2023-12-15T22:39:50.585 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T22:39:50.586 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} --verbose --owner scheduled_smanjara@teuthology --name smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi --archive /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342 -- /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/orig.config.yaml 2023-12-15T22:39:50.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:39:50.691 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342 branch: wip-shilpa-test-wo-sync-policy description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} email: smanjara@redhat.com first_in_suite: false job_id: '7493342' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-shilpa-test-wo-sync-policy ceph: conf: client: debug rgw: 20 debug rgw sync: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw data sync poll interval: 5 rgw md log max shards: 4 rgw meta sync poll interval: 5 rgw sync data inject err probability: 0.1 rgw sync log trim interval: 0 rgw sync meta inject err probability: 0.1 rgw sync obj etag verify: true setgroup: ceph setuser: ceph client.0: rgw data notify interval msec: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 rocksdb delete range threshold: 0 osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - enabled_features: - resharding endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 rgw-multisite-tests: args: - tests.py workunit: branch: wip-shilpa-test-wo-sync-policy sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 owner: scheduled_smanjara@teuthology priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c1.mgr.x - c1.osd.3 - c1.osd.4 - c1.osd.5 - c1.client.1 - - c2.mon.a - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - - c2.mgr.x - c2.osd.3 - c2.osd.4 - c2.osd.5 - c2.client.1 sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 sleep_before_teardown: 0 suite: rgw:multisite suite_branch: wip-shilpa-test-wo-sync-policy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 targets: smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTkSOV80tJk85dkV8F5PRsO6fi64MovGnV7hV3dDBO4DaKTO97r0g9H9hvqss8awoXMTdhDInHUZ7dnzFDH68g= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXg1PuUOpLyPc+kU9XLJlFkTsEj5Zhzl2NxipOMVIhhYH5Epow/wtZAh5ghI6PVAo+qb+3MZTv9QWu6gJWLuEI= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzekXi9h3/MUFBU2UQZ7W94HhOodc/o+NbksKUAvvdCscx2OIzXTPDVq26QcSiz7Kug++81lhm9RHqFHhSx8r0= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLkkrrjNNiylYVct9T7DdexgtF0FBcoy72e6vlrR88zR4RNLA2bKY4BfIJB9kgkPtZFLtQ90ihqWgfs1+Sckyg= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-15_22:32:14 tube: smithi user: smanjara verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-15T22:39:50.691 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa; will attempt to use it 2023-12-15T22:39:50.692 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks 2023-12-15T22:39:50.692 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-15T22:39:50.694 INFO:teuthology.task.internal:Checking packages... 2023-12-15T22:39:50.716 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9' 2023-12-15T22:39:50.716 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-15T22:39:50.716 INFO:teuthology.packaging:ref: None 2023-12-15T22:39:50.716 INFO:teuthology.packaging:tag: None 2023-12-15T22:39:50.716 INFO:teuthology.packaging:branch: wip-shilpa-test-wo-sync-policy 2023-12-15T22:39:50.716 INFO:teuthology.packaging:sha1: e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:39:50.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-shilpa-test-wo-sync-policy 2023-12-15T22:39:50.887 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-202.ge787ab71 2023-12-15T22:39:50.889 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-15T22:39:50.895 INFO:teuthology.task.internal:no buildpackages task found 2023-12-15T22:39:50.895 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-15T22:39:50.902 INFO:teuthology.task.internal:Saving configuration 2023-12-15T22:39:50.915 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-15T22:39:50.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-15T22:39:50.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.995171', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTkSOV80tJk85dkV8F5PRsO6fi64MovGnV7hV3dDBO4DaKTO97r0g9H9hvqss8awoXMTdhDInHUZ7dnzFDH68g='} 2023-12-15T22:39:50.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.993096', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXg1PuUOpLyPc+kU9XLJlFkTsEj5Zhzl2NxipOMVIhhYH5Epow/wtZAh5ghI6PVAo+qb+3MZTv9QWu6gJWLuEI='} 2023-12-15T22:39:50.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.996359', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzekXi9h3/MUFBU2UQZ7W94HhOodc/o+NbksKUAvvdCscx2OIzXTPDVq26QcSiz7Kug++81lhm9RHqFHhSx8r0='} 2023-12-15T22:39:51.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.997522', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLkkrrjNNiylYVct9T7DdexgtF0FBcoy72e6vlrR88zR4RNLA2bKY4BfIJB9kgkPtZFLtQ90ihqWgfs1+Sckyg='} 2023-12-15T22:39:51.003 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-15T22:39:51.010 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2023-12-15T22:39:51.010 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'] 2023-12-15T22:39:51.010 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'] 2023-12-15T22:39:51.010 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1'] 2023-12-15T22:39:51.010 INFO:teuthology.run_tasks:Running task console_log... 2023-12-15T22:39:51.120 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7058a87e50>, signals=[15]) 2023-12-15T22:39:51.121 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-15T22:39:51.128 INFO:teuthology.task.internal:Opening connections... 2023-12-15T22:39:51.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:39:51.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:39:51.216 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:39:51.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:39:51.298 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:39:51.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:39:51.383 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:39:51.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:39:51.464 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-15T22:39:51.470 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-12-15T22:39:51.488 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-12-15T22:39:51.488 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:39:51.546 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:39:51.547 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:39:51.547 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-15T22:39:51.569 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-12-15T22:39:51.587 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-12-15T22:39:51.587 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-12-15T22:39:51.644 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-12-15T22:39:51.644 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-12-15T22:39:51.644 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-12-15T22:39:51.644 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:39:51.644 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:39:51.645 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:39:51.645 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-12-15T22:39:51.660 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-12-15T22:39:51.678 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-12-15T22:39:51.678 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:39:51.733 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:39:51.734 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:39:51.734 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-12-15T22:39:51.752 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-12-15T22:39:51.770 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-12-15T22:39:51.770 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:39:51.827 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:39:51.828 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:39:51.828 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-12-15T22:39:51.844 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-15T22:39:51.853 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-15T22:39:51.860 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-15T22:39:51.860 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-12-15T22:39:51.863 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-12-15T22:39:51.865 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2023-12-15T22:39:51.867 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-12-15T22:39:51.884 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-15T22:39:51.892 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-15T22:39:51.892 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-12-15T22:39:51.920 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-12-15T22:39:51.922 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2023-12-15T22:39:51.925 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-12-15T22:39:52.036 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-15T22:39:52.120 INFO:teuthology.run_tasks:Running task kernel... 2023-12-15T22:39:52.134 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-15T22:39:52.134 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-15T22:39:52.134 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-15T22:39:52.135 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-15T22:39:52.135 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-15T22:39:52.135 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-15T22:39:52.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:39:52.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:39:52.153 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-12-15T22:39:52.153 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-12-15T22:39:52.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:39:52.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:39:52.155 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-12-15T22:39:52.155 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-12-15T22:39:52.210 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-361.el9.x86_64 2023-12-15T22:39:52.210 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.14.0-361.el9.x86_64 2023-12-15T22:39:52.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2023-12-15T22:39:52.212 INFO:teuthology.orchestra.run.smithi093.stdout:5.14.0-361.el9.x86_64 2023-12-15T22:39:52.212 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-361.el9.x86_64 2023-12-15T22:39:52.212 INFO:teuthology.task.kernel:Running kernel on smithi093: 5.14.0-361.el9.x86_64 2023-12-15T22:39:52.212 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum install -y kernel 2023-12-15T22:39:52.213 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-361.el9.x86_64 2023-12-15T22:39:52.213 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2023-12-15T22:39:52.214 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-361.el9.x86_64 2023-12-15T22:39:52.214 INFO:teuthology.task.kernel:Running kernel on smithi183: 5.14.0-361.el9.x86_64 2023-12-15T22:39:52.214 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2023-12-15T22:39:54.216 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-15T22:39:54.247 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-15T22:39:54.317 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-15T22:39:54.420 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-15T22:39:55.753 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-15T22:39:55.841 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-12-15T22:39:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-12-15T22:39:55.933 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-12-15T22:39:56.728 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-15T22:39:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-15T22:39:57.416 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 7.9 MB 00:01 2023-12-15T22:39:58.231 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 7.9 MB 00:02 2023-12-15T22:39:58.887 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-12-15T22:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 18 MB 00:02 2023-12-15T22:40:00.875 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 18 MB 00:02 2023-12-15T22:40:00.941 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-15T22:40:03.121 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 5.8 MB 00:00 2023-12-15T22:40:04.056 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-15T22:40:04.621 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-15T22:40:04.701 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.8 MB 00:00 2023-12-15T22:40:05.482 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 15 kB 00:00 2023-12-15T22:40:05.618 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-15T22:40:05.692 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2023-12-15T22:40:06.168 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2023-12-15T22:40:07.342 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-15T22:40:07.351 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-12-15T22:40:08.097 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-15T22:40:09.579 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 20 MB 00:02 2023-12-15T22:40:10.380 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-15T22:40:12.067 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2023-12-15T22:40:12.546 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-15T22:40:12.546 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-15T22:40:12.634 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:40:12.645 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:40:12.645 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2023-12-15T22:40:12.645 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout:Install 4 Packages 2023-12-15T22:40:12.646 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:40:12.647 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 96 M 2023-12-15T22:40:12.647 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 121 M 2023-12-15T22:40:12.647 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:40:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-15T22:40:14.032 INFO:teuthology.orchestra.run.smithi188.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 5.0 MB/s | 5.6 MB 00:01 2023-12-15T22:40:14.182 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-15T22:40:14.182 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-15T22:40:14.251 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-12-15T22:40:14.278 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout:Install 4 Packages 2023-12-15T22:40:14.290 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:40:14.291 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 96 M 2023-12-15T22:40:14.291 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 121 M 2023-12-15T22:40:14.291 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:40:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 19 MB/s | 5.6 MB 00:00 2023-12-15T22:40:14.673 INFO:teuthology.orchestra.run.smithi188.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 12 MB/s | 20 MB 00:01 2023-12-15T22:40:14.960 INFO:teuthology.orchestra.run.smithi093.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 35 MB/s | 20 MB 00:00 2023-12-15T22:40:15.076 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-15T22:40:15.076 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-15T22:40:15.162 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:40:15.167 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2023-12-15T22:40:15.168 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:40:15.168 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 96 M 2023-12-15T22:40:15.168 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 121 M 2023-12-15T22:40:15.168 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:40:15.444 INFO:teuthology.orchestra.run.smithi093.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 35 MB/s | 38 MB 00:01 2023-12-15T22:40:15.448 INFO:teuthology.orchestra.run.smithi188.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 15 MB/s | 38 MB 00:02 2023-12-15T22:40:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 21 MB/s | 5.6 MB 00:00 2023-12-15T22:40:15.782 INFO:teuthology.orchestra.run.smithi188.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 19 MB/s | 32 MB 00:01 2023-12-15T22:40:15.785 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:40:15.786 INFO:teuthology.orchestra.run.smithi188.stdout:Total 31 MB/s | 96 MB 00:03 2023-12-15T22:40:15.819 INFO:teuthology.orchestra.run.smithi093.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 28 MB/s | 32 MB 00:01 2023-12-15T22:40:15.819 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:40:15.819 INFO:teuthology.orchestra.run.smithi093.stdout:Total 63 MB/s | 96 MB 00:01 2023-12-15T22:40:15.879 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 34 MB/s | 20 MB 00:00 2023-12-15T22:40:16.341 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-15T22:40:16.341 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-15T22:40:16.429 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 33 MB/s | 38 MB 00:01 2023-12-15T22:40:16.433 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:40:16.443 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:40:16.443 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2023-12-15T22:40:16.443 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:40:16.443 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:40:16.443 INFO:teuthology.orchestra.run.smithi183.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout:Install 4 Packages 2023-12-15T22:40:16.444 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:40:16.445 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 96 M 2023-12-15T22:40:16.445 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 121 M 2023-12-15T22:40:16.445 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:40:16.644 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:40:16.670 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:40:16.729 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 27 MB/s | 32 MB 00:01 2023-12-15T22:40:16.730 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:40:16.730 INFO:teuthology.orchestra.run.smithi192.stdout:Total 62 MB/s | 96 MB 00:01 2023-12-15T22:40:17.016 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:40:17.017 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:40:17.031 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:40:17.031 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:40:17.527 INFO:teuthology.orchestra.run.smithi183.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 7.0 MB/s | 5.6 MB 00:00 2023-12-15T22:40:17.585 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:40:17.894 INFO:teuthology.orchestra.run.smithi183.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 17 MB/s | 20 MB 00:01 2023-12-15T22:40:17.942 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:40:17.942 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:40:18.338 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:40:18.338 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:40:18.352 INFO:teuthology.orchestra.run.smithi183.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 23 MB/s | 38 MB 00:01 2023-12-15T22:40:18.353 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:40:18.354 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:40:19.251 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:40:19.251 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:40:19.369 INFO:teuthology.orchestra.run.smithi183.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 18 MB/s | 32 MB 00:01 2023-12-15T22:40:19.370 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:40:19.370 INFO:teuthology.orchestra.run.smithi183.stdout:Total 33 MB/s | 96 MB 00:02 2023-12-15T22:40:20.228 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:40:20.579 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:40:20.580 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:40:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:40:21.226 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:40:21.877 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:40:21.882 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:40:21.882 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:40:21.950 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:40:22.001 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:22.082 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:22.167 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:40:22.817 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:40:22.940 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:24.502 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:40:24.724 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:24.823 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:24.910 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:25.012 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:25.127 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:40:25.244 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:25.653 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:25.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:28.018 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:40:28.279 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:29.477 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:29.632 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:29.726 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:30.448 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:30.567 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:32.868 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:40:32.988 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:34.364 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:34.474 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:35.163 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:40:37.604 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.258 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.301 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.396 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.438 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.677 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.678 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:41:03.678 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:41:03.678 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:41:03.901 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:03.901 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:41:03.901 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:41:03.901 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.143 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.144 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.144 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:41:04.144 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:41:04.169 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:04.211 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:04.318 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:41:04.319 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:41:04.590 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:04.590 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:41:04.590 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:41:04.590 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:41:04.651 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:04.796 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.797 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.797 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.797 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-15T22:41:04.797 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-15T22:41:04.797 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2023-12-15T22:41:04.797 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi093.front.sepia.ceph.com, path=None, version=distro) 2023-12-15T22:41:04.797 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:04.807 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:04.914 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.915 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.915 DEBUG:teuthology.orchestra.run.smithi093:> sudo rpm -qi grub2-tools 2023-12-15T22:41:04.949 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:04.949 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.949 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.950 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-15T22:41:04.950 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-15T22:41:04.950 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2023-12-15T22:41:04.950 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2023-12-15T22:41:04.950 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:04.950 INFO:teuthology.orchestra.run.smithi093.stdout:Name : grub2-tools 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Epoch : 1 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Version : 2.06 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Release : 68.el9 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Architecture: x86_64 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Group : Unspecified 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Size : 8264254 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:License : GPLv3+ 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Packager : builder@centos.org 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Vendor : CentOS 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-15T22:41:04.951 INFO:teuthology.orchestra.run.smithi093.stdout:Summary : Support tools for GRUB. 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:Description : 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:hardware devices. 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:41:04.952 INFO:teuthology.orchestra.run.smithi093.stdout:This subpackage provides tools for support of all platforms. 2023-12-15T22:41:04.953 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-15T22:41:04.953 INFO:teuthology.task.kernel:Updating grub on smithi093 to boot 5.14.0-391.el9.x86_64 2023-12-15T22:41:04.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-15T22:41:05.001 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:05.001 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:41:05.001 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:41:05.001 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.002 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.002 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.002 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.002 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:41:05.002 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:41:05.068 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.068 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2023-12-15T22:41:05.102 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2023-12-15T22:41:05.102 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2023-12-15T22:41:05.102 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 68.el9 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8264254 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-15T22:41:05.103 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:41:05.104 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2023-12-15T22:41:05.105 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-15T22:41:05.105 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.105 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-15T22:41:05.512 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:05.555 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-12-15T22:41:05.652 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.652 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.652 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.652 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-15T22:41:05.652 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-15T22:41:05.652 INFO:teuthology.task.kernel:Installing distro kernel on c2.mgr.x... 2023-12-15T22:41:05.652 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2023-12-15T22:41:05.652 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:05.704 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2023-12-15T22:41:05.770 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:05.770 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2023-12-15T22:41:05.803 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2023-12-15T22:41:05.803 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2023-12-15T22:41:05.803 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2023-12-15T22:41:05.803 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 68.el9 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8264254 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2023-12-15T22:41:05.804 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:41:05.805 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2023-12-15T22:41:05.806 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-15T22:41:05.806 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-391.el9.x86_64 2023-12-15T22:41:05.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-15T22:41:06.323 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:06.366 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-12-15T22:41:06.791 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:06.791 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-15T22:41:06.791 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-15T22:41:06.791 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-15T22:41:06.985 INFO:teuthology.orchestra.run.smithi093.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-15T22:41:07.001 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-12-15T22:41:07.003 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-12-15T22:41:07.018 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.FG4xBq2wlo 2023-12-15T22:41:07.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FG4xBq2wlo 2023-12-15T22:41:07.031 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-15T22:41:07.070 INFO:teuthology.orchestra.run.smithi188.stderr:done 2023-12-15T22:41:07.072 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-12-15T22:41:07.087 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.P8L6t4iKQe 2023-12-15T22:41:07.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.P8L6t4iKQe 2023-12-15T22:41:07.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.FG4xBq2wlo 2023-12-15T22:41:07.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.P8L6t4iKQe 2023-12-15T22:41:07.235 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.FG4xBq2wlo is 6KB 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:41:07.248 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:41:07.255 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.FG4xBq2wlo 2023-12-15T22:41:07.269 DEBUG:teuthology.orchestra.run.smithi093:> sudo /bin/ls /boot/loader/entries || true 2023-12-15T22:41:07.292 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.P8L6t4iKQe is 6KB 2023-12-15T22:41:07.334 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-15T22:41:07.334 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-15T22:41:07.334 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-15T22:41:07.334 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-15T22:41:07.336 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.340 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.P8L6t4iKQe 2023-12-15T22:41:07.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2023-12-15T22:41:07.418 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-15T22:41:07.418 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-15T22:41:07.419 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-15T22:41:07.419 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-15T22:41:07.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo shutdown -r now 2023-12-15T22:41:07.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2023-12-15T22:41:07.737 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:07.870 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-15T22:41:07.881 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:07.881 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:07.881 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-15T22:41:07.882 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-15T22:41:07.882 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-15T22:41:07.882 INFO:teuthology.task.kernel:Installing distro kernel on c1.mgr.x... 2023-12-15T22:41:07.882 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2023-12-15T22:41:07.882 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-12-15T22:41:07.884 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-12-15T22:41:07.886 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-12-15T22:41:07.902 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.z00S7MZuCX 2023-12-15T22:41:07.902 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.z00S7MZuCX 2023-12-15T22:41:07.970 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.z00S7MZuCX 2023-12-15T22:41:08.000 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-15T22:41:08.000 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-15T22:41:08.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2023-12-15T22:41:08.034 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2023-12-15T22:41:08.034 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 68.el9 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8264254 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2023-12-15T22:41:08.035 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:41:08.036 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2023-12-15T22:41:08.037 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-15T22:41:08.038 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 5.14.0-391.el9.x86_64 2023-12-15T22:41:08.038 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-15T22:41:08.108 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.z00S7MZuCX is 6KB 2023-12-15T22:41:08.156 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.z00S7MZuCX 2023-12-15T22:41:08.170 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2023-12-15T22:41:08.235 INFO:teuthology.orchestra.run.smithi192.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-15T22:41:08.235 INFO:teuthology.orchestra.run.smithi192.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-15T22:41:08.235 INFO:teuthology.orchestra.run.smithi192.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-15T22:41:08.235 INFO:teuthology.orchestra.run.smithi192.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-15T22:41:08.236 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-15T22:41:08.373 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-12-15T22:41:08.674 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-12-15T22:41:10.143 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-15T22:41:10.175 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-12-15T22:41:10.177 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-12-15T22:41:10.192 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.XYcPBotYzH 2023-12-15T22:41:10.192 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XYcPBotYzH 2023-12-15T22:41:10.263 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.XYcPBotYzH 2023-12-15T22:41:10.410 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.XYcPBotYzH is 6KB 2023-12-15T22:41:10.459 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.XYcPBotYzH 2023-12-15T22:41:10.473 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2023-12-15T22:41:10.538 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-15T22:41:10.538 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-15T22:41:10.538 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-15T22:41:10.538 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-15T22:41:10.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-15T22:41:10.684 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2023-12-15T22:41:37.511 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2023-12-15T22:41:37.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-15T22:41:37.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:41:37.577 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2023-12-15T22:41:37.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-15T22:41:37.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:41:38.376 INFO:teuthology.task.kernel:Checking client c2.mgr.x for new kernel version... 2023-12-15T22:41:38.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:41:38.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:41:40.690 INFO:teuthology.task.kernel:Checking client c1.mgr.x for new kernel version... 2023-12-15T22:41:40.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-15T22:41:40.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:41:56.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-12-15T22:42:05.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:42:05.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:42:08.817 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-12-15T22:42:20.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:42:20.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:42:37.529 DEBUG:teuthology.orchestra.remote:timed out 2023-12-15T22:42:37.580 DEBUG:teuthology.orchestra.remote:timed out 2023-12-15T22:42:40.696 DEBUG:teuthology.orchestra.remote:timed out 2023-12-15T22:42:46.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-15T22:42:46.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:42:46.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-15T22:42:46.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:42:46.873 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-12-15T22:42:47.021 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-15T22:42:47.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-15T22:42:47.319 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-15T22:42:47.320 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-12-15T22:42:47.334 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-391.el9.x86_64 2023-12-15T22:42:47.334 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-15T22:42:47.334 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-15T22:42:47.334 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-15T22:42:47.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-15T22:42:47.440 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-15T22:42:47.440 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-12-15T22:42:47.454 INFO:teuthology.orchestra.run.smithi093.stdout:5.14.0-391.el9.x86_64 2023-12-15T22:42:47.454 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-15T22:42:47.454 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-15T22:42:47.454 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-15T22:42:48.335 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2023-12-15T22:42:48.335 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2023-12-15T22:42:48.431 DEBUG:teuthology.parallel:result is None 2023-12-15T22:42:48.455 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2023-12-15T22:42:48.455 DEBUG:teuthology.orchestra.run.smithi093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-15T22:42:48.536 INFO:teuthology.orchestra.run.smithi093.stdout:ttyS1 2023-12-15T22:42:48.567 DEBUG:teuthology.parallel:result is None 2023-12-15T22:42:49.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-15T22:42:49.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:42:50.049 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-12-15T22:42:50.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-15T22:42:50.456 INFO:teuthology.task.kernel:Checking kernel version of c1.mgr.x, want "5.14.0-391.el9.x86_64"... 2023-12-15T22:42:50.456 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-12-15T22:42:50.470 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-391.el9.x86_64 2023-12-15T22:42:50.470 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-15T22:42:50.470 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-15T22:42:50.470 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-15T22:42:51.471 INFO:teuthology.task.kernel:Enabling kdb on c1.mgr.x... 2023-12-15T22:42:51.471 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-15T22:42:51.560 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2023-12-15T22:42:51.599 DEBUG:teuthology.parallel:result is None 2023-12-15T22:42:52.846 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-12-15T22:42:53.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:42:53.216 INFO:teuthology.task.kernel:Checking kernel version of c2.mgr.x, want "5.14.0-391.el9.x86_64"... 2023-12-15T22:42:53.217 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-12-15T22:42:53.230 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-391.el9.x86_64 2023-12-15T22:42:53.231 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-15T22:42:53.231 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-15T22:42:53.231 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-15T22:42:54.232 INFO:teuthology.task.kernel:Enabling kdb on c2.mgr.x... 2023-12-15T22:42:54.232 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-15T22:42:54.300 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2023-12-15T22:42:54.336 DEBUG:teuthology.parallel:result is None 2023-12-15T22:42:54.336 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-15T22:42:54.346 INFO:teuthology.task.internal:Creating test directory... 2023-12-15T22:42:54.346 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-15T22:42:54.349 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-15T22:42:54.353 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-15T22:42:54.356 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-15T22:42:54.371 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-15T22:42:54.379 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-15T22:42:54.388 INFO:teuthology.task.internal:Creating archive directory... 2023-12-15T22:42:54.388 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-15T22:42:54.405 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-15T22:42:54.409 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-15T22:42:54.412 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-15T22:42:54.468 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-15T22:42:54.477 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-15T22:42:54.477 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-15T22:42:54.479 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-15T22:42:54.482 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-15T22:42:54.484 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-15T22:42:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.511 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.517 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.523 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.530 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.681 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.700 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-15T22:42:54.703 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-15T22:42:54.711 INFO:teuthology.task.internal:Configuring sudo... 2023-12-15T22:42:54.712 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-15T22:42:54.714 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-15T22:42:54.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-15T22:42:54.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-15T22:42:54.760 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-15T22:42:54.774 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-15T22:42:54.774 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-15T22:42:54.781 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-15T22:42:54.784 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-15T22:42:54.786 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-15T22:42:54.804 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:54.873 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:54.936 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:54.978 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.020 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:42:55.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-15T22:42:55.086 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.137 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.200 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.309 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:42:55.309 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-15T22:42:55.339 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.433 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.558 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:42:55.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-15T22:42:55.624 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-15T22:42:55.735 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.788 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-15T22:42:55.847 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:42:55.847 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-15T22:42:55.888 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-12-15T22:42:55.890 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-12-15T22:42:55.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2023-12-15T22:42:55.895 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-12-15T22:42:55.940 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-15T22:42:55.943 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-15T22:42:55.950 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-15T22:42:55.989 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-15T22:42:56.443 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-15T22:42:56.452 INFO:teuthology.task.internal:Starting timer... 2023-12-15T22:42:56.452 INFO:teuthology.run_tasks:Running task pcp... 2023-12-15T22:42:56.468 INFO:teuthology.run_tasks:Running task selinux... 2023-12-15T22:42:56.484 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2023-12-15T22:42:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: 2023-12-15T22:42:56.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-12-15T22:42:56.609 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2023-12-15T22:42:56.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2023-12-15T22:42:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2023-12-15T22:42:56.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2023-12-15T22:42:56.768 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2023-12-15T22:42:56.770 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-15T22:42:56.770 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2023-12-15T22:42:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2023-12-15T22:42:56.793 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-12-15T22:42:56.818 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-12-15T22:42:56.819 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2023-12-15T22:42:56.842 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2023-12-15T22:42:56.842 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2023-12-15T22:42:56.904 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2023-12-15T22:42:56.904 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2023-12-15T22:42:56.904 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-15T22:42:56.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:42:56.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-15T22:42:56.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:42:56.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-15T22:42:56.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:42:56.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-15T22:42:57.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T22:42:57.016 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-15T22:42:57.016 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2023-12-15T22:42:57.053 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-12-15T22:42:57.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2023-12-15T22:42:57.118 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2023-12-15T22:42:57.148 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-15T22:42:57.158 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-15T22:42:57.158 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-15T22:42:57.174 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-15T22:42:57.176 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi093.front.sepia.ceph.com,smithi183.front.sepia.ceph.com,smithi188.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-15T22:49:13.144 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-12-15T22:49:13.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-15T22:49:13.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:49:13.231 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-15T22:49:13.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-15T22:49:13.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-15T22:49:13.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:49:13.382 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-12-15T22:49:13.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-15T22:49:13.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-15T22:49:13.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:49:13.539 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-12-15T22:49:13.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-15T22:49:13.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:49:13.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:49:13.693 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-12-15T22:49:13.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-12-15T22:49:13.761 INFO:teuthology.run_tasks:Running task clock... 2023-12-15T22:49:13.773 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-15T22:49:13.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-15T22:49:13.774 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-15T22:49:13.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-15T22:49:13.778 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-15T22:49:13.781 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-15T22:49:13.781 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-15T22:49:13.783 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-15T22:49:13.783 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-15T22:49:13.808 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-15T22:49:13.809 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-15T22:49:13.817 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-15T22:49:13.825 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-15T22:49:13.827 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-15T22:49:13.831 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-15T22:49:13.835 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-15T22:49:13.848 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-15T22:49:13.854 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-12-15T22:49:13.858 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2023-12-15T22:49:13.866 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2023-12-15T22:49:13.868 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-12-15T22:49:13.872 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2023-12-15T22:49:13.877 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2023-12-15T22:49:13.880 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2023-12-15T22:49:13.885 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-15T22:49:13.889 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-15T22:49:13.890 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2023-12-15T22:49:13.898 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-15T22:49:13.901 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-15T22:49:13.906 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-15T22:49:13.906 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-15T22:49:13.914 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-15T22:49:13.923 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-15T22:49:13.943 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.947 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.948 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 1: ntpq: command not found 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.952 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.956 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2023-12-15T22:49:13.961 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-15T22:49:13.962 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-12-15T22:49:13.962 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.962 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.962 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.962 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.965 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2023-12-15T22:49:13.968 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-15T22:49:13.968 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-12-15T22:49:13.968 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.968 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.969 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.969 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-15T22:49:13.969 INFO:teuthology.run_tasks:Running task install... 2023-12-15T22:49:13.978 DEBUG:teuthology.task.install:project ceph 2023-12-15T22:49:13.978 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}} 2023-12-15T22:49:13.978 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'} 2023-12-15T22:49:13.978 INFO:teuthology.task.install:Using flavor: default 2023-12-15T22:49:13.984 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-15T22:49:13.984 INFO:teuthology.task.install:extra packages: [] 2023-12-15T22:49:13.984 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'tag': None, 'wait_for_package': False} 2023-12-15T22:49:13.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:49:13.986 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'tag': None, 'wait_for_package': False} 2023-12-15T22:49:13.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:49:13.988 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'tag': None, 'wait_for_package': False} 2023-12-15T22:49:13.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:49:13.989 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'tag': None, 'wait_for_package': False} 2023-12-15T22:49:13.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:49:14.142 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/ 2023-12-15T22:49:14.142 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.ge787ab71 2023-12-15T22:49:14.156 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/ 2023-12-15T22:49:14.156 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.ge787ab71 2023-12-15T22:49:14.157 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/ 2023-12-15T22:49:14.157 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.ge787ab71 2023-12-15T22:49:14.217 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/ 2023-12-15T22:49:14.217 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.ge787ab71 2023-12-15T22:49:14.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-15T22:49:14.280 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:49:14.280 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-15T22:49:14.282 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-15T22:49:14.282 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:49:14.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-15T22:49:14.310 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-15T22:49:14.310 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-15T22:49:14.311 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-15T22:49:14.312 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-15T22:49:14.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-15T22:49:14.331 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:49:14.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-15T22:49:14.361 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-15T22:49:14.361 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-15T22:49:14.379 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-15T22:49:14.380 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-15T22:49:14.388 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-test-wo-sync-policy/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-15T22:49:14.388 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:49:14.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-15T22:49:14.416 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-15T22:49:14.416 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-15T22:49:14.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-15T22:49:14.458 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-15T22:49:14.460 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-15T22:49:14.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-15T22:49:14.507 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-15T22:49:14.525 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2023-12-15T22:49:14.530 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-12-15T22:49:14.530 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2023-12-15T22:49:14.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-12-15T22:49:14.567 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-15T22:49:14.574 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2023-12-15T22:49:14.575 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2023-12-15T22:49:14.633 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2023-12-15T22:49:14.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2023-12-15T22:49:14.768 INFO:teuthology.orchestra.run.smithi192.stdout:73 files removed 2023-12-15T22:49:14.777 INFO:teuthology.orchestra.run.smithi183.stdout:73 files removed 2023-12-15T22:49:14.795 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw 2023-12-15T22:49:14.804 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw 2023-12-15T22:49:14.816 INFO:teuthology.orchestra.run.smithi093.stdout:73 files removed 2023-12-15T22:49:14.842 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw 2023-12-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi188.stdout:73 files removed 2023-12-15T22:49:14.900 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw 2023-12-15T22:49:15.535 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 191 kB/s | 78 kB 00:00 2023-12-15T22:49:15.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 198 kB/s | 78 kB 00:00 2023-12-15T22:49:15.590 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 165 kB/s | 78 kB 00:00 2023-12-15T22:49:15.690 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 166 kB/s | 78 kB 00:00 2023-12-15T22:49:16.010 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-12-15T22:49:16.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-15T22:49:16.099 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 21 kB/s | 9.5 kB 00:00 2023-12-15T22:49:16.140 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 24 kB/s | 9.5 kB 00:00 2023-12-15T22:49:16.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2023-12-15T22:49:16.436 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-12-15T22:49:16.449 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-12-15T22:49:16.549 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2023-12-15T22:49:16.794 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-15T22:49:16.880 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-15T22:49:16.935 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-15T22:49:17.027 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-15T22:49:18.194 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.0 MB 00:00 2023-12-15T22:49:18.347 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-12-15T22:49:18.352 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-12-15T22:49:18.394 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2023-12-15T22:49:19.077 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-15T22:49:19.611 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 7.9 MB 00:00 2023-12-15T22:49:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-12-15T22:49:20.667 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.9 MB 00:01 2023-12-15T22:49:20.686 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - AppStream 32 MB/s | 18 MB 00:00 2023-12-15T22:49:21.846 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-12-15T22:49:22.128 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-12-15T22:49:24.110 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 18 MB 00:02 2023-12-15T22:49:24.512 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.8 MB 00:00 2023-12-15T22:49:26.021 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 15 kB 00:00 2023-12-15T22:49:26.550 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.8 MB 00:01 2023-12-15T22:49:26.804 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 5.8 MB 00:01 2023-12-15T22:49:27.918 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-15T22:49:28.221 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2023-12-15T22:49:28.240 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-12-15T22:49:30.037 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 15 kB 00:00 2023-12-15T22:49:30.109 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-15T22:49:31.066 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 20 MB 00:02 2023-12-15T22:49:31.613 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-15T22:49:34.559 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 20 MB 00:08 2023-12-15T22:49:34.723 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2023-12-15T22:49:35.816 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-15T22:49:36.211 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-15T22:49:37.185 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 8.6 M 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.3 M 2023-12-15T22:49:37.208 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.0.0-202.ge787ab71.el9 ceph 5.2 M 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 19 M 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.0.0-202.ge787ab71.el9 ceph 24 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 719 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-15T22:49:37.209 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 476 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.8 M 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 45 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 130 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.0.0-202.ge787ab71.el9 ceph 162 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.0.0-202.ge787ab71.el9 ceph 320 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 298 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 99 k 2023-12-15T22:49:37.210 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout:Install 27 Packages 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 2 Packages 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:49:37.211 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 55 M 2023-12-15T22:49:37.212 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:49:38.008 INFO:teuthology.orchestra.run.smithi192.stdout:(1/29): ceph-base-19.0.0-202.ge787ab71.el9.x86_ 8.1 MB/s | 5.2 MB 00:00 2023-12-15T22:49:38.116 INFO:teuthology.orchestra.run.smithi192.stdout:(2/29): ceph-selinux-19.0.0-202.ge787ab71.el9.x 222 kB/s | 24 kB 00:00 2023-12-15T22:49:38.217 INFO:teuthology.orchestra.run.smithi192.stdout:(3/29): libcephfs2-19.0.0-202.ge787ab71.el9.x86 7.0 MB/s | 719 kB 00:00 2023-12-15T22:49:38.264 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 8.6 M 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.3 M 2023-12-15T22:49:38.268 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.0.0-202.ge787ab71.el9 ceph 5.2 M 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 19 M 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.0.0-202.ge787ab71.el9 ceph 24 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 719 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 476 k 2023-12-15T22:49:38.269 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.8 M 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 45 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 130 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.0.0-202.ge787ab71.el9 ceph 162 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.0.0-202.ge787ab71.el9 ceph 320 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 298 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 99 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:49:38.270 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout:Install 27 Packages 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 55 M 2023-12-15T22:49:38.271 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:49:38.317 INFO:teuthology.orchestra.run.smithi192.stdout:(4/29): libradosstriper1-19.0.0-202.ge787ab71.e 4.6 MB/s | 476 kB 00:00 2023-12-15T22:49:38.655 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:49:38.658 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 8.6 M 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.3 M 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-202.ge787ab71.el9 ceph 5.2 M 2023-12-15T22:49:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 19 M 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-202.ge787ab71.el9 ceph 24 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 719 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 476 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.8 M 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-15T22:49:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 45 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 130 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-202.ge787ab71.el9 ceph 162 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-202.ge787ab71.el9 ceph 320 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 298 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 99 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:49:38.661 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout:Install 27 Packages 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 2 Packages 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 55 M 2023-12-15T22:49:38.662 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:49:38.884 INFO:teuthology.orchestra.run.smithi192.stdout:(5/29): librgw2-19.0.0-202.ge787ab71.el9.x86_64 8.4 MB/s | 4.8 MB 00:00 2023-12-15T22:49:39.017 INFO:teuthology.orchestra.run.smithi192.stdout:(6/29): ceph-radosgw-19.0.0-202.ge787ab71.el9.x 5.2 MB/s | 8.6 MB 00:01 2023-12-15T22:49:39.043 INFO:teuthology.orchestra.run.smithi192.stdout:(7/29): python3-ceph-argparse-19.0.0-202.ge787a 284 kB/s | 45 kB 00:00 2023-12-15T22:49:39.110 INFO:teuthology.orchestra.run.smithi192.stdout:(8/29): python3-ceph-common-19.0.0-202.ge787ab7 1.4 MB/s | 130 kB 00:00 2023-12-15T22:49:39.135 INFO:teuthology.orchestra.run.smithi192.stdout:(9/29): python3-cephfs-19.0.0-202.ge787ab71.el9 1.7 MB/s | 162 kB 00:00 2023-12-15T22:49:39.227 INFO:teuthology.orchestra.run.smithi192.stdout:(10/29): python3-rados-19.0.0-202.ge787ab71.el9 2.7 MB/s | 320 kB 00:00 2023-12-15T22:49:39.397 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-15T22:49:39.402 INFO:teuthology.orchestra.run.smithi192.stdout:(11/29): ceph-common-19.0.0-202.ge787ab71.el9.x 9.4 MB/s | 19 MB 00:02 2023-12-15T22:49:39.428 INFO:teuthology.orchestra.run.smithi192.stdout:(12/29): python3-rgw-19.0.0-202.ge787ab71.el9.x 496 kB/s | 99 kB 00:00 2023-12-15T22:49:39.478 INFO:teuthology.orchestra.run.smithi192.stdout:(13/29): python3-rbd-19.0.0-202.ge787ab71.el9.x 870 kB/s | 298 kB 00:00 2023-12-15T22:49:39.536 INFO:teuthology.orchestra.run.smithi192.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 791 kB/s | 106 kB 00:00 2023-12-15T22:49:39.562 INFO:teuthology.orchestra.run.smithi192.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 755 kB/s | 44 kB 00:00 2023-12-15T22:49:39.595 INFO:teuthology.orchestra.run.smithi192.stdout:(16/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-12-15T22:49:39.654 INFO:teuthology.orchestra.run.smithi192.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2023-12-15T22:49:39.679 INFO:teuthology.orchestra.run.smithi192.stdout:(18/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 282 kB 00:00 2023-12-15T22:49:39.683 INFO:teuthology.orchestra.run.smithi183.stdout:(1/29): ceph-base-19.0.0-202.ge787ab71.el9.x86_ 3.8 MB/s | 5.2 MB 00:01 2023-12-15T22:49:39.704 INFO:teuthology.orchestra.run.smithi192.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 379 kB/s | 41 kB 00:00 2023-12-15T22:49:39.742 INFO:teuthology.orchestra.run.smithi183.stdout:(2/29): ceph-selinux-19.0.0-202.ge787ab71.el9.x 412 kB/s | 24 kB 00:00 2023-12-15T22:49:39.900 INFO:teuthology.orchestra.run.smithi183.stdout:(3/29): libcephfs2-19.0.0-202.ge787ab71.el9.x86 4.4 MB/s | 719 kB 00:00 2023-12-15T22:49:39.946 INFO:teuthology.orchestra.run.smithi192.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 107 kB/s | 26 kB 00:00 2023-12-15T22:49:40.000 INFO:teuthology.orchestra.run.smithi183.stdout:(4/29): libradosstriper1-19.0.0-202.ge787ab71.e 4.6 MB/s | 476 kB 00:00 2023-12-15T22:49:40.030 INFO:teuthology.orchestra.run.smithi192.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 824 kB/s | 309 kB 00:00 2023-12-15T22:49:40.055 INFO:teuthology.orchestra.run.smithi192.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2023-12-15T22:49:40.089 INFO:teuthology.orchestra.run.smithi192.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-12-15T22:49:40.206 INFO:teuthology.orchestra.run.smithi192.stdout:(24/29): libarrow-9.0.0-10.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2023-12-15T22:49:40.231 INFO:teuthology.orchestra.run.smithi192.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-12-15T22:49:40.296 INFO:teuthology.orchestra.run.smithi192.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2023-12-15T22:49:40.321 INFO:teuthology.orchestra.run.smithi192.stdout:(27/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2023-12-15T22:49:40.793 INFO:teuthology.orchestra.run.smithi183.stdout:(5/29): ceph-radosgw-19.0.0-202.ge787ab71.el9.x 3.5 MB/s | 8.6 MB 00:02 2023-12-15T22:49:40.851 INFO:teuthology.orchestra.run.smithi183.stdout:(6/29): librgw2-19.0.0-202.ge787ab71.el9.x86_64 5.6 MB/s | 4.8 MB 00:00 2023-12-15T22:49:40.876 INFO:teuthology.orchestra.run.smithi183.stdout:(7/29): python3-ceph-argparse-19.0.0-202.ge787a 539 kB/s | 45 kB 00:00 2023-12-15T22:49:41.068 INFO:teuthology.orchestra.run.smithi183.stdout:(8/29): ceph-common-19.0.0-202.ge787ab71.el9.x8 7.0 MB/s | 19 MB 00:02 2023-12-15T22:49:41.093 INFO:teuthology.orchestra.run.smithi183.stdout:(9/29): python3-ceph-common-19.0.0-202.ge787ab7 536 kB/s | 130 kB 00:00 2023-12-15T22:49:41.118 INFO:teuthology.orchestra.run.smithi183.stdout:(10/29): python3-cephfs-19.0.0-202.ge787ab71.el 669 kB/s | 162 kB 00:00 2023-12-15T22:49:41.144 INFO:teuthology.orchestra.run.smithi183.stdout:(11/29): python3-rados-19.0.0-202.ge787ab71.el9 4.2 MB/s | 320 kB 00:00 2023-12-15T22:49:41.169 INFO:teuthology.orchestra.run.smithi183.stdout:(12/29): python3-rbd-19.0.0-202.ge787ab71.el9.x 3.9 MB/s | 298 kB 00:00 2023-12-15T22:49:41.211 INFO:teuthology.orchestra.run.smithi183.stdout:(13/29): python3-rgw-19.0.0-202.ge787ab71.el9.x 1.1 MB/s | 99 kB 00:00 2023-12-15T22:49:41.270 INFO:teuthology.orchestra.run.smithi183.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 843 kB/s | 106 kB 00:00 2023-12-15T22:49:41.286 INFO:teuthology.orchestra.run.smithi183.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 875 kB/s | 44 kB 00:00 2023-12-15T22:49:41.320 INFO:teuthology.orchestra.run.smithi183.stdout:(16/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2023-12-15T22:49:41.387 INFO:teuthology.orchestra.run.smithi188.stdout:(1/29): ceph-base-19.0.0-202.ge787ab71.el9.x86_ 2.0 MB/s | 5.2 MB 00:02 2023-12-15T22:49:41.387 INFO:teuthology.orchestra.run.smithi183.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2023-12-15T22:49:41.412 INFO:teuthology.orchestra.run.smithi183.stdout:(18/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2023-12-15T22:49:41.429 INFO:teuthology.orchestra.run.smithi183.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 379 kB/s | 41 kB 00:00 2023-12-15T22:49:41.429 INFO:teuthology.orchestra.run.smithi192.stdout:(28/29): librados2-19.0.0-202.ge787ab71.el9.x86 2.8 MB/s | 3.3 MB 00:01 2023-12-15T22:49:41.445 INFO:teuthology.orchestra.run.smithi188.stdout:(2/29): ceph-selinux-19.0.0-202.ge787ab71.el9.x 413 kB/s | 24 kB 00:00 2023-12-15T22:49:41.530 INFO:teuthology.orchestra.run.smithi192.stdout:(29/29): librbd1-19.0.0-202.ge787ab71.el9.x86_6 2.4 MB/s | 3.0 MB 00:01 2023-12-15T22:49:41.536 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:49:41.536 INFO:teuthology.orchestra.run.smithi192.stdout:Total 13 MB/s | 55 MB 00:04 2023-12-15T22:49:41.536 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:49:41.545 INFO:teuthology.orchestra.run.smithi188.stdout:(3/29): ceph-radosgw-19.0.0-202.ge787ab71.el9.x 3.1 MB/s | 8.6 MB 00:02 2023-12-15T22:49:41.567 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:49:41.567 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:49:41.621 INFO:teuthology.orchestra.run.smithi188.stdout:(4/29): libradosstriper1-19.0.0-202.ge787ab71.e 6.2 MB/s | 476 kB 00:00 2023-12-15T22:49:41.721 INFO:teuthology.orchestra.run.smithi188.stdout:(5/29): libcephfs2-19.0.0-202.ge787ab71.el9.x86 2.5 MB/s | 719 kB 00:00 2023-12-15T22:49:41.738 INFO:teuthology.orchestra.run.smithi183.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 84 kB/s | 26 kB 00:00 2023-12-15T22:49:41.788 INFO:teuthology.orchestra.run.smithi188.stdout:(6/29): python3-ceph-argparse-19.0.0-202.ge787a 677 kB/s | 45 kB 00:00 2023-12-15T22:49:41.844 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:49:41.846 INFO:teuthology.orchestra.run.smithi183.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 674 kB/s | 309 kB 00:00 2023-12-15T22:49:41.857 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:49:41.857 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:49:41.857 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 8.6 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.3 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:19.0.0-202.ge787ab71.el9 ceph 5.2 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 19 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:19.0.0-202.ge787ab71.el9 ceph 24 k 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-15T22:49:41.858 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 719 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 476 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.8 M 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-15T22:49:41.859 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 45 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:19.0.0-202.ge787ab71.el9 ceph 130 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:19.0.0-202.ge787ab71.el9 ceph 162 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:19.0.0-202.ge787ab71.el9 ceph 320 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 298 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:19.0.0-202.ge787ab71.el9 ceph 99 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:49:41.860 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:49:41.861 INFO:teuthology.orchestra.run.smithi093.stdout:Install 27 Packages 2023-12-15T22:49:41.861 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 2 Packages 2023-12-15T22:49:41.861 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:49:41.861 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 55 M 2023-12-15T22:49:41.861 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:49:41.864 INFO:teuthology.orchestra.run.smithi188.stdout:(7/29): python3-ceph-common-19.0.0-202.ge787ab7 1.7 MB/s | 130 kB 00:00 2023-12-15T22:49:41.871 INFO:teuthology.orchestra.run.smithi183.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2023-12-15T22:49:41.930 INFO:teuthology.orchestra.run.smithi183.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2023-12-15T22:49:41.972 INFO:teuthology.orchestra.run.smithi188.stdout:(8/29): python3-cephfs-19.0.0-202.ge787ab71.el9 1.5 MB/s | 162 kB 00:00 2023-12-15T22:49:42.022 INFO:teuthology.orchestra.run.smithi183.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-15T22:49:42.027 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:49:42.028 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout:(9/29): librgw2-19.0.0-202.ge787ab71.el9.x86_64 11 MB/s | 4.8 MB 00:00 2023-12-15T22:49:42.112 INFO:teuthology.orchestra.run.smithi183.stdout:(25/29): libarrow-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2023-12-15T22:49:42.114 INFO:teuthology.orchestra.run.smithi188.stdout:(10/29): python3-rados-19.0.0-202.ge787ab71.el9 2.2 MB/s | 320 kB 00:00 2023-12-15T22:49:42.147 INFO:teuthology.orchestra.run.smithi188.stdout:(11/29): python3-rbd-19.0.0-202.ge787ab71.el9.x 3.2 MB/s | 298 kB 00:00 2023-12-15T22:49:42.154 INFO:teuthology.orchestra.run.smithi183.stdout:(26/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2023-12-15T22:49:42.175 INFO:teuthology.orchestra.run.smithi188.stdout:(12/29): python3-rgw-19.0.0-202.ge787ab71.el9.x 1.6 MB/s | 99 kB 00:00 2023-12-15T22:49:42.279 INFO:teuthology.orchestra.run.smithi183.stdout:(27/29): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2023-12-15T22:49:42.284 INFO:teuthology.orchestra.run.smithi188.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 777 kB/s | 106 kB 00:00 2023-12-15T22:49:42.309 INFO:teuthology.orchestra.run.smithi188.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2023-12-15T22:49:42.334 INFO:teuthology.orchestra.run.smithi188.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2023-12-15T22:49:42.393 INFO:teuthology.orchestra.run.smithi188.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2023-12-15T22:49:42.418 INFO:teuthology.orchestra.run.smithi188.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2023-12-15T22:49:42.444 INFO:teuthology.orchestra.run.smithi188.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 825 kB/s | 41 kB 00:00 2023-12-15T22:49:42.594 INFO:teuthology.orchestra.run.smithi188.stdout:(19/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.7 MB/s | 309 kB 00:00 2023-12-15T22:49:42.604 INFO:teuthology.orchestra.run.smithi183.stdout:(28/29): librbd1-19.0.0-202.ge787ab71.el9.x86_6 6.7 MB/s | 3.0 MB 00:00 2023-12-15T22:49:42.636 INFO:teuthology.orchestra.run.smithi188.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2023-12-15T22:49:42.655 INFO:teuthology.orchestra.run.smithi183.stdout:(29/29): librados2-19.0.0-202.ge787ab71.el9.x86 6.1 MB/s | 3.3 MB 00:00 2023-12-15T22:49:42.661 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:49:42.661 INFO:teuthology.orchestra.run.smithi183.stdout:Total 13 MB/s | 55 MB 00:04 2023-12-15T22:49:42.661 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:49:42.692 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:49:42.692 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:49:42.845 INFO:teuthology.orchestra.run.smithi188.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 233 kB/s | 49 kB 00:00 2023-12-15T22:49:42.920 INFO:teuthology.orchestra.run.smithi188.stdout:(22/29): libarrow-9.0.0-10.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2023-12-15T22:49:42.945 INFO:teuthology.orchestra.run.smithi188.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2023-12-15T22:49:42.995 INFO:teuthology.orchestra.run.smithi188.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2023-12-15T22:49:43.021 INFO:teuthology.orchestra.run.smithi188.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-12-15T22:49:43.062 INFO:teuthology.orchestra.run.smithi188.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2023-12-15T22:49:43.156 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:49:43.157 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:49:43.398 INFO:teuthology.orchestra.run.smithi093.stdout:(1/29): ceph-base-19.0.0-202.ge787ab71.el9.x86_ 3.8 MB/s | 5.2 MB 00:01 2023-12-15T22:49:43.402 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:49:43.498 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-15T22:49:43.498 INFO:teuthology.orchestra.run.smithi093.stdout:(2/29): ceph-selinux-19.0.0-202.ge787ab71.el9.x 241 kB/s | 24 kB 00:00 2023-12-15T22:49:43.530 INFO:teuthology.orchestra.run.smithi188.stdout:(27/29): librbd1-19.0.0-202.ge787ab71.el9.x86_6 6.5 MB/s | 3.0 MB 00:00 2023-12-15T22:49:43.535 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-15T22:49:43.586 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-15T22:49:43.632 INFO:teuthology.orchestra.run.smithi093.stdout:(3/29): libcephfs2-19.0.0-202.ge787ab71.el9.x86 5.3 MB/s | 719 kB 00:00 2023-12-15T22:49:43.782 INFO:teuthology.orchestra.run.smithi093.stdout:(4/29): libradosstriper1-19.0.0-202.ge787ab71.e 3.1 MB/s | 476 kB 00:00 2023-12-15T22:49:43.900 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-15T22:49:43.915 INFO:teuthology.orchestra.run.smithi093.stdout:(5/29): ceph-radosgw-19.0.0-202.ge787ab71.el9.x 4.5 MB/s | 8.6 MB 00:01 2023-12-15T22:49:43.951 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:43.980 INFO:teuthology.orchestra.run.smithi188.stdout:(28/29): ceph-common-19.0.0-202.ge787ab71.el9.x 3.6 MB/s | 19 MB 00:05 2023-12-15T22:49:43.999 INFO:teuthology.orchestra.run.smithi093.stdout:(6/29): python3-ceph-argparse-19.0.0-202.ge787a 542 kB/s | 45 kB 00:00 2023-12-15T22:49:44.043 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:44.074 INFO:teuthology.orchestra.run.smithi093.stdout:(7/29): python3-ceph-common-19.0.0-202.ge787ab7 1.7 MB/s | 130 kB 00:00 2023-12-15T22:49:44.128 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:49:44.158 INFO:teuthology.orchestra.run.smithi093.stdout:(8/29): python3-cephfs-19.0.0-202.ge787ab71.el9 1.9 MB/s | 162 kB 00:00 2023-12-15T22:49:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:44.241 INFO:teuthology.orchestra.run.smithi093.stdout:(9/29): python3-rados-19.0.0-202.ge787ab71.el9. 3.8 MB/s | 320 kB 00:00 2023-12-15T22:49:44.246 INFO:teuthology.orchestra.run.smithi188.stdout:(29/29): librados2-19.0.0-202.ge787ab71.el9.x86 2.7 MB/s | 3.3 MB 00:01 2023-12-15T22:49:44.250 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:49:44.251 INFO:teuthology.orchestra.run.smithi188.stdout:Total 9.8 MB/s | 55 MB 00:05 2023-12-15T22:49:44.251 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:49:44.252 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-15T22:49:44.284 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:49:44.284 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:49:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 9/31 2023-12-15T22:49:44.342 INFO:teuthology.orchestra.run.smithi093.stdout:(10/29): librgw2-19.0.0-202.ge787ab71.el9.x86_6 8.5 MB/s | 4.8 MB 00:00 2023-12-15T22:49:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:49:44.367 INFO:teuthology.orchestra.run.smithi093.stdout:(11/29): python3-rbd-19.0.0-202.ge787ab71.el9.x 2.3 MB/s | 298 kB 00:00 2023-12-15T22:49:44.388 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:44.428 INFO:teuthology.orchestra.run.smithi093.stdout:(12/29): python3-rgw-19.0.0-202.ge787ab71.el9.x 1.1 MB/s | 99 kB 00:00 2023-12-15T22:49:44.454 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:44.478 INFO:teuthology.orchestra.run.smithi093.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 952 kB/s | 106 kB 00:00 2023-12-15T22:49:44.504 INFO:teuthology.orchestra.run.smithi093.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-12-15T22:49:44.528 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:49:44.529 INFO:teuthology.orchestra.run.smithi093.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 875 kB/s | 44 kB 00:00 2023-12-15T22:49:44.560 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-15T22:49:44.563 INFO:teuthology.orchestra.run.smithi093.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-15T22:49:44.588 INFO:teuthology.orchestra.run.smithi093.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-15T22:49:44.597 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-15T22:49:44.614 INFO:teuthology.orchestra.run.smithi093.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 829 kB/s | 41 kB 00:00 2023-12-15T22:49:44.621 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-15T22:49:44.637 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-15T22:49:44.651 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-15T22:49:44.669 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-15T22:49:44.698 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-15T22:49:44.700 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-15T22:49:44.730 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-15T22:49:44.742 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:49:44.742 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:49:44.805 INFO:teuthology.orchestra.run.smithi093.stdout:(19/29): ceph-common-19.0.0-202.ge787ab71.el9.x 6.9 MB/s | 19 MB 00:02 2023-12-15T22:49:45.039 INFO:teuthology.orchestra.run.smithi093.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 111 kB/s | 26 kB 00:00 2023-12-15T22:49:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-15T22:49:45.069 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:45.075 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-15T22:49:45.109 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:45.159 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:45.186 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 20/31 2023-12-15T22:49:45.191 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:45.222 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-15T22:49:45.239 INFO:teuthology.orchestra.run.smithi093.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 475 kB/s | 309 kB 00:00 2023-12-15T22:49:45.265 INFO:teuthology.orchestra.run.smithi093.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 216 kB/s | 49 kB 00:00 2023-12-15T22:49:45.276 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:49:45.302 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2023-12-15T22:49:45.363 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:45.385 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-15T22:49:45.419 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 9/31 2023-12-15T22:49:45.440 INFO:teuthology.orchestra.run.smithi093.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-15T22:49:45.485 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:49:45.512 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:45.569 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:45.582 INFO:teuthology.orchestra.run.smithi093.stdout:(25/29): libarrow-9.0.0-10.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2023-12-15T22:49:45.647 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-15T22:49:45.675 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-15T22:49:45.675 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:45.682 INFO:teuthology.orchestra.run.smithi093.stdout:(26/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2023-12-15T22:49:45.703 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-15T22:49:45.730 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:45.732 INFO:teuthology.orchestra.run.smithi093.stdout:(27/29): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2023-12-15T22:49:45.744 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-15T22:49:45.784 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-15T22:49:45.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-15T22:49:45.805 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 24/31 2023-12-15T22:49:45.829 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-15T22:49:45.836 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 25/31 2023-12-15T22:49:46.016 INFO:teuthology.orchestra.run.smithi093.stdout:(28/29): librbd1-19.0.0-202.ge787ab71.el9.x86_6 9.1 MB/s | 3.0 MB 00:00 2023-12-15T22:49:46.066 INFO:teuthology.orchestra.run.smithi093.stdout:(29/29): librados2-19.0.0-202.ge787ab71.el9.x86 6.9 MB/s | 3.3 MB 00:00 2023-12-15T22:49:46.069 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:49:46.069 INFO:teuthology.orchestra.run.smithi093.stdout:Total 13 MB/s | 55 MB 00:04 2023-12-15T22:49:46.070 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:49:46.101 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:49:46.102 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:49:46.102 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:49:46.135 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-15T22:49:46.167 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:46.196 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-15T22:49:46.239 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-15T22:49:46.281 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 20/31 2023-12-15T22:49:46.317 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-15T22:49:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-15T22:49:46.567 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:49:46.567 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:49:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-15T22:49:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:46.760 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-15T22:49:46.793 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:46.795 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:46.874 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:46.876 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:49:46.902 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:46.942 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 24/31 2023-12-15T22:49:46.964 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:46.972 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 25/31 2023-12-15T22:49:46.992 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-15T22:49:47.028 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 9/31 2023-12-15T22:49:47.094 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:49:47.121 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:47.169 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:47.283 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-15T22:49:47.311 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-15T22:49:47.355 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-15T22:49:47.395 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-15T22:49:47.424 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-15T22:49:47.457 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-15T22:49:47.763 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-15T22:49:47.787 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:47.860 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:47.891 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 20/31 2023-12-15T22:49:47.926 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-15T22:49:47.961 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:49:47.983 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:48.024 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:48.050 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-15T22:49:48.079 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-15T22:49:48.130 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-15T22:49:48.351 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-15T22:49:48.381 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:48.444 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:48.487 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-15T22:49:48.519 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 24/31 2023-12-15T22:49:48.528 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:48.550 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 25/31 2023-12-15T22:49:48.580 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:48.619 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:49:48.619 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:48.703 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:48.703 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-15T22:49:48.703 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-15T22:49:48.703 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:49:48.713 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:49:48.737 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:48.746 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:48.808 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:49:48.838 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-15T22:49:48.882 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 9/31 2023-12-15T22:49:48.947 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:49:48.974 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:49.023 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:49:49.090 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:49.119 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:49.129 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-15T22:49:49.173 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-15T22:49:49.232 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-15T22:49:49.263 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-15T22:49:49.284 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-15T22:49:49.308 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-15T22:49:49.615 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-15T22:49:49.646 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:49.736 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 19/31 2023-12-15T22:49:49.767 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 20/31 2023-12-15T22:49:49.787 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:49.788 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-15T22:49:49.788 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-15T22:49:49.788 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:49:49.803 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-15T22:49:49.824 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:50.227 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-15T22:49:50.257 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:50.311 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 23/31 2023-12-15T22:49:50.381 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 24/31 2023-12-15T22:49:50.409 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 25/31 2023-12-15T22:49:50.685 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:50.730 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:51.281 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:51.338 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:51.430 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:51.430 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-15T22:49:51.430 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-15T22:49:51.430 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:49:51.468 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:52.505 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:53.089 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 26/31 2023-12-15T22:49:53.125 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:53.195 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 27/31 2023-12-15T22:49:53.195 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-15T22:49:53.195 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-15T22:49:53.196 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:49:53.227 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2023-12-15T22:49:58.269 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:49:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:49:59.127 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:49:59.127 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:49:59.128 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-15T22:49:59.128 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:49:59.128 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:49:59.128 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:49:59.129 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:49:59.222 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:49:59.223 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-12-15T22:49:59.330 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:00.164 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:00.191 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:00.193 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:00.276 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:00.276 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 1/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 3/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 4/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:50:00.375 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 8/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 9/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 12/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 13/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-15T22:50:00.376 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-15T22:50:00.377 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 30/31 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2023-12-15T22:50:01.029 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2023-12-15T22:50:01.030 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2023-12-15T22:50:01.030 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2023-12-15T22:50:01.030 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 1/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 3/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 4/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:50:01.368 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 8/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 9/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 12/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 13/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-15T22:50:01.369 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-15T22:50:01.370 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:01.371 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-15T22:50:01.371 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 30/31 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:01.374 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.375 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-3.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:01.376 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:01.682 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-test 2023-12-15T22:50:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:02.235 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:28 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.306 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-15T22:50:02.307 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:02.308 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:02.387 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:02.388 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:02.388 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:02.388 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.0.0-202.ge787ab71.el9 ceph 41 M 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.0.0-202.ge787ab71.el9 ceph 163 k 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:02.389 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:02.390 INFO:teuthology.orchestra.run.smithi192.stdout:Install 6 Packages 2023-12-15T22:50:02.390 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:02.390 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 42 M 2023-12-15T22:50:02.390 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 173 M 2023-12-15T22:50:02.390 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:02.543 INFO:teuthology.orchestra.run.smithi192.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2023-12-15T22:50:02.585 INFO:teuthology.orchestra.run.smithi192.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-12-15T22:50:02.627 INFO:teuthology.orchestra.run.smithi192.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2023-12-15T22:50:02.629 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2023-12-15T22:50:02.630 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /root 2023-12-15T22:50:02.630 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2023-12-15T22:50:02.630 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:02.660 INFO:teuthology.orchestra.run.smithi192.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-15T22:50:02.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-test 2023-12-15T22:50:02.718 INFO:teuthology.orchestra.run.smithi192.stdout:(5/6): libcephsqlite-19.0.0-202.ge787ab71.el9.x 499 kB/s | 163 kB 00:00 2023-12-15T22:50:03.088 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 1/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 3/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 4/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 8/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 9/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 12/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 13/31 2023-12-15T22:50:03.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-15T22:50:03.090 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:03.091 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-15T22:50:03.091 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 30/31 2023-12-15T22:50:03.223 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:28 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:03.368 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.0.0-202.ge787ab71.el9 ceph 41 M 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.0.0-202.ge787ab71.el9 ceph 163 k 2023-12-15T22:50:03.369 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout:Install 6 Packages 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:03.370 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 42 M 2023-12-15T22:50:03.371 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 173 M 2023-12-15T22:50:03.371 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:03.433 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 29/31 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-15T22:50:03.457 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:03.459 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:03.497 INFO:teuthology.orchestra.run.smithi183.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.5 MB/s | 186 kB 00:00 2023-12-15T22:50:03.529 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-15T22:50:03.529 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:03.555 INFO:teuthology.orchestra.run.smithi183.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.9 MB/s | 217 kB 00:00 2023-12-15T22:50:03.606 INFO:teuthology.orchestra.run.smithi183.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2023-12-15T22:50:03.639 INFO:teuthology.orchestra.run.smithi183.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-15T22:50:04.056 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-15T22:50:04.057 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.058 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:04.059 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2023-12-15T22:50:04.059 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-15T22:50:04.059 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:04.059 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:04.264 INFO:teuthology.orchestra.run.smithi183.stdout:(5/6): libcephsqlite-19.0.0-202.ge787ab71.el9.x 183 kB/s | 163 kB 00:00 2023-12-15T22:50:04.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-test 2023-12-15T22:50:04.536 INFO:teuthology.orchestra.run.smithi192.stdout:(6/6): ceph-test-19.0.0-202.ge787ab71.el9.x86_6 19 MB/s | 41 MB 00:02 2023-12-15T22:50:04.539 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:04.539 INFO:teuthology.orchestra.run.smithi192.stdout:Total 20 MB/s | 42 MB 00:02 2023-12-15T22:50:04.540 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:04.559 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:04.559 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:04.652 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 1/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 3/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 4/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 5/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 6/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 7/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x 8/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86 9/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 10/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 11/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 12/31 2023-12-15T22:50:04.653 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 13/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:19.0.0-202.ge787ab71.el9.x86_64 28/31 2023-12-15T22:50:04.654 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-15T22:50:04.655 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 30/31 2023-12-15T22:50:04.843 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:28 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:04.900 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:04.901 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:04.986 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-202.ge787ab71.el9 ceph 41 M 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-202.ge787ab71.el9 ceph 163 k 2023-12-15T22:50:04.987 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout:Install 6 Packages 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:04.988 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 42 M 2023-12-15T22:50:04.989 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 173 M 2023-12-15T22:50:04.989 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:05.158 INFO:teuthology.orchestra.run.smithi188.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 186 kB 00:00 2023-12-15T22:50:05.200 INFO:teuthology.orchestra.run.smithi188.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-15T22:50:05.242 INFO:teuthology.orchestra.run.smithi188.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-15T22:50:05.276 INFO:teuthology.orchestra.run.smithi188.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-15T22:50:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:05.516 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-15T22:50:05.562 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-15T22:50:05.593 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-15T22:50:05.636 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-15T22:50:05.659 INFO:teuthology.orchestra.run.smithi188.stdout:(5/6): libcephsqlite-19.0.0-202.ge787ab71.el9.x 244 kB/s | 163 kB 00:00 2023-12-15T22:50:05.663 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.702 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.703 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: re2-1:20211101-3.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:05.704 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:06.066 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-test 2023-12-15T22:50:06.215 INFO:teuthology.orchestra.run.smithi183.stdout:(6/6): ceph-test-19.0.0-202.ge787ab71.el9.x86_6 14 MB/s | 41 MB 00:02 2023-12-15T22:50:06.218 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:06.218 INFO:teuthology.orchestra.run.smithi183.stdout:Total 15 MB/s | 42 MB 00:02 2023-12-15T22:50:06.218 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:06.237 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:06.238 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:06.585 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:06.586 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:06.619 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:00:27 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:06.772 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:06.772 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:06.772 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:06.772 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:19.0.0-202.ge787ab71.el9 ceph 41 M 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:19.0.0-202.ge787ab71.el9 ceph 163 k 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout:Install 6 Packages 2023-12-15T22:50:06.773 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:06.774 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 42 M 2023-12-15T22:50:06.774 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 173 M 2023-12-15T22:50:06.774 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:06.892 INFO:teuthology.orchestra.run.smithi093.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.6 MB/s | 186 kB 00:00 2023-12-15T22:50:06.983 INFO:teuthology.orchestra.run.smithi093.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.6 MB/s | 217 kB 00:00 2023-12-15T22:50:07.025 INFO:teuthology.orchestra.run.smithi093.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-15T22:50:07.051 INFO:teuthology.orchestra.run.smithi093.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2023-12-15T22:50:07.115 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:07.217 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-15T22:50:07.260 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-15T22:50:07.289 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-15T22:50:07.331 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-15T22:50:07.359 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:07.584 INFO:teuthology.orchestra.run.smithi093.stdout:(5/6): libcephsqlite-19.0.0-202.ge787ab71.el9.x 202 kB/s | 163 kB 00:00 2023-12-15T22:50:09.515 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:09.596 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:11.075 INFO:teuthology.orchestra.run.smithi188.stdout:(6/6): ceph-test-19.0.0-202.ge787ab71.el9.x86_6 6.8 MB/s | 41 MB 00:06 2023-12-15T22:50:11.078 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:11.079 INFO:teuthology.orchestra.run.smithi188.stdout:Total 6.9 MB/s | 42 MB 00:06 2023-12-15T22:50:11.079 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:11.099 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:11.099 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:11.237 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:11.308 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:11.440 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:11.441 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 1/6 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2/6 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-15T22:50:11.702 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-15T22:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.6-16.el9.x86_64 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-15T22:50:12.104 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-15T22:50:12.105 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:12.105 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:12.108 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-15T22:50:12.141 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-15T22:50:12.184 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-15T22:50:12.211 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:12.437 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph 2023-12-15T22:50:13.000 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:39 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:13.147 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:13.149 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================== 2023-12-15T22:50:13.149 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================== 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.0.0-202.ge787ab71.el9 ceph 6.5 k 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.0.0-202.ge787ab71.el9 ceph 2.1 M 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.0.0-202.ge787ab71.el9 ceph 1.5 M 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 243 k 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.4 M 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 18 M 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-15T22:50:13.150 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-15T22:50:13.151 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================== 2023-12-15T22:50:13.152 INFO:teuthology.orchestra.run.smithi192.stdout:Install 35 Packages 2023-12-15T22:50:13.153 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:13.153 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 30 M 2023-12-15T22:50:13.153 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 111 M 2023-12-15T22:50:13.153 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:13.338 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:13.339 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 1/6 2023-12-15T22:50:13.339 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2/6 2023-12-15T22:50:13.339 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-15T22:50:13.339 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-15T22:50:13.339 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-15T22:50:13.538 INFO:teuthology.orchestra.run.smithi192.stdout:(1/35): ceph-19.0.0-202.ge787ab71.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2023-12-15T22:50:13.775 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-15T22:50:13.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-16.el9.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:13.776 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:13.879 INFO:teuthology.orchestra.run.smithi192.stdout:(2/35): ceph-mds-19.0.0-202.ge787ab71.el9.x86_6 3.7 MB/s | 2.1 MB 00:00 2023-12-15T22:50:14.005 INFO:teuthology.orchestra.run.smithi192.stdout:(3/35): ceph-mgr-19.0.0-202.ge787ab71.el9.x86_6 2.1 MB/s | 1.5 MB 00:00 2023-12-15T22:50:14.066 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph 2023-12-15T22:50:14.580 INFO:teuthology.orchestra.run.smithi192.stdout:(4/35): ceph-mgr-modules-core-19.0.0-202.ge787a 423 kB/s | 243 kB 00:00 2023-12-15T22:50:14.633 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:39 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:14.672 INFO:teuthology.orchestra.run.smithi192.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-12-15T22:50:14.697 INFO:teuthology.orchestra.run.smithi192.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 5.7 MB/s | 144 kB 00:00 2023-12-15T22:50:14.731 INFO:teuthology.orchestra.run.smithi192.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 947 kB/s | 32 kB 00:00 2023-12-15T22:50:14.764 INFO:teuthology.orchestra.run.smithi192.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-15T22:50:14.788 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.0.0-202.ge787ab71.el9 ceph 6.5 k 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.0.0-202.ge787ab71.el9 ceph 2.1 M 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.0.0-202.ge787ab71.el9 ceph 1.5 M 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 243 k 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.4 M 2023-12-15T22:50:14.791 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 18 M 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-15T22:50:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-15T22:50:14.793 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout:Install 35 Packages 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:14.794 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 30 M 2023-12-15T22:50:14.795 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 111 M 2023-12-15T22:50:14.795 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:14.798 INFO:teuthology.orchestra.run.smithi192.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-15T22:50:14.840 INFO:teuthology.orchestra.run.smithi192.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-15T22:50:14.899 INFO:teuthology.orchestra.run.smithi192.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-15T22:50:14.932 INFO:teuthology.orchestra.run.smithi192.stdout:(12/35): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-15T22:50:14.966 INFO:teuthology.orchestra.run.smithi192.stdout:(13/35): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-15T22:50:14.991 INFO:teuthology.orchestra.run.smithi192.stdout:(14/35): python3-requests-2.25.1-7.el9.noarch.r 4.4 MB/s | 113 kB 00:00 2023-12-15T22:50:15.025 INFO:teuthology.orchestra.run.smithi192.stdout:(15/35): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-12-15T22:50:15.150 INFO:teuthology.orchestra.run.smithi192.stdout:(16/35): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2023-12-15T22:50:15.200 INFO:teuthology.orchestra.run.smithi192.stdout:(17/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 871 kB/s | 43 kB 00:00 2023-12-15T22:50:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:(18/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2023-12-15T22:50:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:(19/35): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2023-12-15T22:50:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:(20/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 256 kB/s | 11 kB 00:00 2023-12-15T22:50:15.392 INFO:teuthology.orchestra.run.smithi183.stdout:(1/35): ceph-19.0.0-202.ge787ab71.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2023-12-15T22:50:15.418 INFO:teuthology.orchestra.run.smithi192.stdout:(21/35): python3-jaraco-classes-3.2.1-5.el9.noa 423 kB/s | 18 kB 00:00 2023-12-15T22:50:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:(22/35): python3-jaraco-collections-3.0.0-8.el9 557 kB/s | 23 kB 00:00 2023-12-15T22:50:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:(23/35): python3-jaraco-functools-3.5.0-2.el9.n 466 kB/s | 19 kB 00:00 2023-12-15T22:50:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:(24/35): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2023-12-15T22:50:15.702 INFO:teuthology.orchestra.run.smithi192.stdout:(25/35): ceph-osd-19.0.0-202.ge787ab71.el9.x86_ 9.7 MB/s | 18 MB 00:01 2023-12-15T22:50:15.727 INFO:teuthology.orchestra.run.smithi192.stdout:(26/35): python3-logutils-0.3.5-21.el9.noarch.r 252 kB/s | 46 kB 00:00 2023-12-15T22:50:15.786 INFO:teuthology.orchestra.run.smithi192.stdout:(27/35): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-12-15T22:50:15.792 INFO:teuthology.orchestra.run.smithi183.stdout:(2/35): ceph-mds-19.0.0-202.ge787ab71.el9.x86_6 3.2 MB/s | 2.1 MB 00:00 2023-12-15T22:50:15.836 INFO:teuthology.orchestra.run.smithi192.stdout:(28/35): python3-more-itertools-8.12.0-2.el9.no 590 kB/s | 79 kB 00:00 2023-12-15T22:50:15.853 INFO:teuthology.orchestra.run.smithi192.stdout:(29/35): python3-portend-3.1.0-2.el9.noarch.rpm 246 kB/s | 16 kB 00:00 2023-12-15T22:50:15.887 INFO:teuthology.orchestra.run.smithi192.stdout:(30/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2023-12-15T22:50:15.912 INFO:teuthology.orchestra.run.smithi192.stdout:(31/35): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2023-12-15T22:50:15.946 INFO:teuthology.orchestra.run.smithi192.stdout:(32/35): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2023-12-15T22:50:15.979 INFO:teuthology.orchestra.run.smithi192.stdout:(33/35): python3-zc-lockfile-2.0-10.el9.noarch. 601 kB/s | 20 kB 00:00 2023-12-15T22:50:16.004 INFO:teuthology.orchestra.run.smithi192.stdout:(34/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2023-12-15T22:50:16.080 INFO:teuthology.orchestra.run.smithi192.stdout:(35/35): ceph-mon-19.0.0-202.ge787ab71.el9.x86_ 1.7 MB/s | 4.4 MB 00:02 2023-12-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi192.stdout:Total 10 MB/s | 30 MB 00:02 2023-12-15T22:50:16.084 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:16.120 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:16.120 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:16.185 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:16.261 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:16.500 INFO:teuthology.orchestra.run.smithi183.stdout:(3/35): ceph-mgr-19.0.0-202.ge787ab71.el9.x86_6 1.1 MB/s | 1.5 MB 00:01 2023-12-15T22:50:16.523 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:16.523 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:16.776 INFO:teuthology.orchestra.run.smithi183.stdout:(4/35): ceph-mgr-modules-core-19.0.0-202.ge787a 884 kB/s | 243 kB 00:00 2023-12-15T22:50:16.876 INFO:teuthology.orchestra.run.smithi183.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-15T22:50:16.909 INFO:teuthology.orchestra.run.smithi183.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-12-15T22:50:16.943 INFO:teuthology.orchestra.run.smithi183.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 951 kB/s | 32 kB 00:00 2023-12-15T22:50:16.976 INFO:teuthology.orchestra.run.smithi183.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-15T22:50:17.010 INFO:teuthology.orchestra.run.smithi183.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-15T22:50:17.052 INFO:teuthology.orchestra.run.smithi183.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-15T22:50:17.111 INFO:teuthology.orchestra.run.smithi183.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-15T22:50:17.286 INFO:teuthology.orchestra.run.smithi183.stdout:(12/35): ceph-osd-19.0.0-202.ge787ab71.el9.x86_ 12 MB/s | 18 MB 00:01 2023-12-15T22:50:17.331 INFO:teuthology.orchestra.run.smithi183.stdout:(13/35): python3-ply-3.11-14.el9.noarch.rpm 468 kB/s | 103 kB 00:00 2023-12-15T22:50:17.353 INFO:teuthology.orchestra.run.smithi183.stdout:(14/35): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2023-12-15T22:50:17.378 INFO:teuthology.orchestra.run.smithi183.stdout:(15/35): python3-requests-2.25.1-7.el9.noarch.r 2.3 MB/s | 113 kB 00:00 2023-12-15T22:50:17.412 INFO:teuthology.orchestra.run.smithi183.stdout:(16/35): python3-urllib3-1.26.5-4.el9.noarch.rp 3.1 MB/s | 187 kB 00:00 2023-12-15T22:50:17.471 INFO:teuthology.orchestra.run.smithi183.stdout:(17/35): ceph-mon-19.0.0-202.ge787ab71.el9.x86_ 2.1 MB/s | 4.4 MB 00:02 2023-12-15T22:50:17.765 INFO:teuthology.orchestra.run.smithi183.stdout:(18/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 123 kB/s | 43 kB 00:00 2023-12-15T22:50:17.861 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:17.880 INFO:teuthology.orchestra.run.smithi183.stdout:(19/35): luarocks-3.9.2-1.el9.noarch.rpm 302 kB/s | 151 kB 00:00 2023-12-15T22:50:17.916 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-15T22:50:17.947 INFO:teuthology.orchestra.run.smithi183.stdout:(20/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 361 kB/s | 172 kB 00:00 2023-12-15T22:50:17.948 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-15T22:50:17.972 INFO:teuthology.orchestra.run.smithi183.stdout:(21/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2023-12-15T22:50:17.981 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-15T22:50:18.047 INFO:teuthology.orchestra.run.smithi183.stdout:(22/35): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2023-12-15T22:50:18.073 INFO:teuthology.orchestra.run.smithi183.stdout:(23/35): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2023-12-15T22:50:18.073 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-15T22:50:18.114 INFO:teuthology.orchestra.run.smithi183.stdout:(24/35): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2023-12-15T22:50:18.148 INFO:teuthology.orchestra.run.smithi183.stdout:(25/35): python3-jaraco-functools-3.5.0-2.el9.n 193 kB/s | 19 kB 00:00 2023-12-15T22:50:18.150 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-15T22:50:18.173 INFO:teuthology.orchestra.run.smithi183.stdout:(26/35): python3-jaraco-text-3.2.0-6.el9.noarch 195 kB/s | 20 kB 00:00 2023-12-15T22:50:18.192 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-15T22:50:18.223 INFO:teuthology.orchestra.run.smithi183.stdout:(27/35): python3-logutils-0.3.5-21.el9.noarch.r 425 kB/s | 46 kB 00:00 2023-12-15T22:50:18.263 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-15T22:50:18.274 INFO:teuthology.orchestra.run.smithi183.stdout:(28/35): python3-more-itertools-8.12.0-2.el9.no 629 kB/s | 79 kB 00:00 2023-12-15T22:50:18.317 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-15T22:50:18.324 INFO:teuthology.orchestra.run.smithi183.stdout:(29/35): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2023-12-15T22:50:18.325 INFO:teuthology.orchestra.run.smithi093.stdout:(6/6): ceph-test-19.0.0-202.ge787ab71.el9.x86_6 3.6 MB/s | 41 MB 00:11 2023-12-15T22:50:18.327 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:18.328 INFO:teuthology.orchestra.run.smithi093.stdout:Total 3.6 MB/s | 42 MB 00:11 2023-12-15T22:50:18.328 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:18.346 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:18.346 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:18.356 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-15T22:50:18.384 INFO:teuthology.orchestra.run.smithi183.stdout:(30/35): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2023-12-15T22:50:18.404 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-15T22:50:18.409 INFO:teuthology.orchestra.run.smithi183.stdout:(31/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 665 kB/s | 90 kB 00:00 2023-12-15T22:50:18.435 INFO:teuthology.orchestra.run.smithi183.stdout:(32/35): python3-tempora-5.0.0-2.el9.noarch.rpm 324 kB/s | 36 kB 00:00 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 1/6 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2/6 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-15T22:50:18.445 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-15T22:50:18.465 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-15T22:50:18.519 INFO:teuthology.orchestra.run.smithi183.stdout:(33/35): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-15T22:50:18.545 INFO:teuthology.orchestra.run.smithi183.stdout:(34/35): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2023-12-15T22:50:18.660 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:18.669 INFO:teuthology.orchestra.run.smithi183.stdout:(35/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2023-12-15T22:50:18.673 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:18.673 INFO:teuthology.orchestra.run.smithi183.stdout:Total 7.8 MB/s | 30 MB 00:03 2023-12-15T22:50:18.673 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:18.698 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:18.698 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:18.710 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:18.714 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:18.714 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:18.741 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-15T22:50:18.775 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-15T22:50:18.805 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-16.el9.x86_64 2023-12-15T22:50:18.858 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:18.859 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-15T22:50:18.859 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-15T22:50:18.859 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-15T22:50:18.859 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:18.859 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-15T22:50:18.916 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-15T22:50:18.949 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-15T22:50:18.990 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-15T22:50:19.024 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-15T22:50:19.059 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-15T22:50:19.121 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:19.121 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:19.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph 2023-12-15T22:50:19.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-15T22:50:19.182 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-15T22:50:19.231 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:19.253 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-15T22:50:19.315 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-15T22:50:19.355 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-15T22:50:19.389 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-15T22:50:19.391 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-15T22:50:19.434 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-15T22:50:19.461 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:19.516 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-15T22:50:19.676 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 28/35 2023-12-15T22:50:19.703 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:19.717 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:43 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:19.727 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:19.727 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:19.728 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-15T22:50:19.728 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:19.728 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:19.728 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:19.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-15T22:50:19.872 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:19.875 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2023-12-15T22:50:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:19.875 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-202.ge787ab71.el9 ceph 6.5 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-202.ge787ab71.el9 ceph 2.1 M 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-202.ge787ab71.el9 ceph 1.5 M 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 243 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.4 M 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 18 M 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-15T22:50:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-15T22:50:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout:Install 35 Packages 2023-12-15T22:50:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:19.879 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 30 M 2023-12-15T22:50:19.879 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 111 M 2023-12-15T22:50:19.879 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:20.403 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:20.444 INFO:teuthology.orchestra.run.smithi188.stdout:(1/35): ceph-19.0.0-202.ge787ab71.el9.x86_64.rp 32 kB/s | 6.5 kB 00:00 2023-12-15T22:50:20.496 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-15T22:50:20.529 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-15T22:50:20.570 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-15T22:50:20.661 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-15T22:50:20.733 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-15T22:50:20.773 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-15T22:50:20.811 INFO:teuthology.orchestra.run.smithi188.stdout:(2/35): ceph-mgr-19.0.0-202.ge787ab71.el9.x86_6 2.6 MB/s | 1.5 MB 00:00 2023-12-15T22:50:20.844 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-15T22:50:20.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-15T22:50:20.936 INFO:teuthology.orchestra.run.smithi188.stdout:(3/35): ceph-mds-19.0.0-202.ge787ab71.el9.x86_6 3.0 MB/s | 2.1 MB 00:00 2023-12-15T22:50:20.937 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-15T22:50:20.986 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-15T22:50:21.020 INFO:teuthology.orchestra.run.smithi188.stdout:(4/35): ceph-mgr-modules-core-19.0.0-202.ge787a 2.9 MB/s | 243 kB 00:00 2023-12-15T22:50:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-15T22:50:21.120 INFO:teuthology.orchestra.run.smithi188.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-15T22:50:21.162 INFO:teuthology.orchestra.run.smithi188.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-15T22:50:21.196 INFO:teuthology.orchestra.run.smithi188.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 953 kB/s | 32 kB 00:00 2023-12-15T22:50:21.230 INFO:teuthology.orchestra.run.smithi188.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-15T22:50:21.241 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:21.263 INFO:teuthology.orchestra.run.smithi188.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-15T22:50:21.291 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:21.305 INFO:teuthology.orchestra.run.smithi188.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-12-15T22:50:21.322 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-15T22:50:21.335 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-15T22:50:21.363 INFO:teuthology.orchestra.run.smithi188.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-15T22:50:21.364 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-15T22:50:21.365 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:21.395 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-15T22:50:21.397 INFO:teuthology.orchestra.run.smithi188.stdout:(12/35): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-15T22:50:21.399 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:21.399 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:21.399 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-15T22:50:21.400 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:21.400 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:21.400 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:21.431 INFO:teuthology.orchestra.run.smithi188.stdout:(13/35): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-15T22:50:21.464 INFO:teuthology.orchestra.run.smithi188.stdout:(14/35): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-12-15T22:50:21.471 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-15T22:50:21.498 INFO:teuthology.orchestra.run.smithi188.stdout:(15/35): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-12-15T22:50:21.513 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-15T22:50:21.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-15T22:50:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-15T22:50:21.621 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-15T22:50:21.648 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-15T22:50:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-15T22:50:21.748 INFO:teuthology.orchestra.run.smithi188.stdout:(16/35): ceph-mon-19.0.0-202.ge787ab71.el9.x86_ 3.4 MB/s | 4.4 MB 00:01 2023-12-15T22:50:21.777 INFO:teuthology.orchestra.run.smithi188.stdout:(17/35): luarocks-3.9.2-1.el9.noarch.rpm 541 kB/s | 151 kB 00:00 2023-12-15T22:50:21.788 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-15T22:50:21.857 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:21.859 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:21.882 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:21.986 INFO:teuthology.orchestra.run.smithi188.stdout:(18/35): ceph-osd-19.0.0-202.ge787ab71.el9.x86_ 15 MB/s | 18 MB 00:01 2023-12-15T22:50:22.004 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-15T22:50:22.011 INFO:teuthology.orchestra.run.smithi188.stdout:(19/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 165 kB/s | 43 kB 00:00 2023-12-15T22:50:22.062 INFO:teuthology.orchestra.run.smithi188.stdout:(20/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 605 kB/s | 172 kB 00:00 2023-12-15T22:50:22.087 INFO:teuthology.orchestra.run.smithi188.stdout:(21/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2023-12-15T22:50:22.099 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:22.123 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:22.129 INFO:teuthology.orchestra.run.smithi188.stdout:(22/35): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2023-12-15T22:50:22.130 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-15T22:50:22.155 INFO:teuthology.orchestra.run.smithi188.stdout:(23/35): python3-jaraco-collections-3.0.0-8.el9 344 kB/s | 23 kB 00:00 2023-12-15T22:50:22.180 INFO:teuthology.orchestra.run.smithi188.stdout:(24/35): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2023-12-15T22:50:22.190 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:22.213 INFO:teuthology.orchestra.run.smithi188.stdout:(25/35): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2023-12-15T22:50:22.255 INFO:teuthology.orchestra.run.smithi188.stdout:(26/35): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2023-12-15T22:50:22.299 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 28/35 2023-12-15T22:50:22.314 INFO:teuthology.orchestra.run.smithi188.stdout:(27/35): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2023-12-15T22:50:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:22.339 INFO:teuthology.orchestra.run.smithi188.stdout:(28/35): python3-more-itertools-8.12.0-2.el9.no 627 kB/s | 79 kB 00:00 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:22.364 INFO:teuthology.orchestra.run.smithi188.stdout:(29/35): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-12-15T22:50:22.381 INFO:teuthology.orchestra.run.smithi188.stdout:(30/35): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2023-12-15T22:50:22.423 INFO:teuthology.orchestra.run.smithi188.stdout:(31/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2023-12-15T22:50:22.433 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-15T22:50:22.440 INFO:teuthology.orchestra.run.smithi188.stdout:(32/35): python3-tempora-5.0.0-2.el9.noarch.rpm 473 kB/s | 36 kB 00:00 2023-12-15T22:50:22.466 INFO:teuthology.orchestra.run.smithi188.stdout:(33/35): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-12-15T22:50:22.507 INFO:teuthology.orchestra.run.smithi188.stdout:(34/35): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2023-12-15T22:50:22.583 INFO:teuthology.orchestra.run.smithi188.stdout:(35/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2023-12-15T22:50:22.586 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:22.586 INFO:teuthology.orchestra.run.smithi188.stdout:Total 11 MB/s | 30 MB 00:02 2023-12-15T22:50:22.586 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:22.627 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:22.627 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:23.023 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:23.023 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:23.311 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 5/6 2023-12-15T22:50:23.386 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 1/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 3/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 4/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 5/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 6/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-15T22:50:23.979 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-15T22:50:23.980 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-15T22:50:23.981 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-15T22:50:23.982 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-15T22:50:24.004 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-15T22:50:24.038 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:24.067 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-15T22:50:24.417 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-15T22:50:24.451 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-15T22:50:24.513 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:24.537 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-15T22:50:24.620 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-15T22:50:24.662 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-15T22:50:24.734 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-15T22:50:24.739 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:24.762 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:24.787 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-15T22:50:24.828 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:24.834 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-15T22:50:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-15T22:50:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-15T22:50:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-15T22:50:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:24.911 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-15T22:50:25.138 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:25.189 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-base 2023-12-15T22:50:25.189 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:25.219 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-15T22:50:25.253 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-15T22:50:25.283 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-15T22:50:25.359 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-15T22:50:25.394 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-15T22:50:25.427 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 6/6 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 1/6 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2/6 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-15T22:50:25.438 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-15T22:50:25.467 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-15T22:50:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-15T22:50:25.529 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-15T22:50:25.617 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-15T22:50:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-15T22:50:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-15T22:50:25.745 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:51 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:25.839 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:25.867 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.6-16.el9.x86_64 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:25.873 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-15T22:50:25.874 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-15T22:50:25.874 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-15T22:50:25.874 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:25.874 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:25.890 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:25.890 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:50:25.890 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:25.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install cephadm 2023-12-15T22:50:25.992 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-15T22:50:26.148 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 28/35 2023-12-15T22:50:26.161 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph 2023-12-15T22:50:26.173 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:26.199 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:26.199 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:26.199 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-15T22:50:26.199 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:26.199 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:26.200 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:26.279 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-15T22:50:26.503 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:52 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:26.645 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 807 k 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:50:26.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:26.647 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 807 k 2023-12-15T22:50:26.647 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 823 k 2023-12-15T22:50:26.647 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:26.653 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:26.653 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 1/35 2023-12-15T22:50:26.653 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 3/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 4/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 5/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 6/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-15T22:50:26.654 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-15T22:50:26.655 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-15T22:50:26.656 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-15T22:50:26.723 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:00:47 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:26.880 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================== 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================== 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:19.0.0-202.ge787ab71.el9 ceph 6.5 k 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:19.0.0-202.ge787ab71.el9 ceph 2.1 M 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:19.0.0-202.ge787ab71.el9 ceph 1.5 M 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 243 k 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:19.0.0-202.ge787ab71.el9 ceph 4.4 M 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 18 M 2023-12-15T22:50:26.883 INFO:teuthology.orchestra.run.smithi093.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-15T22:50:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:26.885 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================== 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout:Install 35 Packages 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 30 M 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 111 M 2023-12-15T22:50:26.886 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:26.997 INFO:teuthology.orchestra.run.smithi192.stdout:cephadm-19.0.0-202.ge787ab71.el9.noarch.rpm 2.2 MB/s | 807 kB 00:00 2023-12-15T22:50:26.998 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:26.998 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.2 MB/s | 807 kB 00:00 2023-12-15T22:50:26.998 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:27.004 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:27.004 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:27.009 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:27.009 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:27.087 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:27.418 INFO:teuthology.orchestra.run.smithi093.stdout:(1/35): ceph-19.0.0-202.ge787ab71.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:27.526 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-15T22:50:27.527 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-15T22:50:27.528 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:27.529 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:27.569 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:27.643 INFO:teuthology.orchestra.run.smithi093.stdout:(2/35): ceph-mds-19.0.0-202.ge787ab71.el9.x86_6 5.2 MB/s | 2.1 MB 00:00 2023-12-15T22:50:27.650 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:27.797 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-15T22:50:27.826 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:27.852 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:27.853 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:28.102 INFO:teuthology.orchestra.run.smithi093.stdout:(3/35): ceph-mon-19.0.0-202.ge787ab71.el9.x86_6 6.4 MB/s | 4.4 MB 00:00 2023-12-15T22:50:28.152 INFO:teuthology.orchestra.run.smithi093.stdout:(4/35): ceph-mgr-19.0.0-202.ge787ab71.el9.x86_6 1.6 MB/s | 1.5 MB 00:00 2023-12-15T22:50:28.211 INFO:teuthology.orchestra.run.smithi093.stdout:(5/35): ceph-mgr-modules-core-19.0.0-202.ge787a 2.2 MB/s | 243 kB 00:00 2023-12-15T22:50:28.269 INFO:teuthology.orchestra.run.smithi093.stdout:(6/35): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-12-15T22:50:28.294 INFO:teuthology.orchestra.run.smithi093.stdout:(7/35): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-12-15T22:50:28.302 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:28.320 INFO:teuthology.orchestra.run.smithi093.stdout:(8/35): python3-markupsafe-1.1.1-12.el9.x86_64. 633 kB/s | 32 kB 00:00 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:28.325 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:28.328 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:28.345 INFO:teuthology.orchestra.run.smithi093.stdout:(9/35): python3-pytz-2021.1-5.el9.noarch.rpm 942 kB/s | 47 kB 00:00 2023-12-15T22:50:28.371 INFO:teuthology.orchestra.run.smithi093.stdout:(10/35): python3-toml-0.10.2-6.el9.noarch.rpm 772 kB/s | 39 kB 00:00 2023-12-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi093.stdout:(11/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:53 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:28.434 INFO:teuthology.orchestra.run.smithi093.stdout:(12/35): python3-cryptography-36.0.1-4.el9.x86_ 18 MB/s | 1.1 MB 00:00 2023-12-15T22:50:28.459 INFO:teuthology.orchestra.run.smithi093.stdout:(13/35): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-15T22:50:28.484 INFO:teuthology.orchestra.run.smithi093.stdout:(14/35): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-12-15T22:50:28.499 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:28.510 INFO:teuthology.orchestra.run.smithi093.stdout:(15/35): python3-requests-2.25.1-7.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2023-12-15T22:50:28.527 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:28.535 INFO:teuthology.orchestra.run.smithi093.stdout:(16/35): python3-urllib3-1.26.5-4.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2023-12-15T22:50:28.547 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:28.548 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:50:28.548 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:28.550 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:28.551 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:28.551 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-15T22:50:28.551 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:28.551 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:28.551 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:28.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-immutable-object-cache 2023-12-15T22:50:28.611 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install cephadm 2023-12-15T22:50:28.618 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:28.711 INFO:teuthology.orchestra.run.smithi093.stdout:(17/35): ceph-osd-19.0.0-202.ge787ab71.el9.x86_ 17 MB/s | 18 MB 00:01 2023-12-15T22:50:28.986 INFO:teuthology.orchestra.run.smithi093.stdout:(18/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 96 kB/s | 43 kB 00:00 2023-12-15T22:50:29.036 INFO:teuthology.orchestra.run.smithi093.stdout:(19/35): luarocks-3.9.2-1.el9.noarch.rpm 287 kB/s | 151 kB 00:00 2023-12-15T22:50:29.119 INFO:teuthology.orchestra.run.smithi093.stdout:(20/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2023-12-15T22:50:29.138 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:55 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:29.145 INFO:teuthology.orchestra.run.smithi093.stdout:(21/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 444 kB/s | 172 kB 00:00 2023-12-15T22:50:29.168 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:54 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:29.195 INFO:teuthology.orchestra.run.smithi093.stdout:(22/35): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2023-12-15T22:50:29.220 INFO:teuthology.orchestra.run.smithi093.stdout:(23/35): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2023-12-15T22:50:29.245 INFO:teuthology.orchestra.run.smithi093.stdout:(24/35): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2023-12-15T22:50:29.271 INFO:teuthology.orchestra.run.smithi093.stdout:(25/35): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2023-12-15T22:50:29.284 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:29.285 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:29.285 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.ge787ab71.el9 ceph 141 k 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 141 k 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 395 k 2023-12-15T22:50:29.286 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:29.296 INFO:teuthology.orchestra.run.smithi093.stdout:(26/35): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2023-12-15T22:50:29.311 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:29.311 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:29.311 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:29.311 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:29.311 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 807 k 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 807 k 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 823 k 2023-12-15T22:50:29.312 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:29.330 INFO:teuthology.orchestra.run.smithi093.stdout:(27/35): python3-logutils-0.3.5-21.el9.noarch.r 551 kB/s | 46 kB 00:00 2023-12-15T22:50:29.363 INFO:teuthology.orchestra.run.smithi093.stdout:(28/35): python3-more-itertools-8.12.0-2.el9.no 855 kB/s | 79 kB 00:00 2023-12-15T22:50:29.397 INFO:teuthology.orchestra.run.smithi093.stdout:(29/35): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-12-15T22:50:29.422 INFO:teuthology.orchestra.run.smithi093.stdout:(30/35): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2023-12-15T22:50:29.456 INFO:teuthology.orchestra.run.smithi093.stdout:(31/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 975 kB/s | 90 kB 00:00 2023-12-15T22:50:29.481 INFO:teuthology.orchestra.run.smithi093.stdout:(32/35): python3-tempora-5.0.0-2.el9.noarch.rpm 426 kB/s | 36 kB 00:00 2023-12-15T22:50:29.519 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-immutable-object-cache-19.0.0-202.ge787ab7 606 kB/s | 141 kB 00:00 2023-12-15T22:50:29.520 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:29.520 INFO:teuthology.orchestra.run.smithi192.stdout:Total 602 kB/s | 141 kB 00:00 2023-12-15T22:50:29.520 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:29.527 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:29.539 INFO:teuthology.orchestra.run.smithi093.stdout:(33/35): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-12-15T22:50:29.565 INFO:teuthology.orchestra.run.smithi093.stdout:(34/35): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2023-12-15T22:50:29.579 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:29.580 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:29.640 INFO:teuthology.orchestra.run.smithi093.stdout:(35/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2023-12-15T22:50:29.646 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:29.646 INFO:teuthology.orchestra.run.smithi093.stdout:Total 11 MB/s | 30 MB 00:02 2023-12-15T22:50:29.646 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:29.686 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:29.686 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:29.715 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:29.740 INFO:teuthology.orchestra.run.smithi183.stdout:cephadm-19.0.0-202.ge787ab71.el9.noarch.rpm 1.8 MB/s | 807 kB 00:00 2023-12-15T22:50:29.740 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:29.740 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.8 MB/s | 807 kB 00:00 2023-12-15T22:50:29.740 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:29.745 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:29.746 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:29.751 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:29.752 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:29.770 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:29.795 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:29.795 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:29.795 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-15T22:50:29.795 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:30.094 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:30.094 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:30.311 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 1/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 3/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 4/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 5/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 6/35 2023-12-15T22:50:30.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-15T22:50:30.351 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-15T22:50:30.352 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-15T22:50:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:30.835 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:30.836 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:30.836 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:30.836 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:30.836 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:30.836 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:30.844 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:31.055 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:31.154 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:31.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-15T22:50:31.189 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-15T22:50:31.190 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-15T22:50:31.191 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:31.191 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:31.393 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-immutable-object-cache 2023-12-15T22:50:31.402 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:31.460 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-15T22:50:31.491 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-15T22:50:31.524 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-15T22:50:31.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-base 2023-12-15T22:50:31.615 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-15T22:50:31.620 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:57 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:31.694 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-15T22:50:31.716 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-15T22:50:31.766 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:31.767 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:50:31.767 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-15T22:50:31.838 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-dashboard 2023-12-15T22:50:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-15T22:50:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-15T22:50:31.948 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-15T22:50:31.958 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:56 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:32.006 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-15T22:50:32.104 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.ge787ab71.el9 ceph 141 k 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:50:32.105 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:32.106 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 141 k 2023-12-15T22:50:32.106 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 395 k 2023-12-15T22:50:32.106 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:32.122 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:56 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:32.190 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:32.216 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:32.236 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:32.265 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:32.266 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:50:32.266 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:32.267 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-15T22:50:32.301 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-15T22:50:32.331 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-15T22:50:32.337 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-immutable-object-cache-19.0.0-202.ge787ab7 612 kB/s | 141 kB 00:00 2023-12-15T22:50:32.337 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:32.338 INFO:teuthology.orchestra.run.smithi183.stdout:Total 608 kB/s | 141 kB 00:00 2023-12-15T22:50:32.338 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:32.345 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:32.345 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:32.349 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install cephadm 2023-12-15T22:50:32.389 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:58 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:32.397 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:32.397 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:32.406 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-15T22:50:32.442 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-15T22:50:32.475 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-15T22:50:32.515 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-15T22:50:32.536 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 1.8 M 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 28 k 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 15 k 2023-12-15T22:50:32.537 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout:Install 7 Packages 2023-12-15T22:50:32.538 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:32.539 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:32.539 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 2.1 M 2023-12-15T22:50:32.539 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 8.7 M 2023-12-15T22:50:32.539 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:32.550 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-15T22:50:32.585 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-15T22:50:32.604 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:32.628 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:32.628 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:32.628 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-15T22:50:32.628 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:32.673 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-15T22:50:32.707 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-15T22:50:32.787 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-15T22:50:32.823 INFO:teuthology.orchestra.run.smithi192.stdout:(1/7): ceph-grafana-dashboards-19.0.0-202.ge787 139 kB/s | 28 kB 00:00 2023-12-15T22:50:32.848 INFO:teuthology.orchestra.run.smithi192.stdout:(2/7): ceph-prometheus-alerts-19.0.0-202.ge787a 66 kB/s | 15 kB 00:00 2023-12-15T22:50:32.900 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:56 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:32.923 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-15T22:50:33.032 INFO:teuthology.orchestra.run.smithi192.stdout:(3/7): ceph-mgr-dashboard-19.0.0-202.ge787ab71. 4.3 MB/s | 1.8 MB 00:00 2023-12-15T22:50:33.044 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:33.044 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:33.044 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:33.044 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:33.044 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 807 k 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 807 k 2023-12-15T22:50:33.045 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 823 k 2023-12-15T22:50:33.046 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:33.049 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-15T22:50:33.057 INFO:teuthology.orchestra.run.smithi192.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 39 kB/s | 9.0 kB 00:00 2023-12-15T22:50:33.149 INFO:teuthology.orchestra.run.smithi192.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 263 kB/s | 31 kB 00:00 2023-12-15T22:50:33.174 INFO:teuthology.orchestra.run.smithi192.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 126 kB/s | 41 kB 00:00 2023-12-15T22:50:33.214 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 28/35 2023-12-15T22:50:33.237 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:33.262 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 29/35 2023-12-15T22:50:33.262 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:33.262 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-15T22:50:33.263 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:33.263 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-15T22:50:33.263 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:33.343 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-15T22:50:33.449 INFO:teuthology.orchestra.run.smithi192.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 481 kB/s | 188 kB 00:00 2023-12-15T22:50:33.453 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:33.454 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.3 MB/s | 2.1 MB 00:00 2023-12-15T22:50:33.454 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:33.461 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:33.461 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:cephadm-19.0.0-202.ge787ab71.el9.noarch.rpm 1.8 MB/s | 807 kB 00:00 2023-12-15T22:50:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.8 MB/s | 807 kB 00:00 2023-12-15T22:50:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:33.528 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:33.528 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:33.574 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:33.685 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:33.685 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:33.686 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:33.686 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:33.686 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:33.686 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:33.818 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:33.867 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-15T22:50:33.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-15T22:50:33.911 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr 2023-12-15T22:50:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:33.946 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-15T22:50:33.980 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-15T22:50:34.001 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 5/7 2023-12-15T22:50:34.031 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:34.229 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 6/7 2023-12-15T22:50:34.261 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:34.476 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:59 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:34.482 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:34.570 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:34.619 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:34.620 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:50:34.620 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:34.685 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-dashboard 2023-12-15T22:50:34.817 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:34.817 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:34.818 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:34.818 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:34.818 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:34.818 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 1/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 3/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-15T22:50:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-15T22:50:34.877 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-15T22:50:34.915 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:34.945 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 32/35 2023-12-15T22:50:34.945 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:34.945 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-15T22:50:34.945 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:34.945 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-15T22:50:34.946 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:35.047 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-immutable-object-cache 2023-12-15T22:50:35.187 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-15T22:50:35.187 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:35.187 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:35.187 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:35.187 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:35.188 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:35.237 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:00 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:35.381 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:35.381 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 1.8 M 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 28 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 15 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Install 7 Packages 2023-12-15T22:50:35.383 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.1 M 2023-12-15T22:50:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 8.7 M 2023-12-15T22:50:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:35.403 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-15T22:50:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 33/35 2023-12-15T22:50:35.422 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:35.422 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-15T22:50:35.422 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:35.422 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-15T22:50:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:35.615 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:59 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:35.624 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:35.647 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 34/35 2023-12-15T22:50:35.647 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:35.647 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-15T22:50:35.648 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:35.648 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-15T22:50:35.648 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:35.713 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:35.759 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.ge787ab71.el9 ceph 141 k 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 141 k 2023-12-15T22:50:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 395 k 2023-12-15T22:50:35.761 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:35.807 INFO:teuthology.orchestra.run.smithi183.stdout:(1/7): ceph-prometheus-alerts-19.0.0-202.ge787a 59 kB/s | 15 kB 00:00 2023-12-15T22:50:35.833 INFO:teuthology.orchestra.run.smithi183.stdout:(2/7): ceph-grafana-dashboards-19.0.0-202.ge787 100 kB/s | 28 kB 00:00 2023-12-15T22:50:35.933 INFO:teuthology.orchestra.run.smithi183.stdout:(3/7): ceph-mgr-dashboard-19.0.0-202.ge787ab71. 4.6 MB/s | 1.8 MB 00:00 2023-12-15T22:50:35.949 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:01 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:35.991 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-immutable-object-cache-19.0.0-202.ge787ab7 614 kB/s | 141 kB 00:00 2023-12-15T22:50:35.991 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:35.992 INFO:teuthology.orchestra.run.smithi188.stdout:Total 609 kB/s | 141 kB 00:00 2023-12-15T22:50:35.992 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:35.999 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:35.999 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:36.025 INFO:teuthology.orchestra.run.smithi183.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 42 kB/s | 9.0 kB 00:00 2023-12-15T22:50:36.050 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:36.051 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:36.095 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:36.096 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================== 2023-12-15T22:50:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================== 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 7.4 M 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-15T22:50:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================== 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout:Install 12 Packages 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:36.098 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 37 M 2023-12-15T22:50:36.099 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 209 M 2023-12-15T22:50:36.099 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:36.184 INFO:teuthology.orchestra.run.smithi183.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 117 kB/s | 41 kB 00:00 2023-12-15T22:50:36.185 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:36.208 INFO:teuthology.orchestra.run.smithi183.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 112 kB/s | 31 kB 00:00 2023-12-15T22:50:36.250 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:36.274 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:36.274 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:36.274 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-15T22:50:36.274 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:36.348 INFO:teuthology.orchestra.run.smithi192.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 254 kB/s | 32 kB 00:00 2023-12-15T22:50:36.373 INFO:teuthology.orchestra.run.smithi192.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 730 kB/s | 17 kB 00:00 2023-12-15T22:50:36.392 INFO:teuthology.orchestra.run.smithi183.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 513 kB/s | 188 kB 00:00 2023-12-15T22:50:36.394 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:36.394 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.0 MB/s | 2.1 MB 00:01 2023-12-15T22:50:36.395 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:36.399 INFO:teuthology.orchestra.run.smithi192.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2023-12-15T22:50:36.403 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:36.403 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:36.449 INFO:teuthology.orchestra.run.smithi192.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-15T22:50:36.468 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:36.469 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:36.583 INFO:teuthology.orchestra.run.smithi192.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-12-15T22:50:36.650 INFO:teuthology.orchestra.run.smithi192.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-12-15T22:50:36.675 INFO:teuthology.orchestra.run.smithi192.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2023-12-15T22:50:36.733 INFO:teuthology.orchestra.run.smithi192.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-15T22:50:36.768 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:36.835 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-15T22:50:36.869 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-15T22:50:36.884 INFO:teuthology.orchestra.run.smithi192.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 67 MB/s | 16 MB 00:00 2023-12-15T22:50:36.909 INFO:teuthology.orchestra.run.smithi192.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-15T22:50:36.923 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-15T22:50:36.964 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-15T22:50:36.994 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 5/7 2023-12-15T22:50:37.051 INFO:teuthology.orchestra.run.smithi192.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-12-15T22:50:37.232 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 6/7 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:37.260 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:37.263 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:37.488 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 35/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:19.0.0-202.ge787ab71.el9.x86_64 1/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 3/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 4/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 5/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.n 6/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-15T22:50:37.489 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-15T22:50:37.490 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-15T22:50:37.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr 2023-12-15T22:50:37.492 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-15T22:50:37.493 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-15T22:50:37.798 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:37.798 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 1/7 2023-12-15T22:50:37.799 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2/7 2023-12-15T22:50:37.799 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 3/7 2023-12-15T22:50:37.799 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-15T22:50:37.799 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-15T22:50:37.799 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-15T22:50:38.057 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:02 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:38.152 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-15T22:50:38.178 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-15T22:50:38.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-15T22:50:38.179 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:38.179 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:38.201 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:38.202 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:50:38.202 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:38.259 INFO:teuthology.orchestra.run.smithi192.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 3.6 MB/s | 7.4 MB 00:02 2023-12-15T22:50:38.263 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:38.263 INFO:teuthology.orchestra.run.smithi192.stdout:Total 17 MB/s | 37 MB 00:02 2023-12-15T22:50:38.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-dashboard 2023-12-15T22:50:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:38.301 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:38.301 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:38.407 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-15T22:50:38.435 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-15T22:50:38.435 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:38.435 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:38.435 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:38.436 INFO:teuthology.orchestra.run.smithi093.stdout: lua-5.4.4-4.el9.x86_64 2023-12-15T22:50:38.437 INFO:teuthology.orchestra.run.smithi093.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-15T22:50:38.437 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-15T22:50:38.437 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-15T22:50:38.437 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-15T22:50:38.437 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-15T22:50:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ply-3.11-14.el9.noarch 2023-12-15T22:50:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-15T22:50:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:38.441 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:38.694 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:38.695 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:38.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-base 2023-12-15T22:50:38.831 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:02 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:38.962 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:03 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:38.974 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 1.8 M 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:38.975 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 28 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 15 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout:Install 7 Packages 2023-12-15T22:50:38.976 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:38.977 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 2.1 M 2023-12-15T22:50:38.977 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 8.7 M 2023-12-15T22:50:38.977 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:39.107 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:39.108 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-12-15T22:50:39.108 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:39.108 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 7.4 M 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-15T22:50:39.109 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Install 12 Packages 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:39.110 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 37 M 2023-12-15T22:50:39.111 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 209 M 2023-12-15T22:50:39.111 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:39.317 INFO:teuthology.orchestra.run.smithi183.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 219 kB/s | 32 kB 00:00 2023-12-15T22:50:39.348 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:00 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:39.350 INFO:teuthology.orchestra.run.smithi183.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 542 kB/s | 17 kB 00:00 2023-12-15T22:50:39.383 INFO:teuthology.orchestra.run.smithi183.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-15T22:50:39.403 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:39.442 INFO:teuthology.orchestra.run.smithi093.stdout:Package ceph-base-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:39.450 INFO:teuthology.orchestra.run.smithi183.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-12-15T22:50:39.470 INFO:teuthology.orchestra.run.smithi188.stdout:(1/7): ceph-grafana-dashboards-19.0.0-202.ge787 86 kB/s | 28 kB 00:00 2023-12-15T22:50:39.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-15T22:50:39.491 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:39.492 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:50:39.492 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:39.503 INFO:teuthology.orchestra.run.smithi188.stdout:(2/7): ceph-prometheus-alerts-19.0.0-202.ge787a 42 kB/s | 15 kB 00:00 2023-12-15T22:50:39.522 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-15T22:50:39.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install cephadm 2023-12-15T22:50:39.609 INFO:teuthology.orchestra.run.smithi183.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-12-15T22:50:39.615 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:39.658 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-15T22:50:39.684 INFO:teuthology.orchestra.run.smithi183.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-12-15T22:50:39.709 INFO:teuthology.orchestra.run.smithi183.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-12-15T22:50:39.776 INFO:teuthology.orchestra.run.smithi183.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-15T22:50:39.839 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:39.868 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:39.870 INFO:teuthology.orchestra.run.smithi188.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 23 kB/s | 9.0 kB 00:00 2023-12-15T22:50:39.927 INFO:teuthology.orchestra.run.smithi183.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-15T22:50:39.952 INFO:teuthology.orchestra.run.smithi183.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-15T22:50:39.952 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-15T22:50:39.970 INFO:teuthology.orchestra.run.smithi188.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 88 kB/s | 41 kB 00:00 2023-12-15T22:50:40.103 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:01 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:40.127 INFO:teuthology.orchestra.run.smithi183.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-12-15T22:50:40.249 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 807 k 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 807 k 2023-12-15T22:50:40.250 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 823 k 2023-12-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:40.371 INFO:teuthology.orchestra.run.smithi188.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 61 kB/s | 31 kB 00:00 2023-12-15T22:50:40.602 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-15T22:50:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 309 kB/s | 188 kB 00:00 2023-12-15T22:50:40.671 INFO:teuthology.orchestra.run.smithi188.stdout:(7/7): ceph-mgr-dashboard-19.0.0-202.ge787ab71. 1.2 MB/s | 1.8 MB 00:01 2023-12-15T22:50:40.674 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:40.674 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.2 MB/s | 2.1 MB 00:01 2023-12-15T22:50:40.674 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:40.682 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:40.682 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:40.712 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-15T22:50:40.746 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:40.746 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:40.955 INFO:teuthology.orchestra.run.smithi093.stdout:cephadm-19.0.0-202.ge787ab71.el9.noarch.rpm 1.1 MB/s | 807 kB 00:00 2023-12-15T22:50:40.956 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:40.957 INFO:teuthology.orchestra.run.smithi093.stdout:Total 1.1 MB/s | 807 kB 00:00 2023-12-15T22:50:40.957 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:40.962 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:40.962 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:40.968 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:40.968 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:41.040 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:41.045 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:41.106 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-15T22:50:41.139 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-15T22:50:41.194 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-15T22:50:41.226 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-15T22:50:41.256 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 5/7 2023-12-15T22:50:41.443 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:41.460 INFO:teuthology.orchestra.run.smithi183.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 3.2 MB/s | 7.4 MB 00:02 2023-12-15T22:50:41.464 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:41.464 INFO:teuthology.orchestra.run.smithi183.stdout:Total 16 MB/s | 37 MB 00:02 2023-12-15T22:50:41.478 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:41.499 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 6/7 2023-12-15T22:50:41.504 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:41.504 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:41.533 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:41.536 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:41.875 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:41.876 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:41.883 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:41.936 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 1/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 3/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-15T22:50:42.070 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-15T22:50:42.184 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:50:42.184 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:42.184 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:42.184 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:42.184 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:42.185 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:42.373 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-immutable-object-cache 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:42.408 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-15T22:50:42.409 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-15T22:50:42.409 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-15T22:50:42.409 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-15T22:50:42.409 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:42.409 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:42.580 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:42.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-15T22:50:42.648 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-15T22:50:42.681 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-15T22:50:42.774 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:42.810 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-15T22:50:42.934 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:03 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:42.958 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-15T22:50:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:43.027 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:43.059 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:43.082 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.ge787ab71.el9 ceph 141 k 2023-12-15T22:50:43.083 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:43.084 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:43.084 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:43.084 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:50:43.084 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:43.085 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 141 k 2023-12-15T22:50:43.085 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 395 k 2023-12-15T22:50:43.085 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:43.139 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-15T22:50:43.202 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:07 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:43.347 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:43.348 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================== 2023-12-15T22:50:43.348 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:43.348 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================== 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 7.4 M 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-15T22:50:43.349 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:=========================================================================================== 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:Install 12 Packages 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 37 M 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 209 M 2023-12-15T22:50:43.350 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:43.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-immutable-object-cache-19.0.0-202.ge787ab7 422 kB/s | 141 kB 00:00 2023-12-15T22:50:43.419 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi093.stdout:Total 420 kB/s | 141 kB 00:00 2023-12-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:43.479 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:43.479 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:43.616 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:43.678 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:43.702 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:43.702 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:50:43.702 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-15T22:50:43.702 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:43.754 INFO:teuthology.orchestra.run.smithi188.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 254 kB/s | 32 kB 00:00 2023-12-15T22:50:43.787 INFO:teuthology.orchestra.run.smithi188.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 537 kB/s | 17 kB 00:00 2023-12-15T22:50:43.792 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-15T22:50:43.854 INFO:teuthology.orchestra.run.smithi188.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-15T22:50:43.879 INFO:teuthology.orchestra.run.smithi188.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 379 kB/s | 34 kB 00:00 2023-12-15T22:50:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-15T22:50:44.005 INFO:teuthology.orchestra.run.smithi188.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 32 MB/s | 4.7 MB 00:00 2023-12-15T22:50:44.072 INFO:teuthology.orchestra.run.smithi188.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-12-15T22:50:44.097 INFO:teuthology.orchestra.run.smithi188.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 217 kB 00:00 2023-12-15T22:50:44.155 INFO:teuthology.orchestra.run.smithi188.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-15T22:50:44.314 INFO:teuthology.orchestra.run.smithi188.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-15T22:50:44.339 INFO:teuthology.orchestra.run.smithi188.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2023-12-15T22:50:44.473 INFO:teuthology.orchestra.run.smithi188.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2023-12-15T22:50:44.631 INFO:teuthology.orchestra.run.smithi188.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 7.4 MB/s | 7.4 MB 00:01 2023-12-15T22:50:44.634 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:44.634 INFO:teuthology.orchestra.run.smithi188.stdout:Total 29 MB/s | 37 MB 00:01 2023-12-15T22:50:44.647 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:44.671 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:44.671 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.e 1/1 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:44.695 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:44.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr 2023-12-15T22:50:45.060 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:45.060 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:45.147 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-15T22:50:45.432 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 1/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-15T22:50:45.433 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-15T22:50:45.487 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:06 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:45.584 INFO:teuthology.orchestra.run.smithi093.stdout:Package ceph-mgr-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:50:45.632 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:45.634 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:50:45.634 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:45.692 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-dashboard 2023-12-15T22:50:45.752 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:45.844 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-15T22:50:45.869 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:45.898 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-15T22:50:45.899 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:45.899 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:45.965 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-15T22:50:46.175 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-15T22:50:46.192 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:46.200 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:46.217 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-rook 2023-12-15T22:50:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:46.241 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:07 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-15T22:50:46.385 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:46.386 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:46.386 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:46.386 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:46.386 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 1.8 M 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 28 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 15 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout:Installing weak dependencies: 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout:Install 7 Packages 2023-12-15T22:50:46.387 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:46.388 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 2.1 M 2023-12-15T22:50:46.388 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 8.7 M 2023-12-15T22:50:46.388 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:46.663 INFO:teuthology.orchestra.run.smithi093.stdout:(1/7): ceph-prometheus-alerts-19.0.0-202.ge787a 78 kB/s | 15 kB 00:00 2023-12-15T22:50:46.688 INFO:teuthology.orchestra.run.smithi093.stdout:(2/7): ceph-grafana-dashboards-19.0.0-202.ge787 129 kB/s | 28 kB 00:00 2023-12-15T22:50:46.772 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:12 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:46.789 INFO:teuthology.orchestra.run.smithi093.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 72 kB/s | 9.0 kB 00:00 2023-12-15T22:50:46.848 INFO:teuthology.orchestra.run.smithi093.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 258 kB/s | 41 kB 00:00 2023-12-15T22:50:46.881 INFO:teuthology.orchestra.run.smithi093.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 335 kB/s | 31 kB 00:00 2023-12-15T22:50:46.914 INFO:teuthology.orchestra.run.smithi093.stdout:(6/7): ceph-mgr-dashboard-19.0.0-202.ge787ab71. 4.0 MB/s | 1.8 MB 00:00 2023-12-15T22:50:46.919 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:46.920 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:46.920 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:46.920 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:46.920 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:46.920 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 50 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:46.921 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout:Install 13 Packages 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 2.0 M 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 26 M 2023-12-15T22:50:46.922 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:46.959 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-15T22:50:46.998 INFO:teuthology.orchestra.run.smithi093.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.2 MB/s | 188 kB 00:00 2023-12-15T22:50:47.000 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:47.000 INFO:teuthology.orchestra.run.smithi093.stdout:Total 3.4 MB/s | 2.1 MB 00:00 2023-12-15T22:50:47.000 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:47.008 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:47.008 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:47.074 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:47.074 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:47.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-15T22:50:47.116 INFO:teuthology.orchestra.run.smithi192.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 207 kB/s | 24 kB 00:00 2023-12-15T22:50:47.141 INFO:teuthology.orchestra.run.smithi192.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 126 kB/s | 18 kB 00:00 2023-12-15T22:50:47.183 INFO:teuthology.orchestra.run.smithi192.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-15T22:50:47.208 INFO:teuthology.orchestra.run.smithi192.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-15T22:50:47.234 INFO:teuthology.orchestra.run.smithi192.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-15T22:50:47.259 INFO:teuthology.orchestra.run.smithi192.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 857 kB/s | 43 kB 00:00 2023-12-15T22:50:47.284 INFO:teuthology.orchestra.run.smithi192.stdout:(7/13): ceph-mgr-rook-19.0.0-202.ge787ab71.el9. 175 kB/s | 50 kB 00:00 2023-12-15T22:50:47.361 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:47.416 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-15T22:50:47.450 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-15T22:50:47.460 INFO:teuthology.orchestra.run.smithi192.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 75 kB/s | 15 kB 00:00 2023-12-15T22:50:47.496 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-15T22:50:47.528 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-15T22:50:47.551 INFO:teuthology.orchestra.run.smithi192.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 101 kB/s | 32 kB 00:00 2023-12-15T22:50:47.558 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 5/7 2023-12-15T22:50:47.685 INFO:teuthology.orchestra.run.smithi192.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 443 kB/s | 59 kB 00:00 2023-12-15T22:50:47.727 INFO:teuthology.orchestra.run.smithi192.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 446 kB/s | 197 kB 00:00 2023-12-15T22:50:47.787 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 6/7 2023-12-15T22:50:47.794 INFO:teuthology.orchestra.run.smithi192.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 829 kB/s | 90 kB 00:00 2023-12-15T22:50:47.818 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:47.828 INFO:teuthology.orchestra.run.smithi192.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.8 MB/s | 1.0 MB 00:00 2023-12-15T22:50:47.832 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:47.832 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-12-15T22:50:47.832 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:47.844 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:47.845 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:47.940 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:47.941 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:48.321 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 7/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.n 1/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.no 3/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-15T22:50:48.330 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-15T22:50:48.447 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:48.613 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:48.613 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 1/12 2023-12-15T22:50:48.613 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-15T22:50:48.614 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-15T22:50:48.624 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:48.635 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-15T22:50:48.636 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-15T22:50:48.636 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-15T22:50:48.636 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-15T22:50:48.636 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:48.636 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:48.678 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-15T22:50:48.759 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-15T22:50:48.796 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-15T22:50:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-15T22:50:48.852 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-15T22:50:48.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-15T22:50:49.030 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-15T22:50:49.053 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-15T22:50:49.053 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-15T22:50:49.054 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:49.055 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:49.081 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-15T22:50:49.347 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-15T22:50:49.380 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:49.403 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:10 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:49.418 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-rook 2023-12-15T22:50:49.548 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================== 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================== 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 7.4 M 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-15T22:50:49.550 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================== 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout:Install 12 Packages 2023-12-15T22:50:49.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:49.552 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 37 M 2023-12-15T22:50:49.552 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 209 M 2023-12-15T22:50:49.552 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-15T22:50:49.853 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-15T22:50:49.886 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-15T22:50:49.934 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-15T22:50:49.957 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:49.963 INFO:teuthology.orchestra.run.smithi093.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 32 kB 00:00 2023-12-15T22:50:49.978 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:14 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:49.988 INFO:teuthology.orchestra.run.smithi093.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 721 kB/s | 17 kB 00:00 2023-12-15T22:50:50.013 INFO:teuthology.orchestra.run.smithi093.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2023-12-15T22:50:50.064 INFO:teuthology.orchestra.run.smithi093.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-15T22:50:50.123 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:50.124 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 50 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-15T22:50:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout:Install 13 Packages 2023-12-15T22:50:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:50.127 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.0 M 2023-12-15T22:50:50.127 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 26 M 2023-12-15T22:50:50.127 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:50.206 INFO:teuthology.orchestra.run.smithi093.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-12-15T22:50:50.273 INFO:teuthology.orchestra.run.smithi093.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-12-15T22:50:50.298 INFO:teuthology.orchestra.run.smithi093.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2023-12-15T22:50:50.410 INFO:teuthology.orchestra.run.smithi183.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 190 kB/s | 24 kB 00:00 2023-12-15T22:50:50.434 INFO:teuthology.orchestra.run.smithi183.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 118 kB/s | 18 kB 00:00 2023-12-15T22:50:50.476 INFO:teuthology.orchestra.run.smithi183.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-15T22:50:50.489 INFO:teuthology.orchestra.run.smithi093.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 72 MB/s | 16 MB 00:00 2023-12-15T22:50:50.502 INFO:teuthology.orchestra.run.smithi183.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-15T22:50:50.523 INFO:teuthology.orchestra.run.smithi093.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2023-12-15T22:50:50.527 INFO:teuthology.orchestra.run.smithi183.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-15T22:50:50.548 INFO:teuthology.orchestra.run.smithi093.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-15T22:50:50.552 INFO:teuthology.orchestra.run.smithi183.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 859 kB/s | 43 kB 00:00 2023-12-15T22:50:50.578 INFO:teuthology.orchestra.run.smithi183.stdout:(7/13): ceph-mgr-rook-19.0.0-202.ge787ab71.el9. 169 kB/s | 50 kB 00:00 2023-12-15T22:50:50.620 INFO:teuthology.orchestra.run.smithi183.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 224 kB/s | 15 kB 00:00 2023-12-15T22:50:50.645 INFO:teuthology.orchestra.run.smithi183.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 274 kB/s | 32 kB 00:00 2023-12-15T22:50:50.699 INFO:teuthology.orchestra.run.smithi093.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-12-15T22:50:50.704 INFO:teuthology.orchestra.run.smithi183.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 1.5 MB/s | 197 kB 00:00 2023-12-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi183.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2023-12-15T22:50:50.754 INFO:teuthology.orchestra.run.smithi183.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2023-12-15T22:50:50.796 INFO:teuthology.orchestra.run.smithi183.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2023-12-15T22:50:50.798 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:50.798 INFO:teuthology.orchestra.run.smithi183.stdout:Total 3.0 MB/s | 2.0 MB 00:00 2023-12-15T22:50:50.798 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:50.811 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:50.811 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 1/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-15T22:50:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-15T22:50:50.882 INFO:teuthology.orchestra.run.smithi093.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 7.0 MB/s | 7.4 MB 00:01 2023-12-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi093.stdout:Total 28 MB/s | 37 MB 00:01 2023-12-15T22:50:50.898 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:50:50.905 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:50.906 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:50.921 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:50:50.921 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:50:51.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-15T22:50:51.203 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:51.203 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:51.203 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:51.203 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:51.204 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:51.298 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:50:51.299 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:50:51.418 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:51.447 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-cephadm 2023-12-15T22:50:51.575 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-15T22:50:51.630 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-15T22:50:51.685 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-15T22:50:51.715 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-15T22:50:51.756 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-15T22:50:51.847 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-15T22:50:51.890 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 1/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-15T22:50:51.891 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-15T22:50:51.966 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-15T22:50:51.987 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:50:52.006 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:18 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:52.016 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-15T22:50:52.073 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-15T22:50:52.103 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-15T22:50:52.152 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 133 k 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:52.153 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:52.154 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2023-12-15T22:50:52.154 INFO:teuthology.orchestra.run.smithi192.stdout:Install 6 Packages 2023-12-15T22:50:52.154 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:52.154 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 6.8 M 2023-12-15T22:50:52.155 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 33 M 2023-12-15T22:50:52.155 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:52.195 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:52.240 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:52.345 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:52.346 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:52.417 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:52.447 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:52.537 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-15T22:50:52.671 INFO:teuthology.orchestra.run.smithi192.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-12-15T22:50:52.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-rook 2023-12-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-15T22:50:52.779 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-15T22:50:52.796 INFO:teuthology.orchestra.run.smithi192.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-15T22:50:52.813 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-15T22:50:52.861 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-15T22:50:52.883 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:52.980 INFO:teuthology.orchestra.run.smithi192.stdout:(3/6): ceph-mgr-cephadm-19.0.0-202.ge787ab71.el 284 kB/s | 133 kB 00:00 2023-12-15T22:50:53.030 INFO:teuthology.orchestra.run.smithi192.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 274 kB/s | 58 kB 00:00 2023-12-15T22:50:53.122 INFO:teuthology.orchestra.run.smithi192.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2023-12-15T22:50:53.179 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-15T22:50:53.206 INFO:teuthology.orchestra.run.smithi192.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 226 kB/s | 51 kB 00:00 2023-12-15T22:50:53.210 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:53.210 INFO:teuthology.orchestra.run.smithi192.stdout:Total 6.4 MB/s | 6.8 MB 00:01 2023-12-15T22:50:53.210 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:53.219 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:53.219 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:53.269 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:17 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:53.300 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-15T22:50:53.307 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:53.307 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:53.414 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 50 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-15T22:50:53.416 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout:Install 13 Packages 2023-12-15T22:50:53.417 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:53.418 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 2.0 M 2023-12-15T22:50:53.418 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 26 M 2023-12-15T22:50:53.418 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:53.583 INFO:teuthology.orchestra.run.smithi188.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 24 kB 00:00 2023-12-15T22:50:53.599 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:53.633 INFO:teuthology.orchestra.run.smithi188.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 113 kB/s | 18 kB 00:00 2023-12-15T22:50:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:53.642 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 1/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-15T22:50:53.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-15T22:50:53.675 INFO:teuthology.orchestra.run.smithi188.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.5 MB/s | 174 kB 00:00 2023-12-15T22:50:53.700 INFO:teuthology.orchestra.run.smithi188.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-15T22:50:53.726 INFO:teuthology.orchestra.run.smithi188.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-15T22:50:53.751 INFO:teuthology.orchestra.run.smithi188.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 859 kB/s | 43 kB 00:00 2023-12-15T22:50:53.762 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-15T22:50:53.816 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-15T22:50:53.885 INFO:teuthology.orchestra.run.smithi188.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 112 kB/s | 15 kB 00:00 2023-12-15T22:50:53.910 INFO:teuthology.orchestra.run.smithi188.stdout:(8/13): ceph-mgr-rook-19.0.0-202.ge787ab71.el9. 115 kB/s | 50 kB 00:00 2023-12-15T22:50:53.935 INFO:teuthology.orchestra.run.smithi188.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 154 kB/s | 32 kB 00:00 2023-12-15T22:50:54.020 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-15T22:50:54.020 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:54.020 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:54.020 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:54.021 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:54.094 INFO:teuthology.orchestra.run.smithi188.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 946 kB/s | 197 kB 00:00 2023-12-15T22:50:54.119 INFO:teuthology.orchestra.run.smithi188.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2023-12-15T22:50:54.161 INFO:teuthology.orchestra.run.smithi188.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2023-12-15T22:50:54.228 INFO:teuthology.orchestra.run.smithi188.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.5 MB/s | 1.0 MB 00:00 2023-12-15T22:50:54.230 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:54.230 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.5 MB/s | 2.0 MB 00:00 2023-12-15T22:50:54.230 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:54.243 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:54.243 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:54.258 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-cephadm 2023-12-15T22:50:54.336 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-15T22:50:54.337 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:54.338 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:54.418 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-15T22:50:54.479 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-15T22:50:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:50:54.530 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-15T22:50:54.819 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:19 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:54.859 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:54.967 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 133 k 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-15T22:50:54.968 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout:Install 6 Packages 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 6.8 M 2023-12-15T22:50:54.969 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 33 M 2023-12-15T22:50:54.970 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:55.041 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-15T22:50:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-15T22:50:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-15T22:50:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-15T22:50:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/6 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-15T22:50:55.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-15T22:50:55.330 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-15T22:50:55.448 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-15T22:50:55.473 INFO:teuthology.orchestra.run.smithi183.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-12-15T22:50:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-15T22:50:55.561 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-15T22:50:55.582 INFO:teuthology.orchestra.run.smithi183.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-12-15T22:50:55.587 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-15T22:50:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:55.618 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:55.699 INFO:teuthology.orchestra.run.smithi183.stdout:(3/6): ceph-mgr-cephadm-19.0.0-202.ge787ab71.el 353 kB/s | 133 kB 00:00 2023-12-15T22:50:55.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-fuse 2023-12-15T22:50:56.107 INFO:teuthology.orchestra.run.smithi183.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 115 kB/s | 58 kB 00:00 2023-12-15T22:50:56.174 INFO:teuthology.orchestra.run.smithi183.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 113 kB/s | 51 kB 00:00 2023-12-15T22:50:56.214 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-15T22:50:56.224 INFO:teuthology.orchestra.run.smithi183.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 731 kB/s | 548 kB 00:00 2023-12-15T22:50:56.228 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:56.228 INFO:teuthology.orchestra.run.smithi183.stdout:Total 5.4 MB/s | 6.8 MB 00:01 2023-12-15T22:50:56.228 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:56.237 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:56.237 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:56.270 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-15T22:50:56.304 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-15T22:50:56.326 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:50:56.328 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:50:56.352 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-15T22:50:56.374 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:56.405 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:22 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:56.550 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 859 k 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout:Install 2 Packages 2023-12-15T22:50:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:56.552 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 938 k 2023-12-15T22:50:56.552 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 2.7 M 2023-12-15T22:50:56.552 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:56.629 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:50:56.674 INFO:teuthology.orchestra.run.smithi192.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 646 kB/s | 79 kB 00:00 2023-12-15T22:50:56.797 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-15T22:50:56.851 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-15T22:50:56.899 INFO:teuthology.orchestra.run.smithi192.stdout:(2/2): ceph-fuse-19.0.0-202.ge787ab71.el9.x86_6 2.4 MB/s | 859 kB 00:00 2023-12-15T22:50:56.901 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:56.901 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.6 MB/s | 938 kB 00:00 2023-12-15T22:50:56.901 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:56.921 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:56.921 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:56.997 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:56.998 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:57.180 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 1/13 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-15T22:50:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-15T22:50:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-15T22:50:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-15T22:50:57.361 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-15T22:50:57.391 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:50:57.445 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-15T22:50:57.573 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:57.574 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:50:57.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-cephadm 2023-12-15T22:50:58.052 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:50:58.052 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/2 2023-12-15T22:50:58.057 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 12/12 2023-12-15T22:50:58.057 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab 1/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-15T22:50:58.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-15T22:50:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:50:58.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/6 2023-12-15T22:50:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-15T22:50:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-15T22:50:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-15T22:50:58.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-15T22:50:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:22 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:58.400 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:50:58.491 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-15T22:50:58.492 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:50:58.528 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:50:58.528 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:58.528 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 133 k 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:58.529 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:Install 6 Packages 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 6.8 M 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 33 M 2023-12-15T22:50:58.530 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:50:58.666 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-volume 2023-12-15T22:50:58.666 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-15T22:50:58.666 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:58.666 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:50:58.666 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:58.667 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:50:58.764 INFO:teuthology.orchestra.run.smithi188.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-12-15T22:50:58.852 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-rook 2023-12-15T22:50:58.864 INFO:teuthology.orchestra.run.smithi188.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-12-15T22:50:58.908 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-fuse 2023-12-15T22:50:58.973 INFO:teuthology.orchestra.run.smithi188.stdout:(3/6): ceph-mgr-cephadm-19.0.0-202.ge787ab71.el 368 kB/s | 133 kB 00:00 2023-12-15T22:50:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 169 kB/s | 58 kB 00:00 2023-12-15T22:50:59.240 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:25 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:50:59.307 INFO:teuthology.orchestra.run.smithi188.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 153 kB/s | 51 kB 00:00 2023-12-15T22:50:59.386 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 262 k 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:50:59.387 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 262 k 2023-12-15T22:50:59.388 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 1.2 M 2023-12-15T22:50:59.388 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:50:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 854 kB/s | 548 kB 00:00 2023-12-15T22:50:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:Total 7.7 MB/s | 6.8 MB 00:00 2023-12-15T22:50:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:50:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:20 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:50:59.418 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:50:59.418 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:50:59.461 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:24 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:50:59.507 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:50:59.507 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:50:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 50 k 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-15T22:50:59.556 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:Install 13 Packages 2023-12-15T22:50:59.557 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:50:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 2.0 M 2023-12-15T22:50:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 26 M 2023-12-15T22:50:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:50:59.608 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:50:59.608 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:59.608 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:50:59.608 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:59.608 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 859 k 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout:Install 2 Packages 2023-12-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 938 k 2023-12-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.7 M 2023-12-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:50:59.670 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-volume-19.0.0-202.ge787ab71.el9.noarch.rpm 931 kB/s | 262 kB 00:00 2023-12-15T22:50:59.670 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:59.671 INFO:teuthology.orchestra.run.smithi192.stdout:Total 926 kB/s | 262 kB 00:00 2023-12-15T22:50:59.671 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:50:59.678 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:50:59.679 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:50:59.712 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:50:59.713 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:50:59.726 INFO:teuthology.orchestra.run.smithi183.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 678 kB/s | 79 kB 00:00 2023-12-15T22:50:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:50:59.909 INFO:teuthology.orchestra.run.smithi183.stdout:(2/2): ceph-fuse-19.0.0-202.ge787ab71.el9.x86_6 2.8 MB/s | 859 kB 00:00 2023-12-15T22:50:59.911 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:50:59.911 INFO:teuthology.orchestra.run.smithi183.stdout:Total 3.0 MB/s | 938 kB 00:00 2023-12-15T22:50:59.911 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:50:59.931 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:50:59.931 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:50:59.932 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:50:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-15T22:51:00.006 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:00.006 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:00.008 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-15T22:51:00.014 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:00.029 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:00.029 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:00.030 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-15T22:51:00.030 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 24 kB 00:00 2023-12-15T22:51:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 129 kB/s | 18 kB 00:00 2023-12-15T22:51:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-15T22:51:00.128 INFO:teuthology.orchestra.run.smithi093.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-15T22:51:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.9 MB/s | 211 kB 00:00 2023-12-15T22:51:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2023-12-15T22:51:00.187 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:(7/13): ceph-mgr-rook-19.0.0-202.ge787ab71.el9. 183 kB/s | 50 kB 00:00 2023-12-15T22:51:00.326 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-15T22:51:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2023-12-15T22:51:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2023-12-15T22:51:00.392 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 622 kB/s | 197 kB 00:00 2023-12-15T22:51:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2023-12-15T22:51:00.553 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-15T22:51:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 976 kB/s | 90 kB 00:00 2023-12-15T22:51:00.636 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-15T22:51:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2023-12-15T22:51:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2023-12-15T22:51:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:00.704 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-15T22:51:00.729 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:51:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:01.047 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:01.047 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:01.047 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:01.048 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:01.048 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:01.048 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:01.079 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:01.079 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/2 2023-12-15T22:51:01.306 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:01.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados-devel 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:01.399 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-15T22:51:01.523 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-15T22:51:01.539 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:51:01.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/6 2023-12-15T22:51:01.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-15T22:51:01.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-15T22:51:01.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-15T22:51:01.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-15T22:51:01.578 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-15T22:51:01.608 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-15T22:51:01.649 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-15T22:51:01.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-volume 2023-12-15T22:51:01.740 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-15T22:51:01.842 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-15T22:51:01.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-15T22:51:01.855 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:01.855 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:01.855 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:01.855 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:01.856 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:01.891 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-15T22:51:01.961 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:27 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:02.107 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 126 k 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 126 k 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 456 k 2023-12-15T22:51:02.108 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:51:02.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-fuse 2023-12-15T22:51:02.222 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:27 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:02.359 INFO:teuthology.orchestra.run.smithi192.stdout:librados-devel-19.0.0-202.ge787ab71.el9.x86_64. 506 kB/s | 126 kB 00:00 2023-12-15T22:51:02.359 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:02.360 INFO:teuthology.orchestra.run.smithi192.stdout:Total 503 kB/s | 126 kB 00:00 2023-12-15T22:51:02.360 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:51:02.365 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:51:02.365 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:51:02.368 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 262 k 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 262 k 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.2 M 2023-12-15T22:51:02.369 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:02.420 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:51:02.421 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:51:02.560 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:51:02.605 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-15T22:51:02.622 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-volume-19.0.0-202.ge787ab71.el9.noarch.rpm 1.0 MB/s | 262 kB 00:00 2023-12-15T22:51:02.622 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:02.623 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.0 MB/s | 262 kB 00:00 2023-12-15T22:51:02.623 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:02.630 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:02.631 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:02.647 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-15T22:51:02.657 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:02.665 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:26 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:02.667 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:02.667 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:02.680 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-15T22:51:02.727 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-15T22:51:02.750 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:02.811 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 859 k 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 938 k 2023-12-15T22:51:02.812 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 2.7 M 2023-12-15T22:51:02.813 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:02.876 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:02.925 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 699 kB/s | 79 kB 00:00 2023-12-15T22:51:02.949 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:02.965 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:02.965 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:02.965 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-15T22:51:02.965 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:03.117 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): ceph-fuse-19.0.0-202.ge787ab71.el9.x86_6 2.8 MB/s | 859 kB 00:00 2023-12-15T22:51:03.119 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:03.119 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.0 MB/s | 938 kB 00:00 2023-12-15T22:51:03.119 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:03.128 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:03.139 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:03.139 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:03.400 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:03.457 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:03.457 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:03.457 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:03.457 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:03.457 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:03.458 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:03.550 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 13/13 2023-12-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 1/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-15T22:51:03.626 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:03.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs2 2023-12-15T22:51:03.929 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-15T22:51:03.929 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:03.929 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:03.929 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:03.929 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:03.930 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:03.964 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:04.164 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-cephadm 2023-12-15T22:51:04.256 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados-devel 2023-12-15T22:51:04.304 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:30 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/2 2023-12-15T22:51:04.401 INFO:teuthology.orchestra.run.smithi192.stdout:Package libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:04.450 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:04.451 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:04.451 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:04.513 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs-devel 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:04.671 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:04.718 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:25 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:04.843 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:29 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:04.862 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 133 k 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-15T22:51:04.863 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout:======================================================================================= 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout:Install 6 Packages 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:04.864 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 6.8 M 2023-12-15T22:51:04.865 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 33 M 2023-12-15T22:51:04.865 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:04.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-volume 2023-12-15T22:51:04.990 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 126 k 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 126 k 2023-12-15T22:51:04.992 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 456 k 2023-12-15T22:51:04.992 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:05.064 INFO:teuthology.orchestra.run.smithi093.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-12-15T22:51:05.072 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:31 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:05.198 INFO:teuthology.orchestra.run.smithi093.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-15T22:51:05.218 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:05.218 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 31 k 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:51:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:05.220 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 31 k 2023-12-15T22:51:05.220 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 140 k 2023-12-15T22:51:05.220 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:51:05.290 INFO:teuthology.orchestra.run.smithi093.stdout:(3/6): ceph-mgr-cephadm-19.0.0-202.ge787ab71.el 352 kB/s | 133 kB 00:00 2023-12-15T22:51:05.335 INFO:teuthology.orchestra.run.smithi183.stdout:librados-devel-19.0.0-202.ge787ab71.el9.x86_64. 368 kB/s | 126 kB 00:00 2023-12-15T22:51:05.336 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:05.336 INFO:teuthology.orchestra.run.smithi183.stdout:Total 366 kB/s | 126 kB 00:00 2023-12-15T22:51:05.336 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:05.342 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:05.342 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:05.386 INFO:teuthology.orchestra.run.smithi192.stdout:libcephfs-devel-19.0.0-202.ge787ab71.el9.x86_64 187 kB/s | 31 kB 00:00 2023-12-15T22:51:05.387 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:05.387 INFO:teuthology.orchestra.run.smithi192.stdout:Total 185 kB/s | 31 kB 00:00 2023-12-15T22:51:05.387 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:51:05.391 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:51:05.391 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:51:05.398 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:05.398 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:05.420 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:51:05.420 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:51:05.510 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:51:05.537 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:29 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:05.618 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:05.643 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:05.681 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:05.682 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:05.682 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-15T22:51:05.682 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:05.682 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:05.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 262 k 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 262 k 2023-12-15T22:51:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 1.2 M 2023-12-15T22:51:05.684 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:05.690 INFO:teuthology.orchestra.run.smithi093.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 123 kB/s | 58 kB 00:00 2023-12-15T22:51:05.740 INFO:teuthology.orchestra.run.smithi093.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 113 kB/s | 51 kB 00:00 2023-12-15T22:51:05.857 INFO:teuthology.orchestra.run.smithi093.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 692 kB/s | 548 kB 00:00 2023-12-15T22:51:05.861 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:05.862 INFO:teuthology.orchestra.run.smithi093.stdout:Total 6.8 MB/s | 6.8 MB 00:00 2023-12-15T22:51:05.862 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:05.871 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:05.871 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:05.931 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-volume-19.0.0-202.ge787ab71.el9.noarch.rpm 1.0 MB/s | 262 kB 00:00 2023-12-15T22:51:05.931 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:05.931 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.0 MB/s | 262 kB 00:00 2023-12-15T22:51:05.932 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:05.939 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:05.939 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:05.960 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:05.960 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:05.972 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:05.972 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:06.101 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:06.240 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:06.273 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:06.297 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:06.298 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:06.298 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:06.298 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:06.298 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:06.298 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:06.407 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:06.408 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:06.408 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:06.408 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:06.408 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:06.408 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:06.455 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-15T22:51:06.484 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados2 2023-12-15T22:51:06.509 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-15T22:51:06.663 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs2 2023-12-15T22:51:07.038 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-15T22:51:07.042 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:33 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-15T22:51:07.136 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:07.186 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:07.187 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:07.187 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:07.188 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-15T22:51:07.213 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:51:07.230 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:32 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:07.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librbd1 2023-12-15T22:51:07.328 INFO:teuthology.orchestra.run.smithi183.stdout:Package libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:07.354 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:07.380 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:07.381 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:07.382 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:07.450 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs-devel 2023-12-15T22:51:07.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados-devel 2023-12-15T22:51:07.806 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:33 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:07.900 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:07.951 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:07.952 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:07.952 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:08.010 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:33 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:08.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rados 2023-12-15T22:51:08.029 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 6/6 2023-12-15T22:51:08.029 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 1/6 2023-12-15T22:51:08.029 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-15T22:51:08.030 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-15T22:51:08.030 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-15T22:51:08.030 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-15T22:51:08.156 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 31 k 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:08.157 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:08.158 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 31 k 2023-12-15T22:51:08.158 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 140 k 2023-12-15T22:51:08.158 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:08.248 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:32 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:08.345 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:08.395 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 126 k 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 126 k 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 456 k 2023-12-15T22:51:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:08.397 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs-devel-19.0.0-202.ge787ab71.el9.x86_64 130 kB/s | 31 kB 00:00 2023-12-15T22:51:08.398 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:08.398 INFO:teuthology.orchestra.run.smithi183.stdout:Total 129 kB/s | 31 kB 00:00 2023-12-15T22:51:08.398 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:08.402 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:08.402 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:08.430 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:08.430 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:08.522 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:08.570 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:34 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:08.579 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-fuse 2023-12-15T22:51:08.628 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:08.664 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:08.713 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:08.714 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:08.714 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:08.719 INFO:teuthology.orchestra.run.smithi188.stdout:librados-devel-19.0.0-202.ge787ab71.el9.x86_64. 392 kB/s | 126 kB 00:00 2023-12-15T22:51:08.720 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:08.720 INFO:teuthology.orchestra.run.smithi188.stdout:Total 390 kB/s | 126 kB 00:00 2023-12-15T22:51:08.720 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:08.726 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:08.726 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:08.779 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rgw 2023-12-15T22:51:08.781 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:08.782 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:08.920 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:09.009 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:09.026 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:09.131 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:30 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:09.271 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:09.276 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:09.276 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:09.276 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:51:09.276 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 859 k 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout:Install 2 Packages 2023-12-15T22:51:09.277 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:09.278 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 938 k 2023-12-15T22:51:09.278 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 2.7 M 2023-12-15T22:51:09.278 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:09.335 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:35 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:09.392 INFO:teuthology.orchestra.run.smithi093.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 694 kB/s | 79 kB 00:00 2023-12-15T22:51:09.429 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:09.448 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2 2023-12-15T22:51:09.479 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:09.481 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:09.482 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:09.483 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:09.548 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-cephfs 2023-12-15T22:51:09.608 INFO:teuthology.orchestra.run.smithi093.stdout:(2/2): ceph-fuse-19.0.0-202.ge787ab71.el9.x86_6 2.5 MB/s | 859 kB 00:00 2023-12-15T22:51:09.610 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:09.610 INFO:teuthology.orchestra.run.smithi093.stdout:Total 2.8 MB/s | 938 kB 00:00 2023-12-15T22:51:09.610 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:09.630 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:09.630 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:09.704 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:09.705 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:09.809 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:09.878 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:10.003 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:35 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:10.015 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-15T22:51:10.063 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs2 2023-12-15T22:51:10.091 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:10.096 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:10.106 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:36 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:10.147 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:10.148 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:10.148 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:10.201 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:10.214 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librbd1 2023-12-15T22:51:10.252 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:10.253 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:10.253 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:10.315 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rbd 2023-12-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:34 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:10.721 INFO:teuthology.orchestra.run.smithi188.stdout:Package libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:10.769 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:35 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:10.771 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:10.772 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:10.772 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:10.812 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2/2 2023-12-15T22:51:10.812 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/2 2023-12-15T22:51:10.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs-devel 2023-12-15T22:51:10.863 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:10.873 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:36 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:10.914 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:10.915 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:10.915 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:10.967 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:10.983 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rados 2023-12-15T22:51:11.017 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:11.018 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-12-15T22:51:11.018 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:11.086 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-fuse 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:11.123 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:11.382 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-volume 2023-12-15T22:51:11.401 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:35 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:11.542 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:36 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:11.548 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:11.548 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:11.548 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2023-12-15T22:51:11.548 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:11.548 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 31 k 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:11.549 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:11.550 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 31 k 2023-12-15T22:51:11.550 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 140 k 2023-12-15T22:51:11.550 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:11.635 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:11.641 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:37 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:11.685 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:11.686 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:11.686 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:11.759 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rgw 2023-12-15T22:51:11.784 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 85 k 2023-12-15T22:51:11.785 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 85 k 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 231 k 2023-12-15T22:51:11.786 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:51:11.939 INFO:teuthology.orchestra.run.smithi188.stdout:libcephfs-devel-19.0.0-202.ge787ab71.el9.x86_64 80 kB/s | 31 kB 00:00 2023-12-15T22:51:11.940 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:11.940 INFO:teuthology.orchestra.run.smithi188.stdout:Total 80 kB/s | 31 kB 00:00 2023-12-15T22:51:11.940 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:11.943 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:11.943 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:11.949 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:32 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:11.976 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:11.976 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:12.007 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-fuse-19.0.0-202.ge787ab71.el9.x86_64.rpm 385 kB/s | 85 kB 00:00 2023-12-15T22:51:12.007 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:12.008 INFO:teuthology.orchestra.run.smithi192.stdout:Total 382 kB/s | 85 kB 00:00 2023-12-15T22:51:12.008 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:51:12.015 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:51:12.015 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:51:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:12.068 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:51:12.069 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:51:12.093 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:12.093 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:12.093 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume noarch 2:19.0.0-202.ge787ab71.el9 ceph-noarch 262 k 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:12.094 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:12.095 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 262 k 2023-12-15T22:51:12.095 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 1.2 M 2023-12-15T22:51:12.095 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:12.170 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:12.210 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:51:12.305 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:12.315 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:37 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:12.410 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:12.460 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:12.460 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:12.461 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:12.539 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-cephfs 2023-12-15T22:51:12.557 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:12.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-volume-19.0.0-202.ge787ab71.el9.noarch.rpm 490 kB/s | 262 kB 00:00 2023-12-15T22:51:12.631 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:12.631 INFO:teuthology.orchestra.run.smithi093.stdout:Total 488 kB/s | 262 kB 00:00 2023-12-15T22:51:12.632 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:12.639 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:12.640 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:12.674 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:12.674 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:12.721 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:12.835 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:12.890 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:12.965 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:12.981 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:12.982 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:12.982 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-15T22:51:12.982 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:12.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados2 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:13.055 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:38 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:13.189 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:13.239 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:13.240 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:13.240 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:13.274 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-mirror 2023-12-15T22:51:13.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rbd 2023-12-15T22:51:13.551 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:37 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:13.644 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:13.694 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:13.695 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:13.695 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:13.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librbd1 2023-12-15T22:51:13.840 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:39 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:13.870 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:38 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:13.963 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:13.987 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:13.987 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:13.987 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:13.988 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 3.0 M 2023-12-15T22:51:13.989 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 12 M 2023-12-15T22:51:13.989 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:51:14.013 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:14.014 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-12-15T22:51:14.014 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 1/1 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume-2:19.0.0-202.ge787ab71.el9.noarch 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:14.018 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:14.083 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-fuse 2023-12-15T22:51:14.312 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librados-devel 2023-12-15T22:51:14.321 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:38 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:14.376 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-mirror-19.0.0-202.ge787ab71.el9.x86_64.rpm 7.8 MB/s | 3.0 MB 00:00 2023-12-15T22:51:14.376 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:14.377 INFO:teuthology.orchestra.run.smithi192.stdout:Total 7.7 MB/s | 3.0 MB 00:00 2023-12-15T22:51:14.377 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:51:14.386 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:51:14.386 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:51:14.417 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:14.458 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:51:14.458 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:51:14.467 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:14.468 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:14.468 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:14.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rados 2023-12-15T22:51:14.641 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:39 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:14.785 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 85 k 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 85 k 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 231 k 2023-12-15T22:51:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:35 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:14.886 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:51:14.944 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:14.967 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:14.967 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-15T22:51:14.967 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:14.967 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:15.017 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse-19.0.0-202.ge787ab71.el9.x86_64.rpm 369 kB/s | 85 kB 00:00 2023-12-15T22:51:15.017 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:15.018 INFO:teuthology.orchestra.run.smithi183.stdout:Total 367 kB/s | 85 kB 00:00 2023-12-15T22:51:15.018 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:15.024 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:15.024 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:15.026 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 126 k 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 126 k 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 456 k 2023-12-15T22:51:15.027 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:15.079 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:15.079 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:15.093 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:39 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:15.186 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:15.225 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:15.236 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:15.237 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:15.237 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:15.259 INFO:teuthology.orchestra.run.smithi093.stdout:librados-devel-19.0.0-202.ge787ab71.el9.x86_64. 546 kB/s | 126 kB 00:00 2023-12-15T22:51:15.260 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:15.260 INFO:teuthology.orchestra.run.smithi093.stdout:Total 543 kB/s | 126 kB 00:00 2023-12-15T22:51:15.260 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:15.266 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:15.266 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:15.306 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rgw 2023-12-15T22:51:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:15.333 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:15.468 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:15.575 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:15.712 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:15.859 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:39 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:15.954 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:16.004 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:16.005 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:16.005 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:16.012 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:16.017 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:16.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-cephfs 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:16.081 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:16.209 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-mirror 2023-12-15T22:51:16.337 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-nbd 2023-12-15T22:51:16.343 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:16.343 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:16.343 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:16.343 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:16.344 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:16.344 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:16.578 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install libcephfs2 2023-12-15T22:51:16.627 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:40 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:16.772 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:16.773 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:16.773 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:16.777 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:41 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:16.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rbd 2023-12-15T22:51:16.900 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:42 ago on Fri 15 Dec 2023 10:49:34 PM UTC. 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:51:16.927 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 3.0 M 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 12 M 2023-12-15T22:51:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:17.043 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 170 k 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-12-15T22:51:17.044 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:17.045 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 170 k 2023-12-15T22:51:17.045 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 490 k 2023-12-15T22:51:17.045 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-12-15T22:51:17.139 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:38 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:17.237 INFO:teuthology.orchestra.run.smithi093.stdout:Package libcephfs2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:17.288 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:17.288 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-nbd-19.0.0-202.ge787ab71.el9.x86_64.rpm 700 kB/s | 170 kB 00:00 2023-12-15T22:51:17.289 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:17.289 INFO:teuthology.orchestra.run.smithi192.stdout:Total 696 kB/s | 170 kB 00:00 2023-12-15T22:51:17.289 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-12-15T22:51:17.289 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:17.289 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:17.297 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-12-15T22:51:17.297 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-12-15T22:51:17.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install libcephfs-devel 2023-12-15T22:51:17.353 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-12-15T22:51:17.353 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-12-15T22:51:17.394 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:41 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:17.489 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:17.509 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-12-15T22:51:17.539 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:17.540 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2023-12-15T22:51:17.540 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:17.594 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:17.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-fuse 2023-12-15T22:51:17.854 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-mirror-19.0.0-202.ge787ab71.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2023-12-15T22:51:17.854 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:17.855 INFO:teuthology.orchestra.run.smithi183.stdout:Total 3.2 MB/s | 3.0 MB 00:00 2023-12-15T22:51:17.855 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:17.864 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:17.865 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:17.903 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:38 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:17.938 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:17.938 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:18.038 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.049 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:19.0.0-202.ge787ab71.el9 ceph 31 k 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 31 k 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 140 k 2023-12-15T22:51:18.050 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:18.156 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:42 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:18.287 INFO:teuthology.orchestra.run.smithi093.stdout:libcephfs-devel-19.0.0-202.ge787ab71.el9.x86_64 132 kB/s | 31 kB 00:00 2023-12-15T22:51:18.287 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:18.287 INFO:teuthology.orchestra.run.smithi093.stdout:Total 131 kB/s | 31 kB 00:00 2023-12-15T22:51:18.287 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:18.292 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:18.292 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 85 k 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 85 k 2023-12-15T22:51:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 231 k 2023-12-15T22:51:18.303 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:18.319 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:18.320 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:18.339 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-12-15T22:51:18.360 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:18.409 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:18.429 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.453 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.453 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:18.453 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-15T22:51:18.453 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:18.453 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:18.454 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:18.509 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.510 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-fuse-19.0.0-202.ge787ab71.el9.x86_64.rpm 411 kB/s | 85 kB 00:00 2023-12-15T22:51:18.510 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:18.510 INFO:teuthology.orchestra.run.smithi188.stdout:Total 409 kB/s | 85 kB 00:00 2023-12-15T22:51:18.510 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:18.517 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:18.517 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:18.565 DEBUG:teuthology.parallel:result is None 2023-12-15T22:51:18.571 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:18.571 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:18.745 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:18.848 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:18.872 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:19.147 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:19.224 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:19.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librados2 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:19.536 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:19.580 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:19.580 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:19.581 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:19.581 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:19.581 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:19.581 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:19.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-mirror 2023-12-15T22:51:19.839 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-nbd 2023-12-15T22:51:19.861 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:40 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:19.954 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:20.004 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:20.005 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:20.005 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:20.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librbd1 2023-12-15T22:51:20.331 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:44 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:20.405 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:45 ago on Fri 15 Dec 2023 10:49:35 PM UTC. 2023-12-15T22:51:20.482 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:20.484 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 3.0 M 2023-12-15T22:51:20.484 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 12 M 2023-12-15T22:51:20.484 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:20.549 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 170 k 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-12-15T22:51:20.550 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-12-15T22:51:20.551 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-12-15T22:51:20.551 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:20.551 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 170 k 2023-12-15T22:51:20.551 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 490 k 2023-12-15T22:51:20.551 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-12-15T22:51:20.625 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:41 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:20.718 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:20.765 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-nbd-19.0.0-202.ge787ab71.el9.x86_64.rpm 795 kB/s | 170 kB 00:00 2023-12-15T22:51:20.766 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:20.766 INFO:teuthology.orchestra.run.smithi183.stdout:Total 790 kB/s | 170 kB 00:00 2023-12-15T22:51:20.766 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-12-15T22:51:20.769 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:20.770 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:20.770 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:20.774 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-12-15T22:51:20.774 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-12-15T22:51:20.828 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rados 2023-12-15T22:51:20.829 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-12-15T22:51:20.830 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-12-15T22:51:20.974 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-12-15T22:51:21.081 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:21.238 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-mirror-19.0.0-202.ge787ab71.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2023-12-15T22:51:21.239 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:21.239 INFO:teuthology.orchestra.run.smithi188.stdout:Total 4.0 MB/s | 3.0 MB 00:00 2023-12-15T22:51:21.239 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:21.248 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:21.248 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:21.320 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:21.320 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:21.387 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:42 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:21.491 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rados-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:21.537 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:21.543 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:21.544 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:21.544 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:21.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rgw 2023-12-15T22:51:21.745 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:21.814 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:21.837 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:21.839 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:22.054 DEBUG:teuthology.parallel:result is None 2023-12-15T22:51:22.154 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:43 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:22.247 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rgw-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:22.296 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:22.297 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:22.297 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:22.352 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-cephfs 2023-12-15T22:51:22.903 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:43 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:22.984 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:22.984 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:22.985 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:22.985 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:22.985 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:22.985 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:22.998 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-cephfs-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:23.048 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:23.049 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:23.050 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:23.120 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rbd 2023-12-15T22:51:23.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-nbd 2023-12-15T22:51:23.670 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:44 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:23.763 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rbd-2:19.0.0-202.ge787ab71.el9.x86_64 is already installed. 2023-12-15T22:51:23.781 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:47 ago on Fri 15 Dec 2023 10:49:36 PM UTC. 2023-12-15T22:51:23.813 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:23.814 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-15T22:51:23.814 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:23.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-fuse 2023-12-15T22:51:23.926 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-15T22:51:23.926 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:23.926 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 170 k 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:23.927 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 170 k 2023-12-15T22:51:23.928 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 490 k 2023-12-15T22:51:23.928 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-15T22:51:24.158 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-nbd-19.0.0-202.ge787ab71.el9.x86_64.rpm 738 kB/s | 170 kB 00:00 2023-12-15T22:51:24.159 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:24.159 INFO:teuthology.orchestra.run.smithi188.stdout:Total 733 kB/s | 170 kB 00:00 2023-12-15T22:51:24.159 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-15T22:51:24.167 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-15T22:51:24.167 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-15T22:51:24.222 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-15T22:51:24.223 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-15T22:51:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-15T22:51:24.432 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:45 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:24.472 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:24.577 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:24.578 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:24.578 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:24.578 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:24.578 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:24.578 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:19.0.0-202.ge787ab71.el9 ceph 85 k 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 85 k 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 231 k 2023-12-15T22:51:24.579 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:24.789 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-fuse-19.0.0-202.ge787ab71.el9.x86_64.rpm 404 kB/s | 85 kB 00:00 2023-12-15T22:51:24.790 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:24.790 INFO:teuthology.orchestra.run.smithi093.stdout:Total 401 kB/s | 85 kB 00:00 2023-12-15T22:51:24.790 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:24.797 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:24.797 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:24.851 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:24.851 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:25.004 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:25.112 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-15T22:51:25.479 DEBUG:teuthology.parallel:result is None 2023-12-15T22:51:25.489 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:25.838 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:25.838 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:25.838 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:25.838 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:25.838 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:25.839 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:26.052 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-mirror 2023-12-15T22:51:26.627 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:47 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:26.780 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:19.0.0-202.ge787ab71.el9 ceph 3.0 M 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 3.0 M 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 12 M 2023-12-15T22:51:26.781 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:27.542 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-mirror-19.0.0-202.ge787ab71.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2023-12-15T22:51:27.542 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:27.543 INFO:teuthology.orchestra.run.smithi093.stdout:Total 3.9 MB/s | 3.0 MB 00:00 2023-12-15T22:51:27.543 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:27.552 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:27.552 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:27.626 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:28.052 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:28.134 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:28.134 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-15T22:51:28.134 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-15T22:51:28.134 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:28.134 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-15T22:51:28.135 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:29.283 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:29.283 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:29.283 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:29.283 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:29.284 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:29.284 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:29.521 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-nbd 2023-12-15T22:51:30.084 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:51 ago on Fri 15 Dec 2023 10:49:39 PM UTC. 2023-12-15T22:51:30.229 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:19.0.0-202.ge787ab71.el9 ceph 170 k 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 170 k 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 490 k 2023-12-15T22:51:30.230 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-15T22:51:30.461 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-nbd-19.0.0-202.ge787ab71.el9.x86_64.rpm 738 kB/s | 170 kB 00:00 2023-12-15T22:51:30.462 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-15T22:51:30.462 INFO:teuthology.orchestra.run.smithi093.stdout:Total 733 kB/s | 170 kB 00:00 2023-12-15T22:51:30.462 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-15T22:51:30.470 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-15T22:51:30.470 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-15T22:51:30.525 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-15T22:51:30.526 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-15T22:51:30.683 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-15T22:51:30.785 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:31.219 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 1/1 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:19.0.0-202.ge787ab71.el9.x86_64 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:31.522 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-15T22:51:31.726 DEBUG:teuthology.parallel:result is None 2023-12-15T22:51:31.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:51:31.875 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-15T22:51:31.895 INFO:teuthology.orchestra.run.smithi093.stdout:19.0.0-202.ge787ab71.el9 2023-12-15T22:51:31.896 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.ge787ab71.el9 2023-12-15T22:51:31.896 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.ge787ab71 is installed. 2023-12-15T22:51:31.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:51:32.114 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-15T22:51:32.139 INFO:teuthology.orchestra.run.smithi183.stdout:19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.139 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.139 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.ge787ab71 is installed. 2023-12-15T22:51:32.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:51:32.295 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-15T22:51:32.320 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.320 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.320 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.ge787ab71 is installed. 2023-12-15T22:51:32.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e787ab71a54a65a1c318d8bb7b1e65f35409fcd9 2023-12-15T22:51:32.461 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-15T22:51:32.486 INFO:teuthology.orchestra.run.smithi192.stdout:19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.486 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.ge787ab71.el9 2023-12-15T22:51:32.486 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.ge787ab71 is installed. 2023-12-15T22:51:32.487 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-15T22:51:32.487 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:32.488 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-15T22:51:32.515 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:32.515 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-15T22:51:32.548 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:32.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-15T22:51:32.580 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:32.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-15T22:51:32.613 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-15T22:51:32.613 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:32.613 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-12-15T22:51:32.640 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-15T22:51:32.707 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:32.707 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-12-15T22:51:32.738 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-15T22:51:32.809 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:32.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2023-12-15T22:51:32.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-15T22:51:32.911 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:32.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-12-15T22:51:32.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-15T22:51:33.011 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-15T22:51:33.011 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:33.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-15T22:51:33.038 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-15T22:51:33.106 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:33.106 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-15T22:51:33.135 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-15T22:51:33.202 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:33.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-15T22:51:33.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-15T22:51:33.303 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:33.303 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-15T22:51:33.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-15T22:51:33.400 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-15T22:51:33.400 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:33.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-12-15T22:51:33.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-15T22:51:33.494 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:33.494 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-12-15T22:51:33.522 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-15T22:51:33.589 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:33.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2023-12-15T22:51:33.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-15T22:51:33.689 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:33.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-12-15T22:51:33.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-15T22:51:33.782 INFO:teuthology.run_tasks:Running task ceph... 2023-12-15T22:51:33.848 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-15T22:51:33.849 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2023-12-15T22:51:33.851 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-12-15T22:51:33.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2023-12-15T22:51:33.855 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-12-15T22:51:33.882 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-15T22:51:33.883 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-15T22:51:33.918 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-15T22:51:33.920 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-15T22:51:33.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-15T22:51:33.952 INFO:tasks.ceph:Creating extra log directories... 2023-12-15T22:51:33.952 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-15T22:51:33.985 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-15T22:51:33.988 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-15T22:51:33.994 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-15T22:51:34.031 INFO:tasks.ceph:Creating ceph cluster c1... 2023-12-15T22:51:34.031 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-15T22:51:34.031 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'branch': 'wip-shilpa-test-wo-sync-policy', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi}', 'email': 'smanjara@redhat.com', 'first_in_suite': False, 'job_id': '7493342', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-shilpa-test-wo-sync-policy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py']}, 'workunit': {'branch': 'wip-shilpa-test-wo-sync-policy', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-test-wo-sync-policy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'targets': {'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTkSOV80tJk85dkV8F5PRsO6fi64MovGnV7hV3dDBO4DaKTO97r0g9H9hvqss8awoXMTdhDInHUZ7dnzFDH68g=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXg1PuUOpLyPc+kU9XLJlFkTsEj5Zhzl2NxipOMVIhhYH5Epow/wtZAh5ghI6PVAo+qb+3MZTv9QWu6gJWLuEI=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzekXi9h3/MUFBU2UQZ7W94HhOodc/o+NbksKUAvvdCscx2OIzXTPDVq26QcSiz7Kug++81lhm9RHqFHhSx8r0=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLkkrrjNNiylYVct9T7DdexgtF0FBcoy72e6vlrR88zR4RNLA2bKY4BfIJB9kgkPtZFLtQ90ihqWgfs1+Sckyg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-15_22:32:14', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-15T22:51:34.032 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2023-12-15T22:51:34.052 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2023-12-15T22:51:34.055 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2023-12-15T22:51:34.063 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2023-12-15T22:51:34.077 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:51:34.107 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:51:34.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:51:34.119 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:51:34.146 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:34.146 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-12-15T22:51:34.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-15T22:51:34.186 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-15 22:51:28.397986954 +0000 2023-12-15T22:51:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-15 22:48:28.455211683 +0000 2023-12-15T22:51:34.241 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-15 22:48:28.455211683 +0000 2023-12-15T22:51:34.241 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-15 22:48:28.455211683 +0000 2023-12-15T22:51:34.241 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-15T22:51:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-15T22:51:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-15T22:51:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000176833 s, 2.9 MB/s 2023-12-15T22:51:34.306 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-15T22:51:34.361 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-15 22:51:28.397986954 +0000 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-15 22:48:28.961200247 +0000 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-15 22:48:28.961200247 +0000 2023-12-15T22:51:34.415 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-15 22:48:28.961200247 +0000 2023-12-15T22:51:34.416 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-15T22:51:34.480 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-15T22:51:34.480 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-15T22:51:34.480 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000209685 s, 2.4 MB/s 2023-12-15T22:51:34.481 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-15T22:51:34.537 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-15 22:51:28.398986931 +0000 2023-12-15T22:51:34.591 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-15 22:48:29.469188765 +0000 2023-12-15T22:51:34.592 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-15 22:48:29.469188765 +0000 2023-12-15T22:51:34.592 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-15 22:48:29.469188765 +0000 2023-12-15T22:51:34.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-15T22:51:34.655 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-15T22:51:34.656 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-15T22:51:34.656 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000210237 s, 2.4 MB/s 2023-12-15T22:51:34.657 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-15T22:51:34.712 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-15 22:51:28.398986931 +0000 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-15 22:48:29.963177599 +0000 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-15 22:48:29.963177599 +0000 2023-12-15T22:51:34.766 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-15 22:48:29.963177599 +0000 2023-12-15T22:51:34.767 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-15T22:51:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-15T22:51:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-15T22:51:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000155247 s, 3.3 MB/s 2023-12-15T22:51:34.832 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-15T22:51:34.887 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:34.887 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:34.887 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-12-15T22:51:34.904 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-15T22:51:34.904 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-12-15T22:51:34.959 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-15T22:51:34.959 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:34.959 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-12-15 22:51:18.694432768 +0000 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-12-15 22:48:28.475047675 +0000 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-12-15 22:48:28.475047675 +0000 2023-12-15T22:51:34.960 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-12-15 22:48:28.475047675 +0000 2023-12-15T22:51:34.960 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-15T22:51:35.026 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-12-15T22:51:35.026 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-12-15T22:51:35.027 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000200954 s, 2.5 MB/s 2023-12-15T22:51:35.028 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-15T22:51:35.084 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-12-15T22:51:35.139 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-12-15 22:51:18.694432768 +0000 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-12-15 22:48:28.971033815 +0000 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-12-15 22:48:28.971033815 +0000 2023-12-15T22:51:35.140 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-12-15 22:48:28.971033815 +0000 2023-12-15T22:51:35.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-15T22:51:35.205 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-12-15T22:51:35.205 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-12-15T22:51:35.205 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000189905 s, 2.7 MB/s 2023-12-15T22:51:35.207 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-15T22:51:35.262 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-12-15 22:51:18.694432768 +0000 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-12-15 22:48:29.468019928 +0000 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-12-15 22:48:29.468019928 +0000 2023-12-15T22:51:35.318 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-12-15 22:48:29.468019928 +0000 2023-12-15T22:51:35.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-15T22:51:35.384 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-12-15T22:51:35.384 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-12-15T22:51:35.384 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000290502 s, 1.8 MB/s 2023-12-15T22:51:35.385 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-15T22:51:35.440 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-12-15 22:51:18.695432740 +0000 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-12-15 22:48:29.962006124 +0000 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-12-15 22:48:29.962006124 +0000 2023-12-15T22:51:35.495 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-12-15 22:48:29.962006124 +0000 2023-12-15T22:51:35.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-15T22:51:35.560 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-12-15T22:51:35.560 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-12-15T22:51:35.560 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000190358 s, 2.7 MB/s 2023-12-15T22:51:35.561 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-15T22:51:35.617 INFO:tasks.ceph:osd dev map: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:35.617 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2023-12-15T22:51:35.617 INFO:tasks.ceph:Generating config... 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] debug rgw sync = 20 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw data log num shards = 4 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw md log max shards = 4 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2023-12-15T22:51:35.619 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2023-12-15T22:51:35.620 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2023-12-15T22:51:35.620 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2023-12-15T22:51:35.620 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-15T22:51:35.620 INFO:tasks.ceph:[client] setuser = ceph 2023-12-15T22:51:35.620 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2023-12-15T22:51:35.620 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-15T22:51:35.620 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-15T22:51:35.620 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-15T22:51:35.620 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-15T22:51:35.620 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2023-12-15T22:51:35.620 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2023-12-15T22:51:35.621 INFO:tasks.ceph:Setting up c1.mon.a... 2023-12-15T22:51:35.621 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2023-12-15T22:51:35.678 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/c1.keyring 2023-12-15T22:51:35.681 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2023-12-15T22:51:35.725 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/c1.keyring 2023-12-15T22:51:35.794 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.93')] 2023-12-15T22:51:35.795 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.93'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2023-12-15T22:51:35.796 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:35.796 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-15T22:51:35.850 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.93 --print /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:35.927 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: generated fsid ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:setting min_mon_release = pacific 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:epoch 0 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:fsid ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:last_changed 2023-12-15T22:51:35.928979+0000 2023-12-15T22:51:35.928 INFO:teuthology.orchestra.run.smithi093.stdout:created 2023-12-15T22:51:35.928979+0000 2023-12-15T22:51:35.929 INFO:teuthology.orchestra.run.smithi093.stdout:min_mon_release 16 (pacific) 2023-12-15T22:51:35.929 INFO:teuthology.orchestra.run.smithi093.stdout:election_strategy: 1 2023-12-15T22:51:35.929 INFO:teuthology.orchestra.run.smithi093.stdout:0: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.a 2023-12-15T22:51:35.929 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2023-12-15T22:51:35.930 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-15T22:51:35.984 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID ca043eb7-b8b1-425e-9d77-8b4dba62c7c4... 2023-12-15T22:51:35.985 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2023-12-15T22:51:36.027 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2023-12-15T22:51:36.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2023-12-15T22:51:36.032 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-12-15T22:51:36.074 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:51:36.075 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-12-15T22:51:36.076 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = 172.21.15.93 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-12-15T22:51:36.077 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug trim objects = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-12-15T22:51:36.078 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: rocksdb delete range threshold = 0 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:51:36.079 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:51:36.080 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: debug rgw = 20 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: debug rgw sync = 20 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt require ssl = False 2023-12-15T22:51:36.081 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw curl low speed time = 300 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data log num shards = 4 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data sync poll interval = 5 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw md log max shards = 4 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw meta sync poll interval = 5 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync log trim interval = 0 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync obj etag verify = True 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: setgroup = ceph 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: setuser = ceph 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data notify interval msec = 0 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2023-12-15T22:51:36.082 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-12-15T22:51:36.083 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.084 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.085 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = 172.21.15.93 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:51:36.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-12-15T22:51:36.087 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: rocksdb delete range threshold = 0 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:51:36.088 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.089 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:51:36.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw = 20 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw sync = 20 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt require ssl = False 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw curl low speed time = 300 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data log num shards = 4 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data sync poll interval = 5 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw md log max shards = 4 2023-12-15T22:51:36.091 INFO:teuthology.orchestra.run.smithi183.stdout: rgw meta sync poll interval = 5 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync log trim interval = 0 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync obj etag verify = True 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: setgroup = ceph 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: setuser = ceph 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data notify interval msec = 0 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-12-15T22:51:36.092 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:51:36.093 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-12-15T22:51:36.093 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-12-15T22:51:36.093 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:51:36.093 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-12-15T22:51:36.093 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.094 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.095 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = 172.21.15.93 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-12-15T22:51:36.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.097 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: rocksdb delete range threshold = 0 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.098 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.099 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-12-15T22:51:36.100 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: debug rgw = 20 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: debug rgw sync = 20 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt require ssl = False 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw curl low speed time = 300 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data log num shards = 4 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data sync poll interval = 5 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw md log max shards = 4 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw meta sync poll interval = 5 2023-12-15T22:51:36.101 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync log trim interval = 0 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync obj etag verify = True 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: setgroup = ceph 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: setuser = ceph 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data notify interval msec = 0 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-12-15T22:51:36.102 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2023-12-15T22:51:36.103 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:51:36.104 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2023-12-15T22:51:36.105 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = 172.21.15.93 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = ca043eb7-b8b1-425e-9d77-8b4dba62c7c4 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2023-12-15T22:51:36.106 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2023-12-15T22:51:36.107 INFO:teuthology.orchestra.run.smithi188.stdout: rocksdb delete range threshold = 0 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2023-12-15T22:51:36.108 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2023-12-15T22:51:36.109 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: debug rgw = 20 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: debug rgw sync = 20 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt require ssl = False 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw curl low speed time = 300 2023-12-15T22:51:36.110 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data log num shards = 4 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data sync poll interval = 5 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw md log max shards = 4 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw meta sync poll interval = 5 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync log trim interval = 0 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync obj etag verify = True 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: setgroup = ceph 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: setuser = ceph 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data notify interval msec = 0 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2023-12-15T22:51:36.111 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:51:36.113 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2023-12-15T22:51:36.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2023-12-15T22:51:36.208 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-15T22:51:36.208 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:36.208 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2023-12-15T22:51:36.222 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:36.222 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2023-12-15T22:51:36.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:51:36.276 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:36.276 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/c1.keyring 2023-12-15T22:51:36.277 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/c1.keyring 2023-12-15T22:51:36.355 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:36.355 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:36.410 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:51:36.410 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:36.410 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/c1.keyring 2023-12-15T22:51:36.410 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/c1.keyring 2023-12-15T22:51:36.449 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:36.450 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:36.505 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:51:36.505 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:36.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/c1.keyring 2023-12-15T22:51:36.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/c1.keyring 2023-12-15T22:51:36.550 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:51:36.550 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:36.607 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:51:36.608 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:36.608 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/c1.keyring 2023-12-15T22:51:36.608 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/c1.keyring 2023-12-15T22:51:36.652 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:51:36.652 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:36.709 INFO:tasks.ceph:Setting up mon nodes... 2023-12-15T22:51:36.709 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-15T22:51:36.710 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2023-12-15T22:51:36.772 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2023-12-15T22:51:36.775 INFO:tasks.ceph:Setting up mds nodes... 2023-12-15T22:51:36.775 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-15T22:51:36.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2023-12-15T22:51:36.818 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/c1.client.0.keyring 2023-12-15T22:51:36.833 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2023-12-15T22:51:36.875 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/c1.client.1.keyring 2023-12-15T22:51:36.891 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-15T22:51:36.891 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2023-12-15T22:51:36.891 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2023-12-15T22:51:36.917 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:36.917 INFO:tasks.ceph:role: c1.osd.0 2023-12-15T22:51:36.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:51:36.918 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-15T22:51:36.992 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:36.992 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:36.993 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:37.481 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-12-15T22:51:37.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-12-15T22:51:37.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2023-12-15T22:51:37.601 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2023-12-15T22:51:37.635 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2023-12-15T22:51:37.701 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:37.701 INFO:tasks.ceph:role: c1.osd.1 2023-12-15T22:51:37.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:51:37.702 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-15T22:51:37.776 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:37.776 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:37.777 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:38.243 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-12-15T22:51:38.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-12-15T22:51:38.245 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2023-12-15T22:51:38.329 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2023-12-15T22:51:38.361 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2023-12-15T22:51:38.428 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:38.428 INFO:tasks.ceph:role: c1.osd.2 2023-12-15T22:51:38.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:51:38.428 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-15T22:51:38.501 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:38.501 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:38.501 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:38.502 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:38.991 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-12-15T22:51:38.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-12-15T22:51:38.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2023-12-15T22:51:39.124 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2023-12-15T22:51:39.155 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:39.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.256+0000 7f9c46613500 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2023-12-15T22:51:39.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.260+0000 7f9c46613500 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2023-12-15T22:51:39.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.260+0000 7f9c46613500 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2023-12-15T22:51:39.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.260+0000 7f9c46613500 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2023-12-15T22:51:39.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.260+0000 7f9c46613500 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2023-12-15T22:51:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:39.264+0000 7f9c46613500 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2023-12-15T22:51:41.344 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2023-12-15T22:51:41.376 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.469+0000 7f478779b500 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.469+0000 7f478779b500 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.469+0000 7f478779b500 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.469+0000 7f478779b500 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.469+0000 7f478779b500 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2023-12-15T22:51:41.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:41.470+0000 7f478779b500 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2023-12-15T22:51:43.555 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2023-12-15T22:51:43.586 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:43.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.678+0000 7f529f722500 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2023-12-15T22:51:43.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.679+0000 7f529f722500 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2023-12-15T22:51:43.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.679+0000 7f529f722500 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2023-12-15T22:51:43.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.679+0000 7f529f722500 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2023-12-15T22:51:43.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.679+0000 7f529f722500 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2023-12-15T22:51:43.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:51:43.679+0000 7f529f722500 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2023-12-15T22:51:45.758 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2023-12-15T22:51:45.790 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-3 2023-12-15T22:51:45.822 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:45.822 INFO:tasks.ceph:role: c1.osd.3 2023-12-15T22:51:45.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:51:45.822 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:45.899 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:45.900 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:45.900 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:45.900 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:45.900 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:46.426 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-12-15T22:51:46.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-12-15T22:51:46.429 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-3 2023-12-15T22:51:46.590 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-3 2023-12-15T22:51:46.626 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-4 2023-12-15T22:51:46.695 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:46.696 INFO:tasks.ceph:role: c1.osd.4 2023-12-15T22:51:46.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:51:46.696 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:46.771 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:46.772 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:47.213 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-12-15T22:51:47.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-12-15T22:51:47.215 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-4 2023-12-15T22:51:47.315 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-4 2023-12-15T22:51:47.346 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-5 2023-12-15T22:51:47.414 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:51:47.414 INFO:tasks.ceph:role: c1.osd.5 2023-12-15T22:51:47.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:51:47.414 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:51:47.489 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:51:47.975 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-12-15T22:51:47.977 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-12-15T22:51:47.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-5 2023-12-15T22:51:48.108 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-5 2023-12-15T22:51:48.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:48.241 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.241+0000 7f11c6a11500 -1 auth: error reading file: /var/lib/ceph/osd/c1-3/keyring: can't open /var/lib/ceph/osd/c1-3/keyring: (2) No such file or directory 2023-12-15T22:51:48.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.244+0000 7f11c6a11500 -1 created new key in keyring /var/lib/ceph/osd/c1-3/keyring 2023-12-15T22:51:48.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.244+0000 7f11c6a11500 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2023-12-15T22:51:48.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.244+0000 7f11c6a11500 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2023-12-15T22:51:48.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.244+0000 7f11c6a11500 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2023-12-15T22:51:48.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:48.245+0000 7f11c6a11500 -1 bluestore(/var/lib/ceph/osd/c1-3) _read_fsid unparsable uuid 2023-12-15T22:51:50.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-3 2023-12-15T22:51:50.358 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.446+0000 7f3c21838500 -1 auth: error reading file: /var/lib/ceph/osd/c1-4/keyring: can't open /var/lib/ceph/osd/c1-4/keyring: (2) No such file or directory 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.446+0000 7f3c21838500 -1 created new key in keyring /var/lib/ceph/osd/c1-4/keyring 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.446+0000 7f3c21838500 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.446+0000 7f3c21838500 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.446+0000 7f3c21838500 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2023-12-15T22:51:50.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:50.447+0000 7f3c21838500 -1 bluestore(/var/lib/ceph/osd/c1-4) _read_fsid unparsable uuid 2023-12-15T22:51:52.527 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-4 2023-12-15T22:51:52.558 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:52.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 auth: error reading file: /var/lib/ceph/osd/c1-5/keyring: can't open /var/lib/ceph/osd/c1-5/keyring: (2) No such file or directory 2023-12-15T22:51:52.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 created new key in keyring /var/lib/ceph/osd/c1-5/keyring 2023-12-15T22:51:52.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2023-12-15T22:51:52.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2023-12-15T22:51:52.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2023-12-15T22:51:52.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:51:52.650+0000 7f7cd4811500 -1 bluestore(/var/lib/ceph/osd/c1-5) _read_fsid unparsable uuid 2023-12-15T22:51:54.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-5 2023-12-15T22:51:54.757 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-15T22:51:54.757 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:54.757 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2023-12-15T22:51:54.790 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:54.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2023-12-15T22:51:54.861 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:54.861 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2023-12-15T22:51:54.932 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:54.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2023-12-15T22:51:54.963 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:54.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-3/keyring of=/dev/stdout 2023-12-15T22:51:55.033 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:55.033 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-4/keyring of=/dev/stdout 2023-12-15T22:51:55.102 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:55.102 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-5/keyring of=/dev/stdout 2023-12-15T22:51:55.170 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:55.171 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2023-12-15T22:51:55.188 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:55.188 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/c1.client.1.keyring of=/dev/stdout 2023-12-15T22:51:55.227 INFO:tasks.ceph:Adding keys to all mons... 2023-12-15T22:51:55.227 DEBUG:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/c1.keyring 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB72HxlvQ5TDxAA4YlcJoRzWx3ycoM2/8Ujwg== 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB92HxlNxsLHBAA/oXWeWbLyoXTanG4hl+LCQ== 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB/2HxlrHGCKBAAWYnYwBLw8aD1eT4SdlTdSw== 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2023-12-15T22:51:55.257 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB42Hxlts4eLhAAJqPGVw9BHRgwaJ35wnEd2g== 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQCE2HxltJlyDhAAAdcxxdRZ1KhzmdgGs0CaAQ== 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQCG2HxlsjCuGhAAuq6oIoezM65KJYaBvHk9cQ== 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQCI2HxlVsvOJhAAiWMrTh58Bcqbie/SHDxtSw== 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB42Hxl0FDXMBAAmW963vEdkmVauQQb97QuvA== 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:[client.1] 2023-12-15T22:51:55.258 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB42Hxl7q87NBAA02+EIkRCD1nQg6Q93whG3A== 2023-12-15T22:51:55.259 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.359 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.419 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.475 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-15T22:51:55.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.580 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.631 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:51:55.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-15T22:51:55.736 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-15T22:51:55.790 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-15T22:51:55.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2023-12-15T22:51:55.816 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2023-12-15T22:51:55.912 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2023-12-15T22:51:55.938 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/c1.monmap 2023-12-15T22:51:55.994 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2023-12-15T22:51:55.994 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2023-12-15T22:51:55.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2023-12-15T22:51:56.036 INFO:tasks.ceph.c1.mon.a:Started 2023-12-15T22:51:56.036 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2023-12-15T22:51:56.037 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2023-12-15T22:51:56.037 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2023-12-15T22:51:56.039 INFO:tasks.ceph.c1.mgr.x:Started 2023-12-15T22:51:56.039 INFO:tasks.ceph:Setting crush tunables to default 2023-12-15T22:51:56.039 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster c1 osd crush tunables default 2023-12-15T22:51:56.230 INFO:teuthology.orchestra.run.smithi093.stderr:adjusted tunables profile to default 2023-12-15T22:51:56.241 INFO:tasks.ceph:check_enable_crimson: False 2023-12-15T22:51:56.241 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2023-12-15T22:51:56.241 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:56.241 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2023-12-15T22:51:56.268 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:56.268 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2023-12-15T22:51:56.334 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:51:56.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2023-12-15T22:51:56.400 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:56.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-3/fsid of=/dev/stdout 2023-12-15T22:51:56.428 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:56.428 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-4/fsid of=/dev/stdout 2023-12-15T22:51:56.494 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:51:56.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-5/fsid of=/dev/stdout 2023-12-15T22:51:56.562 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new d2895c77-ea02-472e-8365-2c4168dc7216 0 2023-12-15T22:51:56.620 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:56.619+0000 7f86edc0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-15T22:51:56.673 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:56.673+0000 7f86edc0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-15T22:51:56.782 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-12-15T22:51:56.792 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new d11b8e90-0a3c-41fe-8376-2deb8ea4c388 1 2023-12-15T22:51:57.011 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-12-15T22:51:57.022 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new 01a766eb-4905-4f0f-88b3-272b0bd4265b 2 2023-12-15T22:51:57.202 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-12-15T22:51:57.213 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new c4e80006-d170-4303-816b-0249ee0f62a6 3 2023-12-15T22:51:57.238 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.238+0000 7f86edc0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-15T22:51:57.293 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.292+0000 7f86edc0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-15T22:51:57.344 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.343+0000 7f86edc0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-15T22:51:57.396 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-12-15T22:51:57.407 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new a43f287a-5db3-475d-8a39-cb5a33400bb6 4 2023-12-15T22:51:57.413 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.413+0000 7f86edc0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-15T22:51:57.458 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.458+0000 7f86edc0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-15T22:51:57.563 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.563+0000 7f86edc0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-15T22:51:57.593 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-12-15T22:51:57.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new 886ec69f-1076-4e87-a873-fbeb53284364 5 2023-12-15T22:51:57.637 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.637+0000 7f86edc0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-15T22:51:57.685 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.685+0000 7f86edc0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-15T22:51:57.740 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.739+0000 7f86edc0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-15T22:51:57.784 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-12-15T22:51:57.787 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:57.786+0000 7f86edc0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-15T22:51:57.796 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2023-12-15T22:51:57.796 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2023-12-15T22:51:57.798 INFO:tasks.ceph.c1.osd.0:Started 2023-12-15T22:51:57.798 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2023-12-15T22:51:57.799 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2023-12-15T22:51:57.801 INFO:tasks.ceph.c1.osd.1:Started 2023-12-15T22:51:57.801 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2023-12-15T22:51:57.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2023-12-15T22:51:57.803 INFO:tasks.ceph.c1.osd.2:Started 2023-12-15T22:51:57.803 INFO:tasks.ceph.c1.osd.3:Restarting daemon 2023-12-15T22:51:57.803 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 3 2023-12-15T22:51:57.838 INFO:tasks.ceph.c1.osd.3:Started 2023-12-15T22:51:57.838 INFO:tasks.ceph.c1.osd.4:Restarting daemon 2023-12-15T22:51:57.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 4 2023-12-15T22:51:57.841 INFO:tasks.ceph.c1.osd.4:Started 2023-12-15T22:51:57.841 INFO:tasks.ceph.c1.osd.5:Restarting daemon 2023-12-15T22:51:57.841 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 5 2023-12-15T22:51:57.843 INFO:tasks.ceph.c1.osd.5:Started 2023-12-15T22:51:57.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2023-12-15T22:51:58.017 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:51:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":8,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T22:51:57.782156+0000","last_up_change":"0.000000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:51:58.027 INFO:tasks.ceph.ceph_manager.c1:[] 2023-12-15T22:51:58.027 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-15T22:51:58.187 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.187+0000 7f86edc0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-15T22:51:58.320 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.319+0000 7f86edc0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-15T22:51:58.405 INFO:tasks.ceph.c1.osd.1.smithi093.stderr:2023-12-15T22:51:58.405+0000 7ff33f40e500 -1 Falling back to public interface 2023-12-15T22:51:58.405 INFO:tasks.ceph.c1.osd.0.smithi093.stderr:2023-12-15T22:51:58.405+0000 7fec09ec9500 -1 Falling back to public interface 2023-12-15T22:51:58.408 INFO:tasks.ceph.c1.osd.2.smithi093.stderr:2023-12-15T22:51:58.408+0000 7f4123214500 -1 Falling back to public interface 2023-12-15T22:51:58.434 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.434+0000 7f86edc0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-15T22:51:58.440 INFO:tasks.ceph.c1.osd.5.smithi183.stderr:2023-12-15T22:51:58.439+0000 7f4809cda500 -1 Falling back to public interface 2023-12-15T22:51:58.446 INFO:tasks.ceph.c1.osd.4.smithi183.stderr:2023-12-15T22:51:58.446+0000 7f25b6f6e500 -1 Falling back to public interface 2023-12-15T22:51:58.460 INFO:tasks.ceph.c1.osd.3.smithi183.stderr:2023-12-15T22:51:58.460+0000 7fa90514a500 -1 Falling back to public interface 2023-12-15T22:51:58.484 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.484+0000 7f86edc0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-15T22:51:58.580 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.579+0000 7f86edc0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-15T22:51:58.631 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2023-12-15T22:51:58.672 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.672+0000 7f86edc0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-15T22:51:58.790 INFO:teuthology.misc.health.smithi093.stdout: 2023-12-15T22:51:58.790 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":8,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T22:51:57.782156+0000","last_up_change":"0.000000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:51:58.799 DEBUG:teuthology.misc:0 of 6 OSDs are up 2023-12-15T22:51:58.811 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.811+0000 7f86edc0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-15T22:51:58.853 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.853+0000 7f86edc0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-15T22:51:58.991 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:58.991+0000 7f86edc0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-15T22:51:59.772 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:51:59.771+0000 7f86edc0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-15T22:52:00.038 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:52:00.038+0000 7f86edc0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-15T22:52:00.091 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:52:00.090+0000 7f86edc0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-15T22:52:00.189 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:52:00.189+0000 7f86edc0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-15T22:52:01.098 INFO:tasks.ceph.c1.osd.2.smithi093.stderr:2023-12-15T22:52:01.097+0000 7f4123214500 -1 osd.2 0 log_to_monitors true 2023-12-15T22:52:01.131 INFO:tasks.ceph.c1.osd.1.smithi093.stderr:2023-12-15T22:52:01.131+0000 7ff33f40e500 -1 osd.1 0 log_to_monitors true 2023-12-15T22:52:01.164 INFO:tasks.ceph.c1.osd.0.smithi093.stderr:2023-12-15T22:52:01.164+0000 7fec09ec9500 -1 osd.0 0 log_to_monitors true 2023-12-15T22:52:01.187 INFO:tasks.ceph.c1.osd.5.smithi183.stderr:2023-12-15T22:52:01.186+0000 7f4809cda500 -1 osd.5 0 log_to_monitors true 2023-12-15T22:52:01.187 INFO:tasks.ceph.c1.osd.3.smithi183.stderr:2023-12-15T22:52:01.186+0000 7fa90514a500 -1 osd.3 0 log_to_monitors true 2023-12-15T22:52:01.187 INFO:tasks.ceph.c1.osd.4.smithi183.stderr:2023-12-15T22:52:01.186+0000 7f25b6f6e500 -1 osd.4 0 log_to_monitors true 2023-12-15T22:52:01.210 INFO:tasks.ceph.c1.mgr.x.smithi183.stderr:2023-12-15T22:52:01.209+0000 7f868eb82640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-15T22:52:03.374 INFO:tasks.ceph.c1.osd.0.smithi093.stderr:2023-12-15T22:52:03.374+0000 7fec05e59640 -1 osd.0 0 waiting for initial osdmap 2023-12-15T22:52:03.486 INFO:tasks.ceph.c1.osd.5.smithi183.stderr:2023-12-15T22:52:03.486+0000 7f4805c6a640 -1 osd.5 0 waiting for initial osdmap 2023-12-15T22:52:03.496 INFO:tasks.ceph.c1.osd.3.smithi183.stderr:2023-12-15T22:52:03.495+0000 7fa9010da640 -1 osd.3 0 waiting for initial osdmap 2023-12-15T22:52:03.585 INFO:tasks.ceph.c1.osd.0.smithi093.stderr:2023-12-15T22:52:03.585+0000 7febfdc80640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:03.594 INFO:tasks.ceph.c1.osd.5.smithi183.stderr:2023-12-15T22:52:03.594+0000 7f47fda91640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:03.594 INFO:tasks.ceph.c1.osd.3.smithi183.stderr:2023-12-15T22:52:03.594+0000 7fa8f8f01640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:03.601 INFO:tasks.ceph.c1.osd.2.smithi093.stderr:2023-12-15T22:52:03.601+0000 7f411f1a2640 -1 osd.2 0 waiting for initial osdmap 2023-12-15T22:52:03.615 INFO:tasks.ceph.c1.osd.2.smithi093.stderr:2023-12-15T22:52:03.615+0000 7f4116fc9640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:03.716 INFO:tasks.ceph.c1.osd.1.smithi093.stderr:2023-12-15T22:52:03.716+0000 7ff33ad77640 -1 osd.1 0 waiting for initial osdmap 2023-12-15T22:52:03.726 INFO:tasks.ceph.c1.osd.1.smithi093.stderr:2023-12-15T22:52:03.726+0000 7ff332b9e640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:05.316 INFO:tasks.ceph.c1.osd.4.smithi183.stderr:2023-12-15T22:52:05.316+0000 7f25b2efc640 -1 osd.4 0 waiting for initial osdmap 2023-12-15T22:52:05.328 INFO:tasks.ceph.c1.osd.4.smithi183.stderr:2023-12-15T22:52:05.328+0000 7f25aad23640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:05.405 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2023-12-15T22:52:05.682 INFO:teuthology.misc.health.smithi093.stdout: 2023-12-15T22:52:05.683 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":12,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T22:52:05.581827+0000","last_up_change":"2023-12-15T22:52:05.581827+0000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6809","nonce":3795688080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6811","nonce":3795688080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6815","nonce":3795688080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6813","nonce":3795688080}]},"public_addr":"172.21.15.93:6809/3795688080","cluster_addr":"172.21.15.93:6811/3795688080","heartbeat_back_addr":"172.21.15.93:6815/3795688080","heartbeat_front_addr":"172.21.15.93:6813/3795688080","state":["exists","up"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6801","nonce":1313249003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6803","nonce":1313249003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6807","nonce":1313249003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6805","nonce":1313249003}]},"public_addr":"172.21.15.93:6801/1313249003","cluster_addr":"172.21.15.93:6803/1313249003","heartbeat_back_addr":"172.21.15.93:6807/1313249003","heartbeat_front_addr":"172.21.15.93:6805/1313249003","state":["exists","up"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6817","nonce":1745339019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6819","nonce":1745339019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6823","nonce":1745339019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6821","nonce":1745339019}]},"public_addr":"172.21.15.93:6817/1745339019","cluster_addr":"172.21.15.93:6819/1745339019","heartbeat_back_addr":"172.21.15.93:6823/1745339019","heartbeat_front_addr":"172.21.15.93:6821/1745339019","state":["exists","up"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6817","nonce":3659828503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6819","nonce":3659828503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6823","nonce":3659828503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6821","nonce":3659828503}]},"public_addr":"172.21.15.183:6817/3659828503","cluster_addr":"172.21.15.183:6819/3659828503","heartbeat_back_addr":"172.21.15.183:6823/3659828503","heartbeat_front_addr":"172.21.15.183:6821/3659828503","state":["exists","up"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6809","nonce":3040168975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6811","nonce":3040168975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6815","nonce":3040168975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6813","nonce":3040168975}]},"public_addr":"172.21.15.183:6809/3040168975","cluster_addr":"172.21.15.183:6811/3040168975","heartbeat_back_addr":"172.21.15.183:6815/3040168975","heartbeat_front_addr":"172.21.15.183:6813/3040168975","state":["exists","up"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6801","nonce":4200067776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6803","nonce":4200067776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6807","nonce":4200067776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6805","nonce":4200067776}]},"public_addr":"172.21.15.183:6801/4200067776","cluster_addr":"172.21.15.183:6803/4200067776","heartbeat_back_addr":"172.21.15.183:6807/4200067776","heartbeat_front_addr":"172.21.15.183:6805/4200067776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.159139+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.094022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.098210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.215926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:05.694 DEBUG:teuthology.misc:6 of 6 OSDs are up 2023-12-15T22:52:05.694 INFO:tasks.ceph:Creating RBD pool 2023-12-15T22:52:05.694 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster c1 osd pool create rbd 8 2023-12-15T22:52:06.592 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'rbd' created 2023-12-15T22:52:06.657 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-15T22:52:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-15T22:52:07.611 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2023-12-15T22:52:07.611 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2023-12-15T22:52:07.612 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2023-12-15T22:52:07.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2023-12-15T22:52:07.612 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-15T22:52:07.957 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:07.968 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":274343275},{"type":"v1","addr":"172.21.15.183:6825","nonce":274343275}]},"active_addr":"172.21.15.183:6825/274343275","active_change":"2023-12-15T22:52:00.204058+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":436271883}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":2855964209}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":1092964867}]}]} 2023-12-15T22:52:07.970 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2023-12-15T22:52:07.970 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2023-12-15T22:52:07.970 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2023-12-15T22:52:08.252 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:08.252 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":14,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T22:52:07.592641+0000","last_up_change":"2023-12-15T22:52:05.581827+0000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-12-15T22:52:05.989487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-12-15T22:52:06.248998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6809","nonce":3795688080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6811","nonce":3795688080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6815","nonce":3795688080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6813","nonce":3795688080}]},"public_addr":"172.21.15.93:6809/3795688080","cluster_addr":"172.21.15.93:6811/3795688080","heartbeat_back_addr":"172.21.15.93:6815/3795688080","heartbeat_front_addr":"172.21.15.93:6813/3795688080","state":["exists","up"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6801","nonce":1313249003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6803","nonce":1313249003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6807","nonce":1313249003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6805","nonce":1313249003}]},"public_addr":"172.21.15.93:6801/1313249003","cluster_addr":"172.21.15.93:6803/1313249003","heartbeat_back_addr":"172.21.15.93:6807/1313249003","heartbeat_front_addr":"172.21.15.93:6805/1313249003","state":["exists","up"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6817","nonce":1745339019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6819","nonce":1745339019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6823","nonce":1745339019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6821","nonce":1745339019}]},"public_addr":"172.21.15.93:6817/1745339019","cluster_addr":"172.21.15.93:6819/1745339019","heartbeat_back_addr":"172.21.15.93:6823/1745339019","heartbeat_front_addr":"172.21.15.93:6821/1745339019","state":["exists","up"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6817","nonce":3659828503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6819","nonce":3659828503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6823","nonce":3659828503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6821","nonce":3659828503}]},"public_addr":"172.21.15.183:6817/3659828503","cluster_addr":"172.21.15.183:6819/3659828503","heartbeat_back_addr":"172.21.15.183:6823/3659828503","heartbeat_front_addr":"172.21.15.183:6821/3659828503","state":["exists","up"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6809","nonce":3040168975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6811","nonce":3040168975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6815","nonce":3040168975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6813","nonce":3040168975}]},"public_addr":"172.21.15.183:6809/3040168975","cluster_addr":"172.21.15.183:6811/3040168975","heartbeat_back_addr":"172.21.15.183:6815/3040168975","heartbeat_front_addr":"172.21.15.183:6813/3040168975","state":["exists","up"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6801","nonce":4200067776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6803","nonce":4200067776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6807","nonce":4200067776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6805","nonce":4200067776}]},"public_addr":"172.21.15.183:6801/4200067776","cluster_addr":"172.21.15.183:6803/4200067776","heartbeat_back_addr":"172.21.15.183:6807/4200067776","heartbeat_front_addr":"172.21.15.183:6805/4200067776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.159139+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.094022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.098210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.215926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.153298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:08.264 INFO:tasks.ceph.ceph_manager.c1:all up! 2023-12-15T22:52:08.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2023-12-15T22:52:08.547 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:08.547 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":14,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T22:52:07.592641+0000","last_up_change":"2023-12-15T22:52:05.581827+0000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-12-15T22:52:05.989487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-12-15T22:52:06.248998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6809","nonce":3795688080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6811","nonce":3795688080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6815","nonce":3795688080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6813","nonce":3795688080}]},"public_addr":"172.21.15.93:6809/3795688080","cluster_addr":"172.21.15.93:6811/3795688080","heartbeat_back_addr":"172.21.15.93:6815/3795688080","heartbeat_front_addr":"172.21.15.93:6813/3795688080","state":["exists","up"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6801","nonce":1313249003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6803","nonce":1313249003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6807","nonce":1313249003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6805","nonce":1313249003}]},"public_addr":"172.21.15.93:6801/1313249003","cluster_addr":"172.21.15.93:6803/1313249003","heartbeat_back_addr":"172.21.15.93:6807/1313249003","heartbeat_front_addr":"172.21.15.93:6805/1313249003","state":["exists","up"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6817","nonce":1745339019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6819","nonce":1745339019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6823","nonce":1745339019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6821","nonce":1745339019}]},"public_addr":"172.21.15.93:6817/1745339019","cluster_addr":"172.21.15.93:6819/1745339019","heartbeat_back_addr":"172.21.15.93:6823/1745339019","heartbeat_front_addr":"172.21.15.93:6821/1745339019","state":["exists","up"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6817","nonce":3659828503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6819","nonce":3659828503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6823","nonce":3659828503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6821","nonce":3659828503}]},"public_addr":"172.21.15.183:6817/3659828503","cluster_addr":"172.21.15.183:6819/3659828503","heartbeat_back_addr":"172.21.15.183:6823/3659828503","heartbeat_front_addr":"172.21.15.183:6821/3659828503","state":["exists","up"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6809","nonce":3040168975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6811","nonce":3040168975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6815","nonce":3040168975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6813","nonce":3040168975}]},"public_addr":"172.21.15.183:6809/3040168975","cluster_addr":"172.21.15.183:6811/3040168975","heartbeat_back_addr":"172.21.15.183:6815/3040168975","heartbeat_front_addr":"172.21.15.183:6813/3040168975","state":["exists","up"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6801","nonce":4200067776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6803","nonce":4200067776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6807","nonce":4200067776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6805","nonce":4200067776}]},"public_addr":"172.21.15.183:6801/4200067776","cluster_addr":"172.21.15.183:6803/4200067776","heartbeat_back_addr":"172.21.15.183:6807/4200067776","heartbeat_front_addr":"172.21.15.183:6805/4200067776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.159139+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.094022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.098210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.215926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.153298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:08.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2023-12-15T22:52:08.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2023-12-15T22:52:08.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2023-12-15T22:52:08.561 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 flush_pg_stats 2023-12-15T22:52:08.561 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 flush_pg_stats 2023-12-15T22:52:08.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 flush_pg_stats 2023-12-15T22:52:08.713 INFO:teuthology.orchestra.run.smithi093.stdout:47244640261 2023-12-15T22:52:08.713 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2023-12-15T22:52:08.714 INFO:teuthology.orchestra.run.smithi093.stdout:51539607557 2023-12-15T22:52:08.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2023-12-15T22:52:08.759 INFO:teuthology.orchestra.run.smithi093.stdout:47244640258 2023-12-15T22:52:08.760 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2023-12-15T22:52:08.763 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:08.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2023-12-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:08.765 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2023-12-15T22:52:08.766 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:08.766 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2023-12-15T22:52:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:47244640260 2023-12-15T22:52:09.091 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640261 got 47244640260 for osd.3 2023-12-15T22:52:09.103 INFO:teuthology.orchestra.run.smithi093.stdout:0 2023-12-15T22:52:09.116 INFO:tasks.ceph.ceph_manager.c1:need seq 51539607557 got 0 for osd.4 2023-12-15T22:52:09.228 INFO:teuthology.orchestra.run.smithi093.stdout:47244640258 2023-12-15T22:52:09.229 INFO:teuthology.orchestra.run.smithi093.stdout:47244640257 2023-12-15T22:52:09.241 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.5 2023-12-15T22:52:09.247 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640257 for osd.2 2023-12-15T22:52:09.249 INFO:teuthology.orchestra.run.smithi093.stdout:47244640258 2023-12-15T22:52:09.261 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.1 2023-12-15T22:52:09.271 INFO:teuthology.orchestra.run.smithi093.stdout:47244640258 2023-12-15T22:52:09.284 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.0 2023-12-15T22:52:10.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2023-12-15T22:52:10.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2023-12-15T22:52:10.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2023-12-15T22:52:10.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2023-12-15T22:52:10.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2023-12-15T22:52:10.284 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2023-12-15T22:52:10.414 INFO:teuthology.orchestra.run.smithi093.stdout:47244640260 2023-12-15T22:52:10.428 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640261 got 47244640260 for osd.3 2023-12-15T22:52:10.524 INFO:teuthology.orchestra.run.smithi093.stdout:51539607556 2023-12-15T22:52:10.537 INFO:tasks.ceph.ceph_manager.c1:need seq 51539607557 got 51539607556 for osd.4 2023-12-15T22:52:10.611 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:10.624 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640259 for osd.5 2023-12-15T22:52:10.624 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:10.631 INFO:teuthology.orchestra.run.smithi093.stdout:47244640258 2023-12-15T22:52:10.643 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640258 for osd.2 2023-12-15T22:52:10.644 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:10.661 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:10.673 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640259 for osd.0 2023-12-15T22:52:10.673 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:10.688 INFO:teuthology.orchestra.run.smithi093.stdout:47244640259 2023-12-15T22:52:10.700 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640259 for osd.1 2023-12-15T22:52:10.700 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:11.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2023-12-15T22:52:11.538 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2023-12-15T22:52:11.746 INFO:teuthology.orchestra.run.smithi093.stdout:47244640261 2023-12-15T22:52:11.759 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640261 got 47244640261 for osd.3 2023-12-15T22:52:11.759 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:11.845 INFO:teuthology.orchestra.run.smithi093.stdout:51539607557 2023-12-15T22:52:11.857 INFO:tasks.ceph.ceph_manager.c1:need seq 51539607557 got 51539607557 for osd.4 2023-12-15T22:52:11.857 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:11.857 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2023-12-15T22:52:11.857 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-15T22:52:12.131 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:12.132 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-15T22:52:12.144 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-12-15T22:52:10.209133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164876,"kb_used_data":1928,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628980724,"statfs":{"total":644245094400,"available":644076261376,"internally_reserved":0,"allocated":1974272,"data_stored":1405634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.601013+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T22:52:08.601013+0000","last_peered":"2023-12-15T22:52:08.601013+0000","last_clean":"2023-12-15T22:52:08.601013+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T22:52:08.601013+0000","last_undegraded":"2023-12-15T22:52:08.601013+0000","last_fullsized":"2023-12-15T22:52:08.601013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.043638+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T22:52:08.043638+0000","last_peered":"2023-12-15T22:52:08.043638+0000","last_clean":"2023-12-15T22:52:08.043638+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T22:52:08.043638+0000","last_undegraded":"2023-12-15T22:52:08.043638+0000","last_fullsized":"2023-12-15T22:52:08.043638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.042769+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T22:52:08.042769+0000","last_peered":"2023-12-15T22:52:08.042769+0000","last_clean":"2023-12-15T22:52:08.042769+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T22:52:08.042769+0000","last_undegraded":"2023-12-15T22:52:08.042769+0000","last_fullsized":"2023-12-15T22:52:08.042769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:07.607709+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T22:52:07.607709+0000","last_peered":"2023-12-15T22:52:07.607709+0000","last_clean":"2023-12-15T22:52:07.607709+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T22:52:07.607709+0000","last_undegraded":"2023-12-15T22:52:07.607709+0000","last_fullsized":"2023-12-15T22:52:07.607709+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":159,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.500941+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T22:52:08.500941+0000","last_peered":"2023-12-15T22:52:08.500941+0000","last_clean":"2023-12-15T22:52:08.500941+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T22:52:08.500941+0000","last_undegraded":"2023-12-15T22:52:08.500941+0000","last_fullsized":"2023-12-15T22:52:08.500941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:07.606472+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T22:52:07.606472+0000","last_peered":"2023-12-15T22:52:07.606472+0000","last_clean":"2023-12-15T22:52:07.606472+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T22:52:07.606472+0000","last_undegraded":"2023-12-15T22:52:07.606472+0000","last_fullsized":"2023-12-15T22:52:07.606472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:50.386115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.042779+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T22:52:08.042779+0000","last_peered":"2023-12-15T22:52:08.042779+0000","last_clean":"2023-12-15T22:52:08.042779+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T22:52:08.042779+0000","last_undegraded":"2023-12-15T22:52:08.042779+0000","last_fullsized":"2023-12-15T22:52:08.042779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.601013+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T22:52:08.601013+0000","last_peered":"2023-12-15T22:52:08.601013+0000","last_clean":"2023-12-15T22:52:08.601013+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T22:52:08.601013+0000","last_undegraded":"2023-12-15T22:52:08.601013+0000","last_fullsized":"2023-12-15T22:52:08.601013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.043465+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T22:52:08.043465+0000","last_peered":"2023-12-15T22:52:08.043465+0000","last_clean":"2023-12-15T22:52:08.043465+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T22:52:08.043465+0000","last_undegraded":"2023-12-15T22:52:08.043465+0000","last_fullsized":"2023-12-15T22:52:08.043465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]}]},{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28160,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829440,"statfs":{"total":107374182400,"available":107345346560,"internally_reserved":0,"allocated":724992,"data_stored":627851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":11,"seq":47244640258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":131072,"data_stored":37483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28100,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829500,"statfs":{"total":107374182400,"available":107345408000,"internally_reserved":0,"allocated":724992,"data_stored":627851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":131072,"data_stored":37483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-15T22:52:12.145 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-15T22:52:12.417 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:12.418 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-15T22:52:12.429 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-12-15T22:52:12.209505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164160,"kb_used_data":2000,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628981440,"statfs":{"total":644245094400,"available":644076994560,"internally_reserved":0,"allocated":2048000,"data_stored":1437158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000371"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.601013+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T22:52:08.601013+0000","last_peered":"2023-12-15T22:52:08.601013+0000","last_clean":"2023-12-15T22:52:08.601013+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T22:52:08.601013+0000","last_undegraded":"2023-12-15T22:52:08.601013+0000","last_fullsized":"2023-12-15T22:52:08.601013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791551+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T22:52:08.791551+0000","last_peered":"2023-12-15T22:52:08.791551+0000","last_clean":"2023-12-15T22:52:08.791551+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T22:52:08.791551+0000","last_undegraded":"2023-12-15T22:52:08.791551+0000","last_fullsized":"2023-12-15T22:52:08.791551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:20.385525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791654+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T22:52:08.791654+0000","last_peered":"2023-12-15T22:52:08.791654+0000","last_clean":"2023-12-15T22:52:08.791654+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T22:52:08.791654+0000","last_undegraded":"2023-12-15T22:52:08.791654+0000","last_fullsized":"2023-12-15T22:52:08.791654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791683+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T22:52:08.791683+0000","last_peered":"2023-12-15T22:52:08.791683+0000","last_clean":"2023-12-15T22:52:08.791683+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T22:52:08.791683+0000","last_undegraded":"2023-12-15T22:52:08.791683+0000","last_fullsized":"2023-12-15T22:52:08.791683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":161,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791517+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T22:52:08.791517+0000","last_peered":"2023-12-15T22:52:08.791517+0000","last_clean":"2023-12-15T22:52:08.791517+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T22:52:08.791517+0000","last_undegraded":"2023-12-15T22:52:08.791517+0000","last_fullsized":"2023-12-15T22:52:08.791517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:48:45.986851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791543+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T22:52:08.791543+0000","last_peered":"2023-12-15T22:52:08.791543+0000","last_clean":"2023-12-15T22:52:08.791543+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T22:52:08.791543+0000","last_undegraded":"2023-12-15T22:52:08.791543+0000","last_fullsized":"2023-12-15T22:52:08.791543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791625+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T22:52:08.791625+0000","last_peered":"2023-12-15T22:52:08.791625+0000","last_clean":"2023-12-15T22:52:08.791625+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T22:52:08.791625+0000","last_undegraded":"2023-12-15T22:52:08.791625+0000","last_fullsized":"2023-12-15T22:52:08.791625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.601013+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T22:52:08.601013+0000","last_peered":"2023-12-15T22:52:08.601013+0000","last_clean":"2023-12-15T22:52:08.601013+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T22:52:08.601013+0000","last_undegraded":"2023-12-15T22:52:08.601013+0000","last_fullsized":"2023-12-15T22:52:08.601013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:08.791495+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T22:52:08.791495+0000","last_peered":"2023-12-15T22:52:08.791495+0000","last_clean":"2023-12-15T22:52:08.791495+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T22:52:08.791495+0000","last_undegraded":"2023-12-15T22:52:08.791495+0000","last_fullsized":"2023-12-15T22:52:08.791495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":42737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]}]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":42737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]}]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829860,"statfs":{"total":107374182400,"available":107345776640,"internally_reserved":0,"allocated":737280,"data_stored":633105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830428,"statfs":{"total":107374182400,"available":107346358272,"internally_reserved":0,"allocated":143360,"data_stored":42737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829860,"statfs":{"total":107374182400,"available":107345776640,"internally_reserved":0,"allocated":737280,"data_stored":633105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830428,"statfs":{"total":107374182400,"available":107346358272,"internally_reserved":0,"allocated":143360,"data_stored":42737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-15T22:52:12.430 INFO:tasks.ceph.ceph_manager.c1:clean! 2023-12-15T22:52:12.430 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2023-12-15T22:52:12.430 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2023-12-15T22:52:12.430 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2023-12-15T22:52:12.740 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:12.740 INFO:teuthology.orchestra.run.smithi093.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-15T22:52:12.752 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2023-12-15T22:52:12.752 INFO:teuthology.run_tasks:Running task ceph... 2023-12-15T22:52:12.761 INFO:tasks.ceph:Creating ceph cluster c2... 2023-12-15T22:52:12.761 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-15T22:52:12.762 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'branch': 'wip-shilpa-test-wo-sync-policy', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi}', 'email': 'smanjara@redhat.com', 'first_in_suite': False, 'job_id': '7493342', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-shilpa-test-wo-sync-policy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py']}, 'workunit': {'branch': 'wip-shilpa-test-wo-sync-policy', 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-test-wo-sync-policy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9', 'targets': {'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTkSOV80tJk85dkV8F5PRsO6fi64MovGnV7hV3dDBO4DaKTO97r0g9H9hvqss8awoXMTdhDInHUZ7dnzFDH68g=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXg1PuUOpLyPc+kU9XLJlFkTsEj5Zhzl2NxipOMVIhhYH5Epow/wtZAh5ghI6PVAo+qb+3MZTv9QWu6gJWLuEI=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzekXi9h3/MUFBU2UQZ7W94HhOodc/o+NbksKUAvvdCscx2OIzXTPDVq26QcSiz7Kug++81lhm9RHqFHhSx8r0=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLkkrrjNNiylYVct9T7DdexgtF0FBcoy72e6vlrR88zR4RNLA2bKY4BfIJB9kgkPtZFLtQ90ihqWgfs1+Sckyg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e787ab71a54a65a1c318d8bb7b1e65f35409fcd9'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-15_22:32:14', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-15T22:52:12.762 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2023-12-15T22:52:12.764 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2023-12-15T22:52:12.767 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2023-12-15T22:52:12.769 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2023-12-15T22:52:12.787 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:52:12.819 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:52:12.825 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:52:12.828 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-12-15T22:52:12.858 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:12.858 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2023-12-15T22:52:12.913 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-15T22:52:12.913 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-12-15 22:51:22.101074146 +0000 2023-12-15T22:52:12.969 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-12-15 22:48:29.217039991 +0000 2023-12-15T22:52:12.970 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-12-15 22:48:29.217039991 +0000 2023-12-15T22:52:12.970 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-12-15 22:48:29.217039991 +0000 2023-12-15T22:52:12.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-15T22:52:13.037 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-12-15T22:52:13.037 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-12-15T22:52:13.037 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.00019358 s, 2.6 MB/s 2023-12-15T22:52:13.038 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-15T22:52:13.095 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-12-15 22:51:22.101074146 +0000 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-12-15 22:48:29.719030785 +0000 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-12-15 22:48:29.719030785 +0000 2023-12-15T22:52:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-12-15 22:48:29.719030785 +0000 2023-12-15T22:52:13.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-15T22:52:13.215 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-12-15T22:52:13.215 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-12-15T22:52:13.215 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000178577 s, 2.9 MB/s 2023-12-15T22:52:13.216 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-15T22:52:13.272 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-12-15 22:51:22.101074146 +0000 2023-12-15T22:52:13.327 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-12-15 22:48:30.199021982 +0000 2023-12-15T22:52:13.328 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-12-15 22:48:30.199021982 +0000 2023-12-15T22:52:13.328 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-12-15 22:48:30.199021982 +0000 2023-12-15T22:52:13.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-15T22:52:13.393 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-12-15T22:52:13.393 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-12-15T22:52:13.393 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000208184 s, 2.5 MB/s 2023-12-15T22:52:13.395 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-15T22:52:13.450 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2023-12-15T22:52:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-12-15 22:51:22.102074127 +0000 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-12-15 22:48:30.687013033 +0000 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-12-15 22:48:30.687013033 +0000 2023-12-15T22:52:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-12-15 22:48:30.687013033 +0000 2023-12-15T22:52:13.506 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-12-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-12-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000216304 s, 2.4 MB/s 2023-12-15T22:52:13.572 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-15T22:52:13.628 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:13.628 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:13.629 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-12-15T22:52:13.644 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-15T22:52:13.644 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-12-15 22:51:15.217337897 +0000 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-12-15 22:48:39.476087768 +0000 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-12-15 22:48:39.476087768 +0000 2023-12-15T22:52:13.699 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2023-12-15 22:48:39.476087768 +0000 2023-12-15T22:52:13.699 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-15T22:52:13.765 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-12-15T22:52:13.765 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-12-15T22:52:13.765 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000210136 s, 2.4 MB/s 2023-12-15T22:52:13.766 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-15T22:52:13.822 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-12-15T22:52:13.876 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-15T22:52:13.876 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-12-15 22:51:15.217337897 +0000 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-12-15 22:48:40.013076829 +0000 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-12-15 22:48:40.013076829 +0000 2023-12-15T22:52:13.877 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2023-12-15 22:48:40.013076829 +0000 2023-12-15T22:52:13.877 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-15T22:52:13.941 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-12-15T22:52:13.941 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-12-15T22:52:13.942 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000189158 s, 2.7 MB/s 2023-12-15T22:52:13.943 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-15T22:52:13.998 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-12-15 22:51:15.217337897 +0000 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-12-15 22:48:40.503066848 +0000 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-12-15 22:48:40.503066848 +0000 2023-12-15T22:52:14.052 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2023-12-15 22:48:40.503066848 +0000 2023-12-15T22:52:14.053 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-15T22:52:14.117 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-12-15T22:52:14.117 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-12-15T22:52:14.117 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000163343 s, 3.1 MB/s 2023-12-15T22:52:14.118 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-15T22:52:14.173 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-12-15 22:51:15.218337876 +0000 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-12-15 22:48:41.005056622 +0000 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-12-15 22:48:41.005056622 +0000 2023-12-15T22:52:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2023-12-15 22:48:41.005056622 +0000 2023-12-15T22:52:14.227 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-15T22:52:14.292 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-12-15T22:52:14.292 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-12-15T22:52:14.292 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000191634 s, 2.7 MB/s 2023-12-15T22:52:14.293 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-15T22:52:14.348 INFO:tasks.ceph:osd dev map: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:14.348 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2023-12-15T22:52:14.348 INFO:tasks.ceph:Generating config... 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] debug rgw sync = 20 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:52:14.349 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw data log num shards = 4 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw md log max shards = 4 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client] setuser = ceph 2023-12-15T22:52:14.350 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2023-12-15T22:52:14.350 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-15T22:52:14.350 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-15T22:52:14.350 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-15T22:52:14.350 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-15T22:52:14.350 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2023-12-15T22:52:14.351 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2023-12-15T22:52:14.351 INFO:tasks.ceph:Setting up c2.mon.a... 2023-12-15T22:52:14.351 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2023-12-15T22:52:14.403 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/c2.keyring 2023-12-15T22:52:14.406 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2023-12-15T22:52:14.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/c2.keyring 2023-12-15T22:52:14.515 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.188')] 2023-12-15T22:52:14.516 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.188'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2023-12-15T22:52:14.516 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:14.516 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-15T22:52:14.570 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.188 --print /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:14.648 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:52:14.648 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:52:14.648 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:14.648 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: generated fsid 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:setting min_mon_release = pacific 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:epoch 0 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:fsid 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:last_changed 2023-12-15T22:52:14.649612+0000 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:created 2023-12-15T22:52:14.649612+0000 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:min_mon_release 16 (pacific) 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:election_strategy: 1 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:0: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.a 2023-12-15T22:52:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2023-12-15T22:52:14.650 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-15T22:52:14.705 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 04dcd530-0fa5-49c9-bdf2-2896faaf39ad... 2023-12-15T22:52:14.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2023-12-15T22:52:14.708 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2023-12-15T22:52:14.711 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2023-12-15T22:52:14.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.762 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-12-15T22:52:14.763 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-12-15T22:52:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = 172.21.15.188 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-12-15T22:52:14.765 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug trim objects = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-12-15T22:52:14.766 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: rocksdb delete range threshold = 0 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-12-15T22:52:14.767 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.768 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: debug rgw = 20 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: debug rgw sync = 20 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt require ssl = False 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:52:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: rgw curl low speed time = 300 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data log num shards = 4 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data sync poll interval = 5 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw md log max shards = 4 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw meta sync poll interval = 5 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync log trim interval = 0 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw sync obj etag verify = True 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: setgroup = ceph 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: setuser = ceph 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: rgw data notify interval msec = 0 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2023-12-15T22:52:14.770 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-12-15T22:52:14.771 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-12-15T22:52:14.772 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-12-15T22:52:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = 172.21.15.188 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:52:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-12-15T22:52:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: rocksdb delete range threshold = 0 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-12-15T22:52:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-12-15T22:52:14.778 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw = 20 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw sync = 20 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt require ssl = False 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw curl low speed time = 300 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data log num shards = 4 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data sync poll interval = 5 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw md log max shards = 4 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw meta sync poll interval = 5 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync log trim interval = 0 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync obj etag verify = True 2023-12-15T22:52:14.779 INFO:teuthology.orchestra.run.smithi183.stdout: setgroup = ceph 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout: setuser = ceph 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data notify interval msec = 0 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-12-15T22:52:14.780 INFO:teuthology.orchestra.run.smithi183.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:52:14.796 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2023-12-15T22:52:14.796 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2023-12-15T22:52:14.796 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.797 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:52:14.798 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = 172.21.15.188 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2023-12-15T22:52:14.799 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2023-12-15T22:52:14.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: rocksdb delete range threshold = 0 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2023-12-15T22:52:14.801 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2023-12-15T22:52:14.802 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2023-12-15T22:52:14.803 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: debug rgw = 20 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: debug rgw sync = 20 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt require ssl = False 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:52:14.804 INFO:teuthology.orchestra.run.smithi188.stdout: rgw curl low speed time = 300 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data log num shards = 4 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data sync poll interval = 5 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw md log max shards = 4 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw meta sync poll interval = 5 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync log trim interval = 0 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw sync obj etag verify = True 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: setgroup = ceph 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: setuser = ceph 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: rgw data notify interval msec = 0 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2023-12-15T22:52:14.805 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.806 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.807 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-12-15T22:52:14.808 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = 172.21.15.188 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 04dcd530-0fa5-49c9-bdf2-2896faaf39ad 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.809 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.810 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: rocksdb delete range threshold = 0 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-12-15T22:52:14.811 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-12-15T22:52:14.812 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-12-15T22:52:14.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: debug rgw = 20 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: debug rgw sync = 20 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt require ssl = False 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt s3 kms backend = testing 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw curl low speed time = 300 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data log num shards = 4 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data sync poll interval = 5 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw md log max shards = 4 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw meta sync poll interval = 5 2023-12-15T22:52:14.814 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync data inject err probability = 0.1 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync log trim interval = 0 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync meta inject err probability = 0.1 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: rgw sync obj etag verify = True 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: setgroup = ceph 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: setuser = ceph 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: rgw data notify interval msec = 0 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 10 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 1000 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-12-15T22:52:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 10000 2023-12-15T22:52:14.816 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2023-12-15T22:52:14.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2023-12-15T22:52:14.911 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-15T22:52:14.912 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:14.912 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2023-12-15T22:52:14.926 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:14.926 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2023-12-15T22:52:14.980 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2023-12-15T22:52:14.980 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:52:14.980 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/c2.keyring 2023-12-15T22:52:14.980 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/c2.keyring 2023-12-15T22:52:15.023 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-15T22:52:15.023 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:15.080 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-12-15T22:52:15.080 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:52:15.080 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/c2.keyring 2023-12-15T22:52:15.080 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/c2.keyring 2023-12-15T22:52:15.124 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-12-15T22:52:15.124 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:15.181 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:52:15.181 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:15.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/c2.keyring 2023-12-15T22:52:15.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/c2.keyring 2023-12-15T22:52:15.221 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:15.221 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:15.275 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:52:15.275 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:15.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/c2.keyring 2023-12-15T22:52:15.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/c2.keyring 2023-12-15T22:52:15.315 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:15.315 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:15.370 INFO:tasks.ceph:Setting up mon nodes... 2023-12-15T22:52:15.371 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-15T22:52:15.371 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2023-12-15T22:52:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2023-12-15T22:52:15.479 INFO:tasks.ceph:Setting up mds nodes... 2023-12-15T22:52:15.479 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-15T22:52:15.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2023-12-15T22:52:15.521 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/c2.client.0.keyring 2023-12-15T22:52:15.537 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2023-12-15T22:52:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/c2.client.1.keyring 2023-12-15T22:52:15.593 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-15T22:52:15.593 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2023-12-15T22:52:15.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2023-12-15T22:52:15.620 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:15.620 INFO:tasks.ceph:role: c2.osd.0 2023-12-15T22:52:15.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:52:15.621 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-15T22:52:15.694 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:15.695 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:16.174 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-12-15T22:52:16.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-12-15T22:52:16.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2023-12-15T22:52:16.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2023-12-15T22:52:16.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2023-12-15T22:52:16.396 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:16.397 INFO:tasks.ceph:role: c2.osd.1 2023-12-15T22:52:16.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:52:16.397 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:16.471 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:16.472 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:16.936 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-12-15T22:52:16.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-12-15T22:52:16.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2023-12-15T22:52:17.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2023-12-15T22:52:17.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2023-12-15T22:52:17.135 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:17.135 INFO:tasks.ceph:role: c2.osd.2 2023-12-15T22:52:17.135 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-15T22:52:17.135 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-15T22:52:17.209 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:17.209 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:17.209 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:17.209 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:17.210 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:17.724 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-12-15T22:52:17.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-12-15T22:52:17.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2023-12-15T22:52:17.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2023-12-15T22:52:17.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:17.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.983+0000 7ff16cd07500 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2023-12-15T22:52:17.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.986+0000 7ff16cd07500 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2023-12-15T22:52:17.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.987+0000 7ff16cd07500 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2023-12-15T22:52:17.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.987+0000 7ff16cd07500 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2023-12-15T22:52:17.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.987+0000 7ff16cd07500 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2023-12-15T22:52:17.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:17.988+0000 7ff16cd07500 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2023-12-15T22:52:20.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2023-12-15T22:52:20.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.186+0000 7ff073a20500 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.187+0000 7ff073a20500 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.187+0000 7ff073a20500 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.187+0000 7ff073a20500 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.187+0000 7ff073a20500 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2023-12-15T22:52:20.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:20.187+0000 7ff073a20500 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2023-12-15T22:52:22.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2023-12-15T22:52:22.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:22.382 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.381+0000 7f2d43dfe500 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2023-12-15T22:52:22.382 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.381+0000 7f2d43dfe500 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2023-12-15T22:52:22.383 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.381+0000 7f2d43dfe500 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2023-12-15T22:52:22.383 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.381+0000 7f2d43dfe500 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2023-12-15T22:52:22.383 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.381+0000 7f2d43dfe500 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2023-12-15T22:52:22.383 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:52:22.382+0000 7f2d43dfe500 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2023-12-15T22:52:24.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2023-12-15T22:52:24.489 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/c2-3 2023-12-15T22:52:24.518 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:24.518 INFO:tasks.ceph:role: c2.osd.3 2023-12-15T22:52:24.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:52:24.519 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-15T22:52:24.594 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:24.595 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:25.108 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-12-15T22:52:25.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-12-15T22:52:25.110 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-3 2023-12-15T22:52:25.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-3 2023-12-15T22:52:25.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/c2-4 2023-12-15T22:52:25.339 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:25.339 INFO:tasks.ceph:role: c2.osd.4 2023-12-15T22:52:25.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:52:25.339 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:25.414 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:25.876 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-12-15T22:52:25.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-12-15T22:52:25.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-4 2023-12-15T22:52:25.970 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-4 2023-12-15T22:52:26.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/c2-5 2023-12-15T22:52:26.071 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2023-12-15T22:52:26.071 INFO:tasks.ceph:role: c2.osd.5 2023-12-15T22:52:26.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-15T22:52:26.072 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-15T22:52:26.148 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-15T22:52:26.631 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-12-15T22:52:26.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-12-15T22:52:26.633 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-5 2023-12-15T22:52:26.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-5 2023-12-15T22:52:26.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:26.909 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.909+0000 7fb0ceca3500 -1 auth: error reading file: /var/lib/ceph/osd/c2-3/keyring: can't open /var/lib/ceph/osd/c2-3/keyring: (2) No such file or directory 2023-12-15T22:52:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.910+0000 7fb0ceca3500 -1 created new key in keyring /var/lib/ceph/osd/c2-3/keyring 2023-12-15T22:52:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.910+0000 7fb0ceca3500 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2023-12-15T22:52:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.910+0000 7fb0ceca3500 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2023-12-15T22:52:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.910+0000 7fb0ceca3500 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2023-12-15T22:52:26.917 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:26.917+0000 7fb0ceca3500 -1 bluestore(/var/lib/ceph/osd/c2-3) _read_fsid unparsable uuid 2023-12-15T22:52:28.990 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-3 2023-12-15T22:52:29.021 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.112+0000 7fa2b2414500 -1 auth: error reading file: /var/lib/ceph/osd/c2-4/keyring: can't open /var/lib/ceph/osd/c2-4/keyring: (2) No such file or directory 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.112+0000 7fa2b2414500 -1 created new key in keyring /var/lib/ceph/osd/c2-4/keyring 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.112+0000 7fa2b2414500 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.112+0000 7fa2b2414500 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.112+0000 7fa2b2414500 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2023-12-15T22:52:29.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:29.113+0000 7fa2b2414500 -1 bluestore(/var/lib/ceph/osd/c2-4) _read_fsid unparsable uuid 2023-12-15T22:52:31.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-4 2023-12-15T22:52:31.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:31.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.323+0000 7f1acb746500 -1 auth: error reading file: /var/lib/ceph/osd/c2-5/keyring: can't open /var/lib/ceph/osd/c2-5/keyring: (2) No such file or directory 2023-12-15T22:52:31.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.323+0000 7f1acb746500 -1 created new key in keyring /var/lib/ceph/osd/c2-5/keyring 2023-12-15T22:52:31.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.323+0000 7f1acb746500 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2023-12-15T22:52:31.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.323+0000 7f1acb746500 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2023-12-15T22:52:31.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.323+0000 7f1acb746500 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2023-12-15T22:52:31.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:52:31.324+0000 7f1acb746500 -1 bluestore(/var/lib/ceph/osd/c2-5) _read_fsid unparsable uuid 2023-12-15T22:52:33.401 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-5 2023-12-15T22:52:33.430 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-15T22:52:33.430 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:33.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2023-12-15T22:52:33.461 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:33.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2023-12-15T22:52:33.532 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:33.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2023-12-15T22:52:33.603 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:33.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2023-12-15T22:52:33.631 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:33.631 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-3/keyring of=/dev/stdout 2023-12-15T22:52:33.698 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:33.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-4/keyring of=/dev/stdout 2023-12-15T22:52:33.765 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:33.765 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-5/keyring of=/dev/stdout 2023-12-15T22:52:33.831 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:33.831 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2023-12-15T22:52:33.849 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:33.849 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2023-12-15T22:52:33.886 INFO:tasks.ceph:Adding keys to all mons... 2023-12-15T22:52:33.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/c2.keyring 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCh2HxljISqOhAA+LvUJt9TRV+vuCMNRp+cww== 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCk2HxlqD8wCxAAUyaCyVem3jm+jblmnArISw== 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCm2HxlfEfXFhAAB7jnhOsiu0YZMIZ2y0pFfA== 2023-12-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCf2Hxl/Zd7HBAA2aqddIp217AFpVCxzdt3iQ== 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCq2HxlfhNFNhAAChnpZm9tNoCcujhqE7nxhQ== 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.4] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCt2Hxlp/LDBhAAwDs+t7PCw1u77CJwLIOksA== 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCv2Hxl8J5TExAAxY2CrKWMfx3Re0oQ61cpSw== 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCf2HxlrCAqHxAADPuxI/4QkLbjHSZZribgmg== 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2023-12-15T22:52:33.918 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCf2Hxl+26KIhAA3V5uktmEithnNNpqEJJdoQ== 2023-12-15T22:52:33.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-15T22:52:34.169 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-15T22:52:34.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-15T22:52:34.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-15T22:52:34.430 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-15T22:52:34.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2023-12-15T22:52:34.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2023-12-15T22:52:34.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2023-12-15T22:52:34.579 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/c2.monmap 2023-12-15T22:52:34.633 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2023-12-15T22:52:34.633 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2023-12-15T22:52:34.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2023-12-15T22:52:34.675 INFO:tasks.ceph.c2.mon.a:Started 2023-12-15T22:52:34.675 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2023-12-15T22:52:34.675 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2023-12-15T22:52:34.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2023-12-15T22:52:34.677 INFO:tasks.ceph.c2.mgr.x:Started 2023-12-15T22:52:34.678 INFO:tasks.ceph:Setting crush tunables to default 2023-12-15T22:52:34.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster c2 osd crush tunables default 2023-12-15T22:52:34.865 INFO:teuthology.orchestra.run.smithi188.stderr:adjusted tunables profile to default 2023-12-15T22:52:34.876 INFO:tasks.ceph:check_enable_crimson: False 2023-12-15T22:52:34.876 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2023-12-15T22:52:34.876 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:34.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2023-12-15T22:52:34.902 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:34.902 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2023-12-15T22:52:34.969 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-15T22:52:34.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2023-12-15T22:52:35.036 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:35.037 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-3/fsid of=/dev/stdout 2023-12-15T22:52:35.066 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:35.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-4/fsid of=/dev/stdout 2023-12-15T22:52:35.132 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-12-15T22:52:35.133 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/c2-5/fsid of=/dev/stdout 2023-12-15T22:52:35.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new 106b9511-dccd-4711-9bd6-e914ed44c8e9 0 2023-12-15T22:52:35.420 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-12-15T22:52:35.431 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new 5f59f502-7c8d-4f03-9aa5-c0a8e70601ce 1 2023-12-15T22:52:35.469 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:35.469+0000 7f1ca1df1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-15T22:52:35.522 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:35.522+0000 7f1ca1df1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-15T22:52:35.609 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-12-15T22:52:35.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new 4c5e83a5-d068-46b1-88a3-b529b6dfe5ef 2 2023-12-15T22:52:35.840 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-12-15T22:52:35.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new bfef6b25-bf33-4459-93ee-9bccb2578a1d 3 2023-12-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-12-15T22:52:36.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new e09d8784-856e-4df3-900f-00a8aab4d10e 4 2023-12-15T22:52:36.135 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.135+0000 7f1ca1df1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-15T22:52:36.189 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.189+0000 7f1ca1df1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-15T22:52:36.223 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-12-15T22:52:36.234 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster c2 osd new a02b7733-8345-4dd3-bd5b-758124da70cf 5 2023-12-15T22:52:36.237 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.236+0000 7f1ca1df1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-15T22:52:36.292 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.292+0000 7f1ca1df1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-15T22:52:36.336 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.336+0000 7f1ca1df1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-15T22:52:36.417 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-12-15T22:52:36.428 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2023-12-15T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2023-12-15T22:52:36.431 INFO:tasks.ceph.c2.osd.0:Started 2023-12-15T22:52:36.431 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2023-12-15T22:52:36.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2023-12-15T22:52:36.434 INFO:tasks.ceph.c2.osd.1:Started 2023-12-15T22:52:36.434 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2023-12-15T22:52:36.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2023-12-15T22:52:36.436 INFO:tasks.ceph.c2.osd.2:Started 2023-12-15T22:52:36.436 INFO:tasks.ceph.c2.osd.3:Restarting daemon 2023-12-15T22:52:36.436 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 3 2023-12-15T22:52:36.439 INFO:tasks.ceph.c2.osd.3:Started 2023-12-15T22:52:36.439 INFO:tasks.ceph.c2.osd.4:Restarting daemon 2023-12-15T22:52:36.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 4 2023-12-15T22:52:36.441 INFO:tasks.ceph.c2.osd.4:Started 2023-12-15T22:52:36.441 INFO:tasks.ceph.c2.osd.5:Restarting daemon 2023-12-15T22:52:36.441 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 5 2023-12-15T22:52:36.443 INFO:tasks.ceph.c2.osd.5:Started 2023-12-15T22:52:36.444 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2023-12-15T22:52:36.444 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.443+0000 7f1ca1df1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-15T22:52:36.521 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.521+0000 7f1ca1df1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-15T22:52:36.566 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.566+0000 7f1ca1df1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-15T22:52:36.617 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.617+0000 7f1ca1df1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-15T22:52:36.621 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:36.622 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":8,"fsid":"04dcd530-0fa5-49c9-bdf2-2896faaf39ad","created":"2023-12-15T22:52:34.787369+0000","modified":"2023-12-15T22:52:36.414361+0000","last_up_change":"0.000000","last_in_change":"2023-12-15T22:52:36.414361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"106b9511-dccd-4711-9bd6-e914ed44c8e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f59f502-7c8d-4f03-9aa5-c0a8e70601ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c5e83a5-d068-46b1-88a3-b529b6dfe5ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bfef6b25-bf33-4459-93ee-9bccb2578a1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e09d8784-856e-4df3-900f-00a8aab4d10e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a02b7733-8345-4dd3-bd5b-758124da70cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:36.633 INFO:tasks.ceph.ceph_manager.c2:[] 2023-12-15T22:52:36.633 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-15T22:52:36.663 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:36.662+0000 7f1ca1df1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-15T22:52:37.032 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T22:52:37.031+0000 7fd08af39500 -1 Falling back to public interface 2023-12-15T22:52:37.034 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T22:52:37.034+0000 7f8c80b07500 -1 Falling back to public interface 2023-12-15T22:52:37.036 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T22:52:37.035+0000 7f758c80d500 -1 Falling back to public interface 2023-12-15T22:52:37.036 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T22:52:37.035+0000 7fb45c412500 -1 Falling back to public interface 2023-12-15T22:52:37.037 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T22:52:37.037+0000 7fe1e8f12500 -1 Falling back to public interface 2023-12-15T22:52:37.038 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.038+0000 7f1ca1df1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-15T22:52:37.039 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T22:52:37.038+0000 7f1db039b500 -1 Falling back to public interface 2023-12-15T22:52:37.170 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.170+0000 7f1ca1df1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-15T22:52:37.237 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2023-12-15T22:52:37.285 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.285+0000 7f1ca1df1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-15T22:52:37.332 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.332+0000 7f1ca1df1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-15T22:52:37.394 INFO:teuthology.misc.health.smithi188.stdout: 2023-12-15T22:52:37.394 INFO:teuthology.misc.health.smithi188.stdout:{"epoch":8,"fsid":"04dcd530-0fa5-49c9-bdf2-2896faaf39ad","created":"2023-12-15T22:52:34.787369+0000","modified":"2023-12-15T22:52:36.414361+0000","last_up_change":"0.000000","last_in_change":"2023-12-15T22:52:36.414361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"106b9511-dccd-4711-9bd6-e914ed44c8e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f59f502-7c8d-4f03-9aa5-c0a8e70601ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c5e83a5-d068-46b1-88a3-b529b6dfe5ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bfef6b25-bf33-4459-93ee-9bccb2578a1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e09d8784-856e-4df3-900f-00a8aab4d10e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a02b7733-8345-4dd3-bd5b-758124da70cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:37.403 DEBUG:teuthology.misc:0 of 6 OSDs are up 2023-12-15T22:52:37.427 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.427+0000 7f1ca1df1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-15T22:52:37.519 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.519+0000 7f1ca1df1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-15T22:52:37.658 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.658+0000 7f1ca1df1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-15T22:52:37.699 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.699+0000 7f1ca1df1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-15T22:52:37.836 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:37.836+0000 7f1ca1df1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-15T22:52:38.629 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:38.628+0000 7f1ca1df1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-15T22:52:38.896 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:38.896+0000 7f1ca1df1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-15T22:52:38.947 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:38.946+0000 7f1ca1df1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-15T22:52:39.047 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:39.047+0000 7f1ca1df1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-15T22:52:39.699 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T22:52:39.699+0000 7f8c80b07500 -1 osd.0 0 log_to_monitors true 2023-12-15T22:52:39.744 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T22:52:39.744+0000 7f1db039b500 -1 osd.2 0 log_to_monitors true 2023-12-15T22:52:39.751 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T22:52:39.751+0000 7fb45c412500 -1 osd.1 0 log_to_monitors true 2023-12-15T22:52:39.754 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T22:52:39.754+0000 7fd08af39500 -1 osd.3 0 log_to_monitors true 2023-12-15T22:52:39.786 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T22:52:39.786+0000 7fe1e8f12500 -1 osd.4 0 log_to_monitors true 2023-12-15T22:52:39.793 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T22:52:39.793+0000 7f758c80d500 -1 osd.5 0 log_to_monitors true 2023-12-15T22:52:40.067 INFO:tasks.ceph.c2.mgr.x.smithi192.stderr:2023-12-15T22:52:40.067+0000 7f1c4391e640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-15T22:52:42.266 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T22:52:42.266+0000 7f8c7d2ab640 -1 osd.0 0 waiting for initial osdmap 2023-12-15T22:52:42.280 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T22:52:42.280+0000 7f8c748be640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:42.319 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T22:52:42.319+0000 7f1dac32b640 -1 osd.2 0 waiting for initial osdmap 2023-12-15T22:52:42.333 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T22:52:42.333+0000 7f1da4152640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:42.346 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T22:52:42.346+0000 7fb457d09640 -1 osd.1 0 waiting for initial osdmap 2023-12-15T22:52:42.355 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T22:52:42.355+0000 7fb44fb30640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:42.548 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T22:52:42.548+0000 7fd086ec7640 -1 osd.3 0 waiting for initial osdmap 2023-12-15T22:52:42.558 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T22:52:42.558+0000 7fd07ecee640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:42.657 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T22:52:42.657+0000 7fe1e4ea0640 -1 osd.4 0 waiting for initial osdmap 2023-12-15T22:52:42.659 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T22:52:42.659+0000 7f758893b640 -1 osd.5 0 waiting for initial osdmap 2023-12-15T22:52:42.668 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T22:52:42.668+0000 7fe1dccc7640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:42.671 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T22:52:42.671+0000 7f757ff4e640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-15T22:52:44.009 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2023-12-15T22:52:44.294 INFO:teuthology.misc.health.smithi188.stdout: 2023-12-15T22:52:44.294 INFO:teuthology.misc.health.smithi188.stdout:{"epoch":12,"fsid":"04dcd530-0fa5-49c9-bdf2-2896faaf39ad","created":"2023-12-15T22:52:34.787369+0000","modified":"2023-12-15T22:52:44.270999+0000","last_up_change":"2023-12-15T22:52:43.270167+0000","last_in_change":"2023-12-15T22:52:36.414361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"106b9511-dccd-4711-9bd6-e914ed44c8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6801","nonce":169267262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6803","nonce":169267262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6807","nonce":169267262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6805","nonce":169267262}]},"public_addr":"172.21.15.188:6801/169267262","cluster_addr":"172.21.15.188:6803/169267262","heartbeat_back_addr":"172.21.15.188:6807/169267262","heartbeat_front_addr":"172.21.15.188:6805/169267262","state":["exists","up"]},{"osd":1,"uuid":"5f59f502-7c8d-4f03-9aa5-c0a8e70601ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6809","nonce":2874837664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6811","nonce":2874837664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6815","nonce":2874837664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6813","nonce":2874837664}]},"public_addr":"172.21.15.188:6809/2874837664","cluster_addr":"172.21.15.188:6811/2874837664","heartbeat_back_addr":"172.21.15.188:6815/2874837664","heartbeat_front_addr":"172.21.15.188:6813/2874837664","state":["exists","up"]},{"osd":2,"uuid":"4c5e83a5-d068-46b1-88a3-b529b6dfe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6817","nonce":878383302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6819","nonce":878383302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6823","nonce":878383302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6821","nonce":878383302}]},"public_addr":"172.21.15.188:6817/878383302","cluster_addr":"172.21.15.188:6819/878383302","heartbeat_back_addr":"172.21.15.188:6823/878383302","heartbeat_front_addr":"172.21.15.188:6821/878383302","state":["exists","up"]},{"osd":3,"uuid":"bfef6b25-bf33-4459-93ee-9bccb2578a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6801","nonce":1942018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6803","nonce":1942018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6807","nonce":1942018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6805","nonce":1942018351}]},"public_addr":"172.21.15.192:6801/1942018351","cluster_addr":"172.21.15.192:6803/1942018351","heartbeat_back_addr":"172.21.15.192:6807/1942018351","heartbeat_front_addr":"172.21.15.192:6805/1942018351","state":["exists","up"]},{"osd":4,"uuid":"e09d8784-856e-4df3-900f-00a8aab4d10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6817","nonce":2901923447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6819","nonce":2901923447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6823","nonce":2901923447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6821","nonce":2901923447}]},"public_addr":"172.21.15.192:6817/2901923447","cluster_addr":"172.21.15.192:6819/2901923447","heartbeat_back_addr":"172.21.15.192:6823/2901923447","heartbeat_front_addr":"172.21.15.192:6821/2901923447","state":["exists","up"]},{"osd":5,"uuid":"a02b7733-8345-4dd3-bd5b-758124da70cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6809","nonce":1961855731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6811","nonce":1961855731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6815","nonce":1961855731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6813","nonce":1961855731}]},"public_addr":"172.21.15.192:6809/1961855731","cluster_addr":"172.21.15.192:6811/1961855731","heartbeat_back_addr":"172.21.15.192:6815/1961855731","heartbeat_front_addr":"172.21.15.192:6813/1961855731","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.675513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.728379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.716107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.785631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.749292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.844122+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:44.305 DEBUG:teuthology.misc:6 of 6 OSDs are up 2023-12-15T22:52:44.305 INFO:tasks.ceph:Creating RBD pool 2023-12-15T22:52:44.306 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster c2 osd pool create rbd 8 2023-12-15T22:52:45.281 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'rbd' created 2023-12-15T22:52:45.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-15T22:52:46.282 INFO:teuthology.orchestra.run.smithi188.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-15T22:52:46.297 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2023-12-15T22:52:46.298 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2023-12-15T22:52:46.298 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2023-12-15T22:52:46.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2023-12-15T22:52:46.298 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-15T22:52:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:46.640 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3936894303},{"type":"v1","addr":"172.21.15.192:6825","nonce":3936894303}]},"active_addr":"172.21.15.192:6825/3936894303","active_change":"2023-12-15T22:52:39.061112+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2939341703}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3022168217}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3598123844}]}]} 2023-12-15T22:52:46.642 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2023-12-15T22:52:46.642 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2023-12-15T22:52:46.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2023-12-15T22:52:46.931 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:46.931 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":14,"fsid":"04dcd530-0fa5-49c9-bdf2-2896faaf39ad","created":"2023-12-15T22:52:34.787369+0000","modified":"2023-12-15T22:52:46.281751+0000","last_up_change":"2023-12-15T22:52:43.270167+0000","last_in_change":"2023-12-15T22:52:36.414361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-12-15T22:52:44.600259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-12-15T22:52:45.105676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"106b9511-dccd-4711-9bd6-e914ed44c8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6801","nonce":169267262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6803","nonce":169267262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6807","nonce":169267262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6805","nonce":169267262}]},"public_addr":"172.21.15.188:6801/169267262","cluster_addr":"172.21.15.188:6803/169267262","heartbeat_back_addr":"172.21.15.188:6807/169267262","heartbeat_front_addr":"172.21.15.188:6805/169267262","state":["exists","up"]},{"osd":1,"uuid":"5f59f502-7c8d-4f03-9aa5-c0a8e70601ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6809","nonce":2874837664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6811","nonce":2874837664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6815","nonce":2874837664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6813","nonce":2874837664}]},"public_addr":"172.21.15.188:6809/2874837664","cluster_addr":"172.21.15.188:6811/2874837664","heartbeat_back_addr":"172.21.15.188:6815/2874837664","heartbeat_front_addr":"172.21.15.188:6813/2874837664","state":["exists","up"]},{"osd":2,"uuid":"4c5e83a5-d068-46b1-88a3-b529b6dfe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6817","nonce":878383302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6819","nonce":878383302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6823","nonce":878383302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6821","nonce":878383302}]},"public_addr":"172.21.15.188:6817/878383302","cluster_addr":"172.21.15.188:6819/878383302","heartbeat_back_addr":"172.21.15.188:6823/878383302","heartbeat_front_addr":"172.21.15.188:6821/878383302","state":["exists","up"]},{"osd":3,"uuid":"bfef6b25-bf33-4459-93ee-9bccb2578a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6801","nonce":1942018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6803","nonce":1942018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6807","nonce":1942018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6805","nonce":1942018351}]},"public_addr":"172.21.15.192:6801/1942018351","cluster_addr":"172.21.15.192:6803/1942018351","heartbeat_back_addr":"172.21.15.192:6807/1942018351","heartbeat_front_addr":"172.21.15.192:6805/1942018351","state":["exists","up"]},{"osd":4,"uuid":"e09d8784-856e-4df3-900f-00a8aab4d10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6817","nonce":2901923447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6819","nonce":2901923447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6823","nonce":2901923447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6821","nonce":2901923447}]},"public_addr":"172.21.15.192:6817/2901923447","cluster_addr":"172.21.15.192:6819/2901923447","heartbeat_back_addr":"172.21.15.192:6823/2901923447","heartbeat_front_addr":"172.21.15.192:6821/2901923447","state":["exists","up"]},{"osd":5,"uuid":"a02b7733-8345-4dd3-bd5b-758124da70cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6809","nonce":1961855731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6811","nonce":1961855731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6815","nonce":1961855731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6813","nonce":1961855731}]},"public_addr":"172.21.15.192:6809/1961855731","cluster_addr":"172.21.15.192:6811/1961855731","heartbeat_back_addr":"172.21.15.192:6815/1961855731","heartbeat_front_addr":"172.21.15.192:6813/1961855731","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.675513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.728379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.716107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.785631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.749292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.844122+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:46.944 INFO:tasks.ceph.ceph_manager.c2:all up! 2023-12-15T22:52:46.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2023-12-15T22:52:47.226 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:47.226 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":14,"fsid":"04dcd530-0fa5-49c9-bdf2-2896faaf39ad","created":"2023-12-15T22:52:34.787369+0000","modified":"2023-12-15T22:52:46.281751+0000","last_up_change":"2023-12-15T22:52:43.270167+0000","last_in_change":"2023-12-15T22:52:36.414361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-12-15T22:52:44.600259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-12-15T22:52:45.105676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"106b9511-dccd-4711-9bd6-e914ed44c8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6801","nonce":169267262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6803","nonce":169267262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6807","nonce":169267262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":169267262},{"type":"v1","addr":"172.21.15.188:6805","nonce":169267262}]},"public_addr":"172.21.15.188:6801/169267262","cluster_addr":"172.21.15.188:6803/169267262","heartbeat_back_addr":"172.21.15.188:6807/169267262","heartbeat_front_addr":"172.21.15.188:6805/169267262","state":["exists","up"]},{"osd":1,"uuid":"5f59f502-7c8d-4f03-9aa5-c0a8e70601ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6809","nonce":2874837664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6811","nonce":2874837664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6815","nonce":2874837664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2874837664},{"type":"v1","addr":"172.21.15.188:6813","nonce":2874837664}]},"public_addr":"172.21.15.188:6809/2874837664","cluster_addr":"172.21.15.188:6811/2874837664","heartbeat_back_addr":"172.21.15.188:6815/2874837664","heartbeat_front_addr":"172.21.15.188:6813/2874837664","state":["exists","up"]},{"osd":2,"uuid":"4c5e83a5-d068-46b1-88a3-b529b6dfe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6817","nonce":878383302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6819","nonce":878383302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6823","nonce":878383302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":878383302},{"type":"v1","addr":"172.21.15.188:6821","nonce":878383302}]},"public_addr":"172.21.15.188:6817/878383302","cluster_addr":"172.21.15.188:6819/878383302","heartbeat_back_addr":"172.21.15.188:6823/878383302","heartbeat_front_addr":"172.21.15.188:6821/878383302","state":["exists","up"]},{"osd":3,"uuid":"bfef6b25-bf33-4459-93ee-9bccb2578a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6801","nonce":1942018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6803","nonce":1942018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6807","nonce":1942018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1942018351},{"type":"v1","addr":"172.21.15.192:6805","nonce":1942018351}]},"public_addr":"172.21.15.192:6801/1942018351","cluster_addr":"172.21.15.192:6803/1942018351","heartbeat_back_addr":"172.21.15.192:6807/1942018351","heartbeat_front_addr":"172.21.15.192:6805/1942018351","state":["exists","up"]},{"osd":4,"uuid":"e09d8784-856e-4df3-900f-00a8aab4d10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6817","nonce":2901923447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6819","nonce":2901923447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6823","nonce":2901923447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2901923447},{"type":"v1","addr":"172.21.15.192:6821","nonce":2901923447}]},"public_addr":"172.21.15.192:6817/2901923447","cluster_addr":"172.21.15.192:6819/2901923447","heartbeat_back_addr":"172.21.15.192:6823/2901923447","heartbeat_front_addr":"172.21.15.192:6821/2901923447","state":["exists","up"]},{"osd":5,"uuid":"a02b7733-8345-4dd3-bd5b-758124da70cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6809","nonce":1961855731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6811","nonce":1961855731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6815","nonce":1961855731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1961855731},{"type":"v1","addr":"172.21.15.192:6813","nonce":1961855731}]},"public_addr":"172.21.15.192:6809/1961855731","cluster_addr":"172.21.15.192:6811/1961855731","heartbeat_back_addr":"172.21.15.192:6815/1961855731","heartbeat_front_addr":"172.21.15.192:6813/1961855731","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.675513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.728379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.716107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.785631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.749292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:40.844122+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-15T22:52:47.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2023-12-15T22:52:47.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2023-12-15T22:52:47.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2023-12-15T22:52:47.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.3 flush_pg_stats 2023-12-15T22:52:47.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.4 flush_pg_stats 2023-12-15T22:52:47.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.5 flush_pg_stats 2023-12-15T22:52:47.397 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:47.397 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2023-12-15T22:52:47.404 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:47.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2023-12-15T22:52:47.527 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:47.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2023-12-15T22:52:47.529 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:47.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2023-12-15T22:52:47.542 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:47.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2023-12-15T22:52:47.549 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:47.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2023-12-15T22:52:47.746 INFO:teuthology.orchestra.run.smithi188.stdout:47244640259 2023-12-15T22:52:47.760 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.1 2023-12-15T22:52:47.878 INFO:teuthology.orchestra.run.smithi188.stdout:47244640259 2023-12-15T22:52:47.891 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.3 2023-12-15T22:52:47.895 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:47.908 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640260 for osd.5 2023-12-15T22:52:47.936 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:47.948 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640260 for osd.2 2023-12-15T22:52:48.018 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:48.031 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640260 for osd.4 2023-12-15T22:52:48.036 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:48.049 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640260 for osd.0 2023-12-15T22:52:48.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2023-12-15T22:52:48.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2023-12-15T22:52:48.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2023-12-15T22:52:48.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2023-12-15T22:52:49.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2023-12-15T22:52:49.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2023-12-15T22:52:49.073 INFO:teuthology.orchestra.run.smithi188.stdout:47244640259 2023-12-15T22:52:49.089 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.1 2023-12-15T22:52:49.216 INFO:teuthology.orchestra.run.smithi188.stdout:47244640259 2023-12-15T22:52:49.229 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.3 2023-12-15T22:52:49.341 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:49.341 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:49.355 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640261 for osd.5 2023-12-15T22:52:49.355 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:49.359 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640261 for osd.4 2023-12-15T22:52:49.359 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:49.389 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:49.394 INFO:teuthology.orchestra.run.smithi188.stdout:47244640261 2023-12-15T22:52:49.402 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640261 for osd.2 2023-12-15T22:52:49.403 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:49.407 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640261 for osd.0 2023-12-15T22:52:49.407 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:50.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2023-12-15T22:52:50.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2023-12-15T22:52:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:50.394 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.1 2023-12-15T22:52:50.394 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:50.515 INFO:teuthology.orchestra.run.smithi188.stdout:47244640260 2023-12-15T22:52:50.527 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.3 2023-12-15T22:52:50.528 DEBUG:teuthology.parallel:result is None 2023-12-15T22:52:50.528 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2023-12-15T22:52:50.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2023-12-15T22:52:50.801 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:50.802 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2023-12-15T22:52:50.814 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-12-15T22:52:49.066262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164496,"kb_used_data":1636,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628981104,"statfs":{"total":644245094400,"available":644076650496,"internally_reserved":0,"allocated":1675264,"data_stored":1131683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9565,"internal_metadata":165927587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.292122+0000","last_change":"2023-12-15T22:52:46.679994+0000","last_active":"2023-12-15T22:52:47.292122+0000","last_peered":"2023-12-15T22:52:47.292122+0000","last_clean":"2023-12-15T22:52:47.292122+0000","last_became_active":"2023-12-15T22:52:46.679753+0000","last_became_peered":"2023-12-15T22:52:46.679753+0000","last_unstale":"2023-12-15T22:52:47.292122+0000","last_undegraded":"2023-12-15T22:52:47.292122+0000","last_fullsized":"2023-12-15T22:52:47.292122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:53.253058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.358277+0000","last_change":"2023-12-15T22:52:46.632125+0000","last_active":"2023-12-15T22:52:47.358277+0000","last_peered":"2023-12-15T22:52:47.358277+0000","last_clean":"2023-12-15T22:52:47.358277+0000","last_became_active":"2023-12-15T22:52:46.631839+0000","last_became_peered":"2023-12-15T22:52:46.631839+0000","last_unstale":"2023-12-15T22:52:47.358277+0000","last_undegraded":"2023-12-15T22:52:47.358277+0000","last_fullsized":"2023-12-15T22:52:47.358277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:39.027572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:46.682848+0000","last_change":"2023-12-15T22:52:46.679942+0000","last_active":"2023-12-15T22:52:46.682848+0000","last_peered":"2023-12-15T22:52:46.682848+0000","last_clean":"2023-12-15T22:52:46.682848+0000","last_became_active":"2023-12-15T22:52:46.679699+0000","last_became_peered":"2023-12-15T22:52:46.679699+0000","last_unstale":"2023-12-15T22:52:46.682848+0000","last_undegraded":"2023-12-15T22:52:46.682848+0000","last_fullsized":"2023-12-15T22:52:46.682848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:59.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:46.290579+0000","last_change":"2023-12-15T22:52:46.289869+0000","last_active":"2023-12-15T22:52:46.290579+0000","last_peered":"2023-12-15T22:52:46.290579+0000","last_clean":"2023-12-15T22:52:46.290579+0000","last_became_active":"2023-12-15T22:52:46.289616+0000","last_became_peered":"2023-12-15T22:52:46.289616+0000","last_unstale":"2023-12-15T22:52:46.290579+0000","last_undegraded":"2023-12-15T22:52:46.290579+0000","last_fullsized":"2023-12-15T22:52:46.290579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:22:18.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'105","reported_seq":146,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.358247+0000","last_change":"2023-12-15T22:52:46.291333+0000","last_active":"2023-12-15T22:52:47.358247+0000","last_peered":"2023-12-15T22:52:47.358247+0000","last_clean":"2023-12-15T22:52:47.358247+0000","last_became_active":"2023-12-15T22:52:46.291040+0000","last_became_peered":"2023-12-15T22:52:46.291040+0000","last_unstale":"2023-12-15T22:52:47.358247+0000","last_undegraded":"2023-12-15T22:52:47.358247+0000","last_fullsized":"2023-12-15T22:52:47.358247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:32.406633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:46.290587+0000","last_change":"2023-12-15T22:52:46.290155+0000","last_active":"2023-12-15T22:52:46.290587+0000","last_peered":"2023-12-15T22:52:46.290587+0000","last_clean":"2023-12-15T22:52:46.290587+0000","last_became_active":"2023-12-15T22:52:46.289929+0000","last_became_peered":"2023-12-15T22:52:46.289929+0000","last_unstale":"2023-12-15T22:52:46.290587+0000","last_undegraded":"2023-12-15T22:52:46.290587+0000","last_fullsized":"2023-12-15T22:52:46.290587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:59.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-15T22:52:46.635031+0000","last_change":"2023-12-15T22:52:46.632190+0000","last_active":"2023-12-15T22:52:46.635031+0000","last_peered":"2023-12-15T22:52:46.635031+0000","last_clean":"2023-12-15T22:52:46.635031+0000","last_became_active":"2023-12-15T22:52:46.631864+0000","last_became_peered":"2023-12-15T22:52:46.631864+0000","last_unstale":"2023-12-15T22:52:46.635031+0000","last_undegraded":"2023-12-15T22:52:46.635031+0000","last_fullsized":"2023-12-15T22:52:46.635031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:22:18.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.292115+0000","last_change":"2023-12-15T22:52:46.632193+0000","last_active":"2023-12-15T22:52:47.292115+0000","last_peered":"2023-12-15T22:52:47.292115+0000","last_clean":"2023-12-15T22:52:47.292115+0000","last_became_active":"2023-12-15T22:52:46.631875+0000","last_became_peered":"2023-12-15T22:52:46.631875+0000","last_unstale":"2023-12-15T22:52:47.292115+0000","last_undegraded":"2023-12-15T22:52:47.292115+0000","last_fullsized":"2023-12-15T22:52:47.292115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:50.437635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.358250+0000","last_change":"2023-12-15T22:52:46.632300+0000","last_active":"2023-12-15T22:52:47.358250+0000","last_peered":"2023-12-15T22:52:47.358250+0000","last_clean":"2023-12-15T22:52:47.358250+0000","last_became_active":"2023-12-15T22:52:46.631984+0000","last_became_peered":"2023-12-15T22:52:46.631984+0000","last_unstale":"2023-12-15T22:52:47.358250+0000","last_undegraded":"2023-12-15T22:52:47.358250+0000","last_fullsized":"2023-12-15T22:52:47.358250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:23.305256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830452,"statfs":{"total":107374182400,"available":107346382848,"internally_reserved":0,"allocated":131072,"data_stored":37763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27968,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829632,"statfs":{"total":107374182400,"available":107345543168,"internally_reserved":0,"allocated":593920,"data_stored":497043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":114688,"data_stored":31516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27964,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829636,"statfs":{"total":107374182400,"available":107345547264,"internally_reserved":0,"allocated":589824,"data_stored":496082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":114688,"data_stored":31516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-15T22:52:50.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2023-12-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi188.stderr:dumped all 2023-12-15T22:52:51.099 INFO:teuthology.orchestra.run.smithi188.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-12-15T22:52:51.066737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164884,"kb_used_data":1988,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628980716,"statfs":{"total":644245094400,"available":644076253184,"internally_reserved":0,"allocated":2035712,"data_stored":1435955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9565,"internal_metadata":165927587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000475"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.292122+0000","last_change":"2023-12-15T22:52:46.679994+0000","last_active":"2023-12-15T22:52:47.292122+0000","last_peered":"2023-12-15T22:52:47.292122+0000","last_clean":"2023-12-15T22:52:47.292122+0000","last_became_active":"2023-12-15T22:52:46.679753+0000","last_became_peered":"2023-12-15T22:52:46.679753+0000","last_unstale":"2023-12-15T22:52:47.292122+0000","last_undegraded":"2023-12-15T22:52:47.292122+0000","last_fullsized":"2023-12-15T22:52:47.292122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:53.253058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.358277+0000","last_change":"2023-12-15T22:52:46.632125+0000","last_active":"2023-12-15T22:52:47.358277+0000","last_peered":"2023-12-15T22:52:47.358277+0000","last_clean":"2023-12-15T22:52:47.358277+0000","last_became_active":"2023-12-15T22:52:46.631839+0000","last_became_peered":"2023-12-15T22:52:46.631839+0000","last_unstale":"2023-12-15T22:52:47.358277+0000","last_undegraded":"2023-12-15T22:52:47.358277+0000","last_fullsized":"2023-12-15T22:52:47.358277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:39.027572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.955081+0000","last_change":"2023-12-15T22:52:46.679942+0000","last_active":"2023-12-15T22:52:47.955081+0000","last_peered":"2023-12-15T22:52:47.955081+0000","last_clean":"2023-12-15T22:52:47.955081+0000","last_became_active":"2023-12-15T22:52:46.679699+0000","last_became_peered":"2023-12-15T22:52:46.679699+0000","last_unstale":"2023-12-15T22:52:47.955081+0000","last_undegraded":"2023-12-15T22:52:47.955081+0000","last_fullsized":"2023-12-15T22:52:47.955081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:53.253058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.487590+0000","last_change":"2023-12-15T22:52:46.289869+0000","last_active":"2023-12-15T22:52:47.487590+0000","last_peered":"2023-12-15T22:52:47.487590+0000","last_clean":"2023-12-15T22:52:47.487590+0000","last_became_active":"2023-12-15T22:52:46.289616+0000","last_became_peered":"2023-12-15T22:52:46.289616+0000","last_unstale":"2023-12-15T22:52:47.487590+0000","last_undegraded":"2023-12-15T22:52:47.487590+0000","last_fullsized":"2023-12-15T22:52:47.487590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:53.253058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":161,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.497002+0000","last_change":"2023-12-15T22:52:46.291333+0000","last_active":"2023-12-15T22:52:47.497002+0000","last_peered":"2023-12-15T22:52:47.497002+0000","last_clean":"2023-12-15T22:52:47.497002+0000","last_became_active":"2023-12-15T22:52:46.291040+0000","last_became_peered":"2023-12-15T22:52:46.291040+0000","last_unstale":"2023-12-15T22:52:47.497002+0000","last_undegraded":"2023-12-15T22:52:47.497002+0000","last_fullsized":"2023-12-15T22:52:47.497002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:32.406633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.487567+0000","last_change":"2023-12-15T22:52:46.290155+0000","last_active":"2023-12-15T22:52:47.487567+0000","last_peered":"2023-12-15T22:52:47.487567+0000","last_clean":"2023-12-15T22:52:47.487567+0000","last_became_active":"2023-12-15T22:52:46.289929+0000","last_became_peered":"2023-12-15T22:52:46.289929+0000","last_unstale":"2023-12-15T22:52:47.487567+0000","last_undegraded":"2023-12-15T22:52:47.487567+0000","last_fullsized":"2023-12-15T22:52:47.487567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:50.437635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.955081+0000","last_change":"2023-12-15T22:52:46.632190+0000","last_active":"2023-12-15T22:52:47.955081+0000","last_peered":"2023-12-15T22:52:47.955081+0000","last_clean":"2023-12-15T22:52:47.955081+0000","last_became_active":"2023-12-15T22:52:46.631864+0000","last_became_peered":"2023-12-15T22:52:46.631864+0000","last_unstale":"2023-12-15T22:52:47.955081+0000","last_undegraded":"2023-12-15T22:52:47.955081+0000","last_fullsized":"2023-12-15T22:52:47.955081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:23.305256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.292115+0000","last_change":"2023-12-15T22:52:46.632193+0000","last_active":"2023-12-15T22:52:47.292115+0000","last_peered":"2023-12-15T22:52:47.292115+0000","last_clean":"2023-12-15T22:52:47.292115+0000","last_became_active":"2023-12-15T22:52:46.631875+0000","last_became_peered":"2023-12-15T22:52:46.631875+0000","last_unstale":"2023-12-15T22:52:47.292115+0000","last_undegraded":"2023-12-15T22:52:47.292115+0000","last_fullsized":"2023-12-15T22:52:47.292115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:50.437635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-15T22:52:47.358250+0000","last_change":"2023-12-15T22:52:46.632300+0000","last_active":"2023-12-15T22:52:47.358250+0000","last_peered":"2023-12-15T22:52:47.358250+0000","last_clean":"2023-12-15T22:52:47.358250+0000","last_became_active":"2023-12-15T22:52:46.631984+0000","last_became_peered":"2023-12-15T22:52:46.631984+0000","last_unstale":"2023-12-15T22:52:47.358250+0000","last_undegraded":"2023-12-15T22:52:47.358250+0000","last_fullsized":"2023-12-15T22:52:47.358250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:45.274416+0000","last_clean_scrub_stamp":"2023-12-15T22:52:45.274416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:23.305256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830436,"statfs":{"total":107374182400,"available":107346366464,"internally_reserved":0,"allocated":143360,"data_stored":43017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27864,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829736,"statfs":{"total":107374182400,"available":107345649664,"internally_reserved":0,"allocated":737280,"data_stored":633385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27164,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830436,"statfs":{"total":107374182400,"available":107346366464,"internally_reserved":0,"allocated":139264,"data_stored":42056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28360,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829240,"statfs":{"total":107374182400,"available":107345141760,"internally_reserved":0,"allocated":733184,"data_stored":632424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27164,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830436,"statfs":{"total":107374182400,"available":107346366464,"internally_reserved":0,"allocated":139264,"data_stored":42056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-15T22:52:51.100 INFO:tasks.ceph.ceph_manager.c2:clean! 2023-12-15T22:52:51.100 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2023-12-15T22:52:51.100 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2023-12-15T22:52:51.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2023-12-15T22:52:51.412 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-15T22:52:51.412 INFO:teuthology.orchestra.run.smithi188.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-15T22:52:51.424 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2023-12-15T22:52:51.425 INFO:teuthology.run_tasks:Running task rgw... 2023-12-15T22:52:51.439 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2023-12-15T22:52:51.439 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2023-12-15T22:52:51.439 INFO:tasks.rgw:Creating data pools 2023-12-15T22:52:51.439 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2023-12-15T22:52:51.440 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2023-12-15T22:52:52.155 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'default.rgw.buckets.data' created 2023-12-15T22:52:52.172 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2023-12-15T22:52:53.158 INFO:teuthology.orchestra.run.smithi093.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-15T22:52:53.185 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2023-12-15T22:52:54.162 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'default.rgw.buckets.index' created 2023-12-15T22:52:54.182 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2023-12-15T22:52:55.168 INFO:teuthology.orchestra.run.smithi093.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-15T22:52:55.190 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2023-12-15T22:52:55.191 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2023-12-15T22:52:55.475 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'default.rgw.buckets.data' already exists 2023-12-15T22:52:55.487 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2023-12-15T22:52:56.172 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-15T22:52:56.185 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2023-12-15T22:52:56.465 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'default.rgw.buckets.index' already exists 2023-12-15T22:52:56.477 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2023-12-15T22:52:57.186 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-15T22:52:57.200 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2023-12-15T22:52:57.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2023-12-15T22:52:57.766 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'default.rgw.buckets.data' created 2023-12-15T22:52:57.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2023-12-15T22:52:58.769 INFO:teuthology.orchestra.run.smithi188.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-15T22:52:58.795 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2023-12-15T22:52:59.772 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'default.rgw.buckets.index' created 2023-12-15T22:52:59.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2023-12-15T22:53:00.773 INFO:teuthology.orchestra.run.smithi188.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-15T22:53:00.800 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2023-12-15T22:53:00.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2023-12-15T22:53:01.089 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'default.rgw.buckets.data' already exists 2023-12-15T22:53:01.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2023-12-15T22:53:01.783 INFO:teuthology.orchestra.run.smithi192.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-15T22:53:01.796 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2023-12-15T22:53:02.073 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'default.rgw.buckets.index' already exists 2023-12-15T22:53:02.085 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2023-12-15T22:53:02.783 INFO:teuthology.orchestra.run.smithi192.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-15T22:53:02.797 DEBUG:tasks.rgw:Pools created 2023-12-15T22:53:02.797 INFO:tasks.rgw:Configuring compression type = random 2023-12-15T22:53:02.797 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2023-12-15T22:53:02.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2023-12-15T22:53:02.797 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2023-12-15T22:53:02.916 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:02.916 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:02.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:02.928+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 20 realm 2023-12-15T22:53:04.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-15T22:53:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.318+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.319+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.319+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.320+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.320+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.321+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.321+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.321+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.321+0000 7f692472c800 10 Creating default zonegroup 2023-12-15T22:53:04.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.333+0000 7f692472c800 10 WARNING: driver->list_zones() returned r=-2 2023-12-15T22:53:04.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.333+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.333+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 10 could not read realm id: (2) No such file or directory 2023-12-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 10 WARNING: failed to set zone as default, r=-22 2023-12-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.336+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.339+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.339+0000 7f692472c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-15T22:53:04.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.339+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.340+0000 7f692472c800 20 rados_obj.operate() r=0 bl.length=420 2023-12-15T22:53:04.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.340+0000 7f692472c800 10 Using default name default 2023-12-15T22:53:04.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.340+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.340+0000 7f692472c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:04.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.340+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 20 zone default found 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 4 Realm: () 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 4 ZoneGroup: default (049f76e2-e6ec-4d53-911b-666a7230bd0f) 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 4 Zone: default (37d07bca-5ce3-439a-b493-6eb05d9f98b6) 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 20 zonegroup default 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.341+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.342+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:04.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:04.342+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:06.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:06.324+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:06.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:06.324+0000 7f692472c800 20 rados->read ofs=0 len=0 2023-12-15T22:53:06.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:06.324+0000 7f692472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:06.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:06.324+0000 7f692472c800 20 started sync module instance, tier type = 2023-12-15T22:53:06.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:06.324+0000 7f692472c800 20 started zone id=37d07bca-5ce3-439a-b493-6eb05d9f98b6 (name=default) with tier type = 2023-12-15T22:53:08.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=0 2023-12-15T22:53:08.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=1 2023-12-15T22:53:08.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=2 2023-12-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=3 2023-12-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=4 2023-12-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=5 2023-12-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.354+0000 7f692472c800 20 add_watcher() i=6 2023-12-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.355+0000 7f692472c800 20 add_watcher() i=7 2023-12-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.355+0000 7f692472c800 2 all 8 watchers are set, enabling cache 2023-12-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.355+0000 7f692472c800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-12-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.355+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-12-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.355+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-12-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-12-15T22:53:08.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.356+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:08.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.357+0000 7f692472c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-12-15T22:53:08.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.357+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-12-15T22:53:08.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.358+0000 7f692472c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:08.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.364+0000 7f68e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:08.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.365+0000 7f692472c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:08.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:08.365+0000 7f692472c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:11.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.327+0000 7f692472c800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-12-15T22:53:11.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.327+0000 7f692472c800 5 note: GC not initialized 2023-12-15T22:53:11.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.328+0000 7f68e57e2640 20 reqs_thread_entry: start 2023-12-15T22:53:11.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.328+0000 7f692472c800 20 init_complete bucket index max shards: 11 2023-12-15T22:53:11.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.328+0000 7f692472c800 20 Filter name: none 2023-12-15T22:53:11.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.328+0000 7f6856ffd640 20 reqs_thread_entry: start 2023-12-15T22:53:11.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.340+0000 7f68e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:11.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.343+0000 7f692472c800 20 remove_watcher() i=0 2023-12-15T22:53:11.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.343+0000 7f692472c800 2 removed watcher, disabling cache 2023-12-15T22:53:11.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.346+0000 7f692472c800 20 remove_watcher() i=1 2023-12-15T22:53:11.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.347+0000 7f692472c800 20 remove_watcher() i=2 2023-12-15T22:53:11.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.349+0000 7f692472c800 20 remove_watcher() i=3 2023-12-15T22:53:11.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.358+0000 7f692472c800 20 remove_watcher() i=4 2023-12-15T22:53:11.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.365+0000 7f692472c800 20 remove_watcher() i=5 2023-12-15T22:53:11.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.366+0000 7f692472c800 20 remove_watcher() i=6 2023-12-15T22:53:11.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.371+0000 7f692472c800 20 remove_watcher() i=7 2023-12-15T22:53:11.376 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T22:53:11.377 DEBUG:tasks.util.rgw: json result: [] 2023-12-15T22:53:11.377 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:11.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:11.377 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-15T22:53:11.427 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:11.427 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:11.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.437+0000 7fe83852b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:11.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.437+0000 7fe83852b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:11.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:11.438+0000 7fe7fa7e4640 20 reqs_thread_entry: start 2023-12-15T22:53:11.447 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"37d07bca-5ce3-439a-b493-6eb05d9f98b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-15T22:53:11.447 DEBUG:tasks.util.rgw: json result: {'id': '37d07bca-5ce3-439a-b493-6eb05d9f98b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-15T22:53:11.447 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2023-12-15T22:53:11.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2023-12-15T22:53:11.447 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2023-12-15T22:53:11.549 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:11.549 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:11.563 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.562+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.563+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.563+0000 7f3a0e337800 20 realm 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.563+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.564+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.564+0000 7f3a0e337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.564+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.564+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.564 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.564+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.565 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.565+0000 7f3a0e337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:11.565 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.565+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.565 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.565+0000 7f3a0e337800 20 rados_obj.operate() r=0 bl.length=890 2023-12-15T22:53:11.565 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.565+0000 7f3a0e337800 20 searching for the correct realm 2023-12-15T22:53:11.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 RGWRados::pool_iterate: got zone_info.37d07bca-5ce3-439a-b493-6eb05d9f98b6 2023-12-15T22:53:11.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 RGWRados::pool_iterate: got zonegroup_info.049f76e2-e6ec-4d53-911b-666a7230bd0f 2023-12-15T22:53:11.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-15T22:53:11.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-15T22:53:11.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.575+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados_obj.operate() r=0 bl.length=420 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 zone default found 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 4 Realm: () 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 4 ZoneGroup: default (049f76e2-e6ec-4d53-911b-666a7230bd0f) 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 4 Zone: default (37d07bca-5ce3-439a-b493-6eb05d9f98b6) 2023-12-15T22:53:11.577 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 zonegroup default 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.576+0000 7f3a0e337800 20 rados->read ofs=0 len=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.577+0000 7f3a0e337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.577+0000 7f3a0e337800 20 started sync module instance, tier type = 2023-12-15T22:53:11.578 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.577+0000 7f3a0e337800 20 started zone id=37d07bca-5ce3-439a-b493-6eb05d9f98b6 (name=default) with tier type = 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=0 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=1 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=2 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=3 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=4 2023-12-15T22:53:11.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=5 2023-12-15T22:53:11.602 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.601+0000 7f3a0e337800 20 add_watcher() i=6 2023-12-15T22:53:11.604 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.604+0000 7f3a0e337800 20 add_watcher() i=7 2023-12-15T22:53:11.604 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.604+0000 7f3a0e337800 2 all 8 watchers are set, enabling cache 2023-12-15T22:53:11.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.605+0000 7f39cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:11.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f3a0e337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:11.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f3a0e337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:11.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f3a0e337800 5 note: GC not initialized 2023-12-15T22:53:11.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f39ca7fc640 20 reqs_thread_entry: start 2023-12-15T22:53:11.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f3a0e337800 20 init_complete bucket index max shards: 11 2023-12-15T22:53:11.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f3a0e337800 20 Filter name: none 2023-12-15T22:53:11.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.606+0000 7f393bfff640 20 reqs_thread_entry: start 2023-12-15T22:53:11.616 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.616+0000 7f39cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:11.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.619+0000 7f3a0e337800 20 remove_watcher() i=0 2023-12-15T22:53:11.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.619+0000 7f3a0e337800 2 removed watcher, disabling cache 2023-12-15T22:53:11.620 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.620+0000 7f3a0e337800 20 remove_watcher() i=1 2023-12-15T22:53:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.621+0000 7f3a0e337800 20 remove_watcher() i=2 2023-12-15T22:53:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.623+0000 7f3a0e337800 20 remove_watcher() i=3 2023-12-15T22:53:11.624 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.624+0000 7f3a0e337800 20 remove_watcher() i=4 2023-12-15T22:53:11.625 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.624+0000 7f3a0e337800 20 remove_watcher() i=5 2023-12-15T22:53:11.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.626+0000 7f3a0e337800 20 remove_watcher() i=6 2023-12-15T22:53:11.629 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.629+0000 7f3a0e337800 20 remove_watcher() i=7 2023-12-15T22:53:11.644 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2023-12-15T22:53:11.644 DEBUG:tasks.util.rgw: json result: [] 2023-12-15T22:53:11.645 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:11.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:11.645 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-15T22:53:11.693 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:11.693 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:11.705 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.704+0000 7f2a11926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:11.705 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.704+0000 7f2a11926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:11.705 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T22:53:11.704+0000 7f29d37e6640 20 reqs_thread_entry: start 2023-12-15T22:53:11.713 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"37d07bca-5ce3-439a-b493-6eb05d9f98b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-15T22:53:11.713 DEBUG:tasks.util.rgw: json result: {'id': '37d07bca-5ce3-439a-b493-6eb05d9f98b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-15T22:53:11.714 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2023-12-15T22:53:11.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2023-12-15T22:53:11.714 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2023-12-15T22:53:11.815 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:11.815 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:11.828 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:11.828+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.817+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.817+0000 7f30d5c10800 20 realm 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.817+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.817+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.817+0000 7f30d5c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.818+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.818+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.819 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.818+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.820 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.820+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.821 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.820+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.821 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.821+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.822 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.821+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.822 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.821+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.822 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.822+0000 7f30d5c10800 10 Creating default zonegroup 2023-12-15T22:53:13.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.834+0000 7f30d5c10800 10 WARNING: driver->list_zones() returned r=-2 2023-12-15T22:53:13.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.834+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.834+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.836 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.836+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.837 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.837+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.837 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.837+0000 7f30d5c10800 10 could not read realm id: (2) No such file or directory 2023-12-15T22:53:13.837 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.837+0000 7f30d5c10800 10 WARNING: failed to set zone as default, r=-22 2023-12-15T22:53:13.837 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.837+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.837 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.837+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.839 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.839+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.841+0000 7f30d5c10800 20 rados_obj.operate() r=0 bl.length=874 2023-12-15T22:53:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.841+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.841+0000 7f30d5c10800 20 rados_obj.operate() r=0 bl.length=420 2023-12-15T22:53:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.841+0000 7f30d5c10800 10 Using default name default 2023-12-15T22:53:13.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.841+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:13.842 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 rados_obj.operate() r=0 bl.length=874 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 zone default found 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 4 Realm: () 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 4 ZoneGroup: default (ca7b60e2-cc3d-4aff-a0d1-069f02dbe359) 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 4 Zone: default (76e2af14-25ee-4dab-b24e-031cc56bbcae) 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 zonegroup default 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.842+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:13.843 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:13.843+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:15.826 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:15.826+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:15.826 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:15.826+0000 7f30d5c10800 20 rados->read ofs=0 len=0 2023-12-15T22:53:15.827 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:15.826+0000 7f30d5c10800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:15.827 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:15.826+0000 7f30d5c10800 20 started sync module instance, tier type = 2023-12-15T22:53:15.827 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:15.826+0000 7f30d5c10800 20 started zone id=76e2af14-25ee-4dab-b24e-031cc56bbcae (name=default) with tier type = 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=0 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=1 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=2 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=3 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=4 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=5 2023-12-15T22:53:17.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=6 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 20 add_watcher() i=7 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.852+0000 7f30d5c10800 2 all 8 watchers are set, enabling cache 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-12-15T22:53:17.855 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.853+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.854+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.854+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.854+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.854+0000 7f30d5c10800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.854+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-12-15T22:53:17.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.855+0000 7f30d5c10800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-15T22:53:17.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.861+0000 7f3096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:17.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.861+0000 7f30d5c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:17.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:17.861+0000 7f30d5c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f30d5c10800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f30d5c10800 5 note: GC not initialized 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f3095fe3640 20 reqs_thread_entry: start 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f30d5c10800 20 init_complete bucket index max shards: 11 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f30d5c10800 20 Filter name: none 2023-12-15T22:53:20.834 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.832+0000 7f2fff7fe640 20 reqs_thread_entry: start 2023-12-15T22:53:20.858 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.857+0000 7f3096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:20.860 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.859+0000 7f30d5c10800 20 remove_watcher() i=0 2023-12-15T22:53:20.860 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.859+0000 7f30d5c10800 2 removed watcher, disabling cache 2023-12-15T22:53:20.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.861+0000 7f30d5c10800 20 remove_watcher() i=1 2023-12-15T22:53:20.864 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.863+0000 7f30d5c10800 20 remove_watcher() i=2 2023-12-15T22:53:20.870 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.869+0000 7f30d5c10800 20 remove_watcher() i=3 2023-12-15T22:53:20.871 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.870+0000 7f30d5c10800 20 remove_watcher() i=4 2023-12-15T22:53:20.873 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.872+0000 7f30d5c10800 20 remove_watcher() i=5 2023-12-15T22:53:20.874 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.873+0000 7f30d5c10800 20 remove_watcher() i=6 2023-12-15T22:53:20.876 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.876+0000 7f30d5c10800 20 remove_watcher() i=7 2023-12-15T22:53:20.885 INFO:teuthology.orchestra.run.smithi188.stdout:[] 2023-12-15T22:53:20.885 DEBUG:tasks.util.rgw: json result: [] 2023-12-15T22:53:20.885 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:20.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:20.885 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-15T22:53:20.935 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:20.935 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:20.946 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.945+0000 7f22faeb8800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:20.947 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.945+0000 7f22faeb8800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:20.947 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:20.946+0000 7f22befe5640 20 reqs_thread_entry: start 2023-12-15T22:53:20.956 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"76e2af14-25ee-4dab-b24e-031cc56bbcae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-15T22:53:20.956 DEBUG:tasks.util.rgw: json result: {'id': '76e2af14-25ee-4dab-b24e-031cc56bbcae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-15T22:53:20.956 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2023-12-15T22:53:20.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2023-12-15T22:53:20.956 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2023-12-15T22:53:21.120 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:21.120 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.134+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.134+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.134+0000 7f4bce33a800 20 realm 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.134+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.135+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.135+0000 7f4bce33a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.135+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.135+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.135+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.136+0000 7f4bce33a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.136+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.136+0000 7f4bce33a800 20 rados_obj.operate() r=0 bl.length=890 2023-12-15T22:53:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.136+0000 7f4bce33a800 20 searching for the correct realm 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 RGWRados::pool_iterate: got zone_info.76e2af14-25ee-4dab-b24e-031cc56bbcae 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 RGWRados::pool_iterate: got zonegroup_info.ca7b60e2-cc3d-4aff-a0d1-069f02dbe359 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.147+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 rados_obj.operate() r=0 bl.length=420 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 zone default found 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 4 Realm: () 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 4 ZoneGroup: default (ca7b60e2-cc3d-4aff-a0d1-069f02dbe359) 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 4 Zone: default (76e2af14-25ee-4dab-b24e-031cc56bbcae) 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 zonegroup default 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.148+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.149+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.149+0000 7f4bce33a800 20 rados->read ofs=0 len=0 2023-12-15T22:53:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.149+0000 7f4bce33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T22:53:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.149+0000 7f4bce33a800 20 started sync module instance, tier type = 2023-12-15T22:53:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.149+0000 7f4bce33a800 20 started zone id=76e2af14-25ee-4dab-b24e-031cc56bbcae (name=default) with tier type = 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=0 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=1 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=2 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=3 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=4 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=5 2023-12-15T22:53:21.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.172+0000 7f4bce33a800 20 add_watcher() i=6 2023-12-15T22:53:21.173 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.173+0000 7f4bce33a800 20 add_watcher() i=7 2023-12-15T22:53:21.173 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.173+0000 7f4bce33a800 2 all 8 watchers are set, enabling cache 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4b8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4bce33a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4bce33a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4bce33a800 5 note: GC not initialized 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4b8a7fc640 20 reqs_thread_entry: start 2023-12-15T22:53:21.175 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4bce33a800 20 init_complete bucket index max shards: 11 2023-12-15T22:53:21.176 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4bce33a800 20 Filter name: none 2023-12-15T22:53:21.176 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.175+0000 7f4afbfff640 20 reqs_thread_entry: start 2023-12-15T22:53:21.185 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.185+0000 7f4b8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T22:53:21.187 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.187+0000 7f4bce33a800 20 remove_watcher() i=0 2023-12-15T22:53:21.187 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.187+0000 7f4bce33a800 2 removed watcher, disabling cache 2023-12-15T22:53:21.188 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.188+0000 7f4bce33a800 20 remove_watcher() i=1 2023-12-15T22:53:21.189 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.189+0000 7f4bce33a800 20 remove_watcher() i=2 2023-12-15T22:53:21.190 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.190+0000 7f4bce33a800 20 remove_watcher() i=3 2023-12-15T22:53:21.191 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.191+0000 7f4bce33a800 20 remove_watcher() i=4 2023-12-15T22:53:21.193 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.193+0000 7f4bce33a800 20 remove_watcher() i=5 2023-12-15T22:53:21.194 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.194+0000 7f4bce33a800 20 remove_watcher() i=6 2023-12-15T22:53:21.195 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.195+0000 7f4bce33a800 20 remove_watcher() i=7 2023-12-15T22:53:21.200 INFO:teuthology.orchestra.run.smithi192.stdout:[] 2023-12-15T22:53:21.200 DEBUG:tasks.util.rgw: json result: [] 2023-12-15T22:53:21.201 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:21.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-15T22:53:21.201 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-15T22:53:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:21.262 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.261+0000 7fdb69b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T22:53:21.262 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.261+0000 7fdb69b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T22:53:21.262 INFO:teuthology.orchestra.run.smithi192.stderr:2023-12-15T22:53:21.262+0000 7fdb2afe5640 20 reqs_thread_entry: start 2023-12-15T22:53:21.270 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"76e2af14-25ee-4dab-b24e-031cc56bbcae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-15T22:53:21.270 DEBUG:tasks.util.rgw: json result: {'id': '76e2af14-25ee-4dab-b24e-031cc56bbcae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-15T22:53:21.270 INFO:tasks.rgw:Starting rgw... 2023-12-15T22:53:21.270 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2023-12-15T22:53:21.271 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-15T22:53:21.271 INFO:tasks.rgw.c1.client.0:Restarting daemon 2023-12-15T22:53:21.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2023-12-15T22:53:21.273 INFO:tasks.rgw.c1.client.0:Started 2023-12-15T22:53:21.274 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2023-12-15T22:53:21.274 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-15T22:53:21.274 INFO:tasks.rgw.c1.client.1:Restarting daemon 2023-12-15T22:53:21.274 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2023-12-15T22:53:21.276 INFO:tasks.rgw.c1.client.1:Started 2023-12-15T22:53:21.277 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2023-12-15T22:53:21.277 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-15T22:53:21.277 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T22:53:21.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T22:53:21.279 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T22:53:21.279 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2023-12-15T22:53:21.279 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-15T22:53:21.279 INFO:tasks.rgw.c2.client.1:Restarting daemon 2023-12-15T22:53:21.280 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2023-12-15T22:53:21.282 INFO:tasks.rgw.c2.client.1:Started 2023-12-15T22:53:21.282 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi093.front.sepia.ceph.com:8000/ 2023-12-15T22:53:21.282 DEBUG:teuthology.orchestra.run.smithi093:> curl http://smithi093.front.sepia.ceph.com:8000/ 2023-12-15T22:53:21.390 INFO:teuthology.orchestra.run.smithi093.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:21.391 INFO:teuthology.orchestra.run.smithi093.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:21.392 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T22:53:21.393 INFO:teuthology.orchestra.run.smithi093.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T22:53:21.393 INFO:teuthology.orchestra.run.smithi093.stderr:curl: (7) Failed to connect to smithi093.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T22:53:22.393 DEBUG:teuthology.orchestra.run.smithi093:> curl http://smithi093.front.sepia.ceph.com:8000/ 2023-12-15T22:53:22.412 INFO:teuthology.orchestra.run.smithi093.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:22.412 INFO:teuthology.orchestra.run.smithi093.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:22.435 INFO:teuthology.orchestra.run.smithi093.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 9304 0 --:--:-- --:--:-- --:--:-- 9304 2023-12-15T22:53:22.436 INFO:teuthology.orchestra.run.smithi093.stdout:anonymous 2023-12-15T22:53:22.436 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://smithi183.front.sepia.ceph.com:8001/ 2023-12-15T22:53:22.436 DEBUG:teuthology.orchestra.run.smithi183:> curl http://smithi183.front.sepia.ceph.com:8001/ 2023-12-15T22:53:22.467 INFO:teuthology.orchestra.run.smithi183.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:22.467 INFO:teuthology.orchestra.run.smithi183.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:22.479 INFO:teuthology.orchestra.run.smithi183.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 17833 0 --:--:-- --:--:-- --:--:-- 19454 2023-12-15T22:53:22.479 INFO:teuthology.orchestra.run.smithi183.stdout:anonymous 2023-12-15T22:53:22.480 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi188.front.sepia.ceph.com:8000/ 2023-12-15T22:53:22.480 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000/ 2023-12-15T22:53:22.508 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:22.508 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:22.518 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 21400 0 --:--:-- --:--:-- --:--:-- 21400 2023-12-15T22:53:22.519 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T22:53:22.519 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi192.front.sepia.ceph.com:8001/ 2023-12-15T22:53:22.519 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:8001/ 2023-12-15T22:53:22.556 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:22.556 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:22.570 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 15285 0 --:--:-- --:--:-- --:--:-- 15285 2023-12-15T22:53:22.570 INFO:teuthology.orchestra.run.smithi192.stdout:anonymous 2023-12-15T22:53:22.570 INFO:teuthology.run_tasks:Running task rgw-multisite... 2023-12-15T22:53:23.877 INFO:tasks.rgw_multisite:creating realm.. 2023-12-15T22:53:23.877 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:23.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:23.877 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:23.928 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:23.928 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:23.958 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"60dac693-64f5-45c2-a83a-5740fda91d5c","name":"test-realm","current_period":"6724491c-d60d-45a2-9694-fd058cbeabad","epoch":1} 2023-12-15T22:53:23.958 INFO:tasks.rgw_multisite:creating master zonegroup.. 2023-12-15T22:53:23.958 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:23.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:23.959 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:24.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:24.016+0000 7ff345ab8800 -1 old format 2023-12-15T22:53:24.032 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2023-12-15T22:53:24.032 INFO:tasks.rgw_multisite:creating master zone.. 2023-12-15T22:53:24.032 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--endpoints', 'http://smithi093.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:24.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--endpoints', 'http://smithi093.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:24.033 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key 8CZ2YL9B4KQ03VL5 --secret CjV3P1uGaOifTnspbIJ5KF55U101Q7FK --endpoints http://smithi093.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:24.123 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:24.123 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:NOTICE: set zone's realm_id=60dac693-64f5-45c2-a83a-5740fda91d5c 2023-12-15T22:53:24.160 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone1.rgw.log:notif"} 2023-12-15T22:53:24.161 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2023-12-15T22:53:25.142 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'test-zone1.rgw.buckets.data' created 2023-12-15T22:53:25.162 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2023-12-15T22:53:26.142 INFO:teuthology.orchestra.run.smithi093.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2023-12-15T22:53:26.170 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:26.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:26.171 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:26.222 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:26.222 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:26.241 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone1.rgw.log:notif"} 2023-12-15T22:53:26.241 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:26.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:26.242 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:26.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:53:26.300+0000 7f37519dc800 0 period (6724491c-d60d-45a2-9694-fd058cbeabad does not have zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c configured 2023-12-15T22:53:33.251 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":1,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T22:53:33.252 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2023-12-15T22:53:33.252 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T22:53:33.253 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T22:53:33.253+0000 7f1cb76fb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 88588) UID: 0 2023-12-15T22:53:33.253 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T22:53:33.253+0000 7f1cbaf5a880 -1 shutting down 2023-12-15T22:53:36.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2023-12-15T22:53:39.354 INFO:tasks.rgw.c1.client.0:Stopped 2023-12-15T22:53:39.354 INFO:tasks.rgw.c1.client.0:Restarting daemon 2023-12-15T22:53:39.354 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2023-12-15T22:53:39.357 INFO:tasks.rgw.c1.client.0:Started 2023-12-15T22:53:39.357 DEBUG:teuthology.orchestra.run.smithi093:> curl http://smithi093.front.sepia.ceph.com:8000 2023-12-15T22:53:39.378 INFO:teuthology.orchestra.run.smithi093.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:39.379 INFO:teuthology.orchestra.run.smithi093.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:39.379 INFO:teuthology.orchestra.run.smithi093.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T22:53:39.379 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T22:53:39.380 INFO:teuthology.orchestra.run.smithi093.stderr:curl: (7) Failed to connect to smithi093.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T22:53:40.381 DEBUG:teuthology.orchestra.run.smithi093:> curl http://smithi093.front.sepia.ceph.com:8000 2023-12-15T22:53:40.400 INFO:teuthology.orchestra.run.smithi093.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:40.400 INFO:teuthology.orchestra.run.smithi093.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:40.401 INFO:teuthology.orchestra.run.smithi093.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T22:53:40.402 INFO:teuthology.orchestra.run.smithi093.stdout:anonymous 2023-12-15T22:53:40.402 INFO:tasks.rgw_multisite:creating admin user.. 2023-12-15T22:53:40.402 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.402 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key 8CZ2YL9B4KQ03VL5 --secret CjV3P1uGaOifTnspbIJ5KF55U101Q7FK --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:40.495 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:40.495 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:40.531 INFO:teuthology.orchestra.run.smithi093.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-15T22:53:40.546 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2023-12-15T22:53:40.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi093.front.sepia.ceph.com:8000', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi093.front.sepia.ceph.com:8000', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.547 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi093.front.sepia.ceph.com:8000 --access-key 8CZ2YL9B4KQ03VL5 --secret CjV3P1uGaOifTnspbIJ5KF55U101Q7FK --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:40.602 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:40.602 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:40.646 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"60dac693-64f5-45c2-a83a-5740fda91d5c","name":"test-realm","current_period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":2} 2023-12-15T22:53:40.646 INFO:tasks.rgw_multisite:creating zone.. 2023-12-15T22:53:40.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--endpoints', 'http://smithi188.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--endpoints', 'http://smithi188.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:40.647 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key 8CZ2YL9B4KQ03VL5 --secret CjV3P1uGaOifTnspbIJ5KF55U101Q7FK --endpoints http://smithi188.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:40.699 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:40.699 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:40.714 INFO:teuthology.orchestra.run.smithi188.stderr:NOTICE: set zone's realm_id=60dac693-64f5-45c2-a83a-5740fda91d5c 2023-12-15T22:53:40.735 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T22:53:40.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2023-12-15T22:53:41.860 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'test-zone2.rgw.buckets.data' created 2023-12-15T22:53:41.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2023-12-15T22:53:42.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2023-12-15T22:53:42.864 INFO:teuthology.orchestra.run.smithi188.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2023-12-15T22:53:42.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:42.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:42.893 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:42.941 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:42.942 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:42.962 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T22:53:42.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:42.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:42.962 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:43.006 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:43.007 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:43.021 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:43.021+0000 7f48d560f800 0 period (8bfcaea7-8c6a-42ca-968d-33484415a55a does not have zone 160ba887-62cd-49c7-8578-f3cea1ced053 configured 2023-12-15T22:53:49.955 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T22:53:50.001 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":2,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T22:53:50.001 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T22:53:50.002 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T22:53:50.002 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T22:53:50.002+0000 7f90542a0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 88799) UID: 0 2023-12-15T22:53:50.002 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T22:53:50.002+0000 7f9059e15880 -1 shutting down 2023-12-15T22:53:51.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T22:53:56.103 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T22:53:56.103 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T22:53:56.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T22:53:56.106 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T22:53:56.106 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T22:53:56.127 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:56.128 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:56.128 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T22:53:56.129 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T22:53:56.129 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T22:53:57.130 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T22:53:57.148 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T22:53:57.148 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T22:53:57.149 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T22:53:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T22:53:57.150 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2023-12-15T22:53:57.150 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2023-12-15T22:53:57.161 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi 2023-12-15T22:53:57.180 INFO:tasks.rgw_multisite_tests:creating test user.. 2023-12-15T22:53:57.180 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--caps', 'roles=*', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:57.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--caps', 'roles=*', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:53:57.180 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --caps 'roles=*' --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:53:57.240 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:57.240 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"RQ4G229IF2X1XV5EJM37","secret_key":"rt9KpdwvX40eLL4OtDcb4UIWNksZBoSEa9gGwKk8"}],"swift_keys":[],"caps":[{"type":"roles","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-15T22:53:57.304 INFO:rgw_multi.tests:meta checkpoint 2023-12-15T22:53:57.305 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:53:57.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:53:57.305 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:53:57.349 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:57.350 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:57.397 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:53:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:53:57.417 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:53:57.417 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:53:57.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:53:57.417 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:53:57.464 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:53:57.464 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:53:57.504 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:57.504+0000 7fbe00a12800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:53:57.505 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:53:57.505+0000 7fbe00a12800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:53:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"building-full-sync-maps","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":1,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":2,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":3,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:53:57Z"} 2023-12-15T22:53:57.525 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702680837.286670_27.1 target= 2023-12-15T22:53:57.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T22:54:02.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.527 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:02.579 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:02.579 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:02.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:02.616+0000 7f8c1a33e800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:02.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:02.617+0000 7f8c1a33e800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:02.632 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:02Z"} 2023-12-15T22:54:02.632 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:02.632 INFO:rgw_multi.tests:meta checkpoint 2023-12-15T22:54:02.633 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.633 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:02.683 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:02.683 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:02.747 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:02.747 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:02.747 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:02.747 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:02.796 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:02.796 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:02.839 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:02.840+0000 7f671c533800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:02.840 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:02.841+0000 7f671c533800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:02.858 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:02Z"} 2023-12-15T22:54:02.859 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:02.859 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi' with args=['tests.py'] 2023-12-15T22:54:02.997 DEBUG:boto:Using access key provided by client. 2023-12-15T22:54:02.997 DEBUG:boto:Using secret key provided by client. 2023-12-15T22:54:02.998 DEBUG:boto:Using access key provided by client. 2023-12-15T22:54:02.998 DEBUG:boto:Using secret key provided by client. 2023-12-15T22:54:02.998 DEBUG:boto:Using access key provided by client. 2023-12-15T22:54:02.998 DEBUG:boto:Using secret key provided by client. 2023-12-15T22:54:02.999 DEBUG:boto:Using access key provided by client. 2023-12-15T22:54:02.999 DEBUG:boto:Using secret key provided by client. 2023-12-15T22:54:02.999 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-1 2023-12-15T22:54:02.999 DEBUG:boto:path=/kskgfn-1/ 2023-12-15T22:54:02.999 DEBUG:boto:auth_path=/kskgfn-1/ 2023-12-15T22:54:02.999 DEBUG:boto:Method: PUT 2023-12-15T22:54:02.999 DEBUG:boto:Path: /kskgfn-1/ 2023-12-15T22:54:02.999 DEBUG:boto:Data: 2023-12-15T22:54:03.000 DEBUG:boto:Headers: {} 2023-12-15T22:54:03.000 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:03.000 DEBUG:boto:Port: 8000 2023-12-15T22:54:03.000 DEBUG:boto:Params: {} 2023-12-15T22:54:03.000 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T22:54:03.000 DEBUG:boto:Token: None 2023-12-15T22:54:03.000 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:03 GMT /kskgfn-1/ 2023-12-15T22:54:03.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:19krek6TWtd11k7rSnodj027VWs= 2023-12-15T22:54:03.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:19krek6TWtd11k7rSnodj027VWs=', 'Content-Length': '0'} 2023-12-15T22:54:05.203 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000efe3de5872a95748-00657cd90b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:05.204 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-2 2023-12-15T22:54:05.204 DEBUG:boto:path=/kskgfn-2/ 2023-12-15T22:54:05.204 DEBUG:boto:auth_path=/kskgfn-2/ 2023-12-15T22:54:05.204 DEBUG:boto:Method: PUT 2023-12-15T22:54:05.204 DEBUG:boto:Path: /kskgfn-2/ 2023-12-15T22:54:05.204 DEBUG:boto:Data: 2023-12-15T22:54:05.204 DEBUG:boto:Headers: {} 2023-12-15T22:54:05.204 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:05.204 DEBUG:boto:Port: 8000 2023-12-15T22:54:05.204 DEBUG:boto:Params: {} 2023-12-15T22:54:05.204 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T22:54:05.205 DEBUG:boto:Token: None 2023-12-15T22:54:05.205 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:05 GMT /kskgfn-2/ 2023-12-15T22:54:05.205 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j7iQLu6W1ZlnN8MbHvlS+OY9NFE= 2023-12-15T22:54:05.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j7iQLu6W1ZlnN8MbHvlS+OY9NFE=', 'Content-Length': '0'} 2023-12-15T22:54:07.965 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f7eea6444a14edc0-00657cd90d-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:07.965 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:07.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:07.965 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:08.020 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:08.020 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:08.080 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680845.227219_31.1","last_update":"2023-12-15T22:54:05.227219Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:08.080 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680845.227219_31.1', 2: '', 3: ''} 2023-12-15T22:54:08.080 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:08.080 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:08.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:08.081 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:08.131 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:08.131 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:08.173 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:08.174+0000 7f639a811800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:08.175 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:08.175+0000 7f639a811800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:08.193 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680845.184842_24.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:05.184842Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:08Z"} 2023-12-15T22:54:08.193 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680845.184842_24.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:05.184842Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:08Z"} 2023-12-15T22:54:08.193 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680845.184842_24.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:05.184842Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:08.193 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680845.227219_31.1', 2: '', 3: ''} 2023-12-15T22:54:08.194 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680845.184842_24.1', 2: '', 3: ''} 2023-12-15T22:54:08.194 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702680845.227219_31.1 target=1_1702680845.184842_24.1 2023-12-15T22:54:10.414 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T22:54:10.414+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T22:54:13.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.195 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:13.248 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:13.248 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:13.288 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.287+0000 7f5be512b800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.290 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.289+0000 7f5be512b800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.310 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680845.227219_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:05.227219Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.310 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680845.227219_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:05.227219Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.310 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680845.227219_31.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:05.227219Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:13.310 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680845.227219_31.1', 2: '', 3: ''} 2023-12-15T22:54:13.310 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680845.227219_31.1', 2: '', 3: ''} 2023-12-15T22:54:13.310 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:13.310 DEBUG:boto:path=/kskgfn-1/ 2023-12-15T22:54:13.311 DEBUG:boto:auth_path=/kskgfn-1/ 2023-12-15T22:54:13.311 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.311 DEBUG:boto:Path: /kskgfn-1/ 2023-12-15T22:54:13.311 DEBUG:boto:Data: 2023-12-15T22:54:13.311 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.311 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.311 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.311 DEBUG:boto:Params: {} 2023-12-15T22:54:13.311 DEBUG:boto:Token: None 2023-12-15T22:54:13.312 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-1/ 2023-12-15T22:54:13.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7na1ufXxkzbF2cOn5KImZT83Q= 2023-12-15T22:54:13.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7na1ufXxkzbF2cOn5KImZT83Q=', 'Content-Length': '0'} 2023-12-15T22:54:13.314 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ee662e5d336b704-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.315 DEBUG:boto:path=/kskgfn-2/ 2023-12-15T22:54:13.315 DEBUG:boto:auth_path=/kskgfn-2/ 2023-12-15T22:54:13.315 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.315 DEBUG:boto:Path: /kskgfn-2/ 2023-12-15T22:54:13.315 DEBUG:boto:Data: 2023-12-15T22:54:13.315 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.315 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.315 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.315 DEBUG:boto:Params: {} 2023-12-15T22:54:13.316 DEBUG:boto:Token: None 2023-12-15T22:54:13.316 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-2/ 2023-12-15T22:54:13.316 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qnv/Kl5iZFQJJJ5RrpI2jBIg7/M= 2023-12-15T22:54:13.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qnv/Kl5iZFQJJJ5RrpI2jBIg7/M=', 'Content-Length': '0'} 2023-12-15T22:54:13.318 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d88484e3e652847c-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.318 DEBUG:boto:path=/kskgfn-1/ 2023-12-15T22:54:13.318 DEBUG:boto:auth_path=/kskgfn-1/ 2023-12-15T22:54:13.318 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.318 DEBUG:boto:Path: /kskgfn-1/ 2023-12-15T22:54:13.318 DEBUG:boto:Data: 2023-12-15T22:54:13.318 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.319 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.319 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.319 DEBUG:boto:Params: {} 2023-12-15T22:54:13.319 DEBUG:boto:Token: None 2023-12-15T22:54:13.319 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-1/ 2023-12-15T22:54:13.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7na1ufXxkzbF2cOn5KImZT83Q= 2023-12-15T22:54:13.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7na1ufXxkzbF2cOn5KImZT83Q=', 'Content-Length': '0'} 2023-12-15T22:54:13.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007698ca28779eeb19-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.322 DEBUG:boto:path=/kskgfn-2/ 2023-12-15T22:54:13.322 DEBUG:boto:auth_path=/kskgfn-2/ 2023-12-15T22:54:13.322 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.322 DEBUG:boto:Path: /kskgfn-2/ 2023-12-15T22:54:13.323 DEBUG:boto:Data: 2023-12-15T22:54:13.323 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.323 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.323 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.323 DEBUG:boto:Params: {} 2023-12-15T22:54:13.323 DEBUG:boto:Token: None 2023-12-15T22:54:13.323 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-2/ 2023-12-15T22:54:13.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qnv/Kl5iZFQJJJ5RrpI2jBIg7/M= 2023-12-15T22:54:13.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qnv/Kl5iZFQJJJ5RrpI2jBIg7/M=', 'Content-Length': '0'} 2023-12-15T22:54:13.325 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ea4960f145fbd40-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.326 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2023-12-15T22:54:13.326 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-3 2023-12-15T22:54:13.326 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.326 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.327 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.327 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.327 DEBUG:boto:Data: 2023-12-15T22:54:13.327 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.327 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.327 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.327 DEBUG:boto:Params: {} 2023-12-15T22:54:13.327 DEBUG:boto:Token: None 2023-12-15T22:54:13.327 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ= 2023-12-15T22:54:13.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ=', 'Content-Length': '0'} 2023-12-15T22:54:13.347 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000374525cedc5696d3-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.347 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-4 2023-12-15T22:54:13.347 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.347 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.347 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.348 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.348 DEBUG:boto:Data: 2023-12-15T22:54:13.348 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.348 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.348 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.348 DEBUG:boto:Params: {} 2023-12-15T22:54:13.348 DEBUG:boto:Token: None 2023-12-15T22:54:13.348 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.349 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE= 2023-12-15T22:54:13.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE=', 'Content-Length': '0'} 2023-12-15T22:54:13.385 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003d5e419a78d1c867-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.385 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.385 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:13.469 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:13.484 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680853.370377_39.1","last_update":"2023-12-15T22:54:13.370377Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:13.484 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680853.370377_39.1', 2: '', 3: ''} 2023-12-15T22:54:13.484 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:13.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.485 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:13.533 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:13.533 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:13.576 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.575+0000 7f24a2344800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.577 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.576+0000 7f24a2344800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.597 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680853.370377_39.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:13.370377Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.597 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680853.370377_39.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:13.370377Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.597 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680853.370377_39.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:13.370377Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:13.597 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680853.370377_39.1', 2: '', 3: ''} 2023-12-15T22:54:13.597 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680853.370377_39.1', 2: '', 3: ''} 2023-12-15T22:54:13.597 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:13.597 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.598 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.598 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.598 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.598 DEBUG:boto:Data: 2023-12-15T22:54:13.598 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.598 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.598 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.598 DEBUG:boto:Params: {} 2023-12-15T22:54:13.598 DEBUG:boto:Token: None 2023-12-15T22:54:13.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.601 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eb4715656282e34f-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.601 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.601 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.602 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.602 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.602 DEBUG:boto:Data: 2023-12-15T22:54:13.602 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.602 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.602 DEBUG:boto:Params: {} 2023-12-15T22:54:13.602 DEBUG:boto:Token: None 2023-12-15T22:54:13.602 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.604 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000017a67ef509186bba-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.605 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.605 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.605 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.605 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.605 DEBUG:boto:Data: 2023-12-15T22:54:13.605 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.605 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.605 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.605 DEBUG:boto:Params: {} 2023-12-15T22:54:13.605 DEBUG:boto:Token: None 2023-12-15T22:54:13.605 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.608 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a12767f93f9b2b77-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.608 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.608 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.608 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.608 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.608 DEBUG:boto:Data: 2023-12-15T22:54:13.608 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.608 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.608 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.609 DEBUG:boto:Params: {} 2023-12-15T22:54:13.609 DEBUG:boto:Token: None 2023-12-15T22:54:13.609 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.611 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000027d3b34857f056f5-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.611 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.611 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.611 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.611 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.611 DEBUG:boto:Data: 2023-12-15T22:54:13.611 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.612 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.612 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.612 DEBUG:boto:Params: {} 2023-12-15T22:54:13.612 DEBUG:boto:Token: None 2023-12-15T22:54:13.612 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.612 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ= 2023-12-15T22:54:13.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ=', 'Content-Length': '0'} 2023-12-15T22:54:13.633 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003db0e0b7d81fdfc3-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.634 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.634 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.634 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.634 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.634 DEBUG:boto:Data: 2023-12-15T22:54:13.634 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.634 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.634 DEBUG:boto:Params: {} 2023-12-15T22:54:13.634 DEBUG:boto:Token: None 2023-12-15T22:54:13.635 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE= 2023-12-15T22:54:13.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE=', 'Content-Length': '0'} 2023-12-15T22:54:13.654 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005c09ab160d591b5c-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.654 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.654 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.654 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.654 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.654 DEBUG:boto:Data: 2023-12-15T22:54:13.654 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.655 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.655 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.655 DEBUG:boto:Params: {} 2023-12-15T22:54:13.655 DEBUG:boto:Token: None 2023-12-15T22:54:13.655 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ= 2023-12-15T22:54:13.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4WgfM6aqkXkXm/hGawbnJEcbeQ=', 'Content-Length': '0'} 2023-12-15T22:54:13.684 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006cb26863b6feceff-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.684 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.684 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.684 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.684 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.684 DEBUG:boto:Data: 2023-12-15T22:54:13.684 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.684 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.685 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.685 DEBUG:boto:Params: {} 2023-12-15T22:54:13.685 DEBUG:boto:Token: None 2023-12-15T22:54:13.685 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE= 2023-12-15T22:54:13.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9kOfIwlf0cO4r7b63xbu0GOjqVE=', 'Content-Length': '0'} 2023-12-15T22:54:13.756 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ae544d6807fd5811-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.756 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.756 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.756 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.756 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.756 DEBUG:boto:Data: 2023-12-15T22:54:13.756 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.756 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.757 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.757 DEBUG:boto:Params: {} 2023-12-15T22:54:13.757 DEBUG:boto:Token: None 2023-12-15T22:54:13.757 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.757 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.759 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000068219849caa554cc-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.760 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.760 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.760 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.760 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.760 DEBUG:boto:Data: 2023-12-15T22:54:13.760 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.760 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.760 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.760 DEBUG:boto:Params: {} 2023-12-15T22:54:13.760 DEBUG:boto:Token: None 2023-12-15T22:54:13.761 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.763 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000309dcdf2ce019668-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.763 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.763 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.763 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.764 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.764 DEBUG:boto:Data: 2023-12-15T22:54:13.764 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.764 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.764 DEBUG:boto:Params: {} 2023-12-15T22:54:13.764 DEBUG:boto:Token: None 2023-12-15T22:54:13.764 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.767 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b37cdb2d464268f3-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.767 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.767 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.767 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.767 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.767 DEBUG:boto:Data: 2023-12-15T22:54:13.767 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.767 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.767 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.768 DEBUG:boto:Params: {} 2023-12-15T22:54:13.768 DEBUG:boto:Token: None 2023-12-15T22:54:13.768 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.768 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.771 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9afc2e13d8ad767-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.771 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.771 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:13.845 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:13.858 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680853.697828_55.1","last_update":"2023-12-15T22:54:13.697828Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:13.859 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680853.697828_55.1', 2: '', 3: ''} 2023-12-15T22:54:13.859 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:13.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:13.859 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:13.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:13.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:13.939 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.939+0000 7f0ae968a800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.940 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:13.940+0000 7f0ae968a800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:13.955 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680853.697828_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:13.697828Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.955 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680853.697828_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:13.697828Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:13Z"} 2023-12-15T22:54:13.955 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680853.697828_55.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:13.697828Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:13.956 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680853.697828_55.1', 2: '', 3: ''} 2023-12-15T22:54:13.956 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680853.697828_55.1', 2: '', 3: ''} 2023-12-15T22:54:13.956 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:13.956 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.956 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.956 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.956 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.956 DEBUG:boto:Data: 2023-12-15T22:54:13.956 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.956 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.956 DEBUG:boto:Params: {} 2023-12-15T22:54:13.957 DEBUG:boto:Token: None 2023-12-15T22:54:13.957 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.959 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001e96ef8c14368524-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.959 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.960 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.960 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.960 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.960 DEBUG:boto:Data: 2023-12-15T22:54:13.960 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.960 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.960 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.960 DEBUG:boto:Params: {} 2023-12-15T22:54:13.960 DEBUG:boto:Token: None 2023-12-15T22:54:13.960 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.961 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.962 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006375ccf407efc8cb-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.963 DEBUG:boto:path=/kskgfn-3/ 2023-12-15T22:54:13.963 DEBUG:boto:auth_path=/kskgfn-3/ 2023-12-15T22:54:13.963 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.963 DEBUG:boto:Path: /kskgfn-3/ 2023-12-15T22:54:13.963 DEBUG:boto:Data: 2023-12-15T22:54:13.963 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.963 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.963 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.963 DEBUG:boto:Params: {} 2023-12-15T22:54:13.963 DEBUG:boto:Token: None 2023-12-15T22:54:13.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-3/ 2023-12-15T22:54:13.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0= 2023-12-15T22:54:13.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BKXEbJy9g+cvxFKmMRyiZg1f/S0=', 'Content-Length': '0'} 2023-12-15T22:54:13.966 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004c9b1e8105742976-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.966 DEBUG:boto:path=/kskgfn-4/ 2023-12-15T22:54:13.966 DEBUG:boto:auth_path=/kskgfn-4/ 2023-12-15T22:54:13.966 DEBUG:boto:Method: HEAD 2023-12-15T22:54:13.966 DEBUG:boto:Path: /kskgfn-4/ 2023-12-15T22:54:13.966 DEBUG:boto:Data: 2023-12-15T22:54:13.966 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.967 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.967 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.967 DEBUG:boto:Params: {} 2023-12-15T22:54:13.967 DEBUG:boto:Token: None 2023-12-15T22:54:13.967 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-4/ 2023-12-15T22:54:13.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s= 2023-12-15T22:54:13.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaaKH5TUg7gF85TYj5V1QkfGI8s=', 'Content-Length': '0'} 2023-12-15T22:54:13.969 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000037c6a7c9c7499ae6-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.969 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2023-12-15T22:54:13.970 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-5 2023-12-15T22:54:13.970 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:13.970 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:13.970 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.970 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:13.970 DEBUG:boto:Data: 2023-12-15T22:54:13.970 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:13.971 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.971 DEBUG:boto:Params: {} 2023-12-15T22:54:13.971 DEBUG:boto:Token: None 2023-12-15T22:54:13.971 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-5/ 2023-12-15T22:54:13.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8yRHqYYB6WpOIkq7QjANjK8HGqY= 2023-12-15T22:54:13.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8yRHqYYB6WpOIkq7QjANjK8HGqY=', 'Content-Length': '0'} 2023-12-15T22:54:13.988 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e7c0cc94a66ee047-00657cd915-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:13.988 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-6 2023-12-15T22:54:13.988 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:13.988 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:13.988 DEBUG:boto:Method: PUT 2023-12-15T22:54:13.989 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:13.989 DEBUG:boto:Data: 2023-12-15T22:54:13.989 DEBUG:boto:Headers: {} 2023-12-15T22:54:13.989 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:13.989 DEBUG:boto:Port: 8000 2023-12-15T22:54:13.989 DEBUG:boto:Params: {} 2023-12-15T22:54:13.989 DEBUG:boto:Token: None 2023-12-15T22:54:13.989 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:13 GMT /kskgfn-6/ 2023-12-15T22:54:13.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zfCdAJX7mVwDBjfOZXHzHOe5q+c= 2023-12-15T22:54:13.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zfCdAJX7mVwDBjfOZXHzHOe5q+c=', 'Content-Length': '0'} 2023-12-15T22:54:14.017 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004c95f9d3e233086f-00657cd915-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.017 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:14.063 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:14.063 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:14.090 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680854.005102_63.1","last_update":"2023-12-15T22:54:14.005102Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:14.104 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680854.005102_63.1', 2: '', 3: ''} 2023-12-15T22:54:14.105 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:14.105 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.105 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:14.151 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:14.151 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:14.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:14.177+0000 7f27a8935800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:14.179 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:14.178+0000 7f27a8935800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:14.193 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.005102_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.005102Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:14Z"} 2023-12-15T22:54:14.194 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.005102_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.005102Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:14Z"} 2023-12-15T22:54:14.194 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680854.005102_63.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:14.005102Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:14.194 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.005102_63.1', 2: '', 3: ''} 2023-12-15T22:54:14.194 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.005102_63.1', 2: '', 3: ''} 2023-12-15T22:54:14.194 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:14.194 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:14.194 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:14.194 DEBUG:boto:Method: HEAD 2023-12-15T22:54:14.194 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:14.194 DEBUG:boto:Data: 2023-12-15T22:54:14.195 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.195 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:14.195 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.195 DEBUG:boto:Params: {} 2023-12-15T22:54:14.195 DEBUG:boto:Token: None 2023-12-15T22:54:14.195 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-5/ 2023-12-15T22:54:14.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/KCZd99yxekR+lrPLjgdrGpRSaw= 2023-12-15T22:54:14.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/KCZd99yxekR+lrPLjgdrGpRSaw=', 'Content-Length': '0'} 2023-12-15T22:54:14.197 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003104726ff1d919f3-00657cd916-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.197 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:14.198 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:14.198 DEBUG:boto:Method: HEAD 2023-12-15T22:54:14.198 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:14.198 DEBUG:boto:Data: 2023-12-15T22:54:14.198 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:14.198 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.198 DEBUG:boto:Params: {} 2023-12-15T22:54:14.198 DEBUG:boto:Token: None 2023-12-15T22:54:14.198 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-6/ 2023-12-15T22:54:14.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fg7jtnxvILyrxb43cJmKGszVndo= 2023-12-15T22:54:14.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fg7jtnxvILyrxb43cJmKGszVndo=', 'Content-Length': '0'} 2023-12-15T22:54:14.200 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002dba631398945056-00657cd916-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.201 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:14.201 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:14.201 DEBUG:boto:Method: HEAD 2023-12-15T22:54:14.201 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:14.201 DEBUG:boto:Data: 2023-12-15T22:54:14.201 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.201 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:14.201 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.201 DEBUG:boto:Params: {} 2023-12-15T22:54:14.201 DEBUG:boto:Token: None 2023-12-15T22:54:14.202 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-5/ 2023-12-15T22:54:14.202 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/KCZd99yxekR+lrPLjgdrGpRSaw= 2023-12-15T22:54:14.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/KCZd99yxekR+lrPLjgdrGpRSaw=', 'Content-Length': '0'} 2023-12-15T22:54:14.203 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000080dc4866f8bbb0d8-00657cd916-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.204 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:14.204 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:14.204 DEBUG:boto:Method: HEAD 2023-12-15T22:54:14.204 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:14.204 DEBUG:boto:Data: 2023-12-15T22:54:14.204 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.204 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:14.204 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.204 DEBUG:boto:Params: {} 2023-12-15T22:54:14.204 DEBUG:boto:Token: None 2023-12-15T22:54:14.205 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-6/ 2023-12-15T22:54:14.205 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fg7jtnxvILyrxb43cJmKGszVndo= 2023-12-15T22:54:14.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fg7jtnxvILyrxb43cJmKGszVndo=', 'Content-Length': '0'} 2023-12-15T22:54:14.206 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea51ead426dc1fc4-00657cd916-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.206 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:14.207 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:14.207 DEBUG:boto:Method: DELETE 2023-12-15T22:54:14.207 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:14.207 DEBUG:boto:Data: 2023-12-15T22:54:14.207 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.207 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:14.207 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.207 DEBUG:boto:Params: {} 2023-12-15T22:54:14.207 DEBUG:boto:Token: None 2023-12-15T22:54:14.207 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-5/ 2023-12-15T22:54:14.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XmGEjA8YND2ZO/8GtC08BxRi9bo= 2023-12-15T22:54:14.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XmGEjA8YND2ZO/8GtC08BxRi9bo=', 'Content-Length': '0'} 2023-12-15T22:54:14.231 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004ff4d5cf66305517-00657cd916-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.231 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:14.231 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:14.231 DEBUG:boto:Method: DELETE 2023-12-15T22:54:14.232 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:14.232 DEBUG:boto:Data: 2023-12-15T22:54:14.232 DEBUG:boto:Headers: {} 2023-12-15T22:54:14.232 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:14.232 DEBUG:boto:Port: 8000 2023-12-15T22:54:14.232 DEBUG:boto:Params: {} 2023-12-15T22:54:14.232 DEBUG:boto:Token: None 2023-12-15T22:54:14.232 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:54:14 GMT /kskgfn-6/ 2023-12-15T22:54:14.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2yvcV6dvFIrPyjd7okngcYxdifY= 2023-12-15T22:54:14.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2yvcV6dvFIrPyjd7okngcYxdifY=', 'Content-Length': '0'} 2023-12-15T22:54:14.281 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000be1153854ec2453d-00657cd916-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:14.282 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.282 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:14.327 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:14.327 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:14.354 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:14.370 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680854.259434_67.1","last_update":"2023-12-15T22:54:14.259434Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:14.370 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680854.259434_67.1', 2: '', 3: ''} 2023-12-15T22:54:14.370 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:14.370 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:14.371 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:14.417 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:14.417 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:14.453 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:14.452+0000 7f732c013800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:14.454 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:14.453+0000 7f732c013800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:14.476 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.005102_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.005102Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:14Z"} 2023-12-15T22:54:14.476 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.005102_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.005102Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:14Z"} 2023-12-15T22:54:14.476 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680854.005102_63.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:14.005102Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:14.476 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.259434_67.1', 2: '', 3: ''} 2023-12-15T22:54:14.476 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.005102_63.1', 2: '', 3: ''} 2023-12-15T22:54:14.477 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702680854.259434_67.1 target=1_1702680854.005102_63.1 2023-12-15T22:54:19.477 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.478 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:19.530 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:19.531 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:19.568 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:19.567+0000 7f0a97444800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:19.569 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:19.568+0000 7f0a97444800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:19.584 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.259434_67.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.259434Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:19Z"} 2023-12-15T22:54:19.585 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680854.259434_67.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:14.259434Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:19Z"} 2023-12-15T22:54:19.585 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680854.259434_67.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:14.259434Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:19.585 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.259434_67.1', 2: '', 3: ''} 2023-12-15T22:54:19.585 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680854.259434_67.1', 2: '', 3: ''} 2023-12-15T22:54:19.585 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:19.585 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:19.585 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:19.586 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.586 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:19.586 DEBUG:boto:Data: 2023-12-15T22:54:19.586 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.586 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.586 DEBUG:boto:Params: {} 2023-12-15T22:54:19.586 DEBUG:boto:Token: None 2023-12-15T22:54:19.586 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-5/ 2023-12-15T22:54:19.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lIohUZI1wiYUu4jb/xslJvd3V14= 2023-12-15T22:54:19.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lIohUZI1wiYUu4jb/xslJvd3V14=', 'Content-Length': '0'} 2023-12-15T22:54:19.588 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx000001444472ecc29f706-00657cd91b-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.588 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:19.588 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:19.588 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.588 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:19.588 DEBUG:boto:Data: 2023-12-15T22:54:19.588 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.588 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.588 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.589 DEBUG:boto:Params: {} 2023-12-15T22:54:19.589 DEBUG:boto:Token: None 2023-12-15T22:54:19.589 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-6/ 2023-12-15T22:54:19.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iFJUJ2ya7lwppl8bgSpCrgLYCIs= 2023-12-15T22:54:19.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iFJUJ2ya7lwppl8bgSpCrgLYCIs=', 'Content-Length': '0'} 2023-12-15T22:54:19.590 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx0000046c0281f4814c520-00657cd91b-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.590 DEBUG:boto:path=/kskgfn-5/ 2023-12-15T22:54:19.590 DEBUG:boto:auth_path=/kskgfn-5/ 2023-12-15T22:54:19.590 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.590 DEBUG:boto:Path: /kskgfn-5/ 2023-12-15T22:54:19.591 DEBUG:boto:Data: 2023-12-15T22:54:19.591 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.591 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.591 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.591 DEBUG:boto:Params: {} 2023-12-15T22:54:19.591 DEBUG:boto:Token: None 2023-12-15T22:54:19.591 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-5/ 2023-12-15T22:54:19.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lIohUZI1wiYUu4jb/xslJvd3V14= 2023-12-15T22:54:19.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lIohUZI1wiYUu4jb/xslJvd3V14=', 'Content-Length': '0'} 2023-12-15T22:54:19.592 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx0000001f77e4db72c6e91-00657cd91b-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.592 DEBUG:boto:path=/kskgfn-6/ 2023-12-15T22:54:19.593 DEBUG:boto:auth_path=/kskgfn-6/ 2023-12-15T22:54:19.593 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.593 DEBUG:boto:Path: /kskgfn-6/ 2023-12-15T22:54:19.593 DEBUG:boto:Data: 2023-12-15T22:54:19.593 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.593 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.593 DEBUG:boto:Params: {} 2023-12-15T22:54:19.593 DEBUG:boto:Token: None 2023-12-15T22:54:19.593 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-6/ 2023-12-15T22:54:19.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iFJUJ2ya7lwppl8bgSpCrgLYCIs= 2023-12-15T22:54:19.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iFJUJ2ya7lwppl8bgSpCrgLYCIs=', 'Content-Length': '0'} 2023-12-15T22:54:19.594 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx0000086a90db3eee367b3-00657cd91b-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.595 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2023-12-15T22:54:19.595 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-7 2023-12-15T22:54:19.595 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:19.595 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:19.596 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.596 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:19.596 DEBUG:boto:Data: 2023-12-15T22:54:19.596 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.596 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.596 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.596 DEBUG:boto:Params: {} 2023-12-15T22:54:19.596 DEBUG:boto:Token: None 2023-12-15T22:54:19.596 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/ 2023-12-15T22:54:19.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MdhUIpCF+Cc1g2ALlAwlqzMuJoY= 2023-12-15T22:54:19.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MdhUIpCF+Cc1g2ALlAwlqzMuJoY=', 'Content-Length': '0'} 2023-12-15T22:54:19.615 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006f732b99a69be16e-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.616 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-8 2023-12-15T22:54:19.616 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:19.616 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:19.616 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.616 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:19.616 DEBUG:boto:Data: 2023-12-15T22:54:19.616 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.616 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.616 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.616 DEBUG:boto:Params: {} 2023-12-15T22:54:19.616 DEBUG:boto:Token: None 2023-12-15T22:54:19.617 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/ 2023-12-15T22:54:19.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eLTeZhtQAcrpR8B+XwuPX4MuBJI= 2023-12-15T22:54:19.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eLTeZhtQAcrpR8B+XwuPX4MuBJI=', 'Content-Length': '0'} 2023-12-15T22:54:19.646 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002501fa68b5b684f6-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.647 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:19.647 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:19.647 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.647 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:19.647 DEBUG:boto:Data: 2023-12-15T22:54:19.647 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.647 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.647 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.647 DEBUG:boto:Params: {} 2023-12-15T22:54:19.647 DEBUG:boto:Token: None 2023-12-15T22:54:19.648 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/ 2023-12-15T22:54:19.648 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4= 2023-12-15T22:54:19.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4=', 'Content-Length': '0'} 2023-12-15T22:54:19.650 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006e6958e752f3e2ea-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.652 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:19.652 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:19.652 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.652 DEBUG:boto:Path: /kskgfn-7/myobj 2023-12-15T22:54:19.652 DEBUG:boto:Data: 2023-12-15T22:54:19.653 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.653 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.653 DEBUG:boto:Params: {} 2023-12-15T22:54:19.653 DEBUG:boto:Token: None 2023-12-15T22:54:19.653 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/myobj 2023-12-15T22:54:19.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n3gC6LAjJDWp9Auao78nO4JFUTU= 2023-12-15T22:54:19.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n3gC6LAjJDWp9Auao78nO4JFUTU='} 2023-12-15T22:54:19.698 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000681aa9df3ca3ea7c-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.698 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:19.698 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:19.698 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.698 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:19.698 DEBUG:boto:Data: 2023-12-15T22:54:19.698 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.698 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.698 DEBUG:boto:Params: {} 2023-12-15T22:54:19.699 DEBUG:boto:Token: None 2023-12-15T22:54:19.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/ 2023-12-15T22:54:19.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4= 2023-12-15T22:54:19.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4=', 'Content-Length': '0'} 2023-12-15T22:54:19.701 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ac2dbcda2cdee2d0-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.701 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:19.701 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:19.702 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.702 DEBUG:boto:Path: /kskgfn-7/_myobj 2023-12-15T22:54:19.702 DEBUG:boto:Data: 2023-12-15T22:54:19.702 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.702 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.702 DEBUG:boto:Params: {} 2023-12-15T22:54:19.702 DEBUG:boto:Token: None 2023-12-15T22:54:19.702 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/_myobj 2023-12-15T22:54:19.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z8Ti7rsKeGBQV4zo1ChMulT1q8o= 2023-12-15T22:54:19.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z8Ti7rsKeGBQV4zo1ChMulT1q8o='} 2023-12-15T22:54:19.713 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002e0b240c02ab41fe-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.713 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:19.713 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:19.713 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.713 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:19.713 DEBUG:boto:Data: 2023-12-15T22:54:19.713 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.713 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.713 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.713 DEBUG:boto:Params: {} 2023-12-15T22:54:19.714 DEBUG:boto:Token: None 2023-12-15T22:54:19.714 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/ 2023-12-15T22:54:19.714 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4= 2023-12-15T22:54:19.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4=', 'Content-Length': '0'} 2023-12-15T22:54:19.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000588d418ce1617b2f-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.716 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:19.716 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:19.716 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.716 DEBUG:boto:Path: /kskgfn-7/%3A 2023-12-15T22:54:19.716 DEBUG:boto:Data: 2023-12-15T22:54:19.716 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.717 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.717 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.717 DEBUG:boto:Params: {} 2023-12-15T22:54:19.717 DEBUG:boto:Token: None 2023-12-15T22:54:19.717 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/%3A 2023-12-15T22:54:19.717 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPsW7caFNyzH+wH49AT3fb+/Aso= 2023-12-15T22:54:19.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPsW7caFNyzH+wH49AT3fb+/Aso='} 2023-12-15T22:54:19.727 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eb7171a99bf85b22-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.727 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:19.727 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:19.728 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.728 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:19.728 DEBUG:boto:Data: 2023-12-15T22:54:19.728 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.728 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.728 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.728 DEBUG:boto:Params: {} 2023-12-15T22:54:19.728 DEBUG:boto:Token: None 2023-12-15T22:54:19.728 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/ 2023-12-15T22:54:19.728 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4= 2023-12-15T22:54:19.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5P//keVTqOjn7EYCA90cPzeUa4=', 'Content-Length': '0'} 2023-12-15T22:54:19.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004fea238a69df7e1a-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.731 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:19.731 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:19.731 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.731 DEBUG:boto:Path: /kskgfn-7/%26 2023-12-15T22:54:19.731 DEBUG:boto:Data: 2023-12-15T22:54:19.731 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.731 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:19.731 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.731 DEBUG:boto:Params: {} 2023-12-15T22:54:19.731 DEBUG:boto:Token: None 2023-12-15T22:54:19.731 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-7/%26 2023-12-15T22:54:19.732 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8e7i34jk7WOW4U9vsCKofWPhLiA= 2023-12-15T22:54:19.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8e7i34jk7WOW4U9vsCKofWPhLiA='} 2023-12-15T22:54:19.774 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003f4f841a7d968365-00657cd91b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.774 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:19.774 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:19.774 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.774 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:19.774 DEBUG:boto:Data: 2023-12-15T22:54:19.774 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.774 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.774 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.774 DEBUG:boto:Params: {} 2023-12-15T22:54:19.775 DEBUG:boto:Token: None 2023-12-15T22:54:19.775 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/ 2023-12-15T22:54:19.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358= 2023-12-15T22:54:19.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358=', 'Content-Length': '0'} 2023-12-15T22:54:19.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000656dac6a70f00691-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.777 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:19.777 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:19.777 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.778 DEBUG:boto:Path: /kskgfn-8/myobj 2023-12-15T22:54:19.778 DEBUG:boto:Data: 2023-12-15T22:54:19.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.778 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.778 DEBUG:boto:Params: {} 2023-12-15T22:54:19.778 DEBUG:boto:Token: None 2023-12-15T22:54:19.778 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/myobj 2023-12-15T22:54:19.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+pFlKzR9kWRM/hGLdzKZH9Cus/U= 2023-12-15T22:54:19.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+pFlKzR9kWRM/hGLdzKZH9Cus/U='} 2023-12-15T22:54:19.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c8f55b20a4915783-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.790 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:19.790 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:19.790 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.790 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:19.790 DEBUG:boto:Data: 2023-12-15T22:54:19.790 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.791 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.791 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.791 DEBUG:boto:Params: {} 2023-12-15T22:54:19.791 DEBUG:boto:Token: None 2023-12-15T22:54:19.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/ 2023-12-15T22:54:19.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358= 2023-12-15T22:54:19.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358=', 'Content-Length': '0'} 2023-12-15T22:54:19.793 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000928be8ddf49d4c08-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.793 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:19.793 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:19.793 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.793 DEBUG:boto:Path: /kskgfn-8/_myobj 2023-12-15T22:54:19.793 DEBUG:boto:Data: 2023-12-15T22:54:19.794 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.794 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.794 DEBUG:boto:Params: {} 2023-12-15T22:54:19.794 DEBUG:boto:Token: None 2023-12-15T22:54:19.794 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/_myobj 2023-12-15T22:54:19.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UexrSi+psPshGHZYdRjI4W6ymkw= 2023-12-15T22:54:19.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UexrSi+psPshGHZYdRjI4W6ymkw='} 2023-12-15T22:54:19.837 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bf11601e1f38357e-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.838 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:19.838 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:19.838 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.838 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:19.838 DEBUG:boto:Data: 2023-12-15T22:54:19.838 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.838 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.838 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.838 DEBUG:boto:Params: {} 2023-12-15T22:54:19.838 DEBUG:boto:Token: None 2023-12-15T22:54:19.839 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/ 2023-12-15T22:54:19.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358= 2023-12-15T22:54:19.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358=', 'Content-Length': '0'} 2023-12-15T22:54:19.840 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007a117f3e3d2d8905-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.841 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:19.841 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:19.841 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.841 DEBUG:boto:Path: /kskgfn-8/%3A 2023-12-15T22:54:19.841 DEBUG:boto:Data: 2023-12-15T22:54:19.841 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.841 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.841 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.841 DEBUG:boto:Params: {} 2023-12-15T22:54:19.842 DEBUG:boto:Token: None 2023-12-15T22:54:19.842 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/%3A 2023-12-15T22:54:19.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9nKkLjExiIwQRmxqvqCSiKZQJ34= 2023-12-15T22:54:19.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9nKkLjExiIwQRmxqvqCSiKZQJ34='} 2023-12-15T22:54:19.852 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000de0d53530181033f-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.852 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:19.852 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:19.852 DEBUG:boto:Method: HEAD 2023-12-15T22:54:19.852 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:19.852 DEBUG:boto:Data: 2023-12-15T22:54:19.852 DEBUG:boto:Headers: {} 2023-12-15T22:54:19.852 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.853 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.853 DEBUG:boto:Params: {} 2023-12-15T22:54:19.853 DEBUG:boto:Token: None 2023-12-15T22:54:19.853 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/ 2023-12-15T22:54:19.853 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358= 2023-12-15T22:54:19.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7bsyvmckzdZjikeehn+Dw9Y358=', 'Content-Length': '0'} 2023-12-15T22:54:19.855 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d5d5299463e86e40-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.855 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:19.855 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:19.855 DEBUG:boto:Method: PUT 2023-12-15T22:54:19.855 DEBUG:boto:Path: /kskgfn-8/%26 2023-12-15T22:54:19.855 DEBUG:boto:Data: 2023-12-15T22:54:19.855 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:19.855 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:19.856 DEBUG:boto:Port: 8000 2023-12-15T22:54:19.856 DEBUG:boto:Params: {} 2023-12-15T22:54:19.856 DEBUG:boto:Token: None 2023-12-15T22:54:19.856 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:19 GMT /kskgfn-8/%26 2023-12-15T22:54:19.856 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o4X4VwVCaUbsPL3Q414EXxv2/hU= 2023-12-15T22:54:19.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o4X4VwVCaUbsPL3Q414EXxv2/hU='} 2023-12-15T22:54:19.861 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d281123f65a92d44-00657cd91b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:19.861 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.862 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:19.912 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:19.912 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:19.944 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:19.959 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680837.286670_27.1","last_update":"2023-12-15T22:53:57.286670Z"},{"marker":"1_1702680859.634893_75.1","last_update":"2023-12-15T22:54:19.634893Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:19.959 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680837.286670_27.1', 1: '1_1702680859.634893_75.1', 2: '', 3: ''} 2023-12-15T22:54:19.959 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:19.960 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:19.960 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:20.006 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:20.006 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:20.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:20.034+0000 7f1bcc92f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:20.037 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:20.036+0000 7f1bcc92f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:20.050 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680859.605014_68.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:19.605014Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:20Z"} 2023-12-15T22:54:20.050 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680859.605014_68.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:19.605014Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:20Z"} 2023-12-15T22:54:20.050 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680859.605014_68.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:19.605014Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:20.050 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680859.634893_75.1', 2: '', 3: ''} 2023-12-15T22:54:20.050 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680859.605014_68.1', 2: '', 3: ''} 2023-12-15T22:54:20.050 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702680859.634893_75.1 target=1_1702680859.605014_68.1 2023-12-15T22:54:21.467 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T22:54:21.467+0000 7f4f7f816640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T22:54:25.052 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:25.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:25.052 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:25.106 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:25.106 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:25.137 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:25.137+0000 7ff34c925800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:25.138 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:25.138+0000 7ff34c925800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:25.153 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680859.634893_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:19.634893Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:25Z"} 2023-12-15T22:54:25.153 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680859.634893_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:19.634893Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:25Z"} 2023-12-15T22:54:25.153 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680859.634893_75.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:19.634893Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:25.153 DEBUG:rgw_multi.tests:log_status={0: '1_1702680837.286670_27.1', 1: '1_1702680859.634893_75.1', 2: '', 3: ''} 2023-12-15T22:54:25.154 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680859.634893_75.1', 2: '', 3: ''} 2023-12-15T22:54:25.154 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:25.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:25.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:25.154 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-7 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:54:25.208 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:25.209 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:25.247 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:25.247+0000 7f25a8930800 1 bucket sync caught up with source: 2023-12-15T22:54:25.247 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.9.6, , 00000000001.11.6, , , , 00000000001.8.6, 00000000001.5.6, , ] 2023-12-15T22:54:25.247 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.9.6, , 00000000001.11.6, , , , 00000000001.8.6, 00000000001.5.6, , ] 2023-12-15T22:54:25.247 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:25.247+0000 7f25a8930800 0 bucket checkpoint complete 2023-12-15T22:54:25.260 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-7 zones={test-zone2, test-zone1} 2023-12-15T22:54:25.260 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.260 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.261 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.261 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:25.261 DEBUG:boto:Data: 2023-12-15T22:54:25.261 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.261 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.261 DEBUG:boto:Params: {} 2023-12-15T22:54:25.261 DEBUG:boto:Token: None 2023-12-15T22:54:25.261 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eEwjxGexsTY3aunIz2tWbbh7O4s= 2023-12-15T22:54:25.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eEwjxGexsTY3aunIz2tWbbh7O4s=', 'Content-Length': '0'} 2023-12-15T22:54:25.264 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be25e361da51b08f-00657cd921-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.264 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.264 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.265 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.265 DEBUG:boto:Path: /kskgfn-7/ 2023-12-15T22:54:25.265 DEBUG:boto:Data: 2023-12-15T22:54:25.265 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.265 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.265 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.265 DEBUG:boto:Params: {} 2023-12-15T22:54:25.265 DEBUG:boto:Token: None 2023-12-15T22:54:25.265 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.265 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eEwjxGexsTY3aunIz2tWbbh7O4s= 2023-12-15T22:54:25.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eEwjxGexsTY3aunIz2tWbbh7O4s=', 'Content-Length': '0'} 2023-12-15T22:54:25.268 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000008290b09dc835743-00657cd921-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.268 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:54:25.268 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.268 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.268 DEBUG:boto:path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.269 DEBUG:boto:auth_path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.269 DEBUG:boto:Method: GET 2023-12-15T22:54:25.269 DEBUG:boto:Path: /kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.269 DEBUG:boto:Data: 2023-12-15T22:54:25.269 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.269 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.269 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.269 DEBUG:boto:Params: {} 2023-12-15T22:54:25.269 DEBUG:boto:Token: None 2023-12-15T22:54:25.269 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/?versions 2023-12-15T22:54:25.269 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4= 2023-12-15T22:54:25.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4=', 'Content-Length': '0'} 2023-12-15T22:54:25.272 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025759d770394131e-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.272 DEBUG:boto:b'kskgfn-7999false&nulltrue2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.319 DEBUG:tasks.rgw_multi.zone_rados:o=& 2023-12-15T22:54:25.319 DEBUG:tasks.rgw_multi.zone_rados:o=: 2023-12-15T22:54:25.319 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2023-12-15T22:54:25.320 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:25.320 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:54:25.320 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.320 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.320 DEBUG:boto:path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.320 DEBUG:boto:auth_path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.320 DEBUG:boto:Method: GET 2023-12-15T22:54:25.320 DEBUG:boto:Path: /kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.320 DEBUG:boto:Data: 2023-12-15T22:54:25.320 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.320 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.321 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.321 DEBUG:boto:Params: {} 2023-12-15T22:54:25.321 DEBUG:boto:Token: None 2023-12-15T22:54:25.321 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/?versions 2023-12-15T22:54:25.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4= 2023-12-15T22:54:25.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4=', 'Content-Length': '0'} 2023-12-15T22:54:25.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031c70f8a407f13e4-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.324 DEBUG:boto:b'kskgfn-7999false&nulltrue2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.324 DEBUG:tasks.rgw_multi.zone_rados:o=& 2023-12-15T22:54:25.324 DEBUG:tasks.rgw_multi.zone_rados:o=: 2023-12-15T22:54:25.325 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2023-12-15T22:54:25.325 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:25.325 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.325 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.325 DEBUG:boto:path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.325 DEBUG:boto:auth_path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.325 DEBUG:boto:Method: GET 2023-12-15T22:54:25.325 DEBUG:boto:Path: /kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.325 DEBUG:boto:Data: 2023-12-15T22:54:25.325 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.325 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.325 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.326 DEBUG:boto:Params: {} 2023-12-15T22:54:25.326 DEBUG:boto:Token: None 2023-12-15T22:54:25.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/?versions 2023-12-15T22:54:25.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4= 2023-12-15T22:54:25.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4=', 'Content-Length': '0'} 2023-12-15T22:54:25.328 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050e36d37c2a293c1-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.328 DEBUG:boto:b'kskgfn-7999false&nulltrue2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.329 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.329 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.329 DEBUG:boto:path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.329 DEBUG:boto:auth_path=/kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.329 DEBUG:boto:Method: GET 2023-12-15T22:54:25.329 DEBUG:boto:Path: /kskgfn-7/?versions&max-keys=999 2023-12-15T22:54:25.329 DEBUG:boto:Data: 2023-12-15T22:54:25.329 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.329 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.329 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.330 DEBUG:boto:Params: {} 2023-12-15T22:54:25.330 DEBUG:boto:Token: None 2023-12-15T22:54:25.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/?versions 2023-12-15T22:54:25.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4= 2023-12-15T22:54:25.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xL1LA6pdGiyfI1VWzSXxNTtqEw4=', 'Content-Length': '0'} 2023-12-15T22:54:25.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef5c273458b6fa55-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.333 DEBUG:boto:b'kskgfn-7999false&nulltrue2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.333 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:25.333 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.333 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.333 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.333 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.333 DEBUG:boto:Method: GET 2023-12-15T22:54:25.334 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.334 DEBUG:boto:Data: 2023-12-15T22:54:25.334 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.334 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.334 DEBUG:boto:Params: {} 2023-12-15T22:54:25.334 DEBUG:boto:Token: None 2023-12-15T22:54:25.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA= 2023-12-15T22:54:25.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA=', 'Content-Length': '0'} 2023-12-15T22:54:25.336 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d9cce5dd4ede3a6c-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.337 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.337 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.337 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.337 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.337 DEBUG:boto:Method: GET 2023-12-15T22:54:25.337 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.337 DEBUG:boto:Data: 2023-12-15T22:54:25.337 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.337 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.338 DEBUG:boto:Params: {} 2023-12-15T22:54:25.338 DEBUG:boto:Token: None 2023-12-15T22:54:25.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA= 2023-12-15T22:54:25.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA=', 'Content-Length': '0'} 2023-12-15T22:54:25.340 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000866565373c1cbc4b-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.340 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.340 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.340 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.340 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.341 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.341 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.341 DEBUG:boto:Data: 2023-12-15T22:54:25.341 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.341 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.341 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.341 DEBUG:boto:Params: {} 2023-12-15T22:54:25.341 DEBUG:boto:Token: None 2023-12-15T22:54:25.341 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9IBGMrkJv0HcFifSGh85Xj4QiRE= 2023-12-15T22:54:25.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9IBGMrkJv0HcFifSGh85Xj4QiRE=', 'Content-Length': '0'} 2023-12-15T22:54:25.343 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b3345a57975fa8cc-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.343 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.343 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.343 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.343 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.344 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.344 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.344 DEBUG:boto:Data: 2023-12-15T22:54:25.344 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.344 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.344 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.344 DEBUG:boto:Params: {} 2023-12-15T22:54:25.344 DEBUG:boto:Token: None 2023-12-15T22:54:25.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9IBGMrkJv0HcFifSGh85Xj4QiRE= 2023-12-15T22:54:25.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9IBGMrkJv0HcFifSGh85Xj4QiRE=', 'Content-Length': '0'} 2023-12-15T22:54:25.346 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d463941659a77b4-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:25.347 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.347 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.347 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.347 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.347 DEBUG:boto:Method: GET 2023-12-15T22:54:25.347 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.347 DEBUG:boto:Data: 2023-12-15T22:54:25.347 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.348 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.348 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.348 DEBUG:boto:Params: {} 2023-12-15T22:54:25.348 DEBUG:boto:Token: None 2023-12-15T22:54:25.348 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA= 2023-12-15T22:54:25.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA=', 'Content-Length': '0'} 2023-12-15T22:54:25.350 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005041d26361b1142e-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.350 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.350 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.350 DEBUG:boto:path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.350 DEBUG:boto:auth_path=/kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.350 DEBUG:boto:Method: GET 2023-12-15T22:54:25.350 DEBUG:boto:Path: /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.351 DEBUG:boto:Data: 2023-12-15T22:54:25.351 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.351 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.351 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.351 DEBUG:boto:Params: {} 2023-12-15T22:54:25.351 DEBUG:boto:Token: None 2023-12-15T22:54:25.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26?versionId=null 2023-12-15T22:54:25.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA= 2023-12-15T22:54:25.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uuFWvqWbARNx98xBdCZs4Gv6FA=', 'Content-Length': '0'} 2023-12-15T22:54:25.353 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005613097f1f5e1a98-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.353 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.353 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.354 DEBUG:boto:path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.354 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.354 DEBUG:boto:Method: GET 2023-12-15T22:54:25.354 DEBUG:boto:Path: /kskgfn-7/?prefix=%26 2023-12-15T22:54:25.354 DEBUG:boto:Data: 2023-12-15T22:54:25.354 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.354 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.354 DEBUG:boto:Params: {} 2023-12-15T22:54:25.354 DEBUG:boto:Token: None 2023-12-15T22:54:25.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000719ec80d1846793-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.400 DEBUG:boto:b'kskgfn-7&1000false&2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.400 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.401 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.401 DEBUG:boto:path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.401 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.401 DEBUG:boto:Method: GET 2023-12-15T22:54:25.401 DEBUG:boto:Path: /kskgfn-7/?prefix=%26 2023-12-15T22:54:25.401 DEBUG:boto:Data: 2023-12-15T22:54:25.401 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.401 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.402 DEBUG:boto:Params: {} 2023-12-15T22:54:25.402 DEBUG:boto:Token: None 2023-12-15T22:54:25.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030b0bd5503f9eecf-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.405 DEBUG:boto:b'kskgfn-7&1000false&2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.405 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.405 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.405 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.406 DEBUG:boto:Path: /kskgfn-7/%26 2023-12-15T22:54:25.406 DEBUG:boto:Data: 2023-12-15T22:54:25.406 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.406 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.406 DEBUG:boto:Params: {} 2023-12-15T22:54:25.406 DEBUG:boto:Token: None 2023-12-15T22:54:25.406 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26 2023-12-15T22:54:25.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHCetW1hgeqI/Cv6EJDYscKOlbA= 2023-12-15T22:54:25.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHCetW1hgeqI/Cv6EJDYscKOlbA=', 'Content-Length': '0'} 2023-12-15T22:54:25.408 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005fe932e08e734104-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.408 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.408 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.408 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.408 DEBUG:boto:Path: /kskgfn-7/%26 2023-12-15T22:54:25.409 DEBUG:boto:Data: 2023-12-15T22:54:25.409 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.409 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.409 DEBUG:boto:Params: {} 2023-12-15T22:54:25.409 DEBUG:boto:Token: None 2023-12-15T22:54:25.409 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26 2023-12-15T22:54:25.409 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHCetW1hgeqI/Cv6EJDYscKOlbA= 2023-12-15T22:54:25.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHCetW1hgeqI/Cv6EJDYscKOlbA=', 'Content-Length': '0'} 2023-12-15T22:54:25.411 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000066cf2bc13b481a7c-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:25.411 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.412 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.412 DEBUG:boto:Method: GET 2023-12-15T22:54:25.412 DEBUG:boto:Path: /kskgfn-7/%26 2023-12-15T22:54:25.412 DEBUG:boto:Data: 2023-12-15T22:54:25.412 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.412 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.412 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.412 DEBUG:boto:Params: {} 2023-12-15T22:54:25.412 DEBUG:boto:Token: None 2023-12-15T22:54:25.412 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26 2023-12-15T22:54:25.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i2BkaIAHXXd/+injDmYBFHJSNBI= 2023-12-15T22:54:25.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i2BkaIAHXXd/+injDmYBFHJSNBI=', 'Content-Length': '0'} 2023-12-15T22:54:25.414 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce3b5ce37db4a84a-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.457 DEBUG:boto:path=/kskgfn-7/%26 2023-12-15T22:54:25.458 DEBUG:boto:auth_path=/kskgfn-7/%26 2023-12-15T22:54:25.458 DEBUG:boto:Method: GET 2023-12-15T22:54:25.458 DEBUG:boto:Path: /kskgfn-7/%26 2023-12-15T22:54:25.458 DEBUG:boto:Data: 2023-12-15T22:54:25.458 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.458 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.458 DEBUG:boto:Params: {} 2023-12-15T22:54:25.458 DEBUG:boto:Token: None 2023-12-15T22:54:25.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%26 2023-12-15T22:54:25.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i2BkaIAHXXd/+injDmYBFHJSNBI= 2023-12-15T22:54:25.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i2BkaIAHXXd/+injDmYBFHJSNBI=', 'Content-Length': '0'} 2023-12-15T22:54:25.461 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c4c4156d37b18e2-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.461 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.461 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.461 DEBUG:boto:path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.461 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.461 DEBUG:boto:Method: GET 2023-12-15T22:54:25.461 DEBUG:boto:Path: /kskgfn-7/?prefix=%26 2023-12-15T22:54:25.462 DEBUG:boto:Data: 2023-12-15T22:54:25.462 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.462 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.462 DEBUG:boto:Params: {} 2023-12-15T22:54:25.462 DEBUG:boto:Token: None 2023-12-15T22:54:25.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd060f937dbc6e56-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.464 DEBUG:boto:b'kskgfn-7&1000false&2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.465 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.465 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.465 DEBUG:boto:path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.465 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%26 2023-12-15T22:54:25.465 DEBUG:boto:Method: GET 2023-12-15T22:54:25.465 DEBUG:boto:Path: /kskgfn-7/?prefix=%26 2023-12-15T22:54:25.465 DEBUG:boto:Data: 2023-12-15T22:54:25.465 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.466 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.466 DEBUG:boto:Params: {} 2023-12-15T22:54:25.466 DEBUG:boto:Token: None 2023-12-15T22:54:25.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc2f899c592c3eab-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.469 DEBUG:boto:b'kskgfn-7&1000false&2023-12-15T22:54:19.734Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.469 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:25.469 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.469 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.469 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.469 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.469 DEBUG:boto:Method: GET 2023-12-15T22:54:25.470 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.470 DEBUG:boto:Data: 2023-12-15T22:54:25.470 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.470 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.470 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.470 DEBUG:boto:Params: {} 2023-12-15T22:54:25.470 DEBUG:boto:Token: None 2023-12-15T22:54:25.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo= 2023-12-15T22:54:25.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo=', 'Content-Length': '0'} 2023-12-15T22:54:25.472 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b3e77ed3f6d3eb01-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.473 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.473 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.473 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.473 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.473 DEBUG:boto:Method: GET 2023-12-15T22:54:25.473 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.473 DEBUG:boto:Data: 2023-12-15T22:54:25.473 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.473 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.473 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.473 DEBUG:boto:Params: {} 2023-12-15T22:54:25.474 DEBUG:boto:Token: None 2023-12-15T22:54:25.474 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.474 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo= 2023-12-15T22:54:25.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo=', 'Content-Length': '0'} 2023-12-15T22:54:25.476 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000feedc787ddda1cf0-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.476 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.477 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.477 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.477 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.477 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.477 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.477 DEBUG:boto:Data: 2023-12-15T22:54:25.477 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.477 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.477 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.477 DEBUG:boto:Params: {} 2023-12-15T22:54:25.477 DEBUG:boto:Token: None 2023-12-15T22:54:25.478 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zanE/6ODY0p5EkSdOrNfHh+nHnM= 2023-12-15T22:54:25.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zanE/6ODY0p5EkSdOrNfHh+nHnM=', 'Content-Length': '0'} 2023-12-15T22:54:25.479 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ad970d9c79a3c3fc-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.480 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.480 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.480 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.480 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.480 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.480 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.480 DEBUG:boto:Data: 2023-12-15T22:54:25.480 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.480 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.481 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.481 DEBUG:boto:Params: {} 2023-12-15T22:54:25.481 DEBUG:boto:Token: None 2023-12-15T22:54:25.481 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.481 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zanE/6ODY0p5EkSdOrNfHh+nHnM= 2023-12-15T22:54:25.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zanE/6ODY0p5EkSdOrNfHh+nHnM=', 'Content-Length': '0'} 2023-12-15T22:54:25.483 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000060b3ae97e67dfa-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.483 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:25.483 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.483 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.483 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.484 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.484 DEBUG:boto:Method: GET 2023-12-15T22:54:25.484 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.484 DEBUG:boto:Data: 2023-12-15T22:54:25.484 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.484 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.484 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.484 DEBUG:boto:Params: {} 2023-12-15T22:54:25.484 DEBUG:boto:Token: None 2023-12-15T22:54:25.484 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.484 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo= 2023-12-15T22:54:25.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo=', 'Content-Length': '0'} 2023-12-15T22:54:25.486 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000008e51d4f503a309b-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.529 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.529 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.530 DEBUG:boto:path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.530 DEBUG:boto:auth_path=/kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.530 DEBUG:boto:Method: GET 2023-12-15T22:54:25.530 DEBUG:boto:Path: /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.530 DEBUG:boto:Data: 2023-12-15T22:54:25.530 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.530 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.530 DEBUG:boto:Params: {} 2023-12-15T22:54:25.530 DEBUG:boto:Token: None 2023-12-15T22:54:25.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A?versionId=null 2023-12-15T22:54:25.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo= 2023-12-15T22:54:25.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zweRdyn+aXnzSdsrEKmo2IoizUo=', 'Content-Length': '0'} 2023-12-15T22:54:25.533 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000844c0a7fa75c9a99-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.533 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.533 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.533 DEBUG:boto:path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.533 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.534 DEBUG:boto:Method: GET 2023-12-15T22:54:25.534 DEBUG:boto:Path: /kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.534 DEBUG:boto:Data: 2023-12-15T22:54:25.534 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.534 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.534 DEBUG:boto:Params: {} 2023-12-15T22:54:25.534 DEBUG:boto:Token: None 2023-12-15T22:54:25.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.536 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032761671839f485d-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.577 DEBUG:boto:b'kskgfn-7:1000false:2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.578 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.578 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.578 DEBUG:boto:path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.578 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.578 DEBUG:boto:Method: GET 2023-12-15T22:54:25.578 DEBUG:boto:Path: /kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.578 DEBUG:boto:Data: 2023-12-15T22:54:25.578 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.579 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.579 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.579 DEBUG:boto:Params: {} 2023-12-15T22:54:25.579 DEBUG:boto:Token: None 2023-12-15T22:54:25.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2c2bc7e52c1fc9e-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.582 DEBUG:boto:b'kskgfn-7:1000false:2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.582 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.582 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.582 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.582 DEBUG:boto:Path: /kskgfn-7/%3A 2023-12-15T22:54:25.582 DEBUG:boto:Data: 2023-12-15T22:54:25.582 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.583 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.583 DEBUG:boto:Params: {} 2023-12-15T22:54:25.583 DEBUG:boto:Token: None 2023-12-15T22:54:25.583 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A 2023-12-15T22:54:25.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jWnmhoHevrmGGXVge93tPKPYiR0= 2023-12-15T22:54:25.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jWnmhoHevrmGGXVge93tPKPYiR0=', 'Content-Length': '0'} 2023-12-15T22:54:25.585 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dcc438ff39e6ab4b-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.586 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.586 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.586 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.586 DEBUG:boto:Path: /kskgfn-7/%3A 2023-12-15T22:54:25.586 DEBUG:boto:Data: 2023-12-15T22:54:25.586 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.586 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.586 DEBUG:boto:Params: {} 2023-12-15T22:54:25.586 DEBUG:boto:Token: None 2023-12-15T22:54:25.587 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A 2023-12-15T22:54:25.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jWnmhoHevrmGGXVge93tPKPYiR0= 2023-12-15T22:54:25.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jWnmhoHevrmGGXVge93tPKPYiR0=', 'Content-Length': '0'} 2023-12-15T22:54:25.588 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006da81b2f3882a14e-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:25.589 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.589 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.589 DEBUG:boto:Method: GET 2023-12-15T22:54:25.589 DEBUG:boto:Path: /kskgfn-7/%3A 2023-12-15T22:54:25.589 DEBUG:boto:Data: 2023-12-15T22:54:25.589 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.590 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.590 DEBUG:boto:Params: {} 2023-12-15T22:54:25.590 DEBUG:boto:Token: None 2023-12-15T22:54:25.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A 2023-12-15T22:54:25.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C5jxoQy7uJvwmZBfj66fJAucSHk= 2023-12-15T22:54:25.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C5jxoQy7uJvwmZBfj66fJAucSHk=', 'Content-Length': '0'} 2023-12-15T22:54:25.592 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000669508feeab0c82d-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.634 DEBUG:boto:path=/kskgfn-7/%3A 2023-12-15T22:54:25.634 DEBUG:boto:auth_path=/kskgfn-7/%3A 2023-12-15T22:54:25.634 DEBUG:boto:Method: GET 2023-12-15T22:54:25.634 DEBUG:boto:Path: /kskgfn-7/%3A 2023-12-15T22:54:25.634 DEBUG:boto:Data: 2023-12-15T22:54:25.634 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.634 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.634 DEBUG:boto:Params: {} 2023-12-15T22:54:25.635 DEBUG:boto:Token: None 2023-12-15T22:54:25.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/%3A 2023-12-15T22:54:25.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C5jxoQy7uJvwmZBfj66fJAucSHk= 2023-12-15T22:54:25.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C5jxoQy7uJvwmZBfj66fJAucSHk=', 'Content-Length': '0'} 2023-12-15T22:54:25.637 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ed5a1c39b8815ab7-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.637 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.638 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.638 DEBUG:boto:path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.638 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.638 DEBUG:boto:Method: GET 2023-12-15T22:54:25.638 DEBUG:boto:Path: /kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.638 DEBUG:boto:Data: 2023-12-15T22:54:25.638 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.638 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.638 DEBUG:boto:Params: {} 2023-12-15T22:54:25.638 DEBUG:boto:Token: None 2023-12-15T22:54:25.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.641 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000df5250f7ad3f4f2-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.641 DEBUG:boto:b'kskgfn-7:1000false:2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.641 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.641 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.642 DEBUG:boto:path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.642 DEBUG:boto:auth_path=/kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.642 DEBUG:boto:Method: GET 2023-12-15T22:54:25.642 DEBUG:boto:Path: /kskgfn-7/?prefix=%3A 2023-12-15T22:54:25.642 DEBUG:boto:Data: 2023-12-15T22:54:25.642 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.642 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.642 DEBUG:boto:Params: {} 2023-12-15T22:54:25.642 DEBUG:boto:Token: None 2023-12-15T22:54:25.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e62a7570427ae07-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.645 DEBUG:boto:b'kskgfn-7:1000false:2023-12-15T22:54:19.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:25.646 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.646 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.646 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.646 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.646 DEBUG:boto:Method: GET 2023-12-15T22:54:25.646 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.646 DEBUG:boto:Data: 2023-12-15T22:54:25.646 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.646 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.646 DEBUG:boto:Params: {} 2023-12-15T22:54:25.647 DEBUG:boto:Token: None 2023-12-15T22:54:25.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE= 2023-12-15T22:54:25.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE=', 'Content-Length': '0'} 2023-12-15T22:54:25.648 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c8787ef39bceab01-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.689 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.690 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.690 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.690 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.690 DEBUG:boto:Method: GET 2023-12-15T22:54:25.690 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.690 DEBUG:boto:Data: 2023-12-15T22:54:25.690 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.690 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.690 DEBUG:boto:Params: {} 2023-12-15T22:54:25.690 DEBUG:boto:Token: None 2023-12-15T22:54:25.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE= 2023-12-15T22:54:25.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE=', 'Content-Length': '0'} 2023-12-15T22:54:25.693 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b3ef7a7f8eeb6d1c-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.693 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.693 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.693 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.693 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.693 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.694 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.694 DEBUG:boto:Data: 2023-12-15T22:54:25.694 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.694 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.694 DEBUG:boto:Params: {} 2023-12-15T22:54:25.694 DEBUG:boto:Token: None 2023-12-15T22:54:25.694 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+gbUR3eSmj4yjp3Uom/gYy6BB0= 2023-12-15T22:54:25.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+gbUR3eSmj4yjp3Uom/gYy6BB0=', 'Content-Length': '0'} 2023-12-15T22:54:25.696 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000c09f5bb93a048b2-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.696 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.697 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.697 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.697 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.697 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.697 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.697 DEBUG:boto:Data: 2023-12-15T22:54:25.697 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.697 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.697 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.697 DEBUG:boto:Params: {} 2023-12-15T22:54:25.697 DEBUG:boto:Token: None 2023-12-15T22:54:25.697 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+gbUR3eSmj4yjp3Uom/gYy6BB0= 2023-12-15T22:54:25.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+gbUR3eSmj4yjp3Uom/gYy6BB0=', 'Content-Length': '0'} 2023-12-15T22:54:25.700 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fabf9870066733b6-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:25.700 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.700 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.700 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.700 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.700 DEBUG:boto:Method: GET 2023-12-15T22:54:25.700 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.700 DEBUG:boto:Data: 2023-12-15T22:54:25.701 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.701 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.701 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.701 DEBUG:boto:Params: {} 2023-12-15T22:54:25.701 DEBUG:boto:Token: None 2023-12-15T22:54:25.701 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE= 2023-12-15T22:54:25.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE=', 'Content-Length': '0'} 2023-12-15T22:54:25.703 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b75d2a132d78ed69-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.749 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.750 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.750 DEBUG:boto:path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.750 DEBUG:boto:auth_path=/kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.750 DEBUG:boto:Method: GET 2023-12-15T22:54:25.750 DEBUG:boto:Path: /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.750 DEBUG:boto:Data: 2023-12-15T22:54:25.750 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.750 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.750 DEBUG:boto:Params: {} 2023-12-15T22:54:25.751 DEBUG:boto:Token: None 2023-12-15T22:54:25.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj?versionId=null 2023-12-15T22:54:25.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE= 2023-12-15T22:54:25.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aPicBGBSK6dIUpo9SjkXlkhGbSE=', 'Content-Length': '0'} 2023-12-15T22:54:25.753 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005aac7d3af9f2c7a8-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.753 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.753 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.754 DEBUG:boto:path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.754 DEBUG:boto:auth_path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.754 DEBUG:boto:Method: GET 2023-12-15T22:54:25.754 DEBUG:boto:Path: /kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.754 DEBUG:boto:Data: 2023-12-15T22:54:25.754 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.754 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.754 DEBUG:boto:Params: {} 2023-12-15T22:54:25.754 DEBUG:boto:Token: None 2023-12-15T22:54:25.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096d8e5491809085f-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.757 DEBUG:boto:b'kskgfn-7_myobj1000false_myobj2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.757 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.757 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.758 DEBUG:boto:path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.758 DEBUG:boto:auth_path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.758 DEBUG:boto:Method: GET 2023-12-15T22:54:25.758 DEBUG:boto:Path: /kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.758 DEBUG:boto:Data: 2023-12-15T22:54:25.758 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.758 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.758 DEBUG:boto:Params: {} 2023-12-15T22:54:25.758 DEBUG:boto:Token: None 2023-12-15T22:54:25.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076bd03e00ba080c9-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.761 DEBUG:boto:b'kskgfn-7_myobj1000false_myobj2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.761 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.762 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.762 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.762 DEBUG:boto:Path: /kskgfn-7/_myobj 2023-12-15T22:54:25.762 DEBUG:boto:Data: 2023-12-15T22:54:25.762 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.762 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.762 DEBUG:boto:Params: {} 2023-12-15T22:54:25.762 DEBUG:boto:Token: None 2023-12-15T22:54:25.762 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj 2023-12-15T22:54:25.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TJWrTJbA0hadvfc4aVkldDWTNTA= 2023-12-15T22:54:25.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TJWrTJbA0hadvfc4aVkldDWTNTA=', 'Content-Length': '0'} 2023-12-15T22:54:25.764 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001b66544cc8b82303-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.764 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.764 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.765 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.765 DEBUG:boto:Path: /kskgfn-7/_myobj 2023-12-15T22:54:25.765 DEBUG:boto:Data: 2023-12-15T22:54:25.765 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.765 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.765 DEBUG:boto:Params: {} 2023-12-15T22:54:25.765 DEBUG:boto:Token: None 2023-12-15T22:54:25.765 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj 2023-12-15T22:54:25.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TJWrTJbA0hadvfc4aVkldDWTNTA= 2023-12-15T22:54:25.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TJWrTJbA0hadvfc4aVkldDWTNTA=', 'Content-Length': '0'} 2023-12-15T22:54:25.767 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b06512fb35f0afad-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:25.768 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.768 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.768 DEBUG:boto:Method: GET 2023-12-15T22:54:25.768 DEBUG:boto:Path: /kskgfn-7/_myobj 2023-12-15T22:54:25.768 DEBUG:boto:Data: 2023-12-15T22:54:25.768 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.768 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.768 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.768 DEBUG:boto:Params: {} 2023-12-15T22:54:25.768 DEBUG:boto:Token: None 2023-12-15T22:54:25.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj 2023-12-15T22:54:25.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuzaTyxIteZkgrNI9v1K6wrlLdo= 2023-12-15T22:54:25.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuzaTyxIteZkgrNI9v1K6wrlLdo=', 'Content-Length': '0'} 2023-12-15T22:54:25.770 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000015cf1c4449559152-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.817 DEBUG:boto:path=/kskgfn-7/_myobj 2023-12-15T22:54:25.818 DEBUG:boto:auth_path=/kskgfn-7/_myobj 2023-12-15T22:54:25.818 DEBUG:boto:Method: GET 2023-12-15T22:54:25.818 DEBUG:boto:Path: /kskgfn-7/_myobj 2023-12-15T22:54:25.818 DEBUG:boto:Data: 2023-12-15T22:54:25.818 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.819 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.819 DEBUG:boto:Params: {} 2023-12-15T22:54:25.819 DEBUG:boto:Token: None 2023-12-15T22:54:25.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/_myobj 2023-12-15T22:54:25.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuzaTyxIteZkgrNI9v1K6wrlLdo= 2023-12-15T22:54:25.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuzaTyxIteZkgrNI9v1K6wrlLdo=', 'Content-Length': '0'} 2023-12-15T22:54:25.821 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ea399e4130bd139-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.821 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.821 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.821 DEBUG:boto:path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.822 DEBUG:boto:auth_path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.822 DEBUG:boto:Method: GET 2023-12-15T22:54:25.822 DEBUG:boto:Path: /kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.822 DEBUG:boto:Data: 2023-12-15T22:54:25.822 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.822 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.822 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.822 DEBUG:boto:Params: {} 2023-12-15T22:54:25.822 DEBUG:boto:Token: None 2023-12-15T22:54:25.822 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.822 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.824 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f63024cd4cc39a90-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.824 DEBUG:boto:b'kskgfn-7_myobj1000false_myobj2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.825 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.825 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.825 DEBUG:boto:path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.825 DEBUG:boto:auth_path=/kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.825 DEBUG:boto:Method: GET 2023-12-15T22:54:25.825 DEBUG:boto:Path: /kskgfn-7/?prefix=_myobj 2023-12-15T22:54:25.825 DEBUG:boto:Data: 2023-12-15T22:54:25.826 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.826 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.826 DEBUG:boto:Params: {} 2023-12-15T22:54:25.826 DEBUG:boto:Token: None 2023-12-15T22:54:25.826 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.828 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054c6f788d2300628-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.829 DEBUG:boto:b'kskgfn-7_myobj1000false_myobj2023-12-15T22:54:19.705Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:25.829 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.829 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.829 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.829 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.829 DEBUG:boto:Method: GET 2023-12-15T22:54:25.829 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.830 DEBUG:boto:Data: 2023-12-15T22:54:25.830 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.830 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.830 DEBUG:boto:Params: {} 2023-12-15T22:54:25.830 DEBUG:boto:Token: None 2023-12-15T22:54:25.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw= 2023-12-15T22:54:25.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw=', 'Content-Length': '0'} 2023-12-15T22:54:25.832 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ff0499ca120aebc1-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.833 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.833 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.833 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.833 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.833 DEBUG:boto:Method: GET 2023-12-15T22:54:25.833 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.833 DEBUG:boto:Data: 2023-12-15T22:54:25.833 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.833 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.834 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.834 DEBUG:boto:Params: {} 2023-12-15T22:54:25.834 DEBUG:boto:Token: None 2023-12-15T22:54:25.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw= 2023-12-15T22:54:25.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw=', 'Content-Length': '0'} 2023-12-15T22:54:25.836 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b8782cb0d1b76a1-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.837 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.837 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.837 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.837 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.837 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.837 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.837 DEBUG:boto:Data: 2023-12-15T22:54:25.837 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.837 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.837 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.838 DEBUG:boto:Params: {} 2023-12-15T22:54:25.838 DEBUG:boto:Token: None 2023-12-15T22:54:25.838 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.838 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S3aBlh58Ay+pufJFepuyh6npOxc= 2023-12-15T22:54:25.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S3aBlh58Ay+pufJFepuyh6npOxc=', 'Content-Length': '0'} 2023-12-15T22:54:25.840 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000009d11a6756f4a27d-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.840 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.840 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.840 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.841 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.841 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.841 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.841 DEBUG:boto:Data: 2023-12-15T22:54:25.841 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.841 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.841 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.841 DEBUG:boto:Params: {} 2023-12-15T22:54:25.841 DEBUG:boto:Token: None 2023-12-15T22:54:25.841 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.841 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S3aBlh58Ay+pufJFepuyh6npOxc= 2023-12-15T22:54:25.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S3aBlh58Ay+pufJFepuyh6npOxc=', 'Content-Length': '0'} 2023-12-15T22:54:25.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f35a468d0a365782-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:25.844 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.844 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.844 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.844 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.844 DEBUG:boto:Method: GET 2023-12-15T22:54:25.845 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.845 DEBUG:boto:Data: 2023-12-15T22:54:25.845 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.845 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.845 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.845 DEBUG:boto:Params: {} 2023-12-15T22:54:25.845 DEBUG:boto:Token: None 2023-12-15T22:54:25.845 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.845 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw= 2023-12-15T22:54:25.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw=', 'Content-Length': '0'} 2023-12-15T22:54:25.848 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004f15df9e0dc1d563-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.890 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.890 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.890 DEBUG:boto:path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.890 DEBUG:boto:auth_path=/kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.890 DEBUG:boto:Method: GET 2023-12-15T22:54:25.890 DEBUG:boto:Path: /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.890 DEBUG:boto:Data: 2023-12-15T22:54:25.890 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.890 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.890 DEBUG:boto:Params: {} 2023-12-15T22:54:25.890 DEBUG:boto:Token: None 2023-12-15T22:54:25.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj?versionId=null 2023-12-15T22:54:25.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw= 2023-12-15T22:54:25.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:45sTf51ukKR2atuuYkHX6/E6Suw=', 'Content-Length': '0'} 2023-12-15T22:54:25.893 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d2ba6b98cef5cdde-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.893 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.894 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.894 DEBUG:boto:path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.894 DEBUG:boto:auth_path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.894 DEBUG:boto:Method: GET 2023-12-15T22:54:25.894 DEBUG:boto:Path: /kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.894 DEBUG:boto:Data: 2023-12-15T22:54:25.894 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.894 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.894 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.894 DEBUG:boto:Params: {} 2023-12-15T22:54:25.895 DEBUG:boto:Token: None 2023-12-15T22:54:25.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8eb29a8ca4e50b8-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.937 DEBUG:boto:b'kskgfn-7myobj1000falsemyobj2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.938 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.938 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.938 DEBUG:boto:path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.938 DEBUG:boto:auth_path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.938 DEBUG:boto:Method: GET 2023-12-15T22:54:25.938 DEBUG:boto:Path: /kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.938 DEBUG:boto:Data: 2023-12-15T22:54:25.938 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.939 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.939 DEBUG:boto:Params: {} 2023-12-15T22:54:25.939 DEBUG:boto:Token: None 2023-12-15T22:54:25.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:25.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085605842db05df12-00657cd921-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.941 DEBUG:boto:b'kskgfn-7myobj1000falsemyobj2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:25.942 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.942 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.942 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.942 DEBUG:boto:Path: /kskgfn-7/myobj 2023-12-15T22:54:25.942 DEBUG:boto:Data: 2023-12-15T22:54:25.942 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.942 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.942 DEBUG:boto:Params: {} 2023-12-15T22:54:25.943 DEBUG:boto:Token: None 2023-12-15T22:54:25.943 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj 2023-12-15T22:54:25.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+lIRpzFhDrPuEh44NHrbuEDNMM= 2023-12-15T22:54:25.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+lIRpzFhDrPuEh44NHrbuEDNMM=', 'Content-Length': '0'} 2023-12-15T22:54:25.944 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d76f8339d6660a3c-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.945 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.945 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.945 DEBUG:boto:Method: HEAD 2023-12-15T22:54:25.945 DEBUG:boto:Path: /kskgfn-7/myobj 2023-12-15T22:54:25.945 DEBUG:boto:Data: 2023-12-15T22:54:25.945 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.945 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.945 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.945 DEBUG:boto:Params: {} 2023-12-15T22:54:25.946 DEBUG:boto:Token: None 2023-12-15T22:54:25.946 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj 2023-12-15T22:54:25.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+lIRpzFhDrPuEh44NHrbuEDNMM= 2023-12-15T22:54:25.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+lIRpzFhDrPuEh44NHrbuEDNMM=', 'Content-Length': '0'} 2023-12-15T22:54:25.948 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e4083de72212d5cf-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:25.948 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.949 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.949 DEBUG:boto:Method: GET 2023-12-15T22:54:25.949 DEBUG:boto:Path: /kskgfn-7/myobj 2023-12-15T22:54:25.949 DEBUG:boto:Data: 2023-12-15T22:54:25.949 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.949 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.949 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.949 DEBUG:boto:Params: {} 2023-12-15T22:54:25.949 DEBUG:boto:Token: None 2023-12-15T22:54:25.949 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj 2023-12-15T22:54:25.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kzQ8K/K3RlSM0Zu6HAj3deKUHh4= 2023-12-15T22:54:25.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kzQ8K/K3RlSM0Zu6HAj3deKUHh4=', 'Content-Length': '0'} 2023-12-15T22:54:25.952 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b03e02eaad6d9940-00657cd921-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.994 DEBUG:boto:path=/kskgfn-7/myobj 2023-12-15T22:54:25.994 DEBUG:boto:auth_path=/kskgfn-7/myobj 2023-12-15T22:54:25.994 DEBUG:boto:Method: GET 2023-12-15T22:54:25.994 DEBUG:boto:Path: /kskgfn-7/myobj 2023-12-15T22:54:25.994 DEBUG:boto:Data: 2023-12-15T22:54:25.994 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:25.994 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.994 DEBUG:boto:Params: {} 2023-12-15T22:54:25.994 DEBUG:boto:Token: None 2023-12-15T22:54:25.995 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/myobj 2023-12-15T22:54:25.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kzQ8K/K3RlSM0Zu6HAj3deKUHh4= 2023-12-15T22:54:25.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kzQ8K/K3RlSM0Zu6HAj3deKUHh4=', 'Content-Length': '0'} 2023-12-15T22:54:25.997 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f07c59c125ea6a1-00657cd921-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:25.997 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:25.997 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:25.997 DEBUG:boto:path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.997 DEBUG:boto:auth_path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.997 DEBUG:boto:Method: GET 2023-12-15T22:54:25.997 DEBUG:boto:Path: /kskgfn-7/?prefix=myobj 2023-12-15T22:54:25.998 DEBUG:boto:Data: 2023-12-15T22:54:25.998 DEBUG:boto:Headers: {} 2023-12-15T22:54:25.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:25.998 DEBUG:boto:Port: 8000 2023-12-15T22:54:25.998 DEBUG:boto:Params: {} 2023-12-15T22:54:25.998 DEBUG:boto:Token: None 2023-12-15T22:54:25.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:25 GMT /kskgfn-7/ 2023-12-15T22:54:25.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q= 2023-12-15T22:54:25.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ceXA099u2Uc3MfxV46zjDBm1N7Q=', 'Content-Length': '0'} 2023-12-15T22:54:26.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b80d3d4bfa5538f-00657cd921-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:26.001 DEBUG:boto:b'kskgfn-7myobj1000falsemyobj2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:26.001 DEBUG:boto:path=/kskgfn-7/ 2023-12-15T22:54:26.001 DEBUG:boto:auth_path=/kskgfn-7/ 2023-12-15T22:54:26.001 DEBUG:boto:path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:26.001 DEBUG:boto:auth_path=/kskgfn-7/?prefix=myobj 2023-12-15T22:54:26.001 DEBUG:boto:Method: GET 2023-12-15T22:54:26.002 DEBUG:boto:Path: /kskgfn-7/?prefix=myobj 2023-12-15T22:54:26.002 DEBUG:boto:Data: 2023-12-15T22:54:26.002 DEBUG:boto:Headers: {} 2023-12-15T22:54:26.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:26.002 DEBUG:boto:Port: 8000 2023-12-15T22:54:26.002 DEBUG:boto:Params: {} 2023-12-15T22:54:26.002 DEBUG:boto:Token: None 2023-12-15T22:54:26.002 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:26 GMT /kskgfn-7/ 2023-12-15T22:54:26.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ooSRcWDuaUZE0IgegrFTt+m+Y4o= 2023-12-15T22:54:26.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ooSRcWDuaUZE0IgegrFTt+m+Y4o=', 'Content-Length': '0'} 2023-12-15T22:54:26.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7b6bac7bc697182-00657cd922-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:26.005 DEBUG:boto:b'kskgfn-7myobj1000falsemyobj2023-12-15T22:54:19.657Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:26.005 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-7 zones={test-zone2, test-zone1} 2023-12-15T22:54:26.005 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:26.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:26.006 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-8 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:54:26.067 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:26.067 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:26.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:54:26.103+0000 7ff5d332e800 1 waiting to reach incremental sync.. 2023-12-15T22:54:31.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:54:31.106+0000 7ff5d332e800 1 bucket sync caught up with source: 2023-12-15T22:54:31.107 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.8.6, , 00000000001.6.6, , , , 00000000001.12.6, 00000000001.5.6, , ] 2023-12-15T22:54:31.107 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.8.6, , 00000000001.6.6, , , , 00000000001.12.6, 00000000001.5.6, , ] 2023-12-15T22:54:31.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:54:31.106+0000 7ff5d332e800 0 bucket checkpoint complete 2023-12-15T22:54:31.123 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-8 zones={test-zone1, test-zone2} 2023-12-15T22:54:31.123 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.123 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.124 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.124 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:31.124 DEBUG:boto:Data: 2023-12-15T22:54:31.124 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.124 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.124 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.124 DEBUG:boto:Params: {} 2023-12-15T22:54:31.124 DEBUG:boto:Token: None 2023-12-15T22:54:31.124 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a6+2Ty/AP2WNYP29HqxjRg1r5Ds= 2023-12-15T22:54:31.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a6+2Ty/AP2WNYP29HqxjRg1r5Ds=', 'Content-Length': '0'} 2023-12-15T22:54:31.127 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fa89c693ec74f5e7-00657cd927-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.127 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.128 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.128 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.128 DEBUG:boto:Path: /kskgfn-8/ 2023-12-15T22:54:31.128 DEBUG:boto:Data: 2023-12-15T22:54:31.128 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.128 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.128 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.128 DEBUG:boto:Params: {} 2023-12-15T22:54:31.128 DEBUG:boto:Token: None 2023-12-15T22:54:31.128 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a6+2Ty/AP2WNYP29HqxjRg1r5Ds= 2023-12-15T22:54:31.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a6+2Ty/AP2WNYP29HqxjRg1r5Ds=', 'Content-Length': '0'} 2023-12-15T22:54:31.131 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0de574706f1e5d8-00657cd927-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.131 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:54:31.131 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.131 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.131 DEBUG:boto:path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.131 DEBUG:boto:auth_path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.131 DEBUG:boto:Method: GET 2023-12-15T22:54:31.131 DEBUG:boto:Path: /kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.132 DEBUG:boto:Data: 2023-12-15T22:54:31.132 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.132 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.132 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.132 DEBUG:boto:Params: {} 2023-12-15T22:54:31.132 DEBUG:boto:Token: None 2023-12-15T22:54:31.132 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/?versions 2023-12-15T22:54:31.132 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI= 2023-12-15T22:54:31.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI=', 'Content-Length': '0'} 2023-12-15T22:54:31.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079ada0ab0569b77b-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.135 DEBUG:boto:b'kskgfn-8999false&nulltrue2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.135 DEBUG:tasks.rgw_multi.zone_rados:o=& 2023-12-15T22:54:31.135 DEBUG:tasks.rgw_multi.zone_rados:o=: 2023-12-15T22:54:31.135 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2023-12-15T22:54:31.135 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:31.135 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:54:31.136 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.136 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.136 DEBUG:boto:path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.136 DEBUG:boto:auth_path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.136 DEBUG:boto:Method: GET 2023-12-15T22:54:31.136 DEBUG:boto:Path: /kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.136 DEBUG:boto:Data: 2023-12-15T22:54:31.136 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.136 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.136 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.136 DEBUG:boto:Params: {} 2023-12-15T22:54:31.136 DEBUG:boto:Token: None 2023-12-15T22:54:31.137 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/?versions 2023-12-15T22:54:31.137 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI= 2023-12-15T22:54:31.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI=', 'Content-Length': '0'} 2023-12-15T22:54:31.139 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fef945cd42de2e2-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.139 DEBUG:boto:b'kskgfn-8999false&nulltrue2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.140 DEBUG:tasks.rgw_multi.zone_rados:o=& 2023-12-15T22:54:31.140 DEBUG:tasks.rgw_multi.zone_rados:o=: 2023-12-15T22:54:31.140 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2023-12-15T22:54:31.140 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:31.140 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.140 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.140 DEBUG:boto:path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.140 DEBUG:boto:auth_path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.140 DEBUG:boto:Method: GET 2023-12-15T22:54:31.140 DEBUG:boto:Path: /kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.141 DEBUG:boto:Data: 2023-12-15T22:54:31.141 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.141 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.141 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.141 DEBUG:boto:Params: {} 2023-12-15T22:54:31.141 DEBUG:boto:Token: None 2023-12-15T22:54:31.141 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/?versions 2023-12-15T22:54:31.141 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI= 2023-12-15T22:54:31.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI=', 'Content-Length': '0'} 2023-12-15T22:54:31.144 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ecace900e53b672-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.144 DEBUG:boto:b'kskgfn-8999false&nulltrue2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.144 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.144 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.144 DEBUG:boto:path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.145 DEBUG:boto:auth_path=/kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.145 DEBUG:boto:Method: GET 2023-12-15T22:54:31.145 DEBUG:boto:Path: /kskgfn-8/?versions&max-keys=999 2023-12-15T22:54:31.145 DEBUG:boto:Data: 2023-12-15T22:54:31.145 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.145 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.145 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.145 DEBUG:boto:Params: {} 2023-12-15T22:54:31.145 DEBUG:boto:Token: None 2023-12-15T22:54:31.145 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/?versions 2023-12-15T22:54:31.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI= 2023-12-15T22:54:31.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ5VHpCPtf0FWWSDGcIbUZascQI=', 'Content-Length': '0'} 2023-12-15T22:54:31.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9c5f40b7f1d3991-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.148 DEBUG:boto:b'kskgfn-8999false&nulltrue2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal:nulltrue2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal_myobjnulltrue2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalmyobjnulltrue2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:31.149 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.149 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.149 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.149 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.149 DEBUG:boto:Method: GET 2023-12-15T22:54:31.149 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.149 DEBUG:boto:Data: 2023-12-15T22:54:31.149 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.149 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.149 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.150 DEBUG:boto:Params: {} 2023-12-15T22:54:31.150 DEBUG:boto:Token: None 2023-12-15T22:54:31.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs= 2023-12-15T22:54:31.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs=', 'Content-Length': '0'} 2023-12-15T22:54:31.152 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000880acf1d5b1e0c77-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.152 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.152 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.152 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.153 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.153 DEBUG:boto:Method: GET 2023-12-15T22:54:31.153 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.153 DEBUG:boto:Data: 2023-12-15T22:54:31.153 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.153 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.153 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.153 DEBUG:boto:Params: {} 2023-12-15T22:54:31.153 DEBUG:boto:Token: None 2023-12-15T22:54:31.153 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.153 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs= 2023-12-15T22:54:31.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs=', 'Content-Length': '0'} 2023-12-15T22:54:31.156 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000023f71e9f5a1adf25-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.197 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.198 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.198 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.198 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.198 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.198 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.198 DEBUG:boto:Data: 2023-12-15T22:54:31.198 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.198 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.198 DEBUG:boto:Params: {} 2023-12-15T22:54:31.198 DEBUG:boto:Token: None 2023-12-15T22:54:31.199 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Tb0NMbLEdnYEYjcO8ij0yYXK57E= 2023-12-15T22:54:31.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Tb0NMbLEdnYEYjcO8ij0yYXK57E=', 'Content-Length': '0'} 2023-12-15T22:54:31.201 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000817b14e9694996b4-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.201 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.201 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.201 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.201 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.201 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.201 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.202 DEBUG:boto:Data: 2023-12-15T22:54:31.202 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.202 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.202 DEBUG:boto:Params: {} 2023-12-15T22:54:31.202 DEBUG:boto:Token: None 2023-12-15T22:54:31.202 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.202 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Tb0NMbLEdnYEYjcO8ij0yYXK57E= 2023-12-15T22:54:31.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Tb0NMbLEdnYEYjcO8ij0yYXK57E=', 'Content-Length': '0'} 2023-12-15T22:54:31.204 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ea5dcebebfed0119-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.205 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:31.205 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.205 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.205 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.205 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.205 DEBUG:boto:Method: GET 2023-12-15T22:54:31.205 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.205 DEBUG:boto:Data: 2023-12-15T22:54:31.205 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.205 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.205 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.206 DEBUG:boto:Params: {} 2023-12-15T22:54:31.206 DEBUG:boto:Token: None 2023-12-15T22:54:31.206 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs= 2023-12-15T22:54:31.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs=', 'Content-Length': '0'} 2023-12-15T22:54:31.208 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000254a71035f59dd69-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.208 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.209 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.209 DEBUG:boto:path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.209 DEBUG:boto:auth_path=/kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.209 DEBUG:boto:Method: GET 2023-12-15T22:54:31.209 DEBUG:boto:Path: /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.209 DEBUG:boto:Data: 2023-12-15T22:54:31.209 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.209 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.209 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.209 DEBUG:boto:Params: {} 2023-12-15T22:54:31.210 DEBUG:boto:Token: None 2023-12-15T22:54:31.210 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26?versionId=null 2023-12-15T22:54:31.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs= 2023-12-15T22:54:31.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fXaQXhFSiustZRtQ9cOLZXUeTvs=', 'Content-Length': '0'} 2023-12-15T22:54:31.212 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000016c6bd1c483898c0-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.212 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.212 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.212 DEBUG:boto:path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.212 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.212 DEBUG:boto:Method: GET 2023-12-15T22:54:31.213 DEBUG:boto:Path: /kskgfn-8/?prefix=%26 2023-12-15T22:54:31.213 DEBUG:boto:Data: 2023-12-15T22:54:31.213 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.213 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.213 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.213 DEBUG:boto:Params: {} 2023-12-15T22:54:31.213 DEBUG:boto:Token: None 2023-12-15T22:54:31.213 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.213 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a08b6059bab2318-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.216 DEBUG:boto:b'kskgfn-8&1000false&2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.216 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.216 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.217 DEBUG:boto:path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.217 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.217 DEBUG:boto:Method: GET 2023-12-15T22:54:31.217 DEBUG:boto:Path: /kskgfn-8/?prefix=%26 2023-12-15T22:54:31.217 DEBUG:boto:Data: 2023-12-15T22:54:31.217 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.217 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.217 DEBUG:boto:Params: {} 2023-12-15T22:54:31.217 DEBUG:boto:Token: None 2023-12-15T22:54:31.217 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.220 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070b18c5bee27626e-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.220 DEBUG:boto:b'kskgfn-8&1000false&2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.220 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.220 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.221 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.221 DEBUG:boto:Path: /kskgfn-8/%26 2023-12-15T22:54:31.221 DEBUG:boto:Data: 2023-12-15T22:54:31.221 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.221 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.221 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.221 DEBUG:boto:Params: {} 2023-12-15T22:54:31.221 DEBUG:boto:Token: None 2023-12-15T22:54:31.221 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26 2023-12-15T22:54:31.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lagCV1WIBjSKnXEJO/T4DnezrxI= 2023-12-15T22:54:31.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lagCV1WIBjSKnXEJO/T4DnezrxI=', 'Content-Length': '0'} 2023-12-15T22:54:31.223 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ec15074900d23a65-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.224 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.224 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.224 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.224 DEBUG:boto:Path: /kskgfn-8/%26 2023-12-15T22:54:31.224 DEBUG:boto:Data: 2023-12-15T22:54:31.224 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.224 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.224 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.224 DEBUG:boto:Params: {} 2023-12-15T22:54:31.224 DEBUG:boto:Token: None 2023-12-15T22:54:31.225 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26 2023-12-15T22:54:31.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lagCV1WIBjSKnXEJO/T4DnezrxI= 2023-12-15T22:54:31.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lagCV1WIBjSKnXEJO/T4DnezrxI=', 'Content-Length': '0'} 2023-12-15T22:54:31.227 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa238b8ddeb2bcc1-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2023-12-15T22:54:31.227 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.227 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.227 DEBUG:boto:Method: GET 2023-12-15T22:54:31.227 DEBUG:boto:Path: /kskgfn-8/%26 2023-12-15T22:54:31.227 DEBUG:boto:Data: 2023-12-15T22:54:31.227 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.228 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.228 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.228 DEBUG:boto:Params: {} 2023-12-15T22:54:31.228 DEBUG:boto:Token: None 2023-12-15T22:54:31.228 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26 2023-12-15T22:54:31.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6AXyLwFUBu9ICvQJXpQTHEzJYc= 2023-12-15T22:54:31.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6AXyLwFUBu9ICvQJXpQTHEzJYc=', 'Content-Length': '0'} 2023-12-15T22:54:31.230 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3fc2fb6f3542be3-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.230 DEBUG:boto:path=/kskgfn-8/%26 2023-12-15T22:54:31.231 DEBUG:boto:auth_path=/kskgfn-8/%26 2023-12-15T22:54:31.231 DEBUG:boto:Method: GET 2023-12-15T22:54:31.231 DEBUG:boto:Path: /kskgfn-8/%26 2023-12-15T22:54:31.231 DEBUG:boto:Data: 2023-12-15T22:54:31.231 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.231 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.231 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.231 DEBUG:boto:Params: {} 2023-12-15T22:54:31.231 DEBUG:boto:Token: None 2023-12-15T22:54:31.232 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%26 2023-12-15T22:54:31.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6AXyLwFUBu9ICvQJXpQTHEzJYc= 2023-12-15T22:54:31.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6AXyLwFUBu9ICvQJXpQTHEzJYc=', 'Content-Length': '0'} 2023-12-15T22:54:31.234 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008969d1cc5ef4a31b-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.234 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.234 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.234 DEBUG:boto:path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.234 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.234 DEBUG:boto:Method: GET 2023-12-15T22:54:31.235 DEBUG:boto:Path: /kskgfn-8/?prefix=%26 2023-12-15T22:54:31.235 DEBUG:boto:Data: 2023-12-15T22:54:31.235 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.235 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.235 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.235 DEBUG:boto:Params: {} 2023-12-15T22:54:31.235 DEBUG:boto:Token: None 2023-12-15T22:54:31.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b8a02c61552cbf7-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.281 DEBUG:boto:b'kskgfn-8&1000false&2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.282 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.282 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.282 DEBUG:boto:path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.282 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%26 2023-12-15T22:54:31.282 DEBUG:boto:Method: GET 2023-12-15T22:54:31.282 DEBUG:boto:Path: /kskgfn-8/?prefix=%26 2023-12-15T22:54:31.282 DEBUG:boto:Data: 2023-12-15T22:54:31.282 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.283 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.283 DEBUG:boto:Params: {} 2023-12-15T22:54:31.283 DEBUG:boto:Token: None 2023-12-15T22:54:31.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e147c00ad60bbcb-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.286 DEBUG:boto:b'kskgfn-8&1000false&2023-12-15T22:54:19.858Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.286 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:31.286 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.287 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.287 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.287 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.287 DEBUG:boto:Method: GET 2023-12-15T22:54:31.287 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.287 DEBUG:boto:Data: 2023-12-15T22:54:31.287 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.287 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.287 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.287 DEBUG:boto:Params: {} 2023-12-15T22:54:31.287 DEBUG:boto:Token: None 2023-12-15T22:54:31.288 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.288 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ= 2023-12-15T22:54:31.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ=', 'Content-Length': '0'} 2023-12-15T22:54:31.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d1becef4451257cf-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.290 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.290 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.290 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.290 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.290 DEBUG:boto:Method: GET 2023-12-15T22:54:31.290 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.290 DEBUG:boto:Data: 2023-12-15T22:54:31.290 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.291 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.291 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.291 DEBUG:boto:Params: {} 2023-12-15T22:54:31.291 DEBUG:boto:Token: None 2023-12-15T22:54:31.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ= 2023-12-15T22:54:31.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ=', 'Content-Length': '0'} 2023-12-15T22:54:31.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a2071d6cfa1ffbe5-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.333 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.334 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.334 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.334 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.334 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.334 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.334 DEBUG:boto:Data: 2023-12-15T22:54:31.334 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.334 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.334 DEBUG:boto:Params: {} 2023-12-15T22:54:31.334 DEBUG:boto:Token: None 2023-12-15T22:54:31.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NakJ0AGXigi1pqQPQVel+J3/4xs= 2023-12-15T22:54:31.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NakJ0AGXigi1pqQPQVel+J3/4xs=', 'Content-Length': '0'} 2023-12-15T22:54:31.337 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c94c733e4f1568e3-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.337 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.337 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.337 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.337 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.337 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.337 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.337 DEBUG:boto:Data: 2023-12-15T22:54:31.338 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.338 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.338 DEBUG:boto:Params: {} 2023-12-15T22:54:31.338 DEBUG:boto:Token: None 2023-12-15T22:54:31.338 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NakJ0AGXigi1pqQPQVel+J3/4xs= 2023-12-15T22:54:31.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NakJ0AGXigi1pqQPQVel+J3/4xs=', 'Content-Length': '0'} 2023-12-15T22:54:31.340 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009ec59f7f85c10967-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:31.341 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.341 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.341 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.341 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.341 DEBUG:boto:Method: GET 2023-12-15T22:54:31.341 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.341 DEBUG:boto:Data: 2023-12-15T22:54:31.341 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.341 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.341 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.342 DEBUG:boto:Params: {} 2023-12-15T22:54:31.342 DEBUG:boto:Token: None 2023-12-15T22:54:31.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ= 2023-12-15T22:54:31.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ=', 'Content-Length': '0'} 2023-12-15T22:54:31.344 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000636bc461e2a656e7-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.344 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.344 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.344 DEBUG:boto:path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.344 DEBUG:boto:auth_path=/kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.344 DEBUG:boto:Method: GET 2023-12-15T22:54:31.344 DEBUG:boto:Path: /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.344 DEBUG:boto:Data: 2023-12-15T22:54:31.345 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.345 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.345 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.345 DEBUG:boto:Params: {} 2023-12-15T22:54:31.345 DEBUG:boto:Token: None 2023-12-15T22:54:31.345 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A?versionId=null 2023-12-15T22:54:31.345 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ= 2023-12-15T22:54:31.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMFCnQp3y8AyBo8c5s9oaah8LTQ=', 'Content-Length': '0'} 2023-12-15T22:54:31.347 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f8f5b021b040f40-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.348 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.348 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.348 DEBUG:boto:path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.348 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.348 DEBUG:boto:Method: GET 2023-12-15T22:54:31.348 DEBUG:boto:Path: /kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.348 DEBUG:boto:Data: 2023-12-15T22:54:31.348 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.348 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.348 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.348 DEBUG:boto:Params: {} 2023-12-15T22:54:31.349 DEBUG:boto:Token: None 2023-12-15T22:54:31.349 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.349 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004edcb3b73bc3ef62-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.351 DEBUG:boto:b'kskgfn-8:1000false:2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.352 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.352 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.352 DEBUG:boto:path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.352 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.352 DEBUG:boto:Method: GET 2023-12-15T22:54:31.352 DEBUG:boto:Path: /kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.352 DEBUG:boto:Data: 2023-12-15T22:54:31.352 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.352 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.353 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.353 DEBUG:boto:Params: {} 2023-12-15T22:54:31.353 DEBUG:boto:Token: None 2023-12-15T22:54:31.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.355 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3fb3f3577fb5b5b-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.355 DEBUG:boto:b'kskgfn-8:1000false:2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.356 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.356 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.356 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.356 DEBUG:boto:Path: /kskgfn-8/%3A 2023-12-15T22:54:31.356 DEBUG:boto:Data: 2023-12-15T22:54:31.356 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.356 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.356 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.356 DEBUG:boto:Params: {} 2023-12-15T22:54:31.356 DEBUG:boto:Token: None 2023-12-15T22:54:31.357 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A 2023-12-15T22:54:31.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PjJqwsbllbeDKqu2pmW5HS5DOi0= 2023-12-15T22:54:31.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PjJqwsbllbeDKqu2pmW5HS5DOi0=', 'Content-Length': '0'} 2023-12-15T22:54:31.358 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b37d61088ae82b41-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.359 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.359 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.359 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.359 DEBUG:boto:Path: /kskgfn-8/%3A 2023-12-15T22:54:31.359 DEBUG:boto:Data: 2023-12-15T22:54:31.359 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.359 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.359 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.359 DEBUG:boto:Params: {} 2023-12-15T22:54:31.359 DEBUG:boto:Token: None 2023-12-15T22:54:31.360 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A 2023-12-15T22:54:31.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PjJqwsbllbeDKqu2pmW5HS5DOi0= 2023-12-15T22:54:31.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PjJqwsbllbeDKqu2pmW5HS5DOi0=', 'Content-Length': '0'} 2023-12-15T22:54:31.361 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000052226a635a65061b-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2023-12-15T22:54:31.362 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.362 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.362 DEBUG:boto:Method: GET 2023-12-15T22:54:31.362 DEBUG:boto:Path: /kskgfn-8/%3A 2023-12-15T22:54:31.362 DEBUG:boto:Data: 2023-12-15T22:54:31.362 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.362 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.362 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.362 DEBUG:boto:Params: {} 2023-12-15T22:54:31.362 DEBUG:boto:Token: None 2023-12-15T22:54:31.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A 2023-12-15T22:54:31.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hlQJGTGI1Qk/Oqxtvb3igAukNLw= 2023-12-15T22:54:31.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hlQJGTGI1Qk/Oqxtvb3igAukNLw=', 'Content-Length': '0'} 2023-12-15T22:54:31.365 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005aefcbd47ea00ccc-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.365 DEBUG:boto:path=/kskgfn-8/%3A 2023-12-15T22:54:31.365 DEBUG:boto:auth_path=/kskgfn-8/%3A 2023-12-15T22:54:31.365 DEBUG:boto:Method: GET 2023-12-15T22:54:31.365 DEBUG:boto:Path: /kskgfn-8/%3A 2023-12-15T22:54:31.366 DEBUG:boto:Data: 2023-12-15T22:54:31.366 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.366 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.366 DEBUG:boto:Params: {} 2023-12-15T22:54:31.366 DEBUG:boto:Token: None 2023-12-15T22:54:31.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/%3A 2023-12-15T22:54:31.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hlQJGTGI1Qk/Oqxtvb3igAukNLw= 2023-12-15T22:54:31.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hlQJGTGI1Qk/Oqxtvb3igAukNLw=', 'Content-Length': '0'} 2023-12-15T22:54:31.368 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009d973ae1f0db1884-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.368 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.368 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.368 DEBUG:boto:path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.369 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.369 DEBUG:boto:Method: GET 2023-12-15T22:54:31.369 DEBUG:boto:Path: /kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.369 DEBUG:boto:Data: 2023-12-15T22:54:31.369 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.369 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.369 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.369 DEBUG:boto:Params: {} 2023-12-15T22:54:31.369 DEBUG:boto:Token: None 2023-12-15T22:54:31.369 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc0b23b68e828aeb-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.372 DEBUG:boto:b'kskgfn-8:1000false:2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.372 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.372 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.372 DEBUG:boto:path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.372 DEBUG:boto:auth_path=/kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.372 DEBUG:boto:Method: GET 2023-12-15T22:54:31.372 DEBUG:boto:Path: /kskgfn-8/?prefix=%3A 2023-12-15T22:54:31.373 DEBUG:boto:Data: 2023-12-15T22:54:31.373 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.373 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.373 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.373 DEBUG:boto:Params: {} 2023-12-15T22:54:31.373 DEBUG:boto:Token: None 2023-12-15T22:54:31.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.376 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a02bd4813a6c21c5-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.376 DEBUG:boto:b'kskgfn-8:1000false:2023-12-15T22:54:19.844Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:31.377 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.377 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.377 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.377 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.377 DEBUG:boto:Method: GET 2023-12-15T22:54:31.377 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.377 DEBUG:boto:Data: 2023-12-15T22:54:31.377 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.377 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.377 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.377 DEBUG:boto:Params: {} 2023-12-15T22:54:31.378 DEBUG:boto:Token: None 2023-12-15T22:54:31.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE= 2023-12-15T22:54:31.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE=', 'Content-Length': '0'} 2023-12-15T22:54:31.380 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000096b95ffb6db5d758-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.380 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.380 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.380 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.380 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.380 DEBUG:boto:Method: GET 2023-12-15T22:54:31.380 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.380 DEBUG:boto:Data: 2023-12-15T22:54:31.380 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.381 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.381 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.381 DEBUG:boto:Params: {} 2023-12-15T22:54:31.381 DEBUG:boto:Token: None 2023-12-15T22:54:31.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE= 2023-12-15T22:54:31.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE=', 'Content-Length': '0'} 2023-12-15T22:54:31.383 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000cfbe4bca6dce2f4-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.384 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.384 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.384 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.384 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.384 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.384 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.384 DEBUG:boto:Data: 2023-12-15T22:54:31.384 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.384 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.384 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.385 DEBUG:boto:Params: {} 2023-12-15T22:54:31.385 DEBUG:boto:Token: None 2023-12-15T22:54:31.385 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VtQ+eqOqnjkCTVA7vhQEWjFoCmc= 2023-12-15T22:54:31.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VtQ+eqOqnjkCTVA7vhQEWjFoCmc=', 'Content-Length': '0'} 2023-12-15T22:54:31.387 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000091afc8f910a9e3f4-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.387 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.387 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.387 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.387 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.387 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.387 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.387 DEBUG:boto:Data: 2023-12-15T22:54:31.387 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.388 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.388 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.388 DEBUG:boto:Params: {} 2023-12-15T22:54:31.388 DEBUG:boto:Token: None 2023-12-15T22:54:31.388 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VtQ+eqOqnjkCTVA7vhQEWjFoCmc= 2023-12-15T22:54:31.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VtQ+eqOqnjkCTVA7vhQEWjFoCmc=', 'Content-Length': '0'} 2023-12-15T22:54:31.390 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000031ff410a9211e31d-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:31.390 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.390 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.390 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.390 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.390 DEBUG:boto:Method: GET 2023-12-15T22:54:31.391 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.391 DEBUG:boto:Data: 2023-12-15T22:54:31.391 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.391 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.391 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.391 DEBUG:boto:Params: {} 2023-12-15T22:54:31.391 DEBUG:boto:Token: None 2023-12-15T22:54:31.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE= 2023-12-15T22:54:31.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE=', 'Content-Length': '0'} 2023-12-15T22:54:31.393 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001635bdbd6ba129b5-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.394 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.394 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.394 DEBUG:boto:path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.394 DEBUG:boto:auth_path=/kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.394 DEBUG:boto:Method: GET 2023-12-15T22:54:31.394 DEBUG:boto:Path: /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.394 DEBUG:boto:Data: 2023-12-15T22:54:31.394 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.394 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.395 DEBUG:boto:Params: {} 2023-12-15T22:54:31.395 DEBUG:boto:Token: None 2023-12-15T22:54:31.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj?versionId=null 2023-12-15T22:54:31.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE= 2023-12-15T22:54:31.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jzRHD0nZOXGXLMXEwLgHubKf7ZE=', 'Content-Length': '0'} 2023-12-15T22:54:31.397 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e43dc1b79401324-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.437 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.438 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.438 DEBUG:boto:path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.438 DEBUG:boto:auth_path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.438 DEBUG:boto:Method: GET 2023-12-15T22:54:31.438 DEBUG:boto:Path: /kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.438 DEBUG:boto:Data: 2023-12-15T22:54:31.438 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.438 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.438 DEBUG:boto:Params: {} 2023-12-15T22:54:31.438 DEBUG:boto:Token: None 2023-12-15T22:54:31.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048b4f2469c496d0d-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.441 DEBUG:boto:b'kskgfn-8_myobj1000false_myobj2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.442 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.442 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.442 DEBUG:boto:path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.442 DEBUG:boto:auth_path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.442 DEBUG:boto:Method: GET 2023-12-15T22:54:31.442 DEBUG:boto:Path: /kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.442 DEBUG:boto:Data: 2023-12-15T22:54:31.442 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.442 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.442 DEBUG:boto:Params: {} 2023-12-15T22:54:31.443 DEBUG:boto:Token: None 2023-12-15T22:54:31.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f479d8b805229a17-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.445 DEBUG:boto:b'kskgfn-8_myobj1000false_myobj2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.446 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.446 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.446 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.446 DEBUG:boto:Path: /kskgfn-8/_myobj 2023-12-15T22:54:31.446 DEBUG:boto:Data: 2023-12-15T22:54:31.446 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.446 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.446 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.446 DEBUG:boto:Params: {} 2023-12-15T22:54:31.447 DEBUG:boto:Token: None 2023-12-15T22:54:31.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj 2023-12-15T22:54:31.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jn/9XPWrbSv0/9EpVELVjnaes20= 2023-12-15T22:54:31.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jn/9XPWrbSv0/9EpVELVjnaes20=', 'Content-Length': '0'} 2023-12-15T22:54:31.449 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d615151babe8da2d-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.449 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.449 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.449 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.449 DEBUG:boto:Path: /kskgfn-8/_myobj 2023-12-15T22:54:31.449 DEBUG:boto:Data: 2023-12-15T22:54:31.449 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.449 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.450 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.450 DEBUG:boto:Params: {} 2023-12-15T22:54:31.450 DEBUG:boto:Token: None 2023-12-15T22:54:31.450 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj 2023-12-15T22:54:31.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jn/9XPWrbSv0/9EpVELVjnaes20= 2023-12-15T22:54:31.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jn/9XPWrbSv0/9EpVELVjnaes20=', 'Content-Length': '0'} 2023-12-15T22:54:31.452 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000055ba519e1fa0d033-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2023-12-15T22:54:31.452 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.452 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.452 DEBUG:boto:Method: GET 2023-12-15T22:54:31.453 DEBUG:boto:Path: /kskgfn-8/_myobj 2023-12-15T22:54:31.453 DEBUG:boto:Data: 2023-12-15T22:54:31.453 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.453 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.453 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.453 DEBUG:boto:Params: {} 2023-12-15T22:54:31.453 DEBUG:boto:Token: None 2023-12-15T22:54:31.453 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj 2023-12-15T22:54:31.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Oe0ovloT1xlfvsUwfEzOOqLlU3s= 2023-12-15T22:54:31.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oe0ovloT1xlfvsUwfEzOOqLlU3s=', 'Content-Length': '0'} 2023-12-15T22:54:31.455 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005866fc2ac0d046b4-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.455 DEBUG:boto:path=/kskgfn-8/_myobj 2023-12-15T22:54:31.456 DEBUG:boto:auth_path=/kskgfn-8/_myobj 2023-12-15T22:54:31.456 DEBUG:boto:Method: GET 2023-12-15T22:54:31.456 DEBUG:boto:Path: /kskgfn-8/_myobj 2023-12-15T22:54:31.456 DEBUG:boto:Data: 2023-12-15T22:54:31.456 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.456 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.456 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.456 DEBUG:boto:Params: {} 2023-12-15T22:54:31.456 DEBUG:boto:Token: None 2023-12-15T22:54:31.456 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/_myobj 2023-12-15T22:54:31.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Oe0ovloT1xlfvsUwfEzOOqLlU3s= 2023-12-15T22:54:31.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oe0ovloT1xlfvsUwfEzOOqLlU3s=', 'Content-Length': '0'} 2023-12-15T22:54:31.458 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e6b943bcff3b0a6e-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.459 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.459 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.459 DEBUG:boto:path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.459 DEBUG:boto:auth_path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.459 DEBUG:boto:Method: GET 2023-12-15T22:54:31.459 DEBUG:boto:Path: /kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.459 DEBUG:boto:Data: 2023-12-15T22:54:31.459 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.459 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.459 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.460 DEBUG:boto:Params: {} 2023-12-15T22:54:31.460 DEBUG:boto:Token: None 2023-12-15T22:54:31.460 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.460 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093b50172521265a6-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.462 DEBUG:boto:b'kskgfn-8_myobj1000false_myobj2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.463 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.463 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.463 DEBUG:boto:path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.463 DEBUG:boto:auth_path=/kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.463 DEBUG:boto:Method: GET 2023-12-15T22:54:31.463 DEBUG:boto:Path: /kskgfn-8/?prefix=_myobj 2023-12-15T22:54:31.463 DEBUG:boto:Data: 2023-12-15T22:54:31.464 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.464 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.464 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.464 DEBUG:boto:Params: {} 2023-12-15T22:54:31.464 DEBUG:boto:Token: None 2023-12-15T22:54:31.464 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.464 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.466 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc31a2fe0cc489c5-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.467 DEBUG:boto:b'kskgfn-8_myobj1000false_myobj2023-12-15T22:54:19.797Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:31.467 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.467 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.467 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.467 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.467 DEBUG:boto:Method: GET 2023-12-15T22:54:31.468 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.468 DEBUG:boto:Data: 2023-12-15T22:54:31.468 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.468 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.468 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.468 DEBUG:boto:Params: {} 2023-12-15T22:54:31.468 DEBUG:boto:Token: None 2023-12-15T22:54:31.468 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.468 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8= 2023-12-15T22:54:31.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8=', 'Content-Length': '0'} 2023-12-15T22:54:31.471 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000061c9ee1119333076-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.513 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.514 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.514 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.514 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.514 DEBUG:boto:Method: GET 2023-12-15T22:54:31.514 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.514 DEBUG:boto:Data: 2023-12-15T22:54:31.514 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.514 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.514 DEBUG:boto:Params: {} 2023-12-15T22:54:31.515 DEBUG:boto:Token: None 2023-12-15T22:54:31.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8= 2023-12-15T22:54:31.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8=', 'Content-Length': '0'} 2023-12-15T22:54:31.517 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c7eac3c0ec22476-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.517 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.517 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.517 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.517 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.517 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.518 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.518 DEBUG:boto:Data: 2023-12-15T22:54:31.518 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.518 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.518 DEBUG:boto:Params: {} 2023-12-15T22:54:31.518 DEBUG:boto:Token: None 2023-12-15T22:54:31.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Cd0FfaZ1vSH7XxI6rIfZkWt7nA= 2023-12-15T22:54:31.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Cd0FfaZ1vSH7XxI6rIfZkWt7nA=', 'Content-Length': '0'} 2023-12-15T22:54:31.520 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e1aa3d9558d107e-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.521 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.521 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.521 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.521 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.521 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.521 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.521 DEBUG:boto:Data: 2023-12-15T22:54:31.521 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.521 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.522 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.522 DEBUG:boto:Params: {} 2023-12-15T22:54:31.522 DEBUG:boto:Token: None 2023-12-15T22:54:31.522 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Cd0FfaZ1vSH7XxI6rIfZkWt7nA= 2023-12-15T22:54:31.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Cd0FfaZ1vSH7XxI6rIfZkWt7nA=', 'Content-Length': '0'} 2023-12-15T22:54:31.524 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003cff37833b2f1860-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:31.525 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.525 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.525 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.525 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.525 DEBUG:boto:Method: GET 2023-12-15T22:54:31.525 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.525 DEBUG:boto:Data: 2023-12-15T22:54:31.525 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.525 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.525 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.525 DEBUG:boto:Params: {} 2023-12-15T22:54:31.526 DEBUG:boto:Token: None 2023-12-15T22:54:31.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8= 2023-12-15T22:54:31.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8=', 'Content-Length': '0'} 2023-12-15T22:54:31.528 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e38737717678d6d4-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.528 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.528 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.528 DEBUG:boto:path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.528 DEBUG:boto:auth_path=/kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.529 DEBUG:boto:Method: GET 2023-12-15T22:54:31.529 DEBUG:boto:Path: /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.529 DEBUG:boto:Data: 2023-12-15T22:54:31.529 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.529 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.529 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.529 DEBUG:boto:Params: {} 2023-12-15T22:54:31.529 DEBUG:boto:Token: None 2023-12-15T22:54:31.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj?versionId=null 2023-12-15T22:54:31.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8= 2023-12-15T22:54:31.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wGefZW2JRTyX87sPyd//8G1uHd8=', 'Content-Length': '0'} 2023-12-15T22:54:31.532 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f2613921d071874-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.532 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.532 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.532 DEBUG:boto:path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.532 DEBUG:boto:auth_path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.532 DEBUG:boto:Method: GET 2023-12-15T22:54:31.532 DEBUG:boto:Path: /kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.532 DEBUG:boto:Data: 2023-12-15T22:54:31.533 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.533 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.533 DEBUG:boto:Params: {} 2023-12-15T22:54:31.533 DEBUG:boto:Token: None 2023-12-15T22:54:31.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000507f6d6b79d4fcbd-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.536 DEBUG:boto:b'kskgfn-8myobj1000falsemyobj2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.536 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.536 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.536 DEBUG:boto:path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.536 DEBUG:boto:auth_path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.536 DEBUG:boto:Method: GET 2023-12-15T22:54:31.536 DEBUG:boto:Path: /kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.536 DEBUG:boto:Data: 2023-12-15T22:54:31.536 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.536 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.537 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.537 DEBUG:boto:Params: {} 2023-12-15T22:54:31.537 DEBUG:boto:Token: None 2023-12-15T22:54:31.537 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009516d0fbc58bc150-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.540 DEBUG:boto:b'kskgfn-8myobj1000falsemyobj2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.540 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.540 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.540 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.540 DEBUG:boto:Path: /kskgfn-8/myobj 2023-12-15T22:54:31.541 DEBUG:boto:Data: 2023-12-15T22:54:31.541 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.541 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.541 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.541 DEBUG:boto:Params: {} 2023-12-15T22:54:31.541 DEBUG:boto:Token: None 2023-12-15T22:54:31.541 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj 2023-12-15T22:54:31.541 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FoGZkOTJB5Z7I+Yvo4l8Ow0AinE= 2023-12-15T22:54:31.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FoGZkOTJB5Z7I+Yvo4l8Ow0AinE=', 'Content-Length': '0'} 2023-12-15T22:54:31.543 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000712131fd302ea66a-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.543 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.543 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.544 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.544 DEBUG:boto:Path: /kskgfn-8/myobj 2023-12-15T22:54:31.544 DEBUG:boto:Data: 2023-12-15T22:54:31.544 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.544 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.544 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.544 DEBUG:boto:Params: {} 2023-12-15T22:54:31.544 DEBUG:boto:Token: None 2023-12-15T22:54:31.544 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj 2023-12-15T22:54:31.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FoGZkOTJB5Z7I+Yvo4l8Ow0AinE= 2023-12-15T22:54:31.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FoGZkOTJB5Z7I+Yvo4l8Ow0AinE=', 'Content-Length': '0'} 2023-12-15T22:54:31.546 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006cc392d504ad2860-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:31.547 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.547 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.547 DEBUG:boto:Method: GET 2023-12-15T22:54:31.547 DEBUG:boto:Path: /kskgfn-8/myobj 2023-12-15T22:54:31.547 DEBUG:boto:Data: 2023-12-15T22:54:31.547 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.547 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.547 DEBUG:boto:Params: {} 2023-12-15T22:54:31.547 DEBUG:boto:Token: None 2023-12-15T22:54:31.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj 2023-12-15T22:54:31.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zvlbVVNZ10MYT6wU5/ZIK/0Jjgs= 2023-12-15T22:54:31.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zvlbVVNZ10MYT6wU5/ZIK/0Jjgs=', 'Content-Length': '0'} 2023-12-15T22:54:31.550 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000de7cde5b35e48da7-00657cd927-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.550 DEBUG:boto:path=/kskgfn-8/myobj 2023-12-15T22:54:31.550 DEBUG:boto:auth_path=/kskgfn-8/myobj 2023-12-15T22:54:31.550 DEBUG:boto:Method: GET 2023-12-15T22:54:31.550 DEBUG:boto:Path: /kskgfn-8/myobj 2023-12-15T22:54:31.550 DEBUG:boto:Data: 2023-12-15T22:54:31.550 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.550 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.550 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.551 DEBUG:boto:Params: {} 2023-12-15T22:54:31.551 DEBUG:boto:Token: None 2023-12-15T22:54:31.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/myobj 2023-12-15T22:54:31.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zvlbVVNZ10MYT6wU5/ZIK/0Jjgs= 2023-12-15T22:54:31.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zvlbVVNZ10MYT6wU5/ZIK/0Jjgs=', 'Content-Length': '0'} 2023-12-15T22:54:31.553 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004f8b8802e4f0320e-00657cd927-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.593 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.594 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.594 DEBUG:boto:path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.594 DEBUG:boto:auth_path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.594 DEBUG:boto:Method: GET 2023-12-15T22:54:31.594 DEBUG:boto:Path: /kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.594 DEBUG:boto:Data: 2023-12-15T22:54:31.594 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.594 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.594 DEBUG:boto:Params: {} 2023-12-15T22:54:31.594 DEBUG:boto:Token: None 2023-12-15T22:54:31.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040fee866ba9cea64-00657cd927-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.597 DEBUG:boto:b'kskgfn-8myobj1000falsemyobj2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.597 DEBUG:boto:path=/kskgfn-8/ 2023-12-15T22:54:31.597 DEBUG:boto:auth_path=/kskgfn-8/ 2023-12-15T22:54:31.597 DEBUG:boto:path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.598 DEBUG:boto:auth_path=/kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.598 DEBUG:boto:Method: GET 2023-12-15T22:54:31.598 DEBUG:boto:Path: /kskgfn-8/?prefix=myobj 2023-12-15T22:54:31.598 DEBUG:boto:Data: 2023-12-15T22:54:31.598 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.598 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.598 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.598 DEBUG:boto:Params: {} 2023-12-15T22:54:31.598 DEBUG:boto:Token: None 2023-12-15T22:54:31.598 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-8/ 2023-12-15T22:54:31.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8= 2023-12-15T22:54:31.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zG0dXg1iTnlNMgBU1eXQs9134k8=', 'Content-Length': '0'} 2023-12-15T22:54:31.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e701dfbcbc2585e-00657cd927-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.601 DEBUG:boto:b'kskgfn-8myobj1000falsemyobj2023-12-15T22:54:19.781Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:31.602 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-8 zones={test-zone1, test-zone2} 2023-12-15T22:54:31.602 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2023-12-15T22:54:31.603 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-9 2023-12-15T22:54:31.603 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:31.603 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:31.603 DEBUG:boto:Method: PUT 2023-12-15T22:54:31.603 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:54:31.603 DEBUG:boto:Data: 2023-12-15T22:54:31.603 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.603 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.603 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.603 DEBUG:boto:Params: {} 2023-12-15T22:54:31.604 DEBUG:boto:Token: None 2023-12-15T22:54:31.604 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-9/ 2023-12-15T22:54:31.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ky8yyD0ngRD8QEIXwtMyU7R54WI= 2023-12-15T22:54:31.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ky8yyD0ngRD8QEIXwtMyU7R54WI=', 'Content-Length': '0'} 2023-12-15T22:54:31.621 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005b234a06e7165f1a-00657cd927-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.622 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-10 2023-12-15T22:54:31.622 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:31.622 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:31.622 DEBUG:boto:Method: PUT 2023-12-15T22:54:31.622 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:54:31.622 DEBUG:boto:Data: 2023-12-15T22:54:31.622 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.622 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.622 DEBUG:boto:Params: {} 2023-12-15T22:54:31.622 DEBUG:boto:Token: None 2023-12-15T22:54:31.623 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-10/ 2023-12-15T22:54:31.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ad7Vyym4NSqrF8DwzRBzbXb7rW0= 2023-12-15T22:54:31.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ad7Vyym4NSqrF8DwzRBzbXb7rW0=', 'Content-Length': '0'} 2023-12-15T22:54:31.656 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000597212013a315b47-00657cd927-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.656 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:31.656 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:31.656 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.656 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:54:31.656 DEBUG:boto:Data: 2023-12-15T22:54:31.656 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.656 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.656 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.656 DEBUG:boto:Params: {} 2023-12-15T22:54:31.657 DEBUG:boto:Token: None 2023-12-15T22:54:31.657 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-9/ 2023-12-15T22:54:31.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jz6sJY1SrttaVHwCLSu70+FLwpY= 2023-12-15T22:54:31.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jz6sJY1SrttaVHwCLSu70+FLwpY=', 'Content-Length': '0'} 2023-12-15T22:54:31.659 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000acdb383b2527308c-00657cd927-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.659 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:31.659 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:31.659 DEBUG:boto:Method: PUT 2023-12-15T22:54:31.659 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:31.659 DEBUG:boto:Data: 2023-12-15T22:54:31.659 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:31.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:31.660 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.660 DEBUG:boto:Params: {} 2023-12-15T22:54:31.660 DEBUG:boto:Token: None 2023-12-15T22:54:31.660 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-9/myobj 2023-12-15T22:54:31.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UzHhN0jAo5pVZyxqGHQpSoF5HS8= 2023-12-15T22:54:31.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UzHhN0jAo5pVZyxqGHQpSoF5HS8='} 2023-12-15T22:54:31.702 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000077bfdc6acb423b01-00657cd927-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.702 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:31.702 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:31.702 DEBUG:boto:Method: HEAD 2023-12-15T22:54:31.702 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:54:31.702 DEBUG:boto:Data: 2023-12-15T22:54:31.702 DEBUG:boto:Headers: {} 2023-12-15T22:54:31.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.702 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.702 DEBUG:boto:Params: {} 2023-12-15T22:54:31.703 DEBUG:boto:Token: None 2023-12-15T22:54:31.703 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-10/ 2023-12-15T22:54:31.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L3dwYb0XYJDZfDq1MNhXBKHQz/A= 2023-12-15T22:54:31.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L3dwYb0XYJDZfDq1MNhXBKHQz/A=', 'Content-Length': '0'} 2023-12-15T22:54:31.705 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c29aaa556605fa7-00657cd927-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.706 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:31.706 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:31.706 DEBUG:boto:Method: PUT 2023-12-15T22:54:31.706 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:54:31.706 DEBUG:boto:Data: 2023-12-15T22:54:31.706 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T22:54:31.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:31.706 DEBUG:boto:Port: 8000 2023-12-15T22:54:31.706 DEBUG:boto:Params: {} 2023-12-15T22:54:31.706 DEBUG:boto:Token: None 2023-12-15T22:54:31.707 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 22:54:31 GMT /kskgfn-10/myobj 2023-12-15T22:54:31.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0f35LLyXG8tb+gktx4a9CbUfW5g= 2023-12-15T22:54:31.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:54:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0f35LLyXG8tb+gktx4a9CbUfW5g='} 2023-12-15T22:54:31.726 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a5d39c92b84cf121-00657cd927-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:31.726 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:31.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:31.726 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:31.775 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:31.775 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:31.805 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:54:31.821 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680871.641055_37.1","last_update":"2023-12-15T22:54:31.641055Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:54:31.821 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680871.641055_37.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:54:31.821 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:54:31.821 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:31.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:31.821 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:31.874 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:31.874 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:31.915 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:31.916+0000 7f32c9520800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:31.917 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:31.917+0000 7f32c9520800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:31.935 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.610347_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.610347Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:31Z"} 2023-12-15T22:54:31.935 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680837.286670_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:53:57.286670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.610347_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.610347Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:31Z"} 2023-12-15T22:54:31.935 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680837.286670_27.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:53:57.286670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.610347_83.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.610347Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:31.936 DEBUG:rgw_multi.tests:log_status={0: '1_1702680871.641055_37.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:54:31.936 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680837.286670_27.1', 1: '1_1702680871.610347_83.1', 2: '', 3: ''} 2023-12-15T22:54:31.936 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702680871.641055_37.1 target=1_1702680837.286670_27.1, shard=1 master=1_1702680871.620243_86.1 target=1_1702680871.610347_83.1 2023-12-15T22:54:36.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:36.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:54:36.937 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:54:36.991 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:36.991 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:37.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:37.022+0000 7fbbd9b11800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:37.023 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:37.023+0000 7fbbd9b11800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:54:37.038 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680871.641055_37.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:54:31.641055Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:37Z"} 2023-12-15T22:54:37.038 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680871.641055_37.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:54:31.641055Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:54:37Z"} 2023-12-15T22:54:37.039 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680871.641055_37.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.641055Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:54:37.039 DEBUG:rgw_multi.tests:log_status={0: '1_1702680871.641055_37.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:54:37.039 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680871.641055_37.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:54:37.039 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:54:37.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.039 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:54:37.093 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:37.093 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:37.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:37.129+0000 7f1a6d921800 1 bucket sync caught up with source: 2023-12-15T22:54:37.129 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:37.129 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:37.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:37.129+0000 7f1a6d921800 0 bucket checkpoint complete 2023-12-15T22:54:37.142 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-9 zones={test-zone2, test-zone1} 2023-12-15T22:54:37.142 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.142 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.143 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.143 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:54:37.143 DEBUG:boto:Data: 2023-12-15T22:54:37.143 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.143 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.143 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.143 DEBUG:boto:Params: {} 2023-12-15T22:54:37.143 DEBUG:boto:Token: None 2023-12-15T22:54:37.143 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0= 2023-12-15T22:54:37.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0=', 'Content-Length': '0'} 2023-12-15T22:54:37.146 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d12fb88ee33fed65-00657cd92d-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.146 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.146 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.146 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.146 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:54:37.146 DEBUG:boto:Data: 2023-12-15T22:54:37.146 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.146 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.147 DEBUG:boto:Params: {} 2023-12-15T22:54:37.147 DEBUG:boto:Token: None 2023-12-15T22:54:37.147 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0= 2023-12-15T22:54:37.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0=', 'Content-Length': '0'} 2023-12-15T22:54:37.149 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e36d006404b90452-00657cd92d-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.149 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:54:37.149 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.149 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.150 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.150 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.150 DEBUG:boto:Method: GET 2023-12-15T22:54:37.150 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.150 DEBUG:boto:Data: 2023-12-15T22:54:37.150 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.150 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.150 DEBUG:boto:Params: {} 2023-12-15T22:54:37.150 DEBUG:boto:Token: None 2023-12-15T22:54:37.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/?versions 2023-12-15T22:54:37.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw= 2023-12-15T22:54:37.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw=', 'Content-Length': '0'} 2023-12-15T22:54:37.153 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc311648049b1da1-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.153 DEBUG:boto:b'kskgfn-9999falsemyobjnulltrue2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.154 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:37.154 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:54:37.154 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.154 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.154 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.154 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.154 DEBUG:boto:Method: GET 2023-12-15T22:54:37.154 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.155 DEBUG:boto:Data: 2023-12-15T22:54:37.155 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.155 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.155 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.155 DEBUG:boto:Params: {} 2023-12-15T22:54:37.155 DEBUG:boto:Token: None 2023-12-15T22:54:37.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/?versions 2023-12-15T22:54:37.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw= 2023-12-15T22:54:37.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw=', 'Content-Length': '0'} 2023-12-15T22:54:37.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fa2e8c50234bbb1-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.158 DEBUG:boto:b'kskgfn-9999falsemyobjnulltrue2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.158 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:37.158 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.158 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.158 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.158 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.158 DEBUG:boto:Method: GET 2023-12-15T22:54:37.158 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.159 DEBUG:boto:Data: 2023-12-15T22:54:37.159 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.159 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.159 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.159 DEBUG:boto:Params: {} 2023-12-15T22:54:37.159 DEBUG:boto:Token: None 2023-12-15T22:54:37.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/?versions 2023-12-15T22:54:37.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw= 2023-12-15T22:54:37.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw=', 'Content-Length': '0'} 2023-12-15T22:54:37.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2af0da97a9b1817-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.161 DEBUG:boto:b'kskgfn-9999falsemyobjnulltrue2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.162 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.162 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.162 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.162 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.162 DEBUG:boto:Method: GET 2023-12-15T22:54:37.162 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:54:37.162 DEBUG:boto:Data: 2023-12-15T22:54:37.162 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.162 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.163 DEBUG:boto:Params: {} 2023-12-15T22:54:37.163 DEBUG:boto:Token: None 2023-12-15T22:54:37.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/?versions 2023-12-15T22:54:37.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw= 2023-12-15T22:54:37.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPIFAOhfSRs28nebVs2LGDYpasw=', 'Content-Length': '0'} 2023-12-15T22:54:37.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a57f217be4e49724-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.165 DEBUG:boto:b'kskgfn-9999falsemyobjnulltrue2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.166 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.166 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.166 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.166 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.166 DEBUG:boto:Method: GET 2023-12-15T22:54:37.166 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.166 DEBUG:boto:Data: 2023-12-15T22:54:37.166 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.166 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.166 DEBUG:boto:Params: {} 2023-12-15T22:54:37.167 DEBUG:boto:Token: None 2023-12-15T22:54:37.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg= 2023-12-15T22:54:37.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg=', 'Content-Length': '0'} 2023-12-15T22:54:37.169 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009c03f2761e392554-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.210 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.210 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.210 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.210 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.210 DEBUG:boto:Method: GET 2023-12-15T22:54:37.210 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.210 DEBUG:boto:Data: 2023-12-15T22:54:37.210 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.210 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.210 DEBUG:boto:Params: {} 2023-12-15T22:54:37.211 DEBUG:boto:Token: None 2023-12-15T22:54:37.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg= 2023-12-15T22:54:37.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg=', 'Content-Length': '0'} 2023-12-15T22:54:37.213 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000c59bf8c7ef6926e-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.213 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.213 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.213 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.213 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.214 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.214 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.214 DEBUG:boto:Data: 2023-12-15T22:54:37.214 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.214 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.214 DEBUG:boto:Params: {} 2023-12-15T22:54:37.214 DEBUG:boto:Token: None 2023-12-15T22:54:37.214 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9ewOk+XfNWhhoEA67cL5jCN+SaE= 2023-12-15T22:54:37.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9ewOk+XfNWhhoEA67cL5jCN+SaE=', 'Content-Length': '0'} 2023-12-15T22:54:37.216 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000084863062798eb773-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.217 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.217 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.217 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.217 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.217 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.217 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.217 DEBUG:boto:Data: 2023-12-15T22:54:37.217 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.217 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.217 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.217 DEBUG:boto:Params: {} 2023-12-15T22:54:37.217 DEBUG:boto:Token: None 2023-12-15T22:54:37.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9ewOk+XfNWhhoEA67cL5jCN+SaE= 2023-12-15T22:54:37.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9ewOk+XfNWhhoEA67cL5jCN+SaE=', 'Content-Length': '0'} 2023-12-15T22:54:37.220 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000081d5a81f5cccc6ad-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.220 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.220 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.221 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.221 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.221 DEBUG:boto:Method: GET 2023-12-15T22:54:37.221 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.221 DEBUG:boto:Data: 2023-12-15T22:54:37.221 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.221 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.221 DEBUG:boto:Params: {} 2023-12-15T22:54:37.221 DEBUG:boto:Token: None 2023-12-15T22:54:37.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg= 2023-12-15T22:54:37.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg=', 'Content-Length': '0'} 2023-12-15T22:54:37.223 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3946596b8e51c93-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.224 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.224 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.224 DEBUG:boto:path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.224 DEBUG:boto:auth_path=/kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.224 DEBUG:boto:Method: GET 2023-12-15T22:54:37.224 DEBUG:boto:Path: /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.224 DEBUG:boto:Data: 2023-12-15T22:54:37.224 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.224 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.224 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.224 DEBUG:boto:Params: {} 2023-12-15T22:54:37.225 DEBUG:boto:Token: None 2023-12-15T22:54:37.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj?versionId=null 2023-12-15T22:54:37.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg= 2023-12-15T22:54:37.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oMMAtJPfa5peFwruJ7HZrYr8DGg=', 'Content-Length': '0'} 2023-12-15T22:54:37.227 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007f40cadaf08bc75-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.227 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.227 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.227 DEBUG:boto:path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.227 DEBUG:boto:auth_path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.227 DEBUG:boto:Method: GET 2023-12-15T22:54:37.227 DEBUG:boto:Path: /kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.228 DEBUG:boto:Data: 2023-12-15T22:54:37.228 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.228 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.228 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.228 DEBUG:boto:Params: {} 2023-12-15T22:54:37.228 DEBUG:boto:Token: None 2023-12-15T22:54:37.228 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8= 2023-12-15T22:54:37.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8=', 'Content-Length': '0'} 2023-12-15T22:54:37.230 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae69ebec1e5ab64f-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.231 DEBUG:boto:b'kskgfn-9myobj1000falsemyobj2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.231 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.231 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.231 DEBUG:boto:path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.231 DEBUG:boto:auth_path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.231 DEBUG:boto:Method: GET 2023-12-15T22:54:37.231 DEBUG:boto:Path: /kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.231 DEBUG:boto:Data: 2023-12-15T22:54:37.231 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.232 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.232 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.232 DEBUG:boto:Params: {} 2023-12-15T22:54:37.232 DEBUG:boto:Token: None 2023-12-15T22:54:37.232 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8= 2023-12-15T22:54:37.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8=', 'Content-Length': '0'} 2023-12-15T22:54:37.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d9a6dfc54edc991-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.238 DEBUG:boto:b'kskgfn-9myobj1000falsemyobj2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.238 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.238 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.238 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.238 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.238 DEBUG:boto:Data: 2023-12-15T22:54:37.238 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.238 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.239 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.239 DEBUG:boto:Params: {} 2023-12-15T22:54:37.239 DEBUG:boto:Token: None 2023-12-15T22:54:37.239 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8= 2023-12-15T22:54:37.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8=', 'Content-Length': '0'} 2023-12-15T22:54:37.241 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aba91d06a8bf74a5-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.241 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.241 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.241 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.241 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.241 DEBUG:boto:Data: 2023-12-15T22:54:37.241 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.242 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.242 DEBUG:boto:Params: {} 2023-12-15T22:54:37.242 DEBUG:boto:Token: None 2023-12-15T22:54:37.242 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8= 2023-12-15T22:54:37.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8=', 'Content-Length': '0'} 2023-12-15T22:54:37.244 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000024fe3e38cb558f12-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.244 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.244 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.244 DEBUG:boto:Method: GET 2023-12-15T22:54:37.245 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.245 DEBUG:boto:Data: 2023-12-15T22:54:37.245 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.245 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.245 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.245 DEBUG:boto:Params: {} 2023-12-15T22:54:37.245 DEBUG:boto:Token: None 2023-12-15T22:54:37.245 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.245 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:36H41EHsKhO/sZea9fhECGH3uKQ= 2023-12-15T22:54:37.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:36H41EHsKhO/sZea9fhECGH3uKQ=', 'Content-Length': '0'} 2023-12-15T22:54:37.247 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000514b0324624bf008-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.290 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.290 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.290 DEBUG:boto:Method: GET 2023-12-15T22:54:37.290 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.290 DEBUG:boto:Data: 2023-12-15T22:54:37.290 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.290 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.290 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.290 DEBUG:boto:Params: {} 2023-12-15T22:54:37.290 DEBUG:boto:Token: None 2023-12-15T22:54:37.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:36H41EHsKhO/sZea9fhECGH3uKQ= 2023-12-15T22:54:37.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:36H41EHsKhO/sZea9fhECGH3uKQ=', 'Content-Length': '0'} 2023-12-15T22:54:37.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008e0a09df31f654b2-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.293 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.293 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.293 DEBUG:boto:path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.294 DEBUG:boto:auth_path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.294 DEBUG:boto:Method: GET 2023-12-15T22:54:37.294 DEBUG:boto:Path: /kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.294 DEBUG:boto:Data: 2023-12-15T22:54:37.294 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.294 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.294 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.294 DEBUG:boto:Params: {} 2023-12-15T22:54:37.294 DEBUG:boto:Token: None 2023-12-15T22:54:37.294 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.294 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8= 2023-12-15T22:54:37.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8=', 'Content-Length': '0'} 2023-12-15T22:54:37.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043cdab17580185ca-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.337 DEBUG:boto:b'kskgfn-9myobj1000falsemyobj2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.338 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.338 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.338 DEBUG:boto:path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.338 DEBUG:boto:auth_path=/kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.338 DEBUG:boto:Method: GET 2023-12-15T22:54:37.338 DEBUG:boto:Path: /kskgfn-9/?prefix=myobj 2023-12-15T22:54:37.338 DEBUG:boto:Data: 2023-12-15T22:54:37.338 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.339 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.339 DEBUG:boto:Params: {} 2023-12-15T22:54:37.339 DEBUG:boto:Token: None 2023-12-15T22:54:37.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8= 2023-12-15T22:54:37.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BnQDU1BRZi16k84SY5mrq0+fmb8=', 'Content-Length': '0'} 2023-12-15T22:54:37.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e74276665bd02ad4-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.342 DEBUG:boto:b'kskgfn-9myobj1000falsemyobj2023-12-15T22:54:31.663Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.342 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-9 zones={test-zone2, test-zone1} 2023-12-15T22:54:37.342 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.342 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:54:37.402 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:37.403 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:37.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:54:37.444+0000 7fdf4fc10800 1 bucket sync caught up with source: 2023-12-15T22:54:37.444 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.2.6, , , , , , , , , ] 2023-12-15T22:54:37.444 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.2.6, , , , , , , , , ] 2023-12-15T22:54:37.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:54:37.444+0000 7fdf4fc10800 0 bucket checkpoint complete 2023-12-15T22:54:37.458 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-10 zones={test-zone1, test-zone2} 2023-12-15T22:54:37.458 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.458 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.458 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.458 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:54:37.458 DEBUG:boto:Data: 2023-12-15T22:54:37.458 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.458 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.459 DEBUG:boto:Params: {} 2023-12-15T22:54:37.459 DEBUG:boto:Token: None 2023-12-15T22:54:37.459 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:txbWl+z79E0q0eHBdaYut1JRJS0= 2023-12-15T22:54:37.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:txbWl+z79E0q0eHBdaYut1JRJS0=', 'Content-Length': '0'} 2023-12-15T22:54:37.461 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ab82fcc01b360c9d-00657cd92d-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.461 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.461 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.461 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.462 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:54:37.462 DEBUG:boto:Data: 2023-12-15T22:54:37.462 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.462 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.462 DEBUG:boto:Params: {} 2023-12-15T22:54:37.462 DEBUG:boto:Token: None 2023-12-15T22:54:37.462 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:txbWl+z79E0q0eHBdaYut1JRJS0= 2023-12-15T22:54:37.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:txbWl+z79E0q0eHBdaYut1JRJS0=', 'Content-Length': '0'} 2023-12-15T22:54:37.464 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005863182542018c99-00657cd92d-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.464 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:54:37.464 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.464 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.465 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.465 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.465 DEBUG:boto:Method: GET 2023-12-15T22:54:37.465 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.465 DEBUG:boto:Data: 2023-12-15T22:54:37.465 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.465 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.465 DEBUG:boto:Params: {} 2023-12-15T22:54:37.465 DEBUG:boto:Token: None 2023-12-15T22:54:37.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/?versions 2023-12-15T22:54:37.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g= 2023-12-15T22:54:37.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g=', 'Content-Length': '0'} 2023-12-15T22:54:37.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000bd1267971259964-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.468 DEBUG:boto:b'kskgfn-10999falsemyobjnulltrue2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.468 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:37.468 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:54:37.468 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.468 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.468 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.468 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.469 DEBUG:boto:Method: GET 2023-12-15T22:54:37.469 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.469 DEBUG:boto:Data: 2023-12-15T22:54:37.469 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.469 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.469 DEBUG:boto:Params: {} 2023-12-15T22:54:37.469 DEBUG:boto:Token: None 2023-12-15T22:54:37.469 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/?versions 2023-12-15T22:54:37.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g= 2023-12-15T22:54:37.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g=', 'Content-Length': '0'} 2023-12-15T22:54:37.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047a0e3cd891551f8-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.472 DEBUG:boto:b'kskgfn-10999falsemyobjnulltrue2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.472 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2023-12-15T22:54:37.472 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.472 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.472 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.472 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.473 DEBUG:boto:Method: GET 2023-12-15T22:54:37.473 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.473 DEBUG:boto:Data: 2023-12-15T22:54:37.473 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.473 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.473 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.473 DEBUG:boto:Params: {} 2023-12-15T22:54:37.473 DEBUG:boto:Token: None 2023-12-15T22:54:37.473 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/?versions 2023-12-15T22:54:37.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g= 2023-12-15T22:54:37.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g=', 'Content-Length': '0'} 2023-12-15T22:54:37.475 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c384cc1c78d8eec7-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.476 DEBUG:boto:b'kskgfn-10999falsemyobjnulltrue2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.476 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.476 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.476 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.476 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.476 DEBUG:boto:Method: GET 2023-12-15T22:54:37.476 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:54:37.476 DEBUG:boto:Data: 2023-12-15T22:54:37.477 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.477 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.477 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.477 DEBUG:boto:Params: {} 2023-12-15T22:54:37.477 DEBUG:boto:Token: None 2023-12-15T22:54:37.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/?versions 2023-12-15T22:54:37.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g= 2023-12-15T22:54:37.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9EwQPNfOSQ3lmp+w9OLdShsyE1g=', 'Content-Length': '0'} 2023-12-15T22:54:37.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003a3699cac47e21e-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.479 DEBUG:boto:b'kskgfn-10999falsemyobjnulltrue2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.480 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.480 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.480 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.480 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.480 DEBUG:boto:Method: GET 2023-12-15T22:54:37.480 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.480 DEBUG:boto:Data: 2023-12-15T22:54:37.480 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.481 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.481 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.481 DEBUG:boto:Params: {} 2023-12-15T22:54:37.481 DEBUG:boto:Token: None 2023-12-15T22:54:37.481 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.481 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4= 2023-12-15T22:54:37.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4=', 'Content-Length': '0'} 2023-12-15T22:54:37.483 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d970da559a60257-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.483 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.483 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.483 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.483 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.483 DEBUG:boto:Method: GET 2023-12-15T22:54:37.483 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.483 DEBUG:boto:Data: 2023-12-15T22:54:37.483 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.483 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.484 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.484 DEBUG:boto:Params: {} 2023-12-15T22:54:37.484 DEBUG:boto:Token: None 2023-12-15T22:54:37.484 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.484 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4= 2023-12-15T22:54:37.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4=', 'Content-Length': '0'} 2023-12-15T22:54:37.486 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000adcc102da946b51c-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.486 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.486 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.486 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.486 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.486 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.486 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.486 DEBUG:boto:Data: 2023-12-15T22:54:37.486 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.487 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.487 DEBUG:boto:Params: {} 2023-12-15T22:54:37.487 DEBUG:boto:Token: None 2023-12-15T22:54:37.487 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3JK2sDnojrvnB9R598dppJl/X/o= 2023-12-15T22:54:37.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3JK2sDnojrvnB9R598dppJl/X/o=', 'Content-Length': '0'} 2023-12-15T22:54:37.489 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b131e33b3fb5e4a5-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.489 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.489 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.489 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.489 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.489 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.489 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.489 DEBUG:boto:Data: 2023-12-15T22:54:37.490 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.490 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.490 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.490 DEBUG:boto:Params: {} 2023-12-15T22:54:37.490 DEBUG:boto:Token: None 2023-12-15T22:54:37.490 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3JK2sDnojrvnB9R598dppJl/X/o= 2023-12-15T22:54:37.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3JK2sDnojrvnB9R598dppJl/X/o=', 'Content-Length': '0'} 2023-12-15T22:54:37.492 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000952fcf4296e3554a-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.492 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.492 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.492 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.492 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.492 DEBUG:boto:Method: GET 2023-12-15T22:54:37.492 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.492 DEBUG:boto:Data: 2023-12-15T22:54:37.492 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.493 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.493 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.493 DEBUG:boto:Params: {} 2023-12-15T22:54:37.493 DEBUG:boto:Token: None 2023-12-15T22:54:37.493 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4= 2023-12-15T22:54:37.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4=', 'Content-Length': '0'} 2023-12-15T22:54:37.495 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fbb012725a59c0e6-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.495 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.495 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.495 DEBUG:boto:path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.495 DEBUG:boto:auth_path=/kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.495 DEBUG:boto:Method: GET 2023-12-15T22:54:37.495 DEBUG:boto:Path: /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.495 DEBUG:boto:Data: 2023-12-15T22:54:37.496 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.496 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.496 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.496 DEBUG:boto:Params: {} 2023-12-15T22:54:37.496 DEBUG:boto:Token: None 2023-12-15T22:54:37.496 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj?versionId=null 2023-12-15T22:54:37.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4= 2023-12-15T22:54:37.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cJdmWPabRl5f4xO5upDqyewsx4=', 'Content-Length': '0'} 2023-12-15T22:54:37.498 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a24f66fc0ca96c85-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.498 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.498 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.498 DEBUG:boto:path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.498 DEBUG:boto:auth_path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.498 DEBUG:boto:Method: GET 2023-12-15T22:54:37.498 DEBUG:boto:Path: /kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.498 DEBUG:boto:Data: 2023-12-15T22:54:37.499 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.499 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.499 DEBUG:boto:Params: {} 2023-12-15T22:54:37.499 DEBUG:boto:Token: None 2023-12-15T22:54:37.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I= 2023-12-15T22:54:37.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I=', 'Content-Length': '0'} 2023-12-15T22:54:37.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057655ec2a2cc8d9c-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.501 DEBUG:boto:b'kskgfn-10myobj1000falsemyobj2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.502 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.502 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.502 DEBUG:boto:path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.502 DEBUG:boto:auth_path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.502 DEBUG:boto:Method: GET 2023-12-15T22:54:37.502 DEBUG:boto:Path: /kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.502 DEBUG:boto:Data: 2023-12-15T22:54:37.502 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.502 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.503 DEBUG:boto:Params: {} 2023-12-15T22:54:37.503 DEBUG:boto:Token: None 2023-12-15T22:54:37.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I= 2023-12-15T22:54:37.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I=', 'Content-Length': '0'} 2023-12-15T22:54:37.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068e6dad3f4b77120-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.505 DEBUG:boto:b'kskgfn-10myobj1000falsemyobj2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.506 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.506 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.506 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.506 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:54:37.506 DEBUG:boto:Data: 2023-12-15T22:54:37.506 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.506 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.506 DEBUG:boto:Params: {} 2023-12-15T22:54:37.506 DEBUG:boto:Token: None 2023-12-15T22:54:37.507 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj 2023-12-15T22:54:37.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cEuQYjuYFDw7iHQ7vSHuZ4mn6vk= 2023-12-15T22:54:37.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cEuQYjuYFDw7iHQ7vSHuZ4mn6vk=', 'Content-Length': '0'} 2023-12-15T22:54:37.508 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000059380caaf8b08c8a-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.509 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.509 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.509 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.509 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:54:37.509 DEBUG:boto:Data: 2023-12-15T22:54:37.509 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.509 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.509 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.509 DEBUG:boto:Params: {} 2023-12-15T22:54:37.509 DEBUG:boto:Token: None 2023-12-15T22:54:37.510 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj 2023-12-15T22:54:37.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cEuQYjuYFDw7iHQ7vSHuZ4mn6vk= 2023-12-15T22:54:37.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cEuQYjuYFDw7iHQ7vSHuZ4mn6vk=', 'Content-Length': '0'} 2023-12-15T22:54:37.511 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005af0a51dee0f788c-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2023-12-15T22:54:37.512 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.512 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.512 DEBUG:boto:Method: GET 2023-12-15T22:54:37.512 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:54:37.512 DEBUG:boto:Data: 2023-12-15T22:54:37.512 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.512 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.512 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.512 DEBUG:boto:Params: {} 2023-12-15T22:54:37.512 DEBUG:boto:Token: None 2023-12-15T22:54:37.512 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj 2023-12-15T22:54:37.512 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KVC564lievwm6zayooNKlmDJbBA= 2023-12-15T22:54:37.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KVC564lievwm6zayooNKlmDJbBA=', 'Content-Length': '0'} 2023-12-15T22:54:37.514 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000098ba00a6541bcbd4-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.557 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:54:37.558 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:54:37.558 DEBUG:boto:Method: GET 2023-12-15T22:54:37.558 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:54:37.558 DEBUG:boto:Data: 2023-12-15T22:54:37.558 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.558 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.558 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.558 DEBUG:boto:Params: {} 2023-12-15T22:54:37.558 DEBUG:boto:Token: None 2023-12-15T22:54:37.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/myobj 2023-12-15T22:54:37.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KVC564lievwm6zayooNKlmDJbBA= 2023-12-15T22:54:37.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KVC564lievwm6zayooNKlmDJbBA=', 'Content-Length': '0'} 2023-12-15T22:54:37.560 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a34a84fed59b61bf-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.561 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.561 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.561 DEBUG:boto:path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.561 DEBUG:boto:auth_path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.561 DEBUG:boto:Method: GET 2023-12-15T22:54:37.561 DEBUG:boto:Path: /kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.561 DEBUG:boto:Data: 2023-12-15T22:54:37.561 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.561 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.561 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.561 DEBUG:boto:Params: {} 2023-12-15T22:54:37.561 DEBUG:boto:Token: None 2023-12-15T22:54:37.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I= 2023-12-15T22:54:37.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I=', 'Content-Length': '0'} 2023-12-15T22:54:37.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a50d9efaae4cda66-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.564 DEBUG:boto:b'kskgfn-10myobj1000falsemyobj2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.564 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:54:37.564 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:54:37.564 DEBUG:boto:path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.564 DEBUG:boto:auth_path=/kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.564 DEBUG:boto:Method: GET 2023-12-15T22:54:37.565 DEBUG:boto:Path: /kskgfn-10/?prefix=myobj 2023-12-15T22:54:37.565 DEBUG:boto:Data: 2023-12-15T22:54:37.565 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.565 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:54:37.565 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.565 DEBUG:boto:Params: {} 2023-12-15T22:54:37.565 DEBUG:boto:Token: None 2023-12-15T22:54:37.565 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-10/ 2023-12-15T22:54:37.565 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I= 2023-12-15T22:54:37.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i1n/2PiDY95e9Brnoe8NrjGE46I=', 'Content-Length': '0'} 2023-12-15T22:54:37.567 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c2a0d77e90e144a-00657cd92d-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.568 DEBUG:boto:b'kskgfn-10myobj1000falsemyobj2023-12-15T22:54:31.710Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:54:37.568 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-10 zones={test-zone1, test-zone2} 2023-12-15T22:54:37.568 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:54:37.568 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:54:37.568 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.568 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:54:37.568 DEBUG:boto:Data: 2023-12-15T22:54:37.568 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.569 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.569 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.569 DEBUG:boto:Params: {} 2023-12-15T22:54:37.569 DEBUG:boto:Token: None 2023-12-15T22:54:37.569 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/ 2023-12-15T22:54:37.569 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0= 2023-12-15T22:54:37.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sAOZt+ajn6YbmK5g260H1xsYfL0=', 'Content-Length': '0'} 2023-12-15T22:54:37.571 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007a6b9a07f2ee6420-00657cd92d-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.571 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.572 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.572 DEBUG:boto:Method: HEAD 2023-12-15T22:54:37.572 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.572 DEBUG:boto:Data: 2023-12-15T22:54:37.572 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.572 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.572 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.572 DEBUG:boto:Params: {} 2023-12-15T22:54:37.572 DEBUG:boto:Token: None 2023-12-15T22:54:37.572 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8= 2023-12-15T22:54:37.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bV3aJu8W4FgyBjfIBhq7DGMbWy8=', 'Content-Length': '0'} 2023-12-15T22:54:37.574 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000004d7768ca7f270ba-00657cd92d-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.575 DEBUG:boto:path=/kskgfn-9/myobj 2023-12-15T22:54:37.575 DEBUG:boto:auth_path=/kskgfn-9/myobj 2023-12-15T22:54:37.575 DEBUG:boto:Method: DELETE 2023-12-15T22:54:37.575 DEBUG:boto:Path: /kskgfn-9/myobj 2023-12-15T22:54:37.575 DEBUG:boto:Data: 2023-12-15T22:54:37.575 DEBUG:boto:Headers: {} 2023-12-15T22:54:37.575 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:54:37.575 DEBUG:boto:Port: 8000 2023-12-15T22:54:37.575 DEBUG:boto:Params: {} 2023-12-15T22:54:37.576 DEBUG:boto:Token: None 2023-12-15T22:54:37.576 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:54:37 GMT /kskgfn-9/myobj 2023-12-15T22:54:37.576 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7JVOEpbmfwjfw+dZWmktk1Gie84= 2023-12-15T22:54:37.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:54:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7JVOEpbmfwjfw+dZWmktk1Gie84=', 'Content-Length': '0'} 2023-12-15T22:54:37.580 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a73e703ecb7f264d-00657cd92d-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:54:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:54:37.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:54:37.581 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:54:37.634 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:54:37.634 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:54:37.668 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:37.668+0000 7f6996d2b800 1 waiting for incremental sync to catch up: 2023-12-15T22:54:37.668 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:37.668 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:54:42.670 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:42.669+0000 7f6996d2b800 1 waiting for incremental sync to catch up: 2023-12-15T22:54:42.670 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:42.670 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:54:47.671 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:47.671+0000 7f6996d2b800 1 waiting for incremental sync to catch up: 2023-12-15T22:54:47.672 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:47.672 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:54:52.673 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:52.673+0000 7f6996d2b800 1 waiting for incremental sync to catch up: 2023-12-15T22:54:52.673 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:52.674 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:54:57.674 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:54:57.674+0000 7f6996d2b800 1 waiting for incremental sync to catch up: 2023-12-15T22:54:57.675 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.8.6, , , , , , , , , ] 2023-12-15T22:54:57.675 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:55:02.676 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:02.676+0000 7f6996d2b800 1 bucket sync caught up with source: 2023-12-15T22:55:02.677 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:55:02.677 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000002.10.6, , , , , , , , , ] 2023-12-15T22:55:02.677 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:02.676+0000 7f6996d2b800 0 bucket checkpoint complete 2023-12-15T22:55:02.694 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-9 zones={test-zone2, test-zone1} 2023-12-15T22:55:02.694 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.694 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.694 DEBUG:boto:Method: HEAD 2023-12-15T22:55:02.694 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:55:02.694 DEBUG:boto:Data: 2023-12-15T22:55:02.694 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.694 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.694 DEBUG:boto:Params: {} 2023-12-15T22:55:02.695 DEBUG:boto:Token: None 2023-12-15T22:55:02.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/ 2023-12-15T22:55:02.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WR1sksXfnmRsosfXjPVK3siFFzU= 2023-12-15T22:55:02.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WR1sksXfnmRsosfXjPVK3siFFzU=', 'Content-Length': '0'} 2023-12-15T22:55:02.697 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000007ae14304caa882-00657cd946-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.697 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.698 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.698 DEBUG:boto:Method: HEAD 2023-12-15T22:55:02.698 DEBUG:boto:Path: /kskgfn-9/ 2023-12-15T22:55:02.698 DEBUG:boto:Data: 2023-12-15T22:55:02.698 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:02.698 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.698 DEBUG:boto:Params: {} 2023-12-15T22:55:02.698 DEBUG:boto:Token: None 2023-12-15T22:55:02.698 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/ 2023-12-15T22:55:02.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WR1sksXfnmRsosfXjPVK3siFFzU= 2023-12-15T22:55:02.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WR1sksXfnmRsosfXjPVK3siFFzU=', 'Content-Length': '0'} 2023-12-15T22:55:02.701 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000419f482ef9fc347e-00657cd946-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.701 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:55:02.701 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.701 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.701 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.702 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.702 DEBUG:boto:Method: GET 2023-12-15T22:55:02.702 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.702 DEBUG:boto:Data: 2023-12-15T22:55:02.702 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.702 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.702 DEBUG:boto:Params: {} 2023-12-15T22:55:02.703 DEBUG:boto:Token: None 2023-12-15T22:55:02.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/?versions 2023-12-15T22:55:02.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw= 2023-12-15T22:55:02.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw=', 'Content-Length': '0'} 2023-12-15T22:55:02.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b65028ddb818325e-00657cd946-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.705 DEBUG:boto:b'kskgfn-9999false' 2023-12-15T22:55:02.706 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:55:02.706 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.706 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.706 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.706 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.706 DEBUG:boto:Method: GET 2023-12-15T22:55:02.706 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.706 DEBUG:boto:Data: 2023-12-15T22:55:02.706 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:02.707 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.707 DEBUG:boto:Params: {} 2023-12-15T22:55:02.707 DEBUG:boto:Token: None 2023-12-15T22:55:02.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/?versions 2023-12-15T22:55:02.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw= 2023-12-15T22:55:02.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw=', 'Content-Length': '0'} 2023-12-15T22:55:02.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba493ef5d466e161-00657cd946-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.709 DEBUG:boto:b'kskgfn-9999false' 2023-12-15T22:55:02.710 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.710 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.710 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.710 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.710 DEBUG:boto:Method: GET 2023-12-15T22:55:02.710 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.710 DEBUG:boto:Data: 2023-12-15T22:55:02.710 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.711 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.711 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.711 DEBUG:boto:Params: {} 2023-12-15T22:55:02.711 DEBUG:boto:Token: None 2023-12-15T22:55:02.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/?versions 2023-12-15T22:55:02.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw= 2023-12-15T22:55:02.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw=', 'Content-Length': '0'} 2023-12-15T22:55:02.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aa7577c7624ae89-00657cd946-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.714 DEBUG:boto:b'kskgfn-9999false' 2023-12-15T22:55:02.714 DEBUG:boto:path=/kskgfn-9/ 2023-12-15T22:55:02.714 DEBUG:boto:auth_path=/kskgfn-9/ 2023-12-15T22:55:02.714 DEBUG:boto:path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.714 DEBUG:boto:auth_path=/kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.714 DEBUG:boto:Method: GET 2023-12-15T22:55:02.714 DEBUG:boto:Path: /kskgfn-9/?versions&max-keys=999 2023-12-15T22:55:02.715 DEBUG:boto:Data: 2023-12-15T22:55:02.715 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.715 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:02.715 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.715 DEBUG:boto:Params: {} 2023-12-15T22:55:02.715 DEBUG:boto:Token: None 2023-12-15T22:55:02.715 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-9/?versions 2023-12-15T22:55:02.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw= 2023-12-15T22:55:02.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hwe8nAvyKHSxCRB8qFvOZTemBUw=', 'Content-Length': '0'} 2023-12-15T22:55:02.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d483faa07769fe5e-00657cd946-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.718 DEBUG:boto:b'kskgfn-9999false' 2023-12-15T22:55:02.718 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-9 zones={test-zone2, test-zone1} 2023-12-15T22:55:02.718 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:02.718 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:02.718 DEBUG:boto:Method: HEAD 2023-12-15T22:55:02.718 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:55:02.718 DEBUG:boto:Data: 2023-12-15T22:55:02.718 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.719 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.719 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.719 DEBUG:boto:Params: {} 2023-12-15T22:55:02.719 DEBUG:boto:Token: None 2023-12-15T22:55:02.719 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-10/ 2023-12-15T22:55:02.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uduVBsyIBx2kWqJH+Bkx/lLJwN8= 2023-12-15T22:55:02.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uduVBsyIBx2kWqJH+Bkx/lLJwN8=', 'Content-Length': '0'} 2023-12-15T22:55:02.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e4148842efad26ce-00657cd946-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.721 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:55:02.722 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:55:02.722 DEBUG:boto:Method: HEAD 2023-12-15T22:55:02.722 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:55:02.722 DEBUG:boto:Data: 2023-12-15T22:55:02.722 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.722 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.722 DEBUG:boto:Params: {} 2023-12-15T22:55:02.722 DEBUG:boto:Token: None 2023-12-15T22:55:02.722 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-10/myobj 2023-12-15T22:55:02.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lqkl4k0ozzb2ZPiHl/0jctrMwQI= 2023-12-15T22:55:02.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lqkl4k0ozzb2ZPiHl/0jctrMwQI=', 'Content-Length': '0'} 2023-12-15T22:55:02.724 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:54:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b152dc93a8d60036-00657cd946-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.724 DEBUG:boto:path=/kskgfn-10/myobj 2023-12-15T22:55:02.725 DEBUG:boto:auth_path=/kskgfn-10/myobj 2023-12-15T22:55:02.725 DEBUG:boto:Method: DELETE 2023-12-15T22:55:02.725 DEBUG:boto:Path: /kskgfn-10/myobj 2023-12-15T22:55:02.725 DEBUG:boto:Data: 2023-12-15T22:55:02.725 DEBUG:boto:Headers: {} 2023-12-15T22:55:02.725 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:02.725 DEBUG:boto:Port: 8000 2023-12-15T22:55:02.725 DEBUG:boto:Params: {} 2023-12-15T22:55:02.726 DEBUG:boto:Token: None 2023-12-15T22:55:02.726 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:02 GMT /kskgfn-10/myobj 2023-12-15T22:55:02.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IzaDH1toQvPCY3yNaO67SH6HtUU= 2023-12-15T22:55:02.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IzaDH1toQvPCY3yNaO67SH6HtUU=', 'Content-Length': '0'} 2023-12-15T22:55:02.733 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000067f09bd12b4ab045-00657cd946-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:02.733 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:02.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:02.734 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:02.794 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:02.795 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:02.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:02.840+0000 7fb5f8816800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:02.840 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.2.6, , , , , , , , , ] 2023-12-15T22:55:02.841 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.7.6, , , , , , , , , ] 2023-12-15T22:55:07.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:07.841+0000 7fb5f8816800 1 bucket sync caught up with source: 2023-12-15T22:55:07.842 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.7.6, , , , , , , , , ] 2023-12-15T22:55:07.842 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.7.6, , , , , , , , , ] 2023-12-15T22:55:07.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:07.841+0000 7fb5f8816800 0 bucket checkpoint complete 2023-12-15T22:55:07.858 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-10 zones={test-zone1, test-zone2} 2023-12-15T22:55:07.858 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.859 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.859 DEBUG:boto:Method: HEAD 2023-12-15T22:55:07.859 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:55:07.859 DEBUG:boto:Data: 2023-12-15T22:55:07.859 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.859 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:07.859 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.859 DEBUG:boto:Params: {} 2023-12-15T22:55:07.859 DEBUG:boto:Token: None 2023-12-15T22:55:07.860 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/ 2023-12-15T22:55:07.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AZxYcNYPmf+i3zUyc0VraIAPH9I= 2023-12-15T22:55:07.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AZxYcNYPmf+i3zUyc0VraIAPH9I=', 'Content-Length': '0'} 2023-12-15T22:55:07.862 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bc09cff7e044d3c1-00657cd94b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.862 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.862 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.862 DEBUG:boto:Method: HEAD 2023-12-15T22:55:07.862 DEBUG:boto:Path: /kskgfn-10/ 2023-12-15T22:55:07.863 DEBUG:boto:Data: 2023-12-15T22:55:07.863 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.863 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:07.863 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.863 DEBUG:boto:Params: {} 2023-12-15T22:55:07.863 DEBUG:boto:Token: None 2023-12-15T22:55:07.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/ 2023-12-15T22:55:07.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AZxYcNYPmf+i3zUyc0VraIAPH9I= 2023-12-15T22:55:07.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AZxYcNYPmf+i3zUyc0VraIAPH9I=', 'Content-Length': '0'} 2023-12-15T22:55:07.865 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000011e52dba72a5fb6a-00657cd94b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.866 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:55:07.866 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.866 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.866 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.866 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.867 DEBUG:boto:Method: GET 2023-12-15T22:55:07.867 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.867 DEBUG:boto:Data: 2023-12-15T22:55:07.867 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.867 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:07.867 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.867 DEBUG:boto:Params: {} 2023-12-15T22:55:07.868 DEBUG:boto:Token: None 2023-12-15T22:55:07.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/?versions 2023-12-15T22:55:07.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w= 2023-12-15T22:55:07.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w=', 'Content-Length': '0'} 2023-12-15T22:55:07.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000649af570e0653374-00657cd94b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.913 DEBUG:boto:b'kskgfn-10999false' 2023-12-15T22:55:07.914 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:55:07.914 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.914 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.914 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.914 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.915 DEBUG:boto:Method: GET 2023-12-15T22:55:07.915 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.915 DEBUG:boto:Data: 2023-12-15T22:55:07.915 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.915 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:07.915 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.915 DEBUG:boto:Params: {} 2023-12-15T22:55:07.916 DEBUG:boto:Token: None 2023-12-15T22:55:07.916 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/?versions 2023-12-15T22:55:07.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w= 2023-12-15T22:55:07.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w=', 'Content-Length': '0'} 2023-12-15T22:55:07.919 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091bf8f5127b84174-00657cd94b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.919 DEBUG:boto:b'kskgfn-10999false' 2023-12-15T22:55:07.919 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.919 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.919 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.919 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.919 DEBUG:boto:Method: GET 2023-12-15T22:55:07.920 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.920 DEBUG:boto:Data: 2023-12-15T22:55:07.920 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.920 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:07.920 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.920 DEBUG:boto:Params: {} 2023-12-15T22:55:07.920 DEBUG:boto:Token: None 2023-12-15T22:55:07.920 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/?versions 2023-12-15T22:55:07.920 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w= 2023-12-15T22:55:07.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w=', 'Content-Length': '0'} 2023-12-15T22:55:07.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099f7b1c241925332-00657cd94b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.923 DEBUG:boto:b'kskgfn-10999false' 2023-12-15T22:55:07.923 DEBUG:boto:path=/kskgfn-10/ 2023-12-15T22:55:07.923 DEBUG:boto:auth_path=/kskgfn-10/ 2023-12-15T22:55:07.924 DEBUG:boto:path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.924 DEBUG:boto:auth_path=/kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.924 DEBUG:boto:Method: GET 2023-12-15T22:55:07.924 DEBUG:boto:Path: /kskgfn-10/?versions&max-keys=999 2023-12-15T22:55:07.924 DEBUG:boto:Data: 2023-12-15T22:55:07.924 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.924 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:07.924 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.924 DEBUG:boto:Params: {} 2023-12-15T22:55:07.924 DEBUG:boto:Token: None 2023-12-15T22:55:07.924 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-10/?versions 2023-12-15T22:55:07.925 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w= 2023-12-15T22:55:07.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAE/xOirYq4xhVF0V4mj0uRjW5w=', 'Content-Length': '0'} 2023-12-15T22:55:07.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fe4787b41b3c137-00657cd94b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.927 DEBUG:boto:b'kskgfn-10999false' 2023-12-15T22:55:07.928 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-10 zones={test-zone1, test-zone2} 2023-12-15T22:55:07.928 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2023-12-15T22:55:07.928 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-11 2023-12-15T22:55:07.929 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:07.929 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:07.929 DEBUG:boto:Method: PUT 2023-12-15T22:55:07.929 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:07.929 DEBUG:boto:Data: 2023-12-15T22:55:07.929 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:07.929 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.929 DEBUG:boto:Params: {} 2023-12-15T22:55:07.929 DEBUG:boto:Token: None 2023-12-15T22:55:07.930 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-11/ 2023-12-15T22:55:07.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0kFOTD6H50glWJxpmT53tH/iQFQ= 2023-12-15T22:55:07.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0kFOTD6H50glWJxpmT53tH/iQFQ=', 'Content-Length': '0'} 2023-12-15T22:55:07.948 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c2342525d2184507-00657cd94b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.948 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-12 2023-12-15T22:55:07.948 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:07.948 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:07.949 DEBUG:boto:Method: PUT 2023-12-15T22:55:07.949 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:07.949 DEBUG:boto:Data: 2023-12-15T22:55:07.949 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.949 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:07.949 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.949 DEBUG:boto:Params: {} 2023-12-15T22:55:07.949 DEBUG:boto:Token: None 2023-12-15T22:55:07.949 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-12/ 2023-12-15T22:55:07.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4n3jao1seXcJxWNlur1MyjSdT8g= 2023-12-15T22:55:07.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4n3jao1seXcJxWNlur1MyjSdT8g=', 'Content-Length': '0'} 2023-12-15T22:55:07.976 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000000274c9d4f90a9abd-00657cd94b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.977 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:07.977 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:07.977 DEBUG:boto:path=/kskgfn-11/?versioning 2023-12-15T22:55:07.977 DEBUG:boto:auth_path=/kskgfn-11/?versioning 2023-12-15T22:55:07.977 DEBUG:boto:Method: PUT 2023-12-15T22:55:07.978 DEBUG:boto:Path: /kskgfn-11/?versioning 2023-12-15T22:55:07.978 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:55:07.978 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:07.978 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.978 DEBUG:boto:Params: {} 2023-12-15T22:55:07.978 DEBUG:boto:Token: None 2023-12-15T22:55:07.979 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-11/?versioning 2023-12-15T22:55:07.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aYeN1qavDAizKdQa5VOlDZJ3EAo= 2023-12-15T22:55:07.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aYeN1qavDAizKdQa5VOlDZJ3EAo=', 'Content-Length': '228'} 2023-12-15T22:55:07.985 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000038282f45cbcf3922-00657cd94b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.985 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:07.986 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:07.986 DEBUG:boto:path=/kskgfn-12/?versioning 2023-12-15T22:55:07.986 DEBUG:boto:auth_path=/kskgfn-12/?versioning 2023-12-15T22:55:07.986 DEBUG:boto:Method: PUT 2023-12-15T22:55:07.986 DEBUG:boto:Path: /kskgfn-12/?versioning 2023-12-15T22:55:07.986 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:55:07.986 DEBUG:boto:Headers: {} 2023-12-15T22:55:07.986 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:07.986 DEBUG:boto:Port: 8000 2023-12-15T22:55:07.986 DEBUG:boto:Params: {} 2023-12-15T22:55:07.986 DEBUG:boto:Token: None 2023-12-15T22:55:07.987 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:07 GMT /kskgfn-12/?versioning 2023-12-15T22:55:07.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IbVSAigvhLLOsVKLkkWeqB0g1Kg= 2023-12-15T22:55:07.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IbVSAigvhLLOsVKLkkWeqB0g1Kg=', 'Content-Length': '228'} 2023-12-15T22:55:07.997 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002d7906a593634e47-00657cd94b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:07.998 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:07.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:07.998 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:55:08.051 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:08.051 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:08.088 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:55:08.102 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680907.994388_49.1","last_update":"2023-12-15T22:55:07.994388Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:55:08.102 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680907.994388_49.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:55:08.103 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:55:08.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:08.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:08.103 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:55:08.154 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:08.154 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:08.183 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:08.182+0000 7f378033a800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:55:08.184 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:08.183+0000 7f378033a800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:55:08.198 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680871.641055_37.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:54:31.641055Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:55:08Z"} 2023-12-15T22:55:08.198 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680871.641055_37.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:54:31.641055Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:55:08Z"} 2023-12-15T22:55:08.198 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680871.641055_37.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.641055Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:55:08.199 DEBUG:rgw_multi.tests:log_status={0: '1_1702680907.994388_49.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:55:08.199 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680871.641055_37.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:55:08.199 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702680907.994388_49.1 target=1_1702680871.641055_37.1 2023-12-15T22:55:13.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:13.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:55:13.200 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:55:13.252 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:13.253 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:13.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:13.282+0000 7fdb32733800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:55:13.284 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:13.283+0000 7fdb32733800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:55:13.299 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680907.994388_49.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:55:07.994388Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:55:13Z"} 2023-12-15T22:55:13.299 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680907.994388_49.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:55:07.994388Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:55:13Z"} 2023-12-15T22:55:13.299 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680907.994388_49.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:55:07.994388Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:55:13.299 DEBUG:rgw_multi.tests:log_status={0: '1_1702680907.994388_49.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:55:13.300 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680907.994388_49.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:55:13.300 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:55:13.300 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:13.300 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:13.300 DEBUG:boto:Method: HEAD 2023-12-15T22:55:13.300 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:13.300 DEBUG:boto:Data: 2023-12-15T22:55:13.300 DEBUG:boto:Headers: {} 2023-12-15T22:55:13.300 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:13.300 DEBUG:boto:Port: 8000 2023-12-15T22:55:13.300 DEBUG:boto:Params: {} 2023-12-15T22:55:13.301 DEBUG:boto:Token: None 2023-12-15T22:55:13.301 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:13 GMT /kskgfn-11/ 2023-12-15T22:55:13.301 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qx6F0SspmiZbZ9DqG4T/oeDxpz0= 2023-12-15T22:55:13.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qx6F0SspmiZbZ9DqG4T/oeDxpz0=', 'Content-Length': '0'} 2023-12-15T22:55:13.303 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007bf1c00d892a33c7-00657cd951-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:13.303 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:13.304 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:13.304 DEBUG:boto:Method: PUT 2023-12-15T22:55:13.304 DEBUG:boto:Path: /kskgfn-11/dummy 2023-12-15T22:55:13.304 DEBUG:boto:Data: 2023-12-15T22:55:13.304 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:55:13.304 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:13.304 DEBUG:boto:Port: 8000 2023-12-15T22:55:13.304 DEBUG:boto:Params: {} 2023-12-15T22:55:13.304 DEBUG:boto:Token: None 2023-12-15T22:55:13.305 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:55:13 GMT /kskgfn-11/dummy 2023-12-15T22:55:13.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:84z9Un3KSWURPAwAUXU9bNHU+8U= 2023-12-15T22:55:13.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:84z9Un3KSWURPAwAUXU9bNHU+8U='} 2023-12-15T22:55:13.320 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-amz-request-id', 'tx00000e48deae0303a4152-00657cd951-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:13.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:13.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:13.320 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:13.375 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:13.375 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:13.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:13.407+0000 7f0abd212800 1 waiting to reach incremental sync.. 2023-12-15T22:55:18.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:18.410+0000 7f0abd212800 1 bucket sync caught up with source: 2023-12-15T22:55:18.410 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000002.15.11, , , , , ] 2023-12-15T22:55:18.410 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000002.15.11, , , , , ] 2023-12-15T22:55:18.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:18.410+0000 7f0abd212800 0 bucket checkpoint complete 2023-12-15T22:55:18.427 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:18.427 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:18.427 DEBUG:boto:Method: HEAD 2023-12-15T22:55:18.427 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:18.427 DEBUG:boto:Data: 2023-12-15T22:55:18.427 DEBUG:boto:Headers: {} 2023-12-15T22:55:18.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:18.427 DEBUG:boto:Port: 8000 2023-12-15T22:55:18.428 DEBUG:boto:Params: {} 2023-12-15T22:55:18.428 DEBUG:boto:Token: None 2023-12-15T22:55:18.428 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:18 GMT /kskgfn-12/ 2023-12-15T22:55:18.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9c649HT+IuCo7LRegY2JUVy8cA0= 2023-12-15T22:55:18.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9c649HT+IuCo7LRegY2JUVy8cA0=', 'Content-Length': '0'} 2023-12-15T22:55:18.430 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000840d91481d4629ce-00657cd956-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:18.431 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:18.431 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:18.431 DEBUG:boto:Method: PUT 2023-12-15T22:55:18.431 DEBUG:boto:Path: /kskgfn-12/dummy 2023-12-15T22:55:18.431 DEBUG:boto:Data: 2023-12-15T22:55:18.431 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:55:18.431 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:18.431 DEBUG:boto:Port: 8000 2023-12-15T22:55:18.431 DEBUG:boto:Params: {} 2023-12-15T22:55:18.431 DEBUG:boto:Token: None 2023-12-15T22:55:18.432 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:55:18 GMT /kskgfn-12/dummy 2023-12-15T22:55:18.432 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OYUvE5STPnD5rwlzqSR+jV7NsFo= 2023-12-15T22:55:18.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OYUvE5STPnD5rwlzqSR+jV7NsFo='} 2023-12-15T22:55:18.445 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-amz-request-id', 'tx00000497d9715029ebd0c-00657cd956-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:18.445 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:18.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:18.446 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:18.507 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:18.507 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:18.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:18.550+0000 7f167862d800 1 waiting to reach incremental sync.. 2023-12-15T22:55:23.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:23.552+0000 7f167862d800 1 bucket sync caught up with source: 2023-12-15T22:55:23.553 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000002.19.11, , , , , ] 2023-12-15T22:55:23.553 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000002.19.11, , , , , ] 2023-12-15T22:55:23.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:23.552+0000 7f167862d800 0 bucket checkpoint complete 2023-12-15T22:55:23.569 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:23.569 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:23.569 DEBUG:boto:Method: HEAD 2023-12-15T22:55:23.569 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:23.570 DEBUG:boto:Data: 2023-12-15T22:55:23.570 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.570 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.570 DEBUG:boto:Params: {} 2023-12-15T22:55:23.570 DEBUG:boto:Token: None 2023-12-15T22:55:23.570 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/ 2023-12-15T22:55:23.570 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KcqxmA+6n3kTc+eXHbFCCVYKYl4= 2023-12-15T22:55:23.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KcqxmA+6n3kTc+eXHbFCCVYKYl4=', 'Content-Length': '0'} 2023-12-15T22:55:23.573 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000684a5bad3269ba39-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.573 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.573 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.573 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.574 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.574 DEBUG:boto:Data: 2023-12-15T22:55:23.574 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.574 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.574 DEBUG:boto:Params: {} 2023-12-15T22:55:23.574 DEBUG:boto:Token: None 2023-12-15T22:55:23.574 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mbhQ22cWW527ff2w45a6e4V+4bM= 2023-12-15T22:55:23.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mbhQ22cWW527ff2w45a6e4V+4bM='} 2023-12-15T22:55:23.589 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-amz-request-id', 'tx00000c4f7e3694909d1e0-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.589 DEBUG:rgw_multi.tests:version1 id=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:23.590 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.590 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.590 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.590 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.590 DEBUG:boto:Data: 2023-12-15T22:55:23.590 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.590 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.590 DEBUG:boto:Params: {} 2023-12-15T22:55:23.591 DEBUG:boto:Token: None 2023-12-15T22:55:23.591 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SnrsNVbR3tATfarLYFKNmiAgt3E= 2023-12-15T22:55:23.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SnrsNVbR3tATfarLYFKNmiAgt3E='} 2023-12-15T22:55:23.601 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq'), ('x-amz-request-id', 'tx0000057ef9917869aa816-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.601 DEBUG:rgw_multi.tests:version2 id=Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq 2023-12-15T22:55:23.601 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.601 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.602 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq 2023-12-15T22:55:23.602 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq 2023-12-15T22:55:23.602 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.602 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq 2023-12-15T22:55:23.602 DEBUG:boto:Data: 2023-12-15T22:55:23.602 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.602 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.602 DEBUG:boto:Params: {} 2023-12-15T22:55:23.602 DEBUG:boto:Token: None 2023-12-15T22:55:23.603 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone1?versionId=Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq 2023-12-15T22:55:23.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CYP1W1W6R6OsIHpl97g/Bir1Dkk= 2023-12-15T22:55:23.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CYP1W1W6R6OsIHpl97g/Bir1Dkk=', 'Content-Length': '0'} 2023-12-15T22:55:23.612 DEBUG:boto:Response headers: [('x-amz-version-id', 'Nc27ZmFeUjKEWnlmkcMTFCDzktyqoaq'), ('x-amz-request-id', 'tx00000c4e9dac5168f666a-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.613 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.613 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.613 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.613 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.613 DEBUG:boto:Data: 2023-12-15T22:55:23.613 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.613 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.614 DEBUG:boto:Params: {} 2023-12-15T22:55:23.614 DEBUG:boto:Token: None 2023-12-15T22:55:23.614 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xQgLez7kk1MuuN2PeohGYlf5rAg= 2023-12-15T22:55:23.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xQgLez7kk1MuuN2PeohGYlf5rAg='} 2023-12-15T22:55:23.657 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj'), ('x-amz-request-id', 'tx00000aa3bd9d855c93c3d-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.658 DEBUG:rgw_multi.tests:version3 id=kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj 2023-12-15T22:55:23.658 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.658 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:23.658 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj 2023-12-15T22:55:23.658 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj 2023-12-15T22:55:23.658 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.658 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj 2023-12-15T22:55:23.658 DEBUG:boto:Data: 2023-12-15T22:55:23.658 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.659 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.659 DEBUG:boto:Params: {} 2023-12-15T22:55:23.659 DEBUG:boto:Token: None 2023-12-15T22:55:23.659 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone1?versionId=kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj 2023-12-15T22:55:23.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P4io5PaxojtIiaFyMDSpToGWM7Y= 2023-12-15T22:55:23.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P4io5PaxojtIiaFyMDSpToGWM7Y=', 'Content-Length': '0'} 2023-12-15T22:55:23.671 DEBUG:boto:Response headers: [('x-amz-version-id', 'kjOmQ0jghPZY5gOnD6RCTw8X5oNHgkj'), ('x-amz-request-id', 'tx000006bfc9deb7bd6df95-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.671 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:23.671 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:23.671 DEBUG:boto:Method: HEAD 2023-12-15T22:55:23.671 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:23.671 DEBUG:boto:Data: 2023-12-15T22:55:23.672 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.672 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.672 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.672 DEBUG:boto:Params: {} 2023-12-15T22:55:23.672 DEBUG:boto:Token: None 2023-12-15T22:55:23.672 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/ 2023-12-15T22:55:23.672 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KcqxmA+6n3kTc+eXHbFCCVYKYl4= 2023-12-15T22:55:23.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KcqxmA+6n3kTc+eXHbFCCVYKYl4=', 'Content-Length': '0'} 2023-12-15T22:55:23.675 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d7508e78764c1ef-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.675 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.675 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.675 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.675 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.675 DEBUG:boto:Data: 2023-12-15T22:55:23.675 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.676 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.676 DEBUG:boto:Params: {} 2023-12-15T22:55:23.676 DEBUG:boto:Token: None 2023-12-15T22:55:23.676 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f/L5r6So1YsS2+qsMX6XUAuiAIw= 2023-12-15T22:55:23.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f/L5r6So1YsS2+qsMX6XUAuiAIw='} 2023-12-15T22:55:23.689 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-amz-request-id', 'tx0000075b2ad92f47a2676-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.689 DEBUG:rgw_multi.tests:version1 id=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:23.689 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.690 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.690 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.690 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.690 DEBUG:boto:Data: 2023-12-15T22:55:23.690 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.690 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.690 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.690 DEBUG:boto:Params: {} 2023-12-15T22:55:23.690 DEBUG:boto:Token: None 2023-12-15T22:55:23.690 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rJUDSPu1dtAJFFX8VHaQR81Tulc= 2023-12-15T22:55:23.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rJUDSPu1dtAJFFX8VHaQR81Tulc='} 2023-12-15T22:55:23.733 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'Dc-FtdK9kYfXQsyRuk1eogchmJot7GR'), ('x-amz-request-id', 'tx00000ae5838df8a9d8f20-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.734 DEBUG:rgw_multi.tests:version2 id=Dc-FtdK9kYfXQsyRuk1eogchmJot7GR 2023-12-15T22:55:23.734 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.734 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.734 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=Dc-FtdK9kYfXQsyRuk1eogchmJot7GR 2023-12-15T22:55:23.734 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=Dc-FtdK9kYfXQsyRuk1eogchmJot7GR 2023-12-15T22:55:23.734 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.734 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=Dc-FtdK9kYfXQsyRuk1eogchmJot7GR 2023-12-15T22:55:23.734 DEBUG:boto:Data: 2023-12-15T22:55:23.734 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.735 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.735 DEBUG:boto:Params: {} 2023-12-15T22:55:23.735 DEBUG:boto:Token: None 2023-12-15T22:55:23.735 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone2?versionId=Dc-FtdK9kYfXQsyRuk1eogchmJot7GR 2023-12-15T22:55:23.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0ZJAkcyXQM5jwsyFNErdWTecCXE= 2023-12-15T22:55:23.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0ZJAkcyXQM5jwsyFNErdWTecCXE=', 'Content-Length': '0'} 2023-12-15T22:55:23.747 DEBUG:boto:Response headers: [('x-amz-version-id', 'Dc-FtdK9kYfXQsyRuk1eogchmJot7GR'), ('x-amz-request-id', 'tx00000861ff654a04cc70b-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.748 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.748 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.748 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.748 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.748 DEBUG:boto:Data: 2023-12-15T22:55:23.748 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.748 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.748 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.748 DEBUG:boto:Params: {} 2023-12-15T22:55:23.748 DEBUG:boto:Token: None 2023-12-15T22:55:23.749 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.749 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:g2r2OnM5L2zvAOc0RvuGHILFdWA= 2023-12-15T22:55:23.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:g2r2OnM5L2zvAOc0RvuGHILFdWA='} 2023-12-15T22:55:23.759 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'i8Hga4O94xpFYsPK-CcwTvRphGhPDtm'), ('x-amz-request-id', 'tx00000afa29dcbfbc3c250-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.759 DEBUG:rgw_multi.tests:version3 id=i8Hga4O94xpFYsPK-CcwTvRphGhPDtm 2023-12-15T22:55:23.759 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.759 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:23.760 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=i8Hga4O94xpFYsPK-CcwTvRphGhPDtm 2023-12-15T22:55:23.760 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=i8Hga4O94xpFYsPK-CcwTvRphGhPDtm 2023-12-15T22:55:23.760 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.760 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=i8Hga4O94xpFYsPK-CcwTvRphGhPDtm 2023-12-15T22:55:23.760 DEBUG:boto:Data: 2023-12-15T22:55:23.760 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.760 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.760 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.760 DEBUG:boto:Params: {} 2023-12-15T22:55:23.760 DEBUG:boto:Token: None 2023-12-15T22:55:23.760 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-11/obj-test-zone2?versionId=i8Hga4O94xpFYsPK-CcwTvRphGhPDtm 2023-12-15T22:55:23.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A0HcbClyV/dm8gfX2rWDG94pqGc= 2023-12-15T22:55:23.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A0HcbClyV/dm8gfX2rWDG94pqGc=', 'Content-Length': '0'} 2023-12-15T22:55:23.772 DEBUG:boto:Response headers: [('x-amz-version-id', 'i8Hga4O94xpFYsPK-CcwTvRphGhPDtm'), ('x-amz-request-id', 'tx00000f3a6872a25515c32-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.772 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:23.772 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:23.772 DEBUG:boto:Method: HEAD 2023-12-15T22:55:23.772 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:23.772 DEBUG:boto:Data: 2023-12-15T22:55:23.772 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.772 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.772 DEBUG:boto:Params: {} 2023-12-15T22:55:23.773 DEBUG:boto:Token: None 2023-12-15T22:55:23.773 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/ 2023-12-15T22:55:23.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZzwn6FT4NT7q546OT1tQ6U14yw= 2023-12-15T22:55:23.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZzwn6FT4NT7q546OT1tQ6U14yw=', 'Content-Length': '0'} 2023-12-15T22:55:23.775 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf7acbe7cfda0e5f-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.775 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.775 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.776 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.776 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.776 DEBUG:boto:Data: 2023-12-15T22:55:23.776 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.776 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.776 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.776 DEBUG:boto:Params: {} 2023-12-15T22:55:23.776 DEBUG:boto:Token: None 2023-12-15T22:55:23.776 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yC/gOezY/qazXsycEZLEWlUfkjM= 2023-12-15T22:55:23.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yC/gOezY/qazXsycEZLEWlUfkjM='} 2023-12-15T22:55:23.788 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-amz-request-id', 'tx00000712b0352b923e9ab-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.788 DEBUG:rgw_multi.tests:version1 id=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:23.788 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.788 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.789 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.789 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.789 DEBUG:boto:Data: 2023-12-15T22:55:23.789 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.789 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.789 DEBUG:boto:Params: {} 2023-12-15T22:55:23.789 DEBUG:boto:Token: None 2023-12-15T22:55:23.789 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jyGEWVh1G6xMWUpfuZDShr0l1w8= 2023-12-15T22:55:23.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jyGEWVh1G6xMWUpfuZDShr0l1w8='} 2023-12-15T22:55:23.801 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS'), ('x-amz-request-id', 'tx00000f9b293af0f350fd8-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.801 DEBUG:rgw_multi.tests:version2 id=nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS 2023-12-15T22:55:23.801 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.801 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.801 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS 2023-12-15T22:55:23.801 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS 2023-12-15T22:55:23.801 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.801 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS 2023-12-15T22:55:23.801 DEBUG:boto:Data: 2023-12-15T22:55:23.801 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.802 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.802 DEBUG:boto:Params: {} 2023-12-15T22:55:23.802 DEBUG:boto:Token: None 2023-12-15T22:55:23.802 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone1?versionId=nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS 2023-12-15T22:55:23.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W0PGvFkHBjGNs5cUXvvCrxV/cH4= 2023-12-15T22:55:23.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W0PGvFkHBjGNs5cUXvvCrxV/cH4=', 'Content-Length': '0'} 2023-12-15T22:55:23.812 DEBUG:boto:Response headers: [('x-amz-version-id', 'nTupqwuNcq9.VAIkUcJ2obUiuOsYBHS'), ('x-amz-request-id', 'tx00000d3c9ec358c4111b1-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.813 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.813 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.813 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.813 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.813 DEBUG:boto:Data: 2023-12-15T22:55:23.813 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.813 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.813 DEBUG:boto:Params: {} 2023-12-15T22:55:23.813 DEBUG:boto:Token: None 2023-12-15T22:55:23.814 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n4JrETF7UyXz9a6kM9lWSfAo0fc= 2023-12-15T22:55:23.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n4JrETF7UyXz9a6kM9lWSfAo0fc='} 2023-12-15T22:55:23.857 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'E08O-3xbdcWXgBujH-oqmTohng2x9OZ'), ('x-amz-request-id', 'tx00000e0465d54d61cf01b-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.858 DEBUG:rgw_multi.tests:version3 id=E08O-3xbdcWXgBujH-oqmTohng2x9OZ 2023-12-15T22:55:23.858 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.858 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:23.858 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=E08O-3xbdcWXgBujH-oqmTohng2x9OZ 2023-12-15T22:55:23.858 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=E08O-3xbdcWXgBujH-oqmTohng2x9OZ 2023-12-15T22:55:23.858 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.858 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=E08O-3xbdcWXgBujH-oqmTohng2x9OZ 2023-12-15T22:55:23.858 DEBUG:boto:Data: 2023-12-15T22:55:23.858 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:23.858 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.859 DEBUG:boto:Params: {} 2023-12-15T22:55:23.859 DEBUG:boto:Token: None 2023-12-15T22:55:23.859 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone1?versionId=E08O-3xbdcWXgBujH-oqmTohng2x9OZ 2023-12-15T22:55:23.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yaQkReuCQvpGjJV8pVbP8CDdtlU= 2023-12-15T22:55:23.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yaQkReuCQvpGjJV8pVbP8CDdtlU=', 'Content-Length': '0'} 2023-12-15T22:55:23.869 DEBUG:boto:Response headers: [('x-amz-version-id', 'E08O-3xbdcWXgBujH-oqmTohng2x9OZ'), ('x-amz-request-id', 'tx00000e8d4a7d31f5d3cf3-00657cd95b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.869 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:23.869 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:23.869 DEBUG:boto:Method: HEAD 2023-12-15T22:55:23.869 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:23.869 DEBUG:boto:Data: 2023-12-15T22:55:23.869 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.869 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.869 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.870 DEBUG:boto:Params: {} 2023-12-15T22:55:23.870 DEBUG:boto:Token: None 2023-12-15T22:55:23.870 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/ 2023-12-15T22:55:23.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZzwn6FT4NT7q546OT1tQ6U14yw= 2023-12-15T22:55:23.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZzwn6FT4NT7q546OT1tQ6U14yw=', 'Content-Length': '0'} 2023-12-15T22:55:23.872 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecaab7e6c577e105-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.872 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.872 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.872 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.873 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.873 DEBUG:boto:Data: 2023-12-15T22:55:23.873 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.873 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.873 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.873 DEBUG:boto:Params: {} 2023-12-15T22:55:23.873 DEBUG:boto:Token: None 2023-12-15T22:55:23.873 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.873 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vKqulLsuW/xCziAAEUqODZQTHDk= 2023-12-15T22:55:23.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vKqulLsuW/xCziAAEUqODZQTHDk='} 2023-12-15T22:55:23.885 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-amz-request-id', 'tx00000aa57265f55d6705f-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.886 DEBUG:rgw_multi.tests:version1 id=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:23.886 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.886 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.886 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.886 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.886 DEBUG:boto:Data: 2023-12-15T22:55:23.886 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.886 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.887 DEBUG:boto:Params: {} 2023-12-15T22:55:23.887 DEBUG:boto:Token: None 2023-12-15T22:55:23.887 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s8d5buQwMt7copkLaEll3HOq2Cg= 2023-12-15T22:55:23.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s8d5buQwMt7copkLaEll3HOq2Cg='} 2023-12-15T22:55:23.897 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M'), ('x-amz-request-id', 'tx00000554d5ede3feaa5e9-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.897 DEBUG:rgw_multi.tests:version2 id=9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M 2023-12-15T22:55:23.897 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.898 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.898 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M 2023-12-15T22:55:23.898 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M 2023-12-15T22:55:23.898 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.898 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M 2023-12-15T22:55:23.898 DEBUG:boto:Data: 2023-12-15T22:55:23.898 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.898 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.898 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.898 DEBUG:boto:Params: {} 2023-12-15T22:55:23.898 DEBUG:boto:Token: None 2023-12-15T22:55:23.899 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone2?versionId=9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M 2023-12-15T22:55:23.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Ip3iDcThZBw+mQ9h/pC3fpPdsk= 2023-12-15T22:55:23.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Ip3iDcThZBw+mQ9h/pC3fpPdsk=', 'Content-Length': '0'} 2023-12-15T22:55:23.911 DEBUG:boto:Response headers: [('x-amz-version-id', '9Bgm7cB-c7aKIPpBuutDyKZ-H6q9Q6M'), ('x-amz-request-id', 'tx00000ae1a2fa539f5f477-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.911 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.911 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.911 DEBUG:boto:Method: PUT 2023-12-15T22:55:23.911 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.911 DEBUG:boto:Data: 2023-12-15T22:55:23.912 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:55:23.912 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.912 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.912 DEBUG:boto:Params: {} 2023-12-15T22:55:23.912 DEBUG:boto:Token: None 2023-12-15T22:55:23.912 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bAFrN39Cl/M9558az8tl2yNUU8c= 2023-12-15T22:55:23.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bAFrN39Cl/M9558az8tl2yNUU8c='} 2023-12-15T22:55:23.958 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '78ai4bSoG7.MkBXFDltIIln2PWO2uiO'), ('x-amz-request-id', 'tx0000092ebf264b5402271-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.958 DEBUG:rgw_multi.tests:version3 id=78ai4bSoG7.MkBXFDltIIln2PWO2uiO 2023-12-15T22:55:23.958 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.958 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:23.958 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=78ai4bSoG7.MkBXFDltIIln2PWO2uiO 2023-12-15T22:55:23.958 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=78ai4bSoG7.MkBXFDltIIln2PWO2uiO 2023-12-15T22:55:23.958 DEBUG:boto:Method: DELETE 2023-12-15T22:55:23.958 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=78ai4bSoG7.MkBXFDltIIln2PWO2uiO 2023-12-15T22:55:23.958 DEBUG:boto:Data: 2023-12-15T22:55:23.959 DEBUG:boto:Headers: {} 2023-12-15T22:55:23.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:23.959 DEBUG:boto:Port: 8000 2023-12-15T22:55:23.959 DEBUG:boto:Params: {} 2023-12-15T22:55:23.959 DEBUG:boto:Token: None 2023-12-15T22:55:23.959 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:55:23 GMT /kskgfn-12/obj-test-zone2?versionId=78ai4bSoG7.MkBXFDltIIln2PWO2uiO 2023-12-15T22:55:23.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bxPbxVf2NOHPlQ4u6TKRdJveg3o= 2023-12-15T22:55:23.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bxPbxVf2NOHPlQ4u6TKRdJveg3o=', 'Content-Length': '0'} 2023-12-15T22:55:23.970 DEBUG:boto:Response headers: [('x-amz-version-id', '78ai4bSoG7.MkBXFDltIIln2PWO2uiO'), ('x-amz-request-id', 'tx000007277cceee48147be-00657cd95b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:23.970 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-11 2023-12-15T22:55:23.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:23.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:23.971 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:24.027 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:24.027 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:24.063 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:24.063+0000 7f9b84a0f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:24.063 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000002.15.11, , , , , ] 2023-12-15T22:55:24.063 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.26.6, , , , 00000000003.17.10, , , , , ] 2023-12-15T22:55:29.064 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:29.064+0000 7f9b84a0f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:29.065 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000002.15.11, , , , , ] 2023-12-15T22:55:29.065 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.26.6, , , , 00000000003.17.10, , , , , ] 2023-12-15T22:55:34.066 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:34.066+0000 7f9b84a0f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:34.066 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000002.15.11, , , , , ] 2023-12-15T22:55:34.066 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.26.6, , , , 00000000003.17.10, , , , , ] 2023-12-15T22:55:39.068 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:39.067+0000 7f9b84a0f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:39.068 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000002.15.11, , , , , ] 2023-12-15T22:55:39.068 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.26.6, , , , 00000000003.17.10, , , , , ] 2023-12-15T22:55:44.069 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:44.069+0000 7f9b84a0f800 1 bucket sync caught up with source: 2023-12-15T22:55:44.069 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:44.069 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.26.6, , , , 00000000003.17.10, , , , , ] 2023-12-15T22:55:44.069 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:44.069+0000 7f9b84a0f800 0 bucket checkpoint complete 2023-12-15T22:55:44.087 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-11 2023-12-15T22:55:44.087 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.087 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:44.148 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:44.148 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:44.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:44.189+0000 7fd18e130800 1 bucket sync caught up with source: 2023-12-15T22:55:44.189 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.31.11, , 00000000010.43.6, , 00000000002.30.11, , , , , ] 2023-12-15T22:55:44.189 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.31.11, , 00000000010.43.6, , 00000000002.30.11, , , , , ] 2023-12-15T22:55:44.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:44.189+0000 7fd18e130800 0 bucket checkpoint complete 2023-12-15T22:55:44.203 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-11 zones={test-zone2, test-zone1} 2023-12-15T22:55:44.203 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.204 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.204 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.204 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:44.204 DEBUG:boto:Data: 2023-12-15T22:55:44.204 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.204 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.204 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.204 DEBUG:boto:Params: {} 2023-12-15T22:55:44.204 DEBUG:boto:Token: None 2023-12-15T22:55:44.205 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.205 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EenY/3Hhn0J+5BPHCmY/cuixc6s= 2023-12-15T22:55:44.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EenY/3Hhn0J+5BPHCmY/cuixc6s=', 'Content-Length': '0'} 2023-12-15T22:55:44.207 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b970871c2fd3217-00657cd970-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.207 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.207 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.207 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.208 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:44.208 DEBUG:boto:Data: 2023-12-15T22:55:44.208 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.208 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.208 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.208 DEBUG:boto:Params: {} 2023-12-15T22:55:44.208 DEBUG:boto:Token: None 2023-12-15T22:55:44.208 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EenY/3Hhn0J+5BPHCmY/cuixc6s= 2023-12-15T22:55:44.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EenY/3Hhn0J+5BPHCmY/cuixc6s=', 'Content-Length': '0'} 2023-12-15T22:55:44.211 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a5cecfc7c21ddd6e-00657cd970-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.211 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:55:44.211 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.211 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.211 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.211 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.211 DEBUG:boto:Method: GET 2023-12-15T22:55:44.211 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.212 DEBUG:boto:Data: 2023-12-15T22:55:44.212 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.212 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.212 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.212 DEBUG:boto:Params: {} 2023-12-15T22:55:44.212 DEBUG:boto:Token: None 2023-12-15T22:55:44.212 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/?versions 2023-12-15T22:55:44.212 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4= 2023-12-15T22:55:44.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4=', 'Content-Length': '0'} 2023-12-15T22:55:44.214 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000898a87d0258d0abf-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.215 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.215 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:55:44.215 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:55:44.215 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:55:44.215 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:55:44.216 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.216 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.216 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.216 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.216 DEBUG:boto:Method: GET 2023-12-15T22:55:44.216 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.216 DEBUG:boto:Data: 2023-12-15T22:55:44.216 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.216 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.216 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.216 DEBUG:boto:Params: {} 2023-12-15T22:55:44.216 DEBUG:boto:Token: None 2023-12-15T22:55:44.217 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/?versions 2023-12-15T22:55:44.217 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4= 2023-12-15T22:55:44.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4=', 'Content-Length': '0'} 2023-12-15T22:55:44.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c6cd21f06fb4ad3-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.219 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.220 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:55:44.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:55:44.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:55:44.220 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.220 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.220 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.220 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.220 DEBUG:boto:Method: GET 2023-12-15T22:55:44.220 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.220 DEBUG:boto:Data: 2023-12-15T22:55:44.220 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.220 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.221 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.221 DEBUG:boto:Params: {} 2023-12-15T22:55:44.221 DEBUG:boto:Token: None 2023-12-15T22:55:44.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/?versions 2023-12-15T22:55:44.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4= 2023-12-15T22:55:44.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4=', 'Content-Length': '0'} 2023-12-15T22:55:44.223 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000412ed4944e52783c-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.223 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.224 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.224 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.224 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.224 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.224 DEBUG:boto:Method: GET 2023-12-15T22:55:44.224 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:55:44.224 DEBUG:boto:Data: 2023-12-15T22:55:44.225 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.225 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.225 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.225 DEBUG:boto:Params: {} 2023-12-15T22:55:44.225 DEBUG:boto:Token: None 2023-12-15T22:55:44.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/?versions 2023-12-15T22:55:44.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4= 2023-12-15T22:55:44.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LenoWsXmHm3FuVe99tK8rpPHZs4=', 'Content-Length': '0'} 2023-12-15T22:55:44.227 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074a472e65e56ea04-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.227 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.228 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.228 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.228 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.228 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.228 DEBUG:boto:Method: GET 2023-12-15T22:55:44.228 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.228 DEBUG:boto:Data: 2023-12-15T22:55:44.229 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.229 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.229 DEBUG:boto:Params: {} 2023-12-15T22:55:44.229 DEBUG:boto:Token: None 2023-12-15T22:55:44.229 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.229 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.231 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ca0de28682f1ae1f-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.231 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.232 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.232 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.232 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.232 DEBUG:boto:Method: GET 2023-12-15T22:55:44.232 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.232 DEBUG:boto:Data: 2023-12-15T22:55:44.232 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.232 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.232 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.232 DEBUG:boto:Params: {} 2023-12-15T22:55:44.232 DEBUG:boto:Token: None 2023-12-15T22:55:44.233 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.235 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000073e3b8d30769251b-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.235 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.235 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.235 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.235 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.235 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.236 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.236 DEBUG:boto:Data: 2023-12-15T22:55:44.236 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.236 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.236 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.236 DEBUG:boto:Params: {} 2023-12-15T22:55:44.236 DEBUG:boto:Token: None 2023-12-15T22:55:44.236 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.236 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pnUejvRnFC9f33deqUlsaAt+Fw= 2023-12-15T22:55:44.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pnUejvRnFC9f33deqUlsaAt+Fw=', 'Content-Length': '0'} 2023-12-15T22:55:44.238 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008834b770591dada0-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.239 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.239 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.239 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.239 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.239 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.239 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.239 DEBUG:boto:Data: 2023-12-15T22:55:44.239 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.239 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.240 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.240 DEBUG:boto:Params: {} 2023-12-15T22:55:44.240 DEBUG:boto:Token: None 2023-12-15T22:55:44.240 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.240 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pnUejvRnFC9f33deqUlsaAt+Fw= 2023-12-15T22:55:44.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pnUejvRnFC9f33deqUlsaAt+Fw=', 'Content-Length': '0'} 2023-12-15T22:55:44.242 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006f7c0f01358b93e2-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.242 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.242 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.242 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.242 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.243 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.243 DEBUG:boto:Method: GET 2023-12-15T22:55:44.243 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.243 DEBUG:boto:Data: 2023-12-15T22:55:44.243 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.243 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.243 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.243 DEBUG:boto:Params: {} 2023-12-15T22:55:44.243 DEBUG:boto:Token: None 2023-12-15T22:55:44.243 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.245 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007aa3667790ac8b14-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.246 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.246 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.246 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.246 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.246 DEBUG:boto:Method: GET 2023-12-15T22:55:44.246 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.246 DEBUG:boto:Data: 2023-12-15T22:55:44.246 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.247 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.247 DEBUG:boto:Params: {} 2023-12-15T22:55:44.247 DEBUG:boto:Token: None 2023-12-15T22:55:44.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.249 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001bfd2a39a3ca4120-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.249 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.249 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.249 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.249 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.250 DEBUG:boto:Method: GET 2023-12-15T22:55:44.250 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.250 DEBUG:boto:Data: 2023-12-15T22:55:44.250 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.250 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.250 DEBUG:boto:Params: {} 2023-12-15T22:55:44.250 DEBUG:boto:Token: None 2023-12-15T22:55:44.250 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.253 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000baf3475987d83952-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.294 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.294 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.294 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.294 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.294 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.294 DEBUG:boto:Method: GET 2023-12-15T22:55:44.295 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.295 DEBUG:boto:Data: 2023-12-15T22:55:44.295 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.295 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.295 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.295 DEBUG:boto:Params: {} 2023-12-15T22:55:44.295 DEBUG:boto:Token: None 2023-12-15T22:55:44.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.297 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000639f68d05eb86a8d-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.298 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.298 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.298 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.298 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.298 DEBUG:boto:Path: /kskgfn-11/dummy 2023-12-15T22:55:44.298 DEBUG:boto:Data: 2023-12-15T22:55:44.299 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.299 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.299 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.299 DEBUG:boto:Params: {} 2023-12-15T22:55:44.299 DEBUG:boto:Token: None 2023-12-15T22:55:44.299 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy 2023-12-15T22:55:44.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F2onORzrzRnlYcSfWX71HBs6Kus= 2023-12-15T22:55:44.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F2onORzrzRnlYcSfWX71HBs6Kus=', 'Content-Length': '0'} 2023-12-15T22:55:44.302 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003e018221b207c6ba-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.302 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.302 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.303 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.303 DEBUG:boto:Path: /kskgfn-11/dummy 2023-12-15T22:55:44.303 DEBUG:boto:Data: 2023-12-15T22:55:44.303 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.303 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.303 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.303 DEBUG:boto:Params: {} 2023-12-15T22:55:44.303 DEBUG:boto:Token: None 2023-12-15T22:55:44.303 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy 2023-12-15T22:55:44.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F2onORzrzRnlYcSfWX71HBs6Kus= 2023-12-15T22:55:44.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F2onORzrzRnlYcSfWX71HBs6Kus=', 'Content-Length': '0'} 2023-12-15T22:55:44.306 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001ce0fa6bf92e067d-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.306 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.306 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.306 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.306 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.307 DEBUG:boto:Method: GET 2023-12-15T22:55:44.307 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.307 DEBUG:boto:Data: 2023-12-15T22:55:44.307 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.307 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.307 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.307 DEBUG:boto:Params: {} 2023-12-15T22:55:44.307 DEBUG:boto:Token: None 2023-12-15T22:55:44.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.310 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a4966352884ea35c-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.310 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:55:44.310 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:55:44.310 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.310 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.310 DEBUG:boto:Method: GET 2023-12-15T22:55:44.310 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.310 DEBUG:boto:Data: 2023-12-15T22:55:44.310 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.311 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.311 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.311 DEBUG:boto:Params: {} 2023-12-15T22:55:44.311 DEBUG:boto:Token: None 2023-12-15T22:55:44.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:55:44.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc= 2023-12-15T22:55:44.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S7csqIgX9nH4Ij14fERtybwKrmc=', 'Content-Length': '0'} 2023-12-15T22:55:44.313 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002cc6b4bf1feead6f-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.313 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.313 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.314 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.314 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.314 DEBUG:boto:Method: GET 2023-12-15T22:55:44.314 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.314 DEBUG:boto:Data: 2023-12-15T22:55:44.314 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.314 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.314 DEBUG:boto:Params: {} 2023-12-15T22:55:44.314 DEBUG:boto:Token: None 2023-12-15T22:55:44.314 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a99cc6ad40feb02c-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.357 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.358 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.358 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.358 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.358 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.358 DEBUG:boto:Method: GET 2023-12-15T22:55:44.358 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:55:44.358 DEBUG:boto:Data: 2023-12-15T22:55:44.359 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.359 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.359 DEBUG:boto:Params: {} 2023-12-15T22:55:44.359 DEBUG:boto:Token: None 2023-12-15T22:55:44.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d5f92e525cca917-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.361 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:44.362 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.362 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.362 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.362 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.362 DEBUG:boto:Method: GET 2023-12-15T22:55:44.362 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.362 DEBUG:boto:Data: 2023-12-15T22:55:44.362 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.363 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.363 DEBUG:boto:Params: {} 2023-12-15T22:55:44.363 DEBUG:boto:Token: None 2023-12-15T22:55:44.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.366 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000036bdce927393694b-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.413 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.414 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.414 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.414 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.414 DEBUG:boto:Method: GET 2023-12-15T22:55:44.414 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.414 DEBUG:boto:Data: 2023-12-15T22:55:44.414 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.414 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.414 DEBUG:boto:Params: {} 2023-12-15T22:55:44.415 DEBUG:boto:Token: None 2023-12-15T22:55:44.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.417 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002cda240f97830c48-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.417 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.417 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.417 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.417 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.417 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.418 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.418 DEBUG:boto:Data: 2023-12-15T22:55:44.418 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.418 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.418 DEBUG:boto:Params: {} 2023-12-15T22:55:44.418 DEBUG:boto:Token: None 2023-12-15T22:55:44.418 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xGQHa1Kfjd0AsL3ZDiLytUhvjSM= 2023-12-15T22:55:44.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xGQHa1Kfjd0AsL3ZDiLytUhvjSM=', 'Content-Length': '0'} 2023-12-15T22:55:44.420 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000de63ca55d965f376-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.420 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.420 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.420 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.421 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.421 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.421 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.421 DEBUG:boto:Data: 2023-12-15T22:55:44.421 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.421 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.421 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.421 DEBUG:boto:Params: {} 2023-12-15T22:55:44.421 DEBUG:boto:Token: None 2023-12-15T22:55:44.421 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.422 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xGQHa1Kfjd0AsL3ZDiLytUhvjSM= 2023-12-15T22:55:44.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xGQHa1Kfjd0AsL3ZDiLytUhvjSM=', 'Content-Length': '0'} 2023-12-15T22:55:44.423 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006d772ab59f4ef17d-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:44.424 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.424 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.424 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.424 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.424 DEBUG:boto:Method: GET 2023-12-15T22:55:44.424 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.424 DEBUG:boto:Data: 2023-12-15T22:55:44.424 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.424 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.424 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.424 DEBUG:boto:Params: {} 2023-12-15T22:55:44.425 DEBUG:boto:Token: None 2023-12-15T22:55:44.425 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.425 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.427 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000050df9fd14f6dc09c-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.469 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.470 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.470 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.470 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.470 DEBUG:boto:Method: GET 2023-12-15T22:55:44.470 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.470 DEBUG:boto:Data: 2023-12-15T22:55:44.470 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.470 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.470 DEBUG:boto:Params: {} 2023-12-15T22:55:44.471 DEBUG:boto:Token: None 2023-12-15T22:55:44.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.473 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000025ff516ca27a016-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.473 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.473 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.473 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.473 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.473 DEBUG:boto:Method: GET 2023-12-15T22:55:44.473 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.473 DEBUG:boto:Data: 2023-12-15T22:55:44.474 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.474 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.474 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.474 DEBUG:boto:Params: {} 2023-12-15T22:55:44.474 DEBUG:boto:Token: None 2023-12-15T22:55:44.474 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.474 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004087035fbdc220e3-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.517 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.518 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.518 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.518 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.518 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.518 DEBUG:boto:Method: GET 2023-12-15T22:55:44.518 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.518 DEBUG:boto:Data: 2023-12-15T22:55:44.519 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.519 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.519 DEBUG:boto:Params: {} 2023-12-15T22:55:44.519 DEBUG:boto:Token: None 2023-12-15T22:55:44.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047831a37425108d8-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.522 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.522 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.522 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.522 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.522 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.522 DEBUG:boto:Data: 2023-12-15T22:55:44.522 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.523 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.523 DEBUG:boto:Params: {} 2023-12-15T22:55:44.523 DEBUG:boto:Token: None 2023-12-15T22:55:44.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hCgDOVHCilIsBUS3Q3Kg59X5Zfc= 2023-12-15T22:55:44.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hCgDOVHCilIsBUS3Q3Kg59X5Zfc=', 'Content-Length': '0'} 2023-12-15T22:55:44.525 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000018aed0e3976d273a-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.525 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.525 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.526 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.526 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.526 DEBUG:boto:Data: 2023-12-15T22:55:44.526 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.526 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.526 DEBUG:boto:Params: {} 2023-12-15T22:55:44.526 DEBUG:boto:Token: None 2023-12-15T22:55:44.526 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hCgDOVHCilIsBUS3Q3Kg59X5Zfc= 2023-12-15T22:55:44.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hCgDOVHCilIsBUS3Q3Kg59X5Zfc=', 'Content-Length': '0'} 2023-12-15T22:55:44.528 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b7476e30080b330f-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:44.529 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.529 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.529 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.529 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.529 DEBUG:boto:Method: GET 2023-12-15T22:55:44.529 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.529 DEBUG:boto:Data: 2023-12-15T22:55:44.529 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.530 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.530 DEBUG:boto:Params: {} 2023-12-15T22:55:44.530 DEBUG:boto:Token: None 2023-12-15T22:55:44.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.532 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000032aee3eaa52f9891-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.573 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.573 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:44.574 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.574 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.574 DEBUG:boto:Method: GET 2023-12-15T22:55:44.574 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.574 DEBUG:boto:Data: 2023-12-15T22:55:44.574 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.574 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.574 DEBUG:boto:Params: {} 2023-12-15T22:55:44.574 DEBUG:boto:Token: None 2023-12-15T22:55:44.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:55:44.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o= 2023-12-15T22:55:44.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J27hszoOBTUlruIlZyyJeSb+d0o=', 'Content-Length': '0'} 2023-12-15T22:55:44.576 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004408ad3d9b29d8a8-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.577 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.577 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.577 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.577 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.577 DEBUG:boto:Method: GET 2023-12-15T22:55:44.577 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.577 DEBUG:boto:Data: 2023-12-15T22:55:44.577 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.577 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.577 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.578 DEBUG:boto:Params: {} 2023-12-15T22:55:44.578 DEBUG:boto:Token: None 2023-12-15T22:55:44.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a46bdcfab944c5c0-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.580 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.581 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.581 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.581 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.581 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.581 DEBUG:boto:Method: GET 2023-12-15T22:55:44.581 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:55:44.581 DEBUG:boto:Data: 2023-12-15T22:55:44.581 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.582 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.582 DEBUG:boto:Params: {} 2023-12-15T22:55:44.582 DEBUG:boto:Token: None 2023-12-15T22:55:44.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ecbd17bbb1d193aa-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.585 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.585 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:44.585 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.585 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.585 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.585 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.585 DEBUG:boto:Method: GET 2023-12-15T22:55:44.586 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.586 DEBUG:boto:Data: 2023-12-15T22:55:44.586 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.586 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.586 DEBUG:boto:Params: {} 2023-12-15T22:55:44.586 DEBUG:boto:Token: None 2023-12-15T22:55:44.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.588 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000abacfb3e24941734-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.589 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.589 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.589 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.589 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.589 DEBUG:boto:Method: GET 2023-12-15T22:55:44.589 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.589 DEBUG:boto:Data: 2023-12-15T22:55:44.589 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.589 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.590 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.590 DEBUG:boto:Params: {} 2023-12-15T22:55:44.590 DEBUG:boto:Token: None 2023-12-15T22:55:44.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.592 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000da3da5c4a1ac3e1-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.592 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.593 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.593 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.593 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.593 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.593 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.593 DEBUG:boto:Data: 2023-12-15T22:55:44.593 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.593 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.593 DEBUG:boto:Params: {} 2023-12-15T22:55:44.594 DEBUG:boto:Token: None 2023-12-15T22:55:44.594 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wU/yuoVnr5oeePKh57QQGKKlgpw= 2023-12-15T22:55:44.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wU/yuoVnr5oeePKh57QQGKKlgpw=', 'Content-Length': '0'} 2023-12-15T22:55:44.596 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008b808f369c74a3e3-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.596 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.596 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.596 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.597 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.597 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.597 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.597 DEBUG:boto:Data: 2023-12-15T22:55:44.597 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.597 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.597 DEBUG:boto:Params: {} 2023-12-15T22:55:44.597 DEBUG:boto:Token: None 2023-12-15T22:55:44.597 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wU/yuoVnr5oeePKh57QQGKKlgpw= 2023-12-15T22:55:44.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wU/yuoVnr5oeePKh57QQGKKlgpw=', 'Content-Length': '0'} 2023-12-15T22:55:44.600 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009083aacd2678a608-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:44.600 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.600 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.601 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.601 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.601 DEBUG:boto:Method: GET 2023-12-15T22:55:44.601 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.601 DEBUG:boto:Data: 2023-12-15T22:55:44.601 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.601 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.601 DEBUG:boto:Params: {} 2023-12-15T22:55:44.601 DEBUG:boto:Token: None 2023-12-15T22:55:44.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.604 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f0f3f8e37ee6258d-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.604 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.604 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.604 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.604 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.605 DEBUG:boto:Method: GET 2023-12-15T22:55:44.605 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.605 DEBUG:boto:Data: 2023-12-15T22:55:44.605 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.605 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.605 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.605 DEBUG:boto:Params: {} 2023-12-15T22:55:44.605 DEBUG:boto:Token: None 2023-12-15T22:55:44.605 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.605 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.608 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d4fa1ac28c00aeab-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.608 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.608 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.608 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.609 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.609 DEBUG:boto:Method: GET 2023-12-15T22:55:44.609 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.609 DEBUG:boto:Data: 2023-12-15T22:55:44.609 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.609 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.609 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.609 DEBUG:boto:Params: {} 2023-12-15T22:55:44.609 DEBUG:boto:Token: None 2023-12-15T22:55:44.609 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044faab963644a8b5-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.612 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.612 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.612 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.613 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.613 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.613 DEBUG:boto:Method: GET 2023-12-15T22:55:44.613 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.613 DEBUG:boto:Data: 2023-12-15T22:55:44.613 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.613 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.613 DEBUG:boto:Params: {} 2023-12-15T22:55:44.613 DEBUG:boto:Token: None 2023-12-15T22:55:44.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.616 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028f56dce6e231680-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.616 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.616 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.616 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.616 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.616 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.616 DEBUG:boto:Data: 2023-12-15T22:55:44.617 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.617 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.617 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.617 DEBUG:boto:Params: {} 2023-12-15T22:55:44.617 DEBUG:boto:Token: None 2023-12-15T22:55:44.617 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KJ7nvkOeq23j23+F9Yw52XUmFt4= 2023-12-15T22:55:44.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KJ7nvkOeq23j23+F9Yw52XUmFt4=', 'Content-Length': '0'} 2023-12-15T22:55:44.620 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000014d4d4406e22b329-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.620 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.620 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.620 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.620 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.621 DEBUG:boto:Data: 2023-12-15T22:55:44.621 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.621 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.621 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.621 DEBUG:boto:Params: {} 2023-12-15T22:55:44.621 DEBUG:boto:Token: None 2023-12-15T22:55:44.621 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.621 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KJ7nvkOeq23j23+F9Yw52XUmFt4= 2023-12-15T22:55:44.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KJ7nvkOeq23j23+F9Yw52XUmFt4=', 'Content-Length': '0'} 2023-12-15T22:55:44.624 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000660db899056f5826-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:44.624 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.625 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.625 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.625 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.625 DEBUG:boto:Method: GET 2023-12-15T22:55:44.625 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.625 DEBUG:boto:Data: 2023-12-15T22:55:44.625 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.625 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.625 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.626 DEBUG:boto:Params: {} 2023-12-15T22:55:44.626 DEBUG:boto:Token: None 2023-12-15T22:55:44.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.628 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002fa077dd61b9b2ad-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.629 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.629 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:44.629 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.629 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.629 DEBUG:boto:Method: GET 2023-12-15T22:55:44.629 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.630 DEBUG:boto:Data: 2023-12-15T22:55:44.630 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.630 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.630 DEBUG:boto:Params: {} 2023-12-15T22:55:44.630 DEBUG:boto:Token: None 2023-12-15T22:55:44.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:55:44.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc= 2023-12-15T22:55:44.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkTZmyicokB9I7CK+4OhPD2/Vcc=', 'Content-Length': '0'} 2023-12-15T22:55:44.633 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007474fe3d87ecb5f9-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.633 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.633 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.633 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.634 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.634 DEBUG:boto:Method: GET 2023-12-15T22:55:44.634 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.634 DEBUG:boto:Data: 2023-12-15T22:55:44.634 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.634 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.634 DEBUG:boto:Params: {} 2023-12-15T22:55:44.634 DEBUG:boto:Token: None 2023-12-15T22:55:44.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.637 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6651795b44dffc3-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.637 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.638 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:44.638 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:44.638 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.638 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.638 DEBUG:boto:Method: GET 2023-12-15T22:55:44.638 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:55:44.638 DEBUG:boto:Data: 2023-12-15T22:55:44.638 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.639 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.639 DEBUG:boto:Params: {} 2023-12-15T22:55:44.639 DEBUG:boto:Token: None 2023-12-15T22:55:44.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-11/ 2023-12-15T22:55:44.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms= 2023-12-15T22:55:44.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6YyiRS5mQ/udXfcH8OLpQ6cZms=', 'Content-Length': '0'} 2023-12-15T22:55:44.641 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d623bf3e314e8f9-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.642 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.642 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-11 zones={test-zone2, test-zone1} 2023-12-15T22:55:44.642 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-12 2023-12-15T22:55:44.642 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.643 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:44.703 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:44.703 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:44.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:44.741+0000 7f54a8723800 1 bucket sync caught up with source: 2023-12-15T22:55:44.741 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.25.6, , 00000000002.13.11, , 00000000002.10.11, , , , , ] 2023-12-15T22:55:44.741 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000010.25.6, , 00000000002.13.11, , 00000000002.10.11, , , , , ] 2023-12-15T22:55:44.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:44.741+0000 7f54a8723800 0 bucket checkpoint complete 2023-12-15T22:55:44.755 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-12 2023-12-15T22:55:44.756 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:44.756 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:44.817 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:44.817 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:44.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:44.858+0000 7f25589ad800 1 bucket sync caught up with source: 2023-12-15T22:55:44.858 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.23.11, , 00000000010.37.6, , 00000000003.21.10, , , , , ] 2023-12-15T22:55:44.858 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.23.11, , 00000000010.37.6, , 00000000003.21.10, , , , , ] 2023-12-15T22:55:44.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:55:44.858+0000 7f25589ad800 0 bucket checkpoint complete 2023-12-15T22:55:44.873 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-12 zones={test-zone2, test-zone1} 2023-12-15T22:55:44.873 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.873 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.873 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.873 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:44.873 DEBUG:boto:Data: 2023-12-15T22:55:44.873 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.874 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.874 DEBUG:boto:Params: {} 2023-12-15T22:55:44.874 DEBUG:boto:Token: None 2023-12-15T22:55:44.874 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8DiP9/gUcayx56l87fPtTqewaYM= 2023-12-15T22:55:44.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8DiP9/gUcayx56l87fPtTqewaYM=', 'Content-Length': '0'} 2023-12-15T22:55:44.876 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf4c169e5b950a70-00657cd970-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.876 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.877 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.877 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.877 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:44.877 DEBUG:boto:Data: 2023-12-15T22:55:44.877 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.877 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.877 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.877 DEBUG:boto:Params: {} 2023-12-15T22:55:44.877 DEBUG:boto:Token: None 2023-12-15T22:55:44.877 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8DiP9/gUcayx56l87fPtTqewaYM= 2023-12-15T22:55:44.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8DiP9/gUcayx56l87fPtTqewaYM=', 'Content-Length': '0'} 2023-12-15T22:55:44.880 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f09d7a3523123b43-00657cd970-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.880 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:55:44.880 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.881 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.881 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.881 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.881 DEBUG:boto:Method: GET 2023-12-15T22:55:44.881 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.881 DEBUG:boto:Data: 2023-12-15T22:55:44.881 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.881 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.881 DEBUG:boto:Params: {} 2023-12-15T22:55:44.881 DEBUG:boto:Token: None 2023-12-15T22:55:44.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/?versions 2023-12-15T22:55:44.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow= 2023-12-15T22:55:44.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow=', 'Content-Length': '0'} 2023-12-15T22:55:44.884 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a05a2f6e806e355-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.884 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:55:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:55:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:55:44.885 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:55:44.885 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.885 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.885 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.885 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.885 DEBUG:boto:Method: GET 2023-12-15T22:55:44.885 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.885 DEBUG:boto:Data: 2023-12-15T22:55:44.885 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.885 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.886 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.886 DEBUG:boto:Params: {} 2023-12-15T22:55:44.886 DEBUG:boto:Token: None 2023-12-15T22:55:44.886 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/?versions 2023-12-15T22:55:44.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow= 2023-12-15T22:55:44.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow=', 'Content-Length': '0'} 2023-12-15T22:55:44.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017398e3caa6cae1b-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.888 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.889 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:55:44.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:55:44.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:55:44.889 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.889 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.889 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.889 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.889 DEBUG:boto:Method: GET 2023-12-15T22:55:44.889 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.889 DEBUG:boto:Data: 2023-12-15T22:55:44.890 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.890 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.890 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.890 DEBUG:boto:Params: {} 2023-12-15T22:55:44.890 DEBUG:boto:Token: None 2023-12-15T22:55:44.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/?versions 2023-12-15T22:55:44.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow= 2023-12-15T22:55:44.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow=', 'Content-Length': '0'} 2023-12-15T22:55:44.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6d50e393fdfffca-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.893 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.893 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.893 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.893 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.893 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.893 DEBUG:boto:Method: GET 2023-12-15T22:55:44.894 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:55:44.894 DEBUG:boto:Data: 2023-12-15T22:55:44.894 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.894 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.894 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.894 DEBUG:boto:Params: {} 2023-12-15T22:55:44.894 DEBUG:boto:Token: None 2023-12-15T22:55:44.894 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/?versions 2023-12-15T22:55:44.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow= 2023-12-15T22:55:44.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J4R3fmxsKzDn4lWaf5RzcdqCiow=', 'Content-Length': '0'} 2023-12-15T22:55:44.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d39bb329d7cac60-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.896 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.897 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.897 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.897 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.897 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.897 DEBUG:boto:Method: GET 2023-12-15T22:55:44.897 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.898 DEBUG:boto:Data: 2023-12-15T22:55:44.898 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.898 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.898 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.898 DEBUG:boto:Params: {} 2023-12-15T22:55:44.898 DEBUG:boto:Token: None 2023-12-15T22:55:44.898 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.898 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.900 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002e72abe01b1a01b0-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.900 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.900 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.901 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.901 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.901 DEBUG:boto:Method: GET 2023-12-15T22:55:44.901 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.901 DEBUG:boto:Data: 2023-12-15T22:55:44.901 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.901 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.901 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.901 DEBUG:boto:Params: {} 2023-12-15T22:55:44.901 DEBUG:boto:Token: None 2023-12-15T22:55:44.901 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.902 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.904 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008fcb946bbdce489c-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.904 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.904 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.904 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.904 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.904 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.904 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.905 DEBUG:boto:Data: 2023-12-15T22:55:44.905 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.905 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.905 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.905 DEBUG:boto:Params: {} 2023-12-15T22:55:44.905 DEBUG:boto:Token: None 2023-12-15T22:55:44.905 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.905 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:38dcnhSYNejJX/0xHdFCaplbDd8= 2023-12-15T22:55:44.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:38dcnhSYNejJX/0xHdFCaplbDd8=', 'Content-Length': '0'} 2023-12-15T22:55:44.907 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000aad2d0674197af2e-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.907 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.907 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.908 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.908 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.908 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.908 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.908 DEBUG:boto:Data: 2023-12-15T22:55:44.908 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.908 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.908 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.908 DEBUG:boto:Params: {} 2023-12-15T22:55:44.908 DEBUG:boto:Token: None 2023-12-15T22:55:44.908 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.909 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:38dcnhSYNejJX/0xHdFCaplbDd8= 2023-12-15T22:55:44.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:38dcnhSYNejJX/0xHdFCaplbDd8=', 'Content-Length': '0'} 2023-12-15T22:55:44.911 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005b14837853360e5a-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.911 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.911 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.911 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.911 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.911 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.911 DEBUG:boto:Method: GET 2023-12-15T22:55:44.912 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.912 DEBUG:boto:Data: 2023-12-15T22:55:44.912 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.912 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.912 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.912 DEBUG:boto:Params: {} 2023-12-15T22:55:44.912 DEBUG:boto:Token: None 2023-12-15T22:55:44.912 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.914 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000445773258134c609-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.914 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.914 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.915 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.915 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.915 DEBUG:boto:Method: GET 2023-12-15T22:55:44.915 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.915 DEBUG:boto:Data: 2023-12-15T22:55:44.915 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.915 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.915 DEBUG:boto:Params: {} 2023-12-15T22:55:44.915 DEBUG:boto:Token: None 2023-12-15T22:55:44.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.918 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f117a725cb628c6b-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.918 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.918 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.918 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.918 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.918 DEBUG:boto:Method: GET 2023-12-15T22:55:44.918 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.918 DEBUG:boto:Data: 2023-12-15T22:55:44.919 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.919 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.919 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.919 DEBUG:boto:Params: {} 2023-12-15T22:55:44.919 DEBUG:boto:Token: None 2023-12-15T22:55:44.919 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE= 2023-12-15T22:55:44.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE=', 'Content-Length': '0'} 2023-12-15T22:55:44.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097b86d9fbb6af76b-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.965 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.966 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.966 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.966 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.966 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.966 DEBUG:boto:Method: GET 2023-12-15T22:55:44.966 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.966 DEBUG:boto:Data: 2023-12-15T22:55:44.966 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.967 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.967 DEBUG:boto:Params: {} 2023-12-15T22:55:44.967 DEBUG:boto:Token: None 2023-12-15T22:55:44.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE= 2023-12-15T22:55:44.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE=', 'Content-Length': '0'} 2023-12-15T22:55:44.969 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c84c1714d5d6e9f-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.969 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.970 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.970 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.970 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.970 DEBUG:boto:Path: /kskgfn-12/dummy 2023-12-15T22:55:44.970 DEBUG:boto:Data: 2023-12-15T22:55:44.970 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.970 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.970 DEBUG:boto:Params: {} 2023-12-15T22:55:44.971 DEBUG:boto:Token: None 2023-12-15T22:55:44.971 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy 2023-12-15T22:55:44.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2RwRhmeIYxcVPOBq5//lCmYECk= 2023-12-15T22:55:44.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2RwRhmeIYxcVPOBq5//lCmYECk=', 'Content-Length': '0'} 2023-12-15T22:55:44.973 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e40c76324c197c81-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.973 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.974 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.974 DEBUG:boto:Method: HEAD 2023-12-15T22:55:44.974 DEBUG:boto:Path: /kskgfn-12/dummy 2023-12-15T22:55:44.974 DEBUG:boto:Data: 2023-12-15T22:55:44.974 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.974 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.974 DEBUG:boto:Params: {} 2023-12-15T22:55:44.974 DEBUG:boto:Token: None 2023-12-15T22:55:44.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy 2023-12-15T22:55:44.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2RwRhmeIYxcVPOBq5//lCmYECk= 2023-12-15T22:55:44.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2RwRhmeIYxcVPOBq5//lCmYECk=', 'Content-Length': '0'} 2023-12-15T22:55:44.977 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ddb022e0b6c6abec-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:55:44.977 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.977 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.977 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.977 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.978 DEBUG:boto:Method: GET 2023-12-15T22:55:44.978 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.978 DEBUG:boto:Data: 2023-12-15T22:55:44.978 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.978 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.978 DEBUG:boto:Params: {} 2023-12-15T22:55:44.978 DEBUG:boto:Token: None 2023-12-15T22:55:44.978 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.980 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000874059ac067f45fe-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.980 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:55:44.981 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:55:44.981 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.981 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.981 DEBUG:boto:Method: GET 2023-12-15T22:55:44.981 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.981 DEBUG:boto:Data: 2023-12-15T22:55:44.981 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.981 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.981 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.981 DEBUG:boto:Params: {} 2023-12-15T22:55:44.981 DEBUG:boto:Token: None 2023-12-15T22:55:44.982 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:55:44.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4= 2023-12-15T22:55:44.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i+LrGCV6zHmZ5/Echu+LxlIF1i4=', 'Content-Length': '0'} 2023-12-15T22:55:44.983 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004f1118e41aaf359a-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.984 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.984 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.984 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.984 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.984 DEBUG:boto:Method: GET 2023-12-15T22:55:44.984 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.984 DEBUG:boto:Data: 2023-12-15T22:55:44.984 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.984 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.984 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.984 DEBUG:boto:Params: {} 2023-12-15T22:55:44.985 DEBUG:boto:Token: None 2023-12-15T22:55:44.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE= 2023-12-15T22:55:44.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE=', 'Content-Length': '0'} 2023-12-15T22:55:44.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077be1898638ae8a6-00657cd970-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.987 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.988 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:44.988 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:44.988 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.988 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.988 DEBUG:boto:Method: GET 2023-12-15T22:55:44.988 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:55:44.988 DEBUG:boto:Data: 2023-12-15T22:55:44.988 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.988 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.988 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.988 DEBUG:boto:Params: {} 2023-12-15T22:55:44.988 DEBUG:boto:Token: None 2023-12-15T22:55:44.989 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/ 2023-12-15T22:55:44.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE= 2023-12-15T22:55:44.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3wfubtDJslDAZ6pdfMEIQ+gq6RE=', 'Content-Length': '0'} 2023-12-15T22:55:44.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef7956bf507ad9a1-00657cd970-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.991 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:44.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:44.992 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:44.992 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:44.992 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.992 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.992 DEBUG:boto:Method: GET 2023-12-15T22:55:44.992 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.992 DEBUG:boto:Data: 2023-12-15T22:55:44.992 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.992 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:44.992 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.992 DEBUG:boto:Params: {} 2023-12-15T22:55:44.992 DEBUG:boto:Token: None 2023-12-15T22:55:44.993 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.993 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PH5iiB/vvBiDwf9AhrX3uX0k3FM= 2023-12-15T22:55:44.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PH5iiB/vvBiDwf9AhrX3uX0k3FM=', 'Content-Length': '0'} 2023-12-15T22:55:44.995 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000050a6ac851a7746c4-00657cd970-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:44.995 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:44.995 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:44.995 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.995 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.995 DEBUG:boto:Method: GET 2023-12-15T22:55:44.995 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.995 DEBUG:boto:Data: 2023-12-15T22:55:44.996 DEBUG:boto:Headers: {} 2023-12-15T22:55:44.996 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:44.996 DEBUG:boto:Port: 8000 2023-12-15T22:55:44.996 DEBUG:boto:Params: {} 2023-12-15T22:55:44.996 DEBUG:boto:Token: None 2023-12-15T22:55:44.996 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:44 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:44.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PH5iiB/vvBiDwf9AhrX3uX0k3FM= 2023-12-15T22:55:44.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PH5iiB/vvBiDwf9AhrX3uX0k3FM=', 'Content-Length': '0'} 2023-12-15T22:55:44.998 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000011344c7d3c42a813-00657cd970-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.041 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.042 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.042 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.042 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.042 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.042 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.042 DEBUG:boto:Data: 2023-12-15T22:55:45.042 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.042 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.042 DEBUG:boto:Params: {} 2023-12-15T22:55:45.042 DEBUG:boto:Token: None 2023-12-15T22:55:45.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M2eSBhrtQgEXNT5ag3ZnSNS09eM= 2023-12-15T22:55:45.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M2eSBhrtQgEXNT5ag3ZnSNS09eM=', 'Content-Length': '0'} 2023-12-15T22:55:45.044 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003569305ec429528b-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.045 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.045 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.045 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.045 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.045 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.045 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.045 DEBUG:boto:Data: 2023-12-15T22:55:45.045 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.045 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.045 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.045 DEBUG:boto:Params: {} 2023-12-15T22:55:45.046 DEBUG:boto:Token: None 2023-12-15T22:55:45.046 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M2eSBhrtQgEXNT5ag3ZnSNS09eM= 2023-12-15T22:55:45.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M2eSBhrtQgEXNT5ag3ZnSNS09eM=', 'Content-Length': '0'} 2023-12-15T22:55:45.048 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000075a1ca9dcb752c93-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:45.048 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.048 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.048 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.048 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.048 DEBUG:boto:Method: GET 2023-12-15T22:55:45.048 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.049 DEBUG:boto:Data: 2023-12-15T22:55:45.049 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.049 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.049 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.049 DEBUG:boto:Params: {} 2023-12-15T22:55:45.049 DEBUG:boto:Token: None 2023-12-15T22:55:45.049 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.049 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA= 2023-12-15T22:55:45.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA=', 'Content-Length': '0'} 2023-12-15T22:55:45.051 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e875f78a0fc8ec78-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.093 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.094 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.094 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.094 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.094 DEBUG:boto:Method: GET 2023-12-15T22:55:45.094 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.094 DEBUG:boto:Data: 2023-12-15T22:55:45.094 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.094 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.094 DEBUG:boto:Params: {} 2023-12-15T22:55:45.094 DEBUG:boto:Token: None 2023-12-15T22:55:45.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA= 2023-12-15T22:55:45.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA=', 'Content-Length': '0'} 2023-12-15T22:55:45.096 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000608df2488c04cdbd-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.097 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.097 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.097 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.097 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.097 DEBUG:boto:Method: GET 2023-12-15T22:55:45.097 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.097 DEBUG:boto:Data: 2023-12-15T22:55:45.098 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.098 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.098 DEBUG:boto:Params: {} 2023-12-15T22:55:45.098 DEBUG:boto:Token: None 2023-12-15T22:55:45.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd1914339e999440-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.100 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.101 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.101 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.101 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.101 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.101 DEBUG:boto:Method: GET 2023-12-15T22:55:45.101 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.101 DEBUG:boto:Data: 2023-12-15T22:55:45.101 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.101 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.102 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.102 DEBUG:boto:Params: {} 2023-12-15T22:55:45.102 DEBUG:boto:Token: None 2023-12-15T22:55:45.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024af1fb3b7d8ad4f-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.104 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.105 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.105 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.105 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.105 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.105 DEBUG:boto:Data: 2023-12-15T22:55:45.105 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.105 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.105 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.105 DEBUG:boto:Params: {} 2023-12-15T22:55:45.105 DEBUG:boto:Token: None 2023-12-15T22:55:45.106 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cxerBANNBiVCuXayp30/5L6vh28= 2023-12-15T22:55:45.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cxerBANNBiVCuXayp30/5L6vh28=', 'Content-Length': '0'} 2023-12-15T22:55:45.107 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000001a529b1fe1466ca-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.108 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.108 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.108 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.108 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.108 DEBUG:boto:Data: 2023-12-15T22:55:45.108 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.108 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.108 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.109 DEBUG:boto:Params: {} 2023-12-15T22:55:45.109 DEBUG:boto:Token: None 2023-12-15T22:55:45.109 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cxerBANNBiVCuXayp30/5L6vh28= 2023-12-15T22:55:45.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cxerBANNBiVCuXayp30/5L6vh28=', 'Content-Length': '0'} 2023-12-15T22:55:45.111 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000f7adcb2587374a0-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:55:45.111 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.112 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.112 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.112 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.112 DEBUG:boto:Method: GET 2023-12-15T22:55:45.112 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.112 DEBUG:boto:Data: 2023-12-15T22:55:45.112 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.112 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.112 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.112 DEBUG:boto:Params: {} 2023-12-15T22:55:45.112 DEBUG:boto:Token: None 2023-12-15T22:55:45.112 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.113 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA= 2023-12-15T22:55:45.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA=', 'Content-Length': '0'} 2023-12-15T22:55:45.114 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f6362e9be5871bc7-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.157 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.158 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.158 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.158 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.158 DEBUG:boto:Method: GET 2023-12-15T22:55:45.158 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.158 DEBUG:boto:Data: 2023-12-15T22:55:45.158 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.158 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.159 DEBUG:boto:Params: {} 2023-12-15T22:55:45.159 DEBUG:boto:Token: None 2023-12-15T22:55:45.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:55:45.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA= 2023-12-15T22:55:45.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AoJVffwdxVNR5wSvs97HuCozQSA=', 'Content-Length': '0'} 2023-12-15T22:55:45.161 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d1da3f32d770c57c-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.161 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.161 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.161 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.161 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.161 DEBUG:boto:Method: GET 2023-12-15T22:55:45.162 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.162 DEBUG:boto:Data: 2023-12-15T22:55:45.162 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.162 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.162 DEBUG:boto:Params: {} 2023-12-15T22:55:45.162 DEBUG:boto:Token: None 2023-12-15T22:55:45.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000351e91d2ff75d9c6-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.205 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.206 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.206 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.206 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.206 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.206 DEBUG:boto:Method: GET 2023-12-15T22:55:45.206 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:55:45.206 DEBUG:boto:Data: 2023-12-15T22:55:45.206 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.207 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.207 DEBUG:boto:Params: {} 2023-12-15T22:55:45.207 DEBUG:boto:Token: None 2023-12-15T22:55:45.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043e8488b7e45a713-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.210 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:45.210 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.210 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.210 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.210 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.210 DEBUG:boto:Method: GET 2023-12-15T22:55:45.210 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.211 DEBUG:boto:Data: 2023-12-15T22:55:45.211 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.211 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.211 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.211 DEBUG:boto:Params: {} 2023-12-15T22:55:45.211 DEBUG:boto:Token: None 2023-12-15T22:55:45.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.213 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000810b0b65f4088bbe-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.213 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.213 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.213 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.213 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.214 DEBUG:boto:Method: GET 2023-12-15T22:55:45.214 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.214 DEBUG:boto:Data: 2023-12-15T22:55:45.214 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.214 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.214 DEBUG:boto:Params: {} 2023-12-15T22:55:45.214 DEBUG:boto:Token: None 2023-12-15T22:55:45.214 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.216 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004c7bae4ee5f424e2-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.217 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.217 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.217 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.217 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.217 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.217 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.217 DEBUG:boto:Data: 2023-12-15T22:55:45.217 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.217 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.218 DEBUG:boto:Params: {} 2023-12-15T22:55:45.218 DEBUG:boto:Token: None 2023-12-15T22:55:45.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vUMpc/WkO7bNgmX771/jxn/Kpto= 2023-12-15T22:55:45.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vUMpc/WkO7bNgmX771/jxn/Kpto=', 'Content-Length': '0'} 2023-12-15T22:55:45.220 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e0cbd558491b6c27-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.220 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.220 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.220 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.221 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.221 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.221 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.221 DEBUG:boto:Data: 2023-12-15T22:55:45.221 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.221 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.221 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.221 DEBUG:boto:Params: {} 2023-12-15T22:55:45.221 DEBUG:boto:Token: None 2023-12-15T22:55:45.222 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vUMpc/WkO7bNgmX771/jxn/Kpto= 2023-12-15T22:55:45.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vUMpc/WkO7bNgmX771/jxn/Kpto=', 'Content-Length': '0'} 2023-12-15T22:55:45.224 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000023336aecfc94d6e9-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:45.224 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.224 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.224 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.224 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.225 DEBUG:boto:Method: GET 2023-12-15T22:55:45.225 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.225 DEBUG:boto:Data: 2023-12-15T22:55:45.225 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.225 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.225 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.225 DEBUG:boto:Params: {} 2023-12-15T22:55:45.225 DEBUG:boto:Token: None 2023-12-15T22:55:45.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.227 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c65212d4535f4931-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.227 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.227 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.228 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.228 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.228 DEBUG:boto:Method: GET 2023-12-15T22:55:45.228 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.228 DEBUG:boto:Data: 2023-12-15T22:55:45.228 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.228 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.228 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.228 DEBUG:boto:Params: {} 2023-12-15T22:55:45.228 DEBUG:boto:Token: None 2023-12-15T22:55:45.228 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.230 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000f88b174f0527c67-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.231 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.231 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.231 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.231 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.231 DEBUG:boto:Method: GET 2023-12-15T22:55:45.231 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.231 DEBUG:boto:Data: 2023-12-15T22:55:45.231 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.231 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.231 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.231 DEBUG:boto:Params: {} 2023-12-15T22:55:45.232 DEBUG:boto:Token: None 2023-12-15T22:55:45.232 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.234 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009061e76e55bcd115-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.234 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.234 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.234 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.235 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.235 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.235 DEBUG:boto:Method: GET 2023-12-15T22:55:45.235 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.235 DEBUG:boto:Data: 2023-12-15T22:55:45.235 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.235 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.235 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.235 DEBUG:boto:Params: {} 2023-12-15T22:55:45.235 DEBUG:boto:Token: None 2023-12-15T22:55:45.236 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.236 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063e280e84771a9c2-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.281 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.282 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.282 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.282 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.282 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.282 DEBUG:boto:Data: 2023-12-15T22:55:45.282 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.282 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.282 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.283 DEBUG:boto:Params: {} 2023-12-15T22:55:45.283 DEBUG:boto:Token: None 2023-12-15T22:55:45.283 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mRfkNuxP9FVa+fOeXykgyAIXZ0Y= 2023-12-15T22:55:45.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mRfkNuxP9FVa+fOeXykgyAIXZ0Y=', 'Content-Length': '0'} 2023-12-15T22:55:45.285 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fb33f07a311606b7-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.285 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.285 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.286 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.286 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.286 DEBUG:boto:Data: 2023-12-15T22:55:45.286 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.286 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.286 DEBUG:boto:Params: {} 2023-12-15T22:55:45.286 DEBUG:boto:Token: None 2023-12-15T22:55:45.286 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mRfkNuxP9FVa+fOeXykgyAIXZ0Y= 2023-12-15T22:55:45.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mRfkNuxP9FVa+fOeXykgyAIXZ0Y=', 'Content-Length': '0'} 2023-12-15T22:55:45.288 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000026e216206eadb213-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.289 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:55:45.289 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.289 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.289 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.289 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.289 DEBUG:boto:Method: GET 2023-12-15T22:55:45.289 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.289 DEBUG:boto:Data: 2023-12-15T22:55:45.290 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.290 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.290 DEBUG:boto:Params: {} 2023-12-15T22:55:45.290 DEBUG:boto:Token: None 2023-12-15T22:55:45.290 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.290 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.292 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006e2bb875b8092bb6-00657cd971-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.292 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.292 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.292 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.292 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.292 DEBUG:boto:Method: GET 2023-12-15T22:55:45.293 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.293 DEBUG:boto:Data: 2023-12-15T22:55:45.293 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.293 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.293 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.293 DEBUG:boto:Params: {} 2023-12-15T22:55:45.293 DEBUG:boto:Token: None 2023-12-15T22:55:45.293 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:55:45.293 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY= 2023-12-15T22:55:45.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+Cmy4/8qDP2jflKQJDv8qXNiAY=', 'Content-Length': '0'} 2023-12-15T22:55:45.295 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009dd40f5e232c3a40-00657cd971-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.296 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.296 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.296 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.296 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.296 DEBUG:boto:Method: GET 2023-12-15T22:55:45.296 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.296 DEBUG:boto:Data: 2023-12-15T22:55:45.296 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.296 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.296 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.296 DEBUG:boto:Params: {} 2023-12-15T22:55:45.297 DEBUG:boto:Token: None 2023-12-15T22:55:45.297 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.297 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.299 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af32cc9c2365b9fd-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.300 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.300 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.300 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.300 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.300 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.300 DEBUG:boto:Method: GET 2023-12-15T22:55:45.300 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:55:45.301 DEBUG:boto:Data: 2023-12-15T22:55:45.301 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.301 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.301 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.301 DEBUG:boto:Params: {} 2023-12-15T22:55:45.301 DEBUG:boto:Token: None 2023-12-15T22:55:45.301 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.301 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4= 2023-12-15T22:55:45.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQQvq1cXHpKncDe7caRanP+DFZ4=', 'Content-Length': '0'} 2023-12-15T22:55:45.303 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000095f851396b5bd66-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.304 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.304 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-12 zones={test-zone2, test-zone1} 2023-12-15T22:55:45.304 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:45.304 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:45.304 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.304 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:45.304 DEBUG:boto:Data: 2023-12-15T22:55:45.305 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.305 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.305 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.305 DEBUG:boto:Params: {} 2023-12-15T22:55:45.305 DEBUG:boto:Token: None 2023-12-15T22:55:45.305 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-11/ 2023-12-15T22:55:45.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:g/ke4i7T4NiPxln/uoilWj6UWlc= 2023-12-15T22:55:45.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:g/ke4i7T4NiPxln/uoilWj6UWlc=', 'Content-Length': '0'} 2023-12-15T22:55:45.307 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003e1caf4d220017e9-00657cd971-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.307 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:45.308 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:45.308 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.308 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.308 DEBUG:boto:Method: GET 2023-12-15T22:55:45.308 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.308 DEBUG:boto:Data: 2023-12-15T22:55:45.308 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.308 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.308 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.308 DEBUG:boto:Params: {} 2023-12-15T22:55:45.308 DEBUG:boto:Token: None 2023-12-15T22:55:45.309 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-11/?versions 2023-12-15T22:55:45.309 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rFbpU8Jq37ngEPzbBVtbyRoNHY0= 2023-12-15T22:55:45.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rFbpU8Jq37ngEPzbBVtbyRoNHY0=', 'Content-Length': '0'} 2023-12-15T22:55:45.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a957704731bd8469-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.311 DEBUG:boto:b'kskgfn-11obj-test-zone1999falseobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.311 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:45.311 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:55:45.311 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?acl 2023-12-15T22:55:45.311 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?acl 2023-12-15T22:55:45.312 DEBUG:boto:Method: PUT 2023-12-15T22:55:45.312 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?acl 2023-12-15T22:55:45.312 DEBUG:boto:Data: 2023-12-15T22:55:45.312 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:55:45.312 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.312 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.312 DEBUG:boto:Params: {} 2023-12-15T22:55:45.312 DEBUG:boto:Token: None 2023-12-15T22:55:45.312 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:45 GMT x-amz-acl:public-read /kskgfn-11/obj-test-zone1?acl 2023-12-15T22:55:45.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YczVRScME8Y6/bTg+f/wptqogew= 2023-12-15T22:55:45.313 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YczVRScME8Y6/bTg+f/wptqogew=', 'Content-Length': '0'} 2023-12-15T22:55:45.318 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000551ed4b861c544bd-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.318 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:45.318 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:45.318 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.318 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:55:45.318 DEBUG:boto:Data: 2023-12-15T22:55:45.318 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.319 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.319 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.319 DEBUG:boto:Params: {} 2023-12-15T22:55:45.319 DEBUG:boto:Token: None 2023-12-15T22:55:45.319 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-11/ 2023-12-15T22:55:45.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:g/ke4i7T4NiPxln/uoilWj6UWlc= 2023-12-15T22:55:45.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:g/ke4i7T4NiPxln/uoilWj6UWlc=', 'Content-Length': '0'} 2023-12-15T22:55:45.321 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a69c1dc20c5d982a-00657cd971-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.321 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:55:45.322 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:55:45.322 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.322 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.322 DEBUG:boto:Method: GET 2023-12-15T22:55:45.322 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.322 DEBUG:boto:Data: 2023-12-15T22:55:45.322 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.322 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.322 DEBUG:boto:Params: {} 2023-12-15T22:55:45.322 DEBUG:boto:Token: None 2023-12-15T22:55:45.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-11/?versions 2023-12-15T22:55:45.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rFbpU8Jq37ngEPzbBVtbyRoNHY0= 2023-12-15T22:55:45.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rFbpU8Jq37ngEPzbBVtbyRoNHY0=', 'Content-Length': '0'} 2023-12-15T22:55:45.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b3c5d7b434a9c61-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.325 DEBUG:boto:b'kskgfn-11obj-test-zone2999falseobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.325 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:45.325 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:55:45.325 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?acl 2023-12-15T22:55:45.325 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?acl 2023-12-15T22:55:45.326 DEBUG:boto:Method: PUT 2023-12-15T22:55:45.326 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?acl 2023-12-15T22:55:45.326 DEBUG:boto:Data: 2023-12-15T22:55:45.326 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:55:45.326 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.326 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.326 DEBUG:boto:Params: {} 2023-12-15T22:55:45.326 DEBUG:boto:Token: None 2023-12-15T22:55:45.326 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:45 GMT x-amz-acl:public-read /kskgfn-11/obj-test-zone2?acl 2023-12-15T22:55:45.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C3xpPxbNGx/MHAjgYtc6BEaKHF4= 2023-12-15T22:55:45.327 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C3xpPxbNGx/MHAjgYtc6BEaKHF4=', 'Content-Length': '0'} 2023-12-15T22:55:45.333 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d12549930970e482-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.333 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.333 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.334 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.334 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:45.334 DEBUG:boto:Data: 2023-12-15T22:55:45.334 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.334 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.334 DEBUG:boto:Params: {} 2023-12-15T22:55:45.334 DEBUG:boto:Token: None 2023-12-15T22:55:45.334 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nxe1JKxW6jO0vYj8bwKlbPzIFcs= 2023-12-15T22:55:45.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nxe1JKxW6jO0vYj8bwKlbPzIFcs=', 'Content-Length': '0'} 2023-12-15T22:55:45.336 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000018c23f588e90f420-00657cd971-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.337 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.337 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.337 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.337 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.337 DEBUG:boto:Method: GET 2023-12-15T22:55:45.337 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone1 2023-12-15T22:55:45.337 DEBUG:boto:Data: 2023-12-15T22:55:45.337 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.337 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.338 DEBUG:boto:Params: {} 2023-12-15T22:55:45.338 DEBUG:boto:Token: None 2023-12-15T22:55:45.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/?versions 2023-12-15T22:55:45.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cK3pVEurh2R9wtE+Vyaql9nEggI= 2023-12-15T22:55:45.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cK3pVEurh2R9wtE+Vyaql9nEggI=', 'Content-Length': '0'} 2023-12-15T22:55:45.340 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009548ca7766a811b6-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.381 DEBUG:boto:b'kskgfn-12obj-test-zone1999falseobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.382 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.382 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:55:45.382 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?acl 2023-12-15T22:55:45.382 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?acl 2023-12-15T22:55:45.382 DEBUG:boto:Method: PUT 2023-12-15T22:55:45.382 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?acl 2023-12-15T22:55:45.382 DEBUG:boto:Data: 2023-12-15T22:55:45.382 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:55:45.383 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:55:45.383 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.383 DEBUG:boto:Params: {} 2023-12-15T22:55:45.383 DEBUG:boto:Token: None 2023-12-15T22:55:45.383 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:45 GMT x-amz-acl:public-read /kskgfn-12/obj-test-zone1?acl 2023-12-15T22:55:45.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oW6jS7NPxmleh8tuuiQrvIOfZfk= 2023-12-15T22:55:45.383 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oW6jS7NPxmleh8tuuiQrvIOfZfk=', 'Content-Length': '0'} 2023-12-15T22:55:45.389 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005bc3424071598cdd-00657cd971-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.389 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.389 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.389 DEBUG:boto:Method: HEAD 2023-12-15T22:55:45.389 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:55:45.389 DEBUG:boto:Data: 2023-12-15T22:55:45.390 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.390 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.390 DEBUG:boto:Params: {} 2023-12-15T22:55:45.390 DEBUG:boto:Token: None 2023-12-15T22:55:45.390 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/ 2023-12-15T22:55:45.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nxe1JKxW6jO0vYj8bwKlbPzIFcs= 2023-12-15T22:55:45.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nxe1JKxW6jO0vYj8bwKlbPzIFcs=', 'Content-Length': '0'} 2023-12-15T22:55:45.392 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b676864964fd3618-00657cd971-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.393 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:55:45.393 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:55:45.393 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.393 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.393 DEBUG:boto:Method: GET 2023-12-15T22:55:45.393 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999&prefix=obj-test-zone2 2023-12-15T22:55:45.393 DEBUG:boto:Data: 2023-12-15T22:55:45.393 DEBUG:boto:Headers: {} 2023-12-15T22:55:45.393 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.393 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.393 DEBUG:boto:Params: {} 2023-12-15T22:55:45.393 DEBUG:boto:Token: None 2023-12-15T22:55:45.394 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:55:45 GMT /kskgfn-12/?versions 2023-12-15T22:55:45.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cK3pVEurh2R9wtE+Vyaql9nEggI= 2023-12-15T22:55:45.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cK3pVEurh2R9wtE+Vyaql9nEggI=', 'Content-Length': '0'} 2023-12-15T22:55:45.396 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4ff313707f6b974-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.396 DEBUG:boto:b'kskgfn-12obj-test-zone2999falseobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:55:45.396 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.397 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:55:45.397 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?acl 2023-12-15T22:55:45.397 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?acl 2023-12-15T22:55:45.397 DEBUG:boto:Method: PUT 2023-12-15T22:55:45.397 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?acl 2023-12-15T22:55:45.397 DEBUG:boto:Data: 2023-12-15T22:55:45.397 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:55:45.397 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:55:45.397 DEBUG:boto:Port: 8000 2023-12-15T22:55:45.397 DEBUG:boto:Params: {} 2023-12-15T22:55:45.397 DEBUG:boto:Token: None 2023-12-15T22:55:45.398 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:55:45 GMT x-amz-acl:public-read /kskgfn-12/obj-test-zone2?acl 2023-12-15T22:55:45.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+HZZjlYjT4iN7JS53kfkEimqhKI= 2023-12-15T22:55:45.398 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:55:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+HZZjlYjT4iN7JS53kfkEimqhKI=', 'Content-Length': '0'} 2023-12-15T22:55:45.403 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c41350368fa46cdd-00657cd971-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:55:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:55:45.403 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-11 2023-12-15T22:55:45.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:45.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:55:45.404 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:55:45.459 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:55:45.459 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:55:45.495 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:45.495+0000 7fc095b1f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:45.495 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:45.495 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:50.497 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:50.496+0000 7fc095b1f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:50.497 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:50.497 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:55.498 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:55:55.498+0000 7fc095b1f800 1 waiting for incremental sync to catch up: 2023-12-15T22:55:55.499 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:55:55.499 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:00.499 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:00.498+0000 7fc095b1f800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:00.500 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:00.500 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:05.501 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:05.500+0000 7fc095b1f800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:05.501 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000010.26.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:05.501 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:10.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:10.502+0000 7fc095b1f800 1 bucket sync caught up with source: 2023-12-15T22:56:10.502 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:10.502 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.29.6, , 00000000002.9.11, , 00000000003.17.10, , , , , ] 2023-12-15T22:56:10.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:10.502+0000 7fc095b1f800 0 bucket checkpoint complete 2023-12-15T22:56:10.519 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-11 2023-12-15T22:56:10.519 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:10.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:10.520 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:10.581 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:10.581 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:10.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:10.624+0000 7f40bd2b8800 1 bucket sync caught up with source: 2023-12-15T22:56:10.624 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.31.11, , 00000000011.46.6, , 00000000002.30.11, , , , , ] 2023-12-15T22:56:10.624 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.31.11, , 00000000011.46.6, , 00000000002.30.11, , , , , ] 2023-12-15T22:56:10.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:10.624+0000 7f40bd2b8800 0 bucket checkpoint complete 2023-12-15T22:56:10.639 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-11 zones={test-zone2, test-zone1} 2023-12-15T22:56:10.640 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.640 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.640 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.640 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:56:10.640 DEBUG:boto:Data: 2023-12-15T22:56:10.640 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.641 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.641 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.641 DEBUG:boto:Params: {} 2023-12-15T22:56:10.641 DEBUG:boto:Token: None 2023-12-15T22:56:10.641 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.641 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RiU/K28Oj6QnQOqBUnBcXGjF988= 2023-12-15T22:56:10.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RiU/K28Oj6QnQOqBUnBcXGjF988=', 'Content-Length': '0'} 2023-12-15T22:56:10.644 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ceb09ef1a066eace-00657cd98a-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.644 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.644 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.644 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.644 DEBUG:boto:Path: /kskgfn-11/ 2023-12-15T22:56:10.644 DEBUG:boto:Data: 2023-12-15T22:56:10.645 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.645 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.645 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.645 DEBUG:boto:Params: {} 2023-12-15T22:56:10.645 DEBUG:boto:Token: None 2023-12-15T22:56:10.645 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.645 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RiU/K28Oj6QnQOqBUnBcXGjF988= 2023-12-15T22:56:10.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RiU/K28Oj6QnQOqBUnBcXGjF988=', 'Content-Length': '0'} 2023-12-15T22:56:10.647 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007f3e035c03a71900-00657cd98a-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.648 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:56:10.648 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.648 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.648 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.648 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.648 DEBUG:boto:Method: GET 2023-12-15T22:56:10.648 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.648 DEBUG:boto:Data: 2023-12-15T22:56:10.648 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.648 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.649 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.649 DEBUG:boto:Params: {} 2023-12-15T22:56:10.649 DEBUG:boto:Token: None 2023-12-15T22:56:10.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/?versions 2023-12-15T22:56:10.649 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM= 2023-12-15T22:56:10.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM=', 'Content-Length': '0'} 2023-12-15T22:56:10.652 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005687dce0894e19bf-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.652 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.652 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:10.653 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:56:10.653 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:56:10.653 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:56:10.653 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.653 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.653 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.653 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.653 DEBUG:boto:Method: GET 2023-12-15T22:56:10.653 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.653 DEBUG:boto:Data: 2023-12-15T22:56:10.653 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.654 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.654 DEBUG:boto:Params: {} 2023-12-15T22:56:10.654 DEBUG:boto:Token: None 2023-12-15T22:56:10.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/?versions 2023-12-15T22:56:10.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM= 2023-12-15T22:56:10.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM=', 'Content-Length': '0'} 2023-12-15T22:56:10.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009aa84a2652998ccf-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.657 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.657 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:10.657 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:56:10.657 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:56:10.657 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.658 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.658 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.658 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.658 DEBUG:boto:Method: GET 2023-12-15T22:56:10.658 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.658 DEBUG:boto:Data: 2023-12-15T22:56:10.658 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.658 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.658 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.658 DEBUG:boto:Params: {} 2023-12-15T22:56:10.659 DEBUG:boto:Token: None 2023-12-15T22:56:10.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/?versions 2023-12-15T22:56:10.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM= 2023-12-15T22:56:10.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM=', 'Content-Length': '0'} 2023-12-15T22:56:10.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008671f5ffadd52fcd-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.661 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.662 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.662 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.662 DEBUG:boto:path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.662 DEBUG:boto:auth_path=/kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.662 DEBUG:boto:Method: GET 2023-12-15T22:56:10.662 DEBUG:boto:Path: /kskgfn-11/?versions&max-keys=999 2023-12-15T22:56:10.662 DEBUG:boto:Data: 2023-12-15T22:56:10.662 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.662 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.662 DEBUG:boto:Params: {} 2023-12-15T22:56:10.663 DEBUG:boto:Token: None 2023-12-15T22:56:10.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/?versions 2023-12-15T22:56:10.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM= 2023-12-15T22:56:10.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RXZqqgS8lnYOA4B3GSRZsQ4rkwM=', 'Content-Length': '0'} 2023-12-15T22:56:10.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f17edfcbbb35ded1-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.665 DEBUG:boto:b'kskgfn-11999falsedummyKBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfptrue2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1ltjOtRqBNxS6zUE2VEqngrW3.a8iljLtrue2023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0true2023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:10.666 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.666 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.666 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.666 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.666 DEBUG:boto:Method: GET 2023-12-15T22:56:10.666 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.666 DEBUG:boto:Data: 2023-12-15T22:56:10.666 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.667 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.667 DEBUG:boto:Params: {} 2023-12-15T22:56:10.667 DEBUG:boto:Token: None 2023-12-15T22:56:10.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.669 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000d2a9c6a9c5c0570-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.669 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.670 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.670 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.670 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.670 DEBUG:boto:Method: GET 2023-12-15T22:56:10.670 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.670 DEBUG:boto:Data: 2023-12-15T22:56:10.670 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.670 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.670 DEBUG:boto:Params: {} 2023-12-15T22:56:10.670 DEBUG:boto:Token: None 2023-12-15T22:56:10.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.672 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000007e2a6c042d8bd3c-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.673 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.673 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.673 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.673 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.673 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.673 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.673 DEBUG:boto:Data: 2023-12-15T22:56:10.673 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.673 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.674 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.674 DEBUG:boto:Params: {} 2023-12-15T22:56:10.674 DEBUG:boto:Token: None 2023-12-15T22:56:10.674 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EHDzT5hQosnE8GXtxN3aBLfx/4U= 2023-12-15T22:56:10.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EHDzT5hQosnE8GXtxN3aBLfx/4U=', 'Content-Length': '0'} 2023-12-15T22:56:10.676 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f933975bef61a658-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.677 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.677 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.677 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.677 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.677 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.677 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.677 DEBUG:boto:Data: 2023-12-15T22:56:10.677 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.677 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.677 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.678 DEBUG:boto:Params: {} 2023-12-15T22:56:10.678 DEBUG:boto:Token: None 2023-12-15T22:56:10.678 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EHDzT5hQosnE8GXtxN3aBLfx/4U= 2023-12-15T22:56:10.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EHDzT5hQosnE8GXtxN3aBLfx/4U=', 'Content-Length': '0'} 2023-12-15T22:56:10.680 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005709759cffecb641-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:10.680 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.680 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.680 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.680 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.680 DEBUG:boto:Method: GET 2023-12-15T22:56:10.680 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.681 DEBUG:boto:Data: 2023-12-15T22:56:10.681 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.681 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.681 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.681 DEBUG:boto:Params: {} 2023-12-15T22:56:10.681 DEBUG:boto:Token: None 2023-12-15T22:56:10.681 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.681 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.683 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003e47f4b65306e36f-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.684 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.684 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.684 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.684 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.684 DEBUG:boto:Method: GET 2023-12-15T22:56:10.684 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.684 DEBUG:boto:Data: 2023-12-15T22:56:10.684 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.684 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.684 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.684 DEBUG:boto:Params: {} 2023-12-15T22:56:10.685 DEBUG:boto:Token: None 2023-12-15T22:56:10.685 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.687 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000015904c9792e8020f-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.687 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.687 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.687 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.687 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.687 DEBUG:boto:Method: GET 2023-12-15T22:56:10.688 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.688 DEBUG:boto:Data: 2023-12-15T22:56:10.688 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.688 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.688 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.688 DEBUG:boto:Params: {} 2023-12-15T22:56:10.688 DEBUG:boto:Token: None 2023-12-15T22:56:10.688 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.688 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.691 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ff6dbfd2fefc938-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.691 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.691 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.691 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.691 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.691 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.691 DEBUG:boto:Method: GET 2023-12-15T22:56:10.692 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.692 DEBUG:boto:Data: 2023-12-15T22:56:10.692 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.692 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.692 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.692 DEBUG:boto:Params: {} 2023-12-15T22:56:10.692 DEBUG:boto:Token: None 2023-12-15T22:56:10.692 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.692 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.694 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085750c21f90d3c43-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.695 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.695 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.695 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.695 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.695 DEBUG:boto:Path: /kskgfn-11/dummy 2023-12-15T22:56:10.695 DEBUG:boto:Data: 2023-12-15T22:56:10.695 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.695 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.696 DEBUG:boto:Params: {} 2023-12-15T22:56:10.696 DEBUG:boto:Token: None 2023-12-15T22:56:10.696 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy 2023-12-15T22:56:10.696 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t/XkuGYfDldkxZ85sUnWvsSuRV8= 2023-12-15T22:56:10.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t/XkuGYfDldkxZ85sUnWvsSuRV8=', 'Content-Length': '0'} 2023-12-15T22:56:10.698 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fceb80e39f0bc379-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.699 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.699 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.699 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.699 DEBUG:boto:Path: /kskgfn-11/dummy 2023-12-15T22:56:10.699 DEBUG:boto:Data: 2023-12-15T22:56:10.699 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.699 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.699 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.699 DEBUG:boto:Params: {} 2023-12-15T22:56:10.699 DEBUG:boto:Token: None 2023-12-15T22:56:10.700 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy 2023-12-15T22:56:10.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t/XkuGYfDldkxZ85sUnWvsSuRV8= 2023-12-15T22:56:10.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t/XkuGYfDldkxZ85sUnWvsSuRV8=', 'Content-Length': '0'} 2023-12-15T22:56:10.702 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d22013a8a758503a-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.702 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:10.702 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.703 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.703 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.703 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.703 DEBUG:boto:Method: GET 2023-12-15T22:56:10.703 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.703 DEBUG:boto:Data: 2023-12-15T22:56:10.703 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.703 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.703 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.703 DEBUG:boto:Params: {} 2023-12-15T22:56:10.703 DEBUG:boto:Token: None 2023-12-15T22:56:10.704 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.704 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.706 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a58323a1f326e9ca-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.706 DEBUG:boto:path=/kskgfn-11/dummy 2023-12-15T22:56:10.707 DEBUG:boto:auth_path=/kskgfn-11/dummy 2023-12-15T22:56:10.707 DEBUG:boto:path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.707 DEBUG:boto:auth_path=/kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.707 DEBUG:boto:Method: GET 2023-12-15T22:56:10.707 DEBUG:boto:Path: /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.707 DEBUG:boto:Data: 2023-12-15T22:56:10.707 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.707 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.707 DEBUG:boto:Params: {} 2023-12-15T22:56:10.707 DEBUG:boto:Token: None 2023-12-15T22:56:10.708 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/dummy?versionId=KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp 2023-12-15T22:56:10.708 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4= 2023-12-15T22:56:10.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:baCIpLkeCHuvRNLJxI3O0os1Aw4=', 'Content-Length': '0'} 2023-12-15T22:56:10.709 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:13 GMT'), ('x-amz-version-id', 'KBvz8FBTB.Hud1Zb2YIZGwfkRIWpBfp'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c2994349adbf67d7-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.710 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.710 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.710 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.710 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.710 DEBUG:boto:Method: GET 2023-12-15T22:56:10.710 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.710 DEBUG:boto:Data: 2023-12-15T22:56:10.710 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.710 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.711 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.711 DEBUG:boto:Params: {} 2023-12-15T22:56:10.711 DEBUG:boto:Token: None 2023-12-15T22:56:10.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e28470713fd60e25-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.753 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.754 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.754 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.754 DEBUG:boto:path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.754 DEBUG:boto:auth_path=/kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.754 DEBUG:boto:Method: GET 2023-12-15T22:56:10.754 DEBUG:boto:Path: /kskgfn-11/?prefix=dummy 2023-12-15T22:56:10.754 DEBUG:boto:Data: 2023-12-15T22:56:10.755 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.755 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.755 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.755 DEBUG:boto:Params: {} 2023-12-15T22:56:10.755 DEBUG:boto:Token: None 2023-12-15T22:56:10.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c9e2d38f6ddfef3-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.758 DEBUG:boto:b'kskgfn-11dummy1000falsedummy2023-12-15T22:55:13.307Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:10.758 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.759 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.759 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.759 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.759 DEBUG:boto:Method: GET 2023-12-15T22:56:10.759 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.759 DEBUG:boto:Data: 2023-12-15T22:56:10.759 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.759 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.759 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.759 DEBUG:boto:Params: {} 2023-12-15T22:56:10.760 DEBUG:boto:Token: None 2023-12-15T22:56:10.760 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002fce8a7d8292f51c-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.806 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.806 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.806 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.806 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.806 DEBUG:boto:Method: GET 2023-12-15T22:56:10.806 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.806 DEBUG:boto:Data: 2023-12-15T22:56:10.806 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.807 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.807 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.807 DEBUG:boto:Params: {} 2023-12-15T22:56:10.807 DEBUG:boto:Token: None 2023-12-15T22:56:10.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.809 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000e21f43df5cca411-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.810 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.810 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.810 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.810 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.810 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.810 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.810 DEBUG:boto:Data: 2023-12-15T22:56:10.810 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.810 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.810 DEBUG:boto:Params: {} 2023-12-15T22:56:10.811 DEBUG:boto:Token: None 2023-12-15T22:56:10.811 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p+1JQqPLJwHytuoG2JaKmlKijQ4= 2023-12-15T22:56:10.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p+1JQqPLJwHytuoG2JaKmlKijQ4=', 'Content-Length': '0'} 2023-12-15T22:56:10.813 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001b5f9bb1564f3389-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.813 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.813 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.813 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.813 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.813 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.813 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.814 DEBUG:boto:Data: 2023-12-15T22:56:10.814 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.814 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.814 DEBUG:boto:Params: {} 2023-12-15T22:56:10.814 DEBUG:boto:Token: None 2023-12-15T22:56:10.814 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p+1JQqPLJwHytuoG2JaKmlKijQ4= 2023-12-15T22:56:10.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p+1JQqPLJwHytuoG2JaKmlKijQ4=', 'Content-Length': '0'} 2023-12-15T22:56:10.816 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000035492036529fed35-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:10.817 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.817 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.817 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.817 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.817 DEBUG:boto:Method: GET 2023-12-15T22:56:10.817 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.817 DEBUG:boto:Data: 2023-12-15T22:56:10.817 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.817 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.818 DEBUG:boto:Params: {} 2023-12-15T22:56:10.818 DEBUG:boto:Token: None 2023-12-15T22:56:10.818 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.820 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e8ba3b00920a107f-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.865 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.866 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.866 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.866 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.866 DEBUG:boto:Method: GET 2023-12-15T22:56:10.866 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.866 DEBUG:boto:Data: 2023-12-15T22:56:10.866 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.866 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.866 DEBUG:boto:Params: {} 2023-12-15T22:56:10.867 DEBUG:boto:Token: None 2023-12-15T22:56:10.867 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.869 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d52c1fd1330cd235-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.869 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.869 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.869 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.869 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.870 DEBUG:boto:Method: GET 2023-12-15T22:56:10.870 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.870 DEBUG:boto:Data: 2023-12-15T22:56:10.870 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.870 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.870 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.870 DEBUG:boto:Params: {} 2023-12-15T22:56:10.870 DEBUG:boto:Token: None 2023-12-15T22:56:10.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006001a38d172c187a-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.913 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.914 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.914 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.914 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.914 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.914 DEBUG:boto:Method: GET 2023-12-15T22:56:10.914 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.914 DEBUG:boto:Data: 2023-12-15T22:56:10.915 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.915 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.915 DEBUG:boto:Params: {} 2023-12-15T22:56:10.915 DEBUG:boto:Token: None 2023-12-15T22:56:10.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e8563ab148ff308-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.917 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.918 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.918 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.918 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.918 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.918 DEBUG:boto:Data: 2023-12-15T22:56:10.918 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.919 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.919 DEBUG:boto:Params: {} 2023-12-15T22:56:10.919 DEBUG:boto:Token: None 2023-12-15T22:56:10.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Rfkp6aWtiAWOBtwPWCoyBDuwKV0= 2023-12-15T22:56:10.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Rfkp6aWtiAWOBtwPWCoyBDuwKV0=', 'Content-Length': '0'} 2023-12-15T22:56:10.921 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff8278599f50b03d-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.921 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.922 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.922 DEBUG:boto:Method: HEAD 2023-12-15T22:56:10.922 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.922 DEBUG:boto:Data: 2023-12-15T22:56:10.922 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.922 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.922 DEBUG:boto:Params: {} 2023-12-15T22:56:10.922 DEBUG:boto:Token: None 2023-12-15T22:56:10.922 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Rfkp6aWtiAWOBtwPWCoyBDuwKV0= 2023-12-15T22:56:10.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Rfkp6aWtiAWOBtwPWCoyBDuwKV0=', 'Content-Length': '0'} 2023-12-15T22:56:10.925 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000933aa4a691372e30-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.925 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:10.926 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.926 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.926 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.926 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.926 DEBUG:boto:Method: GET 2023-12-15T22:56:10.926 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.926 DEBUG:boto:Data: 2023-12-15T22:56:10.927 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.927 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.927 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.927 DEBUG:boto:Params: {} 2023-12-15T22:56:10.927 DEBUG:boto:Token: None 2023-12-15T22:56:10.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.929 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c08d2d2266eac7d2-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.969 DEBUG:boto:path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.970 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1 2023-12-15T22:56:10.970 DEBUG:boto:path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.970 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.970 DEBUG:boto:Method: GET 2023-12-15T22:56:10.970 DEBUG:boto:Path: /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.970 DEBUG:boto:Data: 2023-12-15T22:56:10.970 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.971 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.971 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.971 DEBUG:boto:Params: {} 2023-12-15T22:56:10.971 DEBUG:boto:Token: None 2023-12-15T22:56:10.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone1?versionId=ltjOtRqBNxS6zUE2VEqngrW3.a8iljL 2023-12-15T22:56:10.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo= 2023-12-15T22:56:10.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aRbWBswhDCnFSmjRGRro4Fooulo=', 'Content-Length': '0'} 2023-12-15T22:56:10.974 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'ltjOtRqBNxS6zUE2VEqngrW3.a8iljL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000234aea9309b1aefd-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.974 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.974 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.974 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.974 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.975 DEBUG:boto:Method: GET 2023-12-15T22:56:10.975 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.975 DEBUG:boto:Data: 2023-12-15T22:56:10.975 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.975 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.975 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.975 DEBUG:boto:Params: {} 2023-12-15T22:56:10.976 DEBUG:boto:Token: None 2023-12-15T22:56:10.976 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.976 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e431edab8316d68-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.979 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.979 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:10.979 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:10.979 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.979 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.980 DEBUG:boto:Method: GET 2023-12-15T22:56:10.980 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone1 2023-12-15T22:56:10.980 DEBUG:boto:Data: 2023-12-15T22:56:10.980 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.980 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:10.980 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.980 DEBUG:boto:Params: {} 2023-12-15T22:56:10.981 DEBUG:boto:Token: None 2023-12-15T22:56:10.981 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/ 2023-12-15T22:56:10.981 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8= 2023-12-15T22:56:10.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQpg9Zb/Mg8+UhG0zNeSivZmDB8=', 'Content-Length': '0'} 2023-12-15T22:56:10.983 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ba9cefae400a394-00657cd98a-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:10.984 DEBUG:boto:b'kskgfn-11obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.577Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:10.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:10.984 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:10.984 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:10.984 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:10.984 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:10.984 DEBUG:boto:Method: GET 2023-12-15T22:56:10.984 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:10.985 DEBUG:boto:Data: 2023-12-15T22:56:10.985 DEBUG:boto:Headers: {} 2023-12-15T22:56:10.985 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:10.985 DEBUG:boto:Port: 8000 2023-12-15T22:56:10.985 DEBUG:boto:Params: {} 2023-12-15T22:56:10.985 DEBUG:boto:Token: None 2023-12-15T22:56:10.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:10 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:10.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hp5Ug8KMps8XTfChO6IZ4zhaLe0= 2023-12-15T22:56:10.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hp5Ug8KMps8XTfChO6IZ4zhaLe0=', 'Content-Length': '0'} 2023-12-15T22:56:10.987 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000086604b7c9e78dcdd-00657cd98a-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.029 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.030 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.030 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.030 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.030 DEBUG:boto:Method: GET 2023-12-15T22:56:11.030 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.030 DEBUG:boto:Data: 2023-12-15T22:56:11.030 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.030 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.030 DEBUG:boto:Params: {} 2023-12-15T22:56:11.031 DEBUG:boto:Token: None 2023-12-15T22:56:11.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM= 2023-12-15T22:56:11.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM=', 'Content-Length': '0'} 2023-12-15T22:56:11.034 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d067dec9650ae901-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.034 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.034 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.034 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.034 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.034 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.034 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.035 DEBUG:boto:Data: 2023-12-15T22:56:11.035 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.035 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.035 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.035 DEBUG:boto:Params: {} 2023-12-15T22:56:11.035 DEBUG:boto:Token: None 2023-12-15T22:56:11.035 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AK7LZOhIgbjnpzkEjoNydBVL6UY= 2023-12-15T22:56:11.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AK7LZOhIgbjnpzkEjoNydBVL6UY=', 'Content-Length': '0'} 2023-12-15T22:56:11.037 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000eb88cee5976f0292-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.038 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.038 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.038 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.038 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.038 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.038 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.038 DEBUG:boto:Data: 2023-12-15T22:56:11.038 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.038 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.039 DEBUG:boto:Params: {} 2023-12-15T22:56:11.039 DEBUG:boto:Token: None 2023-12-15T22:56:11.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AK7LZOhIgbjnpzkEjoNydBVL6UY= 2023-12-15T22:56:11.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AK7LZOhIgbjnpzkEjoNydBVL6UY=', 'Content-Length': '0'} 2023-12-15T22:56:11.041 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000030ef68582799e6ed-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:11.042 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.042 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.042 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.042 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.042 DEBUG:boto:Method: GET 2023-12-15T22:56:11.042 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.042 DEBUG:boto:Data: 2023-12-15T22:56:11.042 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.042 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.042 DEBUG:boto:Params: {} 2023-12-15T22:56:11.043 DEBUG:boto:Token: None 2023-12-15T22:56:11.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM= 2023-12-15T22:56:11.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM=', 'Content-Length': '0'} 2023-12-15T22:56:11.045 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bc8d6f0ee0b995ee-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.045 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.046 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.046 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.046 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.046 DEBUG:boto:Method: GET 2023-12-15T22:56:11.046 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.046 DEBUG:boto:Data: 2023-12-15T22:56:11.046 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.046 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.046 DEBUG:boto:Params: {} 2023-12-15T22:56:11.047 DEBUG:boto:Token: None 2023-12-15T22:56:11.047 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM= 2023-12-15T22:56:11.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM=', 'Content-Length': '0'} 2023-12-15T22:56:11.049 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000787b2d1ddbb3287f-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.090 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:11.090 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:11.090 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.090 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.090 DEBUG:boto:Method: GET 2023-12-15T22:56:11.090 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.090 DEBUG:boto:Data: 2023-12-15T22:56:11.090 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.090 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.091 DEBUG:boto:Params: {} 2023-12-15T22:56:11.091 DEBUG:boto:Token: None 2023-12-15T22:56:11.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/ 2023-12-15T22:56:11.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE= 2023-12-15T22:56:11.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE=', 'Content-Length': '0'} 2023-12-15T22:56:11.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8e71be6b6191738-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.093 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.094 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:11.094 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:11.094 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.094 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.094 DEBUG:boto:Method: GET 2023-12-15T22:56:11.094 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.095 DEBUG:boto:Data: 2023-12-15T22:56:11.095 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.095 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.095 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.095 DEBUG:boto:Params: {} 2023-12-15T22:56:11.095 DEBUG:boto:Token: None 2023-12-15T22:56:11.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/ 2023-12-15T22:56:11.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE= 2023-12-15T22:56:11.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE=', 'Content-Length': '0'} 2023-12-15T22:56:11.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bf9b2443c67a82e-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.098 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.098 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.098 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.099 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.099 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.099 DEBUG:boto:Data: 2023-12-15T22:56:11.099 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.099 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.099 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.099 DEBUG:boto:Params: {} 2023-12-15T22:56:11.099 DEBUG:boto:Token: None 2023-12-15T22:56:11.099 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UgwBX5Xv+oDug31H/o78UGX7ljM= 2023-12-15T22:56:11.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UgwBX5Xv+oDug31H/o78UGX7ljM=', 'Content-Length': '0'} 2023-12-15T22:56:11.102 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c295297f135d53ca-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.102 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.102 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.102 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.102 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.103 DEBUG:boto:Data: 2023-12-15T22:56:11.103 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.103 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.103 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.103 DEBUG:boto:Params: {} 2023-12-15T22:56:11.103 DEBUG:boto:Token: None 2023-12-15T22:56:11.103 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UgwBX5Xv+oDug31H/o78UGX7ljM= 2023-12-15T22:56:11.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UgwBX5Xv+oDug31H/o78UGX7ljM=', 'Content-Length': '0'} 2023-12-15T22:56:11.106 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000360fda933d6f63e3-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:11.106 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.106 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.106 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.106 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.106 DEBUG:boto:Method: GET 2023-12-15T22:56:11.106 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.107 DEBUG:boto:Data: 2023-12-15T22:56:11.107 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.107 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.107 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.107 DEBUG:boto:Params: {} 2023-12-15T22:56:11.107 DEBUG:boto:Token: None 2023-12-15T22:56:11.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM= 2023-12-15T22:56:11.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM=', 'Content-Length': '0'} 2023-12-15T22:56:11.110 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002a9194c74d37857b-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.157 DEBUG:boto:path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.158 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2 2023-12-15T22:56:11.158 DEBUG:boto:path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.158 DEBUG:boto:auth_path=/kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.158 DEBUG:boto:Method: GET 2023-12-15T22:56:11.158 DEBUG:boto:Path: /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.158 DEBUG:boto:Data: 2023-12-15T22:56:11.158 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.158 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.158 DEBUG:boto:Params: {} 2023-12-15T22:56:11.158 DEBUG:boto:Token: None 2023-12-15T22:56:11.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/obj-test-zone2?versionId=J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0 2023-12-15T22:56:11.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM= 2023-12-15T22:56:11.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BUXSUNmAU3lrbwaTkUo/o4VfnAM=', 'Content-Length': '0'} 2023-12-15T22:56:11.161 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'J4y0cSHb5tGmgZHBCN1yP9FbWvQT8p0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9889987881089c2-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.161 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:11.161 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:11.162 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.162 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.162 DEBUG:boto:Method: GET 2023-12-15T22:56:11.162 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.162 DEBUG:boto:Data: 2023-12-15T22:56:11.162 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.162 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.162 DEBUG:boto:Params: {} 2023-12-15T22:56:11.162 DEBUG:boto:Token: None 2023-12-15T22:56:11.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/ 2023-12-15T22:56:11.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE= 2023-12-15T22:56:11.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE=', 'Content-Length': '0'} 2023-12-15T22:56:11.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000854e6911a870a7d6-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.165 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.166 DEBUG:boto:path=/kskgfn-11/ 2023-12-15T22:56:11.166 DEBUG:boto:auth_path=/kskgfn-11/ 2023-12-15T22:56:11.166 DEBUG:boto:path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.166 DEBUG:boto:auth_path=/kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.166 DEBUG:boto:Method: GET 2023-12-15T22:56:11.166 DEBUG:boto:Path: /kskgfn-11/?prefix=obj-test-zone2 2023-12-15T22:56:11.166 DEBUG:boto:Data: 2023-12-15T22:56:11.166 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.166 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.166 DEBUG:boto:Params: {} 2023-12-15T22:56:11.167 DEBUG:boto:Token: None 2023-12-15T22:56:11.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-11/ 2023-12-15T22:56:11.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE= 2023-12-15T22:56:11.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cSf8X5DTHWAyYO62nLpPRIuV6eE=', 'Content-Length': '0'} 2023-12-15T22:56:11.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000111272fb602c425c-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.169 DEBUG:boto:b'kskgfn-11obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.678Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.170 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-11 zones={test-zone2, test-zone1} 2023-12-15T22:56:11.170 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-12 2023-12-15T22:56:11.170 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:11.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:11.170 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:11.267+0000 7fb6f9d22800 1 bucket sync caught up with source: 2023-12-15T22:56:11.267 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000011.28.6, , 00000000002.13.11, , 00000000002.10.11, , , , , ] 2023-12-15T22:56:11.267 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000011.28.6, , 00000000002.13.11, , 00000000002.10.11, , , , , ] 2023-12-15T22:56:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:11.267+0000 7fb6f9d22800 0 bucket checkpoint complete 2023-12-15T22:56:11.281 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-12 2023-12-15T22:56:11.282 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:11.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:11.282 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:11.341 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:11.342 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:11.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:11.378+0000 7f26aebdc800 1 bucket sync caught up with source: 2023-12-15T22:56:11.379 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.23.11, , 00000000011.40.6, , 00000000003.21.10, , , , , ] 2023-12-15T22:56:11.379 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.23.11, , 00000000011.40.6, , 00000000003.21.10, , , , , ] 2023-12-15T22:56:11.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:11.378+0000 7f26aebdc800 0 bucket checkpoint complete 2023-12-15T22:56:11.393 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-12 zones={test-zone2, test-zone1} 2023-12-15T22:56:11.393 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.393 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.393 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.393 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:56:11.393 DEBUG:boto:Data: 2023-12-15T22:56:11.394 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.394 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.394 DEBUG:boto:Params: {} 2023-12-15T22:56:11.394 DEBUG:boto:Token: None 2023-12-15T22:56:11.394 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahNamhLP6i3GJ2wZtj5krfoRgWw= 2023-12-15T22:56:11.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahNamhLP6i3GJ2wZtj5krfoRgWw=', 'Content-Length': '0'} 2023-12-15T22:56:11.396 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f639f67fd5e88fb3-00657cd98b-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.396 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.397 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.397 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.397 DEBUG:boto:Path: /kskgfn-12/ 2023-12-15T22:56:11.397 DEBUG:boto:Data: 2023-12-15T22:56:11.397 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.397 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.397 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.397 DEBUG:boto:Params: {} 2023-12-15T22:56:11.397 DEBUG:boto:Token: None 2023-12-15T22:56:11.397 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.397 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahNamhLP6i3GJ2wZtj5krfoRgWw= 2023-12-15T22:56:11.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahNamhLP6i3GJ2wZtj5krfoRgWw=', 'Content-Length': '0'} 2023-12-15T22:56:11.400 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038d4ae17c2915887-00657cd98b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.400 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:56:11.400 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.400 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.401 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.401 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.401 DEBUG:boto:Method: GET 2023-12-15T22:56:11.401 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.401 DEBUG:boto:Data: 2023-12-15T22:56:11.401 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.401 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.401 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.401 DEBUG:boto:Params: {} 2023-12-15T22:56:11.401 DEBUG:boto:Token: None 2023-12-15T22:56:11.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/?versions 2023-12-15T22:56:11.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs= 2023-12-15T22:56:11.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs=', 'Content-Length': '0'} 2023-12-15T22:56:11.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a11ea1213f52b2e-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.404 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.405 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:11.405 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:56:11.405 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:56:11.405 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:56:11.405 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.405 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.405 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.405 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.405 DEBUG:boto:Method: GET 2023-12-15T22:56:11.406 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.406 DEBUG:boto:Data: 2023-12-15T22:56:11.406 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.406 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.406 DEBUG:boto:Params: {} 2023-12-15T22:56:11.406 DEBUG:boto:Token: None 2023-12-15T22:56:11.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/?versions 2023-12-15T22:56:11.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs= 2023-12-15T22:56:11.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs=', 'Content-Length': '0'} 2023-12-15T22:56:11.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002627aff55683e640-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.409 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.409 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:11.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2023-12-15T22:56:11.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2023-12-15T22:56:11.410 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.410 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.410 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.410 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.410 DEBUG:boto:Method: GET 2023-12-15T22:56:11.410 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.410 DEBUG:boto:Data: 2023-12-15T22:56:11.410 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.410 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.410 DEBUG:boto:Params: {} 2023-12-15T22:56:11.411 DEBUG:boto:Token: None 2023-12-15T22:56:11.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/?versions 2023-12-15T22:56:11.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs= 2023-12-15T22:56:11.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs=', 'Content-Length': '0'} 2023-12-15T22:56:11.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c0a371415242a4f-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.413 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.414 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.414 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.414 DEBUG:boto:path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.414 DEBUG:boto:auth_path=/kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.414 DEBUG:boto:Method: GET 2023-12-15T22:56:11.414 DEBUG:boto:Path: /kskgfn-12/?versions&max-keys=999 2023-12-15T22:56:11.414 DEBUG:boto:Data: 2023-12-15T22:56:11.415 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.415 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.415 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.415 DEBUG:boto:Params: {} 2023-12-15T22:56:11.415 DEBUG:boto:Token: None 2023-12-15T22:56:11.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/?versions 2023-12-15T22:56:11.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs= 2023-12-15T22:56:11.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tS9VhT1LYb8c/nFapm3HHr8X/hs=', 'Content-Length': '0'} 2023-12-15T22:56:11.417 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009acf744b687caaa9-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.417 DEBUG:boto:b'kskgfn-12999falsedummyIpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mztrue2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone1XPdWneu9CEAMaYj5O49mQPRo4AR8dPitrue2023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-test-zone2lutFIztsfoULWvIJGSHhlu-c1SwYd2ntrue2023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:11.418 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.418 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.418 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.418 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.418 DEBUG:boto:Method: GET 2023-12-15T22:56:11.418 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.419 DEBUG:boto:Data: 2023-12-15T22:56:11.419 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.419 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.419 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.419 DEBUG:boto:Params: {} 2023-12-15T22:56:11.419 DEBUG:boto:Token: None 2023-12-15T22:56:11.419 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.421 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002991e4abac308a02-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.421 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.421 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.422 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.422 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.422 DEBUG:boto:Method: GET 2023-12-15T22:56:11.422 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.422 DEBUG:boto:Data: 2023-12-15T22:56:11.422 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.422 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.422 DEBUG:boto:Params: {} 2023-12-15T22:56:11.422 DEBUG:boto:Token: None 2023-12-15T22:56:11.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.425 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000022ab2bd39ce88c7e-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.425 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.425 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.425 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.425 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.425 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.425 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.425 DEBUG:boto:Data: 2023-12-15T22:56:11.425 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.426 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.426 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.426 DEBUG:boto:Params: {} 2023-12-15T22:56:11.426 DEBUG:boto:Token: None 2023-12-15T22:56:11.426 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.426 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VM09R/JNYS7liseH0hP4yUKNm7E= 2023-12-15T22:56:11.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VM09R/JNYS7liseH0hP4yUKNm7E=', 'Content-Length': '0'} 2023-12-15T22:56:11.428 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000538fec88cda5d6e9-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.428 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.428 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.428 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.429 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.429 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.429 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.429 DEBUG:boto:Data: 2023-12-15T22:56:11.429 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.429 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.429 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.429 DEBUG:boto:Params: {} 2023-12-15T22:56:11.429 DEBUG:boto:Token: None 2023-12-15T22:56:11.429 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.430 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VM09R/JNYS7liseH0hP4yUKNm7E= 2023-12-15T22:56:11.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VM09R/JNYS7liseH0hP4yUKNm7E=', 'Content-Length': '0'} 2023-12-15T22:56:11.431 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000094d18beabf2e171f-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:11.432 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.432 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.432 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.432 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.432 DEBUG:boto:Method: GET 2023-12-15T22:56:11.432 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.432 DEBUG:boto:Data: 2023-12-15T22:56:11.433 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.433 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.433 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.433 DEBUG:boto:Params: {} 2023-12-15T22:56:11.433 DEBUG:boto:Token: None 2023-12-15T22:56:11.433 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.433 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.435 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000026c7068c0de2338a-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.435 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.435 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.435 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.435 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.436 DEBUG:boto:Method: GET 2023-12-15T22:56:11.436 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.436 DEBUG:boto:Data: 2023-12-15T22:56:11.436 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.436 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.436 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.436 DEBUG:boto:Params: {} 2023-12-15T22:56:11.436 DEBUG:boto:Token: None 2023-12-15T22:56:11.436 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.436 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.438 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a647817f27f22375-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.439 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.439 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.439 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.439 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.439 DEBUG:boto:Method: GET 2023-12-15T22:56:11.439 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.439 DEBUG:boto:Data: 2023-12-15T22:56:11.439 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.439 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.439 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.440 DEBUG:boto:Params: {} 2023-12-15T22:56:11.440 DEBUG:boto:Token: None 2023-12-15T22:56:11.440 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.440 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd0369aaa2127f9f-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.442 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.443 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.443 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.443 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.443 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.443 DEBUG:boto:Method: GET 2023-12-15T22:56:11.443 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.443 DEBUG:boto:Data: 2023-12-15T22:56:11.443 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.444 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.444 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.444 DEBUG:boto:Params: {} 2023-12-15T22:56:11.444 DEBUG:boto:Token: None 2023-12-15T22:56:11.444 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.447 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000241301cc276a9144-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.490 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.490 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.490 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.490 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.490 DEBUG:boto:Path: /kskgfn-12/dummy 2023-12-15T22:56:11.490 DEBUG:boto:Data: 2023-12-15T22:56:11.491 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.491 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.491 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.491 DEBUG:boto:Params: {} 2023-12-15T22:56:11.491 DEBUG:boto:Token: None 2023-12-15T22:56:11.491 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy 2023-12-15T22:56:11.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7GIlZ04nNqxXmLSrOtZ9/jw6Sc= 2023-12-15T22:56:11.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7GIlZ04nNqxXmLSrOtZ9/jw6Sc=', 'Content-Length': '0'} 2023-12-15T22:56:11.494 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001eaa5df70b553126-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.494 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.494 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.494 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.494 DEBUG:boto:Path: /kskgfn-12/dummy 2023-12-15T22:56:11.494 DEBUG:boto:Data: 2023-12-15T22:56:11.495 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.495 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.495 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.495 DEBUG:boto:Params: {} 2023-12-15T22:56:11.495 DEBUG:boto:Token: None 2023-12-15T22:56:11.495 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy 2023-12-15T22:56:11.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v7GIlZ04nNqxXmLSrOtZ9/jw6Sc= 2023-12-15T22:56:11.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v7GIlZ04nNqxXmLSrOtZ9/jw6Sc=', 'Content-Length': '0'} 2023-12-15T22:56:11.497 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000379e565b19f643a6-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.498 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:11.498 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.498 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.498 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.498 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.498 DEBUG:boto:Method: GET 2023-12-15T22:56:11.498 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.498 DEBUG:boto:Data: 2023-12-15T22:56:11.498 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.499 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.499 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.499 DEBUG:boto:Params: {} 2023-12-15T22:56:11.499 DEBUG:boto:Token: None 2023-12-15T22:56:11.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.501 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000567928d0feecaf3-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.501 DEBUG:boto:path=/kskgfn-12/dummy 2023-12-15T22:56:11.501 DEBUG:boto:auth_path=/kskgfn-12/dummy 2023-12-15T22:56:11.501 DEBUG:boto:path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.502 DEBUG:boto:auth_path=/kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.502 DEBUG:boto:Method: GET 2023-12-15T22:56:11.502 DEBUG:boto:Path: /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.502 DEBUG:boto:Data: 2023-12-15T22:56:11.502 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.502 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.502 DEBUG:boto:Params: {} 2023-12-15T22:56:11.502 DEBUG:boto:Token: None 2023-12-15T22:56:11.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/dummy?versionId=IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz 2023-12-15T22:56:11.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg= 2023-12-15T22:56:11.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwWaPRGFqPQ4B2x0XBi1QuqCfCg=', 'Content-Length': '0'} 2023-12-15T22:56:11.505 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:18 GMT'), ('x-amz-version-id', 'IpeQ7FACsEZwgGBjvlwcLSNsaC.P-Mz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000076f54a2fe7dfc423-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.505 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.505 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.505 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.505 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.505 DEBUG:boto:Method: GET 2023-12-15T22:56:11.505 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.505 DEBUG:boto:Data: 2023-12-15T22:56:11.506 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.506 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.506 DEBUG:boto:Params: {} 2023-12-15T22:56:11.506 DEBUG:boto:Token: None 2023-12-15T22:56:11.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d25af68b5a9dc16-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.509 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.509 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.509 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.509 DEBUG:boto:path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.509 DEBUG:boto:auth_path=/kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.509 DEBUG:boto:Method: GET 2023-12-15T22:56:11.509 DEBUG:boto:Path: /kskgfn-12/?prefix=dummy 2023-12-15T22:56:11.509 DEBUG:boto:Data: 2023-12-15T22:56:11.510 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.510 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.510 DEBUG:boto:Params: {} 2023-12-15T22:56:11.510 DEBUG:boto:Token: None 2023-12-15T22:56:11.510 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.512 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c009fa571e00379e-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.512 DEBUG:boto:b'kskgfn-12dummy1000falsedummy2023-12-15T22:55:18.434Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:11.513 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.513 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.513 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.513 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.513 DEBUG:boto:Method: GET 2023-12-15T22:56:11.513 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.513 DEBUG:boto:Data: 2023-12-15T22:56:11.513 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.513 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.513 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.513 DEBUG:boto:Params: {} 2023-12-15T22:56:11.514 DEBUG:boto:Token: None 2023-12-15T22:56:11.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.515 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000020f7cfebd70841af-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.516 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.516 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.516 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.516 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.516 DEBUG:boto:Method: GET 2023-12-15T22:56:11.516 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.516 DEBUG:boto:Data: 2023-12-15T22:56:11.516 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.516 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.516 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.516 DEBUG:boto:Params: {} 2023-12-15T22:56:11.517 DEBUG:boto:Token: None 2023-12-15T22:56:11.517 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.517 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.519 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f4be8185bb5ccfea-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.519 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.519 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.519 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.519 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.519 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.519 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.519 DEBUG:boto:Data: 2023-12-15T22:56:11.520 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.520 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.520 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.520 DEBUG:boto:Params: {} 2023-12-15T22:56:11.520 DEBUG:boto:Token: None 2023-12-15T22:56:11.520 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.520 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y9Ro27dMRIykv+rEnMjhCjxyqfQ= 2023-12-15T22:56:11.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y9Ro27dMRIykv+rEnMjhCjxyqfQ=', 'Content-Length': '0'} 2023-12-15T22:56:11.522 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000053fc804d7ca61ba5-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.522 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.522 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.522 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.522 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.523 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.523 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.523 DEBUG:boto:Data: 2023-12-15T22:56:11.523 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.523 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.523 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.523 DEBUG:boto:Params: {} 2023-12-15T22:56:11.523 DEBUG:boto:Token: None 2023-12-15T22:56:11.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y9Ro27dMRIykv+rEnMjhCjxyqfQ= 2023-12-15T22:56:11.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y9Ro27dMRIykv+rEnMjhCjxyqfQ=', 'Content-Length': '0'} 2023-12-15T22:56:11.525 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e166795697ba0fd7-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:11.525 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.526 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.526 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.526 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.526 DEBUG:boto:Method: GET 2023-12-15T22:56:11.526 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.526 DEBUG:boto:Data: 2023-12-15T22:56:11.526 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.526 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.526 DEBUG:boto:Params: {} 2023-12-15T22:56:11.526 DEBUG:boto:Token: None 2023-12-15T22:56:11.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.528 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000028bff3e1814990c7-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.569 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.570 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.570 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.570 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.570 DEBUG:boto:Method: GET 2023-12-15T22:56:11.570 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.570 DEBUG:boto:Data: 2023-12-15T22:56:11.570 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.570 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.570 DEBUG:boto:Params: {} 2023-12-15T22:56:11.570 DEBUG:boto:Token: None 2023-12-15T22:56:11.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.573 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009b83158107e7a558-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.573 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.573 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.573 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.573 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.573 DEBUG:boto:Method: GET 2023-12-15T22:56:11.573 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.574 DEBUG:boto:Data: 2023-12-15T22:56:11.574 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.574 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.574 DEBUG:boto:Params: {} 2023-12-15T22:56:11.574 DEBUG:boto:Token: None 2023-12-15T22:56:11.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034a406c826e3071a-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.577 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.577 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.577 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.577 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.577 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.577 DEBUG:boto:Method: GET 2023-12-15T22:56:11.577 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.578 DEBUG:boto:Data: 2023-12-15T22:56:11.578 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.578 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.578 DEBUG:boto:Params: {} 2023-12-15T22:56:11.578 DEBUG:boto:Token: None 2023-12-15T22:56:11.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028dee008dd120ad2-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.581 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.581 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.581 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.581 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.581 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.581 DEBUG:boto:Data: 2023-12-15T22:56:11.581 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.582 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.582 DEBUG:boto:Params: {} 2023-12-15T22:56:11.582 DEBUG:boto:Token: None 2023-12-15T22:56:11.582 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qolALGEukzjPY6Qes900/OIh2GE= 2023-12-15T22:56:11.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qolALGEukzjPY6Qes900/OIh2GE=', 'Content-Length': '0'} 2023-12-15T22:56:11.584 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c41be81af7da4273-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.584 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.584 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.584 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.585 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.585 DEBUG:boto:Data: 2023-12-15T22:56:11.585 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.585 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.585 DEBUG:boto:Params: {} 2023-12-15T22:56:11.585 DEBUG:boto:Token: None 2023-12-15T22:56:11.585 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qolALGEukzjPY6Qes900/OIh2GE= 2023-12-15T22:56:11.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qolALGEukzjPY6Qes900/OIh2GE=', 'Content-Length': '0'} 2023-12-15T22:56:11.588 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000029df8ea900a06619-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2023-12-15T22:56:11.588 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.588 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.588 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.588 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.588 DEBUG:boto:Method: GET 2023-12-15T22:56:11.588 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.588 DEBUG:boto:Data: 2023-12-15T22:56:11.589 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.589 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.589 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.589 DEBUG:boto:Params: {} 2023-12-15T22:56:11.589 DEBUG:boto:Token: None 2023-12-15T22:56:11.589 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.591 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b6c3104025b67ccd-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.633 DEBUG:boto:path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.634 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1 2023-12-15T22:56:11.634 DEBUG:boto:path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.634 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.634 DEBUG:boto:Method: GET 2023-12-15T22:56:11.634 DEBUG:boto:Path: /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.634 DEBUG:boto:Data: 2023-12-15T22:56:11.634 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.634 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.634 DEBUG:boto:Params: {} 2023-12-15T22:56:11.635 DEBUG:boto:Token: None 2023-12-15T22:56:11.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone1?versionId=XPdWneu9CEAMaYj5O49mQPRo4AR8dPi 2023-12-15T22:56:11.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8= 2023-12-15T22:56:11.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmuQcoKEOiNc0zXo8Nc+MacJQW8=', 'Content-Length': '0'} 2023-12-15T22:56:11.637 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'XPdWneu9CEAMaYj5O49mQPRo4AR8dPi'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002e9d803c9226ba19-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.637 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.637 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.637 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.637 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.637 DEBUG:boto:Method: GET 2023-12-15T22:56:11.637 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.637 DEBUG:boto:Data: 2023-12-15T22:56:11.638 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.638 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.638 DEBUG:boto:Params: {} 2023-12-15T22:56:11.638 DEBUG:boto:Token: None 2023-12-15T22:56:11.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c67d8bf31eeb2954-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.640 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.641 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.641 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.641 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.641 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.641 DEBUG:boto:Method: GET 2023-12-15T22:56:11.641 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone1 2023-12-15T22:56:11.641 DEBUG:boto:Data: 2023-12-15T22:56:11.641 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.641 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.642 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.642 DEBUG:boto:Params: {} 2023-12-15T22:56:11.642 DEBUG:boto:Token: None 2023-12-15T22:56:11.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.644 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000413f6eb4d1fda732-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.644 DEBUG:boto:b'kskgfn-12obj-test-zone11000falseobj-test-zone12023-12-15T22:55:23.779Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:11.645 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.645 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.645 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.645 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.645 DEBUG:boto:Method: GET 2023-12-15T22:56:11.645 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.645 DEBUG:boto:Data: 2023-12-15T22:56:11.645 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.645 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.645 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.645 DEBUG:boto:Params: {} 2023-12-15T22:56:11.646 DEBUG:boto:Token: None 2023-12-15T22:56:11.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.647 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ae643aa0b2fbd3f6-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.648 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.648 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.648 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.648 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.648 DEBUG:boto:Method: GET 2023-12-15T22:56:11.648 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.648 DEBUG:boto:Data: 2023-12-15T22:56:11.648 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.648 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.648 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.648 DEBUG:boto:Params: {} 2023-12-15T22:56:11.649 DEBUG:boto:Token: None 2023-12-15T22:56:11.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.649 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.651 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ca03c7b8d44e8488-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.693 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.694 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.694 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.694 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.694 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.694 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.694 DEBUG:boto:Data: 2023-12-15T22:56:11.694 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.694 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.694 DEBUG:boto:Params: {} 2023-12-15T22:56:11.694 DEBUG:boto:Token: None 2023-12-15T22:56:11.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rbjt8zq71tmO9tYGfiU91yZoLvA= 2023-12-15T22:56:11.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rbjt8zq71tmO9tYGfiU91yZoLvA=', 'Content-Length': '0'} 2023-12-15T22:56:11.697 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005c2e163ebab6105c-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.697 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.697 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.697 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.697 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.697 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.697 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.697 DEBUG:boto:Data: 2023-12-15T22:56:11.697 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.698 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.698 DEBUG:boto:Params: {} 2023-12-15T22:56:11.698 DEBUG:boto:Token: None 2023-12-15T22:56:11.698 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rbjt8zq71tmO9tYGfiU91yZoLvA= 2023-12-15T22:56:11.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rbjt8zq71tmO9tYGfiU91yZoLvA=', 'Content-Length': '0'} 2023-12-15T22:56:11.700 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000def31b16d9281c0-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:11.700 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.700 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.700 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.701 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.701 DEBUG:boto:Method: GET 2023-12-15T22:56:11.701 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.701 DEBUG:boto:Data: 2023-12-15T22:56:11.701 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.701 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.701 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.701 DEBUG:boto:Params: {} 2023-12-15T22:56:11.701 DEBUG:boto:Token: None 2023-12-15T22:56:11.701 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.703 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008aa4af03592bbb44-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.704 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.704 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.704 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.704 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.704 DEBUG:boto:Method: GET 2023-12-15T22:56:11.704 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.704 DEBUG:boto:Data: 2023-12-15T22:56:11.704 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.704 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.704 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.704 DEBUG:boto:Params: {} 2023-12-15T22:56:11.704 DEBUG:boto:Token: None 2023-12-15T22:56:11.705 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.705 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.706 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004c427bdd109b39b3-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.749 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.749 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.750 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.750 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.750 DEBUG:boto:Method: GET 2023-12-15T22:56:11.750 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.750 DEBUG:boto:Data: 2023-12-15T22:56:11.750 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.750 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.750 DEBUG:boto:Params: {} 2023-12-15T22:56:11.750 DEBUG:boto:Token: None 2023-12-15T22:56:11.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c1be079a3ef18d0-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.753 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.753 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.754 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.754 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.754 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.754 DEBUG:boto:Method: GET 2023-12-15T22:56:11.754 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.754 DEBUG:boto:Data: 2023-12-15T22:56:11.754 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.754 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.754 DEBUG:boto:Params: {} 2023-12-15T22:56:11.754 DEBUG:boto:Token: None 2023-12-15T22:56:11.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d75841e2693d6059-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.757 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.757 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.757 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.757 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.757 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.757 DEBUG:boto:Data: 2023-12-15T22:56:11.758 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.758 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.758 DEBUG:boto:Params: {} 2023-12-15T22:56:11.758 DEBUG:boto:Token: None 2023-12-15T22:56:11.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZfhbcLFY90P4TS7f1rWwwhp+sgw= 2023-12-15T22:56:11.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZfhbcLFY90P4TS7f1rWwwhp+sgw=', 'Content-Length': '0'} 2023-12-15T22:56:11.760 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000299ef1875d8ad5a8-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.760 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.760 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.760 DEBUG:boto:Method: HEAD 2023-12-15T22:56:11.761 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.761 DEBUG:boto:Data: 2023-12-15T22:56:11.761 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.761 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.761 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.761 DEBUG:boto:Params: {} 2023-12-15T22:56:11.761 DEBUG:boto:Token: None 2023-12-15T22:56:11.761 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZfhbcLFY90P4TS7f1rWwwhp+sgw= 2023-12-15T22:56:11.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZfhbcLFY90P4TS7f1rWwwhp+sgw=', 'Content-Length': '0'} 2023-12-15T22:56:11.763 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000987885083eec35e5-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2023-12-15T22:56:11.764 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.764 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.764 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.764 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.764 DEBUG:boto:Method: GET 2023-12-15T22:56:11.764 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.764 DEBUG:boto:Data: 2023-12-15T22:56:11.764 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.764 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.764 DEBUG:boto:Params: {} 2023-12-15T22:56:11.765 DEBUG:boto:Token: None 2023-12-15T22:56:11.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.766 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000202f2348ecaef0c3-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.767 DEBUG:boto:path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.767 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2 2023-12-15T22:56:11.767 DEBUG:boto:path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.767 DEBUG:boto:auth_path=/kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.767 DEBUG:boto:Method: GET 2023-12-15T22:56:11.767 DEBUG:boto:Path: /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.767 DEBUG:boto:Data: 2023-12-15T22:56:11.767 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.767 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.767 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.768 DEBUG:boto:Params: {} 2023-12-15T22:56:11.768 DEBUG:boto:Token: None 2023-12-15T22:56:11.768 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/obj-test-zone2?versionId=lutFIztsfoULWvIJGSHhlu-c1SwYd2n 2023-12-15T22:56:11.768 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU= 2023-12-15T22:56:11.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZaqle9ITu+4drQKKLMeAynE4gU=', 'Content-Length': '0'} 2023-12-15T22:56:11.770 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:55:23 GMT'), ('x-amz-version-id', 'lutFIztsfoULWvIJGSHhlu-c1SwYd2n'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003fb914f5a13ab5c5-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.813 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.817 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.817 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.817 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.817 DEBUG:boto:Method: GET 2023-12-15T22:56:11.817 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.817 DEBUG:boto:Data: 2023-12-15T22:56:11.817 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.818 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:11.818 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.818 DEBUG:boto:Params: {} 2023-12-15T22:56:11.818 DEBUG:boto:Token: None 2023-12-15T22:56:11.818 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000696f9d7317d710a2-00657cd98b-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.821 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.822 DEBUG:boto:path=/kskgfn-12/ 2023-12-15T22:56:11.822 DEBUG:boto:auth_path=/kskgfn-12/ 2023-12-15T22:56:11.822 DEBUG:boto:path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.822 DEBUG:boto:auth_path=/kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.822 DEBUG:boto:Method: GET 2023-12-15T22:56:11.822 DEBUG:boto:Path: /kskgfn-12/?prefix=obj-test-zone2 2023-12-15T22:56:11.822 DEBUG:boto:Data: 2023-12-15T22:56:11.822 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.822 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.823 DEBUG:boto:Params: {} 2023-12-15T22:56:11.823 DEBUG:boto:Token: None 2023-12-15T22:56:11.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-12/ 2023-12-15T22:56:11.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I= 2023-12-15T22:56:11.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKdB28Ki6kI/B3K2PdrEIHV0h4I=', 'Content-Length': '0'} 2023-12-15T22:56:11.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d23a0c90793a43a-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.865 DEBUG:boto:b'kskgfn-12obj-test-zone21000falseobj-test-zone22023-12-15T22:55:23.876Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:11.866 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-12 zones={test-zone2, test-zone1} 2023-12-15T22:56:11.866 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2023-12-15T22:56:11.867 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:11.867 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:11.867 DEBUG:boto:Method: PUT 2023-12-15T22:56:11.868 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:11.868 DEBUG:boto:Data: 2023-12-15T22:56:11.868 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.868 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.868 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.868 DEBUG:boto:Params: {} 2023-12-15T22:56:11.868 DEBUG:boto:Token: None 2023-12-15T22:56:11.868 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-13/ 2023-12-15T22:56:11.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RxTqGjkO5pbTk55xlb044YWBpz4= 2023-12-15T22:56:11.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RxTqGjkO5pbTk55xlb044YWBpz4=', 'Content-Length': '0'} 2023-12-15T22:56:11.885 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006c832c937dbc14af-00657cd98b-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.885 DEBUG:rgw_multi.tests:created bucket=kskgfn-13 2023-12-15T22:56:11.885 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:11.885 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:11.885 DEBUG:boto:path=/kskgfn-13/?versioning 2023-12-15T22:56:11.885 DEBUG:boto:auth_path=/kskgfn-13/?versioning 2023-12-15T22:56:11.886 DEBUG:boto:Method: PUT 2023-12-15T22:56:11.886 DEBUG:boto:Path: /kskgfn-13/?versioning 2023-12-15T22:56:11.886 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:56:11.886 DEBUG:boto:Headers: {} 2023-12-15T22:56:11.886 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:11.886 DEBUG:boto:Port: 8000 2023-12-15T22:56:11.886 DEBUG:boto:Params: {} 2023-12-15T22:56:11.886 DEBUG:boto:Token: None 2023-12-15T22:56:11.886 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:56:11 GMT /kskgfn-13/?versioning 2023-12-15T22:56:11.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Oij7KK6WkfOk9MDY+8K4XFcLtKM= 2023-12-15T22:56:11.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oij7KK6WkfOk9MDY+8K4XFcLtKM=', 'Content-Length': '228'} 2023-12-15T22:56:11.892 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000beca9cee54e23955-00657cd98b-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:11.892 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:11.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:11.892 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:11.941 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:11.941 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:11.972 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:56:11.987 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680971.892202_55.1","last_update":"2023-12-15T22:56:11.892202Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:56:11.987 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680971.892202_55.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:11.987 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:56:11.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:11.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:11.988 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:12.038 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:12.038 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:12.068 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:12.068+0000 7f0bf42e4800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:12.069 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:12.069+0000 7f0bf42e4800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:12.083 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680971.892202_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:11.892202Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:12Z"} 2023-12-15T22:56:12.084 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680971.892202_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:11.892202Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:12Z"} 2023-12-15T22:56:12.084 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680971.892202_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:56:11.892202Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:56:12.084 DEBUG:rgw_multi.tests:log_status={0: '1_1702680971.892202_55.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:12.084 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680971.892202_55.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:12.084 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:56:12.084 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:12.084 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:12.084 DEBUG:boto:Method: HEAD 2023-12-15T22:56:12.084 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:12.084 DEBUG:boto:Data: 2023-12-15T22:56:12.085 DEBUG:boto:Headers: {} 2023-12-15T22:56:12.085 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:12.085 DEBUG:boto:Port: 8000 2023-12-15T22:56:12.085 DEBUG:boto:Params: {} 2023-12-15T22:56:12.085 DEBUG:boto:Token: None 2023-12-15T22:56:12.085 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:12 GMT /kskgfn-13/ 2023-12-15T22:56:12.085 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WYjsBfoiWvM4t7rOmuR/4hoN83w= 2023-12-15T22:56:12.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WYjsBfoiWvM4t7rOmuR/4hoN83w=', 'Content-Length': '0'} 2023-12-15T22:56:12.087 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a40353509c9afc31-00657cd98c-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:12.088 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:12.088 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:12.088 DEBUG:boto:Method: PUT 2023-12-15T22:56:12.088 DEBUG:boto:Path: /kskgfn-13/dummy 2023-12-15T22:56:12.088 DEBUG:boto:Data: 2023-12-15T22:56:12.088 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:56:12.088 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:12.088 DEBUG:boto:Port: 8000 2023-12-15T22:56:12.088 DEBUG:boto:Params: {} 2023-12-15T22:56:12.088 DEBUG:boto:Token: None 2023-12-15T22:56:12.088 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:56:12 GMT /kskgfn-13/dummy 2023-12-15T22:56:12.089 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y46PJFtBXjCgtFdzCVvm60igbzw= 2023-12-15T22:56:12.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y46PJFtBXjCgtFdzCVvm60igbzw='} 2023-12-15T22:56:12.102 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-amz-request-id', 'tx000004d0b48b50b78f8f1-00657cd98c-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:12.102 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-13 2023-12-15T22:56:12.102 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:12.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:12.102 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:12.155 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:12.155 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:12.189 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:12.189+0000 7f2c60c9d800 1 waiting to reach incremental sync.. 2023-12-15T22:56:17.191 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:17.191+0000 7f2c60c9d800 1 bucket sync caught up with source: 2023-12-15T22:56:17.191 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000002.9.11, , , , , ] 2023-12-15T22:56:17.191 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000002.9.11, , , , , ] 2023-12-15T22:56:17.191 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:17.191+0000 7f2c60c9d800 0 bucket checkpoint complete 2023-12-15T22:56:17.208 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-13 2023-12-15T22:56:17.208 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:17.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:17.208 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:17.271 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:17.271 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:17.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:17.310+0000 7f5a29729800 1 waiting to reach incremental sync.. 2023-12-15T22:56:22.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:22.311+0000 7f5a29729800 1 bucket sync caught up with source: 2023-12-15T22:56:22.312 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000002.22.11, , , , , ] 2023-12-15T22:56:22.312 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000002.22.11, , , , , ] 2023-12-15T22:56:22.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:22.311+0000 7f5a29729800 0 bucket checkpoint complete 2023-12-15T22:56:22.329 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-13 zones={test-zone2, test-zone1} 2023-12-15T22:56:22.330 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.330 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.330 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.330 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.330 DEBUG:boto:Data: 2023-12-15T22:56:22.330 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.330 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.330 DEBUG:boto:Params: {} 2023-12-15T22:56:22.331 DEBUG:boto:Token: None 2023-12-15T22:56:22.331 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.334 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000acf754fb0ffdc029-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.334 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.334 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.335 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.335 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.335 DEBUG:boto:Data: 2023-12-15T22:56:22.335 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.335 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.335 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.335 DEBUG:boto:Params: {} 2023-12-15T22:56:22.335 DEBUG:boto:Token: None 2023-12-15T22:56:22.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.338 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001bac54512ef67218-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.338 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:56:22.338 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.338 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.338 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.338 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.338 DEBUG:boto:Method: GET 2023-12-15T22:56:22.339 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.339 DEBUG:boto:Data: 2023-12-15T22:56:22.339 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.339 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.339 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.339 DEBUG:boto:Params: {} 2023-12-15T22:56:22.339 DEBUG:boto:Token: None 2023-12-15T22:56:22.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/?versions 2023-12-15T22:56:22.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug= 2023-12-15T22:56:22.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug=', 'Content-Length': '0'} 2023-12-15T22:56:22.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098092fb1a61246f2-00657cd996-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.385 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.386 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:22.386 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:56:22.386 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.386 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.386 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.386 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.386 DEBUG:boto:Method: GET 2023-12-15T22:56:22.387 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.387 DEBUG:boto:Data: 2023-12-15T22:56:22.387 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.387 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.387 DEBUG:boto:Params: {} 2023-12-15T22:56:22.387 DEBUG:boto:Token: None 2023-12-15T22:56:22.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/?versions 2023-12-15T22:56:22.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug= 2023-12-15T22:56:22.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug=', 'Content-Length': '0'} 2023-12-15T22:56:22.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049870567d8ccd86e-00657cd996-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.390 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.390 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:22.390 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.390 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.391 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.391 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.391 DEBUG:boto:Method: GET 2023-12-15T22:56:22.391 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.391 DEBUG:boto:Data: 2023-12-15T22:56:22.391 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.391 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.391 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.391 DEBUG:boto:Params: {} 2023-12-15T22:56:22.391 DEBUG:boto:Token: None 2023-12-15T22:56:22.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/?versions 2023-12-15T22:56:22.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug= 2023-12-15T22:56:22.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug=', 'Content-Length': '0'} 2023-12-15T22:56:22.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034675bc009d47e8c-00657cd996-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.394 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.394 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.394 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.394 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.395 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.395 DEBUG:boto:Method: GET 2023-12-15T22:56:22.395 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:22.395 DEBUG:boto:Data: 2023-12-15T22:56:22.395 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.395 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.395 DEBUG:boto:Params: {} 2023-12-15T22:56:22.395 DEBUG:boto:Token: None 2023-12-15T22:56:22.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/?versions 2023-12-15T22:56:22.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug= 2023-12-15T22:56:22.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pvcIbwdjJRU9tEN5u3PKvvHdSug=', 'Content-Length': '0'} 2023-12-15T22:56:22.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a542c1486e36af29-00657cd996-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.441 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:22.442 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.442 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.442 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.442 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.442 DEBUG:boto:Method: GET 2023-12-15T22:56:22.442 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.442 DEBUG:boto:Data: 2023-12-15T22:56:22.442 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.443 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.443 DEBUG:boto:Params: {} 2023-12-15T22:56:22.443 DEBUG:boto:Token: None 2023-12-15T22:56:22.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.445 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004e3000582a0e783b-00657cd996-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.446 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.446 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.446 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.446 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.446 DEBUG:boto:Method: GET 2023-12-15T22:56:22.446 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.446 DEBUG:boto:Data: 2023-12-15T22:56:22.446 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.446 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.446 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.447 DEBUG:boto:Params: {} 2023-12-15T22:56:22.447 DEBUG:boto:Token: None 2023-12-15T22:56:22.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.449 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000065e075d6cf30843e-00657cd996-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.449 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.449 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.449 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.450 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.450 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.450 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.450 DEBUG:boto:Data: 2023-12-15T22:56:22.450 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.450 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.450 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.450 DEBUG:boto:Params: {} 2023-12-15T22:56:22.450 DEBUG:boto:Token: None 2023-12-15T22:56:22.450 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+10h5QskUxXuKPzPQPc9PRaOF2k= 2023-12-15T22:56:22.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+10h5QskUxXuKPzPQPc9PRaOF2k=', 'Content-Length': '0'} 2023-12-15T22:56:22.452 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007a4012f4a03a9f76-00657cd996-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.453 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.453 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.453 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.453 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.453 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.453 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.453 DEBUG:boto:Data: 2023-12-15T22:56:22.453 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.453 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.454 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.454 DEBUG:boto:Params: {} 2023-12-15T22:56:22.454 DEBUG:boto:Token: None 2023-12-15T22:56:22.454 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+10h5QskUxXuKPzPQPc9PRaOF2k= 2023-12-15T22:56:22.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+10h5QskUxXuKPzPQPc9PRaOF2k=', 'Content-Length': '0'} 2023-12-15T22:56:22.456 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d0d8622198c6e8e4-00657cd996-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:22.456 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.456 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.457 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.457 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.457 DEBUG:boto:Method: GET 2023-12-15T22:56:22.457 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.457 DEBUG:boto:Data: 2023-12-15T22:56:22.457 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.457 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.457 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.457 DEBUG:boto:Params: {} 2023-12-15T22:56:22.457 DEBUG:boto:Token: None 2023-12-15T22:56:22.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.460 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a44a28fd706c477c-00657cd996-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.460 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.460 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.460 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.461 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.461 DEBUG:boto:Method: GET 2023-12-15T22:56:22.461 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.461 DEBUG:boto:Data: 2023-12-15T22:56:22.461 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.461 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.461 DEBUG:boto:Params: {} 2023-12-15T22:56:22.461 DEBUG:boto:Token: None 2023-12-15T22:56:22.461 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.464 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000393634674680b32-00657cd996-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.464 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.464 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.464 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.464 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.464 DEBUG:boto:Method: GET 2023-12-15T22:56:22.464 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.464 DEBUG:boto:Data: 2023-12-15T22:56:22.465 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.465 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.465 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.465 DEBUG:boto:Params: {} 2023-12-15T22:56:22.465 DEBUG:boto:Token: None 2023-12-15T22:56:22.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4= 2023-12-15T22:56:22.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4=', 'Content-Length': '0'} 2023-12-15T22:56:22.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076f9ce9bb8f14f60-00657cd996-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.468 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.468 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.468 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.468 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.468 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.468 DEBUG:boto:Method: GET 2023-12-15T22:56:22.469 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.469 DEBUG:boto:Data: 2023-12-15T22:56:22.469 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.469 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.469 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.469 DEBUG:boto:Params: {} 2023-12-15T22:56:22.469 DEBUG:boto:Token: None 2023-12-15T22:56:22.469 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4= 2023-12-15T22:56:22.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4=', 'Content-Length': '0'} 2023-12-15T22:56:22.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004556a66de23771de-00657cd996-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.472 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.472 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.472 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.472 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.472 DEBUG:boto:Path: /kskgfn-13/dummy 2023-12-15T22:56:22.472 DEBUG:boto:Data: 2023-12-15T22:56:22.473 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.473 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.473 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.473 DEBUG:boto:Params: {} 2023-12-15T22:56:22.473 DEBUG:boto:Token: None 2023-12-15T22:56:22.473 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy 2023-12-15T22:56:22.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QP6cZ+kAdHPv4UwTQXmLS66I1p0= 2023-12-15T22:56:22.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QP6cZ+kAdHPv4UwTQXmLS66I1p0=', 'Content-Length': '0'} 2023-12-15T22:56:22.476 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000133594cf78a387d5-00657cd996-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.476 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.476 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.476 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.476 DEBUG:boto:Path: /kskgfn-13/dummy 2023-12-15T22:56:22.476 DEBUG:boto:Data: 2023-12-15T22:56:22.477 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.477 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.477 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.477 DEBUG:boto:Params: {} 2023-12-15T22:56:22.477 DEBUG:boto:Token: None 2023-12-15T22:56:22.477 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy 2023-12-15T22:56:22.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QP6cZ+kAdHPv4UwTQXmLS66I1p0= 2023-12-15T22:56:22.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QP6cZ+kAdHPv4UwTQXmLS66I1p0=', 'Content-Length': '0'} 2023-12-15T22:56:22.480 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b04cf2c4567b7c54-00657cd996-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:22.480 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.480 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.480 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.480 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.481 DEBUG:boto:Method: GET 2023-12-15T22:56:22.481 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.481 DEBUG:boto:Data: 2023-12-15T22:56:22.481 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.481 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.481 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.481 DEBUG:boto:Params: {} 2023-12-15T22:56:22.481 DEBUG:boto:Token: None 2023-12-15T22:56:22.481 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.481 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.484 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002865728016eb45bb-00657cd996-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.484 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:22.484 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:22.484 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.484 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.484 DEBUG:boto:Method: GET 2023-12-15T22:56:22.484 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.484 DEBUG:boto:Data: 2023-12-15T22:56:22.484 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.485 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.485 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.485 DEBUG:boto:Params: {} 2023-12-15T22:56:22.485 DEBUG:boto:Token: None 2023-12-15T22:56:22.485 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:22.485 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw= 2023-12-15T22:56:22.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iH08XQnznHslfSbj00E+73j+DQw=', 'Content-Length': '0'} 2023-12-15T22:56:22.487 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003b828e558293a58d-00657cd996-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.488 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.488 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.488 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.488 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.488 DEBUG:boto:Method: GET 2023-12-15T22:56:22.488 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.488 DEBUG:boto:Data: 2023-12-15T22:56:22.488 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.488 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.488 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.488 DEBUG:boto:Params: {} 2023-12-15T22:56:22.488 DEBUG:boto:Token: None 2023-12-15T22:56:22.489 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.489 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4= 2023-12-15T22:56:22.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4=', 'Content-Length': '0'} 2023-12-15T22:56:22.491 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fd8316e15cba0d2-00657cd996-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.491 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.492 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.492 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.492 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.492 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.492 DEBUG:boto:Method: GET 2023-12-15T22:56:22.492 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:22.492 DEBUG:boto:Data: 2023-12-15T22:56:22.492 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.492 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.492 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.493 DEBUG:boto:Params: {} 2023-12-15T22:56:22.493 DEBUG:boto:Token: None 2023-12-15T22:56:22.493 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4= 2023-12-15T22:56:22.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nq89rY7wkrvRZ4Frixxse4DOZN4=', 'Content-Length': '0'} 2023-12-15T22:56:22.495 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad956978a22be592-00657cd996-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.495 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:22.496 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-13 zones={test-zone2, test-zone1} 2023-12-15T22:56:22.496 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.496 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.496 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.496 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.496 DEBUG:boto:Data: 2023-12-15T22:56:22.496 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.496 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.496 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.497 DEBUG:boto:Params: {} 2023-12-15T22:56:22.497 DEBUG:boto:Token: None 2023-12-15T22:56:22.497 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.497 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.499 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ba0ac1fec8645cbb-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.499 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.499 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.499 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.500 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.500 DEBUG:boto:Data: 2023-12-15T22:56:22.500 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.500 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.500 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.500 DEBUG:boto:Params: {} 2023-12-15T22:56:22.500 DEBUG:boto:Token: None 2023-12-15T22:56:22.500 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.500 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.514 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-amz-request-id', 'tx0000026106bd967f023b6-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.514 DEBUG:rgw_multi.tests:zone=test-zone1 version=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:22.515 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.515 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.515 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.515 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.515 DEBUG:boto:Data: 2023-12-15T22:56:22.515 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.515 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.515 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.515 DEBUG:boto:Params: {} 2023-12-15T22:56:22.515 DEBUG:boto:Token: None 2023-12-15T22:56:22.515 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.516 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.518 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eb48e6e9513fbdd3-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.518 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.518 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.518 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.518 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.518 DEBUG:boto:Data: 2023-12-15T22:56:22.518 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.518 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.519 DEBUG:boto:Params: {} 2023-12-15T22:56:22.519 DEBUG:boto:Token: None 2023-12-15T22:56:22.519 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.562 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-amz-request-id', 'tx000003421c2d05873ba8a-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.562 DEBUG:rgw_multi.tests:zone=test-zone2 version=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:22.562 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.562 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.562 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.562 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.562 DEBUG:boto:Data: 2023-12-15T22:56:22.562 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.562 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.562 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.563 DEBUG:boto:Params: {} 2023-12-15T22:56:22.563 DEBUG:boto:Token: None 2023-12-15T22:56:22.563 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.565 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbf6bf12391cd2e7-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.565 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.565 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.566 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.566 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.566 DEBUG:boto:Data: 2023-12-15T22:56:22.566 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.566 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.566 DEBUG:boto:Params: {} 2023-12-15T22:56:22.566 DEBUG:boto:Token: None 2023-12-15T22:56:22.566 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.566 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.577 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-amz-request-id', 'tx0000081bb17383cf8aecc-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.577 DEBUG:rgw_multi.tests:zone=test-zone1 version=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:22.577 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.577 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.577 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.577 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.578 DEBUG:boto:Data: 2023-12-15T22:56:22.578 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.578 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.578 DEBUG:boto:Params: {} 2023-12-15T22:56:22.578 DEBUG:boto:Token: None 2023-12-15T22:56:22.578 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.581 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c667347829b3789-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.581 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.581 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.581 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.581 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.581 DEBUG:boto:Data: 2023-12-15T22:56:22.581 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.582 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.582 DEBUG:boto:Params: {} 2023-12-15T22:56:22.582 DEBUG:boto:Token: None 2023-12-15T22:56:22.582 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.593 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-amz-request-id', 'tx00000420f252a5866867e-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.593 DEBUG:rgw_multi.tests:zone=test-zone2 version=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:22.593 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.594 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.594 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.594 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.594 DEBUG:boto:Data: 2023-12-15T22:56:22.594 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.594 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.594 DEBUG:boto:Params: {} 2023-12-15T22:56:22.594 DEBUG:boto:Token: None 2023-12-15T22:56:22.594 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.597 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000084ac3ea2fdd9d7bf-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.597 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.597 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.597 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.597 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.597 DEBUG:boto:Data: 2023-12-15T22:56:22.598 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.598 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.598 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.598 DEBUG:boto:Params: {} 2023-12-15T22:56:22.598 DEBUG:boto:Token: None 2023-12-15T22:56:22.598 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.609 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-amz-request-id', 'tx000001376595e2ff144c8-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.609 DEBUG:rgw_multi.tests:zone=test-zone1 version=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:22.609 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.609 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.610 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.610 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.610 DEBUG:boto:Data: 2023-12-15T22:56:22.610 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.610 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.610 DEBUG:boto:Params: {} 2023-12-15T22:56:22.610 DEBUG:boto:Token: None 2023-12-15T22:56:22.610 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.612 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c33333512012a120-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.613 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.613 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.613 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.613 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.613 DEBUG:boto:Data: 2023-12-15T22:56:22.613 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.613 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.613 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.614 DEBUG:boto:Params: {} 2023-12-15T22:56:22.614 DEBUG:boto:Token: None 2023-12-15T22:56:22.614 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.625 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-amz-request-id', 'tx00000307f813e43ff0c9c-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.625 DEBUG:rgw_multi.tests:zone=test-zone2 version=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:22.626 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.626 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.626 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.626 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.626 DEBUG:boto:Data: 2023-12-15T22:56:22.626 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.626 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.626 DEBUG:boto:Params: {} 2023-12-15T22:56:22.626 DEBUG:boto:Token: None 2023-12-15T22:56:22.626 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.629 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000179410a99553e754-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.629 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.629 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.629 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.629 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.629 DEBUG:boto:Data: 2023-12-15T22:56:22.629 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.629 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.630 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.630 DEBUG:boto:Params: {} 2023-12-15T22:56:22.630 DEBUG:boto:Token: None 2023-12-15T22:56:22.630 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.674 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-amz-request-id', 'tx0000034a48ee8ecb343a5-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.674 DEBUG:rgw_multi.tests:zone=test-zone1 version=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:22.674 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.674 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.674 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.674 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.674 DEBUG:boto:Data: 2023-12-15T22:56:22.674 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.674 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.674 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.675 DEBUG:boto:Params: {} 2023-12-15T22:56:22.675 DEBUG:boto:Token: None 2023-12-15T22:56:22.675 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001eb48ca5c429fb21-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.678 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.678 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.678 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.678 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.678 DEBUG:boto:Data: 2023-12-15T22:56:22.678 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.678 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.678 DEBUG:boto:Params: {} 2023-12-15T22:56:22.678 DEBUG:boto:Token: None 2023-12-15T22:56:22.679 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.679 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-amz-request-id', 'tx000000374e4e950edab8b-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.722 DEBUG:rgw_multi.tests:zone=test-zone2 version=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:22.722 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.722 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.722 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.722 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.722 DEBUG:boto:Data: 2023-12-15T22:56:22.722 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.722 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.722 DEBUG:boto:Params: {} 2023-12-15T22:56:22.723 DEBUG:boto:Token: None 2023-12-15T22:56:22.723 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.725 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d5e9370e2c9d170-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.725 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.725 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.726 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.726 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.726 DEBUG:boto:Data: 2023-12-15T22:56:22.726 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.726 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.726 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.726 DEBUG:boto:Params: {} 2023-12-15T22:56:22.726 DEBUG:boto:Token: None 2023-12-15T22:56:22.726 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.737 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-amz-request-id', 'tx000007a8bb515ea0e604d-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.737 DEBUG:rgw_multi.tests:zone=test-zone1 version=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:22.737 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.737 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.738 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.738 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.738 DEBUG:boto:Data: 2023-12-15T22:56:22.738 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.738 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.738 DEBUG:boto:Params: {} 2023-12-15T22:56:22.738 DEBUG:boto:Token: None 2023-12-15T22:56:22.738 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.740 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c45f4e23088bd908-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.741 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.741 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.741 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.741 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.741 DEBUG:boto:Data: 2023-12-15T22:56:22.741 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.741 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.741 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.741 DEBUG:boto:Params: {} 2023-12-15T22:56:22.742 DEBUG:boto:Token: None 2023-12-15T22:56:22.742 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.753 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-amz-request-id', 'tx000001f8892080034b04e-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.753 DEBUG:rgw_multi.tests:zone=test-zone2 version=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:22.753 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.753 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.754 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.754 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.754 DEBUG:boto:Data: 2023-12-15T22:56:22.754 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.754 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.754 DEBUG:boto:Params: {} 2023-12-15T22:56:22.754 DEBUG:boto:Token: None 2023-12-15T22:56:22.754 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.757 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '40'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ffcf0334e07ee4d9-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.757 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.757 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.757 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.757 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.757 DEBUG:boto:Data: 2023-12-15T22:56:22.757 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.758 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.758 DEBUG:boto:Params: {} 2023-12-15T22:56:22.758 DEBUG:boto:Token: None 2023-12-15T22:56:22.758 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.768 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-amz-request-id', 'tx000000007b072718398a1-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.769 DEBUG:rgw_multi.tests:zone=test-zone1 version=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:22.769 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.769 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.769 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.769 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.769 DEBUG:boto:Data: 2023-12-15T22:56:22.769 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.769 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.769 DEBUG:boto:Params: {} 2023-12-15T22:56:22.770 DEBUG:boto:Token: None 2023-12-15T22:56:22.770 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.772 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e1537e52dbca749b-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.772 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.772 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.772 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.772 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.773 DEBUG:boto:Data: 2023-12-15T22:56:22.773 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.773 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.773 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.773 DEBUG:boto:Params: {} 2023-12-15T22:56:22.773 DEBUG:boto:Token: None 2023-12-15T22:56:22.773 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.783 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-amz-request-id', 'tx00000c747287d044d0807-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.783 DEBUG:rgw_multi.tests:zone=test-zone2 version=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:22.783 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.784 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.784 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.784 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.784 DEBUG:boto:Data: 2023-12-15T22:56:22.784 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.784 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.784 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.784 DEBUG:boto:Params: {} 2023-12-15T22:56:22.784 DEBUG:boto:Token: None 2023-12-15T22:56:22.785 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.787 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f828abec8bbf888b-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.787 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.787 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.787 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.787 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.787 DEBUG:boto:Data: 2023-12-15T22:56:22.788 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.788 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.788 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.788 DEBUG:boto:Params: {} 2023-12-15T22:56:22.788 DEBUG:boto:Token: None 2023-12-15T22:56:22.788 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.829 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-amz-request-id', 'tx00000fa7219f14845e756-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.830 DEBUG:rgw_multi.tests:zone=test-zone1 version=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:22.830 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.830 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.830 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.830 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.830 DEBUG:boto:Data: 2023-12-15T22:56:22.830 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.830 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.830 DEBUG:boto:Params: {} 2023-12-15T22:56:22.831 DEBUG:boto:Token: None 2023-12-15T22:56:22.831 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.833 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '88'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031c43175480622cf-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.833 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.833 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.833 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.833 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.833 DEBUG:boto:Data: 2023-12-15T22:56:22.833 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.833 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.834 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.834 DEBUG:boto:Params: {} 2023-12-15T22:56:22.834 DEBUG:boto:Token: None 2023-12-15T22:56:22.834 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.843 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-amz-request-id', 'tx000000a146428d9263ad7-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.843 DEBUG:rgw_multi.tests:zone=test-zone2 version=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:22.843 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.843 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.843 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.843 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.844 DEBUG:boto:Data: 2023-12-15T22:56:22.844 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.844 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.844 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.844 DEBUG:boto:Params: {} 2023-12-15T22:56:22.844 DEBUG:boto:Token: None 2023-12-15T22:56:22.844 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.849 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '104'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ea6fb6daef01404-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.849 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.849 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.849 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.849 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.849 DEBUG:boto:Data: 2023-12-15T22:56:22.849 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.850 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.850 DEBUG:boto:Params: {} 2023-12-15T22:56:22.850 DEBUG:boto:Token: None 2023-12-15T22:56:22.850 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.860 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-amz-request-id', 'tx000001d91c21e2278184c-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.860 DEBUG:rgw_multi.tests:zone=test-zone1 version=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:22.860 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.860 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.860 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.860 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.860 DEBUG:boto:Data: 2023-12-15T22:56:22.860 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.861 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.861 DEBUG:boto:Params: {} 2023-12-15T22:56:22.861 DEBUG:boto:Token: None 2023-12-15T22:56:22.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.863 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '112'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a7e5ae55109c9cfa-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.863 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.863 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.864 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.864 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.864 DEBUG:boto:Data: 2023-12-15T22:56:22.864 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.864 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.864 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.864 DEBUG:boto:Params: {} 2023-12-15T22:56:22.864 DEBUG:boto:Token: None 2023-12-15T22:56:22.864 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.910 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-amz-request-id', 'tx000004c39d60da1421d2f-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.910 DEBUG:rgw_multi.tests:zone=test-zone2 version=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:22.910 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.910 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.910 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.910 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.910 DEBUG:boto:Data: 2023-12-15T22:56:22.910 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.911 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.911 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.911 DEBUG:boto:Params: {} 2023-12-15T22:56:22.911 DEBUG:boto:Token: None 2023-12-15T22:56:22.911 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.914 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '128'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000268ca4021c95196a-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.914 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.914 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.914 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.914 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.914 DEBUG:boto:Data: 2023-12-15T22:56:22.915 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.915 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.915 DEBUG:boto:Params: {} 2023-12-15T22:56:22.915 DEBUG:boto:Token: None 2023-12-15T22:56:22.915 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.958 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-amz-request-id', 'tx00000c023c15656483a6e-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.958 DEBUG:rgw_multi.tests:zone=test-zone1 version=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:22.958 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.958 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.958 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.958 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.958 DEBUG:boto:Data: 2023-12-15T22:56:22.958 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.959 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.959 DEBUG:boto:Params: {} 2023-12-15T22:56:22.959 DEBUG:boto:Token: None 2023-12-15T22:56:22.959 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.961 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b505d8dc51c7bc7-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.961 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.961 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.962 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.962 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.962 DEBUG:boto:Data: 2023-12-15T22:56:22.962 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.962 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.962 DEBUG:boto:Params: {} 2023-12-15T22:56:22.962 DEBUG:boto:Token: None 2023-12-15T22:56:22.962 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.972 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-amz-request-id', 'tx00000e0360e4778f22da3-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.972 DEBUG:rgw_multi.tests:zone=test-zone2 version=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:22.973 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.973 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.973 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.973 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.973 DEBUG:boto:Data: 2023-12-15T22:56:22.973 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.973 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.973 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.974 DEBUG:boto:Params: {} 2023-12-15T22:56:22.974 DEBUG:boto:Token: None 2023-12-15T22:56:22.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.976 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '136'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ed15f9d7c737441d-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.976 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.977 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.977 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.977 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.977 DEBUG:boto:Data: 2023-12-15T22:56:22.977 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.977 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:22.977 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.977 DEBUG:boto:Params: {} 2023-12-15T22:56:22.977 DEBUG:boto:Token: None 2023-12-15T22:56:22.978 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:22.987 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-amz-request-id', 'tx0000024b0fa8c2b5eb966-00657cd996-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.987 DEBUG:rgw_multi.tests:zone=test-zone1 version=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:22.987 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:22.987 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:22.987 DEBUG:boto:Method: HEAD 2023-12-15T22:56:22.987 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:22.987 DEBUG:boto:Data: 2023-12-15T22:56:22.988 DEBUG:boto:Headers: {} 2023-12-15T22:56:22.988 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.988 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.988 DEBUG:boto:Params: {} 2023-12-15T22:56:22.988 DEBUG:boto:Token: None 2023-12-15T22:56:22.988 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/ 2023-12-15T22:56:22.988 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM= 2023-12-15T22:56:22.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F6x7e3JG9K8IUi4NM3Vf8Sf5bQM=', 'Content-Length': '0'} 2023-12-15T22:56:22.990 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '128'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000976c43d1ac027791-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:22.990 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:22.990 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:22.990 DEBUG:boto:Method: PUT 2023-12-15T22:56:22.990 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:22.991 DEBUG:boto:Data: 2023-12-15T22:56:22.991 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2023-12-15T22:56:22.991 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:22.991 DEBUG:boto:Port: 8000 2023-12-15T22:56:22.991 DEBUG:boto:Params: {} 2023-12-15T22:56:22.991 DEBUG:boto:Token: None 2023-12-15T22:56:22.991 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Fri, 15 Dec 2023 22:56:22 GMT /kskgfn-13/obj 2023-12-15T22:56:22.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4= 2023-12-15T22:56:22.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4do98Hn3gZD/I4B2PpS0upHLy4='} 2023-12-15T22:56:23.001 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-amz-request-id', 'tx00000e8cb39fac96db2d4-00657cd996-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:23.001 DEBUG:rgw_multi.tests:zone=test-zone2 version=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:23.001 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-13 2023-12-15T22:56:23.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:23.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:23.002 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:23.055 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:23.055 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:23.087 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:23.087+0000 7f9f2d940800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:23.087 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000002.9.11, , , 00000000021.78.6, , ] 2023-12-15T22:56:23.087 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000003.11.10, , , 00000000029.94.12, , ] 2023-12-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:28.088+0000 7f9f2d940800 1 bucket sync caught up with source: 2023-12-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000003.11.10, , , 00000000029.94.12, , ] 2023-12-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000003.11.10, , , 00000000029.94.12, , ] 2023-12-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:28.088+0000 7f9f2d940800 0 bucket checkpoint complete 2023-12-15T22:56:28.107 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-13 2023-12-15T22:56:28.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:28.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:28.108 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:28.169 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:28.169 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:28.207+0000 7f8360329800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:28.208 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000002.22.11, , , 00000000024.80.12, , ] 2023-12-15T22:56:28.208 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000002.22.11, , , 00000000032.98.9, , ] 2023-12-15T22:56:33.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:33.209+0000 7f8360329800 1 bucket sync caught up with source: 2023-12-15T22:56:33.209 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000002.22.11, , , 00000000032.98.9, , ] 2023-12-15T22:56:33.209 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000002.22.11, , , 00000000032.98.9, , ] 2023-12-15T22:56:33.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:33.209+0000 7f8360329800 0 bucket checkpoint complete 2023-12-15T22:56:33.225 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-13 zones={test-zone2, test-zone1} 2023-12-15T22:56:33.226 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.226 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.226 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.226 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:33.226 DEBUG:boto:Data: 2023-12-15T22:56:33.226 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.226 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.226 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.226 DEBUG:boto:Params: {} 2023-12-15T22:56:33.226 DEBUG:boto:Token: None 2023-12-15T22:56:33.227 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWf6cQ5JlvGIP/TS4UVzNeRdrd0= 2023-12-15T22:56:33.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWf6cQ5JlvGIP/TS4UVzNeRdrd0=', 'Content-Length': '0'} 2023-12-15T22:56:33.229 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a48f5151e80cec0a-00657cd9a1-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.229 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.230 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.230 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.230 DEBUG:boto:Path: /kskgfn-13/ 2023-12-15T22:56:33.230 DEBUG:boto:Data: 2023-12-15T22:56:33.230 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.230 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.230 DEBUG:boto:Params: {} 2023-12-15T22:56:33.230 DEBUG:boto:Token: None 2023-12-15T22:56:33.230 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWf6cQ5JlvGIP/TS4UVzNeRdrd0= 2023-12-15T22:56:33.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWf6cQ5JlvGIP/TS4UVzNeRdrd0=', 'Content-Length': '0'} 2023-12-15T22:56:33.233 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e9178728eaface14-00657cd9a1-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.233 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:56:33.233 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.234 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.234 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.234 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.234 DEBUG:boto:Method: GET 2023-12-15T22:56:33.234 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.234 DEBUG:boto:Data: 2023-12-15T22:56:33.234 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.234 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.234 DEBUG:boto:Params: {} 2023-12-15T22:56:33.235 DEBUG:boto:Token: None 2023-12-15T22:56:33.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/?versions 2023-12-15T22:56:33.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk= 2023-12-15T22:56:33.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk=', 'Content-Length': '0'} 2023-12-15T22:56:33.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009be4d460a8d5727d-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.238 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3QtoBH8LE69KTyCJsh6PJj5RqGMNUjztrue2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSSxGHM4WDbJn3-7VMXFvFihm7w06lnUfalse2023-12-15T22:56:22.980Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXEcx0QIiQvKBuEM6.ADP.rnGExb903efalse2023-12-15T22:56:22.965Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXv6P8.jN0R2pQ275-7GWxN2XzwQVB6sfalse2023-12-15T22:56:22.918Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjd-oH9elSTqNdDvyjqT3g6oLs45dqCTbfalse2023-12-15T22:56:22.867Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjvTZ6c3KrCi.srBSpKva33j1thTAOn50false2023-12-15T22:56:22.852Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj0s6cyoYrc8T5VBG76rZ7eh79x3a9b1Ufalse2023-12-15T22:56:22.836Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjUbVDCdACx1N7qu3Cm4ruXFlbDsqSpPbfalse2023-12-15T22:56:22.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjEXfHCAQIijdDWWIi1LYwo3NHAcveG8kfalse2023-12-15T22:56:22.761Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjiGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZfalse2023-12-15T22:56:22.776Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-hpnsSvu58IbqQOxiajlTbJIs83X1QXfalse2023-12-15T22:56:22.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjyjAKdpKlj3Yh9CyZ8J34cr1vUv2L43pfalse2023-12-15T22:56:22.729Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwOfalse2023-12-15T22:56:22.632Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjELiP64.-9ImKBdXw1V4J3oT7s8ynJt0false2023-12-15T22:56:22.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjlbzMk1gqf71XLqD2vk3YmoNzMVpwtUMfalse2023-12-15T22:56:22.601Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq5CefSIJUWWwv8YpVPSjFuKnO7x22swfalse2023-12-15T22:56:22.616Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj.YZiBCR2mmPSn158CxWHUZ.enE1zvXWfalse2023-12-15T22:56:22.569Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4M2M401HV1oeV5EtB.f8adCFTkSoiPnfalse2023-12-15T22:56:22.584Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjsdCl7v0IZEVuMiXDPUH1T9ryWnmLRvSfalse2023-12-15T22:56:22.521Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjuuHiYqZpmhG6zE2w2.CDxlFgnkOeI-ifalse2023-12-15T22:56:22.503Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.239 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:33.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.241 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.241 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.241 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:56:33.241 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.241 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.241 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.241 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.241 DEBUG:boto:Method: GET 2023-12-15T22:56:33.241 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.241 DEBUG:boto:Data: 2023-12-15T22:56:33.242 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.242 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.242 DEBUG:boto:Params: {} 2023-12-15T22:56:33.242 DEBUG:boto:Token: None 2023-12-15T22:56:33.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/?versions 2023-12-15T22:56:33.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk= 2023-12-15T22:56:33.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk=', 'Content-Length': '0'} 2023-12-15T22:56:33.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070dad8639bff3343-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.245 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3QtoBH8LE69KTyCJsh6PJj5RqGMNUjztrue2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSSxGHM4WDbJn3-7VMXFvFihm7w06lnUfalse2023-12-15T22:56:22.980Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXEcx0QIiQvKBuEM6.ADP.rnGExb903efalse2023-12-15T22:56:22.965Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXv6P8.jN0R2pQ275-7GWxN2XzwQVB6sfalse2023-12-15T22:56:22.918Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjd-oH9elSTqNdDvyjqT3g6oLs45dqCTbfalse2023-12-15T22:56:22.867Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjvTZ6c3KrCi.srBSpKva33j1thTAOn50false2023-12-15T22:56:22.852Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj0s6cyoYrc8T5VBG76rZ7eh79x3a9b1Ufalse2023-12-15T22:56:22.836Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjUbVDCdACx1N7qu3Cm4ruXFlbDsqSpPbfalse2023-12-15T22:56:22.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjEXfHCAQIijdDWWIi1LYwo3NHAcveG8kfalse2023-12-15T22:56:22.761Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjiGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZfalse2023-12-15T22:56:22.776Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-hpnsSvu58IbqQOxiajlTbJIs83X1QXfalse2023-12-15T22:56:22.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjyjAKdpKlj3Yh9CyZ8J34cr1vUv2L43pfalse2023-12-15T22:56:22.729Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwOfalse2023-12-15T22:56:22.632Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjELiP64.-9ImKBdXw1V4J3oT7s8ynJt0false2023-12-15T22:56:22.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjlbzMk1gqf71XLqD2vk3YmoNzMVpwtUMfalse2023-12-15T22:56:22.601Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq5CefSIJUWWwv8YpVPSjFuKnO7x22swfalse2023-12-15T22:56:22.616Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj.YZiBCR2mmPSn158CxWHUZ.enE1zvXWfalse2023-12-15T22:56:22.569Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4M2M401HV1oeV5EtB.f8adCFTkSoiPnfalse2023-12-15T22:56:22.584Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjsdCl7v0IZEVuMiXDPUH1T9ryWnmLRvSfalse2023-12-15T22:56:22.521Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjuuHiYqZpmhG6zE2w2.CDxlFgnkOeI-ifalse2023-12-15T22:56:22.503Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:33.247 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.248 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.248 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.248 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.248 DEBUG:boto:Method: GET 2023-12-15T22:56:33.248 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.248 DEBUG:boto:Data: 2023-12-15T22:56:33.248 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.248 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.248 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.248 DEBUG:boto:Params: {} 2023-12-15T22:56:33.248 DEBUG:boto:Token: None 2023-12-15T22:56:33.248 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/?versions 2023-12-15T22:56:33.249 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk= 2023-12-15T22:56:33.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk=', 'Content-Length': '0'} 2023-12-15T22:56:33.251 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040d4ef9b342adce6-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.252 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3QtoBH8LE69KTyCJsh6PJj5RqGMNUjztrue2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSSxGHM4WDbJn3-7VMXFvFihm7w06lnUfalse2023-12-15T22:56:22.980Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXEcx0QIiQvKBuEM6.ADP.rnGExb903efalse2023-12-15T22:56:22.965Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXv6P8.jN0R2pQ275-7GWxN2XzwQVB6sfalse2023-12-15T22:56:22.918Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjd-oH9elSTqNdDvyjqT3g6oLs45dqCTbfalse2023-12-15T22:56:22.867Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjvTZ6c3KrCi.srBSpKva33j1thTAOn50false2023-12-15T22:56:22.852Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj0s6cyoYrc8T5VBG76rZ7eh79x3a9b1Ufalse2023-12-15T22:56:22.836Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjUbVDCdACx1N7qu3Cm4ruXFlbDsqSpPbfalse2023-12-15T22:56:22.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjEXfHCAQIijdDWWIi1LYwo3NHAcveG8kfalse2023-12-15T22:56:22.761Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjiGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZfalse2023-12-15T22:56:22.776Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-hpnsSvu58IbqQOxiajlTbJIs83X1QXfalse2023-12-15T22:56:22.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjyjAKdpKlj3Yh9CyZ8J34cr1vUv2L43pfalse2023-12-15T22:56:22.729Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwOfalse2023-12-15T22:56:22.632Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjELiP64.-9ImKBdXw1V4J3oT7s8ynJt0false2023-12-15T22:56:22.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjlbzMk1gqf71XLqD2vk3YmoNzMVpwtUMfalse2023-12-15T22:56:22.601Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq5CefSIJUWWwv8YpVPSjFuKnO7x22swfalse2023-12-15T22:56:22.616Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj.YZiBCR2mmPSn158CxWHUZ.enE1zvXWfalse2023-12-15T22:56:22.569Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4M2M401HV1oeV5EtB.f8adCFTkSoiPnfalse2023-12-15T22:56:22.584Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjsdCl7v0IZEVuMiXDPUH1T9ryWnmLRvSfalse2023-12-15T22:56:22.521Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjuuHiYqZpmhG6zE2w2.CDxlFgnkOeI-ifalse2023-12-15T22:56:22.503Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.253 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.253 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.253 DEBUG:boto:path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.253 DEBUG:boto:auth_path=/kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.253 DEBUG:boto:Method: GET 2023-12-15T22:56:33.253 DEBUG:boto:Path: /kskgfn-13/?versions&max-keys=999 2023-12-15T22:56:33.253 DEBUG:boto:Data: 2023-12-15T22:56:33.253 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.253 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.254 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.254 DEBUG:boto:Params: {} 2023-12-15T22:56:33.254 DEBUG:boto:Token: None 2023-12-15T22:56:33.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/?versions 2023-12-15T22:56:33.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk= 2023-12-15T22:56:33.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WVGQcoysi5W1TQnn8wcaCVMJxCk=', 'Content-Length': '0'} 2023-12-15T22:56:33.256 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de59ac33a90dd798-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.257 DEBUG:boto:b'kskgfn-13999falsedummypkjWzVUBVTVqo4Y95QSdhTkdsFT6qkNtrue2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3QtoBH8LE69KTyCJsh6PJj5RqGMNUjztrue2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjSSxGHM4WDbJn3-7VMXFvFihm7w06lnUfalse2023-12-15T22:56:22.980Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXEcx0QIiQvKBuEM6.ADP.rnGExb903efalse2023-12-15T22:56:22.965Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjXv6P8.jN0R2pQ275-7GWxN2XzwQVB6sfalse2023-12-15T22:56:22.918Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjd-oH9elSTqNdDvyjqT3g6oLs45dqCTbfalse2023-12-15T22:56:22.867Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjvTZ6c3KrCi.srBSpKva33j1thTAOn50false2023-12-15T22:56:22.852Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj0s6cyoYrc8T5VBG76rZ7eh79x3a9b1Ufalse2023-12-15T22:56:22.836Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjUbVDCdACx1N7qu3Cm4ruXFlbDsqSpPbfalse2023-12-15T22:56:22.790Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjEXfHCAQIijdDWWIi1LYwo3NHAcveG8kfalse2023-12-15T22:56:22.761Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjiGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZfalse2023-12-15T22:56:22.776Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj-hpnsSvu58IbqQOxiajlTbJIs83X1QXfalse2023-12-15T22:56:22.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjyjAKdpKlj3Yh9CyZ8J34cr1vUv2L43pfalse2023-12-15T22:56:22.729Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwOfalse2023-12-15T22:56:22.632Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjELiP64.-9ImKBdXw1V4J3oT7s8ynJt0false2023-12-15T22:56:22.681Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjlbzMk1gqf71XLqD2vk3YmoNzMVpwtUMfalse2023-12-15T22:56:22.601Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjq5CefSIJUWWwv8YpVPSjFuKnO7x22swfalse2023-12-15T22:56:22.616Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj.YZiBCR2mmPSn158CxWHUZ.enE1zvXWfalse2023-12-15T22:56:22.569Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4M2M401HV1oeV5EtB.f8adCFTkSoiPnfalse2023-12-15T22:56:22.584Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjsdCl7v0IZEVuMiXDPUH1T9ryWnmLRvSfalse2023-12-15T22:56:22.521Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormalobjuuHiYqZpmhG6zE2w2.CDxlFgnkOeI-ifalse2023-12-15T22:56:22.503Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:33.258 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.258 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.258 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.258 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.258 DEBUG:boto:Method: GET 2023-12-15T22:56:33.258 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.258 DEBUG:boto:Data: 2023-12-15T22:56:33.258 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.259 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.259 DEBUG:boto:Params: {} 2023-12-15T22:56:33.259 DEBUG:boto:Token: None 2023-12-15T22:56:33.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.261 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e16b0274eb340c87-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.261 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.261 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.262 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.262 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.262 DEBUG:boto:Method: GET 2023-12-15T22:56:33.262 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.262 DEBUG:boto:Data: 2023-12-15T22:56:33.262 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.262 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.262 DEBUG:boto:Params: {} 2023-12-15T22:56:33.262 DEBUG:boto:Token: None 2023-12-15T22:56:33.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.265 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000005b692aa13d3aaa6-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.265 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.265 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.265 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.266 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.266 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.266 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.266 DEBUG:boto:Data: 2023-12-15T22:56:33.266 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.266 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.266 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.266 DEBUG:boto:Params: {} 2023-12-15T22:56:33.266 DEBUG:boto:Token: None 2023-12-15T22:56:33.266 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6p318oL/3HkfcOI5XVuaR1kDKrI= 2023-12-15T22:56:33.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6p318oL/3HkfcOI5XVuaR1kDKrI=', 'Content-Length': '0'} 2023-12-15T22:56:33.269 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004e4acb14678b8854-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.269 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.269 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.269 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.269 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.269 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.270 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.270 DEBUG:boto:Data: 2023-12-15T22:56:33.270 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.270 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.270 DEBUG:boto:Params: {} 2023-12-15T22:56:33.270 DEBUG:boto:Token: None 2023-12-15T22:56:33.270 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6p318oL/3HkfcOI5XVuaR1kDKrI= 2023-12-15T22:56:33.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6p318oL/3HkfcOI5XVuaR1kDKrI=', 'Content-Length': '0'} 2023-12-15T22:56:33.273 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000453250cbbfe4cae5-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:33.274 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.274 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.274 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.274 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.274 DEBUG:boto:Method: GET 2023-12-15T22:56:33.274 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.274 DEBUG:boto:Data: 2023-12-15T22:56:33.274 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.274 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.274 DEBUG:boto:Params: {} 2023-12-15T22:56:33.275 DEBUG:boto:Token: None 2023-12-15T22:56:33.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.277 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000795bdb6115d1d1c3-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.277 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.277 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.278 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.278 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.278 DEBUG:boto:Method: GET 2023-12-15T22:56:33.278 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.278 DEBUG:boto:Data: 2023-12-15T22:56:33.278 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.278 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.278 DEBUG:boto:Params: {} 2023-12-15T22:56:33.278 DEBUG:boto:Token: None 2023-12-15T22:56:33.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.280 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008257cfbc1cb19195-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.280 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.281 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.281 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.281 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.281 DEBUG:boto:Method: GET 2023-12-15T22:56:33.281 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.281 DEBUG:boto:Data: 2023-12-15T22:56:33.281 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.281 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.281 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.281 DEBUG:boto:Params: {} 2023-12-15T22:56:33.282 DEBUG:boto:Token: None 2023-12-15T22:56:33.282 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ae23387a5c2f18b-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.325 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.326 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.326 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.326 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.326 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.326 DEBUG:boto:Method: GET 2023-12-15T22:56:33.326 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.326 DEBUG:boto:Data: 2023-12-15T22:56:33.326 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.327 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.327 DEBUG:boto:Params: {} 2023-12-15T22:56:33.327 DEBUG:boto:Token: None 2023-12-15T22:56:33.327 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e51fdf838a9f415-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.329 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.330 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.330 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.330 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.330 DEBUG:boto:Path: /kskgfn-13/dummy 2023-12-15T22:56:33.330 DEBUG:boto:Data: 2023-12-15T22:56:33.330 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.330 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.331 DEBUG:boto:Params: {} 2023-12-15T22:56:33.331 DEBUG:boto:Token: None 2023-12-15T22:56:33.331 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy 2023-12-15T22:56:33.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C5SDRMRbfnHAG3FAEzLNidyXb4o= 2023-12-15T22:56:33.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C5SDRMRbfnHAG3FAEzLNidyXb4o=', 'Content-Length': '0'} 2023-12-15T22:56:33.334 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000061ece09d856b32b7-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.334 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.334 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.334 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.334 DEBUG:boto:Path: /kskgfn-13/dummy 2023-12-15T22:56:33.334 DEBUG:boto:Data: 2023-12-15T22:56:33.334 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.335 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.335 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.335 DEBUG:boto:Params: {} 2023-12-15T22:56:33.335 DEBUG:boto:Token: None 2023-12-15T22:56:33.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy 2023-12-15T22:56:33.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C5SDRMRbfnHAG3FAEzLNidyXb4o= 2023-12-15T22:56:33.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C5SDRMRbfnHAG3FAEzLNidyXb4o=', 'Content-Length': '0'} 2023-12-15T22:56:33.337 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000038d1145a69daef3c-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T22:56:33.338 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.338 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.338 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.338 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.338 DEBUG:boto:Method: GET 2023-12-15T22:56:33.338 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.338 DEBUG:boto:Data: 2023-12-15T22:56:33.338 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.338 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.338 DEBUG:boto:Params: {} 2023-12-15T22:56:33.339 DEBUG:boto:Token: None 2023-12-15T22:56:33.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.341 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c149043e3c4a4aab-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.341 DEBUG:boto:path=/kskgfn-13/dummy 2023-12-15T22:56:33.341 DEBUG:boto:auth_path=/kskgfn-13/dummy 2023-12-15T22:56:33.341 DEBUG:boto:path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.341 DEBUG:boto:auth_path=/kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.341 DEBUG:boto:Method: GET 2023-12-15T22:56:33.341 DEBUG:boto:Path: /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.341 DEBUG:boto:Data: 2023-12-15T22:56:33.342 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.342 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.342 DEBUG:boto:Params: {} 2023-12-15T22:56:33.342 DEBUG:boto:Token: None 2023-12-15T22:56:33.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/dummy?versionId=pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN 2023-12-15T22:56:33.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE= 2023-12-15T22:56:33.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HxYVm4wc6DFa2pGjsj5cetnPMgE=', 'Content-Length': '0'} 2023-12-15T22:56:33.344 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:12 GMT'), ('x-amz-version-id', 'pkjWzVUBVTVqo4Y95QSdhTkdsFT6qkN'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c0f96794681c0335-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.345 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.345 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.345 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.345 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.345 DEBUG:boto:Method: GET 2023-12-15T22:56:33.345 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.345 DEBUG:boto:Data: 2023-12-15T22:56:33.345 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.345 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.345 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.345 DEBUG:boto:Params: {} 2023-12-15T22:56:33.346 DEBUG:boto:Token: None 2023-12-15T22:56:33.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f4aa1c9fc5de69b-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.348 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.348 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.349 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.349 DEBUG:boto:path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.349 DEBUG:boto:auth_path=/kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.349 DEBUG:boto:Method: GET 2023-12-15T22:56:33.349 DEBUG:boto:Path: /kskgfn-13/?prefix=dummy 2023-12-15T22:56:33.349 DEBUG:boto:Data: 2023-12-15T22:56:33.349 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.349 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.349 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.349 DEBUG:boto:Params: {} 2023-12-15T22:56:33.349 DEBUG:boto:Token: None 2023-12-15T22:56:33.349 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000944b7a48fd6717c1-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.352 DEBUG:boto:b'kskgfn-13dummy1000falsedummy2023-12-15T22:56:12.091Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.353 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.353 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.353 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.353 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.353 DEBUG:boto:Method: GET 2023-12-15T22:56:33.353 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.353 DEBUG:boto:Data: 2023-12-15T22:56:33.353 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.353 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.353 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.354 DEBUG:boto:Params: {} 2023-12-15T22:56:33.354 DEBUG:boto:Token: None 2023-12-15T22:56:33.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.356 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b3a9b51046b88dbf-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.357 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.357 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.357 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.357 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.357 DEBUG:boto:Method: GET 2023-12-15T22:56:33.357 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.357 DEBUG:boto:Data: 2023-12-15T22:56:33.357 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.357 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.357 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.357 DEBUG:boto:Params: {} 2023-12-15T22:56:33.357 DEBUG:boto:Token: None 2023-12-15T22:56:33.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.360 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a12cdb958b57ac3a-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.361 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.361 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.361 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.361 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.361 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.361 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.361 DEBUG:boto:Data: 2023-12-15T22:56:33.361 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.361 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.361 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.361 DEBUG:boto:Params: {} 2023-12-15T22:56:33.362 DEBUG:boto:Token: None 2023-12-15T22:56:33.362 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:niGsQm6glLuHsoLltTXhqy+M40g= 2023-12-15T22:56:33.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:niGsQm6glLuHsoLltTXhqy+M40g=', 'Content-Length': '0'} 2023-12-15T22:56:33.364 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003d3abf6dc2f161e6-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.364 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.364 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.364 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.364 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.364 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.364 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.364 DEBUG:boto:Data: 2023-12-15T22:56:33.364 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.364 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.365 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.365 DEBUG:boto:Params: {} 2023-12-15T22:56:33.365 DEBUG:boto:Token: None 2023-12-15T22:56:33.365 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.365 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:niGsQm6glLuHsoLltTXhqy+M40g= 2023-12-15T22:56:33.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:niGsQm6glLuHsoLltTXhqy+M40g=', 'Content-Length': '0'} 2023-12-15T22:56:33.367 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000013f3e8589466c932-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.367 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.368 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.368 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.368 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.368 DEBUG:boto:Method: GET 2023-12-15T22:56:33.368 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.368 DEBUG:boto:Data: 2023-12-15T22:56:33.368 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.368 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.368 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.368 DEBUG:boto:Params: {} 2023-12-15T22:56:33.368 DEBUG:boto:Token: None 2023-12-15T22:56:33.368 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.371 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007334b7dcc754fb4c-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.371 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.371 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.371 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.371 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.371 DEBUG:boto:Method: GET 2023-12-15T22:56:33.372 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.372 DEBUG:boto:Data: 2023-12-15T22:56:33.372 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.372 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.372 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.372 DEBUG:boto:Params: {} 2023-12-15T22:56:33.372 DEBUG:boto:Token: None 2023-12-15T22:56:33.372 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.372 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.374 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c0a7931cf0bb71d6-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.422 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.422 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.422 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.422 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.422 DEBUG:boto:Method: GET 2023-12-15T22:56:33.422 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.422 DEBUG:boto:Data: 2023-12-15T22:56:33.422 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.422 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.422 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.422 DEBUG:boto:Params: {} 2023-12-15T22:56:33.423 DEBUG:boto:Token: None 2023-12-15T22:56:33.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022e093b3007ff1d0-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.425 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.426 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.426 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.426 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.426 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.426 DEBUG:boto:Method: GET 2023-12-15T22:56:33.426 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.426 DEBUG:boto:Data: 2023-12-15T22:56:33.427 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.427 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.427 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.427 DEBUG:boto:Params: {} 2023-12-15T22:56:33.427 DEBUG:boto:Token: None 2023-12-15T22:56:33.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4d23d97da4d5c9a-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.477 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.478 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.478 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.478 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.478 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.478 DEBUG:boto:Data: 2023-12-15T22:56:33.478 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.479 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.479 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.479 DEBUG:boto:Params: {} 2023-12-15T22:56:33.479 DEBUG:boto:Token: None 2023-12-15T22:56:33.479 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.483 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b793337d63e8e444-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.484 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.484 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.484 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.484 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.484 DEBUG:boto:Data: 2023-12-15T22:56:33.484 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.484 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.484 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.484 DEBUG:boto:Params: {} 2023-12-15T22:56:33.485 DEBUG:boto:Token: None 2023-12-15T22:56:33.485 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.485 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.488 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fc8ed0a2960f8d50-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.489 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.489 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.489 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.489 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.489 DEBUG:boto:Method: GET 2023-12-15T22:56:33.489 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.489 DEBUG:boto:Data: 2023-12-15T22:56:33.489 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.489 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.490 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.490 DEBUG:boto:Params: {} 2023-12-15T22:56:33.490 DEBUG:boto:Token: None 2023-12-15T22:56:33.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.492 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d53475cd7975a115-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.537 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.538 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.538 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.538 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.538 DEBUG:boto:Method: GET 2023-12-15T22:56:33.538 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.538 DEBUG:boto:Data: 2023-12-15T22:56:33.538 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.538 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.538 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.538 DEBUG:boto:Params: {} 2023-12-15T22:56:33.539 DEBUG:boto:Token: None 2023-12-15T22:56:33.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.541 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000563e8b0bef3cb487-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.582 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.582 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.582 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.582 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.582 DEBUG:boto:Method: GET 2023-12-15T22:56:33.582 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.582 DEBUG:boto:Data: 2023-12-15T22:56:33.582 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.582 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.582 DEBUG:boto:Params: {} 2023-12-15T22:56:33.583 DEBUG:boto:Token: None 2023-12-15T22:56:33.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000790994ad63db870c-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.585 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.586 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.586 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.586 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.586 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.586 DEBUG:boto:Method: GET 2023-12-15T22:56:33.586 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.586 DEBUG:boto:Data: 2023-12-15T22:56:33.586 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.587 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.587 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.587 DEBUG:boto:Params: {} 2023-12-15T22:56:33.587 DEBUG:boto:Token: None 2023-12-15T22:56:33.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008002c0fd698f8efa-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.590 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.590 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.590 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.590 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.590 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.590 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.591 DEBUG:boto:Method: GET 2023-12-15T22:56:33.591 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.591 DEBUG:boto:Data: 2023-12-15T22:56:33.591 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.591 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.591 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.591 DEBUG:boto:Params: {} 2023-12-15T22:56:33.591 DEBUG:boto:Token: None 2023-12-15T22:56:33.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s= 2023-12-15T22:56:33.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s=', 'Content-Length': '0'} 2023-12-15T22:56:33.594 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000abf3d225f906ee8d-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.637 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.638 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.638 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.638 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.638 DEBUG:boto:Method: GET 2023-12-15T22:56:33.638 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.638 DEBUG:boto:Data: 2023-12-15T22:56:33.638 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.638 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.638 DEBUG:boto:Params: {} 2023-12-15T22:56:33.638 DEBUG:boto:Token: None 2023-12-15T22:56:33.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s= 2023-12-15T22:56:33.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s=', 'Content-Length': '0'} 2023-12-15T22:56:33.641 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008f101bb398d73aac-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.681 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.682 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.682 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.682 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.682 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.682 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.682 DEBUG:boto:Data: 2023-12-15T22:56:33.682 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.682 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.682 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.682 DEBUG:boto:Params: {} 2023-12-15T22:56:33.682 DEBUG:boto:Token: None 2023-12-15T22:56:33.682 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZduyaYpCIigkABjL0MADlbzJ8Us= 2023-12-15T22:56:33.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZduyaYpCIigkABjL0MADlbzJ8Us=', 'Content-Length': '0'} 2023-12-15T22:56:33.685 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004f1fa57b90d55ff4-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.685 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.685 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.685 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.686 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.686 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.686 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.686 DEBUG:boto:Data: 2023-12-15T22:56:33.686 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.686 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.686 DEBUG:boto:Params: {} 2023-12-15T22:56:33.686 DEBUG:boto:Token: None 2023-12-15T22:56:33.687 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZduyaYpCIigkABjL0MADlbzJ8Us= 2023-12-15T22:56:33.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZduyaYpCIigkABjL0MADlbzJ8Us=', 'Content-Length': '0'} 2023-12-15T22:56:33.689 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ddd6c01c04655021-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.689 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.689 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.689 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.689 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.690 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.690 DEBUG:boto:Method: GET 2023-12-15T22:56:33.690 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.690 DEBUG:boto:Data: 2023-12-15T22:56:33.690 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.690 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.690 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.690 DEBUG:boto:Params: {} 2023-12-15T22:56:33.690 DEBUG:boto:Token: None 2023-12-15T22:56:33.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s= 2023-12-15T22:56:33.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s=', 'Content-Length': '0'} 2023-12-15T22:56:33.693 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000be37117ca9e0d56f-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.733 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.734 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.734 DEBUG:boto:path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.734 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.734 DEBUG:boto:Method: GET 2023-12-15T22:56:33.734 DEBUG:boto:Path: /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.734 DEBUG:boto:Data: 2023-12-15T22:56:33.734 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.734 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.735 DEBUG:boto:Params: {} 2023-12-15T22:56:33.735 DEBUG:boto:Token: None 2023-12-15T22:56:33.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=SSxGHM4WDbJn3-7VMXFvFihm7w06lnU 2023-12-15T22:56:33.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s= 2023-12-15T22:56:33.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f4xEk0L+RvEfmk+0pX7N4ck0H5s=', 'Content-Length': '0'} 2023-12-15T22:56:33.737 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'SSxGHM4WDbJn3-7VMXFvFihm7w06lnU'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005fb5fd9fcb659905-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.738 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.738 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.738 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.738 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.738 DEBUG:boto:Method: GET 2023-12-15T22:56:33.738 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.738 DEBUG:boto:Data: 2023-12-15T22:56:33.738 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.739 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.739 DEBUG:boto:Params: {} 2023-12-15T22:56:33.739 DEBUG:boto:Token: None 2023-12-15T22:56:33.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005af6e384a1cc3759-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.741 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.742 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.742 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.742 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.742 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.742 DEBUG:boto:Method: GET 2023-12-15T22:56:33.742 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.742 DEBUG:boto:Data: 2023-12-15T22:56:33.743 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.743 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.743 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.743 DEBUG:boto:Params: {} 2023-12-15T22:56:33.743 DEBUG:boto:Token: None 2023-12-15T22:56:33.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc018eb8447ecaee-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.746 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.746 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.746 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.746 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.746 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.747 DEBUG:boto:Data: 2023-12-15T22:56:33.747 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.747 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.747 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.747 DEBUG:boto:Params: {} 2023-12-15T22:56:33.747 DEBUG:boto:Token: None 2023-12-15T22:56:33.747 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.751 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000057f09a420a7dbde0-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.751 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.751 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.752 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.752 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.752 DEBUG:boto:Data: 2023-12-15T22:56:33.752 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.752 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.752 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.752 DEBUG:boto:Params: {} 2023-12-15T22:56:33.752 DEBUG:boto:Token: None 2023-12-15T22:56:33.752 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.753 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.756 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002f102cace18a2494-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.757 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.757 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.757 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.757 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.757 DEBUG:boto:Method: GET 2023-12-15T22:56:33.757 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.757 DEBUG:boto:Data: 2023-12-15T22:56:33.757 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.758 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.758 DEBUG:boto:Params: {} 2023-12-15T22:56:33.758 DEBUG:boto:Token: None 2023-12-15T22:56:33.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.760 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f8c694910770f63a-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.805 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.806 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.806 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.806 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.806 DEBUG:boto:Method: GET 2023-12-15T22:56:33.806 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.806 DEBUG:boto:Data: 2023-12-15T22:56:33.806 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.806 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.807 DEBUG:boto:Params: {} 2023-12-15T22:56:33.807 DEBUG:boto:Token: None 2023-12-15T22:56:33.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.809 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bba4abbe817eee3a-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.849 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.850 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.850 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.850 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.850 DEBUG:boto:Method: GET 2023-12-15T22:56:33.850 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.850 DEBUG:boto:Data: 2023-12-15T22:56:33.850 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.850 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.850 DEBUG:boto:Params: {} 2023-12-15T22:56:33.851 DEBUG:boto:Token: None 2023-12-15T22:56:33.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0611d582e19458b-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.854 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.854 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.854 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.854 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.855 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.855 DEBUG:boto:Method: GET 2023-12-15T22:56:33.855 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.855 DEBUG:boto:Data: 2023-12-15T22:56:33.855 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.855 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.855 DEBUG:boto:Params: {} 2023-12-15T22:56:33.855 DEBUG:boto:Token: None 2023-12-15T22:56:33.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.856 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a54b1b9f36db0fb2-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.858 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.859 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.859 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.859 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.859 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.859 DEBUG:boto:Method: GET 2023-12-15T22:56:33.859 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.859 DEBUG:boto:Data: 2023-12-15T22:56:33.860 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.860 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.860 DEBUG:boto:Params: {} 2023-12-15T22:56:33.860 DEBUG:boto:Token: None 2023-12-15T22:56:33.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0= 2023-12-15T22:56:33.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.862 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002baf58b4db14f36d-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.862 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.863 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.863 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.863 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.863 DEBUG:boto:Method: GET 2023-12-15T22:56:33.863 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.863 DEBUG:boto:Data: 2023-12-15T22:56:33.863 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.863 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.863 DEBUG:boto:Params: {} 2023-12-15T22:56:33.864 DEBUG:boto:Token: None 2023-12-15T22:56:33.864 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0= 2023-12-15T22:56:33.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.866 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000adff6d6c00d6a4e-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.913 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.914 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.914 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.914 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.914 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.914 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.914 DEBUG:boto:Data: 2023-12-15T22:56:33.914 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.915 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.915 DEBUG:boto:Params: {} 2023-12-15T22:56:33.915 DEBUG:boto:Token: None 2023-12-15T22:56:33.915 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3aOQ2OlC1O/qIU3L+gtDGhhrpY0= 2023-12-15T22:56:33.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3aOQ2OlC1O/qIU3L+gtDGhhrpY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.917 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000067f922420a8d5ff8-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.917 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.917 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.918 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.918 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.918 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.918 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.918 DEBUG:boto:Data: 2023-12-15T22:56:33.918 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.918 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.918 DEBUG:boto:Params: {} 2023-12-15T22:56:33.918 DEBUG:boto:Token: None 2023-12-15T22:56:33.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3aOQ2OlC1O/qIU3L+gtDGhhrpY0= 2023-12-15T22:56:33.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3aOQ2OlC1O/qIU3L+gtDGhhrpY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.921 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001dbbd000b3bb0370-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.921 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.921 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.921 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.921 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.921 DEBUG:boto:Method: GET 2023-12-15T22:56:33.922 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.922 DEBUG:boto:Data: 2023-12-15T22:56:33.922 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.922 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.922 DEBUG:boto:Params: {} 2023-12-15T22:56:33.922 DEBUG:boto:Token: None 2023-12-15T22:56:33.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0= 2023-12-15T22:56:33.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.924 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000018c5fd37f9cf353f-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.925 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.925 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.925 DEBUG:boto:path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.925 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.925 DEBUG:boto:Method: GET 2023-12-15T22:56:33.925 DEBUG:boto:Path: /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.925 DEBUG:boto:Data: 2023-12-15T22:56:33.925 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.925 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.926 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.926 DEBUG:boto:Params: {} 2023-12-15T22:56:33.926 DEBUG:boto:Token: None 2023-12-15T22:56:33.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=XEcx0QIiQvKBuEM6.ADP.rnGExb903e 2023-12-15T22:56:33.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0= 2023-12-15T22:56:33.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kh3f0d1hfKZJ9CBTB/8w0CUixY0=', 'Content-Length': '0'} 2023-12-15T22:56:33.928 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'XEcx0QIiQvKBuEM6.ADP.rnGExb903e'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000085adddbd1cbc244b-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.973 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.974 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.974 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.974 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.974 DEBUG:boto:Method: GET 2023-12-15T22:56:33.974 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.974 DEBUG:boto:Data: 2023-12-15T22:56:33.974 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.975 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.975 DEBUG:boto:Params: {} 2023-12-15T22:56:33.975 DEBUG:boto:Token: None 2023-12-15T22:56:33.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aff9a8869f6a4c12-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.978 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.978 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:33.978 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:33.978 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.978 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:33.979 DEBUG:boto:Method: GET 2023-12-15T22:56:33.979 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:33.979 DEBUG:boto:Data: 2023-12-15T22:56:33.979 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.979 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.979 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.979 DEBUG:boto:Params: {} 2023-12-15T22:56:33.979 DEBUG:boto:Token: None 2023-12-15T22:56:33.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/ 2023-12-15T22:56:33.980 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M= 2023-12-15T22:56:33.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ea93vDBlMRpj3NTzzRhzJons9M=', 'Content-Length': '0'} 2023-12-15T22:56:33.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081c720eae969d3f1-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.982 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:33.982 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.982 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.983 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.983 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.983 DEBUG:boto:Data: 2023-12-15T22:56:33.983 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.983 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.983 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.983 DEBUG:boto:Params: {} 2023-12-15T22:56:33.983 DEBUG:boto:Token: None 2023-12-15T22:56:33.983 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.987 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9ad1083bb7e2465-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.987 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.987 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.988 DEBUG:boto:Method: HEAD 2023-12-15T22:56:33.988 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:33.988 DEBUG:boto:Data: 2023-12-15T22:56:33.988 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.988 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:33.988 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.988 DEBUG:boto:Params: {} 2023-12-15T22:56:33.988 DEBUG:boto:Token: None 2023-12-15T22:56:33.988 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj 2023-12-15T22:56:33.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8= 2023-12-15T22:56:33.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oowKSQ6KtOLK8RLS7dNv6w5Iax8=', 'Content-Length': '0'} 2023-12-15T22:56:33.992 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000534b6ca42c66af70-00657cd9a1-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:33.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:33.993 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:33.993 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:33.993 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.993 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.993 DEBUG:boto:Method: GET 2023-12-15T22:56:33.993 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.993 DEBUG:boto:Data: 2023-12-15T22:56:33.993 DEBUG:boto:Headers: {} 2023-12-15T22:56:33.993 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:33.993 DEBUG:boto:Port: 8000 2023-12-15T22:56:33.994 DEBUG:boto:Params: {} 2023-12-15T22:56:33.994 DEBUG:boto:Token: None 2023-12-15T22:56:33.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:33 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:33.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY= 2023-12-15T22:56:33.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1apzAcB8j2T49oDT0BvJPdZyoY=', 'Content-Length': '0'} 2023-12-15T22:56:33.996 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000542782c90b5a0604-00657cd9a1-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.038 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.038 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.038 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.038 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.038 DEBUG:boto:Method: GET 2023-12-15T22:56:34.038 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.038 DEBUG:boto:Data: 2023-12-15T22:56:34.038 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.038 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.038 DEBUG:boto:Params: {} 2023-12-15T22:56:34.039 DEBUG:boto:Token: None 2023-12-15T22:56:34.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.041 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000050ac4c9b7d0310cb-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.082 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.082 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.082 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.082 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.082 DEBUG:boto:Method: GET 2023-12-15T22:56:34.082 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.082 DEBUG:boto:Data: 2023-12-15T22:56:34.082 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.082 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.082 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.082 DEBUG:boto:Params: {} 2023-12-15T22:56:34.083 DEBUG:boto:Token: None 2023-12-15T22:56:34.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bd229f1563774f7-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.086 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.086 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.086 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.086 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.086 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.087 DEBUG:boto:Method: GET 2023-12-15T22:56:34.087 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.087 DEBUG:boto:Data: 2023-12-15T22:56:34.087 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.087 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.087 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.087 DEBUG:boto:Params: {} 2023-12-15T22:56:34.087 DEBUG:boto:Token: None 2023-12-15T22:56:34.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b1eda5320a53ab3-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.090 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.090 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.091 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.091 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.091 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.091 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.091 DEBUG:boto:Method: GET 2023-12-15T22:56:34.091 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.091 DEBUG:boto:Data: 2023-12-15T22:56:34.091 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.091 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.091 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.091 DEBUG:boto:Params: {} 2023-12-15T22:56:34.091 DEBUG:boto:Token: None 2023-12-15T22:56:34.092 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4= 2023-12-15T22:56:34.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4=', 'Content-Length': '0'} 2023-12-15T22:56:34.094 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff9abce91169f051-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.138 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.138 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.138 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.138 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.138 DEBUG:boto:Method: GET 2023-12-15T22:56:34.138 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.138 DEBUG:boto:Data: 2023-12-15T22:56:34.138 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.139 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.139 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.139 DEBUG:boto:Params: {} 2023-12-15T22:56:34.139 DEBUG:boto:Token: None 2023-12-15T22:56:34.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4= 2023-12-15T22:56:34.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4=', 'Content-Length': '0'} 2023-12-15T22:56:34.142 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009ec5024eb523863c-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.142 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.142 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.142 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.142 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.143 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.143 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.143 DEBUG:boto:Data: 2023-12-15T22:56:34.143 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.143 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.143 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.143 DEBUG:boto:Params: {} 2023-12-15T22:56:34.143 DEBUG:boto:Token: None 2023-12-15T22:56:34.143 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.144 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9HmvDewLLkLplvCl4Jf1noOohZg= 2023-12-15T22:56:34.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9HmvDewLLkLplvCl4Jf1noOohZg=', 'Content-Length': '0'} 2023-12-15T22:56:34.146 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ac5f96403d86ec7f-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.146 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.146 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.146 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.146 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.146 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.146 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.146 DEBUG:boto:Data: 2023-12-15T22:56:34.147 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.147 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.147 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.147 DEBUG:boto:Params: {} 2023-12-15T22:56:34.147 DEBUG:boto:Token: None 2023-12-15T22:56:34.147 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9HmvDewLLkLplvCl4Jf1noOohZg= 2023-12-15T22:56:34.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9HmvDewLLkLplvCl4Jf1noOohZg=', 'Content-Length': '0'} 2023-12-15T22:56:34.150 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000037f7bbc3f2b3d94-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.150 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.150 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.150 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.150 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.151 DEBUG:boto:Method: GET 2023-12-15T22:56:34.151 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.151 DEBUG:boto:Data: 2023-12-15T22:56:34.151 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.151 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.151 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.151 DEBUG:boto:Params: {} 2023-12-15T22:56:34.151 DEBUG:boto:Token: None 2023-12-15T22:56:34.151 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4= 2023-12-15T22:56:34.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4=', 'Content-Length': '0'} 2023-12-15T22:56:34.154 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007add024d1c12192c-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.197 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.198 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.198 DEBUG:boto:path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.198 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.198 DEBUG:boto:Method: GET 2023-12-15T22:56:34.198 DEBUG:boto:Path: /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.198 DEBUG:boto:Data: 2023-12-15T22:56:34.198 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.198 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.199 DEBUG:boto:Params: {} 2023-12-15T22:56:34.199 DEBUG:boto:Token: None 2023-12-15T22:56:34.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s 2023-12-15T22:56:34.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4= 2023-12-15T22:56:34.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1gddfEirwF5Ift8pEtxBOapfbR4=', 'Content-Length': '0'} 2023-12-15T22:56:34.201 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'Xv6P8.jN0R2pQ275-7GWxN2XzwQVB6s'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000005022bea0f19b66d-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.201 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.201 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.202 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.202 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.202 DEBUG:boto:Method: GET 2023-12-15T22:56:34.202 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.202 DEBUG:boto:Data: 2023-12-15T22:56:34.202 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.202 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.202 DEBUG:boto:Params: {} 2023-12-15T22:56:34.203 DEBUG:boto:Token: None 2023-12-15T22:56:34.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083c048987abd5844-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.205 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.206 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.206 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.206 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.206 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.206 DEBUG:boto:Method: GET 2023-12-15T22:56:34.206 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.206 DEBUG:boto:Data: 2023-12-15T22:56:34.206 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.207 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.207 DEBUG:boto:Params: {} 2023-12-15T22:56:34.207 DEBUG:boto:Token: None 2023-12-15T22:56:34.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.210 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee9be21fbdc9427d-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.210 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.210 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.210 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.210 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.211 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.211 DEBUG:boto:Data: 2023-12-15T22:56:34.211 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.211 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.211 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.211 DEBUG:boto:Params: {} 2023-12-15T22:56:34.211 DEBUG:boto:Token: None 2023-12-15T22:56:34.211 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.215 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000016118bfa5bb3fe32-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.215 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.216 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.216 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.216 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.216 DEBUG:boto:Data: 2023-12-15T22:56:34.216 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.216 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.216 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.216 DEBUG:boto:Params: {} 2023-12-15T22:56:34.216 DEBUG:boto:Token: None 2023-12-15T22:56:34.216 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.217 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.220 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e13b0edb53b01577-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.220 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.220 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.220 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.220 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.220 DEBUG:boto:Method: GET 2023-12-15T22:56:34.221 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.221 DEBUG:boto:Data: 2023-12-15T22:56:34.221 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.221 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.221 DEBUG:boto:Params: {} 2023-12-15T22:56:34.221 DEBUG:boto:Token: None 2023-12-15T22:56:34.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.223 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007811f642e6373bc5-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.223 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.224 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.224 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.224 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.224 DEBUG:boto:Method: GET 2023-12-15T22:56:34.224 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.224 DEBUG:boto:Data: 2023-12-15T22:56:34.224 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.224 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.224 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.224 DEBUG:boto:Params: {} 2023-12-15T22:56:34.224 DEBUG:boto:Token: None 2023-12-15T22:56:34.224 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.227 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004782511edb2f5e42-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.269 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.270 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.270 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.270 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.270 DEBUG:boto:Method: GET 2023-12-15T22:56:34.270 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.270 DEBUG:boto:Data: 2023-12-15T22:56:34.270 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.270 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.270 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.270 DEBUG:boto:Params: {} 2023-12-15T22:56:34.270 DEBUG:boto:Token: None 2023-12-15T22:56:34.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f349b4738aa90f92-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.273 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.274 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.274 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.274 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.274 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.274 DEBUG:boto:Method: GET 2023-12-15T22:56:34.274 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.274 DEBUG:boto:Data: 2023-12-15T22:56:34.274 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.274 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.275 DEBUG:boto:Params: {} 2023-12-15T22:56:34.275 DEBUG:boto:Token: None 2023-12-15T22:56:34.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a012483a20414025-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.278 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.278 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.278 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.278 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.278 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.278 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.278 DEBUG:boto:Method: GET 2023-12-15T22:56:34.278 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.278 DEBUG:boto:Data: 2023-12-15T22:56:34.279 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.279 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.279 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.279 DEBUG:boto:Params: {} 2023-12-15T22:56:34.279 DEBUG:boto:Token: None 2023-12-15T22:56:34.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8= 2023-12-15T22:56:34.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8=', 'Content-Length': '0'} 2023-12-15T22:56:34.281 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b21da7e92981883d-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.282 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.282 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.282 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.282 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.282 DEBUG:boto:Method: GET 2023-12-15T22:56:34.282 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.282 DEBUG:boto:Data: 2023-12-15T22:56:34.282 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.282 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.283 DEBUG:boto:Params: {} 2023-12-15T22:56:34.283 DEBUG:boto:Token: None 2023-12-15T22:56:34.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8= 2023-12-15T22:56:34.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8=', 'Content-Length': '0'} 2023-12-15T22:56:34.285 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b763fcea2d55e496-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.329 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.329 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.330 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.330 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.330 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.330 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.330 DEBUG:boto:Data: 2023-12-15T22:56:34.330 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.330 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.330 DEBUG:boto:Params: {} 2023-12-15T22:56:34.330 DEBUG:boto:Token: None 2023-12-15T22:56:34.331 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p9aXd4NUfE0MrMLSe1jFb27WKJo= 2023-12-15T22:56:34.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p9aXd4NUfE0MrMLSe1jFb27WKJo=', 'Content-Length': '0'} 2023-12-15T22:56:34.333 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000074b3861a1985d176-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.333 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.333 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.333 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.333 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.334 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.334 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.334 DEBUG:boto:Data: 2023-12-15T22:56:34.334 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.334 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.334 DEBUG:boto:Params: {} 2023-12-15T22:56:34.334 DEBUG:boto:Token: None 2023-12-15T22:56:34.334 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p9aXd4NUfE0MrMLSe1jFb27WKJo= 2023-12-15T22:56:34.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p9aXd4NUfE0MrMLSe1jFb27WKJo=', 'Content-Length': '0'} 2023-12-15T22:56:34.336 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000063b0362b7ca99992-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.337 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.337 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.337 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.337 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.337 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.337 DEBUG:boto:Method: GET 2023-12-15T22:56:34.337 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.337 DEBUG:boto:Data: 2023-12-15T22:56:34.337 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.338 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.338 DEBUG:boto:Params: {} 2023-12-15T22:56:34.338 DEBUG:boto:Token: None 2023-12-15T22:56:34.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8= 2023-12-15T22:56:34.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8=', 'Content-Length': '0'} 2023-12-15T22:56:34.340 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000078a0bef3a02fd282-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.340 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.340 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.340 DEBUG:boto:path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.341 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.341 DEBUG:boto:Method: GET 2023-12-15T22:56:34.341 DEBUG:boto:Path: /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.341 DEBUG:boto:Data: 2023-12-15T22:56:34.341 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.341 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.341 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.341 DEBUG:boto:Params: {} 2023-12-15T22:56:34.341 DEBUG:boto:Token: None 2023-12-15T22:56:34.341 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=d-oH9elSTqNdDvyjqT3g6oLs45dqCTb 2023-12-15T22:56:34.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8= 2023-12-15T22:56:34.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+V4Z9FOsn0AOYenu3ui+YzgND8=', 'Content-Length': '0'} 2023-12-15T22:56:34.343 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'd-oH9elSTqNdDvyjqT3g6oLs45dqCTb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f91ac2613337e656-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.385 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.386 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.386 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.386 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.386 DEBUG:boto:Method: GET 2023-12-15T22:56:34.386 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.386 DEBUG:boto:Data: 2023-12-15T22:56:34.386 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.386 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.386 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.386 DEBUG:boto:Params: {} 2023-12-15T22:56:34.386 DEBUG:boto:Token: None 2023-12-15T22:56:34.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091e1e9ef46058ee9-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.389 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.390 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.390 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.390 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.390 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.390 DEBUG:boto:Method: GET 2023-12-15T22:56:34.390 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.390 DEBUG:boto:Data: 2023-12-15T22:56:34.390 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.390 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.390 DEBUG:boto:Params: {} 2023-12-15T22:56:34.391 DEBUG:boto:Token: None 2023-12-15T22:56:34.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002b9f203f09803f4-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.393 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.394 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.394 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.394 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.394 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.394 DEBUG:boto:Data: 2023-12-15T22:56:34.394 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.394 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.394 DEBUG:boto:Params: {} 2023-12-15T22:56:34.394 DEBUG:boto:Token: None 2023-12-15T22:56:34.394 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.398 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000491e00bafd0d38a6-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.399 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.399 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.399 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.399 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.399 DEBUG:boto:Data: 2023-12-15T22:56:34.399 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.399 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.399 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.399 DEBUG:boto:Params: {} 2023-12-15T22:56:34.400 DEBUG:boto:Token: None 2023-12-15T22:56:34.400 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.400 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.403 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000050106e908d553ffd-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.403 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.403 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.403 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.404 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.404 DEBUG:boto:Method: GET 2023-12-15T22:56:34.404 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.404 DEBUG:boto:Data: 2023-12-15T22:56:34.404 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.404 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.404 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.404 DEBUG:boto:Params: {} 2023-12-15T22:56:34.404 DEBUG:boto:Token: None 2023-12-15T22:56:34.404 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.407 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c2071db7ba46d50d-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.450 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.450 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.450 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.450 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.450 DEBUG:boto:Method: GET 2023-12-15T22:56:34.450 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.450 DEBUG:boto:Data: 2023-12-15T22:56:34.450 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.450 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.450 DEBUG:boto:Params: {} 2023-12-15T22:56:34.451 DEBUG:boto:Token: None 2023-12-15T22:56:34.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.453 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f1ef5c1c6b570009-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.498 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.498 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.498 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.498 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.498 DEBUG:boto:Method: GET 2023-12-15T22:56:34.498 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.498 DEBUG:boto:Data: 2023-12-15T22:56:34.498 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.498 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.498 DEBUG:boto:Params: {} 2023-12-15T22:56:34.499 DEBUG:boto:Token: None 2023-12-15T22:56:34.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001cbad039668dfc3d-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.501 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.502 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.502 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.502 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.502 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.502 DEBUG:boto:Method: GET 2023-12-15T22:56:34.502 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.502 DEBUG:boto:Data: 2023-12-15T22:56:34.502 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.502 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.502 DEBUG:boto:Params: {} 2023-12-15T22:56:34.502 DEBUG:boto:Token: None 2023-12-15T22:56:34.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d5e09897c106d9b-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.545 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.546 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.546 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.546 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.546 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.546 DEBUG:boto:Method: GET 2023-12-15T22:56:34.546 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.546 DEBUG:boto:Data: 2023-12-15T22:56:34.546 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.547 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.547 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.547 DEBUG:boto:Params: {} 2023-12-15T22:56:34.547 DEBUG:boto:Token: None 2023-12-15T22:56:34.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA= 2023-12-15T22:56:34.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA=', 'Content-Length': '0'} 2023-12-15T22:56:34.549 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000979325d99ce9a463-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.589 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.590 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.590 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.590 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.590 DEBUG:boto:Method: GET 2023-12-15T22:56:34.590 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.590 DEBUG:boto:Data: 2023-12-15T22:56:34.590 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.590 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.590 DEBUG:boto:Params: {} 2023-12-15T22:56:34.590 DEBUG:boto:Token: None 2023-12-15T22:56:34.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA= 2023-12-15T22:56:34.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA=', 'Content-Length': '0'} 2023-12-15T22:56:34.593 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a41fbc432e8569e7-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.593 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.593 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.593 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.593 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.593 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.594 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.594 DEBUG:boto:Data: 2023-12-15T22:56:34.594 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.594 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.594 DEBUG:boto:Params: {} 2023-12-15T22:56:34.594 DEBUG:boto:Token: None 2023-12-15T22:56:34.594 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oFAwWTLHjfAXkBEPX592hE2STCw= 2023-12-15T22:56:34.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oFAwWTLHjfAXkBEPX592hE2STCw=', 'Content-Length': '0'} 2023-12-15T22:56:34.596 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f84d81c56fd3646b-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.597 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.597 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.597 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.597 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.597 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.597 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.597 DEBUG:boto:Data: 2023-12-15T22:56:34.597 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.597 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.597 DEBUG:boto:Params: {} 2023-12-15T22:56:34.598 DEBUG:boto:Token: None 2023-12-15T22:56:34.598 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oFAwWTLHjfAXkBEPX592hE2STCw= 2023-12-15T22:56:34.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oFAwWTLHjfAXkBEPX592hE2STCw=', 'Content-Length': '0'} 2023-12-15T22:56:34.600 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006d7f94b7effcddbf-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.600 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.600 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.600 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.600 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.600 DEBUG:boto:Method: GET 2023-12-15T22:56:34.600 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.600 DEBUG:boto:Data: 2023-12-15T22:56:34.601 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.601 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.601 DEBUG:boto:Params: {} 2023-12-15T22:56:34.601 DEBUG:boto:Token: None 2023-12-15T22:56:34.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA= 2023-12-15T22:56:34.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA=', 'Content-Length': '0'} 2023-12-15T22:56:34.603 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000631a267d0742c507-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.645 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.646 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.646 DEBUG:boto:path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.646 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.646 DEBUG:boto:Method: GET 2023-12-15T22:56:34.646 DEBUG:boto:Path: /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.646 DEBUG:boto:Data: 2023-12-15T22:56:34.646 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.646 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.646 DEBUG:boto:Params: {} 2023-12-15T22:56:34.647 DEBUG:boto:Token: None 2023-12-15T22:56:34.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=vTZ6c3KrCi.srBSpKva33j1thTAOn50 2023-12-15T22:56:34.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA= 2023-12-15T22:56:34.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HWpJdmDV9oH65t/xWhChUyQrvCA=', 'Content-Length': '0'} 2023-12-15T22:56:34.649 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'vTZ6c3KrCi.srBSpKva33j1thTAOn50'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005119433a5eb5b831-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.650 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.650 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.650 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.650 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.651 DEBUG:boto:Method: GET 2023-12-15T22:56:34.651 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.651 DEBUG:boto:Data: 2023-12-15T22:56:34.651 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.651 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.651 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.651 DEBUG:boto:Params: {} 2023-12-15T22:56:34.651 DEBUG:boto:Token: None 2023-12-15T22:56:34.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.652 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001007eabaaf679b80-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.654 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.654 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.655 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.655 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.655 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.655 DEBUG:boto:Method: GET 2023-12-15T22:56:34.655 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.655 DEBUG:boto:Data: 2023-12-15T22:56:34.655 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.655 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.655 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.655 DEBUG:boto:Params: {} 2023-12-15T22:56:34.656 DEBUG:boto:Token: None 2023-12-15T22:56:34.656 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.656 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bbf88a1a849d9f2-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.659 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.659 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.659 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.659 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.659 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.659 DEBUG:boto:Data: 2023-12-15T22:56:34.659 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.660 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.660 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.660 DEBUG:boto:Params: {} 2023-12-15T22:56:34.660 DEBUG:boto:Token: None 2023-12-15T22:56:34.660 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.664 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c39a2d7a6fd9ec63-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.664 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.665 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.665 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.665 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.665 DEBUG:boto:Data: 2023-12-15T22:56:34.665 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.665 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.665 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.665 DEBUG:boto:Params: {} 2023-12-15T22:56:34.665 DEBUG:boto:Token: None 2023-12-15T22:56:34.666 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.669 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000054bc2e20ca01960d-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.670 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.670 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.670 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.670 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.670 DEBUG:boto:Method: GET 2023-12-15T22:56:34.670 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.670 DEBUG:boto:Data: 2023-12-15T22:56:34.670 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.670 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.670 DEBUG:boto:Params: {} 2023-12-15T22:56:34.671 DEBUG:boto:Token: None 2023-12-15T22:56:34.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.673 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c51414f7be8c10ae-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.713 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.714 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.714 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.714 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.714 DEBUG:boto:Method: GET 2023-12-15T22:56:34.714 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.714 DEBUG:boto:Data: 2023-12-15T22:56:34.714 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.714 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.714 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.714 DEBUG:boto:Params: {} 2023-12-15T22:56:34.714 DEBUG:boto:Token: None 2023-12-15T22:56:34.715 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.717 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f398ba239169c4c3-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.761 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.762 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.762 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.762 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.762 DEBUG:boto:Method: GET 2023-12-15T22:56:34.762 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.762 DEBUG:boto:Data: 2023-12-15T22:56:34.762 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.762 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.762 DEBUG:boto:Params: {} 2023-12-15T22:56:34.762 DEBUG:boto:Token: None 2023-12-15T22:56:34.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000181f029a574c2a8d-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.765 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.765 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.765 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.766 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.766 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.766 DEBUG:boto:Method: GET 2023-12-15T22:56:34.766 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.766 DEBUG:boto:Data: 2023-12-15T22:56:34.766 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.766 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.766 DEBUG:boto:Params: {} 2023-12-15T22:56:34.766 DEBUG:boto:Token: None 2023-12-15T22:56:34.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008157ec99617eff70-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.809 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.810 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.810 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.810 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.810 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.810 DEBUG:boto:Method: GET 2023-12-15T22:56:34.810 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.810 DEBUG:boto:Data: 2023-12-15T22:56:34.810 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.811 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.811 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.811 DEBUG:boto:Params: {} 2023-12-15T22:56:34.811 DEBUG:boto:Token: None 2023-12-15T22:56:34.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4= 2023-12-15T22:56:34.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4=', 'Content-Length': '0'} 2023-12-15T22:56:34.813 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009617a87b7e104bb2-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.813 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.814 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.814 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.814 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.814 DEBUG:boto:Method: GET 2023-12-15T22:56:34.814 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.814 DEBUG:boto:Data: 2023-12-15T22:56:34.814 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.814 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.814 DEBUG:boto:Params: {} 2023-12-15T22:56:34.814 DEBUG:boto:Token: None 2023-12-15T22:56:34.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4= 2023-12-15T22:56:34.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4=', 'Content-Length': '0'} 2023-12-15T22:56:34.817 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000083d7f77a20134a0b-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.857 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.858 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.858 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.858 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.858 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.858 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.858 DEBUG:boto:Data: 2023-12-15T22:56:34.858 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.858 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.858 DEBUG:boto:Params: {} 2023-12-15T22:56:34.858 DEBUG:boto:Token: None 2023-12-15T22:56:34.859 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MISwNcxDxgiK3yhX3syq4HxPge4= 2023-12-15T22:56:34.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MISwNcxDxgiK3yhX3syq4HxPge4=', 'Content-Length': '0'} 2023-12-15T22:56:34.861 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000990a43827d85b3be-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.861 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.861 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.861 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.861 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.861 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.862 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.862 DEBUG:boto:Data: 2023-12-15T22:56:34.862 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.862 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.862 DEBUG:boto:Params: {} 2023-12-15T22:56:34.862 DEBUG:boto:Token: None 2023-12-15T22:56:34.862 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.862 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MISwNcxDxgiK3yhX3syq4HxPge4= 2023-12-15T22:56:34.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MISwNcxDxgiK3yhX3syq4HxPge4=', 'Content-Length': '0'} 2023-12-15T22:56:34.864 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004f8eee092320c1cd-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.865 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.865 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.865 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.865 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.865 DEBUG:boto:Method: GET 2023-12-15T22:56:34.865 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.865 DEBUG:boto:Data: 2023-12-15T22:56:34.865 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.865 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.866 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.866 DEBUG:boto:Params: {} 2023-12-15T22:56:34.866 DEBUG:boto:Token: None 2023-12-15T22:56:34.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4= 2023-12-15T22:56:34.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4=', 'Content-Length': '0'} 2023-12-15T22:56:34.868 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000f8369cbbb2008e2-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.868 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.868 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.868 DEBUG:boto:path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.868 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.868 DEBUG:boto:Method: GET 2023-12-15T22:56:34.868 DEBUG:boto:Path: /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.869 DEBUG:boto:Data: 2023-12-15T22:56:34.869 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.869 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.869 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.869 DEBUG:boto:Params: {} 2023-12-15T22:56:34.869 DEBUG:boto:Token: None 2023-12-15T22:56:34.869 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U 2023-12-15T22:56:34.869 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4= 2023-12-15T22:56:34.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qTT7JxCw3bGkjmQITx/xds9Ikh4=', 'Content-Length': '0'} 2023-12-15T22:56:34.871 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '0s6cyoYrc8T5VBG76rZ7eh79x3a9b1U'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f5275b2f010d362f-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.917 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.918 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.918 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.918 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.918 DEBUG:boto:Method: GET 2023-12-15T22:56:34.918 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.918 DEBUG:boto:Data: 2023-12-15T22:56:34.918 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.918 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.918 DEBUG:boto:Params: {} 2023-12-15T22:56:34.919 DEBUG:boto:Token: None 2023-12-15T22:56:34.920 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.920 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.922 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006cf9920ab5e14e8e-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.923 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.923 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:34.923 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:34.923 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.923 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:34.924 DEBUG:boto:Method: GET 2023-12-15T22:56:34.924 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:34.924 DEBUG:boto:Data: 2023-12-15T22:56:34.924 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.924 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.924 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.924 DEBUG:boto:Params: {} 2023-12-15T22:56:34.924 DEBUG:boto:Token: None 2023-12-15T22:56:34.924 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/ 2023-12-15T22:56:34.924 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4= 2023-12-15T22:56:34.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ztlx5YWUsCeSvD/eunXdGEZ9Lj4=', 'Content-Length': '0'} 2023-12-15T22:56:34.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000975b3cd3f0827813-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.970 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:34.970 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.970 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.970 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.970 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.971 DEBUG:boto:Data: 2023-12-15T22:56:34.971 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.971 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.971 DEBUG:boto:Params: {} 2023-12-15T22:56:34.971 DEBUG:boto:Token: None 2023-12-15T22:56:34.971 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.975 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003abe79cf73652408-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.975 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.975 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.976 DEBUG:boto:Method: HEAD 2023-12-15T22:56:34.976 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:34.976 DEBUG:boto:Data: 2023-12-15T22:56:34.976 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.976 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.976 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.976 DEBUG:boto:Params: {} 2023-12-15T22:56:34.976 DEBUG:boto:Token: None 2023-12-15T22:56:34.976 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj 2023-12-15T22:56:34.976 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk= 2023-12-15T22:56:34.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qV8GthyL6JqcOUz+4SMPa9YbpGk=', 'Content-Length': '0'} 2023-12-15T22:56:34.980 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000032ea2a868b73d5e6-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:34.980 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.980 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.980 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.980 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.981 DEBUG:boto:Method: GET 2023-12-15T22:56:34.981 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.981 DEBUG:boto:Data: 2023-12-15T22:56:34.981 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.981 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:34.981 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.981 DEBUG:boto:Params: {} 2023-12-15T22:56:34.981 DEBUG:boto:Token: None 2023-12-15T22:56:34.981 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.981 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.983 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d44336d2c07f3c35-00657cd9a2-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:34.984 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:34.984 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:34.984 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.984 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.984 DEBUG:boto:Method: GET 2023-12-15T22:56:34.984 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.984 DEBUG:boto:Data: 2023-12-15T22:56:34.984 DEBUG:boto:Headers: {} 2023-12-15T22:56:34.984 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:34.985 DEBUG:boto:Port: 8000 2023-12-15T22:56:34.985 DEBUG:boto:Params: {} 2023-12-15T22:56:34.985 DEBUG:boto:Token: None 2023-12-15T22:56:34.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:34 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:34.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc= 2023-12-15T22:56:34.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nKuDgIghJNGFXCXJTu+zzLSAkOc=', 'Content-Length': '0'} 2023-12-15T22:56:34.987 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000df5fb8980d24db32-00657cd9a2-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.030 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.030 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.030 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.030 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.030 DEBUG:boto:Method: GET 2023-12-15T22:56:35.030 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.030 DEBUG:boto:Data: 2023-12-15T22:56:35.030 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.030 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.031 DEBUG:boto:Params: {} 2023-12-15T22:56:35.031 DEBUG:boto:Token: None 2023-12-15T22:56:35.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7ca51c7c8581796-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.034 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.034 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.034 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.034 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.034 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.034 DEBUG:boto:Method: GET 2023-12-15T22:56:35.034 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.034 DEBUG:boto:Data: 2023-12-15T22:56:35.035 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.035 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.035 DEBUG:boto:Params: {} 2023-12-15T22:56:35.035 DEBUG:boto:Token: None 2023-12-15T22:56:35.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5468d052091ad49-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.085 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.086 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.086 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.086 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.086 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.086 DEBUG:boto:Method: GET 2023-12-15T22:56:35.086 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.086 DEBUG:boto:Data: 2023-12-15T22:56:35.086 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.087 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.087 DEBUG:boto:Params: {} 2023-12-15T22:56:35.087 DEBUG:boto:Token: None 2023-12-15T22:56:35.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4= 2023-12-15T22:56:35.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4=', 'Content-Length': '0'} 2023-12-15T22:56:35.089 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000276e92c0fb0fda88-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.133 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.134 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.134 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.134 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.134 DEBUG:boto:Method: GET 2023-12-15T22:56:35.134 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.134 DEBUG:boto:Data: 2023-12-15T22:56:35.134 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.134 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.135 DEBUG:boto:Params: {} 2023-12-15T22:56:35.135 DEBUG:boto:Token: None 2023-12-15T22:56:35.135 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4= 2023-12-15T22:56:35.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4=', 'Content-Length': '0'} 2023-12-15T22:56:35.137 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000a2e803d3d1094b9-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.137 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.137 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.137 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.138 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.138 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.138 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.138 DEBUG:boto:Data: 2023-12-15T22:56:35.138 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.138 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.138 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.138 DEBUG:boto:Params: {} 2023-12-15T22:56:35.138 DEBUG:boto:Token: None 2023-12-15T22:56:35.138 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+ix34PQTah7iPrlCtY+1WEYZJAg= 2023-12-15T22:56:35.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+ix34PQTah7iPrlCtY+1WEYZJAg=', 'Content-Length': '0'} 2023-12-15T22:56:35.141 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003f18ccc2edf3bd62-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.141 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.141 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.141 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.141 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.142 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.142 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.142 DEBUG:boto:Data: 2023-12-15T22:56:35.142 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.142 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.142 DEBUG:boto:Params: {} 2023-12-15T22:56:35.142 DEBUG:boto:Token: None 2023-12-15T22:56:35.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+ix34PQTah7iPrlCtY+1WEYZJAg= 2023-12-15T22:56:35.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+ix34PQTah7iPrlCtY+1WEYZJAg=', 'Content-Length': '0'} 2023-12-15T22:56:35.145 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008ae3e800459b6a01-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.145 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.145 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.145 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.145 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.145 DEBUG:boto:Method: GET 2023-12-15T22:56:35.145 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.146 DEBUG:boto:Data: 2023-12-15T22:56:35.146 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.146 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.146 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.146 DEBUG:boto:Params: {} 2023-12-15T22:56:35.146 DEBUG:boto:Token: None 2023-12-15T22:56:35.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4= 2023-12-15T22:56:35.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4=', 'Content-Length': '0'} 2023-12-15T22:56:35.149 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c3e59f1620cb97c9-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.193 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.194 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.194 DEBUG:boto:path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.194 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.194 DEBUG:boto:Method: GET 2023-12-15T22:56:35.194 DEBUG:boto:Path: /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.194 DEBUG:boto:Data: 2023-12-15T22:56:35.194 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.194 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.194 DEBUG:boto:Params: {} 2023-12-15T22:56:35.194 DEBUG:boto:Token: None 2023-12-15T22:56:35.195 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb 2023-12-15T22:56:35.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4= 2023-12-15T22:56:35.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG6/6zYar4d93hSlkWsiarzKjo4=', 'Content-Length': '0'} 2023-12-15T22:56:35.196 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'UbVDCdACx1N7qu3Cm4ruXFlbDsqSpPb'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002e6334f02cc4d040-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.197 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.197 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.197 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.197 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.197 DEBUG:boto:Method: GET 2023-12-15T22:56:35.197 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.197 DEBUG:boto:Data: 2023-12-15T22:56:35.198 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.198 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.198 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.198 DEBUG:boto:Params: {} 2023-12-15T22:56:35.198 DEBUG:boto:Token: None 2023-12-15T22:56:35.198 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b649220f9d948f25-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.245 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.246 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.246 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.246 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.246 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.246 DEBUG:boto:Method: GET 2023-12-15T22:56:35.247 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.247 DEBUG:boto:Data: 2023-12-15T22:56:35.247 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.247 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.247 DEBUG:boto:Params: {} 2023-12-15T22:56:35.247 DEBUG:boto:Token: None 2023-12-15T22:56:35.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eadde26e6f05c27d-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.250 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.251 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.251 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.251 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.251 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.251 DEBUG:boto:Data: 2023-12-15T22:56:35.251 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.251 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.251 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.251 DEBUG:boto:Params: {} 2023-12-15T22:56:35.252 DEBUG:boto:Token: None 2023-12-15T22:56:35.252 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.252 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.255 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000dd03e312e055cfaf-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.255 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.256 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.256 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.256 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.256 DEBUG:boto:Data: 2023-12-15T22:56:35.256 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.256 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.256 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.256 DEBUG:boto:Params: {} 2023-12-15T22:56:35.256 DEBUG:boto:Token: None 2023-12-15T22:56:35.257 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.257 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.260 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000381c64603f93223f-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.261 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.261 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.261 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.261 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.261 DEBUG:boto:Method: GET 2023-12-15T22:56:35.261 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.261 DEBUG:boto:Data: 2023-12-15T22:56:35.261 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.262 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.262 DEBUG:boto:Params: {} 2023-12-15T22:56:35.262 DEBUG:boto:Token: None 2023-12-15T22:56:35.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.264 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ad83d961205c3835-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.265 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.265 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.265 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.265 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.265 DEBUG:boto:Method: GET 2023-12-15T22:56:35.265 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.266 DEBUG:boto:Data: 2023-12-15T22:56:35.266 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.266 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.266 DEBUG:boto:Params: {} 2023-12-15T22:56:35.266 DEBUG:boto:Token: None 2023-12-15T22:56:35.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.269 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ecb0cda6e45bac31-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.309 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.310 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.310 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.310 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.310 DEBUG:boto:Method: GET 2023-12-15T22:56:35.310 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.310 DEBUG:boto:Data: 2023-12-15T22:56:35.310 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.310 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.311 DEBUG:boto:Params: {} 2023-12-15T22:56:35.311 DEBUG:boto:Token: None 2023-12-15T22:56:35.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009890e8c4c1027ffb-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.314 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.314 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.314 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.314 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.314 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.314 DEBUG:boto:Method: GET 2023-12-15T22:56:35.314 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.315 DEBUG:boto:Data: 2023-12-15T22:56:35.315 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.315 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.315 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.315 DEBUG:boto:Params: {} 2023-12-15T22:56:35.315 DEBUG:boto:Token: None 2023-12-15T22:56:35.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7e0b124a19bed7f-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.318 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.318 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.319 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.319 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.319 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.319 DEBUG:boto:Method: GET 2023-12-15T22:56:35.319 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.319 DEBUG:boto:Data: 2023-12-15T22:56:35.319 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.319 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.319 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.319 DEBUG:boto:Params: {} 2023-12-15T22:56:35.319 DEBUG:boto:Token: None 2023-12-15T22:56:35.320 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM= 2023-12-15T22:56:35.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM=', 'Content-Length': '0'} 2023-12-15T22:56:35.322 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000117ddba275c5f810-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.365 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.366 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.366 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.366 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.366 DEBUG:boto:Method: GET 2023-12-15T22:56:35.366 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.366 DEBUG:boto:Data: 2023-12-15T22:56:35.366 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.366 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.367 DEBUG:boto:Params: {} 2023-12-15T22:56:35.367 DEBUG:boto:Token: None 2023-12-15T22:56:35.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM= 2023-12-15T22:56:35.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM=', 'Content-Length': '0'} 2023-12-15T22:56:35.369 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000091d9c8b61aab87c1-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.369 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.369 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.370 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.370 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.370 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.370 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.370 DEBUG:boto:Data: 2023-12-15T22:56:35.370 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.370 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.370 DEBUG:boto:Params: {} 2023-12-15T22:56:35.370 DEBUG:boto:Token: None 2023-12-15T22:56:35.371 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A/tmG5aL7I4SUMTyt4B9GGZcgXc= 2023-12-15T22:56:35.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A/tmG5aL7I4SUMTyt4B9GGZcgXc=', 'Content-Length': '0'} 2023-12-15T22:56:35.373 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b5751f0ee2c26ea7-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.373 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.373 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.373 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.373 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.374 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.374 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.374 DEBUG:boto:Data: 2023-12-15T22:56:35.374 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.374 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.374 DEBUG:boto:Params: {} 2023-12-15T22:56:35.374 DEBUG:boto:Token: None 2023-12-15T22:56:35.374 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A/tmG5aL7I4SUMTyt4B9GGZcgXc= 2023-12-15T22:56:35.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A/tmG5aL7I4SUMTyt4B9GGZcgXc=', 'Content-Length': '0'} 2023-12-15T22:56:35.376 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000078739bd0fa28c135-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.377 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.377 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.377 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.377 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.377 DEBUG:boto:Method: GET 2023-12-15T22:56:35.377 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.377 DEBUG:boto:Data: 2023-12-15T22:56:35.377 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.378 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.378 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.378 DEBUG:boto:Params: {} 2023-12-15T22:56:35.378 DEBUG:boto:Token: None 2023-12-15T22:56:35.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM= 2023-12-15T22:56:35.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM=', 'Content-Length': '0'} 2023-12-15T22:56:35.380 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000042bb9e584c44187b-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.421 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.422 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.422 DEBUG:boto:path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.422 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.422 DEBUG:boto:Method: GET 2023-12-15T22:56:35.422 DEBUG:boto:Path: /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.422 DEBUG:boto:Data: 2023-12-15T22:56:35.422 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.422 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.422 DEBUG:boto:Params: {} 2023-12-15T22:56:35.423 DEBUG:boto:Token: None 2023-12-15T22:56:35.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=EXfHCAQIijdDWWIi1LYwo3NHAcveG8k 2023-12-15T22:56:35.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM= 2023-12-15T22:56:35.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4mJyz3vBnWLXR7nyCItFjRdySMM=', 'Content-Length': '0'} 2023-12-15T22:56:35.425 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'EXfHCAQIijdDWWIi1LYwo3NHAcveG8k'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e968e869a744ec8c-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.425 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.425 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.426 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.426 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.426 DEBUG:boto:Method: GET 2023-12-15T22:56:35.426 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.426 DEBUG:boto:Data: 2023-12-15T22:56:35.426 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.426 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.426 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.426 DEBUG:boto:Params: {} 2023-12-15T22:56:35.426 DEBUG:boto:Token: None 2023-12-15T22:56:35.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ea7f658ef9d73e1-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.429 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.430 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.430 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.430 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.430 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.430 DEBUG:boto:Method: GET 2023-12-15T22:56:35.430 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.430 DEBUG:boto:Data: 2023-12-15T22:56:35.430 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.431 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.431 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.431 DEBUG:boto:Params: {} 2023-12-15T22:56:35.431 DEBUG:boto:Token: None 2023-12-15T22:56:35.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008496aa8decd608f1-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.434 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.434 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.434 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.434 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.435 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.435 DEBUG:boto:Data: 2023-12-15T22:56:35.435 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.435 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.435 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.435 DEBUG:boto:Params: {} 2023-12-15T22:56:35.435 DEBUG:boto:Token: None 2023-12-15T22:56:35.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.439 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f0870cc62296cc16-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.439 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.440 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.440 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.440 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.440 DEBUG:boto:Data: 2023-12-15T22:56:35.440 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.440 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.440 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.440 DEBUG:boto:Params: {} 2023-12-15T22:56:35.440 DEBUG:boto:Token: None 2023-12-15T22:56:35.441 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.441 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.444 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b7c6adb64a5563f3-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.445 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.445 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.445 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.445 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.445 DEBUG:boto:Method: GET 2023-12-15T22:56:35.445 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.445 DEBUG:boto:Data: 2023-12-15T22:56:35.445 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.445 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.445 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.446 DEBUG:boto:Params: {} 2023-12-15T22:56:35.446 DEBUG:boto:Token: None 2023-12-15T22:56:35.446 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.448 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a8f900b8c35b5957-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.489 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.490 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.490 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.490 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.490 DEBUG:boto:Method: GET 2023-12-15T22:56:35.490 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.490 DEBUG:boto:Data: 2023-12-15T22:56:35.490 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.490 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.490 DEBUG:boto:Params: {} 2023-12-15T22:56:35.491 DEBUG:boto:Token: None 2023-12-15T22:56:35.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.493 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000295c7b8fc7f6d3b3-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.533 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.534 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.534 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.534 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.534 DEBUG:boto:Method: GET 2023-12-15T22:56:35.534 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.534 DEBUG:boto:Data: 2023-12-15T22:56:35.534 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.534 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.534 DEBUG:boto:Params: {} 2023-12-15T22:56:35.534 DEBUG:boto:Token: None 2023-12-15T22:56:35.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b8f3d05c3a213a7-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.537 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.538 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.538 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.538 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.538 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.538 DEBUG:boto:Method: GET 2023-12-15T22:56:35.538 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.538 DEBUG:boto:Data: 2023-12-15T22:56:35.538 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.538 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.538 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.538 DEBUG:boto:Params: {} 2023-12-15T22:56:35.539 DEBUG:boto:Token: None 2023-12-15T22:56:35.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.541 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9160a024781fddb-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.541 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.542 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.542 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.542 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.542 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.542 DEBUG:boto:Method: GET 2023-12-15T22:56:35.542 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.542 DEBUG:boto:Data: 2023-12-15T22:56:35.542 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.543 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.543 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.543 DEBUG:boto:Params: {} 2023-12-15T22:56:35.543 DEBUG:boto:Token: None 2023-12-15T22:56:35.543 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs= 2023-12-15T22:56:35.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs=', 'Content-Length': '0'} 2023-12-15T22:56:35.545 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a03e6557bfe7c359-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.546 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.546 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.546 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.546 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.546 DEBUG:boto:Method: GET 2023-12-15T22:56:35.546 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.546 DEBUG:boto:Data: 2023-12-15T22:56:35.546 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.546 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.546 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.547 DEBUG:boto:Params: {} 2023-12-15T22:56:35.547 DEBUG:boto:Token: None 2023-12-15T22:56:35.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs= 2023-12-15T22:56:35.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs=', 'Content-Length': '0'} 2023-12-15T22:56:35.549 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000063a6b17e1b0476e1-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.593 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.594 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.594 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.594 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.594 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.594 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.594 DEBUG:boto:Data: 2023-12-15T22:56:35.594 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.594 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.594 DEBUG:boto:Params: {} 2023-12-15T22:56:35.594 DEBUG:boto:Token: None 2023-12-15T22:56:35.595 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:guDYZ61vnbdu1W/OD8rpbdIRYkE= 2023-12-15T22:56:35.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:guDYZ61vnbdu1W/OD8rpbdIRYkE=', 'Content-Length': '0'} 2023-12-15T22:56:35.597 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000737d9b62a8d59a9-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.597 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.597 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.598 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.598 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.598 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.598 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.598 DEBUG:boto:Data: 2023-12-15T22:56:35.598 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.598 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.598 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.598 DEBUG:boto:Params: {} 2023-12-15T22:56:35.598 DEBUG:boto:Token: None 2023-12-15T22:56:35.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:guDYZ61vnbdu1W/OD8rpbdIRYkE= 2023-12-15T22:56:35.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:guDYZ61vnbdu1W/OD8rpbdIRYkE=', 'Content-Length': '0'} 2023-12-15T22:56:35.601 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000134d057afe11dc00-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.601 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.601 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.602 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.602 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.602 DEBUG:boto:Method: GET 2023-12-15T22:56:35.602 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.602 DEBUG:boto:Data: 2023-12-15T22:56:35.602 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.602 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.602 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.602 DEBUG:boto:Params: {} 2023-12-15T22:56:35.602 DEBUG:boto:Token: None 2023-12-15T22:56:35.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs= 2023-12-15T22:56:35.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs=', 'Content-Length': '0'} 2023-12-15T22:56:35.605 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000094f811ba80c9f3c1-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.605 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.605 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.605 DEBUG:boto:path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.605 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.605 DEBUG:boto:Method: GET 2023-12-15T22:56:35.605 DEBUG:boto:Path: /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.606 DEBUG:boto:Data: 2023-12-15T22:56:35.606 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.606 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.606 DEBUG:boto:Params: {} 2023-12-15T22:56:35.606 DEBUG:boto:Token: None 2023-12-15T22:56:35.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ 2023-12-15T22:56:35.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs= 2023-12-15T22:56:35.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrfBu/Tf2DMYs37kce8Xb9vsWqs=', 'Content-Length': '0'} 2023-12-15T22:56:35.608 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'iGtgHIBrQ6AZDyxJQMBrsMi65sNKJJZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f5bd1f814fce2e22-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.653 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.654 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.654 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.654 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.654 DEBUG:boto:Method: GET 2023-12-15T22:56:35.654 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.654 DEBUG:boto:Data: 2023-12-15T22:56:35.654 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.654 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.654 DEBUG:boto:Params: {} 2023-12-15T22:56:35.655 DEBUG:boto:Token: None 2023-12-15T22:56:35.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006aa6cc352eb7dbf5-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.657 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.658 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.658 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.658 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.658 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.658 DEBUG:boto:Method: GET 2023-12-15T22:56:35.658 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.658 DEBUG:boto:Data: 2023-12-15T22:56:35.658 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.659 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.659 DEBUG:boto:Params: {} 2023-12-15T22:56:35.659 DEBUG:boto:Token: None 2023-12-15T22:56:35.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d29bb5080ea8d4d4-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.701 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.702 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.702 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.702 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.702 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.702 DEBUG:boto:Data: 2023-12-15T22:56:35.702 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.702 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.702 DEBUG:boto:Params: {} 2023-12-15T22:56:35.703 DEBUG:boto:Token: None 2023-12-15T22:56:35.703 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.706 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003a8df700126f255b-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.707 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.707 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.707 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.707 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.707 DEBUG:boto:Data: 2023-12-15T22:56:35.707 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.707 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.707 DEBUG:boto:Params: {} 2023-12-15T22:56:35.707 DEBUG:boto:Token: None 2023-12-15T22:56:35.708 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.708 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.711 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000057c7f9b0b49520cd-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.711 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.711 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.712 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.712 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.712 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.712 DEBUG:boto:Method: GET 2023-12-15T22:56:35.712 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.712 DEBUG:boto:Data: 2023-12-15T22:56:35.712 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.712 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.712 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.712 DEBUG:boto:Params: {} 2023-12-15T22:56:35.712 DEBUG:boto:Token: None 2023-12-15T22:56:35.712 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.714 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000073994b39dbd02b95-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.715 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.715 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.715 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.715 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.715 DEBUG:boto:Method: GET 2023-12-15T22:56:35.715 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.715 DEBUG:boto:Data: 2023-12-15T22:56:35.715 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.715 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.715 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.716 DEBUG:boto:Params: {} 2023-12-15T22:56:35.716 DEBUG:boto:Token: None 2023-12-15T22:56:35.716 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.716 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.718 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000050e76f76d0f176fb-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.765 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.766 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.766 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.766 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.766 DEBUG:boto:Method: GET 2023-12-15T22:56:35.766 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.766 DEBUG:boto:Data: 2023-12-15T22:56:35.766 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.767 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.767 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.767 DEBUG:boto:Params: {} 2023-12-15T22:56:35.767 DEBUG:boto:Token: None 2023-12-15T22:56:35.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a22b9b53311995d-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.770 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.770 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.770 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.770 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.770 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.770 DEBUG:boto:Method: GET 2023-12-15T22:56:35.771 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.771 DEBUG:boto:Data: 2023-12-15T22:56:35.771 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.771 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.771 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.771 DEBUG:boto:Params: {} 2023-12-15T22:56:35.771 DEBUG:boto:Token: None 2023-12-15T22:56:35.771 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b06905f5bc6b1b9a-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.817 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.818 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.818 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.818 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.818 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.818 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.818 DEBUG:boto:Method: GET 2023-12-15T22:56:35.818 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.818 DEBUG:boto:Data: 2023-12-15T22:56:35.819 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.819 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.819 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.819 DEBUG:boto:Params: {} 2023-12-15T22:56:35.819 DEBUG:boto:Token: None 2023-12-15T22:56:35.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ= 2023-12-15T22:56:35.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.821 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007d2c39bd505671ea-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.821 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.821 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.822 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.822 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.822 DEBUG:boto:Method: GET 2023-12-15T22:56:35.822 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.822 DEBUG:boto:Data: 2023-12-15T22:56:35.822 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.822 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.822 DEBUG:boto:Params: {} 2023-12-15T22:56:35.822 DEBUG:boto:Token: None 2023-12-15T22:56:35.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ= 2023-12-15T22:56:35.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.825 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d87542d5131bbf16-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.865 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.865 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.866 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.866 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.866 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.866 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.866 DEBUG:boto:Data: 2023-12-15T22:56:35.866 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.866 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.866 DEBUG:boto:Params: {} 2023-12-15T22:56:35.866 DEBUG:boto:Token: None 2023-12-15T22:56:35.866 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vjj60bb1Ki59K5wKz/W8OavC1ks= 2023-12-15T22:56:35.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vjj60bb1Ki59K5wKz/W8OavC1ks=', 'Content-Length': '0'} 2023-12-15T22:56:35.868 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c07d8eede4722f15-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.869 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.869 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.869 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.869 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.869 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.869 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.869 DEBUG:boto:Data: 2023-12-15T22:56:35.869 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.869 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.869 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.869 DEBUG:boto:Params: {} 2023-12-15T22:56:35.870 DEBUG:boto:Token: None 2023-12-15T22:56:35.870 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vjj60bb1Ki59K5wKz/W8OavC1ks= 2023-12-15T22:56:35.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vjj60bb1Ki59K5wKz/W8OavC1ks=', 'Content-Length': '0'} 2023-12-15T22:56:35.872 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007edd3e7f62f119ba-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.872 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.872 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.872 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.872 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.872 DEBUG:boto:Method: GET 2023-12-15T22:56:35.872 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.873 DEBUG:boto:Data: 2023-12-15T22:56:35.873 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.873 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.873 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.873 DEBUG:boto:Params: {} 2023-12-15T22:56:35.873 DEBUG:boto:Token: None 2023-12-15T22:56:35.873 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.873 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ= 2023-12-15T22:56:35.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.875 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000001573e0907f6cca0-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.875 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.875 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.876 DEBUG:boto:path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.876 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.876 DEBUG:boto:Method: GET 2023-12-15T22:56:35.876 DEBUG:boto:Path: /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.876 DEBUG:boto:Data: 2023-12-15T22:56:35.876 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.876 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.876 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.876 DEBUG:boto:Params: {} 2023-12-15T22:56:35.876 DEBUG:boto:Token: None 2023-12-15T22:56:35.876 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=-hpnsSvu58IbqQOxiajlTbJIs83X1QX 2023-12-15T22:56:35.876 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ= 2023-12-15T22:56:35.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT4W3/OYIw49TQ+sqIm2OhVvaKQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.878 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '-hpnsSvu58IbqQOxiajlTbJIs83X1QX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000031dadbe267c92d68-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.921 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.922 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.922 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.922 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.922 DEBUG:boto:Method: GET 2023-12-15T22:56:35.922 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.922 DEBUG:boto:Data: 2023-12-15T22:56:35.922 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.923 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.923 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.923 DEBUG:boto:Params: {} 2023-12-15T22:56:35.923 DEBUG:boto:Token: None 2023-12-15T22:56:35.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c7a42b94b7ea22b-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.926 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.926 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:35.926 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:35.926 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.926 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:35.926 DEBUG:boto:Method: GET 2023-12-15T22:56:35.927 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:35.927 DEBUG:boto:Data: 2023-12-15T22:56:35.927 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.927 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.927 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.927 DEBUG:boto:Params: {} 2023-12-15T22:56:35.927 DEBUG:boto:Token: None 2023-12-15T22:56:35.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/ 2023-12-15T22:56:35.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE= 2023-12-15T22:56:35.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9e6xXkm2TiUO3L+Zs2otA/JvGeE=', 'Content-Length': '0'} 2023-12-15T22:56:35.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003318790c4b051ad2-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.973 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:35.974 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.974 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.974 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.974 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.974 DEBUG:boto:Data: 2023-12-15T22:56:35.974 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.974 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.974 DEBUG:boto:Params: {} 2023-12-15T22:56:35.975 DEBUG:boto:Token: None 2023-12-15T22:56:35.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.978 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000051e9150bf3269415-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.978 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.979 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.979 DEBUG:boto:Method: HEAD 2023-12-15T22:56:35.979 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:35.979 DEBUG:boto:Data: 2023-12-15T22:56:35.979 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.979 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.979 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.979 DEBUG:boto:Params: {} 2023-12-15T22:56:35.979 DEBUG:boto:Token: None 2023-12-15T22:56:35.979 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj 2023-12-15T22:56:35.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw= 2023-12-15T22:56:35.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2N6gNDmR+sEeT0Qv8l8BmG7Jerw=', 'Content-Length': '0'} 2023-12-15T22:56:35.983 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f63f50251453e86a-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:35.983 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.983 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.983 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.984 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.984 DEBUG:boto:Method: GET 2023-12-15T22:56:35.984 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.984 DEBUG:boto:Data: 2023-12-15T22:56:35.984 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.984 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:35.984 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.984 DEBUG:boto:Params: {} 2023-12-15T22:56:35.984 DEBUG:boto:Token: None 2023-12-15T22:56:35.984 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.987 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e845d956e26c1889-00657cd9a3-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:35.987 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:35.987 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:35.988 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.988 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.988 DEBUG:boto:Method: GET 2023-12-15T22:56:35.988 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.988 DEBUG:boto:Data: 2023-12-15T22:56:35.988 DEBUG:boto:Headers: {} 2023-12-15T22:56:35.988 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:35.988 DEBUG:boto:Port: 8000 2023-12-15T22:56:35.988 DEBUG:boto:Params: {} 2023-12-15T22:56:35.988 DEBUG:boto:Token: None 2023-12-15T22:56:35.989 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:35 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:35.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ= 2023-12-15T22:56:35.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+JF7cRAlEQPespaKNy8Ya/wWaQ=', 'Content-Length': '0'} 2023-12-15T22:56:35.991 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000da6254c6f1d1c704-00657cd9a3-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.033 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.033 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.034 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.034 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.034 DEBUG:boto:Method: GET 2023-12-15T22:56:36.034 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.034 DEBUG:boto:Data: 2023-12-15T22:56:36.034 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.034 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.034 DEBUG:boto:Params: {} 2023-12-15T22:56:36.034 DEBUG:boto:Token: None 2023-12-15T22:56:36.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5907a9fca86ce36-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.037 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.037 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.038 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.038 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.038 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.038 DEBUG:boto:Method: GET 2023-12-15T22:56:36.038 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.038 DEBUG:boto:Data: 2023-12-15T22:56:36.038 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.038 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.038 DEBUG:boto:Params: {} 2023-12-15T22:56:36.038 DEBUG:boto:Token: None 2023-12-15T22:56:36.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee84a038505700a0-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.081 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.082 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.082 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.083 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.083 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.083 DEBUG:boto:Method: GET 2023-12-15T22:56:36.083 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.084 DEBUG:boto:Data: 2023-12-15T22:56:36.084 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.084 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.084 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.084 DEBUG:boto:Params: {} 2023-12-15T22:56:36.085 DEBUG:boto:Token: None 2023-12-15T22:56:36.085 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.085 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo= 2023-12-15T22:56:36.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo=', 'Content-Length': '0'} 2023-12-15T22:56:36.088 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b5030a0de108d8e8-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.129 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.130 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.130 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.130 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.130 DEBUG:boto:Method: GET 2023-12-15T22:56:36.130 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.130 DEBUG:boto:Data: 2023-12-15T22:56:36.130 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.130 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.130 DEBUG:boto:Params: {} 2023-12-15T22:56:36.130 DEBUG:boto:Token: None 2023-12-15T22:56:36.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo= 2023-12-15T22:56:36.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo=', 'Content-Length': '0'} 2023-12-15T22:56:36.133 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d2ea4ae35c0f7918-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.133 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.133 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.133 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.134 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.134 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.134 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.134 DEBUG:boto:Data: 2023-12-15T22:56:36.134 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.134 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.134 DEBUG:boto:Params: {} 2023-12-15T22:56:36.134 DEBUG:boto:Token: None 2023-12-15T22:56:36.134 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIpSeE6t+8AI3FkeMtbuWQXdGjs= 2023-12-15T22:56:36.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIpSeE6t+8AI3FkeMtbuWQXdGjs=', 'Content-Length': '0'} 2023-12-15T22:56:36.137 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000106428a3fdbffdde-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.137 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.137 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.137 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.138 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.138 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.138 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.138 DEBUG:boto:Data: 2023-12-15T22:56:36.138 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.138 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.138 DEBUG:boto:Params: {} 2023-12-15T22:56:36.138 DEBUG:boto:Token: None 2023-12-15T22:56:36.138 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIpSeE6t+8AI3FkeMtbuWQXdGjs= 2023-12-15T22:56:36.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIpSeE6t+8AI3FkeMtbuWQXdGjs=', 'Content-Length': '0'} 2023-12-15T22:56:36.141 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007aaec5ca65bd921e-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.141 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.141 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.141 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.141 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.141 DEBUG:boto:Method: GET 2023-12-15T22:56:36.141 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.142 DEBUG:boto:Data: 2023-12-15T22:56:36.142 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.142 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.142 DEBUG:boto:Params: {} 2023-12-15T22:56:36.142 DEBUG:boto:Token: None 2023-12-15T22:56:36.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo= 2023-12-15T22:56:36.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo=', 'Content-Length': '0'} 2023-12-15T22:56:36.145 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bae69bc888636e5b-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.185 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.186 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.186 DEBUG:boto:path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.186 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.186 DEBUG:boto:Method: GET 2023-12-15T22:56:36.186 DEBUG:boto:Path: /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.186 DEBUG:boto:Data: 2023-12-15T22:56:36.186 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.186 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.186 DEBUG:boto:Params: {} 2023-12-15T22:56:36.187 DEBUG:boto:Token: None 2023-12-15T22:56:36.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p 2023-12-15T22:56:36.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo= 2023-12-15T22:56:36.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZA+PBelo7XrKPHQsSFgyUSQeVGo=', 'Content-Length': '0'} 2023-12-15T22:56:36.189 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'yjAKdpKlj3Yh9CyZ8J34cr1vUv2L43p'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f81601c3f9479f43-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.189 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.189 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.189 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.189 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.189 DEBUG:boto:Method: GET 2023-12-15T22:56:36.190 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.190 DEBUG:boto:Data: 2023-12-15T22:56:36.190 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.190 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.190 DEBUG:boto:Params: {} 2023-12-15T22:56:36.190 DEBUG:boto:Token: None 2023-12-15T22:56:36.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c9f8b0fca476f93-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.193 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.193 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.193 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.193 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.193 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.194 DEBUG:boto:Method: GET 2023-12-15T22:56:36.194 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.194 DEBUG:boto:Data: 2023-12-15T22:56:36.194 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.194 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.194 DEBUG:boto:Params: {} 2023-12-15T22:56:36.194 DEBUG:boto:Token: None 2023-12-15T22:56:36.194 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ede2a855bfb5edf-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.197 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.197 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.197 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.197 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.197 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.197 DEBUG:boto:Data: 2023-12-15T22:56:36.198 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.198 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.198 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.198 DEBUG:boto:Params: {} 2023-12-15T22:56:36.198 DEBUG:boto:Token: None 2023-12-15T22:56:36.198 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.201 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a8dcb6a94148023f-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.202 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.202 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.202 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.202 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.202 DEBUG:boto:Data: 2023-12-15T22:56:36.202 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.202 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.202 DEBUG:boto:Params: {} 2023-12-15T22:56:36.203 DEBUG:boto:Token: None 2023-12-15T22:56:36.203 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.206 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004699dde72508a8c9-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.206 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.207 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.207 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.207 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.207 DEBUG:boto:Method: GET 2023-12-15T22:56:36.207 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.207 DEBUG:boto:Data: 2023-12-15T22:56:36.207 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.207 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.207 DEBUG:boto:Params: {} 2023-12-15T22:56:36.207 DEBUG:boto:Token: None 2023-12-15T22:56:36.208 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.210 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002375468742fe1fb0-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.210 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.210 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.210 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.210 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.210 DEBUG:boto:Method: GET 2023-12-15T22:56:36.211 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.211 DEBUG:boto:Data: 2023-12-15T22:56:36.211 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.211 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.211 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.211 DEBUG:boto:Params: {} 2023-12-15T22:56:36.211 DEBUG:boto:Token: None 2023-12-15T22:56:36.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.213 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e9fb5785407e1dd-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.253 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.254 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.254 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.254 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.254 DEBUG:boto:Method: GET 2023-12-15T22:56:36.254 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.254 DEBUG:boto:Data: 2023-12-15T22:56:36.254 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.254 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.254 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.254 DEBUG:boto:Params: {} 2023-12-15T22:56:36.255 DEBUG:boto:Token: None 2023-12-15T22:56:36.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.257 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009710383af778d88c-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.257 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.258 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.258 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.258 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.258 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.258 DEBUG:boto:Method: GET 2023-12-15T22:56:36.258 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.258 DEBUG:boto:Data: 2023-12-15T22:56:36.258 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.258 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.259 DEBUG:boto:Params: {} 2023-12-15T22:56:36.259 DEBUG:boto:Token: None 2023-12-15T22:56:36.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a7883fb325fe3f1-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.261 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.262 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.262 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.262 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.262 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.262 DEBUG:boto:Method: GET 2023-12-15T22:56:36.262 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.262 DEBUG:boto:Data: 2023-12-15T22:56:36.263 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.263 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.263 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.263 DEBUG:boto:Params: {} 2023-12-15T22:56:36.263 DEBUG:boto:Token: None 2023-12-15T22:56:36.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I= 2023-12-15T22:56:36.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I=', 'Content-Length': '0'} 2023-12-15T22:56:36.265 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000177e92908f96a904-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.305 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.305 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.306 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.306 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.306 DEBUG:boto:Method: GET 2023-12-15T22:56:36.306 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.306 DEBUG:boto:Data: 2023-12-15T22:56:36.306 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.306 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.306 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.306 DEBUG:boto:Params: {} 2023-12-15T22:56:36.306 DEBUG:boto:Token: None 2023-12-15T22:56:36.306 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I= 2023-12-15T22:56:36.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I=', 'Content-Length': '0'} 2023-12-15T22:56:36.309 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000198c227598247251-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.309 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.309 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.309 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.309 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.309 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.309 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.309 DEBUG:boto:Data: 2023-12-15T22:56:36.310 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.310 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.310 DEBUG:boto:Params: {} 2023-12-15T22:56:36.310 DEBUG:boto:Token: None 2023-12-15T22:56:36.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:09eMrJRlroMKVK02KDo0LjTuXCs= 2023-12-15T22:56:36.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:09eMrJRlroMKVK02KDo0LjTuXCs=', 'Content-Length': '0'} 2023-12-15T22:56:36.312 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cbf764c10e15447e-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.312 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.312 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.312 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.312 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.313 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.313 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.313 DEBUG:boto:Data: 2023-12-15T22:56:36.313 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.313 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.313 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.313 DEBUG:boto:Params: {} 2023-12-15T22:56:36.313 DEBUG:boto:Token: None 2023-12-15T22:56:36.313 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:09eMrJRlroMKVK02KDo0LjTuXCs= 2023-12-15T22:56:36.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:09eMrJRlroMKVK02KDo0LjTuXCs=', 'Content-Length': '0'} 2023-12-15T22:56:36.315 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000d994441dc3bd0ad-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.316 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.316 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.316 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.316 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.316 DEBUG:boto:Method: GET 2023-12-15T22:56:36.316 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.316 DEBUG:boto:Data: 2023-12-15T22:56:36.316 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.316 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.316 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.316 DEBUG:boto:Params: {} 2023-12-15T22:56:36.317 DEBUG:boto:Token: None 2023-12-15T22:56:36.317 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I= 2023-12-15T22:56:36.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I=', 'Content-Length': '0'} 2023-12-15T22:56:36.319 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000018fce298210de4dd-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.361 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.362 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.362 DEBUG:boto:path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.362 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.362 DEBUG:boto:Method: GET 2023-12-15T22:56:36.362 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.362 DEBUG:boto:Data: 2023-12-15T22:56:36.362 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.362 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.362 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.362 DEBUG:boto:Params: {} 2023-12-15T22:56:36.362 DEBUG:boto:Token: None 2023-12-15T22:56:36.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO 2023-12-15T22:56:36.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I= 2023-12-15T22:56:36.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gZqFB2o/u0540Yq5p4+YiIccY1I=', 'Content-Length': '0'} 2023-12-15T22:56:36.365 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3Q8OU-J9KNb2znchMvQ6MZIIsb-zjwO'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007c145515456c603b-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.365 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.365 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.365 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.365 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.365 DEBUG:boto:Method: GET 2023-12-15T22:56:36.365 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.366 DEBUG:boto:Data: 2023-12-15T22:56:36.366 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.366 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.366 DEBUG:boto:Params: {} 2023-12-15T22:56:36.366 DEBUG:boto:Token: None 2023-12-15T22:56:36.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020d69b704f93e35a-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.369 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.369 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.369 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.369 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.369 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.369 DEBUG:boto:Method: GET 2023-12-15T22:56:36.369 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.369 DEBUG:boto:Data: 2023-12-15T22:56:36.370 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.370 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.370 DEBUG:boto:Params: {} 2023-12-15T22:56:36.370 DEBUG:boto:Token: None 2023-12-15T22:56:36.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000449c9a5b7842bdec-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.373 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.373 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.373 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.373 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.373 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.373 DEBUG:boto:Data: 2023-12-15T22:56:36.373 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.374 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.374 DEBUG:boto:Params: {} 2023-12-15T22:56:36.374 DEBUG:boto:Token: None 2023-12-15T22:56:36.374 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.378 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000095805f95e807c840-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.378 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.378 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.378 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.378 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.378 DEBUG:boto:Data: 2023-12-15T22:56:36.379 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.379 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.379 DEBUG:boto:Params: {} 2023-12-15T22:56:36.379 DEBUG:boto:Token: None 2023-12-15T22:56:36.379 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.382 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000449096f5cf0c9063-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.383 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.383 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.383 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.383 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.383 DEBUG:boto:Method: GET 2023-12-15T22:56:36.383 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.383 DEBUG:boto:Data: 2023-12-15T22:56:36.383 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.383 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.384 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.384 DEBUG:boto:Params: {} 2023-12-15T22:56:36.384 DEBUG:boto:Token: None 2023-12-15T22:56:36.384 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.386 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006e7364fafa095b17-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.386 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.386 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.387 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.387 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.387 DEBUG:boto:Method: GET 2023-12-15T22:56:36.387 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.387 DEBUG:boto:Data: 2023-12-15T22:56:36.387 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.387 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.387 DEBUG:boto:Params: {} 2023-12-15T22:56:36.387 DEBUG:boto:Token: None 2023-12-15T22:56:36.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.389 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bc1c0abe399d64b5-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.433 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.434 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.434 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.434 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.434 DEBUG:boto:Method: GET 2023-12-15T22:56:36.434 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.434 DEBUG:boto:Data: 2023-12-15T22:56:36.434 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.434 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.434 DEBUG:boto:Params: {} 2023-12-15T22:56:36.435 DEBUG:boto:Token: None 2023-12-15T22:56:36.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000181bd5a2b65e847f-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.438 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.438 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.438 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.438 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.438 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.438 DEBUG:boto:Method: GET 2023-12-15T22:56:36.438 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.438 DEBUG:boto:Data: 2023-12-15T22:56:36.439 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.439 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.439 DEBUG:boto:Params: {} 2023-12-15T22:56:36.439 DEBUG:boto:Token: None 2023-12-15T22:56:36.439 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ba6f82c8f443907-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.442 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.442 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.442 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.442 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.442 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.442 DEBUG:boto:Method: GET 2023-12-15T22:56:36.443 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.443 DEBUG:boto:Data: 2023-12-15T22:56:36.443 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.443 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.443 DEBUG:boto:Params: {} 2023-12-15T22:56:36.443 DEBUG:boto:Token: None 2023-12-15T22:56:36.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts= 2023-12-15T22:56:36.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts=', 'Content-Length': '0'} 2023-12-15T22:56:36.445 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004ea8c6589a49f65c-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.485 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.485 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.486 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.486 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.486 DEBUG:boto:Method: GET 2023-12-15T22:56:36.486 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.486 DEBUG:boto:Data: 2023-12-15T22:56:36.486 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.486 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.486 DEBUG:boto:Params: {} 2023-12-15T22:56:36.486 DEBUG:boto:Token: None 2023-12-15T22:56:36.486 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts= 2023-12-15T22:56:36.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts=', 'Content-Length': '0'} 2023-12-15T22:56:36.489 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002b865cf0d666e09b-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.529 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.530 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.530 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.530 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.530 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.530 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.530 DEBUG:boto:Data: 2023-12-15T22:56:36.530 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.530 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.530 DEBUG:boto:Params: {} 2023-12-15T22:56:36.530 DEBUG:boto:Token: None 2023-12-15T22:56:36.531 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k35MfQ3topTeEQZebTohwzJLvJs= 2023-12-15T22:56:36.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k35MfQ3topTeEQZebTohwzJLvJs=', 'Content-Length': '0'} 2023-12-15T22:56:36.532 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007ba71810bf9f6efe-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.533 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.533 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.533 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.533 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.533 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.533 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.533 DEBUG:boto:Data: 2023-12-15T22:56:36.533 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.533 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.534 DEBUG:boto:Params: {} 2023-12-15T22:56:36.534 DEBUG:boto:Token: None 2023-12-15T22:56:36.534 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k35MfQ3topTeEQZebTohwzJLvJs= 2023-12-15T22:56:36.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k35MfQ3topTeEQZebTohwzJLvJs=', 'Content-Length': '0'} 2023-12-15T22:56:36.535 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000017227b5fd51a2321-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.536 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.536 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.536 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.536 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.536 DEBUG:boto:Method: GET 2023-12-15T22:56:36.536 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.536 DEBUG:boto:Data: 2023-12-15T22:56:36.536 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.537 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.537 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.537 DEBUG:boto:Params: {} 2023-12-15T22:56:36.537 DEBUG:boto:Token: None 2023-12-15T22:56:36.537 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts= 2023-12-15T22:56:36.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts=', 'Content-Length': '0'} 2023-12-15T22:56:36.539 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000efb87cd6b339a187-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.539 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.539 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.539 DEBUG:boto:path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.539 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.540 DEBUG:boto:Method: GET 2023-12-15T22:56:36.540 DEBUG:boto:Path: /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.540 DEBUG:boto:Data: 2023-12-15T22:56:36.540 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.540 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.540 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.540 DEBUG:boto:Params: {} 2023-12-15T22:56:36.540 DEBUG:boto:Token: None 2023-12-15T22:56:36.540 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0 2023-12-15T22:56:36.540 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts= 2023-12-15T22:56:36.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nIeZnbB2ByN5E4GM1Jog98RE3Ts=', 'Content-Length': '0'} 2023-12-15T22:56:36.542 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'ELiP64.-9ImKBdXw1V4J3oT7s8ynJt0'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000af46e814f344960c-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.590 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.590 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.590 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.590 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.590 DEBUG:boto:Method: GET 2023-12-15T22:56:36.590 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.590 DEBUG:boto:Data: 2023-12-15T22:56:36.590 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.590 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.591 DEBUG:boto:Params: {} 2023-12-15T22:56:36.591 DEBUG:boto:Token: None 2023-12-15T22:56:36.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ea242fd433131fa-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.594 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.594 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.594 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.594 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.594 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.594 DEBUG:boto:Method: GET 2023-12-15T22:56:36.594 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.595 DEBUG:boto:Data: 2023-12-15T22:56:36.595 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.595 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.595 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.595 DEBUG:boto:Params: {} 2023-12-15T22:56:36.595 DEBUG:boto:Token: None 2023-12-15T22:56:36.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b0587a24402d0d8-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.641 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.642 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.642 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.642 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.642 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.642 DEBUG:boto:Data: 2023-12-15T22:56:36.642 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.643 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.643 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.643 DEBUG:boto:Params: {} 2023-12-15T22:56:36.643 DEBUG:boto:Token: None 2023-12-15T22:56:36.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.647 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008852046d5ffba786-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.647 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.647 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.647 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.648 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.648 DEBUG:boto:Data: 2023-12-15T22:56:36.648 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.648 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.648 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.648 DEBUG:boto:Params: {} 2023-12-15T22:56:36.648 DEBUG:boto:Token: None 2023-12-15T22:56:36.648 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.648 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.652 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005477ab59a747b19b-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.652 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.652 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.652 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.653 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.653 DEBUG:boto:Method: GET 2023-12-15T22:56:36.653 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.653 DEBUG:boto:Data: 2023-12-15T22:56:36.653 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.653 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.653 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.653 DEBUG:boto:Params: {} 2023-12-15T22:56:36.653 DEBUG:boto:Token: None 2023-12-15T22:56:36.653 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.655 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000075909b237b31c398-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.656 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.656 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.656 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.656 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.656 DEBUG:boto:Method: GET 2023-12-15T22:56:36.656 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.656 DEBUG:boto:Data: 2023-12-15T22:56:36.656 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.657 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.657 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.657 DEBUG:boto:Params: {} 2023-12-15T22:56:36.657 DEBUG:boto:Token: None 2023-12-15T22:56:36.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.659 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008e8b77e812aebed1-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.702 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.702 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.702 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.702 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.702 DEBUG:boto:Method: GET 2023-12-15T22:56:36.702 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.702 DEBUG:boto:Data: 2023-12-15T22:56:36.702 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.703 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.703 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.703 DEBUG:boto:Params: {} 2023-12-15T22:56:36.703 DEBUG:boto:Token: None 2023-12-15T22:56:36.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029d6fe9c1c701b4e-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.706 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.706 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.706 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.706 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.707 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.707 DEBUG:boto:Method: GET 2023-12-15T22:56:36.707 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.707 DEBUG:boto:Data: 2023-12-15T22:56:36.707 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.707 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.707 DEBUG:boto:Params: {} 2023-12-15T22:56:36.707 DEBUG:boto:Token: None 2023-12-15T22:56:36.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000061f614853da3ebd-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.753 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.754 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.754 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.754 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.754 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.754 DEBUG:boto:Method: GET 2023-12-15T22:56:36.754 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.754 DEBUG:boto:Data: 2023-12-15T22:56:36.755 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.755 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.755 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.755 DEBUG:boto:Params: {} 2023-12-15T22:56:36.755 DEBUG:boto:Token: None 2023-12-15T22:56:36.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU= 2023-12-15T22:56:36.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU=', 'Content-Length': '0'} 2023-12-15T22:56:36.757 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000627c1834f843cb95-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.797 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.797 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.798 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.798 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.798 DEBUG:boto:Method: GET 2023-12-15T22:56:36.798 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.798 DEBUG:boto:Data: 2023-12-15T22:56:36.798 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.798 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.798 DEBUG:boto:Params: {} 2023-12-15T22:56:36.798 DEBUG:boto:Token: None 2023-12-15T22:56:36.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU= 2023-12-15T22:56:36.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU=', 'Content-Length': '0'} 2023-12-15T22:56:36.800 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000013e1709f9bcc82a5-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.801 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.801 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.801 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.801 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.801 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.801 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.801 DEBUG:boto:Data: 2023-12-15T22:56:36.802 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.802 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.802 DEBUG:boto:Params: {} 2023-12-15T22:56:36.802 DEBUG:boto:Token: None 2023-12-15T22:56:36.802 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yprRfdiVql86M3fV215LC0ZZQI= 2023-12-15T22:56:36.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yprRfdiVql86M3fV215LC0ZZQI=', 'Content-Length': '0'} 2023-12-15T22:56:36.804 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000da3cd90bb8ab51d0-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.804 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.804 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.805 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.805 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.805 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.805 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.805 DEBUG:boto:Data: 2023-12-15T22:56:36.806 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.806 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.806 DEBUG:boto:Params: {} 2023-12-15T22:56:36.806 DEBUG:boto:Token: None 2023-12-15T22:56:36.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yprRfdiVql86M3fV215LC0ZZQI= 2023-12-15T22:56:36.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yprRfdiVql86M3fV215LC0ZZQI=', 'Content-Length': '0'} 2023-12-15T22:56:36.808 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000a9764eb8867fb16-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.809 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.809 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.809 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.809 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.809 DEBUG:boto:Method: GET 2023-12-15T22:56:36.809 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.809 DEBUG:boto:Data: 2023-12-15T22:56:36.809 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.809 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.810 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.810 DEBUG:boto:Params: {} 2023-12-15T22:56:36.810 DEBUG:boto:Token: None 2023-12-15T22:56:36.810 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU= 2023-12-15T22:56:36.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU=', 'Content-Length': '0'} 2023-12-15T22:56:36.812 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004c7577cb3642d6b3-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.857 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.858 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.858 DEBUG:boto:path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.858 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.858 DEBUG:boto:Method: GET 2023-12-15T22:56:36.858 DEBUG:boto:Path: /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.858 DEBUG:boto:Data: 2023-12-15T22:56:36.858 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.858 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.858 DEBUG:boto:Params: {} 2023-12-15T22:56:36.858 DEBUG:boto:Token: None 2023-12-15T22:56:36.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM 2023-12-15T22:56:36.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU= 2023-12-15T22:56:36.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MBOR2DFZYlkDxrx4WWgAcec64dU=', 'Content-Length': '0'} 2023-12-15T22:56:36.861 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'lbzMk1gqf71XLqD2vk3YmoNzMVpwtUM'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001e7a99f18c37b6de-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.861 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.861 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.861 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.861 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.861 DEBUG:boto:Method: GET 2023-12-15T22:56:36.861 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.862 DEBUG:boto:Data: 2023-12-15T22:56:36.862 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.862 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.862 DEBUG:boto:Params: {} 2023-12-15T22:56:36.862 DEBUG:boto:Token: None 2023-12-15T22:56:36.862 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd2969c9df1dc19c-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.907 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.907 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.907 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.907 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.907 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.908 DEBUG:boto:Method: GET 2023-12-15T22:56:36.908 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.908 DEBUG:boto:Data: 2023-12-15T22:56:36.908 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.908 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.908 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.908 DEBUG:boto:Params: {} 2023-12-15T22:56:36.908 DEBUG:boto:Token: None 2023-12-15T22:56:36.908 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.908 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.911 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009770a05b689f93d4-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.911 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.911 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.911 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.911 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.911 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.912 DEBUG:boto:Data: 2023-12-15T22:56:36.912 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.912 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.912 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.912 DEBUG:boto:Params: {} 2023-12-15T22:56:36.912 DEBUG:boto:Token: None 2023-12-15T22:56:36.912 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.915 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000433f5ba4dc37bb9-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.916 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.916 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.916 DEBUG:boto:Method: HEAD 2023-12-15T22:56:36.916 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:36.916 DEBUG:boto:Data: 2023-12-15T22:56:36.916 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.916 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.916 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.916 DEBUG:boto:Params: {} 2023-12-15T22:56:36.917 DEBUG:boto:Token: None 2023-12-15T22:56:36.917 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj 2023-12-15T22:56:36.917 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o= 2023-12-15T22:56:36.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EawkX0C9uzot2ZSfk8RnnS1BH9o=', 'Content-Length': '0'} 2023-12-15T22:56:36.921 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000058f4e597084b9b9-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:36.921 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.921 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.921 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.921 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.921 DEBUG:boto:Method: GET 2023-12-15T22:56:36.921 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.922 DEBUG:boto:Data: 2023-12-15T22:56:36.922 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.922 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.922 DEBUG:boto:Params: {} 2023-12-15T22:56:36.922 DEBUG:boto:Token: None 2023-12-15T22:56:36.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.924 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000731a05571642ce74-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.925 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:36.925 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:36.925 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.925 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.925 DEBUG:boto:Method: GET 2023-12-15T22:56:36.925 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.925 DEBUG:boto:Data: 2023-12-15T22:56:36.925 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.925 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.925 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.926 DEBUG:boto:Params: {} 2023-12-15T22:56:36.926 DEBUG:boto:Token: None 2023-12-15T22:56:36.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:36.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY= 2023-12-15T22:56:36.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o/CCoF9QmAV7k2Xr5uwrLM9cyJY=', 'Content-Length': '0'} 2023-12-15T22:56:36.928 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ba831bc90120af9a-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.970 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.970 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.970 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.970 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.970 DEBUG:boto:Method: GET 2023-12-15T22:56:36.970 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.970 DEBUG:boto:Data: 2023-12-15T22:56:36.970 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:36.970 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.970 DEBUG:boto:Params: {} 2023-12-15T22:56:36.971 DEBUG:boto:Token: None 2023-12-15T22:56:36.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.973 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae4ab6af1d171b8d-00657cd9a4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:36.974 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:36.974 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:36.974 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:36.974 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.974 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:36.974 DEBUG:boto:Method: GET 2023-12-15T22:56:36.974 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:36.975 DEBUG:boto:Data: 2023-12-15T22:56:36.975 DEBUG:boto:Headers: {} 2023-12-15T22:56:36.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:36.975 DEBUG:boto:Port: 8000 2023-12-15T22:56:36.975 DEBUG:boto:Params: {} 2023-12-15T22:56:36.975 DEBUG:boto:Token: None 2023-12-15T22:56:36.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:36 GMT /kskgfn-13/ 2023-12-15T22:56:36.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg= 2023-12-15T22:56:36.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/nnaxxWXfeN2mB9kpO9vV3woXg=', 'Content-Length': '0'} 2023-12-15T22:56:36.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f5776b731094de0-00657cd9a4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.021 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.022 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.022 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.022 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.022 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.022 DEBUG:boto:Method: GET 2023-12-15T22:56:37.022 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.022 DEBUG:boto:Data: 2023-12-15T22:56:37.022 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.023 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.023 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.023 DEBUG:boto:Params: {} 2023-12-15T22:56:37.023 DEBUG:boto:Token: None 2023-12-15T22:56:37.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE= 2023-12-15T22:56:37.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE=', 'Content-Length': '0'} 2023-12-15T22:56:37.025 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000098b70f6651ce4f51-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.025 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.026 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.026 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.026 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.026 DEBUG:boto:Method: GET 2023-12-15T22:56:37.026 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.026 DEBUG:boto:Data: 2023-12-15T22:56:37.026 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.026 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.026 DEBUG:boto:Params: {} 2023-12-15T22:56:37.026 DEBUG:boto:Token: None 2023-12-15T22:56:37.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE= 2023-12-15T22:56:37.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE=', 'Content-Length': '0'} 2023-12-15T22:56:37.029 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000cf57edcdee211d3-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.069 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.070 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.070 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.070 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.070 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.070 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.070 DEBUG:boto:Data: 2023-12-15T22:56:37.070 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.070 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.070 DEBUG:boto:Params: {} 2023-12-15T22:56:37.070 DEBUG:boto:Token: None 2023-12-15T22:56:37.071 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ebzgRFPWkhtTDA0+Hl2Mm32XKdQ= 2023-12-15T22:56:37.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ebzgRFPWkhtTDA0+Hl2Mm32XKdQ=', 'Content-Length': '0'} 2023-12-15T22:56:37.073 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e3c45d29d272e642-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.073 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.073 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.073 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.074 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.074 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.074 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.074 DEBUG:boto:Data: 2023-12-15T22:56:37.074 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.074 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.074 DEBUG:boto:Params: {} 2023-12-15T22:56:37.074 DEBUG:boto:Token: None 2023-12-15T22:56:37.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ebzgRFPWkhtTDA0+Hl2Mm32XKdQ= 2023-12-15T22:56:37.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ebzgRFPWkhtTDA0+Hl2Mm32XKdQ=', 'Content-Length': '0'} 2023-12-15T22:56:37.077 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000ec4e8b788017c57-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.077 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.077 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.077 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.077 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.077 DEBUG:boto:Method: GET 2023-12-15T22:56:37.078 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.078 DEBUG:boto:Data: 2023-12-15T22:56:37.078 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.078 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.078 DEBUG:boto:Params: {} 2023-12-15T22:56:37.078 DEBUG:boto:Token: None 2023-12-15T22:56:37.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE= 2023-12-15T22:56:37.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE=', 'Content-Length': '0'} 2023-12-15T22:56:37.080 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000190ea9d3bf24eea2-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.081 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.081 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.081 DEBUG:boto:path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.081 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.081 DEBUG:boto:Method: GET 2023-12-15T22:56:37.081 DEBUG:boto:Path: /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.081 DEBUG:boto:Data: 2023-12-15T22:56:37.081 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.081 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.082 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.082 DEBUG:boto:Params: {} 2023-12-15T22:56:37.082 DEBUG:boto:Token: None 2023-12-15T22:56:37.082 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=q5CefSIJUWWwv8YpVPSjFuKnO7x22sw 2023-12-15T22:56:37.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE= 2023-12-15T22:56:37.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3SNyxGFPfwfyZ1nt+QzenYKkjXE=', 'Content-Length': '0'} 2023-12-15T22:56:37.084 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'q5CefSIJUWWwv8YpVPSjFuKnO7x22sw'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004431bbf7299106f1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.125 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.126 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.126 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.126 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.126 DEBUG:boto:Method: GET 2023-12-15T22:56:37.126 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.126 DEBUG:boto:Data: 2023-12-15T22:56:37.126 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.126 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.126 DEBUG:boto:Params: {} 2023-12-15T22:56:37.126 DEBUG:boto:Token: None 2023-12-15T22:56:37.126 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066fe73f6fae69c49-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.129 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.129 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.129 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.129 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.129 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.130 DEBUG:boto:Method: GET 2023-12-15T22:56:37.130 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.130 DEBUG:boto:Data: 2023-12-15T22:56:37.130 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.130 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.130 DEBUG:boto:Params: {} 2023-12-15T22:56:37.130 DEBUG:boto:Token: None 2023-12-15T22:56:37.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008714b394a3e33c86-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.173 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.174 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.174 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.174 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.174 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.174 DEBUG:boto:Data: 2023-12-15T22:56:37.174 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.174 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.174 DEBUG:boto:Params: {} 2023-12-15T22:56:37.175 DEBUG:boto:Token: None 2023-12-15T22:56:37.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.179 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000022dccd3190d44bdd-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.179 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.179 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.179 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.179 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.179 DEBUG:boto:Data: 2023-12-15T22:56:37.179 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.179 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.179 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.179 DEBUG:boto:Params: {} 2023-12-15T22:56:37.180 DEBUG:boto:Token: None 2023-12-15T22:56:37.180 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.183 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fb2b6da5d3ad77c1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.183 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.183 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.183 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.184 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.184 DEBUG:boto:Method: GET 2023-12-15T22:56:37.184 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.184 DEBUG:boto:Data: 2023-12-15T22:56:37.184 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.184 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.184 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.184 DEBUG:boto:Params: {} 2023-12-15T22:56:37.184 DEBUG:boto:Token: None 2023-12-15T22:56:37.184 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.185 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.187 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d60deb9aff99d7db-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.229 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.229 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.230 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.230 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.230 DEBUG:boto:Method: GET 2023-12-15T22:56:37.230 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.230 DEBUG:boto:Data: 2023-12-15T22:56:37.230 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.230 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.230 DEBUG:boto:Params: {} 2023-12-15T22:56:37.230 DEBUG:boto:Token: None 2023-12-15T22:56:37.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.233 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ba92a4897898b8cf-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.274 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.274 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.274 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.274 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.274 DEBUG:boto:Method: GET 2023-12-15T22:56:37.274 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.274 DEBUG:boto:Data: 2023-12-15T22:56:37.274 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.275 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.275 DEBUG:boto:Params: {} 2023-12-15T22:56:37.275 DEBUG:boto:Token: None 2023-12-15T22:56:37.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2408b1e6ddb4449-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.278 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.278 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.278 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.278 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.278 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.278 DEBUG:boto:Method: GET 2023-12-15T22:56:37.278 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.278 DEBUG:boto:Data: 2023-12-15T22:56:37.279 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.279 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.279 DEBUG:boto:Params: {} 2023-12-15T22:56:37.279 DEBUG:boto:Token: None 2023-12-15T22:56:37.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009eae24b5fb222cea-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.321 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.322 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.322 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.322 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.322 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.322 DEBUG:boto:Method: GET 2023-12-15T22:56:37.322 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.322 DEBUG:boto:Data: 2023-12-15T22:56:37.322 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.323 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.323 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.323 DEBUG:boto:Params: {} 2023-12-15T22:56:37.323 DEBUG:boto:Token: None 2023-12-15T22:56:37.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg= 2023-12-15T22:56:37.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg=', 'Content-Length': '0'} 2023-12-15T22:56:37.325 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bc142182aafa86fa-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.369 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.370 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.370 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.370 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.370 DEBUG:boto:Method: GET 2023-12-15T22:56:37.370 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.370 DEBUG:boto:Data: 2023-12-15T22:56:37.370 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.370 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.370 DEBUG:boto:Params: {} 2023-12-15T22:56:37.371 DEBUG:boto:Token: None 2023-12-15T22:56:37.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg= 2023-12-15T22:56:37.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg=', 'Content-Length': '0'} 2023-12-15T22:56:37.374 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000684ae08e768f87e9-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.375 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.375 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.375 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.375 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.375 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.376 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.376 DEBUG:boto:Data: 2023-12-15T22:56:37.376 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.376 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.376 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.376 DEBUG:boto:Params: {} 2023-12-15T22:56:37.376 DEBUG:boto:Token: None 2023-12-15T22:56:37.376 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.376 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DxuvLSxX2heR4oYw8QeEgfdgh8A= 2023-12-15T22:56:37.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DxuvLSxX2heR4oYw8QeEgfdgh8A=', 'Content-Length': '0'} 2023-12-15T22:56:37.378 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ce69e497da994027-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.378 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.379 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.379 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.379 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.379 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.379 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.379 DEBUG:boto:Data: 2023-12-15T22:56:37.379 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.379 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.379 DEBUG:boto:Params: {} 2023-12-15T22:56:37.380 DEBUG:boto:Token: None 2023-12-15T22:56:37.380 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DxuvLSxX2heR4oYw8QeEgfdgh8A= 2023-12-15T22:56:37.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DxuvLSxX2heR4oYw8QeEgfdgh8A=', 'Content-Length': '0'} 2023-12-15T22:56:37.382 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008e140c68d427aea1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.382 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.382 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.382 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.382 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.383 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.383 DEBUG:boto:Method: GET 2023-12-15T22:56:37.383 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.383 DEBUG:boto:Data: 2023-12-15T22:56:37.383 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.383 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.383 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.383 DEBUG:boto:Params: {} 2023-12-15T22:56:37.383 DEBUG:boto:Token: None 2023-12-15T22:56:37.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg= 2023-12-15T22:56:37.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg=', 'Content-Length': '0'} 2023-12-15T22:56:37.385 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b97ddd1306856bf2-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.429 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.430 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.430 DEBUG:boto:path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.430 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.430 DEBUG:boto:Method: GET 2023-12-15T22:56:37.430 DEBUG:boto:Path: /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.430 DEBUG:boto:Data: 2023-12-15T22:56:37.430 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.430 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.430 DEBUG:boto:Params: {} 2023-12-15T22:56:37.431 DEBUG:boto:Token: None 2023-12-15T22:56:37.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=.YZiBCR2mmPSn158CxWHUZ.enE1zvXW 2023-12-15T22:56:37.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg= 2023-12-15T22:56:37.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmukibNpfC62G8jr6qepPtmw4Dg=', 'Content-Length': '0'} 2023-12-15T22:56:37.433 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '.YZiBCR2mmPSn158CxWHUZ.enE1zvXW'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c2edec0598906286-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.433 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.434 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.434 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.434 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.434 DEBUG:boto:Method: GET 2023-12-15T22:56:37.434 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.434 DEBUG:boto:Data: 2023-12-15T22:56:37.435 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.435 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.435 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.435 DEBUG:boto:Params: {} 2023-12-15T22:56:37.435 DEBUG:boto:Token: None 2023-12-15T22:56:37.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ddf0dabc67b6532-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.481 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.482 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.482 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.482 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.482 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.482 DEBUG:boto:Method: GET 2023-12-15T22:56:37.482 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.482 DEBUG:boto:Data: 2023-12-15T22:56:37.482 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.482 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.482 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.483 DEBUG:boto:Params: {} 2023-12-15T22:56:37.483 DEBUG:boto:Token: None 2023-12-15T22:56:37.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004569b7d9a9a4bf2a-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.485 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.486 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.486 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.486 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.486 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.486 DEBUG:boto:Data: 2023-12-15T22:56:37.486 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.486 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.487 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.487 DEBUG:boto:Params: {} 2023-12-15T22:56:37.487 DEBUG:boto:Token: None 2023-12-15T22:56:37.487 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.491 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000057657ca2321e8eb7-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.492 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.492 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.492 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.492 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.492 DEBUG:boto:Data: 2023-12-15T22:56:37.492 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.492 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.492 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.493 DEBUG:boto:Params: {} 2023-12-15T22:56:37.493 DEBUG:boto:Token: None 2023-12-15T22:56:37.493 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.496 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000047d6c2af29b523de-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.496 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.497 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.497 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.497 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.497 DEBUG:boto:Method: GET 2023-12-15T22:56:37.497 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.497 DEBUG:boto:Data: 2023-12-15T22:56:37.497 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.497 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.497 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.497 DEBUG:boto:Params: {} 2023-12-15T22:56:37.497 DEBUG:boto:Token: None 2023-12-15T22:56:37.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.498 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.500 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000045d999b60a8fdeda-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.500 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.500 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.500 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.500 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.500 DEBUG:boto:Method: GET 2023-12-15T22:56:37.501 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.501 DEBUG:boto:Data: 2023-12-15T22:56:37.501 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.501 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.501 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.501 DEBUG:boto:Params: {} 2023-12-15T22:56:37.501 DEBUG:boto:Token: None 2023-12-15T22:56:37.501 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.501 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.503 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001b9027b2bbfc70aa-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.549 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.550 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.550 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.550 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.550 DEBUG:boto:Method: GET 2023-12-15T22:56:37.550 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.550 DEBUG:boto:Data: 2023-12-15T22:56:37.550 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.550 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.550 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.550 DEBUG:boto:Params: {} 2023-12-15T22:56:37.550 DEBUG:boto:Token: None 2023-12-15T22:56:37.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060358d83b6e6dd70-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.553 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.553 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.554 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.554 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.554 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.554 DEBUG:boto:Method: GET 2023-12-15T22:56:37.554 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.554 DEBUG:boto:Data: 2023-12-15T22:56:37.554 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.554 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.554 DEBUG:boto:Params: {} 2023-12-15T22:56:37.554 DEBUG:boto:Token: None 2023-12-15T22:56:37.555 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.557 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000761556008d2edf02-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.597 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.598 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.598 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.598 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.598 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.598 DEBUG:boto:Method: GET 2023-12-15T22:56:37.598 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.598 DEBUG:boto:Data: 2023-12-15T22:56:37.598 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.598 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.598 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.598 DEBUG:boto:Params: {} 2023-12-15T22:56:37.599 DEBUG:boto:Token: None 2023-12-15T22:56:37.599 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0= 2023-12-15T22:56:37.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0=', 'Content-Length': '0'} 2023-12-15T22:56:37.601 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bc6c46bb5f813329-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.601 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.601 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.601 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.601 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.601 DEBUG:boto:Method: GET 2023-12-15T22:56:37.601 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.602 DEBUG:boto:Data: 2023-12-15T22:56:37.602 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.602 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.602 DEBUG:boto:Params: {} 2023-12-15T22:56:37.602 DEBUG:boto:Token: None 2023-12-15T22:56:37.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0= 2023-12-15T22:56:37.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0=', 'Content-Length': '0'} 2023-12-15T22:56:37.604 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008c18db14374ceb06-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.645 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.646 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.646 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.646 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.646 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.646 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.646 DEBUG:boto:Data: 2023-12-15T22:56:37.646 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.646 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.646 DEBUG:boto:Params: {} 2023-12-15T22:56:37.646 DEBUG:boto:Token: None 2023-12-15T22:56:37.646 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yuhRqsOnp0qEVXLK2SqZPpcuZ0= 2023-12-15T22:56:37.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yuhRqsOnp0qEVXLK2SqZPpcuZ0=', 'Content-Length': '0'} 2023-12-15T22:56:37.648 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000832181548cdff1f9-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.649 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.649 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.649 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.649 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.649 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.649 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.649 DEBUG:boto:Data: 2023-12-15T22:56:37.649 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.649 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.649 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.650 DEBUG:boto:Params: {} 2023-12-15T22:56:37.650 DEBUG:boto:Token: None 2023-12-15T22:56:37.650 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yuhRqsOnp0qEVXLK2SqZPpcuZ0= 2023-12-15T22:56:37.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yuhRqsOnp0qEVXLK2SqZPpcuZ0=', 'Content-Length': '0'} 2023-12-15T22:56:37.652 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cd515a20faa653a1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.652 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.652 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.653 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.653 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.653 DEBUG:boto:Method: GET 2023-12-15T22:56:37.653 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.653 DEBUG:boto:Data: 2023-12-15T22:56:37.653 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.653 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.653 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.653 DEBUG:boto:Params: {} 2023-12-15T22:56:37.653 DEBUG:boto:Token: None 2023-12-15T22:56:37.653 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0= 2023-12-15T22:56:37.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0=', 'Content-Length': '0'} 2023-12-15T22:56:37.655 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c607c550b83a9662-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.656 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.656 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.656 DEBUG:boto:path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.656 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.656 DEBUG:boto:Method: GET 2023-12-15T22:56:37.656 DEBUG:boto:Path: /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.656 DEBUG:boto:Data: 2023-12-15T22:56:37.656 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.656 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.656 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.656 DEBUG:boto:Params: {} 2023-12-15T22:56:37.657 DEBUG:boto:Token: None 2023-12-15T22:56:37.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=4M2M401HV1oeV5EtB.f8adCFTkSoiPn 2023-12-15T22:56:37.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0= 2023-12-15T22:56:37.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ukKBHn36YmFX9EyrJQBmjVzc8H0=', 'Content-Length': '0'} 2023-12-15T22:56:37.659 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '4M2M401HV1oeV5EtB.f8adCFTkSoiPn'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000088455b7961ddf4f1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.701 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.702 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.702 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.702 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.702 DEBUG:boto:Method: GET 2023-12-15T22:56:37.702 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.702 DEBUG:boto:Data: 2023-12-15T22:56:37.702 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.702 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.702 DEBUG:boto:Params: {} 2023-12-15T22:56:37.702 DEBUG:boto:Token: None 2023-12-15T22:56:37.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001164dff3a5c2aa60-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.705 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.706 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.706 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.706 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.706 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.706 DEBUG:boto:Method: GET 2023-12-15T22:56:37.706 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.706 DEBUG:boto:Data: 2023-12-15T22:56:37.706 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.706 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.706 DEBUG:boto:Params: {} 2023-12-15T22:56:37.707 DEBUG:boto:Token: None 2023-12-15T22:56:37.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf28a828afd0ba2f-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.753 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.754 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.754 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.754 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.754 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.754 DEBUG:boto:Data: 2023-12-15T22:56:37.754 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.754 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.754 DEBUG:boto:Params: {} 2023-12-15T22:56:37.754 DEBUG:boto:Token: None 2023-12-15T22:56:37.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.758 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005e06901609a2910c-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.758 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.758 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.758 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.758 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:37.759 DEBUG:boto:Data: 2023-12-15T22:56:37.759 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.759 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.759 DEBUG:boto:Params: {} 2023-12-15T22:56:37.759 DEBUG:boto:Token: None 2023-12-15T22:56:37.759 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj 2023-12-15T22:56:37.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0= 2023-12-15T22:56:37.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MbKUWyhDWee4OM9+B8J0FmZoTC0=', 'Content-Length': '0'} 2023-12-15T22:56:37.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002f7c8e17f6b80ef1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.763 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.763 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.763 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.763 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.763 DEBUG:boto:Method: GET 2023-12-15T22:56:37.763 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.763 DEBUG:boto:Data: 2023-12-15T22:56:37.763 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.764 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.764 DEBUG:boto:Params: {} 2023-12-15T22:56:37.764 DEBUG:boto:Token: None 2023-12-15T22:56:37.764 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.766 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006750168358ad3d14-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.813 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.814 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.814 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.814 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.814 DEBUG:boto:Method: GET 2023-12-15T22:56:37.814 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.814 DEBUG:boto:Data: 2023-12-15T22:56:37.814 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.814 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.814 DEBUG:boto:Params: {} 2023-12-15T22:56:37.814 DEBUG:boto:Token: None 2023-12-15T22:56:37.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:37.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU= 2023-12-15T22:56:37.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i5u5ldQdEf3KjcC4Y/fUJ/B/dpU=', 'Content-Length': '0'} 2023-12-15T22:56:37.817 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ae84c058e0cfe4ed-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.857 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.858 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.858 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.858 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.858 DEBUG:boto:Method: GET 2023-12-15T22:56:37.858 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.858 DEBUG:boto:Data: 2023-12-15T22:56:37.858 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.858 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.858 DEBUG:boto:Params: {} 2023-12-15T22:56:37.858 DEBUG:boto:Token: None 2023-12-15T22:56:37.858 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000921df6a191e0509a-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.861 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.861 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:37.862 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:37.862 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.862 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:37.862 DEBUG:boto:Method: GET 2023-12-15T22:56:37.862 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:37.862 DEBUG:boto:Data: 2023-12-15T22:56:37.862 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.862 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.862 DEBUG:boto:Params: {} 2023-12-15T22:56:37.862 DEBUG:boto:Token: None 2023-12-15T22:56:37.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/ 2023-12-15T22:56:37.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns= 2023-12-15T22:56:37.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QFFgJREOiG6PISW0KpTOFaSlqns=', 'Content-Length': '0'} 2023-12-15T22:56:37.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd4a7be5f4f1e58c-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.905 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:37.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.906 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.906 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.906 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.906 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.906 DEBUG:boto:Method: GET 2023-12-15T22:56:37.906 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.906 DEBUG:boto:Data: 2023-12-15T22:56:37.907 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.907 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.907 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.907 DEBUG:boto:Params: {} 2023-12-15T22:56:37.907 DEBUG:boto:Token: None 2023-12-15T22:56:37.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc= 2023-12-15T22:56:37.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc=', 'Content-Length': '0'} 2023-12-15T22:56:37.909 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ad835f91e1e4155f-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.910 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.910 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.910 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.910 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.910 DEBUG:boto:Method: GET 2023-12-15T22:56:37.910 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.910 DEBUG:boto:Data: 2023-12-15T22:56:37.910 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.910 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.910 DEBUG:boto:Params: {} 2023-12-15T22:56:37.911 DEBUG:boto:Token: None 2023-12-15T22:56:37.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc= 2023-12-15T22:56:37.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc=', 'Content-Length': '0'} 2023-12-15T22:56:37.913 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005b9944326834f2a6-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.953 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.954 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.954 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.954 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.954 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.954 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.954 DEBUG:boto:Data: 2023-12-15T22:56:37.954 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.955 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.955 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.955 DEBUG:boto:Params: {} 2023-12-15T22:56:37.955 DEBUG:boto:Token: None 2023-12-15T22:56:37.955 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iAoGoInKNYpqQKoYG/AROKzwM00= 2023-12-15T22:56:37.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iAoGoInKNYpqQKoYG/AROKzwM00=', 'Content-Length': '0'} 2023-12-15T22:56:37.957 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005cf0c2851123f105-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.957 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.957 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.957 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.957 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.957 DEBUG:boto:Method: HEAD 2023-12-15T22:56:37.957 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.957 DEBUG:boto:Data: 2023-12-15T22:56:37.957 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.958 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.958 DEBUG:boto:Params: {} 2023-12-15T22:56:37.958 DEBUG:boto:Token: None 2023-12-15T22:56:37.958 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iAoGoInKNYpqQKoYG/AROKzwM00= 2023-12-15T22:56:37.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iAoGoInKNYpqQKoYG/AROKzwM00=', 'Content-Length': '0'} 2023-12-15T22:56:37.960 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d95ac99ac96c073e-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.960 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:37.960 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.960 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.960 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.960 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.961 DEBUG:boto:Method: GET 2023-12-15T22:56:37.961 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.961 DEBUG:boto:Data: 2023-12-15T22:56:37.961 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.961 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:37.961 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.961 DEBUG:boto:Params: {} 2023-12-15T22:56:37.961 DEBUG:boto:Token: None 2023-12-15T22:56:37.961 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.961 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc= 2023-12-15T22:56:37.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc=', 'Content-Length': '0'} 2023-12-15T22:56:37.963 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000020b7481cbee21297-00657cd9a5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:37.964 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:37.964 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:37.964 DEBUG:boto:path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.964 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.964 DEBUG:boto:Method: GET 2023-12-15T22:56:37.964 DEBUG:boto:Path: /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.964 DEBUG:boto:Data: 2023-12-15T22:56:37.964 DEBUG:boto:Headers: {} 2023-12-15T22:56:37.964 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:37.964 DEBUG:boto:Port: 8000 2023-12-15T22:56:37.965 DEBUG:boto:Params: {} 2023-12-15T22:56:37.965 DEBUG:boto:Token: None 2023-12-15T22:56:37.965 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:37 GMT /kskgfn-13/obj?versionId=sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS 2023-12-15T22:56:37.965 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc= 2023-12-15T22:56:37.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZrBJAdo/pxwPXLkS17MJkBwxAZc=', 'Content-Length': '0'} 2023-12-15T22:56:37.967 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'sdCl7v0IZEVuMiXDPUH1T9ryWnmLRvS'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ce20c0e8583220a1-00657cd9a5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.013 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.014 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.014 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.014 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.014 DEBUG:boto:Method: GET 2023-12-15T22:56:38.014 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.014 DEBUG:boto:Data: 2023-12-15T22:56:38.014 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.014 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.014 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.014 DEBUG:boto:Params: {} 2023-12-15T22:56:38.014 DEBUG:boto:Token: None 2023-12-15T22:56:38.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000061a0a2716b92c2e-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.017 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.017 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.018 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.018 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.018 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.018 DEBUG:boto:Method: GET 2023-12-15T22:56:38.018 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.018 DEBUG:boto:Data: 2023-12-15T22:56:38.018 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.018 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.018 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.018 DEBUG:boto:Params: {} 2023-12-15T22:56:38.018 DEBUG:boto:Token: None 2023-12-15T22:56:38.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d389bb52a0ba50f-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.061 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.062 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.062 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.062 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.062 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:38.062 DEBUG:boto:Data: 2023-12-15T22:56:38.062 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.062 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.062 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.062 DEBUG:boto:Params: {} 2023-12-15T22:56:38.063 DEBUG:boto:Token: None 2023-12-15T22:56:38.063 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj 2023-12-15T22:56:38.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U= 2023-12-15T22:56:38.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U=', 'Content-Length': '0'} 2023-12-15T22:56:38.066 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004991267d8aa8aad5-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.066 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.066 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.066 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.067 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:38.067 DEBUG:boto:Data: 2023-12-15T22:56:38.067 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.067 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.067 DEBUG:boto:Params: {} 2023-12-15T22:56:38.067 DEBUG:boto:Token: None 2023-12-15T22:56:38.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj 2023-12-15T22:56:38.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U= 2023-12-15T22:56:38.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U=', 'Content-Length': '0'} 2023-12-15T22:56:38.071 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002d216704235f84be-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:38.071 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.071 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.072 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.072 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.072 DEBUG:boto:Method: GET 2023-12-15T22:56:38.072 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.072 DEBUG:boto:Data: 2023-12-15T22:56:38.072 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.072 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.072 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.072 DEBUG:boto:Params: {} 2023-12-15T22:56:38.072 DEBUG:boto:Token: None 2023-12-15T22:56:38.072 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg= 2023-12-15T22:56:38.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg=', 'Content-Length': '0'} 2023-12-15T22:56:38.075 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005192b1d5a569027b-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.075 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.075 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.075 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.075 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.076 DEBUG:boto:Method: GET 2023-12-15T22:56:38.076 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.076 DEBUG:boto:Data: 2023-12-15T22:56:38.076 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.076 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.076 DEBUG:boto:Params: {} 2023-12-15T22:56:38.076 DEBUG:boto:Token: None 2023-12-15T22:56:38.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg= 2023-12-15T22:56:38.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg=', 'Content-Length': '0'} 2023-12-15T22:56:38.079 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e3cec13026a323ae-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.122 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.122 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.122 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.122 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.122 DEBUG:boto:Method: GET 2023-12-15T22:56:38.122 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.122 DEBUG:boto:Data: 2023-12-15T22:56:38.122 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.122 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.123 DEBUG:boto:Params: {} 2023-12-15T22:56:38.123 DEBUG:boto:Token: None 2023-12-15T22:56:38.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3d1ae0f26b0b28f-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.125 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.126 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.126 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.126 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.126 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.126 DEBUG:boto:Method: GET 2023-12-15T22:56:38.126 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.126 DEBUG:boto:Data: 2023-12-15T22:56:38.126 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.126 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.126 DEBUG:boto:Params: {} 2023-12-15T22:56:38.126 DEBUG:boto:Token: None 2023-12-15T22:56:38.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060360d5278727aa1-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.169 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:38.170 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.170 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.170 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.170 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.170 DEBUG:boto:Method: GET 2023-12-15T22:56:38.170 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.170 DEBUG:boto:Data: 2023-12-15T22:56:38.170 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.170 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.170 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.171 DEBUG:boto:Params: {} 2023-12-15T22:56:38.171 DEBUG:boto:Token: None 2023-12-15T22:56:38.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU= 2023-12-15T22:56:38.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU=', 'Content-Length': '0'} 2023-12-15T22:56:38.173 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009fd433fd49f42f43-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.213 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.214 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.214 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.214 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.214 DEBUG:boto:Method: GET 2023-12-15T22:56:38.214 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.214 DEBUG:boto:Data: 2023-12-15T22:56:38.214 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.214 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.214 DEBUG:boto:Params: {} 2023-12-15T22:56:38.215 DEBUG:boto:Token: None 2023-12-15T22:56:38.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU= 2023-12-15T22:56:38.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU=', 'Content-Length': '0'} 2023-12-15T22:56:38.217 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008ecd3036c6fe72eb-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.217 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.218 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.218 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.218 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.218 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.218 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.218 DEBUG:boto:Data: 2023-12-15T22:56:38.219 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.219 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.219 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.219 DEBUG:boto:Params: {} 2023-12-15T22:56:38.219 DEBUG:boto:Token: None 2023-12-15T22:56:38.220 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.220 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5Yy3rwzl8YhCdUCpcnWHVyIfI4= 2023-12-15T22:56:38.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5Yy3rwzl8YhCdUCpcnWHVyIfI4=', 'Content-Length': '0'} 2023-12-15T22:56:38.223 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007cd01ca412d23d52-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.223 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.223 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.223 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.223 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.223 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.223 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.223 DEBUG:boto:Data: 2023-12-15T22:56:38.223 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.223 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.224 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.224 DEBUG:boto:Params: {} 2023-12-15T22:56:38.224 DEBUG:boto:Token: None 2023-12-15T22:56:38.224 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.224 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5Yy3rwzl8YhCdUCpcnWHVyIfI4= 2023-12-15T22:56:38.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5Yy3rwzl8YhCdUCpcnWHVyIfI4=', 'Content-Length': '0'} 2023-12-15T22:56:38.226 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003917baa6255fe57d-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.226 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:38.226 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.226 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.226 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.226 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.226 DEBUG:boto:Method: GET 2023-12-15T22:56:38.227 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.227 DEBUG:boto:Data: 2023-12-15T22:56:38.227 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.227 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.227 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.227 DEBUG:boto:Params: {} 2023-12-15T22:56:38.227 DEBUG:boto:Token: None 2023-12-15T22:56:38.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU= 2023-12-15T22:56:38.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU=', 'Content-Length': '0'} 2023-12-15T22:56:38.230 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ac52296ddaf601be-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.273 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.274 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.274 DEBUG:boto:path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.274 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.274 DEBUG:boto:Method: GET 2023-12-15T22:56:38.274 DEBUG:boto:Path: /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.274 DEBUG:boto:Data: 2023-12-15T22:56:38.274 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.274 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.274 DEBUG:boto:Params: {} 2023-12-15T22:56:38.274 DEBUG:boto:Token: None 2023-12-15T22:56:38.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i 2023-12-15T22:56:38.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU= 2023-12-15T22:56:38.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CzbhElPpdKjm145P61HddryZ6GU=', 'Content-Length': '0'} 2023-12-15T22:56:38.277 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', 'uuHiYqZpmhG6zE2w2.CDxlFgnkOeI-i'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000aca36e0d08913507-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.277 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.278 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.278 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.278 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.278 DEBUG:boto:Method: GET 2023-12-15T22:56:38.278 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.278 DEBUG:boto:Data: 2023-12-15T22:56:38.278 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.278 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.278 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.278 DEBUG:boto:Params: {} 2023-12-15T22:56:38.278 DEBUG:boto:Token: None 2023-12-15T22:56:38.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aea7a94c481bd5f4-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.281 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.282 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.282 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.282 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.282 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.282 DEBUG:boto:Method: GET 2023-12-15T22:56:38.282 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.282 DEBUG:boto:Data: 2023-12-15T22:56:38.282 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.282 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.282 DEBUG:boto:Params: {} 2023-12-15T22:56:38.283 DEBUG:boto:Token: None 2023-12-15T22:56:38.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026227433a76c9bcc-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.285 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.286 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.286 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.286 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.286 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:38.286 DEBUG:boto:Data: 2023-12-15T22:56:38.286 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.286 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.286 DEBUG:boto:Params: {} 2023-12-15T22:56:38.286 DEBUG:boto:Token: None 2023-12-15T22:56:38.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj 2023-12-15T22:56:38.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U= 2023-12-15T22:56:38.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U=', 'Content-Length': '0'} 2023-12-15T22:56:38.291 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002c2797e9862f1695-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.291 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.291 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.291 DEBUG:boto:Method: HEAD 2023-12-15T22:56:38.291 DEBUG:boto:Path: /kskgfn-13/obj 2023-12-15T22:56:38.291 DEBUG:boto:Data: 2023-12-15T22:56:38.291 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.291 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.292 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.292 DEBUG:boto:Params: {} 2023-12-15T22:56:38.292 DEBUG:boto:Token: None 2023-12-15T22:56:38.292 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj 2023-12-15T22:56:38.292 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U= 2023-12-15T22:56:38.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aLUfCSEZbLee4boQ+srIso7wM6U=', 'Content-Length': '0'} 2023-12-15T22:56:38.295 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000399187769c63cbbf-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:38.296 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.296 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.296 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.296 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.296 DEBUG:boto:Method: GET 2023-12-15T22:56:38.296 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.296 DEBUG:boto:Data: 2023-12-15T22:56:38.296 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.297 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.297 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.297 DEBUG:boto:Params: {} 2023-12-15T22:56:38.297 DEBUG:boto:Token: None 2023-12-15T22:56:38.297 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.297 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg= 2023-12-15T22:56:38.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg=', 'Content-Length': '0'} 2023-12-15T22:56:38.299 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000010a38b9bffb781cf-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.299 DEBUG:boto:path=/kskgfn-13/obj 2023-12-15T22:56:38.299 DEBUG:boto:auth_path=/kskgfn-13/obj 2023-12-15T22:56:38.300 DEBUG:boto:path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.300 DEBUG:boto:auth_path=/kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.300 DEBUG:boto:Method: GET 2023-12-15T22:56:38.300 DEBUG:boto:Path: /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.300 DEBUG:boto:Data: 2023-12-15T22:56:38.300 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.300 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.300 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.300 DEBUG:boto:Params: {} 2023-12-15T22:56:38.300 DEBUG:boto:Token: None 2023-12-15T22:56:38.300 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/obj?versionId=3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz 2023-12-15T22:56:38.301 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg= 2023-12-15T22:56:38.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rZ+84pBSXPBq2oJ+p6ecr1SwdBg=', 'Content-Length': '0'} 2023-12-15T22:56:38.303 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:22 GMT'), ('x-amz-version-id', '3QtoBH8LE69KTyCJsh6PJj5RqGMNUjz'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000027e00c15acf32ae9-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.346 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.346 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.346 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.346 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.346 DEBUG:boto:Method: GET 2023-12-15T22:56:38.346 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.346 DEBUG:boto:Data: 2023-12-15T22:56:38.346 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:38.346 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.346 DEBUG:boto:Params: {} 2023-12-15T22:56:38.346 DEBUG:boto:Token: None 2023-12-15T22:56:38.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a47e891c4cbfac02-00657cd9a6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.349 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.350 DEBUG:boto:path=/kskgfn-13/ 2023-12-15T22:56:38.350 DEBUG:boto:auth_path=/kskgfn-13/ 2023-12-15T22:56:38.350 DEBUG:boto:path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.350 DEBUG:boto:auth_path=/kskgfn-13/?prefix=obj 2023-12-15T22:56:38.350 DEBUG:boto:Method: GET 2023-12-15T22:56:38.350 DEBUG:boto:Path: /kskgfn-13/?prefix=obj 2023-12-15T22:56:38.350 DEBUG:boto:Data: 2023-12-15T22:56:38.350 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.351 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.351 DEBUG:boto:Params: {} 2023-12-15T22:56:38.351 DEBUG:boto:Token: None 2023-12-15T22:56:38.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-13/ 2023-12-15T22:56:38.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU= 2023-12-15T22:56:38.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euDWtP1JjtZWbFYuleFhXhzErU=', 'Content-Length': '0'} 2023-12-15T22:56:38.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000115a4e2cba1bb1cf-00657cd9a6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.393 DEBUG:boto:b'kskgfn-13obj1000falseobj2023-12-15T22:56:22.993Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:38.394 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-13 zones={test-zone2, test-zone1} 2023-12-15T22:56:38.394 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T22:56:38.394 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.394 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.447 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.447 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:38.503 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000002204","last_update":"2023-12-15T22:56:24.211436Z"},{"marker":"00000000000000000000:00000000000000000932","last_update":"2023-12-15T22:54:20.488953Z"},{"marker":"00000000000000000000:00000000000000000933","last_update":"2023-12-15T22:55:26.961460Z"},{"marker":"00000000000000000000:00000000000000001213","last_update":"2023-12-15T22:56:24.213334Z"}] 2023-12-15T22:56:38.503 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.503 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T22:56:38.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.504 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.558 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.558 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:38.607 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:20.488953Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.213334Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:56:38Z"} 2023-12-15T22:56:38.607 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:20.488953Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.213334Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:56:38Z"} 2023-12-15T22:56:38.607 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002204', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:24.211436Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000932', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:20.488953Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001213', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:24.213334Z'}}] 2023-12-15T22:56:38.607 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.607 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.608 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T22:56:38.608 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T22:56:38.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.608 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.654 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.654 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:38.702 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000001499","last_update":"2023-12-15T22:56:16.623627Z"},{"marker":"00000000000000000000:00000000000000000932","last_update":"2023-12-15T22:54:21.587221Z"},{"marker":"00000000000000000000:00000000000000001497","last_update":"2023-12-15T22:55:46.250275Z"},{"marker":"00000000000000000000:00000000000000001213","last_update":"2023-12-15T22:56:30.252628Z"}] 2023-12-15T22:56:38.715 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.715 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T22:56:38.715 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.715 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.768 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.768 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:38.817 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:21.587221Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:30.252628Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:56:38Z"} 2023-12-15T22:56:38.817 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:21.587221Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001213","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:30.252628Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:56:38Z"} 2023-12-15T22:56:38.817 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001499', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:16.623627Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000932', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:21.587221Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001497', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T22:55:46.250275Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001213', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:30.252628Z'}}] 2023-12-15T22:56:38.817 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.817 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000001213'} 2023-12-15T22:56:38.818 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T22:56:38.818 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2023-12-15T22:56:38.819 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:38.819 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:38.819 DEBUG:boto:Method: PUT 2023-12-15T22:56:38.819 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:56:38.819 DEBUG:boto:Data: 2023-12-15T22:56:38.819 DEBUG:boto:Headers: {} 2023-12-15T22:56:38.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:38.819 DEBUG:boto:Port: 8000 2023-12-15T22:56:38.819 DEBUG:boto:Params: {} 2023-12-15T22:56:38.820 DEBUG:boto:Token: None 2023-12-15T22:56:38.820 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:56:38 GMT /kskgfn-14/ 2023-12-15T22:56:38.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vxpfZlYdKBCLQIFEElPSSNJVMjs= 2023-12-15T22:56:38.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vxpfZlYdKBCLQIFEElPSSNJVMjs=', 'Content-Length': '0'} 2023-12-15T22:56:38.835 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000036e2f8bb02e452a6-00657cd9a6-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:38.835 DEBUG:rgw_multi.tests:created bucket=kskgfn-14 2023-12-15T22:56:38.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.835 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.881 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.881 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:38.910 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:56:38.924 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702680998.833875_61.1","last_update":"2023-12-15T22:56:38.833875Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:56:38.924 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702680998.833875_61.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:38.924 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:56:38.924 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:38.925 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:38.971 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:38.972 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:39.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:39.000+0000 7f3ff891f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:39.001+0000 7f3ff891f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:39.016 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680998.827214_58.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:38.827214Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:39Z"} 2023-12-15T22:56:39.016 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680998.827214_58.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:38.827214Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:39Z"} 2023-12-15T22:56:39.017 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680998.827214_58.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:56:38.827214Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:56:39.017 DEBUG:rgw_multi.tests:log_status={0: '1_1702680998.833875_61.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:39.017 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680998.827214_58.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:39.017 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702680998.833875_61.1 target=1_1702680998.827214_58.1 2023-12-15T22:56:44.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:44.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:44.018 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:44.071 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:44.071 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:44.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:44.103+0000 7f34a3331800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:44.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:44.104+0000 7f34a3331800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:44.119 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680998.833875_61.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:38.833875Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:44Z"} 2023-12-15T22:56:44.119 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702680998.833875_61.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:38.833875Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:44Z"} 2023-12-15T22:56:44.119 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702680998.833875_61.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:56:38.833875Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:56:44.120 DEBUG:rgw_multi.tests:log_status={0: '1_1702680998.833875_61.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:44.120 DEBUG:rgw_multi.tests:sync_status={0: '1_1702680998.833875_61.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:44.120 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:56:44.120 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:44.120 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:44.120 DEBUG:boto:Method: HEAD 2023-12-15T22:56:44.120 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:56:44.120 DEBUG:boto:Data: 2023-12-15T22:56:44.120 DEBUG:boto:Headers: {} 2023-12-15T22:56:44.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:44.121 DEBUG:boto:Port: 8000 2023-12-15T22:56:44.121 DEBUG:boto:Params: {} 2023-12-15T22:56:44.121 DEBUG:boto:Token: None 2023-12-15T22:56:44.121 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:44 GMT /kskgfn-14/ 2023-12-15T22:56:44.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HRC06Mag5vX0j740KcKmbg+hFHI= 2023-12-15T22:56:44.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HRC06Mag5vX0j740KcKmbg+hFHI=', 'Content-Length': '0'} 2023-12-15T22:56:44.124 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002736bfa559e58036-00657cd9ac-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:44.124 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:44.124 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:44.125 DEBUG:boto:Method: PUT 2023-12-15T22:56:44.125 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:44.125 DEBUG:boto:Data: 2023-12-15T22:56:44.125 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:56:44.125 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:44.125 DEBUG:boto:Port: 8000 2023-12-15T22:56:44.125 DEBUG:boto:Params: {} 2023-12-15T22:56:44.125 DEBUG:boto:Token: None 2023-12-15T22:56:44.125 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:56:44 GMT /kskgfn-14/obj 2023-12-15T22:56:44.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zq0Z1sXPo9O3HZOmg0m1KsGZcoc= 2023-12-15T22:56:44.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zq0Z1sXPo9O3HZOmg0m1KsGZcoc='} 2023-12-15T22:56:44.134 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000204280a1db0c7791-00657cd9ac-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:44.134 DEBUG:rgw_multi.tests:created initial version id=None 2023-12-15T22:56:44.134 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-14 2023-12-15T22:56:44.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:44.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:44.135 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:44.189 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:44.189 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:44.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:44.224+0000 7fd0eb433800 1 waiting to reach incremental sync.. 2023-12-15T22:56:49.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:49.226+0000 7fd0eb433800 1 bucket sync caught up with source: 2023-12-15T22:56:49.226 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.7.6, , ] 2023-12-15T22:56:49.227 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000001.7.6, , ] 2023-12-15T22:56:49.227 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:49.226+0000 7fd0eb433800 0 bucket checkpoint complete 2023-12-15T22:56:49.243 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-14 2023-12-15T22:56:49.243 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:49.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:49.244 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:49.305 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:49.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:49.346+0000 7f55bde85800 1 waiting to reach incremental sync.. 2023-12-15T22:56:54.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:54.347+0000 7f55bde85800 1 bucket sync caught up with source: 2023-12-15T22:56:54.348 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.29.6, , ] 2023-12-15T22:56:54.348 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000001.29.6, , ] 2023-12-15T22:56:54.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:56:54.347+0000 7f55bde85800 0 bucket checkpoint complete 2023-12-15T22:56:54.365 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:56:54.365 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.365 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.365 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.365 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:56:54.365 DEBUG:boto:Data: 2023-12-15T22:56:54.365 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.365 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.366 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.366 DEBUG:boto:Params: {} 2023-12-15T22:56:54.366 DEBUG:boto:Token: None 2023-12-15T22:56:54.366 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY= 2023-12-15T22:56:54.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY=', 'Content-Length': '0'} 2023-12-15T22:56:54.369 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b1bc28ffa9615bda-00657cd9b6-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.369 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.369 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.369 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.369 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:56:54.369 DEBUG:boto:Data: 2023-12-15T22:56:54.370 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.370 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.370 DEBUG:boto:Params: {} 2023-12-15T22:56:54.370 DEBUG:boto:Token: None 2023-12-15T22:56:54.370 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY= 2023-12-15T22:56:54.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY=', 'Content-Length': '0'} 2023-12-15T22:56:54.373 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ee467a9df1221237-00657cd9b6-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.373 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:56:54.373 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.373 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.373 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.373 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.373 DEBUG:boto:Method: GET 2023-12-15T22:56:54.373 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.374 DEBUG:boto:Data: 2023-12-15T22:56:54.374 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.374 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.374 DEBUG:boto:Params: {} 2023-12-15T22:56:54.374 DEBUG:boto:Token: None 2023-12-15T22:56:54.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/?versions 2023-12-15T22:56:54.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k= 2023-12-15T22:56:54.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k=', 'Content-Length': '0'} 2023-12-15T22:56:54.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be6ba1409ea3b04d-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.377 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:54.378 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:56:54.378 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.378 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.378 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.378 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.378 DEBUG:boto:Method: GET 2023-12-15T22:56:54.378 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.378 DEBUG:boto:Data: 2023-12-15T22:56:54.378 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.378 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.379 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.379 DEBUG:boto:Params: {} 2023-12-15T22:56:54.379 DEBUG:boto:Token: None 2023-12-15T22:56:54.379 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/?versions 2023-12-15T22:56:54.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k= 2023-12-15T22:56:54.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k=', 'Content-Length': '0'} 2023-12-15T22:56:54.381 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027c2e8d13b7aeb7e-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.381 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.382 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:56:54.382 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.382 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.382 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.382 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.382 DEBUG:boto:Method: GET 2023-12-15T22:56:54.382 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.382 DEBUG:boto:Data: 2023-12-15T22:56:54.382 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.383 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.383 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.383 DEBUG:boto:Params: {} 2023-12-15T22:56:54.383 DEBUG:boto:Token: None 2023-12-15T22:56:54.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/?versions 2023-12-15T22:56:54.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k= 2023-12-15T22:56:54.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k=', 'Content-Length': '0'} 2023-12-15T22:56:54.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a2093f919258a33-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.386 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.386 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.386 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.386 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.386 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.386 DEBUG:boto:Method: GET 2023-12-15T22:56:54.386 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:56:54.387 DEBUG:boto:Data: 2023-12-15T22:56:54.387 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.387 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.387 DEBUG:boto:Params: {} 2023-12-15T22:56:54.387 DEBUG:boto:Token: None 2023-12-15T22:56:54.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/?versions 2023-12-15T22:56:54.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k= 2023-12-15T22:56:54.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O7rmhhbUfe0XOMtW7Y0UodDWJ7k=', 'Content-Length': '0'} 2023-12-15T22:56:54.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cc3189205f92589-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.390 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:54.390 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.391 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.391 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.391 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.391 DEBUG:boto:Method: GET 2023-12-15T22:56:54.391 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.392 DEBUG:boto:Data: 2023-12-15T22:56:54.392 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.392 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.392 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.392 DEBUG:boto:Params: {} 2023-12-15T22:56:54.392 DEBUG:boto:Token: None 2023-12-15T22:56:54.393 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.393 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI= 2023-12-15T22:56:54.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI=', 'Content-Length': '0'} 2023-12-15T22:56:54.396 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000dfceffb39eb27c17-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.396 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.396 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.396 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.397 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.397 DEBUG:boto:Method: GET 2023-12-15T22:56:54.397 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.397 DEBUG:boto:Data: 2023-12-15T22:56:54.397 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.398 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.398 DEBUG:boto:Params: {} 2023-12-15T22:56:54.398 DEBUG:boto:Token: None 2023-12-15T22:56:54.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI= 2023-12-15T22:56:54.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI=', 'Content-Length': '0'} 2023-12-15T22:56:54.400 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000085aff803b0c9d02e-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.401 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.401 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.401 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.401 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.402 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.402 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.402 DEBUG:boto:Data: 2023-12-15T22:56:54.402 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.402 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.403 DEBUG:boto:Params: {} 2023-12-15T22:56:54.403 DEBUG:boto:Token: None 2023-12-15T22:56:54.403 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2PS8PTuodq+1Jwte/AA36/Y5Ydk= 2023-12-15T22:56:54.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2PS8PTuodq+1Jwte/AA36/Y5Ydk=', 'Content-Length': '0'} 2023-12-15T22:56:54.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a81fa6f14b964e4d-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.406 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.406 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.407 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.407 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.407 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.407 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.407 DEBUG:boto:Data: 2023-12-15T22:56:54.407 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.408 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.408 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.408 DEBUG:boto:Params: {} 2023-12-15T22:56:54.408 DEBUG:boto:Token: None 2023-12-15T22:56:54.408 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.409 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2PS8PTuodq+1Jwte/AA36/Y5Ydk= 2023-12-15T22:56:54.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2PS8PTuodq+1Jwte/AA36/Y5Ydk=', 'Content-Length': '0'} 2023-12-15T22:56:54.411 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e0ee787b0c997d69-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:54.412 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.412 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.412 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.412 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.412 DEBUG:boto:Method: GET 2023-12-15T22:56:54.413 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.413 DEBUG:boto:Data: 2023-12-15T22:56:54.413 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.413 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.413 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.414 DEBUG:boto:Params: {} 2023-12-15T22:56:54.414 DEBUG:boto:Token: None 2023-12-15T22:56:54.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI= 2023-12-15T22:56:54.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI=', 'Content-Length': '0'} 2023-12-15T22:56:54.417 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ccb8a7db2b48f8c8-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.418 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.418 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.418 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.418 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.419 DEBUG:boto:Method: GET 2023-12-15T22:56:54.419 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.419 DEBUG:boto:Data: 2023-12-15T22:56:54.420 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.420 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.420 DEBUG:boto:Params: {} 2023-12-15T22:56:54.420 DEBUG:boto:Token: None 2023-12-15T22:56:54.421 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:56:54.421 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI= 2023-12-15T22:56:54.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aCz3fgJO3dacSZK8Py82wK0jEI=', 'Content-Length': '0'} 2023-12-15T22:56:54.424 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000061995175ab0258d-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.424 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.425 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.425 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.425 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.426 DEBUG:boto:Method: GET 2023-12-15T22:56:54.426 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:56:54.426 DEBUG:boto:Data: 2023-12-15T22:56:54.426 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.427 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.427 DEBUG:boto:Params: {} 2023-12-15T22:56:54.427 DEBUG:boto:Token: None 2023-12-15T22:56:54.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA= 2023-12-15T22:56:54.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA=', 'Content-Length': '0'} 2023-12-15T22:56:54.431 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c10eca3a5fd6661-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.473 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.474 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.474 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.475 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.475 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.475 DEBUG:boto:Method: GET 2023-12-15T22:56:54.475 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:56:54.475 DEBUG:boto:Data: 2023-12-15T22:56:54.476 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.476 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.476 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.476 DEBUG:boto:Params: {} 2023-12-15T22:56:54.476 DEBUG:boto:Token: None 2023-12-15T22:56:54.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA= 2023-12-15T22:56:54.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA=', 'Content-Length': '0'} 2023-12-15T22:56:54.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000979fd6649eebcd9e-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.480 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.480 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.481 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.481 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.481 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:54.481 DEBUG:boto:Data: 2023-12-15T22:56:54.482 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.482 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.482 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.482 DEBUG:boto:Params: {} 2023-12-15T22:56:54.482 DEBUG:boto:Token: None 2023-12-15T22:56:54.483 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj 2023-12-15T22:56:54.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KxCgxOElnK1dzRqzr7Fzx6HRmzM= 2023-12-15T22:56:54.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KxCgxOElnK1dzRqzr7Fzx6HRmzM=', 'Content-Length': '0'} 2023-12-15T22:56:54.485 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ac2b4d7fed2fa4ca-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.486 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.486 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.486 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.486 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:54.486 DEBUG:boto:Data: 2023-12-15T22:56:54.487 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.487 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.487 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.487 DEBUG:boto:Params: {} 2023-12-15T22:56:54.487 DEBUG:boto:Token: None 2023-12-15T22:56:54.488 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj 2023-12-15T22:56:54.488 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KxCgxOElnK1dzRqzr7Fzx6HRmzM= 2023-12-15T22:56:54.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KxCgxOElnK1dzRqzr7Fzx6HRmzM=', 'Content-Length': '0'} 2023-12-15T22:56:54.490 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000094de2e40b9e70608-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:56:54.491 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.491 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.492 DEBUG:boto:Method: GET 2023-12-15T22:56:54.492 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:54.492 DEBUG:boto:Data: 2023-12-15T22:56:54.492 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.492 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.492 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.493 DEBUG:boto:Params: {} 2023-12-15T22:56:54.493 DEBUG:boto:Token: None 2023-12-15T22:56:54.493 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj 2023-12-15T22:56:54.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c3361zhrbpPu+Qs5VMtro4r4S/M= 2023-12-15T22:56:54.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c3361zhrbpPu+Qs5VMtro4r4S/M=', 'Content-Length': '0'} 2023-12-15T22:56:54.496 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009d4faaa83d5dfb1c-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.496 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.496 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.497 DEBUG:boto:Method: GET 2023-12-15T22:56:54.497 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:54.497 DEBUG:boto:Data: 2023-12-15T22:56:54.497 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.497 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.498 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.498 DEBUG:boto:Params: {} 2023-12-15T22:56:54.498 DEBUG:boto:Token: None 2023-12-15T22:56:54.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj 2023-12-15T22:56:54.498 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c3361zhrbpPu+Qs5VMtro4r4S/M= 2023-12-15T22:56:54.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c3361zhrbpPu+Qs5VMtro4r4S/M=', 'Content-Length': '0'} 2023-12-15T22:56:54.501 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001dee60b02262a4df-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.502 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.502 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.502 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.503 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.503 DEBUG:boto:Method: GET 2023-12-15T22:56:54.503 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:56:54.503 DEBUG:boto:Data: 2023-12-15T22:56:54.504 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.504 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:56:54.504 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.504 DEBUG:boto:Params: {} 2023-12-15T22:56:54.505 DEBUG:boto:Token: None 2023-12-15T22:56:54.505 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.505 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA= 2023-12-15T22:56:54.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA=', 'Content-Length': '0'} 2023-12-15T22:56:54.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb9ed32ee1fddc68-00657cd9b6-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.509 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.510 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.510 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.510 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.510 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:56:54.511 DEBUG:boto:Method: GET 2023-12-15T22:56:54.511 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:56:54.511 DEBUG:boto:Data: 2023-12-15T22:56:54.511 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.512 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.512 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.512 DEBUG:boto:Params: {} 2023-12-15T22:56:54.512 DEBUG:boto:Token: None 2023-12-15T22:56:54.513 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.513 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA= 2023-12-15T22:56:54.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mEqf0bwJN/rNP6cGGKsiPkaynIA=', 'Content-Length': '0'} 2023-12-15T22:56:54.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5d695f33ec66f21-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.516 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:56:54.517 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:56:54.517 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.518 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.518 DEBUG:boto:path=/kskgfn-14/?versioning 2023-12-15T22:56:54.518 DEBUG:boto:auth_path=/kskgfn-14/?versioning 2023-12-15T22:56:54.518 DEBUG:boto:Method: PUT 2023-12-15T22:56:54.519 DEBUG:boto:Path: /kskgfn-14/?versioning 2023-12-15T22:56:54.519 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:56:54.519 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.519 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.520 DEBUG:boto:Params: {} 2023-12-15T22:56:54.520 DEBUG:boto:Token: None 2023-12-15T22:56:54.520 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/?versioning 2023-12-15T22:56:54.520 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rJdrLmtViZVwmHhGOFIJu5ONbgc= 2023-12-15T22:56:54.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rJdrLmtViZVwmHhGOFIJu5ONbgc=', 'Content-Length': '228'} 2023-12-15T22:56:54.528 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007a4987a3f9abe715-00657cd9b6-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.528 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:54.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:54.529 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:54.582 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:54.582 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:54.615 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:56:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681014.527101_63.1","last_update":"2023-12-15T22:56:54.527101Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:56:54.631 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681014.527101_63.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:54.631 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:56:54.631 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:54.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:56:54.632 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:54.715 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:54.715+0000 7f5007726800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:54.716 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:54.717+0000 7f5007726800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:56:54.732 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681014.527101_63.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:54.527101Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:54Z"} 2023-12-15T22:56:54.733 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681014.527101_63.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:56:54.527101Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:56:54Z"} 2023-12-15T22:56:54.733 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681014.527101_63.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:56:54.527101Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:56:54.733 DEBUG:rgw_multi.tests:log_status={0: '1_1702681014.527101_63.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:54.734 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681014.527101_63.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:56:54.734 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:56:54.734 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:56:54.735 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:56:54.735 DEBUG:boto:Method: HEAD 2023-12-15T22:56:54.735 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:56:54.735 DEBUG:boto:Data: 2023-12-15T22:56:54.735 DEBUG:boto:Headers: {} 2023-12-15T22:56:54.736 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.736 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.736 DEBUG:boto:Params: {} 2023-12-15T22:56:54.736 DEBUG:boto:Token: None 2023-12-15T22:56:54.737 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/ 2023-12-15T22:56:54.737 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY= 2023-12-15T22:56:54.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qimoqYHzyHfViKJ2UhT0Sy8SByY=', 'Content-Length': '0'} 2023-12-15T22:56:54.739 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f8e81db13a4e3b42-00657cd9b6-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.740 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:56:54.740 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:56:54.740 DEBUG:boto:Method: PUT 2023-12-15T22:56:54.740 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:56:54.741 DEBUG:boto:Data: 2023-12-15T22:56:54.741 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:56:54.741 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:56:54.741 DEBUG:boto:Port: 8000 2023-12-15T22:56:54.741 DEBUG:boto:Params: {} 2023-12-15T22:56:54.742 DEBUG:boto:Token: None 2023-12-15T22:56:54.742 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:56:54 GMT /kskgfn-14/obj 2023-12-15T22:56:54.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6xisM39kPSaOjyBQwvLztNUWx64= 2023-12-15T22:56:54.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:56:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6xisM39kPSaOjyBQwvLztNUWx64='} 2023-12-15T22:56:54.753 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-amz-request-id', 'tx000003d602485707ba157-00657cd9b6-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:56:54.753 DEBUG:rgw_multi.tests:created new version id=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:56:54.754 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-14 2023-12-15T22:56:54.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:54.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:56:54.754 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:56:54.810 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:56:54.810 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:56:54.844 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:54.843+0000 7f1547937800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:54.844 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.7.6, , ] 2023-12-15T22:56:54.844 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:56:59.845 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:56:59.844+0000 7f1547937800 1 waiting for incremental sync to catch up: 2023-12-15T22:56:59.845 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.7.6, , ] 2023-12-15T22:56:59.845 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:04.846 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:04.846+0000 7f1547937800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:04.846 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.7.6, , ] 2023-12-15T22:57:04.846 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:09.847 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:09.847+0000 7f1547937800 1 bucket sync caught up with source: 2023-12-15T22:57:09.848 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:09.848 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:09.848 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:09.847+0000 7f1547937800 0 bucket checkpoint complete 2023-12-15T22:57:09.864 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-14 2023-12-15T22:57:09.865 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:09.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:09.865 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:09.927 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:09.927 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:09.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:09.969+0000 7fad8dd29800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:09.969 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.29.6, , ] 2023-12-15T22:57:09.969 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000003.33.13, , ] 2023-12-15T22:57:14.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:14.970+0000 7fad8dd29800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:14.971 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.29.6, , ] 2023-12-15T22:57:14.971 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000003.33.13, , ] 2023-12-15T22:57:19.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:19.971+0000 7fad8dd29800 1 bucket sync caught up with source: 2023-12-15T22:57:19.972 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000003.33.13, , ] 2023-12-15T22:57:19.972 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000003.33.13, , ] 2023-12-15T22:57:19.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:19.971+0000 7fad8dd29800 0 bucket checkpoint complete 2023-12-15T22:57:19.989 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:57:19.989 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:19.989 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:19.990 DEBUG:boto:Method: HEAD 2023-12-15T22:57:19.990 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:57:19.990 DEBUG:boto:Data: 2023-12-15T22:57:19.990 DEBUG:boto:Headers: {} 2023-12-15T22:57:19.990 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:19.990 DEBUG:boto:Port: 8000 2023-12-15T22:57:19.990 DEBUG:boto:Params: {} 2023-12-15T22:57:19.990 DEBUG:boto:Token: None 2023-12-15T22:57:19.990 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:19 GMT /kskgfn-14/ 2023-12-15T22:57:19.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atEDszGh3UTMP1VYL5ltq7plxN0= 2023-12-15T22:57:19.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atEDszGh3UTMP1VYL5ltq7plxN0=', 'Content-Length': '0'} 2023-12-15T22:57:19.993 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b11bb75960d88f3a-00657cd9cf-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:19.993 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:19.993 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:19.993 DEBUG:boto:Method: HEAD 2023-12-15T22:57:19.994 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:57:19.994 DEBUG:boto:Data: 2023-12-15T22:57:19.994 DEBUG:boto:Headers: {} 2023-12-15T22:57:19.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:19.994 DEBUG:boto:Port: 8000 2023-12-15T22:57:19.994 DEBUG:boto:Params: {} 2023-12-15T22:57:19.994 DEBUG:boto:Token: None 2023-12-15T22:57:19.994 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:19 GMT /kskgfn-14/ 2023-12-15T22:57:19.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atEDszGh3UTMP1VYL5ltq7plxN0= 2023-12-15T22:57:19.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atEDszGh3UTMP1VYL5ltq7plxN0=', 'Content-Length': '0'} 2023-12-15T22:57:19.996 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f44c001c020a28d0-00657cd9cf-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:19.997 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:57:19.997 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:19.997 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:19.997 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:19.997 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:19.997 DEBUG:boto:Method: GET 2023-12-15T22:57:19.997 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:19.997 DEBUG:boto:Data: 2023-12-15T22:57:19.997 DEBUG:boto:Headers: {} 2023-12-15T22:57:19.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:19.998 DEBUG:boto:Port: 8000 2023-12-15T22:57:19.998 DEBUG:boto:Params: {} 2023-12-15T22:57:19.998 DEBUG:boto:Token: None 2023-12-15T22:57:19.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:19 GMT /kskgfn-14/?versions 2023-12-15T22:57:19.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HtwfMsUL/jlmkASpn5N2np+6BB8= 2023-12-15T22:57:19.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HtwfMsUL/jlmkASpn5N2np+6BB8=', 'Content-Length': '0'} 2023-12-15T22:57:20.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a846da8ee66914b-00657cd9cf-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.001 DEBUG:boto:b'kskgfn-14999falseobj1CK1hxayp-1o8iMimaikIR7EPLxhJoatrue2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.001 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:20.001 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:20.001 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:57:20.002 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.002 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.002 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.002 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.002 DEBUG:boto:Method: GET 2023-12-15T22:57:20.002 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.002 DEBUG:boto:Data: 2023-12-15T22:57:20.002 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.002 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.002 DEBUG:boto:Params: {} 2023-12-15T22:57:20.003 DEBUG:boto:Token: None 2023-12-15T22:57:20.003 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/?versions 2023-12-15T22:57:20.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E= 2023-12-15T22:57:20.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E=', 'Content-Length': '0'} 2023-12-15T22:57:20.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4a6b32325de0b51-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.005 DEBUG:boto:b'kskgfn-14999falseobj1CK1hxayp-1o8iMimaikIR7EPLxhJoatrue2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:20.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:20.006 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.006 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.006 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.006 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.006 DEBUG:boto:Method: GET 2023-12-15T22:57:20.006 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.006 DEBUG:boto:Data: 2023-12-15T22:57:20.007 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.007 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.007 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.007 DEBUG:boto:Params: {} 2023-12-15T22:57:20.007 DEBUG:boto:Token: None 2023-12-15T22:57:20.007 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/?versions 2023-12-15T22:57:20.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E= 2023-12-15T22:57:20.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E=', 'Content-Length': '0'} 2023-12-15T22:57:20.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4a013fa00816a51-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.010 DEBUG:boto:b'kskgfn-14999falseobj1CK1hxayp-1o8iMimaikIR7EPLxhJoatrue2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.010 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.010 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.010 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.010 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.010 DEBUG:boto:Method: GET 2023-12-15T22:57:20.010 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:20.010 DEBUG:boto:Data: 2023-12-15T22:57:20.011 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.011 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.011 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.011 DEBUG:boto:Params: {} 2023-12-15T22:57:20.011 DEBUG:boto:Token: None 2023-12-15T22:57:20.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/?versions 2023-12-15T22:57:20.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E= 2023-12-15T22:57:20.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9rKJ77+UFSFupwke9Abq8b3R40E=', 'Content-Length': '0'} 2023-12-15T22:57:20.013 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c83fd67c8d4dd8e-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.014 DEBUG:boto:b'kskgfn-14999falseobj1CK1hxayp-1o8iMimaikIR7EPLxhJoatrue2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobjnullfalse2023-12-15T22:56:44.129Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.014 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.014 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.014 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.015 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.015 DEBUG:boto:Method: GET 2023-12-15T22:57:20.015 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.015 DEBUG:boto:Data: 2023-12-15T22:57:20.015 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.015 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.015 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.015 DEBUG:boto:Params: {} 2023-12-15T22:57:20.015 DEBUG:boto:Token: None 2023-12-15T22:57:20.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.016 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.018 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000080506cb6bee31f69-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.018 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.018 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.018 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.018 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.018 DEBUG:boto:Method: GET 2023-12-15T22:57:20.018 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.018 DEBUG:boto:Data: 2023-12-15T22:57:20.018 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.019 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.019 DEBUG:boto:Params: {} 2023-12-15T22:57:20.019 DEBUG:boto:Token: None 2023-12-15T22:57:20.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.021 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b3c649906ef8fadc-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.021 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.021 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.021 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.021 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.021 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.021 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.022 DEBUG:boto:Data: 2023-12-15T22:57:20.022 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.022 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.022 DEBUG:boto:Params: {} 2023-12-15T22:57:20.022 DEBUG:boto:Token: None 2023-12-15T22:57:20.022 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jL4Nu7gC8gAgTAjyH4UUnfGBR1E= 2023-12-15T22:57:20.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jL4Nu7gC8gAgTAjyH4UUnfGBR1E=', 'Content-Length': '0'} 2023-12-15T22:57:20.024 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000079ab2f67c4bfb11b-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.024 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.024 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.024 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.025 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.025 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.025 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.025 DEBUG:boto:Data: 2023-12-15T22:57:20.025 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.025 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.025 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.025 DEBUG:boto:Params: {} 2023-12-15T22:57:20.025 DEBUG:boto:Token: None 2023-12-15T22:57:20.025 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jL4Nu7gC8gAgTAjyH4UUnfGBR1E= 2023-12-15T22:57:20.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jL4Nu7gC8gAgTAjyH4UUnfGBR1E=', 'Content-Length': '0'} 2023-12-15T22:57:20.027 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b0af1e06aefec3cc-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.028 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.028 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.028 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.028 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.028 DEBUG:boto:Method: GET 2023-12-15T22:57:20.028 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.028 DEBUG:boto:Data: 2023-12-15T22:57:20.028 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.028 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.028 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.029 DEBUG:boto:Params: {} 2023-12-15T22:57:20.029 DEBUG:boto:Token: None 2023-12-15T22:57:20.029 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.029 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.031 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004a059649c1866044-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.031 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.031 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.031 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.031 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.032 DEBUG:boto:Method: GET 2023-12-15T22:57:20.032 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.032 DEBUG:boto:Data: 2023-12-15T22:57:20.032 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.032 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.032 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.032 DEBUG:boto:Params: {} 2023-12-15T22:57:20.032 DEBUG:boto:Token: None 2023-12-15T22:57:20.032 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.032 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.034 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000149f0b1b58a89f40-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.034 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.035 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.035 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.035 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.035 DEBUG:boto:Method: GET 2023-12-15T22:57:20.035 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.035 DEBUG:boto:Data: 2023-12-15T22:57:20.035 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.035 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.035 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.035 DEBUG:boto:Params: {} 2023-12-15T22:57:20.036 DEBUG:boto:Token: None 2023-12-15T22:57:20.036 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.036 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.038 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000802e07041ae7622d-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.081 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.082 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.082 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.082 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.082 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.082 DEBUG:boto:Method: GET 2023-12-15T22:57:20.082 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.082 DEBUG:boto:Data: 2023-12-15T22:57:20.082 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.083 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.083 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.083 DEBUG:boto:Params: {} 2023-12-15T22:57:20.083 DEBUG:boto:Token: None 2023-12-15T22:57:20.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a98f045ab2944cc5-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.086 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.086 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.086 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.086 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.086 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:20.086 DEBUG:boto:Data: 2023-12-15T22:57:20.086 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.087 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.087 DEBUG:boto:Params: {} 2023-12-15T22:57:20.087 DEBUG:boto:Token: None 2023-12-15T22:57:20.087 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj 2023-12-15T22:57:20.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA= 2023-12-15T22:57:20.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA=', 'Content-Length': '0'} 2023-12-15T22:57:20.089 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e084b9155116f780-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.090 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.090 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.090 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.090 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:20.090 DEBUG:boto:Data: 2023-12-15T22:57:20.090 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.090 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.090 DEBUG:boto:Params: {} 2023-12-15T22:57:20.091 DEBUG:boto:Token: None 2023-12-15T22:57:20.091 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj 2023-12-15T22:57:20.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA= 2023-12-15T22:57:20.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA=', 'Content-Length': '0'} 2023-12-15T22:57:20.093 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002dfc6c1b764a04ea-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.093 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.093 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.094 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.094 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.094 DEBUG:boto:Method: GET 2023-12-15T22:57:20.094 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.094 DEBUG:boto:Data: 2023-12-15T22:57:20.094 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.094 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.094 DEBUG:boto:Params: {} 2023-12-15T22:57:20.094 DEBUG:boto:Token: None 2023-12-15T22:57:20.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.096 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000099dc9413d98b7325-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.097 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.097 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.097 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.097 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.097 DEBUG:boto:Method: GET 2023-12-15T22:57:20.097 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.097 DEBUG:boto:Data: 2023-12-15T22:57:20.097 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.098 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.098 DEBUG:boto:Params: {} 2023-12-15T22:57:20.098 DEBUG:boto:Token: None 2023-12-15T22:57:20.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.100 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000092f600885d64633e-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.101 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.101 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.101 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.101 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.101 DEBUG:boto:Method: GET 2023-12-15T22:57:20.101 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.101 DEBUG:boto:Data: 2023-12-15T22:57:20.101 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.101 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.101 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.101 DEBUG:boto:Params: {} 2023-12-15T22:57:20.102 DEBUG:boto:Token: None 2023-12-15T22:57:20.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcd5f61612ca7b7c-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.104 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.105 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.105 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.105 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.105 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.105 DEBUG:boto:Method: GET 2023-12-15T22:57:20.105 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.105 DEBUG:boto:Data: 2023-12-15T22:57:20.105 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.105 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.106 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.106 DEBUG:boto:Params: {} 2023-12-15T22:57:20.106 DEBUG:boto:Token: None 2023-12-15T22:57:20.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.108 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000044d16f43107c497-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.108 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.109 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.109 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.109 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.109 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.109 DEBUG:boto:Method: GET 2023-12-15T22:57:20.109 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.109 DEBUG:boto:Data: 2023-12-15T22:57:20.110 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.110 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.110 DEBUG:boto:Params: {} 2023-12-15T22:57:20.110 DEBUG:boto:Token: None 2023-12-15T22:57:20.110 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ= 2023-12-15T22:57:20.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ=', 'Content-Length': '0'} 2023-12-15T22:57:20.112 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fee096af9a0b7673-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.113 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.113 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.113 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.113 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.113 DEBUG:boto:Method: GET 2023-12-15T22:57:20.113 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.113 DEBUG:boto:Data: 2023-12-15T22:57:20.113 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.114 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.114 DEBUG:boto:Params: {} 2023-12-15T22:57:20.114 DEBUG:boto:Token: None 2023-12-15T22:57:20.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ= 2023-12-15T22:57:20.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ=', 'Content-Length': '0'} 2023-12-15T22:57:20.116 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000967a746c28fb92c-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.116 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.116 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.116 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.117 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.117 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.117 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.117 DEBUG:boto:Data: 2023-12-15T22:57:20.117 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.117 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.117 DEBUG:boto:Params: {} 2023-12-15T22:57:20.117 DEBUG:boto:Token: None 2023-12-15T22:57:20.117 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tk6FTVZPxp2ga2Eq+hWapvdimOM= 2023-12-15T22:57:20.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tk6FTVZPxp2ga2Eq+hWapvdimOM=', 'Content-Length': '0'} 2023-12-15T22:57:20.120 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ad9fe72503837efa-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.120 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.120 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.120 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.120 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.120 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.120 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.120 DEBUG:boto:Data: 2023-12-15T22:57:20.120 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.121 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.121 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.121 DEBUG:boto:Params: {} 2023-12-15T22:57:20.121 DEBUG:boto:Token: None 2023-12-15T22:57:20.121 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tk6FTVZPxp2ga2Eq+hWapvdimOM= 2023-12-15T22:57:20.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tk6FTVZPxp2ga2Eq+hWapvdimOM=', 'Content-Length': '0'} 2023-12-15T22:57:20.123 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000003bf6d190a2999b8-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.124 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.124 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.124 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.124 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.124 DEBUG:boto:Method: GET 2023-12-15T22:57:20.124 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.124 DEBUG:boto:Data: 2023-12-15T22:57:20.124 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.124 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.124 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.124 DEBUG:boto:Params: {} 2023-12-15T22:57:20.125 DEBUG:boto:Token: None 2023-12-15T22:57:20.125 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ= 2023-12-15T22:57:20.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ=', 'Content-Length': '0'} 2023-12-15T22:57:20.127 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fbf7372ed6b6d52c-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.127 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.127 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.127 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.128 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.128 DEBUG:boto:Method: GET 2023-12-15T22:57:20.128 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.128 DEBUG:boto:Data: 2023-12-15T22:57:20.128 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.128 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.128 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.128 DEBUG:boto:Params: {} 2023-12-15T22:57:20.128 DEBUG:boto:Token: None 2023-12-15T22:57:20.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:20.129 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ= 2023-12-15T22:57:20.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NSdZymjRRTQQWDkLyRbag93DaGQ=', 'Content-Length': '0'} 2023-12-15T22:57:20.131 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:44 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000086c429a556058cd-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.131 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.131 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.131 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.131 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.131 DEBUG:boto:Method: GET 2023-12-15T22:57:20.131 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.131 DEBUG:boto:Data: 2023-12-15T22:57:20.132 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.132 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.132 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.132 DEBUG:boto:Params: {} 2023-12-15T22:57:20.132 DEBUG:boto:Token: None 2023-12-15T22:57:20.132 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.132 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1f486d8d1b36d93-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.135 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.135 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.135 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.135 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.135 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.135 DEBUG:boto:Method: GET 2023-12-15T22:57:20.135 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.135 DEBUG:boto:Data: 2023-12-15T22:57:20.136 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.136 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.136 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.136 DEBUG:boto:Params: {} 2023-12-15T22:57:20.136 DEBUG:boto:Token: None 2023-12-15T22:57:20.136 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.138 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d71dd1be70ff001-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.138 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.139 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.139 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.139 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.139 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:20.139 DEBUG:boto:Data: 2023-12-15T22:57:20.139 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.139 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.139 DEBUG:boto:Params: {} 2023-12-15T22:57:20.140 DEBUG:boto:Token: None 2023-12-15T22:57:20.140 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj 2023-12-15T22:57:20.140 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA= 2023-12-15T22:57:20.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA=', 'Content-Length': '0'} 2023-12-15T22:57:20.142 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fb11c558ab236a65-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.142 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.142 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.142 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.143 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:20.143 DEBUG:boto:Data: 2023-12-15T22:57:20.143 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.143 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.143 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.143 DEBUG:boto:Params: {} 2023-12-15T22:57:20.143 DEBUG:boto:Token: None 2023-12-15T22:57:20.143 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj 2023-12-15T22:57:20.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA= 2023-12-15T22:57:20.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b8lk+75STfvDpmPM3Mjh6GA5gkA=', 'Content-Length': '0'} 2023-12-15T22:57:20.145 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007dd8866fad63f5b4-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.146 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:20.146 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.146 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.146 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.146 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.146 DEBUG:boto:Method: GET 2023-12-15T22:57:20.146 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.146 DEBUG:boto:Data: 2023-12-15T22:57:20.147 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.147 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.147 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.147 DEBUG:boto:Params: {} 2023-12-15T22:57:20.147 DEBUG:boto:Token: None 2023-12-15T22:57:20.147 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.149 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000079ecdb6af2c0f33c-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.149 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.149 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.149 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.149 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.150 DEBUG:boto:Method: GET 2023-12-15T22:57:20.150 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.150 DEBUG:boto:Data: 2023-12-15T22:57:20.150 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.150 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.150 DEBUG:boto:Params: {} 2023-12-15T22:57:20.150 DEBUG:boto:Token: None 2023-12-15T22:57:20.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:20.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I= 2023-12-15T22:57:20.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5euYUup7nKkp+JMHgrIk2vui/5I=', 'Content-Length': '0'} 2023-12-15T22:57:20.152 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000071afbe754b44eb52-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.152 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.153 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.153 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.153 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.153 DEBUG:boto:Method: GET 2023-12-15T22:57:20.153 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.153 DEBUG:boto:Data: 2023-12-15T22:57:20.153 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.153 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:20.153 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.153 DEBUG:boto:Params: {} 2023-12-15T22:57:20.154 DEBUG:boto:Token: None 2023-12-15T22:57:20.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c42656e8d1917264-00657cd9d0-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.197 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.198 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.198 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.198 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.198 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:20.198 DEBUG:boto:Method: GET 2023-12-15T22:57:20.198 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:20.198 DEBUG:boto:Data: 2023-12-15T22:57:20.198 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.198 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.199 DEBUG:boto:Params: {} 2023-12-15T22:57:20.199 DEBUG:boto:Token: None 2023-12-15T22:57:20.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI= 2023-12-15T22:57:20.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WP+BkfmFx9DdmFod0AhywH6IPJI=', 'Content-Length': '0'} 2023-12-15T22:57:20.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000245563a9b2af340f-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.202 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:20.202 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:57:20.202 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.202 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.202 DEBUG:boto:path=/kskgfn-14/?versioning 2023-12-15T22:57:20.202 DEBUG:boto:auth_path=/kskgfn-14/?versioning 2023-12-15T22:57:20.202 DEBUG:boto:Method: PUT 2023-12-15T22:57:20.202 DEBUG:boto:Path: /kskgfn-14/?versioning 2023-12-15T22:57:20.203 DEBUG:boto:Data: Suspended Disabled 2023-12-15T22:57:20.203 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.203 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.203 DEBUG:boto:Params: {} 2023-12-15T22:57:20.203 DEBUG:boto:Token: None 2023-12-15T22:57:20.203 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/?versioning 2023-12-15T22:57:20.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VOJ/P0uVfzv4VFbtKWRtKMhkonA= 2023-12-15T22:57:20.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VOJ/P0uVfzv4VFbtKWRtKMhkonA=', 'Content-Length': '230'} 2023-12-15T22:57:20.211 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003bfcbd37abe31b04-00657cd9d0-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.211 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:20.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:20.211 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:20.293 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681040.210963_65.1","last_update":"2023-12-15T22:57:20.210963Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:57:20.309 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681040.210963_65.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:20.309 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:57:20.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:20.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:20.309 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:20.363 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:20.364 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:20.395 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:20.395+0000 7f031828c800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:20.396 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:20.396+0000 7f031828c800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:20.411 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681040.210963_65.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:20.210963Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:20Z"} 2023-12-15T22:57:20.412 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681040.210963_65.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:20.210963Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:20Z"} 2023-12-15T22:57:20.412 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681040.210963_65.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:57:20.210963Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:57:20.412 DEBUG:rgw_multi.tests:log_status={0: '1_1702681040.210963_65.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:20.412 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681040.210963_65.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:20.412 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:57:20.412 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:20.412 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:20.412 DEBUG:boto:Method: HEAD 2023-12-15T22:57:20.413 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:57:20.413 DEBUG:boto:Data: 2023-12-15T22:57:20.413 DEBUG:boto:Headers: {} 2023-12-15T22:57:20.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.413 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.413 DEBUG:boto:Params: {} 2023-12-15T22:57:20.413 DEBUG:boto:Token: None 2023-12-15T22:57:20.413 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/ 2023-12-15T22:57:20.413 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:skf2lIqVaOj99WkGIpaBrnbI2EQ= 2023-12-15T22:57:20.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:skf2lIqVaOj99WkGIpaBrnbI2EQ=', 'Content-Length': '0'} 2023-12-15T22:57:20.416 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c23c86e69e8a49da-00657cd9d0-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.416 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:20.416 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:20.416 DEBUG:boto:Method: PUT 2023-12-15T22:57:20.417 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:20.417 DEBUG:boto:Data: 2023-12-15T22:57:20.417 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:57:20.417 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:20.417 DEBUG:boto:Port: 8000 2023-12-15T22:57:20.417 DEBUG:boto:Params: {} 2023-12-15T22:57:20.417 DEBUG:boto:Token: None 2023-12-15T22:57:20.417 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:57:20 GMT /kskgfn-14/obj 2023-12-15T22:57:20.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jGBPTGXdgQWoCKltLA+EcLsVkXg= 2023-12-15T22:57:20.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:57:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jGBPTGXdgQWoCKltLA+EcLsVkXg='} 2023-12-15T22:57:20.431 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a74ea2b61a00e369-00657cd9d0-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:20.431 DEBUG:rgw_multi.tests:created null version id=None 2023-12-15T22:57:20.431 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-14 2023-12-15T22:57:20.431 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:20.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:20.432 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:20.486 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:20.486 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:20.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:20.521+0000 7f412d6e4800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:20.521 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:20.521 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000005.14.18, , ] 2023-12-15T22:57:25.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:25.522+0000 7f412d6e4800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:25.523 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:25.523 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000005.14.18, , ] 2023-12-15T22:57:30.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:30.524+0000 7f412d6e4800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:30.524 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.10.13, , ] 2023-12-15T22:57:30.524 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000005.14.18, , ] 2023-12-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:35.525+0000 7f412d6e4800 1 bucket sync caught up with source: 2023-12-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000005.14.18, , ] 2023-12-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000005.14.18, , ] 2023-12-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:35.525+0000 7f412d6e4800 0 bucket checkpoint complete 2023-12-15T22:57:35.543 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-14 2023-12-15T22:57:35.544 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:35.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:35.544 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:35.606 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:35.606 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:35.644+0000 7f26a2d3a800 1 waiting for incremental sync to catch up: 2023-12-15T22:57:35.644 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000003.33.13, , ] 2023-12-15T22:57:35.645 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000005.38.18, , ] 2023-12-15T22:57:40.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:40.645+0000 7f26a2d3a800 1 bucket sync caught up with source: 2023-12-15T22:57:41.019 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000005.38.18, , ] 2023-12-15T22:57:41.019 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000005.38.18, , ] 2023-12-15T22:57:41.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:40.645+0000 7f26a2d3a800 0 bucket checkpoint complete 2023-12-15T22:57:41.021 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:57:41.021 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.021 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.021 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.021 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:57:41.021 DEBUG:boto:Data: 2023-12-15T22:57:41.021 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.022 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.022 DEBUG:boto:Params: {} 2023-12-15T22:57:41.022 DEBUG:boto:Token: None 2023-12-15T22:57:41.022 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whh15656+VzQBHCca2wmm/4BuoE= 2023-12-15T22:57:41.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whh15656+VzQBHCca2wmm/4BuoE=', 'Content-Length': '0'} 2023-12-15T22:57:41.025 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b05d2064a2a73ef-00657cd9e5-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.025 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.026 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.026 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.026 DEBUG:boto:Path: /kskgfn-14/ 2023-12-15T22:57:41.026 DEBUG:boto:Data: 2023-12-15T22:57:41.026 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.026 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.026 DEBUG:boto:Params: {} 2023-12-15T22:57:41.027 DEBUG:boto:Token: None 2023-12-15T22:57:41.027 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whh15656+VzQBHCca2wmm/4BuoE= 2023-12-15T22:57:41.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whh15656+VzQBHCca2wmm/4BuoE=', 'Content-Length': '0'} 2023-12-15T22:57:41.029 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a9c665f9999c93b-00657cd9e5-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.029 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:57:41.030 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.030 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.030 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.030 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.030 DEBUG:boto:Method: GET 2023-12-15T22:57:41.030 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.030 DEBUG:boto:Data: 2023-12-15T22:57:41.030 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.031 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.031 DEBUG:boto:Params: {} 2023-12-15T22:57:41.031 DEBUG:boto:Token: None 2023-12-15T22:57:41.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/?versions 2023-12-15T22:57:41.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE= 2023-12-15T22:57:41.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE=', 'Content-Length': '0'} 2023-12-15T22:57:41.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5863caca9dd9d57-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.034 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1CK1hxayp-1o8iMimaikIR7EPLxhJoafalse2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.035 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:41.035 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:41.035 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:57:41.035 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.035 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.035 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.035 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.036 DEBUG:boto:Method: GET 2023-12-15T22:57:41.036 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.036 DEBUG:boto:Data: 2023-12-15T22:57:41.036 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.036 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.036 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.036 DEBUG:boto:Params: {} 2023-12-15T22:57:41.036 DEBUG:boto:Token: None 2023-12-15T22:57:41.036 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/?versions 2023-12-15T22:57:41.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE= 2023-12-15T22:57:41.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE=', 'Content-Length': '0'} 2023-12-15T22:57:41.039 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d34f94eace4f473-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.040 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1CK1hxayp-1o8iMimaikIR7EPLxhJoafalse2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.041 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:41.041 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:41.041 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.041 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.041 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.041 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.041 DEBUG:boto:Method: GET 2023-12-15T22:57:41.041 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.042 DEBUG:boto:Data: 2023-12-15T22:57:41.042 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.042 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.042 DEBUG:boto:Params: {} 2023-12-15T22:57:41.042 DEBUG:boto:Token: None 2023-12-15T22:57:41.042 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/?versions 2023-12-15T22:57:41.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE= 2023-12-15T22:57:41.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE=', 'Content-Length': '0'} 2023-12-15T22:57:41.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085bda96cb687d396-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.045 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1CK1hxayp-1o8iMimaikIR7EPLxhJoafalse2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.045 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.045 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.045 DEBUG:boto:path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.046 DEBUG:boto:auth_path=/kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.046 DEBUG:boto:Method: GET 2023-12-15T22:57:41.046 DEBUG:boto:Path: /kskgfn-14/?versions&max-keys=999 2023-12-15T22:57:41.046 DEBUG:boto:Data: 2023-12-15T22:57:41.046 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.046 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.046 DEBUG:boto:Params: {} 2023-12-15T22:57:41.047 DEBUG:boto:Token: None 2023-12-15T22:57:41.047 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/?versions 2023-12-15T22:57:41.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE= 2023-12-15T22:57:41.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mm6w6ODBySzN9z2cr14rZG/86WE=', 'Content-Length': '0'} 2023-12-15T22:57:41.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e87713f2a1a49c2e-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.049 DEBUG:boto:b'kskgfn-14999falseobjnulltrue2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1CK1hxayp-1o8iMimaikIR7EPLxhJoafalse2023-12-15T22:56:54.745Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.050 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.050 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.050 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.050 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.050 DEBUG:boto:Method: GET 2023-12-15T22:57:41.050 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.050 DEBUG:boto:Data: 2023-12-15T22:57:41.051 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.051 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.051 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.051 DEBUG:boto:Params: {} 2023-12-15T22:57:41.051 DEBUG:boto:Token: None 2023-12-15T22:57:41.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks= 2023-12-15T22:57:41.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks=', 'Content-Length': '0'} 2023-12-15T22:57:41.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000eb63075ab767333d-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.054 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.054 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.054 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.054 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.055 DEBUG:boto:Method: GET 2023-12-15T22:57:41.055 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.055 DEBUG:boto:Data: 2023-12-15T22:57:41.055 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.055 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.055 DEBUG:boto:Params: {} 2023-12-15T22:57:41.055 DEBUG:boto:Token: None 2023-12-15T22:57:41.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.056 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks= 2023-12-15T22:57:41.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks=', 'Content-Length': '0'} 2023-12-15T22:57:41.058 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008aeed4abdfdfd7c5-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.058 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.058 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.058 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.059 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.059 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.059 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.059 DEBUG:boto:Data: 2023-12-15T22:57:41.059 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.059 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.059 DEBUG:boto:Params: {} 2023-12-15T22:57:41.059 DEBUG:boto:Token: None 2023-12-15T22:57:41.059 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o6vSmSgZfycU0mSnq6IxUbqfXGY= 2023-12-15T22:57:41.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o6vSmSgZfycU0mSnq6IxUbqfXGY=', 'Content-Length': '0'} 2023-12-15T22:57:41.061 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009f84718862641a1f-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.062 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.062 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.062 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.062 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.062 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.062 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.062 DEBUG:boto:Data: 2023-12-15T22:57:41.062 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.063 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.063 DEBUG:boto:Params: {} 2023-12-15T22:57:41.063 DEBUG:boto:Token: None 2023-12-15T22:57:41.063 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o6vSmSgZfycU0mSnq6IxUbqfXGY= 2023-12-15T22:57:41.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o6vSmSgZfycU0mSnq6IxUbqfXGY=', 'Content-Length': '0'} 2023-12-15T22:57:41.065 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007393de62938c6ec4-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.066 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.066 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.066 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.066 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.066 DEBUG:boto:Method: GET 2023-12-15T22:57:41.066 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.067 DEBUG:boto:Data: 2023-12-15T22:57:41.067 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.067 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.067 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.067 DEBUG:boto:Params: {} 2023-12-15T22:57:41.067 DEBUG:boto:Token: None 2023-12-15T22:57:41.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks= 2023-12-15T22:57:41.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks=', 'Content-Length': '0'} 2023-12-15T22:57:41.069 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000006a1a9a12488b3fd-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.069 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.069 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.069 DEBUG:boto:path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.070 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.070 DEBUG:boto:Method: GET 2023-12-15T22:57:41.070 DEBUG:boto:Path: /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.070 DEBUG:boto:Data: 2023-12-15T22:57:41.070 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.070 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.070 DEBUG:boto:Params: {} 2023-12-15T22:57:41.070 DEBUG:boto:Token: None 2023-12-15T22:57:41.070 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=null 2023-12-15T22:57:41.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks= 2023-12-15T22:57:41.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sl+3aSLEHYs/hyRU7qyBjzBc7Ks=', 'Content-Length': '0'} 2023-12-15T22:57:41.073 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bdbaed71ff8cc8c1-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.073 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.073 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.073 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.073 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.073 DEBUG:boto:Method: GET 2023-12-15T22:57:41.074 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.074 DEBUG:boto:Data: 2023-12-15T22:57:41.074 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.074 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.074 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.074 DEBUG:boto:Params: {} 2023-12-15T22:57:41.074 DEBUG:boto:Token: None 2023-12-15T22:57:41.074 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.077 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016059d843d3aae0a-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.121 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.122 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.122 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.122 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.122 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.122 DEBUG:boto:Method: GET 2023-12-15T22:57:41.123 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.123 DEBUG:boto:Data: 2023-12-15T22:57:41.123 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.123 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.123 DEBUG:boto:Params: {} 2023-12-15T22:57:41.123 DEBUG:boto:Token: None 2023-12-15T22:57:41.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f8adb4ccc5c7f52-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.126 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.126 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.126 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.126 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.127 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.127 DEBUG:boto:Data: 2023-12-15T22:57:41.127 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.127 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.127 DEBUG:boto:Params: {} 2023-12-15T22:57:41.127 DEBUG:boto:Token: None 2023-12-15T22:57:41.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU= 2023-12-15T22:57:41.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU=', 'Content-Length': '0'} 2023-12-15T22:57:41.129 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000704d662211a4a743-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.130 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.130 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.130 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.130 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.130 DEBUG:boto:Data: 2023-12-15T22:57:41.130 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.130 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.130 DEBUG:boto:Params: {} 2023-12-15T22:57:41.131 DEBUG:boto:Token: None 2023-12-15T22:57:41.131 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU= 2023-12-15T22:57:41.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU=', 'Content-Length': '0'} 2023-12-15T22:57:41.133 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c5bd64b09348c7d6-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.133 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.133 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.133 DEBUG:boto:Method: GET 2023-12-15T22:57:41.133 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.134 DEBUG:boto:Data: 2023-12-15T22:57:41.134 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.134 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.134 DEBUG:boto:Params: {} 2023-12-15T22:57:41.134 DEBUG:boto:Token: None 2023-12-15T22:57:41.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0= 2023-12-15T22:57:41.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0=', 'Content-Length': '0'} 2023-12-15T22:57:41.136 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000009599e230fd3ea5b-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.137 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.137 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.137 DEBUG:boto:Method: GET 2023-12-15T22:57:41.137 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.137 DEBUG:boto:Data: 2023-12-15T22:57:41.137 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.137 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.137 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.137 DEBUG:boto:Params: {} 2023-12-15T22:57:41.137 DEBUG:boto:Token: None 2023-12-15T22:57:41.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0= 2023-12-15T22:57:41.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0=', 'Content-Length': '0'} 2023-12-15T22:57:41.139 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007ab1d5d677d65999-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.140 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.140 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.140 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.140 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.140 DEBUG:boto:Method: GET 2023-12-15T22:57:41.140 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.140 DEBUG:boto:Data: 2023-12-15T22:57:41.140 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.141 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.141 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.141 DEBUG:boto:Params: {} 2023-12-15T22:57:41.141 DEBUG:boto:Token: None 2023-12-15T22:57:41.141 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.141 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.144 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b15c5f9589a33a4-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.144 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.144 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.144 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.144 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.144 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.145 DEBUG:boto:Method: GET 2023-12-15T22:57:41.145 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.145 DEBUG:boto:Data: 2023-12-15T22:57:41.145 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.145 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.145 DEBUG:boto:Params: {} 2023-12-15T22:57:41.145 DEBUG:boto:Token: None 2023-12-15T22:57:41.145 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.145 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd40006674b76070-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.148 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.148 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.148 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.148 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.148 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.148 DEBUG:boto:Method: GET 2023-12-15T22:57:41.149 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.149 DEBUG:boto:Data: 2023-12-15T22:57:41.149 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.149 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.149 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.149 DEBUG:boto:Params: {} 2023-12-15T22:57:41.149 DEBUG:boto:Token: None 2023-12-15T22:57:41.149 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.149 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk= 2023-12-15T22:57:41.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk=', 'Content-Length': '0'} 2023-12-15T22:57:41.151 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d41ccc3a8cd86278-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.151 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.151 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.151 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.152 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.152 DEBUG:boto:Method: GET 2023-12-15T22:57:41.152 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.152 DEBUG:boto:Data: 2023-12-15T22:57:41.152 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.152 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.152 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.152 DEBUG:boto:Params: {} 2023-12-15T22:57:41.152 DEBUG:boto:Token: None 2023-12-15T22:57:41.152 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.152 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk= 2023-12-15T22:57:41.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk=', 'Content-Length': '0'} 2023-12-15T22:57:41.154 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003eb65f077359124a-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.154 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.154 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.155 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.155 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.155 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.155 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.155 DEBUG:boto:Data: 2023-12-15T22:57:41.155 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.155 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.155 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.155 DEBUG:boto:Params: {} 2023-12-15T22:57:41.155 DEBUG:boto:Token: None 2023-12-15T22:57:41.156 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.156 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q0liKN55tkj3zisBQKot05nORK8= 2023-12-15T22:57:41.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q0liKN55tkj3zisBQKot05nORK8=', 'Content-Length': '0'} 2023-12-15T22:57:41.157 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006078fe72cd2fcfcb-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.158 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.158 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.158 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.158 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.158 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.158 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.158 DEBUG:boto:Data: 2023-12-15T22:57:41.158 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.159 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.159 DEBUG:boto:Params: {} 2023-12-15T22:57:41.159 DEBUG:boto:Token: None 2023-12-15T22:57:41.159 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q0liKN55tkj3zisBQKot05nORK8= 2023-12-15T22:57:41.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q0liKN55tkj3zisBQKot05nORK8=', 'Content-Length': '0'} 2023-12-15T22:57:41.161 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000078fed65c615d1097-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.161 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.161 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.161 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.161 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.162 DEBUG:boto:Method: GET 2023-12-15T22:57:41.162 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.162 DEBUG:boto:Data: 2023-12-15T22:57:41.162 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.162 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.162 DEBUG:boto:Params: {} 2023-12-15T22:57:41.162 DEBUG:boto:Token: None 2023-12-15T22:57:41.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk= 2023-12-15T22:57:41.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk=', 'Content-Length': '0'} 2023-12-15T22:57:41.164 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000969b97472765b732-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.164 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.165 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.165 DEBUG:boto:path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.165 DEBUG:boto:auth_path=/kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.165 DEBUG:boto:Method: GET 2023-12-15T22:57:41.165 DEBUG:boto:Path: /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.165 DEBUG:boto:Data: 2023-12-15T22:57:41.165 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.165 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.165 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.165 DEBUG:boto:Params: {} 2023-12-15T22:57:41.165 DEBUG:boto:Token: None 2023-12-15T22:57:41.166 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj?versionId=1CK1hxayp-1o8iMimaikIR7EPLxhJoa 2023-12-15T22:57:41.166 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk= 2023-12-15T22:57:41.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gO3ZXmC3BiI3AQDAl6IcgY2Cwvk=', 'Content-Length': '0'} 2023-12-15T22:57:41.167 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:56:54 GMT'), ('x-amz-version-id', '1CK1hxayp-1o8iMimaikIR7EPLxhJoa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000015373f14e740527b-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.168 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.168 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.168 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.168 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.168 DEBUG:boto:Method: GET 2023-12-15T22:57:41.168 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.168 DEBUG:boto:Data: 2023-12-15T22:57:41.168 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.168 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.169 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.169 DEBUG:boto:Params: {} 2023-12-15T22:57:41.169 DEBUG:boto:Token: None 2023-12-15T22:57:41.169 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.169 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.171 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c15d5acdaa76bebb-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.213 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.214 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.214 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.214 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.214 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.214 DEBUG:boto:Method: GET 2023-12-15T22:57:41.215 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.215 DEBUG:boto:Data: 2023-12-15T22:57:41.215 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.215 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.215 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.215 DEBUG:boto:Params: {} 2023-12-15T22:57:41.215 DEBUG:boto:Token: None 2023-12-15T22:57:41.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096abab076626acc2-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.218 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.218 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.218 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.219 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.219 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.219 DEBUG:boto:Data: 2023-12-15T22:57:41.219 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.219 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.219 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.219 DEBUG:boto:Params: {} 2023-12-15T22:57:41.219 DEBUG:boto:Token: None 2023-12-15T22:57:41.219 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU= 2023-12-15T22:57:41.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU=', 'Content-Length': '0'} 2023-12-15T22:57:41.221 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d70739da5ab4f5b6-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.222 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.222 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.222 DEBUG:boto:Method: HEAD 2023-12-15T22:57:41.222 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.222 DEBUG:boto:Data: 2023-12-15T22:57:41.222 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.222 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.222 DEBUG:boto:Params: {} 2023-12-15T22:57:41.223 DEBUG:boto:Token: None 2023-12-15T22:57:41.223 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU= 2023-12-15T22:57:41.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SeS9i0R3DX11PRQDQGwlDj1y8RU=', 'Content-Length': '0'} 2023-12-15T22:57:41.225 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000eee2c8839a2d07ae-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.225 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:41.225 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.225 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.225 DEBUG:boto:Method: GET 2023-12-15T22:57:41.225 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.226 DEBUG:boto:Data: 2023-12-15T22:57:41.226 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.226 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.226 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.226 DEBUG:boto:Params: {} 2023-12-15T22:57:41.226 DEBUG:boto:Token: None 2023-12-15T22:57:41.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0= 2023-12-15T22:57:41.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0=', 'Content-Length': '0'} 2023-12-15T22:57:41.228 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ab0e7586d854caac-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.229 DEBUG:boto:path=/kskgfn-14/obj 2023-12-15T22:57:41.229 DEBUG:boto:auth_path=/kskgfn-14/obj 2023-12-15T22:57:41.229 DEBUG:boto:Method: GET 2023-12-15T22:57:41.229 DEBUG:boto:Path: /kskgfn-14/obj 2023-12-15T22:57:41.229 DEBUG:boto:Data: 2023-12-15T22:57:41.229 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.229 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.229 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.230 DEBUG:boto:Params: {} 2023-12-15T22:57:41.230 DEBUG:boto:Token: None 2023-12-15T22:57:41.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/obj 2023-12-15T22:57:41.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0= 2023-12-15T22:57:41.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/iTAx38HDfhCUN5X9r8Q8mKkqe0=', 'Content-Length': '0'} 2023-12-15T22:57:41.232 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000803a2a54547b8759-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.232 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.232 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.232 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.232 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.233 DEBUG:boto:Method: GET 2023-12-15T22:57:41.233 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.233 DEBUG:boto:Data: 2023-12-15T22:57:41.233 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.233 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.233 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.233 DEBUG:boto:Params: {} 2023-12-15T22:57:41.233 DEBUG:boto:Token: None 2023-12-15T22:57:41.233 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.235 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfb453bef0fe6829-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.236 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.236 DEBUG:boto:path=/kskgfn-14/ 2023-12-15T22:57:41.236 DEBUG:boto:auth_path=/kskgfn-14/ 2023-12-15T22:57:41.236 DEBUG:boto:path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.236 DEBUG:boto:auth_path=/kskgfn-14/?prefix=obj 2023-12-15T22:57:41.236 DEBUG:boto:Method: GET 2023-12-15T22:57:41.236 DEBUG:boto:Path: /kskgfn-14/?prefix=obj 2023-12-15T22:57:41.237 DEBUG:boto:Data: 2023-12-15T22:57:41.237 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.237 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.237 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.237 DEBUG:boto:Params: {} 2023-12-15T22:57:41.237 DEBUG:boto:Token: None 2023-12-15T22:57:41.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-14/ 2023-12-15T22:57:41.237 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s= 2023-12-15T22:57:41.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDrNhVADp4GshJvKv9OiClbBz3s=', 'Content-Length': '0'} 2023-12-15T22:57:41.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d77dbfd62387a508-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.281 DEBUG:boto:b'kskgfn-14obj1000falseobj2023-12-15T22:57:20.420Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:41.282 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-14 zones={test-zone2, test-zone1} 2023-12-15T22:57:41.282 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2023-12-15T22:57:41.283 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-15 2023-12-15T22:57:41.283 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:41.283 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:41.283 DEBUG:boto:Method: PUT 2023-12-15T22:57:41.283 DEBUG:boto:Path: /kskgfn-15/ 2023-12-15T22:57:41.284 DEBUG:boto:Data: 2023-12-15T22:57:41.284 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.284 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.284 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.284 DEBUG:boto:Params: {} 2023-12-15T22:57:41.284 DEBUG:boto:Token: None 2023-12-15T22:57:41.284 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-15/ 2023-12-15T22:57:41.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+TsIHRREkPXAq5Dk0T2gYKNrYLY= 2023-12-15T22:57:41.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+TsIHRREkPXAq5Dk0T2gYKNrYLY=', 'Content-Length': '0'} 2023-12-15T22:57:41.303 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a4ec30a2892becd4-00657cd9e5-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.303 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-16 2023-12-15T22:57:41.303 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:41.303 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:41.303 DEBUG:boto:Method: PUT 2023-12-15T22:57:41.304 DEBUG:boto:Path: /kskgfn-16/ 2023-12-15T22:57:41.304 DEBUG:boto:Data: 2023-12-15T22:57:41.304 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.304 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.304 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.304 DEBUG:boto:Params: {} 2023-12-15T22:57:41.304 DEBUG:boto:Token: None 2023-12-15T22:57:41.304 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-16/ 2023-12-15T22:57:41.304 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qU3Wr/Qdi2ykWeNrTC3/1I+AJV0= 2023-12-15T22:57:41.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qU3Wr/Qdi2ykWeNrTC3/1I+AJV0=', 'Content-Length': '0'} 2023-12-15T22:57:41.334 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fb2fa0387ac50d9e-00657cd9e5-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.334 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:41.334 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:41.334 DEBUG:boto:path=/kskgfn-15/?versioning 2023-12-15T22:57:41.334 DEBUG:boto:auth_path=/kskgfn-15/?versioning 2023-12-15T22:57:41.334 DEBUG:boto:Method: PUT 2023-12-15T22:57:41.334 DEBUG:boto:Path: /kskgfn-15/?versioning 2023-12-15T22:57:41.334 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:57:41.335 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.335 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:41.335 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.335 DEBUG:boto:Params: {} 2023-12-15T22:57:41.335 DEBUG:boto:Token: None 2023-12-15T22:57:41.335 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-15/?versioning 2023-12-15T22:57:41.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xqgbkeb91A5KYxouKW5Dhg2Uj+8= 2023-12-15T22:57:41.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xqgbkeb91A5KYxouKW5Dhg2Uj+8=', 'Content-Length': '228'} 2023-12-15T22:57:41.341 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004d11a38ecdccc9fc-00657cd9e5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.341 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:41.342 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:41.342 DEBUG:boto:path=/kskgfn-16/?versioning 2023-12-15T22:57:41.342 DEBUG:boto:auth_path=/kskgfn-16/?versioning 2023-12-15T22:57:41.342 DEBUG:boto:Method: PUT 2023-12-15T22:57:41.342 DEBUG:boto:Path: /kskgfn-16/?versioning 2023-12-15T22:57:41.342 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:57:41.342 DEBUG:boto:Headers: {} 2023-12-15T22:57:41.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:41.342 DEBUG:boto:Port: 8000 2023-12-15T22:57:41.342 DEBUG:boto:Params: {} 2023-12-15T22:57:41.342 DEBUG:boto:Token: None 2023-12-15T22:57:41.343 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:41 GMT /kskgfn-16/?versioning 2023-12-15T22:57:41.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:111kPYB/lwdn9sFAzzBUyGxQQFg= 2023-12-15T22:57:41.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:111kPYB/lwdn9sFAzzBUyGxQQFg=', 'Content-Length': '228'} 2023-12-15T22:57:41.353 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c058643b54da7fd6-00657cd9e5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:41.353 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:41.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:41.354 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:41.407 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:41.407 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:41.443 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:57:41.459 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681061.350275_77.1","last_update":"2023-12-15T22:57:41.350275Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:57:41.459 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681061.350275_77.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:41.460 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:57:41.460 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:41.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:41.460 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:41.512 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:41.513 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:41.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:41.544+0000 7f59f55da800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:41.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:41.545+0000 7f59f55da800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:41.559 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681061.293309_66.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:41.293309Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:41Z"} 2023-12-15T22:57:41.559 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681061.293309_66.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:41.293309Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:41Z"} 2023-12-15T22:57:41.560 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681061.293309_66.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:57:41.293309Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:57:41.560 DEBUG:rgw_multi.tests:log_status={0: '1_1702681061.350275_77.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:41.560 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681061.293309_66.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:41.560 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681061.350275_77.1 target=1_1702681061.293309_66.1 2023-12-15T22:57:46.561 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:46.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:46.562 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:46.613 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:46.643 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:46.643+0000 7fba8100f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:46.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:46.645+0000 7fba8100f800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:46.659 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681061.350275_77.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:41.350275Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:46Z"} 2023-12-15T22:57:46.660 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681061.350275_77.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:41.350275Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:46Z"} 2023-12-15T22:57:46.660 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681061.350275_77.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:57:41.350275Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:57:46.660 DEBUG:rgw_multi.tests:log_status={0: '1_1702681061.350275_77.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:46.660 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681061.350275_77.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:46.660 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:57:46.660 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:46.661 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:46.661 DEBUG:boto:Method: HEAD 2023-12-15T22:57:46.661 DEBUG:boto:Path: /kskgfn-15/ 2023-12-15T22:57:46.661 DEBUG:boto:Data: 2023-12-15T22:57:46.661 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.661 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:46.661 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.661 DEBUG:boto:Params: {} 2023-12-15T22:57:46.661 DEBUG:boto:Token: None 2023-12-15T22:57:46.662 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-15/ 2023-12-15T22:57:46.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bLJVm7ogq6va6jZKuwhqZN8tY0c= 2023-12-15T22:57:46.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bLJVm7ogq6va6jZKuwhqZN8tY0c=', 'Content-Length': '0'} 2023-12-15T22:57:46.664 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d79ee704a429c41b-00657cd9ea-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.665 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:46.665 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:46.665 DEBUG:boto:Method: PUT 2023-12-15T22:57:46.665 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:46.665 DEBUG:boto:Data: 2023-12-15T22:57:46.665 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:57:46.665 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:46.665 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.666 DEBUG:boto:Params: {} 2023-12-15T22:57:46.666 DEBUG:boto:Token: None 2023-12-15T22:57:46.666 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-15/obj 2023-12-15T22:57:46.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AStDSgRWWtuWsR2LZxBFThzNY7U= 2023-12-15T22:57:46.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AStDSgRWWtuWsR2LZxBFThzNY7U='} 2023-12-15T22:57:46.681 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-amz-request-id', 'tx00000a1602d2cdced8714-00657cd9ea-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.681 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:46.681 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:46.681 DEBUG:boto:Method: HEAD 2023-12-15T22:57:46.681 DEBUG:boto:Path: /kskgfn-15/ 2023-12-15T22:57:46.682 DEBUG:boto:Data: 2023-12-15T22:57:46.682 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:46.682 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.682 DEBUG:boto:Params: {} 2023-12-15T22:57:46.682 DEBUG:boto:Token: None 2023-12-15T22:57:46.682 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-15/ 2023-12-15T22:57:46.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bLJVm7ogq6va6jZKuwhqZN8tY0c= 2023-12-15T22:57:46.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bLJVm7ogq6va6jZKuwhqZN8tY0c=', 'Content-Length': '0'} 2023-12-15T22:57:46.684 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006f86e4e344204ee7-00657cd9ea-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.684 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:46.685 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:46.685 DEBUG:boto:Method: DELETE 2023-12-15T22:57:46.685 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:46.685 DEBUG:boto:Data: 2023-12-15T22:57:46.685 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.685 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:46.685 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.685 DEBUG:boto:Params: {} 2023-12-15T22:57:46.685 DEBUG:boto:Token: None 2023-12-15T22:57:46.686 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-15/obj 2023-12-15T22:57:46.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c9N6t5TCJef4lT+hn9b/JvXl8ng= 2023-12-15T22:57:46.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c9N6t5TCJef4lT+hn9b/JvXl8ng=', 'Content-Length': '0'} 2023-12-15T22:57:46.694 DEBUG:boto:Response headers: [('x-amz-version-id', '9ibhYTBQ5S6uFvSvInCuhWuWmW.HtUm'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx000007b7e04e6aef166b0-00657cd9ea-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.695 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:46.695 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:46.695 DEBUG:boto:Method: HEAD 2023-12-15T22:57:46.695 DEBUG:boto:Path: /kskgfn-16/ 2023-12-15T22:57:46.695 DEBUG:boto:Data: 2023-12-15T22:57:46.695 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:46.695 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.695 DEBUG:boto:Params: {} 2023-12-15T22:57:46.695 DEBUG:boto:Token: None 2023-12-15T22:57:46.696 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-16/ 2023-12-15T22:57:46.696 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1/m1FX7OJWaWiV8M75zB1/3fVV8= 2023-12-15T22:57:46.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1/m1FX7OJWaWiV8M75zB1/3fVV8=', 'Content-Length': '0'} 2023-12-15T22:57:46.698 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000011fc359d42576c20-00657cd9ea-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.699 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:46.699 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:46.699 DEBUG:boto:Method: PUT 2023-12-15T22:57:46.699 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:46.699 DEBUG:boto:Data: 2023-12-15T22:57:46.699 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:57:46.699 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:46.699 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.700 DEBUG:boto:Params: {} 2023-12-15T22:57:46.700 DEBUG:boto:Token: None 2023-12-15T22:57:46.700 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-16/obj 2023-12-15T22:57:46.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gY+2L7HAot/pbwpKDaVrKf3lQoA= 2023-12-15T22:57:46.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gY+2L7HAot/pbwpKDaVrKf3lQoA='} 2023-12-15T22:57:46.713 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-amz-request-id', 'tx000007a901d44aca48ae8-00657cd9ea-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.713 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:46.713 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:46.714 DEBUG:boto:Method: HEAD 2023-12-15T22:57:46.714 DEBUG:boto:Path: /kskgfn-16/ 2023-12-15T22:57:46.714 DEBUG:boto:Data: 2023-12-15T22:57:46.714 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:46.714 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.714 DEBUG:boto:Params: {} 2023-12-15T22:57:46.714 DEBUG:boto:Token: None 2023-12-15T22:57:46.714 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-16/ 2023-12-15T22:57:46.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1/m1FX7OJWaWiV8M75zB1/3fVV8= 2023-12-15T22:57:46.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1/m1FX7OJWaWiV8M75zB1/3fVV8=', 'Content-Length': '0'} 2023-12-15T22:57:46.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e70705b160116e3-00657cd9ea-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.717 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:46.717 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:46.717 DEBUG:boto:Method: DELETE 2023-12-15T22:57:46.717 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:46.717 DEBUG:boto:Data: 2023-12-15T22:57:46.718 DEBUG:boto:Headers: {} 2023-12-15T22:57:46.718 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:46.718 DEBUG:boto:Port: 8000 2023-12-15T22:57:46.718 DEBUG:boto:Params: {} 2023-12-15T22:57:46.718 DEBUG:boto:Token: None 2023-12-15T22:57:46.718 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:57:46 GMT /kskgfn-16/obj 2023-12-15T22:57:46.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dHtPEawf5TcYJSUJshCT1b2y4/0= 2023-12-15T22:57:46.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dHtPEawf5TcYJSUJshCT1b2y4/0=', 'Content-Length': '0'} 2023-12-15T22:57:46.726 DEBUG:boto:Response headers: [('x-amz-version-id', 'mnxOptw2vEwDTctg2kOimt0P9do49IN'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx0000038e6bc86052bce65-00657cd9ea-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:46.726 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-15 2023-12-15T22:57:46.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:46.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:46.727 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:46.779 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:46.779 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:46.815 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:46.816+0000 7f2cd9e12800 1 waiting to reach incremental sync.. 2023-12-15T22:57:51.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:51.817+0000 7f2cd9e12800 1 bucket sync caught up with source: 2023-12-15T22:57:51.818 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.23.12, , ] 2023-12-15T22:57:51.818 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.23.12, , ] 2023-12-15T22:57:51.818 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:51.817+0000 7f2cd9e12800 0 bucket checkpoint complete 2023-12-15T22:57:51.835 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-15 2023-12-15T22:57:51.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:51.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:51.835 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:51.897 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:51.897 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:51.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:51.936+0000 7fe214e0f800 1 waiting to reach incremental sync.. 2023-12-15T22:57:56.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:56.938+0000 7fe214e0f800 1 bucket sync caught up with source: 2023-12-15T22:57:56.939 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000002.56.6, , ] 2023-12-15T22:57:56.939 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000002.56.6, , ] 2023-12-15T22:57:56.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:56.938+0000 7fe214e0f800 0 bucket checkpoint complete 2023-12-15T22:57:56.955 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-15 zones={test-zone2, test-zone1} 2023-12-15T22:57:56.956 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.956 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.956 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.956 DEBUG:boto:Path: /kskgfn-15/ 2023-12-15T22:57:56.956 DEBUG:boto:Data: 2023-12-15T22:57:56.956 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.956 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.956 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.956 DEBUG:boto:Params: {} 2023-12-15T22:57:56.957 DEBUG:boto:Token: None 2023-12-15T22:57:56.957 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/ 2023-12-15T22:57:56.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RIY2D0206s95XjIGUaTrYVw8ess= 2023-12-15T22:57:56.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RIY2D0206s95XjIGUaTrYVw8ess=', 'Content-Length': '0'} 2023-12-15T22:57:56.960 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000bbe0bd724febed7-00657cd9f4-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.960 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.960 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.960 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.960 DEBUG:boto:Path: /kskgfn-15/ 2023-12-15T22:57:56.960 DEBUG:boto:Data: 2023-12-15T22:57:56.960 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.960 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.960 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.960 DEBUG:boto:Params: {} 2023-12-15T22:57:56.961 DEBUG:boto:Token: None 2023-12-15T22:57:56.961 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/ 2023-12-15T22:57:56.961 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RIY2D0206s95XjIGUaTrYVw8ess= 2023-12-15T22:57:56.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RIY2D0206s95XjIGUaTrYVw8ess=', 'Content-Length': '0'} 2023-12-15T22:57:56.963 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000062816e8c34fd45c0-00657cd9f4-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.963 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:57:56.964 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.964 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.964 DEBUG:boto:path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.964 DEBUG:boto:auth_path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.964 DEBUG:boto:Method: GET 2023-12-15T22:57:56.964 DEBUG:boto:Path: /kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.964 DEBUG:boto:Data: 2023-12-15T22:57:56.964 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.964 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.964 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.964 DEBUG:boto:Params: {} 2023-12-15T22:57:56.965 DEBUG:boto:Token: None 2023-12-15T22:57:56.965 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/?versions 2023-12-15T22:57:56.965 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo= 2023-12-15T22:57:56.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo=', 'Content-Length': '0'} 2023-12-15T22:57:56.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a4981f896c30e20-00657cd9f4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.967 DEBUG:boto:b'kskgfn-15999falseobj9ibhYTBQ5S6uFvSvInCuhWuWmW.HtUmtrue2023-12-15T22:57:46.689Zrgw-multisite-test-userMultisite Test UserNormalobjA7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3false2023-12-15T22:57:46.669Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:56.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:56.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:56.968 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:57:56.968 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.968 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.969 DEBUG:boto:path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.969 DEBUG:boto:auth_path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.969 DEBUG:boto:Method: GET 2023-12-15T22:57:56.969 DEBUG:boto:Path: /kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.969 DEBUG:boto:Data: 2023-12-15T22:57:56.969 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.969 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.969 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.969 DEBUG:boto:Params: {} 2023-12-15T22:57:56.969 DEBUG:boto:Token: None 2023-12-15T22:57:56.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/?versions 2023-12-15T22:57:56.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo= 2023-12-15T22:57:56.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo=', 'Content-Length': '0'} 2023-12-15T22:57:56.972 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca03f5666bbbc2d5-00657cd9f4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.972 DEBUG:boto:b'kskgfn-15999falseobj9ibhYTBQ5S6uFvSvInCuhWuWmW.HtUmtrue2023-12-15T22:57:46.689Zrgw-multisite-test-userMultisite Test UserNormalobjA7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3false2023-12-15T22:57:46.669Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:56.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:56.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:56.973 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.973 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.973 DEBUG:boto:path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.973 DEBUG:boto:auth_path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.973 DEBUG:boto:Method: GET 2023-12-15T22:57:56.973 DEBUG:boto:Path: /kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.973 DEBUG:boto:Data: 2023-12-15T22:57:56.973 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.974 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.974 DEBUG:boto:Params: {} 2023-12-15T22:57:56.974 DEBUG:boto:Token: None 2023-12-15T22:57:56.974 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/?versions 2023-12-15T22:57:56.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo= 2023-12-15T22:57:56.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo=', 'Content-Length': '0'} 2023-12-15T22:57:56.976 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f29fa2e0d282030b-00657cd9f4-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.976 DEBUG:boto:b'kskgfn-15999falseobj9ibhYTBQ5S6uFvSvInCuhWuWmW.HtUmtrue2023-12-15T22:57:46.689Zrgw-multisite-test-userMultisite Test UserNormalobjA7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3false2023-12-15T22:57:46.669Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:56.977 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:56.977 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:56.977 DEBUG:boto:path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.977 DEBUG:boto:auth_path=/kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.977 DEBUG:boto:Method: GET 2023-12-15T22:57:56.977 DEBUG:boto:Path: /kskgfn-15/?versions&max-keys=999 2023-12-15T22:57:56.977 DEBUG:boto:Data: 2023-12-15T22:57:56.977 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.978 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.978 DEBUG:boto:Params: {} 2023-12-15T22:57:56.978 DEBUG:boto:Token: None 2023-12-15T22:57:56.978 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/?versions 2023-12-15T22:57:56.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo= 2023-12-15T22:57:56.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hGRwWCrx4VbaDHIu5w2Miac2zFo=', 'Content-Length': '0'} 2023-12-15T22:57:56.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a01a9335e11a64e-00657cd9f4-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.980 DEBUG:boto:b'kskgfn-15999falseobj9ibhYTBQ5S6uFvSvInCuhWuWmW.HtUmtrue2023-12-15T22:57:46.689Zrgw-multisite-test-userMultisite Test UserNormalobjA7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3false2023-12-15T22:57:46.669Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:56.981 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:56.981 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.981 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.981 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.981 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:56.981 DEBUG:boto:Data: 2023-12-15T22:57:56.981 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.981 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.981 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.982 DEBUG:boto:Params: {} 2023-12-15T22:57:56.982 DEBUG:boto:Token: None 2023-12-15T22:57:56.982 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/obj 2023-12-15T22:57:56.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/Dr+LQLLl7x22g0ZCnF2J1Q+PdI= 2023-12-15T22:57:56.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/Dr+LQLLl7x22g0ZCnF2J1Q+PdI=', 'Content-Length': '0'} 2023-12-15T22:57:56.984 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000053646e93ff9f0eea-00657cd9f4-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.985 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.985 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.985 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.985 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:56.985 DEBUG:boto:Data: 2023-12-15T22:57:56.985 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.985 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.985 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.985 DEBUG:boto:Params: {} 2023-12-15T22:57:56.985 DEBUG:boto:Token: None 2023-12-15T22:57:56.986 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/obj 2023-12-15T22:57:56.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/Dr+LQLLl7x22g0ZCnF2J1Q+PdI= 2023-12-15T22:57:56.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/Dr+LQLLl7x22g0ZCnF2J1Q+PdI=', 'Content-Length': '0'} 2023-12-15T22:57:56.988 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000e0b0899ac9758ec4-00657cd9f4-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:56.988 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.988 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.988 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.988 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.989 DEBUG:boto:Method: GET 2023-12-15T22:57:56.989 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.989 DEBUG:boto:Data: 2023-12-15T22:57:56.989 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.989 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.989 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.989 DEBUG:boto:Params: {} 2023-12-15T22:57:56.989 DEBUG:boto:Token: None 2023-12-15T22:57:56.989 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8XE2AfGiLKXRobsGeG6U0vb3fI= 2023-12-15T22:57:56.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8XE2AfGiLKXRobsGeG6U0vb3fI=', 'Content-Length': '0'} 2023-12-15T22:57:56.991 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003d7dce81a70af9f3-00657cd9f4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.992 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.992 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.992 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.992 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.992 DEBUG:boto:Method: GET 2023-12-15T22:57:56.992 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.992 DEBUG:boto:Data: 2023-12-15T22:57:56.992 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.992 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.992 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.992 DEBUG:boto:Params: {} 2023-12-15T22:57:56.992 DEBUG:boto:Token: None 2023-12-15T22:57:56.993 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.993 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8XE2AfGiLKXRobsGeG6U0vb3fI= 2023-12-15T22:57:56.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8XE2AfGiLKXRobsGeG6U0vb3fI=', 'Content-Length': '0'} 2023-12-15T22:57:56.995 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fdf232fa581cc287-00657cd9f4-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.995 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.995 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.995 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.995 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.995 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.995 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.995 DEBUG:boto:Data: 2023-12-15T22:57:56.995 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.996 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:56.996 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.996 DEBUG:boto:Params: {} 2023-12-15T22:57:56.996 DEBUG:boto:Token: None 2023-12-15T22:57:56.996 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:56 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OxogT9pZ5LH+cNtSzfdkdjASXs0= 2023-12-15T22:57:56.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OxogT9pZ5LH+cNtSzfdkdjASXs0=', 'Content-Length': '0'} 2023-12-15T22:57:56.998 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000aeaa465a1f3b245d-00657cd9f4-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:56.998 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:56.999 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:56.999 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.999 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.999 DEBUG:boto:Method: HEAD 2023-12-15T22:57:56.999 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:56.999 DEBUG:boto:Data: 2023-12-15T22:57:56.999 DEBUG:boto:Headers: {} 2023-12-15T22:57:56.999 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:56.999 DEBUG:boto:Port: 8000 2023-12-15T22:57:56.999 DEBUG:boto:Params: {} 2023-12-15T22:57:56.999 DEBUG:boto:Token: None 2023-12-15T22:57:57.000 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XiHp/WVvkXNkoZUMuwnocAdw/ec= 2023-12-15T22:57:57.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XiHp/WVvkXNkoZUMuwnocAdw/ec=', 'Content-Length': '0'} 2023-12-15T22:57:57.001 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000064d9e47c26e92f88-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:57.002 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:57.002 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:57.002 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.002 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.002 DEBUG:boto:Method: GET 2023-12-15T22:57:57.002 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.002 DEBUG:boto:Data: 2023-12-15T22:57:57.002 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.003 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.003 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.003 DEBUG:boto:Params: {} 2023-12-15T22:57:57.003 DEBUG:boto:Token: None 2023-12-15T22:57:57.003 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R9NBTsfZIUULVgqJysQP02tHgVE= 2023-12-15T22:57:57.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R9NBTsfZIUULVgqJysQP02tHgVE=', 'Content-Length': '0'} 2023-12-15T22:57:57.005 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002dbc44ee0fb26901-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.005 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:57.005 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:57.005 DEBUG:boto:path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.006 DEBUG:boto:auth_path=/kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.006 DEBUG:boto:Method: GET 2023-12-15T22:57:57.006 DEBUG:boto:Path: /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.006 DEBUG:boto:Data: 2023-12-15T22:57:57.006 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.006 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.006 DEBUG:boto:Params: {} 2023-12-15T22:57:57.006 DEBUG:boto:Token: None 2023-12-15T22:57:57.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/obj?versionId=A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3 2023-12-15T22:57:57.006 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R9NBTsfZIUULVgqJysQP02tHgVE= 2023-12-15T22:57:57.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R9NBTsfZIUULVgqJysQP02tHgVE=', 'Content-Length': '0'} 2023-12-15T22:57:57.008 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'A7sbb8HSeXaw6ndCYKWxJ7geOzX7FL3'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c57597e940bd7f61-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.009 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:57.009 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:57.009 DEBUG:boto:path=/kskgfn-15/?prefix=obj 2023-12-15T22:57:57.009 DEBUG:boto:auth_path=/kskgfn-15/?prefix=obj 2023-12-15T22:57:57.009 DEBUG:boto:Method: GET 2023-12-15T22:57:57.009 DEBUG:boto:Path: /kskgfn-15/?prefix=obj 2023-12-15T22:57:57.009 DEBUG:boto:Data: 2023-12-15T22:57:57.009 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.009 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.010 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.010 DEBUG:boto:Params: {} 2023-12-15T22:57:57.010 DEBUG:boto:Token: None 2023-12-15T22:57:57.010 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/ 2023-12-15T22:57:57.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:igy/i87zMdNj0ci0QtqVj8M/4jU= 2023-12-15T22:57:57.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:igy/i87zMdNj0ci0QtqVj8M/4jU=', 'Content-Length': '0'} 2023-12-15T22:57:57.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c281847a8043b58-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.058 DEBUG:boto:b'kskgfn-15obj1000false' 2023-12-15T22:57:57.058 DEBUG:boto:path=/kskgfn-15/ 2023-12-15T22:57:57.058 DEBUG:boto:auth_path=/kskgfn-15/ 2023-12-15T22:57:57.058 DEBUG:boto:path=/kskgfn-15/?prefix=obj 2023-12-15T22:57:57.058 DEBUG:boto:auth_path=/kskgfn-15/?prefix=obj 2023-12-15T22:57:57.058 DEBUG:boto:Method: GET 2023-12-15T22:57:57.058 DEBUG:boto:Path: /kskgfn-15/?prefix=obj 2023-12-15T22:57:57.059 DEBUG:boto:Data: 2023-12-15T22:57:57.059 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.059 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.059 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.059 DEBUG:boto:Params: {} 2023-12-15T22:57:57.059 DEBUG:boto:Token: None 2023-12-15T22:57:57.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/ 2023-12-15T22:57:57.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:igy/i87zMdNj0ci0QtqVj8M/4jU= 2023-12-15T22:57:57.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:igy/i87zMdNj0ci0QtqVj8M/4jU=', 'Content-Length': '0'} 2023-12-15T22:57:57.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ded569921eb9f0e8-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.062 DEBUG:boto:b'kskgfn-15obj1000false' 2023-12-15T22:57:57.062 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:57.062 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:57.063 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.063 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:57.063 DEBUG:boto:Data: 2023-12-15T22:57:57.063 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.063 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.063 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.063 DEBUG:boto:Params: {} 2023-12-15T22:57:57.064 DEBUG:boto:Token: None 2023-12-15T22:57:57.064 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/obj 2023-12-15T22:57:57.064 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oj+cKOHxTSdou+XHCDkaFubdrpo= 2023-12-15T22:57:57.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oj+cKOHxTSdou+XHCDkaFubdrpo=', 'Content-Length': '0'} 2023-12-15T22:57:57.066 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000e7597f842c232798-00657cd9f5-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.067 DEBUG:boto:path=/kskgfn-15/obj 2023-12-15T22:57:57.067 DEBUG:boto:auth_path=/kskgfn-15/obj 2023-12-15T22:57:57.067 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.067 DEBUG:boto:Path: /kskgfn-15/obj 2023-12-15T22:57:57.067 DEBUG:boto:Data: 2023-12-15T22:57:57.067 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.067 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.067 DEBUG:boto:Params: {} 2023-12-15T22:57:57.067 DEBUG:boto:Token: None 2023-12-15T22:57:57.068 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-15/obj 2023-12-15T22:57:57.068 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oj+cKOHxTSdou+XHCDkaFubdrpo= 2023-12-15T22:57:57.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oj+cKOHxTSdou+XHCDkaFubdrpo=', 'Content-Length': '0'} 2023-12-15T22:57:57.070 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000061aeb5a7a376e55b-00657cd9f5-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.070 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-15 zones={test-zone2, test-zone1} 2023-12-15T22:57:57.070 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-16 2023-12-15T22:57:57.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:57.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:57.071 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:57.132 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:57.133 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:57.171 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:57.170+0000 7fbba6d2e800 1 bucket sync caught up with source: 2023-12-15T22:57:57.171 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.10.6, , ] 2023-12-15T22:57:57.171 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000002.10.6, , ] 2023-12-15T22:57:57.171 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:57.170+0000 7fbba6d2e800 0 bucket checkpoint complete 2023-12-15T22:57:57.187 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-16 2023-12-15T22:57:57.187 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:57.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:57:57.187 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:57:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:57.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:57.288+0000 7f456e13e800 1 bucket sync caught up with source: 2023-12-15T22:57:57.288 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000003.31.12, , ] 2023-12-15T22:57:57.289 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000003.31.12, , ] 2023-12-15T22:57:57.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:57:57.288+0000 7f456e13e800 0 bucket checkpoint complete 2023-12-15T22:57:57.303 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-16 zones={test-zone2, test-zone1} 2023-12-15T22:57:57.303 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.303 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.304 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.304 DEBUG:boto:Path: /kskgfn-16/ 2023-12-15T22:57:57.304 DEBUG:boto:Data: 2023-12-15T22:57:57.304 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.304 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.304 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.304 DEBUG:boto:Params: {} 2023-12-15T22:57:57.304 DEBUG:boto:Token: None 2023-12-15T22:57:57.304 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/ 2023-12-15T22:57:57.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c0M6LPeotdNjaqfG4NS/KKJBtY8= 2023-12-15T22:57:57.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c0M6LPeotdNjaqfG4NS/KKJBtY8=', 'Content-Length': '0'} 2023-12-15T22:57:57.307 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1e3ad05ed5ddffc-00657cd9f5-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.307 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.307 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.307 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.307 DEBUG:boto:Path: /kskgfn-16/ 2023-12-15T22:57:57.307 DEBUG:boto:Data: 2023-12-15T22:57:57.307 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.308 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.308 DEBUG:boto:Params: {} 2023-12-15T22:57:57.308 DEBUG:boto:Token: None 2023-12-15T22:57:57.308 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/ 2023-12-15T22:57:57.308 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c0M6LPeotdNjaqfG4NS/KKJBtY8= 2023-12-15T22:57:57.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c0M6LPeotdNjaqfG4NS/KKJBtY8=', 'Content-Length': '0'} 2023-12-15T22:57:57.310 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e03a974dcc601d09-00657cd9f5-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.310 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:57:57.311 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.311 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.311 DEBUG:boto:path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.311 DEBUG:boto:auth_path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.311 DEBUG:boto:Method: GET 2023-12-15T22:57:57.311 DEBUG:boto:Path: /kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.311 DEBUG:boto:Data: 2023-12-15T22:57:57.311 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.311 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.311 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.311 DEBUG:boto:Params: {} 2023-12-15T22:57:57.311 DEBUG:boto:Token: None 2023-12-15T22:57:57.312 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/?versions 2023-12-15T22:57:57.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g= 2023-12-15T22:57:57.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g=', 'Content-Length': '0'} 2023-12-15T22:57:57.314 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e5a036cb5c7e06b-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.314 DEBUG:boto:b'kskgfn-16999falseobjmnxOptw2vEwDTctg2kOimt0P9do49INtrue2023-12-15T22:57:46.721Zrgw-multisite-test-userMultisite Test UserNormalobjgrQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FBfalse2023-12-15T22:57:46.703Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:57.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:57.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:57.315 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:57:57.315 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.315 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.315 DEBUG:boto:path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.315 DEBUG:boto:auth_path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.315 DEBUG:boto:Method: GET 2023-12-15T22:57:57.315 DEBUG:boto:Path: /kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.316 DEBUG:boto:Data: 2023-12-15T22:57:57.316 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.316 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.316 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.316 DEBUG:boto:Params: {} 2023-12-15T22:57:57.316 DEBUG:boto:Token: None 2023-12-15T22:57:57.316 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/?versions 2023-12-15T22:57:57.316 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g= 2023-12-15T22:57:57.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g=', 'Content-Length': '0'} 2023-12-15T22:57:57.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005232d16043d6424e-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.318 DEBUG:boto:b'kskgfn-16999falseobjmnxOptw2vEwDTctg2kOimt0P9do49INtrue2023-12-15T22:57:46.721Zrgw-multisite-test-userMultisite Test UserNormalobjgrQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FBfalse2023-12-15T22:57:46.703Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:57.319 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:57.319 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:57:57.319 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.319 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.319 DEBUG:boto:path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.319 DEBUG:boto:auth_path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.319 DEBUG:boto:Method: GET 2023-12-15T22:57:57.320 DEBUG:boto:Path: /kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.320 DEBUG:boto:Data: 2023-12-15T22:57:57.320 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.320 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.320 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.320 DEBUG:boto:Params: {} 2023-12-15T22:57:57.320 DEBUG:boto:Token: None 2023-12-15T22:57:57.320 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/?versions 2023-12-15T22:57:57.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g= 2023-12-15T22:57:57.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g=', 'Content-Length': '0'} 2023-12-15T22:57:57.323 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f81ebd4b73c42af7-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.365 DEBUG:boto:b'kskgfn-16999falseobjmnxOptw2vEwDTctg2kOimt0P9do49INtrue2023-12-15T22:57:46.721Zrgw-multisite-test-userMultisite Test UserNormalobjgrQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FBfalse2023-12-15T22:57:46.703Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:57.366 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.366 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.366 DEBUG:boto:path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.366 DEBUG:boto:auth_path=/kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.366 DEBUG:boto:Method: GET 2023-12-15T22:57:57.366 DEBUG:boto:Path: /kskgfn-16/?versions&max-keys=999 2023-12-15T22:57:57.366 DEBUG:boto:Data: 2023-12-15T22:57:57.367 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.367 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.367 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.367 DEBUG:boto:Params: {} 2023-12-15T22:57:57.367 DEBUG:boto:Token: None 2023-12-15T22:57:57.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/?versions 2023-12-15T22:57:57.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g= 2023-12-15T22:57:57.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HBzDZkVmcR0h5F3jAU5lWiTzP1g=', 'Content-Length': '0'} 2023-12-15T22:57:57.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038e8a0d4fd8c3a3d-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.369 DEBUG:boto:b'kskgfn-16999falseobjmnxOptw2vEwDTctg2kOimt0P9do49INtrue2023-12-15T22:57:46.721Zrgw-multisite-test-userMultisite Test UserNormalobjgrQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FBfalse2023-12-15T22:57:46.703Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:57:57.370 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:57.370 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.370 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.370 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.370 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:57.370 DEBUG:boto:Data: 2023-12-15T22:57:57.370 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.370 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.371 DEBUG:boto:Params: {} 2023-12-15T22:57:57.371 DEBUG:boto:Token: None 2023-12-15T22:57:57.371 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj 2023-12-15T22:57:57.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4= 2023-12-15T22:57:57.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4=', 'Content-Length': '0'} 2023-12-15T22:57:57.373 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000002b6779437ef747d4-00657cd9f5-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.373 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.373 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.373 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.374 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:57.374 DEBUG:boto:Data: 2023-12-15T22:57:57.374 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.374 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.374 DEBUG:boto:Params: {} 2023-12-15T22:57:57.374 DEBUG:boto:Token: None 2023-12-15T22:57:57.374 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj 2023-12-15T22:57:57.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4= 2023-12-15T22:57:57.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4=', 'Content-Length': '0'} 2023-12-15T22:57:57.376 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000bb80a59487eda7f1-00657cd9f5-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:57.377 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.377 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.377 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.377 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.377 DEBUG:boto:Method: GET 2023-12-15T22:57:57.377 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.377 DEBUG:boto:Data: 2023-12-15T22:57:57.377 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.377 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.378 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.378 DEBUG:boto:Params: {} 2023-12-15T22:57:57.378 DEBUG:boto:Token: None 2023-12-15T22:57:57.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI= 2023-12-15T22:57:57.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI=', 'Content-Length': '0'} 2023-12-15T22:57:57.380 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000afbf3271a4176ac4-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.380 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.380 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.380 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.380 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.380 DEBUG:boto:Method: GET 2023-12-15T22:57:57.380 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.381 DEBUG:boto:Data: 2023-12-15T22:57:57.381 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.381 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.381 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.381 DEBUG:boto:Params: {} 2023-12-15T22:57:57.381 DEBUG:boto:Token: None 2023-12-15T22:57:57.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI= 2023-12-15T22:57:57.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI=', 'Content-Length': '0'} 2023-12-15T22:57:57.383 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e58fde6afa6ac989-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.384 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.384 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.384 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.384 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.384 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.384 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.384 DEBUG:boto:Data: 2023-12-15T22:57:57.384 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.384 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.384 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.384 DEBUG:boto:Params: {} 2023-12-15T22:57:57.384 DEBUG:boto:Token: None 2023-12-15T22:57:57.385 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QdblH5slKW0KbnqyvrPX2e1/s/I= 2023-12-15T22:57:57.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QdblH5slKW0KbnqyvrPX2e1/s/I=', 'Content-Length': '0'} 2023-12-15T22:57:57.386 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f48fd8cf4d8aa779-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.387 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.387 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.387 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.387 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.387 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.387 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.387 DEBUG:boto:Data: 2023-12-15T22:57:57.387 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.387 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.387 DEBUG:boto:Params: {} 2023-12-15T22:57:57.388 DEBUG:boto:Token: None 2023-12-15T22:57:57.388 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QdblH5slKW0KbnqyvrPX2e1/s/I= 2023-12-15T22:57:57.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QdblH5slKW0KbnqyvrPX2e1/s/I=', 'Content-Length': '0'} 2023-12-15T22:57:57.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000033b01b570ee62476-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:57:57.390 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.390 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.390 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.391 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.391 DEBUG:boto:Method: GET 2023-12-15T22:57:57.391 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.391 DEBUG:boto:Data: 2023-12-15T22:57:57.391 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.391 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.391 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.391 DEBUG:boto:Params: {} 2023-12-15T22:57:57.391 DEBUG:boto:Token: None 2023-12-15T22:57:57.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI= 2023-12-15T22:57:57.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI=', 'Content-Length': '0'} 2023-12-15T22:57:57.393 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d3d0ca5611e7e89d-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.393 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.393 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.394 DEBUG:boto:path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.394 DEBUG:boto:auth_path=/kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.394 DEBUG:boto:Method: GET 2023-12-15T22:57:57.394 DEBUG:boto:Path: /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.394 DEBUG:boto:Data: 2023-12-15T22:57:57.394 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.394 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.394 DEBUG:boto:Params: {} 2023-12-15T22:57:57.394 DEBUG:boto:Token: None 2023-12-15T22:57:57.394 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj?versionId=grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB 2023-12-15T22:57:57.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI= 2023-12-15T22:57:57.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:07KibWN5XpqGg0fgcWeS8W5LjeI=', 'Content-Length': '0'} 2023-12-15T22:57:57.396 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:57:46 GMT'), ('x-amz-version-id', 'grQ-apHq5xCCWkkSdh-l7Y3Ox5Pz1FB'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bcddbbdf0f3e7c06-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.397 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.397 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.397 DEBUG:boto:path=/kskgfn-16/?prefix=obj 2023-12-15T22:57:57.397 DEBUG:boto:auth_path=/kskgfn-16/?prefix=obj 2023-12-15T22:57:57.397 DEBUG:boto:Method: GET 2023-12-15T22:57:57.397 DEBUG:boto:Path: /kskgfn-16/?prefix=obj 2023-12-15T22:57:57.397 DEBUG:boto:Data: 2023-12-15T22:57:57.397 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.397 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.397 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.397 DEBUG:boto:Params: {} 2023-12-15T22:57:57.398 DEBUG:boto:Token: None 2023-12-15T22:57:57.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/ 2023-12-15T22:57:57.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7zpMnBn0DXLPshpZh6fBOc62UUw= 2023-12-15T22:57:57.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7zpMnBn0DXLPshpZh6fBOc62UUw=', 'Content-Length': '0'} 2023-12-15T22:57:57.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008a9b6ef59ab789e-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.400 DEBUG:boto:b'kskgfn-16obj1000false' 2023-12-15T22:57:57.400 DEBUG:boto:path=/kskgfn-16/ 2023-12-15T22:57:57.401 DEBUG:boto:auth_path=/kskgfn-16/ 2023-12-15T22:57:57.401 DEBUG:boto:path=/kskgfn-16/?prefix=obj 2023-12-15T22:57:57.401 DEBUG:boto:auth_path=/kskgfn-16/?prefix=obj 2023-12-15T22:57:57.401 DEBUG:boto:Method: GET 2023-12-15T22:57:57.401 DEBUG:boto:Path: /kskgfn-16/?prefix=obj 2023-12-15T22:57:57.401 DEBUG:boto:Data: 2023-12-15T22:57:57.401 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.401 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.401 DEBUG:boto:Params: {} 2023-12-15T22:57:57.401 DEBUG:boto:Token: None 2023-12-15T22:57:57.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/ 2023-12-15T22:57:57.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7zpMnBn0DXLPshpZh6fBOc62UUw= 2023-12-15T22:57:57.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7zpMnBn0DXLPshpZh6fBOc62UUw=', 'Content-Length': '0'} 2023-12-15T22:57:57.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073a5e332d138849c-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.404 DEBUG:boto:b'kskgfn-16obj1000false' 2023-12-15T22:57:57.404 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.404 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.405 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.405 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:57.405 DEBUG:boto:Data: 2023-12-15T22:57:57.405 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.405 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.405 DEBUG:boto:Params: {} 2023-12-15T22:57:57.405 DEBUG:boto:Token: None 2023-12-15T22:57:57.405 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj 2023-12-15T22:57:57.405 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4= 2023-12-15T22:57:57.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4=', 'Content-Length': '0'} 2023-12-15T22:57:57.408 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000eb3fe650b3578835-00657cd9f5-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.409 DEBUG:boto:path=/kskgfn-16/obj 2023-12-15T22:57:57.409 DEBUG:boto:auth_path=/kskgfn-16/obj 2023-12-15T22:57:57.409 DEBUG:boto:Method: HEAD 2023-12-15T22:57:57.409 DEBUG:boto:Path: /kskgfn-16/obj 2023-12-15T22:57:57.409 DEBUG:boto:Data: 2023-12-15T22:57:57.409 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.409 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.409 DEBUG:boto:Params: {} 2023-12-15T22:57:57.409 DEBUG:boto:Token: None 2023-12-15T22:57:57.409 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-16/obj 2023-12-15T22:57:57.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4= 2023-12-15T22:57:57.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ovwjXVqG5H71pEOsMw6qblErYr4=', 'Content-Length': '0'} 2023-12-15T22:57:57.412 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000008b9fe0cfac43853d-00657cd9f5-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.412 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-16 zones={test-zone2, test-zone1} 2023-12-15T22:57:57.412 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2023-12-15T22:57:57.413 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-17 2023-12-15T22:57:57.413 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:57:57.413 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:57:57.413 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.413 DEBUG:boto:Path: /kskgfn-17/ 2023-12-15T22:57:57.413 DEBUG:boto:Data: 2023-12-15T22:57:57.413 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.413 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.414 DEBUG:boto:Params: {} 2023-12-15T22:57:57.414 DEBUG:boto:Token: None 2023-12-15T22:57:57.414 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-17/ 2023-12-15T22:57:57.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S27sEik9JPSqzBpGf9pBjYL22uo= 2023-12-15T22:57:57.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S27sEik9JPSqzBpGf9pBjYL22uo=', 'Content-Length': '0'} 2023-12-15T22:57:57.427 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006d50150c93ed337b-00657cd9f5-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.428 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-18 2023-12-15T22:57:57.428 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:57:57.428 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:57:57.428 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.428 DEBUG:boto:Path: /kskgfn-18/ 2023-12-15T22:57:57.428 DEBUG:boto:Data: 2023-12-15T22:57:57.428 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.428 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.428 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.428 DEBUG:boto:Params: {} 2023-12-15T22:57:57.429 DEBUG:boto:Token: None 2023-12-15T22:57:57.429 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-18/ 2023-12-15T22:57:57.429 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0vAKgE9sUXVyDWTERPx29Ymkzws= 2023-12-15T22:57:57.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0vAKgE9sUXVyDWTERPx29Ymkzws=', 'Content-Length': '0'} 2023-12-15T22:57:57.456 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e875ed340a7bed9c-00657cd9f5-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.456 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:57:57.456 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:57:57.457 DEBUG:boto:path=/kskgfn-17/?versioning 2023-12-15T22:57:57.457 DEBUG:boto:auth_path=/kskgfn-17/?versioning 2023-12-15T22:57:57.457 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.457 DEBUG:boto:Path: /kskgfn-17/?versioning 2023-12-15T22:57:57.457 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:57:57.457 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.457 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.457 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.457 DEBUG:boto:Params: {} 2023-12-15T22:57:57.457 DEBUG:boto:Token: None 2023-12-15T22:57:57.458 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-17/?versioning 2023-12-15T22:57:57.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/UuWlOhEiO3FrsWNEhjZc6u2h0= 2023-12-15T22:57:57.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/UuWlOhEiO3FrsWNEhjZc6u2h0=', 'Content-Length': '228'} 2023-12-15T22:57:57.463 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008e7f9506fa2606bb-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.463 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:57:57.463 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:57:57.463 DEBUG:boto:path=/kskgfn-17/?versioning 2023-12-15T22:57:57.463 DEBUG:boto:auth_path=/kskgfn-17/?versioning 2023-12-15T22:57:57.463 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.464 DEBUG:boto:Path: /kskgfn-17/?versioning 2023-12-15T22:57:57.464 DEBUG:boto:Data: Suspended Disabled 2023-12-15T22:57:57.464 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.464 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:57:57.464 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.464 DEBUG:boto:Params: {} 2023-12-15T22:57:57.464 DEBUG:boto:Token: None 2023-12-15T22:57:57.464 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-17/?versioning 2023-12-15T22:57:57.464 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/UuWlOhEiO3FrsWNEhjZc6u2h0= 2023-12-15T22:57:57.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/UuWlOhEiO3FrsWNEhjZc6u2h0=', 'Content-Length': '230'} 2023-12-15T22:57:57.469 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004a8baa8784a3f4ba-00657cd9f5-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.469 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:57:57.469 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:57:57.470 DEBUG:boto:path=/kskgfn-18/?versioning 2023-12-15T22:57:57.470 DEBUG:boto:auth_path=/kskgfn-18/?versioning 2023-12-15T22:57:57.470 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.470 DEBUG:boto:Path: /kskgfn-18/?versioning 2023-12-15T22:57:57.470 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:57:57.470 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.470 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.470 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.470 DEBUG:boto:Params: {} 2023-12-15T22:57:57.470 DEBUG:boto:Token: None 2023-12-15T22:57:57.470 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-18/?versioning 2023-12-15T22:57:57.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG08/TpeUAtxkm3tBVpT96446lA= 2023-12-15T22:57:57.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG08/TpeUAtxkm3tBVpT96446lA=', 'Content-Length': '228'} 2023-12-15T22:57:57.478 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003df66026fc6c8320-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.478 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:57:57.478 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:57:57.478 DEBUG:boto:path=/kskgfn-18/?versioning 2023-12-15T22:57:57.478 DEBUG:boto:auth_path=/kskgfn-18/?versioning 2023-12-15T22:57:57.479 DEBUG:boto:Method: PUT 2023-12-15T22:57:57.479 DEBUG:boto:Path: /kskgfn-18/?versioning 2023-12-15T22:57:57.479 DEBUG:boto:Data: Suspended Disabled 2023-12-15T22:57:57.479 DEBUG:boto:Headers: {} 2023-12-15T22:57:57.479 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:57:57.479 DEBUG:boto:Port: 8000 2023-12-15T22:57:57.479 DEBUG:boto:Params: {} 2023-12-15T22:57:57.479 DEBUG:boto:Token: None 2023-12-15T22:57:57.479 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:57:57 GMT /kskgfn-18/?versioning 2023-12-15T22:57:57.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LG08/TpeUAtxkm3tBVpT96446lA= 2023-12-15T22:57:57.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:57:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LG08/TpeUAtxkm3tBVpT96446lA=', 'Content-Length': '230'} 2023-12-15T22:57:57.489 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000009dd7355240810ecb-00657cd9f5-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:57:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:57:57.489 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:57.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:57.489 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:57.535 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:57.536 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:57.565 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:57:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681077.485453_94.1","last_update":"2023-12-15T22:57:57.485453Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:57:57.579 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681077.485453_94.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:57.579 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:57:57.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:57.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:57:57.580 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:57:57.630 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:57:57.630 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:57:57.658 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:57.657+0000 7f2052120800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:57.659 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:57:57.658+0000 7f2052120800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:57:57.674 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681077.438444_83.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:57.438444Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:57Z"} 2023-12-15T22:57:57.674 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681077.438444_83.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:57.438444Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:57:57Z"} 2023-12-15T22:57:57.674 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681077.438444_83.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:57:57.438444Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:57:57.674 DEBUG:rgw_multi.tests:log_status={0: '1_1702681077.485453_94.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:57.674 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681077.438444_83.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:57:57.674 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681077.485453_94.1 target=1_1702681077.438444_83.1 2023-12-15T22:58:02.675 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:02.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:02.676 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:02.728 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:02.728 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:02.759 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:02.759+0000 7f053e726800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:02.760 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:02.760+0000 7f053e726800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:02.776 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681077.485453_94.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:57.485453Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:02Z"} 2023-12-15T22:58:02.776 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681077.485453_94.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:57:57.485453Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:02Z"} 2023-12-15T22:58:02.777 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681077.485453_94.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:57:57.485453Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:58:02.777 DEBUG:rgw_multi.tests:log_status={0: '1_1702681077.485453_94.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:02.777 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681077.485453_94.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:02.777 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:58:02.777 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:02.777 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:02.777 DEBUG:boto:Method: HEAD 2023-12-15T22:58:02.777 DEBUG:boto:Path: /kskgfn-17/ 2023-12-15T22:58:02.778 DEBUG:boto:Data: 2023-12-15T22:58:02.778 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.778 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:02.778 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.778 DEBUG:boto:Params: {} 2023-12-15T22:58:02.778 DEBUG:boto:Token: None 2023-12-15T22:58:02.778 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-17/ 2023-12-15T22:58:02.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cr1QoNeb+295HIgLFHSbgO7AzNo= 2023-12-15T22:58:02.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cr1QoNeb+295HIgLFHSbgO7AzNo=', 'Content-Length': '0'} 2023-12-15T22:58:02.781 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003211bd4f8d011e22-00657cd9fa-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.781 DEBUG:boto:path=/kskgfn-17/obj 2023-12-15T22:58:02.781 DEBUG:boto:auth_path=/kskgfn-17/obj 2023-12-15T22:58:02.782 DEBUG:boto:Method: PUT 2023-12-15T22:58:02.782 DEBUG:boto:Path: /kskgfn-17/obj 2023-12-15T22:58:02.782 DEBUG:boto:Data: 2023-12-15T22:58:02.782 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:58:02.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:02.782 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.782 DEBUG:boto:Params: {} 2023-12-15T22:58:02.782 DEBUG:boto:Token: None 2023-12-15T22:58:02.782 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-17/obj 2023-12-15T22:58:02.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jc0b7wlcSb8wqvqAFA2Z318GHcg= 2023-12-15T22:58:02.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jc0b7wlcSb8wqvqAFA2Z318GHcg='} 2023-12-15T22:58:02.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ae0bff7cf33790d9-00657cd9fa-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.790 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:02.790 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:02.790 DEBUG:boto:Method: HEAD 2023-12-15T22:58:02.790 DEBUG:boto:Path: /kskgfn-17/ 2023-12-15T22:58:02.790 DEBUG:boto:Data: 2023-12-15T22:58:02.790 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:02.790 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.791 DEBUG:boto:Params: {} 2023-12-15T22:58:02.791 DEBUG:boto:Token: None 2023-12-15T22:58:02.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-17/ 2023-12-15T22:58:02.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cr1QoNeb+295HIgLFHSbgO7AzNo= 2023-12-15T22:58:02.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cr1QoNeb+295HIgLFHSbgO7AzNo=', 'Content-Length': '0'} 2023-12-15T22:58:02.793 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000dc4784904586fdf-00657cd9fa-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.793 DEBUG:boto:path=/kskgfn-17/obj 2023-12-15T22:58:02.793 DEBUG:boto:auth_path=/kskgfn-17/obj 2023-12-15T22:58:02.793 DEBUG:boto:Method: DELETE 2023-12-15T22:58:02.793 DEBUG:boto:Path: /kskgfn-17/obj 2023-12-15T22:58:02.793 DEBUG:boto:Data: 2023-12-15T22:58:02.793 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:02.794 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.794 DEBUG:boto:Params: {} 2023-12-15T22:58:02.794 DEBUG:boto:Token: None 2023-12-15T22:58:02.794 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-17/obj 2023-12-15T22:58:02.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QvtTLaxG+qpyijyZpBC12NOQIBE= 2023-12-15T22:58:02.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QvtTLaxG+qpyijyZpBC12NOQIBE=', 'Content-Length': '0'} 2023-12-15T22:58:02.805 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx000005ff6074222d689c0-00657cd9fa-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.806 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:02.806 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:02.806 DEBUG:boto:Method: HEAD 2023-12-15T22:58:02.806 DEBUG:boto:Path: /kskgfn-18/ 2023-12-15T22:58:02.806 DEBUG:boto:Data: 2023-12-15T22:58:02.806 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.806 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:02.806 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.806 DEBUG:boto:Params: {} 2023-12-15T22:58:02.807 DEBUG:boto:Token: None 2023-12-15T22:58:02.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-18/ 2023-12-15T22:58:02.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xTmsbpIn0PJN2P+/CUXHtscYGEs= 2023-12-15T22:58:02.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xTmsbpIn0PJN2P+/CUXHtscYGEs=', 'Content-Length': '0'} 2023-12-15T22:58:02.809 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009704b81d119675d4-00657cd9fa-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.809 DEBUG:boto:path=/kskgfn-18/obj 2023-12-15T22:58:02.809 DEBUG:boto:auth_path=/kskgfn-18/obj 2023-12-15T22:58:02.809 DEBUG:boto:Method: PUT 2023-12-15T22:58:02.810 DEBUG:boto:Path: /kskgfn-18/obj 2023-12-15T22:58:02.810 DEBUG:boto:Data: 2023-12-15T22:58:02.810 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2023-12-15T22:58:02.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:02.810 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.810 DEBUG:boto:Params: {} 2023-12-15T22:58:02.810 DEBUG:boto:Token: None 2023-12-15T22:58:02.810 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-18/obj 2023-12-15T22:58:02.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rtDuH2to7himSrWkRG7TdJgzuds= 2023-12-15T22:58:02.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rtDuH2to7himSrWkRG7TdJgzuds='} 2023-12-15T22:58:02.817 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006536b8f04278c79-00657cd9fa-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.817 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:02.817 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:02.817 DEBUG:boto:Method: HEAD 2023-12-15T22:58:02.817 DEBUG:boto:Path: /kskgfn-18/ 2023-12-15T22:58:02.818 DEBUG:boto:Data: 2023-12-15T22:58:02.818 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.818 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:02.818 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.818 DEBUG:boto:Params: {} 2023-12-15T22:58:02.818 DEBUG:boto:Token: None 2023-12-15T22:58:02.818 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-18/ 2023-12-15T22:58:02.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xTmsbpIn0PJN2P+/CUXHtscYGEs= 2023-12-15T22:58:02.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xTmsbpIn0PJN2P+/CUXHtscYGEs=', 'Content-Length': '0'} 2023-12-15T22:58:02.820 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000013d1843f713d0ed5-00657cd9fa-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.820 DEBUG:boto:path=/kskgfn-18/obj 2023-12-15T22:58:02.820 DEBUG:boto:auth_path=/kskgfn-18/obj 2023-12-15T22:58:02.821 DEBUG:boto:Method: DELETE 2023-12-15T22:58:02.821 DEBUG:boto:Path: /kskgfn-18/obj 2023-12-15T22:58:02.821 DEBUG:boto:Data: 2023-12-15T22:58:02.821 DEBUG:boto:Headers: {} 2023-12-15T22:58:02.821 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:02.821 DEBUG:boto:Port: 8000 2023-12-15T22:58:02.821 DEBUG:boto:Params: {} 2023-12-15T22:58:02.821 DEBUG:boto:Token: None 2023-12-15T22:58:02.821 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:58:02 GMT /kskgfn-18/obj 2023-12-15T22:58:02.821 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xB7LX38Ff0908U45hcMhS+NLYoY= 2023-12-15T22:58:02.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xB7LX38Ff0908U45hcMhS+NLYoY=', 'Content-Length': '0'} 2023-12-15T22:58:02.830 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000bcf6b7ae5f5232f5-00657cd9fa-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:02.831 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-17 2023-12-15T22:58:02.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:02.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:02.831 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:58:02.884 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:02.885 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:02.921 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:02.921+0000 7f7af8f2d800 1 waiting to reach incremental sync.. 2023-12-15T22:58:07.923 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:07.923+0000 7f7af8f2d800 1 bucket sync caught up with source: 2023-12-15T22:58:07.923 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000003.16.7, , ] 2023-12-15T22:58:07.924 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000003.16.7, , ] 2023-12-15T22:58:07.924 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:07.923+0000 7f7af8f2d800 0 bucket checkpoint complete 2023-12-15T22:58:07.943 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-17 2023-12-15T22:58:07.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:07.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:07.943 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:58:08.003 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:08.003 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:08.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:58:08.041+0000 7fbd0d123800 1 bucket sync caught up with source: 2023-12-15T22:58:08.042 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.48.14, , ] 2023-12-15T22:58:08.042 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000001.48.14, , ] 2023-12-15T22:58:08.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:58:08.041+0000 7fbd0d123800 0 bucket checkpoint complete 2023-12-15T22:58:08.057 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-17 zones={test-zone2, test-zone1} 2023-12-15T22:58:08.057 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.057 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.057 DEBUG:boto:Method: HEAD 2023-12-15T22:58:08.057 DEBUG:boto:Path: /kskgfn-17/ 2023-12-15T22:58:08.058 DEBUG:boto:Data: 2023-12-15T22:58:08.058 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.058 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:08.058 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.058 DEBUG:boto:Params: {} 2023-12-15T22:58:08.058 DEBUG:boto:Token: None 2023-12-15T22:58:08.058 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/ 2023-12-15T22:58:08.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9MEfccABzrW7PvT27AfJ1fPek84= 2023-12-15T22:58:08.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9MEfccABzrW7PvT27AfJ1fPek84=', 'Content-Length': '0'} 2023-12-15T22:58:08.061 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000072910e9f586b965d-00657cda00-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.061 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.061 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.061 DEBUG:boto:Method: HEAD 2023-12-15T22:58:08.061 DEBUG:boto:Path: /kskgfn-17/ 2023-12-15T22:58:08.061 DEBUG:boto:Data: 2023-12-15T22:58:08.061 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:08.062 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.062 DEBUG:boto:Params: {} 2023-12-15T22:58:08.062 DEBUG:boto:Token: None 2023-12-15T22:58:08.062 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/ 2023-12-15T22:58:08.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9MEfccABzrW7PvT27AfJ1fPek84= 2023-12-15T22:58:08.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9MEfccABzrW7PvT27AfJ1fPek84=', 'Content-Length': '0'} 2023-12-15T22:58:08.065 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000056ce913fcc0b1c23-00657cda00-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.065 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:58:08.065 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.065 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.065 DEBUG:boto:path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.065 DEBUG:boto:auth_path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.065 DEBUG:boto:Method: GET 2023-12-15T22:58:08.066 DEBUG:boto:Path: /kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.066 DEBUG:boto:Data: 2023-12-15T22:58:08.066 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.066 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:08.066 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.066 DEBUG:boto:Params: {} 2023-12-15T22:58:08.066 DEBUG:boto:Token: None 2023-12-15T22:58:08.066 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/?versions 2023-12-15T22:58:08.066 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY= 2023-12-15T22:58:08.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY=', 'Content-Length': '0'} 2023-12-15T22:58:08.069 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f31eead31933f4e-00657cda00-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.069 DEBUG:boto:b'kskgfn-17999falseobjnulltrue2023-12-15T22:58:02.796Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:08.069 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:58:08.070 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:58:08.070 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.070 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.070 DEBUG:boto:path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.070 DEBUG:boto:auth_path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.070 DEBUG:boto:Method: GET 2023-12-15T22:58:08.070 DEBUG:boto:Path: /kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.070 DEBUG:boto:Data: 2023-12-15T22:58:08.070 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:08.071 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.071 DEBUG:boto:Params: {} 2023-12-15T22:58:08.071 DEBUG:boto:Token: None 2023-12-15T22:58:08.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/?versions 2023-12-15T22:58:08.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY= 2023-12-15T22:58:08.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY=', 'Content-Length': '0'} 2023-12-15T22:58:08.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ae052408ef1328c-00657cda00-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.073 DEBUG:boto:b'kskgfn-17999falseobjnulltrue2023-12-15T22:58:02.796Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:08.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:58:08.074 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.074 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.074 DEBUG:boto:path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.074 DEBUG:boto:auth_path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.074 DEBUG:boto:Method: GET 2023-12-15T22:58:08.074 DEBUG:boto:Path: /kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.074 DEBUG:boto:Data: 2023-12-15T22:58:08.074 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.074 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:08.075 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.075 DEBUG:boto:Params: {} 2023-12-15T22:58:08.075 DEBUG:boto:Token: None 2023-12-15T22:58:08.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/?versions 2023-12-15T22:58:08.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY= 2023-12-15T22:58:08.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY=', 'Content-Length': '0'} 2023-12-15T22:58:08.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c1e6d68d2ca127f-00657cda00-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.078 DEBUG:boto:b'kskgfn-17999falseobjnulltrue2023-12-15T22:58:02.796Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:08.078 DEBUG:boto:path=/kskgfn-17/ 2023-12-15T22:58:08.078 DEBUG:boto:auth_path=/kskgfn-17/ 2023-12-15T22:58:08.079 DEBUG:boto:path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.079 DEBUG:boto:auth_path=/kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.079 DEBUG:boto:Method: GET 2023-12-15T22:58:08.079 DEBUG:boto:Path: /kskgfn-17/?versions&max-keys=999 2023-12-15T22:58:08.079 DEBUG:boto:Data: 2023-12-15T22:58:08.079 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.079 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:08.079 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.079 DEBUG:boto:Params: {} 2023-12-15T22:58:08.079 DEBUG:boto:Token: None 2023-12-15T22:58:08.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/?versions 2023-12-15T22:58:08.080 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY= 2023-12-15T22:58:08.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZcuwcS8gd/h7WVEq2YxMkBBhSY=', 'Content-Length': '0'} 2023-12-15T22:58:08.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000de9b5629d6025e4-00657cda00-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.082 DEBUG:boto:b'kskgfn-17999falseobjnulltrue2023-12-15T22:58:02.796Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:08.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:58:08.083 DEBUG:boto:path=/kskgfn-17/obj 2023-12-15T22:58:08.083 DEBUG:boto:auth_path=/kskgfn-17/obj 2023-12-15T22:58:08.083 DEBUG:boto:Method: HEAD 2023-12-15T22:58:08.083 DEBUG:boto:Path: /kskgfn-17/obj 2023-12-15T22:58:08.083 DEBUG:boto:Data: 2023-12-15T22:58:08.083 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.083 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:08.083 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.083 DEBUG:boto:Params: {} 2023-12-15T22:58:08.083 DEBUG:boto:Token: None 2023-12-15T22:58:08.084 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/obj 2023-12-15T22:58:08.084 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLo4/xgLx0+A3nXPrOzbY2+czyY= 2023-12-15T22:58:08.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLo4/xgLx0+A3nXPrOzbY2+czyY=', 'Content-Length': '0'} 2023-12-15T22:58:08.085 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000fdfd0233e34715b1-00657cda00-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.085 DEBUG:boto:path=/kskgfn-17/obj 2023-12-15T22:58:08.086 DEBUG:boto:auth_path=/kskgfn-17/obj 2023-12-15T22:58:08.086 DEBUG:boto:Method: HEAD 2023-12-15T22:58:08.086 DEBUG:boto:Path: /kskgfn-17/obj 2023-12-15T22:58:08.086 DEBUG:boto:Data: 2023-12-15T22:58:08.086 DEBUG:boto:Headers: {} 2023-12-15T22:58:08.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:08.086 DEBUG:boto:Port: 8000 2023-12-15T22:58:08.086 DEBUG:boto:Params: {} 2023-12-15T22:58:08.086 DEBUG:boto:Token: None 2023-12-15T22:58:08.086 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:08 GMT /kskgfn-17/obj 2023-12-15T22:58:08.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLo4/xgLx0+A3nXPrOzbY2+czyY= 2023-12-15T22:58:08.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLo4/xgLx0+A3nXPrOzbY2+czyY=', 'Content-Length': '0'} 2023-12-15T22:58:08.088 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000bb4c6694bc96b361-00657cda00-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:08.088 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-17 zones={test-zone2, test-zone1} 2023-12-15T22:58:08.088 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-18 2023-12-15T22:58:08.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:08.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:08.089 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T22:58:08.148 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:08.148 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:08.185 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:08.185+0000 7fa30b775800 1 waiting to reach incremental sync.. 2023-12-15T22:58:13.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:13.187+0000 7fa30b775800 1 bucket sync caught up with source: 2023-12-15T22:58:13.188 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.14.14, , ] 2023-12-15T22:58:13.188 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000001.14.14, , ] 2023-12-15T22:58:13.188 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:13.187+0000 7fa30b775800 0 bucket checkpoint complete 2023-12-15T22:58:13.204 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-18 2023-12-15T22:58:13.204 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:13.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T22:58:13.204 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T22:58:13.266 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:13.266 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:13.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:58:13.314+0000 7f5366940800 1 bucket sync caught up with source: 2023-12-15T22:58:13.315 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000003.38.7, , ] 2023-12-15T22:58:13.315 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000003.38.7, , ] 2023-12-15T22:58:13.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T22:58:13.314+0000 7f5366940800 0 bucket checkpoint complete 2023-12-15T22:58:13.330 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-18 zones={test-zone2, test-zone1} 2023-12-15T22:58:13.330 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.330 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.330 DEBUG:boto:Method: HEAD 2023-12-15T22:58:13.330 DEBUG:boto:Path: /kskgfn-18/ 2023-12-15T22:58:13.330 DEBUG:boto:Data: 2023-12-15T22:58:13.330 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.330 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.331 DEBUG:boto:Params: {} 2023-12-15T22:58:13.331 DEBUG:boto:Token: None 2023-12-15T22:58:13.331 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/ 2023-12-15T22:58:13.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1stZleW5k3ITY/xBIJEB48x2l6s= 2023-12-15T22:58:13.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1stZleW5k3ITY/xBIJEB48x2l6s=', 'Content-Length': '0'} 2023-12-15T22:58:13.333 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000986577a8f99279b6-00657cda05-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.334 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.334 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.334 DEBUG:boto:Method: HEAD 2023-12-15T22:58:13.334 DEBUG:boto:Path: /kskgfn-18/ 2023-12-15T22:58:13.334 DEBUG:boto:Data: 2023-12-15T22:58:13.334 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.334 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.334 DEBUG:boto:Params: {} 2023-12-15T22:58:13.335 DEBUG:boto:Token: None 2023-12-15T22:58:13.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/ 2023-12-15T22:58:13.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1stZleW5k3ITY/xBIJEB48x2l6s= 2023-12-15T22:58:13.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1stZleW5k3ITY/xBIJEB48x2l6s=', 'Content-Length': '0'} 2023-12-15T22:58:13.337 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc441f39e7af16c7-00657cda05-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.337 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T22:58:13.337 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.337 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.338 DEBUG:boto:path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.338 DEBUG:boto:auth_path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.338 DEBUG:boto:Method: GET 2023-12-15T22:58:13.338 DEBUG:boto:Path: /kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.338 DEBUG:boto:Data: 2023-12-15T22:58:13.338 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.338 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.338 DEBUG:boto:Params: {} 2023-12-15T22:58:13.338 DEBUG:boto:Token: None 2023-12-15T22:58:13.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/?versions 2023-12-15T22:58:13.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag= 2023-12-15T22:58:13.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag=', 'Content-Length': '0'} 2023-12-15T22:58:13.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8f768bcd2206cac-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.381 DEBUG:boto:b'kskgfn-18999falseobjnulltrue2023-12-15T22:58:02.824Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:13.382 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:58:13.382 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T22:58:13.382 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.382 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.382 DEBUG:boto:path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.382 DEBUG:boto:auth_path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.382 DEBUG:boto:Method: GET 2023-12-15T22:58:13.382 DEBUG:boto:Path: /kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.383 DEBUG:boto:Data: 2023-12-15T22:58:13.383 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.383 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.383 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.383 DEBUG:boto:Params: {} 2023-12-15T22:58:13.383 DEBUG:boto:Token: None 2023-12-15T22:58:13.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/?versions 2023-12-15T22:58:13.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag= 2023-12-15T22:58:13.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag=', 'Content-Length': '0'} 2023-12-15T22:58:13.386 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001052924cf8bc03a6-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.386 DEBUG:boto:b'kskgfn-18999falseobjnulltrue2023-12-15T22:58:02.824Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:13.386 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2023-12-15T22:58:13.386 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.386 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.387 DEBUG:boto:path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.387 DEBUG:boto:auth_path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.387 DEBUG:boto:Method: GET 2023-12-15T22:58:13.387 DEBUG:boto:Path: /kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.387 DEBUG:boto:Data: 2023-12-15T22:58:13.387 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.387 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.387 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.387 DEBUG:boto:Params: {} 2023-12-15T22:58:13.387 DEBUG:boto:Token: None 2023-12-15T22:58:13.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/?versions 2023-12-15T22:58:13.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag= 2023-12-15T22:58:13.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag=', 'Content-Length': '0'} 2023-12-15T22:58:13.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013a9ad4082b46bf6-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.390 DEBUG:boto:b'kskgfn-18999falseobjnulltrue2023-12-15T22:58:02.824Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:13.390 DEBUG:boto:path=/kskgfn-18/ 2023-12-15T22:58:13.391 DEBUG:boto:auth_path=/kskgfn-18/ 2023-12-15T22:58:13.391 DEBUG:boto:path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.391 DEBUG:boto:auth_path=/kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.391 DEBUG:boto:Method: GET 2023-12-15T22:58:13.391 DEBUG:boto:Path: /kskgfn-18/?versions&max-keys=999 2023-12-15T22:58:13.391 DEBUG:boto:Data: 2023-12-15T22:58:13.391 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.391 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.391 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.391 DEBUG:boto:Params: {} 2023-12-15T22:58:13.391 DEBUG:boto:Token: None 2023-12-15T22:58:13.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/?versions 2023-12-15T22:58:13.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag= 2023-12-15T22:58:13.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hiuf2HGR5mToSLw/ktci3bux1ag=', 'Content-Length': '0'} 2023-12-15T22:58:13.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc9167af8a1a298d-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.437 DEBUG:boto:b'kskgfn-18999falseobjnulltrue2023-12-15T22:58:02.824Zrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T22:58:13.438 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2023-12-15T22:58:13.438 DEBUG:boto:path=/kskgfn-18/obj 2023-12-15T22:58:13.438 DEBUG:boto:auth_path=/kskgfn-18/obj 2023-12-15T22:58:13.438 DEBUG:boto:Method: HEAD 2023-12-15T22:58:13.438 DEBUG:boto:Path: /kskgfn-18/obj 2023-12-15T22:58:13.438 DEBUG:boto:Data: 2023-12-15T22:58:13.438 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.438 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.438 DEBUG:boto:Params: {} 2023-12-15T22:58:13.439 DEBUG:boto:Token: None 2023-12-15T22:58:13.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/obj 2023-12-15T22:58:13.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tfYxVF7E3XwePgJKoxBEsIVqUXk= 2023-12-15T22:58:13.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tfYxVF7E3XwePgJKoxBEsIVqUXk=', 'Content-Length': '0'} 2023-12-15T22:58:13.441 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000021b891fdb20f91a9-00657cda05-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.441 DEBUG:boto:path=/kskgfn-18/obj 2023-12-15T22:58:13.441 DEBUG:boto:auth_path=/kskgfn-18/obj 2023-12-15T22:58:13.441 DEBUG:boto:Method: HEAD 2023-12-15T22:58:13.441 DEBUG:boto:Path: /kskgfn-18/obj 2023-12-15T22:58:13.441 DEBUG:boto:Data: 2023-12-15T22:58:13.441 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.441 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.441 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.441 DEBUG:boto:Params: {} 2023-12-15T22:58:13.442 DEBUG:boto:Token: None 2023-12-15T22:58:13.442 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-18/obj 2023-12-15T22:58:13.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tfYxVF7E3XwePgJKoxBEsIVqUXk= 2023-12-15T22:58:13.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tfYxVF7E3XwePgJKoxBEsIVqUXk=', 'Content-Length': '0'} 2023-12-15T22:58:13.443 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000ec69f1a78d4c558d-00657cda05-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.444 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-18 zones={test-zone2, test-zone1} 2023-12-15T22:58:13.444 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2023-12-15T22:58:13.445 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-19 2023-12-15T22:58:13.445 DEBUG:boto:path=/kskgfn-19/ 2023-12-15T22:58:13.445 DEBUG:boto:auth_path=/kskgfn-19/ 2023-12-15T22:58:13.445 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.445 DEBUG:boto:Path: /kskgfn-19/ 2023-12-15T22:58:13.445 DEBUG:boto:Data: 2023-12-15T22:58:13.445 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.445 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.445 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.445 DEBUG:boto:Params: {} 2023-12-15T22:58:13.446 DEBUG:boto:Token: None 2023-12-15T22:58:13.446 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-19/ 2023-12-15T22:58:13.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8hRoCHwik0krsNdcp94tzh3o/KA= 2023-12-15T22:58:13.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8hRoCHwik0krsNdcp94tzh3o/KA=', 'Content-Length': '0'} 2023-12-15T22:58:13.461 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000080455841103714e7-00657cda05-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.461 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-20 2023-12-15T22:58:13.462 DEBUG:boto:path=/kskgfn-20/ 2023-12-15T22:58:13.462 DEBUG:boto:auth_path=/kskgfn-20/ 2023-12-15T22:58:13.462 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.462 DEBUG:boto:Path: /kskgfn-20/ 2023-12-15T22:58:13.462 DEBUG:boto:Data: 2023-12-15T22:58:13.462 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.462 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.462 DEBUG:boto:Params: {} 2023-12-15T22:58:13.462 DEBUG:boto:Token: None 2023-12-15T22:58:13.462 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-20/ 2023-12-15T22:58:13.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fxki8bwL5WViEuVZjEL3lOXzyFY= 2023-12-15T22:58:13.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fxki8bwL5WViEuVZjEL3lOXzyFY=', 'Content-Length': '0'} 2023-12-15T22:58:13.493 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001d4e622714e2f5a1-00657cda05-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.493 DEBUG:boto:path=/kskgfn-19/ 2023-12-15T22:58:13.493 DEBUG:boto:auth_path=/kskgfn-19/ 2023-12-15T22:58:13.493 DEBUG:boto:path=/kskgfn-19/?versioning 2023-12-15T22:58:13.493 DEBUG:boto:auth_path=/kskgfn-19/?versioning 2023-12-15T22:58:13.493 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.494 DEBUG:boto:Path: /kskgfn-19/?versioning 2023-12-15T22:58:13.494 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:58:13.494 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.494 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.494 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.494 DEBUG:boto:Params: {} 2023-12-15T22:58:13.494 DEBUG:boto:Token: None 2023-12-15T22:58:13.494 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-19/?versioning 2023-12-15T22:58:13.494 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+V6yQE37pFxUdO2PjW0ys5vMlF0= 2023-12-15T22:58:13.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+V6yQE37pFxUdO2PjW0ys5vMlF0=', 'Content-Length': '228'} 2023-12-15T22:58:13.500 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f618d93d5a5d12d8-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.500 DEBUG:boto:path=/kskgfn-19/ 2023-12-15T22:58:13.500 DEBUG:boto:auth_path=/kskgfn-19/ 2023-12-15T22:58:13.500 DEBUG:boto:path=/kskgfn-19/?versioning 2023-12-15T22:58:13.501 DEBUG:boto:auth_path=/kskgfn-19/?versioning 2023-12-15T22:58:13.501 DEBUG:boto:Method: GET 2023-12-15T22:58:13.501 DEBUG:boto:Path: /kskgfn-19/?versioning 2023-12-15T22:58:13.501 DEBUG:boto:Data: 2023-12-15T22:58:13.501 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.501 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.501 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.501 DEBUG:boto:Params: {} 2023-12-15T22:58:13.501 DEBUG:boto:Token: None 2023-12-15T22:58:13.501 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-19/?versioning 2023-12-15T22:58:13.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:octz6wbfw3HP2hc9AEr+BNmkUMY= 2023-12-15T22:58:13.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:octz6wbfw3HP2hc9AEr+BNmkUMY=', 'Content-Length': '0'} 2023-12-15T22:58:13.503 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d65612c78080f082-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '192'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.545 DEBUG:boto:EnabledDisabled 2023-12-15T22:58:13.546 DEBUG:boto:path=/kskgfn-20/ 2023-12-15T22:58:13.546 DEBUG:boto:auth_path=/kskgfn-20/ 2023-12-15T22:58:13.546 DEBUG:boto:path=/kskgfn-20/?versioning 2023-12-15T22:58:13.546 DEBUG:boto:auth_path=/kskgfn-20/?versioning 2023-12-15T22:58:13.546 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.546 DEBUG:boto:Path: /kskgfn-20/?versioning 2023-12-15T22:58:13.547 DEBUG:boto:Data: Enabled Disabled 2023-12-15T22:58:13.547 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.547 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.547 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.547 DEBUG:boto:Params: {} 2023-12-15T22:58:13.547 DEBUG:boto:Token: None 2023-12-15T22:58:13.547 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-20/?versioning 2023-12-15T22:58:13.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7TUFYw8IkO++xAyQIA6PANOlP8c= 2023-12-15T22:58:13.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7TUFYw8IkO++xAyQIA6PANOlP8c=', 'Content-Length': '228'} 2023-12-15T22:58:13.557 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a34e4d1b4619cf80-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.557 DEBUG:boto:path=/kskgfn-20/ 2023-12-15T22:58:13.557 DEBUG:boto:auth_path=/kskgfn-20/ 2023-12-15T22:58:13.558 DEBUG:boto:path=/kskgfn-20/?versioning 2023-12-15T22:58:13.558 DEBUG:boto:auth_path=/kskgfn-20/?versioning 2023-12-15T22:58:13.558 DEBUG:boto:Method: GET 2023-12-15T22:58:13.558 DEBUG:boto:Path: /kskgfn-20/?versioning 2023-12-15T22:58:13.558 DEBUG:boto:Data: 2023-12-15T22:58:13.558 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.558 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.558 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.558 DEBUG:boto:Params: {} 2023-12-15T22:58:13.558 DEBUG:boto:Token: None 2023-12-15T22:58:13.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-20/?versioning 2023-12-15T22:58:13.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:48PU1vpl/OdJYrdUMKhPhjrW1fA= 2023-12-15T22:58:13.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:48PU1vpl/OdJYrdUMKhPhjrW1fA=', 'Content-Length': '0'} 2023-12-15T22:58:13.560 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000b7a7849b4f4ab105-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '192'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.560 DEBUG:boto:EnabledDisabled 2023-12-15T22:58:13.560 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2023-12-15T22:58:13.561 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-21 2023-12-15T22:58:13.561 DEBUG:boto:path=/kskgfn-21/ 2023-12-15T22:58:13.561 DEBUG:boto:auth_path=/kskgfn-21/ 2023-12-15T22:58:13.561 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.561 DEBUG:boto:Path: /kskgfn-21/ 2023-12-15T22:58:13.561 DEBUG:boto:Data: 2023-12-15T22:58:13.561 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.561 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.562 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.565 DEBUG:boto:Params: {} 2023-12-15T22:58:13.565 DEBUG:boto:Token: None 2023-12-15T22:58:13.565 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-21/ 2023-12-15T22:58:13.565 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PuXOxSUm4b9rsNP+PJbfnXGy0fE= 2023-12-15T22:58:13.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PuXOxSUm4b9rsNP+PJbfnXGy0fE=', 'Content-Length': '0'} 2023-12-15T22:58:13.582 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008ff4b0c0532ff859-00657cda05-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.582 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-22 2023-12-15T22:58:13.582 DEBUG:boto:path=/kskgfn-22/ 2023-12-15T22:58:13.582 DEBUG:boto:auth_path=/kskgfn-22/ 2023-12-15T22:58:13.582 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.582 DEBUG:boto:Path: /kskgfn-22/ 2023-12-15T22:58:13.582 DEBUG:boto:Data: 2023-12-15T22:58:13.582 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.583 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.583 DEBUG:boto:Params: {} 2023-12-15T22:58:13.583 DEBUG:boto:Token: None 2023-12-15T22:58:13.583 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-22/ 2023-12-15T22:58:13.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ywR0L/0aOgowS2my3SM+AEnnfY= 2023-12-15T22:58:13.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ywR0L/0aOgowS2my3SM+AEnnfY=', 'Content-Length': '0'} 2023-12-15T22:58:13.648 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ebfa957370ed1213-00657cda05-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.649 DEBUG:boto:path=/kskgfn-21/ 2023-12-15T22:58:13.649 DEBUG:boto:auth_path=/kskgfn-21/ 2023-12-15T22:58:13.649 DEBUG:boto:path=/kskgfn-21/?acl 2023-12-15T22:58:13.649 DEBUG:boto:auth_path=/kskgfn-21/?acl 2023-12-15T22:58:13.649 DEBUG:boto:Method: GET 2023-12-15T22:58:13.649 DEBUG:boto:Path: /kskgfn-21/?acl 2023-12-15T22:58:13.649 DEBUG:boto:Data: 2023-12-15T22:58:13.649 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.650 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.650 DEBUG:boto:Params: {} 2023-12-15T22:58:13.650 DEBUG:boto:Token: None 2023-12-15T22:58:13.650 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-21/?acl 2023-12-15T22:58:13.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GsDZVCUasKo018fXZgVIucnENG0= 2023-12-15T22:58:13.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GsDZVCUasKo018fXZgVIucnENG0=', 'Content-Length': '0'} 2023-12-15T22:58:13.651 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007c61df1389733df6-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '489'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.652 DEBUG:boto:path=/kskgfn-21/ 2023-12-15T22:58:13.652 DEBUG:boto:auth_path=/kskgfn-21/ 2023-12-15T22:58:13.652 DEBUG:boto:path=/kskgfn-21/?acl 2023-12-15T22:58:13.652 DEBUG:boto:auth_path=/kskgfn-21/?acl 2023-12-15T22:58:13.652 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.652 DEBUG:boto:Path: /kskgfn-21/?acl 2023-12-15T22:58:13.653 DEBUG:boto:Data: 2023-12-15T22:58:13.653 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:58:13.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.653 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.653 DEBUG:boto:Params: {} 2023-12-15T22:58:13.653 DEBUG:boto:Token: None 2023-12-15T22:58:13.653 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT x-amz-acl:public-read /kskgfn-21/?acl 2023-12-15T22:58:13.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G353MLTu4gJE4n/9K4Bj9m5wzYo= 2023-12-15T22:58:13.653 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G353MLTu4gJE4n/9K4Bj9m5wzYo=', 'Content-Length': '0'} 2023-12-15T22:58:13.659 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000630729464a326e0d-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.660 DEBUG:boto:path=/kskgfn-21/ 2023-12-15T22:58:13.660 DEBUG:boto:auth_path=/kskgfn-21/ 2023-12-15T22:58:13.660 DEBUG:boto:path=/kskgfn-21/?acl 2023-12-15T22:58:13.660 DEBUG:boto:auth_path=/kskgfn-21/?acl 2023-12-15T22:58:13.660 DEBUG:boto:Method: GET 2023-12-15T22:58:13.660 DEBUG:boto:Path: /kskgfn-21/?acl 2023-12-15T22:58:13.660 DEBUG:boto:Data: 2023-12-15T22:58:13.660 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.660 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.660 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.660 DEBUG:boto:Params: {} 2023-12-15T22:58:13.660 DEBUG:boto:Token: None 2023-12-15T22:58:13.661 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-21/?acl 2023-12-15T22:58:13.661 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GsDZVCUasKo018fXZgVIucnENG0= 2023-12-15T22:58:13.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GsDZVCUasKo018fXZgVIucnENG0=', 'Content-Length': '0'} 2023-12-15T22:58:13.662 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000062af92c0deda9a9c-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '681'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.662 DEBUG:boto:path=/kskgfn-22/ 2023-12-15T22:58:13.662 DEBUG:boto:auth_path=/kskgfn-22/ 2023-12-15T22:58:13.662 DEBUG:boto:path=/kskgfn-22/?acl 2023-12-15T22:58:13.662 DEBUG:boto:auth_path=/kskgfn-22/?acl 2023-12-15T22:58:13.662 DEBUG:boto:Method: GET 2023-12-15T22:58:13.662 DEBUG:boto:Path: /kskgfn-22/?acl 2023-12-15T22:58:13.663 DEBUG:boto:Data: 2023-12-15T22:58:13.663 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.663 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.663 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.663 DEBUG:boto:Params: {} 2023-12-15T22:58:13.663 DEBUG:boto:Token: None 2023-12-15T22:58:13.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-22/?acl 2023-12-15T22:58:13.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wPvANQsMJ4a+u+mJsPlNPyWdIC0= 2023-12-15T22:58:13.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wPvANQsMJ4a+u+mJsPlNPyWdIC0=', 'Content-Length': '0'} 2023-12-15T22:58:13.665 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000772cf8b776478e07-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '489'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.706 DEBUG:boto:path=/kskgfn-22/ 2023-12-15T22:58:13.706 DEBUG:boto:auth_path=/kskgfn-22/ 2023-12-15T22:58:13.706 DEBUG:boto:path=/kskgfn-22/?acl 2023-12-15T22:58:13.706 DEBUG:boto:auth_path=/kskgfn-22/?acl 2023-12-15T22:58:13.706 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.706 DEBUG:boto:Path: /kskgfn-22/?acl 2023-12-15T22:58:13.706 DEBUG:boto:Data: 2023-12-15T22:58:13.706 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2023-12-15T22:58:13.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.706 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.707 DEBUG:boto:Params: {} 2023-12-15T22:58:13.707 DEBUG:boto:Token: None 2023-12-15T22:58:13.707 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT x-amz-acl:public-read /kskgfn-22/?acl 2023-12-15T22:58:13.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qlmzAfnCEYkAXIXIafs0dckq8+4= 2023-12-15T22:58:13.707 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qlmzAfnCEYkAXIXIafs0dckq8+4=', 'Content-Length': '0'} 2023-12-15T22:58:13.716 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c83aabd7e6e8924f-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.717 DEBUG:boto:path=/kskgfn-22/ 2023-12-15T22:58:13.717 DEBUG:boto:auth_path=/kskgfn-22/ 2023-12-15T22:58:13.717 DEBUG:boto:path=/kskgfn-22/?acl 2023-12-15T22:58:13.717 DEBUG:boto:auth_path=/kskgfn-22/?acl 2023-12-15T22:58:13.717 DEBUG:boto:Method: GET 2023-12-15T22:58:13.717 DEBUG:boto:Path: /kskgfn-22/?acl 2023-12-15T22:58:13.717 DEBUG:boto:Data: 2023-12-15T22:58:13.717 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.717 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.717 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.717 DEBUG:boto:Params: {} 2023-12-15T22:58:13.718 DEBUG:boto:Token: None 2023-12-15T22:58:13.718 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-22/?acl 2023-12-15T22:58:13.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wPvANQsMJ4a+u+mJsPlNPyWdIC0= 2023-12-15T22:58:13.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wPvANQsMJ4a+u+mJsPlNPyWdIC0=', 'Content-Length': '0'} 2023-12-15T22:58:13.719 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000295e478c33de0032-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '681'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.720 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2023-12-15T22:58:13.720 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-23 2023-12-15T22:58:13.720 DEBUG:boto:path=/kskgfn-23/ 2023-12-15T22:58:13.720 DEBUG:boto:auth_path=/kskgfn-23/ 2023-12-15T22:58:13.720 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.721 DEBUG:boto:Path: /kskgfn-23/ 2023-12-15T22:58:13.721 DEBUG:boto:Data: 2023-12-15T22:58:13.721 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.721 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.721 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.721 DEBUG:boto:Params: {} 2023-12-15T22:58:13.721 DEBUG:boto:Token: None 2023-12-15T22:58:13.721 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-23/ 2023-12-15T22:58:13.721 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aETWFVxNPs6sbCs0E8oKWkLLeTU= 2023-12-15T22:58:13.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aETWFVxNPs6sbCs0E8oKWkLLeTU=', 'Content-Length': '0'} 2023-12-15T22:58:13.741 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000febf4e8808806466-00657cda05-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.741 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-24 2023-12-15T22:58:13.741 DEBUG:boto:path=/kskgfn-24/ 2023-12-15T22:58:13.741 DEBUG:boto:auth_path=/kskgfn-24/ 2023-12-15T22:58:13.741 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.741 DEBUG:boto:Path: /kskgfn-24/ 2023-12-15T22:58:13.741 DEBUG:boto:Data: 2023-12-15T22:58:13.741 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.741 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.741 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.741 DEBUG:boto:Params: {} 2023-12-15T22:58:13.742 DEBUG:boto:Token: None 2023-12-15T22:58:13.742 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-24/ 2023-12-15T22:58:13.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:42YpHXaf1Dfn/RsiZWXrr40+Qh4= 2023-12-15T22:58:13.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:42YpHXaf1Dfn/RsiZWXrr40+Qh4=', 'Content-Length': '0'} 2023-12-15T22:58:13.812 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000400a5baccfe90da5-00657cda05-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.812 DEBUG:boto:path=/kskgfn-23/ 2023-12-15T22:58:13.812 DEBUG:boto:auth_path=/kskgfn-23/ 2023-12-15T22:58:13.813 DEBUG:boto:path=/kskgfn-23/?cors 2023-12-15T22:58:13.813 DEBUG:boto:auth_path=/kskgfn-23/?cors 2023-12-15T22:58:13.813 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.813 DEBUG:boto:Path: /kskgfn-23/?cors 2023-12-15T22:58:13.813 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2023-12-15T22:58:13.813 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2023-12-15T22:58:13.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.813 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.813 DEBUG:boto:Params: {} 2023-12-15T22:58:13.813 DEBUG:boto:Token: None 2023-12-15T22:58:13.814 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-23/?cors 2023-12-15T22:58:13.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7wbmiQKoHhjeSLYvIanm8uGUk+8= 2023-12-15T22:58:13.814 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7wbmiQKoHhjeSLYvIanm8uGUk+8=', 'Content-Length': '218'} 2023-12-15T22:58:13.820 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e33c0283e4a5bfba-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.820 DEBUG:boto:path=/kskgfn-23/ 2023-12-15T22:58:13.820 DEBUG:boto:auth_path=/kskgfn-23/ 2023-12-15T22:58:13.821 DEBUG:boto:path=/kskgfn-23/?cors 2023-12-15T22:58:13.821 DEBUG:boto:auth_path=/kskgfn-23/?cors 2023-12-15T22:58:13.821 DEBUG:boto:Method: GET 2023-12-15T22:58:13.821 DEBUG:boto:Path: /kskgfn-23/?cors 2023-12-15T22:58:13.821 DEBUG:boto:Data: 2023-12-15T22:58:13.821 DEBUG:boto:Headers: {} 2023-12-15T22:58:13.821 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:13.821 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.821 DEBUG:boto:Params: {} 2023-12-15T22:58:13.821 DEBUG:boto:Token: None 2023-12-15T22:58:13.822 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-23/?cors 2023-12-15T22:58:13.822 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:an51HC62D/J/uZXaPTWUV6wpGB8= 2023-12-15T22:58:13.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:an51HC62D/J/uZXaPTWUV6wpGB8=', 'Content-Length': '0'} 2023-12-15T22:58:13.823 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005ffd75f272a098a7-00657cda05-4346-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '266'), ('Date', 'Fri, 15 Dec 2023 22:58:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:13.823 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2023-12-15T22:58:13.823 DEBUG:boto:path=/kskgfn-24/ 2023-12-15T22:58:13.824 DEBUG:boto:auth_path=/kskgfn-24/ 2023-12-15T22:58:13.824 DEBUG:boto:path=/kskgfn-24/?cors 2023-12-15T22:58:13.824 DEBUG:boto:auth_path=/kskgfn-24/?cors 2023-12-15T22:58:13.824 DEBUG:boto:Method: PUT 2023-12-15T22:58:13.824 DEBUG:boto:Path: /kskgfn-24/?cors 2023-12-15T22:58:13.824 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2023-12-15T22:58:13.824 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2023-12-15T22:58:13.824 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:13.824 DEBUG:boto:Port: 8000 2023-12-15T22:58:13.824 DEBUG:boto:Params: {} 2023-12-15T22:58:13.824 DEBUG:boto:Token: None 2023-12-15T22:58:13.825 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Fri, 15 Dec 2023 22:58:13 GMT /kskgfn-24/?cors 2023-12-15T22:58:13.825 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzgdC3ks4u4+uIcnTvAf5QarJig= 2023-12-15T22:58:13.825 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzgdC3ks4u4+uIcnTvAf5QarJig=', 'Content-Length': '218'} 2023-12-15T22:58:14.837 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000019a35ab780a47b7d-00657cda05-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:14.837 DEBUG:boto:path=/kskgfn-24/ 2023-12-15T22:58:14.838 DEBUG:boto:auth_path=/kskgfn-24/ 2023-12-15T22:58:14.838 DEBUG:boto:path=/kskgfn-24/?cors 2023-12-15T22:58:14.838 DEBUG:boto:auth_path=/kskgfn-24/?cors 2023-12-15T22:58:14.838 DEBUG:boto:Method: GET 2023-12-15T22:58:14.838 DEBUG:boto:Path: /kskgfn-24/?cors 2023-12-15T22:58:14.838 DEBUG:boto:Data: 2023-12-15T22:58:14.838 DEBUG:boto:Headers: {} 2023-12-15T22:58:14.838 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:14.838 DEBUG:boto:Port: 8000 2023-12-15T22:58:14.838 DEBUG:boto:Params: {} 2023-12-15T22:58:14.839 DEBUG:boto:Token: None 2023-12-15T22:58:14.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 22:58:14 GMT /kskgfn-24/?cors 2023-12-15T22:58:14.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cJVeTHZrThY22HBsslTaEPB3a9g= 2023-12-15T22:58:14.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cJVeTHZrThY22HBsslTaEPB3a9g=', 'Content-Length': '0'} 2023-12-15T22:58:14.840 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000014589201b4519119-00657cda06-4327-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '266'), ('Date', 'Fri, 15 Dec 2023 22:58:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:14.881 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2023-12-15T22:58:14.882 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2023-12-15T22:58:14.882 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-25 2023-12-15T22:58:14.883 DEBUG:boto:path=/kskgfn-25/ 2023-12-15T22:58:14.883 DEBUG:boto:auth_path=/kskgfn-25/ 2023-12-15T22:58:14.883 DEBUG:boto:Method: PUT 2023-12-15T22:58:14.883 DEBUG:boto:Path: /kskgfn-25/ 2023-12-15T22:58:14.883 DEBUG:boto:Data: 2023-12-15T22:58:14.883 DEBUG:boto:Headers: {} 2023-12-15T22:58:14.883 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:14.883 DEBUG:boto:Port: 8000 2023-12-15T22:58:14.883 DEBUG:boto:Params: {} 2023-12-15T22:58:14.883 DEBUG:boto:Token: None 2023-12-15T22:58:14.884 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:14 GMT /kskgfn-25/ 2023-12-15T22:58:14.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S4bB35hhzK77cmX9YC7EJR26zcU= 2023-12-15T22:58:14.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S4bB35hhzK77cmX9YC7EJR26zcU=', 'Content-Length': '0'} 2023-12-15T22:58:14.905 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008c657c5103f5bdf7-00657cda06-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:14.905 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-26 2023-12-15T22:58:14.905 DEBUG:boto:path=/kskgfn-26/ 2023-12-15T22:58:14.905 DEBUG:boto:auth_path=/kskgfn-26/ 2023-12-15T22:58:14.905 DEBUG:boto:Method: PUT 2023-12-15T22:58:14.905 DEBUG:boto:Path: /kskgfn-26/ 2023-12-15T22:58:14.906 DEBUG:boto:Data: 2023-12-15T22:58:14.906 DEBUG:boto:Headers: {} 2023-12-15T22:58:14.906 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:14.906 DEBUG:boto:Port: 8000 2023-12-15T22:58:14.906 DEBUG:boto:Params: {} 2023-12-15T22:58:14.906 DEBUG:boto:Token: None 2023-12-15T22:58:14.906 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:14 GMT /kskgfn-26/ 2023-12-15T22:58:14.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f8x6G5TtgzhbGRTwsCWiOZ744r8= 2023-12-15T22:58:14.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f8x6G5TtgzhbGRTwsCWiOZ744r8=', 'Content-Length': '0'} 2023-12-15T22:58:14.941 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000db817dddb6da6dd1-00657cda06-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:14.942 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:14.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:14.942 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:14.993 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:14.993 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.025 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:58:15.040 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681094.927294_138.1","last_update":"2023-12-15T22:58:14.927294Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:58:15.041 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681094.927294_138.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.041 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:58:15.041 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.041 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:15.092 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:15.092 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:15.121+0000 7f3a21d20800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:15.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:15.122+0000 7f3a21d20800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:15.137 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681094.927294_138.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:14.927294Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.137 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681094.927294_138.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:14.927294Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.137 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681094.927294_138.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:14.927294Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:58:15.138 DEBUG:rgw_multi.tests:log_status={0: '1_1702681094.927294_138.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.138 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681094.927294_138.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.138 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:58:15.138 DEBUG:boto:path=/kskgfn-25/ 2023-12-15T22:58:15.138 DEBUG:boto:auth_path=/kskgfn-25/ 2023-12-15T22:58:15.138 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.138 DEBUG:boto:Path: /kskgfn-25/ 2023-12-15T22:58:15.138 DEBUG:boto:Data: 2023-12-15T22:58:15.138 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.139 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.139 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.139 DEBUG:boto:Params: {} 2023-12-15T22:58:15.139 DEBUG:boto:Token: None 2023-12-15T22:58:15.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-25/ 2023-12-15T22:58:15.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xIupr/gfZ+mmUWMDu01v1sRuH3U= 2023-12-15T22:58:15.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xIupr/gfZ+mmUWMDu01v1sRuH3U=', 'Content-Length': '0'} 2023-12-15T22:58:15.141 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ad473b2a89e098b6-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.142 DEBUG:boto:path=/kskgfn-25/foo 2023-12-15T22:58:15.142 DEBUG:boto:auth_path=/kskgfn-25/foo 2023-12-15T22:58:15.142 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.142 DEBUG:boto:Path: /kskgfn-25/foo 2023-12-15T22:58:15.142 DEBUG:boto:Data: 2023-12-15T22:58:15.142 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T22:58:15.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.143 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.143 DEBUG:boto:Params: {} 2023-12-15T22:58:15.143 DEBUG:boto:Token: None 2023-12-15T22:58:15.143 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-25/foo 2023-12-15T22:58:15.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dicEYWfSrsLnvxVIO/0X5WkZHkE= 2023-12-15T22:58:15.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dicEYWfSrsLnvxVIO/0X5WkZHkE='} 2023-12-15T22:58:15.150 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003c4be3ae4372dd16-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.150 DEBUG:boto:path=/kskgfn-25/ 2023-12-15T22:58:15.150 DEBUG:boto:auth_path=/kskgfn-25/ 2023-12-15T22:58:15.150 DEBUG:boto:Method: DELETE 2023-12-15T22:58:15.150 DEBUG:boto:Path: /kskgfn-25/ 2023-12-15T22:58:15.150 DEBUG:boto:Data: 2023-12-15T22:58:15.151 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.151 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.151 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.151 DEBUG:boto:Params: {} 2023-12-15T22:58:15.151 DEBUG:boto:Token: None 2023-12-15T22:58:15.151 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-25/ 2023-12-15T22:58:15.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jUUUJkQyLdnUb1KU9Gh2NZx/9Gk= 2023-12-15T22:58:15.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jUUUJkQyLdnUb1KU9Gh2NZx/9Gk=', 'Content-Length': '0'} 2023-12-15T22:58:15.159 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx0000041d863ab438e9a90-00657cda07-4346-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.202 DEBUG:boto:path=/kskgfn-26/ 2023-12-15T22:58:15.202 DEBUG:boto:auth_path=/kskgfn-26/ 2023-12-15T22:58:15.202 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.202 DEBUG:boto:Path: /kskgfn-26/ 2023-12-15T22:58:15.202 DEBUG:boto:Data: 2023-12-15T22:58:15.202 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.202 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.202 DEBUG:boto:Params: {} 2023-12-15T22:58:15.203 DEBUG:boto:Token: None 2023-12-15T22:58:15.203 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-26/ 2023-12-15T22:58:15.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DMsTw9Lvl5fA7Necen58Hs58hNo= 2023-12-15T22:58:15.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DMsTw9Lvl5fA7Necen58Hs58hNo=', 'Content-Length': '0'} 2023-12-15T22:58:15.206 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dcef1d0d38ffc183-00657cda07-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.206 DEBUG:boto:path=/kskgfn-26/foo 2023-12-15T22:58:15.207 DEBUG:boto:auth_path=/kskgfn-26/foo 2023-12-15T22:58:15.207 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.207 DEBUG:boto:Path: /kskgfn-26/foo 2023-12-15T22:58:15.207 DEBUG:boto:Data: 2023-12-15T22:58:15.207 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T22:58:15.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.207 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.207 DEBUG:boto:Params: {} 2023-12-15T22:58:15.207 DEBUG:boto:Token: None 2023-12-15T22:58:15.207 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-26/foo 2023-12-15T22:58:15.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uURTxrllzrSdBEFn6ebvk4nhCMM= 2023-12-15T22:58:15.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uURTxrllzrSdBEFn6ebvk4nhCMM='} 2023-12-15T22:58:15.214 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075bbfebb3bb355b5-00657cda07-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.214 DEBUG:boto:path=/kskgfn-26/ 2023-12-15T22:58:15.214 DEBUG:boto:auth_path=/kskgfn-26/ 2023-12-15T22:58:15.214 DEBUG:boto:Method: DELETE 2023-12-15T22:58:15.214 DEBUG:boto:Path: /kskgfn-26/ 2023-12-15T22:58:15.214 DEBUG:boto:Data: 2023-12-15T22:58:15.214 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.215 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.215 DEBUG:boto:Params: {} 2023-12-15T22:58:15.215 DEBUG:boto:Token: None 2023-12-15T22:58:15.215 DEBUG:boto:StringToSign: DELETE Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-26/ 2023-12-15T22:58:15.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWLUmMLxQkDfyk3QAf4asRpok/o= 2023-12-15T22:58:15.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWLUmMLxQkDfyk3QAf4asRpok/o=', 'Content-Length': '0'} 2023-12-15T22:58:15.222 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx00000088d8a036689f9ef-00657cda07-4327-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.265 DEBUG:boto:path=/kskgfn-25/ 2023-12-15T22:58:15.266 DEBUG:boto:auth_path=/kskgfn-25/ 2023-12-15T22:58:15.266 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.266 DEBUG:boto:Path: /kskgfn-25/ 2023-12-15T22:58:15.266 DEBUG:boto:Data: 2023-12-15T22:58:15.266 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.266 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.266 DEBUG:boto:Params: {} 2023-12-15T22:58:15.266 DEBUG:boto:Token: None 2023-12-15T22:58:15.267 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-25/ 2023-12-15T22:58:15.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xIupr/gfZ+mmUWMDu01v1sRuH3U= 2023-12-15T22:58:15.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xIupr/gfZ+mmUWMDu01v1sRuH3U=', 'Content-Length': '0'} 2023-12-15T22:58:15.269 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e3643e5886e50a76-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.269 DEBUG:boto:path=/kskgfn-26/ 2023-12-15T22:58:15.269 DEBUG:boto:auth_path=/kskgfn-26/ 2023-12-15T22:58:15.269 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.269 DEBUG:boto:Path: /kskgfn-26/ 2023-12-15T22:58:15.269 DEBUG:boto:Data: 2023-12-15T22:58:15.269 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.269 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.269 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.270 DEBUG:boto:Params: {} 2023-12-15T22:58:15.270 DEBUG:boto:Token: None 2023-12-15T22:58:15.270 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-26/ 2023-12-15T22:58:15.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DMsTw9Lvl5fA7Necen58Hs58hNo= 2023-12-15T22:58:15.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DMsTw9Lvl5fA7Necen58Hs58hNo=', 'Content-Length': '0'} 2023-12-15T22:58:15.272 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000005cab17a656902da-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.272 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2023-12-15T22:58:15.273 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... SKIP: test_multi_period_incremental_sync skipped. Requires 3 or more zones in master zonegroup. 2023-12-15T22:58:15.273 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-27 2023-12-15T22:58:15.273 DEBUG:boto:path=/kskgfn-27/ 2023-12-15T22:58:15.273 DEBUG:boto:auth_path=/kskgfn-27/ 2023-12-15T22:58:15.273 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.273 DEBUG:boto:Path: /kskgfn-27/ 2023-12-15T22:58:15.274 DEBUG:boto:Data: 2023-12-15T22:58:15.274 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.274 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.274 DEBUG:boto:Params: {} 2023-12-15T22:58:15.274 DEBUG:boto:Token: None 2023-12-15T22:58:15.274 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-27/ 2023-12-15T22:58:15.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bP4oCL0Z87w/G8D1ajpbXKNGc0g= 2023-12-15T22:58:15.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bP4oCL0Z87w/G8D1ajpbXKNGc0g=', 'Content-Length': '0'} 2023-12-15T22:58:15.290 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001a2c185a2135b628-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.290 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-28 2023-12-15T22:58:15.290 DEBUG:boto:path=/kskgfn-28/ 2023-12-15T22:58:15.290 DEBUG:boto:auth_path=/kskgfn-28/ 2023-12-15T22:58:15.291 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.291 DEBUG:boto:Path: /kskgfn-28/ 2023-12-15T22:58:15.291 DEBUG:boto:Data: 2023-12-15T22:58:15.291 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.291 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.291 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.291 DEBUG:boto:Params: {} 2023-12-15T22:58:15.291 DEBUG:boto:Token: None 2023-12-15T22:58:15.291 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-28/ 2023-12-15T22:58:15.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QttQ8mGu5wRElKisYB1jZW5jvjw= 2023-12-15T22:58:15.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QttQ8mGu5wRElKisYB1jZW5jvjw=', 'Content-Length': '0'} 2023-12-15T22:58:15.320 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002fa66f6ef122b742-00657cda07-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.321 DEBUG:boto:path=/kskgfn-27/ 2023-12-15T22:58:15.321 DEBUG:boto:auth_path=/kskgfn-27/ 2023-12-15T22:58:15.321 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.321 DEBUG:boto:Path: /kskgfn-27/ 2023-12-15T22:58:15.321 DEBUG:boto:Data: 2023-12-15T22:58:15.321 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.321 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.321 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.321 DEBUG:boto:Params: {} 2023-12-15T22:58:15.322 DEBUG:boto:Token: None 2023-12-15T22:58:15.322 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-27/ 2023-12-15T22:58:15.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ha/HlE8gNKhzcrpB0TpDmNmzBCI= 2023-12-15T22:58:15.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ha/HlE8gNKhzcrpB0TpDmNmzBCI=', 'Content-Length': '0'} 2023-12-15T22:58:15.324 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000019aaf5bbe72a9852-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.324 DEBUG:boto:path=/kskgfn-27/key 2023-12-15T22:58:15.324 DEBUG:boto:auth_path=/kskgfn-27/key 2023-12-15T22:58:15.324 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.325 DEBUG:boto:Path: /kskgfn-27/key 2023-12-15T22:58:15.325 DEBUG:boto:Data: 2023-12-15T22:58:15.325 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2023-12-15T22:58:15.325 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:58:15.325 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.325 DEBUG:boto:Params: {} 2023-12-15T22:58:15.325 DEBUG:boto:Token: None 2023-12-15T22:58:15.325 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-27/key 2023-12-15T22:58:15.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1OOfXC6YsR4G6O6qU9/4lCP8gUA= 2023-12-15T22:58:15.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1OOfXC6YsR4G6O6qU9/4lCP8gUA='} 2023-12-15T22:58:15.332 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f5110abe8f82dac-00657cda07-4346-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.332 DEBUG:boto:path=/kskgfn-28/ 2023-12-15T22:58:15.332 DEBUG:boto:auth_path=/kskgfn-28/ 2023-12-15T22:58:15.333 DEBUG:boto:Method: HEAD 2023-12-15T22:58:15.333 DEBUG:boto:Path: /kskgfn-28/ 2023-12-15T22:58:15.333 DEBUG:boto:Data: 2023-12-15T22:58:15.333 DEBUG:boto:Headers: {} 2023-12-15T22:58:15.333 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.333 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.333 DEBUG:boto:Params: {} 2023-12-15T22:58:15.333 DEBUG:boto:Token: None 2023-12-15T22:58:15.333 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-28/ 2023-12-15T22:58:15.333 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PN2AErjLg4ULxGlY0geHuAOiZfA= 2023-12-15T22:58:15.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PN2AErjLg4ULxGlY0geHuAOiZfA=', 'Content-Length': '0'} 2023-12-15T22:58:15.336 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000032c883f9497f8a02-00657cda07-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.336 DEBUG:boto:path=/kskgfn-28/key 2023-12-15T22:58:15.336 DEBUG:boto:auth_path=/kskgfn-28/key 2023-12-15T22:58:15.336 DEBUG:boto:Method: PUT 2023-12-15T22:58:15.336 DEBUG:boto:Path: /kskgfn-28/key 2023-12-15T22:58:15.336 DEBUG:boto:Data: 2023-12-15T22:58:15.337 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2023-12-15T22:58:15.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T22:58:15.337 DEBUG:boto:Port: 8000 2023-12-15T22:58:15.337 DEBUG:boto:Params: {} 2023-12-15T22:58:15.337 DEBUG:boto:Token: None 2023-12-15T22:58:15.337 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Fri, 15 Dec 2023 22:58:15 GMT /kskgfn-28/key 2023-12-15T22:58:15.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fWNy71Zt8LEe8S8nJ8lOXiNcCuE= 2023-12-15T22:58:15.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:58:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fWNy71Zt8LEe8S8nJ8lOXiNcCuE='} 2023-12-15T22:58:15.343 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000914efcbfec2db017-00657cda07-4327-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:58:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:58:15.344 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.344 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:15.389 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:15.389 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:58:15.436 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681095.309781_146.1","last_update":"2023-12-15T22:58:15.309781Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:58:15.436 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.436 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:58:15.436 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.437 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:15.482 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:15.483 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:15.509+0000 7f6283bdc800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:15.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:58:15.511+0000 7f6283bdc800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:58:15.526 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.526 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.526 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:58:15.526 DEBUG:rgw_multi.tests:log_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.527 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:58:15.527 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T22:58:15.527 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T22:58:15.527 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.527 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:15.572 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:15.572 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.620 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000002204","last_update":"2023-12-15T22:56:24.211436Z"},{"marker":"00000000000000000000:00000000000000001072","last_update":"2023-12-15T22:58:15.150312Z"},{"marker":"00000000000000000000:00000000000000000933","last_update":"2023-12-15T22:55:26.961460Z"},{"marker":"00000000000000000000:00000000000000003046","last_update":"2023-12-15T22:58:15.332498Z"}] 2023-12-15T22:58:15.620 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000001072', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003046'} 2023-12-15T22:58:15.620 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T22:58:15.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:15.621 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:15.668 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:15.668 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:15.714 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:20.488953Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002623","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:07.843601Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.714 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000932","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:20.488953Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002623","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:07.843601Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:58:15Z"} 2023-12-15T22:58:15.714 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002204', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:24.211436Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000932', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:20.488953Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002623', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:07.843601Z'}}] 2023-12-15T22:58:15.714 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000001072', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003046'} 2023-12-15T22:58:15.715 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000000932', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000002623'} 2023-12-15T22:58:15.715 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=00000000000000000000:00000000000000001072 target=00000000000000000000:00000000000000000932, shard=3 master=00000000000000000000:00000000000000003046 target=00000000000000000000:00000000000000002623 2023-12-15T22:58:20.716 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.716 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:20.771 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:20.772 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:20.821 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:58:20Z"} 2023-12-15T22:58:20.821 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002204","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:24.211436Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T22:58:20Z"} 2023-12-15T22:58:20.821 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002204', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:24.211436Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.734852Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:18.005998Z'}}] 2023-12-15T22:58:20.821 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000001072', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003046'} 2023-12-15T22:58:20.822 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002204', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003187'} 2023-12-15T22:58:20.822 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T22:58:20.822 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T22:58:20.822 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.822 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:20.867 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:20.868 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:20.917 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000001499","last_update":"2023-12-15T22:56:16.623627Z"},{"marker":"00000000000000000000:00000000000000001214","last_update":"2023-12-15T22:58:17.773774Z"},{"marker":"00000000000000000000:00000000000000001497","last_update":"2023-12-15T22:55:46.250275Z"},{"marker":"00000000000000000000:00000000000000002905","last_update":"2023-12-15T22:58:20.260824Z"}] 2023-12-15T22:58:20.917 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000002905'} 2023-12-15T22:58:20.917 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T22:58:20.918 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:20.918 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:21.026 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001072","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:15.214363Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002623","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:15.343882Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:58:21Z"} 2023-12-15T22:58:21.027 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001072","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:15.214363Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002623","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:15.343882Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:58:21Z"} 2023-12-15T22:58:21.027 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001499', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:16.623627Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001072', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.214363Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001497', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T22:55:46.250275Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002623', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.343882Z'}}] 2023-12-15T22:58:21.027 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000002905'} 2023-12-15T22:58:21.027 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000001072', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000002623'} 2023-12-15T22:58:21.027 WARNING:rgw_multi.tests:data of zone test-zone1 behind zone test-zone2: shard=1 master=00000000000000000000:00000000000000001214 target=00000000000000000000:00000000000000001072, shard=3 master=00000000000000000000:00000000000000002905 target=00000000000000000000:00000000000000002623 2023-12-15T22:58:26.028 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.029 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.085 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.085 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.140 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.773774Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:20.260824Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:58:26Z"} 2023-12-15T22:58:26.141 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001499","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:56:16.623627Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.773774Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001497","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T22:55:46.250275Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002905","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:20.260824Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T22:58:26Z"} 2023-12-15T22:58:26.141 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001499', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:56:16.623627Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.773774Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001497', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T22:55:46.250275Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002905', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:20.260824Z'}}] 2023-12-15T22:58:26.141 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000002905'} 2023-12-15T22:58:26.141 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000001499', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000001497', 3: '00000000000000000000:00000000000000002905'} 2023-12-15T22:58:26.141 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T22:58:26.141 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.142 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.187 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.187 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.238 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000002204","last_update":"2023-12-15T22:56:24.211436Z"},{"marker":"00000000000000000000:00000000000000001214","last_update":"2023-12-15T22:58:17.734852Z"},{"marker":"00000000000000000000:00000000000000000933","last_update":"2023-12-15T22:55:26.961460Z"},{"marker":"00000000000000000000:00000000000000003187","last_update":"2023-12-15T22:58:18.005998Z"}] 2023-12-15T22:58:26.238 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:26.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:26.239 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T22:58:26.279 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.279 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.337 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.337 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.423 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.423 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.470 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T22:58:26.470 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.471 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.516 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.516 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.559 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T22:58:26.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.559 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.604 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.604 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.645 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T22:58:26.646 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.646 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 3 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.691 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.692 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.733 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T22:58:26.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.734 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:26.782 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.783 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.837 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000001499","last_update":"2023-12-15T22:56:16.623627Z"},{"marker":"00000000000000000000:00000000000000001214","last_update":"2023-12-15T22:58:17.773774Z"},{"marker":"00000000000000000000:00000000000000001497","last_update":"2023-12-15T22:55:46.250275Z"},{"marker":"00000000000000000000:00000000000000002905","last_update":"2023-12-15T22:58:20.260824Z"}] 2023-12-15T22:58:26.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:26.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:26.837 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:58:26.879 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:26.880 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:26.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:26.933 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 0 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:27.019 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.019 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.064 INFO:teuthology.orchestra.run.smithi188.stdout:[] 2023-12-15T22:58:27.064 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.065 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 1 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:27.110 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.110 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.154 INFO:teuthology.orchestra.run.smithi188.stdout:[] 2023-12-15T22:58:27.155 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.155 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 2 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:27.200 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.200 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.244 INFO:teuthology.orchestra.run.smithi188.stdout:[] 2023-12-15T22:58:27.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:58:27.244 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 3 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:58:27.291 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.291 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.331 INFO:teuthology.orchestra.run.smithi188.stdout:[] 2023-12-15T22:58:27.332 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2023-12-15T22:58:27.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:27.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:27.333 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:58:27.377 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.378 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.398 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T22:58:27.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:27.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T22:58:27.399 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T22:58:27.443 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:58:27.443 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:58:27.489 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T22:58:27.529 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":3,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T22:58:27.530 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2023-12-15T22:59:57.530 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-29 2023-12-15T22:59:57.531 DEBUG:boto:path=/kskgfn-29/ 2023-12-15T22:59:57.532 DEBUG:boto:auth_path=/kskgfn-29/ 2023-12-15T22:59:57.532 DEBUG:boto:Method: PUT 2023-12-15T22:59:57.532 DEBUG:boto:Path: /kskgfn-29/ 2023-12-15T22:59:57.532 DEBUG:boto:Data: 2023-12-15T22:59:57.532 DEBUG:boto:Headers: {} 2023-12-15T22:59:57.532 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:59:57.532 DEBUG:boto:Port: 8000 2023-12-15T22:59:57.532 DEBUG:boto:Params: {} 2023-12-15T22:59:57.533 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T22:59:57.533 DEBUG:boto:Token: None 2023-12-15T22:59:57.533 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 22:59:57 GMT /kskgfn-29/ 2023-12-15T22:59:57.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jy4zHKHqsvvMd9TtVKNs8frTlok= 2023-12-15T22:59:57.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 22:59:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jy4zHKHqsvvMd9TtVKNs8frTlok=', 'Content-Length': '0'} 2023-12-15T22:59:57.556 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cfc9bb12cb0e321e-00657cda6d-4630-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 22:59:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:59:57.557 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T22:59:57.557 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T22:59:57.557 DEBUG:boto:Method: PUT 2023-12-15T22:59:57.557 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T22:59:57.557 DEBUG:boto:Data: 2023-12-15T22:59:57.557 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T22:59:57.557 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T22:59:57.557 DEBUG:boto:Port: 8000 2023-12-15T22:59:57.557 DEBUG:boto:Params: {} 2023-12-15T22:59:57.558 DEBUG:boto:Token: None 2023-12-15T22:59:57.558 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Fri, 15 Dec 2023 22:59:57 GMT /kskgfn-29/testredirect 2023-12-15T22:59:57.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9VOLiN2EkWTqLoQd2BbwIuTaR0Y= 2023-12-15T22:59:57.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 22:59:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9VOLiN2EkWTqLoQd2BbwIuTaR0Y='} 2023-12-15T22:59:57.568 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004dcedd4f590cfde3-00657cda6d-4630-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 22:59:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T22:59:57.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:59:57.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:59:57.569 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:59:57.622 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:59:57.623 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:59:57.656 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T22:59:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681197.554995_164.1","last_update":"2023-12-15T22:59:57.554995Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T22:59:57.672 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:59:57.672 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T22:59:57.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:59:57.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T22:59:57.672 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T22:59:57.724 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T22:59:57.724 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T22:59:57.755 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:59:57.755+0000 7fd6c7f75800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:59:57.756 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T22:59:57.757+0000 7fd6c7f75800 20 RGW-SYNC:meta: read sync status 2023-12-15T22:59:57.771 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:59:57Z"} 2023-12-15T22:59:57.772 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T22:59:57Z"} 2023-12-15T22:59:57.772 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T22:59:57.772 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:59:57.772 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T22:59:57.772 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:02.773 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:02.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:02.774 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:02.827 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:02.827 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:02.858 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:02.858+0000 7f94c9b46800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:02.859 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:02.859+0000 7f94c9b46800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:02.875 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:02Z"} 2023-12-15T23:00:02.875 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:02Z"} 2023-12-15T23:00:02.876 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:02.876 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:02.876 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:02.876 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:07.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:07.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:07.877 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:07.930 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:07.930 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:07.960 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:07.961+0000 7f5b94ec0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:07.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:07.962+0000 7f5b94ec0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:07.977 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:07Z"} 2023-12-15T23:00:07.977 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:07Z"} 2023-12-15T23:00:07.977 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:07.977 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:07.978 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:07.978 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:12.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:12.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:12.979 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:13.032 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:13.032 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:13.064 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:13.064+0000 7f4ccab3e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:13.065 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:13.065+0000 7f4ccab3e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:13.081 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:13Z"} 2023-12-15T23:00:13.081 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:13Z"} 2023-12-15T23:00:13.081 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:13.081 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:13.081 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:13.081 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:18.082 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:18.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:18.083 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:18.136 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:18.136 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:18.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:18.167+0000 7fa979a12800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:18.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:18.168+0000 7fa979a12800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:18.184 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:18Z"} 2023-12-15T23:00:18.184 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:18Z"} 2023-12-15T23:00:18.184 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:18.185 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:18.185 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:18.185 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:23.186 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:23.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:23.186 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:23.239 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:23.239 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:23.272 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:23.272+0000 7fc0d3332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:23.274 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:23.274+0000 7fc0d3332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:23.290 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:23Z"} 2023-12-15T23:00:23.290 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681095.309781_146.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:58:15.309781Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:23Z"} 2023-12-15T23:00:23.290 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681095.309781_146.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:58:15.309781Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:23.290 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:23.291 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681095.309781_146.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:23.291 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681197.554995_164.1 target=1_1702681095.309781_146.1 2023-12-15T23:00:28.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:28.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:00:28.292 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:00:28.347 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:28.347 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:28.379 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:28.379+0000 7f2b69d3a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:28.381 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:00:28.381+0000 7f2b69d3a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:00:28.396 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:28Z"} 2023-12-15T23:00:28.396 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:00:28Z"} 2023-12-15T23:00:28.397 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:00:28.397 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:28.397 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:00:28.397 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:00:28.397 DEBUG:boto:path=/kskgfn-29/ 2023-12-15T23:00:28.397 DEBUG:boto:auth_path=/kskgfn-29/ 2023-12-15T23:00:28.397 DEBUG:boto:Method: HEAD 2023-12-15T23:00:28.397 DEBUG:boto:Path: /kskgfn-29/ 2023-12-15T23:00:28.397 DEBUG:boto:Data: 2023-12-15T23:00:28.398 DEBUG:boto:Headers: {} 2023-12-15T23:00:28.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:00:28.398 DEBUG:boto:Port: 8000 2023-12-15T23:00:28.398 DEBUG:boto:Params: {} 2023-12-15T23:00:28.398 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:00:28.398 DEBUG:boto:Token: None 2023-12-15T23:00:28.398 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:00:28 GMT /kskgfn-29/ 2023-12-15T23:00:28.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FOMuHSv+FJr4K0fIuwr1LRexaqo= 2023-12-15T23:00:28.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:00:28 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FOMuHSv+FJr4K0fIuwr1LRexaqo=', 'Content-Length': '0'} 2023-12-15T23:00:28.404 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000edd6b6341f510d20-00657cda8c-4673-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:00:28 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:00:28.404 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:00:28.404 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:00:28.404 DEBUG:boto:Method: HEAD 2023-12-15T23:00:28.404 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:00:28.404 DEBUG:boto:Data: 2023-12-15T23:00:28.404 DEBUG:boto:Headers: {} 2023-12-15T23:00:28.404 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:00:28.405 DEBUG:boto:Port: 8000 2023-12-15T23:00:28.405 DEBUG:boto:Params: {} 2023-12-15T23:00:28.405 DEBUG:boto:Token: None 2023-12-15T23:00:28.405 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:00:28 GMT /kskgfn-29/testredirect 2023-12-15T23:00:28.405 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ypw0wfw9lTQAZKU+IB1BgzQV6VY= 2023-12-15T23:00:28.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:00:28 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ypw0wfw9lTQAZKU+IB1BgzQV6VY=', 'Content-Length': '0'} 2023-12-15T23:00:28.407 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000005c5768846bc1691d-00657cda8c-4673-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:00:28 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:00:28.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:00:28.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:00:28.407 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:00:28.452 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:28.452 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:28.473 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T23:00:28.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:00:28.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:00:28.474 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:00:28.517 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:00:28.518 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:00:28.564 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T23:00:28.603 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":4,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:00:28.603 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "85829102-5436-4ffc-bbf4-ae2b811bdc9c" 2023-12-15T23:01:58.605 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.605 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.606 DEBUG:boto:Method: HEAD 2023-12-15T23:01:58.606 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.606 DEBUG:boto:Data: 2023-12-15T23:01:58.606 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.606 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.606 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.606 DEBUG:boto:Params: {} 2023-12-15T23:01:58.607 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.607 DEBUG:boto:Token: None 2023-12-15T23:01:58.607 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6UjrnyZnGgICYmc+ddlZWljP4aQ= 2023-12-15T23:01:58.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6UjrnyZnGgICYmc+ddlZWljP4aQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.614 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx00000a569c1336e71ea3f-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.614 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.615 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': '8000'} 2023-12-15T23:01:58.615 DEBUG:boto:Token: None 2023-12-15T23:01:58.615 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6UjrnyZnGgICYmc+ddlZWljP4aQ= 2023-12-15T23:01:58.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6UjrnyZnGgICYmc+ddlZWljP4aQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.621 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:59:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000e7abbc48d9014639-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.621 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.622 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.622 DEBUG:boto:Method: GET 2023-12-15T23:01:58.622 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.622 DEBUG:boto:Data: 2023-12-15T23:01:58.622 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.622 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.622 DEBUG:boto:Params: {} 2023-12-15T23:01:58.622 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.623 DEBUG:boto:Token: None 2023-12-15T23:01:58.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.626 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx000003b4eb1a369a6c3e4-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.626 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.626 DEBUG:boto:Token: None 2023-12-15T23:01:58.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.629 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 22:59:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000bee688e0a6b1850b-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.630 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.630 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.630 DEBUG:boto:Method: PUT 2023-12-15T23:01:58.630 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.630 DEBUG:boto:Data: 2023-12-15T23:01:58.630 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:01:58.631 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:01:58.631 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.631 DEBUG:boto:Params: {} 2023-12-15T23:01:58.631 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.631 DEBUG:boto:Token: None 2023-12-15T23:01:58.631 DEBUG:boto:StringToSign: PUT VpBzljOcorCZvRIkX5Nt3A== application/octet-stream Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.632 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o28wq3cAg/ndk8SNyuzQlewSsSA= 2023-12-15T23:01:58.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o28wq3cAg/ndk8SNyuzQlewSsSA='} 2023-12-15T23:01:58.645 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000970195b9f615dc33-00657cdae6-4638-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.645 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.645 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.645 DEBUG:boto:Method: GET 2023-12-15T23:01:58.645 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.645 DEBUG:boto:Data: 2023-12-15T23:01:58.646 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.646 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.646 DEBUG:boto:Params: {} 2023-12-15T23:01:58.646 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.646 DEBUG:boto:Token: None 2023-12-15T23:01:58.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.649 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx00000ef6744fc0c2aac8b-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.649 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.649 DEBUG:boto:Token: None 2023-12-15T23:01:58.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.653 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('x-amz-request-id', 'tx000007528b43131fb2b3a-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.653 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.653 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.653 DEBUG:boto:Method: PUT 2023-12-15T23:01:58.653 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.654 DEBUG:boto:Data: 2023-12-15T23:01:58.654 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:01:58.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:01:58.654 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.654 DEBUG:boto:Params: {} 2023-12-15T23:01:58.654 DEBUG:boto:Token: None 2023-12-15T23:01:58.654 DEBUG:boto:StringToSign: PUT uk9S5NXZfBvPq4jGr+LM5g== application/octet-stream Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oLpcGv93pMgBaDFbogEpe2aGaFU= 2023-12-15T23:01:58.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oLpcGv93pMgBaDFbogEpe2aGaFU='} 2023-12-15T23:01:58.660 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ae193870bb2ea1c9-00657cdae6-4638-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.661 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.661 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.661 DEBUG:boto:Method: GET 2023-12-15T23:01:58.661 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.661 DEBUG:boto:Data: 2023-12-15T23:01:58.661 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.661 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.661 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.661 DEBUG:boto:Params: {} 2023-12-15T23:01:58.661 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.662 DEBUG:boto:Token: None 2023-12-15T23:01:58.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.665 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx000000d67f7ea93eaf8af-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.665 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.665 DEBUG:boto:Token: None 2023-12-15T23:01:58.665 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.665 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.668 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('x-amz-request-id', 'tx00000582b642930cd9188-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.668 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.669 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.669 DEBUG:boto:Method: PUT 2023-12-15T23:01:58.669 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.669 DEBUG:boto:Data: 2023-12-15T23:01:58.669 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:01:58.669 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:01:58.669 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.669 DEBUG:boto:Params: {} 2023-12-15T23:01:58.669 DEBUG:boto:Token: None 2023-12-15T23:01:58.670 DEBUG:boto:StringToSign: PUT 6aKmvaJMgaK7Z2rfDZvVeg== application/octet-stream Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jPiV0ovNSJw6a1idcT+AMCTd9oU= 2023-12-15T23:01:58.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jPiV0ovNSJw6a1idcT+AMCTd9oU='} 2023-12-15T23:01:58.676 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000960b89d446dffa60-00657cdae6-4638-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.754 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.754 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.754 DEBUG:boto:Method: GET 2023-12-15T23:01:58.754 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.754 DEBUG:boto:Data: 2023-12-15T23:01:58.754 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.754 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.754 DEBUG:boto:Params: {} 2023-12-15T23:01:58.755 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.755 DEBUG:boto:Token: None 2023-12-15T23:01:58.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.758 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx000004deaa4df18331bfa-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.759 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.759 DEBUG:boto:Token: None 2023-12-15T23:01:58.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.762 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('x-amz-request-id', 'tx00000ba677546d2ee07ea-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.763 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.763 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.763 DEBUG:boto:Method: PUT 2023-12-15T23:01:58.763 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.763 DEBUG:boto:Data: 2023-12-15T23:01:58.763 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:01:58.763 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:01:58.763 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.763 DEBUG:boto:Params: {} 2023-12-15T23:01:58.763 DEBUG:boto:Token: None 2023-12-15T23:01:58.764 DEBUG:boto:StringToSign: PUT GbNgNQ5MAukCtgY+rsT5Xw== application/octet-stream Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s/1lA5aR1mu3b2icDUo6xkX7ffw= 2023-12-15T23:01:58.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s/1lA5aR1mu3b2icDUo6xkX7ffw='} 2023-12-15T23:01:58.770 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d0bbc9bc6e872c95-00657cdae6-4638-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.771 DEBUG:boto:path=/kskgfn-29/testredirect 2023-12-15T23:01:58.771 DEBUG:boto:auth_path=/kskgfn-29/testredirect 2023-12-15T23:01:58.771 DEBUG:boto:Method: GET 2023-12-15T23:01:58.771 DEBUG:boto:Path: /kskgfn-29/testredirect 2023-12-15T23:01:58.771 DEBUG:boto:Data: 2023-12-15T23:01:58.771 DEBUG:boto:Headers: {} 2023-12-15T23:01:58.771 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:01:58.771 DEBUG:boto:Port: 8000 2023-12-15T23:01:58.771 DEBUG:boto:Params: {} 2023-12-15T23:01:58.771 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:01:58.772 DEBUG:boto:Token: None 2023-12-15T23:01:58.772 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.772 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.774 DEBUG:boto:Response headers: [('Location', 'http://smithi093.front.sepia.ceph.com:8000/kskgfn-29/testredirect?'), ('x-amz-request-id', 'tx000001eb2c31ad98397f1-00657cdae6-4729-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.775 DEBUG:boto:Redirecting: http://smithi093.front.sepia.ceph.com/kskgfn-29/testredirect 2023-12-15T23:01:58.775 DEBUG:boto:Token: None 2023-12-15T23:01:58.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:01:58 GMT /kskgfn-29/testredirect 2023-12-15T23:01:58.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ= 2023-12-15T23:01:58.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:01:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JIPwNrZamiKlj0jRkop/NDt5akQ=', 'Content-Length': '0'} 2023-12-15T23:01:58.778 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('x-amz-request-id', 'tx00000466fe0b89c56adad-00657cdae6-4638-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:01:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:01:58.778 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:01:58.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:01:58.779 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:01:58.833 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:01:58.833 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:01:58.856 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T23:01:58.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:01:58.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:01:58.857 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:01:58.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:01:58.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:01:58.951 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T23:01:58.993 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":5,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:01:58.993 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2023-12-15T23:01:59.176 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:01:59.176+0000 7f4f80017640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:03:28.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:03:28.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:03:28.995 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:03:29.048 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:03:29.048 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:03:29.074 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"test-zone2.rgw.log:notif"} 2023-12-15T23:03:29.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:03:29.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:03:29.074 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:03:29.121 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:03:29.121 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:03:29.165 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T23:03:29.205 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":6,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:03:29.205 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2023-12-15T23:03:29.472 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:03:29.472+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:04:59.206 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2023-12-15T23:04:59.208 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:04:59.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:04:59.209 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:04:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:04:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:04:59.300 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:04:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681197.554995_164.1","last_update":"2023-12-15T22:59:57.554995Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:04:59.318 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:04:59.318 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:04:59.318 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:04:59.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:04:59.319 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:04:59.371 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:04:59.371 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:04:59.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:04:59.401+0000 7f4a75731800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:04:59.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:04:59.402+0000 7f4a75731800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:04:59.419 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:04:59Z"} 2023-12-15T23:04:59.419 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:04:59Z"} 2023-12-15T23:04:59.419 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:04:59.419 DEBUG:rgw_multi.tests:log_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:04:59.419 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:04:59.420 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:04:59.420 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:04:59.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '8CZ2YL9B4KQ03VL5', '--secret', 'CjV3P1uGaOifTnspbIJ5KF55U101Q7FK', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:04:59.420 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key 8CZ2YL9B4KQ03VL5 --secret CjV3P1uGaOifTnspbIJ5KF55U101Q7FK --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:04:59.469 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:04:59.469 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:04:59.483 INFO:teuthology.orchestra.run.smithi188.stderr:NOTICE: set zone's realm_id=60dac693-64f5-45c2-a83a-5740fda91d5c 2023-12-15T23:04:59.504 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"340ae94f-caf8-4f3c-92a0-46bc581d213e","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"8CZ2YL9B4KQ03VL5","secret_key":"CjV3P1uGaOifTnspbIJ5KF55U101Q7FK"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"remove.rgw.log:notif"} 2023-12-15T23:04:59.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:04:59.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:04:59.504 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:04:59.549 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:04:59.549 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:04:59.565 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:04:59.564+0000 7f5e68928800 0 period (8bfcaea7-8c6a-42ca-968d-33484415a55a does not have zone 340ae94f-caf8-4f3c-92a0-46bc581d213e configured 2023-12-15T23:05:06.133 INFO:teuthology.orchestra.run.smithi188.stderr:Sending period to new master zone 85829102-5436-4ffc-bbf4-ae2b811bdc9c 2023-12-15T23:05:06.176 INFO:teuthology.orchestra.run.smithi188.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":7,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"340ae94f-caf8-4f3c-92a0-46bc581d213e","name":"remove","endpoints":[],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"340ae94f-caf8-4f3c-92a0-46bc581d213e","val":741050465},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:05:06.176 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.176 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.228 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.228 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.250 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2023-12-15T23:05:06.251 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.251 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.297 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.298 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.311 INFO:teuthology.orchestra.run.smithi093.stderr:zone name remove not found in zonegroup test-zonegroup 2023-12-15T23:05:06.316 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-15T23:05:06.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.316 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.366 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.366 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.395 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:06.394+0000 7f9a14726800 0 Removed zone from zonegroup test-zonegroup 2023-12-15T23:05:06.403 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.403 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.455 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.455 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:05:06.473+0000 7fb67431f800 0 WARNING: can't generate connection for zone 340ae94f-caf8-4f3c-92a0-46bc581d213e id remove: no endpoints defined 2023-12-15T23:05:06.529 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":8,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:05:06.529 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2023-12-15T23:05:06.530 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.530 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.596 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"e8c6eb31-e7b1-4ded-bed7-56cb7e7dabac","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2023-12-15T23:05:06.597 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.597 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.642 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.643 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:05:06.670+0000 7f8ea96e4800 0 NOTICE: promoted remove as new master_zone of zonegroup remove_zg 2023-12-15T23:05:06.676 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"614a91ac-a1b4-47fe-b8ec-dc066e6b9775","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","notif_pool":"remove.rgw.log:notif"} 2023-12-15T23:05:06.676 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.676 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.725 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.725 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.808 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":9,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"e8c6eb31-e7b1-4ded-bed7-56cb7e7dabac","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"614a91ac-a1b4-47fe-b8ec-dc066e6b9775","zones":[{"id":"614a91ac-a1b4-47fe-b8ec-dc066e6b9775","name":"remove","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"614a91ac-a1b4-47fe-b8ec-dc066e6b9775","val":1217532095},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:05:06.808 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.808 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.855 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.855 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:05:06.879+0000 7f2be0737800 0 NOTICE: removed master_zone of zonegroup remove_zg 2023-12-15T23:05:06.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:05:06.881+0000 7f2be0737800 0 Removed zone from zonegroup remove_zg 2023-12-15T23:05:06.888 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.889 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:06.934 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:06.934 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:06.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:05:06.958+0000 7f7d2ee10800 0 ERROR: zonegroup remove_zg has a non existent master zone 2023-12-15T23:05:06.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-12-15T23:05:06.963 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:06.963 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:07.007 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:07.007 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:07.028 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:07.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:05:07.028 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:05:07.076 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:07.076 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:07.157 INFO:teuthology.orchestra.run.smithi093.stdout:{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","epoch":10,"predecessor_uuid":"6724491c-d60d-45a2-9694-fd058cbeabad","sync_status":[],"period_map":{"id":"8bfcaea7-8c6a-42ca-968d-33484415a55a","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","zones":[{"id":"160ba887-62cd-49c7-8578-f3cea1ced053","name":"test-zone2","endpoints":["http://smithi188.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]},{"id":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","name":"test-zone1","endpoints":["http://smithi093.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","sync_policy":{"groups":[]},"enabled_features":["resharding"]}],"short_zone_ids":[{"key":"160ba887-62cd-49c7-8578-f3cea1ced053","val":4055337361},{"key":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","val":3204945775}]},"master_zonegroup":"test-zonegroup","master_zone":"85829102-5436-4ffc-bbf4-ae2b811bdc9c","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"60dac693-64f5-45c2-a83a-5740fda91d5c","realm_epoch":2} 2023-12-15T23:05:07.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2023-12-15T23:05:07.158 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-30 2023-12-15T23:05:07.158 DEBUG:boto:path=/kskgfn-30/ 2023-12-15T23:05:07.158 DEBUG:boto:auth_path=/kskgfn-30/ 2023-12-15T23:05:07.158 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.158 DEBUG:boto:Path: /kskgfn-30/ 2023-12-15T23:05:07.158 DEBUG:boto:Data: 2023-12-15T23:05:07.158 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:07.159 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.159 DEBUG:boto:Params: {} 2023-12-15T23:05:07.159 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:05:07.159 DEBUG:boto:Token: None 2023-12-15T23:05:07.159 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-30/ 2023-12-15T23:05:07.160 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FXlsIt/8swx+olM2/7i6vk2Nlng= 2023-12-15T23:05:07.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FXlsIt/8swx+olM2/7i6vk2Nlng=', 'Content-Length': '0'} 2023-12-15T23:05:07.444 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007185d5f24d2cac49-00657cdba3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.445 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-31 2023-12-15T23:05:07.445 DEBUG:boto:path=/kskgfn-31/ 2023-12-15T23:05:07.445 DEBUG:boto:auth_path=/kskgfn-31/ 2023-12-15T23:05:07.445 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.445 DEBUG:boto:Path: /kskgfn-31/ 2023-12-15T23:05:07.445 DEBUG:boto:Data: 2023-12-15T23:05:07.445 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:05:07.446 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.446 DEBUG:boto:Params: {} 2023-12-15T23:05:07.446 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:05:07.446 DEBUG:boto:Token: None 2023-12-15T23:05:07.446 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-31/ 2023-12-15T23:05:07.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uxPp2hS9HAr5xP4W+tDTWlUAU/w= 2023-12-15T23:05:07.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uxPp2hS9HAr5xP4W+tDTWlUAU/w=', 'Content-Length': '0'} 2023-12-15T23:05:07.523 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000867f2b6bf3fd26b8-00657cdba3-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.523 DEBUG:boto:path=/kskgfn-30/ 2023-12-15T23:05:07.523 DEBUG:boto:auth_path=/kskgfn-30/ 2023-12-15T23:05:07.523 DEBUG:boto:path=/kskgfn-30/?website 2023-12-15T23:05:07.523 DEBUG:boto:auth_path=/kskgfn-30/?website 2023-12-15T23:05:07.523 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.523 DEBUG:boto:Path: /kskgfn-30/?website 2023-12-15T23:05:07.523 DEBUG:boto:Data: index.htmlerror.html 2023-12-15T23:05:07.524 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.524 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:07.524 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.524 DEBUG:boto:Params: {} 2023-12-15T23:05:07.524 DEBUG:boto:Token: None 2023-12-15T23:05:07.524 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-30/?website 2023-12-15T23:05:07.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DoWxJL6v22SOmxAreXNjchBIhks= 2023-12-15T23:05:07.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DoWxJL6v22SOmxAreXNjchBIhks=', 'Content-Length': '241'} 2023-12-15T23:05:07.525 DEBUG:boto:Response headers: [('Content-Length', '221'), ('x-amz-request-id', 'tx00000d3357f0eed7ed078-00657cdba3-4716-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.526 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... SKIP: test_set_bucket_website skipped. Requires rgw_enable_static_website = 1. 2023-12-15T23:05:07.526 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-32 2023-12-15T23:05:07.526 DEBUG:boto:path=/kskgfn-32/ 2023-12-15T23:05:07.527 DEBUG:boto:auth_path=/kskgfn-32/ 2023-12-15T23:05:07.527 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.527 DEBUG:boto:Path: /kskgfn-32/ 2023-12-15T23:05:07.527 DEBUG:boto:Data: 2023-12-15T23:05:07.527 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:07.527 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.527 DEBUG:boto:Params: {} 2023-12-15T23:05:07.527 DEBUG:boto:Token: None 2023-12-15T23:05:07.527 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-32/ 2023-12-15T23:05:07.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8A05aIlOwijj5pABPt9+t6oSgpU= 2023-12-15T23:05:07.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8A05aIlOwijj5pABPt9+t6oSgpU=', 'Content-Length': '0'} 2023-12-15T23:05:07.543 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f44916050368b927-00657cdba3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.543 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-33 2023-12-15T23:05:07.543 DEBUG:boto:path=/kskgfn-33/ 2023-12-15T23:05:07.543 DEBUG:boto:auth_path=/kskgfn-33/ 2023-12-15T23:05:07.543 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.543 DEBUG:boto:Path: /kskgfn-33/ 2023-12-15T23:05:07.543 DEBUG:boto:Data: 2023-12-15T23:05:07.543 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.543 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:05:07.543 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.544 DEBUG:boto:Params: {} 2023-12-15T23:05:07.544 DEBUG:boto:Token: None 2023-12-15T23:05:07.544 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-33/ 2023-12-15T23:05:07.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LXkRh8vyRa1jwz9drYu/vPRGF2o= 2023-12-15T23:05:07.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LXkRh8vyRa1jwz9drYu/vPRGF2o=', 'Content-Length': '0'} 2023-12-15T23:05:07.606 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000882bd65ecb60aa08-00657cdba3-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.607 DEBUG:boto:path=/kskgfn-32/ 2023-12-15T23:05:07.607 DEBUG:boto:auth_path=/kskgfn-32/ 2023-12-15T23:05:07.607 DEBUG:boto:path=/kskgfn-32/?policy 2023-12-15T23:05:07.607 DEBUG:boto:auth_path=/kskgfn-32/?policy 2023-12-15T23:05:07.607 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.607 DEBUG:boto:Path: /kskgfn-32/?policy 2023-12-15T23:05:07.607 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2023-12-15T23:05:07.607 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.607 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:07.607 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.608 DEBUG:boto:Params: {} 2023-12-15T23:05:07.608 DEBUG:boto:Token: None 2023-12-15T23:05:07.608 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-32/?policy 2023-12-15T23:05:07.608 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y1GMC7upR7bTZMBmSmGD8UNIPCI= 2023-12-15T23:05:07.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y1GMC7upR7bTZMBmSmGD8UNIPCI=', 'Content-Length': '97'} 2023-12-15T23:05:07.613 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a42acd2ddb604d3b-00657cdba3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.613 DEBUG:boto:path=/kskgfn-32/ 2023-12-15T23:05:07.613 DEBUG:boto:auth_path=/kskgfn-32/ 2023-12-15T23:05:07.613 DEBUG:boto:path=/kskgfn-32/?policy 2023-12-15T23:05:07.613 DEBUG:boto:auth_path=/kskgfn-32/?policy 2023-12-15T23:05:07.613 DEBUG:boto:Method: GET 2023-12-15T23:05:07.613 DEBUG:boto:Path: /kskgfn-32/?policy 2023-12-15T23:05:07.613 DEBUG:boto:Data: 2023-12-15T23:05:07.613 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:07.614 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.614 DEBUG:boto:Params: {} 2023-12-15T23:05:07.614 DEBUG:boto:Token: None 2023-12-15T23:05:07.614 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-32/?policy 2023-12-15T23:05:07.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ARw+eQrPsprEcqrWInANUzxz//g= 2023-12-15T23:05:07.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ARw+eQrPsprEcqrWInANUzxz//g=', 'Content-Length': '0'} 2023-12-15T23:05:07.615 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001a745071aac9f3bd-00657cdba3-4716-test-zone1'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '97'), ('Date', 'Fri, 15 Dec 2023 23:05:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:07.615 DEBUG:boto:path=/kskgfn-33/ 2023-12-15T23:05:07.615 DEBUG:boto:auth_path=/kskgfn-33/ 2023-12-15T23:05:07.616 DEBUG:boto:path=/kskgfn-33/?policy 2023-12-15T23:05:07.616 DEBUG:boto:auth_path=/kskgfn-33/?policy 2023-12-15T23:05:07.616 DEBUG:boto:Method: PUT 2023-12-15T23:05:07.616 DEBUG:boto:Path: /kskgfn-33/?policy 2023-12-15T23:05:07.616 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2023-12-15T23:05:07.616 DEBUG:boto:Headers: {} 2023-12-15T23:05:07.616 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:05:07.616 DEBUG:boto:Port: 8000 2023-12-15T23:05:07.616 DEBUG:boto:Params: {} 2023-12-15T23:05:07.616 DEBUG:boto:Token: None 2023-12-15T23:05:07.616 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:07 GMT /kskgfn-33/?policy 2023-12-15T23:05:07.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NVYPPReE4T056xybx1A8n7Au+Rw= 2023-12-15T23:05:07.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NVYPPReE4T056xybx1A8n7Au+Rw=', 'Content-Length': '97'} 2023-12-15T23:05:08.629 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000072961fe471b8e354-00657cdba3-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:05:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:08.630 DEBUG:boto:path=/kskgfn-33/ 2023-12-15T23:05:08.630 DEBUG:boto:auth_path=/kskgfn-33/ 2023-12-15T23:05:08.630 DEBUG:boto:path=/kskgfn-33/?policy 2023-12-15T23:05:08.630 DEBUG:boto:auth_path=/kskgfn-33/?policy 2023-12-15T23:05:08.630 DEBUG:boto:Method: GET 2023-12-15T23:05:08.630 DEBUG:boto:Path: /kskgfn-33/?policy 2023-12-15T23:05:08.630 DEBUG:boto:Data: 2023-12-15T23:05:08.630 DEBUG:boto:Headers: {} 2023-12-15T23:05:08.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:05:08.630 DEBUG:boto:Port: 8000 2023-12-15T23:05:08.631 DEBUG:boto:Params: {} 2023-12-15T23:05:08.631 DEBUG:boto:Token: None 2023-12-15T23:05:08.631 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:05:08 GMT /kskgfn-33/?policy 2023-12-15T23:05:08.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JMFSbRkv5RY2cKVLyPNIRoRVI6M= 2023-12-15T23:05:08.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JMFSbRkv5RY2cKVLyPNIRoRVI6M=', 'Content-Length': '0'} 2023-12-15T23:05:08.632 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002686fd60b6ae4a35-00657cdba4-4788-test-zone2'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '97'), ('Date', 'Fri, 15 Dec 2023 23:05:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:08.673 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_policy ... ok 2023-12-15T23:05:08.674 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-34 2023-12-15T23:05:08.674 DEBUG:boto:path=/kskgfn-34/ 2023-12-15T23:05:08.674 DEBUG:boto:auth_path=/kskgfn-34/ 2023-12-15T23:05:08.674 DEBUG:boto:Method: PUT 2023-12-15T23:05:08.674 DEBUG:boto:Path: /kskgfn-34/ 2023-12-15T23:05:08.675 DEBUG:boto:Data: 2023-12-15T23:05:08.675 DEBUG:boto:Headers: {} 2023-12-15T23:05:08.675 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:05:08.675 DEBUG:boto:Port: 8000 2023-12-15T23:05:08.675 DEBUG:boto:Params: {} 2023-12-15T23:05:08.675 DEBUG:boto:Token: None 2023-12-15T23:05:08.675 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:08 GMT /kskgfn-34/ 2023-12-15T23:05:08.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJbFJ0MknjORHEGuNLcQaN5mQXE= 2023-12-15T23:05:08.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJbFJ0MknjORHEGuNLcQaN5mQXE=', 'Content-Length': '0'} 2023-12-15T23:05:08.692 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000083cf46d0ab297c83-00657cdba4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:08.693 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-35 2023-12-15T23:05:08.693 DEBUG:boto:path=/kskgfn-35/ 2023-12-15T23:05:08.693 DEBUG:boto:auth_path=/kskgfn-35/ 2023-12-15T23:05:08.693 DEBUG:boto:Method: PUT 2023-12-15T23:05:08.693 DEBUG:boto:Path: /kskgfn-35/ 2023-12-15T23:05:08.693 DEBUG:boto:Data: 2023-12-15T23:05:08.693 DEBUG:boto:Headers: {} 2023-12-15T23:05:08.693 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:05:08.693 DEBUG:boto:Port: 8000 2023-12-15T23:05:08.694 DEBUG:boto:Params: {} 2023-12-15T23:05:08.694 DEBUG:boto:Token: None 2023-12-15T23:05:08.694 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:05:08 GMT /kskgfn-35/ 2023-12-15T23:05:08.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oIVp2phqn/WGgPJ7LYvz4O2y7e4= 2023-12-15T23:05:08.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:05:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oIVp2phqn/WGgPJ7LYvz4O2y7e4=', 'Content-Length': '0'} 2023-12-15T23:05:08.725 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000340325fea55aefb6-00657cdba4-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:05:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:05:08.725 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:08.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:08.725 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:08.776 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:08.776 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:08.808 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:05:08.823 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681508.714178_283.1","last_update":"2023-12-15T23:05:08.714178Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:05:08.824 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:08.824 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:05:08.824 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:08.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:08.824 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:08.877 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:08.877 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:08.908 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:08.908+0000 7fbfd551f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:08.909 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:08.909+0000 7fbfd551f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:08.926 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:08Z"} 2023-12-15T23:05:08.926 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:08Z"} 2023-12-15T23:05:08.926 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:08.926 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:08.926 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:08.926 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:13.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:13.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:13.927 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:13.980 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:14.011 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:14.011+0000 7fe7ca322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:14.012 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:14.012+0000 7fe7ca322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:14.027 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:14Z"} 2023-12-15T23:05:14.028 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:14Z"} 2023-12-15T23:05:14.029 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:14.029 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:14.029 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:14.029 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:19.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:19.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:19.030 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:19.084 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:19.084 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:19.115 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:19.115+0000 7fbaa4342800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:19.116 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:19.116+0000 7fbaa4342800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:19.132 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:19Z"} 2023-12-15T23:05:19.132 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:19Z"} 2023-12-15T23:05:19.132 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:19.132 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:19.132 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:19.132 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:24.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:24.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:24.134 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:24.187 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:24.187 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:24.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:24.218+0000 7f34b2120800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:24.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:24.219+0000 7f34b2120800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:24.234 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:24Z"} 2023-12-15T23:05:24.234 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:24Z"} 2023-12-15T23:05:24.235 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:24.235 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:24.235 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:24.235 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:29.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:29.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:29.237 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:29.291 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:29.291 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:29.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:29.323+0000 7f94a0932800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:29.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:29.324+0000 7f94a0932800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:29.340 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:29Z"} 2023-12-15T23:05:29.340 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:29Z"} 2023-12-15T23:05:29.340 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:29.340 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:29.340 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:29.341 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:34.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:34.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:34.342 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:34.396 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:34.396 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:34.427 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:34.427+0000 7f8f58416800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:34.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:34.428+0000 7f8f58416800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:34.444 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:34Z"} 2023-12-15T23:05:34.444 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:34Z"} 2023-12-15T23:05:34.444 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:34.444 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:34.444 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:34.444 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:39.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:39.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:39.446 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:39.499 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:39.499 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:39.531 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:39.531+0000 7fed93d2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:39.532 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:39.532+0000 7fed93d2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:39.547 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:39Z"} 2023-12-15T23:05:39.548 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:39Z"} 2023-12-15T23:05:39.548 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:39.548 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:39.548 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:39.548 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:44.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:44.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:44.549 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:44.602 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:44.602 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:44.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:44.634+0000 7f93d3122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:44.635 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:44.635+0000 7f93d3122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:44.651 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:44Z"} 2023-12-15T23:05:44.651 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:44Z"} 2023-12-15T23:05:44.651 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:44.651 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:44.651 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:44.652 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:49.653 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:49.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:49.653 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:49.706 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:49.706 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:49.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:49.737+0000 7f2d03b23800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:49.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:49.739+0000 7f2d03b23800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:49Z"} 2023-12-15T23:05:49.756 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:49Z"} 2023-12-15T23:05:49.756 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:49.757 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:49.757 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:49.757 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:54.757 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:54.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:54.759 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:54.813 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:54.813 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:54.844 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:54.843+0000 7f4e6c327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:54.845 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:54.844+0000 7f4e6c327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:54.860 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:54Z"} 2023-12-15T23:05:54.860 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:54Z"} 2023-12-15T23:05:54.861 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:54.861 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:54.861 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:54.861 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:05:59.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:59.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:05:59.862 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:05:59.914 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:05:59.948 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:59.947+0000 7fc24632f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:59.949 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:05:59.948+0000 7fc24632f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:05:59.965 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:59Z"} 2023-12-15T23:05:59.965 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:05:59Z"} 2023-12-15T23:05:59.965 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:05:59.965 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:59.965 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:05:59.966 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:04.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:04.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:04.967 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:05.019 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:05.019 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:05.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:05.050+0000 7f2bf692a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:05.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:05.052+0000 7f2bf692a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:05.068 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:05Z"} 2023-12-15T23:06:05.068 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:05Z"} 2023-12-15T23:06:05.069 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:05.069 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:05.069 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:05.069 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:10.070 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:10.070 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:10.070 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:10.126 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:10.126 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:10.157 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:10.157+0000 7f9ee953a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:10.158 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:10.158+0000 7f9ee953a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:10.174 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:10Z"} 2023-12-15T23:06:10.174 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:10Z"} 2023-12-15T23:06:10.174 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:10.175 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:10.175 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:10.175 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:15.176 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:15.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:15.177 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:15.230 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:15.230 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:15.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:15.262+0000 7f086dc2d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:15.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:15.263+0000 7f086dc2d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:15.278 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:15Z"} 2023-12-15T23:06:15.278 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:15Z"} 2023-12-15T23:06:15.279 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:15.279 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:15.279 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:15.279 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:20.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:20.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:20.281 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:20.334 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:20.334 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:20.366 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:20.366+0000 7ff40c732800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:20.367 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:20.367+0000 7ff40c732800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:20.383 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:20Z"} 2023-12-15T23:06:20.384 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:20Z"} 2023-12-15T23:06:20.384 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:20.384 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:20.384 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:20.384 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:25.385 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:25.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:25.388 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:25.441 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:25.442 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:25.473 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:25.473+0000 7f959d326800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:25.474 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:25.474+0000 7f959d326800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:25.490 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:25Z"} 2023-12-15T23:06:25.490 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:25Z"} 2023-12-15T23:06:25.490 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:25.491 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:25.491 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:25.491 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:30.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:30.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:30.493 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:30.548 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:30.548 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:30.580 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:30.580+0000 7f47fb9af800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:30.582 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:30.581+0000 7f47fb9af800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:30.597 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:30Z"} 2023-12-15T23:06:30.598 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:30Z"} 2023-12-15T23:06:30.598 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:30.598 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:30.598 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:30.598 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:35.599 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:35.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:35.600 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:35.653 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:35.653 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:35.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:35.683+0000 7fdfe3d20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:35.684+0000 7fdfe3d20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:35.700 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:35Z"} 2023-12-15T23:06:35.700 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681197.554995_164.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T22:59:57.554995Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:35Z"} 2023-12-15T23:06:35.700 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681197.554995_164.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T22:59:57.554995Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:35.700 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:35.701 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681197.554995_164.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:35.701 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681197.554995_164.1 2023-12-15T23:06:40.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:40.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:40.702 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:40.762 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:40.763 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:40.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:40.794+0000 7f2af7926800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:40.795 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:40.795+0000 7f2af7926800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:40.811 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681507.535776_262.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:07.535776Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:40Z"} 2023-12-15T23:06:40.811 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681507.535776_262.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:07.535776Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:40Z"} 2023-12-15T23:06:40.811 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681507.535776_262.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:05:07.535776Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:40.811 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:40.811 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681507.535776_262.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:40.811 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681507.535776_262.1 2023-12-15T23:06:45.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:45.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:45.813 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:45.867 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:45.867 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:45.903 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:45.901+0000 7f63ac546800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:45.904 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:45.902+0000 7f63ac546800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:45.919 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681507.438486_249.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:07.438486Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:45Z"} 2023-12-15T23:06:45.919 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681507.438486_249.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:07.438486Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:45Z"} 2023-12-15T23:06:45.919 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681507.438486_249.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:05:07.438486Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:45.920 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:45.920 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681507.438486_249.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:45.920 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681508.714178_283.1 target=1_1702681507.438486_249.1 2023-12-15T23:06:50.921 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:50.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:50.921 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:50.975 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:50.975 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:51.005+0000 7f58441ad800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:06:51.006+0000 7f58441ad800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:06:51.024 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681508.714178_283.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:08.714178Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:51Z"} 2023-12-15T23:06:51.024 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681508.714178_283.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:05:08.714178Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:06:51Z"} 2023-12-15T23:06:51.024 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681508.714178_283.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:05:08.714178Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:06:51.024 DEBUG:rgw_multi.tests:log_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:51.024 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681508.714178_283.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:06:51.024 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:06:51.025 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-34', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:06:51.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-34', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:06:51.025 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-34 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:06:51.082 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.082 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.161 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-35', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:06:51.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-35', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:06:51.162 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-35 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:06:51.210 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.210 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.286 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.286 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:51.328 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.329 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.378 INFO:teuthology.orchestra.run.smithi093.stdout:["obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:4","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:1","obj_delete_at_hint.0000000026","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:9","sync.error-log.8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:2","obj_delete_at_hint.0000000028","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:2","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.1.retry","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:0","obj_delete_at_hint.0000000040","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:1","sync.error-log.6","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1","obj_delete_at_hint.0000000035","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:3","obj_delete_at_hint.0000000037","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:2","obj_delete_at_hint.0000000024","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:3","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:3","data_loggenerations_metadata","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:10","obj_delete_at_hint.0000000076","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:4","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:5","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:2","obj_delete_at_hint.0000000110","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:10","obj_delete_at_hint.0000000096","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:0","obj_delete_at_hint.0000000087","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:2","obj_delete_at_hint.0000000008","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:8","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:7","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:8","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:10","bilog.trim","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:3","obj_delete_at_hint.0000000016","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:5","obj_delete_at_hint.0000000041","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:5","obj_delete_at_hint.0000000018","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:2","obj_delete_at_hint.0000000092","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:7","data_log.2.qNRYSaEtE7G.0","sync.error-log.4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:2","obj_delete_at_hint.0000000014","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:10","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:1","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.3.retry","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:4","obj_delete_at_hint.0000000081","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.0.retry","obj_delete_at_hint.0000000009","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:2","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:6","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:6","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:0","obj_delete_at_hint.0000000077","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:4","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16","sync.error-log.7","sync.error-log.3","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:9","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:10","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:10","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","sync.error-log.12","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:9","obj_delete_at_hint.0000000116","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:8","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:3","obj_delete_at_hint.0000000034","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:5","obj_delete_at_hint.0000000101","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:6","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:3","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:10","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:8","obj_delete_at_hint.0000000066","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:0","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:6","obj_delete_at_hint.0000000073","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:4","obj_delete_at_hint.0000000038","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:9","sync.error-log.10","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.3","obj_delete_at_hint.0000000103","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:3","obj_delete_at_hint.0000000119","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:2","obj_delete_at_hint.0000000098","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:9","meta.log.8bfcaea7-8c6a-42ca-968d-33484415a55a.1","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:10","obj_delete_at_hint.0000000039","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:8","obj_delete_at_hint.0000000100","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.2","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:1","obj_delete_at_hint.0000000093","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:10","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:3","obj_delete_at_hint.0000000057","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:5","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:9","sync.error-log.2","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.2.retry","data_log.0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:1","obj_delete_at_hint.0000000012","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:8","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:6","sync.error-log.11","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:1","obj_delete_at_hint.0000000111","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:9","obj_delete_at_hint.0000000048","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:10","obj_delete_at_hint.0000000020","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:7","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:3","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","data_log.3.wlHK6crnLAH.0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:6","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:7","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:0","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:1","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:1","obj_delete_at_hint.0000000108","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:6","obj_delete_at_hint.0000000094","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:5","obj_delete_at_hint.0000000060","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:2","obj_delete_at_hint.0000000109","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:5","obj_delete_at_hint.0000000013","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:0","obj_delete_at_hint.0000000051","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:1","obj_delete_at_hint.0000000106","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:10","obj_delete_at_hint.0000000017","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:8","obj_delete_at_hint.0000000023","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:6","data_log.0.v9OfqfTuvk7.0","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.1","obj_delete_at_hint.0000000107","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:1","obj_delete_at_hint.0000000046","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:6","data_log.1.rGKTeInMAg5.0","datalog.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:1","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:6","datalog.sync-status.shard.160ba887-62cd-49c7-8578-f3cea1ced053.0","sync.error-log.9","obj_delete_at_hint.0000000086","sync.error-log.5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:6","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1:10","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:5","meta.log.8bfcaea7-8c6a-42ca-968d-33484415a55a.0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:6","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:2","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:4","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:0","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:6","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:5","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:3","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:8","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:2","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:7","obj_delete_at_hint.0000000097","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:9","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:3","obj_delete_at_hint.0000000042","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:3","bucket.full-sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:8","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:7","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:9","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.sync-status.160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:7"] 2023-12-15T23:06:51.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.392 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:51.441 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.442 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.496 INFO:teuthology.orchestra.run.smithi188.stdout:["obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:5","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:1","obj_delete_at_hint.0000000026","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:6","obj_delete_at_hint.0000000028","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:9","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.0.retry","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.2.retry","data_log.1.TZy/2+e0Goq.0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:1","obj_delete_at_hint.0000000040","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:0","obj_delete_at_hint.0000000015","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:0","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:5","obj_delete_at_hint.0000000035","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:3","obj_delete_at_hint.0000000037","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:4","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:5","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:9","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:9","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:9","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:4","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","datalog.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c","obj_delete_at_hint.0000000096","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:0","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:8","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:3","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17","bilog.trim","obj_delete_at_hint.0000000016","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:8","obj_delete_at_hint.0000000041","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:4","sync.error-log.4","obj_delete_at_hint.0000000014","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:5","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:1","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:9","obj_delete_at_hint.0000000074","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:10","data_log.0.0cG5DcfG/3m.0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:4","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:10","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.3.retry","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:3","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:4","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:10","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:6","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:5","obj_delete_at_hint.0000000053","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:1","obj_delete_at_hint.0000000091","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:2","obj_delete_at_hint.0000000065","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:4","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.0","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:9","sync.error-log.3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:2","mdlog.sync-status.shard.2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:3","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:10","obj_delete_at_hint.0000000116","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:4","obj_delete_at_hint.0000000034","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:2","obj_delete_at_hint.0000000101","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:10","mdlog.sync-status.shard.1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:9","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.2","obj_delete_at_hint.0000000066","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:0","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:6","obj_delete_at_hint.0000000073","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:2","obj_delete_at_hint.0000000036","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:3","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:7","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:8","mdlog.sync-status.shard.0","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11","meta.log.8bfcaea7-8c6a-42ca-968d-33484415a55a.1","obj_delete_at_hint.0000000027","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:5","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:7","obj_delete_at_hint.0000000039","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:8","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:6","obj_delete_at_hint.0000000100","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:4","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:9","obj_delete_at_hint.0000000057","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:2","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:8","sync.error-log.2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-11:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.15:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:6","data_log.0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:8","obj_delete_at_hint.0000000012","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:5","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:3","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:6","obj_delete_at_hint.0000000111","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:3","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:9","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:0","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:8","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:9","data_log.3.JRrzwveihK1.0","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:4","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:1","obj_delete_at_hint.0000000108","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:3","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:10","obj_delete_at_hint.0000000051","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:3","obj_delete_at_hint.0000000106","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-10:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.14:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-12:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.16:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:8","obj_delete_at_hint.0000000017","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-14:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.18:5","data_log.2.7G+gnXRUaJS.0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:4","obj_delete_at_hint.0000000023","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:8","bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-16:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.20:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:10","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:9","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:1","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:7","obj_delete_at_hint.0000000086","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:1","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:3","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:4","meta.log.8bfcaea7-8c6a-42ca-968d-33484415a55a.0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:8","datalog.sync-status.shard.85829102-5436-4ffc-bbf4-ae2b811bdc9c.1.retry","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:9","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:2","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-9:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.13:6","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:0","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-18:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.22:5","obj_delete_at_hint.0000000124","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:10","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-25:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.29:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-7:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.11:0","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:7","obj_delete_at_hint.0000000001","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:2","obj_delete_at_hint.0000000126","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-15:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.19:1","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:6","obj_delete_at_hint.0000000097","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:10","obj_delete_at_hint.0000000042","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-29:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4630.1:4","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-27:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.31:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-8:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.12:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-28:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.32:8","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-13:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.17:8","obj_delete_at_hint.0000000075","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:6","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-17:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.21:7","bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-26:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.30:2"] 2023-12-15T23:06:51.511 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T23:06:51.511 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.512 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:51.557 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.557 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.607 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000003465","last_update":"2023-12-15T23:06:51.265313Z"},{"marker":"00000000000000000000:00000000000000002057","last_update":"2023-12-15T23:06:51.266436Z"},{"marker":"00000000000000000000:00000000000000001494","last_update":"2023-12-15T23:06:51.261587Z"},{"marker":"00000000000000000000:00000000000000004028","last_update":"2023-12-15T23:06:51.263478Z"}] 2023-12-15T23:06:51.608 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:06:51.608 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:06:51.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:51.608 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:51.657 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:51.657 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:51.700 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:06:51Z"} 2023-12-15T23:06:51.701 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:06:51Z"} 2023-12-15T23:06:51.701 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:01:59.050392Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.734852Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:18.005998Z'}}] 2023-12-15T23:06:51.701 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:06:51.701 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003187'} 2023-12-15T23:06:51.701 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000003465 target=00000000000000000000:00000000000000002625, shard=1 master=00000000000000000000:00000000000000002057 target=00000000000000000000:00000000000000001214, shard=2 master=00000000000000000000:00000000000000001494 target=00000000000000000000:00000000000000000933, shard=3 master=00000000000000000000:00000000000000004028 target=00000000000000000000:00000000000000003187 2023-12-15T23:06:53.470 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:06:53.469+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:06:56.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:56.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:06:56.703 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:06:56.758 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:06:56.758 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:06:56.807 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:06:56Z"} 2023-12-15T23:06:56.807 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:06:56Z"} 2023-12-15T23:06:56.808 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:01:59.050392Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.734852Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:18.005998Z'}}] 2023-12-15T23:06:56.808 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:06:56.808 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003187'} 2023-12-15T23:06:56.808 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000003465 target=00000000000000000000:00000000000000002625, shard=1 master=00000000000000000000:00000000000000002057 target=00000000000000000000:00000000000000001214, shard=2 master=00000000000000000000:00000000000000001494 target=00000000000000000000:00000000000000000933, shard=3 master=00000000000000000000:00000000000000004028 target=00000000000000000000:00000000000000003187 2023-12-15T23:07:01.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:01.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:01.810 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:01.865 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:01.866 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:01.915 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:01Z"} 2023-12-15T23:07:01.915 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:01Z"} 2023-12-15T23:07:01.916 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:01:59.050392Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.734852Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:18.005998Z'}}] 2023-12-15T23:07:01.916 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:07:01.916 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003187'} 2023-12-15T23:07:01.916 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000003465 target=00000000000000000000:00000000000000002625, shard=1 master=00000000000000000000:00000000000000002057 target=00000000000000000000:00000000000000001214, shard=2 master=00000000000000000000:00000000000000001494 target=00000000000000000000:00000000000000000933, shard=3 master=00000000000000000000:00000000000000004028 target=00000000000000000000:00000000000000003187 2023-12-15T23:07:06.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:06.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:06.917 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:06.973 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:06.973 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:07.023 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:07Z"} 2023-12-15T23:07:07.023 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:01:59.050392Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001214","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:17.734852Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000000933","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:55:26.961460Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003187","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:58:18.005998Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:07Z"} 2023-12-15T23:07:07.023 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:01:59.050392Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001214', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:17.734852Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000000933', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:55:26.961460Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003187', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:58:18.005998Z'}}] 2023-12-15T23:07:07.023 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:07:07.023 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000001214', 2: '00000000000000000000:00000000000000000933', 3: '00000000000000000000:00000000000000003187'} 2023-12-15T23:07:07.023 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000003465 target=00000000000000000000:00000000000000002625, shard=1 master=00000000000000000000:00000000000000002057 target=00000000000000000000:00000000000000001214, shard=2 master=00000000000000000000:00000000000000001494 target=00000000000000000000:00000000000000000933, shard=3 master=00000000000000000000:00000000000000004028 target=00000000000000000000:00000000000000003187 2023-12-15T23:07:08.454 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:07:08.454+0000 7f4f80017640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:07:12.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.025 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:12.079 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.079 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.128 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003465","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.265313Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002057","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.266436Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001494","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.261587Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004028","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.263478Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.129 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003465","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.265313Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002057","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.266436Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000001494","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.261587Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004028","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:51.263478Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.129 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003465', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:51.265313Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002057', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:51.266436Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000001494', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:51.261587Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004028', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:51.263478Z'}}] 2023-12-15T23:07:12.129 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:07:12.129 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000003465', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000001494', 3: '00000000000000000000:00000000000000004028'} 2023-12-15T23:07:12.129 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:07:12.129 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T23:07:12.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.130 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:12.176 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.176 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.227 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000002480","last_update":"2023-12-15T23:06:52.547854Z"},{"marker":"00000000000000000000:00000000000000002057","last_update":"2023-12-15T23:06:52.549335Z"},{"marker":"00000000000000000000:00000000000000002058","last_update":"2023-12-15T23:06:52.544675Z"},{"marker":"00000000000000000000:00000000000000003746","last_update":"2023-12-15T23:06:52.546267Z"}] 2023-12-15T23:07:12.227 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002480', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000002058', 3: '00000000000000000000:00000000000000003746'} 2023-12-15T23:07:12.227 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:07:12.227 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.228 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:12.284 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.284 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.334 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002480","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.547854Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002057","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.549335Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002058","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:06:52.544675Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003746","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.546267Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.334 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002480","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.547854Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002057","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.549335Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002058","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:06:52.544675Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003746","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:06:52.546267Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.334 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002480', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:52.547854Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002057', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:52.549335Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002058', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T23:06:52.544675Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003746', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:06:52.546267Z'}}] 2023-12-15T23:07:12.334 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002480', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000002058', 3: '00000000000000000000:00000000000000003746'} 2023-12-15T23:07:12.335 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002480', 1: '00000000000000000000:00000000000000002057', 2: '00000000000000000000:00000000000000002058', 3: '00000000000000000000:00000000000000003746'} 2023-12-15T23:07:12.335 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:07:12.335 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2023-12-15T23:07:12.336 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-36 2023-12-15T23:07:12.337 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:12.337 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:12.337 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.337 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:12.337 DEBUG:boto:Data: 2023-12-15T23:07:12.337 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.337 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.337 DEBUG:boto:Params: {} 2023-12-15T23:07:12.338 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:07:12.338 DEBUG:boto:Token: None 2023-12-15T23:07:12.338 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/ 2023-12-15T23:07:12.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1+D4rc9wZucqv+aidXkDlaz+7js= 2023-12-15T23:07:12.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1+D4rc9wZucqv+aidXkDlaz+7js=', 'Content-Length': '0'} 2023-12-15T23:07:12.358 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000851ba44a9f11f11c-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.358 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-37 2023-12-15T23:07:12.358 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:12.359 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:12.359 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.359 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:12.359 DEBUG:boto:Data: 2023-12-15T23:07:12.359 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.359 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.359 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.359 DEBUG:boto:Params: {} 2023-12-15T23:07:12.359 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:07:12.360 DEBUG:boto:Token: None 2023-12-15T23:07:12.360 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/ 2023-12-15T23:07:12.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zuu43KNN6e+GsVZjotJe22tGlBc= 2023-12-15T23:07:12.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zuu43KNN6e+GsVZjotJe22tGlBc=', 'Content-Length': '0'} 2023-12-15T23:07:12.390 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000069c5ef2d5c9d2064-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.390 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:12.390 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:12.391 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.391 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:12.391 DEBUG:boto:Data: 2023-12-15T23:07:12.391 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.391 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.391 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.391 DEBUG:boto:Params: {} 2023-12-15T23:07:12.391 DEBUG:boto:Token: None 2023-12-15T23:07:12.391 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/ 2023-12-15T23:07:12.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak= 2023-12-15T23:07:12.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak=', 'Content-Length': '0'} 2023-12-15T23:07:12.393 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054b526572efd3947-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.394 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:12.394 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:12.394 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.394 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:12.394 DEBUG:boto:Data: 2023-12-15T23:07:12.394 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.395 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.395 DEBUG:boto:Params: {} 2023-12-15T23:07:12.395 DEBUG:boto:Token: None 2023-12-15T23:07:12.395 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/obj1 2023-12-15T23:07:12.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qn4SVEULeaE0bd6LaintzSGKbos= 2023-12-15T23:07:12.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qn4SVEULeaE0bd6LaintzSGKbos='} 2023-12-15T23:07:12.402 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc89c45cbf51cc96-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.402 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:12.402 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:12.402 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.402 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:12.403 DEBUG:boto:Data: 2023-12-15T23:07:12.403 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.403 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.403 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.403 DEBUG:boto:Params: {} 2023-12-15T23:07:12.403 DEBUG:boto:Token: None 2023-12-15T23:07:12.403 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/ 2023-12-15T23:07:12.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak= 2023-12-15T23:07:12.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak=', 'Content-Length': '0'} 2023-12-15T23:07:12.405 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f577c6b9bf546db0-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.406 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:12.406 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:12.406 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.406 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:12.406 DEBUG:boto:Data: 2023-12-15T23:07:12.406 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.406 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.407 DEBUG:boto:Params: {} 2023-12-15T23:07:12.407 DEBUG:boto:Token: None 2023-12-15T23:07:12.407 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/obj2 2023-12-15T23:07:12.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vvF4PoAoELufeja3VQyRTVInLFw= 2023-12-15T23:07:12.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vvF4PoAoELufeja3VQyRTVInLFw='} 2023-12-15T23:07:12.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c6e749d9d9ba305-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.450 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:12.450 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:12.450 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.450 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:12.450 DEBUG:boto:Data: 2023-12-15T23:07:12.450 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.450 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.451 DEBUG:boto:Params: {} 2023-12-15T23:07:12.451 DEBUG:boto:Token: None 2023-12-15T23:07:12.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/ 2023-12-15T23:07:12.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak= 2023-12-15T23:07:12.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak=', 'Content-Length': '0'} 2023-12-15T23:07:12.453 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b56adc7a1fb8f08a-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.453 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:12.453 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:12.453 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.454 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:12.454 DEBUG:boto:Data: 2023-12-15T23:07:12.454 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.454 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.454 DEBUG:boto:Params: {} 2023-12-15T23:07:12.454 DEBUG:boto:Token: None 2023-12-15T23:07:12.454 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/obj3 2023-12-15T23:07:12.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MfGVgXVhpK43BDXvSX5fS3CABJg= 2023-12-15T23:07:12.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MfGVgXVhpK43BDXvSX5fS3CABJg='} 2023-12-15T23:07:12.460 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9867b4151f49edd-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.460 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:12.461 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:12.461 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.461 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:12.461 DEBUG:boto:Data: 2023-12-15T23:07:12.461 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.461 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.461 DEBUG:boto:Params: {} 2023-12-15T23:07:12.461 DEBUG:boto:Token: None 2023-12-15T23:07:12.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/ 2023-12-15T23:07:12.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak= 2023-12-15T23:07:12.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bpW5ykamD2CT59sN2GMLQtNtOak=', 'Content-Length': '0'} 2023-12-15T23:07:12.463 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b1a09ee809c16a73-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.464 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:12.464 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:12.464 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.464 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:12.464 DEBUG:boto:Data: 2023-12-15T23:07:12.464 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.464 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:12.464 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.464 DEBUG:boto:Params: {} 2023-12-15T23:07:12.465 DEBUG:boto:Token: None 2023-12-15T23:07:12.465 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-36/obj4 2023-12-15T23:07:12.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YfbUiGP9FvVoUqu8ZC47Cr0FN9c= 2023-12-15T23:07:12.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YfbUiGP9FvVoUqu8ZC47Cr0FN9c='} 2023-12-15T23:07:12.470 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9109ebee00c5ad1-00657cdc20-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.471 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:12.471 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:12.471 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.471 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:12.471 DEBUG:boto:Data: 2023-12-15T23:07:12.471 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.471 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.471 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.471 DEBUG:boto:Params: {} 2023-12-15T23:07:12.471 DEBUG:boto:Token: None 2023-12-15T23:07:12.472 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/ 2023-12-15T23:07:12.472 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8= 2023-12-15T23:07:12.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8=', 'Content-Length': '0'} 2023-12-15T23:07:12.474 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001ab96739996ae1d4-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.474 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:12.474 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:12.474 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.474 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:12.475 DEBUG:boto:Data: 2023-12-15T23:07:12.475 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.475 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.475 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.475 DEBUG:boto:Params: {} 2023-12-15T23:07:12.475 DEBUG:boto:Token: None 2023-12-15T23:07:12.475 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/obj1 2023-12-15T23:07:12.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GCuVzHfDaaNpcNTKDbj2HevPswE= 2023-12-15T23:07:12.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GCuVzHfDaaNpcNTKDbj2HevPswE='} 2023-12-15T23:07:12.482 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001003a49ffe4bc853-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.482 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:12.482 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:12.482 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.482 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:12.483 DEBUG:boto:Data: 2023-12-15T23:07:12.483 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.483 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.483 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.483 DEBUG:boto:Params: {} 2023-12-15T23:07:12.483 DEBUG:boto:Token: None 2023-12-15T23:07:12.483 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/ 2023-12-15T23:07:12.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8= 2023-12-15T23:07:12.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8=', 'Content-Length': '0'} 2023-12-15T23:07:12.485 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000abe429877137152c-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.485 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:12.485 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:12.486 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.486 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:12.486 DEBUG:boto:Data: 2023-12-15T23:07:12.486 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.486 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.486 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.486 DEBUG:boto:Params: {} 2023-12-15T23:07:12.486 DEBUG:boto:Token: None 2023-12-15T23:07:12.486 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/obj2 2023-12-15T23:07:12.486 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J71xcehvxMUZFUh5wASr9LI/mow= 2023-12-15T23:07:12.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J71xcehvxMUZFUh5wASr9LI/mow='} 2023-12-15T23:07:12.491 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002366d3a75a084ae1-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.492 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:12.492 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:12.492 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.492 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:12.492 DEBUG:boto:Data: 2023-12-15T23:07:12.492 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.492 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.492 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.492 DEBUG:boto:Params: {} 2023-12-15T23:07:12.492 DEBUG:boto:Token: None 2023-12-15T23:07:12.493 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/ 2023-12-15T23:07:12.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8= 2023-12-15T23:07:12.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8=', 'Content-Length': '0'} 2023-12-15T23:07:12.494 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004970920c5547ad64-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.495 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:12.495 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:12.495 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.495 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:12.495 DEBUG:boto:Data: 2023-12-15T23:07:12.495 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.495 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.495 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.495 DEBUG:boto:Params: {} 2023-12-15T23:07:12.495 DEBUG:boto:Token: None 2023-12-15T23:07:12.496 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/obj3 2023-12-15T23:07:12.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u1VObWSbRhidNQpl23nxI8ymzQw= 2023-12-15T23:07:12.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u1VObWSbRhidNQpl23nxI8ymzQw='} 2023-12-15T23:07:12.537 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019ab73d9a7d866ff-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.538 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:12.538 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:12.538 DEBUG:boto:Method: HEAD 2023-12-15T23:07:12.538 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:12.538 DEBUG:boto:Data: 2023-12-15T23:07:12.538 DEBUG:boto:Headers: {} 2023-12-15T23:07:12.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.538 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.538 DEBUG:boto:Params: {} 2023-12-15T23:07:12.538 DEBUG:boto:Token: None 2023-12-15T23:07:12.539 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/ 2023-12-15T23:07:12.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8= 2023-12-15T23:07:12.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Js1C72H5NeC2/nubptIgweKpxI8=', 'Content-Length': '0'} 2023-12-15T23:07:12.540 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008cbf839fafb90684-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.540 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:12.541 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:12.541 DEBUG:boto:Method: PUT 2023-12-15T23:07:12.541 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:12.541 DEBUG:boto:Data: 2023-12-15T23:07:12.541 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:12.541 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:12.541 DEBUG:boto:Port: 8000 2023-12-15T23:07:12.541 DEBUG:boto:Params: {} 2023-12-15T23:07:12.541 DEBUG:boto:Token: None 2023-12-15T23:07:12.541 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:12 GMT /kskgfn-37/obj4 2023-12-15T23:07:12.542 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y08yYqSFP8npam9l2MLXNrL95MY= 2023-12-15T23:07:12.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y08yYqSFP8npam9l2MLXNrL95MY='} 2023-12-15T23:07:12.546 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5245ec93907eddd-00657cdc20-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:12.547 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.547 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.625 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:07:12.641 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681632.379205_295.1","last_update":"2023-12-15T23:07:12.379205Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:07:12.641 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681632.379205_295.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:12.641 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:07:12.641 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:12.641 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:12.688 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.688 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.717 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:12.716+0000 7fdd8dac0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:07:12.718 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:12.717+0000 7fdd8dac0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:07:12.733 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681632.379205_295.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:12.379205Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.733 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681632.379205_295.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:12.379205Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:07:12Z"} 2023-12-15T23:07:12.733 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681632.379205_295.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:07:12.379205Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:07:12.733 DEBUG:rgw_multi.tests:log_status={0: '1_1702681632.379205_295.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:12.734 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681632.379205_295.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:12.734 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:07:12.734 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-36 2023-12-15T23:07:12.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:12.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:12.734 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-36 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:12.786 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:12.787 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:12.821 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:12.821+0000 7f10d2e12800 1 waiting to reach incremental sync.. 2023-12-15T23:07:17.824 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:17.823+0000 7f10d2e12800 1 bucket sync caught up with source: 2023-12-15T23:07:17.824 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.106.6, , 00000000001.24.6, , 00000000001.33.6, , , 00000000001.27.6, , , ] 2023-12-15T23:07:17.824 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.106.6, , 00000000001.24.6, , 00000000001.33.6, , , 00000000001.27.6, , , ] 2023-12-15T23:07:17.824 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:17.823+0000 7f10d2e12800 0 bucket checkpoint complete 2023-12-15T23:07:17.842 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-36 2023-12-15T23:07:17.842 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:17.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:17.843 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-36 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:17.904 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:17.904 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:17.952+0000 7fba61410800 1 bucket sync caught up with source: 2023-12-15T23:07:17.953 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:17.953 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:17.952+0000 7fba61410800 0 bucket checkpoint complete 2023-12-15T23:07:17.969 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-36 zones={test-zone2, test-zone1} 2023-12-15T23:07:17.969 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.969 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.970 DEBUG:boto:Method: HEAD 2023-12-15T23:07:17.970 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:17.970 DEBUG:boto:Data: 2023-12-15T23:07:17.970 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:17.970 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.970 DEBUG:boto:Params: {} 2023-12-15T23:07:17.970 DEBUG:boto:Token: None 2023-12-15T23:07:17.970 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/ 2023-12-15T23:07:17.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AUTLrwPTzmKhWfOMIYxnEY+GmOM= 2023-12-15T23:07:17.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AUTLrwPTzmKhWfOMIYxnEY+GmOM=', 'Content-Length': '0'} 2023-12-15T23:07:17.973 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049c1f98914c48eda-00657cdc25-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.973 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.974 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.974 DEBUG:boto:Method: HEAD 2023-12-15T23:07:17.974 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:17.974 DEBUG:boto:Data: 2023-12-15T23:07:17.974 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:17.974 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.974 DEBUG:boto:Params: {} 2023-12-15T23:07:17.974 DEBUG:boto:Token: None 2023-12-15T23:07:17.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/ 2023-12-15T23:07:17.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AUTLrwPTzmKhWfOMIYxnEY+GmOM= 2023-12-15T23:07:17.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AUTLrwPTzmKhWfOMIYxnEY+GmOM=', 'Content-Length': '0'} 2023-12-15T23:07:17.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000028e5050f83cb1239-00657cdc25-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.977 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:07:17.977 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.977 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.977 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.977 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.977 DEBUG:boto:Method: GET 2023-12-15T23:07:17.978 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.978 DEBUG:boto:Data: 2023-12-15T23:07:17.978 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:17.978 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.978 DEBUG:boto:Params: {} 2023-12-15T23:07:17.978 DEBUG:boto:Token: None 2023-12-15T23:07:17.978 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/?versions 2023-12-15T23:07:17.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k= 2023-12-15T23:07:17.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k=', 'Content-Length': '0'} 2023-12-15T23:07:17.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bc2d9bb3bc04e03-00657cdc25-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.981 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:17.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:17.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:17.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:17.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:17.983 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:07:17.983 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.983 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.983 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.983 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.983 DEBUG:boto:Method: GET 2023-12-15T23:07:17.983 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.983 DEBUG:boto:Data: 2023-12-15T23:07:17.983 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.983 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:17.983 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.983 DEBUG:boto:Params: {} 2023-12-15T23:07:17.984 DEBUG:boto:Token: None 2023-12-15T23:07:17.984 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/?versions 2023-12-15T23:07:17.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k= 2023-12-15T23:07:17.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k=', 'Content-Length': '0'} 2023-12-15T23:07:17.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031a4bbb2a5ab4f50-00657cdc25-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.986 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:17.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:17.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:17.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:17.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:17.987 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.987 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.987 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.987 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.987 DEBUG:boto:Method: GET 2023-12-15T23:07:17.988 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.988 DEBUG:boto:Data: 2023-12-15T23:07:17.988 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.988 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:17.988 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.988 DEBUG:boto:Params: {} 2023-12-15T23:07:17.988 DEBUG:boto:Token: None 2023-12-15T23:07:17.988 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/?versions 2023-12-15T23:07:17.988 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k= 2023-12-15T23:07:17.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k=', 'Content-Length': '0'} 2023-12-15T23:07:17.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb4b62cfb75dcd6e-00657cdc25-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.991 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:17.991 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:17.991 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:17.992 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.992 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.992 DEBUG:boto:Method: GET 2023-12-15T23:07:17.992 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:17.992 DEBUG:boto:Data: 2023-12-15T23:07:17.992 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.992 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:17.992 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.992 DEBUG:boto:Params: {} 2023-12-15T23:07:17.992 DEBUG:boto:Token: None 2023-12-15T23:07:17.992 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/?versions 2023-12-15T23:07:17.993 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k= 2023-12-15T23:07:17.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6bI91AORv7Bndt7L/yPrFShml0k=', 'Content-Length': '0'} 2023-12-15T23:07:17.995 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c078a3d35ed35be-00657cdc25-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.995 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:17.995 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:17.996 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:17.996 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:17.996 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:17.996 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:17.996 DEBUG:boto:Method: GET 2023-12-15T23:07:17.996 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:17.996 DEBUG:boto:Data: 2023-12-15T23:07:17.996 DEBUG:boto:Headers: {} 2023-12-15T23:07:17.996 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:17.996 DEBUG:boto:Port: 8000 2023-12-15T23:07:17.997 DEBUG:boto:Params: {} 2023-12-15T23:07:17.997 DEBUG:boto:Token: None 2023-12-15T23:07:17.997 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:17 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:17.997 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rLA9PNE8THPFlZ7loYTqxB5XB7Q= 2023-12-15T23:07:17.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rLA9PNE8THPFlZ7loYTqxB5XB7Q=', 'Content-Length': '0'} 2023-12-15T23:07:17.999 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008876eb574ccfe3aa-00657cdc25-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:17.999 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:17.999 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:17.999 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:17.999 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.000 DEBUG:boto:Method: GET 2023-12-15T23:07:18.000 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.000 DEBUG:boto:Data: 2023-12-15T23:07:18.000 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.000 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.000 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.000 DEBUG:boto:Params: {} 2023-12-15T23:07:18.000 DEBUG:boto:Token: None 2023-12-15T23:07:18.000 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI= 2023-12-15T23:07:18.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI=', 'Content-Length': '0'} 2023-12-15T23:07:18.003 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003cee7d2a26fdaf95-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.049 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.050 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.050 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.050 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.050 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.050 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.050 DEBUG:boto:Data: 2023-12-15T23:07:18.050 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.050 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.050 DEBUG:boto:Params: {} 2023-12-15T23:07:18.051 DEBUG:boto:Token: None 2023-12-15T23:07:18.051 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5424BeY64eU9IhuhjyivMglX98= 2023-12-15T23:07:18.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5424BeY64eU9IhuhjyivMglX98=', 'Content-Length': '0'} 2023-12-15T23:07:18.053 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000099b8862cdc02393a-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.053 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.053 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.053 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.053 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.054 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.054 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.054 DEBUG:boto:Data: 2023-12-15T23:07:18.054 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.054 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.054 DEBUG:boto:Params: {} 2023-12-15T23:07:18.054 DEBUG:boto:Token: None 2023-12-15T23:07:18.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5424BeY64eU9IhuhjyivMglX98= 2023-12-15T23:07:18.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5424BeY64eU9IhuhjyivMglX98=', 'Content-Length': '0'} 2023-12-15T23:07:18.056 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008eeed62a88a405f0-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:18.057 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.057 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.057 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.057 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.057 DEBUG:boto:Method: GET 2023-12-15T23:07:18.057 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.057 DEBUG:boto:Data: 2023-12-15T23:07:18.057 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.057 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.058 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.058 DEBUG:boto:Params: {} 2023-12-15T23:07:18.058 DEBUG:boto:Token: None 2023-12-15T23:07:18.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI= 2023-12-15T23:07:18.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI=', 'Content-Length': '0'} 2023-12-15T23:07:18.060 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d11690a87c8f712a-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.060 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.060 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.060 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.061 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.061 DEBUG:boto:Method: GET 2023-12-15T23:07:18.061 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.061 DEBUG:boto:Data: 2023-12-15T23:07:18.061 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.061 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.061 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.061 DEBUG:boto:Params: {} 2023-12-15T23:07:18.061 DEBUG:boto:Token: None 2023-12-15T23:07:18.061 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:18.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI= 2023-12-15T23:07:18.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:maESVYAqaIRbRUESxSI/h6WJeWI=', 'Content-Length': '0'} 2023-12-15T23:07:18.063 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d775be188852ea13-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.063 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.064 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.064 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.064 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.064 DEBUG:boto:Method: GET 2023-12-15T23:07:18.064 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.064 DEBUG:boto:Data: 2023-12-15T23:07:18.064 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.064 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.064 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.064 DEBUG:boto:Params: {} 2023-12-15T23:07:18.064 DEBUG:boto:Token: None 2023-12-15T23:07:18.065 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.065 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009171ce33476c561e-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.068 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.068 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.068 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.068 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.068 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.068 DEBUG:boto:Method: GET 2023-12-15T23:07:18.068 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.069 DEBUG:boto:Data: 2023-12-15T23:07:18.069 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.069 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.069 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.069 DEBUG:boto:Params: {} 2023-12-15T23:07:18.069 DEBUG:boto:Token: None 2023-12-15T23:07:18.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023e4b0586658a98c-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.072 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.072 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.072 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.072 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.073 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:18.073 DEBUG:boto:Data: 2023-12-15T23:07:18.073 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.073 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.073 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.073 DEBUG:boto:Params: {} 2023-12-15T23:07:18.073 DEBUG:boto:Token: None 2023-12-15T23:07:18.073 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1 2023-12-15T23:07:18.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w3aROQCXVZKjW+6PwSL9ubVTiUo= 2023-12-15T23:07:18.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w3aROQCXVZKjW+6PwSL9ubVTiUo=', 'Content-Length': '0'} 2023-12-15T23:07:18.075 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004761cb57ad53dd9b-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.075 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.076 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.076 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.076 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:18.076 DEBUG:boto:Data: 2023-12-15T23:07:18.076 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.076 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.076 DEBUG:boto:Params: {} 2023-12-15T23:07:18.076 DEBUG:boto:Token: None 2023-12-15T23:07:18.076 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1 2023-12-15T23:07:18.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w3aROQCXVZKjW+6PwSL9ubVTiUo= 2023-12-15T23:07:18.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w3aROQCXVZKjW+6PwSL9ubVTiUo=', 'Content-Length': '0'} 2023-12-15T23:07:18.078 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008b6fdd490c94acab-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.078 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:18.079 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.079 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.079 DEBUG:boto:Method: GET 2023-12-15T23:07:18.079 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:18.079 DEBUG:boto:Data: 2023-12-15T23:07:18.079 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.079 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.079 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.079 DEBUG:boto:Params: {} 2023-12-15T23:07:18.079 DEBUG:boto:Token: None 2023-12-15T23:07:18.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1 2023-12-15T23:07:18.080 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:as2H8wC72YCoKyZ9H0fX8mvVVYI= 2023-12-15T23:07:18.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:as2H8wC72YCoKyZ9H0fX8mvVVYI=', 'Content-Length': '0'} 2023-12-15T23:07:18.082 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e0e2a65efcce126-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.125 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:18.126 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:18.126 DEBUG:boto:Method: GET 2023-12-15T23:07:18.126 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:18.126 DEBUG:boto:Data: 2023-12-15T23:07:18.126 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.126 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.126 DEBUG:boto:Params: {} 2023-12-15T23:07:18.126 DEBUG:boto:Token: None 2023-12-15T23:07:18.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj1 2023-12-15T23:07:18.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:as2H8wC72YCoKyZ9H0fX8mvVVYI= 2023-12-15T23:07:18.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:as2H8wC72YCoKyZ9H0fX8mvVVYI=', 'Content-Length': '0'} 2023-12-15T23:07:18.128 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000012a6c7143c155e35-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.129 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.129 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.129 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.129 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.129 DEBUG:boto:Method: GET 2023-12-15T23:07:18.129 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.129 DEBUG:boto:Data: 2023-12-15T23:07:18.129 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.129 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.129 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.130 DEBUG:boto:Params: {} 2023-12-15T23:07:18.130 DEBUG:boto:Token: None 2023-12-15T23:07:18.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051381ab02fe120c7-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.173 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.174 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.174 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.174 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.174 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.174 DEBUG:boto:Method: GET 2023-12-15T23:07:18.174 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:18.175 DEBUG:boto:Data: 2023-12-15T23:07:18.175 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.175 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.175 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.175 DEBUG:boto:Params: {} 2023-12-15T23:07:18.175 DEBUG:boto:Token: None 2023-12-15T23:07:18.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c856b598c800e590-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.178 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:18.178 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.178 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.179 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.179 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.179 DEBUG:boto:Method: GET 2023-12-15T23:07:18.179 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.179 DEBUG:boto:Data: 2023-12-15T23:07:18.179 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.179 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.179 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.179 DEBUG:boto:Params: {} 2023-12-15T23:07:18.179 DEBUG:boto:Token: None 2023-12-15T23:07:18.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM= 2023-12-15T23:07:18.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM=', 'Content-Length': '0'} 2023-12-15T23:07:18.182 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d72a8b91f7bb7b65-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.182 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.182 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.182 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.182 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.182 DEBUG:boto:Method: GET 2023-12-15T23:07:18.182 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.182 DEBUG:boto:Data: 2023-12-15T23:07:18.182 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.183 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.183 DEBUG:boto:Params: {} 2023-12-15T23:07:18.183 DEBUG:boto:Token: None 2023-12-15T23:07:18.183 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM= 2023-12-15T23:07:18.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM=', 'Content-Length': '0'} 2023-12-15T23:07:18.185 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008a3280b14a761f75-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.185 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.186 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.186 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.186 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.186 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.186 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.186 DEBUG:boto:Data: 2023-12-15T23:07:18.186 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.186 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.186 DEBUG:boto:Params: {} 2023-12-15T23:07:18.186 DEBUG:boto:Token: None 2023-12-15T23:07:18.187 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CUq7afqVeYcOAc/YrvHNmpQxQi4= 2023-12-15T23:07:18.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CUq7afqVeYcOAc/YrvHNmpQxQi4=', 'Content-Length': '0'} 2023-12-15T23:07:18.189 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e02b2fd7e5fad2dd-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.189 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.189 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.189 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.189 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.189 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.189 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.189 DEBUG:boto:Data: 2023-12-15T23:07:18.190 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.190 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.190 DEBUG:boto:Params: {} 2023-12-15T23:07:18.190 DEBUG:boto:Token: None 2023-12-15T23:07:18.190 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CUq7afqVeYcOAc/YrvHNmpQxQi4= 2023-12-15T23:07:18.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CUq7afqVeYcOAc/YrvHNmpQxQi4=', 'Content-Length': '0'} 2023-12-15T23:07:18.192 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a4c473f228211026-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:18.192 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.192 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.192 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.192 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.193 DEBUG:boto:Method: GET 2023-12-15T23:07:18.193 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.193 DEBUG:boto:Data: 2023-12-15T23:07:18.193 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.193 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.193 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.193 DEBUG:boto:Params: {} 2023-12-15T23:07:18.193 DEBUG:boto:Token: None 2023-12-15T23:07:18.193 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM= 2023-12-15T23:07:18.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM=', 'Content-Length': '0'} 2023-12-15T23:07:18.195 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010c782a871885111-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.237 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.238 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.238 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.238 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.238 DEBUG:boto:Method: GET 2023-12-15T23:07:18.238 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.238 DEBUG:boto:Data: 2023-12-15T23:07:18.238 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.238 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.238 DEBUG:boto:Params: {} 2023-12-15T23:07:18.238 DEBUG:boto:Token: None 2023-12-15T23:07:18.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:18.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM= 2023-12-15T23:07:18.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+O96kOY5uiZVWL7pSxM/8N/rUcM=', 'Content-Length': '0'} 2023-12-15T23:07:18.240 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000034b456780461200b-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.241 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.241 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.241 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.241 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.241 DEBUG:boto:Method: GET 2023-12-15T23:07:18.241 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.241 DEBUG:boto:Data: 2023-12-15T23:07:18.242 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.242 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.242 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.242 DEBUG:boto:Params: {} 2023-12-15T23:07:18.242 DEBUG:boto:Token: None 2023-12-15T23:07:18.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e807f2caa38d8e2c-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.285 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.286 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.286 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.286 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.286 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.286 DEBUG:boto:Method: GET 2023-12-15T23:07:18.286 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.286 DEBUG:boto:Data: 2023-12-15T23:07:18.286 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.287 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.287 DEBUG:boto:Params: {} 2023-12-15T23:07:18.287 DEBUG:boto:Token: None 2023-12-15T23:07:18.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce1d3fc30c189b46-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.289 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.290 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.290 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.290 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.290 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:18.290 DEBUG:boto:Data: 2023-12-15T23:07:18.290 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.290 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.290 DEBUG:boto:Params: {} 2023-12-15T23:07:18.291 DEBUG:boto:Token: None 2023-12-15T23:07:18.291 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2 2023-12-15T23:07:18.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4JGRqRrmZQtYdO3+DKu50iPoxNo= 2023-12-15T23:07:18.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4JGRqRrmZQtYdO3+DKu50iPoxNo=', 'Content-Length': '0'} 2023-12-15T23:07:18.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000041c9caf94733610d-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.293 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.293 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.293 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.293 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:18.293 DEBUG:boto:Data: 2023-12-15T23:07:18.293 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.293 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.294 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.294 DEBUG:boto:Params: {} 2023-12-15T23:07:18.294 DEBUG:boto:Token: None 2023-12-15T23:07:18.294 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2 2023-12-15T23:07:18.294 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4JGRqRrmZQtYdO3+DKu50iPoxNo= 2023-12-15T23:07:18.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4JGRqRrmZQtYdO3+DKu50iPoxNo=', 'Content-Length': '0'} 2023-12-15T23:07:18.296 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009f2ec75ef38dad48-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:18.296 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.296 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.296 DEBUG:boto:Method: GET 2023-12-15T23:07:18.296 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:18.296 DEBUG:boto:Data: 2023-12-15T23:07:18.296 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.297 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.297 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.297 DEBUG:boto:Params: {} 2023-12-15T23:07:18.297 DEBUG:boto:Token: None 2023-12-15T23:07:18.297 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2 2023-12-15T23:07:18.297 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aq9Dw4zkASdeioGgaaeLk6kgpoE= 2023-12-15T23:07:18.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aq9Dw4zkASdeioGgaaeLk6kgpoE=', 'Content-Length': '0'} 2023-12-15T23:07:18.299 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4fef1b667655b29-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.341 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:18.342 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:18.342 DEBUG:boto:Method: GET 2023-12-15T23:07:18.342 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:18.342 DEBUG:boto:Data: 2023-12-15T23:07:18.342 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.342 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.342 DEBUG:boto:Params: {} 2023-12-15T23:07:18.342 DEBUG:boto:Token: None 2023-12-15T23:07:18.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj2 2023-12-15T23:07:18.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aq9Dw4zkASdeioGgaaeLk6kgpoE= 2023-12-15T23:07:18.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aq9Dw4zkASdeioGgaaeLk6kgpoE=', 'Content-Length': '0'} 2023-12-15T23:07:18.344 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000695c13ae92b1b041-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.345 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.345 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.345 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.345 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.345 DEBUG:boto:Method: GET 2023-12-15T23:07:18.345 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.345 DEBUG:boto:Data: 2023-12-15T23:07:18.345 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.346 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.346 DEBUG:boto:Params: {} 2023-12-15T23:07:18.346 DEBUG:boto:Token: None 2023-12-15T23:07:18.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7a6f497c56fe9a1-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.349 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.349 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.349 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.349 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.350 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.350 DEBUG:boto:Method: GET 2023-12-15T23:07:18.350 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:18.350 DEBUG:boto:Data: 2023-12-15T23:07:18.350 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.350 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.350 DEBUG:boto:Params: {} 2023-12-15T23:07:18.350 DEBUG:boto:Token: None 2023-12-15T23:07:18.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060549db3a52a1b70-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.353 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.354 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:18.354 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.354 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.354 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.354 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.354 DEBUG:boto:Method: GET 2023-12-15T23:07:18.354 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.354 DEBUG:boto:Data: 2023-12-15T23:07:18.354 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.354 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.355 DEBUG:boto:Params: {} 2023-12-15T23:07:18.355 DEBUG:boto:Token: None 2023-12-15T23:07:18.355 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI= 2023-12-15T23:07:18.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI=', 'Content-Length': '0'} 2023-12-15T23:07:18.357 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cc7470eaaf74057d-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.357 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.357 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.357 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.358 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.358 DEBUG:boto:Method: GET 2023-12-15T23:07:18.358 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.358 DEBUG:boto:Data: 2023-12-15T23:07:18.358 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.358 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.358 DEBUG:boto:Params: {} 2023-12-15T23:07:18.358 DEBUG:boto:Token: None 2023-12-15T23:07:18.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI= 2023-12-15T23:07:18.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI=', 'Content-Length': '0'} 2023-12-15T23:07:18.361 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a318e049dff9263a-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.361 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.361 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.361 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.361 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.361 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.361 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.361 DEBUG:boto:Data: 2023-12-15T23:07:18.362 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.362 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.362 DEBUG:boto:Params: {} 2023-12-15T23:07:18.362 DEBUG:boto:Token: None 2023-12-15T23:07:18.362 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RPpkwxUlsi/LBL/L+rUKXAm3htw= 2023-12-15T23:07:18.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RPpkwxUlsi/LBL/L+rUKXAm3htw=', 'Content-Length': '0'} 2023-12-15T23:07:18.364 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000323922c1c14e08e4-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.364 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.364 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.365 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.365 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.365 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.365 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.365 DEBUG:boto:Data: 2023-12-15T23:07:18.365 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.365 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.365 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.365 DEBUG:boto:Params: {} 2023-12-15T23:07:18.365 DEBUG:boto:Token: None 2023-12-15T23:07:18.365 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RPpkwxUlsi/LBL/L+rUKXAm3htw= 2023-12-15T23:07:18.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RPpkwxUlsi/LBL/L+rUKXAm3htw=', 'Content-Length': '0'} 2023-12-15T23:07:18.367 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b5cc619a232584c-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:18.368 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.368 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.368 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.368 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.368 DEBUG:boto:Method: GET 2023-12-15T23:07:18.368 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.368 DEBUG:boto:Data: 2023-12-15T23:07:18.368 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.368 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.369 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.369 DEBUG:boto:Params: {} 2023-12-15T23:07:18.369 DEBUG:boto:Token: None 2023-12-15T23:07:18.369 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI= 2023-12-15T23:07:18.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI=', 'Content-Length': '0'} 2023-12-15T23:07:18.371 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002bf371ddc7a3f2e7-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.414 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.414 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.414 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.414 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.414 DEBUG:boto:Method: GET 2023-12-15T23:07:18.414 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.414 DEBUG:boto:Data: 2023-12-15T23:07:18.414 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.414 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.414 DEBUG:boto:Params: {} 2023-12-15T23:07:18.415 DEBUG:boto:Token: None 2023-12-15T23:07:18.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:18.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI= 2023-12-15T23:07:18.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WFpT+iwF4m3Au9m14Q6u+oZtFVI=', 'Content-Length': '0'} 2023-12-15T23:07:18.417 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000006434df64059b32e-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.417 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.418 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.418 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.418 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.418 DEBUG:boto:Method: GET 2023-12-15T23:07:18.418 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.418 DEBUG:boto:Data: 2023-12-15T23:07:18.418 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.418 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.418 DEBUG:boto:Params: {} 2023-12-15T23:07:18.419 DEBUG:boto:Token: None 2023-12-15T23:07:18.419 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063479865d5afabea-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.465 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.466 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.466 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.466 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.466 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.466 DEBUG:boto:Method: GET 2023-12-15T23:07:18.466 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.466 DEBUG:boto:Data: 2023-12-15T23:07:18.466 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.467 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.467 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.467 DEBUG:boto:Params: {} 2023-12-15T23:07:18.467 DEBUG:boto:Token: None 2023-12-15T23:07:18.467 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005381bfbd88a0c187-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.470 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.470 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.470 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.470 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.470 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:18.470 DEBUG:boto:Data: 2023-12-15T23:07:18.470 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.471 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.471 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.471 DEBUG:boto:Params: {} 2023-12-15T23:07:18.471 DEBUG:boto:Token: None 2023-12-15T23:07:18.471 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3 2023-12-15T23:07:18.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MH1hLLa6CZb1Xr0kW52e545dTig= 2023-12-15T23:07:18.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MH1hLLa6CZb1Xr0kW52e545dTig=', 'Content-Length': '0'} 2023-12-15T23:07:18.473 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008e8ca180ab4dce67-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.474 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.474 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.474 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.474 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:18.474 DEBUG:boto:Data: 2023-12-15T23:07:18.474 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.474 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.474 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.474 DEBUG:boto:Params: {} 2023-12-15T23:07:18.474 DEBUG:boto:Token: None 2023-12-15T23:07:18.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3 2023-12-15T23:07:18.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MH1hLLa6CZb1Xr0kW52e545dTig= 2023-12-15T23:07:18.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MH1hLLa6CZb1Xr0kW52e545dTig=', 'Content-Length': '0'} 2023-12-15T23:07:18.477 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002782cb8e59f92cde-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:18.477 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.477 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.477 DEBUG:boto:Method: GET 2023-12-15T23:07:18.477 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:18.477 DEBUG:boto:Data: 2023-12-15T23:07:18.477 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.478 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.478 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.478 DEBUG:boto:Params: {} 2023-12-15T23:07:18.478 DEBUG:boto:Token: None 2023-12-15T23:07:18.478 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3 2023-12-15T23:07:18.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NK0BX2o4OTeBIBXOxohw2OEU0Cg= 2023-12-15T23:07:18.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NK0BX2o4OTeBIBXOxohw2OEU0Cg=', 'Content-Length': '0'} 2023-12-15T23:07:18.480 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d59166f4a3ba4bba-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.525 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:18.528 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:18.528 DEBUG:boto:Method: GET 2023-12-15T23:07:18.528 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:18.528 DEBUG:boto:Data: 2023-12-15T23:07:18.528 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.528 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.529 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.529 DEBUG:boto:Params: {} 2023-12-15T23:07:18.529 DEBUG:boto:Token: None 2023-12-15T23:07:18.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj3 2023-12-15T23:07:18.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NK0BX2o4OTeBIBXOxohw2OEU0Cg= 2023-12-15T23:07:18.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NK0BX2o4OTeBIBXOxohw2OEU0Cg=', 'Content-Length': '0'} 2023-12-15T23:07:18.531 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c575c87cd9a70484-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.532 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.532 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.532 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.532 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.532 DEBUG:boto:Method: GET 2023-12-15T23:07:18.532 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.532 DEBUG:boto:Data: 2023-12-15T23:07:18.532 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.532 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.532 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.532 DEBUG:boto:Params: {} 2023-12-15T23:07:18.533 DEBUG:boto:Token: None 2023-12-15T23:07:18.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8a489bb120d4ba3-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.577 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.578 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.578 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.578 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.578 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.578 DEBUG:boto:Method: GET 2023-12-15T23:07:18.578 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:18.578 DEBUG:boto:Data: 2023-12-15T23:07:18.578 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.579 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.579 DEBUG:boto:Params: {} 2023-12-15T23:07:18.579 DEBUG:boto:Token: None 2023-12-15T23:07:18.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056ead01cc8605f22-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.581 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.582 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:18.582 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.582 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.582 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.582 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.582 DEBUG:boto:Method: GET 2023-12-15T23:07:18.582 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.582 DEBUG:boto:Data: 2023-12-15T23:07:18.582 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.583 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.583 DEBUG:boto:Params: {} 2023-12-15T23:07:18.583 DEBUG:boto:Token: None 2023-12-15T23:07:18.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8= 2023-12-15T23:07:18.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8=', 'Content-Length': '0'} 2023-12-15T23:07:18.585 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000014917ee7e5ffbdcf-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.586 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.586 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.586 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.586 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.586 DEBUG:boto:Method: GET 2023-12-15T23:07:18.586 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.586 DEBUG:boto:Data: 2023-12-15T23:07:18.586 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.586 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.586 DEBUG:boto:Params: {} 2023-12-15T23:07:18.587 DEBUG:boto:Token: None 2023-12-15T23:07:18.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8= 2023-12-15T23:07:18.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8=', 'Content-Length': '0'} 2023-12-15T23:07:18.588 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079a100f98c0bb99f-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.589 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.589 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.589 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.589 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.589 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.589 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.589 DEBUG:boto:Data: 2023-12-15T23:07:18.589 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.589 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.590 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.590 DEBUG:boto:Params: {} 2023-12-15T23:07:18.590 DEBUG:boto:Token: None 2023-12-15T23:07:18.590 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m5Fr3tW/mEWePA7XokEqEutdQ34= 2023-12-15T23:07:18.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m5Fr3tW/mEWePA7XokEqEutdQ34=', 'Content-Length': '0'} 2023-12-15T23:07:18.592 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000128d511cad5b5c6a-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.592 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.592 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.592 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.592 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.592 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.592 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.592 DEBUG:boto:Data: 2023-12-15T23:07:18.592 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.593 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.593 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.593 DEBUG:boto:Params: {} 2023-12-15T23:07:18.593 DEBUG:boto:Token: None 2023-12-15T23:07:18.593 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m5Fr3tW/mEWePA7XokEqEutdQ34= 2023-12-15T23:07:18.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m5Fr3tW/mEWePA7XokEqEutdQ34=', 'Content-Length': '0'} 2023-12-15T23:07:18.595 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000effeec90d2c25d39-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.595 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:18.595 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.595 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.595 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.595 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.596 DEBUG:boto:Method: GET 2023-12-15T23:07:18.596 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.596 DEBUG:boto:Data: 2023-12-15T23:07:18.596 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.596 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.596 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.596 DEBUG:boto:Params: {} 2023-12-15T23:07:18.596 DEBUG:boto:Token: None 2023-12-15T23:07:18.596 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8= 2023-12-15T23:07:18.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8=', 'Content-Length': '0'} 2023-12-15T23:07:18.598 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006d2a04090e377dd1-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.641 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.642 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.642 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.642 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.642 DEBUG:boto:Method: GET 2023-12-15T23:07:18.642 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.642 DEBUG:boto:Data: 2023-12-15T23:07:18.642 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.642 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.642 DEBUG:boto:Params: {} 2023-12-15T23:07:18.643 DEBUG:boto:Token: None 2023-12-15T23:07:18.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:18.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8= 2023-12-15T23:07:18.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AtpqDyJ+8LtVMFnKr9eFyniCxs8=', 'Content-Length': '0'} 2023-12-15T23:07:18.645 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b208da5efe508044-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.645 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.645 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.645 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.645 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.645 DEBUG:boto:Method: GET 2023-12-15T23:07:18.645 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.645 DEBUG:boto:Data: 2023-12-15T23:07:18.645 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.645 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.646 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.646 DEBUG:boto:Params: {} 2023-12-15T23:07:18.646 DEBUG:boto:Token: None 2023-12-15T23:07:18.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6eee58e40896196-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.689 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.690 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.690 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.690 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.690 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.690 DEBUG:boto:Method: GET 2023-12-15T23:07:18.690 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.690 DEBUG:boto:Data: 2023-12-15T23:07:18.690 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.690 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.691 DEBUG:boto:Params: {} 2023-12-15T23:07:18.691 DEBUG:boto:Token: None 2023-12-15T23:07:18.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000434b1fe1e508e74d-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.693 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.694 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.694 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.694 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.694 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:18.694 DEBUG:boto:Data: 2023-12-15T23:07:18.694 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.694 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.694 DEBUG:boto:Params: {} 2023-12-15T23:07:18.695 DEBUG:boto:Token: None 2023-12-15T23:07:18.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4 2023-12-15T23:07:18.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TvCC8CFMdmImoxEXTNDp/Iu9wPQ= 2023-12-15T23:07:18.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TvCC8CFMdmImoxEXTNDp/Iu9wPQ=', 'Content-Length': '0'} 2023-12-15T23:07:18.697 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000b4b424b46add7e9-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.697 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.697 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.697 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.697 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:18.697 DEBUG:boto:Data: 2023-12-15T23:07:18.697 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.698 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.698 DEBUG:boto:Params: {} 2023-12-15T23:07:18.698 DEBUG:boto:Token: None 2023-12-15T23:07:18.698 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4 2023-12-15T23:07:18.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TvCC8CFMdmImoxEXTNDp/Iu9wPQ= 2023-12-15T23:07:18.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TvCC8CFMdmImoxEXTNDp/Iu9wPQ=', 'Content-Length': '0'} 2023-12-15T23:07:18.700 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f00ce17e7b20b26e-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:18.700 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.700 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.700 DEBUG:boto:Method: GET 2023-12-15T23:07:18.701 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:18.701 DEBUG:boto:Data: 2023-12-15T23:07:18.701 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.701 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.701 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.701 DEBUG:boto:Params: {} 2023-12-15T23:07:18.701 DEBUG:boto:Token: None 2023-12-15T23:07:18.701 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4 2023-12-15T23:07:18.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sF5ZoF/d3RLmyfJ279tKWIjKCyg= 2023-12-15T23:07:18.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sF5ZoF/d3RLmyfJ279tKWIjKCyg=', 'Content-Length': '0'} 2023-12-15T23:07:18.703 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000585f317841d65793-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.750 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:18.750 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:18.750 DEBUG:boto:Method: GET 2023-12-15T23:07:18.750 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:18.750 DEBUG:boto:Data: 2023-12-15T23:07:18.750 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.750 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.750 DEBUG:boto:Params: {} 2023-12-15T23:07:18.750 DEBUG:boto:Token: None 2023-12-15T23:07:18.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/obj4 2023-12-15T23:07:18.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sF5ZoF/d3RLmyfJ279tKWIjKCyg= 2023-12-15T23:07:18.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sF5ZoF/d3RLmyfJ279tKWIjKCyg=', 'Content-Length': '0'} 2023-12-15T23:07:18.753 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a8e97c18ce012307-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.753 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.753 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.753 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.753 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.753 DEBUG:boto:Method: GET 2023-12-15T23:07:18.753 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.753 DEBUG:boto:Data: 2023-12-15T23:07:18.754 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.754 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.754 DEBUG:boto:Params: {} 2023-12-15T23:07:18.754 DEBUG:boto:Token: None 2023-12-15T23:07:18.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef1a11a4f4945016-00657cdc26-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.757 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.757 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:18.757 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:18.757 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.757 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.758 DEBUG:boto:Method: GET 2023-12-15T23:07:18.758 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:18.758 DEBUG:boto:Data: 2023-12-15T23:07:18.758 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:18.758 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.758 DEBUG:boto:Params: {} 2023-12-15T23:07:18.758 DEBUG:boto:Token: None 2023-12-15T23:07:18.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-36/ 2023-12-15T23:07:18.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk= 2023-12-15T23:07:18.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xfFrZr9jGUSmAv7APTQs0Zhmmdk=', 'Content-Length': '0'} 2023-12-15T23:07:18.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba542263e9ede938-00657cdc26-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:18.761 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:18.761 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-36 zones={test-zone2, test-zone1} 2023-12-15T23:07:18.762 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-37 2023-12-15T23:07:18.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:18.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:18.762 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-37 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:18.824 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:18.824 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:18.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:18.862+0000 7f48cef3d800 1 bucket sync caught up with source: 2023-12-15T23:07:18.863 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.35.6, , 00000000001.17.6, , 00000000001.37.6, , , 00000000001.18.6, , , ] 2023-12-15T23:07:18.863 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.35.6, , 00000000001.17.6, , 00000000001.37.6, , , 00000000001.18.6, , , ] 2023-12-15T23:07:18.863 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:18.862+0000 7f48cef3d800 0 bucket checkpoint complete 2023-12-15T23:07:18.877 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-37 2023-12-15T23:07:18.878 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:18.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:18.878 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-37 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:18.939 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:18.939 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:18.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:18.980+0000 7fae23f22800 1 bucket sync caught up with source: 2023-12-15T23:07:18.980 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.78.6, , 00000000001.50.6, , 00000000001.74.6, , , 00000000001.55.6, , , ] 2023-12-15T23:07:18.980 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.78.6, , 00000000001.50.6, , 00000000001.74.6, , , 00000000001.55.6, , , ] 2023-12-15T23:07:18.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:18.980+0000 7fae23f22800 0 bucket checkpoint complete 2023-12-15T23:07:18.996 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-37 zones={test-zone2, test-zone1} 2023-12-15T23:07:18.997 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:18.997 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:18.997 DEBUG:boto:Method: HEAD 2023-12-15T23:07:18.997 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:18.997 DEBUG:boto:Data: 2023-12-15T23:07:18.997 DEBUG:boto:Headers: {} 2023-12-15T23:07:18.997 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:18.997 DEBUG:boto:Port: 8000 2023-12-15T23:07:18.997 DEBUG:boto:Params: {} 2023-12-15T23:07:18.997 DEBUG:boto:Token: None 2023-12-15T23:07:18.998 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:18 GMT /kskgfn-37/ 2023-12-15T23:07:18.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vNjrLnbT6xDDWnoNIV01+2qjClg= 2023-12-15T23:07:18.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vNjrLnbT6xDDWnoNIV01+2qjClg=', 'Content-Length': '0'} 2023-12-15T23:07:19.000 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000064fbc39205ddb99-00657cdc26-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.000 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.000 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.000 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.000 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:19.001 DEBUG:boto:Data: 2023-12-15T23:07:19.001 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.001 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.001 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.001 DEBUG:boto:Params: {} 2023-12-15T23:07:19.001 DEBUG:boto:Token: None 2023-12-15T23:07:19.001 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.001 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ= 2023-12-15T23:07:19.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ=', 'Content-Length': '0'} 2023-12-15T23:07:19.003 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000385563a4faacf9c6-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.003 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:07:19.004 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.004 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.004 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.004 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.004 DEBUG:boto:Method: GET 2023-12-15T23:07:19.004 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.004 DEBUG:boto:Data: 2023-12-15T23:07:19.004 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.004 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.004 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.004 DEBUG:boto:Params: {} 2023-12-15T23:07:19.005 DEBUG:boto:Token: None 2023-12-15T23:07:19.005 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/?versions 2023-12-15T23:07:19.005 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE= 2023-12-15T23:07:19.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE=', 'Content-Length': '0'} 2023-12-15T23:07:19.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041a71e3f7eca86cb-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.007 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:19.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:19.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:19.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:19.008 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:07:19.009 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.009 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.009 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.009 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.009 DEBUG:boto:Method: GET 2023-12-15T23:07:19.009 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.009 DEBUG:boto:Data: 2023-12-15T23:07:19.009 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.009 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.009 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.010 DEBUG:boto:Params: {} 2023-12-15T23:07:19.010 DEBUG:boto:Token: None 2023-12-15T23:07:19.010 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/?versions 2023-12-15T23:07:19.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE= 2023-12-15T23:07:19.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE=', 'Content-Length': '0'} 2023-12-15T23:07:19.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000934e8aae45adc495-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.012 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.013 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:19.013 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:19.013 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:19.013 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:19.013 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.013 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.014 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.014 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.014 DEBUG:boto:Method: GET 2023-12-15T23:07:19.014 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.014 DEBUG:boto:Data: 2023-12-15T23:07:19.014 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.014 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.014 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.014 DEBUG:boto:Params: {} 2023-12-15T23:07:19.014 DEBUG:boto:Token: None 2023-12-15T23:07:19.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/?versions 2023-12-15T23:07:19.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE= 2023-12-15T23:07:19.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE=', 'Content-Length': '0'} 2023-12-15T23:07:19.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6b348d4ce1b7949-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.017 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.017 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.018 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.018 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.018 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.018 DEBUG:boto:Method: GET 2023-12-15T23:07:19.018 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:19.018 DEBUG:boto:Data: 2023-12-15T23:07:19.018 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.018 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.018 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.018 DEBUG:boto:Params: {} 2023-12-15T23:07:19.019 DEBUG:boto:Token: None 2023-12-15T23:07:19.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/?versions 2023-12-15T23:07:19.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE= 2023-12-15T23:07:19.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nk4MWSZownNBCq1h0EVNVMIUtRE=', 'Content-Length': '0'} 2023-12-15T23:07:19.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009733a40421dddbca-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.022 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:19.022 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.022 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.023 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.023 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.023 DEBUG:boto:Method: GET 2023-12-15T23:07:19.023 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.023 DEBUG:boto:Data: 2023-12-15T23:07:19.023 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.023 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.023 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.023 DEBUG:boto:Params: {} 2023-12-15T23:07:19.023 DEBUG:boto:Token: None 2023-12-15T23:07:19.024 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.024 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw= 2023-12-15T23:07:19.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw=', 'Content-Length': '0'} 2023-12-15T23:07:19.026 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e4c744b819df9b4-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.026 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.026 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.026 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.026 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.026 DEBUG:boto:Method: GET 2023-12-15T23:07:19.026 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.026 DEBUG:boto:Data: 2023-12-15T23:07:19.027 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.027 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.027 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.027 DEBUG:boto:Params: {} 2023-12-15T23:07:19.027 DEBUG:boto:Token: None 2023-12-15T23:07:19.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw= 2023-12-15T23:07:19.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw=', 'Content-Length': '0'} 2023-12-15T23:07:19.029 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e8cab18f038f9dd-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.029 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.029 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.029 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.030 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.030 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.030 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.030 DEBUG:boto:Data: 2023-12-15T23:07:19.030 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.030 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.030 DEBUG:boto:Params: {} 2023-12-15T23:07:19.030 DEBUG:boto:Token: None 2023-12-15T23:07:19.030 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:deAgl07WqlvJnwyono4FA5NCUgk= 2023-12-15T23:07:19.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:deAgl07WqlvJnwyono4FA5NCUgk=', 'Content-Length': '0'} 2023-12-15T23:07:19.033 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a1c2973555a2042-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.033 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.033 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.033 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.033 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.033 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.033 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.034 DEBUG:boto:Data: 2023-12-15T23:07:19.034 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.034 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.034 DEBUG:boto:Params: {} 2023-12-15T23:07:19.034 DEBUG:boto:Token: None 2023-12-15T23:07:19.034 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:deAgl07WqlvJnwyono4FA5NCUgk= 2023-12-15T23:07:19.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:deAgl07WqlvJnwyono4FA5NCUgk=', 'Content-Length': '0'} 2023-12-15T23:07:19.036 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c9f7090ccb0d62c3-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:19.037 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.037 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.037 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.037 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.037 DEBUG:boto:Method: GET 2023-12-15T23:07:19.037 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.037 DEBUG:boto:Data: 2023-12-15T23:07:19.037 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.037 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.038 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.038 DEBUG:boto:Params: {} 2023-12-15T23:07:19.038 DEBUG:boto:Token: None 2023-12-15T23:07:19.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw= 2023-12-15T23:07:19.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw=', 'Content-Length': '0'} 2023-12-15T23:07:19.040 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000018085b27390fea38-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.082 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.082 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.082 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.082 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.082 DEBUG:boto:Method: GET 2023-12-15T23:07:19.082 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.082 DEBUG:boto:Data: 2023-12-15T23:07:19.082 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.082 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.083 DEBUG:boto:Params: {} 2023-12-15T23:07:19.083 DEBUG:boto:Token: None 2023-12-15T23:07:19.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:19.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw= 2023-12-15T23:07:19.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8AKyxcwMOJoSIQjsk92Rouh3+nw=', 'Content-Length': '0'} 2023-12-15T23:07:19.085 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2409e5e37bb38e9-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.086 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.086 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.086 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.086 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.086 DEBUG:boto:Method: GET 2023-12-15T23:07:19.086 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.086 DEBUG:boto:Data: 2023-12-15T23:07:19.086 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.086 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.086 DEBUG:boto:Params: {} 2023-12-15T23:07:19.087 DEBUG:boto:Token: None 2023-12-15T23:07:19.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072554f7cb4576d01-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.089 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.089 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.089 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.090 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.090 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.090 DEBUG:boto:Method: GET 2023-12-15T23:07:19.090 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.090 DEBUG:boto:Data: 2023-12-15T23:07:19.090 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.090 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.090 DEBUG:boto:Params: {} 2023-12-15T23:07:19.090 DEBUG:boto:Token: None 2023-12-15T23:07:19.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003072c53fbc1d37d8-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.093 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.094 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.094 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.094 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.094 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:19.094 DEBUG:boto:Data: 2023-12-15T23:07:19.094 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.094 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.094 DEBUG:boto:Params: {} 2023-12-15T23:07:19.095 DEBUG:boto:Token: None 2023-12-15T23:07:19.095 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1 2023-12-15T23:07:19.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7wgviEm64x23tykxQ456ghzSy7Q= 2023-12-15T23:07:19.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7wgviEm64x23tykxQ456ghzSy7Q=', 'Content-Length': '0'} 2023-12-15T23:07:19.097 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000287950b2c75d57e8-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.097 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.097 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.097 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.097 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:19.097 DEBUG:boto:Data: 2023-12-15T23:07:19.097 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.097 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.098 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.098 DEBUG:boto:Params: {} 2023-12-15T23:07:19.098 DEBUG:boto:Token: None 2023-12-15T23:07:19.098 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1 2023-12-15T23:07:19.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7wgviEm64x23tykxQ456ghzSy7Q= 2023-12-15T23:07:19.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7wgviEm64x23tykxQ456ghzSy7Q=', 'Content-Length': '0'} 2023-12-15T23:07:19.100 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5dd54515423e263-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:19.100 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.100 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.101 DEBUG:boto:Method: GET 2023-12-15T23:07:19.101 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:19.101 DEBUG:boto:Data: 2023-12-15T23:07:19.101 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.101 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.101 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.101 DEBUG:boto:Params: {} 2023-12-15T23:07:19.101 DEBUG:boto:Token: None 2023-12-15T23:07:19.101 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1 2023-12-15T23:07:19.101 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdK7edr3VLoLF5R6uazvEr0U75Q= 2023-12-15T23:07:19.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdK7edr3VLoLF5R6uazvEr0U75Q=', 'Content-Length': '0'} 2023-12-15T23:07:19.104 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000094c175faff4defae-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.104 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:19.104 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:19.104 DEBUG:boto:Method: GET 2023-12-15T23:07:19.105 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:19.105 DEBUG:boto:Data: 2023-12-15T23:07:19.105 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.105 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.105 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.105 DEBUG:boto:Params: {} 2023-12-15T23:07:19.105 DEBUG:boto:Token: None 2023-12-15T23:07:19.105 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj1 2023-12-15T23:07:19.105 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdK7edr3VLoLF5R6uazvEr0U75Q= 2023-12-15T23:07:19.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdK7edr3VLoLF5R6uazvEr0U75Q=', 'Content-Length': '0'} 2023-12-15T23:07:19.107 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000094bf0454be7123b0-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.107 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.107 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.108 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.108 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.108 DEBUG:boto:Method: GET 2023-12-15T23:07:19.108 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.108 DEBUG:boto:Data: 2023-12-15T23:07:19.108 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.108 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.108 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.108 DEBUG:boto:Params: {} 2023-12-15T23:07:19.108 DEBUG:boto:Token: None 2023-12-15T23:07:19.109 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.111 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b02efcb0f8e66012-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.111 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.111 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.112 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.112 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.112 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.112 DEBUG:boto:Method: GET 2023-12-15T23:07:19.112 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:19.112 DEBUG:boto:Data: 2023-12-15T23:07:19.112 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.112 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.112 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.112 DEBUG:boto:Params: {} 2023-12-15T23:07:19.113 DEBUG:boto:Token: None 2023-12-15T23:07:19.113 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.113 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d537dee9395cef2-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.115 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:19.116 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.116 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.116 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.116 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.116 DEBUG:boto:Method: GET 2023-12-15T23:07:19.116 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.116 DEBUG:boto:Data: 2023-12-15T23:07:19.116 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.116 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.117 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.117 DEBUG:boto:Params: {} 2023-12-15T23:07:19.117 DEBUG:boto:Token: None 2023-12-15T23:07:19.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A= 2023-12-15T23:07:19.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A=', 'Content-Length': '0'} 2023-12-15T23:07:19.119 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002976f111d9be5162-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.119 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.119 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.119 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.119 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.119 DEBUG:boto:Method: GET 2023-12-15T23:07:19.120 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.120 DEBUG:boto:Data: 2023-12-15T23:07:19.120 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.120 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.120 DEBUG:boto:Params: {} 2023-12-15T23:07:19.120 DEBUG:boto:Token: None 2023-12-15T23:07:19.120 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.120 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A= 2023-12-15T23:07:19.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A=', 'Content-Length': '0'} 2023-12-15T23:07:19.122 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d712d8e550738ff0-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.123 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.123 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.123 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.123 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.123 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.123 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.123 DEBUG:boto:Data: 2023-12-15T23:07:19.123 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.123 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.123 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.124 DEBUG:boto:Params: {} 2023-12-15T23:07:19.124 DEBUG:boto:Token: None 2023-12-15T23:07:19.124 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hf1IPGigir+8Uz7j/7Ab8eNDqbs= 2023-12-15T23:07:19.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hf1IPGigir+8Uz7j/7Ab8eNDqbs=', 'Content-Length': '0'} 2023-12-15T23:07:19.126 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000259e02953affa7f3-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.126 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.126 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.126 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.126 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.126 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.126 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.127 DEBUG:boto:Data: 2023-12-15T23:07:19.127 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.127 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.127 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.127 DEBUG:boto:Params: {} 2023-12-15T23:07:19.127 DEBUG:boto:Token: None 2023-12-15T23:07:19.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hf1IPGigir+8Uz7j/7Ab8eNDqbs= 2023-12-15T23:07:19.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hf1IPGigir+8Uz7j/7Ab8eNDqbs=', 'Content-Length': '0'} 2023-12-15T23:07:19.129 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d54a941e515dd796-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:19.129 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.129 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.130 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.130 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.130 DEBUG:boto:Method: GET 2023-12-15T23:07:19.130 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.130 DEBUG:boto:Data: 2023-12-15T23:07:19.130 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.130 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.130 DEBUG:boto:Params: {} 2023-12-15T23:07:19.130 DEBUG:boto:Token: None 2023-12-15T23:07:19.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A= 2023-12-15T23:07:19.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A=', 'Content-Length': '0'} 2023-12-15T23:07:19.132 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009c5e8281101c69df-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.173 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.174 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.174 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.174 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.174 DEBUG:boto:Method: GET 2023-12-15T23:07:19.174 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.174 DEBUG:boto:Data: 2023-12-15T23:07:19.174 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.174 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.174 DEBUG:boto:Params: {} 2023-12-15T23:07:19.174 DEBUG:boto:Token: None 2023-12-15T23:07:19.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:19.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A= 2023-12-15T23:07:19.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+83q3tqHBrvHRykdEXJGxjJb2A=', 'Content-Length': '0'} 2023-12-15T23:07:19.177 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004872a17e19c77954-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.177 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.177 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.177 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.177 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.178 DEBUG:boto:Method: GET 2023-12-15T23:07:19.178 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.178 DEBUG:boto:Data: 2023-12-15T23:07:19.178 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.178 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.178 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.178 DEBUG:boto:Params: {} 2023-12-15T23:07:19.178 DEBUG:boto:Token: None 2023-12-15T23:07:19.178 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.180 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c76455b7fae14c33-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.181 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.181 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.181 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.181 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.181 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.182 DEBUG:boto:Method: GET 2023-12-15T23:07:19.182 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.182 DEBUG:boto:Data: 2023-12-15T23:07:19.182 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.182 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.182 DEBUG:boto:Params: {} 2023-12-15T23:07:19.182 DEBUG:boto:Token: None 2023-12-15T23:07:19.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025d53cf90dd7b514-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.185 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.185 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.186 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.186 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.186 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:19.186 DEBUG:boto:Data: 2023-12-15T23:07:19.186 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.186 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.186 DEBUG:boto:Params: {} 2023-12-15T23:07:19.186 DEBUG:boto:Token: None 2023-12-15T23:07:19.186 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2 2023-12-15T23:07:19.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3IxTT5PWI0wGS+1uNuzIsWXbaqM= 2023-12-15T23:07:19.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3IxTT5PWI0wGS+1uNuzIsWXbaqM=', 'Content-Length': '0'} 2023-12-15T23:07:19.188 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000de138928b0d91522-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.188 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.188 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.189 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.189 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:19.189 DEBUG:boto:Data: 2023-12-15T23:07:19.189 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.189 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.189 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.189 DEBUG:boto:Params: {} 2023-12-15T23:07:19.189 DEBUG:boto:Token: None 2023-12-15T23:07:19.189 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2 2023-12-15T23:07:19.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3IxTT5PWI0wGS+1uNuzIsWXbaqM= 2023-12-15T23:07:19.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3IxTT5PWI0wGS+1uNuzIsWXbaqM=', 'Content-Length': '0'} 2023-12-15T23:07:19.191 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000033530b0fd4ab1a91-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:19.192 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.192 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.192 DEBUG:boto:Method: GET 2023-12-15T23:07:19.192 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:19.192 DEBUG:boto:Data: 2023-12-15T23:07:19.192 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.192 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.192 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.192 DEBUG:boto:Params: {} 2023-12-15T23:07:19.193 DEBUG:boto:Token: None 2023-12-15T23:07:19.193 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2 2023-12-15T23:07:19.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7qeTQBwkwiWxlr+HJClxt0wnlJ0= 2023-12-15T23:07:19.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7qeTQBwkwiWxlr+HJClxt0wnlJ0=', 'Content-Length': '0'} 2023-12-15T23:07:19.194 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007f58aa2caeb802e0-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.195 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:19.195 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:19.195 DEBUG:boto:Method: GET 2023-12-15T23:07:19.195 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:19.195 DEBUG:boto:Data: 2023-12-15T23:07:19.195 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.195 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.195 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.195 DEBUG:boto:Params: {} 2023-12-15T23:07:19.196 DEBUG:boto:Token: None 2023-12-15T23:07:19.196 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj2 2023-12-15T23:07:19.196 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7qeTQBwkwiWxlr+HJClxt0wnlJ0= 2023-12-15T23:07:19.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7qeTQBwkwiWxlr+HJClxt0wnlJ0=', 'Content-Length': '0'} 2023-12-15T23:07:19.197 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c013cfcd29134dc4-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.198 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.198 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.198 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.198 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.198 DEBUG:boto:Method: GET 2023-12-15T23:07:19.198 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.198 DEBUG:boto:Data: 2023-12-15T23:07:19.198 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.199 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.199 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.199 DEBUG:boto:Params: {} 2023-12-15T23:07:19.199 DEBUG:boto:Token: None 2023-12-15T23:07:19.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1a98914bc2a748f-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.201 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.202 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.202 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.202 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.202 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.202 DEBUG:boto:Method: GET 2023-12-15T23:07:19.202 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:19.202 DEBUG:boto:Data: 2023-12-15T23:07:19.202 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.203 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.203 DEBUG:boto:Params: {} 2023-12-15T23:07:19.203 DEBUG:boto:Token: None 2023-12-15T23:07:19.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f7e4764990b6f47-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.206 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:19.206 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.206 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.207 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.207 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.207 DEBUG:boto:Method: GET 2023-12-15T23:07:19.207 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.207 DEBUG:boto:Data: 2023-12-15T23:07:19.207 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.207 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.207 DEBUG:boto:Params: {} 2023-12-15T23:07:19.207 DEBUG:boto:Token: None 2023-12-15T23:07:19.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE= 2023-12-15T23:07:19.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE=', 'Content-Length': '0'} 2023-12-15T23:07:19.209 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f54ac9792cbb375d-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.210 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.210 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.210 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.210 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.210 DEBUG:boto:Method: GET 2023-12-15T23:07:19.210 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.210 DEBUG:boto:Data: 2023-12-15T23:07:19.211 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.211 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.211 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.211 DEBUG:boto:Params: {} 2023-12-15T23:07:19.211 DEBUG:boto:Token: None 2023-12-15T23:07:19.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE= 2023-12-15T23:07:19.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE=', 'Content-Length': '0'} 2023-12-15T23:07:19.213 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000078c41c6d433e0445-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.214 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.214 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.214 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.214 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.214 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.214 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.214 DEBUG:boto:Data: 2023-12-15T23:07:19.214 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.215 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.215 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.215 DEBUG:boto:Params: {} 2023-12-15T23:07:19.215 DEBUG:boto:Token: None 2023-12-15T23:07:19.215 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ndkiy79iQjtmsOTh5SubUDCwwAI= 2023-12-15T23:07:19.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ndkiy79iQjtmsOTh5SubUDCwwAI=', 'Content-Length': '0'} 2023-12-15T23:07:19.217 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009758c2e82b67b77e-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.217 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.217 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.217 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.218 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.218 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.218 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.218 DEBUG:boto:Data: 2023-12-15T23:07:19.218 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.218 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.218 DEBUG:boto:Params: {} 2023-12-15T23:07:19.218 DEBUG:boto:Token: None 2023-12-15T23:07:19.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ndkiy79iQjtmsOTh5SubUDCwwAI= 2023-12-15T23:07:19.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ndkiy79iQjtmsOTh5SubUDCwwAI=', 'Content-Length': '0'} 2023-12-15T23:07:19.220 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c1f62787076e14c-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:19.221 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.221 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.221 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.221 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.221 DEBUG:boto:Method: GET 2023-12-15T23:07:19.221 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.221 DEBUG:boto:Data: 2023-12-15T23:07:19.221 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.222 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.222 DEBUG:boto:Params: {} 2023-12-15T23:07:19.222 DEBUG:boto:Token: None 2023-12-15T23:07:19.222 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE= 2023-12-15T23:07:19.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE=', 'Content-Length': '0'} 2023-12-15T23:07:19.224 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002fbc887b46575a76-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.265 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.266 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.266 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.266 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.266 DEBUG:boto:Method: GET 2023-12-15T23:07:19.266 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.266 DEBUG:boto:Data: 2023-12-15T23:07:19.266 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.266 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.266 DEBUG:boto:Params: {} 2023-12-15T23:07:19.267 DEBUG:boto:Token: None 2023-12-15T23:07:19.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:19.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE= 2023-12-15T23:07:19.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XiY42eyNW8B6v5k3CIJJHcLnFxE=', 'Content-Length': '0'} 2023-12-15T23:07:19.269 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000039ac128b393b7d47-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.269 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.269 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.269 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.269 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.269 DEBUG:boto:Method: GET 2023-12-15T23:07:19.269 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.269 DEBUG:boto:Data: 2023-12-15T23:07:19.270 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.270 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.270 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.270 DEBUG:boto:Params: {} 2023-12-15T23:07:19.270 DEBUG:boto:Token: None 2023-12-15T23:07:19.270 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000993e85da4a93e964-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.273 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.273 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.273 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.273 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.274 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.274 DEBUG:boto:Method: GET 2023-12-15T23:07:19.274 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.274 DEBUG:boto:Data: 2023-12-15T23:07:19.274 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.274 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.274 DEBUG:boto:Params: {} 2023-12-15T23:07:19.274 DEBUG:boto:Token: None 2023-12-15T23:07:19.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000757d78ddab204aee-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.277 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.277 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.277 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.277 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.278 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:19.278 DEBUG:boto:Data: 2023-12-15T23:07:19.278 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.278 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.278 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.278 DEBUG:boto:Params: {} 2023-12-15T23:07:19.278 DEBUG:boto:Token: None 2023-12-15T23:07:19.278 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3 2023-12-15T23:07:19.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R+M3ZnkApzdKEEY+inPlL42ZbxU= 2023-12-15T23:07:19.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R+M3ZnkApzdKEEY+inPlL42ZbxU=', 'Content-Length': '0'} 2023-12-15T23:07:19.280 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a98bfbcc2452e811-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.280 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.281 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.281 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.281 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:19.281 DEBUG:boto:Data: 2023-12-15T23:07:19.281 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.281 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.281 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.281 DEBUG:boto:Params: {} 2023-12-15T23:07:19.281 DEBUG:boto:Token: None 2023-12-15T23:07:19.281 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3 2023-12-15T23:07:19.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R+M3ZnkApzdKEEY+inPlL42ZbxU= 2023-12-15T23:07:19.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R+M3ZnkApzdKEEY+inPlL42ZbxU=', 'Content-Length': '0'} 2023-12-15T23:07:19.283 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000656ddc25896a839f-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:19.284 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.284 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.284 DEBUG:boto:Method: GET 2023-12-15T23:07:19.284 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:19.284 DEBUG:boto:Data: 2023-12-15T23:07:19.284 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.284 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.285 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.285 DEBUG:boto:Params: {} 2023-12-15T23:07:19.285 DEBUG:boto:Token: None 2023-12-15T23:07:19.285 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3 2023-12-15T23:07:19.285 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sp59EIpNn8NNDlUq4+LK1FqjXXs= 2023-12-15T23:07:19.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sp59EIpNn8NNDlUq4+LK1FqjXXs=', 'Content-Length': '0'} 2023-12-15T23:07:19.287 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c87e6ce3264700c2-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.287 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:19.287 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:19.287 DEBUG:boto:Method: GET 2023-12-15T23:07:19.287 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:19.287 DEBUG:boto:Data: 2023-12-15T23:07:19.287 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.288 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.288 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.288 DEBUG:boto:Params: {} 2023-12-15T23:07:19.288 DEBUG:boto:Token: None 2023-12-15T23:07:19.288 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj3 2023-12-15T23:07:19.288 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sp59EIpNn8NNDlUq4+LK1FqjXXs= 2023-12-15T23:07:19.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sp59EIpNn8NNDlUq4+LK1FqjXXs=', 'Content-Length': '0'} 2023-12-15T23:07:19.290 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000706528ae4110c979-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.290 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.290 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.290 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.290 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.291 DEBUG:boto:Method: GET 2023-12-15T23:07:19.291 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.291 DEBUG:boto:Data: 2023-12-15T23:07:19.291 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.291 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.291 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.291 DEBUG:boto:Params: {} 2023-12-15T23:07:19.291 DEBUG:boto:Token: None 2023-12-15T23:07:19.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.292 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e89737691d148010-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.294 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.295 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.295 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.295 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.295 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.295 DEBUG:boto:Method: GET 2023-12-15T23:07:19.295 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:19.295 DEBUG:boto:Data: 2023-12-15T23:07:19.295 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.295 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.295 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.295 DEBUG:boto:Params: {} 2023-12-15T23:07:19.296 DEBUG:boto:Token: None 2023-12-15T23:07:19.296 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.296 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078ce03bdd7791314-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.298 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:19.299 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.299 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.299 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.299 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.299 DEBUG:boto:Method: GET 2023-12-15T23:07:19.299 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.299 DEBUG:boto:Data: 2023-12-15T23:07:19.299 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.299 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.300 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.300 DEBUG:boto:Params: {} 2023-12-15T23:07:19.300 DEBUG:boto:Token: None 2023-12-15T23:07:19.300 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.300 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI= 2023-12-15T23:07:19.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI=', 'Content-Length': '0'} 2023-12-15T23:07:19.302 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001fa76d24533f9c2b-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.302 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.302 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.302 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.302 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.302 DEBUG:boto:Method: GET 2023-12-15T23:07:19.302 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.303 DEBUG:boto:Data: 2023-12-15T23:07:19.303 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.303 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.303 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.303 DEBUG:boto:Params: {} 2023-12-15T23:07:19.303 DEBUG:boto:Token: None 2023-12-15T23:07:19.303 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI= 2023-12-15T23:07:19.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI=', 'Content-Length': '0'} 2023-12-15T23:07:19.305 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001979d3e3b4a547b0-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.305 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.305 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.305 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.305 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.306 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.306 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.306 DEBUG:boto:Data: 2023-12-15T23:07:19.306 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.306 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.306 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.306 DEBUG:boto:Params: {} 2023-12-15T23:07:19.306 DEBUG:boto:Token: None 2023-12-15T23:07:19.306 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tKlZTvjKh5p9+KNLI/SPnlxkK5U= 2023-12-15T23:07:19.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tKlZTvjKh5p9+KNLI/SPnlxkK5U=', 'Content-Length': '0'} 2023-12-15T23:07:19.308 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000510b5fc5bf4d5af6-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.308 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.308 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.309 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.309 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.309 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.309 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.309 DEBUG:boto:Data: 2023-12-15T23:07:19.309 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.309 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.309 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.309 DEBUG:boto:Params: {} 2023-12-15T23:07:19.309 DEBUG:boto:Token: None 2023-12-15T23:07:19.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tKlZTvjKh5p9+KNLI/SPnlxkK5U= 2023-12-15T23:07:19.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tKlZTvjKh5p9+KNLI/SPnlxkK5U=', 'Content-Length': '0'} 2023-12-15T23:07:19.311 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006dbf2fa68ea7b271-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:19.312 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.312 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.312 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.312 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.312 DEBUG:boto:Method: GET 2023-12-15T23:07:19.312 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.312 DEBUG:boto:Data: 2023-12-15T23:07:19.312 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.312 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.313 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.313 DEBUG:boto:Params: {} 2023-12-15T23:07:19.313 DEBUG:boto:Token: None 2023-12-15T23:07:19.313 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI= 2023-12-15T23:07:19.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI=', 'Content-Length': '0'} 2023-12-15T23:07:19.315 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a9fa13541a40b75-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.357 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.358 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.358 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.358 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.358 DEBUG:boto:Method: GET 2023-12-15T23:07:19.358 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.358 DEBUG:boto:Data: 2023-12-15T23:07:19.358 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.358 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.358 DEBUG:boto:Params: {} 2023-12-15T23:07:19.359 DEBUG:boto:Token: None 2023-12-15T23:07:19.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:19.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI= 2023-12-15T23:07:19.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYsrzQyZjneiDbOGr6iEwH9gvQI=', 'Content-Length': '0'} 2023-12-15T23:07:19.361 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010a85ca4781347c9-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.361 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.361 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.361 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.361 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.361 DEBUG:boto:Method: GET 2023-12-15T23:07:19.361 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.362 DEBUG:boto:Data: 2023-12-15T23:07:19.362 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.362 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.362 DEBUG:boto:Params: {} 2023-12-15T23:07:19.362 DEBUG:boto:Token: None 2023-12-15T23:07:19.362 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028e8caa8f2ffbd1c-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.365 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.365 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.365 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.365 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.365 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.365 DEBUG:boto:Method: GET 2023-12-15T23:07:19.366 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.366 DEBUG:boto:Data: 2023-12-15T23:07:19.366 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.366 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.366 DEBUG:boto:Params: {} 2023-12-15T23:07:19.366 DEBUG:boto:Token: None 2023-12-15T23:07:19.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009428029dcce9ff2f-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.369 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.369 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.369 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.369 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.370 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:19.370 DEBUG:boto:Data: 2023-12-15T23:07:19.370 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.370 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.370 DEBUG:boto:Params: {} 2023-12-15T23:07:19.370 DEBUG:boto:Token: None 2023-12-15T23:07:19.370 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4 2023-12-15T23:07:19.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2IJ+/OtdQfod3R4Ra+yleZAV+Gk= 2023-12-15T23:07:19.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2IJ+/OtdQfod3R4Ra+yleZAV+Gk=', 'Content-Length': '0'} 2023-12-15T23:07:19.372 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001fc8b2bd637b0587-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.372 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.372 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.373 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.373 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:19.373 DEBUG:boto:Data: 2023-12-15T23:07:19.373 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.373 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.373 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.373 DEBUG:boto:Params: {} 2023-12-15T23:07:19.373 DEBUG:boto:Token: None 2023-12-15T23:07:19.373 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4 2023-12-15T23:07:19.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2IJ+/OtdQfod3R4Ra+yleZAV+Gk= 2023-12-15T23:07:19.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2IJ+/OtdQfod3R4Ra+yleZAV+Gk=', 'Content-Length': '0'} 2023-12-15T23:07:19.375 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c0cd13282c1857d0-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:19.376 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.376 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.376 DEBUG:boto:Method: GET 2023-12-15T23:07:19.376 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:19.376 DEBUG:boto:Data: 2023-12-15T23:07:19.376 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.376 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.376 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.376 DEBUG:boto:Params: {} 2023-12-15T23:07:19.377 DEBUG:boto:Token: None 2023-12-15T23:07:19.377 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4 2023-12-15T23:07:19.377 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RL414ezTkfMCH2/NH6HKaDHMFJc= 2023-12-15T23:07:19.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RL414ezTkfMCH2/NH6HKaDHMFJc=', 'Content-Length': '0'} 2023-12-15T23:07:19.379 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006783525d9f1d59f2-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.379 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:19.379 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:19.379 DEBUG:boto:Method: GET 2023-12-15T23:07:19.379 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:19.380 DEBUG:boto:Data: 2023-12-15T23:07:19.380 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.380 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.380 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.380 DEBUG:boto:Params: {} 2023-12-15T23:07:19.380 DEBUG:boto:Token: None 2023-12-15T23:07:19.380 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj4 2023-12-15T23:07:19.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RL414ezTkfMCH2/NH6HKaDHMFJc= 2023-12-15T23:07:19.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RL414ezTkfMCH2/NH6HKaDHMFJc=', 'Content-Length': '0'} 2023-12-15T23:07:19.382 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a18ee842d43d0c1-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.382 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.382 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.382 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.382 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.383 DEBUG:boto:Method: GET 2023-12-15T23:07:19.383 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.383 DEBUG:boto:Data: 2023-12-15T23:07:19.383 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.383 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.383 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.383 DEBUG:boto:Params: {} 2023-12-15T23:07:19.383 DEBUG:boto:Token: None 2023-12-15T23:07:19.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009249be7485c90cc5-00657cdc27-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.386 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.386 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.386 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.386 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.386 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.386 DEBUG:boto:Method: GET 2023-12-15T23:07:19.387 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:19.387 DEBUG:boto:Data: 2023-12-15T23:07:19.387 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.387 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.387 DEBUG:boto:Params: {} 2023-12-15T23:07:19.387 DEBUG:boto:Token: None 2023-12-15T23:07:19.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM= 2023-12-15T23:07:19.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pt0yRdCDG30m3XLyQbQXRuAXAQM=', 'Content-Length': '0'} 2023-12-15T23:07:19.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b01489c6687328ae-00657cdc27-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.433 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:19.434 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-37 zones={test-zone2, test-zone1} 2023-12-15T23:07:19.434 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.434 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-36 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:07:19.484 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:19.485 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:19.556 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'kskgfn-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'kskgfn-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.556 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket kskgfn-36 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:07:19.603 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:19.603 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:19.673 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.673 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-37 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:07:19.719 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:19.719 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:19.792 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'kskgfn-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'kskgfn-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:07:19.792 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket kskgfn-37 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:07:19.839 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:19.839 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:19.911 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:19.911 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:19.912 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.912 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:19.912 DEBUG:boto:Data: 2023-12-15T23:07:19.912 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.912 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.912 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.912 DEBUG:boto:Params: {} 2023-12-15T23:07:19.912 DEBUG:boto:Token: None 2023-12-15T23:07:19.912 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/ 2023-12-15T23:07:19.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w= 2023-12-15T23:07:19.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w=', 'Content-Length': '0'} 2023-12-15T23:07:19.915 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000102b115bb655292e-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.915 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:19.915 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:19.915 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.915 DEBUG:boto:Path: /kskgfn-36/obj5 2023-12-15T23:07:19.915 DEBUG:boto:Data: 2023-12-15T23:07:19.915 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.916 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.916 DEBUG:boto:Params: {} 2023-12-15T23:07:19.916 DEBUG:boto:Token: None 2023-12-15T23:07:19.916 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/obj5 2023-12-15T23:07:19.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tSGQ4kWdDzpFjel9PMjbUJ/fIHQ= 2023-12-15T23:07:19.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tSGQ4kWdDzpFjel9PMjbUJ/fIHQ='} 2023-12-15T23:07:19.920 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d3edf41a06dbbea-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.920 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:19.920 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:19.920 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.920 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:19.920 DEBUG:boto:Data: 2023-12-15T23:07:19.920 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.921 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.921 DEBUG:boto:Params: {} 2023-12-15T23:07:19.921 DEBUG:boto:Token: None 2023-12-15T23:07:19.921 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/ 2023-12-15T23:07:19.921 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w= 2023-12-15T23:07:19.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w=', 'Content-Length': '0'} 2023-12-15T23:07:19.923 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a90b158009377195-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.923 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:19.923 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:19.923 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.923 DEBUG:boto:Path: /kskgfn-36/obj6 2023-12-15T23:07:19.923 DEBUG:boto:Data: 2023-12-15T23:07:19.924 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.924 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.924 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.924 DEBUG:boto:Params: {} 2023-12-15T23:07:19.924 DEBUG:boto:Token: None 2023-12-15T23:07:19.924 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/obj6 2023-12-15T23:07:19.924 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4AiZf+iQA5RxFIzAOvwJB68lpeQ= 2023-12-15T23:07:19.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4AiZf+iQA5RxFIzAOvwJB68lpeQ='} 2023-12-15T23:07:19.928 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000311cc86b6ce1a73f-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.928 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:19.928 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:19.928 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.928 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:19.928 DEBUG:boto:Data: 2023-12-15T23:07:19.928 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.929 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.929 DEBUG:boto:Params: {} 2023-12-15T23:07:19.929 DEBUG:boto:Token: None 2023-12-15T23:07:19.929 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/ 2023-12-15T23:07:19.929 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w= 2023-12-15T23:07:19.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w=', 'Content-Length': '0'} 2023-12-15T23:07:19.931 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b53dca380259e348-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.931 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:19.932 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:19.932 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.932 DEBUG:boto:Path: /kskgfn-36/obj7 2023-12-15T23:07:19.932 DEBUG:boto:Data: 2023-12-15T23:07:19.932 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.932 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.932 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.932 DEBUG:boto:Params: {} 2023-12-15T23:07:19.932 DEBUG:boto:Token: None 2023-12-15T23:07:19.932 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/obj7 2023-12-15T23:07:19.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jWHGziSStxIibScOC5FANM2qy9g= 2023-12-15T23:07:19.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jWHGziSStxIibScOC5FANM2qy9g='} 2023-12-15T23:07:19.977 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000354e592500446dab-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.978 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:19.978 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:19.978 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.978 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:19.978 DEBUG:boto:Data: 2023-12-15T23:07:19.978 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.978 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.978 DEBUG:boto:Params: {} 2023-12-15T23:07:19.979 DEBUG:boto:Token: None 2023-12-15T23:07:19.979 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/ 2023-12-15T23:07:19.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w= 2023-12-15T23:07:19.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qL0A4FZzTZngz9vVb0Br3xaSp0w=', 'Content-Length': '0'} 2023-12-15T23:07:19.981 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d2df89a55813b54-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.981 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:19.981 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:19.981 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.981 DEBUG:boto:Path: /kskgfn-36/obj8 2023-12-15T23:07:19.981 DEBUG:boto:Data: 2023-12-15T23:07:19.981 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.981 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:19.982 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.982 DEBUG:boto:Params: {} 2023-12-15T23:07:19.982 DEBUG:boto:Token: None 2023-12-15T23:07:19.982 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-36/obj8 2023-12-15T23:07:19.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a1UPj6JNQ2wPnZCxNLWR+6tZdFU= 2023-12-15T23:07:19.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a1UPj6JNQ2wPnZCxNLWR+6tZdFU='} 2023-12-15T23:07:19.986 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d978aca71d3f0e7a-00657cdc27-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.986 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.986 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.986 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.986 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:19.986 DEBUG:boto:Data: 2023-12-15T23:07:19.986 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.987 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.987 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.987 DEBUG:boto:Params: {} 2023-12-15T23:07:19.987 DEBUG:boto:Token: None 2023-12-15T23:07:19.987 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ= 2023-12-15T23:07:19.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ=', 'Content-Length': '0'} 2023-12-15T23:07:19.989 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9fbd75141fe1015-00657cdc27-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.989 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:19.990 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:19.990 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.990 DEBUG:boto:Path: /kskgfn-37/obj5 2023-12-15T23:07:19.990 DEBUG:boto:Data: 2023-12-15T23:07:19.990 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.990 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.990 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.990 DEBUG:boto:Params: {} 2023-12-15T23:07:19.990 DEBUG:boto:Token: None 2023-12-15T23:07:19.990 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj5 2023-12-15T23:07:19.990 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/2AGdirvE18ZnYiaSzNVutMYMDo= 2023-12-15T23:07:19.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/2AGdirvE18ZnYiaSzNVutMYMDo='} 2023-12-15T23:07:19.995 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe406f16777c76ef-00657cdc27-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.995 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:19.995 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:19.995 DEBUG:boto:Method: HEAD 2023-12-15T23:07:19.995 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:19.995 DEBUG:boto:Data: 2023-12-15T23:07:19.995 DEBUG:boto:Headers: {} 2023-12-15T23:07:19.995 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.996 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.996 DEBUG:boto:Params: {} 2023-12-15T23:07:19.996 DEBUG:boto:Token: None 2023-12-15T23:07:19.996 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/ 2023-12-15T23:07:19.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ= 2023-12-15T23:07:19.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wnCFNMmvZACG0wJDFU4tAwFRiKQ=', 'Content-Length': '0'} 2023-12-15T23:07:19.998 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007132b9daadc64503-00657cdc27-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:19.998 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:19.998 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:19.998 DEBUG:boto:Method: PUT 2023-12-15T23:07:19.998 DEBUG:boto:Path: /kskgfn-37/obj6 2023-12-15T23:07:19.998 DEBUG:boto:Data: 2023-12-15T23:07:19.998 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:19.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:19.998 DEBUG:boto:Port: 8000 2023-12-15T23:07:19.998 DEBUG:boto:Params: {} 2023-12-15T23:07:19.999 DEBUG:boto:Token: None 2023-12-15T23:07:19.999 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:19 GMT /kskgfn-37/obj6 2023-12-15T23:07:19.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TxF0ty91fMzgq29l+TvFi7WL0yE= 2023-12-15T23:07:19.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TxF0ty91fMzgq29l+TvFi7WL0yE='} 2023-12-15T23:07:20.042 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000814c32975dec34d0-00657cdc27-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:20.042 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:20.042 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:20.042 DEBUG:boto:Method: HEAD 2023-12-15T23:07:20.042 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:20.042 DEBUG:boto:Data: 2023-12-15T23:07:20.042 DEBUG:boto:Headers: {} 2023-12-15T23:07:20.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:20.042 DEBUG:boto:Port: 8000 2023-12-15T23:07:20.042 DEBUG:boto:Params: {} 2023-12-15T23:07:20.043 DEBUG:boto:Token: None 2023-12-15T23:07:20.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:20 GMT /kskgfn-37/ 2023-12-15T23:07:20.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Om4thit6grmrZNK1MGNMeMuDJQ= 2023-12-15T23:07:20.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Om4thit6grmrZNK1MGNMeMuDJQ=', 'Content-Length': '0'} 2023-12-15T23:07:20.045 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d8a15c9fb10e14f2-00657cdc28-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:20.045 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:20.045 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:20.046 DEBUG:boto:Method: PUT 2023-12-15T23:07:20.046 DEBUG:boto:Path: /kskgfn-37/obj7 2023-12-15T23:07:20.046 DEBUG:boto:Data: 2023-12-15T23:07:20.046 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:20.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:20.046 DEBUG:boto:Port: 8000 2023-12-15T23:07:20.046 DEBUG:boto:Params: {} 2023-12-15T23:07:20.046 DEBUG:boto:Token: None 2023-12-15T23:07:20.046 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:20 GMT /kskgfn-37/obj7 2023-12-15T23:07:20.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JC41E236kwqUtsw3WUp8hm5foA4= 2023-12-15T23:07:20.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JC41E236kwqUtsw3WUp8hm5foA4='} 2023-12-15T23:07:20.051 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009608d97d65dc7c37-00657cdc28-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:20.051 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:20.051 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:20.051 DEBUG:boto:Method: HEAD 2023-12-15T23:07:20.051 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:20.051 DEBUG:boto:Data: 2023-12-15T23:07:20.051 DEBUG:boto:Headers: {} 2023-12-15T23:07:20.051 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:20.051 DEBUG:boto:Port: 8000 2023-12-15T23:07:20.051 DEBUG:boto:Params: {} 2023-12-15T23:07:20.052 DEBUG:boto:Token: None 2023-12-15T23:07:20.052 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:20 GMT /kskgfn-37/ 2023-12-15T23:07:20.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Om4thit6grmrZNK1MGNMeMuDJQ= 2023-12-15T23:07:20.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Om4thit6grmrZNK1MGNMeMuDJQ=', 'Content-Length': '0'} 2023-12-15T23:07:20.054 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000027a987d7b78536c5-00657cdc28-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:20.054 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:20.054 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:20.054 DEBUG:boto:Method: PUT 2023-12-15T23:07:20.054 DEBUG:boto:Path: /kskgfn-37/obj8 2023-12-15T23:07:20.055 DEBUG:boto:Data: 2023-12-15T23:07:20.055 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:20.055 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:20.055 DEBUG:boto:Port: 8000 2023-12-15T23:07:20.055 DEBUG:boto:Params: {} 2023-12-15T23:07:20.055 DEBUG:boto:Token: None 2023-12-15T23:07:20.055 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:20 GMT /kskgfn-37/obj8 2023-12-15T23:07:20.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vlvICSQjmHnwu3KU8pktyMidjBk= 2023-12-15T23:07:20.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vlvICSQjmHnwu3KU8pktyMidjBk='} 2023-12-15T23:07:20.098 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000011ae8b916e188b-00657cdc28-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:20.098 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-36 2023-12-15T23:07:20.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:20.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:20.098 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-36 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:20.156 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:20.156 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:20.193 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:20.192+0000 7f1099724800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:20.193 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.106.6, , 00000000001.24.6, , 00000000001.33.6, , , 00000000001.27.6, , , ] 2023-12-15T23:07:20.193 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000004.110.6, 00000000002.41.1, 00000000004.30.6, 00000000002.45.1, 00000000004.49.6, 00000000002.43.1, 00000000002.19.1, 00000000004.31.6, 00000000002.24.1, 00000000002.25.1, 00000000002.13.1] 2023-12-15T23:07:25.194 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:25.194+0000 7f1099724800 1 bucket sync caught up with source: 2023-12-15T23:07:25.195 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000004.110.6, 00000000002.41.1, 00000000004.30.6, 00000000002.45.1, 00000000004.49.6, 00000000002.43.1, 00000000002.19.1, 00000000004.31.6, 00000000002.24.1, 00000000002.25.1, 00000000002.13.1] 2023-12-15T23:07:25.195 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000004.110.6, 00000000002.41.1, 00000000004.30.6, 00000000002.45.1, 00000000004.49.6, 00000000002.43.1, 00000000002.19.1, 00000000004.31.6, 00000000002.24.1, 00000000002.25.1, 00000000002.13.1] 2023-12-15T23:07:25.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:25.194+0000 7f1099724800 0 bucket checkpoint complete 2023-12-15T23:07:25.213 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-36 2023-12-15T23:07:25.213 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:25.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-36', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:25.213 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-36 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:25.275 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:25.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:25.318+0000 7f1762120800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:25.318 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:25.318 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:30.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:30.319+0000 7f1762120800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:30.320 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:30.320 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:35.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:35.320+0000 7f1762120800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:35.321 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:35.321 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:40.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:40.322+0000 7f1762120800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:40.323 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000001.83.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:40.323 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:45.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:45.322+0000 7f1762120800 1 waiting for incremental sync to catch up: 2023-12-15T23:07:45.324 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.103.6, , 00000000002.89.6, , 00000000001.85.6, , , 00000000001.57.6, , , ] 2023-12-15T23:07:45.324 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:50.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:50.324+0000 7f1762120800 1 bucket sync caught up with source: 2023-12-15T23:07:50.326 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:50.326 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000002.107.6, , 00000000002.89.6, , 00000000002.101.6, , , 00000000002.61.6, , , ] 2023-12-15T23:07:50.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:50.324+0000 7f1762120800 0 bucket checkpoint complete 2023-12-15T23:07:50.344 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-36 zones={test-zone2, test-zone1} 2023-12-15T23:07:50.344 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.345 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.345 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.345 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:50.345 DEBUG:boto:Data: 2023-12-15T23:07:50.345 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.345 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.345 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.345 DEBUG:boto:Params: {} 2023-12-15T23:07:50.346 DEBUG:boto:Token: None 2023-12-15T23:07:50.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b0IJw2cgKwNE367wCDJGD24o9FQ= 2023-12-15T23:07:50.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b0IJw2cgKwNE367wCDJGD24o9FQ=', 'Content-Length': '0'} 2023-12-15T23:07:50.349 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d089bd4fc3b40f85-00657cdc46-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.349 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.349 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.349 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.349 DEBUG:boto:Path: /kskgfn-36/ 2023-12-15T23:07:50.349 DEBUG:boto:Data: 2023-12-15T23:07:50.349 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.350 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.350 DEBUG:boto:Params: {} 2023-12-15T23:07:50.350 DEBUG:boto:Token: None 2023-12-15T23:07:50.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b0IJw2cgKwNE367wCDJGD24o9FQ= 2023-12-15T23:07:50.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b0IJw2cgKwNE367wCDJGD24o9FQ=', 'Content-Length': '0'} 2023-12-15T23:07:50.353 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0b675dc93113d66-00657cdc46-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.353 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:07:50.353 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.353 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.353 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.353 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.353 DEBUG:boto:Method: GET 2023-12-15T23:07:50.354 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.354 DEBUG:boto:Data: 2023-12-15T23:07:50.354 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.354 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.354 DEBUG:boto:Params: {} 2023-12-15T23:07:50.354 DEBUG:boto:Token: None 2023-12-15T23:07:50.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/?versions 2023-12-15T23:07:50.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98= 2023-12-15T23:07:50.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98=', 'Content-Length': '0'} 2023-12-15T23:07:50.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c2e1733e3327624e-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.357 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.358 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:50.358 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:50.358 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:50.358 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:50.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:07:50.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:07:50.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:07:50.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:07:50.359 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:07:50.359 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.359 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.359 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.359 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.359 DEBUG:boto:Method: GET 2023-12-15T23:07:50.359 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.360 DEBUG:boto:Data: 2023-12-15T23:07:50.360 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.360 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.360 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.360 DEBUG:boto:Params: {} 2023-12-15T23:07:50.360 DEBUG:boto:Token: None 2023-12-15T23:07:50.360 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/?versions 2023-12-15T23:07:50.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98= 2023-12-15T23:07:50.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98=', 'Content-Length': '0'} 2023-12-15T23:07:50.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007807d06f31ed1218-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.363 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:07:50.364 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:07:50.364 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.364 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.364 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.364 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.365 DEBUG:boto:Method: GET 2023-12-15T23:07:50.365 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.365 DEBUG:boto:Data: 2023-12-15T23:07:50.365 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.365 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.365 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.365 DEBUG:boto:Params: {} 2023-12-15T23:07:50.365 DEBUG:boto:Token: None 2023-12-15T23:07:50.365 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/?versions 2023-12-15T23:07:50.365 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98= 2023-12-15T23:07:50.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98=', 'Content-Length': '0'} 2023-12-15T23:07:50.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e057d283ca3b0b7-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.368 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.369 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.369 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.369 DEBUG:boto:path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.369 DEBUG:boto:auth_path=/kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.369 DEBUG:boto:Method: GET 2023-12-15T23:07:50.369 DEBUG:boto:Path: /kskgfn-36/?versions&max-keys=999 2023-12-15T23:07:50.369 DEBUG:boto:Data: 2023-12-15T23:07:50.369 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.369 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.370 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.370 DEBUG:boto:Params: {} 2023-12-15T23:07:50.370 DEBUG:boto:Token: None 2023-12-15T23:07:50.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/?versions 2023-12-15T23:07:50.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98= 2023-12-15T23:07:50.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rpSdityAobsI94940ktwExUXR98=', 'Content-Length': '0'} 2023-12-15T23:07:50.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea847307112997b6-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.372 DEBUG:boto:b'kskgfn-36999falseobj1nulltrue2023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:50.373 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.373 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.373 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.373 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.374 DEBUG:boto:Method: GET 2023-12-15T23:07:50.374 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.374 DEBUG:boto:Data: 2023-12-15T23:07:50.374 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.374 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.374 DEBUG:boto:Params: {} 2023-12-15T23:07:50.374 DEBUG:boto:Token: None 2023-12-15T23:07:50.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY= 2023-12-15T23:07:50.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY=', 'Content-Length': '0'} 2023-12-15T23:07:50.376 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000582f40092b6ec04c-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.377 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.377 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.377 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.377 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.377 DEBUG:boto:Method: GET 2023-12-15T23:07:50.377 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.377 DEBUG:boto:Data: 2023-12-15T23:07:50.377 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.377 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.377 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.378 DEBUG:boto:Params: {} 2023-12-15T23:07:50.378 DEBUG:boto:Token: None 2023-12-15T23:07:50.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY= 2023-12-15T23:07:50.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY=', 'Content-Length': '0'} 2023-12-15T23:07:50.380 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a07e63679169643b-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.380 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.380 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.380 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.380 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.381 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.381 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.381 DEBUG:boto:Data: 2023-12-15T23:07:50.381 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.381 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.381 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.381 DEBUG:boto:Params: {} 2023-12-15T23:07:50.381 DEBUG:boto:Token: None 2023-12-15T23:07:50.381 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KD6y7SPFPNO0yViiQMb7U+MUSXk= 2023-12-15T23:07:50.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KD6y7SPFPNO0yViiQMb7U+MUSXk=', 'Content-Length': '0'} 2023-12-15T23:07:50.383 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d66982abf8613623-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.383 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.384 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.384 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.384 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.384 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.384 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.384 DEBUG:boto:Data: 2023-12-15T23:07:50.384 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.384 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.384 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.384 DEBUG:boto:Params: {} 2023-12-15T23:07:50.384 DEBUG:boto:Token: None 2023-12-15T23:07:50.384 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KD6y7SPFPNO0yViiQMb7U+MUSXk= 2023-12-15T23:07:50.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KD6y7SPFPNO0yViiQMb7U+MUSXk=', 'Content-Length': '0'} 2023-12-15T23:07:50.386 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a7cdc542cd75b28-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.386 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:50.387 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.387 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.387 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.387 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.387 DEBUG:boto:Method: GET 2023-12-15T23:07:50.387 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.387 DEBUG:boto:Data: 2023-12-15T23:07:50.387 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.387 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.387 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.387 DEBUG:boto:Params: {} 2023-12-15T23:07:50.387 DEBUG:boto:Token: None 2023-12-15T23:07:50.388 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY= 2023-12-15T23:07:50.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY=', 'Content-Length': '0'} 2023-12-15T23:07:50.390 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b73bd06012ee24e3-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.433 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.434 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.434 DEBUG:boto:path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.434 DEBUG:boto:auth_path=/kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.434 DEBUG:boto:Method: GET 2023-12-15T23:07:50.434 DEBUG:boto:Path: /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.434 DEBUG:boto:Data: 2023-12-15T23:07:50.434 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.434 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.434 DEBUG:boto:Params: {} 2023-12-15T23:07:50.434 DEBUG:boto:Token: None 2023-12-15T23:07:50.434 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1?versionId=null 2023-12-15T23:07:50.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY= 2023-12-15T23:07:50.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahtUgt/zD+IEUJz0seBNfz3POFY=', 'Content-Length': '0'} 2023-12-15T23:07:50.437 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d7228b11dd29d65d-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.437 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.437 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.437 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.437 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.437 DEBUG:boto:Method: GET 2023-12-15T23:07:50.437 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.437 DEBUG:boto:Data: 2023-12-15T23:07:50.438 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.438 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.438 DEBUG:boto:Params: {} 2023-12-15T23:07:50.438 DEBUG:boto:Token: None 2023-12-15T23:07:50.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa8ae580ff9b2d6a-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.441 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.441 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.441 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.441 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.442 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.442 DEBUG:boto:Method: GET 2023-12-15T23:07:50.442 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.442 DEBUG:boto:Data: 2023-12-15T23:07:50.442 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.442 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.442 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.442 DEBUG:boto:Params: {} 2023-12-15T23:07:50.442 DEBUG:boto:Token: None 2023-12-15T23:07:50.442 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004959448861e0faca-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.445 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.445 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.445 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.446 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.446 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:50.446 DEBUG:boto:Data: 2023-12-15T23:07:50.446 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.446 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.446 DEBUG:boto:Params: {} 2023-12-15T23:07:50.446 DEBUG:boto:Token: None 2023-12-15T23:07:50.446 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1 2023-12-15T23:07:50.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jYxbcYxXEX7Or/sP9zSjZBbDp70= 2023-12-15T23:07:50.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jYxbcYxXEX7Or/sP9zSjZBbDp70=', 'Content-Length': '0'} 2023-12-15T23:07:50.448 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e865b2d13800b35-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.449 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.449 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.449 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.449 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:50.449 DEBUG:boto:Data: 2023-12-15T23:07:50.449 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.449 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.449 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.449 DEBUG:boto:Params: {} 2023-12-15T23:07:50.449 DEBUG:boto:Token: None 2023-12-15T23:07:50.449 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1 2023-12-15T23:07:50.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jYxbcYxXEX7Or/sP9zSjZBbDp70= 2023-12-15T23:07:50.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jYxbcYxXEX7Or/sP9zSjZBbDp70=', 'Content-Length': '0'} 2023-12-15T23:07:50.451 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000febcfb615747661d-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:50.452 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.452 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.452 DEBUG:boto:Method: GET 2023-12-15T23:07:50.452 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:50.452 DEBUG:boto:Data: 2023-12-15T23:07:50.452 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.452 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.452 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.452 DEBUG:boto:Params: {} 2023-12-15T23:07:50.452 DEBUG:boto:Token: None 2023-12-15T23:07:50.452 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1 2023-12-15T23:07:50.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u85l+z3+HiGyzPheSf3TJWaQ3dw= 2023-12-15T23:07:50.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u85l+z3+HiGyzPheSf3TJWaQ3dw=', 'Content-Length': '0'} 2023-12-15T23:07:50.455 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd1ad8c426b2a996-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.497 DEBUG:boto:path=/kskgfn-36/obj1 2023-12-15T23:07:50.498 DEBUG:boto:auth_path=/kskgfn-36/obj1 2023-12-15T23:07:50.498 DEBUG:boto:Method: GET 2023-12-15T23:07:50.498 DEBUG:boto:Path: /kskgfn-36/obj1 2023-12-15T23:07:50.498 DEBUG:boto:Data: 2023-12-15T23:07:50.498 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.498 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.498 DEBUG:boto:Params: {} 2023-12-15T23:07:50.498 DEBUG:boto:Token: None 2023-12-15T23:07:50.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj1 2023-12-15T23:07:50.498 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u85l+z3+HiGyzPheSf3TJWaQ3dw= 2023-12-15T23:07:50.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u85l+z3+HiGyzPheSf3TJWaQ3dw=', 'Content-Length': '0'} 2023-12-15T23:07:50.500 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000136d849ea885c6e4-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.501 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.501 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.501 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.501 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.501 DEBUG:boto:Method: GET 2023-12-15T23:07:50.501 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.501 DEBUG:boto:Data: 2023-12-15T23:07:50.501 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.501 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.501 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.502 DEBUG:boto:Params: {} 2023-12-15T23:07:50.502 DEBUG:boto:Token: None 2023-12-15T23:07:50.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060dc4e28bbaefccd-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.504 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.505 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.505 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.505 DEBUG:boto:path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.505 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.505 DEBUG:boto:Method: GET 2023-12-15T23:07:50.505 DEBUG:boto:Path: /kskgfn-36/?prefix=obj1 2023-12-15T23:07:50.506 DEBUG:boto:Data: 2023-12-15T23:07:50.506 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.506 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.506 DEBUG:boto:Params: {} 2023-12-15T23:07:50.506 DEBUG:boto:Token: None 2023-12-15T23:07:50.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf3516958fea6cbe-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.509 DEBUG:boto:b'kskgfn-36obj11000falseobj12023-12-15T23:07:12.397Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:50.509 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.509 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.510 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.510 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.510 DEBUG:boto:Method: GET 2023-12-15T23:07:50.510 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.510 DEBUG:boto:Data: 2023-12-15T23:07:50.510 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.510 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.510 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.510 DEBUG:boto:Params: {} 2023-12-15T23:07:50.510 DEBUG:boto:Token: None 2023-12-15T23:07:50.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs= 2023-12-15T23:07:50.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs=', 'Content-Length': '0'} 2023-12-15T23:07:50.513 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005bf8017ffe7653ee-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.513 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.513 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.513 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.513 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.514 DEBUG:boto:Method: GET 2023-12-15T23:07:50.514 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.514 DEBUG:boto:Data: 2023-12-15T23:07:50.514 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.514 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.514 DEBUG:boto:Params: {} 2023-12-15T23:07:50.514 DEBUG:boto:Token: None 2023-12-15T23:07:50.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs= 2023-12-15T23:07:50.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs=', 'Content-Length': '0'} 2023-12-15T23:07:50.516 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007400823dcacd1f27-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.516 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.517 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.517 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.517 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.517 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.517 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.517 DEBUG:boto:Data: 2023-12-15T23:07:50.517 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.517 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.517 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.517 DEBUG:boto:Params: {} 2023-12-15T23:07:50.518 DEBUG:boto:Token: None 2023-12-15T23:07:50.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0m0I658RvKhRqvFETFW3MQthfmo= 2023-12-15T23:07:50.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0m0I658RvKhRqvFETFW3MQthfmo=', 'Content-Length': '0'} 2023-12-15T23:07:50.519 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c3fc4ad8c1463bf-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.520 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.520 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.520 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.520 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.520 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.520 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.520 DEBUG:boto:Data: 2023-12-15T23:07:50.520 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.520 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.521 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.521 DEBUG:boto:Params: {} 2023-12-15T23:07:50.521 DEBUG:boto:Token: None 2023-12-15T23:07:50.521 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.521 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0m0I658RvKhRqvFETFW3MQthfmo= 2023-12-15T23:07:50.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0m0I658RvKhRqvFETFW3MQthfmo=', 'Content-Length': '0'} 2023-12-15T23:07:50.523 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a4404d68623d827-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:50.523 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.523 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.523 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.523 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.523 DEBUG:boto:Method: GET 2023-12-15T23:07:50.523 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.523 DEBUG:boto:Data: 2023-12-15T23:07:50.524 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.524 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.524 DEBUG:boto:Params: {} 2023-12-15T23:07:50.524 DEBUG:boto:Token: None 2023-12-15T23:07:50.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs= 2023-12-15T23:07:50.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs=', 'Content-Length': '0'} 2023-12-15T23:07:50.526 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ea63b90a48875d72-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.570 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.570 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.570 DEBUG:boto:path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.570 DEBUG:boto:auth_path=/kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.570 DEBUG:boto:Method: GET 2023-12-15T23:07:50.570 DEBUG:boto:Path: /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.570 DEBUG:boto:Data: 2023-12-15T23:07:50.570 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.570 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.571 DEBUG:boto:Params: {} 2023-12-15T23:07:50.571 DEBUG:boto:Token: None 2023-12-15T23:07:50.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2?versionId=null 2023-12-15T23:07:50.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs= 2023-12-15T23:07:50.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J46ZOxaRlZq56n6GTfnfMinJIgs=', 'Content-Length': '0'} 2023-12-15T23:07:50.573 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008d184e11b8fbe1d3-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.573 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.573 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.573 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.573 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.574 DEBUG:boto:Method: GET 2023-12-15T23:07:50.574 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.574 DEBUG:boto:Data: 2023-12-15T23:07:50.574 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.574 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.574 DEBUG:boto:Params: {} 2023-12-15T23:07:50.574 DEBUG:boto:Token: None 2023-12-15T23:07:50.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bd43e422738721b-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.617 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.618 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.618 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.618 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.618 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.618 DEBUG:boto:Method: GET 2023-12-15T23:07:50.618 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.618 DEBUG:boto:Data: 2023-12-15T23:07:50.618 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.619 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.619 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.619 DEBUG:boto:Params: {} 2023-12-15T23:07:50.619 DEBUG:boto:Token: None 2023-12-15T23:07:50.619 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005734fcc2d2aa396a-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.621 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.622 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.622 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.622 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.622 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:50.622 DEBUG:boto:Data: 2023-12-15T23:07:50.622 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.622 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.622 DEBUG:boto:Params: {} 2023-12-15T23:07:50.623 DEBUG:boto:Token: None 2023-12-15T23:07:50.623 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2 2023-12-15T23:07:50.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nEpPaDeKOpoNWAaBTgz6vTRMS8w= 2023-12-15T23:07:50.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nEpPaDeKOpoNWAaBTgz6vTRMS8w=', 'Content-Length': '0'} 2023-12-15T23:07:50.625 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008fbc671df53c87a6-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.625 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.625 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.625 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.625 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:50.625 DEBUG:boto:Data: 2023-12-15T23:07:50.626 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.626 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.626 DEBUG:boto:Params: {} 2023-12-15T23:07:50.626 DEBUG:boto:Token: None 2023-12-15T23:07:50.626 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2 2023-12-15T23:07:50.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nEpPaDeKOpoNWAaBTgz6vTRMS8w= 2023-12-15T23:07:50.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nEpPaDeKOpoNWAaBTgz6vTRMS8w=', 'Content-Length': '0'} 2023-12-15T23:07:50.628 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f08544e5b8e4453-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.628 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:50.628 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.628 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.628 DEBUG:boto:Method: GET 2023-12-15T23:07:50.629 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:50.629 DEBUG:boto:Data: 2023-12-15T23:07:50.629 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.629 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.629 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.629 DEBUG:boto:Params: {} 2023-12-15T23:07:50.629 DEBUG:boto:Token: None 2023-12-15T23:07:50.629 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2 2023-12-15T23:07:50.633 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8DZB0HQ6wcH11UPX70+tlYz1sPE= 2023-12-15T23:07:50.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8DZB0HQ6wcH11UPX70+tlYz1sPE=', 'Content-Length': '0'} 2023-12-15T23:07:50.635 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b617350602da2db3-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.681 DEBUG:boto:path=/kskgfn-36/obj2 2023-12-15T23:07:50.682 DEBUG:boto:auth_path=/kskgfn-36/obj2 2023-12-15T23:07:50.682 DEBUG:boto:Method: GET 2023-12-15T23:07:50.682 DEBUG:boto:Path: /kskgfn-36/obj2 2023-12-15T23:07:50.682 DEBUG:boto:Data: 2023-12-15T23:07:50.683 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.683 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.683 DEBUG:boto:Params: {} 2023-12-15T23:07:50.683 DEBUG:boto:Token: None 2023-12-15T23:07:50.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj2 2023-12-15T23:07:50.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8DZB0HQ6wcH11UPX70+tlYz1sPE= 2023-12-15T23:07:50.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8DZB0HQ6wcH11UPX70+tlYz1sPE=', 'Content-Length': '0'} 2023-12-15T23:07:50.685 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e8351894caf0d8be-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.685 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.686 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.686 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.686 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.686 DEBUG:boto:Method: GET 2023-12-15T23:07:50.686 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.686 DEBUG:boto:Data: 2023-12-15T23:07:50.686 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.686 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.686 DEBUG:boto:Params: {} 2023-12-15T23:07:50.687 DEBUG:boto:Token: None 2023-12-15T23:07:50.687 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005dd854a2d3d946f9-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.690 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.690 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.690 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.690 DEBUG:boto:path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.690 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.690 DEBUG:boto:Method: GET 2023-12-15T23:07:50.690 DEBUG:boto:Path: /kskgfn-36/?prefix=obj2 2023-12-15T23:07:50.690 DEBUG:boto:Data: 2023-12-15T23:07:50.691 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.691 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.691 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.691 DEBUG:boto:Params: {} 2023-12-15T23:07:50.691 DEBUG:boto:Token: None 2023-12-15T23:07:50.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6289baf4f6b4bcd-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.694 DEBUG:boto:b'kskgfn-36obj21000falseobj22023-12-15T23:07:12.409Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:50.694 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.694 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.694 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.694 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.695 DEBUG:boto:Method: GET 2023-12-15T23:07:50.695 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.695 DEBUG:boto:Data: 2023-12-15T23:07:50.695 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.695 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.695 DEBUG:boto:Params: {} 2023-12-15T23:07:50.695 DEBUG:boto:Token: None 2023-12-15T23:07:50.695 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0= 2023-12-15T23:07:50.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0=', 'Content-Length': '0'} 2023-12-15T23:07:50.698 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008fe5c3c0ab987649-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.741 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.742 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.742 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.742 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.742 DEBUG:boto:Method: GET 2023-12-15T23:07:50.742 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.742 DEBUG:boto:Data: 2023-12-15T23:07:50.742 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.742 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.742 DEBUG:boto:Params: {} 2023-12-15T23:07:50.743 DEBUG:boto:Token: None 2023-12-15T23:07:50.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0= 2023-12-15T23:07:50.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0=', 'Content-Length': '0'} 2023-12-15T23:07:50.745 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a78df1f811dfa68-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.745 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.746 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.746 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.746 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.746 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.746 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.746 DEBUG:boto:Data: 2023-12-15T23:07:50.746 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.746 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.746 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.746 DEBUG:boto:Params: {} 2023-12-15T23:07:50.747 DEBUG:boto:Token: None 2023-12-15T23:07:50.747 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+93K00qF+4DpM6Puy2EPuBvbPUQ= 2023-12-15T23:07:50.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+93K00qF+4DpM6Puy2EPuBvbPUQ=', 'Content-Length': '0'} 2023-12-15T23:07:50.749 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e2fcfa151136273-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.749 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.749 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.749 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.749 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.750 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.750 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.750 DEBUG:boto:Data: 2023-12-15T23:07:50.750 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.750 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.750 DEBUG:boto:Params: {} 2023-12-15T23:07:50.750 DEBUG:boto:Token: None 2023-12-15T23:07:50.750 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+93K00qF+4DpM6Puy2EPuBvbPUQ= 2023-12-15T23:07:50.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+93K00qF+4DpM6Puy2EPuBvbPUQ=', 'Content-Length': '0'} 2023-12-15T23:07:50.752 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000082e17840b5b815ef-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:50.753 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.753 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.753 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.753 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.753 DEBUG:boto:Method: GET 2023-12-15T23:07:50.753 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.753 DEBUG:boto:Data: 2023-12-15T23:07:50.754 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.754 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.754 DEBUG:boto:Params: {} 2023-12-15T23:07:50.754 DEBUG:boto:Token: None 2023-12-15T23:07:50.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0= 2023-12-15T23:07:50.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0=', 'Content-Length': '0'} 2023-12-15T23:07:50.756 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005170772c977f927e-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.797 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.798 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.798 DEBUG:boto:path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.798 DEBUG:boto:auth_path=/kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.798 DEBUG:boto:Method: GET 2023-12-15T23:07:50.798 DEBUG:boto:Path: /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.798 DEBUG:boto:Data: 2023-12-15T23:07:50.798 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.798 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.798 DEBUG:boto:Params: {} 2023-12-15T23:07:50.798 DEBUG:boto:Token: None 2023-12-15T23:07:50.799 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3?versionId=null 2023-12-15T23:07:50.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0= 2023-12-15T23:07:50.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uHoW+qTVEnvjlnN7GZ31FgQ2Tg0=', 'Content-Length': '0'} 2023-12-15T23:07:50.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ef0c6ae0744b8dbb-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.801 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.802 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.802 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.802 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.802 DEBUG:boto:Method: GET 2023-12-15T23:07:50.802 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.802 DEBUG:boto:Data: 2023-12-15T23:07:50.802 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.802 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.802 DEBUG:boto:Params: {} 2023-12-15T23:07:50.802 DEBUG:boto:Token: None 2023-12-15T23:07:50.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bd9c7be3e2af941-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.805 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.805 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.806 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.806 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.806 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.806 DEBUG:boto:Method: GET 2023-12-15T23:07:50.806 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.806 DEBUG:boto:Data: 2023-12-15T23:07:50.806 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.806 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.806 DEBUG:boto:Params: {} 2023-12-15T23:07:50.807 DEBUG:boto:Token: None 2023-12-15T23:07:50.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000515b2482a808af44-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.809 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.810 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.810 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.810 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.810 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:50.810 DEBUG:boto:Data: 2023-12-15T23:07:50.810 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.810 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.810 DEBUG:boto:Params: {} 2023-12-15T23:07:50.810 DEBUG:boto:Token: None 2023-12-15T23:07:50.811 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3 2023-12-15T23:07:50.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DBlKjGBufzHypzvCYgX7W5OJczo= 2023-12-15T23:07:50.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DBlKjGBufzHypzvCYgX7W5OJczo=', 'Content-Length': '0'} 2023-12-15T23:07:50.813 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008690b50cf27c5254-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.813 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.813 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.813 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.813 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:50.813 DEBUG:boto:Data: 2023-12-15T23:07:50.813 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.814 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.814 DEBUG:boto:Params: {} 2023-12-15T23:07:50.814 DEBUG:boto:Token: None 2023-12-15T23:07:50.814 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3 2023-12-15T23:07:50.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DBlKjGBufzHypzvCYgX7W5OJczo= 2023-12-15T23:07:50.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DBlKjGBufzHypzvCYgX7W5OJczo=', 'Content-Length': '0'} 2023-12-15T23:07:50.816 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a2b4998d72e04b9-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:50.816 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.816 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.817 DEBUG:boto:Method: GET 2023-12-15T23:07:50.817 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:50.817 DEBUG:boto:Data: 2023-12-15T23:07:50.817 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.817 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.817 DEBUG:boto:Params: {} 2023-12-15T23:07:50.817 DEBUG:boto:Token: None 2023-12-15T23:07:50.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3 2023-12-15T23:07:50.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Da+XvHlCXQaBznjFdcdWBTFKjDc= 2023-12-15T23:07:50.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Da+XvHlCXQaBznjFdcdWBTFKjDc=', 'Content-Length': '0'} 2023-12-15T23:07:50.820 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4a087177b8b6d78-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.861 DEBUG:boto:path=/kskgfn-36/obj3 2023-12-15T23:07:50.862 DEBUG:boto:auth_path=/kskgfn-36/obj3 2023-12-15T23:07:50.862 DEBUG:boto:Method: GET 2023-12-15T23:07:50.862 DEBUG:boto:Path: /kskgfn-36/obj3 2023-12-15T23:07:50.862 DEBUG:boto:Data: 2023-12-15T23:07:50.862 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.862 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.862 DEBUG:boto:Params: {} 2023-12-15T23:07:50.862 DEBUG:boto:Token: None 2023-12-15T23:07:50.862 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj3 2023-12-15T23:07:50.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Da+XvHlCXQaBznjFdcdWBTFKjDc= 2023-12-15T23:07:50.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Da+XvHlCXQaBznjFdcdWBTFKjDc=', 'Content-Length': '0'} 2023-12-15T23:07:50.864 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000069af98fe680e29b7-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.865 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.865 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.865 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.865 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.865 DEBUG:boto:Method: GET 2023-12-15T23:07:50.865 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.865 DEBUG:boto:Data: 2023-12-15T23:07:50.866 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.866 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.866 DEBUG:boto:Params: {} 2023-12-15T23:07:50.866 DEBUG:boto:Token: None 2023-12-15T23:07:50.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000045e81339f6ef984-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.909 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.910 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.910 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.910 DEBUG:boto:path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.910 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.910 DEBUG:boto:Method: GET 2023-12-15T23:07:50.910 DEBUG:boto:Path: /kskgfn-36/?prefix=obj3 2023-12-15T23:07:50.910 DEBUG:boto:Data: 2023-12-15T23:07:50.910 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.911 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.911 DEBUG:boto:Params: {} 2023-12-15T23:07:50.911 DEBUG:boto:Token: None 2023-12-15T23:07:50.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a40c02ec10fa51ad-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.914 DEBUG:boto:b'kskgfn-36obj31000falseobj32023-12-15T23:07:12.456Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:50.914 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:50.914 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.914 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.915 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.915 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.915 DEBUG:boto:Method: GET 2023-12-15T23:07:50.915 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.915 DEBUG:boto:Data: 2023-12-15T23:07:50.915 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.915 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.915 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.915 DEBUG:boto:Params: {} 2023-12-15T23:07:50.915 DEBUG:boto:Token: None 2023-12-15T23:07:50.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM= 2023-12-15T23:07:50.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM=', 'Content-Length': '0'} 2023-12-15T23:07:50.917 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca09d03d6c690a01-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.918 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.918 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.918 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.918 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.918 DEBUG:boto:Method: GET 2023-12-15T23:07:50.918 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.918 DEBUG:boto:Data: 2023-12-15T23:07:50.918 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.918 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.919 DEBUG:boto:Params: {} 2023-12-15T23:07:50.919 DEBUG:boto:Token: None 2023-12-15T23:07:50.919 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM= 2023-12-15T23:07:50.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM=', 'Content-Length': '0'} 2023-12-15T23:07:50.921 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000988cdc38ad6b3b7f-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.921 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.922 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.922 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.922 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.922 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.922 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.922 DEBUG:boto:Data: 2023-12-15T23:07:50.922 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.922 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.922 DEBUG:boto:Params: {} 2023-12-15T23:07:50.922 DEBUG:boto:Token: None 2023-12-15T23:07:50.923 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ytm5l08NeLQ3EllmEnM5AcD9v60= 2023-12-15T23:07:50.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ytm5l08NeLQ3EllmEnM5AcD9v60=', 'Content-Length': '0'} 2023-12-15T23:07:50.924 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000397a47cd3017a828-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.925 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.925 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.925 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.925 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.925 DEBUG:boto:Method: HEAD 2023-12-15T23:07:50.925 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.925 DEBUG:boto:Data: 2023-12-15T23:07:50.925 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.925 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.926 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.926 DEBUG:boto:Params: {} 2023-12-15T23:07:50.926 DEBUG:boto:Token: None 2023-12-15T23:07:50.926 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ytm5l08NeLQ3EllmEnM5AcD9v60= 2023-12-15T23:07:50.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ytm5l08NeLQ3EllmEnM5AcD9v60=', 'Content-Length': '0'} 2023-12-15T23:07:50.928 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057bef52a94a8fe62-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:50.928 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.928 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.928 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.928 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.928 DEBUG:boto:Method: GET 2023-12-15T23:07:50.929 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.929 DEBUG:boto:Data: 2023-12-15T23:07:50.929 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.929 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.929 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.929 DEBUG:boto:Params: {} 2023-12-15T23:07:50.929 DEBUG:boto:Token: None 2023-12-15T23:07:50.929 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.929 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM= 2023-12-15T23:07:50.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM=', 'Content-Length': '0'} 2023-12-15T23:07:50.931 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008d4696da759bc71d-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.974 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:50.974 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:50.974 DEBUG:boto:path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.974 DEBUG:boto:auth_path=/kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.974 DEBUG:boto:Method: GET 2023-12-15T23:07:50.974 DEBUG:boto:Path: /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.974 DEBUG:boto:Data: 2023-12-15T23:07:50.974 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:50.974 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.975 DEBUG:boto:Params: {} 2023-12-15T23:07:50.975 DEBUG:boto:Token: None 2023-12-15T23:07:50.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/obj4?versionId=null 2023-12-15T23:07:50.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM= 2023-12-15T23:07:50.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1PUsMu+/7smbRraR5Q7b4G+F7MM=', 'Content-Length': '0'} 2023-12-15T23:07:50.977 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000778734ab3d0abeec-00657cdc46-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:50.977 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:50.977 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:50.977 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:50.978 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:50.978 DEBUG:boto:Method: GET 2023-12-15T23:07:50.978 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:50.978 DEBUG:boto:Data: 2023-12-15T23:07:50.978 DEBUG:boto:Headers: {} 2023-12-15T23:07:50.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:50.978 DEBUG:boto:Port: 8000 2023-12-15T23:07:50.978 DEBUG:boto:Params: {} 2023-12-15T23:07:50.978 DEBUG:boto:Token: None 2023-12-15T23:07:50.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:50 GMT /kskgfn-36/ 2023-12-15T23:07:50.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU= 2023-12-15T23:07:50.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TUkMJP3cb1DZrh6MFB4SeMqDJXU=', 'Content-Length': '0'} 2023-12-15T23:07:50.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000004fa503d876bf7a-00657cdc46-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.021 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.022 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.022 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.022 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.022 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.022 DEBUG:boto:Method: GET 2023-12-15T23:07:51.022 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.022 DEBUG:boto:Data: 2023-12-15T23:07:51.023 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.023 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.023 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.023 DEBUG:boto:Params: {} 2023-12-15T23:07:51.023 DEBUG:boto:Token: None 2023-12-15T23:07:51.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014dacc48fdc8bf24-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.026 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.026 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:51.026 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:51.026 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.026 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:51.027 DEBUG:boto:Data: 2023-12-15T23:07:51.027 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.027 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.027 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.027 DEBUG:boto:Params: {} 2023-12-15T23:07:51.027 DEBUG:boto:Token: None 2023-12-15T23:07:51.027 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj4 2023-12-15T23:07:51.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/4yi9OgvCFtY4ByGsylRFSbxfog= 2023-12-15T23:07:51.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/4yi9OgvCFtY4ByGsylRFSbxfog=', 'Content-Length': '0'} 2023-12-15T23:07:51.029 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000343ced6d471c6308-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.029 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:51.030 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:51.030 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.030 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:51.030 DEBUG:boto:Data: 2023-12-15T23:07:51.030 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.030 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.030 DEBUG:boto:Params: {} 2023-12-15T23:07:51.030 DEBUG:boto:Token: None 2023-12-15T23:07:51.031 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj4 2023-12-15T23:07:51.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/4yi9OgvCFtY4ByGsylRFSbxfog= 2023-12-15T23:07:51.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/4yi9OgvCFtY4ByGsylRFSbxfog=', 'Content-Length': '0'} 2023-12-15T23:07:51.032 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002157ab107fe189c4-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:51.033 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:51.033 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:51.033 DEBUG:boto:Method: GET 2023-12-15T23:07:51.033 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:51.033 DEBUG:boto:Data: 2023-12-15T23:07:51.033 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.033 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.033 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.033 DEBUG:boto:Params: {} 2023-12-15T23:07:51.033 DEBUG:boto:Token: None 2023-12-15T23:07:51.034 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj4 2023-12-15T23:07:51.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ka9nDFX4wCsXieyUrJ7qq/l6G9Q= 2023-12-15T23:07:51.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ka9nDFX4wCsXieyUrJ7qq/l6G9Q=', 'Content-Length': '0'} 2023-12-15T23:07:51.036 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000631f400da4d11a5-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.077 DEBUG:boto:path=/kskgfn-36/obj4 2023-12-15T23:07:51.078 DEBUG:boto:auth_path=/kskgfn-36/obj4 2023-12-15T23:07:51.078 DEBUG:boto:Method: GET 2023-12-15T23:07:51.078 DEBUG:boto:Path: /kskgfn-36/obj4 2023-12-15T23:07:51.078 DEBUG:boto:Data: 2023-12-15T23:07:51.078 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.078 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.078 DEBUG:boto:Params: {} 2023-12-15T23:07:51.078 DEBUG:boto:Token: None 2023-12-15T23:07:51.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj4 2023-12-15T23:07:51.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ka9nDFX4wCsXieyUrJ7qq/l6G9Q= 2023-12-15T23:07:51.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ka9nDFX4wCsXieyUrJ7qq/l6G9Q=', 'Content-Length': '0'} 2023-12-15T23:07:51.080 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000078c4e9d92c97a97e-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.080 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.081 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.081 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.081 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.081 DEBUG:boto:Method: GET 2023-12-15T23:07:51.081 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.081 DEBUG:boto:Data: 2023-12-15T23:07:51.081 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.081 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.081 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.081 DEBUG:boto:Params: {} 2023-12-15T23:07:51.082 DEBUG:boto:Token: None 2023-12-15T23:07:51.082 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000751e405f55b13a7b-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.085 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.085 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.085 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.086 DEBUG:boto:path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.086 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.086 DEBUG:boto:Method: GET 2023-12-15T23:07:51.086 DEBUG:boto:Path: /kskgfn-36/?prefix=obj4 2023-12-15T23:07:51.086 DEBUG:boto:Data: 2023-12-15T23:07:51.086 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.086 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.086 DEBUG:boto:Params: {} 2023-12-15T23:07:51.086 DEBUG:boto:Token: None 2023-12-15T23:07:51.086 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc525fe396e43244-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.089 DEBUG:boto:b'kskgfn-36obj41000falseobj42023-12-15T23:07:12.467Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.090 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:51.090 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.090 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.090 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.090 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.090 DEBUG:boto:Method: GET 2023-12-15T23:07:51.090 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.090 DEBUG:boto:Data: 2023-12-15T23:07:51.090 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.091 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.091 DEBUG:boto:Params: {} 2023-12-15T23:07:51.091 DEBUG:boto:Token: None 2023-12-15T23:07:51.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8= 2023-12-15T23:07:51.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8=', 'Content-Length': '0'} 2023-12-15T23:07:51.093 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b207afa8651ec402-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.093 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.094 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.094 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.094 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.094 DEBUG:boto:Method: GET 2023-12-15T23:07:51.094 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.094 DEBUG:boto:Data: 2023-12-15T23:07:51.094 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.094 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.094 DEBUG:boto:Params: {} 2023-12-15T23:07:51.094 DEBUG:boto:Token: None 2023-12-15T23:07:51.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8= 2023-12-15T23:07:51.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8=', 'Content-Length': '0'} 2023-12-15T23:07:51.097 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000061e4c677ddb231b2-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.097 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.097 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.097 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.097 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.098 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.098 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.098 DEBUG:boto:Data: 2023-12-15T23:07:51.098 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.098 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.098 DEBUG:boto:Params: {} 2023-12-15T23:07:51.098 DEBUG:boto:Token: None 2023-12-15T23:07:51.098 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQCSzIqeHFnxuV3AKW3WDz5SiP8= 2023-12-15T23:07:51.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQCSzIqeHFnxuV3AKW3WDz5SiP8=', 'Content-Length': '0'} 2023-12-15T23:07:51.101 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005cf7032dc608db40-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.101 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.101 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.101 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.101 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.101 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.102 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.102 DEBUG:boto:Data: 2023-12-15T23:07:51.102 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.102 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.102 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.102 DEBUG:boto:Params: {} 2023-12-15T23:07:51.102 DEBUG:boto:Token: None 2023-12-15T23:07:51.102 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQCSzIqeHFnxuV3AKW3WDz5SiP8= 2023-12-15T23:07:51.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQCSzIqeHFnxuV3AKW3WDz5SiP8=', 'Content-Length': '0'} 2023-12-15T23:07:51.105 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007797b07e312b82fb-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:51.105 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.105 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.105 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.106 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.106 DEBUG:boto:Method: GET 2023-12-15T23:07:51.106 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.106 DEBUG:boto:Data: 2023-12-15T23:07:51.106 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.106 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.106 DEBUG:boto:Params: {} 2023-12-15T23:07:51.106 DEBUG:boto:Token: None 2023-12-15T23:07:51.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8= 2023-12-15T23:07:51.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8=', 'Content-Length': '0'} 2023-12-15T23:07:51.109 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007c1c212e451e2a7d-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.153 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.154 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.154 DEBUG:boto:path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.154 DEBUG:boto:auth_path=/kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.154 DEBUG:boto:Method: GET 2023-12-15T23:07:51.154 DEBUG:boto:Path: /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.154 DEBUG:boto:Data: 2023-12-15T23:07:51.154 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.154 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.154 DEBUG:boto:Params: {} 2023-12-15T23:07:51.154 DEBUG:boto:Token: None 2023-12-15T23:07:51.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5?versionId=null 2023-12-15T23:07:51.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8= 2023-12-15T23:07:51.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eO7dYleWZaC5QK7HGi4SdmQvbI8=', 'Content-Length': '0'} 2023-12-15T23:07:51.157 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a6988322334996f-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.158 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.158 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.158 DEBUG:boto:path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.158 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.158 DEBUG:boto:Method: GET 2023-12-15T23:07:51.158 DEBUG:boto:Path: /kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.158 DEBUG:boto:Data: 2023-12-15T23:07:51.158 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.158 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.159 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.159 DEBUG:boto:Params: {} 2023-12-15T23:07:51.159 DEBUG:boto:Token: None 2023-12-15T23:07:51.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000165cd0c0f5a77360-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.205 DEBUG:boto:b'kskgfn-36obj51000falseobj52023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.206 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.206 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.206 DEBUG:boto:path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.206 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.206 DEBUG:boto:Method: GET 2023-12-15T23:07:51.206 DEBUG:boto:Path: /kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.206 DEBUG:boto:Data: 2023-12-15T23:07:51.206 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.207 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.207 DEBUG:boto:Params: {} 2023-12-15T23:07:51.207 DEBUG:boto:Token: None 2023-12-15T23:07:51.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be0a1a571a6933ea-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.210 DEBUG:boto:b'kskgfn-36obj51000falseobj52023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.210 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.210 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.210 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.210 DEBUG:boto:Path: /kskgfn-36/obj5 2023-12-15T23:07:51.210 DEBUG:boto:Data: 2023-12-15T23:07:51.210 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.211 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.211 DEBUG:boto:Params: {} 2023-12-15T23:07:51.211 DEBUG:boto:Token: None 2023-12-15T23:07:51.211 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5 2023-12-15T23:07:51.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EaCLRgs9XbH5A450LW9Qi4PKoEU= 2023-12-15T23:07:51.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EaCLRgs9XbH5A450LW9Qi4PKoEU=', 'Content-Length': '0'} 2023-12-15T23:07:51.213 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dea6b3bd2a2d6226-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.213 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.213 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.214 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.214 DEBUG:boto:Path: /kskgfn-36/obj5 2023-12-15T23:07:51.214 DEBUG:boto:Data: 2023-12-15T23:07:51.214 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.214 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.214 DEBUG:boto:Params: {} 2023-12-15T23:07:51.214 DEBUG:boto:Token: None 2023-12-15T23:07:51.214 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5 2023-12-15T23:07:51.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EaCLRgs9XbH5A450LW9Qi4PKoEU= 2023-12-15T23:07:51.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EaCLRgs9XbH5A450LW9Qi4PKoEU=', 'Content-Length': '0'} 2023-12-15T23:07:51.216 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b759d9987a54b8d7-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:51.216 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.217 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.217 DEBUG:boto:Method: GET 2023-12-15T23:07:51.217 DEBUG:boto:Path: /kskgfn-36/obj5 2023-12-15T23:07:51.217 DEBUG:boto:Data: 2023-12-15T23:07:51.217 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.217 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.217 DEBUG:boto:Params: {} 2023-12-15T23:07:51.217 DEBUG:boto:Token: None 2023-12-15T23:07:51.217 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5 2023-12-15T23:07:51.217 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ou3Si//c7bNsEy6V/BD+e4/baV4= 2023-12-15T23:07:51.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ou3Si//c7bNsEy6V/BD+e4/baV4=', 'Content-Length': '0'} 2023-12-15T23:07:51.219 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000820d05814196eb3a-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.261 DEBUG:boto:path=/kskgfn-36/obj5 2023-12-15T23:07:51.262 DEBUG:boto:auth_path=/kskgfn-36/obj5 2023-12-15T23:07:51.262 DEBUG:boto:Method: GET 2023-12-15T23:07:51.262 DEBUG:boto:Path: /kskgfn-36/obj5 2023-12-15T23:07:51.262 DEBUG:boto:Data: 2023-12-15T23:07:51.262 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.262 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.262 DEBUG:boto:Params: {} 2023-12-15T23:07:51.262 DEBUG:boto:Token: None 2023-12-15T23:07:51.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj5 2023-12-15T23:07:51.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ou3Si//c7bNsEy6V/BD+e4/baV4= 2023-12-15T23:07:51.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ou3Si//c7bNsEy6V/BD+e4/baV4=', 'Content-Length': '0'} 2023-12-15T23:07:51.264 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000302af26de6791280-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.265 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.265 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.265 DEBUG:boto:path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.265 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.265 DEBUG:boto:Method: GET 2023-12-15T23:07:51.265 DEBUG:boto:Path: /kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.265 DEBUG:boto:Data: 2023-12-15T23:07:51.265 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.265 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.266 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.266 DEBUG:boto:Params: {} 2023-12-15T23:07:51.266 DEBUG:boto:Token: None 2023-12-15T23:07:51.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084302b635c2286bf-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.269 DEBUG:boto:b'kskgfn-36obj51000falseobj52023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.269 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.269 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.269 DEBUG:boto:path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.269 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.269 DEBUG:boto:Method: GET 2023-12-15T23:07:51.269 DEBUG:boto:Path: /kskgfn-36/?prefix=obj5 2023-12-15T23:07:51.270 DEBUG:boto:Data: 2023-12-15T23:07:51.270 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.270 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.270 DEBUG:boto:Params: {} 2023-12-15T23:07:51.270 DEBUG:boto:Token: None 2023-12-15T23:07:51.270 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6ae85501cad41b2-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.273 DEBUG:boto:b'kskgfn-36obj51000falseobj52023-12-15T23:07:19.918Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:51.274 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.274 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.274 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.274 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.274 DEBUG:boto:Method: GET 2023-12-15T23:07:51.274 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.274 DEBUG:boto:Data: 2023-12-15T23:07:51.275 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.275 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.275 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.275 DEBUG:boto:Params: {} 2023-12-15T23:07:51.275 DEBUG:boto:Token: None 2023-12-15T23:07:51.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA= 2023-12-15T23:07:51.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA=', 'Content-Length': '0'} 2023-12-15T23:07:51.278 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ae9777bcfa1113e8-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.278 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.278 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.278 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.278 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.279 DEBUG:boto:Method: GET 2023-12-15T23:07:51.279 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.279 DEBUG:boto:Data: 2023-12-15T23:07:51.279 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.279 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.279 DEBUG:boto:Params: {} 2023-12-15T23:07:51.279 DEBUG:boto:Token: None 2023-12-15T23:07:51.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.280 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA= 2023-12-15T23:07:51.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA=', 'Content-Length': '0'} 2023-12-15T23:07:51.282 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000020821ce87a67b7b3-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.282 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.282 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.282 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.282 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.283 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.283 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.283 DEBUG:boto:Data: 2023-12-15T23:07:51.283 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.283 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.283 DEBUG:boto:Params: {} 2023-12-15T23:07:51.283 DEBUG:boto:Token: None 2023-12-15T23:07:51.283 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B9E/rYKvte6EjbQt8DoOMm7aznE= 2023-12-15T23:07:51.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B9E/rYKvte6EjbQt8DoOMm7aznE=', 'Content-Length': '0'} 2023-12-15T23:07:51.285 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004bd90d49fe8c09c9-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.286 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.286 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.286 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.286 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.286 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.286 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.286 DEBUG:boto:Data: 2023-12-15T23:07:51.286 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.286 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.287 DEBUG:boto:Params: {} 2023-12-15T23:07:51.287 DEBUG:boto:Token: None 2023-12-15T23:07:51.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B9E/rYKvte6EjbQt8DoOMm7aznE= 2023-12-15T23:07:51.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B9E/rYKvte6EjbQt8DoOMm7aznE=', 'Content-Length': '0'} 2023-12-15T23:07:51.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ca1a95a8065a945-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:51.290 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.290 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.290 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.290 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.290 DEBUG:boto:Method: GET 2023-12-15T23:07:51.290 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.290 DEBUG:boto:Data: 2023-12-15T23:07:51.290 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.291 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.291 DEBUG:boto:Params: {} 2023-12-15T23:07:51.291 DEBUG:boto:Token: None 2023-12-15T23:07:51.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA= 2023-12-15T23:07:51.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA=', 'Content-Length': '0'} 2023-12-15T23:07:51.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b2403bf465423634-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.334 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.334 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.334 DEBUG:boto:path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.334 DEBUG:boto:auth_path=/kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.334 DEBUG:boto:Method: GET 2023-12-15T23:07:51.334 DEBUG:boto:Path: /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.334 DEBUG:boto:Data: 2023-12-15T23:07:51.334 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.334 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.334 DEBUG:boto:Params: {} 2023-12-15T23:07:51.334 DEBUG:boto:Token: None 2023-12-15T23:07:51.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6?versionId=null 2023-12-15T23:07:51.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA= 2023-12-15T23:07:51.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:92Utx82VdF/ByUbBld60lIlZSSA=', 'Content-Length': '0'} 2023-12-15T23:07:51.337 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000065267ee57011ced6-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.337 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.337 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.337 DEBUG:boto:path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.337 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.337 DEBUG:boto:Method: GET 2023-12-15T23:07:51.337 DEBUG:boto:Path: /kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.337 DEBUG:boto:Data: 2023-12-15T23:07:51.337 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.338 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.338 DEBUG:boto:Params: {} 2023-12-15T23:07:51.338 DEBUG:boto:Token: None 2023-12-15T23:07:51.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.340 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056cffe0a87202e2d-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.341 DEBUG:boto:b'kskgfn-36obj61000falseobj62023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.341 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.341 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.341 DEBUG:boto:path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.341 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.341 DEBUG:boto:Method: GET 2023-12-15T23:07:51.341 DEBUG:boto:Path: /kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.342 DEBUG:boto:Data: 2023-12-15T23:07:51.342 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.342 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.342 DEBUG:boto:Params: {} 2023-12-15T23:07:51.342 DEBUG:boto:Token: None 2023-12-15T23:07:51.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042a91b49cdd9cab7-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.345 DEBUG:boto:b'kskgfn-36obj61000falseobj62023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.345 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.346 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.346 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.346 DEBUG:boto:Path: /kskgfn-36/obj6 2023-12-15T23:07:51.346 DEBUG:boto:Data: 2023-12-15T23:07:51.346 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.346 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.346 DEBUG:boto:Params: {} 2023-12-15T23:07:51.346 DEBUG:boto:Token: None 2023-12-15T23:07:51.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6 2023-12-15T23:07:51.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hfuyaFZwYp9PTHc667VNebLh5Wc= 2023-12-15T23:07:51.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hfuyaFZwYp9PTHc667VNebLh5Wc=', 'Content-Length': '0'} 2023-12-15T23:07:51.348 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001949de3f9c155a17-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.349 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.349 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.349 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.349 DEBUG:boto:Path: /kskgfn-36/obj6 2023-12-15T23:07:51.349 DEBUG:boto:Data: 2023-12-15T23:07:51.349 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.349 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.349 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.349 DEBUG:boto:Params: {} 2023-12-15T23:07:51.350 DEBUG:boto:Token: None 2023-12-15T23:07:51.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6 2023-12-15T23:07:51.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hfuyaFZwYp9PTHc667VNebLh5Wc= 2023-12-15T23:07:51.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hfuyaFZwYp9PTHc667VNebLh5Wc=', 'Content-Length': '0'} 2023-12-15T23:07:51.351 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c11129c09756e9ab-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:51.352 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.352 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.352 DEBUG:boto:Method: GET 2023-12-15T23:07:51.352 DEBUG:boto:Path: /kskgfn-36/obj6 2023-12-15T23:07:51.352 DEBUG:boto:Data: 2023-12-15T23:07:51.352 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.352 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.352 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.352 DEBUG:boto:Params: {} 2023-12-15T23:07:51.353 DEBUG:boto:Token: None 2023-12-15T23:07:51.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6 2023-12-15T23:07:51.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JTZijdIUKKXKvbIS6XVu0SDb3co= 2023-12-15T23:07:51.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JTZijdIUKKXKvbIS6XVu0SDb3co=', 'Content-Length': '0'} 2023-12-15T23:07:51.355 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dca9146c4e56dfb1-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.397 DEBUG:boto:path=/kskgfn-36/obj6 2023-12-15T23:07:51.398 DEBUG:boto:auth_path=/kskgfn-36/obj6 2023-12-15T23:07:51.398 DEBUG:boto:Method: GET 2023-12-15T23:07:51.398 DEBUG:boto:Path: /kskgfn-36/obj6 2023-12-15T23:07:51.398 DEBUG:boto:Data: 2023-12-15T23:07:51.398 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.398 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.398 DEBUG:boto:Params: {} 2023-12-15T23:07:51.398 DEBUG:boto:Token: None 2023-12-15T23:07:51.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj6 2023-12-15T23:07:51.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JTZijdIUKKXKvbIS6XVu0SDb3co= 2023-12-15T23:07:51.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JTZijdIUKKXKvbIS6XVu0SDb3co=', 'Content-Length': '0'} 2023-12-15T23:07:51.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002ecef6f97035c3ee-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.401 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.401 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.401 DEBUG:boto:path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.401 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.401 DEBUG:boto:Method: GET 2023-12-15T23:07:51.401 DEBUG:boto:Path: /kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.401 DEBUG:boto:Data: 2023-12-15T23:07:51.401 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.402 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.402 DEBUG:boto:Params: {} 2023-12-15T23:07:51.402 DEBUG:boto:Token: None 2023-12-15T23:07:51.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000973faa9c4cb7cd6c-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.405 DEBUG:boto:b'kskgfn-36obj61000falseobj62023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.405 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.405 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.405 DEBUG:boto:path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.405 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.405 DEBUG:boto:Method: GET 2023-12-15T23:07:51.405 DEBUG:boto:Path: /kskgfn-36/?prefix=obj6 2023-12-15T23:07:51.405 DEBUG:boto:Data: 2023-12-15T23:07:51.406 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.406 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.406 DEBUG:boto:Params: {} 2023-12-15T23:07:51.406 DEBUG:boto:Token: None 2023-12-15T23:07:51.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.408 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e11382218b3e7b30-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.409 DEBUG:boto:b'kskgfn-36obj61000falseobj62023-12-15T23:07:19.926Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:51.409 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.409 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.409 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.409 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.410 DEBUG:boto:Method: GET 2023-12-15T23:07:51.410 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.410 DEBUG:boto:Data: 2023-12-15T23:07:51.410 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.410 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.410 DEBUG:boto:Params: {} 2023-12-15T23:07:51.410 DEBUG:boto:Token: None 2023-12-15T23:07:51.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4= 2023-12-15T23:07:51.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4=', 'Content-Length': '0'} 2023-12-15T23:07:51.412 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001cade8a148504240-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.413 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.413 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.413 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.413 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.413 DEBUG:boto:Method: GET 2023-12-15T23:07:51.413 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.413 DEBUG:boto:Data: 2023-12-15T23:07:51.413 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.413 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.413 DEBUG:boto:Params: {} 2023-12-15T23:07:51.414 DEBUG:boto:Token: None 2023-12-15T23:07:51.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4= 2023-12-15T23:07:51.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4=', 'Content-Length': '0'} 2023-12-15T23:07:51.415 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001484272e8e4075a2-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.416 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.416 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.416 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.416 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.416 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.416 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.416 DEBUG:boto:Data: 2023-12-15T23:07:51.416 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.416 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.416 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.417 DEBUG:boto:Params: {} 2023-12-15T23:07:51.417 DEBUG:boto:Token: None 2023-12-15T23:07:51.417 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nvM/UDHpp6ijKQVcs2vplNraLY4= 2023-12-15T23:07:51.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nvM/UDHpp6ijKQVcs2vplNraLY4=', 'Content-Length': '0'} 2023-12-15T23:07:51.419 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e7637a6b4a69e368-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.419 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.419 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.419 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.419 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.419 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.419 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.419 DEBUG:boto:Data: 2023-12-15T23:07:51.420 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.420 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.420 DEBUG:boto:Params: {} 2023-12-15T23:07:51.420 DEBUG:boto:Token: None 2023-12-15T23:07:51.420 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nvM/UDHpp6ijKQVcs2vplNraLY4= 2023-12-15T23:07:51.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nvM/UDHpp6ijKQVcs2vplNraLY4=', 'Content-Length': '0'} 2023-12-15T23:07:51.422 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e7bf4084db5033a5-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.422 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:51.422 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.422 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.422 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.422 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.422 DEBUG:boto:Method: GET 2023-12-15T23:07:51.423 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.423 DEBUG:boto:Data: 2023-12-15T23:07:51.423 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.423 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.423 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.423 DEBUG:boto:Params: {} 2023-12-15T23:07:51.423 DEBUG:boto:Token: None 2023-12-15T23:07:51.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4= 2023-12-15T23:07:51.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4=', 'Content-Length': '0'} 2023-12-15T23:07:51.425 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ee733eb9e68e2b2-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.466 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.466 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.466 DEBUG:boto:path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.466 DEBUG:boto:auth_path=/kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.466 DEBUG:boto:Method: GET 2023-12-15T23:07:51.466 DEBUG:boto:Path: /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.466 DEBUG:boto:Data: 2023-12-15T23:07:51.466 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.467 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.467 DEBUG:boto:Params: {} 2023-12-15T23:07:51.467 DEBUG:boto:Token: None 2023-12-15T23:07:51.467 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7?versionId=null 2023-12-15T23:07:51.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4= 2023-12-15T23:07:51.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MeHmEpE/WAcPrppzBgGou5zFJt4=', 'Content-Length': '0'} 2023-12-15T23:07:51.469 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca8c2855c52ac976-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.469 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.470 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.470 DEBUG:boto:path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.470 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.470 DEBUG:boto:Method: GET 2023-12-15T23:07:51.470 DEBUG:boto:Path: /kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.470 DEBUG:boto:Data: 2023-12-15T23:07:51.470 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.470 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.470 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.470 DEBUG:boto:Params: {} 2023-12-15T23:07:51.471 DEBUG:boto:Token: None 2023-12-15T23:07:51.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c61410ca0667940e-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.518 DEBUG:boto:b'kskgfn-36obj71000falseobj72023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.518 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.518 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.518 DEBUG:boto:path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.518 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.518 DEBUG:boto:Method: GET 2023-12-15T23:07:51.518 DEBUG:boto:Path: /kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.519 DEBUG:boto:Data: 2023-12-15T23:07:51.519 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.519 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.519 DEBUG:boto:Params: {} 2023-12-15T23:07:51.519 DEBUG:boto:Token: None 2023-12-15T23:07:51.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097481db1220c8ee1-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.522 DEBUG:boto:b'kskgfn-36obj71000falseobj72023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.522 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.522 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.523 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.523 DEBUG:boto:Path: /kskgfn-36/obj7 2023-12-15T23:07:51.523 DEBUG:boto:Data: 2023-12-15T23:07:51.523 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.523 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.523 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.523 DEBUG:boto:Params: {} 2023-12-15T23:07:51.523 DEBUG:boto:Token: None 2023-12-15T23:07:51.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7 2023-12-15T23:07:51.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U73CaNdxEOuD1x6lMJAKJWqjoZE= 2023-12-15T23:07:51.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U73CaNdxEOuD1x6lMJAKJWqjoZE=', 'Content-Length': '0'} 2023-12-15T23:07:51.525 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006dbbf999e911ad51-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.525 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.525 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.526 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.526 DEBUG:boto:Path: /kskgfn-36/obj7 2023-12-15T23:07:51.526 DEBUG:boto:Data: 2023-12-15T23:07:51.526 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.526 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.526 DEBUG:boto:Params: {} 2023-12-15T23:07:51.526 DEBUG:boto:Token: None 2023-12-15T23:07:51.526 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7 2023-12-15T23:07:51.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U73CaNdxEOuD1x6lMJAKJWqjoZE= 2023-12-15T23:07:51.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U73CaNdxEOuD1x6lMJAKJWqjoZE=', 'Content-Length': '0'} 2023-12-15T23:07:51.528 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000653be1d567e0f6a6-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:51.529 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.529 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.529 DEBUG:boto:Method: GET 2023-12-15T23:07:51.529 DEBUG:boto:Path: /kskgfn-36/obj7 2023-12-15T23:07:51.529 DEBUG:boto:Data: 2023-12-15T23:07:51.529 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.529 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.529 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.529 DEBUG:boto:Params: {} 2023-12-15T23:07:51.530 DEBUG:boto:Token: None 2023-12-15T23:07:51.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7 2023-12-15T23:07:51.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+hOC4RtiPuhwj2zHcBhnpwv5/Ag= 2023-12-15T23:07:51.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+hOC4RtiPuhwj2zHcBhnpwv5/Ag=', 'Content-Length': '0'} 2023-12-15T23:07:51.532 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000d6d6be7dfd9387c-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.573 DEBUG:boto:path=/kskgfn-36/obj7 2023-12-15T23:07:51.574 DEBUG:boto:auth_path=/kskgfn-36/obj7 2023-12-15T23:07:51.574 DEBUG:boto:Method: GET 2023-12-15T23:07:51.574 DEBUG:boto:Path: /kskgfn-36/obj7 2023-12-15T23:07:51.574 DEBUG:boto:Data: 2023-12-15T23:07:51.574 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.574 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.574 DEBUG:boto:Params: {} 2023-12-15T23:07:51.574 DEBUG:boto:Token: None 2023-12-15T23:07:51.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj7 2023-12-15T23:07:51.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+hOC4RtiPuhwj2zHcBhnpwv5/Ag= 2023-12-15T23:07:51.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+hOC4RtiPuhwj2zHcBhnpwv5/Ag=', 'Content-Length': '0'} 2023-12-15T23:07:51.577 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002254d00052f4c682-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.577 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.577 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.577 DEBUG:boto:path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.577 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.577 DEBUG:boto:Method: GET 2023-12-15T23:07:51.578 DEBUG:boto:Path: /kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.578 DEBUG:boto:Data: 2023-12-15T23:07:51.578 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.578 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.578 DEBUG:boto:Params: {} 2023-12-15T23:07:51.578 DEBUG:boto:Token: None 2023-12-15T23:07:51.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000186403243a84f0b8-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.581 DEBUG:boto:b'kskgfn-36obj71000falseobj72023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.581 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.582 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.582 DEBUG:boto:path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.582 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.582 DEBUG:boto:Method: GET 2023-12-15T23:07:51.582 DEBUG:boto:Path: /kskgfn-36/?prefix=obj7 2023-12-15T23:07:51.582 DEBUG:boto:Data: 2023-12-15T23:07:51.582 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.582 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.582 DEBUG:boto:Params: {} 2023-12-15T23:07:51.582 DEBUG:boto:Token: None 2023-12-15T23:07:51.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000287e5a3bdcb33487-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.585 DEBUG:boto:b'kskgfn-36obj71000falseobj72023-12-15T23:07:19.934Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.585 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:51.586 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.586 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.586 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.586 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.586 DEBUG:boto:Method: GET 2023-12-15T23:07:51.586 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.586 DEBUG:boto:Data: 2023-12-15T23:07:51.586 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.586 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.587 DEBUG:boto:Params: {} 2023-12-15T23:07:51.587 DEBUG:boto:Token: None 2023-12-15T23:07:51.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE= 2023-12-15T23:07:51.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE=', 'Content-Length': '0'} 2023-12-15T23:07:51.589 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bfe62b9640d96f08-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.590 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.590 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.590 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.590 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.590 DEBUG:boto:Method: GET 2023-12-15T23:07:51.590 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.590 DEBUG:boto:Data: 2023-12-15T23:07:51.590 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.591 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.591 DEBUG:boto:Params: {} 2023-12-15T23:07:51.591 DEBUG:boto:Token: None 2023-12-15T23:07:51.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE= 2023-12-15T23:07:51.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE=', 'Content-Length': '0'} 2023-12-15T23:07:51.593 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004878ee5054e9240e-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.593 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.593 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.593 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.594 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.594 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.594 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.594 DEBUG:boto:Data: 2023-12-15T23:07:51.594 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.594 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.594 DEBUG:boto:Params: {} 2023-12-15T23:07:51.594 DEBUG:boto:Token: None 2023-12-15T23:07:51.595 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kN8dp++B1UcNZp180tmfjDkCX5I= 2023-12-15T23:07:51.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kN8dp++B1UcNZp180tmfjDkCX5I=', 'Content-Length': '0'} 2023-12-15T23:07:51.596 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fef7dc4309600dae-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.597 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.597 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.597 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.597 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.597 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.597 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.597 DEBUG:boto:Data: 2023-12-15T23:07:51.598 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.598 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.598 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.598 DEBUG:boto:Params: {} 2023-12-15T23:07:51.598 DEBUG:boto:Token: None 2023-12-15T23:07:51.598 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kN8dp++B1UcNZp180tmfjDkCX5I= 2023-12-15T23:07:51.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kN8dp++B1UcNZp180tmfjDkCX5I=', 'Content-Length': '0'} 2023-12-15T23:07:51.600 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e73cb01365a89f76-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:51.600 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.600 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.601 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.601 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.601 DEBUG:boto:Method: GET 2023-12-15T23:07:51.601 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.601 DEBUG:boto:Data: 2023-12-15T23:07:51.601 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.601 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.601 DEBUG:boto:Params: {} 2023-12-15T23:07:51.601 DEBUG:boto:Token: None 2023-12-15T23:07:51.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE= 2023-12-15T23:07:51.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE=', 'Content-Length': '0'} 2023-12-15T23:07:51.604 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac8323e7794a958f-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.645 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.646 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.646 DEBUG:boto:path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.646 DEBUG:boto:auth_path=/kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.646 DEBUG:boto:Method: GET 2023-12-15T23:07:51.646 DEBUG:boto:Path: /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.646 DEBUG:boto:Data: 2023-12-15T23:07:51.646 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.646 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.646 DEBUG:boto:Params: {} 2023-12-15T23:07:51.646 DEBUG:boto:Token: None 2023-12-15T23:07:51.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8?versionId=null 2023-12-15T23:07:51.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE= 2023-12-15T23:07:51.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AL90jgCetAHPkVEEQzuHdo/GINE=', 'Content-Length': '0'} 2023-12-15T23:07:51.648 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000004c031f5b91f57fc-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.649 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.649 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.649 DEBUG:boto:path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.649 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.649 DEBUG:boto:Method: GET 2023-12-15T23:07:51.649 DEBUG:boto:Path: /kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.649 DEBUG:boto:Data: 2023-12-15T23:07:51.650 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.650 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.650 DEBUG:boto:Params: {} 2023-12-15T23:07:51.650 DEBUG:boto:Token: None 2023-12-15T23:07:51.650 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.652 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ba2ae101c19d4cd-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.693 DEBUG:boto:b'kskgfn-36obj81000falseobj82023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.694 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.694 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.694 DEBUG:boto:path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.694 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.694 DEBUG:boto:Method: GET 2023-12-15T23:07:51.694 DEBUG:boto:Path: /kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.695 DEBUG:boto:Data: 2023-12-15T23:07:51.695 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.695 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.695 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.695 DEBUG:boto:Params: {} 2023-12-15T23:07:51.695 DEBUG:boto:Token: None 2023-12-15T23:07:51.695 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a35d25556309fe53-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.698 DEBUG:boto:b'kskgfn-36obj81000falseobj82023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.698 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.698 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.698 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.698 DEBUG:boto:Path: /kskgfn-36/obj8 2023-12-15T23:07:51.699 DEBUG:boto:Data: 2023-12-15T23:07:51.699 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.699 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.699 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.699 DEBUG:boto:Params: {} 2023-12-15T23:07:51.699 DEBUG:boto:Token: None 2023-12-15T23:07:51.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8 2023-12-15T23:07:51.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ANqpms4kB8xUJXa6NunJuifnD04= 2023-12-15T23:07:51.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ANqpms4kB8xUJXa6NunJuifnD04=', 'Content-Length': '0'} 2023-12-15T23:07:51.701 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c80ef6e47cada93f-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.701 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.701 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.701 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.701 DEBUG:boto:Path: /kskgfn-36/obj8 2023-12-15T23:07:51.701 DEBUG:boto:Data: 2023-12-15T23:07:51.702 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.702 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.702 DEBUG:boto:Params: {} 2023-12-15T23:07:51.702 DEBUG:boto:Token: None 2023-12-15T23:07:51.702 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8 2023-12-15T23:07:51.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ANqpms4kB8xUJXa6NunJuifnD04= 2023-12-15T23:07:51.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ANqpms4kB8xUJXa6NunJuifnD04=', 'Content-Length': '0'} 2023-12-15T23:07:51.704 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009d30ee1c79ffd684-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.704 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:51.704 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.704 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.705 DEBUG:boto:Method: GET 2023-12-15T23:07:51.705 DEBUG:boto:Path: /kskgfn-36/obj8 2023-12-15T23:07:51.705 DEBUG:boto:Data: 2023-12-15T23:07:51.705 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.705 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.705 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.705 DEBUG:boto:Params: {} 2023-12-15T23:07:51.705 DEBUG:boto:Token: None 2023-12-15T23:07:51.705 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8 2023-12-15T23:07:51.705 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uF3ed/lGa+RpCCECIjbA064o1Bo= 2023-12-15T23:07:51.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uF3ed/lGa+RpCCECIjbA064o1Bo=', 'Content-Length': '0'} 2023-12-15T23:07:51.707 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-36:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000053ed4e26b197e8f5-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.749 DEBUG:boto:path=/kskgfn-36/obj8 2023-12-15T23:07:51.750 DEBUG:boto:auth_path=/kskgfn-36/obj8 2023-12-15T23:07:51.750 DEBUG:boto:Method: GET 2023-12-15T23:07:51.750 DEBUG:boto:Path: /kskgfn-36/obj8 2023-12-15T23:07:51.750 DEBUG:boto:Data: 2023-12-15T23:07:51.750 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.750 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.750 DEBUG:boto:Params: {} 2023-12-15T23:07:51.750 DEBUG:boto:Token: None 2023-12-15T23:07:51.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/obj8 2023-12-15T23:07:51.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uF3ed/lGa+RpCCECIjbA064o1Bo= 2023-12-15T23:07:51.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uF3ed/lGa+RpCCECIjbA064o1Bo=', 'Content-Length': '0'} 2023-12-15T23:07:51.752 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000dc6bc99adf560a6-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.753 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.753 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.753 DEBUG:boto:path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.753 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.753 DEBUG:boto:Method: GET 2023-12-15T23:07:51.753 DEBUG:boto:Path: /kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.753 DEBUG:boto:Data: 2023-12-15T23:07:51.753 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.753 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.754 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.754 DEBUG:boto:Params: {} 2023-12-15T23:07:51.754 DEBUG:boto:Token: None 2023-12-15T23:07:51.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009afd8dd20cdfdf39-00657cdc47-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.757 DEBUG:boto:b'kskgfn-36obj81000falseobj82023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.757 DEBUG:boto:path=/kskgfn-36/ 2023-12-15T23:07:51.757 DEBUG:boto:auth_path=/kskgfn-36/ 2023-12-15T23:07:51.757 DEBUG:boto:path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.758 DEBUG:boto:auth_path=/kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.758 DEBUG:boto:Method: GET 2023-12-15T23:07:51.758 DEBUG:boto:Path: /kskgfn-36/?prefix=obj8 2023-12-15T23:07:51.758 DEBUG:boto:Data: 2023-12-15T23:07:51.758 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.758 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.758 DEBUG:boto:Params: {} 2023-12-15T23:07:51.758 DEBUG:boto:Token: None 2023-12-15T23:07:51.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-36/ 2023-12-15T23:07:51.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94= 2023-12-15T23:07:51.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kg6GEZbjLVgfNLbSXnohbhbIs94=', 'Content-Length': '0'} 2023-12-15T23:07:51.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d5cd1b03c22b0c2-00657cdc47-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.761 DEBUG:boto:b'kskgfn-36obj81000falseobj82023-12-15T23:07:19.984Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:51.762 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-36 zones={test-zone2, test-zone1} 2023-12-15T23:07:51.762 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-37 2023-12-15T23:07:51.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:51.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:51.762 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-37 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:51.822 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:51.822 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:51.861 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:51.861+0000 7fb646816800 1 bucket sync caught up with source: 2023-12-15T23:07:51.861 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000004.53.6, 00000000002.30.1, 00000000004.21.6, 00000000002.23.1, 00000000004.51.6, 00000000002.15.1, 00000000002.38.1, 00000000004.22.6, 00000000002.21.1, 00000000002.28.1, 00000000002.28.1] 2023-12-15T23:07:51.861 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000004.53.6, 00000000002.30.1, 00000000004.21.6, 00000000002.23.1, 00000000004.51.6, 00000000002.15.1, 00000000002.38.1, 00000000004.22.6, 00000000002.21.1, 00000000002.28.1, 00000000002.28.1] 2023-12-15T23:07:51.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:51.861+0000 7fb646816800 0 bucket checkpoint complete 2023-12-15T23:07:51.878 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-37 2023-12-15T23:07:51.878 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:51.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-37', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:51.878 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-37 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:51.938 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:51.939 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:51.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:51.978+0000 7f4445213800 1 bucket sync caught up with source: 2023-12-15T23:07:51.979 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000004.102.1, 00000000002.128.1, 00000000004.56.1, 00000000002.107.1, 00000000004.103.1, 00000000002.26.1, 00000000002.112.1, 00000000004.61.1, 00000000002.36.1, 00000000002.111.1, 00000000002.90.1] 2023-12-15T23:07:51.979 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000004.102.1, 00000000002.128.1, 00000000004.56.1, 00000000002.107.1, 00000000004.103.1, 00000000002.26.1, 00000000002.112.1, 00000000004.61.1, 00000000002.36.1, 00000000002.111.1, 00000000002.90.1] 2023-12-15T23:07:51.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:51.978+0000 7f4445213800 0 bucket checkpoint complete 2023-12-15T23:07:51.994 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-37 zones={test-zone2, test-zone1} 2023-12-15T23:07:51.994 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:51.994 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:51.994 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.994 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:51.994 DEBUG:boto:Data: 2023-12-15T23:07:51.994 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:51.994 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.994 DEBUG:boto:Params: {} 2023-12-15T23:07:51.995 DEBUG:boto:Token: None 2023-12-15T23:07:51.995 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-37/ 2023-12-15T23:07:51.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+kNYiGe2xYCfcKib+taEp+ZqFg= 2023-12-15T23:07:51.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+kNYiGe2xYCfcKib+taEp+ZqFg=', 'Content-Length': '0'} 2023-12-15T23:07:51.997 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000014d754d836ad3e3-00657cdc47-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:51 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:51.997 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:51.997 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:51.998 DEBUG:boto:Method: HEAD 2023-12-15T23:07:51.998 DEBUG:boto:Path: /kskgfn-37/ 2023-12-15T23:07:51.998 DEBUG:boto:Data: 2023-12-15T23:07:51.998 DEBUG:boto:Headers: {} 2023-12-15T23:07:51.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:51.998 DEBUG:boto:Port: 8000 2023-12-15T23:07:51.998 DEBUG:boto:Params: {} 2023-12-15T23:07:51.998 DEBUG:boto:Token: None 2023-12-15T23:07:51.998 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:51 GMT /kskgfn-37/ 2023-12-15T23:07:51.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+kNYiGe2xYCfcKib+taEp+ZqFg= 2023-12-15T23:07:51.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:51 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+kNYiGe2xYCfcKib+taEp+ZqFg=', 'Content-Length': '0'} 2023-12-15T23:07:52.001 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be19ae8a17c023b8-00657cdc47-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.001 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:07:52.001 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.001 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.001 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.001 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.001 DEBUG:boto:Method: GET 2023-12-15T23:07:52.001 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.002 DEBUG:boto:Data: 2023-12-15T23:07:52.002 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.002 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.002 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.002 DEBUG:boto:Params: {} 2023-12-15T23:07:52.002 DEBUG:boto:Token: None 2023-12-15T23:07:52.002 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/?versions 2023-12-15T23:07:52.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU= 2023-12-15T23:07:52.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU=', 'Content-Length': '0'} 2023-12-15T23:07:52.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006315ed38dcbc29b5-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.004 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.005 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:52.005 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:52.005 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:07:52.006 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:07:52.006 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.006 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.006 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.006 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.006 DEBUG:boto:Method: GET 2023-12-15T23:07:52.007 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.007 DEBUG:boto:Data: 2023-12-15T23:07:52.007 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.007 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.007 DEBUG:boto:Params: {} 2023-12-15T23:07:52.007 DEBUG:boto:Token: None 2023-12-15T23:07:52.007 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/?versions 2023-12-15T23:07:52.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU= 2023-12-15T23:07:52.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU=', 'Content-Length': '0'} 2023-12-15T23:07:52.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000710fbc353bdd842e-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.009 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:07:52.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:07:52.011 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:07:52.011 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:07:52.011 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.011 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.011 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.011 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.011 DEBUG:boto:Method: GET 2023-12-15T23:07:52.011 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.011 DEBUG:boto:Data: 2023-12-15T23:07:52.011 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.011 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.011 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.012 DEBUG:boto:Params: {} 2023-12-15T23:07:52.012 DEBUG:boto:Token: None 2023-12-15T23:07:52.012 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/?versions 2023-12-15T23:07:52.012 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU= 2023-12-15T23:07:52.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU=', 'Content-Length': '0'} 2023-12-15T23:07:52.014 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e7614fc7ae11072-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.014 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.015 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.015 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.015 DEBUG:boto:path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.015 DEBUG:boto:auth_path=/kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.015 DEBUG:boto:Method: GET 2023-12-15T23:07:52.016 DEBUG:boto:Path: /kskgfn-37/?versions&max-keys=999 2023-12-15T23:07:52.016 DEBUG:boto:Data: 2023-12-15T23:07:52.016 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.016 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.016 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.016 DEBUG:boto:Params: {} 2023-12-15T23:07:52.016 DEBUG:boto:Token: None 2023-12-15T23:07:52.016 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/?versions 2023-12-15T23:07:52.016 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU= 2023-12-15T23:07:52.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DwieXI+Z+kvCb0CdigssnOaBneU=', 'Content-Length': '0'} 2023-12-15T23:07:52.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086e9c3309e769372-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.019 DEBUG:boto:b'kskgfn-37999falseobj1nulltrue2023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:52.020 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.020 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.020 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.020 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.020 DEBUG:boto:Method: GET 2023-12-15T23:07:52.020 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.020 DEBUG:boto:Data: 2023-12-15T23:07:52.020 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.020 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.020 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.021 DEBUG:boto:Params: {} 2023-12-15T23:07:52.021 DEBUG:boto:Token: None 2023-12-15T23:07:52.021 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.021 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA= 2023-12-15T23:07:52.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA=', 'Content-Length': '0'} 2023-12-15T23:07:52.023 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000833cdc1b143bc2f6-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.065 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.068 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.068 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.068 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.068 DEBUG:boto:Method: GET 2023-12-15T23:07:52.068 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.069 DEBUG:boto:Data: 2023-12-15T23:07:52.069 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.069 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.069 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.069 DEBUG:boto:Params: {} 2023-12-15T23:07:52.069 DEBUG:boto:Token: None 2023-12-15T23:07:52.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA= 2023-12-15T23:07:52.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA=', 'Content-Length': '0'} 2023-12-15T23:07:52.072 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008619f4e70bd554de-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.072 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.072 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.072 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.072 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.072 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.072 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.072 DEBUG:boto:Data: 2023-12-15T23:07:52.073 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.073 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.073 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.073 DEBUG:boto:Params: {} 2023-12-15T23:07:52.073 DEBUG:boto:Token: None 2023-12-15T23:07:52.073 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WshB0eM9wmgbkLQrnYta7ZGRFSA= 2023-12-15T23:07:52.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WshB0eM9wmgbkLQrnYta7ZGRFSA=', 'Content-Length': '0'} 2023-12-15T23:07:52.076 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d7b1ddfe5e198d2-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.076 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.076 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.076 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.076 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.076 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.076 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.076 DEBUG:boto:Data: 2023-12-15T23:07:52.077 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.077 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.077 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.077 DEBUG:boto:Params: {} 2023-12-15T23:07:52.077 DEBUG:boto:Token: None 2023-12-15T23:07:52.077 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.077 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WshB0eM9wmgbkLQrnYta7ZGRFSA= 2023-12-15T23:07:52.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WshB0eM9wmgbkLQrnYta7ZGRFSA=', 'Content-Length': '0'} 2023-12-15T23:07:52.079 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000092f05023f27bf8ab-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:52.079 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.079 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.079 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.080 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.080 DEBUG:boto:Method: GET 2023-12-15T23:07:52.080 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.080 DEBUG:boto:Data: 2023-12-15T23:07:52.080 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.080 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.080 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.080 DEBUG:boto:Params: {} 2023-12-15T23:07:52.080 DEBUG:boto:Token: None 2023-12-15T23:07:52.080 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.081 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA= 2023-12-15T23:07:52.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA=', 'Content-Length': '0'} 2023-12-15T23:07:52.083 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000afb52c51000f03d5-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.083 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.083 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.083 DEBUG:boto:path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.083 DEBUG:boto:auth_path=/kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.083 DEBUG:boto:Method: GET 2023-12-15T23:07:52.083 DEBUG:boto:Path: /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.084 DEBUG:boto:Data: 2023-12-15T23:07:52.084 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.084 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.084 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.084 DEBUG:boto:Params: {} 2023-12-15T23:07:52.084 DEBUG:boto:Token: None 2023-12-15T23:07:52.084 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1?versionId=null 2023-12-15T23:07:52.084 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA= 2023-12-15T23:07:52.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:03xRyQ0Sm1KUMTJIFUocMeyFdAA=', 'Content-Length': '0'} 2023-12-15T23:07:52.086 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a51db98270881dc7-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.129 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.130 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.130 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.130 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.130 DEBUG:boto:Method: GET 2023-12-15T23:07:52.130 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.130 DEBUG:boto:Data: 2023-12-15T23:07:52.130 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.130 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.130 DEBUG:boto:Params: {} 2023-12-15T23:07:52.130 DEBUG:boto:Token: None 2023-12-15T23:07:52.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa37f96a58d25413-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.133 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.134 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.134 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.134 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.134 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.134 DEBUG:boto:Method: GET 2023-12-15T23:07:52.134 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.134 DEBUG:boto:Data: 2023-12-15T23:07:52.134 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.135 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.135 DEBUG:boto:Params: {} 2023-12-15T23:07:52.135 DEBUG:boto:Token: None 2023-12-15T23:07:52.135 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fd0d185cd95ee15-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.138 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.138 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.138 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.138 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.138 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:52.138 DEBUG:boto:Data: 2023-12-15T23:07:52.139 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.139 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.139 DEBUG:boto:Params: {} 2023-12-15T23:07:52.139 DEBUG:boto:Token: None 2023-12-15T23:07:52.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1 2023-12-15T23:07:52.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S3PNCqEJ744NAgUCa/y6P6ARorE= 2023-12-15T23:07:52.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S3PNCqEJ744NAgUCa/y6P6ARorE=', 'Content-Length': '0'} 2023-12-15T23:07:52.141 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a9d9cf478e12b2f-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.141 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.141 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.141 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.141 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:52.141 DEBUG:boto:Data: 2023-12-15T23:07:52.141 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.142 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.142 DEBUG:boto:Params: {} 2023-12-15T23:07:52.142 DEBUG:boto:Token: None 2023-12-15T23:07:52.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1 2023-12-15T23:07:52.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S3PNCqEJ744NAgUCa/y6P6ARorE= 2023-12-15T23:07:52.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S3PNCqEJ744NAgUCa/y6P6ARorE=', 'Content-Length': '0'} 2023-12-15T23:07:52.144 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003d87248c70c53885-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.144 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:52.144 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.144 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.145 DEBUG:boto:Method: GET 2023-12-15T23:07:52.145 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:52.145 DEBUG:boto:Data: 2023-12-15T23:07:52.145 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.145 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.145 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.145 DEBUG:boto:Params: {} 2023-12-15T23:07:52.145 DEBUG:boto:Token: None 2023-12-15T23:07:52.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1 2023-12-15T23:07:52.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4hd88Bsed88G0fiA3GO268uRypY= 2023-12-15T23:07:52.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4hd88Bsed88G0fiA3GO268uRypY=', 'Content-Length': '0'} 2023-12-15T23:07:52.148 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008a7e1d65118187cb-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.148 DEBUG:boto:path=/kskgfn-37/obj1 2023-12-15T23:07:52.148 DEBUG:boto:auth_path=/kskgfn-37/obj1 2023-12-15T23:07:52.149 DEBUG:boto:Method: GET 2023-12-15T23:07:52.149 DEBUG:boto:Path: /kskgfn-37/obj1 2023-12-15T23:07:52.149 DEBUG:boto:Data: 2023-12-15T23:07:52.149 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.149 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.149 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.149 DEBUG:boto:Params: {} 2023-12-15T23:07:52.149 DEBUG:boto:Token: None 2023-12-15T23:07:52.149 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj1 2023-12-15T23:07:52.149 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4hd88Bsed88G0fiA3GO268uRypY= 2023-12-15T23:07:52.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4hd88Bsed88G0fiA3GO268uRypY=', 'Content-Length': '0'} 2023-12-15T23:07:52.152 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000075340f928506384f-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.193 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.194 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.194 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.194 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.194 DEBUG:boto:Method: GET 2023-12-15T23:07:52.194 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.194 DEBUG:boto:Data: 2023-12-15T23:07:52.194 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.194 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.194 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.194 DEBUG:boto:Params: {} 2023-12-15T23:07:52.195 DEBUG:boto:Token: None 2023-12-15T23:07:52.195 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.197 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bccfb6a8de9e31a-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.197 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.198 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.198 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.198 DEBUG:boto:path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.198 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.198 DEBUG:boto:Method: GET 2023-12-15T23:07:52.198 DEBUG:boto:Path: /kskgfn-37/?prefix=obj1 2023-12-15T23:07:52.198 DEBUG:boto:Data: 2023-12-15T23:07:52.198 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.199 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.199 DEBUG:boto:Params: {} 2023-12-15T23:07:52.199 DEBUG:boto:Token: None 2023-12-15T23:07:52.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005843b550295bfbe7-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.201 DEBUG:boto:b'kskgfn-37obj11000falseobj12023-12-15T23:07:12.478Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.202 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:52.202 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.202 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.202 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.202 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.202 DEBUG:boto:Method: GET 2023-12-15T23:07:52.202 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.202 DEBUG:boto:Data: 2023-12-15T23:07:52.202 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.203 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.203 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.203 DEBUG:boto:Params: {} 2023-12-15T23:07:52.203 DEBUG:boto:Token: None 2023-12-15T23:07:52.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ= 2023-12-15T23:07:52.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.205 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f61c30f3914c9d3-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.205 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.205 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.205 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.205 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.205 DEBUG:boto:Method: GET 2023-12-15T23:07:52.206 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.206 DEBUG:boto:Data: 2023-12-15T23:07:52.206 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.206 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.206 DEBUG:boto:Params: {} 2023-12-15T23:07:52.206 DEBUG:boto:Token: None 2023-12-15T23:07:52.206 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ= 2023-12-15T23:07:52.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.208 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eff0ea452388cf32-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.209 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.209 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.209 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.209 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.209 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.209 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.209 DEBUG:boto:Data: 2023-12-15T23:07:52.209 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.209 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.209 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.210 DEBUG:boto:Params: {} 2023-12-15T23:07:52.210 DEBUG:boto:Token: None 2023-12-15T23:07:52.210 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n+vI1ZMY24Qg5FJgjI3IYYRxots= 2023-12-15T23:07:52.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n+vI1ZMY24Qg5FJgjI3IYYRxots=', 'Content-Length': '0'} 2023-12-15T23:07:52.211 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ed5865cf57aa6212-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.212 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.212 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.212 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.212 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.212 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.212 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.212 DEBUG:boto:Data: 2023-12-15T23:07:52.212 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.212 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.212 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.212 DEBUG:boto:Params: {} 2023-12-15T23:07:52.213 DEBUG:boto:Token: None 2023-12-15T23:07:52.213 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.213 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n+vI1ZMY24Qg5FJgjI3IYYRxots= 2023-12-15T23:07:52.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n+vI1ZMY24Qg5FJgjI3IYYRxots=', 'Content-Length': '0'} 2023-12-15T23:07:52.214 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000037be7c1f16947a6f-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.215 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:52.215 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.215 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.215 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.215 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.215 DEBUG:boto:Method: GET 2023-12-15T23:07:52.215 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.215 DEBUG:boto:Data: 2023-12-15T23:07:52.216 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.216 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.216 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.216 DEBUG:boto:Params: {} 2023-12-15T23:07:52.216 DEBUG:boto:Token: None 2023-12-15T23:07:52.216 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.216 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ= 2023-12-15T23:07:52.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.218 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000769bdc748adf1914-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.218 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.218 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.218 DEBUG:boto:path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.218 DEBUG:boto:auth_path=/kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.218 DEBUG:boto:Method: GET 2023-12-15T23:07:52.219 DEBUG:boto:Path: /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.219 DEBUG:boto:Data: 2023-12-15T23:07:52.219 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.219 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.219 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.219 DEBUG:boto:Params: {} 2023-12-15T23:07:52.219 DEBUG:boto:Token: None 2023-12-15T23:07:52.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2?versionId=null 2023-12-15T23:07:52.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ= 2023-12-15T23:07:52.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qteaVNzrHp5WSLAAE6vN96OVaYQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.221 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000147c3d717f5b2df8-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.265 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.266 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.266 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.266 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.266 DEBUG:boto:Method: GET 2023-12-15T23:07:52.266 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.266 DEBUG:boto:Data: 2023-12-15T23:07:52.266 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.266 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.266 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.266 DEBUG:boto:Params: {} 2023-12-15T23:07:52.267 DEBUG:boto:Token: None 2023-12-15T23:07:52.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a09151abc6cf0ff6-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.269 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.270 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.270 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.270 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.270 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.270 DEBUG:boto:Method: GET 2023-12-15T23:07:52.270 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.270 DEBUG:boto:Data: 2023-12-15T23:07:52.270 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.271 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.271 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.271 DEBUG:boto:Params: {} 2023-12-15T23:07:52.271 DEBUG:boto:Token: None 2023-12-15T23:07:52.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000998dea700201cc4-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.276 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.277 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.277 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.277 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.277 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:52.277 DEBUG:boto:Data: 2023-12-15T23:07:52.277 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.277 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.277 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.277 DEBUG:boto:Params: {} 2023-12-15T23:07:52.278 DEBUG:boto:Token: None 2023-12-15T23:07:52.278 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2 2023-12-15T23:07:52.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kACEzuaqw7HngyZF2e/M0eQd0dE= 2023-12-15T23:07:52.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kACEzuaqw7HngyZF2e/M0eQd0dE=', 'Content-Length': '0'} 2023-12-15T23:07:52.279 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000da8f9ec3abc5a155-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.280 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.280 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.280 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.280 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:52.280 DEBUG:boto:Data: 2023-12-15T23:07:52.280 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.280 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.280 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.280 DEBUG:boto:Params: {} 2023-12-15T23:07:52.280 DEBUG:boto:Token: None 2023-12-15T23:07:52.281 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2 2023-12-15T23:07:52.281 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kACEzuaqw7HngyZF2e/M0eQd0dE= 2023-12-15T23:07:52.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kACEzuaqw7HngyZF2e/M0eQd0dE=', 'Content-Length': '0'} 2023-12-15T23:07:52.283 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fd9544122efefb18-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.283 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:52.283 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.283 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.283 DEBUG:boto:Method: GET 2023-12-15T23:07:52.283 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:52.283 DEBUG:boto:Data: 2023-12-15T23:07:52.283 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.284 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.284 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.284 DEBUG:boto:Params: {} 2023-12-15T23:07:52.284 DEBUG:boto:Token: None 2023-12-15T23:07:52.284 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2 2023-12-15T23:07:52.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/ZkE/lTxV8RX9gd9H69kbBc/do= 2023-12-15T23:07:52.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/ZkE/lTxV8RX9gd9H69kbBc/do=', 'Content-Length': '0'} 2023-12-15T23:07:52.286 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007353087ad3592317-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.286 DEBUG:boto:path=/kskgfn-37/obj2 2023-12-15T23:07:52.286 DEBUG:boto:auth_path=/kskgfn-37/obj2 2023-12-15T23:07:52.287 DEBUG:boto:Method: GET 2023-12-15T23:07:52.287 DEBUG:boto:Path: /kskgfn-37/obj2 2023-12-15T23:07:52.287 DEBUG:boto:Data: 2023-12-15T23:07:52.287 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.287 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.287 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.287 DEBUG:boto:Params: {} 2023-12-15T23:07:52.287 DEBUG:boto:Token: None 2023-12-15T23:07:52.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj2 2023-12-15T23:07:52.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/ZkE/lTxV8RX9gd9H69kbBc/do= 2023-12-15T23:07:52.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/ZkE/lTxV8RX9gd9H69kbBc/do=', 'Content-Length': '0'} 2023-12-15T23:07:52.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000089e8ab45ece8ad3c-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.330 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.330 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.330 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.330 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.330 DEBUG:boto:Method: GET 2023-12-15T23:07:52.330 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.330 DEBUG:boto:Data: 2023-12-15T23:07:52.330 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.330 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.331 DEBUG:boto:Params: {} 2023-12-15T23:07:52.331 DEBUG:boto:Token: None 2023-12-15T23:07:52.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074881470d1cd7b70-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.334 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.334 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.334 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.334 DEBUG:boto:path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.335 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.335 DEBUG:boto:Method: GET 2023-12-15T23:07:52.335 DEBUG:boto:Path: /kskgfn-37/?prefix=obj2 2023-12-15T23:07:52.335 DEBUG:boto:Data: 2023-12-15T23:07:52.335 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.335 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.335 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.335 DEBUG:boto:Params: {} 2023-12-15T23:07:52.335 DEBUG:boto:Token: None 2023-12-15T23:07:52.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.336 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e84982a943200040-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.338 DEBUG:boto:b'kskgfn-37obj21000falseobj22023-12-15T23:07:12.488Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:52.339 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.339 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.339 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.339 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.339 DEBUG:boto:Method: GET 2023-12-15T23:07:52.339 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.339 DEBUG:boto:Data: 2023-12-15T23:07:52.339 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.339 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.339 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.340 DEBUG:boto:Params: {} 2023-12-15T23:07:52.340 DEBUG:boto:Token: None 2023-12-15T23:07:52.340 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.340 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ= 2023-12-15T23:07:52.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.342 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000db8b781954c9358e-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.342 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.342 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.342 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.343 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.343 DEBUG:boto:Method: GET 2023-12-15T23:07:52.343 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.343 DEBUG:boto:Data: 2023-12-15T23:07:52.343 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.343 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.343 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.343 DEBUG:boto:Params: {} 2023-12-15T23:07:52.343 DEBUG:boto:Token: None 2023-12-15T23:07:52.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ= 2023-12-15T23:07:52.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.346 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f0d2d3cf7f5831a3-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.346 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.346 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.346 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.346 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.346 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.347 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.347 DEBUG:boto:Data: 2023-12-15T23:07:52.347 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.347 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.347 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.347 DEBUG:boto:Params: {} 2023-12-15T23:07:52.347 DEBUG:boto:Token: None 2023-12-15T23:07:52.347 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fmB5uov8Pfq0OytXg4UHFPSki/0= 2023-12-15T23:07:52.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fmB5uov8Pfq0OytXg4UHFPSki/0=', 'Content-Length': '0'} 2023-12-15T23:07:52.349 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d34c410a995695c2-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.349 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.349 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.349 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.349 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.350 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.350 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.350 DEBUG:boto:Data: 2023-12-15T23:07:52.350 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.350 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.350 DEBUG:boto:Params: {} 2023-12-15T23:07:52.350 DEBUG:boto:Token: None 2023-12-15T23:07:52.351 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fmB5uov8Pfq0OytXg4UHFPSki/0= 2023-12-15T23:07:52.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fmB5uov8Pfq0OytXg4UHFPSki/0=', 'Content-Length': '0'} 2023-12-15T23:07:52.352 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aeef689193b96f2f-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:52.353 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.353 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.353 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.353 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.353 DEBUG:boto:Method: GET 2023-12-15T23:07:52.353 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.353 DEBUG:boto:Data: 2023-12-15T23:07:52.353 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.353 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.353 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.354 DEBUG:boto:Params: {} 2023-12-15T23:07:52.354 DEBUG:boto:Token: None 2023-12-15T23:07:52.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ= 2023-12-15T23:07:52.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000078ea803cf36a0ce7-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.398 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.398 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.398 DEBUG:boto:path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.398 DEBUG:boto:auth_path=/kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.398 DEBUG:boto:Method: GET 2023-12-15T23:07:52.398 DEBUG:boto:Path: /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.398 DEBUG:boto:Data: 2023-12-15T23:07:52.398 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.398 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.398 DEBUG:boto:Params: {} 2023-12-15T23:07:52.399 DEBUG:boto:Token: None 2023-12-15T23:07:52.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3?versionId=null 2023-12-15T23:07:52.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ= 2023-12-15T23:07:52.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4mei5n5wCK6sYBzOxc/0y9TukQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000082b8b1934c43df1e-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.441 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.442 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.442 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.442 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.442 DEBUG:boto:Method: GET 2023-12-15T23:07:52.442 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.442 DEBUG:boto:Data: 2023-12-15T23:07:52.442 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.442 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.442 DEBUG:boto:Params: {} 2023-12-15T23:07:52.442 DEBUG:boto:Token: None 2023-12-15T23:07:52.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef6d8481407a1803-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.445 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.446 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.446 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.446 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.446 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.446 DEBUG:boto:Method: GET 2023-12-15T23:07:52.446 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.446 DEBUG:boto:Data: 2023-12-15T23:07:52.446 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.447 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.447 DEBUG:boto:Params: {} 2023-12-15T23:07:52.447 DEBUG:boto:Token: None 2023-12-15T23:07:52.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f97644892145fe44-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.449 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.450 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.450 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.450 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.450 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:52.450 DEBUG:boto:Data: 2023-12-15T23:07:52.450 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.450 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.450 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.450 DEBUG:boto:Params: {} 2023-12-15T23:07:52.451 DEBUG:boto:Token: None 2023-12-15T23:07:52.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3 2023-12-15T23:07:52.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iwSzzFjGD+D532XlmxB9tTIej2c= 2023-12-15T23:07:52.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iwSzzFjGD+D532XlmxB9tTIej2c=', 'Content-Length': '0'} 2023-12-15T23:07:52.452 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009f29705f367dc8e8-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.453 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.453 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.453 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.453 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:52.453 DEBUG:boto:Data: 2023-12-15T23:07:52.453 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.453 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.453 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.454 DEBUG:boto:Params: {} 2023-12-15T23:07:52.454 DEBUG:boto:Token: None 2023-12-15T23:07:52.454 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3 2023-12-15T23:07:52.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iwSzzFjGD+D532XlmxB9tTIej2c= 2023-12-15T23:07:52.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iwSzzFjGD+D532XlmxB9tTIej2c=', 'Content-Length': '0'} 2023-12-15T23:07:52.455 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004bcb8b69912e9d56-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:52.456 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.456 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.456 DEBUG:boto:Method: GET 2023-12-15T23:07:52.456 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:52.456 DEBUG:boto:Data: 2023-12-15T23:07:52.456 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.456 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.456 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.457 DEBUG:boto:Params: {} 2023-12-15T23:07:52.457 DEBUG:boto:Token: None 2023-12-15T23:07:52.457 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3 2023-12-15T23:07:52.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmGJR0S5cNogfgw9yIxH+KEJ+JA= 2023-12-15T23:07:52.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmGJR0S5cNogfgw9yIxH+KEJ+JA=', 'Content-Length': '0'} 2023-12-15T23:07:52.458 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f358fb7fe06efebf-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.459 DEBUG:boto:path=/kskgfn-37/obj3 2023-12-15T23:07:52.459 DEBUG:boto:auth_path=/kskgfn-37/obj3 2023-12-15T23:07:52.459 DEBUG:boto:Method: GET 2023-12-15T23:07:52.459 DEBUG:boto:Path: /kskgfn-37/obj3 2023-12-15T23:07:52.459 DEBUG:boto:Data: 2023-12-15T23:07:52.459 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.459 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.460 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.460 DEBUG:boto:Params: {} 2023-12-15T23:07:52.460 DEBUG:boto:Token: None 2023-12-15T23:07:52.460 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj3 2023-12-15T23:07:52.460 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SmGJR0S5cNogfgw9yIxH+KEJ+JA= 2023-12-15T23:07:52.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SmGJR0S5cNogfgw9yIxH+KEJ+JA=', 'Content-Length': '0'} 2023-12-15T23:07:52.462 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b3f05deb038d2cb0-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.505 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.506 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.506 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.506 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.506 DEBUG:boto:Method: GET 2023-12-15T23:07:52.506 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.506 DEBUG:boto:Data: 2023-12-15T23:07:52.506 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.506 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.506 DEBUG:boto:Params: {} 2023-12-15T23:07:52.507 DEBUG:boto:Token: None 2023-12-15T23:07:52.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000112abf51d64296f6-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.510 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.510 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.510 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.510 DEBUG:boto:path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.510 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.510 DEBUG:boto:Method: GET 2023-12-15T23:07:52.510 DEBUG:boto:Path: /kskgfn-37/?prefix=obj3 2023-12-15T23:07:52.510 DEBUG:boto:Data: 2023-12-15T23:07:52.511 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.511 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.511 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.511 DEBUG:boto:Params: {} 2023-12-15T23:07:52.511 DEBUG:boto:Token: None 2023-12-15T23:07:52.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b5eb0313d895511-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.514 DEBUG:boto:b'kskgfn-37obj31000falseobj32023-12-15T23:07:12.497Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:52.514 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.514 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.514 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.514 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.514 DEBUG:boto:Method: GET 2023-12-15T23:07:52.514 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.515 DEBUG:boto:Data: 2023-12-15T23:07:52.515 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.515 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.515 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.515 DEBUG:boto:Params: {} 2023-12-15T23:07:52.515 DEBUG:boto:Token: None 2023-12-15T23:07:52.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U= 2023-12-15T23:07:52.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U=', 'Content-Length': '0'} 2023-12-15T23:07:52.517 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019ef7e6a8ceb6689-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.517 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.517 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.518 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.518 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.518 DEBUG:boto:Method: GET 2023-12-15T23:07:52.518 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.518 DEBUG:boto:Data: 2023-12-15T23:07:52.518 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.518 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.518 DEBUG:boto:Params: {} 2023-12-15T23:07:52.518 DEBUG:boto:Token: None 2023-12-15T23:07:52.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U= 2023-12-15T23:07:52.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U=', 'Content-Length': '0'} 2023-12-15T23:07:52.520 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5267e9d0feebdfa-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.565 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.566 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.566 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.566 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.566 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.566 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.566 DEBUG:boto:Data: 2023-12-15T23:07:52.566 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.566 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.566 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.566 DEBUG:boto:Params: {} 2023-12-15T23:07:52.566 DEBUG:boto:Token: None 2023-12-15T23:07:52.567 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKiohwXMDGtAgyfsMweML8986OY= 2023-12-15T23:07:52.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKiohwXMDGtAgyfsMweML8986OY=', 'Content-Length': '0'} 2023-12-15T23:07:52.568 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f91d0b125f137c82-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.569 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.569 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.569 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.569 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.569 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.569 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.569 DEBUG:boto:Data: 2023-12-15T23:07:52.569 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.569 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.569 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.570 DEBUG:boto:Params: {} 2023-12-15T23:07:52.570 DEBUG:boto:Token: None 2023-12-15T23:07:52.570 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.570 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKiohwXMDGtAgyfsMweML8986OY= 2023-12-15T23:07:52.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKiohwXMDGtAgyfsMweML8986OY=', 'Content-Length': '0'} 2023-12-15T23:07:52.572 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd2ba410a3954135-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:52.572 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.572 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.572 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.572 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.573 DEBUG:boto:Method: GET 2023-12-15T23:07:52.573 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.573 DEBUG:boto:Data: 2023-12-15T23:07:52.573 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.573 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.573 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.573 DEBUG:boto:Params: {} 2023-12-15T23:07:52.573 DEBUG:boto:Token: None 2023-12-15T23:07:52.573 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.573 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U= 2023-12-15T23:07:52.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U=', 'Content-Length': '0'} 2023-12-15T23:07:52.575 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce6a67809dbc10dc-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.576 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.576 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.576 DEBUG:boto:path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.576 DEBUG:boto:auth_path=/kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.576 DEBUG:boto:Method: GET 2023-12-15T23:07:52.576 DEBUG:boto:Path: /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.576 DEBUG:boto:Data: 2023-12-15T23:07:52.576 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.576 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.576 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.576 DEBUG:boto:Params: {} 2023-12-15T23:07:52.577 DEBUG:boto:Token: None 2023-12-15T23:07:52.577 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4?versionId=null 2023-12-15T23:07:52.577 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U= 2023-12-15T23:07:52.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OmBKemkKFEAyPIc39vIdq24E3U=', 'Content-Length': '0'} 2023-12-15T23:07:52.579 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008bdb7e183efb15ef-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.626 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.626 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.626 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.626 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.626 DEBUG:boto:Method: GET 2023-12-15T23:07:52.626 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.626 DEBUG:boto:Data: 2023-12-15T23:07:52.626 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.626 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.626 DEBUG:boto:Params: {} 2023-12-15T23:07:52.627 DEBUG:boto:Token: None 2023-12-15T23:07:52.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.629 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c75f44e161e2fa1-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.629 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.630 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.630 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.630 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.630 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.630 DEBUG:boto:Method: GET 2023-12-15T23:07:52.630 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.630 DEBUG:boto:Data: 2023-12-15T23:07:52.630 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.630 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.630 DEBUG:boto:Params: {} 2023-12-15T23:07:52.631 DEBUG:boto:Token: None 2023-12-15T23:07:52.631 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fda846d96ee99db1-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.633 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.634 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.634 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.634 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.634 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:52.634 DEBUG:boto:Data: 2023-12-15T23:07:52.634 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.634 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.635 DEBUG:boto:Params: {} 2023-12-15T23:07:52.635 DEBUG:boto:Token: None 2023-12-15T23:07:52.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4 2023-12-15T23:07:52.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OOFAhOEUur036pqkcRqTj2mafxk= 2023-12-15T23:07:52.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OOFAhOEUur036pqkcRqTj2mafxk=', 'Content-Length': '0'} 2023-12-15T23:07:52.637 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000004a5312bdfe9bf7c-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.637 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.637 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.637 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.637 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:52.637 DEBUG:boto:Data: 2023-12-15T23:07:52.638 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.638 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.638 DEBUG:boto:Params: {} 2023-12-15T23:07:52.638 DEBUG:boto:Token: None 2023-12-15T23:07:52.638 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4 2023-12-15T23:07:52.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OOFAhOEUur036pqkcRqTj2mafxk= 2023-12-15T23:07:52.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OOFAhOEUur036pqkcRqTj2mafxk=', 'Content-Length': '0'} 2023-12-15T23:07:52.640 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d33b0b8045feed9-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.640 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:07:52.640 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.640 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.641 DEBUG:boto:Method: GET 2023-12-15T23:07:52.641 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:52.641 DEBUG:boto:Data: 2023-12-15T23:07:52.641 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.641 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.641 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.641 DEBUG:boto:Params: {} 2023-12-15T23:07:52.641 DEBUG:boto:Token: None 2023-12-15T23:07:52.641 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4 2023-12-15T23:07:52.641 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UQwPfldxSVncKnkRv4olmk3AuDg= 2023-12-15T23:07:52.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UQwPfldxSVncKnkRv4olmk3AuDg=', 'Content-Length': '0'} 2023-12-15T23:07:52.643 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000500e80100fba8d56-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.644 DEBUG:boto:path=/kskgfn-37/obj4 2023-12-15T23:07:52.644 DEBUG:boto:auth_path=/kskgfn-37/obj4 2023-12-15T23:07:52.644 DEBUG:boto:Method: GET 2023-12-15T23:07:52.644 DEBUG:boto:Path: /kskgfn-37/obj4 2023-12-15T23:07:52.644 DEBUG:boto:Data: 2023-12-15T23:07:52.644 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.644 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.644 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.644 DEBUG:boto:Params: {} 2023-12-15T23:07:52.644 DEBUG:boto:Token: None 2023-12-15T23:07:52.645 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj4 2023-12-15T23:07:52.645 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UQwPfldxSVncKnkRv4olmk3AuDg= 2023-12-15T23:07:52.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UQwPfldxSVncKnkRv4olmk3AuDg=', 'Content-Length': '0'} 2023-12-15T23:07:52.647 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:12 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051d7d6689b1cce40-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.690 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.690 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.690 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.690 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.690 DEBUG:boto:Method: GET 2023-12-15T23:07:52.690 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.690 DEBUG:boto:Data: 2023-12-15T23:07:52.690 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.690 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.690 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.691 DEBUG:boto:Params: {} 2023-12-15T23:07:52.691 DEBUG:boto:Token: None 2023-12-15T23:07:52.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad7608bc8a99bb1a-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.693 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.694 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.694 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.694 DEBUG:boto:path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.694 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.694 DEBUG:boto:Method: GET 2023-12-15T23:07:52.694 DEBUG:boto:Path: /kskgfn-37/?prefix=obj4 2023-12-15T23:07:52.695 DEBUG:boto:Data: 2023-12-15T23:07:52.695 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.695 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.695 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.695 DEBUG:boto:Params: {} 2023-12-15T23:07:52.695 DEBUG:boto:Token: None 2023-12-15T23:07:52.695 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b70b9bb1da09e066-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.698 DEBUG:boto:b'kskgfn-37obj41000falseobj42023-12-15T23:07:12.543Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.698 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:52.698 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.698 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.698 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.698 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.699 DEBUG:boto:Method: GET 2023-12-15T23:07:52.699 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.699 DEBUG:boto:Data: 2023-12-15T23:07:52.699 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.699 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.699 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.699 DEBUG:boto:Params: {} 2023-12-15T23:07:52.699 DEBUG:boto:Token: None 2023-12-15T23:07:52.699 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI= 2023-12-15T23:07:52.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI=', 'Content-Length': '0'} 2023-12-15T23:07:52.701 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000009211eb0164739e3-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.702 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.702 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.702 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.702 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.702 DEBUG:boto:Method: GET 2023-12-15T23:07:52.702 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.702 DEBUG:boto:Data: 2023-12-15T23:07:52.702 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.702 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.702 DEBUG:boto:Params: {} 2023-12-15T23:07:52.703 DEBUG:boto:Token: None 2023-12-15T23:07:52.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI= 2023-12-15T23:07:52.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI=', 'Content-Length': '0'} 2023-12-15T23:07:52.705 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e942d2561ef69042-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.705 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.705 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.705 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.706 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.706 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.706 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.706 DEBUG:boto:Data: 2023-12-15T23:07:52.706 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.706 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.706 DEBUG:boto:Params: {} 2023-12-15T23:07:52.706 DEBUG:boto:Token: None 2023-12-15T23:07:52.706 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+aja+6i/OAm3r3d+ROlqXDFfnaw= 2023-12-15T23:07:52.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+aja+6i/OAm3r3d+ROlqXDFfnaw=', 'Content-Length': '0'} 2023-12-15T23:07:52.708 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000094e8335ddd6a5774-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.709 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.709 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.709 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.709 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.709 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.709 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.709 DEBUG:boto:Data: 2023-12-15T23:07:52.709 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.709 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.710 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.710 DEBUG:boto:Params: {} 2023-12-15T23:07:52.710 DEBUG:boto:Token: None 2023-12-15T23:07:52.710 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+aja+6i/OAm3r3d+ROlqXDFfnaw= 2023-12-15T23:07:52.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+aja+6i/OAm3r3d+ROlqXDFfnaw=', 'Content-Length': '0'} 2023-12-15T23:07:52.712 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009dc7d3c1dd21e976-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:52.712 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.712 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.712 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.712 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.713 DEBUG:boto:Method: GET 2023-12-15T23:07:52.713 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.713 DEBUG:boto:Data: 2023-12-15T23:07:52.713 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.713 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.713 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.713 DEBUG:boto:Params: {} 2023-12-15T23:07:52.713 DEBUG:boto:Token: None 2023-12-15T23:07:52.713 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.714 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI= 2023-12-15T23:07:52.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI=', 'Content-Length': '0'} 2023-12-15T23:07:52.715 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000076e1b8545e94481c-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.715 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.716 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.716 DEBUG:boto:path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.716 DEBUG:boto:auth_path=/kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.716 DEBUG:boto:Method: GET 2023-12-15T23:07:52.716 DEBUG:boto:Path: /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.716 DEBUG:boto:Data: 2023-12-15T23:07:52.716 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.716 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.716 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.716 DEBUG:boto:Params: {} 2023-12-15T23:07:52.716 DEBUG:boto:Token: None 2023-12-15T23:07:52.717 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5?versionId=null 2023-12-15T23:07:52.717 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI= 2023-12-15T23:07:52.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/f7PmcBrY4+EMm43nwDk+hRknyI=', 'Content-Length': '0'} 2023-12-15T23:07:52.719 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dae0fdf867030455-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.761 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.762 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.762 DEBUG:boto:path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.762 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.762 DEBUG:boto:Method: GET 2023-12-15T23:07:52.762 DEBUG:boto:Path: /kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.762 DEBUG:boto:Data: 2023-12-15T23:07:52.762 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.762 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.762 DEBUG:boto:Params: {} 2023-12-15T23:07:52.762 DEBUG:boto:Token: None 2023-12-15T23:07:52.763 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000174e449dc9bd093a-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.765 DEBUG:boto:b'kskgfn-37obj51000falseobj52023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.766 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.766 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.766 DEBUG:boto:path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.766 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.766 DEBUG:boto:Method: GET 2023-12-15T23:07:52.766 DEBUG:boto:Path: /kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.766 DEBUG:boto:Data: 2023-12-15T23:07:52.766 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.767 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.767 DEBUG:boto:Params: {} 2023-12-15T23:07:52.767 DEBUG:boto:Token: None 2023-12-15T23:07:52.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f2652fdfd8c489c-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.809 DEBUG:boto:b'kskgfn-37obj51000falseobj52023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.810 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.810 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.810 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.810 DEBUG:boto:Path: /kskgfn-37/obj5 2023-12-15T23:07:52.810 DEBUG:boto:Data: 2023-12-15T23:07:52.810 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.810 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.810 DEBUG:boto:Params: {} 2023-12-15T23:07:52.810 DEBUG:boto:Token: None 2023-12-15T23:07:52.811 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5 2023-12-15T23:07:52.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uRNKNkrH1MV8NhBl2R5XKsRF5tY= 2023-12-15T23:07:52.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uRNKNkrH1MV8NhBl2R5XKsRF5tY=', 'Content-Length': '0'} 2023-12-15T23:07:52.812 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000030e12d615b50b81e-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.813 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.813 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.813 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.813 DEBUG:boto:Path: /kskgfn-37/obj5 2023-12-15T23:07:52.813 DEBUG:boto:Data: 2023-12-15T23:07:52.813 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.813 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.813 DEBUG:boto:Params: {} 2023-12-15T23:07:52.814 DEBUG:boto:Token: None 2023-12-15T23:07:52.814 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5 2023-12-15T23:07:52.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uRNKNkrH1MV8NhBl2R5XKsRF5tY= 2023-12-15T23:07:52.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uRNKNkrH1MV8NhBl2R5XKsRF5tY=', 'Content-Length': '0'} 2023-12-15T23:07:52.816 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e7cc7380a038eb2-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:07:52.816 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.816 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.816 DEBUG:boto:Method: GET 2023-12-15T23:07:52.817 DEBUG:boto:Path: /kskgfn-37/obj5 2023-12-15T23:07:52.817 DEBUG:boto:Data: 2023-12-15T23:07:52.817 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.817 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.817 DEBUG:boto:Params: {} 2023-12-15T23:07:52.817 DEBUG:boto:Token: None 2023-12-15T23:07:52.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5 2023-12-15T23:07:52.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x4wNtX8YrZvwawy++ZFOtnSYFrs= 2023-12-15T23:07:52.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x4wNtX8YrZvwawy++ZFOtnSYFrs=', 'Content-Length': '0'} 2023-12-15T23:07:52.819 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000375c15d99fcd5973-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.819 DEBUG:boto:path=/kskgfn-37/obj5 2023-12-15T23:07:52.819 DEBUG:boto:auth_path=/kskgfn-37/obj5 2023-12-15T23:07:52.820 DEBUG:boto:Method: GET 2023-12-15T23:07:52.820 DEBUG:boto:Path: /kskgfn-37/obj5 2023-12-15T23:07:52.820 DEBUG:boto:Data: 2023-12-15T23:07:52.820 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.820 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.820 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.820 DEBUG:boto:Params: {} 2023-12-15T23:07:52.820 DEBUG:boto:Token: None 2023-12-15T23:07:52.820 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj5 2023-12-15T23:07:52.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x4wNtX8YrZvwawy++ZFOtnSYFrs= 2023-12-15T23:07:52.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x4wNtX8YrZvwawy++ZFOtnSYFrs=', 'Content-Length': '0'} 2023-12-15T23:07:52.822 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006aadd2df4928c720-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.865 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.866 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.866 DEBUG:boto:path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.866 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.866 DEBUG:boto:Method: GET 2023-12-15T23:07:52.866 DEBUG:boto:Path: /kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.866 DEBUG:boto:Data: 2023-12-15T23:07:52.866 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.866 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.866 DEBUG:boto:Params: {} 2023-12-15T23:07:52.867 DEBUG:boto:Token: None 2023-12-15T23:07:52.867 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072f27c724fc84ebf-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.869 DEBUG:boto:b'kskgfn-37obj51000falseobj52023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.870 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.870 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.870 DEBUG:boto:path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.870 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.870 DEBUG:boto:Method: GET 2023-12-15T23:07:52.870 DEBUG:boto:Path: /kskgfn-37/?prefix=obj5 2023-12-15T23:07:52.870 DEBUG:boto:Data: 2023-12-15T23:07:52.870 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.871 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.871 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.871 DEBUG:boto:Params: {} 2023-12-15T23:07:52.871 DEBUG:boto:Token: None 2023-12-15T23:07:52.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccf97b9dea62f869-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.874 DEBUG:boto:b'kskgfn-37obj51000falseobj52023-12-15T23:07:19.992Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:52.874 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.874 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.874 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.874 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.874 DEBUG:boto:Method: GET 2023-12-15T23:07:52.875 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.875 DEBUG:boto:Data: 2023-12-15T23:07:52.875 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.875 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.875 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.875 DEBUG:boto:Params: {} 2023-12-15T23:07:52.875 DEBUG:boto:Token: None 2023-12-15T23:07:52.875 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0= 2023-12-15T23:07:52.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0=', 'Content-Length': '0'} 2023-12-15T23:07:52.878 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007cae71c6cea780a8-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.878 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.878 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.878 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.878 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.879 DEBUG:boto:Method: GET 2023-12-15T23:07:52.879 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.879 DEBUG:boto:Data: 2023-12-15T23:07:52.879 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.879 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.879 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.879 DEBUG:boto:Params: {} 2023-12-15T23:07:52.879 DEBUG:boto:Token: None 2023-12-15T23:07:52.879 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0= 2023-12-15T23:07:52.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0=', 'Content-Length': '0'} 2023-12-15T23:07:52.882 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000896d8aea47c23e25-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.925 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.926 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.926 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.926 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.926 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.926 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.926 DEBUG:boto:Data: 2023-12-15T23:07:52.926 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.926 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.926 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.926 DEBUG:boto:Params: {} 2023-12-15T23:07:52.927 DEBUG:boto:Token: None 2023-12-15T23:07:52.927 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i0AT5DPhbZIFFw8IlnFq7eUgKLg= 2023-12-15T23:07:52.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i0AT5DPhbZIFFw8IlnFq7eUgKLg=', 'Content-Length': '0'} 2023-12-15T23:07:52.929 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000adbb72a4a3dc1071-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.929 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.929 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.929 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.929 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.930 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.930 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.930 DEBUG:boto:Data: 2023-12-15T23:07:52.930 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.930 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.930 DEBUG:boto:Params: {} 2023-12-15T23:07:52.930 DEBUG:boto:Token: None 2023-12-15T23:07:52.930 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i0AT5DPhbZIFFw8IlnFq7eUgKLg= 2023-12-15T23:07:52.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i0AT5DPhbZIFFw8IlnFq7eUgKLg=', 'Content-Length': '0'} 2023-12-15T23:07:52.933 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d556ee2b2719cf3-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:52.933 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.933 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.933 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.933 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.933 DEBUG:boto:Method: GET 2023-12-15T23:07:52.934 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.934 DEBUG:boto:Data: 2023-12-15T23:07:52.934 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.934 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.934 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.934 DEBUG:boto:Params: {} 2023-12-15T23:07:52.934 DEBUG:boto:Token: None 2023-12-15T23:07:52.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0= 2023-12-15T23:07:52.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0=', 'Content-Length': '0'} 2023-12-15T23:07:52.936 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d210e2545cb611e3-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.936 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.936 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.937 DEBUG:boto:path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.937 DEBUG:boto:auth_path=/kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.937 DEBUG:boto:Method: GET 2023-12-15T23:07:52.937 DEBUG:boto:Path: /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.937 DEBUG:boto:Data: 2023-12-15T23:07:52.937 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.937 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.937 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.937 DEBUG:boto:Params: {} 2023-12-15T23:07:52.937 DEBUG:boto:Token: None 2023-12-15T23:07:52.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6?versionId=null 2023-12-15T23:07:52.938 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0= 2023-12-15T23:07:52.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MMJv3elrI8tHzCzIMG3yGptnf0=', 'Content-Length': '0'} 2023-12-15T23:07:52.940 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c7819054f85bd00-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.981 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.982 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.982 DEBUG:boto:path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.982 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.982 DEBUG:boto:Method: GET 2023-12-15T23:07:52.982 DEBUG:boto:Path: /kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.982 DEBUG:boto:Data: 2023-12-15T23:07:52.982 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.982 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.982 DEBUG:boto:Params: {} 2023-12-15T23:07:52.983 DEBUG:boto:Token: None 2023-12-15T23:07:52.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000baffe4b500038852-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.985 DEBUG:boto:b'kskgfn-37obj61000falseobj62023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.986 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:52.986 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:52.986 DEBUG:boto:path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.986 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.986 DEBUG:boto:Method: GET 2023-12-15T23:07:52.986 DEBUG:boto:Path: /kskgfn-37/?prefix=obj6 2023-12-15T23:07:52.986 DEBUG:boto:Data: 2023-12-15T23:07:52.986 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.986 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.986 DEBUG:boto:Params: {} 2023-12-15T23:07:52.987 DEBUG:boto:Token: None 2023-12-15T23:07:52.987 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/ 2023-12-15T23:07:52.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4= 2023-12-15T23:07:52.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZrgRVPe3IdWgW9/i5Ci08w9kZ4=', 'Content-Length': '0'} 2023-12-15T23:07:52.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a54183db4b6be500-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.989 DEBUG:boto:b'kskgfn-37obj61000falseobj62023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:52.990 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.990 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.990 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.990 DEBUG:boto:Path: /kskgfn-37/obj6 2023-12-15T23:07:52.990 DEBUG:boto:Data: 2023-12-15T23:07:52.990 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.990 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.990 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.990 DEBUG:boto:Params: {} 2023-12-15T23:07:52.990 DEBUG:boto:Token: None 2023-12-15T23:07:52.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6 2023-12-15T23:07:52.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TfKw+B0/apyfDOiqDHPPA4E8kZQ= 2023-12-15T23:07:52.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TfKw+B0/apyfDOiqDHPPA4E8kZQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.993 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d4ecb34aac2e5ded-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.993 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.993 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.993 DEBUG:boto:Method: HEAD 2023-12-15T23:07:52.993 DEBUG:boto:Path: /kskgfn-37/obj6 2023-12-15T23:07:52.993 DEBUG:boto:Data: 2023-12-15T23:07:52.993 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:52.994 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.994 DEBUG:boto:Params: {} 2023-12-15T23:07:52.994 DEBUG:boto:Token: None 2023-12-15T23:07:52.994 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6 2023-12-15T23:07:52.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TfKw+B0/apyfDOiqDHPPA4E8kZQ= 2023-12-15T23:07:52.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TfKw+B0/apyfDOiqDHPPA4E8kZQ=', 'Content-Length': '0'} 2023-12-15T23:07:52.996 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009213e2ff66eabdbc-00657cdc48-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:52.997 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:07:52.997 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:52.997 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:52.997 DEBUG:boto:Method: GET 2023-12-15T23:07:52.997 DEBUG:boto:Path: /kskgfn-37/obj6 2023-12-15T23:07:52.997 DEBUG:boto:Data: 2023-12-15T23:07:52.997 DEBUG:boto:Headers: {} 2023-12-15T23:07:52.997 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:52.997 DEBUG:boto:Port: 8000 2023-12-15T23:07:52.997 DEBUG:boto:Params: {} 2023-12-15T23:07:52.998 DEBUG:boto:Token: None 2023-12-15T23:07:52.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:52 GMT /kskgfn-37/obj6 2023-12-15T23:07:52.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KZjbDkcJD1PDGNDcHRtlJPipx8A= 2023-12-15T23:07:52.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:52 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KZjbDkcJD1PDGNDcHRtlJPipx8A=', 'Content-Length': '0'} 2023-12-15T23:07:53.000 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a17e973575fa8728-00657cdc48-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:52 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.000 DEBUG:boto:path=/kskgfn-37/obj6 2023-12-15T23:07:53.000 DEBUG:boto:auth_path=/kskgfn-37/obj6 2023-12-15T23:07:53.000 DEBUG:boto:Method: GET 2023-12-15T23:07:53.000 DEBUG:boto:Path: /kskgfn-37/obj6 2023-12-15T23:07:53.000 DEBUG:boto:Data: 2023-12-15T23:07:53.001 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.001 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.001 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.001 DEBUG:boto:Params: {} 2023-12-15T23:07:53.001 DEBUG:boto:Token: None 2023-12-15T23:07:53.001 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj6 2023-12-15T23:07:53.001 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IzOoJ2Mg7A4mFXIQZeguT/KRur4= 2023-12-15T23:07:53.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IzOoJ2Mg7A4mFXIQZeguT/KRur4=', 'Content-Length': '0'} 2023-12-15T23:07:53.003 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bcd58385d808659e-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.049 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.050 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.050 DEBUG:boto:path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.050 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.050 DEBUG:boto:Method: GET 2023-12-15T23:07:53.050 DEBUG:boto:Path: /kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.050 DEBUG:boto:Data: 2023-12-15T23:07:53.050 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.050 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.050 DEBUG:boto:Params: {} 2023-12-15T23:07:53.051 DEBUG:boto:Token: None 2023-12-15T23:07:53.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.053 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000042fa9d719b06317-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.053 DEBUG:boto:b'kskgfn-37obj61000falseobj62023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.054 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.054 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.054 DEBUG:boto:path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.054 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.054 DEBUG:boto:Method: GET 2023-12-15T23:07:53.054 DEBUG:boto:Path: /kskgfn-37/?prefix=obj6 2023-12-15T23:07:53.054 DEBUG:boto:Data: 2023-12-15T23:07:53.055 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.055 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.055 DEBUG:boto:Params: {} 2023-12-15T23:07:53.055 DEBUG:boto:Token: None 2023-12-15T23:07:53.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043e3af75229ae30d-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.102 DEBUG:boto:b'kskgfn-37obj61000falseobj62023-12-15T23:07:20.001Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.102 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:53.102 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.102 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.102 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.102 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.103 DEBUG:boto:Method: GET 2023-12-15T23:07:53.103 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.103 DEBUG:boto:Data: 2023-12-15T23:07:53.103 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.103 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.103 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.103 DEBUG:boto:Params: {} 2023-12-15T23:07:53.103 DEBUG:boto:Token: None 2023-12-15T23:07:53.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.104 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero= 2023-12-15T23:07:53.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero=', 'Content-Length': '0'} 2023-12-15T23:07:53.105 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c4e74b27465c3d7-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.105 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.106 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.106 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.106 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.106 DEBUG:boto:Method: GET 2023-12-15T23:07:53.106 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.106 DEBUG:boto:Data: 2023-12-15T23:07:53.106 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.106 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.106 DEBUG:boto:Params: {} 2023-12-15T23:07:53.107 DEBUG:boto:Token: None 2023-12-15T23:07:53.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero= 2023-12-15T23:07:53.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero=', 'Content-Length': '0'} 2023-12-15T23:07:53.109 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2844f7f2ef0b231-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.110 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.110 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.110 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.110 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.110 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.110 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.110 DEBUG:boto:Data: 2023-12-15T23:07:53.110 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.111 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.111 DEBUG:boto:Params: {} 2023-12-15T23:07:53.111 DEBUG:boto:Token: None 2023-12-15T23:07:53.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gnu3Ke3QVroiqIcZn+wWkhhIMyM= 2023-12-15T23:07:53.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gnu3Ke3QVroiqIcZn+wWkhhIMyM=', 'Content-Length': '0'} 2023-12-15T23:07:53.113 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000085277a5a3107c023-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.113 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.114 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.114 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.114 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.114 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.114 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.114 DEBUG:boto:Data: 2023-12-15T23:07:53.114 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.114 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.114 DEBUG:boto:Params: {} 2023-12-15T23:07:53.114 DEBUG:boto:Token: None 2023-12-15T23:07:53.115 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gnu3Ke3QVroiqIcZn+wWkhhIMyM= 2023-12-15T23:07:53.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gnu3Ke3QVroiqIcZn+wWkhhIMyM=', 'Content-Length': '0'} 2023-12-15T23:07:53.117 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a36167dc12504e5e-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.117 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:53.117 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.117 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.117 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.118 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.118 DEBUG:boto:Method: GET 2023-12-15T23:07:53.118 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.118 DEBUG:boto:Data: 2023-12-15T23:07:53.118 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.118 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.118 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.118 DEBUG:boto:Params: {} 2023-12-15T23:07:53.118 DEBUG:boto:Token: None 2023-12-15T23:07:53.119 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero= 2023-12-15T23:07:53.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero=', 'Content-Length': '0'} 2023-12-15T23:07:53.121 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d5665d791180cb7-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.121 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.121 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.121 DEBUG:boto:path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.122 DEBUG:boto:auth_path=/kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.122 DEBUG:boto:Method: GET 2023-12-15T23:07:53.122 DEBUG:boto:Path: /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.122 DEBUG:boto:Data: 2023-12-15T23:07:53.122 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.122 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.122 DEBUG:boto:Params: {} 2023-12-15T23:07:53.122 DEBUG:boto:Token: None 2023-12-15T23:07:53.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7?versionId=null 2023-12-15T23:07:53.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero= 2023-12-15T23:07:53.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7+tCIUzQ5/uRAwI56zpKWljRero=', 'Content-Length': '0'} 2023-12-15T23:07:53.125 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019a04fa17117051e-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.165 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.166 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.166 DEBUG:boto:path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.166 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.166 DEBUG:boto:Method: GET 2023-12-15T23:07:53.166 DEBUG:boto:Path: /kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.166 DEBUG:boto:Data: 2023-12-15T23:07:53.166 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.166 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.166 DEBUG:boto:Params: {} 2023-12-15T23:07:53.166 DEBUG:boto:Token: None 2023-12-15T23:07:53.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010f14c555fd0243e-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.169 DEBUG:boto:b'kskgfn-37obj71000falseobj72023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.170 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.170 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.170 DEBUG:boto:path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.170 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.170 DEBUG:boto:Method: GET 2023-12-15T23:07:53.170 DEBUG:boto:Path: /kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.170 DEBUG:boto:Data: 2023-12-15T23:07:53.170 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.170 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.171 DEBUG:boto:Params: {} 2023-12-15T23:07:53.171 DEBUG:boto:Token: None 2023-12-15T23:07:53.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa5183f27217f77d-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.217 DEBUG:boto:b'kskgfn-37obj71000falseobj72023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.218 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.218 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.218 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.218 DEBUG:boto:Path: /kskgfn-37/obj7 2023-12-15T23:07:53.218 DEBUG:boto:Data: 2023-12-15T23:07:53.218 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.218 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.218 DEBUG:boto:Params: {} 2023-12-15T23:07:53.219 DEBUG:boto:Token: None 2023-12-15T23:07:53.219 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7 2023-12-15T23:07:53.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XTM8sF6Q42hr779b3N3KJmuXodA= 2023-12-15T23:07:53.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XTM8sF6Q42hr779b3N3KJmuXodA=', 'Content-Length': '0'} 2023-12-15T23:07:53.221 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3a46999ef93ce81-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.221 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.221 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.221 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.221 DEBUG:boto:Path: /kskgfn-37/obj7 2023-12-15T23:07:53.221 DEBUG:boto:Data: 2023-12-15T23:07:53.222 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.222 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.222 DEBUG:boto:Params: {} 2023-12-15T23:07:53.222 DEBUG:boto:Token: None 2023-12-15T23:07:53.222 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7 2023-12-15T23:07:53.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XTM8sF6Q42hr779b3N3KJmuXodA= 2023-12-15T23:07:53.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XTM8sF6Q42hr779b3N3KJmuXodA=', 'Content-Length': '0'} 2023-12-15T23:07:53.224 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009cf3dc7aa8531917-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:07:53.224 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.225 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.225 DEBUG:boto:Method: GET 2023-12-15T23:07:53.225 DEBUG:boto:Path: /kskgfn-37/obj7 2023-12-15T23:07:53.225 DEBUG:boto:Data: 2023-12-15T23:07:53.225 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.225 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.225 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.225 DEBUG:boto:Params: {} 2023-12-15T23:07:53.225 DEBUG:boto:Token: None 2023-12-15T23:07:53.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7 2023-12-15T23:07:53.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E9vf1KP1UprlfPvGj3XTEj+KFg8= 2023-12-15T23:07:53.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E9vf1KP1UprlfPvGj3XTEj+KFg8=', 'Content-Length': '0'} 2023-12-15T23:07:53.228 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d6347162c131dbd3-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.228 DEBUG:boto:path=/kskgfn-37/obj7 2023-12-15T23:07:53.228 DEBUG:boto:auth_path=/kskgfn-37/obj7 2023-12-15T23:07:53.228 DEBUG:boto:Method: GET 2023-12-15T23:07:53.228 DEBUG:boto:Path: /kskgfn-37/obj7 2023-12-15T23:07:53.228 DEBUG:boto:Data: 2023-12-15T23:07:53.228 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.228 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.229 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.229 DEBUG:boto:Params: {} 2023-12-15T23:07:53.229 DEBUG:boto:Token: None 2023-12-15T23:07:53.229 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj7 2023-12-15T23:07:53.229 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E9vf1KP1UprlfPvGj3XTEj+KFg8= 2023-12-15T23:07:53.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E9vf1KP1UprlfPvGj3XTEj+KFg8=', 'Content-Length': '0'} 2023-12-15T23:07:53.231 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000042ca6d20645c365a-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.274 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.274 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.274 DEBUG:boto:path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.274 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.274 DEBUG:boto:Method: GET 2023-12-15T23:07:53.274 DEBUG:boto:Path: /kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.274 DEBUG:boto:Data: 2023-12-15T23:07:53.274 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.275 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.275 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.275 DEBUG:boto:Params: {} 2023-12-15T23:07:53.275 DEBUG:boto:Token: None 2023-12-15T23:07:53.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d95630ffee00996b-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.277 DEBUG:boto:b'kskgfn-37obj71000falseobj72023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.278 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.278 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.278 DEBUG:boto:path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.278 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.278 DEBUG:boto:Method: GET 2023-12-15T23:07:53.278 DEBUG:boto:Path: /kskgfn-37/?prefix=obj7 2023-12-15T23:07:53.279 DEBUG:boto:Data: 2023-12-15T23:07:53.279 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.279 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.279 DEBUG:boto:Params: {} 2023-12-15T23:07:53.279 DEBUG:boto:Token: None 2023-12-15T23:07:53.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0db91cd5b17c509-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.282 DEBUG:boto:b'kskgfn-37obj71000falseobj72023-12-15T23:07:20.048Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:53.282 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.282 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.282 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.282 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.282 DEBUG:boto:Method: GET 2023-12-15T23:07:53.282 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.283 DEBUG:boto:Data: 2023-12-15T23:07:53.283 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.283 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.283 DEBUG:boto:Params: {} 2023-12-15T23:07:53.283 DEBUG:boto:Token: None 2023-12-15T23:07:53.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0= 2023-12-15T23:07:53.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0=', 'Content-Length': '0'} 2023-12-15T23:07:53.285 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d31e5cea90564453-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.286 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.286 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.286 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.286 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.286 DEBUG:boto:Method: GET 2023-12-15T23:07:53.286 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.286 DEBUG:boto:Data: 2023-12-15T23:07:53.286 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.287 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.287 DEBUG:boto:Params: {} 2023-12-15T23:07:53.287 DEBUG:boto:Token: None 2023-12-15T23:07:53.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0= 2023-12-15T23:07:53.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0=', 'Content-Length': '0'} 2023-12-15T23:07:53.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b0bfaa122b7121b0-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.333 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.334 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.334 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.334 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.334 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.334 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.334 DEBUG:boto:Data: 2023-12-15T23:07:53.334 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.334 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.334 DEBUG:boto:Params: {} 2023-12-15T23:07:53.334 DEBUG:boto:Token: None 2023-12-15T23:07:53.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zg9xdWIj8q7rHS24OQoF4DlrdaA= 2023-12-15T23:07:53.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zg9xdWIj8q7rHS24OQoF4DlrdaA=', 'Content-Length': '0'} 2023-12-15T23:07:53.337 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004eb314bc6361cb4f-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.337 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.338 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.338 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.338 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.338 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.338 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.338 DEBUG:boto:Data: 2023-12-15T23:07:53.338 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.338 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.338 DEBUG:boto:Params: {} 2023-12-15T23:07:53.339 DEBUG:boto:Token: None 2023-12-15T23:07:53.339 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zg9xdWIj8q7rHS24OQoF4DlrdaA= 2023-12-15T23:07:53.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zg9xdWIj8q7rHS24OQoF4DlrdaA=', 'Content-Length': '0'} 2023-12-15T23:07:53.341 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000192a327c5e08a8f3-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:53.342 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.342 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.342 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.342 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.342 DEBUG:boto:Method: GET 2023-12-15T23:07:53.342 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.342 DEBUG:boto:Data: 2023-12-15T23:07:53.342 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.342 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.342 DEBUG:boto:Params: {} 2023-12-15T23:07:53.343 DEBUG:boto:Token: None 2023-12-15T23:07:53.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0= 2023-12-15T23:07:53.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0=', 'Content-Length': '0'} 2023-12-15T23:07:53.345 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000de959d5ae6c8821b-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.345 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.345 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.346 DEBUG:boto:path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.346 DEBUG:boto:auth_path=/kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.346 DEBUG:boto:Method: GET 2023-12-15T23:07:53.346 DEBUG:boto:Path: /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.346 DEBUG:boto:Data: 2023-12-15T23:07:53.346 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.346 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.346 DEBUG:boto:Params: {} 2023-12-15T23:07:53.346 DEBUG:boto:Token: None 2023-12-15T23:07:53.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8?versionId=null 2023-12-15T23:07:53.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0= 2023-12-15T23:07:53.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yT19Ra5LeJdwxjK+hK3bIVONmj0=', 'Content-Length': '0'} 2023-12-15T23:07:53.349 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002e9f33e4f193e250-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.389 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.390 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.390 DEBUG:boto:path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.390 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.390 DEBUG:boto:Method: GET 2023-12-15T23:07:53.390 DEBUG:boto:Path: /kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.390 DEBUG:boto:Data: 2023-12-15T23:07:53.390 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.390 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.390 DEBUG:boto:Params: {} 2023-12-15T23:07:53.391 DEBUG:boto:Token: None 2023-12-15T23:07:53.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b46a7618a13a44f-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.393 DEBUG:boto:b'kskgfn-37obj81000falseobj82023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.394 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.394 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.394 DEBUG:boto:path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.394 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.394 DEBUG:boto:Method: GET 2023-12-15T23:07:53.394 DEBUG:boto:Path: /kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.394 DEBUG:boto:Data: 2023-12-15T23:07:53.394 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.395 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.395 DEBUG:boto:Params: {} 2023-12-15T23:07:53.395 DEBUG:boto:Token: None 2023-12-15T23:07:53.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8839820ece64b1d-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.398 DEBUG:boto:b'kskgfn-37obj81000falseobj82023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.398 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.398 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.398 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.398 DEBUG:boto:Path: /kskgfn-37/obj8 2023-12-15T23:07:53.398 DEBUG:boto:Data: 2023-12-15T23:07:53.398 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.399 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.399 DEBUG:boto:Params: {} 2023-12-15T23:07:53.399 DEBUG:boto:Token: None 2023-12-15T23:07:53.399 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8 2023-12-15T23:07:53.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3jZDX2joZ7ThwbkyILI0i6NhQ7o= 2023-12-15T23:07:53.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3jZDX2joZ7ThwbkyILI0i6NhQ7o=', 'Content-Length': '0'} 2023-12-15T23:07:53.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000543e6deecc4e7118-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.401 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.401 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.402 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.402 DEBUG:boto:Path: /kskgfn-37/obj8 2023-12-15T23:07:53.402 DEBUG:boto:Data: 2023-12-15T23:07:53.402 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.402 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.402 DEBUG:boto:Params: {} 2023-12-15T23:07:53.402 DEBUG:boto:Token: None 2023-12-15T23:07:53.402 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8 2023-12-15T23:07:53.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3jZDX2joZ7ThwbkyILI0i6NhQ7o= 2023-12-15T23:07:53.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3jZDX2joZ7ThwbkyILI0i6NhQ7o=', 'Content-Length': '0'} 2023-12-15T23:07:53.404 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000638e35698c721b5b-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:07:53.405 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.405 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.405 DEBUG:boto:Method: GET 2023-12-15T23:07:53.405 DEBUG:boto:Path: /kskgfn-37/obj8 2023-12-15T23:07:53.405 DEBUG:boto:Data: 2023-12-15T23:07:53.405 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.405 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.406 DEBUG:boto:Params: {} 2023-12-15T23:07:53.406 DEBUG:boto:Token: None 2023-12-15T23:07:53.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8 2023-12-15T23:07:53.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIDp9Vv4jaei7dIxr9SU1WjcYns= 2023-12-15T23:07:53.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIDp9Vv4jaei7dIxr9SU1WjcYns=', 'Content-Length': '0'} 2023-12-15T23:07:53.408 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d425faa6424111ba-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.408 DEBUG:boto:path=/kskgfn-37/obj8 2023-12-15T23:07:53.408 DEBUG:boto:auth_path=/kskgfn-37/obj8 2023-12-15T23:07:53.408 DEBUG:boto:Method: GET 2023-12-15T23:07:53.409 DEBUG:boto:Path: /kskgfn-37/obj8 2023-12-15T23:07:53.409 DEBUG:boto:Data: 2023-12-15T23:07:53.409 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.409 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.409 DEBUG:boto:Params: {} 2023-12-15T23:07:53.409 DEBUG:boto:Token: None 2023-12-15T23:07:53.409 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/obj8 2023-12-15T23:07:53.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIDp9Vv4jaei7dIxr9SU1WjcYns= 2023-12-15T23:07:53.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIDp9Vv4jaei7dIxr9SU1WjcYns=', 'Content-Length': '0'} 2023-12-15T23:07:53.412 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-37:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000038a436cc6784824-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.453 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.454 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.454 DEBUG:boto:path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.454 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.454 DEBUG:boto:Method: GET 2023-12-15T23:07:53.454 DEBUG:boto:Path: /kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.454 DEBUG:boto:Data: 2023-12-15T23:07:53.454 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.454 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.454 DEBUG:boto:Params: {} 2023-12-15T23:07:53.455 DEBUG:boto:Token: None 2023-12-15T23:07:53.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.457 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f85cfc736013e4c7-00657cdc49-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.457 DEBUG:boto:b'kskgfn-37obj81000falseobj82023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.458 DEBUG:boto:path=/kskgfn-37/ 2023-12-15T23:07:53.458 DEBUG:boto:auth_path=/kskgfn-37/ 2023-12-15T23:07:53.458 DEBUG:boto:path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.458 DEBUG:boto:auth_path=/kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.458 DEBUG:boto:Method: GET 2023-12-15T23:07:53.458 DEBUG:boto:Path: /kskgfn-37/?prefix=obj8 2023-12-15T23:07:53.458 DEBUG:boto:Data: 2023-12-15T23:07:53.458 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.459 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.459 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.459 DEBUG:boto:Params: {} 2023-12-15T23:07:53.459 DEBUG:boto:Token: None 2023-12-15T23:07:53.459 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-37/ 2023-12-15T23:07:53.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs= 2023-12-15T23:07:53.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVevjkFD39wYUMtBR+eMUFQJAZs=', 'Content-Length': '0'} 2023-12-15T23:07:53.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000507b50a9ddeda84a-00657cdc49-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.462 DEBUG:boto:b'kskgfn-37obj81000falseobj82023-12-15T23:07:20.057Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:53.462 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-37 zones={test-zone2, test-zone1} 2023-12-15T23:07:53.462 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T23:07:53.462 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.463 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:53.515 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:53.516 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:53.572 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000005145","last_update":"2023-12-15T23:07:19.892107Z"},{"marker":"00000000000000000000:00000000000000004302","last_update":"2023-12-15T23:07:41.378166Z"},{"marker":"00000000000000000000:00000000000000003174","last_update":"2023-12-15T23:07:41.380159Z"},{"marker":"00000000000000000000:00000000000000006828","last_update":"2023-12-15T23:07:41.381968Z"}] 2023-12-15T23:07:53.572 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000005145', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000003174', 3: '00000000000000000000:00000000000000006828'} 2023-12-15T23:07:53.572 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:07:53.572 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.572 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:53.627 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:53.627 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:53.676 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005145","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:19.892107Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.378166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003174","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.380159Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006828","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.381968Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:53Z"} 2023-12-15T23:07:53.676 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005145","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:19.892107Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.378166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003174","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.380159Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006828","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.381968Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:07:53Z"} 2023-12-15T23:07:53.676 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005145', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:19.892107Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004302', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.378166Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003174', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.380159Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006828', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.381968Z'}}] 2023-12-15T23:07:53.677 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000005145', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000003174', 3: '00000000000000000000:00000000000000006828'} 2023-12-15T23:07:53.677 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000005145', 1: '00000000000000000000:00000000000000004302', 2: '00000000000000000000:00000000000000003174', 3: '00000000000000000000:00000000000000006828'} 2023-12-15T23:07:53.677 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:07:53.677 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T23:07:53.677 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.677 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:53.723 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:53.723 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:53.774 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000003320","last_update":"2023-12-15T23:07:41.393959Z"},{"marker":"00000000000000000000:00000000000000003179","last_update":"2023-12-15T23:07:41.395872Z"},{"marker":"00000000000000000000:00000000000000002898","last_update":"2023-12-15T23:07:41.397617Z"},{"marker":"00000000000000000000:00000000000000005146","last_update":"2023-12-15T23:07:41.399322Z"}] 2023-12-15T23:07:53.774 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000003320', 1: '00000000000000000000:00000000000000003179', 2: '00000000000000000000:00000000000000002898', 3: '00000000000000000000:00000000000000005146'} 2023-12-15T23:07:53.774 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:07:53.774 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:53.775 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:53.872 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003320","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.393959Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003179","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.395872Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002898","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:07:41.397617Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005146","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.399322Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:07:53Z"} 2023-12-15T23:07:53.872 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003320","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.393959Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003179","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.395872Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002898","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:07:41.397617Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005146","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:07:41.399322Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:07:53Z"} 2023-12-15T23:07:53.872 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003320', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.393959Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003179', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.395872Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002898', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.397617Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005146', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:07:41.399322Z'}}] 2023-12-15T23:07:53.872 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003320', 1: '00000000000000000000:00000000000000003179', 2: '00000000000000000000:00000000000000002898', 3: '00000000000000000000:00000000000000005146'} 2023-12-15T23:07:53.872 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000003320', 1: '00000000000000000000:00000000000000003179', 2: '00000000000000000000:00000000000000002898', 3: '00000000000000000000:00000000000000005146'} 2023-12-15T23:07:53.873 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:07:53.873 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2023-12-15T23:07:53.874 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-38 2023-12-15T23:07:53.874 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:53.874 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:53.874 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.875 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:53.875 DEBUG:boto:Data: 2023-12-15T23:07:53.875 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.875 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.875 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.875 DEBUG:boto:Params: {} 2023-12-15T23:07:53.875 DEBUG:boto:Token: None 2023-12-15T23:07:53.875 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/ 2023-12-15T23:07:53.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qxr/5dfhRS0TZEsa2XCGzLQrJ6A= 2023-12-15T23:07:53.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qxr/5dfhRS0TZEsa2XCGzLQrJ6A=', 'Content-Length': '0'} 2023-12-15T23:07:53.892 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ea0baba8a03a9a69-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.892 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-39 2023-12-15T23:07:53.892 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:07:53.892 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:07:53.892 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.892 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:07:53.893 DEBUG:boto:Data: 2023-12-15T23:07:53.893 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:53.893 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.893 DEBUG:boto:Params: {} 2023-12-15T23:07:53.893 DEBUG:boto:Token: None 2023-12-15T23:07:53.893 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-39/ 2023-12-15T23:07:53.893 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JlXZ34DsfWDopgH2CnGAl6lxvNI= 2023-12-15T23:07:53.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JlXZ34DsfWDopgH2CnGAl6lxvNI=', 'Content-Length': '0'} 2023-12-15T23:07:53.922 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cf16ee3f988ec1c3-00657cdc49-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.922 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:53.922 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:53.922 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.922 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:53.922 DEBUG:boto:Data: 2023-12-15T23:07:53.922 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.922 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.923 DEBUG:boto:Params: {} 2023-12-15T23:07:53.923 DEBUG:boto:Token: None 2023-12-15T23:07:53.923 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/ 2023-12-15T23:07:53.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY= 2023-12-15T23:07:53.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY=', 'Content-Length': '0'} 2023-12-15T23:07:53.925 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002585c9554eb35b5a-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.926 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:53.926 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:53.926 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.926 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:07:53.926 DEBUG:boto:Data: 2023-12-15T23:07:53.926 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:53.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.926 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.926 DEBUG:boto:Params: {} 2023-12-15T23:07:53.926 DEBUG:boto:Token: None 2023-12-15T23:07:53.927 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/obj1 2023-12-15T23:07:53.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+MayHtW+XUEBDBuoJblhJ8Mr8wI= 2023-12-15T23:07:53.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+MayHtW+XUEBDBuoJblhJ8Mr8wI='} 2023-12-15T23:07:53.933 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003c9f54738e468703-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.933 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:53.933 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:53.933 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.933 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:53.933 DEBUG:boto:Data: 2023-12-15T23:07:53.933 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.934 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.934 DEBUG:boto:Params: {} 2023-12-15T23:07:53.934 DEBUG:boto:Token: None 2023-12-15T23:07:53.934 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/ 2023-12-15T23:07:53.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY= 2023-12-15T23:07:53.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY=', 'Content-Length': '0'} 2023-12-15T23:07:53.936 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7c48f1cf410a331-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.936 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:53.936 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:53.936 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.937 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:07:53.937 DEBUG:boto:Data: 2023-12-15T23:07:53.937 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:53.937 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.937 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.937 DEBUG:boto:Params: {} 2023-12-15T23:07:53.937 DEBUG:boto:Token: None 2023-12-15T23:07:53.937 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/obj2 2023-12-15T23:07:53.937 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yGtQ1qLQ54JXzYTcm9wvcEx3FvI= 2023-12-15T23:07:53.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yGtQ1qLQ54JXzYTcm9wvcEx3FvI='} 2023-12-15T23:07:53.982 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008727277a1a872d70-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.982 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:53.982 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:53.982 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.982 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:53.982 DEBUG:boto:Data: 2023-12-15T23:07:53.982 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.982 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.982 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.982 DEBUG:boto:Params: {} 2023-12-15T23:07:53.983 DEBUG:boto:Token: None 2023-12-15T23:07:53.983 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/ 2023-12-15T23:07:53.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY= 2023-12-15T23:07:53.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY=', 'Content-Length': '0'} 2023-12-15T23:07:53.985 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000143baa5d616d6dee-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.985 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:53.985 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:53.985 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.986 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:07:53.986 DEBUG:boto:Data: 2023-12-15T23:07:53.986 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:53.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.986 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.986 DEBUG:boto:Params: {} 2023-12-15T23:07:53.986 DEBUG:boto:Token: None 2023-12-15T23:07:53.986 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/obj3 2023-12-15T23:07:53.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aN81i0XzSVW6r4/zq5d7iDY8gQA= 2023-12-15T23:07:53.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aN81i0XzSVW6r4/zq5d7iDY8gQA='} 2023-12-15T23:07:53.993 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a0f7b6ff4a421502-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.993 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:53.993 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:53.993 DEBUG:boto:Method: HEAD 2023-12-15T23:07:53.993 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:53.993 DEBUG:boto:Data: 2023-12-15T23:07:53.993 DEBUG:boto:Headers: {} 2023-12-15T23:07:53.993 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.993 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.993 DEBUG:boto:Params: {} 2023-12-15T23:07:53.994 DEBUG:boto:Token: None 2023-12-15T23:07:53.994 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/ 2023-12-15T23:07:53.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY= 2023-12-15T23:07:53.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pi+Oa5HevpWqmXmGhIrMEvml2qY=', 'Content-Length': '0'} 2023-12-15T23:07:53.996 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005b3bb5ba6d425b96-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:53.996 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:07:53.996 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:07:53.996 DEBUG:boto:Method: PUT 2023-12-15T23:07:53.997 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:07:53.997 DEBUG:boto:Data: 2023-12-15T23:07:53.997 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:53.997 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:53.997 DEBUG:boto:Port: 8000 2023-12-15T23:07:53.997 DEBUG:boto:Params: {} 2023-12-15T23:07:53.997 DEBUG:boto:Token: None 2023-12-15T23:07:53.997 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:53 GMT /kskgfn-38/obj4 2023-12-15T23:07:53.997 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2/2/VRtV+S+uCjsug/1CUV8lH0= 2023-12-15T23:07:53.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:53 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2/2/VRtV+S+uCjsug/1CUV8lH0='} 2023-12-15T23:07:54.003 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007d97b0926d35caea-00657cdc49-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.003 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:07:54.003 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:07:54.003 DEBUG:boto:Method: HEAD 2023-12-15T23:07:54.003 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:07:54.003 DEBUG:boto:Data: 2023-12-15T23:07:54.003 DEBUG:boto:Headers: {} 2023-12-15T23:07:54.004 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.004 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.004 DEBUG:boto:Params: {} 2023-12-15T23:07:54.004 DEBUG:boto:Token: None 2023-12-15T23:07:54.004 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/ 2023-12-15T23:07:54.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0= 2023-12-15T23:07:54.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0=', 'Content-Length': '0'} 2023-12-15T23:07:54.006 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f4d93e63f1c15e3-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.006 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:07:54.006 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:07:54.007 DEBUG:boto:Method: PUT 2023-12-15T23:07:54.007 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:07:54.007 DEBUG:boto:Data: 2023-12-15T23:07:54.007 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:54.007 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.007 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.007 DEBUG:boto:Params: {} 2023-12-15T23:07:54.007 DEBUG:boto:Token: None 2023-12-15T23:07:54.007 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/obj1 2023-12-15T23:07:54.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vEB5fKtfU/ZonRoErYyuj1LInAg= 2023-12-15T23:07:54.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vEB5fKtfU/ZonRoErYyuj1LInAg='} 2023-12-15T23:07:54.049 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002c5409ded158a83a-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.050 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:07:54.050 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:07:54.050 DEBUG:boto:Method: HEAD 2023-12-15T23:07:54.050 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:07:54.050 DEBUG:boto:Data: 2023-12-15T23:07:54.050 DEBUG:boto:Headers: {} 2023-12-15T23:07:54.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.050 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.050 DEBUG:boto:Params: {} 2023-12-15T23:07:54.051 DEBUG:boto:Token: None 2023-12-15T23:07:54.051 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/ 2023-12-15T23:07:54.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0= 2023-12-15T23:07:54.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0=', 'Content-Length': '0'} 2023-12-15T23:07:54.053 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009122d1afc5600d4a-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.053 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:07:54.053 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:07:54.054 DEBUG:boto:Method: PUT 2023-12-15T23:07:54.054 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:07:54.054 DEBUG:boto:Data: 2023-12-15T23:07:54.054 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:54.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.054 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.054 DEBUG:boto:Params: {} 2023-12-15T23:07:54.054 DEBUG:boto:Token: None 2023-12-15T23:07:54.054 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/obj2 2023-12-15T23:07:54.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qcr2PxzCoU23RNk5R6SNtQ/3/jY= 2023-12-15T23:07:54.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qcr2PxzCoU23RNk5R6SNtQ/3/jY='} 2023-12-15T23:07:54.061 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000077962efceb76cf0a-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.061 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:07:54.061 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:07:54.061 DEBUG:boto:Method: HEAD 2023-12-15T23:07:54.061 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:07:54.061 DEBUG:boto:Data: 2023-12-15T23:07:54.061 DEBUG:boto:Headers: {} 2023-12-15T23:07:54.061 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.062 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.062 DEBUG:boto:Params: {} 2023-12-15T23:07:54.062 DEBUG:boto:Token: None 2023-12-15T23:07:54.062 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/ 2023-12-15T23:07:54.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0= 2023-12-15T23:07:54.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0=', 'Content-Length': '0'} 2023-12-15T23:07:54.064 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbb59172cbed0409-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.064 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:07:54.064 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:07:54.064 DEBUG:boto:Method: PUT 2023-12-15T23:07:54.064 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:07:54.064 DEBUG:boto:Data: 2023-12-15T23:07:54.064 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:54.065 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.065 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.065 DEBUG:boto:Params: {} 2023-12-15T23:07:54.065 DEBUG:boto:Token: None 2023-12-15T23:07:54.065 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/obj3 2023-12-15T23:07:54.065 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mi0qUNl6GJpj0JG+ChrjqIeeHiY= 2023-12-15T23:07:54.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mi0qUNl6GJpj0JG+ChrjqIeeHiY='} 2023-12-15T23:07:54.071 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000020f43d3f81f1d7f4-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.071 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:07:54.071 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:07:54.071 DEBUG:boto:Method: HEAD 2023-12-15T23:07:54.071 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:07:54.071 DEBUG:boto:Data: 2023-12-15T23:07:54.071 DEBUG:boto:Headers: {} 2023-12-15T23:07:54.071 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.071 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.072 DEBUG:boto:Params: {} 2023-12-15T23:07:54.072 DEBUG:boto:Token: None 2023-12-15T23:07:54.072 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/ 2023-12-15T23:07:54.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0= 2023-12-15T23:07:54.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QGPAsjpxEpLlyYyvGaD8vvhjhD0=', 'Content-Length': '0'} 2023-12-15T23:07:54.074 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f18b76b830365e5-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.074 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:07:54.074 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:07:54.074 DEBUG:boto:Method: PUT 2023-12-15T23:07:54.074 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:07:54.074 DEBUG:boto:Data: 2023-12-15T23:07:54.074 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:07:54.075 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:54.075 DEBUG:boto:Port: 8000 2023-12-15T23:07:54.075 DEBUG:boto:Params: {} 2023-12-15T23:07:54.075 DEBUG:boto:Token: None 2023-12-15T23:07:54.075 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:07:54 GMT /kskgfn-39/obj4 2023-12-15T23:07:54.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b7kABXfnH1qy/rNHSM2CEcE+I3c= 2023-12-15T23:07:54.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:07:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b7kABXfnH1qy/rNHSM2CEcE+I3c='} 2023-12-15T23:07:54.122 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c900b83d788018f1-00657cdc4a-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:54.122 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:54.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:54.122 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:54.168 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:54.168 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:54.200 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:07:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681673.908888_315.1","last_update":"2023-12-15T23:07:53.908888Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:07:54.215 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681673.908888_315.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:54.215 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:07:54.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:54.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:07:54.215 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:07:54.261 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:54.261 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:54.291 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:54.290+0000 7f2049d25800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:07:54.292 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:54.291+0000 7f2049d25800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:07:54.307 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681673.908888_315.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:53.908888Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:07:54Z"} 2023-12-15T23:07:54.307 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681673.908888_315.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:53.908888Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:07:54Z"} 2023-12-15T23:07:54.307 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681673.908888_315.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:07:53.908888Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:07:54.307 DEBUG:rgw_multi.tests:log_status={0: '1_1702681673.908888_315.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:54.307 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681673.908888_315.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:07:54.307 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:07:54.307 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-38 2023-12-15T23:07:54.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:54.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:54.308 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:54.360 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:54.361 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:54.397 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:54.397+0000 7f3056d37800 1 waiting to reach incremental sync.. 2023-12-15T23:07:59.400 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:59.399+0000 7f3056d37800 1 bucket sync caught up with source: 2023-12-15T23:07:59.400 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.31.6, , 00000000001.29.6, , 00000000001.16.6, , , 00000000001.114.6, , , ] 2023-12-15T23:07:59.400 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.31.6, , 00000000001.29.6, , 00000000001.16.6, , , 00000000001.114.6, , , ] 2023-12-15T23:07:59.400 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:07:59.399+0000 7f3056d37800 0 bucket checkpoint complete 2023-12-15T23:07:59.418 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-38 2023-12-15T23:07:59.419 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:59.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:07:59.419 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:07:59.484 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:07:59.484 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:07:59.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:59.527+0000 7f5111328800 1 bucket sync caught up with source: 2023-12-15T23:07:59.528 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.94.6, , 00000000001.92.6, , 00000000001.40.6, , , 00000000001.111.6, , , ] 2023-12-15T23:07:59.528 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.94.6, , 00000000001.92.6, , 00000000001.40.6, , , 00000000001.111.6, , , ] 2023-12-15T23:07:59.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:07:59.527+0000 7f5111328800 0 bucket checkpoint complete 2023-12-15T23:07:59.544 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-38 zones={test-zone2, test-zone1} 2023-12-15T23:07:59.544 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.544 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.544 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.544 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:59.544 DEBUG:boto:Data: 2023-12-15T23:07:59.544 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.544 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.545 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.545 DEBUG:boto:Params: {} 2023-12-15T23:07:59.545 DEBUG:boto:Token: None 2023-12-15T23:07:59.545 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y4/Zyyxa+jhZniHm2wh46jJuoBs= 2023-12-15T23:07:59.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y4/Zyyxa+jhZniHm2wh46jJuoBs=', 'Content-Length': '0'} 2023-12-15T23:07:59.548 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b427eb1980dac7da-00657cdc4f-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.548 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.548 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.548 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.548 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:07:59.548 DEBUG:boto:Data: 2023-12-15T23:07:59.548 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.548 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.548 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.549 DEBUG:boto:Params: {} 2023-12-15T23:07:59.549 DEBUG:boto:Token: None 2023-12-15T23:07:59.549 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.549 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y4/Zyyxa+jhZniHm2wh46jJuoBs= 2023-12-15T23:07:59.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y4/Zyyxa+jhZniHm2wh46jJuoBs=', 'Content-Length': '0'} 2023-12-15T23:07:59.551 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f9db05b14d3d4c3b-00657cdc4f-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.551 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:07:59.551 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.551 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.552 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.552 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.552 DEBUG:boto:Method: GET 2023-12-15T23:07:59.552 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.552 DEBUG:boto:Data: 2023-12-15T23:07:59.552 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.552 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.552 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.552 DEBUG:boto:Params: {} 2023-12-15T23:07:59.552 DEBUG:boto:Token: None 2023-12-15T23:07:59.552 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/?versions 2023-12-15T23:07:59.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE= 2023-12-15T23:07:59.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE=', 'Content-Length': '0'} 2023-12-15T23:07:59.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e39d96996fad9c4-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.555 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:59.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:59.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:59.556 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:59.556 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:07:59.557 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.557 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.557 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.557 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.557 DEBUG:boto:Method: GET 2023-12-15T23:07:59.557 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.557 DEBUG:boto:Data: 2023-12-15T23:07:59.557 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.557 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.557 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.557 DEBUG:boto:Params: {} 2023-12-15T23:07:59.558 DEBUG:boto:Token: None 2023-12-15T23:07:59.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/?versions 2023-12-15T23:07:59.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE= 2023-12-15T23:07:59.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE=', 'Content-Length': '0'} 2023-12-15T23:07:59.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007afb93db4963d657-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.560 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:07:59.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:07:59.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:07:59.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:07:59.561 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.561 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.561 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.561 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.561 DEBUG:boto:Method: GET 2023-12-15T23:07:59.561 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.562 DEBUG:boto:Data: 2023-12-15T23:07:59.562 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.562 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.562 DEBUG:boto:Params: {} 2023-12-15T23:07:59.562 DEBUG:boto:Token: None 2023-12-15T23:07:59.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/?versions 2023-12-15T23:07:59.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE= 2023-12-15T23:07:59.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE=', 'Content-Length': '0'} 2023-12-15T23:07:59.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a225a2aa213747b-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.565 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.566 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.566 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.566 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.566 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.566 DEBUG:boto:Method: GET 2023-12-15T23:07:59.566 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:07:59.566 DEBUG:boto:Data: 2023-12-15T23:07:59.566 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.566 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.566 DEBUG:boto:Params: {} 2023-12-15T23:07:59.567 DEBUG:boto:Token: None 2023-12-15T23:07:59.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/?versions 2023-12-15T23:07:59.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE= 2023-12-15T23:07:59.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r2syd/G6ddNH4YbxrVbIwLhAJqE=', 'Content-Length': '0'} 2023-12-15T23:07:59.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca241dee69c51246-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.569 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:59.572 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.572 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.572 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.572 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.573 DEBUG:boto:Method: GET 2023-12-15T23:07:59.573 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.573 DEBUG:boto:Data: 2023-12-15T23:07:59.573 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.573 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.573 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.573 DEBUG:boto:Params: {} 2023-12-15T23:07:59.574 DEBUG:boto:Token: None 2023-12-15T23:07:59.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y= 2023-12-15T23:07:59.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y=', 'Content-Length': '0'} 2023-12-15T23:07:59.576 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000063aa2262dec80671-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.576 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.576 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.577 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.577 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.577 DEBUG:boto:Method: GET 2023-12-15T23:07:59.577 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.577 DEBUG:boto:Data: 2023-12-15T23:07:59.577 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.577 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.577 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.577 DEBUG:boto:Params: {} 2023-12-15T23:07:59.577 DEBUG:boto:Token: None 2023-12-15T23:07:59.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y= 2023-12-15T23:07:59.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y=', 'Content-Length': '0'} 2023-12-15T23:07:59.580 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002e4ddcf4ba93aef7-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.580 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.580 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.580 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.580 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.580 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.580 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.580 DEBUG:boto:Data: 2023-12-15T23:07:59.581 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.581 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.581 DEBUG:boto:Params: {} 2023-12-15T23:07:59.581 DEBUG:boto:Token: None 2023-12-15T23:07:59.581 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.581 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cEpdbPQyePyWEptgUsebfzpZRbg= 2023-12-15T23:07:59.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cEpdbPQyePyWEptgUsebfzpZRbg=', 'Content-Length': '0'} 2023-12-15T23:07:59.583 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ae5cf730f9604734-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.583 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.583 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.583 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.584 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.584 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.584 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.584 DEBUG:boto:Data: 2023-12-15T23:07:59.584 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.584 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.584 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.584 DEBUG:boto:Params: {} 2023-12-15T23:07:59.584 DEBUG:boto:Token: None 2023-12-15T23:07:59.584 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cEpdbPQyePyWEptgUsebfzpZRbg= 2023-12-15T23:07:59.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cEpdbPQyePyWEptgUsebfzpZRbg=', 'Content-Length': '0'} 2023-12-15T23:07:59.586 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007547ff00be4ef9d5-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:59.587 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.587 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.587 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.587 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.587 DEBUG:boto:Method: GET 2023-12-15T23:07:59.587 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.587 DEBUG:boto:Data: 2023-12-15T23:07:59.587 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.587 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.587 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.587 DEBUG:boto:Params: {} 2023-12-15T23:07:59.588 DEBUG:boto:Token: None 2023-12-15T23:07:59.588 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.588 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y= 2023-12-15T23:07:59.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y=', 'Content-Length': '0'} 2023-12-15T23:07:59.590 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000733464df9cc54584-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.590 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.590 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.590 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.590 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.590 DEBUG:boto:Method: GET 2023-12-15T23:07:59.590 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.591 DEBUG:boto:Data: 2023-12-15T23:07:59.591 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.591 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.591 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.591 DEBUG:boto:Params: {} 2023-12-15T23:07:59.591 DEBUG:boto:Token: None 2023-12-15T23:07:59.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:07:59.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y= 2023-12-15T23:07:59.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRatrPR7GkX4kly5OKoMhOo1c7Y=', 'Content-Length': '0'} 2023-12-15T23:07:59.593 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000996d65b654ae332c-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.634 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.634 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.634 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.634 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.634 DEBUG:boto:Method: GET 2023-12-15T23:07:59.634 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.634 DEBUG:boto:Data: 2023-12-15T23:07:59.634 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.634 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.635 DEBUG:boto:Params: {} 2023-12-15T23:07:59.635 DEBUG:boto:Token: None 2023-12-15T23:07:59.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.637 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005a807721e61c467-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.638 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.638 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.638 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.638 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.638 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.638 DEBUG:boto:Method: GET 2023-12-15T23:07:59.639 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.639 DEBUG:boto:Data: 2023-12-15T23:07:59.639 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.639 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.639 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.639 DEBUG:boto:Params: {} 2023-12-15T23:07:59.639 DEBUG:boto:Token: None 2023-12-15T23:07:59.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.641 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073d1abd6c58c7031-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.642 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.642 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.642 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.642 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.642 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:07:59.642 DEBUG:boto:Data: 2023-12-15T23:07:59.642 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.643 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.643 DEBUG:boto:Params: {} 2023-12-15T23:07:59.643 DEBUG:boto:Token: None 2023-12-15T23:07:59.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1 2023-12-15T23:07:59.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XJpww4psOHos5jEcUAkA9Q0IrU= 2023-12-15T23:07:59.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XJpww4psOHos5jEcUAkA9Q0IrU=', 'Content-Length': '0'} 2023-12-15T23:07:59.645 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000039000eac0186ff7b-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.645 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.645 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.645 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.646 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:07:59.646 DEBUG:boto:Data: 2023-12-15T23:07:59.646 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.646 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.646 DEBUG:boto:Params: {} 2023-12-15T23:07:59.646 DEBUG:boto:Token: None 2023-12-15T23:07:59.646 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1 2023-12-15T23:07:59.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XJpww4psOHos5jEcUAkA9Q0IrU= 2023-12-15T23:07:59.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XJpww4psOHos5jEcUAkA9Q0IrU=', 'Content-Length': '0'} 2023-12-15T23:07:59.648 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005b041077e39b8ea4-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:07:59.649 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.649 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.649 DEBUG:boto:Method: GET 2023-12-15T23:07:59.649 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:07:59.649 DEBUG:boto:Data: 2023-12-15T23:07:59.649 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.649 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.649 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.649 DEBUG:boto:Params: {} 2023-12-15T23:07:59.649 DEBUG:boto:Token: None 2023-12-15T23:07:59.650 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1 2023-12-15T23:07:59.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KOn/j1sEpoanxfThRMNmx41a6vU= 2023-12-15T23:07:59.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KOn/j1sEpoanxfThRMNmx41a6vU=', 'Content-Length': '0'} 2023-12-15T23:07:59.651 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000015acb5d424f86329-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.693 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:07:59.694 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:07:59.694 DEBUG:boto:Method: GET 2023-12-15T23:07:59.694 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:07:59.694 DEBUG:boto:Data: 2023-12-15T23:07:59.694 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.694 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.694 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.694 DEBUG:boto:Params: {} 2023-12-15T23:07:59.694 DEBUG:boto:Token: None 2023-12-15T23:07:59.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj1 2023-12-15T23:07:59.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KOn/j1sEpoanxfThRMNmx41a6vU= 2023-12-15T23:07:59.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KOn/j1sEpoanxfThRMNmx41a6vU=', 'Content-Length': '0'} 2023-12-15T23:07:59.696 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cf9ee7b154823343-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.697 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.697 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.697 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.697 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.697 DEBUG:boto:Method: GET 2023-12-15T23:07:59.697 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.697 DEBUG:boto:Data: 2023-12-15T23:07:59.697 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.697 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.698 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.698 DEBUG:boto:Params: {} 2023-12-15T23:07:59.698 DEBUG:boto:Token: None 2023-12-15T23:07:59.698 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c15f2f469ab814b7-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.741 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.742 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.742 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.742 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.742 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.742 DEBUG:boto:Method: GET 2023-12-15T23:07:59.742 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:07:59.742 DEBUG:boto:Data: 2023-12-15T23:07:59.742 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.742 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.743 DEBUG:boto:Params: {} 2023-12-15T23:07:59.743 DEBUG:boto:Token: None 2023-12-15T23:07:59.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005705127b3fedea0e-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.745 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.746 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:59.746 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.746 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.746 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.746 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.746 DEBUG:boto:Method: GET 2023-12-15T23:07:59.746 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.746 DEBUG:boto:Data: 2023-12-15T23:07:59.747 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.747 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.747 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.747 DEBUG:boto:Params: {} 2023-12-15T23:07:59.747 DEBUG:boto:Token: None 2023-12-15T23:07:59.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8= 2023-12-15T23:07:59.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8=', 'Content-Length': '0'} 2023-12-15T23:07:59.749 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f68f6336253b1ea6-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.749 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.750 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.750 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.750 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.750 DEBUG:boto:Method: GET 2023-12-15T23:07:59.750 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.750 DEBUG:boto:Data: 2023-12-15T23:07:59.750 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.750 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.750 DEBUG:boto:Params: {} 2023-12-15T23:07:59.751 DEBUG:boto:Token: None 2023-12-15T23:07:59.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8= 2023-12-15T23:07:59.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8=', 'Content-Length': '0'} 2023-12-15T23:07:59.753 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d161118b3211bb6-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.793 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.794 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.794 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.794 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.794 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.794 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.794 DEBUG:boto:Data: 2023-12-15T23:07:59.794 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.794 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.794 DEBUG:boto:Params: {} 2023-12-15T23:07:59.794 DEBUG:boto:Token: None 2023-12-15T23:07:59.795 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4JIa6uC2BkbvY1DRDq6f6+HlTg= 2023-12-15T23:07:59.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4JIa6uC2BkbvY1DRDq6f6+HlTg=', 'Content-Length': '0'} 2023-12-15T23:07:59.796 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000480b6f502d456d9e-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.797 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.797 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.797 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.797 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.797 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.797 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.797 DEBUG:boto:Data: 2023-12-15T23:07:59.797 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.798 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.798 DEBUG:boto:Params: {} 2023-12-15T23:07:59.798 DEBUG:boto:Token: None 2023-12-15T23:07:59.798 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4JIa6uC2BkbvY1DRDq6f6+HlTg= 2023-12-15T23:07:59.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4JIa6uC2BkbvY1DRDq6f6+HlTg=', 'Content-Length': '0'} 2023-12-15T23:07:59.800 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000056817bc9c3c785b8-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:59.800 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.800 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.800 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.801 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.801 DEBUG:boto:Method: GET 2023-12-15T23:07:59.801 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.801 DEBUG:boto:Data: 2023-12-15T23:07:59.801 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.801 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.801 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.801 DEBUG:boto:Params: {} 2023-12-15T23:07:59.801 DEBUG:boto:Token: None 2023-12-15T23:07:59.801 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8= 2023-12-15T23:07:59.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8=', 'Content-Length': '0'} 2023-12-15T23:07:59.804 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007cd459ccbf57a48b-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.845 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.846 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.846 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.846 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.846 DEBUG:boto:Method: GET 2023-12-15T23:07:59.846 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.846 DEBUG:boto:Data: 2023-12-15T23:07:59.846 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.846 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.846 DEBUG:boto:Params: {} 2023-12-15T23:07:59.846 DEBUG:boto:Token: None 2023-12-15T23:07:59.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:07:59.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8= 2023-12-15T23:07:59.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rELBI6PLMnECVuh1NwXpZkey4i8=', 'Content-Length': '0'} 2023-12-15T23:07:59.848 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c60f2c23041cd9c-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.849 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.849 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.849 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.849 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.849 DEBUG:boto:Method: GET 2023-12-15T23:07:59.849 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.849 DEBUG:boto:Data: 2023-12-15T23:07:59.850 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.850 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.850 DEBUG:boto:Params: {} 2023-12-15T23:07:59.850 DEBUG:boto:Token: None 2023-12-15T23:07:59.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007520c499a0152141-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.853 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.853 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.853 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.854 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.854 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.854 DEBUG:boto:Method: GET 2023-12-15T23:07:59.854 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.854 DEBUG:boto:Data: 2023-12-15T23:07:59.854 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.854 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.854 DEBUG:boto:Params: {} 2023-12-15T23:07:59.854 DEBUG:boto:Token: None 2023-12-15T23:07:59.854 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.857 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d85ef14320eab671-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.857 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.858 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.858 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.858 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.858 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:07:59.858 DEBUG:boto:Data: 2023-12-15T23:07:59.858 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.858 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.858 DEBUG:boto:Params: {} 2023-12-15T23:07:59.858 DEBUG:boto:Token: None 2023-12-15T23:07:59.858 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2 2023-12-15T23:07:59.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:816fzsPEgR/OMTHCleiIWwMZtYQ= 2023-12-15T23:07:59.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:816fzsPEgR/OMTHCleiIWwMZtYQ=', 'Content-Length': '0'} 2023-12-15T23:07:59.861 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019510faacc73640c-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.861 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.861 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.861 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.861 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:07:59.861 DEBUG:boto:Data: 2023-12-15T23:07:59.861 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.861 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.861 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.862 DEBUG:boto:Params: {} 2023-12-15T23:07:59.862 DEBUG:boto:Token: None 2023-12-15T23:07:59.862 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2 2023-12-15T23:07:59.862 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:816fzsPEgR/OMTHCleiIWwMZtYQ= 2023-12-15T23:07:59.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:816fzsPEgR/OMTHCleiIWwMZtYQ=', 'Content-Length': '0'} 2023-12-15T23:07:59.864 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ec9169c2cb2ade83-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:07:59.864 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.864 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.864 DEBUG:boto:Method: GET 2023-12-15T23:07:59.864 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:07:59.865 DEBUG:boto:Data: 2023-12-15T23:07:59.865 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.865 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.865 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.865 DEBUG:boto:Params: {} 2023-12-15T23:07:59.865 DEBUG:boto:Token: None 2023-12-15T23:07:59.865 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2 2023-12-15T23:07:59.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:puneVQGM3cH+g19GVOjuahIMaNI= 2023-12-15T23:07:59.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:puneVQGM3cH+g19GVOjuahIMaNI=', 'Content-Length': '0'} 2023-12-15T23:07:59.867 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c0880a18c480ca8e-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.909 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:07:59.910 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:07:59.910 DEBUG:boto:Method: GET 2023-12-15T23:07:59.910 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:07:59.910 DEBUG:boto:Data: 2023-12-15T23:07:59.910 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.910 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.910 DEBUG:boto:Params: {} 2023-12-15T23:07:59.911 DEBUG:boto:Token: None 2023-12-15T23:07:59.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj2 2023-12-15T23:07:59.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:puneVQGM3cH+g19GVOjuahIMaNI= 2023-12-15T23:07:59.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:puneVQGM3cH+g19GVOjuahIMaNI=', 'Content-Length': '0'} 2023-12-15T23:07:59.913 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a80bd98ea3d6c3e-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.913 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.913 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.913 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.914 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.914 DEBUG:boto:Method: GET 2023-12-15T23:07:59.914 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.914 DEBUG:boto:Data: 2023-12-15T23:07:59.914 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.914 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.914 DEBUG:boto:Params: {} 2023-12-15T23:07:59.915 DEBUG:boto:Token: None 2023-12-15T23:07:59.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa805aaaf7827282-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.965 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.966 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:07:59.966 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:07:59.966 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.966 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.966 DEBUG:boto:Method: GET 2023-12-15T23:07:59.967 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:07:59.967 DEBUG:boto:Data: 2023-12-15T23:07:59.967 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.967 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.967 DEBUG:boto:Params: {} 2023-12-15T23:07:59.967 DEBUG:boto:Token: None 2023-12-15T23:07:59.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/ 2023-12-15T23:07:59.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU= 2023-12-15T23:07:59.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wrnELPRyBdZ6I3cfIoxlNx4fPU=', 'Content-Length': '0'} 2023-12-15T23:07:59.970 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a0aad3e1dbe82ef-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.970 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:07:59.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:59.970 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:59.971 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:59.971 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.971 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.971 DEBUG:boto:Method: GET 2023-12-15T23:07:59.971 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.971 DEBUG:boto:Data: 2023-12-15T23:07:59.971 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.971 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.972 DEBUG:boto:Params: {} 2023-12-15T23:07:59.972 DEBUG:boto:Token: None 2023-12-15T23:07:59.972 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY= 2023-12-15T23:07:59.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY=', 'Content-Length': '0'} 2023-12-15T23:07:59.975 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000026f1e85c8bd52b7b-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.975 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:59.975 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:59.975 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.975 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.975 DEBUG:boto:Method: GET 2023-12-15T23:07:59.975 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.976 DEBUG:boto:Data: 2023-12-15T23:07:59.976 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.976 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.976 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.976 DEBUG:boto:Params: {} 2023-12-15T23:07:59.976 DEBUG:boto:Token: None 2023-12-15T23:07:59.976 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.976 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY= 2023-12-15T23:07:59.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY=', 'Content-Length': '0'} 2023-12-15T23:07:59.978 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b86677ab3cde2469-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.979 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:59.979 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:59.979 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.979 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.979 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.980 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.980 DEBUG:boto:Data: 2023-12-15T23:07:59.980 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.980 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.980 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.980 DEBUG:boto:Params: {} 2023-12-15T23:07:59.980 DEBUG:boto:Token: None 2023-12-15T23:07:59.980 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.980 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:36F3V/vFSVcvAazHvl47/eBv5aU= 2023-12-15T23:07:59.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:36F3V/vFSVcvAazHvl47/eBv5aU=', 'Content-Length': '0'} 2023-12-15T23:07:59.982 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c0bdc0aed07fd11-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.983 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:59.983 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:59.983 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.983 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.983 DEBUG:boto:Method: HEAD 2023-12-15T23:07:59.983 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.983 DEBUG:boto:Data: 2023-12-15T23:07:59.983 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.983 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:07:59.984 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.984 DEBUG:boto:Params: {} 2023-12-15T23:07:59.984 DEBUG:boto:Token: None 2023-12-15T23:07:59.984 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:36F3V/vFSVcvAazHvl47/eBv5aU= 2023-12-15T23:07:59.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:36F3V/vFSVcvAazHvl47/eBv5aU=', 'Content-Length': '0'} 2023-12-15T23:07:59.986 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d634f4bf84902a10-00657cdc4f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:07:59.986 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:07:59.987 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:07:59.987 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:07:59.987 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.987 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.987 DEBUG:boto:Method: GET 2023-12-15T23:07:59.987 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.987 DEBUG:boto:Data: 2023-12-15T23:07:59.987 DEBUG:boto:Headers: {} 2023-12-15T23:07:59.987 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:07:59.987 DEBUG:boto:Port: 8000 2023-12-15T23:07:59.988 DEBUG:boto:Params: {} 2023-12-15T23:07:59.988 DEBUG:boto:Token: None 2023-12-15T23:07:59.988 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:07:59 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:07:59.988 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY= 2023-12-15T23:07:59.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:07:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U2NF8U+V9i5ezJofyOoAv4M8dLY=', 'Content-Length': '0'} 2023-12-15T23:07:59.990 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000603d13a092b478da-00657cdc4f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:07:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.037 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:00.038 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:00.038 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:00.038 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:00.038 DEBUG:boto:Method: GET 2023-12-15T23:08:00.038 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:00.038 DEBUG:boto:Data: 2023-12-15T23:08:00.038 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.038 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.039 DEBUG:boto:Params: {} 2023-12-15T23:08:00.039 DEBUG:boto:Token: None 2023-12-15T23:08:00.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:00.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+RRgy99k8t2NRbOKW3YyCnvQOw= 2023-12-15T23:08:00.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+RRgy99k8t2NRbOKW3YyCnvQOw=', 'Content-Length': '0'} 2023-12-15T23:08:00.041 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aadd5c58aa40b788-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.042 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.042 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.042 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.042 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.042 DEBUG:boto:Method: GET 2023-12-15T23:08:00.042 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.042 DEBUG:boto:Data: 2023-12-15T23:08:00.042 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.043 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.043 DEBUG:boto:Params: {} 2023-12-15T23:08:00.043 DEBUG:boto:Token: None 2023-12-15T23:08:00.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b7f255482dc6c5f-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.046 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.046 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.046 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.046 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.047 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.047 DEBUG:boto:Method: GET 2023-12-15T23:08:00.047 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.047 DEBUG:boto:Data: 2023-12-15T23:08:00.047 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.047 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.047 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.047 DEBUG:boto:Params: {} 2023-12-15T23:08:00.047 DEBUG:boto:Token: None 2023-12-15T23:08:00.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b182a6772b0feec-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.050 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.051 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:00.051 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:00.051 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.051 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:00.051 DEBUG:boto:Data: 2023-12-15T23:08:00.051 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.051 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.051 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.051 DEBUG:boto:Params: {} 2023-12-15T23:08:00.052 DEBUG:boto:Token: None 2023-12-15T23:08:00.052 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj3 2023-12-15T23:08:00.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:smNAv1RAprbQics7tgWMuuY+YVg= 2023-12-15T23:08:00.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:smNAv1RAprbQics7tgWMuuY+YVg=', 'Content-Length': '0'} 2023-12-15T23:08:00.054 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000abfbe3a71c5100df-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.054 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:00.054 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:00.054 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.055 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:00.055 DEBUG:boto:Data: 2023-12-15T23:08:00.055 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.055 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.055 DEBUG:boto:Params: {} 2023-12-15T23:08:00.055 DEBUG:boto:Token: None 2023-12-15T23:08:00.055 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj3 2023-12-15T23:08:00.056 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:smNAv1RAprbQics7tgWMuuY+YVg= 2023-12-15T23:08:00.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:smNAv1RAprbQics7tgWMuuY+YVg=', 'Content-Length': '0'} 2023-12-15T23:08:00.058 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b4af1effd798615-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:00.058 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:00.058 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:00.058 DEBUG:boto:Method: GET 2023-12-15T23:08:00.058 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:00.058 DEBUG:boto:Data: 2023-12-15T23:08:00.059 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.059 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.059 DEBUG:boto:Params: {} 2023-12-15T23:08:00.059 DEBUG:boto:Token: None 2023-12-15T23:08:00.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj3 2023-12-15T23:08:00.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:us55liZ9AI7nVWVdzTCxnXK4gtE= 2023-12-15T23:08:00.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:us55liZ9AI7nVWVdzTCxnXK4gtE=', 'Content-Length': '0'} 2023-12-15T23:08:00.061 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a3fe53da8c6fc210-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.105 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:00.106 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:00.106 DEBUG:boto:Method: GET 2023-12-15T23:08:00.106 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:00.106 DEBUG:boto:Data: 2023-12-15T23:08:00.106 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.106 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.106 DEBUG:boto:Params: {} 2023-12-15T23:08:00.106 DEBUG:boto:Token: None 2023-12-15T23:08:00.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj3 2023-12-15T23:08:00.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:us55liZ9AI7nVWVdzTCxnXK4gtE= 2023-12-15T23:08:00.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:us55liZ9AI7nVWVdzTCxnXK4gtE=', 'Content-Length': '0'} 2023-12-15T23:08:00.109 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001608147d00d23b61-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.110 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.110 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.110 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.110 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.110 DEBUG:boto:Method: GET 2023-12-15T23:08:00.110 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.110 DEBUG:boto:Data: 2023-12-15T23:08:00.110 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.110 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.111 DEBUG:boto:Params: {} 2023-12-15T23:08:00.111 DEBUG:boto:Token: None 2023-12-15T23:08:00.111 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022b471acde54c841-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.114 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.114 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.114 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.114 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.114 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.114 DEBUG:boto:Method: GET 2023-12-15T23:08:00.115 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:00.115 DEBUG:boto:Data: 2023-12-15T23:08:00.115 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.115 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.115 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.115 DEBUG:boto:Params: {} 2023-12-15T23:08:00.115 DEBUG:boto:Token: None 2023-12-15T23:08:00.115 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088ee6271114a9fa9-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.165 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:00.166 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.166 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.166 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.166 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.166 DEBUG:boto:Method: GET 2023-12-15T23:08:00.166 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.166 DEBUG:boto:Data: 2023-12-15T23:08:00.167 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.167 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.167 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.167 DEBUG:boto:Params: {} 2023-12-15T23:08:00.167 DEBUG:boto:Token: None 2023-12-15T23:08:00.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ= 2023-12-15T23:08:00.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.169 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac6dc4c3036d676c-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.170 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.170 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.170 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.170 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.170 DEBUG:boto:Method: GET 2023-12-15T23:08:00.170 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.170 DEBUG:boto:Data: 2023-12-15T23:08:00.170 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.171 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.171 DEBUG:boto:Params: {} 2023-12-15T23:08:00.171 DEBUG:boto:Token: None 2023-12-15T23:08:00.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ= 2023-12-15T23:08:00.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.173 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d727c27b8a0cbd4-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.174 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.174 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.174 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.174 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.174 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.174 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.174 DEBUG:boto:Data: 2023-12-15T23:08:00.175 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.175 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.175 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.175 DEBUG:boto:Params: {} 2023-12-15T23:08:00.175 DEBUG:boto:Token: None 2023-12-15T23:08:00.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rW6Vtvir2PF4/cqXoAbss7f0STQ= 2023-12-15T23:08:00.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rW6Vtvir2PF4/cqXoAbss7f0STQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.177 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fa4b3d925a4596b8-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.177 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.177 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.178 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.178 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.178 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.178 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.178 DEBUG:boto:Data: 2023-12-15T23:08:00.178 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.178 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.178 DEBUG:boto:Params: {} 2023-12-15T23:08:00.178 DEBUG:boto:Token: None 2023-12-15T23:08:00.179 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rW6Vtvir2PF4/cqXoAbss7f0STQ= 2023-12-15T23:08:00.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rW6Vtvir2PF4/cqXoAbss7f0STQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.181 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000097f7b81cb0d476ce-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:00.181 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.182 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.182 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.182 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.182 DEBUG:boto:Method: GET 2023-12-15T23:08:00.182 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.182 DEBUG:boto:Data: 2023-12-15T23:08:00.182 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.182 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.182 DEBUG:boto:Params: {} 2023-12-15T23:08:00.183 DEBUG:boto:Token: None 2023-12-15T23:08:00.183 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ= 2023-12-15T23:08:00.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.185 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a056d564c864170-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.229 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.230 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.230 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.230 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.230 DEBUG:boto:Method: GET 2023-12-15T23:08:00.230 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.230 DEBUG:boto:Data: 2023-12-15T23:08:00.230 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.230 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.230 DEBUG:boto:Params: {} 2023-12-15T23:08:00.231 DEBUG:boto:Token: None 2023-12-15T23:08:00.231 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:00.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ= 2023-12-15T23:08:00.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+MzpZPJeChqcXZBdsiuEIqk0rmQ=', 'Content-Length': '0'} 2023-12-15T23:08:00.233 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b2a22cb89fc61b40-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.233 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.233 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.233 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.233 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.234 DEBUG:boto:Method: GET 2023-12-15T23:08:00.234 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.234 DEBUG:boto:Data: 2023-12-15T23:08:00.234 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.234 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.234 DEBUG:boto:Params: {} 2023-12-15T23:08:00.234 DEBUG:boto:Token: None 2023-12-15T23:08:00.234 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a1ac5ffbf109f05-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.237 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.238 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.238 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.238 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.238 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.238 DEBUG:boto:Method: GET 2023-12-15T23:08:00.238 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.238 DEBUG:boto:Data: 2023-12-15T23:08:00.238 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.239 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.239 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.239 DEBUG:boto:Params: {} 2023-12-15T23:08:00.239 DEBUG:boto:Token: None 2023-12-15T23:08:00.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e812f464c8b1b98-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.242 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.242 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.242 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.242 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.243 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:00.243 DEBUG:boto:Data: 2023-12-15T23:08:00.243 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.243 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.243 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.243 DEBUG:boto:Params: {} 2023-12-15T23:08:00.243 DEBUG:boto:Token: None 2023-12-15T23:08:00.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4 2023-12-15T23:08:00.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DRLzuFjxH3EfN8lcVgLR2+hkqu4= 2023-12-15T23:08:00.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DRLzuFjxH3EfN8lcVgLR2+hkqu4=', 'Content-Length': '0'} 2023-12-15T23:08:00.246 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000822af1dd1a3051f1-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.246 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.246 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.246 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.246 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:00.246 DEBUG:boto:Data: 2023-12-15T23:08:00.247 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.247 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.247 DEBUG:boto:Params: {} 2023-12-15T23:08:00.247 DEBUG:boto:Token: None 2023-12-15T23:08:00.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4 2023-12-15T23:08:00.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DRLzuFjxH3EfN8lcVgLR2+hkqu4= 2023-12-15T23:08:00.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DRLzuFjxH3EfN8lcVgLR2+hkqu4=', 'Content-Length': '0'} 2023-12-15T23:08:00.249 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e00ab5703df6c92-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.249 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:00.250 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.250 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.250 DEBUG:boto:Method: GET 2023-12-15T23:08:00.250 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:00.250 DEBUG:boto:Data: 2023-12-15T23:08:00.250 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.250 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.250 DEBUG:boto:Params: {} 2023-12-15T23:08:00.250 DEBUG:boto:Token: None 2023-12-15T23:08:00.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4 2023-12-15T23:08:00.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCc7BWuygcL6Lo2aKb9N5JFI4Hw= 2023-12-15T23:08:00.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCc7BWuygcL6Lo2aKb9N5JFI4Hw=', 'Content-Length': '0'} 2023-12-15T23:08:00.253 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cdec8a6711361a7c-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.293 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:00.294 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:00.294 DEBUG:boto:Method: GET 2023-12-15T23:08:00.294 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:00.294 DEBUG:boto:Data: 2023-12-15T23:08:00.294 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.294 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.294 DEBUG:boto:Params: {} 2023-12-15T23:08:00.294 DEBUG:boto:Token: None 2023-12-15T23:08:00.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/obj4 2023-12-15T23:08:00.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCc7BWuygcL6Lo2aKb9N5JFI4Hw= 2023-12-15T23:08:00.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCc7BWuygcL6Lo2aKb9N5JFI4Hw=', 'Content-Length': '0'} 2023-12-15T23:08:00.297 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000086789f469861735a-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.297 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.297 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.297 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.298 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.298 DEBUG:boto:Method: GET 2023-12-15T23:08:00.298 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.298 DEBUG:boto:Data: 2023-12-15T23:08:00.298 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.298 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.298 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.298 DEBUG:boto:Params: {} 2023-12-15T23:08:00.298 DEBUG:boto:Token: None 2023-12-15T23:08:00.298 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037d467c0547e3bb5-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.345 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.346 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:00.346 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:00.346 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.346 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.346 DEBUG:boto:Method: GET 2023-12-15T23:08:00.346 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:00.346 DEBUG:boto:Data: 2023-12-15T23:08:00.346 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.347 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.347 DEBUG:boto:Params: {} 2023-12-15T23:08:00.347 DEBUG:boto:Token: None 2023-12-15T23:08:00.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-38/ 2023-12-15T23:08:00.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM= 2023-12-15T23:08:00.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IGmj0wkCnGR9SMzZUmzWWhaEPMM=', 'Content-Length': '0'} 2023-12-15T23:08:00.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092dce03dfa9aee1b-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.349 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.350 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-38 zones={test-zone2, test-zone1} 2023-12-15T23:08:00.350 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-39 2023-12-15T23:08:00.350 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:00.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:00.350 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:00.411 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:00.411 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:00.450 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:00.450+0000 7f9dea532800 1 bucket sync caught up with source: 2023-12-15T23:08:00.451 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.42.6, , 00000000001.14.6, , 00000000001.33.6, , , 00000000001.25.6, , , ] 2023-12-15T23:08:00.451 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.42.6, , 00000000001.14.6, , 00000000001.33.6, , , 00000000001.25.6, , , ] 2023-12-15T23:08:00.451 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:00.450+0000 7f9dea532800 0 bucket checkpoint complete 2023-12-15T23:08:00.466 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-39 2023-12-15T23:08:00.466 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:00.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:00.467 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:00.529 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:00.529 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:00.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:00.568+0000 7f9472d2f800 1 bucket sync caught up with source: 2023-12-15T23:08:00.569 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.118.6, , 00000000001.124.6, , 00000000001.94.6, , , 00000000001.104.6, , , ] 2023-12-15T23:08:00.569 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.118.6, , 00000000001.124.6, , 00000000001.94.6, , , 00000000001.104.6, , , ] 2023-12-15T23:08:00.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:00.568+0000 7f9472d2f800 0 bucket checkpoint complete 2023-12-15T23:08:00.583 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-39 zones={test-zone2, test-zone1} 2023-12-15T23:08:00.583 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.584 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.584 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.584 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:00.584 DEBUG:boto:Data: 2023-12-15T23:08:00.584 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.584 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.584 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.584 DEBUG:boto:Params: {} 2023-12-15T23:08:00.584 DEBUG:boto:Token: None 2023-12-15T23:08:00.585 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cQDj4v3lVJ3e2lhl3w4gSLZ2KR8= 2023-12-15T23:08:00.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cQDj4v3lVJ3e2lhl3w4gSLZ2KR8=', 'Content-Length': '0'} 2023-12-15T23:08:00.587 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c588a746071c8757-00657cdc50-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.587 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.587 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.587 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.587 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:00.587 DEBUG:boto:Data: 2023-12-15T23:08:00.587 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.587 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.588 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.588 DEBUG:boto:Params: {} 2023-12-15T23:08:00.588 DEBUG:boto:Token: None 2023-12-15T23:08:00.588 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.588 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cQDj4v3lVJ3e2lhl3w4gSLZ2KR8= 2023-12-15T23:08:00.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cQDj4v3lVJ3e2lhl3w4gSLZ2KR8=', 'Content-Length': '0'} 2023-12-15T23:08:00.590 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fea31fd39474869c-00657cdc50-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.590 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:08:00.590 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.591 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.591 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.591 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.591 DEBUG:boto:Method: GET 2023-12-15T23:08:00.591 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.591 DEBUG:boto:Data: 2023-12-15T23:08:00.591 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.591 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.591 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.591 DEBUG:boto:Params: {} 2023-12-15T23:08:00.592 DEBUG:boto:Token: None 2023-12-15T23:08:00.592 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/?versions 2023-12-15T23:08:00.592 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q= 2023-12-15T23:08:00.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q=', 'Content-Length': '0'} 2023-12-15T23:08:00.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ebaa18d429f311b-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.594 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:00.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:00.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:00.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:00.595 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:08:00.595 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.596 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.596 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.596 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.596 DEBUG:boto:Method: GET 2023-12-15T23:08:00.596 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.596 DEBUG:boto:Data: 2023-12-15T23:08:00.596 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.596 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.596 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.596 DEBUG:boto:Params: {} 2023-12-15T23:08:00.596 DEBUG:boto:Token: None 2023-12-15T23:08:00.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/?versions 2023-12-15T23:08:00.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q= 2023-12-15T23:08:00.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q=', 'Content-Length': '0'} 2023-12-15T23:08:00.599 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fcd915ce2d10b57-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.599 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:00.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:00.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:00.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:00.600 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.600 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.600 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.600 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.601 DEBUG:boto:Method: GET 2023-12-15T23:08:00.601 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.601 DEBUG:boto:Data: 2023-12-15T23:08:00.601 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.601 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.601 DEBUG:boto:Params: {} 2023-12-15T23:08:00.601 DEBUG:boto:Token: None 2023-12-15T23:08:00.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/?versions 2023-12-15T23:08:00.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q= 2023-12-15T23:08:00.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q=', 'Content-Length': '0'} 2023-12-15T23:08:00.604 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ebce1d14a29454d-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.604 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.604 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.605 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.605 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.605 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.605 DEBUG:boto:Method: GET 2023-12-15T23:08:00.605 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:00.605 DEBUG:boto:Data: 2023-12-15T23:08:00.605 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.605 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.605 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.605 DEBUG:boto:Params: {} 2023-12-15T23:08:00.606 DEBUG:boto:Token: None 2023-12-15T23:08:00.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/?versions 2023-12-15T23:08:00.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q= 2023-12-15T23:08:00.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+jzD6PfdSYGGidI/aZNo6eAc4Q=', 'Content-Length': '0'} 2023-12-15T23:08:00.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000175960bafc5600a7-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.608 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:00.609 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.609 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.609 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.609 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.609 DEBUG:boto:Method: GET 2023-12-15T23:08:00.609 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.609 DEBUG:boto:Data: 2023-12-15T23:08:00.609 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.609 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.610 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.610 DEBUG:boto:Params: {} 2023-12-15T23:08:00.610 DEBUG:boto:Token: None 2023-12-15T23:08:00.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk= 2023-12-15T23:08:00.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk=', 'Content-Length': '0'} 2023-12-15T23:08:00.612 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000083f0c72d5987ece2-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.612 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.612 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.612 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.612 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.612 DEBUG:boto:Method: GET 2023-12-15T23:08:00.612 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.613 DEBUG:boto:Data: 2023-12-15T23:08:00.613 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.613 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.613 DEBUG:boto:Params: {} 2023-12-15T23:08:00.613 DEBUG:boto:Token: None 2023-12-15T23:08:00.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk= 2023-12-15T23:08:00.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk=', 'Content-Length': '0'} 2023-12-15T23:08:00.615 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000655dc2a347b55c55-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.615 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.615 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.616 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.616 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.616 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.616 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.616 DEBUG:boto:Data: 2023-12-15T23:08:00.616 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.616 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.616 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.616 DEBUG:boto:Params: {} 2023-12-15T23:08:00.616 DEBUG:boto:Token: None 2023-12-15T23:08:00.617 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zD0nBZm3Uf7kFghnuoZfv4h1Cak= 2023-12-15T23:08:00.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zD0nBZm3Uf7kFghnuoZfv4h1Cak=', 'Content-Length': '0'} 2023-12-15T23:08:00.618 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3df733936913559-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.619 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.619 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.619 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.619 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.619 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.619 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.619 DEBUG:boto:Data: 2023-12-15T23:08:00.619 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.619 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.620 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.620 DEBUG:boto:Params: {} 2023-12-15T23:08:00.620 DEBUG:boto:Token: None 2023-12-15T23:08:00.620 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.620 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zD0nBZm3Uf7kFghnuoZfv4h1Cak= 2023-12-15T23:08:00.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zD0nBZm3Uf7kFghnuoZfv4h1Cak=', 'Content-Length': '0'} 2023-12-15T23:08:00.621 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ad3da6d32032f0e1-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:00.622 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.622 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.622 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.622 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.622 DEBUG:boto:Method: GET 2023-12-15T23:08:00.622 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.622 DEBUG:boto:Data: 2023-12-15T23:08:00.622 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.623 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.623 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.623 DEBUG:boto:Params: {} 2023-12-15T23:08:00.623 DEBUG:boto:Token: None 2023-12-15T23:08:00.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk= 2023-12-15T23:08:00.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk=', 'Content-Length': '0'} 2023-12-15T23:08:00.625 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000db10e76bf9529a69-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.665 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.666 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.666 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.666 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.666 DEBUG:boto:Method: GET 2023-12-15T23:08:00.666 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.666 DEBUG:boto:Data: 2023-12-15T23:08:00.666 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.666 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.666 DEBUG:boto:Params: {} 2023-12-15T23:08:00.666 DEBUG:boto:Token: None 2023-12-15T23:08:00.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:00.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk= 2023-12-15T23:08:00.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JjnCOU30otj6ZQ6QPqdrMWVgXNk=', 'Content-Length': '0'} 2023-12-15T23:08:00.668 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002c1aa61b62b4c6fc-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.669 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.669 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.669 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.669 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.669 DEBUG:boto:Method: GET 2023-12-15T23:08:00.669 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.669 DEBUG:boto:Data: 2023-12-15T23:08:00.669 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.669 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.670 DEBUG:boto:Params: {} 2023-12-15T23:08:00.670 DEBUG:boto:Token: None 2023-12-15T23:08:00.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.672 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c91675439e82cec3-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.672 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.673 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.673 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.673 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.673 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.673 DEBUG:boto:Method: GET 2023-12-15T23:08:00.673 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.673 DEBUG:boto:Data: 2023-12-15T23:08:00.673 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.673 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.674 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.674 DEBUG:boto:Params: {} 2023-12-15T23:08:00.674 DEBUG:boto:Token: None 2023-12-15T23:08:00.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.676 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001332e2699691c456-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.677 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.677 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.677 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.677 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.677 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:00.677 DEBUG:boto:Data: 2023-12-15T23:08:00.678 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.678 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.678 DEBUG:boto:Params: {} 2023-12-15T23:08:00.678 DEBUG:boto:Token: None 2023-12-15T23:08:00.678 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1 2023-12-15T23:08:00.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G8arLOEbBAho9EXPWK84HGkEv+Y= 2023-12-15T23:08:00.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G8arLOEbBAho9EXPWK84HGkEv+Y=', 'Content-Length': '0'} 2023-12-15T23:08:00.680 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e601822342164c0-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.680 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.680 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.680 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.680 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:00.681 DEBUG:boto:Data: 2023-12-15T23:08:00.681 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.681 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.681 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.681 DEBUG:boto:Params: {} 2023-12-15T23:08:00.681 DEBUG:boto:Token: None 2023-12-15T23:08:00.681 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1 2023-12-15T23:08:00.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G8arLOEbBAho9EXPWK84HGkEv+Y= 2023-12-15T23:08:00.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G8arLOEbBAho9EXPWK84HGkEv+Y=', 'Content-Length': '0'} 2023-12-15T23:08:00.683 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000099f828affe903c59-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.683 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:00.684 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.684 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.684 DEBUG:boto:Method: GET 2023-12-15T23:08:00.684 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:00.684 DEBUG:boto:Data: 2023-12-15T23:08:00.684 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.684 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.684 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.684 DEBUG:boto:Params: {} 2023-12-15T23:08:00.685 DEBUG:boto:Token: None 2023-12-15T23:08:00.685 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1 2023-12-15T23:08:00.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pqR0FpgEMSCbHpUTjuwdggCB5yU= 2023-12-15T23:08:00.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pqR0FpgEMSCbHpUTjuwdggCB5yU=', 'Content-Length': '0'} 2023-12-15T23:08:00.686 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009710e5a150666bae-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.686 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:00.687 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:00.687 DEBUG:boto:Method: GET 2023-12-15T23:08:00.687 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:00.687 DEBUG:boto:Data: 2023-12-15T23:08:00.687 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.687 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.687 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.687 DEBUG:boto:Params: {} 2023-12-15T23:08:00.687 DEBUG:boto:Token: None 2023-12-15T23:08:00.688 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj1 2023-12-15T23:08:00.688 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pqR0FpgEMSCbHpUTjuwdggCB5yU= 2023-12-15T23:08:00.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pqR0FpgEMSCbHpUTjuwdggCB5yU=', 'Content-Length': '0'} 2023-12-15T23:08:00.689 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000961960bb5fd84e34-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.733 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.734 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.734 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.734 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.734 DEBUG:boto:Method: GET 2023-12-15T23:08:00.734 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.734 DEBUG:boto:Data: 2023-12-15T23:08:00.734 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.734 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.734 DEBUG:boto:Params: {} 2023-12-15T23:08:00.735 DEBUG:boto:Token: None 2023-12-15T23:08:00.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099e9ace69108578b-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.737 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.738 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.738 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.738 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.738 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.738 DEBUG:boto:Method: GET 2023-12-15T23:08:00.738 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:00.738 DEBUG:boto:Data: 2023-12-15T23:08:00.738 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.739 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.739 DEBUG:boto:Params: {} 2023-12-15T23:08:00.739 DEBUG:boto:Token: None 2023-12-15T23:08:00.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f06cb98ca26450dc-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.742 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:00.742 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.742 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.742 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.742 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.742 DEBUG:boto:Method: GET 2023-12-15T23:08:00.743 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.743 DEBUG:boto:Data: 2023-12-15T23:08:00.743 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.743 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.743 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.743 DEBUG:boto:Params: {} 2023-12-15T23:08:00.743 DEBUG:boto:Token: None 2023-12-15T23:08:00.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4= 2023-12-15T23:08:00.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4=', 'Content-Length': '0'} 2023-12-15T23:08:00.746 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2b173b41583e639-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.746 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.746 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.746 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.746 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.746 DEBUG:boto:Method: GET 2023-12-15T23:08:00.746 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.747 DEBUG:boto:Data: 2023-12-15T23:08:00.747 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.747 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.747 DEBUG:boto:Params: {} 2023-12-15T23:08:00.747 DEBUG:boto:Token: None 2023-12-15T23:08:00.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4= 2023-12-15T23:08:00.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4=', 'Content-Length': '0'} 2023-12-15T23:08:00.749 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000af6adbb363531d82-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.794 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.794 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.794 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.794 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.794 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.794 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.794 DEBUG:boto:Data: 2023-12-15T23:08:00.794 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.795 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.795 DEBUG:boto:Params: {} 2023-12-15T23:08:00.795 DEBUG:boto:Token: None 2023-12-15T23:08:00.795 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4BiaKjuDS8LP0npKJ+ZULGP7zo= 2023-12-15T23:08:00.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4BiaKjuDS8LP0npKJ+ZULGP7zo=', 'Content-Length': '0'} 2023-12-15T23:08:00.797 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000807bc7ec7b17dd8c-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.797 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.797 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.798 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.798 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.798 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.798 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.798 DEBUG:boto:Data: 2023-12-15T23:08:00.798 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.798 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.798 DEBUG:boto:Params: {} 2023-12-15T23:08:00.799 DEBUG:boto:Token: None 2023-12-15T23:08:00.799 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A4BiaKjuDS8LP0npKJ+ZULGP7zo= 2023-12-15T23:08:00.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A4BiaKjuDS8LP0npKJ+ZULGP7zo=', 'Content-Length': '0'} 2023-12-15T23:08:00.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000045838ea6ea07ff2c-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:00.801 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.801 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.801 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.801 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.801 DEBUG:boto:Method: GET 2023-12-15T23:08:00.801 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.802 DEBUG:boto:Data: 2023-12-15T23:08:00.802 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.802 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.802 DEBUG:boto:Params: {} 2023-12-15T23:08:00.802 DEBUG:boto:Token: None 2023-12-15T23:08:00.802 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4= 2023-12-15T23:08:00.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4=', 'Content-Length': '0'} 2023-12-15T23:08:00.805 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002643eadbd0d0e07e-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.805 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.806 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.806 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.806 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.806 DEBUG:boto:Method: GET 2023-12-15T23:08:00.806 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.806 DEBUG:boto:Data: 2023-12-15T23:08:00.806 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.806 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.806 DEBUG:boto:Params: {} 2023-12-15T23:08:00.807 DEBUG:boto:Token: None 2023-12-15T23:08:00.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:00.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4= 2023-12-15T23:08:00.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0V2A6+eLOs1W8FkAhkyZrW7wXU4=', 'Content-Length': '0'} 2023-12-15T23:08:00.808 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000735e3f079380cd3f-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.849 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.849 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.850 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.850 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.850 DEBUG:boto:Method: GET 2023-12-15T23:08:00.850 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.850 DEBUG:boto:Data: 2023-12-15T23:08:00.850 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.850 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.851 DEBUG:boto:Params: {} 2023-12-15T23:08:00.851 DEBUG:boto:Token: None 2023-12-15T23:08:00.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c61979a24cc4e1c-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.854 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.854 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.854 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.854 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.854 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.855 DEBUG:boto:Method: GET 2023-12-15T23:08:00.855 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.855 DEBUG:boto:Data: 2023-12-15T23:08:00.855 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.855 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.855 DEBUG:boto:Params: {} 2023-12-15T23:08:00.855 DEBUG:boto:Token: None 2023-12-15T23:08:00.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a36e6592bbfc581-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.858 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.858 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.858 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.858 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.859 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:00.859 DEBUG:boto:Data: 2023-12-15T23:08:00.859 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.859 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.859 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.859 DEBUG:boto:Params: {} 2023-12-15T23:08:00.859 DEBUG:boto:Token: None 2023-12-15T23:08:00.859 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2 2023-12-15T23:08:00.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ODEhGXyEIc2dCOiRLKSTeIjGaTo= 2023-12-15T23:08:00.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ODEhGXyEIc2dCOiRLKSTeIjGaTo=', 'Content-Length': '0'} 2023-12-15T23:08:00.862 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000043a6a000d20bcda1-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.862 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.862 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.862 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.862 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:00.862 DEBUG:boto:Data: 2023-12-15T23:08:00.863 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.863 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.863 DEBUG:boto:Params: {} 2023-12-15T23:08:00.863 DEBUG:boto:Token: None 2023-12-15T23:08:00.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2 2023-12-15T23:08:00.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ODEhGXyEIc2dCOiRLKSTeIjGaTo= 2023-12-15T23:08:00.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ODEhGXyEIc2dCOiRLKSTeIjGaTo=', 'Content-Length': '0'} 2023-12-15T23:08:00.865 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bdf0d8faa6a9f993-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:00.865 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.865 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.866 DEBUG:boto:Method: GET 2023-12-15T23:08:00.866 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:00.866 DEBUG:boto:Data: 2023-12-15T23:08:00.866 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.866 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.866 DEBUG:boto:Params: {} 2023-12-15T23:08:00.866 DEBUG:boto:Token: None 2023-12-15T23:08:00.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2 2023-12-15T23:08:00.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YgSSDV2xnDYJvnj0kzdZElrvM+A= 2023-12-15T23:08:00.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YgSSDV2xnDYJvnj0kzdZElrvM+A=', 'Content-Length': '0'} 2023-12-15T23:08:00.868 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b8ad2f44015df24-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.913 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:00.914 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:00.914 DEBUG:boto:Method: GET 2023-12-15T23:08:00.914 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:00.914 DEBUG:boto:Data: 2023-12-15T23:08:00.914 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.914 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.914 DEBUG:boto:Params: {} 2023-12-15T23:08:00.915 DEBUG:boto:Token: None 2023-12-15T23:08:00.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj2 2023-12-15T23:08:00.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YgSSDV2xnDYJvnj0kzdZElrvM+A= 2023-12-15T23:08:00.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YgSSDV2xnDYJvnj0kzdZElrvM+A=', 'Content-Length': '0'} 2023-12-15T23:08:00.917 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000951b37d487724569-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.957 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.957 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.958 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.958 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.958 DEBUG:boto:Method: GET 2023-12-15T23:08:00.958 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.958 DEBUG:boto:Data: 2023-12-15T23:08:00.958 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.958 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.958 DEBUG:boto:Params: {} 2023-12-15T23:08:00.958 DEBUG:boto:Token: None 2023-12-15T23:08:00.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4850e53a4ce9b2c-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.961 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.962 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:00.962 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:00.962 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.962 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.962 DEBUG:boto:Method: GET 2023-12-15T23:08:00.962 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:00.962 DEBUG:boto:Data: 2023-12-15T23:08:00.962 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.963 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.963 DEBUG:boto:Params: {} 2023-12-15T23:08:00.963 DEBUG:boto:Token: None 2023-12-15T23:08:00.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/ 2023-12-15T23:08:00.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw= 2023-12-15T23:08:00.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dasEMx6G5julZsxc9W9GQEb4unw=', 'Content-Length': '0'} 2023-12-15T23:08:00.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d82fa4ab5f0cca50-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.965 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:00.966 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:00.966 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.966 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.966 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.966 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.966 DEBUG:boto:Method: GET 2023-12-15T23:08:00.966 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.966 DEBUG:boto:Data: 2023-12-15T23:08:00.966 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.967 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.967 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.967 DEBUG:boto:Params: {} 2023-12-15T23:08:00.967 DEBUG:boto:Token: None 2023-12-15T23:08:00.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o= 2023-12-15T23:08:00.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o=', 'Content-Length': '0'} 2023-12-15T23:08:00.969 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079daafaa211ccc05-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.969 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.969 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.969 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.969 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.970 DEBUG:boto:Method: GET 2023-12-15T23:08:00.970 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.970 DEBUG:boto:Data: 2023-12-15T23:08:00.970 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.970 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.970 DEBUG:boto:Params: {} 2023-12-15T23:08:00.970 DEBUG:boto:Token: None 2023-12-15T23:08:00.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o= 2023-12-15T23:08:00.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o=', 'Content-Length': '0'} 2023-12-15T23:08:00.972 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000358f19b535860933-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.973 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.973 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.973 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.973 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.973 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.973 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.974 DEBUG:boto:Data: 2023-12-15T23:08:00.974 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.974 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.974 DEBUG:boto:Params: {} 2023-12-15T23:08:00.974 DEBUG:boto:Token: None 2023-12-15T23:08:00.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PAHrLIAHOpALA+eC7D6I/1Gsq+M= 2023-12-15T23:08:00.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PAHrLIAHOpALA+eC7D6I/1Gsq+M=', 'Content-Length': '0'} 2023-12-15T23:08:00.976 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009ad140dd54b082df-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.976 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.976 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.976 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.976 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.976 DEBUG:boto:Method: HEAD 2023-12-15T23:08:00.977 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.977 DEBUG:boto:Data: 2023-12-15T23:08:00.977 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.977 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.977 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.977 DEBUG:boto:Params: {} 2023-12-15T23:08:00.977 DEBUG:boto:Token: None 2023-12-15T23:08:00.977 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PAHrLIAHOpALA+eC7D6I/1Gsq+M= 2023-12-15T23:08:00.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PAHrLIAHOpALA+eC7D6I/1Gsq+M=', 'Content-Length': '0'} 2023-12-15T23:08:00.979 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5302afb85eeecd5-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:00.979 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.979 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.979 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.980 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.980 DEBUG:boto:Method: GET 2023-12-15T23:08:00.980 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.980 DEBUG:boto:Data: 2023-12-15T23:08:00.980 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.980 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:00.980 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.980 DEBUG:boto:Params: {} 2023-12-15T23:08:00.980 DEBUG:boto:Token: None 2023-12-15T23:08:00.980 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.980 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o= 2023-12-15T23:08:00.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o=', 'Content-Length': '0'} 2023-12-15T23:08:00.982 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003df30fa1c9432dab-00657cdc50-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:00.983 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:00.983 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:00.983 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.983 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.983 DEBUG:boto:Method: GET 2023-12-15T23:08:00.983 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.983 DEBUG:boto:Data: 2023-12-15T23:08:00.983 DEBUG:boto:Headers: {} 2023-12-15T23:08:00.983 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:00.983 DEBUG:boto:Port: 8000 2023-12-15T23:08:00.984 DEBUG:boto:Params: {} 2023-12-15T23:08:00.984 DEBUG:boto:Token: None 2023-12-15T23:08:00.984 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:00 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:00.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o= 2023-12-15T23:08:00.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jxm04fLfn9nTwx+wSdWkaNjc82o=', 'Content-Length': '0'} 2023-12-15T23:08:00.986 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009ee844364a0e09cb-00657cdc50-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.029 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.030 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.030 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.030 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.030 DEBUG:boto:Method: GET 2023-12-15T23:08:01.030 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.030 DEBUG:boto:Data: 2023-12-15T23:08:01.030 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.030 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.031 DEBUG:boto:Params: {} 2023-12-15T23:08:01.031 DEBUG:boto:Token: None 2023-12-15T23:08:01.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074719933ca3da4b7-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.034 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.034 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.034 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.034 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.034 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.034 DEBUG:boto:Method: GET 2023-12-15T23:08:01.035 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.035 DEBUG:boto:Data: 2023-12-15T23:08:01.035 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.035 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.035 DEBUG:boto:Params: {} 2023-12-15T23:08:01.035 DEBUG:boto:Token: None 2023-12-15T23:08:01.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.038 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f7c1d563ce53774-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.038 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.038 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:01.038 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:01.038 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.039 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:01.039 DEBUG:boto:Data: 2023-12-15T23:08:01.039 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.039 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.039 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.039 DEBUG:boto:Params: {} 2023-12-15T23:08:01.039 DEBUG:boto:Token: None 2023-12-15T23:08:01.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj3 2023-12-15T23:08:01.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xWtuOLwc6e5WmD3U/FA2/Fi9ti4= 2023-12-15T23:08:01.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xWtuOLwc6e5WmD3U/FA2/Fi9ti4=', 'Content-Length': '0'} 2023-12-15T23:08:01.041 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006723937404bead91-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.042 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:01.042 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:01.042 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.042 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:01.042 DEBUG:boto:Data: 2023-12-15T23:08:01.042 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.042 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.042 DEBUG:boto:Params: {} 2023-12-15T23:08:01.043 DEBUG:boto:Token: None 2023-12-15T23:08:01.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj3 2023-12-15T23:08:01.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xWtuOLwc6e5WmD3U/FA2/Fi9ti4= 2023-12-15T23:08:01.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xWtuOLwc6e5WmD3U/FA2/Fi9ti4=', 'Content-Length': '0'} 2023-12-15T23:08:01.045 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000023a88bf08e552ce4-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:01.045 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:01.045 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:01.045 DEBUG:boto:Method: GET 2023-12-15T23:08:01.045 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:01.045 DEBUG:boto:Data: 2023-12-15T23:08:01.046 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.046 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.046 DEBUG:boto:Params: {} 2023-12-15T23:08:01.046 DEBUG:boto:Token: None 2023-12-15T23:08:01.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj3 2023-12-15T23:08:01.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3qz32pDV+fbbOqgw8aeY/y7wH0Q= 2023-12-15T23:08:01.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3qz32pDV+fbbOqgw8aeY/y7wH0Q=', 'Content-Length': '0'} 2023-12-15T23:08:01.048 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a59158933c598a82-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.048 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:01.048 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:01.049 DEBUG:boto:Method: GET 2023-12-15T23:08:01.049 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:01.049 DEBUG:boto:Data: 2023-12-15T23:08:01.049 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.049 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.049 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.049 DEBUG:boto:Params: {} 2023-12-15T23:08:01.049 DEBUG:boto:Token: None 2023-12-15T23:08:01.049 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj3 2023-12-15T23:08:01.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3qz32pDV+fbbOqgw8aeY/y7wH0Q= 2023-12-15T23:08:01.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3qz32pDV+fbbOqgw8aeY/y7wH0Q=', 'Content-Length': '0'} 2023-12-15T23:08:01.051 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000436e1326d19f8863-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.093 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.094 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.094 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.094 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.094 DEBUG:boto:Method: GET 2023-12-15T23:08:01.094 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.094 DEBUG:boto:Data: 2023-12-15T23:08:01.094 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.094 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.095 DEBUG:boto:Params: {} 2023-12-15T23:08:01.095 DEBUG:boto:Token: None 2023-12-15T23:08:01.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.097 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002f7223451f0c3b8-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.097 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.098 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.098 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.098 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.098 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.098 DEBUG:boto:Method: GET 2023-12-15T23:08:01.098 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:01.098 DEBUG:boto:Data: 2023-12-15T23:08:01.098 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.099 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.099 DEBUG:boto:Params: {} 2023-12-15T23:08:01.099 DEBUG:boto:Token: None 2023-12-15T23:08:01.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc94e9dcd6bb1338-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.101 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:01.102 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.102 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.102 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.102 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.102 DEBUG:boto:Method: GET 2023-12-15T23:08:01.102 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.102 DEBUG:boto:Data: 2023-12-15T23:08:01.102 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.103 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.103 DEBUG:boto:Params: {} 2023-12-15T23:08:01.103 DEBUG:boto:Token: None 2023-12-15T23:08:01.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc= 2023-12-15T23:08:01.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc=', 'Content-Length': '0'} 2023-12-15T23:08:01.105 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e7ca6fb597bba97-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.105 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.105 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.106 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.106 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.106 DEBUG:boto:Method: GET 2023-12-15T23:08:01.106 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.106 DEBUG:boto:Data: 2023-12-15T23:08:01.106 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.106 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.106 DEBUG:boto:Params: {} 2023-12-15T23:08:01.107 DEBUG:boto:Token: None 2023-12-15T23:08:01.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc= 2023-12-15T23:08:01.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc=', 'Content-Length': '0'} 2023-12-15T23:08:01.109 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000987515f77c1867f7-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.109 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.109 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.110 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.110 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.110 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.110 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.110 DEBUG:boto:Data: 2023-12-15T23:08:01.110 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.110 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.110 DEBUG:boto:Params: {} 2023-12-15T23:08:01.110 DEBUG:boto:Token: None 2023-12-15T23:08:01.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t6Da+gxhWPWZmZCd52f3Mha6X04= 2023-12-15T23:08:01.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t6Da+gxhWPWZmZCd52f3Mha6X04=', 'Content-Length': '0'} 2023-12-15T23:08:01.112 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f71ada222b668513-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.113 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.113 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.113 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.113 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.113 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.113 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.113 DEBUG:boto:Data: 2023-12-15T23:08:01.113 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.114 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.114 DEBUG:boto:Params: {} 2023-12-15T23:08:01.114 DEBUG:boto:Token: None 2023-12-15T23:08:01.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t6Da+gxhWPWZmZCd52f3Mha6X04= 2023-12-15T23:08:01.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t6Da+gxhWPWZmZCd52f3Mha6X04=', 'Content-Length': '0'} 2023-12-15T23:08:01.116 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000017469865da649902-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:01.116 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.116 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.116 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.116 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.116 DEBUG:boto:Method: GET 2023-12-15T23:08:01.117 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.117 DEBUG:boto:Data: 2023-12-15T23:08:01.117 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.117 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.117 DEBUG:boto:Params: {} 2023-12-15T23:08:01.117 DEBUG:boto:Token: None 2023-12-15T23:08:01.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc= 2023-12-15T23:08:01.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc=', 'Content-Length': '0'} 2023-12-15T23:08:01.119 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009529344333aa0a8e-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.119 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.119 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.120 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.120 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.120 DEBUG:boto:Method: GET 2023-12-15T23:08:01.120 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.120 DEBUG:boto:Data: 2023-12-15T23:08:01.120 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.120 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.120 DEBUG:boto:Params: {} 2023-12-15T23:08:01.120 DEBUG:boto:Token: None 2023-12-15T23:08:01.121 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:01.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc= 2023-12-15T23:08:01.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QyKEqatQ3Z6+fYpfT+uw5AJKXqc=', 'Content-Length': '0'} 2023-12-15T23:08:01.122 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cc55d507fcd60e65-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.165 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.166 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.166 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.166 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.166 DEBUG:boto:Method: GET 2023-12-15T23:08:01.166 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.166 DEBUG:boto:Data: 2023-12-15T23:08:01.166 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.166 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.166 DEBUG:boto:Params: {} 2023-12-15T23:08:01.167 DEBUG:boto:Token: None 2023-12-15T23:08:01.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c76cfbccea5e0d4e-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.169 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.170 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.170 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.170 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.170 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.170 DEBUG:boto:Method: GET 2023-12-15T23:08:01.170 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.170 DEBUG:boto:Data: 2023-12-15T23:08:01.170 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.171 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.171 DEBUG:boto:Params: {} 2023-12-15T23:08:01.171 DEBUG:boto:Token: None 2023-12-15T23:08:01.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a05e1e8e84dd448-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.173 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.174 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.174 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.174 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.174 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:01.174 DEBUG:boto:Data: 2023-12-15T23:08:01.174 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.175 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.175 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.175 DEBUG:boto:Params: {} 2023-12-15T23:08:01.175 DEBUG:boto:Token: None 2023-12-15T23:08:01.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4 2023-12-15T23:08:01.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YykXoPYVoqadu9dRNH+Yq65ls7I= 2023-12-15T23:08:01.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YykXoPYVoqadu9dRNH+Yq65ls7I=', 'Content-Length': '0'} 2023-12-15T23:08:01.177 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fb5169c64eacfacd-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.177 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.177 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.177 DEBUG:boto:Method: HEAD 2023-12-15T23:08:01.177 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:01.178 DEBUG:boto:Data: 2023-12-15T23:08:01.178 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.178 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.178 DEBUG:boto:Params: {} 2023-12-15T23:08:01.178 DEBUG:boto:Token: None 2023-12-15T23:08:01.178 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4 2023-12-15T23:08:01.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YykXoPYVoqadu9dRNH+Yq65ls7I= 2023-12-15T23:08:01.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YykXoPYVoqadu9dRNH+Yq65ls7I=', 'Content-Length': '0'} 2023-12-15T23:08:01.180 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ca5bc24f731ad81-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:01.181 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.181 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.181 DEBUG:boto:Method: GET 2023-12-15T23:08:01.181 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:01.181 DEBUG:boto:Data: 2023-12-15T23:08:01.181 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.181 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.182 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.182 DEBUG:boto:Params: {} 2023-12-15T23:08:01.182 DEBUG:boto:Token: None 2023-12-15T23:08:01.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4 2023-12-15T23:08:01.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mBakNExPO2Y8IBi1B3vkhWHoMzQ= 2023-12-15T23:08:01.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBakNExPO2Y8IBi1B3vkhWHoMzQ=', 'Content-Length': '0'} 2023-12-15T23:08:01.184 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f240082ecab63535-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.184 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:01.184 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:01.185 DEBUG:boto:Method: GET 2023-12-15T23:08:01.185 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:01.185 DEBUG:boto:Data: 2023-12-15T23:08:01.185 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.185 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.185 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.185 DEBUG:boto:Params: {} 2023-12-15T23:08:01.185 DEBUG:boto:Token: None 2023-12-15T23:08:01.185 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/obj4 2023-12-15T23:08:01.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mBakNExPO2Y8IBi1B3vkhWHoMzQ= 2023-12-15T23:08:01.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBakNExPO2Y8IBi1B3vkhWHoMzQ=', 'Content-Length': '0'} 2023-12-15T23:08:01.187 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008582af79f7947bc1-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.233 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.234 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.234 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.234 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.234 DEBUG:boto:Method: GET 2023-12-15T23:08:01.234 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.234 DEBUG:boto:Data: 2023-12-15T23:08:01.234 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:01.234 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.234 DEBUG:boto:Params: {} 2023-12-15T23:08:01.234 DEBUG:boto:Token: None 2023-12-15T23:08:01.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030ac57f142d2b588-00657cdc51-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.237 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.238 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:01.238 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:01.238 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.238 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.238 DEBUG:boto:Method: GET 2023-12-15T23:08:01.238 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:01.238 DEBUG:boto:Data: 2023-12-15T23:08:01.239 DEBUG:boto:Headers: {} 2023-12-15T23:08:01.239 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:01.239 DEBUG:boto:Port: 8000 2023-12-15T23:08:01.239 DEBUG:boto:Params: {} 2023-12-15T23:08:01.239 DEBUG:boto:Token: None 2023-12-15T23:08:01.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:01 GMT /kskgfn-39/ 2023-12-15T23:08:01.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA= 2023-12-15T23:08:01.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZY/trrY5QonvzQWIyXSawB//LA=', 'Content-Length': '0'} 2023-12-15T23:08:01.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa7eeb415b165883-00657cdc51-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:01.242 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:01.242 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-39 zones={test-zone2, test-zone1} 2023-12-15T23:08:01.242 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:01.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:01.243 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:08:01.294 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:01.294 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:01.368 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'kskgfn-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:01.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'kskgfn-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:01.368 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket kskgfn-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:08:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:01.488 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:01.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:01.488 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:01.533 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:01.533 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:01.564 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:08:01.578 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681681.473883_320.1","last_update":"2023-12-15T23:08:01.473883Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:08:01.578 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681681.473883_320.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:01.579 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:08:01.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:01.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:01.579 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:01.632 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:01.632 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:01.664 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:01.663+0000 7facd0d37800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:01.665 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:01.665+0000 7facd0d37800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:01.682 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681673.908888_315.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:53.908888Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:01Z"} 2023-12-15T23:08:01.682 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681673.908888_315.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:07:53.908888Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:01Z"} 2023-12-15T23:08:01.683 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681673.908888_315.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:07:53.908888Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:08:01.683 DEBUG:rgw_multi.tests:log_status={0: '1_1702681681.473883_320.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:01.683 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681673.908888_315.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:01.683 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681681.473883_320.1 target=1_1702681673.908888_315.1 2023-12-15T23:08:06.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:06.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:06.685 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:06.737 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:06.737 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:06.773 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:06.772+0000 7f3e2db27800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:06.774 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:06.774+0000 7f3e2db27800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:06.789 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681681.473883_320.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:01.473883Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:06Z"} 2023-12-15T23:08:06.789 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681681.473883_320.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:01.473883Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:06Z"} 2023-12-15T23:08:06.789 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681681.473883_320.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:08:01.473883Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:08:06.789 DEBUG:rgw_multi.tests:log_status={0: '1_1702681681.473883_320.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:06.790 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681681.473883_320.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:06.790 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:08:06.790 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:06.790 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:06.790 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.790 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:06.790 DEBUG:boto:Data: 2023-12-15T23:08:06.790 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.790 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.791 DEBUG:boto:Params: {} 2023-12-15T23:08:06.791 DEBUG:boto:Token: None 2023-12-15T23:08:06.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/ 2023-12-15T23:08:06.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8= 2023-12-15T23:08:06.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8=', 'Content-Length': '0'} 2023-12-15T23:08:06.794 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c87f184d7e300d0c-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.794 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:06.795 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:06.795 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.795 DEBUG:boto:Path: /kskgfn-38/obj5 2023-12-15T23:08:06.795 DEBUG:boto:Data: 2023-12-15T23:08:06.795 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.795 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.795 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.795 DEBUG:boto:Params: {} 2023-12-15T23:08:06.795 DEBUG:boto:Token: None 2023-12-15T23:08:06.796 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/obj5 2023-12-15T23:08:06.796 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VDOHwt69FXhBkE/BKsDnGG8FlGc= 2023-12-15T23:08:06.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VDOHwt69FXhBkE/BKsDnGG8FlGc='} 2023-12-15T23:08:06.800 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bdabc0edb7625e8a-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.800 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:06.800 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:06.801 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.801 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:06.801 DEBUG:boto:Data: 2023-12-15T23:08:06.801 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.801 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.801 DEBUG:boto:Params: {} 2023-12-15T23:08:06.801 DEBUG:boto:Token: None 2023-12-15T23:08:06.801 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/ 2023-12-15T23:08:06.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8= 2023-12-15T23:08:06.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8=', 'Content-Length': '0'} 2023-12-15T23:08:06.803 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000548327b38b3bb1ab-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.804 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:06.804 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:06.804 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.804 DEBUG:boto:Path: /kskgfn-38/obj6 2023-12-15T23:08:06.804 DEBUG:boto:Data: 2023-12-15T23:08:06.804 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.804 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.804 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.804 DEBUG:boto:Params: {} 2023-12-15T23:08:06.805 DEBUG:boto:Token: None 2023-12-15T23:08:06.805 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/obj6 2023-12-15T23:08:06.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pf0+qUoii/qCb6I6E3sB+FbMpGs= 2023-12-15T23:08:06.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pf0+qUoii/qCb6I6E3sB+FbMpGs='} 2023-12-15T23:08:06.850 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006e21545063c949fa-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.850 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:06.850 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:06.850 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.850 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:06.850 DEBUG:boto:Data: 2023-12-15T23:08:06.850 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.850 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.851 DEBUG:boto:Params: {} 2023-12-15T23:08:06.851 DEBUG:boto:Token: None 2023-12-15T23:08:06.851 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/ 2023-12-15T23:08:06.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8= 2023-12-15T23:08:06.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8=', 'Content-Length': '0'} 2023-12-15T23:08:06.853 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002d16c8913138de75-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.854 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:06.854 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:06.854 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.854 DEBUG:boto:Path: /kskgfn-38/obj7 2023-12-15T23:08:06.854 DEBUG:boto:Data: 2023-12-15T23:08:06.854 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.854 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.854 DEBUG:boto:Params: {} 2023-12-15T23:08:06.855 DEBUG:boto:Token: None 2023-12-15T23:08:06.855 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/obj7 2023-12-15T23:08:06.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bls10XbY+aH0g4w/W3/1QBRNVKg= 2023-12-15T23:08:06.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bls10XbY+aH0g4w/W3/1QBRNVKg='} 2023-12-15T23:08:06.859 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006300c72d042747cd-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.860 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:06.860 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:06.860 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.860 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:06.860 DEBUG:boto:Data: 2023-12-15T23:08:06.860 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.860 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.860 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.860 DEBUG:boto:Params: {} 2023-12-15T23:08:06.860 DEBUG:boto:Token: None 2023-12-15T23:08:06.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/ 2023-12-15T23:08:06.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8= 2023-12-15T23:08:06.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rtQlKpoj9Kwylb3uzedHOXmBFI8=', 'Content-Length': '0'} 2023-12-15T23:08:06.863 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000094dd0d3fa5afb717-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.863 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:06.863 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:06.864 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.864 DEBUG:boto:Path: /kskgfn-38/obj8 2023-12-15T23:08:06.864 DEBUG:boto:Data: 2023-12-15T23:08:06.864 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:06.864 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.864 DEBUG:boto:Params: {} 2023-12-15T23:08:06.864 DEBUG:boto:Token: None 2023-12-15T23:08:06.864 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-38/obj8 2023-12-15T23:08:06.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vF8tIoNkhHBcGtY+YZdtbALW0SM= 2023-12-15T23:08:06.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vF8tIoNkhHBcGtY+YZdtbALW0SM='} 2023-12-15T23:08:06.913 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000dc91f306719254f-00657cdc56-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.914 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:06.914 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:06.914 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.914 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:06.914 DEBUG:boto:Data: 2023-12-15T23:08:06.914 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.914 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.914 DEBUG:boto:Params: {} 2023-12-15T23:08:06.915 DEBUG:boto:Token: None 2023-12-15T23:08:06.915 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/ 2023-12-15T23:08:06.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY= 2023-12-15T23:08:06.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY=', 'Content-Length': '0'} 2023-12-15T23:08:06.917 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a3b268211cddb1a3-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.917 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:06.917 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:06.917 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.918 DEBUG:boto:Path: /kskgfn-39/obj5 2023-12-15T23:08:06.918 DEBUG:boto:Data: 2023-12-15T23:08:06.918 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.918 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.918 DEBUG:boto:Params: {} 2023-12-15T23:08:06.918 DEBUG:boto:Token: None 2023-12-15T23:08:06.918 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/obj5 2023-12-15T23:08:06.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I8LCz9JlMvmQTevp/q1q2c5gMB0= 2023-12-15T23:08:06.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I8LCz9JlMvmQTevp/q1q2c5gMB0='} 2023-12-15T23:08:06.922 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000a3666e5ca617af6-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.923 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:06.923 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:06.923 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.923 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:06.923 DEBUG:boto:Data: 2023-12-15T23:08:06.923 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.923 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.923 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.923 DEBUG:boto:Params: {} 2023-12-15T23:08:06.924 DEBUG:boto:Token: None 2023-12-15T23:08:06.924 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/ 2023-12-15T23:08:06.924 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY= 2023-12-15T23:08:06.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY=', 'Content-Length': '0'} 2023-12-15T23:08:06.926 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c399838e98b54bd0-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.926 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:06.926 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:06.927 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.927 DEBUG:boto:Path: /kskgfn-39/obj6 2023-12-15T23:08:06.927 DEBUG:boto:Data: 2023-12-15T23:08:06.927 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.927 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.927 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.927 DEBUG:boto:Params: {} 2023-12-15T23:08:06.927 DEBUG:boto:Token: None 2023-12-15T23:08:06.927 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/obj6 2023-12-15T23:08:06.928 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qzOocWOL1Xlspk7dy6AtFrq0oEM= 2023-12-15T23:08:06.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qzOocWOL1Xlspk7dy6AtFrq0oEM='} 2023-12-15T23:08:06.969 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000017aa16156077bca3-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.970 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:06.970 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:06.970 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.970 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:06.970 DEBUG:boto:Data: 2023-12-15T23:08:06.970 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.970 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.970 DEBUG:boto:Params: {} 2023-12-15T23:08:06.971 DEBUG:boto:Token: None 2023-12-15T23:08:06.971 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/ 2023-12-15T23:08:06.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY= 2023-12-15T23:08:06.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY=', 'Content-Length': '0'} 2023-12-15T23:08:06.973 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db1b8142e91c179a-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.973 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:06.974 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:06.974 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.974 DEBUG:boto:Path: /kskgfn-39/obj7 2023-12-15T23:08:06.974 DEBUG:boto:Data: 2023-12-15T23:08:06.974 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.974 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.974 DEBUG:boto:Params: {} 2023-12-15T23:08:06.974 DEBUG:boto:Token: None 2023-12-15T23:08:06.974 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/obj7 2023-12-15T23:08:06.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UYXicOzYHajE4MYee+9D5A78Q2A= 2023-12-15T23:08:06.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UYXicOzYHajE4MYee+9D5A78Q2A='} 2023-12-15T23:08:06.980 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008573cec6564b6ba9-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.980 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:06.980 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:06.980 DEBUG:boto:Method: HEAD 2023-12-15T23:08:06.980 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:06.980 DEBUG:boto:Data: 2023-12-15T23:08:06.980 DEBUG:boto:Headers: {} 2023-12-15T23:08:06.980 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.981 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.981 DEBUG:boto:Params: {} 2023-12-15T23:08:06.981 DEBUG:boto:Token: None 2023-12-15T23:08:06.981 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/ 2023-12-15T23:08:06.981 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY= 2023-12-15T23:08:06.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwpOsXmVxZMvrkyTd0QrLY9eCYY=', 'Content-Length': '0'} 2023-12-15T23:08:06.983 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000f189c35f50ddfb-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.983 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:06.983 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:06.983 DEBUG:boto:Method: PUT 2023-12-15T23:08:06.984 DEBUG:boto:Path: /kskgfn-39/obj8 2023-12-15T23:08:06.984 DEBUG:boto:Data: 2023-12-15T23:08:06.984 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2023-12-15T23:08:06.984 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:06.984 DEBUG:boto:Port: 8000 2023-12-15T23:08:06.984 DEBUG:boto:Params: {} 2023-12-15T23:08:06.984 DEBUG:boto:Token: None 2023-12-15T23:08:06.984 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Fri, 15 Dec 2023 23:08:06 GMT /kskgfn-39/obj8 2023-12-15T23:08:06.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z4GxMOYeKyOXOeKbLmiji1oaiY4= 2023-12-15T23:08:06.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z4GxMOYeKyOXOeKbLmiji1oaiY4='} 2023-12-15T23:08:06.988 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a18bfc2ed48563d5-00657cdc56-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:06.989 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'kskgfn-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:06.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'kskgfn-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:06.989 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket kskgfn-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:08:07.043 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:07.043 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:07.119 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'kskgfn-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:07.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'kskgfn-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:08:07.120 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket kskgfn-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:08:07.167 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:07.167 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:07.239 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-38 2023-12-15T23:08:07.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:07.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:07.240 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:07.297 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:07.297 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:07.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:07.333+0000 7f18b4b2c800 1 waiting to reach incremental sync.. 2023-12-15T23:08:12.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:12.334+0000 7f18b4b2c800 1 bucket sync caught up with source: 2023-12-15T23:08:12.335 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000004.38.1, 00000000002.24.1, 00000000004.39.1, 00000000002.20.1, 00000000004.20.1, 00000000002.119.1, 00000000002.27.1, 00000000004.120.1, 00000000002.16.1, 00000000002.12.1, 00000000002.45.1] 2023-12-15T23:08:12.335 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000004.38.1, 00000000002.24.1, 00000000004.39.1, 00000000002.20.1, 00000000004.20.1, 00000000002.119.1, 00000000002.27.1, 00000000004.120.1, 00000000002.16.1, 00000000002.12.1, 00000000002.45.1] 2023-12-15T23:08:12.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:12.334+0000 7f18b4b2c800 0 bucket checkpoint complete 2023-12-15T23:08:12.354 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-38 2023-12-15T23:08:12.354 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:12.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:12.355 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:12.417 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:12.417 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:12.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:12.455+0000 7f0e03522800 1 waiting to reach incremental sync.. 2023-12-15T23:08:17.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:17.456+0000 7f0e03522800 1 waiting to reach incremental sync.. 2023-12-15T23:08:22.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:22.456+0000 7f0e03522800 1 waiting to reach incremental sync.. 2023-12-15T23:08:27.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:27.457+0000 7f0e03522800 1 waiting to reach incremental sync.. 2023-12-15T23:08:32.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:32.458+0000 7f0e03522800 1 bucket sync caught up with source: 2023-12-15T23:08:32.462 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000004.106.6, 00000000002.43.1, 00000000004.104.6, 00000000002.57.1, 00000000004.46.6, 00000000002.114.1, 00000000002.69.1, 00000000004.121.6, 00000000002.50.1, 00000000002.35.1, 00000000002.126.1] 2023-12-15T23:08:32.462 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000004.106.6, 00000000002.43.1, 00000000004.104.6, 00000000002.57.1, 00000000004.46.6, 00000000002.114.1, 00000000002.69.1, 00000000004.121.6, 00000000002.50.1, 00000000002.35.1, 00000000002.126.1] 2023-12-15T23:08:32.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:32.458+0000 7f0e03522800 0 bucket checkpoint complete 2023-12-15T23:08:32.479 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-38 zones={test-zone2, test-zone1} 2023-12-15T23:08:32.479 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.480 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.480 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.480 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:32.480 DEBUG:boto:Data: 2023-12-15T23:08:32.480 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.480 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.480 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.480 DEBUG:boto:Params: {} 2023-12-15T23:08:32.481 DEBUG:boto:Token: None 2023-12-15T23:08:32.481 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.481 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:anD9dlkz78eMf55vzgI7bEKgQww= 2023-12-15T23:08:32.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:anD9dlkz78eMf55vzgI7bEKgQww=', 'Content-Length': '0'} 2023-12-15T23:08:32.484 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f7c6119dfa48c1f5-00657cdc70-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.484 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.484 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.484 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.484 DEBUG:boto:Path: /kskgfn-38/ 2023-12-15T23:08:32.484 DEBUG:boto:Data: 2023-12-15T23:08:32.485 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.485 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.485 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.485 DEBUG:boto:Params: {} 2023-12-15T23:08:32.485 DEBUG:boto:Token: None 2023-12-15T23:08:32.485 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.485 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:anD9dlkz78eMf55vzgI7bEKgQww= 2023-12-15T23:08:32.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:anD9dlkz78eMf55vzgI7bEKgQww=', 'Content-Length': '0'} 2023-12-15T23:08:32.488 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003883d24ccab8ee86-00657cdc70-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.488 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:08:32.489 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.489 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.489 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.489 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.489 DEBUG:boto:Method: GET 2023-12-15T23:08:32.489 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.489 DEBUG:boto:Data: 2023-12-15T23:08:32.489 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.489 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.489 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.489 DEBUG:boto:Params: {} 2023-12-15T23:08:32.490 DEBUG:boto:Token: None 2023-12-15T23:08:32.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/?versions 2023-12-15T23:08:32.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA= 2023-12-15T23:08:32.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA=', 'Content-Length': '0'} 2023-12-15T23:08:32.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffb62c71236ac5bd-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.493 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:32.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:32.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:32.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:32.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:08:32.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:08:32.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:08:32.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:08:32.495 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:08:32.495 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.495 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.495 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.495 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.495 DEBUG:boto:Method: GET 2023-12-15T23:08:32.495 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.495 DEBUG:boto:Data: 2023-12-15T23:08:32.496 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.496 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.496 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.496 DEBUG:boto:Params: {} 2023-12-15T23:08:32.496 DEBUG:boto:Token: None 2023-12-15T23:08:32.496 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/?versions 2023-12-15T23:08:32.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA= 2023-12-15T23:08:32.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA=', 'Content-Length': '0'} 2023-12-15T23:08:32.499 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf253fe4f07a0c29-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.499 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:08:32.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:08:32.500 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.500 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.500 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.500 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.501 DEBUG:boto:Method: GET 2023-12-15T23:08:32.501 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.501 DEBUG:boto:Data: 2023-12-15T23:08:32.501 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.501 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.501 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.501 DEBUG:boto:Params: {} 2023-12-15T23:08:32.501 DEBUG:boto:Token: None 2023-12-15T23:08:32.501 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/?versions 2023-12-15T23:08:32.501 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA= 2023-12-15T23:08:32.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA=', 'Content-Length': '0'} 2023-12-15T23:08:32.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b6908836bb880bf-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.504 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.505 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.505 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.505 DEBUG:boto:path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.505 DEBUG:boto:auth_path=/kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.505 DEBUG:boto:Method: GET 2023-12-15T23:08:32.505 DEBUG:boto:Path: /kskgfn-38/?versions&max-keys=999 2023-12-15T23:08:32.506 DEBUG:boto:Data: 2023-12-15T23:08:32.506 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.506 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.506 DEBUG:boto:Params: {} 2023-12-15T23:08:32.506 DEBUG:boto:Token: None 2023-12-15T23:08:32.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/?versions 2023-12-15T23:08:32.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA= 2023-12-15T23:08:32.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JMBSd8njlr1yfc1p10RbI1yF1HA=', 'Content-Length': '0'} 2023-12-15T23:08:32.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1bd5d9287a26b79-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.509 DEBUG:boto:b'kskgfn-38999falseobj1nulltrue2023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:32.509 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.510 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.510 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.510 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.510 DEBUG:boto:Method: GET 2023-12-15T23:08:32.510 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.510 DEBUG:boto:Data: 2023-12-15T23:08:32.510 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.510 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.510 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.510 DEBUG:boto:Params: {} 2023-12-15T23:08:32.510 DEBUG:boto:Token: None 2023-12-15T23:08:32.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY= 2023-12-15T23:08:32.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY=', 'Content-Length': '0'} 2023-12-15T23:08:32.513 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a012393b18906d6f-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.513 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.513 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.513 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.513 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.513 DEBUG:boto:Method: GET 2023-12-15T23:08:32.513 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.514 DEBUG:boto:Data: 2023-12-15T23:08:32.514 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.514 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.514 DEBUG:boto:Params: {} 2023-12-15T23:08:32.514 DEBUG:boto:Token: None 2023-12-15T23:08:32.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY= 2023-12-15T23:08:32.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY=', 'Content-Length': '0'} 2023-12-15T23:08:32.516 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000afdfaf334d52c0fa-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.516 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.517 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.517 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.517 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.517 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.517 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.517 DEBUG:boto:Data: 2023-12-15T23:08:32.517 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.517 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.517 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.517 DEBUG:boto:Params: {} 2023-12-15T23:08:32.517 DEBUG:boto:Token: None 2023-12-15T23:08:32.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GVkP0SWhd3rlqm4gqPr6Zb/UicU= 2023-12-15T23:08:32.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GVkP0SWhd3rlqm4gqPr6Zb/UicU=', 'Content-Length': '0'} 2023-12-15T23:08:32.520 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000323485056340fae2-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.520 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.520 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.520 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.520 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.520 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.520 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.520 DEBUG:boto:Data: 2023-12-15T23:08:32.520 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.521 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.521 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.521 DEBUG:boto:Params: {} 2023-12-15T23:08:32.521 DEBUG:boto:Token: None 2023-12-15T23:08:32.521 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.521 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GVkP0SWhd3rlqm4gqPr6Zb/UicU= 2023-12-15T23:08:32.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GVkP0SWhd3rlqm4gqPr6Zb/UicU=', 'Content-Length': '0'} 2023-12-15T23:08:32.523 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000055eca5c0ef3b0b85-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:32.523 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.523 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.523 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.524 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.524 DEBUG:boto:Method: GET 2023-12-15T23:08:32.524 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.524 DEBUG:boto:Data: 2023-12-15T23:08:32.524 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.524 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.524 DEBUG:boto:Params: {} 2023-12-15T23:08:32.524 DEBUG:boto:Token: None 2023-12-15T23:08:32.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY= 2023-12-15T23:08:32.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY=', 'Content-Length': '0'} 2023-12-15T23:08:32.526 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000062b81a5cbeb6a1bd-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.527 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.527 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.527 DEBUG:boto:path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.527 DEBUG:boto:auth_path=/kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.527 DEBUG:boto:Method: GET 2023-12-15T23:08:32.527 DEBUG:boto:Path: /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.527 DEBUG:boto:Data: 2023-12-15T23:08:32.527 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.527 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.528 DEBUG:boto:Params: {} 2023-12-15T23:08:32.528 DEBUG:boto:Token: None 2023-12-15T23:08:32.528 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1?versionId=null 2023-12-15T23:08:32.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY= 2023-12-15T23:08:32.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlwzlHslVz94nQImyXWl6Em5VWY=', 'Content-Length': '0'} 2023-12-15T23:08:32.530 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bacfb4e2c99d3f6d-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.530 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.530 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.530 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.530 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.530 DEBUG:boto:Method: GET 2023-12-15T23:08:32.530 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.530 DEBUG:boto:Data: 2023-12-15T23:08:32.531 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.531 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.531 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.531 DEBUG:boto:Params: {} 2023-12-15T23:08:32.531 DEBUG:boto:Token: None 2023-12-15T23:08:32.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3806ed35bd9ad12-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.577 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.578 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.578 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.578 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.578 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.578 DEBUG:boto:Method: GET 2023-12-15T23:08:32.578 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.578 DEBUG:boto:Data: 2023-12-15T23:08:32.578 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.579 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.579 DEBUG:boto:Params: {} 2023-12-15T23:08:32.579 DEBUG:boto:Token: None 2023-12-15T23:08:32.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1987777bb3761fc-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.582 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.584 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.584 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.585 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.585 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:08:32.585 DEBUG:boto:Data: 2023-12-15T23:08:32.585 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.585 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.585 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.585 DEBUG:boto:Params: {} 2023-12-15T23:08:32.585 DEBUG:boto:Token: None 2023-12-15T23:08:32.586 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1 2023-12-15T23:08:32.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yobeX2oEwbIJlveybWPN1piEGBA= 2023-12-15T23:08:32.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yobeX2oEwbIJlveybWPN1piEGBA=', 'Content-Length': '0'} 2023-12-15T23:08:32.589 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000015cf4d11e25cd539-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.589 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.589 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.589 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.589 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:08:32.589 DEBUG:boto:Data: 2023-12-15T23:08:32.589 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.589 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.590 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.590 DEBUG:boto:Params: {} 2023-12-15T23:08:32.590 DEBUG:boto:Token: None 2023-12-15T23:08:32.590 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1 2023-12-15T23:08:32.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yobeX2oEwbIJlveybWPN1piEGBA= 2023-12-15T23:08:32.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yobeX2oEwbIJlveybWPN1piEGBA=', 'Content-Length': '0'} 2023-12-15T23:08:32.592 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000ac9d363e583939f-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:32.593 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.593 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.593 DEBUG:boto:Method: GET 2023-12-15T23:08:32.593 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:08:32.593 DEBUG:boto:Data: 2023-12-15T23:08:32.593 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.593 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.593 DEBUG:boto:Params: {} 2023-12-15T23:08:32.593 DEBUG:boto:Token: None 2023-12-15T23:08:32.594 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1 2023-12-15T23:08:32.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ozcuCIRXcIAD801kdbi3pjq1Q/s= 2023-12-15T23:08:32.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ozcuCIRXcIAD801kdbi3pjq1Q/s=', 'Content-Length': '0'} 2023-12-15T23:08:32.595 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051b01e32bc5e2e21-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.638 DEBUG:boto:path=/kskgfn-38/obj1 2023-12-15T23:08:32.638 DEBUG:boto:auth_path=/kskgfn-38/obj1 2023-12-15T23:08:32.638 DEBUG:boto:Method: GET 2023-12-15T23:08:32.638 DEBUG:boto:Path: /kskgfn-38/obj1 2023-12-15T23:08:32.638 DEBUG:boto:Data: 2023-12-15T23:08:32.638 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.638 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.638 DEBUG:boto:Params: {} 2023-12-15T23:08:32.638 DEBUG:boto:Token: None 2023-12-15T23:08:32.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj1 2023-12-15T23:08:32.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ozcuCIRXcIAD801kdbi3pjq1Q/s= 2023-12-15T23:08:32.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ozcuCIRXcIAD801kdbi3pjq1Q/s=', 'Content-Length': '0'} 2023-12-15T23:08:32.641 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c709369d3f9f7d07-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.641 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.641 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.641 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.641 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.642 DEBUG:boto:Method: GET 2023-12-15T23:08:32.642 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.642 DEBUG:boto:Data: 2023-12-15T23:08:32.642 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.642 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.642 DEBUG:boto:Params: {} 2023-12-15T23:08:32.642 DEBUG:boto:Token: None 2023-12-15T23:08:32.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001250346f56048b2a-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.645 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.646 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.646 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.646 DEBUG:boto:path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.646 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.646 DEBUG:boto:Method: GET 2023-12-15T23:08:32.646 DEBUG:boto:Path: /kskgfn-38/?prefix=obj1 2023-12-15T23:08:32.646 DEBUG:boto:Data: 2023-12-15T23:08:32.646 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.646 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.646 DEBUG:boto:Params: {} 2023-12-15T23:08:32.647 DEBUG:boto:Token: None 2023-12-15T23:08:32.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a505d93cb1dd7772-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.649 DEBUG:boto:b'kskgfn-38obj11000falseobj12023-12-15T23:07:53.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:32.650 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.650 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.650 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.650 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.650 DEBUG:boto:Method: GET 2023-12-15T23:08:32.651 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.651 DEBUG:boto:Data: 2023-12-15T23:08:32.651 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.651 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.651 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.651 DEBUG:boto:Params: {} 2023-12-15T23:08:32.651 DEBUG:boto:Token: None 2023-12-15T23:08:32.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU= 2023-12-15T23:08:32.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU=', 'Content-Length': '0'} 2023-12-15T23:08:32.653 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000001de8f2c6d992a48-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.653 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.654 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.654 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.654 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.654 DEBUG:boto:Method: GET 2023-12-15T23:08:32.654 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.654 DEBUG:boto:Data: 2023-12-15T23:08:32.654 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.654 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.654 DEBUG:boto:Params: {} 2023-12-15T23:08:32.655 DEBUG:boto:Token: None 2023-12-15T23:08:32.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU= 2023-12-15T23:08:32.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU=', 'Content-Length': '0'} 2023-12-15T23:08:32.656 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bb4e040890a05145-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.701 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.701 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.702 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.702 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.702 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.702 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.702 DEBUG:boto:Data: 2023-12-15T23:08:32.702 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.702 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.702 DEBUG:boto:Params: {} 2023-12-15T23:08:32.702 DEBUG:boto:Token: None 2023-12-15T23:08:32.702 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xZtNQL5xxbAbPIWhiIIPHbK3o/8= 2023-12-15T23:08:32.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xZtNQL5xxbAbPIWhiIIPHbK3o/8=', 'Content-Length': '0'} 2023-12-15T23:08:32.705 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f713e68f1abfa1e8-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.705 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.705 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.705 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.705 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.705 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.705 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.706 DEBUG:boto:Data: 2023-12-15T23:08:32.706 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.706 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.706 DEBUG:boto:Params: {} 2023-12-15T23:08:32.706 DEBUG:boto:Token: None 2023-12-15T23:08:32.706 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xZtNQL5xxbAbPIWhiIIPHbK3o/8= 2023-12-15T23:08:32.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xZtNQL5xxbAbPIWhiIIPHbK3o/8=', 'Content-Length': '0'} 2023-12-15T23:08:32.708 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000da0a0dc22bf6338-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:32.708 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.708 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.709 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.709 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.709 DEBUG:boto:Method: GET 2023-12-15T23:08:32.709 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.709 DEBUG:boto:Data: 2023-12-15T23:08:32.709 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.709 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.709 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.709 DEBUG:boto:Params: {} 2023-12-15T23:08:32.709 DEBUG:boto:Token: None 2023-12-15T23:08:32.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU= 2023-12-15T23:08:32.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU=', 'Content-Length': '0'} 2023-12-15T23:08:32.711 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007753315d9050e02a-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.753 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.754 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.754 DEBUG:boto:path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.754 DEBUG:boto:auth_path=/kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.754 DEBUG:boto:Method: GET 2023-12-15T23:08:32.754 DEBUG:boto:Path: /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.754 DEBUG:boto:Data: 2023-12-15T23:08:32.754 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.754 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.754 DEBUG:boto:Params: {} 2023-12-15T23:08:32.754 DEBUG:boto:Token: None 2023-12-15T23:08:32.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2?versionId=null 2023-12-15T23:08:32.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU= 2023-12-15T23:08:32.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7Rux2Dm+B663rhSueAW0GUbrlLU=', 'Content-Length': '0'} 2023-12-15T23:08:32.756 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e98a5a7f4e53b98-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.757 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.757 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.757 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.757 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.757 DEBUG:boto:Method: GET 2023-12-15T23:08:32.757 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.757 DEBUG:boto:Data: 2023-12-15T23:08:32.758 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.758 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.758 DEBUG:boto:Params: {} 2023-12-15T23:08:32.758 DEBUG:boto:Token: None 2023-12-15T23:08:32.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d12fd6bff2bd447-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.802 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.803 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.803 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.803 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.803 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.803 DEBUG:boto:Method: GET 2023-12-15T23:08:32.804 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.804 DEBUG:boto:Data: 2023-12-15T23:08:32.804 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.804 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.804 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.804 DEBUG:boto:Params: {} 2023-12-15T23:08:32.804 DEBUG:boto:Token: None 2023-12-15T23:08:32.804 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.807 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d23ed3ec6c9eb002-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.807 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.808 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.808 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.808 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.808 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:08:32.808 DEBUG:boto:Data: 2023-12-15T23:08:32.808 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.808 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.809 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.809 DEBUG:boto:Params: {} 2023-12-15T23:08:32.809 DEBUG:boto:Token: None 2023-12-15T23:08:32.809 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2 2023-12-15T23:08:32.809 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o8q8cTO6GK/Orr11dHJ/w5ouQCQ= 2023-12-15T23:08:32.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o8q8cTO6GK/Orr11dHJ/w5ouQCQ=', 'Content-Length': '0'} 2023-12-15T23:08:32.811 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000afd6cf81c04a017c-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.811 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.812 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.812 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.812 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:08:32.812 DEBUG:boto:Data: 2023-12-15T23:08:32.812 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.812 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.812 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.812 DEBUG:boto:Params: {} 2023-12-15T23:08:32.812 DEBUG:boto:Token: None 2023-12-15T23:08:32.813 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2 2023-12-15T23:08:32.813 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o8q8cTO6GK/Orr11dHJ/w5ouQCQ= 2023-12-15T23:08:32.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o8q8cTO6GK/Orr11dHJ/w5ouQCQ=', 'Content-Length': '0'} 2023-12-15T23:08:32.815 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cf0dca81e8a07473-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:32.815 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.816 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.816 DEBUG:boto:Method: GET 2023-12-15T23:08:32.816 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:08:32.816 DEBUG:boto:Data: 2023-12-15T23:08:32.816 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.816 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.816 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.816 DEBUG:boto:Params: {} 2023-12-15T23:08:32.816 DEBUG:boto:Token: None 2023-12-15T23:08:32.816 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2 2023-12-15T23:08:32.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c8q3u7oxWy2/HAiINPZusy1Ny9A= 2023-12-15T23:08:32.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c8q3u7oxWy2/HAiINPZusy1Ny9A=', 'Content-Length': '0'} 2023-12-15T23:08:32.818 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d5260d5a15ee62e-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.862 DEBUG:boto:path=/kskgfn-38/obj2 2023-12-15T23:08:32.862 DEBUG:boto:auth_path=/kskgfn-38/obj2 2023-12-15T23:08:32.862 DEBUG:boto:Method: GET 2023-12-15T23:08:32.862 DEBUG:boto:Path: /kskgfn-38/obj2 2023-12-15T23:08:32.862 DEBUG:boto:Data: 2023-12-15T23:08:32.862 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.862 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.862 DEBUG:boto:Params: {} 2023-12-15T23:08:32.863 DEBUG:boto:Token: None 2023-12-15T23:08:32.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj2 2023-12-15T23:08:32.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c8q3u7oxWy2/HAiINPZusy1Ny9A= 2023-12-15T23:08:32.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c8q3u7oxWy2/HAiINPZusy1Ny9A=', 'Content-Length': '0'} 2023-12-15T23:08:32.865 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cfb063e3cc1df16e-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.865 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.865 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.865 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.865 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.865 DEBUG:boto:Method: GET 2023-12-15T23:08:32.866 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.866 DEBUG:boto:Data: 2023-12-15T23:08:32.866 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.866 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.866 DEBUG:boto:Params: {} 2023-12-15T23:08:32.866 DEBUG:boto:Token: None 2023-12-15T23:08:32.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6cf3669a0c123d2-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.869 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.869 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.869 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.870 DEBUG:boto:path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.870 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.870 DEBUG:boto:Method: GET 2023-12-15T23:08:32.870 DEBUG:boto:Path: /kskgfn-38/?prefix=obj2 2023-12-15T23:08:32.870 DEBUG:boto:Data: 2023-12-15T23:08:32.870 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.870 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.870 DEBUG:boto:Params: {} 2023-12-15T23:08:32.870 DEBUG:boto:Token: None 2023-12-15T23:08:32.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fd85814e99ea492-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.873 DEBUG:boto:b'kskgfn-38obj21000falseobj22023-12-15T23:07:53.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:32.874 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.874 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.874 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.874 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.874 DEBUG:boto:Method: GET 2023-12-15T23:08:32.874 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.874 DEBUG:boto:Data: 2023-12-15T23:08:32.874 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.875 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.875 DEBUG:boto:Params: {} 2023-12-15T23:08:32.875 DEBUG:boto:Token: None 2023-12-15T23:08:32.875 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98= 2023-12-15T23:08:32.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98=', 'Content-Length': '0'} 2023-12-15T23:08:32.877 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000858a42b05a19ab64-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.877 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.877 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.877 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.878 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.878 DEBUG:boto:Method: GET 2023-12-15T23:08:32.878 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.878 DEBUG:boto:Data: 2023-12-15T23:08:32.878 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.878 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.878 DEBUG:boto:Params: {} 2023-12-15T23:08:32.878 DEBUG:boto:Token: None 2023-12-15T23:08:32.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98= 2023-12-15T23:08:32.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98=', 'Content-Length': '0'} 2023-12-15T23:08:32.881 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003b4feb318a7510f1-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.881 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.881 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.881 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.881 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.881 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.882 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.882 DEBUG:boto:Data: 2023-12-15T23:08:32.882 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.882 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.882 DEBUG:boto:Params: {} 2023-12-15T23:08:32.882 DEBUG:boto:Token: None 2023-12-15T23:08:32.882 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NiS7dAYZDvRk/c3qhkwesSxYAsw= 2023-12-15T23:08:32.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NiS7dAYZDvRk/c3qhkwesSxYAsw=', 'Content-Length': '0'} 2023-12-15T23:08:32.884 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2aa071ec6ce027a-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.885 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.885 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.885 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.885 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.885 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.885 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.885 DEBUG:boto:Data: 2023-12-15T23:08:32.885 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.885 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.885 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.886 DEBUG:boto:Params: {} 2023-12-15T23:08:32.886 DEBUG:boto:Token: None 2023-12-15T23:08:32.886 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NiS7dAYZDvRk/c3qhkwesSxYAsw= 2023-12-15T23:08:32.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NiS7dAYZDvRk/c3qhkwesSxYAsw=', 'Content-Length': '0'} 2023-12-15T23:08:32.888 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f22f4e5936c7fb47-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:32.889 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.889 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.889 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.889 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.889 DEBUG:boto:Method: GET 2023-12-15T23:08:32.889 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.889 DEBUG:boto:Data: 2023-12-15T23:08:32.889 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.889 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.889 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.890 DEBUG:boto:Params: {} 2023-12-15T23:08:32.890 DEBUG:boto:Token: None 2023-12-15T23:08:32.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98= 2023-12-15T23:08:32.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98=', 'Content-Length': '0'} 2023-12-15T23:08:32.892 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007a6c97c77510bbfc-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.934 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.934 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.934 DEBUG:boto:path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.934 DEBUG:boto:auth_path=/kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.934 DEBUG:boto:Method: GET 2023-12-15T23:08:32.934 DEBUG:boto:Path: /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.934 DEBUG:boto:Data: 2023-12-15T23:08:32.934 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.935 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.935 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.935 DEBUG:boto:Params: {} 2023-12-15T23:08:32.935 DEBUG:boto:Token: None 2023-12-15T23:08:32.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3?versionId=null 2023-12-15T23:08:32.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98= 2023-12-15T23:08:32.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmdW9c1ruyP9b1QSEcocvbBJd98=', 'Content-Length': '0'} 2023-12-15T23:08:32.937 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009eedcead2182f537-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.938 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.938 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.938 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.938 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.938 DEBUG:boto:Method: GET 2023-12-15T23:08:32.938 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.938 DEBUG:boto:Data: 2023-12-15T23:08:32.939 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.939 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.939 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.939 DEBUG:boto:Params: {} 2023-12-15T23:08:32.939 DEBUG:boto:Token: None 2023-12-15T23:08:32.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004774e9867b4ca445-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.985 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.986 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:32.986 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:32.986 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.986 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.986 DEBUG:boto:Method: GET 2023-12-15T23:08:32.986 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:32.986 DEBUG:boto:Data: 2023-12-15T23:08:32.986 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.987 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.987 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.987 DEBUG:boto:Params: {} 2023-12-15T23:08:32.987 DEBUG:boto:Token: None 2023-12-15T23:08:32.987 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/ 2023-12-15T23:08:32.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI= 2023-12-15T23:08:32.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqAMEyIEhHRJrPXgfCL3UENIcAI=', 'Content-Length': '0'} 2023-12-15T23:08:32.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c5b7ebae44da7f9-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.990 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:32.990 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.990 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.990 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.991 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:32.991 DEBUG:boto:Data: 2023-12-15T23:08:32.992 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.992 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:32.992 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.992 DEBUG:boto:Params: {} 2023-12-15T23:08:32.993 DEBUG:boto:Token: None 2023-12-15T23:08:32.993 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3 2023-12-15T23:08:32.993 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TxYZ/g7+JLfYfpynqbtd2gs7aJ0= 2023-12-15T23:08:32.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TxYZ/g7+JLfYfpynqbtd2gs7aJ0=', 'Content-Length': '0'} 2023-12-15T23:08:32.995 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001ee59c2f6d4bd592-00657cdc70-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.995 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.995 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.996 DEBUG:boto:Method: HEAD 2023-12-15T23:08:32.996 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:32.996 DEBUG:boto:Data: 2023-12-15T23:08:32.996 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.996 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:32.996 DEBUG:boto:Port: 8000 2023-12-15T23:08:32.996 DEBUG:boto:Params: {} 2023-12-15T23:08:32.996 DEBUG:boto:Token: None 2023-12-15T23:08:32.996 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:32 GMT /kskgfn-38/obj3 2023-12-15T23:08:32.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TxYZ/g7+JLfYfpynqbtd2gs7aJ0= 2023-12-15T23:08:32.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TxYZ/g7+JLfYfpynqbtd2gs7aJ0=', 'Content-Length': '0'} 2023-12-15T23:08:32.998 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b9085779412f409b-00657cdc70-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:32.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:32.999 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:32.999 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:32.999 DEBUG:boto:Method: GET 2023-12-15T23:08:32.999 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:32.999 DEBUG:boto:Data: 2023-12-15T23:08:32.999 DEBUG:boto:Headers: {} 2023-12-15T23:08:32.999 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.000 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.000 DEBUG:boto:Params: {} 2023-12-15T23:08:33.000 DEBUG:boto:Token: None 2023-12-15T23:08:33.000 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj3 2023-12-15T23:08:33.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A+9c2jeHgLFfaLREQzBNVsJ8OrY= 2023-12-15T23:08:33.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A+9c2jeHgLFfaLREQzBNVsJ8OrY=', 'Content-Length': '0'} 2023-12-15T23:08:33.002 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000667d64954ab90370-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.046 DEBUG:boto:path=/kskgfn-38/obj3 2023-12-15T23:08:33.046 DEBUG:boto:auth_path=/kskgfn-38/obj3 2023-12-15T23:08:33.046 DEBUG:boto:Method: GET 2023-12-15T23:08:33.046 DEBUG:boto:Path: /kskgfn-38/obj3 2023-12-15T23:08:33.046 DEBUG:boto:Data: 2023-12-15T23:08:33.046 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.046 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.046 DEBUG:boto:Params: {} 2023-12-15T23:08:33.047 DEBUG:boto:Token: None 2023-12-15T23:08:33.047 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj3 2023-12-15T23:08:33.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A+9c2jeHgLFfaLREQzBNVsJ8OrY= 2023-12-15T23:08:33.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A+9c2jeHgLFfaLREQzBNVsJ8OrY=', 'Content-Length': '0'} 2023-12-15T23:08:33.049 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000005ba6509899558c5-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.049 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.049 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.050 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.050 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.050 DEBUG:boto:Method: GET 2023-12-15T23:08:33.050 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.050 DEBUG:boto:Data: 2023-12-15T23:08:33.050 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.050 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.050 DEBUG:boto:Params: {} 2023-12-15T23:08:33.050 DEBUG:boto:Token: None 2023-12-15T23:08:33.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.053 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077427fda00a74596-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.053 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.054 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.054 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.054 DEBUG:boto:path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.054 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.054 DEBUG:boto:Method: GET 2023-12-15T23:08:33.054 DEBUG:boto:Path: /kskgfn-38/?prefix=obj3 2023-12-15T23:08:33.054 DEBUG:boto:Data: 2023-12-15T23:08:33.054 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.055 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.055 DEBUG:boto:Params: {} 2023-12-15T23:08:33.055 DEBUG:boto:Token: None 2023-12-15T23:08:33.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000094ba2e76439d89a-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.058 DEBUG:boto:b'kskgfn-38obj31000falseobj32023-12-15T23:07:53.988Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:33.058 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.058 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.058 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.058 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.059 DEBUG:boto:Method: GET 2023-12-15T23:08:33.059 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.059 DEBUG:boto:Data: 2023-12-15T23:08:33.059 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.059 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.059 DEBUG:boto:Params: {} 2023-12-15T23:08:33.059 DEBUG:boto:Token: None 2023-12-15T23:08:33.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8= 2023-12-15T23:08:33.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8=', 'Content-Length': '0'} 2023-12-15T23:08:33.061 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fda52f5758fd4c1a-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.062 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.062 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.062 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.062 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.062 DEBUG:boto:Method: GET 2023-12-15T23:08:33.062 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.062 DEBUG:boto:Data: 2023-12-15T23:08:33.062 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.063 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.063 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.063 DEBUG:boto:Params: {} 2023-12-15T23:08:33.063 DEBUG:boto:Token: None 2023-12-15T23:08:33.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8= 2023-12-15T23:08:33.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8=', 'Content-Length': '0'} 2023-12-15T23:08:33.065 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050bc8fe25423d862-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.065 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.066 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.066 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.066 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.066 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.066 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.066 DEBUG:boto:Data: 2023-12-15T23:08:33.066 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.066 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.066 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.066 DEBUG:boto:Params: {} 2023-12-15T23:08:33.067 DEBUG:boto:Token: None 2023-12-15T23:08:33.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m96kQXCltv6VUUfl9pdGJQ2jqIk= 2023-12-15T23:08:33.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m96kQXCltv6VUUfl9pdGJQ2jqIk=', 'Content-Length': '0'} 2023-12-15T23:08:33.069 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000040ba95ae30889749-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.069 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.069 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.069 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.069 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.070 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.070 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.070 DEBUG:boto:Data: 2023-12-15T23:08:33.070 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.070 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.070 DEBUG:boto:Params: {} 2023-12-15T23:08:33.070 DEBUG:boto:Token: None 2023-12-15T23:08:33.070 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m96kQXCltv6VUUfl9pdGJQ2jqIk= 2023-12-15T23:08:33.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m96kQXCltv6VUUfl9pdGJQ2jqIk=', 'Content-Length': '0'} 2023-12-15T23:08:33.072 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a20456370d61c446-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:33.073 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.073 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.073 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.073 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.073 DEBUG:boto:Method: GET 2023-12-15T23:08:33.073 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.073 DEBUG:boto:Data: 2023-12-15T23:08:33.073 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.073 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.073 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.074 DEBUG:boto:Params: {} 2023-12-15T23:08:33.074 DEBUG:boto:Token: None 2023-12-15T23:08:33.074 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8= 2023-12-15T23:08:33.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8=', 'Content-Length': '0'} 2023-12-15T23:08:33.076 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e35457cb5f51fcfe-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.118 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.118 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.118 DEBUG:boto:path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.118 DEBUG:boto:auth_path=/kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.118 DEBUG:boto:Method: GET 2023-12-15T23:08:33.118 DEBUG:boto:Path: /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.118 DEBUG:boto:Data: 2023-12-15T23:08:33.118 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.118 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.118 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.118 DEBUG:boto:Params: {} 2023-12-15T23:08:33.119 DEBUG:boto:Token: None 2023-12-15T23:08:33.119 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4?versionId=null 2023-12-15T23:08:33.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8= 2023-12-15T23:08:33.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HHRSgKqXawR3Eb88Cwa1GnKPvI8=', 'Content-Length': '0'} 2023-12-15T23:08:33.121 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000316e089e98384f50-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.121 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.121 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.121 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.122 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.122 DEBUG:boto:Method: GET 2023-12-15T23:08:33.122 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.122 DEBUG:boto:Data: 2023-12-15T23:08:33.122 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.122 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.122 DEBUG:boto:Params: {} 2023-12-15T23:08:33.122 DEBUG:boto:Token: None 2023-12-15T23:08:33.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001732535b75344464-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.125 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.125 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.126 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.126 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.126 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.126 DEBUG:boto:Method: GET 2023-12-15T23:08:33.126 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.126 DEBUG:boto:Data: 2023-12-15T23:08:33.126 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.126 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.126 DEBUG:boto:Params: {} 2023-12-15T23:08:33.126 DEBUG:boto:Token: None 2023-12-15T23:08:33.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e35a0150c6d627b-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.130 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.130 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.130 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.130 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.130 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:33.130 DEBUG:boto:Data: 2023-12-15T23:08:33.130 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.131 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.131 DEBUG:boto:Params: {} 2023-12-15T23:08:33.131 DEBUG:boto:Token: None 2023-12-15T23:08:33.131 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4 2023-12-15T23:08:33.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:62W/t47f8h5mBpX1l5Oeis4/57o= 2023-12-15T23:08:33.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:62W/t47f8h5mBpX1l5Oeis4/57o=', 'Content-Length': '0'} 2023-12-15T23:08:33.133 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000098a5444fb1bd173e-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.133 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.133 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.133 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.134 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:33.134 DEBUG:boto:Data: 2023-12-15T23:08:33.134 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.134 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.134 DEBUG:boto:Params: {} 2023-12-15T23:08:33.134 DEBUG:boto:Token: None 2023-12-15T23:08:33.134 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4 2023-12-15T23:08:33.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:62W/t47f8h5mBpX1l5Oeis4/57o= 2023-12-15T23:08:33.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:62W/t47f8h5mBpX1l5Oeis4/57o=', 'Content-Length': '0'} 2023-12-15T23:08:33.137 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003025dd754b45d926-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:33.137 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.137 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.137 DEBUG:boto:Method: GET 2023-12-15T23:08:33.137 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:33.137 DEBUG:boto:Data: 2023-12-15T23:08:33.137 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.138 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.138 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.138 DEBUG:boto:Params: {} 2023-12-15T23:08:33.138 DEBUG:boto:Token: None 2023-12-15T23:08:33.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4 2023-12-15T23:08:33.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:94DImpw/bpBULwm5gTvbRBm4YWg= 2023-12-15T23:08:33.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:94DImpw/bpBULwm5gTvbRBm4YWg=', 'Content-Length': '0'} 2023-12-15T23:08:33.140 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002186cfb92d445c29-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.181 DEBUG:boto:path=/kskgfn-38/obj4 2023-12-15T23:08:33.182 DEBUG:boto:auth_path=/kskgfn-38/obj4 2023-12-15T23:08:33.182 DEBUG:boto:Method: GET 2023-12-15T23:08:33.182 DEBUG:boto:Path: /kskgfn-38/obj4 2023-12-15T23:08:33.182 DEBUG:boto:Data: 2023-12-15T23:08:33.182 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.182 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.182 DEBUG:boto:Params: {} 2023-12-15T23:08:33.182 DEBUG:boto:Token: None 2023-12-15T23:08:33.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj4 2023-12-15T23:08:33.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:94DImpw/bpBULwm5gTvbRBm4YWg= 2023-12-15T23:08:33.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:94DImpw/bpBULwm5gTvbRBm4YWg=', 'Content-Length': '0'} 2023-12-15T23:08:33.185 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ee0c4f311c18bd79-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.185 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.185 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.186 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.186 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.186 DEBUG:boto:Method: GET 2023-12-15T23:08:33.186 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.186 DEBUG:boto:Data: 2023-12-15T23:08:33.186 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.186 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.186 DEBUG:boto:Params: {} 2023-12-15T23:08:33.186 DEBUG:boto:Token: None 2023-12-15T23:08:33.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bf0052986066adc-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.189 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.190 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.190 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.190 DEBUG:boto:path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.190 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.190 DEBUG:boto:Method: GET 2023-12-15T23:08:33.190 DEBUG:boto:Path: /kskgfn-38/?prefix=obj4 2023-12-15T23:08:33.190 DEBUG:boto:Data: 2023-12-15T23:08:33.190 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.191 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.191 DEBUG:boto:Params: {} 2023-12-15T23:08:33.191 DEBUG:boto:Token: None 2023-12-15T23:08:33.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.193 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e9052ecf02802fa-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.194 DEBUG:boto:b'kskgfn-38obj41000falseobj42023-12-15T23:07:53.999Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:33.194 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.194 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.194 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.194 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.194 DEBUG:boto:Method: GET 2023-12-15T23:08:33.194 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.195 DEBUG:boto:Data: 2023-12-15T23:08:33.196 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.196 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.196 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.196 DEBUG:boto:Params: {} 2023-12-15T23:08:33.196 DEBUG:boto:Token: None 2023-12-15T23:08:33.196 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio= 2023-12-15T23:08:33.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio=', 'Content-Length': '0'} 2023-12-15T23:08:33.199 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000921e67d7cbf23cb-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.199 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.200 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.200 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.200 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.200 DEBUG:boto:Method: GET 2023-12-15T23:08:33.200 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.200 DEBUG:boto:Data: 2023-12-15T23:08:33.200 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.200 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.200 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.200 DEBUG:boto:Params: {} 2023-12-15T23:08:33.200 DEBUG:boto:Token: None 2023-12-15T23:08:33.201 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.201 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio= 2023-12-15T23:08:33.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio=', 'Content-Length': '0'} 2023-12-15T23:08:33.202 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009233f59f59b8001d-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.245 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.246 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.246 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.246 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.246 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.246 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.246 DEBUG:boto:Data: 2023-12-15T23:08:33.246 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.246 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.246 DEBUG:boto:Params: {} 2023-12-15T23:08:33.246 DEBUG:boto:Token: None 2023-12-15T23:08:33.246 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v4raG9Oh3qniFFsU/0ffRv4wc2c= 2023-12-15T23:08:33.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v4raG9Oh3qniFFsU/0ffRv4wc2c=', 'Content-Length': '0'} 2023-12-15T23:08:33.248 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008584d2fd105ec8a1-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.249 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.249 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.249 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.249 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.249 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.249 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.249 DEBUG:boto:Data: 2023-12-15T23:08:33.249 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.249 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.249 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.250 DEBUG:boto:Params: {} 2023-12-15T23:08:33.250 DEBUG:boto:Token: None 2023-12-15T23:08:33.250 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v4raG9Oh3qniFFsU/0ffRv4wc2c= 2023-12-15T23:08:33.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v4raG9Oh3qniFFsU/0ffRv4wc2c=', 'Content-Length': '0'} 2023-12-15T23:08:33.252 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b74399d49144fe18-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:33.252 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.252 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.252 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.252 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.253 DEBUG:boto:Method: GET 2023-12-15T23:08:33.253 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.253 DEBUG:boto:Data: 2023-12-15T23:08:33.253 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.253 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.253 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.253 DEBUG:boto:Params: {} 2023-12-15T23:08:33.253 DEBUG:boto:Token: None 2023-12-15T23:08:33.253 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.253 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio= 2023-12-15T23:08:33.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio=', 'Content-Length': '0'} 2023-12-15T23:08:33.255 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f08b1868b5b65093-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.297 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.298 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.298 DEBUG:boto:path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.298 DEBUG:boto:auth_path=/kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.298 DEBUG:boto:Method: GET 2023-12-15T23:08:33.298 DEBUG:boto:Path: /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.298 DEBUG:boto:Data: 2023-12-15T23:08:33.298 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.298 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.298 DEBUG:boto:Params: {} 2023-12-15T23:08:33.298 DEBUG:boto:Token: None 2023-12-15T23:08:33.299 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5?versionId=null 2023-12-15T23:08:33.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio= 2023-12-15T23:08:33.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AJniiP2RWA3dnQu/6LzIIqawaio=', 'Content-Length': '0'} 2023-12-15T23:08:33.300 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003ac15b9dedc7153c-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.301 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.301 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.301 DEBUG:boto:path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.301 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.301 DEBUG:boto:Method: GET 2023-12-15T23:08:33.301 DEBUG:boto:Path: /kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.301 DEBUG:boto:Data: 2023-12-15T23:08:33.301 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.302 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.302 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.302 DEBUG:boto:Params: {} 2023-12-15T23:08:33.302 DEBUG:boto:Token: None 2023-12-15T23:08:33.302 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.304 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3aaf136a8dc06db-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.345 DEBUG:boto:b'kskgfn-38obj51000falseobj52023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.346 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.346 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.346 DEBUG:boto:path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.346 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.346 DEBUG:boto:Method: GET 2023-12-15T23:08:33.346 DEBUG:boto:Path: /kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.346 DEBUG:boto:Data: 2023-12-15T23:08:33.347 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.347 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.347 DEBUG:boto:Params: {} 2023-12-15T23:08:33.347 DEBUG:boto:Token: None 2023-12-15T23:08:33.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009abcb339ca44e707-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.350 DEBUG:boto:b'kskgfn-38obj51000falseobj52023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.350 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.350 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.350 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.350 DEBUG:boto:Path: /kskgfn-38/obj5 2023-12-15T23:08:33.350 DEBUG:boto:Data: 2023-12-15T23:08:33.351 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.351 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.351 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.351 DEBUG:boto:Params: {} 2023-12-15T23:08:33.351 DEBUG:boto:Token: None 2023-12-15T23:08:33.351 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5 2023-12-15T23:08:33.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TZyc0CM6xmciWG7qnhXKELl9NOE= 2023-12-15T23:08:33.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TZyc0CM6xmciWG7qnhXKELl9NOE=', 'Content-Length': '0'} 2023-12-15T23:08:33.353 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000562c6d1fa4b00897-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.353 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.353 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.354 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.354 DEBUG:boto:Path: /kskgfn-38/obj5 2023-12-15T23:08:33.354 DEBUG:boto:Data: 2023-12-15T23:08:33.354 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.354 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.354 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.354 DEBUG:boto:Params: {} 2023-12-15T23:08:33.354 DEBUG:boto:Token: None 2023-12-15T23:08:33.354 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5 2023-12-15T23:08:33.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TZyc0CM6xmciWG7qnhXKELl9NOE= 2023-12-15T23:08:33.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TZyc0CM6xmciWG7qnhXKELl9NOE=', 'Content-Length': '0'} 2023-12-15T23:08:33.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1b7a301d782eea7-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:33.357 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.357 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.357 DEBUG:boto:Method: GET 2023-12-15T23:08:33.357 DEBUG:boto:Path: /kskgfn-38/obj5 2023-12-15T23:08:33.357 DEBUG:boto:Data: 2023-12-15T23:08:33.357 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.357 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.357 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.357 DEBUG:boto:Params: {} 2023-12-15T23:08:33.358 DEBUG:boto:Token: None 2023-12-15T23:08:33.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5 2023-12-15T23:08:33.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rCu4aMfRfx7FQHcovdVK3bleXUg= 2023-12-15T23:08:33.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rCu4aMfRfx7FQHcovdVK3bleXUg=', 'Content-Length': '0'} 2023-12-15T23:08:33.360 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e8b7aafec19b69e8-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.401 DEBUG:boto:path=/kskgfn-38/obj5 2023-12-15T23:08:33.402 DEBUG:boto:auth_path=/kskgfn-38/obj5 2023-12-15T23:08:33.402 DEBUG:boto:Method: GET 2023-12-15T23:08:33.402 DEBUG:boto:Path: /kskgfn-38/obj5 2023-12-15T23:08:33.402 DEBUG:boto:Data: 2023-12-15T23:08:33.402 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.402 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.402 DEBUG:boto:Params: {} 2023-12-15T23:08:33.402 DEBUG:boto:Token: None 2023-12-15T23:08:33.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj5 2023-12-15T23:08:33.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rCu4aMfRfx7FQHcovdVK3bleXUg= 2023-12-15T23:08:33.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rCu4aMfRfx7FQHcovdVK3bleXUg=', 'Content-Length': '0'} 2023-12-15T23:08:33.404 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd90f50cb94ff084-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.405 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.405 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.405 DEBUG:boto:path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.405 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.405 DEBUG:boto:Method: GET 2023-12-15T23:08:33.405 DEBUG:boto:Path: /kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.405 DEBUG:boto:Data: 2023-12-15T23:08:33.405 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.405 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.405 DEBUG:boto:Params: {} 2023-12-15T23:08:33.406 DEBUG:boto:Token: None 2023-12-15T23:08:33.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.408 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a174a1c15a7f3796-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.409 DEBUG:boto:b'kskgfn-38obj51000falseobj52023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.409 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.409 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.409 DEBUG:boto:path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.409 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.409 DEBUG:boto:Method: GET 2023-12-15T23:08:33.410 DEBUG:boto:Path: /kskgfn-38/?prefix=obj5 2023-12-15T23:08:33.410 DEBUG:boto:Data: 2023-12-15T23:08:33.410 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.410 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.410 DEBUG:boto:Params: {} 2023-12-15T23:08:33.410 DEBUG:boto:Token: None 2023-12-15T23:08:33.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000beaee5a59e1524c4-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.413 DEBUG:boto:b'kskgfn-38obj51000falseobj52023-12-15T23:08:06.798Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:33.413 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.414 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.414 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.414 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.414 DEBUG:boto:Method: GET 2023-12-15T23:08:33.414 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.414 DEBUG:boto:Data: 2023-12-15T23:08:33.414 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.414 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.414 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.414 DEBUG:boto:Params: {} 2023-12-15T23:08:33.414 DEBUG:boto:Token: None 2023-12-15T23:08:33.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE= 2023-12-15T23:08:33.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE=', 'Content-Length': '0'} 2023-12-15T23:08:33.416 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000043907253f243542e-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.417 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.417 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.417 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.417 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.417 DEBUG:boto:Method: GET 2023-12-15T23:08:33.417 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.417 DEBUG:boto:Data: 2023-12-15T23:08:33.417 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.417 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.418 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.418 DEBUG:boto:Params: {} 2023-12-15T23:08:33.418 DEBUG:boto:Token: None 2023-12-15T23:08:33.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE= 2023-12-15T23:08:33.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE=', 'Content-Length': '0'} 2023-12-15T23:08:33.420 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000000238f61bca69879-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.420 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.420 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.420 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.420 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.420 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.421 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.421 DEBUG:boto:Data: 2023-12-15T23:08:33.421 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.421 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.421 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.421 DEBUG:boto:Params: {} 2023-12-15T23:08:33.421 DEBUG:boto:Token: None 2023-12-15T23:08:33.421 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.421 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kt/PEoMQZLNiWC2fEtK+nYedAnM= 2023-12-15T23:08:33.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kt/PEoMQZLNiWC2fEtK+nYedAnM=', 'Content-Length': '0'} 2023-12-15T23:08:33.423 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b23812443590d7a6-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.423 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.424 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.424 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.424 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.424 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.424 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.424 DEBUG:boto:Data: 2023-12-15T23:08:33.424 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.424 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.424 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.424 DEBUG:boto:Params: {} 2023-12-15T23:08:33.424 DEBUG:boto:Token: None 2023-12-15T23:08:33.425 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.425 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kt/PEoMQZLNiWC2fEtK+nYedAnM= 2023-12-15T23:08:33.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kt/PEoMQZLNiWC2fEtK+nYedAnM=', 'Content-Length': '0'} 2023-12-15T23:08:33.426 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051302cb41ece61e7-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.427 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:33.427 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.427 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.427 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.427 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.427 DEBUG:boto:Method: GET 2023-12-15T23:08:33.427 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.427 DEBUG:boto:Data: 2023-12-15T23:08:33.427 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.428 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.428 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.428 DEBUG:boto:Params: {} 2023-12-15T23:08:33.428 DEBUG:boto:Token: None 2023-12-15T23:08:33.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE= 2023-12-15T23:08:33.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE=', 'Content-Length': '0'} 2023-12-15T23:08:33.430 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004f939d190a108c72-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.473 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.474 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.474 DEBUG:boto:path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.474 DEBUG:boto:auth_path=/kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.474 DEBUG:boto:Method: GET 2023-12-15T23:08:33.474 DEBUG:boto:Path: /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.474 DEBUG:boto:Data: 2023-12-15T23:08:33.474 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.474 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.474 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.474 DEBUG:boto:Params: {} 2023-12-15T23:08:33.475 DEBUG:boto:Token: None 2023-12-15T23:08:33.475 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6?versionId=null 2023-12-15T23:08:33.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE= 2023-12-15T23:08:33.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X5HGtvmpHLp7lO/z0rF5XmwAPqE=', 'Content-Length': '0'} 2023-12-15T23:08:33.477 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008e2c60854e3a9477-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.477 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.477 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.477 DEBUG:boto:path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.477 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.478 DEBUG:boto:Method: GET 2023-12-15T23:08:33.478 DEBUG:boto:Path: /kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.478 DEBUG:boto:Data: 2023-12-15T23:08:33.478 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.478 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.478 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.478 DEBUG:boto:Params: {} 2023-12-15T23:08:33.478 DEBUG:boto:Token: None 2023-12-15T23:08:33.478 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f75d948e6415ac8f-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.521 DEBUG:boto:b'kskgfn-38obj61000falseobj62023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.522 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.522 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.522 DEBUG:boto:path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.522 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.522 DEBUG:boto:Method: GET 2023-12-15T23:08:33.522 DEBUG:boto:Path: /kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.522 DEBUG:boto:Data: 2023-12-15T23:08:33.522 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.523 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.523 DEBUG:boto:Params: {} 2023-12-15T23:08:33.523 DEBUG:boto:Token: None 2023-12-15T23:08:33.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.525 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007771bbff3a15d91e-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.526 DEBUG:boto:b'kskgfn-38obj61000falseobj62023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.526 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.526 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.526 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.526 DEBUG:boto:Path: /kskgfn-38/obj6 2023-12-15T23:08:33.526 DEBUG:boto:Data: 2023-12-15T23:08:33.526 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.527 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.527 DEBUG:boto:Params: {} 2023-12-15T23:08:33.527 DEBUG:boto:Token: None 2023-12-15T23:08:33.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6 2023-12-15T23:08:33.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C4/UXFuPELd8dX26PXN2Dtxp2ts= 2023-12-15T23:08:33.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C4/UXFuPELd8dX26PXN2Dtxp2ts=', 'Content-Length': '0'} 2023-12-15T23:08:33.529 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000910d9aeae4376942-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.529 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.529 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.529 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.529 DEBUG:boto:Path: /kskgfn-38/obj6 2023-12-15T23:08:33.529 DEBUG:boto:Data: 2023-12-15T23:08:33.529 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.529 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.529 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.530 DEBUG:boto:Params: {} 2023-12-15T23:08:33.530 DEBUG:boto:Token: None 2023-12-15T23:08:33.530 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6 2023-12-15T23:08:33.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C4/UXFuPELd8dX26PXN2Dtxp2ts= 2023-12-15T23:08:33.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C4/UXFuPELd8dX26PXN2Dtxp2ts=', 'Content-Length': '0'} 2023-12-15T23:08:33.532 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c280d2ffa539145a-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:33.532 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.532 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.532 DEBUG:boto:Method: GET 2023-12-15T23:08:33.532 DEBUG:boto:Path: /kskgfn-38/obj6 2023-12-15T23:08:33.532 DEBUG:boto:Data: 2023-12-15T23:08:33.532 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.532 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.533 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.533 DEBUG:boto:Params: {} 2023-12-15T23:08:33.533 DEBUG:boto:Token: None 2023-12-15T23:08:33.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6 2023-12-15T23:08:33.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xcul2ZYdOAWDA8Fc4OfYuaE0sS0= 2023-12-15T23:08:33.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xcul2ZYdOAWDA8Fc4OfYuaE0sS0=', 'Content-Length': '0'} 2023-12-15T23:08:33.535 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003a85328c135effca-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.577 DEBUG:boto:path=/kskgfn-38/obj6 2023-12-15T23:08:33.578 DEBUG:boto:auth_path=/kskgfn-38/obj6 2023-12-15T23:08:33.578 DEBUG:boto:Method: GET 2023-12-15T23:08:33.578 DEBUG:boto:Path: /kskgfn-38/obj6 2023-12-15T23:08:33.578 DEBUG:boto:Data: 2023-12-15T23:08:33.578 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.578 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.578 DEBUG:boto:Params: {} 2023-12-15T23:08:33.578 DEBUG:boto:Token: None 2023-12-15T23:08:33.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj6 2023-12-15T23:08:33.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xcul2ZYdOAWDA8Fc4OfYuaE0sS0= 2023-12-15T23:08:33.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xcul2ZYdOAWDA8Fc4OfYuaE0sS0=', 'Content-Length': '0'} 2023-12-15T23:08:33.580 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003f17279d95f811af-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.581 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.581 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.581 DEBUG:boto:path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.581 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.581 DEBUG:boto:Method: GET 2023-12-15T23:08:33.581 DEBUG:boto:Path: /kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.581 DEBUG:boto:Data: 2023-12-15T23:08:33.581 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.582 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.582 DEBUG:boto:Params: {} 2023-12-15T23:08:33.582 DEBUG:boto:Token: None 2023-12-15T23:08:33.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0c523cc7a50c11f-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.585 DEBUG:boto:b'kskgfn-38obj61000falseobj62023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.585 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.585 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.585 DEBUG:boto:path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.586 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.586 DEBUG:boto:Method: GET 2023-12-15T23:08:33.586 DEBUG:boto:Path: /kskgfn-38/?prefix=obj6 2023-12-15T23:08:33.586 DEBUG:boto:Data: 2023-12-15T23:08:33.586 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.586 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.586 DEBUG:boto:Params: {} 2023-12-15T23:08:33.586 DEBUG:boto:Token: None 2023-12-15T23:08:33.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1390cf28c212c48-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.589 DEBUG:boto:b'kskgfn-38obj61000falseobj62023-12-15T23:08:06.807Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.590 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:33.590 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.590 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.590 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.590 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.590 DEBUG:boto:Method: GET 2023-12-15T23:08:33.590 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.590 DEBUG:boto:Data: 2023-12-15T23:08:33.591 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.591 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.591 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.591 DEBUG:boto:Params: {} 2023-12-15T23:08:33.591 DEBUG:boto:Token: None 2023-12-15T23:08:33.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k= 2023-12-15T23:08:33.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k=', 'Content-Length': '0'} 2023-12-15T23:08:33.594 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000047f0aa7ff2d21963-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.594 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.594 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.594 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.594 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.594 DEBUG:boto:Method: GET 2023-12-15T23:08:33.594 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.594 DEBUG:boto:Data: 2023-12-15T23:08:33.595 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.595 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.595 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.595 DEBUG:boto:Params: {} 2023-12-15T23:08:33.595 DEBUG:boto:Token: None 2023-12-15T23:08:33.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k= 2023-12-15T23:08:33.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k=', 'Content-Length': '0'} 2023-12-15T23:08:33.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002232fa0a78b04ce9-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.597 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.598 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.598 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.598 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.598 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.598 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.598 DEBUG:boto:Data: 2023-12-15T23:08:33.598 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.598 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.598 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.598 DEBUG:boto:Params: {} 2023-12-15T23:08:33.598 DEBUG:boto:Token: None 2023-12-15T23:08:33.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:izY2zIgi1Zwy7xXCmsHCpVGGKxQ= 2023-12-15T23:08:33.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:izY2zIgi1Zwy7xXCmsHCpVGGKxQ=', 'Content-Length': '0'} 2023-12-15T23:08:33.601 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b0da9844fb1e158a-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.601 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.601 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.601 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.601 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.601 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.601 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.602 DEBUG:boto:Data: 2023-12-15T23:08:33.602 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.602 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.602 DEBUG:boto:Params: {} 2023-12-15T23:08:33.602 DEBUG:boto:Token: None 2023-12-15T23:08:33.602 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:izY2zIgi1Zwy7xXCmsHCpVGGKxQ= 2023-12-15T23:08:33.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:izY2zIgi1Zwy7xXCmsHCpVGGKxQ=', 'Content-Length': '0'} 2023-12-15T23:08:33.605 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008bb6ac39dcf1d19e-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:33.606 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.606 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.606 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.606 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.606 DEBUG:boto:Method: GET 2023-12-15T23:08:33.606 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.606 DEBUG:boto:Data: 2023-12-15T23:08:33.606 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.607 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.607 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.607 DEBUG:boto:Params: {} 2023-12-15T23:08:33.607 DEBUG:boto:Token: None 2023-12-15T23:08:33.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k= 2023-12-15T23:08:33.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k=', 'Content-Length': '0'} 2023-12-15T23:08:33.609 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000045b51fa4558d5f80-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.649 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.650 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.650 DEBUG:boto:path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.650 DEBUG:boto:auth_path=/kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.650 DEBUG:boto:Method: GET 2023-12-15T23:08:33.650 DEBUG:boto:Path: /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.650 DEBUG:boto:Data: 2023-12-15T23:08:33.650 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.650 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.650 DEBUG:boto:Params: {} 2023-12-15T23:08:33.650 DEBUG:boto:Token: None 2023-12-15T23:08:33.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7?versionId=null 2023-12-15T23:08:33.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k= 2023-12-15T23:08:33.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5zvifLFaMNLX3qgyTqc8fz9YB1k=', 'Content-Length': '0'} 2023-12-15T23:08:33.653 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000910c18189dd5e0e7-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.653 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.653 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.654 DEBUG:boto:path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.654 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.654 DEBUG:boto:Method: GET 2023-12-15T23:08:33.654 DEBUG:boto:Path: /kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.654 DEBUG:boto:Data: 2023-12-15T23:08:33.654 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.654 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.654 DEBUG:boto:Params: {} 2023-12-15T23:08:33.654 DEBUG:boto:Token: None 2023-12-15T23:08:33.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000638280120b43e984-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.657 DEBUG:boto:b'kskgfn-38obj71000falseobj72023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.657 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.658 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.658 DEBUG:boto:path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.658 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.658 DEBUG:boto:Method: GET 2023-12-15T23:08:33.658 DEBUG:boto:Path: /kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.658 DEBUG:boto:Data: 2023-12-15T23:08:33.658 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.658 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.658 DEBUG:boto:Params: {} 2023-12-15T23:08:33.658 DEBUG:boto:Token: None 2023-12-15T23:08:33.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a8e00315726c64a-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.661 DEBUG:boto:b'kskgfn-38obj71000falseobj72023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.662 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.662 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.662 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.662 DEBUG:boto:Path: /kskgfn-38/obj7 2023-12-15T23:08:33.662 DEBUG:boto:Data: 2023-12-15T23:08:33.662 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.662 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.662 DEBUG:boto:Params: {} 2023-12-15T23:08:33.663 DEBUG:boto:Token: None 2023-12-15T23:08:33.663 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7 2023-12-15T23:08:33.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idl99O4TqJaxLNjisdEYZpxIVW4= 2023-12-15T23:08:33.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idl99O4TqJaxLNjisdEYZpxIVW4=', 'Content-Length': '0'} 2023-12-15T23:08:33.665 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d74550d8b26bd707-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.665 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.665 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.665 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.665 DEBUG:boto:Path: /kskgfn-38/obj7 2023-12-15T23:08:33.665 DEBUG:boto:Data: 2023-12-15T23:08:33.666 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.666 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.666 DEBUG:boto:Params: {} 2023-12-15T23:08:33.666 DEBUG:boto:Token: None 2023-12-15T23:08:33.666 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7 2023-12-15T23:08:33.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idl99O4TqJaxLNjisdEYZpxIVW4= 2023-12-15T23:08:33.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idl99O4TqJaxLNjisdEYZpxIVW4=', 'Content-Length': '0'} 2023-12-15T23:08:33.668 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000044c1087d2725b840-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:33.668 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.669 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.669 DEBUG:boto:Method: GET 2023-12-15T23:08:33.669 DEBUG:boto:Path: /kskgfn-38/obj7 2023-12-15T23:08:33.669 DEBUG:boto:Data: 2023-12-15T23:08:33.669 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.669 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.669 DEBUG:boto:Params: {} 2023-12-15T23:08:33.669 DEBUG:boto:Token: None 2023-12-15T23:08:33.669 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7 2023-12-15T23:08:33.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CY7M9eAToTa9JL+75bylBWCHWA= 2023-12-15T23:08:33.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CY7M9eAToTa9JL+75bylBWCHWA=', 'Content-Length': '0'} 2023-12-15T23:08:33.671 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cec9b15c7c12fed6-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.713 DEBUG:boto:path=/kskgfn-38/obj7 2023-12-15T23:08:33.714 DEBUG:boto:auth_path=/kskgfn-38/obj7 2023-12-15T23:08:33.714 DEBUG:boto:Method: GET 2023-12-15T23:08:33.714 DEBUG:boto:Path: /kskgfn-38/obj7 2023-12-15T23:08:33.714 DEBUG:boto:Data: 2023-12-15T23:08:33.714 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.714 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.714 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.714 DEBUG:boto:Params: {} 2023-12-15T23:08:33.714 DEBUG:boto:Token: None 2023-12-15T23:08:33.715 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj7 2023-12-15T23:08:33.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CY7M9eAToTa9JL+75bylBWCHWA= 2023-12-15T23:08:33.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CY7M9eAToTa9JL+75bylBWCHWA=', 'Content-Length': '0'} 2023-12-15T23:08:33.717 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f31e53d24bacbddc-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.717 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.717 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.717 DEBUG:boto:path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.717 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.717 DEBUG:boto:Method: GET 2023-12-15T23:08:33.717 DEBUG:boto:Path: /kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.717 DEBUG:boto:Data: 2023-12-15T23:08:33.718 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.718 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.718 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.718 DEBUG:boto:Params: {} 2023-12-15T23:08:33.718 DEBUG:boto:Token: None 2023-12-15T23:08:33.718 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006591f92a0eb43491-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.721 DEBUG:boto:b'kskgfn-38obj71000falseobj72023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.721 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.722 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.722 DEBUG:boto:path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.722 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.722 DEBUG:boto:Method: GET 2023-12-15T23:08:33.722 DEBUG:boto:Path: /kskgfn-38/?prefix=obj7 2023-12-15T23:08:33.722 DEBUG:boto:Data: 2023-12-15T23:08:33.722 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.722 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.722 DEBUG:boto:Params: {} 2023-12-15T23:08:33.722 DEBUG:boto:Token: None 2023-12-15T23:08:33.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013bdbfbe4df83e77-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.725 DEBUG:boto:b'kskgfn-38obj71000falseobj72023-12-15T23:08:06.857Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:33.726 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.726 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.726 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.726 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.726 DEBUG:boto:Method: GET 2023-12-15T23:08:33.726 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.726 DEBUG:boto:Data: 2023-12-15T23:08:33.726 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.727 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.727 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.727 DEBUG:boto:Params: {} 2023-12-15T23:08:33.727 DEBUG:boto:Token: None 2023-12-15T23:08:33.727 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0= 2023-12-15T23:08:33.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0=', 'Content-Length': '0'} 2023-12-15T23:08:33.729 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000401934d76d582a9-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.729 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.729 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.730 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.730 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.730 DEBUG:boto:Method: GET 2023-12-15T23:08:33.730 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.730 DEBUG:boto:Data: 2023-12-15T23:08:33.730 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.730 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.730 DEBUG:boto:Params: {} 2023-12-15T23:08:33.730 DEBUG:boto:Token: None 2023-12-15T23:08:33.730 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0= 2023-12-15T23:08:33.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0=', 'Content-Length': '0'} 2023-12-15T23:08:33.733 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bed693f277beac89-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.733 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.733 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.733 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.733 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.733 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.733 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.733 DEBUG:boto:Data: 2023-12-15T23:08:33.734 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.734 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.734 DEBUG:boto:Params: {} 2023-12-15T23:08:33.734 DEBUG:boto:Token: None 2023-12-15T23:08:33.734 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R7bDLMiI6lNWMv2S1ksIYaWAXq0= 2023-12-15T23:08:33.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R7bDLMiI6lNWMv2S1ksIYaWAXq0=', 'Content-Length': '0'} 2023-12-15T23:08:33.736 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000020eec4c333b54e71-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.736 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.736 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.736 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.736 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.737 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.737 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.737 DEBUG:boto:Data: 2023-12-15T23:08:33.737 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.737 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.737 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.737 DEBUG:boto:Params: {} 2023-12-15T23:08:33.737 DEBUG:boto:Token: None 2023-12-15T23:08:33.737 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R7bDLMiI6lNWMv2S1ksIYaWAXq0= 2023-12-15T23:08:33.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R7bDLMiI6lNWMv2S1ksIYaWAXq0=', 'Content-Length': '0'} 2023-12-15T23:08:33.739 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000357bbd64c7b0285a-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.739 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:33.740 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.740 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.740 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.740 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.740 DEBUG:boto:Method: GET 2023-12-15T23:08:33.740 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.740 DEBUG:boto:Data: 2023-12-15T23:08:33.740 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.740 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.740 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.740 DEBUG:boto:Params: {} 2023-12-15T23:08:33.741 DEBUG:boto:Token: None 2023-12-15T23:08:33.741 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.741 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0= 2023-12-15T23:08:33.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0=', 'Content-Length': '0'} 2023-12-15T23:08:33.743 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4ef3212b3c7ffde-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.785 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.786 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.786 DEBUG:boto:path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.786 DEBUG:boto:auth_path=/kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.786 DEBUG:boto:Method: GET 2023-12-15T23:08:33.786 DEBUG:boto:Path: /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.786 DEBUG:boto:Data: 2023-12-15T23:08:33.786 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.786 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.786 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.786 DEBUG:boto:Params: {} 2023-12-15T23:08:33.787 DEBUG:boto:Token: None 2023-12-15T23:08:33.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8?versionId=null 2023-12-15T23:08:33.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0= 2023-12-15T23:08:33.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZaBKut0b1mz+tqkwJiEEpctQR0=', 'Content-Length': '0'} 2023-12-15T23:08:33.789 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a92863529098f77-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.789 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.789 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.789 DEBUG:boto:path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.789 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.790 DEBUG:boto:Method: GET 2023-12-15T23:08:33.790 DEBUG:boto:Path: /kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.790 DEBUG:boto:Data: 2023-12-15T23:08:33.790 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.790 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.790 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.790 DEBUG:boto:Params: {} 2023-12-15T23:08:33.790 DEBUG:boto:Token: None 2023-12-15T23:08:33.790 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9bfbc1dceb28664-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.833 DEBUG:boto:b'kskgfn-38obj81000falseobj82023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.834 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.834 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.834 DEBUG:boto:path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.834 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.834 DEBUG:boto:Method: GET 2023-12-15T23:08:33.834 DEBUG:boto:Path: /kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.834 DEBUG:boto:Data: 2023-12-15T23:08:33.835 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.835 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.835 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.835 DEBUG:boto:Params: {} 2023-12-15T23:08:33.835 DEBUG:boto:Token: None 2023-12-15T23:08:33.835 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000828d0b51e9924b82-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.838 DEBUG:boto:b'kskgfn-38obj81000falseobj82023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.838 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.838 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.838 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.838 DEBUG:boto:Path: /kskgfn-38/obj8 2023-12-15T23:08:33.838 DEBUG:boto:Data: 2023-12-15T23:08:33.838 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.839 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.839 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.839 DEBUG:boto:Params: {} 2023-12-15T23:08:33.839 DEBUG:boto:Token: None 2023-12-15T23:08:33.839 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8 2023-12-15T23:08:33.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vofngQ9VP7f5z+LL+v02BWJjycM= 2023-12-15T23:08:33.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vofngQ9VP7f5z+LL+v02BWJjycM=', 'Content-Length': '0'} 2023-12-15T23:08:33.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000072d8206f4b142cc6-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.841 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.842 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.842 DEBUG:boto:Method: HEAD 2023-12-15T23:08:33.842 DEBUG:boto:Path: /kskgfn-38/obj8 2023-12-15T23:08:33.842 DEBUG:boto:Data: 2023-12-15T23:08:33.842 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.842 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.842 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.842 DEBUG:boto:Params: {} 2023-12-15T23:08:33.842 DEBUG:boto:Token: None 2023-12-15T23:08:33.842 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8 2023-12-15T23:08:33.843 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vofngQ9VP7f5z+LL+v02BWJjycM= 2023-12-15T23:08:33.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vofngQ9VP7f5z+LL+v02BWJjycM=', 'Content-Length': '0'} 2023-12-15T23:08:33.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d71089a2a1395d8f-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:33.845 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.845 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.845 DEBUG:boto:Method: GET 2023-12-15T23:08:33.845 DEBUG:boto:Path: /kskgfn-38/obj8 2023-12-15T23:08:33.845 DEBUG:boto:Data: 2023-12-15T23:08:33.845 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.845 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.846 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.846 DEBUG:boto:Params: {} 2023-12-15T23:08:33.846 DEBUG:boto:Token: None 2023-12-15T23:08:33.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8 2023-12-15T23:08:33.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3hyQFxOrgtnxJtyrpdAM2Y4+0nw= 2023-12-15T23:08:33.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3hyQFxOrgtnxJtyrpdAM2Y4+0nw=', 'Content-Length': '0'} 2023-12-15T23:08:33.848 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-38:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c1d8b66cee01982f-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.889 DEBUG:boto:path=/kskgfn-38/obj8 2023-12-15T23:08:33.890 DEBUG:boto:auth_path=/kskgfn-38/obj8 2023-12-15T23:08:33.890 DEBUG:boto:Method: GET 2023-12-15T23:08:33.890 DEBUG:boto:Path: /kskgfn-38/obj8 2023-12-15T23:08:33.890 DEBUG:boto:Data: 2023-12-15T23:08:33.890 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.890 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.890 DEBUG:boto:Params: {} 2023-12-15T23:08:33.890 DEBUG:boto:Token: None 2023-12-15T23:08:33.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/obj8 2023-12-15T23:08:33.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3hyQFxOrgtnxJtyrpdAM2Y4+0nw= 2023-12-15T23:08:33.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3hyQFxOrgtnxJtyrpdAM2Y4+0nw=', 'Content-Length': '0'} 2023-12-15T23:08:33.892 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000677df7fd6051d887-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.893 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.893 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.893 DEBUG:boto:path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.893 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.893 DEBUG:boto:Method: GET 2023-12-15T23:08:33.893 DEBUG:boto:Path: /kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.893 DEBUG:boto:Data: 2023-12-15T23:08:33.893 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:33.894 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.894 DEBUG:boto:Params: {} 2023-12-15T23:08:33.894 DEBUG:boto:Token: None 2023-12-15T23:08:33.894 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1addb9b33a5856d-00657cdc71-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.897 DEBUG:boto:b'kskgfn-38obj81000falseobj82023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.897 DEBUG:boto:path=/kskgfn-38/ 2023-12-15T23:08:33.897 DEBUG:boto:auth_path=/kskgfn-38/ 2023-12-15T23:08:33.897 DEBUG:boto:path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.897 DEBUG:boto:auth_path=/kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.897 DEBUG:boto:Method: GET 2023-12-15T23:08:33.897 DEBUG:boto:Path: /kskgfn-38/?prefix=obj8 2023-12-15T23:08:33.897 DEBUG:boto:Data: 2023-12-15T23:08:33.898 DEBUG:boto:Headers: {} 2023-12-15T23:08:33.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:33.898 DEBUG:boto:Port: 8000 2023-12-15T23:08:33.898 DEBUG:boto:Params: {} 2023-12-15T23:08:33.898 DEBUG:boto:Token: None 2023-12-15T23:08:33.898 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:33 GMT /kskgfn-38/ 2023-12-15T23:08:33.898 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8= 2023-12-15T23:08:33.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Fxcrp0Xz2VxdGuuoEFyn2D5ds8=', 'Content-Length': '0'} 2023-12-15T23:08:33.901 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f6e02c9613b533a-00657cdc71-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:33.901 DEBUG:boto:b'kskgfn-38obj81000falseobj82023-12-15T23:08:06.866Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:33.901 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-38 zones={test-zone2, test-zone1} 2023-12-15T23:08:33.901 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-39 2023-12-15T23:08:33.901 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:33.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:33.902 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:33.961 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:33.962 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:34.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:33.999+0000 7f924eb1e800 1 bucket sync caught up with source: 2023-12-15T23:08:34.001 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000004.48.6, 00000000002.13.1, 00000000004.18.6, 00000000002.48.1, 00000000004.37.6, 00000000002.28.1, 00000000002.17.1, 00000000004.31.6, 00000000002.17.1, 00000000002.28.1, 00000000002.56.1] 2023-12-15T23:08:34.001 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000004.48.6, 00000000002.13.1, 00000000004.18.6, 00000000002.48.1, 00000000004.37.6, 00000000002.28.1, 00000000002.17.1, 00000000004.31.6, 00000000002.17.1, 00000000002.28.1, 00000000002.56.1] 2023-12-15T23:08:34.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:33.999+0000 7f924eb1e800 0 bucket checkpoint complete 2023-12-15T23:08:34.016 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-39 2023-12-15T23:08:34.016 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:34.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:34.016 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:34.077 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:34.077 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:34.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:34.115+0000 7f67e3931800 1 bucket sync caught up with source: 2023-12-15T23:08:34.116 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000004.127.1, 00000000002.37.1, 00000000004.130.1, 00000000002.109.1, 00000000004.100.1, 00000000002.113.1, 00000000002.33.1, 00000000004.114.1, 00000000002.52.1, 00000000002.71.1, 00000000002.109.1] 2023-12-15T23:08:34.116 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000004.127.1, 00000000002.37.1, 00000000004.130.1, 00000000002.109.1, 00000000004.100.1, 00000000002.113.1, 00000000002.33.1, 00000000004.114.1, 00000000002.52.1, 00000000002.71.1, 00000000002.109.1] 2023-12-15T23:08:34.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:34.115+0000 7f67e3931800 0 bucket checkpoint complete 2023-12-15T23:08:34.130 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-39 zones={test-zone2, test-zone1} 2023-12-15T23:08:34.131 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.131 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.131 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.131 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:34.131 DEBUG:boto:Data: 2023-12-15T23:08:34.131 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.131 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.131 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.131 DEBUG:boto:Params: {} 2023-12-15T23:08:34.132 DEBUG:boto:Token: None 2023-12-15T23:08:34.132 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.132 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5l+audv5TOhHrI0geWiBo7wUDM= 2023-12-15T23:08:34.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5l+audv5TOhHrI0geWiBo7wUDM=', 'Content-Length': '0'} 2023-12-15T23:08:34.134 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005d608a5d64b73de7-00657cdc72-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.134 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.135 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.135 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.135 DEBUG:boto:Path: /kskgfn-39/ 2023-12-15T23:08:34.135 DEBUG:boto:Data: 2023-12-15T23:08:34.135 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.135 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.135 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.135 DEBUG:boto:Params: {} 2023-12-15T23:08:34.135 DEBUG:boto:Token: None 2023-12-15T23:08:34.136 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5l+audv5TOhHrI0geWiBo7wUDM= 2023-12-15T23:08:34.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5l+audv5TOhHrI0geWiBo7wUDM=', 'Content-Length': '0'} 2023-12-15T23:08:34.138 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c55a2ac42ff60393-00657cdc72-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.138 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:08:34.138 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.138 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.138 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.138 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.139 DEBUG:boto:Method: GET 2023-12-15T23:08:34.139 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.139 DEBUG:boto:Data: 2023-12-15T23:08:34.139 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.139 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.139 DEBUG:boto:Params: {} 2023-12-15T23:08:34.139 DEBUG:boto:Token: None 2023-12-15T23:08:34.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/?versions 2023-12-15T23:08:34.140 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME= 2023-12-15T23:08:34.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME=', 'Content-Length': '0'} 2023-12-15T23:08:34.142 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000630e4a3d72205a7a-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.142 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:08:34.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:08:34.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:08:34.144 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:08:34.144 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.144 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.144 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.144 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.145 DEBUG:boto:Method: GET 2023-12-15T23:08:34.145 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.145 DEBUG:boto:Data: 2023-12-15T23:08:34.145 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.146 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.146 DEBUG:boto:Params: {} 2023-12-15T23:08:34.146 DEBUG:boto:Token: None 2023-12-15T23:08:34.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/?versions 2023-12-15T23:08:34.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME= 2023-12-15T23:08:34.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME=', 'Content-Length': '0'} 2023-12-15T23:08:34.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003428aaaa63174d95-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.148 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2023-12-15T23:08:34.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2023-12-15T23:08:34.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2023-12-15T23:08:34.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2023-12-15T23:08:34.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2023-12-15T23:08:34.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2023-12-15T23:08:34.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2023-12-15T23:08:34.150 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2023-12-15T23:08:34.150 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.150 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.150 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.150 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.150 DEBUG:boto:Method: GET 2023-12-15T23:08:34.150 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.150 DEBUG:boto:Data: 2023-12-15T23:08:34.150 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.151 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.151 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.151 DEBUG:boto:Params: {} 2023-12-15T23:08:34.151 DEBUG:boto:Token: None 2023-12-15T23:08:34.151 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/?versions 2023-12-15T23:08:34.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME= 2023-12-15T23:08:34.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME=', 'Content-Length': '0'} 2023-12-15T23:08:34.153 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052ebd240a4c323cb-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.154 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.154 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.154 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.154 DEBUG:boto:path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.154 DEBUG:boto:auth_path=/kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.155 DEBUG:boto:Method: GET 2023-12-15T23:08:34.155 DEBUG:boto:Path: /kskgfn-39/?versions&max-keys=999 2023-12-15T23:08:34.155 DEBUG:boto:Data: 2023-12-15T23:08:34.155 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.155 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.155 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.155 DEBUG:boto:Params: {} 2023-12-15T23:08:34.155 DEBUG:boto:Token: None 2023-12-15T23:08:34.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/?versions 2023-12-15T23:08:34.156 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME= 2023-12-15T23:08:34.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xFuE20jJuDPYt94IzYg7GRje3ME=', 'Content-Length': '0'} 2023-12-15T23:08:34.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4ddfc414042e416-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.158 DEBUG:boto:b'kskgfn-39999falseobj1nulltrue2023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj2nulltrue2023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj3nulltrue2023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj4nulltrue2023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj5nulltrue2023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj6nulltrue2023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj7nulltrue2023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormalobj8nulltrue2023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:34.159 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.159 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.159 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.159 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.159 DEBUG:boto:Method: GET 2023-12-15T23:08:34.159 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.159 DEBUG:boto:Data: 2023-12-15T23:08:34.159 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.160 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.160 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.160 DEBUG:boto:Params: {} 2023-12-15T23:08:34.160 DEBUG:boto:Token: None 2023-12-15T23:08:34.160 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.160 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0= 2023-12-15T23:08:34.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0=', 'Content-Length': '0'} 2023-12-15T23:08:34.162 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b25d375c42491a62-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.205 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.206 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.206 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.206 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.206 DEBUG:boto:Method: GET 2023-12-15T23:08:34.206 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.206 DEBUG:boto:Data: 2023-12-15T23:08:34.206 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.206 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.206 DEBUG:boto:Params: {} 2023-12-15T23:08:34.207 DEBUG:boto:Token: None 2023-12-15T23:08:34.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0= 2023-12-15T23:08:34.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0=', 'Content-Length': '0'} 2023-12-15T23:08:34.208 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a432e88783ba98b-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.209 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.209 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.209 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.209 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.209 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.209 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.209 DEBUG:boto:Data: 2023-12-15T23:08:34.209 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.209 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.210 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.210 DEBUG:boto:Params: {} 2023-12-15T23:08:34.210 DEBUG:boto:Token: None 2023-12-15T23:08:34.210 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+sL8DaJe9jW3k5e8yznLtCQyOTg= 2023-12-15T23:08:34.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+sL8DaJe9jW3k5e8yznLtCQyOTg=', 'Content-Length': '0'} 2023-12-15T23:08:34.212 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ae4b4ca8ea1a855-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.212 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.212 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.212 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.212 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.213 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.213 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.213 DEBUG:boto:Data: 2023-12-15T23:08:34.213 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.213 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.213 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.213 DEBUG:boto:Params: {} 2023-12-15T23:08:34.213 DEBUG:boto:Token: None 2023-12-15T23:08:34.213 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.213 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+sL8DaJe9jW3k5e8yznLtCQyOTg= 2023-12-15T23:08:34.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+sL8DaJe9jW3k5e8yznLtCQyOTg=', 'Content-Length': '0'} 2023-12-15T23:08:34.216 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000874e8745cbee00eb-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:34.217 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.217 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.217 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.217 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.217 DEBUG:boto:Method: GET 2023-12-15T23:08:34.217 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.217 DEBUG:boto:Data: 2023-12-15T23:08:34.217 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.217 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.217 DEBUG:boto:Params: {} 2023-12-15T23:08:34.218 DEBUG:boto:Token: None 2023-12-15T23:08:34.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0= 2023-12-15T23:08:34.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0=', 'Content-Length': '0'} 2023-12-15T23:08:34.220 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d45b13a97d66d5ce-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.220 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.220 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.220 DEBUG:boto:path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.220 DEBUG:boto:auth_path=/kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.220 DEBUG:boto:Method: GET 2023-12-15T23:08:34.220 DEBUG:boto:Path: /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.220 DEBUG:boto:Data: 2023-12-15T23:08:34.221 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.221 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.221 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.221 DEBUG:boto:Params: {} 2023-12-15T23:08:34.221 DEBUG:boto:Token: None 2023-12-15T23:08:34.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1?versionId=null 2023-12-15T23:08:34.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0= 2023-12-15T23:08:34.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VB/0saWMt0607j1dfpwpcsjPUD0=', 'Content-Length': '0'} 2023-12-15T23:08:34.223 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bfc3dd4828dce259-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.223 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.224 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.224 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.224 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.224 DEBUG:boto:Method: GET 2023-12-15T23:08:34.224 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.224 DEBUG:boto:Data: 2023-12-15T23:08:34.224 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.224 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.224 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.224 DEBUG:boto:Params: {} 2023-12-15T23:08:34.224 DEBUG:boto:Token: None 2023-12-15T23:08:34.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.227 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054dbec9e91a8def4-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.227 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.227 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.228 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.228 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.228 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.228 DEBUG:boto:Method: GET 2023-12-15T23:08:34.228 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.228 DEBUG:boto:Data: 2023-12-15T23:08:34.228 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.228 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.228 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.228 DEBUG:boto:Params: {} 2023-12-15T23:08:34.229 DEBUG:boto:Token: None 2023-12-15T23:08:34.229 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.229 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e8aa475e63da5bd-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.231 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.231 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.232 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.232 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.232 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:34.232 DEBUG:boto:Data: 2023-12-15T23:08:34.232 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.232 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.232 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.232 DEBUG:boto:Params: {} 2023-12-15T23:08:34.232 DEBUG:boto:Token: None 2023-12-15T23:08:34.232 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1 2023-12-15T23:08:34.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4StRUY+Jop7RizXEgRgXx//OKPQ= 2023-12-15T23:08:34.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4StRUY+Jop7RizXEgRgXx//OKPQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.234 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028a8ac2810dae890-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.234 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.235 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.235 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.235 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:34.235 DEBUG:boto:Data: 2023-12-15T23:08:34.235 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.235 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.235 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.235 DEBUG:boto:Params: {} 2023-12-15T23:08:34.235 DEBUG:boto:Token: None 2023-12-15T23:08:34.235 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1 2023-12-15T23:08:34.236 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4StRUY+Jop7RizXEgRgXx//OKPQ= 2023-12-15T23:08:34.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4StRUY+Jop7RizXEgRgXx//OKPQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.237 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d833a654ed183d2-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2023-12-15T23:08:34.238 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.238 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.238 DEBUG:boto:Method: GET 2023-12-15T23:08:34.238 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:34.238 DEBUG:boto:Data: 2023-12-15T23:08:34.238 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.238 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.238 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.238 DEBUG:boto:Params: {} 2023-12-15T23:08:34.239 DEBUG:boto:Token: None 2023-12-15T23:08:34.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1 2023-12-15T23:08:34.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4S3x7/O/7JO71FNS0ifEWJO+H88= 2023-12-15T23:08:34.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4S3x7/O/7JO71FNS0ifEWJO+H88=', 'Content-Length': '0'} 2023-12-15T23:08:34.240 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b09104e0bf6d4e57-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.241 DEBUG:boto:path=/kskgfn-39/obj1 2023-12-15T23:08:34.241 DEBUG:boto:auth_path=/kskgfn-39/obj1 2023-12-15T23:08:34.241 DEBUG:boto:Method: GET 2023-12-15T23:08:34.241 DEBUG:boto:Path: /kskgfn-39/obj1 2023-12-15T23:08:34.241 DEBUG:boto:Data: 2023-12-15T23:08:34.241 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.241 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.242 DEBUG:boto:Params: {} 2023-12-15T23:08:34.242 DEBUG:boto:Token: None 2023-12-15T23:08:34.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj1 2023-12-15T23:08:34.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4S3x7/O/7JO71FNS0ifEWJO+H88= 2023-12-15T23:08:34.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4S3x7/O/7JO71FNS0ifEWJO+H88=', 'Content-Length': '0'} 2023-12-15T23:08:34.243 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a2d068aeb5d24222-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.285 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.286 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.286 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.286 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.286 DEBUG:boto:Method: GET 2023-12-15T23:08:34.286 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.286 DEBUG:boto:Data: 2023-12-15T23:08:34.286 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.286 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.286 DEBUG:boto:Params: {} 2023-12-15T23:08:34.287 DEBUG:boto:Token: None 2023-12-15T23:08:34.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b0513e368a587a0-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.289 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.290 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.290 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.290 DEBUG:boto:path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.290 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.290 DEBUG:boto:Method: GET 2023-12-15T23:08:34.290 DEBUG:boto:Path: /kskgfn-39/?prefix=obj1 2023-12-15T23:08:34.290 DEBUG:boto:Data: 2023-12-15T23:08:34.290 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.290 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.290 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.290 DEBUG:boto:Params: {} 2023-12-15T23:08:34.291 DEBUG:boto:Token: None 2023-12-15T23:08:34.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051eb5b289daf6dd4-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.337 DEBUG:boto:b'kskgfn-39obj11000falseobj12023-12-15T23:07:54.010Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:34.338 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.338 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.338 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.338 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.338 DEBUG:boto:Method: GET 2023-12-15T23:08:34.338 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.338 DEBUG:boto:Data: 2023-12-15T23:08:34.339 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.339 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.339 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.339 DEBUG:boto:Params: {} 2023-12-15T23:08:34.339 DEBUG:boto:Token: None 2023-12-15T23:08:34.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0= 2023-12-15T23:08:34.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0=', 'Content-Length': '0'} 2023-12-15T23:08:34.341 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000096224473eef18b12-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.341 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.342 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.342 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.342 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.342 DEBUG:boto:Method: GET 2023-12-15T23:08:34.342 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.342 DEBUG:boto:Data: 2023-12-15T23:08:34.342 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.342 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.342 DEBUG:boto:Params: {} 2023-12-15T23:08:34.343 DEBUG:boto:Token: None 2023-12-15T23:08:34.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0= 2023-12-15T23:08:34.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0=', 'Content-Length': '0'} 2023-12-15T23:08:34.345 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000410d3d2b94223a65-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.345 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.345 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.345 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.345 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.346 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.346 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.346 DEBUG:boto:Data: 2023-12-15T23:08:34.346 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.346 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.346 DEBUG:boto:Params: {} 2023-12-15T23:08:34.346 DEBUG:boto:Token: None 2023-12-15T23:08:34.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEHmVQ62f1Clbs11Bqw9I9V3B7s= 2023-12-15T23:08:34.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEHmVQ62f1Clbs11Bqw9I9V3B7s=', 'Content-Length': '0'} 2023-12-15T23:08:34.349 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000348793640f9d8015-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.349 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.349 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.349 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.349 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.349 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.350 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.350 DEBUG:boto:Data: 2023-12-15T23:08:34.350 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.350 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.350 DEBUG:boto:Params: {} 2023-12-15T23:08:34.350 DEBUG:boto:Token: None 2023-12-15T23:08:34.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEHmVQ62f1Clbs11Bqw9I9V3B7s= 2023-12-15T23:08:34.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEHmVQ62f1Clbs11Bqw9I9V3B7s=', 'Content-Length': '0'} 2023-12-15T23:08:34.352 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a666a4389fb9ebd-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:34.353 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.353 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.353 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.353 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.353 DEBUG:boto:Method: GET 2023-12-15T23:08:34.353 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.353 DEBUG:boto:Data: 2023-12-15T23:08:34.353 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.354 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.354 DEBUG:boto:Params: {} 2023-12-15T23:08:34.354 DEBUG:boto:Token: None 2023-12-15T23:08:34.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0= 2023-12-15T23:08:34.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0=', 'Content-Length': '0'} 2023-12-15T23:08:34.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000103cb4e942201a4d-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.397 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.398 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.398 DEBUG:boto:path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.398 DEBUG:boto:auth_path=/kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.398 DEBUG:boto:Method: GET 2023-12-15T23:08:34.398 DEBUG:boto:Path: /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.398 DEBUG:boto:Data: 2023-12-15T23:08:34.398 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.398 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.398 DEBUG:boto:Params: {} 2023-12-15T23:08:34.399 DEBUG:boto:Token: None 2023-12-15T23:08:34.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2?versionId=null 2023-12-15T23:08:34.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0= 2023-12-15T23:08:34.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M+X2MGsLmEfj9i3Ors7T3HrMyu0=', 'Content-Length': '0'} 2023-12-15T23:08:34.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f9d545205a2b48e-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.441 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.442 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.442 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.442 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.442 DEBUG:boto:Method: GET 2023-12-15T23:08:34.442 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.442 DEBUG:boto:Data: 2023-12-15T23:08:34.442 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.442 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.442 DEBUG:boto:Params: {} 2023-12-15T23:08:34.443 DEBUG:boto:Token: None 2023-12-15T23:08:34.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095fac6962e1ed063-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.445 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.446 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.446 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.446 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.446 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.446 DEBUG:boto:Method: GET 2023-12-15T23:08:34.446 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.446 DEBUG:boto:Data: 2023-12-15T23:08:34.446 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.447 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.447 DEBUG:boto:Params: {} 2023-12-15T23:08:34.447 DEBUG:boto:Token: None 2023-12-15T23:08:34.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f256fdd0910ada7b-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.450 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.450 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.450 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.450 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.450 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:34.450 DEBUG:boto:Data: 2023-12-15T23:08:34.450 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.450 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.451 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.451 DEBUG:boto:Params: {} 2023-12-15T23:08:34.451 DEBUG:boto:Token: None 2023-12-15T23:08:34.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2 2023-12-15T23:08:34.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BgIifkxUfMi+Kp6C2qOvNNB2OIs= 2023-12-15T23:08:34.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BgIifkxUfMi+Kp6C2qOvNNB2OIs=', 'Content-Length': '0'} 2023-12-15T23:08:34.453 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f05277d52b2c6b36-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.453 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.453 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.454 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.454 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:34.454 DEBUG:boto:Data: 2023-12-15T23:08:34.454 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.454 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.454 DEBUG:boto:Params: {} 2023-12-15T23:08:34.454 DEBUG:boto:Token: None 2023-12-15T23:08:34.454 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2 2023-12-15T23:08:34.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BgIifkxUfMi+Kp6C2qOvNNB2OIs= 2023-12-15T23:08:34.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BgIifkxUfMi+Kp6C2qOvNNB2OIs=', 'Content-Length': '0'} 2023-12-15T23:08:34.456 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000718787e62bb9b72d-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2023-12-15T23:08:34.456 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.457 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.457 DEBUG:boto:Method: GET 2023-12-15T23:08:34.457 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:34.457 DEBUG:boto:Data: 2023-12-15T23:08:34.457 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.457 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.457 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.457 DEBUG:boto:Params: {} 2023-12-15T23:08:34.457 DEBUG:boto:Token: None 2023-12-15T23:08:34.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2 2023-12-15T23:08:34.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s/mQBH7taFH/ygJ+z92069lc0oY= 2023-12-15T23:08:34.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s/mQBH7taFH/ygJ+z92069lc0oY=', 'Content-Length': '0'} 2023-12-15T23:08:34.460 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000144fdd57bd5a59ec-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.460 DEBUG:boto:path=/kskgfn-39/obj2 2023-12-15T23:08:34.460 DEBUG:boto:auth_path=/kskgfn-39/obj2 2023-12-15T23:08:34.460 DEBUG:boto:Method: GET 2023-12-15T23:08:34.461 DEBUG:boto:Path: /kskgfn-39/obj2 2023-12-15T23:08:34.461 DEBUG:boto:Data: 2023-12-15T23:08:34.461 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.461 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.461 DEBUG:boto:Params: {} 2023-12-15T23:08:34.461 DEBUG:boto:Token: None 2023-12-15T23:08:34.461 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj2 2023-12-15T23:08:34.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s/mQBH7taFH/ygJ+z92069lc0oY= 2023-12-15T23:08:34.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s/mQBH7taFH/ygJ+z92069lc0oY=', 'Content-Length': '0'} 2023-12-15T23:08:34.463 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000867b386a6d7f23c5-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.505 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.506 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.506 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.506 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.506 DEBUG:boto:Method: GET 2023-12-15T23:08:34.506 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.506 DEBUG:boto:Data: 2023-12-15T23:08:34.506 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.506 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.506 DEBUG:boto:Params: {} 2023-12-15T23:08:34.506 DEBUG:boto:Token: None 2023-12-15T23:08:34.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f05c6de4c71b610-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.509 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.509 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.510 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.510 DEBUG:boto:path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.510 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.510 DEBUG:boto:Method: GET 2023-12-15T23:08:34.510 DEBUG:boto:Path: /kskgfn-39/?prefix=obj2 2023-12-15T23:08:34.510 DEBUG:boto:Data: 2023-12-15T23:08:34.510 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.510 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.510 DEBUG:boto:Params: {} 2023-12-15T23:08:34.510 DEBUG:boto:Token: None 2023-12-15T23:08:34.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a352d04c1689ceaf-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.513 DEBUG:boto:b'kskgfn-39obj21000falseobj22023-12-15T23:07:54.056Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:34.514 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.514 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.514 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.514 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.514 DEBUG:boto:Method: GET 2023-12-15T23:08:34.515 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.515 DEBUG:boto:Data: 2023-12-15T23:08:34.515 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.515 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.515 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.515 DEBUG:boto:Params: {} 2023-12-15T23:08:34.515 DEBUG:boto:Token: None 2023-12-15T23:08:34.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E= 2023-12-15T23:08:34.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E=', 'Content-Length': '0'} 2023-12-15T23:08:34.517 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000378ee180acb2ee93-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.518 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.518 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.518 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.518 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.518 DEBUG:boto:Method: GET 2023-12-15T23:08:34.518 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.518 DEBUG:boto:Data: 2023-12-15T23:08:34.518 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.518 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.519 DEBUG:boto:Params: {} 2023-12-15T23:08:34.519 DEBUG:boto:Token: None 2023-12-15T23:08:34.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E= 2023-12-15T23:08:34.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E=', 'Content-Length': '0'} 2023-12-15T23:08:34.521 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa4f943ff3e05662-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.521 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.521 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.521 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.521 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.521 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.521 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.522 DEBUG:boto:Data: 2023-12-15T23:08:34.522 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.522 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.522 DEBUG:boto:Params: {} 2023-12-15T23:08:34.522 DEBUG:boto:Token: None 2023-12-15T23:08:34.522 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TSH+q/cBrRdFD1KYePgw3+fqZZY= 2023-12-15T23:08:34.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TSH+q/cBrRdFD1KYePgw3+fqZZY=', 'Content-Length': '0'} 2023-12-15T23:08:34.524 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c27e3b3550cc944e-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.524 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.524 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.524 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.524 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.525 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.525 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.525 DEBUG:boto:Data: 2023-12-15T23:08:34.525 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.525 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.525 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.525 DEBUG:boto:Params: {} 2023-12-15T23:08:34.525 DEBUG:boto:Token: None 2023-12-15T23:08:34.525 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.525 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TSH+q/cBrRdFD1KYePgw3+fqZZY= 2023-12-15T23:08:34.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TSH+q/cBrRdFD1KYePgw3+fqZZY=', 'Content-Length': '0'} 2023-12-15T23:08:34.527 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002ba7c8f2fa551f51-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:34.527 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.528 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.528 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.528 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.528 DEBUG:boto:Method: GET 2023-12-15T23:08:34.528 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.528 DEBUG:boto:Data: 2023-12-15T23:08:34.528 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.528 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.528 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.528 DEBUG:boto:Params: {} 2023-12-15T23:08:34.528 DEBUG:boto:Token: None 2023-12-15T23:08:34.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E= 2023-12-15T23:08:34.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E=', 'Content-Length': '0'} 2023-12-15T23:08:34.530 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bc4ad8e5baa332d0-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.531 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.531 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.531 DEBUG:boto:path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.531 DEBUG:boto:auth_path=/kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.531 DEBUG:boto:Method: GET 2023-12-15T23:08:34.531 DEBUG:boto:Path: /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.531 DEBUG:boto:Data: 2023-12-15T23:08:34.531 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.531 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.531 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.531 DEBUG:boto:Params: {} 2023-12-15T23:08:34.532 DEBUG:boto:Token: None 2023-12-15T23:08:34.532 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3?versionId=null 2023-12-15T23:08:34.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E= 2023-12-15T23:08:34.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v80He7oyxhstJWviSDPJ/W3ac6E=', 'Content-Length': '0'} 2023-12-15T23:08:34.533 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000092a1624df7f6b67e-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.577 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.578 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.578 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.578 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.578 DEBUG:boto:Method: GET 2023-12-15T23:08:34.578 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.578 DEBUG:boto:Data: 2023-12-15T23:08:34.578 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.578 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.578 DEBUG:boto:Params: {} 2023-12-15T23:08:34.579 DEBUG:boto:Token: None 2023-12-15T23:08:34.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002076bdf3a587277b-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.581 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.581 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.581 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.582 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.582 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.582 DEBUG:boto:Method: GET 2023-12-15T23:08:34.582 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.582 DEBUG:boto:Data: 2023-12-15T23:08:34.582 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.582 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.582 DEBUG:boto:Params: {} 2023-12-15T23:08:34.582 DEBUG:boto:Token: None 2023-12-15T23:08:34.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ffee45d0e8af288-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.585 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.585 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.585 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.586 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.586 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:34.586 DEBUG:boto:Data: 2023-12-15T23:08:34.586 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.586 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.586 DEBUG:boto:Params: {} 2023-12-15T23:08:34.586 DEBUG:boto:Token: None 2023-12-15T23:08:34.586 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3 2023-12-15T23:08:34.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8rnUZjGKA+4pg2wTUslEnOQm5h0= 2023-12-15T23:08:34.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8rnUZjGKA+4pg2wTUslEnOQm5h0=', 'Content-Length': '0'} 2023-12-15T23:08:34.588 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d569566c97b4484-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.588 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.588 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.589 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.589 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:34.589 DEBUG:boto:Data: 2023-12-15T23:08:34.589 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.589 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.589 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.589 DEBUG:boto:Params: {} 2023-12-15T23:08:34.589 DEBUG:boto:Token: None 2023-12-15T23:08:34.589 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3 2023-12-15T23:08:34.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8rnUZjGKA+4pg2wTUslEnOQm5h0= 2023-12-15T23:08:34.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8rnUZjGKA+4pg2wTUslEnOQm5h0=', 'Content-Length': '0'} 2023-12-15T23:08:34.591 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a2096189a3b3f36-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.591 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2023-12-15T23:08:34.592 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.592 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.592 DEBUG:boto:Method: GET 2023-12-15T23:08:34.592 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:34.592 DEBUG:boto:Data: 2023-12-15T23:08:34.592 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.592 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.592 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.592 DEBUG:boto:Params: {} 2023-12-15T23:08:34.593 DEBUG:boto:Token: None 2023-12-15T23:08:34.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3 2023-12-15T23:08:34.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZZx003jDwPN1cA8KoMJHvHpfjzU= 2023-12-15T23:08:34.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZZx003jDwPN1cA8KoMJHvHpfjzU=', 'Content-Length': '0'} 2023-12-15T23:08:34.595 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000036baba975f7631ba-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.595 DEBUG:boto:path=/kskgfn-39/obj3 2023-12-15T23:08:34.595 DEBUG:boto:auth_path=/kskgfn-39/obj3 2023-12-15T23:08:34.595 DEBUG:boto:Method: GET 2023-12-15T23:08:34.595 DEBUG:boto:Path: /kskgfn-39/obj3 2023-12-15T23:08:34.595 DEBUG:boto:Data: 2023-12-15T23:08:34.595 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.596 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.596 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.596 DEBUG:boto:Params: {} 2023-12-15T23:08:34.596 DEBUG:boto:Token: None 2023-12-15T23:08:34.596 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj3 2023-12-15T23:08:34.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZZx003jDwPN1cA8KoMJHvHpfjzU= 2023-12-15T23:08:34.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZZx003jDwPN1cA8KoMJHvHpfjzU=', 'Content-Length': '0'} 2023-12-15T23:08:34.598 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000949fa29b265cb5cb-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.642 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.642 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.642 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.642 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.642 DEBUG:boto:Method: GET 2023-12-15T23:08:34.643 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.643 DEBUG:boto:Data: 2023-12-15T23:08:34.643 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.643 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.643 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.643 DEBUG:boto:Params: {} 2023-12-15T23:08:34.643 DEBUG:boto:Token: None 2023-12-15T23:08:34.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0e41eafdda7b182-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.646 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.646 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.646 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.646 DEBUG:boto:path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.647 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.647 DEBUG:boto:Method: GET 2023-12-15T23:08:34.647 DEBUG:boto:Path: /kskgfn-39/?prefix=obj3 2023-12-15T23:08:34.647 DEBUG:boto:Data: 2023-12-15T23:08:34.647 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.647 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.647 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.647 DEBUG:boto:Params: {} 2023-12-15T23:08:34.647 DEBUG:boto:Token: None 2023-12-15T23:08:34.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.648 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046ec24e1d7235d06-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.693 DEBUG:boto:b'kskgfn-39obj31000falseobj32023-12-15T23:07:54.067Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:34.694 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.694 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.694 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.694 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.694 DEBUG:boto:Method: GET 2023-12-15T23:08:34.694 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.695 DEBUG:boto:Data: 2023-12-15T23:08:34.695 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.695 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.695 DEBUG:boto:Params: {} 2023-12-15T23:08:34.695 DEBUG:boto:Token: None 2023-12-15T23:08:34.695 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg= 2023-12-15T23:08:34.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.697 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b4a09ad1e5a8fd2b-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.697 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.697 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.698 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.698 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.698 DEBUG:boto:Method: GET 2023-12-15T23:08:34.698 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.698 DEBUG:boto:Data: 2023-12-15T23:08:34.698 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.698 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.698 DEBUG:boto:Params: {} 2023-12-15T23:08:34.698 DEBUG:boto:Token: None 2023-12-15T23:08:34.699 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg= 2023-12-15T23:08:34.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.700 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079ee721643504351-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.701 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.701 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.701 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.701 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.701 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.701 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.701 DEBUG:boto:Data: 2023-12-15T23:08:34.701 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.702 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.702 DEBUG:boto:Params: {} 2023-12-15T23:08:34.702 DEBUG:boto:Token: None 2023-12-15T23:08:34.702 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wonpwv1a+mdpmfcM8epn0vTG6c0= 2023-12-15T23:08:34.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wonpwv1a+mdpmfcM8epn0vTG6c0=', 'Content-Length': '0'} 2023-12-15T23:08:34.704 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004aa8faa78d1d7e18-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.704 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.704 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.704 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.705 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.705 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.705 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.705 DEBUG:boto:Data: 2023-12-15T23:08:34.705 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.705 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.705 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.705 DEBUG:boto:Params: {} 2023-12-15T23:08:34.705 DEBUG:boto:Token: None 2023-12-15T23:08:34.706 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wonpwv1a+mdpmfcM8epn0vTG6c0= 2023-12-15T23:08:34.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wonpwv1a+mdpmfcM8epn0vTG6c0=', 'Content-Length': '0'} 2023-12-15T23:08:34.708 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007fa9a8c8b86b704b-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:34.708 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.708 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.708 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.708 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.708 DEBUG:boto:Method: GET 2023-12-15T23:08:34.708 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.709 DEBUG:boto:Data: 2023-12-15T23:08:34.709 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.709 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.709 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.709 DEBUG:boto:Params: {} 2023-12-15T23:08:34.709 DEBUG:boto:Token: None 2023-12-15T23:08:34.709 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.709 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg= 2023-12-15T23:08:34.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.711 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000098f8bfd70214e199-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.711 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.711 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.712 DEBUG:boto:path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.712 DEBUG:boto:auth_path=/kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.712 DEBUG:boto:Method: GET 2023-12-15T23:08:34.712 DEBUG:boto:Path: /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.712 DEBUG:boto:Data: 2023-12-15T23:08:34.712 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.712 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.712 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.712 DEBUG:boto:Params: {} 2023-12-15T23:08:34.712 DEBUG:boto:Token: None 2023-12-15T23:08:34.713 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4?versionId=null 2023-12-15T23:08:34.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg= 2023-12-15T23:08:34.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jwkn61XH3vDsOg/LLZYyK2nxhEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.714 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000043194f22d8d0d2e4-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.757 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.758 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.758 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.758 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.758 DEBUG:boto:Method: GET 2023-12-15T23:08:34.759 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.759 DEBUG:boto:Data: 2023-12-15T23:08:34.759 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.759 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.759 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.759 DEBUG:boto:Params: {} 2023-12-15T23:08:34.760 DEBUG:boto:Token: None 2023-12-15T23:08:34.760 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc8b4d1c08bd10cd-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.763 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.763 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.764 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.764 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.764 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.764 DEBUG:boto:Method: GET 2023-12-15T23:08:34.764 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.764 DEBUG:boto:Data: 2023-12-15T23:08:34.764 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.765 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.765 DEBUG:boto:Params: {} 2023-12-15T23:08:34.765 DEBUG:boto:Token: None 2023-12-15T23:08:34.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a02388b6f93d99b3-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.768 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.769 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.769 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.769 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.769 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:34.769 DEBUG:boto:Data: 2023-12-15T23:08:34.769 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.769 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.769 DEBUG:boto:Params: {} 2023-12-15T23:08:34.770 DEBUG:boto:Token: None 2023-12-15T23:08:34.770 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4 2023-12-15T23:08:34.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjBWBtayQYWcvG+hF9yKjrvkMuk= 2023-12-15T23:08:34.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjBWBtayQYWcvG+hF9yKjrvkMuk=', 'Content-Length': '0'} 2023-12-15T23:08:34.771 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac03ea623a14a3f5-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.772 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.772 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.772 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.772 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:34.772 DEBUG:boto:Data: 2023-12-15T23:08:34.772 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.772 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.772 DEBUG:boto:Params: {} 2023-12-15T23:08:34.773 DEBUG:boto:Token: None 2023-12-15T23:08:34.773 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4 2023-12-15T23:08:34.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjBWBtayQYWcvG+hF9yKjrvkMuk= 2023-12-15T23:08:34.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjBWBtayQYWcvG+hF9yKjrvkMuk=', 'Content-Length': '0'} 2023-12-15T23:08:34.775 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d00b9d3f14d61719-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.775 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2023-12-15T23:08:34.775 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.775 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.775 DEBUG:boto:Method: GET 2023-12-15T23:08:34.775 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:34.775 DEBUG:boto:Data: 2023-12-15T23:08:34.776 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.776 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.776 DEBUG:boto:Params: {} 2023-12-15T23:08:34.776 DEBUG:boto:Token: None 2023-12-15T23:08:34.776 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4 2023-12-15T23:08:34.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VdH2mr7bYHBKbQYzjN3VQYQ1OiA= 2023-12-15T23:08:34.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VdH2mr7bYHBKbQYzjN3VQYQ1OiA=', 'Content-Length': '0'} 2023-12-15T23:08:34.778 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e206eb5ce099059-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.778 DEBUG:boto:path=/kskgfn-39/obj4 2023-12-15T23:08:34.778 DEBUG:boto:auth_path=/kskgfn-39/obj4 2023-12-15T23:08:34.778 DEBUG:boto:Method: GET 2023-12-15T23:08:34.779 DEBUG:boto:Path: /kskgfn-39/obj4 2023-12-15T23:08:34.779 DEBUG:boto:Data: 2023-12-15T23:08:34.779 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.779 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.779 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.779 DEBUG:boto:Params: {} 2023-12-15T23:08:34.779 DEBUG:boto:Token: None 2023-12-15T23:08:34.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj4 2023-12-15T23:08:34.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VdH2mr7bYHBKbQYzjN3VQYQ1OiA= 2023-12-15T23:08:34.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VdH2mr7bYHBKbQYzjN3VQYQ1OiA=', 'Content-Length': '0'} 2023-12-15T23:08:34.781 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:07:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000067af8bee4d5aef64-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.825 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.826 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.826 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.826 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.826 DEBUG:boto:Method: GET 2023-12-15T23:08:34.826 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.826 DEBUG:boto:Data: 2023-12-15T23:08:34.826 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.826 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.826 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.826 DEBUG:boto:Params: {} 2023-12-15T23:08:34.827 DEBUG:boto:Token: None 2023-12-15T23:08:34.827 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.828 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.830 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9e8059eb7f56cf7-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.830 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.831 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.831 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.831 DEBUG:boto:path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.831 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.831 DEBUG:boto:Method: GET 2023-12-15T23:08:34.831 DEBUG:boto:Path: /kskgfn-39/?prefix=obj4 2023-12-15T23:08:34.831 DEBUG:boto:Data: 2023-12-15T23:08:34.831 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.832 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.832 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.832 DEBUG:boto:Params: {} 2023-12-15T23:08:34.832 DEBUG:boto:Token: None 2023-12-15T23:08:34.832 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.832 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.834 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c626171e44da6468-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.877 DEBUG:boto:b'kskgfn-39obj41000falseobj42023-12-15T23:07:54.077Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.878 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:34.878 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.878 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.878 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.878 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.878 DEBUG:boto:Method: GET 2023-12-15T23:08:34.878 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.878 DEBUG:boto:Data: 2023-12-15T23:08:34.879 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.879 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.879 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.879 DEBUG:boto:Params: {} 2023-12-15T23:08:34.879 DEBUG:boto:Token: None 2023-12-15T23:08:34.879 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ= 2023-12-15T23:08:34.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.881 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a3a2672b67c00bc-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.881 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.882 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.882 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.882 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.882 DEBUG:boto:Method: GET 2023-12-15T23:08:34.882 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.882 DEBUG:boto:Data: 2023-12-15T23:08:34.882 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.882 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.882 DEBUG:boto:Params: {} 2023-12-15T23:08:34.882 DEBUG:boto:Token: None 2023-12-15T23:08:34.883 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ= 2023-12-15T23:08:34.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.885 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c9474307a5e9959d-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.885 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.885 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.885 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.885 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.886 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.886 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.886 DEBUG:boto:Data: 2023-12-15T23:08:34.886 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.886 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.886 DEBUG:boto:Params: {} 2023-12-15T23:08:34.886 DEBUG:boto:Token: None 2023-12-15T23:08:34.886 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T+uAQrCJGafpyBmCtm2hA0Oi+Fs= 2023-12-15T23:08:34.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T+uAQrCJGafpyBmCtm2hA0Oi+Fs=', 'Content-Length': '0'} 2023-12-15T23:08:34.888 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000331e21a8b1efabef-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.888 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.888 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.889 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.889 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.889 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.889 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.889 DEBUG:boto:Data: 2023-12-15T23:08:34.889 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.889 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.889 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.889 DEBUG:boto:Params: {} 2023-12-15T23:08:34.889 DEBUG:boto:Token: None 2023-12-15T23:08:34.890 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T+uAQrCJGafpyBmCtm2hA0Oi+Fs= 2023-12-15T23:08:34.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T+uAQrCJGafpyBmCtm2hA0Oi+Fs=', 'Content-Length': '0'} 2023-12-15T23:08:34.891 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000628c3f1240d3ea1-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:34.892 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.892 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.892 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.892 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.892 DEBUG:boto:Method: GET 2023-12-15T23:08:34.892 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.892 DEBUG:boto:Data: 2023-12-15T23:08:34.893 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.893 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.893 DEBUG:boto:Params: {} 2023-12-15T23:08:34.893 DEBUG:boto:Token: None 2023-12-15T23:08:34.893 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.893 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ= 2023-12-15T23:08:34.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.895 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028a4db6a9bef9945-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.896 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.896 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.896 DEBUG:boto:path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.896 DEBUG:boto:auth_path=/kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.896 DEBUG:boto:Method: GET 2023-12-15T23:08:34.896 DEBUG:boto:Path: /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.896 DEBUG:boto:Data: 2023-12-15T23:08:34.896 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.896 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.896 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.896 DEBUG:boto:Params: {} 2023-12-15T23:08:34.897 DEBUG:boto:Token: None 2023-12-15T23:08:34.897 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5?versionId=null 2023-12-15T23:08:34.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ= 2023-12-15T23:08:34.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RxASRI7oyxv9+xR9auSzlnAoYWQ=', 'Content-Length': '0'} 2023-12-15T23:08:34.899 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008577a0a04bc8a2b1-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.945 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.946 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.946 DEBUG:boto:path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.946 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.946 DEBUG:boto:Method: GET 2023-12-15T23:08:34.946 DEBUG:boto:Path: /kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.946 DEBUG:boto:Data: 2023-12-15T23:08:34.946 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.946 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.946 DEBUG:boto:Params: {} 2023-12-15T23:08:34.947 DEBUG:boto:Token: None 2023-12-15T23:08:34.947 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b524fff34bae5de2-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.949 DEBUG:boto:b'kskgfn-39obj51000falseobj52023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.950 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:34.950 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:34.950 DEBUG:boto:path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.950 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.950 DEBUG:boto:Method: GET 2023-12-15T23:08:34.950 DEBUG:boto:Path: /kskgfn-39/?prefix=obj5 2023-12-15T23:08:34.950 DEBUG:boto:Data: 2023-12-15T23:08:34.951 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.951 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.951 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.951 DEBUG:boto:Params: {} 2023-12-15T23:08:34.951 DEBUG:boto:Token: None 2023-12-15T23:08:34.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/ 2023-12-15T23:08:34.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw= 2023-12-15T23:08:34.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oC3u+fvqI+3b2P+nb8MYyiycOZw=', 'Content-Length': '0'} 2023-12-15T23:08:34.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000986df4dd5418886c-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.954 DEBUG:boto:b'kskgfn-39obj51000falseobj52023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:34.954 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.954 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.954 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.954 DEBUG:boto:Path: /kskgfn-39/obj5 2023-12-15T23:08:34.954 DEBUG:boto:Data: 2023-12-15T23:08:34.954 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.955 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.955 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.955 DEBUG:boto:Params: {} 2023-12-15T23:08:34.955 DEBUG:boto:Token: None 2023-12-15T23:08:34.955 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5 2023-12-15T23:08:34.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:35TeXCABLXzkueq00XeTHwbYXEg= 2023-12-15T23:08:34.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:35TeXCABLXzkueq00XeTHwbYXEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.957 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eea9fdb8f9fcc96b-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.957 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.957 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.957 DEBUG:boto:Method: HEAD 2023-12-15T23:08:34.958 DEBUG:boto:Path: /kskgfn-39/obj5 2023-12-15T23:08:34.958 DEBUG:boto:Data: 2023-12-15T23:08:34.958 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:34.958 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.958 DEBUG:boto:Params: {} 2023-12-15T23:08:34.958 DEBUG:boto:Token: None 2023-12-15T23:08:34.958 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5 2023-12-15T23:08:34.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:35TeXCABLXzkueq00XeTHwbYXEg= 2023-12-15T23:08:34.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:35TeXCABLXzkueq00XeTHwbYXEg=', 'Content-Length': '0'} 2023-12-15T23:08:34.960 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a1f358e256dd38c-00657cdc72-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:34.960 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2023-12-15T23:08:34.961 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:34.961 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:34.961 DEBUG:boto:Method: GET 2023-12-15T23:08:34.961 DEBUG:boto:Path: /kskgfn-39/obj5 2023-12-15T23:08:34.961 DEBUG:boto:Data: 2023-12-15T23:08:34.961 DEBUG:boto:Headers: {} 2023-12-15T23:08:34.961 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:34.961 DEBUG:boto:Port: 8000 2023-12-15T23:08:34.961 DEBUG:boto:Params: {} 2023-12-15T23:08:34.961 DEBUG:boto:Token: None 2023-12-15T23:08:34.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:34 GMT /kskgfn-39/obj5 2023-12-15T23:08:34.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cHsmn36/TtocJ2CvS0IxFmzNDg0= 2023-12-15T23:08:34.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:34 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cHsmn36/TtocJ2CvS0IxFmzNDg0=', 'Content-Length': '0'} 2023-12-15T23:08:34.963 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e59f0804c11a76d-00657cdc72-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:34 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.005 DEBUG:boto:path=/kskgfn-39/obj5 2023-12-15T23:08:35.006 DEBUG:boto:auth_path=/kskgfn-39/obj5 2023-12-15T23:08:35.006 DEBUG:boto:Method: GET 2023-12-15T23:08:35.006 DEBUG:boto:Path: /kskgfn-39/obj5 2023-12-15T23:08:35.006 DEBUG:boto:Data: 2023-12-15T23:08:35.006 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.006 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.006 DEBUG:boto:Params: {} 2023-12-15T23:08:35.006 DEBUG:boto:Token: None 2023-12-15T23:08:35.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj5 2023-12-15T23:08:35.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3qiW+yTkvZfWWnS2/qSIlDboQVo= 2023-12-15T23:08:35.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3qiW+yTkvZfWWnS2/qSIlDboQVo=', 'Content-Length': '0'} 2023-12-15T23:08:35.009 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d1bbc391b5634a1-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.050 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.050 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.050 DEBUG:boto:path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.050 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.051 DEBUG:boto:Method: GET 2023-12-15T23:08:35.051 DEBUG:boto:Path: /kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.051 DEBUG:boto:Data: 2023-12-15T23:08:35.051 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.051 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.051 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.051 DEBUG:boto:Params: {} 2023-12-15T23:08:35.051 DEBUG:boto:Token: None 2023-12-15T23:08:35.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.053 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000741293108ea1b392-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.054 DEBUG:boto:b'kskgfn-39obj51000falseobj52023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.054 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.054 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.054 DEBUG:boto:path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.054 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.054 DEBUG:boto:Method: GET 2023-12-15T23:08:35.055 DEBUG:boto:Path: /kskgfn-39/?prefix=obj5 2023-12-15T23:08:35.055 DEBUG:boto:Data: 2023-12-15T23:08:35.055 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.055 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.055 DEBUG:boto:Params: {} 2023-12-15T23:08:35.055 DEBUG:boto:Token: None 2023-12-15T23:08:35.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.058 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015ad1e60da96c2ec-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.058 DEBUG:boto:b'kskgfn-39obj51000falseobj52023-12-15T23:08:06.920Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:35.058 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.058 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.059 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.059 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.059 DEBUG:boto:Method: GET 2023-12-15T23:08:35.059 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.059 DEBUG:boto:Data: 2023-12-15T23:08:35.059 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.059 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.059 DEBUG:boto:Params: {} 2023-12-15T23:08:35.059 DEBUG:boto:Token: None 2023-12-15T23:08:35.060 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c= 2023-12-15T23:08:35.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c=', 'Content-Length': '0'} 2023-12-15T23:08:35.062 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000071a4b504223f1bf7-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.062 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.062 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.062 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.062 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.062 DEBUG:boto:Method: GET 2023-12-15T23:08:35.062 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.063 DEBUG:boto:Data: 2023-12-15T23:08:35.063 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.063 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.063 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.063 DEBUG:boto:Params: {} 2023-12-15T23:08:35.063 DEBUG:boto:Token: None 2023-12-15T23:08:35.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c= 2023-12-15T23:08:35.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c=', 'Content-Length': '0'} 2023-12-15T23:08:35.065 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003b95b05ad2844bb8-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.065 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.066 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.066 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.066 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.066 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.066 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.066 DEBUG:boto:Data: 2023-12-15T23:08:35.066 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.066 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.066 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.066 DEBUG:boto:Params: {} 2023-12-15T23:08:35.066 DEBUG:boto:Token: None 2023-12-15T23:08:35.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lt1ApyVyYJcjwpRLd9qoWkFFmfM= 2023-12-15T23:08:35.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lt1ApyVyYJcjwpRLd9qoWkFFmfM=', 'Content-Length': '0'} 2023-12-15T23:08:35.069 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ca4df1eb5d56d093-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.069 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.069 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.069 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.069 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.069 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.069 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.069 DEBUG:boto:Data: 2023-12-15T23:08:35.070 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.070 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.070 DEBUG:boto:Params: {} 2023-12-15T23:08:35.070 DEBUG:boto:Token: None 2023-12-15T23:08:35.070 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lt1ApyVyYJcjwpRLd9qoWkFFmfM= 2023-12-15T23:08:35.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lt1ApyVyYJcjwpRLd9qoWkFFmfM=', 'Content-Length': '0'} 2023-12-15T23:08:35.072 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a3c8a830861424b5-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:35.072 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.072 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.072 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.073 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.073 DEBUG:boto:Method: GET 2023-12-15T23:08:35.073 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.073 DEBUG:boto:Data: 2023-12-15T23:08:35.073 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.073 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.073 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.073 DEBUG:boto:Params: {} 2023-12-15T23:08:35.073 DEBUG:boto:Token: None 2023-12-15T23:08:35.073 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c= 2023-12-15T23:08:35.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c=', 'Content-Length': '0'} 2023-12-15T23:08:35.075 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006ac05bdeca9f1f8e-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.075 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.076 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.076 DEBUG:boto:path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.076 DEBUG:boto:auth_path=/kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.076 DEBUG:boto:Method: GET 2023-12-15T23:08:35.076 DEBUG:boto:Path: /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.076 DEBUG:boto:Data: 2023-12-15T23:08:35.076 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.076 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.076 DEBUG:boto:Params: {} 2023-12-15T23:08:35.076 DEBUG:boto:Token: None 2023-12-15T23:08:35.077 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6?versionId=null 2023-12-15T23:08:35.077 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c= 2023-12-15T23:08:35.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gj51nFmj2/yGDswIhT53eqbVL/c=', 'Content-Length': '0'} 2023-12-15T23:08:35.078 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a32d5560ddcdc3f5-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.121 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.122 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.122 DEBUG:boto:path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.122 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.122 DEBUG:boto:Method: GET 2023-12-15T23:08:35.122 DEBUG:boto:Path: /kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.122 DEBUG:boto:Data: 2023-12-15T23:08:35.122 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.122 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.122 DEBUG:boto:Params: {} 2023-12-15T23:08:35.123 DEBUG:boto:Token: None 2023-12-15T23:08:35.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b522027443191a29-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.125 DEBUG:boto:b'kskgfn-39obj61000falseobj62023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.126 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.126 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.126 DEBUG:boto:path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.126 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.126 DEBUG:boto:Method: GET 2023-12-15T23:08:35.126 DEBUG:boto:Path: /kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.126 DEBUG:boto:Data: 2023-12-15T23:08:35.126 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.126 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.127 DEBUG:boto:Params: {} 2023-12-15T23:08:35.127 DEBUG:boto:Token: None 2023-12-15T23:08:35.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000baf18f5a26318c9b-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.173 DEBUG:boto:b'kskgfn-39obj61000falseobj62023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.174 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.174 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.174 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.174 DEBUG:boto:Path: /kskgfn-39/obj6 2023-12-15T23:08:35.174 DEBUG:boto:Data: 2023-12-15T23:08:35.174 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.174 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.174 DEBUG:boto:Params: {} 2023-12-15T23:08:35.175 DEBUG:boto:Token: None 2023-12-15T23:08:35.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6 2023-12-15T23:08:35.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fHOw+OeXe9+75SJJQZ2v3ttqXTI= 2023-12-15T23:08:35.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fHOw+OeXe9+75SJJQZ2v3ttqXTI=', 'Content-Length': '0'} 2023-12-15T23:08:35.176 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a43eebf62cf1ccc5-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.177 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.177 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.177 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.177 DEBUG:boto:Path: /kskgfn-39/obj6 2023-12-15T23:08:35.177 DEBUG:boto:Data: 2023-12-15T23:08:35.177 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.177 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.177 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.177 DEBUG:boto:Params: {} 2023-12-15T23:08:35.177 DEBUG:boto:Token: None 2023-12-15T23:08:35.178 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6 2023-12-15T23:08:35.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fHOw+OeXe9+75SJJQZ2v3ttqXTI= 2023-12-15T23:08:35.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fHOw+OeXe9+75SJJQZ2v3ttqXTI=', 'Content-Length': '0'} 2023-12-15T23:08:35.179 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009a8357e2dff2faa6-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2023-12-15T23:08:35.180 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.180 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.180 DEBUG:boto:Method: GET 2023-12-15T23:08:35.180 DEBUG:boto:Path: /kskgfn-39/obj6 2023-12-15T23:08:35.180 DEBUG:boto:Data: 2023-12-15T23:08:35.180 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.180 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.180 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.180 DEBUG:boto:Params: {} 2023-12-15T23:08:35.181 DEBUG:boto:Token: None 2023-12-15T23:08:35.181 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6 2023-12-15T23:08:35.181 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dggcWYoeb77yJh9sUV6EA6Hox2I= 2023-12-15T23:08:35.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dggcWYoeb77yJh9sUV6EA6Hox2I=', 'Content-Length': '0'} 2023-12-15T23:08:35.182 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004d83048e733592cb-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.183 DEBUG:boto:path=/kskgfn-39/obj6 2023-12-15T23:08:35.183 DEBUG:boto:auth_path=/kskgfn-39/obj6 2023-12-15T23:08:35.183 DEBUG:boto:Method: GET 2023-12-15T23:08:35.183 DEBUG:boto:Path: /kskgfn-39/obj6 2023-12-15T23:08:35.183 DEBUG:boto:Data: 2023-12-15T23:08:35.183 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.183 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.183 DEBUG:boto:Params: {} 2023-12-15T23:08:35.183 DEBUG:boto:Token: None 2023-12-15T23:08:35.184 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj6 2023-12-15T23:08:35.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dggcWYoeb77yJh9sUV6EA6Hox2I= 2023-12-15T23:08:35.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dggcWYoeb77yJh9sUV6EA6Hox2I=', 'Content-Length': '0'} 2023-12-15T23:08:35.186 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007dfc0c446524e61-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.233 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.234 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.234 DEBUG:boto:path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.236 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.236 DEBUG:boto:Method: GET 2023-12-15T23:08:35.236 DEBUG:boto:Path: /kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.236 DEBUG:boto:Data: 2023-12-15T23:08:35.237 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.237 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.237 DEBUG:boto:Params: {} 2023-12-15T23:08:35.237 DEBUG:boto:Token: None 2023-12-15T23:08:35.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.237 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000061ceffb8b2b30166-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.240 DEBUG:boto:b'kskgfn-39obj61000falseobj62023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.240 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.240 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.240 DEBUG:boto:path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.240 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.240 DEBUG:boto:Method: GET 2023-12-15T23:08:35.241 DEBUG:boto:Path: /kskgfn-39/?prefix=obj6 2023-12-15T23:08:35.241 DEBUG:boto:Data: 2023-12-15T23:08:35.241 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.241 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.241 DEBUG:boto:Params: {} 2023-12-15T23:08:35.241 DEBUG:boto:Token: None 2023-12-15T23:08:35.241 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.241 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d3c173993417258-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.244 DEBUG:boto:b'kskgfn-39obj61000falseobj62023-12-15T23:08:06.929Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:35.245 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.245 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.245 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.245 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.245 DEBUG:boto:Method: GET 2023-12-15T23:08:35.245 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.245 DEBUG:boto:Data: 2023-12-15T23:08:35.245 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.245 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.245 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.245 DEBUG:boto:Params: {} 2023-12-15T23:08:35.246 DEBUG:boto:Token: None 2023-12-15T23:08:35.246 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.246 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo= 2023-12-15T23:08:35.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo=', 'Content-Length': '0'} 2023-12-15T23:08:35.248 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003f4573add4463e7e-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.248 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.249 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.249 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.249 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.249 DEBUG:boto:Method: GET 2023-12-15T23:08:35.249 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.249 DEBUG:boto:Data: 2023-12-15T23:08:35.249 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.249 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.249 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.249 DEBUG:boto:Params: {} 2023-12-15T23:08:35.250 DEBUG:boto:Token: None 2023-12-15T23:08:35.250 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo= 2023-12-15T23:08:35.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo=', 'Content-Length': '0'} 2023-12-15T23:08:35.252 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a982fc530715386-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.252 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.253 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.253 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.253 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.253 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.253 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.253 DEBUG:boto:Data: 2023-12-15T23:08:35.253 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.253 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.253 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.253 DEBUG:boto:Params: {} 2023-12-15T23:08:35.254 DEBUG:boto:Token: None 2023-12-15T23:08:35.254 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XoF/ZuqaPyeztg7D+vJa1Rd80Ow= 2023-12-15T23:08:35.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XoF/ZuqaPyeztg7D+vJa1Rd80Ow=', 'Content-Length': '0'} 2023-12-15T23:08:35.256 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000073471e42370c8536-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.256 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.256 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.256 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.256 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.256 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.256 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.257 DEBUG:boto:Data: 2023-12-15T23:08:35.257 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.257 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.257 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.257 DEBUG:boto:Params: {} 2023-12-15T23:08:35.257 DEBUG:boto:Token: None 2023-12-15T23:08:35.257 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.257 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XoF/ZuqaPyeztg7D+vJa1Rd80Ow= 2023-12-15T23:08:35.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XoF/ZuqaPyeztg7D+vJa1Rd80Ow=', 'Content-Length': '0'} 2023-12-15T23:08:35.260 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000196e1518ae9e3ff6-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:35.260 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.260 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.260 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.260 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.260 DEBUG:boto:Method: GET 2023-12-15T23:08:35.260 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.261 DEBUG:boto:Data: 2023-12-15T23:08:35.261 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.261 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.261 DEBUG:boto:Params: {} 2023-12-15T23:08:35.261 DEBUG:boto:Token: None 2023-12-15T23:08:35.261 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.261 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo= 2023-12-15T23:08:35.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo=', 'Content-Length': '0'} 2023-12-15T23:08:35.263 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000095bdadffd8e0b123-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.263 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.264 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.264 DEBUG:boto:path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.264 DEBUG:boto:auth_path=/kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.264 DEBUG:boto:Method: GET 2023-12-15T23:08:35.264 DEBUG:boto:Path: /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.264 DEBUG:boto:Data: 2023-12-15T23:08:35.264 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.264 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.264 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.264 DEBUG:boto:Params: {} 2023-12-15T23:08:35.264 DEBUG:boto:Token: None 2023-12-15T23:08:35.265 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7?versionId=null 2023-12-15T23:08:35.265 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo= 2023-12-15T23:08:35.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U/c3ZdCODUfIn9AKT9RZ8TQAOMo=', 'Content-Length': '0'} 2023-12-15T23:08:35.267 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001951da7234721838-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.313 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.314 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.314 DEBUG:boto:path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.314 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.314 DEBUG:boto:Method: GET 2023-12-15T23:08:35.314 DEBUG:boto:Path: /kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.314 DEBUG:boto:Data: 2023-12-15T23:08:35.314 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.314 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.314 DEBUG:boto:Params: {} 2023-12-15T23:08:35.314 DEBUG:boto:Token: None 2023-12-15T23:08:35.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004841a086781e8b17-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.317 DEBUG:boto:b'kskgfn-39obj71000falseobj72023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.318 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.318 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.318 DEBUG:boto:path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.318 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.318 DEBUG:boto:Method: GET 2023-12-15T23:08:35.318 DEBUG:boto:Path: /kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.318 DEBUG:boto:Data: 2023-12-15T23:08:35.318 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.318 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.319 DEBUG:boto:Params: {} 2023-12-15T23:08:35.319 DEBUG:boto:Token: None 2023-12-15T23:08:35.319 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000608d231c21c5255f-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.361 DEBUG:boto:b'kskgfn-39obj71000falseobj72023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.362 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.362 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.362 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.362 DEBUG:boto:Path: /kskgfn-39/obj7 2023-12-15T23:08:35.362 DEBUG:boto:Data: 2023-12-15T23:08:35.362 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.362 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.362 DEBUG:boto:Params: {} 2023-12-15T23:08:35.363 DEBUG:boto:Token: None 2023-12-15T23:08:35.363 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7 2023-12-15T23:08:35.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eqqwtc3aAPozAW6K8s+tKDKwYyI= 2023-12-15T23:08:35.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eqqwtc3aAPozAW6K8s+tKDKwYyI=', 'Content-Length': '0'} 2023-12-15T23:08:35.365 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fcc06bf306e062a2-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.365 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.365 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.365 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.365 DEBUG:boto:Path: /kskgfn-39/obj7 2023-12-15T23:08:35.365 DEBUG:boto:Data: 2023-12-15T23:08:35.365 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.366 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.366 DEBUG:boto:Params: {} 2023-12-15T23:08:35.366 DEBUG:boto:Token: None 2023-12-15T23:08:35.366 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7 2023-12-15T23:08:35.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eqqwtc3aAPozAW6K8s+tKDKwYyI= 2023-12-15T23:08:35.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eqqwtc3aAPozAW6K8s+tKDKwYyI=', 'Content-Length': '0'} 2023-12-15T23:08:35.368 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008740dea64ab1a442-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2023-12-15T23:08:35.368 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.369 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.369 DEBUG:boto:Method: GET 2023-12-15T23:08:35.369 DEBUG:boto:Path: /kskgfn-39/obj7 2023-12-15T23:08:35.369 DEBUG:boto:Data: 2023-12-15T23:08:35.369 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.369 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.369 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.369 DEBUG:boto:Params: {} 2023-12-15T23:08:35.369 DEBUG:boto:Token: None 2023-12-15T23:08:35.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7 2023-12-15T23:08:35.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5UZufTEmDWBFFbn0VNG/RZ8D874= 2023-12-15T23:08:35.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5UZufTEmDWBFFbn0VNG/RZ8D874=', 'Content-Length': '0'} 2023-12-15T23:08:35.372 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c9cb7f0376dfe7d-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.372 DEBUG:boto:path=/kskgfn-39/obj7 2023-12-15T23:08:35.372 DEBUG:boto:auth_path=/kskgfn-39/obj7 2023-12-15T23:08:35.372 DEBUG:boto:Method: GET 2023-12-15T23:08:35.372 DEBUG:boto:Path: /kskgfn-39/obj7 2023-12-15T23:08:35.372 DEBUG:boto:Data: 2023-12-15T23:08:35.373 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.373 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.373 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.373 DEBUG:boto:Params: {} 2023-12-15T23:08:35.373 DEBUG:boto:Token: None 2023-12-15T23:08:35.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj7 2023-12-15T23:08:35.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5UZufTEmDWBFFbn0VNG/RZ8D874= 2023-12-15T23:08:35.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5UZufTEmDWBFFbn0VNG/RZ8D874=', 'Content-Length': '0'} 2023-12-15T23:08:35.375 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000abf0c010e5e2f578-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.421 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.422 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.422 DEBUG:boto:path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.422 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.422 DEBUG:boto:Method: GET 2023-12-15T23:08:35.422 DEBUG:boto:Path: /kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.422 DEBUG:boto:Data: 2023-12-15T23:08:35.422 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.422 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.422 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.423 DEBUG:boto:Params: {} 2023-12-15T23:08:35.423 DEBUG:boto:Token: None 2023-12-15T23:08:35.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d7823a85ef9d7ac-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.425 DEBUG:boto:b'kskgfn-39obj71000falseobj72023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.426 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.426 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.426 DEBUG:boto:path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.426 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.426 DEBUG:boto:Method: GET 2023-12-15T23:08:35.426 DEBUG:boto:Path: /kskgfn-39/?prefix=obj7 2023-12-15T23:08:35.426 DEBUG:boto:Data: 2023-12-15T23:08:35.426 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.427 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.427 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.427 DEBUG:boto:Params: {} 2023-12-15T23:08:35.427 DEBUG:boto:Token: None 2023-12-15T23:08:35.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098474907fefc9c0d-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.429 DEBUG:boto:b'kskgfn-39obj71000falseobj72023-12-15T23:08:06.976Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:35.430 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.430 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.430 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.430 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.430 DEBUG:boto:Method: GET 2023-12-15T23:08:35.430 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.430 DEBUG:boto:Data: 2023-12-15T23:08:35.431 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.431 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.431 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.431 DEBUG:boto:Params: {} 2023-12-15T23:08:35.431 DEBUG:boto:Token: None 2023-12-15T23:08:35.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo= 2023-12-15T23:08:35.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo=', 'Content-Length': '0'} 2023-12-15T23:08:35.433 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007de3924457a31eac-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.473 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.474 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.474 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.474 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.474 DEBUG:boto:Method: GET 2023-12-15T23:08:35.474 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.474 DEBUG:boto:Data: 2023-12-15T23:08:35.474 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.474 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.474 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.474 DEBUG:boto:Params: {} 2023-12-15T23:08:35.474 DEBUG:boto:Token: None 2023-12-15T23:08:35.475 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo= 2023-12-15T23:08:35.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo=', 'Content-Length': '0'} 2023-12-15T23:08:35.476 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e5432eada666048-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.521 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.521 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.522 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.522 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.522 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.522 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.522 DEBUG:boto:Data: 2023-12-15T23:08:35.522 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.522 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.522 DEBUG:boto:Params: {} 2023-12-15T23:08:35.522 DEBUG:boto:Token: None 2023-12-15T23:08:35.522 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:es/0DQk+I/MxPlDRJyUHy8yfVGE= 2023-12-15T23:08:35.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:es/0DQk+I/MxPlDRJyUHy8yfVGE=', 'Content-Length': '0'} 2023-12-15T23:08:35.525 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f39bb9ef1b4f76a-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.525 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.525 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.525 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.525 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.525 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.525 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.525 DEBUG:boto:Data: 2023-12-15T23:08:35.525 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.526 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.526 DEBUG:boto:Params: {} 2023-12-15T23:08:35.526 DEBUG:boto:Token: None 2023-12-15T23:08:35.526 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:es/0DQk+I/MxPlDRJyUHy8yfVGE= 2023-12-15T23:08:35.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:es/0DQk+I/MxPlDRJyUHy8yfVGE=', 'Content-Length': '0'} 2023-12-15T23:08:35.528 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e03c405c265d66bc-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:35.529 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.529 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.529 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.529 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.529 DEBUG:boto:Method: GET 2023-12-15T23:08:35.529 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.529 DEBUG:boto:Data: 2023-12-15T23:08:35.529 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.529 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.529 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.529 DEBUG:boto:Params: {} 2023-12-15T23:08:35.530 DEBUG:boto:Token: None 2023-12-15T23:08:35.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo= 2023-12-15T23:08:35.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo=', 'Content-Length': '0'} 2023-12-15T23:08:35.532 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000009309f28097fc4a3-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.532 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.532 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.532 DEBUG:boto:path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.532 DEBUG:boto:auth_path=/kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.532 DEBUG:boto:Method: GET 2023-12-15T23:08:35.532 DEBUG:boto:Path: /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.533 DEBUG:boto:Data: 2023-12-15T23:08:35.533 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.533 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.533 DEBUG:boto:Params: {} 2023-12-15T23:08:35.533 DEBUG:boto:Token: None 2023-12-15T23:08:35.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8?versionId=null 2023-12-15T23:08:35.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo= 2023-12-15T23:08:35.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCj3e9T4Oumqj1UFXcNQILzUNNo=', 'Content-Length': '0'} 2023-12-15T23:08:35.535 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009dec87722fb12c21-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.581 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.582 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.582 DEBUG:boto:path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.582 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.582 DEBUG:boto:Method: GET 2023-12-15T23:08:35.582 DEBUG:boto:Path: /kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.582 DEBUG:boto:Data: 2023-12-15T23:08:35.582 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.582 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.582 DEBUG:boto:Params: {} 2023-12-15T23:08:35.583 DEBUG:boto:Token: None 2023-12-15T23:08:35.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e3a186ad74a202c-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.585 DEBUG:boto:b'kskgfn-39obj81000falseobj82023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.586 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.586 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.586 DEBUG:boto:path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.586 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.586 DEBUG:boto:Method: GET 2023-12-15T23:08:35.586 DEBUG:boto:Path: /kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.586 DEBUG:boto:Data: 2023-12-15T23:08:35.586 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.587 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.587 DEBUG:boto:Params: {} 2023-12-15T23:08:35.587 DEBUG:boto:Token: None 2023-12-15T23:08:35.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019fbcaa1db79d521-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.590 DEBUG:boto:b'kskgfn-39obj81000falseobj82023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.590 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.590 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.590 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.590 DEBUG:boto:Path: /kskgfn-39/obj8 2023-12-15T23:08:35.590 DEBUG:boto:Data: 2023-12-15T23:08:35.590 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.591 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.591 DEBUG:boto:Params: {} 2023-12-15T23:08:35.591 DEBUG:boto:Token: None 2023-12-15T23:08:35.591 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8 2023-12-15T23:08:35.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:batyaPs7XJfzQTfRMuw001K23bM= 2023-12-15T23:08:35.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:batyaPs7XJfzQTfRMuw001K23bM=', 'Content-Length': '0'} 2023-12-15T23:08:35.593 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000092dc85e1cc43bb83-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.593 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.593 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.593 DEBUG:boto:Method: HEAD 2023-12-15T23:08:35.593 DEBUG:boto:Path: /kskgfn-39/obj8 2023-12-15T23:08:35.593 DEBUG:boto:Data: 2023-12-15T23:08:35.593 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.594 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.594 DEBUG:boto:Params: {} 2023-12-15T23:08:35.594 DEBUG:boto:Token: None 2023-12-15T23:08:35.594 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8 2023-12-15T23:08:35.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:batyaPs7XJfzQTfRMuw001K23bM= 2023-12-15T23:08:35.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:batyaPs7XJfzQTfRMuw001K23bM=', 'Content-Length': '0'} 2023-12-15T23:08:35.596 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005fa99df1f2dbe6ac-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.596 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2023-12-15T23:08:35.596 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.596 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.596 DEBUG:boto:Method: GET 2023-12-15T23:08:35.597 DEBUG:boto:Path: /kskgfn-39/obj8 2023-12-15T23:08:35.597 DEBUG:boto:Data: 2023-12-15T23:08:35.597 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.597 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.597 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.597 DEBUG:boto:Params: {} 2023-12-15T23:08:35.597 DEBUG:boto:Token: None 2023-12-15T23:08:35.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8 2023-12-15T23:08:35.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5tOoX2XVMLZK99KxI8CYKYAoK5E= 2023-12-15T23:08:35.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5tOoX2XVMLZK99KxI8CYKYAoK5E=', 'Content-Length': '0'} 2023-12-15T23:08:35.599 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000001e8bef426fe5223-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.600 DEBUG:boto:path=/kskgfn-39/obj8 2023-12-15T23:08:35.600 DEBUG:boto:auth_path=/kskgfn-39/obj8 2023-12-15T23:08:35.600 DEBUG:boto:Method: GET 2023-12-15T23:08:35.600 DEBUG:boto:Path: /kskgfn-39/obj8 2023-12-15T23:08:35.600 DEBUG:boto:Data: 2023-12-15T23:08:35.600 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.600 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.600 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.600 DEBUG:boto:Params: {} 2023-12-15T23:08:35.600 DEBUG:boto:Token: None 2023-12-15T23:08:35.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/obj8 2023-12-15T23:08:35.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5tOoX2XVMLZK99KxI8CYKYAoK5E= 2023-12-15T23:08:35.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5tOoX2XVMLZK99KxI8CYKYAoK5E=', 'Content-Length': '0'} 2023-12-15T23:08:35.603 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:06 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '160ba887-62cd-49c7-8578-f3cea1ced053:kskgfn-39:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d412c794e996747-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.649 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.650 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.650 DEBUG:boto:path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.650 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.650 DEBUG:boto:Method: GET 2023-12-15T23:08:35.650 DEBUG:boto:Path: /kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.650 DEBUG:boto:Data: 2023-12-15T23:08:35.650 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:35.650 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.650 DEBUG:boto:Params: {} 2023-12-15T23:08:35.651 DEBUG:boto:Token: None 2023-12-15T23:08:35.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089aa62937bb451e3-00657cdc73-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.653 DEBUG:boto:b'kskgfn-39obj81000falseobj82023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.653 DEBUG:boto:path=/kskgfn-39/ 2023-12-15T23:08:35.653 DEBUG:boto:auth_path=/kskgfn-39/ 2023-12-15T23:08:35.654 DEBUG:boto:path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.654 DEBUG:boto:auth_path=/kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.654 DEBUG:boto:Method: GET 2023-12-15T23:08:35.654 DEBUG:boto:Path: /kskgfn-39/?prefix=obj8 2023-12-15T23:08:35.654 DEBUG:boto:Data: 2023-12-15T23:08:35.654 DEBUG:boto:Headers: {} 2023-12-15T23:08:35.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:35.654 DEBUG:boto:Port: 8000 2023-12-15T23:08:35.654 DEBUG:boto:Params: {} 2023-12-15T23:08:35.654 DEBUG:boto:Token: None 2023-12-15T23:08:35.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:35 GMT /kskgfn-39/ 2023-12-15T23:08:35.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE= 2023-12-15T23:08:35.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWA+aUqjvlzHAM4a7LC6NZWcaaE=', 'Content-Length': '0'} 2023-12-15T23:08:35.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033e572bfea0c2407-00657cdc73-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:35.657 DEBUG:boto:b'kskgfn-39obj81000falseobj82023-12-15T23:08:06.986Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:35.658 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-39 zones={test-zone2, test-zone1} 2023-12-15T23:08:35.658 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T23:08:35.658 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.658 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:35.711 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:35.711 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:35.765 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000006830","last_update":"2023-12-15T23:08:07.219951Z"},{"marker":"00000000000000000000:00000000000000006553","last_update":"2023-12-15T23:08:25.384083Z"},{"marker":"00000000000000000000:00000000000000004859","last_update":"2023-12-15T23:08:25.385994Z"},{"marker":"00000000000000000000:00000000000000009637","last_update":"2023-12-15T23:08:25.387816Z"}] 2023-12-15T23:08:35.765 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000006830', 1: '00000000000000000000:00000000000000006553', 2: '00000000000000000000:00000000000000004859', 3: '00000000000000000000:00000000000000009637'} 2023-12-15T23:08:35.765 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:08:35.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.766 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:35.823 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:35.823 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:35.873 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006830","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:07.219951Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006553","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.384083Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004859","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.385994Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009637","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.387816Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:08:35Z"} 2023-12-15T23:08:35.873 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1763382617696077244},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006830","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:07.219951Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006553","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.384083Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004859","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.385994Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009637","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.387816Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2023-12-15T23:08:35Z"} 2023-12-15T23:08:35.873 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006830', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:07.219951Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006553', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.384083Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004859', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.385994Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000009637', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.387816Z'}}] 2023-12-15T23:08:35.873 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000006830', 1: '00000000000000000000:00000000000000006553', 2: '00000000000000000000:00000000000000004859', 3: '00000000000000000000:00000000000000009637'} 2023-12-15T23:08:35.874 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000006830', 1: '00000000000000000000:00000000000000006553', 2: '00000000000000000000:00000000000000004859', 3: '00000000000000000000:00000000000000009637'} 2023-12-15T23:08:35.874 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:08:35.874 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T23:08:35.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.874 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:35.920 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:35.920 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:35.971 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000005005","last_update":"2023-12-15T23:08:25.406659Z"},{"marker":"00000000000000000000:00000000000000005149","last_update":"2023-12-15T23:08:25.408627Z"},{"marker":"00000000000000000000:00000000000000004302","last_update":"2023-12-15T23:08:25.410268Z"},{"marker":"00000000000000000000:00000000000000007393","last_update":"2023-12-15T23:08:25.412119Z"}] 2023-12-15T23:08:35.971 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000005005', 1: '00000000000000000000:00000000000000005149', 2: '00000000000000000000:00000000000000004302', 3: '00000000000000000000:00000000000000007393'} 2023-12-15T23:08:35.971 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:08:35.971 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:35.971 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:36.021 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:36.022 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:36.068 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005005","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.406659Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005149","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.408627Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:08:25.410268Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007393","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.412119Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:08:36Z"} 2023-12-15T23:08:36.068 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005005","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.406659Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005149","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.408627Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004302","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:08:25.410268Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007393","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:08:25.412119Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:08:36Z"} 2023-12-15T23:08:36.068 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005005', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.406659Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005149', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.408627Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004302', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.410268Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007393', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:08:25.412119Z'}}] 2023-12-15T23:08:36.068 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000005005', 1: '00000000000000000000:00000000000000005149', 2: '00000000000000000000:00000000000000004302', 3: '00000000000000000000:00000000000000007393'} 2023-12-15T23:08:36.068 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000005005', 1: '00000000000000000000:00000000000000005149', 2: '00000000000000000000:00000000000000004302', 3: '00000000000000000000:00000000000000007393'} 2023-12-15T23:08:36.068 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:08:36.069 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2023-12-15T23:08:36.070 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-40 2023-12-15T23:08:36.070 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:36.070 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:36.070 DEBUG:boto:Method: PUT 2023-12-15T23:08:36.070 DEBUG:boto:Path: /kskgfn-40/ 2023-12-15T23:08:36.071 DEBUG:boto:Data: 2023-12-15T23:08:36.071 DEBUG:boto:Headers: {} 2023-12-15T23:08:36.071 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:36.071 DEBUG:boto:Port: 8000 2023-12-15T23:08:36.071 DEBUG:boto:Params: {} 2023-12-15T23:08:36.071 DEBUG:boto:Token: None 2023-12-15T23:08:36.071 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:08:36 GMT /kskgfn-40/ 2023-12-15T23:08:36.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c5iPJj+CNdckoqyaMf/jLP9Loz8= 2023-12-15T23:08:36.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c5iPJj+CNdckoqyaMf/jLP9Loz8=', 'Content-Length': '0'} 2023-12-15T23:08:36.087 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006e024b2c79233972-00657cdc74-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:36.087 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=kskgfn-41 2023-12-15T23:08:36.087 DEBUG:boto:path=/kskgfn-41/ 2023-12-15T23:08:36.087 DEBUG:boto:auth_path=/kskgfn-41/ 2023-12-15T23:08:36.087 DEBUG:boto:Method: PUT 2023-12-15T23:08:36.088 DEBUG:boto:Path: /kskgfn-41/ 2023-12-15T23:08:36.088 DEBUG:boto:Data: 2023-12-15T23:08:36.088 DEBUG:boto:Headers: {} 2023-12-15T23:08:36.088 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:36.088 DEBUG:boto:Port: 8000 2023-12-15T23:08:36.088 DEBUG:boto:Params: {} 2023-12-15T23:08:36.088 DEBUG:boto:Token: None 2023-12-15T23:08:36.088 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:08:36 GMT /kskgfn-41/ 2023-12-15T23:08:36.088 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vEq/mmRDQzUQllCLvVg8LrKdATM= 2023-12-15T23:08:36.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vEq/mmRDQzUQllCLvVg8LrKdATM=', 'Content-Length': '0'} 2023-12-15T23:08:36.117 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000900cefcb4274d2a0-00657cdc74-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:36.118 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:36.118 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:36.118 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploads 2023-12-15T23:08:36.118 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploads 2023-12-15T23:08:36.118 DEBUG:boto:Method: POST 2023-12-15T23:08:36.118 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploads 2023-12-15T23:08:36.118 DEBUG:boto:Data: 2023-12-15T23:08:36.118 DEBUG:boto:Headers: {} 2023-12-15T23:08:36.118 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:36.118 DEBUG:boto:Port: 8000 2023-12-15T23:08:36.118 DEBUG:boto:Params: {} 2023-12-15T23:08:36.118 DEBUG:boto:Token: None 2023-12-15T23:08:36.119 DEBUG:boto:StringToSign: POST Fri, 15 Dec 2023 23:08:36 GMT /kskgfn-40/MULTIPART?uploads 2023-12-15T23:08:36.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ow12gIttsHXULMcIa0ipyiNleSc= 2023-12-15T23:08:36.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ow12gIttsHXULMcIa0ipyiNleSc=', 'Content-Length': '0'} 2023-12-15T23:08:37.351 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a6b547e9f4363fd4-00657cdc74-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '249'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.351 DEBUG:boto:b'kskgfn-40MULTIPART2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s' 2023-12-15T23:08:37.384 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.384 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.384 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=1 2023-12-15T23:08:37.385 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=1 2023-12-15T23:08:37.385 DEBUG:boto:Method: PUT 2023-12-15T23:08:37.385 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=1 2023-12-15T23:08:37.385 DEBUG:boto:Data: 2023-12-15T23:08:37.385 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2023-12-15T23:08:37.385 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.385 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.385 DEBUG:boto:Params: {} 2023-12-15T23:08:37.386 DEBUG:boto:Token: None 2023-12-15T23:08:37.386 DEBUG:boto:StringToSign: PUT ebKBBg0ze5srhMzzkK3PdA== application/octet-stream Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?partNumber=1&uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IIQeTErtdUw3nqCcBgFWUi40yzE= 2023-12-15T23:08:37.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IIQeTErtdUw3nqCcBgFWUi40yzE='} 2023-12-15T23:08:37.420 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"79b281060d337b9b2b84ccf390adcf74"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003275557620a6cd29-00657cdc75-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.448 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.449 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.449 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=2 2023-12-15T23:08:37.449 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=2 2023-12-15T23:08:37.449 DEBUG:boto:Method: PUT 2023-12-15T23:08:37.449 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=2 2023-12-15T23:08:37.449 DEBUG:boto:Data: 2023-12-15T23:08:37.449 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2023-12-15T23:08:37.449 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.449 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.449 DEBUG:boto:Params: {} 2023-12-15T23:08:37.450 DEBUG:boto:Token: None 2023-12-15T23:08:37.450 DEBUG:boto:StringToSign: PUT dIQ6OrGTo4m87YmUAtmdXw== application/octet-stream Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?partNumber=2&uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NfRjB0iC7XTuxQbFmiObywvsM7U= 2023-12-15T23:08:37.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NfRjB0iC7XTuxQbFmiObywvsM7U='} 2023-12-15T23:08:37.483 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"74843a3ab193a389bced899402d99d5f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a257800d33d45e77-00657cdc75-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.502 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.502 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.502 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=3 2023-12-15T23:08:37.502 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=3 2023-12-15T23:08:37.502 DEBUG:boto:Method: PUT 2023-12-15T23:08:37.502 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=3 2023-12-15T23:08:37.502 DEBUG:boto:Data: 2023-12-15T23:08:37.502 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2023-12-15T23:08:37.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.502 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.502 DEBUG:boto:Params: {} 2023-12-15T23:08:37.503 DEBUG:boto:Token: None 2023-12-15T23:08:37.503 DEBUG:boto:StringToSign: PUT e4RW4edMN49Fhh9TYZ51tg== application/octet-stream Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?partNumber=3&uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PJEV8ohC/PvVf8Jo+1A5OQZfbjo= 2023-12-15T23:08:37.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PJEV8ohC/PvVf8Jo+1A5OQZfbjo='} 2023-12-15T23:08:37.535 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"7b8456e1e74c378f45861f53619e75b6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000074f6824e73f19668-00657cdc75-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.554 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.554 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.554 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=4 2023-12-15T23:08:37.554 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=4 2023-12-15T23:08:37.554 DEBUG:boto:Method: PUT 2023-12-15T23:08:37.554 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s&partNumber=4 2023-12-15T23:08:37.554 DEBUG:boto:Data: 2023-12-15T23:08:37.554 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2023-12-15T23:08:37.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.554 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.555 DEBUG:boto:Params: {} 2023-12-15T23:08:37.555 DEBUG:boto:Token: None 2023-12-15T23:08:37.555 DEBUG:boto:StringToSign: PUT l+jDi4yPcIlVvEiQwDQZTQ== application/octet-stream Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?partNumber=4&uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9nbkOIRQwivheKKHy/2wbHhmw8o= 2023-12-15T23:08:37.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9nbkOIRQwivheKKHy/2wbHhmw8o='} 2023-12-15T23:08:37.584 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"97e8c38b8c8f708955bc4890c034194d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000908ea32946bbc651-00657cdc75-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.584 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.584 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.584 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.584 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.584 DEBUG:boto:Method: GET 2023-12-15T23:08:37.584 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.585 DEBUG:boto:Data: 2023-12-15T23:08:37.585 DEBUG:boto:Headers: {} 2023-12-15T23:08:37.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.585 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.585 DEBUG:boto:Params: {} 2023-12-15T23:08:37.585 DEBUG:boto:Token: None 2023-12-15T23:08:37.585 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GSbdxn62JdZICmoIueXMjrrJuj8= 2023-12-15T23:08:37.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GSbdxn62JdZICmoIueXMjrrJuj8=', 'Content-Length': '0'} 2023-12-15T23:08:37.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b3b4054d10d8c28-00657cdc75-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.630 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.630 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:37.630 DEBUG:boto:path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.630 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.630 DEBUG:boto:Method: POST 2023-12-15T23:08:37.630 DEBUG:boto:Path: /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.630 DEBUG:boto:Data: 1 "79b281060d337b9b2b84ccf390adcf74" 2 "74843a3ab193a389bced899402d99d5f" 3 "7b8456e1e74c378f45861f53619e75b6" 4 "97e8c38b8c8f708955bc4890c034194d" 2023-12-15T23:08:37.630 DEBUG:boto:Headers: {'Content-Type': 'text/xml'} 2023-12-15T23:08:37.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:37.630 DEBUG:boto:Port: 8000 2023-12-15T23:08:37.631 DEBUG:boto:Params: {} 2023-12-15T23:08:37.631 DEBUG:boto:Token: None 2023-12-15T23:08:37.631 DEBUG:boto:StringToSign: POST text/xml Fri, 15 Dec 2023 23:08:37 GMT /kskgfn-40/MULTIPART?uploadId=2~gpnDZ7RZcX2OE_TBYS3dXHtWgtmd3-s 2023-12-15T23:08:37.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQz4/cE5og/gZL+HvIYZK3VSKRg= 2023-12-15T23:08:37.631 DEBUG:boto:Final headers: {'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQz4/cE5og/gZL+HvIYZK3VSKRg=', 'Content-Length': '460'} 2023-12-15T23:08:37.641 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001c2dd53e195efe1f-00657cdc75-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '291'), ('Date', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:37.642 DEBUG:boto:http://smithi093.front.sepia.ceph.com:8000/kskgfn-40/MULTIPARTkskgfn-40MULTIPART 2023-12-15T23:08:37.642 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:37.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:37.643 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:37.687 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:37.687 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:37.719 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:08:37.734 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681716.106670_333.1","last_update":"2023-12-15T23:08:36.106670Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:08:37.734 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681716.106670_333.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:37.734 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:08:37.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:37.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:37.735 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:37.819 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:37.817+0000 7fde62128800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:37.820 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:37.819+0000 7fde62128800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:37.836 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681716.106670_333.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:36.106670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:37Z"} 2023-12-15T23:08:37.837 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681716.106670_333.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:36.106670Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:37Z"} 2023-12-15T23:08:37.837 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681716.106670_333.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:08:36.106670Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:08:37.837 DEBUG:rgw_multi.tests:log_status={0: '1_1702681716.106670_333.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:37.837 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681716.106670_333.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:37.837 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:08:37.837 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-40 2023-12-15T23:08:37.838 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:37.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:37.838 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-40 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:37.892 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:37.892 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:37.928 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:37.927+0000 7f6d2713d800 1 waiting to reach incremental sync.. 2023-12-15T23:08:42.931 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:42.930+0000 7f6d2713d800 1 bucket sync caught up with source: 2023-12-15T23:08:42.931 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000011.52.6, , , , , ] 2023-12-15T23:08:42.931 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000011.52.6, , , , , ] 2023-12-15T23:08:42.931 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:42.930+0000 7f6d2713d800 0 bucket checkpoint complete 2023-12-15T23:08:42.949 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-40 2023-12-15T23:08:42.949 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:42.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:42.949 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-40 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:43.010 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:43.010 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:43.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:43.053+0000 7f039fa12800 1 bucket sync caught up with source: 2023-12-15T23:08:43.054 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000001.105.6, , , , , ] 2023-12-15T23:08:43.054 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000001.105.6, , , , , ] 2023-12-15T23:08:43.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:43.053+0000 7f039fa12800 0 bucket checkpoint complete 2023-12-15T23:08:43.069 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-40 zones={test-zone2, test-zone1} 2023-12-15T23:08:43.069 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.069 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.069 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.069 DEBUG:boto:Path: /kskgfn-40/ 2023-12-15T23:08:43.070 DEBUG:boto:Data: 2023-12-15T23:08:43.070 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.070 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.070 DEBUG:boto:Params: {} 2023-12-15T23:08:43.070 DEBUG:boto:Token: None 2023-12-15T23:08:43.070 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Zf9Ri9Up9JGCITS9mXENF5Uk4w= 2023-12-15T23:08:43.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Zf9Ri9Up9JGCITS9mXENF5Uk4w=', 'Content-Length': '0'} 2023-12-15T23:08:43.073 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f6cab6ea9236ae90-00657cdc7b-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.073 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.073 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.073 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.073 DEBUG:boto:Path: /kskgfn-40/ 2023-12-15T23:08:43.073 DEBUG:boto:Data: 2023-12-15T23:08:43.073 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.074 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.074 DEBUG:boto:Params: {} 2023-12-15T23:08:43.074 DEBUG:boto:Token: None 2023-12-15T23:08:43.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Zf9Ri9Up9JGCITS9mXENF5Uk4w= 2023-12-15T23:08:43.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Zf9Ri9Up9JGCITS9mXENF5Uk4w=', 'Content-Length': '0'} 2023-12-15T23:08:43.077 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d07e2881d335a1ed-00657cdc7b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.077 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:08:43.077 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.077 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.077 DEBUG:boto:path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.077 DEBUG:boto:auth_path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.077 DEBUG:boto:Method: GET 2023-12-15T23:08:43.077 DEBUG:boto:Path: /kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.077 DEBUG:boto:Data: 2023-12-15T23:08:43.078 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.078 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.078 DEBUG:boto:Params: {} 2023-12-15T23:08:43.078 DEBUG:boto:Token: None 2023-12-15T23:08:43.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/?versions 2023-12-15T23:08:43.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg= 2023-12-15T23:08:43.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg=', 'Content-Length': '0'} 2023-12-15T23:08:43.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000625d5f52b6c6727c-00657cdc7b-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.081 DEBUG:boto:b'kskgfn-40999falseMULTIPARTnulltrue2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.082 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2023-12-15T23:08:43.082 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:08:43.082 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.082 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.082 DEBUG:boto:path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.082 DEBUG:boto:auth_path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.082 DEBUG:boto:Method: GET 2023-12-15T23:08:43.082 DEBUG:boto:Path: /kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.082 DEBUG:boto:Data: 2023-12-15T23:08:43.082 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.083 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.083 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.083 DEBUG:boto:Params: {} 2023-12-15T23:08:43.083 DEBUG:boto:Token: None 2023-12-15T23:08:43.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/?versions 2023-12-15T23:08:43.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg= 2023-12-15T23:08:43.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg=', 'Content-Length': '0'} 2023-12-15T23:08:43.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005597fc3e04040250-00657cdc7b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.085 DEBUG:boto:b'kskgfn-40999falseMULTIPARTnulltrue2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.086 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2023-12-15T23:08:43.086 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.086 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.086 DEBUG:boto:path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.086 DEBUG:boto:auth_path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.086 DEBUG:boto:Method: GET 2023-12-15T23:08:43.086 DEBUG:boto:Path: /kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.086 DEBUG:boto:Data: 2023-12-15T23:08:43.087 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.087 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.087 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.087 DEBUG:boto:Params: {} 2023-12-15T23:08:43.087 DEBUG:boto:Token: None 2023-12-15T23:08:43.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/?versions 2023-12-15T23:08:43.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg= 2023-12-15T23:08:43.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg=', 'Content-Length': '0'} 2023-12-15T23:08:43.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9737b3613720134-00657cdc7b-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.090 DEBUG:boto:b'kskgfn-40999falseMULTIPARTnulltrue2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.090 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.090 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.090 DEBUG:boto:path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.090 DEBUG:boto:auth_path=/kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.090 DEBUG:boto:Method: GET 2023-12-15T23:08:43.091 DEBUG:boto:Path: /kskgfn-40/?versions&max-keys=999 2023-12-15T23:08:43.091 DEBUG:boto:Data: 2023-12-15T23:08:43.091 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.091 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.091 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.091 DEBUG:boto:Params: {} 2023-12-15T23:08:43.091 DEBUG:boto:Token: None 2023-12-15T23:08:43.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/?versions 2023-12-15T23:08:43.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg= 2023-12-15T23:08:43.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/dhNVEm5qIZxn6k+qDqXhRDUXg=', 'Content-Length': '0'} 2023-12-15T23:08:43.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001017aa0c42dbdf45-00657cdc7b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.094 DEBUG:boto:b'kskgfn-40999falseMULTIPARTnulltrue2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2023-12-15T23:08:43.094 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.094 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.094 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.094 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.094 DEBUG:boto:Method: GET 2023-12-15T23:08:43.095 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.095 DEBUG:boto:Data: 2023-12-15T23:08:43.095 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.095 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.095 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.095 DEBUG:boto:Params: {} 2023-12-15T23:08:43.095 DEBUG:boto:Token: None 2023-12-15T23:08:43.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk= 2023-12-15T23:08:43.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk=', 'Content-Length': '0'} 2023-12-15T23:08:43.100 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-40:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000003fb8af42ed12b706-00657cdc7b-4788-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.173 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.173 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.174 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.174 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.174 DEBUG:boto:Method: GET 2023-12-15T23:08:43.174 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.174 DEBUG:boto:Data: 2023-12-15T23:08:43.174 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.174 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.174 DEBUG:boto:Params: {} 2023-12-15T23:08:43.174 DEBUG:boto:Token: None 2023-12-15T23:08:43.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk= 2023-12-15T23:08:43.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk=', 'Content-Length': '0'} 2023-12-15T23:08:43.178 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000e545f254113cc597-00657cdc7b-4716-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.268 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.268 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.269 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.269 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.269 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.269 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.269 DEBUG:boto:Data: 2023-12-15T23:08:43.269 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.269 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.269 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.269 DEBUG:boto:Params: {} 2023-12-15T23:08:43.270 DEBUG:boto:Token: None 2023-12-15T23:08:43.270 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:54if4YopWGz24LlhRIhnEsRpsJI= 2023-12-15T23:08:43.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:54if4YopWGz24LlhRIhnEsRpsJI=', 'Content-Length': '0'} 2023-12-15T23:08:43.272 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-40:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000000e95a8df4cad7fb7-00657cdc7b-4788-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.273 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.273 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.273 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.273 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.273 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.273 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.273 DEBUG:boto:Data: 2023-12-15T23:08:43.273 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.274 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.274 DEBUG:boto:Params: {} 2023-12-15T23:08:43.274 DEBUG:boto:Token: None 2023-12-15T23:08:43.274 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:54if4YopWGz24LlhRIhnEsRpsJI= 2023-12-15T23:08:43.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:54if4YopWGz24LlhRIhnEsRpsJI=', 'Content-Length': '0'} 2023-12-15T23:08:43.276 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000004d98a100888321d5-00657cdc7b-4716-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2023-12-15T23:08:43.276 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.276 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.277 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.277 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.277 DEBUG:boto:Method: GET 2023-12-15T23:08:43.277 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.277 DEBUG:boto:Data: 2023-12-15T23:08:43.277 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.277 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.277 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.277 DEBUG:boto:Params: {} 2023-12-15T23:08:43.277 DEBUG:boto:Token: None 2023-12-15T23:08:43.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk= 2023-12-15T23:08:43.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk=', 'Content-Length': '0'} 2023-12-15T23:08:43.282 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-40:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000d6d488315b241fa8-00657cdc7b-4788-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.366 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.366 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.366 DEBUG:boto:path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.366 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.366 DEBUG:boto:Method: GET 2023-12-15T23:08:43.366 DEBUG:boto:Path: /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.366 DEBUG:boto:Data: 2023-12-15T23:08:43.366 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.366 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.367 DEBUG:boto:Params: {} 2023-12-15T23:08:43.367 DEBUG:boto:Token: None 2023-12-15T23:08:43.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART?versionId=null 2023-12-15T23:08:43.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk= 2023-12-15T23:08:43.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:astHlBHx5DBMKlBYcgXxBzQLGyk=', 'Content-Length': '0'} 2023-12-15T23:08:43.370 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000acaf1c9986438f30-00657cdc7b-4716-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.464 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.464 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.464 DEBUG:boto:path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.464 DEBUG:boto:auth_path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.464 DEBUG:boto:Method: GET 2023-12-15T23:08:43.465 DEBUG:boto:Path: /kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.465 DEBUG:boto:Data: 2023-12-15T23:08:43.465 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.465 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.465 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.465 DEBUG:boto:Params: {} 2023-12-15T23:08:43.465 DEBUG:boto:Token: None 2023-12-15T23:08:43.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg= 2023-12-15T23:08:43.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg=', 'Content-Length': '0'} 2023-12-15T23:08:43.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e9874f29beaeabf-00657cdc7b-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.469 DEBUG:boto:b'kskgfn-40MULTIPART1000falseMULTIPART2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.469 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.469 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.469 DEBUG:boto:path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.470 DEBUG:boto:auth_path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.470 DEBUG:boto:Method: GET 2023-12-15T23:08:43.470 DEBUG:boto:Path: /kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.470 DEBUG:boto:Data: 2023-12-15T23:08:43.470 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.470 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.470 DEBUG:boto:Params: {} 2023-12-15T23:08:43.470 DEBUG:boto:Token: None 2023-12-15T23:08:43.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg= 2023-12-15T23:08:43.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg=', 'Content-Length': '0'} 2023-12-15T23:08:43.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da2d9d8d68d263af-00657cdc7b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.473 DEBUG:boto:b'kskgfn-40MULTIPART1000falseMULTIPART2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.474 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.474 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.474 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.474 DEBUG:boto:Path: /kskgfn-40/MULTIPART 2023-12-15T23:08:43.474 DEBUG:boto:Data: 2023-12-15T23:08:43.474 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.474 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.474 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.474 DEBUG:boto:Params: {} 2023-12-15T23:08:43.474 DEBUG:boto:Token: None 2023-12-15T23:08:43.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART 2023-12-15T23:08:43.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lfjqr/0VclofkuvDeRf/WIIB9YE= 2023-12-15T23:08:43.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lfjqr/0VclofkuvDeRf/WIIB9YE=', 'Content-Length': '0'} 2023-12-15T23:08:43.477 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-40:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000c424b6997c10ae8d-00657cdc7b-4788-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.477 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.477 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.477 DEBUG:boto:Method: HEAD 2023-12-15T23:08:43.477 DEBUG:boto:Path: /kskgfn-40/MULTIPART 2023-12-15T23:08:43.478 DEBUG:boto:Data: 2023-12-15T23:08:43.478 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.478 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.478 DEBUG:boto:Params: {} 2023-12-15T23:08:43.478 DEBUG:boto:Token: None 2023-12-15T23:08:43.478 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART 2023-12-15T23:08:43.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lfjqr/0VclofkuvDeRf/WIIB9YE= 2023-12-15T23:08:43.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lfjqr/0VclofkuvDeRf/WIIB9YE=', 'Content-Length': '0'} 2023-12-15T23:08:43.480 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000002a97c8e97bb03efb-00657cdc7b-4716-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2023-12-15T23:08:43.481 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.481 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.481 DEBUG:boto:Method: GET 2023-12-15T23:08:43.481 DEBUG:boto:Path: /kskgfn-40/MULTIPART 2023-12-15T23:08:43.481 DEBUG:boto:Data: 2023-12-15T23:08:43.481 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.481 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.481 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.481 DEBUG:boto:Params: {} 2023-12-15T23:08:43.481 DEBUG:boto:Token: None 2023-12-15T23:08:43.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART 2023-12-15T23:08:43.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EN9CxQ3aTX4z4FoTZpIEY9HOW8Y= 2023-12-15T23:08:43.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EN9CxQ3aTX4z4FoTZpIEY9HOW8Y=', 'Content-Length': '0'} 2023-12-15T23:08:43.486 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-40:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000bcf5f8907d4e9a48-00657cdc7b-4788-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.570 DEBUG:boto:path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.570 DEBUG:boto:auth_path=/kskgfn-40/MULTIPART 2023-12-15T23:08:43.570 DEBUG:boto:Method: GET 2023-12-15T23:08:43.570 DEBUG:boto:Path: /kskgfn-40/MULTIPART 2023-12-15T23:08:43.571 DEBUG:boto:Data: 2023-12-15T23:08:43.571 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.571 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.571 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.571 DEBUG:boto:Params: {} 2023-12-15T23:08:43.571 DEBUG:boto:Token: None 2023-12-15T23:08:43.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/MULTIPART 2023-12-15T23:08:43.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EN9CxQ3aTX4z4FoTZpIEY9HOW8Y= 2023-12-15T23:08:43.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EN9CxQ3aTX4z4FoTZpIEY9HOW8Y=', 'Content-Length': '0'} 2023-12-15T23:08:43.574 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000006f6d59b7aa869014-00657cdc7b-4716-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.669 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.669 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.669 DEBUG:boto:path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.669 DEBUG:boto:auth_path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.669 DEBUG:boto:Method: GET 2023-12-15T23:08:43.669 DEBUG:boto:Path: /kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.669 DEBUG:boto:Data: 2023-12-15T23:08:43.670 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:43.670 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.670 DEBUG:boto:Params: {} 2023-12-15T23:08:43.670 DEBUG:boto:Token: None 2023-12-15T23:08:43.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg= 2023-12-15T23:08:43.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg=', 'Content-Length': '0'} 2023-12-15T23:08:43.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038630b407b63ff47-00657cdc7b-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.673 DEBUG:boto:b'kskgfn-40MULTIPART1000falseMULTIPART2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.673 DEBUG:boto:path=/kskgfn-40/ 2023-12-15T23:08:43.674 DEBUG:boto:auth_path=/kskgfn-40/ 2023-12-15T23:08:43.674 DEBUG:boto:path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.674 DEBUG:boto:auth_path=/kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.674 DEBUG:boto:Method: GET 2023-12-15T23:08:43.674 DEBUG:boto:Path: /kskgfn-40/?prefix=MULTIPART 2023-12-15T23:08:43.674 DEBUG:boto:Data: 2023-12-15T23:08:43.674 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.674 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.674 DEBUG:boto:Params: {} 2023-12-15T23:08:43.674 DEBUG:boto:Token: None 2023-12-15T23:08:43.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-40/ 2023-12-15T23:08:43.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg= 2023-12-15T23:08:43.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lj3JeOcwSRx0R0dWYXEf50FBgMg=', 'Content-Length': '0'} 2023-12-15T23:08:43.677 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000655fb2c2c624e3f2-00657cdc7b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.677 DEBUG:boto:b'kskgfn-40MULTIPART1000falseMULTIPART2023-12-15T23:08:37.635Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:08:43.677 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-40 zones={test-zone2, test-zone1} 2023-12-15T23:08:43.678 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2023-12-15T23:08:43.678 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-42 2023-12-15T23:08:43.678 DEBUG:boto:path=/kskgfn-42/ 2023-12-15T23:08:43.678 DEBUG:boto:auth_path=/kskgfn-42/ 2023-12-15T23:08:43.679 DEBUG:boto:Method: PUT 2023-12-15T23:08:43.679 DEBUG:boto:Path: /kskgfn-42/ 2023-12-15T23:08:43.679 DEBUG:boto:Data: 2023-12-15T23:08:43.679 DEBUG:boto:Headers: {} 2023-12-15T23:08:43.679 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.679 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.679 DEBUG:boto:Params: {} 2023-12-15T23:08:43.679 DEBUG:boto:Token: None 2023-12-15T23:08:43.679 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:08:43 GMT /kskgfn-42/ 2023-12-15T23:08:43.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NQrxpYN2Msf/6hHtkAg/ySgAamg= 2023-12-15T23:08:43.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NQrxpYN2Msf/6hHtkAg/ySgAamg=', 'Content-Length': '0'} 2023-12-15T23:08:43.699 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d3400864d4d1855f-00657cdc7b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.699 DEBUG:boto:path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:43.700 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:43.700 DEBUG:boto:Method: PUT 2023-12-15T23:08:43.700 DEBUG:boto:Path: /kskgfn-42/testobj-sse-c 2023-12-15T23:08:43.700 DEBUG:boto:Data: 2023-12-15T23:08:43.700 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:08:43.700 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.700 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.700 DEBUG:boto:Params: {} 2023-12-15T23:08:43.700 DEBUG:boto:Token: None 2023-12-15T23:08:43.700 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Fri, 15 Dec 2023 23:08:43 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /kskgfn-42/testobj-sse-c 2023-12-15T23:08:43.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oE0HAwrMdQuV0X/RIjhkV2+IlLo= 2023-12-15T23:08:43.701 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oE0HAwrMdQuV0X/RIjhkV2+IlLo='} 2023-12-15T23:08:43.750 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('x-amz-request-id', 'tx000008d0529c767e1865c-00657cdc7b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.750 DEBUG:boto:path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:43.750 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:43.750 DEBUG:boto:Method: PUT 2023-12-15T23:08:43.750 DEBUG:boto:Path: /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:43.750 DEBUG:boto:Data: 2023-12-15T23:08:43.750 DEBUG:boto:Headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2023-12-15T23:08:43.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:43.751 DEBUG:boto:Port: 8000 2023-12-15T23:08:43.751 DEBUG:boto:Params: {} 2023-12-15T23:08:43.751 DEBUG:boto:Token: None 2023-12-15T23:08:43.751 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Fri, 15 Dec 2023 23:08:43 GMT x-amz-server-side-encryption:aws:kms x-amz-server-side-encryption-aws-kms-key-id:testkey-1 /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:43.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L548JjBnRH6/ZNym/fmdV+KsfA8= 2023-12-15T23:08:43.751 DEBUG:boto:Final headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L548JjBnRH6/ZNym/fmdV+KsfA8='} 2023-12-15T23:08:43.783 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('x-amz-server-side-encryption-context', 'eyJhd3M6czM6YXJuIjoiYXJuOmF3czpzMzo6cmd3LW11bHRpc2l0ZS10ZXN0LXVzZXI6a3NrZ2ZuLTQyL3Rlc3RvYmotc3NlLWttcyJ9'), ('x-amz-request-id', 'tx00000685589616e084df2-00657cdc7b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:43.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:43.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:43.784 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:43.832 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:43.832 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:43.865 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:08:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681723.697387_337.1","last_update":"2023-12-15T23:08:43.697387Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:08:43.880 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681723.697387_337.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:43.880 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:08:43.881 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:43.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:43.881 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:43.934 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:43.934 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:43.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:43.965+0000 7f8ba3a8c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:43.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:43.966+0000 7f8ba3a8c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:43.982 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681723.697387_337.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:43.697387Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:43Z"} 2023-12-15T23:08:43.983 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681723.697387_337.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:43.697387Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:43Z"} 2023-12-15T23:08:43.983 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681723.697387_337.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:08:43.697387Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:08:43.983 DEBUG:rgw_multi.tests:log_status={0: '1_1702681723.697387_337.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:43.983 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681723.697387_337.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:43.983 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:08:43.983 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:43.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:43.984 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-42 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:44.040 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:44.040 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:44.075 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:44.074+0000 7fc05313d800 1 waiting to reach incremental sync.. 2023-12-15T23:08:49.075 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:49.075+0000 7fc05313d800 1 waiting to reach incremental sync.. 2023-12-15T23:08:54.077 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:54.077+0000 7fc05313d800 1 bucket sync caught up with source: 2023-12-15T23:08:54.078 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.56.6, , , , 00000000001.28.6, , , , , ] 2023-12-15T23:08:54.078 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.56.6, , , , 00000000001.28.6, , , , , ] 2023-12-15T23:08:54.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:54.077+0000 7fc05313d800 0 bucket checkpoint complete 2023-12-15T23:08:54.096 DEBUG:boto:path=/kskgfn-42/ 2023-12-15T23:08:54.096 DEBUG:boto:auth_path=/kskgfn-42/ 2023-12-15T23:08:54.097 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.097 DEBUG:boto:Path: /kskgfn-42/ 2023-12-15T23:08:54.097 DEBUG:boto:Data: 2023-12-15T23:08:54.097 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.097 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:54.097 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.097 DEBUG:boto:Params: {} 2023-12-15T23:08:54.097 DEBUG:boto:Token: None 2023-12-15T23:08:54.098 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-42/ 2023-12-15T23:08:54.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Tp/xOw0dz9rU8w4SVdIYAFHYAAI= 2023-12-15T23:08:54.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Tp/xOw0dz9rU8w4SVdIYAFHYAAI=', 'Content-Length': '0'} 2023-12-15T23:08:54.100 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '1024'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023a582b37fba4a3f-00657cdc86-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.101 DEBUG:boto:path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.101 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.101 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.102 DEBUG:boto:Path: /kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.102 DEBUG:boto:Data: 2023-12-15T23:08:54.102 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2023-12-15T23:08:54.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:54.102 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.102 DEBUG:boto:Params: {} 2023-12-15T23:08:54.102 DEBUG:boto:Token: None 2023-12-15T23:08:54.102 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uiasE1UYjCS6QID7u0/4lS8IGA8= 2023-12-15T23:08:54.103 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uiasE1UYjCS6QID7u0/4lS8IGA8=', 'Content-Length': '0'} 2023-12-15T23:08:54.104 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-42:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000365fa415a89d6b6e-00657cdc86-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.104 DEBUG:boto:path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.105 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.105 DEBUG:boto:Method: GET 2023-12-15T23:08:54.105 DEBUG:boto:Path: /kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.105 DEBUG:boto:Data: 2023-12-15T23:08:54.105 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2023-12-15T23:08:54.105 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:54.105 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.105 DEBUG:boto:Params: {} 2023-12-15T23:08:54.105 DEBUG:boto:Token: None 2023-12-15T23:08:54.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:54 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /kskgfn-42/testobj-sse-c 2023-12-15T23:08:54.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MM04tYf4RXuqPg0mhIhSfjNxHJY= 2023-12-15T23:08:54.106 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MM04tYf4RXuqPg0mhIhSfjNxHJY=', 'Content-Length': '0'} 2023-12-15T23:08:54.108 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-42:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000d636efac0889b7ef-00657cdc86-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.108 DEBUG:boto:path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.108 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.108 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.108 DEBUG:boto:Path: /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.108 DEBUG:boto:Data: 2023-12-15T23:08:54.109 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.109 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:54.109 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.109 DEBUG:boto:Params: {} 2023-12-15T23:08:54.109 DEBUG:boto:Token: None 2023-12-15T23:08:54.109 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LMhKlkE7KNRjxbjgPUKF367O/G0= 2023-12-15T23:08:54.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LMhKlkE7KNRjxbjgPUKF367O/G0=', 'Content-Length': '0'} 2023-12-15T23:08:54.111 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-42:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000004128e68343c8f44c-00657cdc86-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.111 DEBUG:boto:path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.112 DEBUG:boto:auth_path=/kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.112 DEBUG:boto:Method: GET 2023-12-15T23:08:54.112 DEBUG:boto:Path: /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.112 DEBUG:boto:Data: 2023-12-15T23:08:54.112 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.112 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:08:54.112 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.112 DEBUG:boto:Params: {} 2023-12-15T23:08:54.112 DEBUG:boto:Token: None 2023-12-15T23:08:54.113 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-42/testobj-sse-kms 2023-12-15T23:08:54.113 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cK5slZGbnCvyNQLzlcIWHBYYlIw= 2023-12-15T23:08:54.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cK5slZGbnCvyNQLzlcIWHBYYlIw=', 'Content-Length': '0'} 2023-12-15T23:08:54.115 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-42:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000634aff01142ce761-00657cdc86-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.116 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2023-12-15T23:08:54.116 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-43 2023-12-15T23:08:54.116 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:08:54.116 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:08:54.116 DEBUG:boto:Method: PUT 2023-12-15T23:08:54.117 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:08:54.117 DEBUG:boto:Data: 2023-12-15T23:08:54.117 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.117 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.117 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.117 DEBUG:boto:Params: {} 2023-12-15T23:08:54.117 DEBUG:boto:Token: None 2023-12-15T23:08:54.117 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/ 2023-12-15T23:08:54.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZoAbrDig/lPb0ItL/L8jxZBlAcI= 2023-12-15T23:08:54.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZoAbrDig/lPb0ItL/L8jxZBlAcI=', 'Content-Length': '0'} 2023-12-15T23:08:54.137 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004dfa87b63ddeb330-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.137 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:08:54.138 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:08:54.138 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.138 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:08:54.138 DEBUG:boto:Data: 2023-12-15T23:08:54.138 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.138 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.138 DEBUG:boto:Params: {} 2023-12-15T23:08:54.138 DEBUG:boto:Token: None 2023-12-15T23:08:54.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/ 2023-12-15T23:08:54.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo= 2023-12-15T23:08:54.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo=', 'Content-Length': '0'} 2023-12-15T23:08:54.141 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f233fdc19de52901-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.141 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:08:54.141 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:08:54.141 DEBUG:boto:Method: PUT 2023-12-15T23:08:54.141 DEBUG:boto:Path: /kskgfn-43/a 2023-12-15T23:08:54.142 DEBUG:boto:Data: 2023-12-15T23:08:54.142 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:08:54.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.142 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.142 DEBUG:boto:Params: {} 2023-12-15T23:08:54.142 DEBUG:boto:Token: None 2023-12-15T23:08:54.142 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/a 2023-12-15T23:08:54.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S4NLH695/ca1DVHPRRpy35j2pfw= 2023-12-15T23:08:54.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S4NLH695/ca1DVHPRRpy35j2pfw='} 2023-12-15T23:08:54.150 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000f3cf30b17fd3375-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.150 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:08:54.150 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:08:54.151 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.151 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:08:54.151 DEBUG:boto:Data: 2023-12-15T23:08:54.151 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.151 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.151 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.151 DEBUG:boto:Params: {} 2023-12-15T23:08:54.151 DEBUG:boto:Token: None 2023-12-15T23:08:54.151 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/ 2023-12-15T23:08:54.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo= 2023-12-15T23:08:54.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo=', 'Content-Length': '0'} 2023-12-15T23:08:54.154 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c80f109389d9a2d5-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.154 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:08:54.154 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:08:54.154 DEBUG:boto:Method: PUT 2023-12-15T23:08:54.154 DEBUG:boto:Path: /kskgfn-43/b 2023-12-15T23:08:54.154 DEBUG:boto:Data: 2023-12-15T23:08:54.155 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:08:54.155 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.155 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.155 DEBUG:boto:Params: {} 2023-12-15T23:08:54.155 DEBUG:boto:Token: None 2023-12-15T23:08:54.155 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/b 2023-12-15T23:08:54.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8uxWxeRVSBy9AZaFg3Ut6Lv4MLY= 2023-12-15T23:08:54.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8uxWxeRVSBy9AZaFg3Ut6Lv4MLY='} 2023-12-15T23:08:54.198 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000021a0caab0030bc38-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.198 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:08:54.198 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:08:54.198 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.198 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:08:54.198 DEBUG:boto:Data: 2023-12-15T23:08:54.198 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.199 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.199 DEBUG:boto:Params: {} 2023-12-15T23:08:54.199 DEBUG:boto:Token: None 2023-12-15T23:08:54.199 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/ 2023-12-15T23:08:54.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo= 2023-12-15T23:08:54.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo=', 'Content-Length': '0'} 2023-12-15T23:08:54.201 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d6f0782f2f1ed5c-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.202 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:08:54.202 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:08:54.202 DEBUG:boto:Method: PUT 2023-12-15T23:08:54.202 DEBUG:boto:Path: /kskgfn-43/c 2023-12-15T23:08:54.202 DEBUG:boto:Data: 2023-12-15T23:08:54.202 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:08:54.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.202 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.202 DEBUG:boto:Params: {} 2023-12-15T23:08:54.202 DEBUG:boto:Token: None 2023-12-15T23:08:54.203 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/c 2023-12-15T23:08:54.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CXdGYab/XtzWATu0O2AWXuohrYM= 2023-12-15T23:08:54.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CXdGYab/XtzWATu0O2AWXuohrYM='} 2023-12-15T23:08:54.208 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d960c0c3d89f741e-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.209 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:08:54.209 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:08:54.209 DEBUG:boto:Method: HEAD 2023-12-15T23:08:54.209 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:08:54.209 DEBUG:boto:Data: 2023-12-15T23:08:54.209 DEBUG:boto:Headers: {} 2023-12-15T23:08:54.209 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.209 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.209 DEBUG:boto:Params: {} 2023-12-15T23:08:54.210 DEBUG:boto:Token: None 2023-12-15T23:08:54.210 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/ 2023-12-15T23:08:54.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo= 2023-12-15T23:08:54.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fYBj04RHJWvW0pLmNLwhkOv26mo=', 'Content-Length': '0'} 2023-12-15T23:08:54.212 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000007a35f6d4f0ea5fd-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.212 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:08:54.212 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:08:54.212 DEBUG:boto:Method: PUT 2023-12-15T23:08:54.212 DEBUG:boto:Path: /kskgfn-43/d 2023-12-15T23:08:54.212 DEBUG:boto:Data: 2023-12-15T23:08:54.212 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:08:54.212 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:08:54.212 DEBUG:boto:Port: 8000 2023-12-15T23:08:54.213 DEBUG:boto:Params: {} 2023-12-15T23:08:54.213 DEBUG:boto:Token: None 2023-12-15T23:08:54.213 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:08:54 GMT /kskgfn-43/d 2023-12-15T23:08:54.213 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Luxh6fy6LmFJmcRUZCOHyvOX3SE= 2023-12-15T23:08:54.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:08:54 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Luxh6fy6LmFJmcRUZCOHyvOX3SE='} 2023-12-15T23:08:54.257 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2ea1ab7035b2933-00657cdc86-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:08:54.258 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:54.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:54.258 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:54.306 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:54.306 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:54.337 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:08:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681734.135226_342.1","last_update":"2023-12-15T23:08:54.135226Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:08:54.353 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681734.135226_342.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:54.353 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:08:54.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:54.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:08:54.354 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:08:54.406 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:54.406 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:54.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:54.439+0000 7f7617722800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:54.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:54.440+0000 7f7617722800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:08:54.457 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681734.135226_342.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:54.135226Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:54Z"} 2023-12-15T23:08:54.457 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681734.135226_342.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:08:54.135226Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:08:54Z"} 2023-12-15T23:08:54.457 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681734.135226_342.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:08:54.135226Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:08:54.457 DEBUG:rgw_multi.tests:log_status={0: '1_1702681734.135226_342.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:54.458 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681734.135226_342.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:08:54.458 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:08:54.458 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-43 2023-12-15T23:08:54.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-43', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:54.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-43', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:54.458 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-43 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:54.512 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:54.513 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:54.547 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:54.547+0000 7f70f3e16800 1 waiting to reach incremental sync.. 2023-12-15T23:08:59.549 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:59.548+0000 7f70f3e16800 1 bucket sync caught up with source: 2023-12-15T23:08:59.550 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.53.6, , , , 00000000001.34.6, , , 00000000001.27.6, , 00000000001.28.6] 2023-12-15T23:08:59.550 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.53.6, , , , 00000000001.34.6, , , 00000000001.27.6, , 00000000001.28.6] 2023-12-15T23:08:59.550 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:08:59.548+0000 7f70f3e16800 0 bucket checkpoint complete 2023-12-15T23:08:59.569 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-43 2023-12-15T23:08:59.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-43', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:59.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-43', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:08:59.570 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-43 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:08:59.631 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:08:59.631 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:08:59.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:08:59.671+0000 7f871c127800 1 waiting to reach incremental sync.. 2023-12-15T23:09:04.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:04.673+0000 7f871c127800 1 bucket sync caught up with source: 2023-12-15T23:09:04.674 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.134.6, , , , 00000000001.135.6, , , 00000000001.115.6, , 00000000001.74.6] 2023-12-15T23:09:04.675 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.134.6, , , , 00000000001.135.6, , , 00000000001.115.6, , 00000000001.74.6] 2023-12-15T23:09:04.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:04.673+0000 7f871c127800 0 bucket checkpoint complete 2023-12-15T23:09:04.693 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-43 zones={test-zone2, test-zone1} 2023-12-15T23:09:04.693 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.693 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.693 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.693 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:09:04.693 DEBUG:boto:Data: 2023-12-15T23:09:04.694 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.694 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.694 DEBUG:boto:Params: {} 2023-12-15T23:09:04.694 DEBUG:boto:Token: None 2023-12-15T23:09:04.694 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d6oNPM2W7Ytn4xP2mQMVQluFbi0= 2023-12-15T23:09:04.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d6oNPM2W7Ytn4xP2mQMVQluFbi0=', 'Content-Length': '0'} 2023-12-15T23:09:04.697 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003d47579238700a00-00657cdc90-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.697 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.697 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.697 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.697 DEBUG:boto:Path: /kskgfn-43/ 2023-12-15T23:09:04.697 DEBUG:boto:Data: 2023-12-15T23:09:04.697 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.698 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.698 DEBUG:boto:Params: {} 2023-12-15T23:09:04.698 DEBUG:boto:Token: None 2023-12-15T23:09:04.698 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d6oNPM2W7Ytn4xP2mQMVQluFbi0= 2023-12-15T23:09:04.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d6oNPM2W7Ytn4xP2mQMVQluFbi0=', 'Content-Length': '0'} 2023-12-15T23:09:04.700 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005ed6af0e45a46d91-00657cdc90-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.701 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:09:04.701 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.701 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.701 DEBUG:boto:path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.701 DEBUG:boto:auth_path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.701 DEBUG:boto:Method: GET 2023-12-15T23:09:04.701 DEBUG:boto:Path: /kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.701 DEBUG:boto:Data: 2023-12-15T23:09:04.701 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.702 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.702 DEBUG:boto:Params: {} 2023-12-15T23:09:04.702 DEBUG:boto:Token: None 2023-12-15T23:09:04.702 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/?versions 2023-12-15T23:09:04.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w= 2023-12-15T23:09:04.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w=', 'Content-Length': '0'} 2023-12-15T23:09:04.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c6342643fac6662-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.705 DEBUG:boto:b'kskgfn-43999falseanulltrue2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.705 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:04.706 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:04.706 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:04.706 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:04.706 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:09:04.706 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.706 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.706 DEBUG:boto:path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.706 DEBUG:boto:auth_path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.706 DEBUG:boto:Method: GET 2023-12-15T23:09:04.706 DEBUG:boto:Path: /kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.706 DEBUG:boto:Data: 2023-12-15T23:09:04.707 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.707 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.707 DEBUG:boto:Params: {} 2023-12-15T23:09:04.707 DEBUG:boto:Token: None 2023-12-15T23:09:04.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/?versions 2023-12-15T23:09:04.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w= 2023-12-15T23:09:04.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w=', 'Content-Length': '0'} 2023-12-15T23:09:04.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e518bd62e213e319-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.709 DEBUG:boto:b'kskgfn-43999falseanulltrue2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.710 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:04.710 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:04.710 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:04.710 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:04.710 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.710 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.710 DEBUG:boto:path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.710 DEBUG:boto:auth_path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.711 DEBUG:boto:Method: GET 2023-12-15T23:09:04.711 DEBUG:boto:Path: /kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.711 DEBUG:boto:Data: 2023-12-15T23:09:04.711 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.711 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.711 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.711 DEBUG:boto:Params: {} 2023-12-15T23:09:04.711 DEBUG:boto:Token: None 2023-12-15T23:09:04.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/?versions 2023-12-15T23:09:04.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w= 2023-12-15T23:09:04.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w=', 'Content-Length': '0'} 2023-12-15T23:09:04.713 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd53c8a799e8c7f4-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.714 DEBUG:boto:b'kskgfn-43999falseanulltrue2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.714 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.714 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.714 DEBUG:boto:path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.714 DEBUG:boto:auth_path=/kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.715 DEBUG:boto:Method: GET 2023-12-15T23:09:04.715 DEBUG:boto:Path: /kskgfn-43/?versions&max-keys=999 2023-12-15T23:09:04.715 DEBUG:boto:Data: 2023-12-15T23:09:04.715 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.715 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.715 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.715 DEBUG:boto:Params: {} 2023-12-15T23:09:04.715 DEBUG:boto:Token: None 2023-12-15T23:09:04.715 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/?versions 2023-12-15T23:09:04.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w= 2023-12-15T23:09:04.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bCohI4P7PU7Mbs/9jU547zjvi3w=', 'Content-Length': '0'} 2023-12-15T23:09:04.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a4ea66959e473a1-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.718 DEBUG:boto:b'kskgfn-43999falseanulltrue2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.718 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:04.719 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.719 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.719 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.719 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.719 DEBUG:boto:Method: GET 2023-12-15T23:09:04.719 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.719 DEBUG:boto:Data: 2023-12-15T23:09:04.719 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.719 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.719 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.719 DEBUG:boto:Params: {} 2023-12-15T23:09:04.720 DEBUG:boto:Token: None 2023-12-15T23:09:04.720 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.720 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA= 2023-12-15T23:09:04.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA=', 'Content-Length': '0'} 2023-12-15T23:09:04.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087d98cf298052c7c-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.722 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.722 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.722 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.722 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.722 DEBUG:boto:Method: GET 2023-12-15T23:09:04.723 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.723 DEBUG:boto:Data: 2023-12-15T23:09:04.723 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.723 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.723 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.723 DEBUG:boto:Params: {} 2023-12-15T23:09:04.723 DEBUG:boto:Token: None 2023-12-15T23:09:04.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA= 2023-12-15T23:09:04.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA=', 'Content-Length': '0'} 2023-12-15T23:09:04.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcee922431c1bb09-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.725 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.725 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.726 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.726 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.726 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.726 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.726 DEBUG:boto:Data: 2023-12-15T23:09:04.726 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.726 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.726 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.726 DEBUG:boto:Params: {} 2023-12-15T23:09:04.726 DEBUG:boto:Token: None 2023-12-15T23:09:04.727 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RLV4DSMeP0oxoBgTuSfMaVECQxc= 2023-12-15T23:09:04.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RLV4DSMeP0oxoBgTuSfMaVECQxc=', 'Content-Length': '0'} 2023-12-15T23:09:04.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000297fad27d483f1c7-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.729 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.729 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.729 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.729 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.729 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.729 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.730 DEBUG:boto:Data: 2023-12-15T23:09:04.730 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.730 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.730 DEBUG:boto:Params: {} 2023-12-15T23:09:04.730 DEBUG:boto:Token: None 2023-12-15T23:09:04.730 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RLV4DSMeP0oxoBgTuSfMaVECQxc= 2023-12-15T23:09:04.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RLV4DSMeP0oxoBgTuSfMaVECQxc=', 'Content-Length': '0'} 2023-12-15T23:09:04.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087412379edfe058b-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:04.732 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.732 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.733 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.733 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.733 DEBUG:boto:Method: GET 2023-12-15T23:09:04.733 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.733 DEBUG:boto:Data: 2023-12-15T23:09:04.733 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.733 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.733 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.733 DEBUG:boto:Params: {} 2023-12-15T23:09:04.733 DEBUG:boto:Token: None 2023-12-15T23:09:04.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA= 2023-12-15T23:09:04.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA=', 'Content-Length': '0'} 2023-12-15T23:09:04.735 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e655ea850bdb97d8-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.736 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.736 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.736 DEBUG:boto:path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.736 DEBUG:boto:auth_path=/kskgfn-43/a?versionId=null 2023-12-15T23:09:04.736 DEBUG:boto:Method: GET 2023-12-15T23:09:04.736 DEBUG:boto:Path: /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.736 DEBUG:boto:Data: 2023-12-15T23:09:04.736 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.736 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.737 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.737 DEBUG:boto:Params: {} 2023-12-15T23:09:04.737 DEBUG:boto:Token: None 2023-12-15T23:09:04.737 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a?versionId=null 2023-12-15T23:09:04.737 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA= 2023-12-15T23:09:04.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MO+8Eps1Kyrvl/RFku6iPrmrChA=', 'Content-Length': '0'} 2023-12-15T23:09:04.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ffe86a7fe7d5437-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.739 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.739 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.739 DEBUG:boto:path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.740 DEBUG:boto:auth_path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.740 DEBUG:boto:Method: GET 2023-12-15T23:09:04.740 DEBUG:boto:Path: /kskgfn-43/?prefix=a 2023-12-15T23:09:04.740 DEBUG:boto:Data: 2023-12-15T23:09:04.740 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.740 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.740 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.740 DEBUG:boto:Params: {} 2023-12-15T23:09:04.740 DEBUG:boto:Token: None 2023-12-15T23:09:04.740 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.741 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.743 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce4782cdb89e5bfa-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.743 DEBUG:boto:b'kskgfn-43a1000falsea2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.743 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.743 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.744 DEBUG:boto:path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.744 DEBUG:boto:auth_path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.744 DEBUG:boto:Method: GET 2023-12-15T23:09:04.744 DEBUG:boto:Path: /kskgfn-43/?prefix=a 2023-12-15T23:09:04.744 DEBUG:boto:Data: 2023-12-15T23:09:04.744 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.744 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.744 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.744 DEBUG:boto:Params: {} 2023-12-15T23:09:04.744 DEBUG:boto:Token: None 2023-12-15T23:09:04.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.745 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0eff6a330961aeb-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.747 DEBUG:boto:b'kskgfn-43a1000falsea2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.747 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.747 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.747 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.748 DEBUG:boto:Path: /kskgfn-43/a 2023-12-15T23:09:04.748 DEBUG:boto:Data: 2023-12-15T23:09:04.748 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.748 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.748 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.748 DEBUG:boto:Params: {} 2023-12-15T23:09:04.748 DEBUG:boto:Token: None 2023-12-15T23:09:04.748 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a 2023-12-15T23:09:04.748 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ap72awQsxl1GjgO+UGDvynSVyCE= 2023-12-15T23:09:04.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ap72awQsxl1GjgO+UGDvynSVyCE=', 'Content-Length': '0'} 2023-12-15T23:09:04.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a1156fdc8883058-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.750 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.750 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.751 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.751 DEBUG:boto:Path: /kskgfn-43/a 2023-12-15T23:09:04.751 DEBUG:boto:Data: 2023-12-15T23:09:04.751 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.751 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.751 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.751 DEBUG:boto:Params: {} 2023-12-15T23:09:04.751 DEBUG:boto:Token: None 2023-12-15T23:09:04.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a 2023-12-15T23:09:04.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ap72awQsxl1GjgO+UGDvynSVyCE= 2023-12-15T23:09:04.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ap72awQsxl1GjgO+UGDvynSVyCE=', 'Content-Length': '0'} 2023-12-15T23:09:04.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8435245f693088d-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:04.753 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.754 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.754 DEBUG:boto:Method: GET 2023-12-15T23:09:04.754 DEBUG:boto:Path: /kskgfn-43/a 2023-12-15T23:09:04.754 DEBUG:boto:Data: 2023-12-15T23:09:04.754 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.754 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.754 DEBUG:boto:Params: {} 2023-12-15T23:09:04.754 DEBUG:boto:Token: None 2023-12-15T23:09:04.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a 2023-12-15T23:09:04.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JZ+1et9n41AoGawqmS1l8Ys/KFk= 2023-12-15T23:09:04.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JZ+1et9n41AoGawqmS1l8Ys/KFk=', 'Content-Length': '0'} 2023-12-15T23:09:04.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0ab405b3372f44d-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.797 DEBUG:boto:path=/kskgfn-43/a 2023-12-15T23:09:04.798 DEBUG:boto:auth_path=/kskgfn-43/a 2023-12-15T23:09:04.798 DEBUG:boto:Method: GET 2023-12-15T23:09:04.798 DEBUG:boto:Path: /kskgfn-43/a 2023-12-15T23:09:04.798 DEBUG:boto:Data: 2023-12-15T23:09:04.798 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.798 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.798 DEBUG:boto:Params: {} 2023-12-15T23:09:04.798 DEBUG:boto:Token: None 2023-12-15T23:09:04.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/a 2023-12-15T23:09:04.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JZ+1et9n41AoGawqmS1l8Ys/KFk= 2023-12-15T23:09:04.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JZ+1et9n41AoGawqmS1l8Ys/KFk=', 'Content-Length': '0'} 2023-12-15T23:09:04.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b164b59f500fe1c1-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.801 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.801 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.801 DEBUG:boto:path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.801 DEBUG:boto:auth_path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.801 DEBUG:boto:Method: GET 2023-12-15T23:09:04.801 DEBUG:boto:Path: /kskgfn-43/?prefix=a 2023-12-15T23:09:04.801 DEBUG:boto:Data: 2023-12-15T23:09:04.801 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.802 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.802 DEBUG:boto:Params: {} 2023-12-15T23:09:04.802 DEBUG:boto:Token: None 2023-12-15T23:09:04.802 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009611412535556ad0-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.805 DEBUG:boto:b'kskgfn-43a1000falsea2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.805 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.805 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.805 DEBUG:boto:path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.805 DEBUG:boto:auth_path=/kskgfn-43/?prefix=a 2023-12-15T23:09:04.805 DEBUG:boto:Method: GET 2023-12-15T23:09:04.805 DEBUG:boto:Path: /kskgfn-43/?prefix=a 2023-12-15T23:09:04.806 DEBUG:boto:Data: 2023-12-15T23:09:04.806 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.806 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.806 DEBUG:boto:Params: {} 2023-12-15T23:09:04.806 DEBUG:boto:Token: None 2023-12-15T23:09:04.806 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.806 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bef0caa06955780-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.808 DEBUG:boto:b'kskgfn-43a1000falsea2023-12-15T23:08:54.145Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:04.809 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.809 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.809 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.809 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.809 DEBUG:boto:Method: GET 2023-12-15T23:09:04.809 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.810 DEBUG:boto:Data: 2023-12-15T23:09:04.810 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.810 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.810 DEBUG:boto:Params: {} 2023-12-15T23:09:04.810 DEBUG:boto:Token: None 2023-12-15T23:09:04.810 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA= 2023-12-15T23:09:04.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA=', 'Content-Length': '0'} 2023-12-15T23:09:04.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007adf84abe582e8f-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.853 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.854 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.854 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.854 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.854 DEBUG:boto:Method: GET 2023-12-15T23:09:04.854 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.854 DEBUG:boto:Data: 2023-12-15T23:09:04.854 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.854 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.854 DEBUG:boto:Params: {} 2023-12-15T23:09:04.854 DEBUG:boto:Token: None 2023-12-15T23:09:04.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA= 2023-12-15T23:09:04.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA=', 'Content-Length': '0'} 2023-12-15T23:09:04.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e26ce5fe2d2f2fcf-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.857 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.857 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.857 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.857 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.857 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.858 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.858 DEBUG:boto:Data: 2023-12-15T23:09:04.858 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.858 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.858 DEBUG:boto:Params: {} 2023-12-15T23:09:04.858 DEBUG:boto:Token: None 2023-12-15T23:09:04.858 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.858 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DxAeJI5H/3kQAB9pU+4pN9+fWmM= 2023-12-15T23:09:04.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DxAeJI5H/3kQAB9pU+4pN9+fWmM=', 'Content-Length': '0'} 2023-12-15T23:09:04.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a31f17060fe219a-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.860 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.860 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.861 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.861 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.861 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.861 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.861 DEBUG:boto:Data: 2023-12-15T23:09:04.861 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.861 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.861 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.861 DEBUG:boto:Params: {} 2023-12-15T23:09:04.861 DEBUG:boto:Token: None 2023-12-15T23:09:04.862 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.862 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DxAeJI5H/3kQAB9pU+4pN9+fWmM= 2023-12-15T23:09:04.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DxAeJI5H/3kQAB9pU+4pN9+fWmM=', 'Content-Length': '0'} 2023-12-15T23:09:04.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005983dcb85a146b6-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:04.864 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.864 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.864 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.864 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.864 DEBUG:boto:Method: GET 2023-12-15T23:09:04.864 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.865 DEBUG:boto:Data: 2023-12-15T23:09:04.865 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.865 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.865 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.865 DEBUG:boto:Params: {} 2023-12-15T23:09:04.865 DEBUG:boto:Token: None 2023-12-15T23:09:04.865 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA= 2023-12-15T23:09:04.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA=', 'Content-Length': '0'} 2023-12-15T23:09:04.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b20882c15161943d-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.909 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.910 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.910 DEBUG:boto:path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.910 DEBUG:boto:auth_path=/kskgfn-43/b?versionId=null 2023-12-15T23:09:04.910 DEBUG:boto:Method: GET 2023-12-15T23:09:04.910 DEBUG:boto:Path: /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.910 DEBUG:boto:Data: 2023-12-15T23:09:04.910 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.910 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.910 DEBUG:boto:Params: {} 2023-12-15T23:09:04.911 DEBUG:boto:Token: None 2023-12-15T23:09:04.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b?versionId=null 2023-12-15T23:09:04.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA= 2023-12-15T23:09:04.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eWsooJVDvrgsW0dWGqGM8Y6stA=', 'Content-Length': '0'} 2023-12-15T23:09:04.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6ec5dccb4557b05-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.914 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.914 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.914 DEBUG:boto:path=/kskgfn-43/?prefix=b 2023-12-15T23:09:04.914 DEBUG:boto:auth_path=/kskgfn-43/?prefix=b 2023-12-15T23:09:04.914 DEBUG:boto:Method: GET 2023-12-15T23:09:04.914 DEBUG:boto:Path: /kskgfn-43/?prefix=b 2023-12-15T23:09:04.914 DEBUG:boto:Data: 2023-12-15T23:09:04.914 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.915 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.915 DEBUG:boto:Params: {} 2023-12-15T23:09:04.915 DEBUG:boto:Token: None 2023-12-15T23:09:04.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b247920e28940ce-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.957 DEBUG:boto:b'kskgfn-43b1000falseb2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.958 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:04.958 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:04.958 DEBUG:boto:path=/kskgfn-43/?prefix=b 2023-12-15T23:09:04.958 DEBUG:boto:auth_path=/kskgfn-43/?prefix=b 2023-12-15T23:09:04.958 DEBUG:boto:Method: GET 2023-12-15T23:09:04.958 DEBUG:boto:Path: /kskgfn-43/?prefix=b 2023-12-15T23:09:04.958 DEBUG:boto:Data: 2023-12-15T23:09:04.958 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.959 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.959 DEBUG:boto:Params: {} 2023-12-15T23:09:04.959 DEBUG:boto:Token: None 2023-12-15T23:09:04.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/ 2023-12-15T23:09:04.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4= 2023-12-15T23:09:04.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YwKBRuLAZ/vxbkb6i6bNEYiJHj4=', 'Content-Length': '0'} 2023-12-15T23:09:04.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031e48bbedf93d8af-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.962 DEBUG:boto:b'kskgfn-43b1000falseb2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:04.962 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.962 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.962 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.962 DEBUG:boto:Path: /kskgfn-43/b 2023-12-15T23:09:04.962 DEBUG:boto:Data: 2023-12-15T23:09:04.963 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.963 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.963 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.963 DEBUG:boto:Params: {} 2023-12-15T23:09:04.963 DEBUG:boto:Token: None 2023-12-15T23:09:04.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b 2023-12-15T23:09:04.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B0LkymbFhLyQrbx19xWmD6SwDNc= 2023-12-15T23:09:04.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B0LkymbFhLyQrbx19xWmD6SwDNc=', 'Content-Length': '0'} 2023-12-15T23:09:04.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c54a58ac92e14238-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.966 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.966 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.966 DEBUG:boto:Method: HEAD 2023-12-15T23:09:04.966 DEBUG:boto:Path: /kskgfn-43/b 2023-12-15T23:09:04.966 DEBUG:boto:Data: 2023-12-15T23:09:04.966 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:04.966 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.966 DEBUG:boto:Params: {} 2023-12-15T23:09:04.966 DEBUG:boto:Token: None 2023-12-15T23:09:04.967 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b 2023-12-15T23:09:04.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B0LkymbFhLyQrbx19xWmD6SwDNc= 2023-12-15T23:09:04.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B0LkymbFhLyQrbx19xWmD6SwDNc=', 'Content-Length': '0'} 2023-12-15T23:09:04.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd184c6ab823f925-00657cdc90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:04.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:04.969 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:04.969 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:04.969 DEBUG:boto:Method: GET 2023-12-15T23:09:04.969 DEBUG:boto:Path: /kskgfn-43/b 2023-12-15T23:09:04.970 DEBUG:boto:Data: 2023-12-15T23:09:04.970 DEBUG:boto:Headers: {} 2023-12-15T23:09:04.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:04.970 DEBUG:boto:Port: 8000 2023-12-15T23:09:04.970 DEBUG:boto:Params: {} 2023-12-15T23:09:04.970 DEBUG:boto:Token: None 2023-12-15T23:09:04.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:04 GMT /kskgfn-43/b 2023-12-15T23:09:04.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DrwPWtG/yEDFPFv1HvDzJiJ0YPk= 2023-12-15T23:09:04.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:04 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DrwPWtG/yEDFPFv1HvDzJiJ0YPk=', 'Content-Length': '0'} 2023-12-15T23:09:04.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ef56eea6ab66d77-00657cdc90-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:04 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.017 DEBUG:boto:path=/kskgfn-43/b 2023-12-15T23:09:05.018 DEBUG:boto:auth_path=/kskgfn-43/b 2023-12-15T23:09:05.018 DEBUG:boto:Method: GET 2023-12-15T23:09:05.018 DEBUG:boto:Path: /kskgfn-43/b 2023-12-15T23:09:05.018 DEBUG:boto:Data: 2023-12-15T23:09:05.018 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.018 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.018 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.018 DEBUG:boto:Params: {} 2023-12-15T23:09:05.018 DEBUG:boto:Token: None 2023-12-15T23:09:05.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/b 2023-12-15T23:09:05.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s0zuGKd+6PyOf0alnecE9zYEtjU= 2023-12-15T23:09:05.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s0zuGKd+6PyOf0alnecE9zYEtjU=', 'Content-Length': '0'} 2023-12-15T23:09:05.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a412daab136737b-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.021 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.021 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.021 DEBUG:boto:path=/kskgfn-43/?prefix=b 2023-12-15T23:09:05.021 DEBUG:boto:auth_path=/kskgfn-43/?prefix=b 2023-12-15T23:09:05.022 DEBUG:boto:Method: GET 2023-12-15T23:09:05.022 DEBUG:boto:Path: /kskgfn-43/?prefix=b 2023-12-15T23:09:05.022 DEBUG:boto:Data: 2023-12-15T23:09:05.022 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.022 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.022 DEBUG:boto:Params: {} 2023-12-15T23:09:05.022 DEBUG:boto:Token: None 2023-12-15T23:09:05.022 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fcbf7b370b7ccd5-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.065 DEBUG:boto:b'kskgfn-43b1000falseb2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.066 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.066 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.066 DEBUG:boto:path=/kskgfn-43/?prefix=b 2023-12-15T23:09:05.066 DEBUG:boto:auth_path=/kskgfn-43/?prefix=b 2023-12-15T23:09:05.066 DEBUG:boto:Method: GET 2023-12-15T23:09:05.066 DEBUG:boto:Path: /kskgfn-43/?prefix=b 2023-12-15T23:09:05.066 DEBUG:boto:Data: 2023-12-15T23:09:05.066 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.067 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.067 DEBUG:boto:Params: {} 2023-12-15T23:09:05.067 DEBUG:boto:Token: None 2023-12-15T23:09:05.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.069 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1aa1915e6054c61-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.070 DEBUG:boto:b'kskgfn-43b1000falseb2023-12-15T23:08:54.157Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.070 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:05.070 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.070 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.070 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.070 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.070 DEBUG:boto:Method: GET 2023-12-15T23:09:05.070 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.071 DEBUG:boto:Data: 2023-12-15T23:09:05.071 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.071 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.071 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.071 DEBUG:boto:Params: {} 2023-12-15T23:09:05.071 DEBUG:boto:Token: None 2023-12-15T23:09:05.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg= 2023-12-15T23:09:05.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg=', 'Content-Length': '0'} 2023-12-15T23:09:05.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000803a60e7707886d7-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.113 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.114 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.114 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.114 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.114 DEBUG:boto:Method: GET 2023-12-15T23:09:05.114 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.114 DEBUG:boto:Data: 2023-12-15T23:09:05.114 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.114 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.114 DEBUG:boto:Params: {} 2023-12-15T23:09:05.114 DEBUG:boto:Token: None 2023-12-15T23:09:05.115 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg= 2023-12-15T23:09:05.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg=', 'Content-Length': '0'} 2023-12-15T23:09:05.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7ace1950f6c4441-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.117 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.117 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.117 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.117 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.117 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.118 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.118 DEBUG:boto:Data: 2023-12-15T23:09:05.118 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.118 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.118 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.118 DEBUG:boto:Params: {} 2023-12-15T23:09:05.118 DEBUG:boto:Token: None 2023-12-15T23:09:05.118 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0I/9oiYqwTe7wcL+lbM9HNCxPLs= 2023-12-15T23:09:05.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0I/9oiYqwTe7wcL+lbM9HNCxPLs=', 'Content-Length': '0'} 2023-12-15T23:09:05.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080a9523e5609cf6f-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.120 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.121 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.121 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.121 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.121 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.121 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.121 DEBUG:boto:Data: 2023-12-15T23:09:05.121 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.121 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.121 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.121 DEBUG:boto:Params: {} 2023-12-15T23:09:05.122 DEBUG:boto:Token: None 2023-12-15T23:09:05.122 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0I/9oiYqwTe7wcL+lbM9HNCxPLs= 2023-12-15T23:09:05.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0I/9oiYqwTe7wcL+lbM9HNCxPLs=', 'Content-Length': '0'} 2023-12-15T23:09:05.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbffb6cdf279b3b2-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:05.124 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.124 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.124 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.124 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.124 DEBUG:boto:Method: GET 2023-12-15T23:09:05.124 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.124 DEBUG:boto:Data: 2023-12-15T23:09:05.124 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.124 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.125 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.125 DEBUG:boto:Params: {} 2023-12-15T23:09:05.125 DEBUG:boto:Token: None 2023-12-15T23:09:05.125 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg= 2023-12-15T23:09:05.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg=', 'Content-Length': '0'} 2023-12-15T23:09:05.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a187b8ef24e3057-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.169 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.170 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.170 DEBUG:boto:path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.170 DEBUG:boto:auth_path=/kskgfn-43/c?versionId=null 2023-12-15T23:09:05.170 DEBUG:boto:Method: GET 2023-12-15T23:09:05.170 DEBUG:boto:Path: /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.170 DEBUG:boto:Data: 2023-12-15T23:09:05.170 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.170 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.170 DEBUG:boto:Params: {} 2023-12-15T23:09:05.170 DEBUG:boto:Token: None 2023-12-15T23:09:05.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c?versionId=null 2023-12-15T23:09:05.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg= 2023-12-15T23:09:05.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KrCjLjJKnizvb3y4ElmO0W0JbIg=', 'Content-Length': '0'} 2023-12-15T23:09:05.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009373e5e5ee278946-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.173 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.173 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.173 DEBUG:boto:path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.173 DEBUG:boto:auth_path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.173 DEBUG:boto:Method: GET 2023-12-15T23:09:05.173 DEBUG:boto:Path: /kskgfn-43/?prefix=c 2023-12-15T23:09:05.173 DEBUG:boto:Data: 2023-12-15T23:09:05.174 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.174 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.174 DEBUG:boto:Params: {} 2023-12-15T23:09:05.174 DEBUG:boto:Token: None 2023-12-15T23:09:05.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.176 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f44e6480bc26ea7-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.217 DEBUG:boto:b'kskgfn-43c1000falsec2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.218 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.218 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.218 DEBUG:boto:path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.218 DEBUG:boto:auth_path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.218 DEBUG:boto:Method: GET 2023-12-15T23:09:05.218 DEBUG:boto:Path: /kskgfn-43/?prefix=c 2023-12-15T23:09:05.218 DEBUG:boto:Data: 2023-12-15T23:09:05.218 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.219 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.219 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.219 DEBUG:boto:Params: {} 2023-12-15T23:09:05.219 DEBUG:boto:Token: None 2023-12-15T23:09:05.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5e46c0bb754cb5b-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.221 DEBUG:boto:b'kskgfn-43c1000falsec2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.222 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.222 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.222 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.222 DEBUG:boto:Path: /kskgfn-43/c 2023-12-15T23:09:05.222 DEBUG:boto:Data: 2023-12-15T23:09:05.222 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.222 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.223 DEBUG:boto:Params: {} 2023-12-15T23:09:05.223 DEBUG:boto:Token: None 2023-12-15T23:09:05.223 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c 2023-12-15T23:09:05.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcZ8zMR76x+mLE9yf9XqTm5ldck= 2023-12-15T23:09:05.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcZ8zMR76x+mLE9yf9XqTm5ldck=', 'Content-Length': '0'} 2023-12-15T23:09:05.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097a35121e7bc40e9-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.225 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.225 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.225 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.225 DEBUG:boto:Path: /kskgfn-43/c 2023-12-15T23:09:05.225 DEBUG:boto:Data: 2023-12-15T23:09:05.225 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.225 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.226 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.226 DEBUG:boto:Params: {} 2023-12-15T23:09:05.226 DEBUG:boto:Token: None 2023-12-15T23:09:05.226 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c 2023-12-15T23:09:05.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcZ8zMR76x+mLE9yf9XqTm5ldck= 2023-12-15T23:09:05.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcZ8zMR76x+mLE9yf9XqTm5ldck=', 'Content-Length': '0'} 2023-12-15T23:09:05.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062d84fcc435e2299-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:05.228 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.228 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.228 DEBUG:boto:Method: GET 2023-12-15T23:09:05.229 DEBUG:boto:Path: /kskgfn-43/c 2023-12-15T23:09:05.229 DEBUG:boto:Data: 2023-12-15T23:09:05.229 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.229 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.229 DEBUG:boto:Params: {} 2023-12-15T23:09:05.229 DEBUG:boto:Token: None 2023-12-15T23:09:05.229 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c 2023-12-15T23:09:05.229 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5/xwjGXes8CGDpwa9/BDcGPqpQ= 2023-12-15T23:09:05.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5/xwjGXes8CGDpwa9/BDcGPqpQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c39cbf8ac15696ab-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.273 DEBUG:boto:path=/kskgfn-43/c 2023-12-15T23:09:05.274 DEBUG:boto:auth_path=/kskgfn-43/c 2023-12-15T23:09:05.274 DEBUG:boto:Method: GET 2023-12-15T23:09:05.274 DEBUG:boto:Path: /kskgfn-43/c 2023-12-15T23:09:05.274 DEBUG:boto:Data: 2023-12-15T23:09:05.274 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.274 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.274 DEBUG:boto:Params: {} 2023-12-15T23:09:05.274 DEBUG:boto:Token: None 2023-12-15T23:09:05.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/c 2023-12-15T23:09:05.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5/xwjGXes8CGDpwa9/BDcGPqpQ= 2023-12-15T23:09:05.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5/xwjGXes8CGDpwa9/BDcGPqpQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3bdb7166989e380-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.276 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.277 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.277 DEBUG:boto:path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.277 DEBUG:boto:auth_path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.277 DEBUG:boto:Method: GET 2023-12-15T23:09:05.277 DEBUG:boto:Path: /kskgfn-43/?prefix=c 2023-12-15T23:09:05.277 DEBUG:boto:Data: 2023-12-15T23:09:05.277 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.277 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.277 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.277 DEBUG:boto:Params: {} 2023-12-15T23:09:05.278 DEBUG:boto:Token: None 2023-12-15T23:09:05.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1b1285564dce134-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.280 DEBUG:boto:b'kskgfn-43c1000falsec2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.281 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.281 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.281 DEBUG:boto:path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.281 DEBUG:boto:auth_path=/kskgfn-43/?prefix=c 2023-12-15T23:09:05.281 DEBUG:boto:Method: GET 2023-12-15T23:09:05.281 DEBUG:boto:Path: /kskgfn-43/?prefix=c 2023-12-15T23:09:05.281 DEBUG:boto:Data: 2023-12-15T23:09:05.281 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.281 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.282 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.282 DEBUG:boto:Params: {} 2023-12-15T23:09:05.282 DEBUG:boto:Token: None 2023-12-15T23:09:05.282 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b57ad61fd1170c97-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.284 DEBUG:boto:b'kskgfn-43c1000falsec2023-12-15T23:08:54.205Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:05.285 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.285 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.285 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.288 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.288 DEBUG:boto:Method: GET 2023-12-15T23:09:05.288 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.288 DEBUG:boto:Data: 2023-12-15T23:09:05.288 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.288 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.289 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.289 DEBUG:boto:Params: {} 2023-12-15T23:09:05.289 DEBUG:boto:Token: None 2023-12-15T23:09:05.289 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.289 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ= 2023-12-15T23:09:05.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e5378581af285f-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.337 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.338 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.338 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.338 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.338 DEBUG:boto:Method: GET 2023-12-15T23:09:05.338 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.338 DEBUG:boto:Data: 2023-12-15T23:09:05.338 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.338 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.338 DEBUG:boto:Params: {} 2023-12-15T23:09:05.339 DEBUG:boto:Token: None 2023-12-15T23:09:05.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ= 2023-12-15T23:09:05.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070513e200a4810b3-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.341 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.341 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.341 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.342 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.342 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.342 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.342 DEBUG:boto:Data: 2023-12-15T23:09:05.342 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.342 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.342 DEBUG:boto:Params: {} 2023-12-15T23:09:05.342 DEBUG:boto:Token: None 2023-12-15T23:09:05.342 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zujldwqH/XnO8WIbzt7ysE9b/EY= 2023-12-15T23:09:05.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zujldwqH/XnO8WIbzt7ysE9b/EY=', 'Content-Length': '0'} 2023-12-15T23:09:05.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e446eacc46a9ff41-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.345 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.345 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.345 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.345 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.345 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.345 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.345 DEBUG:boto:Data: 2023-12-15T23:09:05.346 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.346 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.346 DEBUG:boto:Params: {} 2023-12-15T23:09:05.346 DEBUG:boto:Token: None 2023-12-15T23:09:05.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zujldwqH/XnO8WIbzt7ysE9b/EY= 2023-12-15T23:09:05.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zujldwqH/XnO8WIbzt7ysE9b/EY=', 'Content-Length': '0'} 2023-12-15T23:09:05.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a732715f24be7ea-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:05.349 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.349 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.349 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.349 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.349 DEBUG:boto:Method: GET 2023-12-15T23:09:05.349 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.349 DEBUG:boto:Data: 2023-12-15T23:09:05.349 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.350 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.350 DEBUG:boto:Params: {} 2023-12-15T23:09:05.350 DEBUG:boto:Token: None 2023-12-15T23:09:05.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ= 2023-12-15T23:09:05.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037b6d66d2a94c099-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.393 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.394 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.394 DEBUG:boto:path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.394 DEBUG:boto:auth_path=/kskgfn-43/d?versionId=null 2023-12-15T23:09:05.394 DEBUG:boto:Method: GET 2023-12-15T23:09:05.394 DEBUG:boto:Path: /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.394 DEBUG:boto:Data: 2023-12-15T23:09:05.394 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.394 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.394 DEBUG:boto:Params: {} 2023-12-15T23:09:05.394 DEBUG:boto:Token: None 2023-12-15T23:09:05.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d?versionId=null 2023-12-15T23:09:05.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ= 2023-12-15T23:09:05.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UxBoNmJjjHvx7mffdjeAdOQ2hSQ=', 'Content-Length': '0'} 2023-12-15T23:09:05.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017f39238103b4667-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.397 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.397 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.397 DEBUG:boto:path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.397 DEBUG:boto:auth_path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.397 DEBUG:boto:Method: GET 2023-12-15T23:09:05.397 DEBUG:boto:Path: /kskgfn-43/?prefix=d 2023-12-15T23:09:05.397 DEBUG:boto:Data: 2023-12-15T23:09:05.397 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.398 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.398 DEBUG:boto:Params: {} 2023-12-15T23:09:05.398 DEBUG:boto:Token: None 2023-12-15T23:09:05.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bed8ab7d0a659bba-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.401 DEBUG:boto:b'kskgfn-43d1000falsed2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.401 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.401 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.401 DEBUG:boto:path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.402 DEBUG:boto:auth_path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.402 DEBUG:boto:Method: GET 2023-12-15T23:09:05.402 DEBUG:boto:Path: /kskgfn-43/?prefix=d 2023-12-15T23:09:05.402 DEBUG:boto:Data: 2023-12-15T23:09:05.402 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.402 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.402 DEBUG:boto:Params: {} 2023-12-15T23:09:05.402 DEBUG:boto:Token: None 2023-12-15T23:09:05.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007aeeed394c76c576-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.405 DEBUG:boto:b'kskgfn-43d1000falsed2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.405 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.405 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.406 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.406 DEBUG:boto:Path: /kskgfn-43/d 2023-12-15T23:09:05.406 DEBUG:boto:Data: 2023-12-15T23:09:05.406 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.406 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.406 DEBUG:boto:Params: {} 2023-12-15T23:09:05.406 DEBUG:boto:Token: None 2023-12-15T23:09:05.406 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d 2023-12-15T23:09:05.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bF/g+Rv76PaVLWgqfQR5hplxEfM= 2023-12-15T23:09:05.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bF/g+Rv76PaVLWgqfQR5hplxEfM=', 'Content-Length': '0'} 2023-12-15T23:09:05.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1d4eba43c23bc97-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.409 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.409 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.409 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.409 DEBUG:boto:Path: /kskgfn-43/d 2023-12-15T23:09:05.409 DEBUG:boto:Data: 2023-12-15T23:09:05.409 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.409 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.409 DEBUG:boto:Params: {} 2023-12-15T23:09:05.409 DEBUG:boto:Token: None 2023-12-15T23:09:05.410 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d 2023-12-15T23:09:05.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bF/g+Rv76PaVLWgqfQR5hplxEfM= 2023-12-15T23:09:05.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bF/g+Rv76PaVLWgqfQR5hplxEfM=', 'Content-Length': '0'} 2023-12-15T23:09:05.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab983ed7822d2dfe-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:05.412 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.412 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.412 DEBUG:boto:Method: GET 2023-12-15T23:09:05.412 DEBUG:boto:Path: /kskgfn-43/d 2023-12-15T23:09:05.412 DEBUG:boto:Data: 2023-12-15T23:09:05.412 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.412 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.412 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.412 DEBUG:boto:Params: {} 2023-12-15T23:09:05.413 DEBUG:boto:Token: None 2023-12-15T23:09:05.413 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d 2023-12-15T23:09:05.413 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GsDoMlTlCbor7qw3ozLMvhKad50= 2023-12-15T23:09:05.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GsDoMlTlCbor7qw3ozLMvhKad50=', 'Content-Length': '0'} 2023-12-15T23:09:05.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066ab950e7ae1333f-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.457 DEBUG:boto:path=/kskgfn-43/d 2023-12-15T23:09:05.458 DEBUG:boto:auth_path=/kskgfn-43/d 2023-12-15T23:09:05.458 DEBUG:boto:Method: GET 2023-12-15T23:09:05.458 DEBUG:boto:Path: /kskgfn-43/d 2023-12-15T23:09:05.458 DEBUG:boto:Data: 2023-12-15T23:09:05.458 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.458 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.458 DEBUG:boto:Params: {} 2023-12-15T23:09:05.458 DEBUG:boto:Token: None 2023-12-15T23:09:05.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/d 2023-12-15T23:09:05.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GsDoMlTlCbor7qw3ozLMvhKad50= 2023-12-15T23:09:05.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GsDoMlTlCbor7qw3ozLMvhKad50=', 'Content-Length': '0'} 2023-12-15T23:09:05.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:08:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9b6faf2715200fe-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.461 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.461 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.461 DEBUG:boto:path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.461 DEBUG:boto:auth_path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.461 DEBUG:boto:Method: GET 2023-12-15T23:09:05.461 DEBUG:boto:Path: /kskgfn-43/?prefix=d 2023-12-15T23:09:05.461 DEBUG:boto:Data: 2023-12-15T23:09:05.461 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.461 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:05.461 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.461 DEBUG:boto:Params: {} 2023-12-15T23:09:05.462 DEBUG:boto:Token: None 2023-12-15T23:09:05.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b567041226f5bb8-00657cdc91-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.464 DEBUG:boto:b'kskgfn-43d1000falsed2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.464 DEBUG:boto:path=/kskgfn-43/ 2023-12-15T23:09:05.464 DEBUG:boto:auth_path=/kskgfn-43/ 2023-12-15T23:09:05.465 DEBUG:boto:path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.465 DEBUG:boto:auth_path=/kskgfn-43/?prefix=d 2023-12-15T23:09:05.465 DEBUG:boto:Method: GET 2023-12-15T23:09:05.465 DEBUG:boto:Path: /kskgfn-43/?prefix=d 2023-12-15T23:09:05.465 DEBUG:boto:Data: 2023-12-15T23:09:05.465 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.465 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.465 DEBUG:boto:Params: {} 2023-12-15T23:09:05.465 DEBUG:boto:Token: None 2023-12-15T23:09:05.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-43/ 2023-12-15T23:09:05.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo= 2023-12-15T23:09:05.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wh3a7x4C4KgbfnHvb708rg8lhlo=', 'Content-Length': '0'} 2023-12-15T23:09:05.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074042aedab2db065-00657cdc91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.468 DEBUG:boto:b'kskgfn-43d1000falsed2023-12-15T23:08:54.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:05.468 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-43 zones={test-zone2, test-zone1} 2023-12-15T23:09:05.468 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:05.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:05.469 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:05.516 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:05.517 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:05.568 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-44 2023-12-15T23:09:05.568 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:05.568 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:05.568 DEBUG:boto:Method: PUT 2023-12-15T23:09:05.568 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:05.568 DEBUG:boto:Data: 2023-12-15T23:09:05.569 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.569 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.569 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.569 DEBUG:boto:Params: {} 2023-12-15T23:09:05.569 DEBUG:boto:Token: None 2023-12-15T23:09:05.569 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/ 2023-12-15T23:09:05.569 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CGl2kgwQwLhwjzq4TCPt/PmEQKA= 2023-12-15T23:09:05.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CGl2kgwQwLhwjzq4TCPt/PmEQKA=', 'Content-Length': '0'} 2023-12-15T23:09:05.587 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000861aaca66a1170ba-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.587 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:05.587 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:05.587 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.587 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:05.587 DEBUG:boto:Data: 2023-12-15T23:09:05.587 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.587 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.587 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.587 DEBUG:boto:Params: {} 2023-12-15T23:09:05.588 DEBUG:boto:Token: None 2023-12-15T23:09:05.588 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/ 2023-12-15T23:09:05.588 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA= 2023-12-15T23:09:05.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA=', 'Content-Length': '0'} 2023-12-15T23:09:05.590 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000423e5d6a8fd5cad4-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.590 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:05.590 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:05.590 DEBUG:boto:Method: PUT 2023-12-15T23:09:05.590 DEBUG:boto:Path: /kskgfn-44/a 2023-12-15T23:09:05.590 DEBUG:boto:Data: 2023-12-15T23:09:05.590 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:05.591 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.591 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.591 DEBUG:boto:Params: {} 2023-12-15T23:09:05.591 DEBUG:boto:Token: None 2023-12-15T23:09:05.591 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/a 2023-12-15T23:09:05.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:klrLdT0JYrhr7uKefgjJKqz9+Vc= 2023-12-15T23:09:05.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:klrLdT0JYrhr7uKefgjJKqz9+Vc='} 2023-12-15T23:09:05.638 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000f07686ea2950c81-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.638 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:05.638 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:05.638 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.638 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:05.638 DEBUG:boto:Data: 2023-12-15T23:09:05.638 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.638 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.638 DEBUG:boto:Params: {} 2023-12-15T23:09:05.639 DEBUG:boto:Token: None 2023-12-15T23:09:05.639 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/ 2023-12-15T23:09:05.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA= 2023-12-15T23:09:05.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA=', 'Content-Length': '0'} 2023-12-15T23:09:05.641 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007a3f4602b71f8b81-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.641 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:05.641 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:05.641 DEBUG:boto:Method: PUT 2023-12-15T23:09:05.641 DEBUG:boto:Path: /kskgfn-44/b 2023-12-15T23:09:05.642 DEBUG:boto:Data: 2023-12-15T23:09:05.642 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:05.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.642 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.642 DEBUG:boto:Params: {} 2023-12-15T23:09:05.642 DEBUG:boto:Token: None 2023-12-15T23:09:05.642 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/b 2023-12-15T23:09:05.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mS1xhwQ02wfDb2BJgBvisjutqm0= 2023-12-15T23:09:05.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mS1xhwQ02wfDb2BJgBvisjutqm0='} 2023-12-15T23:09:05.649 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bceba57031c932fe-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.649 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:05.649 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:05.650 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.650 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:05.650 DEBUG:boto:Data: 2023-12-15T23:09:05.650 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.650 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.650 DEBUG:boto:Params: {} 2023-12-15T23:09:05.650 DEBUG:boto:Token: None 2023-12-15T23:09:05.650 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/ 2023-12-15T23:09:05.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA= 2023-12-15T23:09:05.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA=', 'Content-Length': '0'} 2023-12-15T23:09:05.652 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b7806d2a42ff1733-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.652 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:05.653 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:05.653 DEBUG:boto:Method: PUT 2023-12-15T23:09:05.653 DEBUG:boto:Path: /kskgfn-44/c 2023-12-15T23:09:05.653 DEBUG:boto:Data: 2023-12-15T23:09:05.653 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:05.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.653 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.653 DEBUG:boto:Params: {} 2023-12-15T23:09:05.653 DEBUG:boto:Token: None 2023-12-15T23:09:05.653 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/c 2023-12-15T23:09:05.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W9FtsQl4TH9jjAgC1SS9MjcQqHg= 2023-12-15T23:09:05.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W9FtsQl4TH9jjAgC1SS9MjcQqHg='} 2023-12-15T23:09:05.659 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e2be9699922bcf96-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.659 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:05.659 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:05.659 DEBUG:boto:Method: HEAD 2023-12-15T23:09:05.659 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:05.659 DEBUG:boto:Data: 2023-12-15T23:09:05.659 DEBUG:boto:Headers: {} 2023-12-15T23:09:05.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.660 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.660 DEBUG:boto:Params: {} 2023-12-15T23:09:05.660 DEBUG:boto:Token: None 2023-12-15T23:09:05.660 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/ 2023-12-15T23:09:05.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA= 2023-12-15T23:09:05.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WWo+b645Wib1dPzBMew6EAgAaDA=', 'Content-Length': '0'} 2023-12-15T23:09:05.662 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005bbe6eed77d0fdda-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.662 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:05.662 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:05.662 DEBUG:boto:Method: PUT 2023-12-15T23:09:05.662 DEBUG:boto:Path: /kskgfn-44/d 2023-12-15T23:09:05.662 DEBUG:boto:Data: 2023-12-15T23:09:05.662 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:05.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:05.663 DEBUG:boto:Port: 8000 2023-12-15T23:09:05.663 DEBUG:boto:Params: {} 2023-12-15T23:09:05.663 DEBUG:boto:Token: None 2023-12-15T23:09:05.663 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:05 GMT /kskgfn-44/d 2023-12-15T23:09:05.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HI3FrD0Hh1PrYL3h+vqDGDdEZk8= 2023-12-15T23:09:05.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HI3FrD0Hh1PrYL3h+vqDGDdEZk8='} 2023-12-15T23:09:05.706 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1a34eca0a897b80-00657cdc91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:05.706 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:05.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:05.706 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:05.752 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:05.753 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:05.782 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:09:05.796 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681745.585304_348.1","last_update":"2023-12-15T23:09:05.585304Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:09:05.797 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681745.585304_348.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:05.797 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:09:05.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:05.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:05.797 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:05.849 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:05.849 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:05.881 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:05.881+0000 7fdc1db75800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:05.882 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:05.882+0000 7fdc1db75800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:05.898 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681745.577957_345.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:05.577957Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:05Z"} 2023-12-15T23:09:05.898 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681745.577957_345.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:05.577957Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:05Z"} 2023-12-15T23:09:05.898 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681745.577957_345.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:09:05.577957Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:09:05.899 DEBUG:rgw_multi.tests:log_status={0: '1_1702681745.585304_348.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:05.899 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681745.577957_345.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:05.899 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681745.585304_348.1 target=1_1702681745.577957_345.1 2023-12-15T23:09:10.899 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:10.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:10.901 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:10.955 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:10.956 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:10.990 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:10.989+0000 7f0a36d24800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:10.991 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:10.990+0000 7f0a36d24800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:11.010 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681745.585304_348.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:05.585304Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:10Z"} 2023-12-15T23:09:11.011 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681745.585304_348.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:05.585304Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:10Z"} 2023-12-15T23:09:11.011 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681745.585304_348.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:09:05.585304Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:09:11.011 DEBUG:rgw_multi.tests:log_status={0: '1_1702681745.585304_348.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:11.011 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681745.585304_348.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:11.011 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:09:11.011 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-44 2023-12-15T23:09:11.012 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:11.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:11.012 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-44 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:11.066 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:11.067 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:11.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:11.104+0000 7f1d82b22800 1 bucket sync caught up with source: 2023-12-15T23:09:11.105 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.29.6, , , , 00000000001.26.6, , , 00000000001.21.6, , 00000000001.60.6] 2023-12-15T23:09:11.105 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.29.6, , , , 00000000001.26.6, , , 00000000001.21.6, , 00000000001.60.6] 2023-12-15T23:09:11.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:11.104+0000 7f1d82b22800 0 bucket checkpoint complete 2023-12-15T23:09:11.119 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-44 2023-12-15T23:09:11.119 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-44', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:11.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-44', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:11.120 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-44 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:11.181 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:11.181 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:11.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:11.219+0000 7f26e9522800 1 bucket sync caught up with source: 2023-12-15T23:09:11.220 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.94.6, , , , 00000000001.64.6, , , 00000000001.52.6, , 00000000001.115.6] 2023-12-15T23:09:11.220 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.94.6, , , , 00000000001.64.6, , , 00000000001.52.6, , 00000000001.115.6] 2023-12-15T23:09:11.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:11.219+0000 7f26e9522800 0 bucket checkpoint complete 2023-12-15T23:09:11.236 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-44 zones={test-zone2, test-zone1} 2023-12-15T23:09:11.236 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.236 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.237 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.237 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:11.237 DEBUG:boto:Data: 2023-12-15T23:09:11.237 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.237 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.237 DEBUG:boto:Params: {} 2023-12-15T23:09:11.238 DEBUG:boto:Token: None 2023-12-15T23:09:11.239 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uO/dWZc9sJAvosSe2IDwt7JVvn4= 2023-12-15T23:09:11.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uO/dWZc9sJAvosSe2IDwt7JVvn4=', 'Content-Length': '0'} 2023-12-15T23:09:11.243 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000021d3866b84ee8391-00657cdc97-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.244 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.244 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.244 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.244 DEBUG:boto:Path: /kskgfn-44/ 2023-12-15T23:09:11.244 DEBUG:boto:Data: 2023-12-15T23:09:11.244 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.244 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.244 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.244 DEBUG:boto:Params: {} 2023-12-15T23:09:11.245 DEBUG:boto:Token: None 2023-12-15T23:09:11.245 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.245 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uO/dWZc9sJAvosSe2IDwt7JVvn4= 2023-12-15T23:09:11.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uO/dWZc9sJAvosSe2IDwt7JVvn4=', 'Content-Length': '0'} 2023-12-15T23:09:11.248 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009c1cedb16e00f57b-00657cdc97-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.248 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:09:11.248 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.248 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.248 DEBUG:boto:path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.248 DEBUG:boto:auth_path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.249 DEBUG:boto:Method: GET 2023-12-15T23:09:11.249 DEBUG:boto:Path: /kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.249 DEBUG:boto:Data: 2023-12-15T23:09:11.249 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.249 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.249 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.249 DEBUG:boto:Params: {} 2023-12-15T23:09:11.249 DEBUG:boto:Token: None 2023-12-15T23:09:11.250 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/?versions 2023-12-15T23:09:11.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI= 2023-12-15T23:09:11.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI=', 'Content-Length': '0'} 2023-12-15T23:09:11.252 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000647ab63856b9037e-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.252 DEBUG:boto:b'kskgfn-44999falseanulltrue2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.253 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:11.253 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:11.253 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:11.253 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:11.253 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:09:11.253 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.254 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.254 DEBUG:boto:path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.254 DEBUG:boto:auth_path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.254 DEBUG:boto:Method: GET 2023-12-15T23:09:11.254 DEBUG:boto:Path: /kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.254 DEBUG:boto:Data: 2023-12-15T23:09:11.254 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.254 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.254 DEBUG:boto:Params: {} 2023-12-15T23:09:11.255 DEBUG:boto:Token: None 2023-12-15T23:09:11.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/?versions 2023-12-15T23:09:11.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI= 2023-12-15T23:09:11.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI=', 'Content-Length': '0'} 2023-12-15T23:09:11.257 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c276c1697b503cf4-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.257 DEBUG:boto:b'kskgfn-44999falseanulltrue2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.258 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:11.258 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:11.258 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:11.258 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:11.258 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.258 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.258 DEBUG:boto:path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.258 DEBUG:boto:auth_path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.259 DEBUG:boto:Method: GET 2023-12-15T23:09:11.259 DEBUG:boto:Path: /kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.259 DEBUG:boto:Data: 2023-12-15T23:09:11.259 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.259 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.259 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.259 DEBUG:boto:Params: {} 2023-12-15T23:09:11.259 DEBUG:boto:Token: None 2023-12-15T23:09:11.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/?versions 2023-12-15T23:09:11.260 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI= 2023-12-15T23:09:11.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI=', 'Content-Length': '0'} 2023-12-15T23:09:11.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffa93179fb3d93a4-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.262 DEBUG:boto:b'kskgfn-44999falseanulltrue2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.263 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.263 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.263 DEBUG:boto:path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.263 DEBUG:boto:auth_path=/kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.263 DEBUG:boto:Method: GET 2023-12-15T23:09:11.263 DEBUG:boto:Path: /kskgfn-44/?versions&max-keys=999 2023-12-15T23:09:11.263 DEBUG:boto:Data: 2023-12-15T23:09:11.263 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.264 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.264 DEBUG:boto:Params: {} 2023-12-15T23:09:11.264 DEBUG:boto:Token: None 2023-12-15T23:09:11.264 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/?versions 2023-12-15T23:09:11.264 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI= 2023-12-15T23:09:11.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gKGvN+zJSki0M8sOWCqXcm9nyyI=', 'Content-Length': '0'} 2023-12-15T23:09:11.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de4bc7e10933a031-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.266 DEBUG:boto:b'kskgfn-44999falseanulltrue2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:11.267 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.267 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.267 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.267 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.268 DEBUG:boto:Method: GET 2023-12-15T23:09:11.268 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.268 DEBUG:boto:Data: 2023-12-15T23:09:11.268 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.268 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.268 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.268 DEBUG:boto:Params: {} 2023-12-15T23:09:11.268 DEBUG:boto:Token: None 2023-12-15T23:09:11.269 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.269 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE= 2023-12-15T23:09:11.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE=', 'Content-Length': '0'} 2023-12-15T23:09:11.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f5423895c836d18-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.313 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.314 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.314 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.314 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.314 DEBUG:boto:Method: GET 2023-12-15T23:09:11.314 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.314 DEBUG:boto:Data: 2023-12-15T23:09:11.314 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.314 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.315 DEBUG:boto:Params: {} 2023-12-15T23:09:11.315 DEBUG:boto:Token: None 2023-12-15T23:09:11.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE= 2023-12-15T23:09:11.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE=', 'Content-Length': '0'} 2023-12-15T23:09:11.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b107f6ac3f8a5624-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.317 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.318 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.318 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.318 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.318 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.318 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.318 DEBUG:boto:Data: 2023-12-15T23:09:11.318 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.318 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.319 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.319 DEBUG:boto:Params: {} 2023-12-15T23:09:11.319 DEBUG:boto:Token: None 2023-12-15T23:09:11.319 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mcsq4Ty+ut7tNGdHRGauqSotVz8= 2023-12-15T23:09:11.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mcsq4Ty+ut7tNGdHRGauqSotVz8=', 'Content-Length': '0'} 2023-12-15T23:09:11.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca9757b901a666c5-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.321 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.321 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.321 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.321 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.321 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.321 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.322 DEBUG:boto:Data: 2023-12-15T23:09:11.322 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.322 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.322 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.322 DEBUG:boto:Params: {} 2023-12-15T23:09:11.322 DEBUG:boto:Token: None 2023-12-15T23:09:11.322 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mcsq4Ty+ut7tNGdHRGauqSotVz8= 2023-12-15T23:09:11.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mcsq4Ty+ut7tNGdHRGauqSotVz8=', 'Content-Length': '0'} 2023-12-15T23:09:11.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afe1c74f60440d14-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:11.325 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.325 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.325 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.325 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.325 DEBUG:boto:Method: GET 2023-12-15T23:09:11.325 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.325 DEBUG:boto:Data: 2023-12-15T23:09:11.326 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.326 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.326 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.326 DEBUG:boto:Params: {} 2023-12-15T23:09:11.326 DEBUG:boto:Token: None 2023-12-15T23:09:11.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE= 2023-12-15T23:09:11.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE=', 'Content-Length': '0'} 2023-12-15T23:09:11.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbe9f65b0ab4953e-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.328 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.328 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.329 DEBUG:boto:path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.329 DEBUG:boto:auth_path=/kskgfn-44/a?versionId=null 2023-12-15T23:09:11.329 DEBUG:boto:Method: GET 2023-12-15T23:09:11.329 DEBUG:boto:Path: /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.329 DEBUG:boto:Data: 2023-12-15T23:09:11.329 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.329 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.329 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.329 DEBUG:boto:Params: {} 2023-12-15T23:09:11.329 DEBUG:boto:Token: None 2023-12-15T23:09:11.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a?versionId=null 2023-12-15T23:09:11.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE= 2023-12-15T23:09:11.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y00SS+FJHdhKHqvcAHpH8dKBmBE=', 'Content-Length': '0'} 2023-12-15T23:09:11.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a620e792dc27376-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.331 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.332 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.332 DEBUG:boto:path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.332 DEBUG:boto:auth_path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.332 DEBUG:boto:Method: GET 2023-12-15T23:09:11.332 DEBUG:boto:Path: /kskgfn-44/?prefix=a 2023-12-15T23:09:11.332 DEBUG:boto:Data: 2023-12-15T23:09:11.332 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.332 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.332 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.332 DEBUG:boto:Params: {} 2023-12-15T23:09:11.333 DEBUG:boto:Token: None 2023-12-15T23:09:11.333 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.333 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.335 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d79edd791f445da2-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.335 DEBUG:boto:b'kskgfn-44a1000falsea2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.336 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.336 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.336 DEBUG:boto:path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.336 DEBUG:boto:auth_path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.336 DEBUG:boto:Method: GET 2023-12-15T23:09:11.336 DEBUG:boto:Path: /kskgfn-44/?prefix=a 2023-12-15T23:09:11.336 DEBUG:boto:Data: 2023-12-15T23:09:11.336 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.336 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.337 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.337 DEBUG:boto:Params: {} 2023-12-15T23:09:11.337 DEBUG:boto:Token: None 2023-12-15T23:09:11.337 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.339 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c6ed2ec6dfa69dd-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.339 DEBUG:boto:b'kskgfn-44a1000falsea2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.339 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.339 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.340 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.340 DEBUG:boto:Path: /kskgfn-44/a 2023-12-15T23:09:11.340 DEBUG:boto:Data: 2023-12-15T23:09:11.340 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.340 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.340 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.340 DEBUG:boto:Params: {} 2023-12-15T23:09:11.340 DEBUG:boto:Token: None 2023-12-15T23:09:11.340 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a 2023-12-15T23:09:11.340 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tK2QUau2mj15ICuirqz1ju8FAqg= 2023-12-15T23:09:11.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tK2QUau2mj15ICuirqz1ju8FAqg=', 'Content-Length': '0'} 2023-12-15T23:09:11.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ac834f290f7b24e-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.342 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.342 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.343 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.343 DEBUG:boto:Path: /kskgfn-44/a 2023-12-15T23:09:11.343 DEBUG:boto:Data: 2023-12-15T23:09:11.343 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.343 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.343 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.343 DEBUG:boto:Params: {} 2023-12-15T23:09:11.343 DEBUG:boto:Token: None 2023-12-15T23:09:11.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a 2023-12-15T23:09:11.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tK2QUau2mj15ICuirqz1ju8FAqg= 2023-12-15T23:09:11.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tK2QUau2mj15ICuirqz1ju8FAqg=', 'Content-Length': '0'} 2023-12-15T23:09:11.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fff6f0d85aa440c5-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:11.345 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.346 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.346 DEBUG:boto:Method: GET 2023-12-15T23:09:11.346 DEBUG:boto:Path: /kskgfn-44/a 2023-12-15T23:09:11.346 DEBUG:boto:Data: 2023-12-15T23:09:11.346 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.346 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.346 DEBUG:boto:Params: {} 2023-12-15T23:09:11.346 DEBUG:boto:Token: None 2023-12-15T23:09:11.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a 2023-12-15T23:09:11.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6RhZFm4GqP9dndQ2fvu/lbiP+Qk= 2023-12-15T23:09:11.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6RhZFm4GqP9dndQ2fvu/lbiP+Qk=', 'Content-Length': '0'} 2023-12-15T23:09:11.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064b3100d3cfafa4a-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.390 DEBUG:boto:path=/kskgfn-44/a 2023-12-15T23:09:11.390 DEBUG:boto:auth_path=/kskgfn-44/a 2023-12-15T23:09:11.390 DEBUG:boto:Method: GET 2023-12-15T23:09:11.390 DEBUG:boto:Path: /kskgfn-44/a 2023-12-15T23:09:11.390 DEBUG:boto:Data: 2023-12-15T23:09:11.391 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.391 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.391 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.391 DEBUG:boto:Params: {} 2023-12-15T23:09:11.391 DEBUG:boto:Token: None 2023-12-15T23:09:11.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/a 2023-12-15T23:09:11.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6RhZFm4GqP9dndQ2fvu/lbiP+Qk= 2023-12-15T23:09:11.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6RhZFm4GqP9dndQ2fvu/lbiP+Qk=', 'Content-Length': '0'} 2023-12-15T23:09:11.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5d080a9e01f48e3-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.393 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.393 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.394 DEBUG:boto:path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.394 DEBUG:boto:auth_path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.394 DEBUG:boto:Method: GET 2023-12-15T23:09:11.394 DEBUG:boto:Path: /kskgfn-44/?prefix=a 2023-12-15T23:09:11.394 DEBUG:boto:Data: 2023-12-15T23:09:11.394 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.394 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.394 DEBUG:boto:Params: {} 2023-12-15T23:09:11.395 DEBUG:boto:Token: None 2023-12-15T23:09:11.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb11688dfb8cb6b6-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.437 DEBUG:boto:b'kskgfn-44a1000falsea2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.439 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.439 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.440 DEBUG:boto:path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.440 DEBUG:boto:auth_path=/kskgfn-44/?prefix=a 2023-12-15T23:09:11.440 DEBUG:boto:Method: GET 2023-12-15T23:09:11.440 DEBUG:boto:Path: /kskgfn-44/?prefix=a 2023-12-15T23:09:11.440 DEBUG:boto:Data: 2023-12-15T23:09:11.440 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.440 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.440 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.440 DEBUG:boto:Params: {} 2023-12-15T23:09:11.440 DEBUG:boto:Token: None 2023-12-15T23:09:11.441 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.441 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.443 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000954d7fcdd0cfc03c-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.443 DEBUG:boto:b'kskgfn-44a1000falsea2023-12-15T23:09:05.593Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:11.444 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.444 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.444 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.444 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.444 DEBUG:boto:Method: GET 2023-12-15T23:09:11.444 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.444 DEBUG:boto:Data: 2023-12-15T23:09:11.444 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.445 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.445 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.445 DEBUG:boto:Params: {} 2023-12-15T23:09:11.445 DEBUG:boto:Token: None 2023-12-15T23:09:11.445 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.445 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM= 2023-12-15T23:09:11.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM=', 'Content-Length': '0'} 2023-12-15T23:09:11.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009600c5d7c1791dd8-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.490 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.490 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.490 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.490 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.490 DEBUG:boto:Method: GET 2023-12-15T23:09:11.490 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.490 DEBUG:boto:Data: 2023-12-15T23:09:11.490 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.491 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.491 DEBUG:boto:Params: {} 2023-12-15T23:09:11.491 DEBUG:boto:Token: None 2023-12-15T23:09:11.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM= 2023-12-15T23:09:11.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM=', 'Content-Length': '0'} 2023-12-15T23:09:11.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bb944d9f1ca2529-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.494 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.494 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.494 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.494 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.494 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.494 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.494 DEBUG:boto:Data: 2023-12-15T23:09:11.494 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.494 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.494 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.495 DEBUG:boto:Params: {} 2023-12-15T23:09:11.495 DEBUG:boto:Token: None 2023-12-15T23:09:11.495 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:opFTKT9agVsnMEq+FewTWBKc+nc= 2023-12-15T23:09:11.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:opFTKT9agVsnMEq+FewTWBKc+nc=', 'Content-Length': '0'} 2023-12-15T23:09:11.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fc5a83f943c2736-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.497 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.497 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.497 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.498 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.498 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.498 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.498 DEBUG:boto:Data: 2023-12-15T23:09:11.498 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.498 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.498 DEBUG:boto:Params: {} 2023-12-15T23:09:11.498 DEBUG:boto:Token: None 2023-12-15T23:09:11.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:opFTKT9agVsnMEq+FewTWBKc+nc= 2023-12-15T23:09:11.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:opFTKT9agVsnMEq+FewTWBKc+nc=', 'Content-Length': '0'} 2023-12-15T23:09:11.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2049c3731480046-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.501 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:11.501 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.501 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.501 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.501 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.501 DEBUG:boto:Method: GET 2023-12-15T23:09:11.502 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.502 DEBUG:boto:Data: 2023-12-15T23:09:11.502 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.502 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.502 DEBUG:boto:Params: {} 2023-12-15T23:09:11.502 DEBUG:boto:Token: None 2023-12-15T23:09:11.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM= 2023-12-15T23:09:11.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM=', 'Content-Length': '0'} 2023-12-15T23:09:11.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f59a959919405749-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.545 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.546 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.546 DEBUG:boto:path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.546 DEBUG:boto:auth_path=/kskgfn-44/b?versionId=null 2023-12-15T23:09:11.546 DEBUG:boto:Method: GET 2023-12-15T23:09:11.546 DEBUG:boto:Path: /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.546 DEBUG:boto:Data: 2023-12-15T23:09:11.546 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.546 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.546 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.546 DEBUG:boto:Params: {} 2023-12-15T23:09:11.546 DEBUG:boto:Token: None 2023-12-15T23:09:11.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b?versionId=null 2023-12-15T23:09:11.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM= 2023-12-15T23:09:11.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XI3baidhtY1LBji8b5TJsiVrfM=', 'Content-Length': '0'} 2023-12-15T23:09:11.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000645f0dfa27a2a776-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.549 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.549 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.549 DEBUG:boto:path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.549 DEBUG:boto:auth_path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.549 DEBUG:boto:Method: GET 2023-12-15T23:09:11.550 DEBUG:boto:Path: /kskgfn-44/?prefix=b 2023-12-15T23:09:11.550 DEBUG:boto:Data: 2023-12-15T23:09:11.550 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.550 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.550 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.550 DEBUG:boto:Params: {} 2023-12-15T23:09:11.550 DEBUG:boto:Token: None 2023-12-15T23:09:11.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002da52b7c36ffb7f5-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.593 DEBUG:boto:b'kskgfn-44b1000falseb2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.594 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.594 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.594 DEBUG:boto:path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.594 DEBUG:boto:auth_path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.594 DEBUG:boto:Method: GET 2023-12-15T23:09:11.594 DEBUG:boto:Path: /kskgfn-44/?prefix=b 2023-12-15T23:09:11.594 DEBUG:boto:Data: 2023-12-15T23:09:11.594 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.595 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.595 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.595 DEBUG:boto:Params: {} 2023-12-15T23:09:11.595 DEBUG:boto:Token: None 2023-12-15T23:09:11.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5f97ad903fdf9b2-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.597 DEBUG:boto:b'kskgfn-44b1000falseb2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.598 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.598 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.598 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.598 DEBUG:boto:Path: /kskgfn-44/b 2023-12-15T23:09:11.598 DEBUG:boto:Data: 2023-12-15T23:09:11.598 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.598 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.598 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.599 DEBUG:boto:Params: {} 2023-12-15T23:09:11.599 DEBUG:boto:Token: None 2023-12-15T23:09:11.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b 2023-12-15T23:09:11.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B2PP8SAQu9LvKM2ZEhUu4oqLljc= 2023-12-15T23:09:11.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B2PP8SAQu9LvKM2ZEhUu4oqLljc=', 'Content-Length': '0'} 2023-12-15T23:09:11.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7a547bec98095d6-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.601 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.601 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.602 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.602 DEBUG:boto:Path: /kskgfn-44/b 2023-12-15T23:09:11.602 DEBUG:boto:Data: 2023-12-15T23:09:11.602 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.602 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.602 DEBUG:boto:Params: {} 2023-12-15T23:09:11.602 DEBUG:boto:Token: None 2023-12-15T23:09:11.602 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b 2023-12-15T23:09:11.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B2PP8SAQu9LvKM2ZEhUu4oqLljc= 2023-12-15T23:09:11.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B2PP8SAQu9LvKM2ZEhUu4oqLljc=', 'Content-Length': '0'} 2023-12-15T23:09:11.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e4159caefd89f6d-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:11.605 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.605 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.605 DEBUG:boto:Method: GET 2023-12-15T23:09:11.605 DEBUG:boto:Path: /kskgfn-44/b 2023-12-15T23:09:11.605 DEBUG:boto:Data: 2023-12-15T23:09:11.605 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.605 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.605 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.605 DEBUG:boto:Params: {} 2023-12-15T23:09:11.606 DEBUG:boto:Token: None 2023-12-15T23:09:11.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b 2023-12-15T23:09:11.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AecSYm19nT9MobK9yjzclRKhsKA= 2023-12-15T23:09:11.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AecSYm19nT9MobK9yjzclRKhsKA=', 'Content-Length': '0'} 2023-12-15T23:09:11.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cfa7feeafe1be77-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.650 DEBUG:boto:path=/kskgfn-44/b 2023-12-15T23:09:11.650 DEBUG:boto:auth_path=/kskgfn-44/b 2023-12-15T23:09:11.650 DEBUG:boto:Method: GET 2023-12-15T23:09:11.650 DEBUG:boto:Path: /kskgfn-44/b 2023-12-15T23:09:11.650 DEBUG:boto:Data: 2023-12-15T23:09:11.650 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.650 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.651 DEBUG:boto:Params: {} 2023-12-15T23:09:11.651 DEBUG:boto:Token: None 2023-12-15T23:09:11.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/b 2023-12-15T23:09:11.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AecSYm19nT9MobK9yjzclRKhsKA= 2023-12-15T23:09:11.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AecSYm19nT9MobK9yjzclRKhsKA=', 'Content-Length': '0'} 2023-12-15T23:09:11.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033958363eb74df1d-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.654 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.654 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.654 DEBUG:boto:path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.654 DEBUG:boto:auth_path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.654 DEBUG:boto:Method: GET 2023-12-15T23:09:11.654 DEBUG:boto:Path: /kskgfn-44/?prefix=b 2023-12-15T23:09:11.655 DEBUG:boto:Data: 2023-12-15T23:09:11.655 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.655 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.655 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.655 DEBUG:boto:Params: {} 2023-12-15T23:09:11.655 DEBUG:boto:Token: None 2023-12-15T23:09:11.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e448846918bbbda5-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.658 DEBUG:boto:b'kskgfn-44b1000falseb2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.658 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.659 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.659 DEBUG:boto:path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.659 DEBUG:boto:auth_path=/kskgfn-44/?prefix=b 2023-12-15T23:09:11.659 DEBUG:boto:Method: GET 2023-12-15T23:09:11.659 DEBUG:boto:Path: /kskgfn-44/?prefix=b 2023-12-15T23:09:11.659 DEBUG:boto:Data: 2023-12-15T23:09:11.659 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.659 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.659 DEBUG:boto:Params: {} 2023-12-15T23:09:11.659 DEBUG:boto:Token: None 2023-12-15T23:09:11.660 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095098cfbf7ea1942-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.662 DEBUG:boto:b'kskgfn-44b1000falseb2023-12-15T23:09:05.644Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.663 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:11.663 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.663 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.663 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.663 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.663 DEBUG:boto:Method: GET 2023-12-15T23:09:11.663 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.664 DEBUG:boto:Data: 2023-12-15T23:09:11.664 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.664 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.664 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.664 DEBUG:boto:Params: {} 2023-12-15T23:09:11.664 DEBUG:boto:Token: None 2023-12-15T23:09:11.664 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.664 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE= 2023-12-15T23:09:11.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE=', 'Content-Length': '0'} 2023-12-15T23:09:11.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb7dcbed11ba0703-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.709 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.710 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.710 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.710 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.710 DEBUG:boto:Method: GET 2023-12-15T23:09:11.710 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.710 DEBUG:boto:Data: 2023-12-15T23:09:11.710 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.710 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.710 DEBUG:boto:Params: {} 2023-12-15T23:09:11.711 DEBUG:boto:Token: None 2023-12-15T23:09:11.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE= 2023-12-15T23:09:11.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE=', 'Content-Length': '0'} 2023-12-15T23:09:11.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c40e7613129d3415-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.713 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.713 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.714 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.714 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.714 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.714 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.714 DEBUG:boto:Data: 2023-12-15T23:09:11.714 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.714 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.714 DEBUG:boto:Params: {} 2023-12-15T23:09:11.714 DEBUG:boto:Token: None 2023-12-15T23:09:11.715 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xdj0FcdzX44Mokn7UyaouIjlplY= 2023-12-15T23:09:11.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xdj0FcdzX44Mokn7UyaouIjlplY=', 'Content-Length': '0'} 2023-12-15T23:09:11.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000048ea881d1774041-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.717 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.717 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.717 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.717 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.717 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.717 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.718 DEBUG:boto:Data: 2023-12-15T23:09:11.718 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.718 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.718 DEBUG:boto:Params: {} 2023-12-15T23:09:11.718 DEBUG:boto:Token: None 2023-12-15T23:09:11.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xdj0FcdzX44Mokn7UyaouIjlplY= 2023-12-15T23:09:11.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xdj0FcdzX44Mokn7UyaouIjlplY=', 'Content-Length': '0'} 2023-12-15T23:09:11.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d10f5302c5ebeecc-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:11.720 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.720 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.721 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.721 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.721 DEBUG:boto:Method: GET 2023-12-15T23:09:11.721 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.721 DEBUG:boto:Data: 2023-12-15T23:09:11.721 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.721 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.721 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.721 DEBUG:boto:Params: {} 2023-12-15T23:09:11.721 DEBUG:boto:Token: None 2023-12-15T23:09:11.722 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.722 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE= 2023-12-15T23:09:11.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE=', 'Content-Length': '0'} 2023-12-15T23:09:11.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bc9c64068c806f3-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.765 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.766 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.766 DEBUG:boto:path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.766 DEBUG:boto:auth_path=/kskgfn-44/c?versionId=null 2023-12-15T23:09:11.766 DEBUG:boto:Method: GET 2023-12-15T23:09:11.766 DEBUG:boto:Path: /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.766 DEBUG:boto:Data: 2023-12-15T23:09:11.766 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.766 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.766 DEBUG:boto:Params: {} 2023-12-15T23:09:11.767 DEBUG:boto:Token: None 2023-12-15T23:09:11.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c?versionId=null 2023-12-15T23:09:11.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE= 2023-12-15T23:09:11.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tYcCx79sQO3t9qsuOhaluElnSGE=', 'Content-Length': '0'} 2023-12-15T23:09:11.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000049fed102c89fd04-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.769 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.769 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.769 DEBUG:boto:path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.769 DEBUG:boto:auth_path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.770 DEBUG:boto:Method: GET 2023-12-15T23:09:11.770 DEBUG:boto:Path: /kskgfn-44/?prefix=c 2023-12-15T23:09:11.770 DEBUG:boto:Data: 2023-12-15T23:09:11.770 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.770 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.770 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.770 DEBUG:boto:Params: {} 2023-12-15T23:09:11.770 DEBUG:boto:Token: None 2023-12-15T23:09:11.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7a86012bfd94ea9-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.773 DEBUG:boto:b'kskgfn-44c1000falsec2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.774 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.774 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.774 DEBUG:boto:path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.774 DEBUG:boto:auth_path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.774 DEBUG:boto:Method: GET 2023-12-15T23:09:11.774 DEBUG:boto:Path: /kskgfn-44/?prefix=c 2023-12-15T23:09:11.774 DEBUG:boto:Data: 2023-12-15T23:09:11.774 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.774 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.775 DEBUG:boto:Params: {} 2023-12-15T23:09:11.775 DEBUG:boto:Token: None 2023-12-15T23:09:11.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bed140ec3cc8c2a-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.778 DEBUG:boto:b'kskgfn-44c1000falsec2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.778 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.778 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.778 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.778 DEBUG:boto:Path: /kskgfn-44/c 2023-12-15T23:09:11.778 DEBUG:boto:Data: 2023-12-15T23:09:11.778 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.778 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.779 DEBUG:boto:Params: {} 2023-12-15T23:09:11.779 DEBUG:boto:Token: None 2023-12-15T23:09:11.779 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c 2023-12-15T23:09:11.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ge9DW0I7OJRZIsO0hi0ewERIVT4= 2023-12-15T23:09:11.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ge9DW0I7OJRZIsO0hi0ewERIVT4=', 'Content-Length': '0'} 2023-12-15T23:09:11.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c75b4c57589bd9e-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.781 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.782 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.782 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.782 DEBUG:boto:Path: /kskgfn-44/c 2023-12-15T23:09:11.782 DEBUG:boto:Data: 2023-12-15T23:09:11.782 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.782 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.782 DEBUG:boto:Params: {} 2023-12-15T23:09:11.782 DEBUG:boto:Token: None 2023-12-15T23:09:11.782 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c 2023-12-15T23:09:11.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ge9DW0I7OJRZIsO0hi0ewERIVT4= 2023-12-15T23:09:11.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ge9DW0I7OJRZIsO0hi0ewERIVT4=', 'Content-Length': '0'} 2023-12-15T23:09:11.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c006169c9f5c503-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:11.785 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.785 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.786 DEBUG:boto:Method: GET 2023-12-15T23:09:11.786 DEBUG:boto:Path: /kskgfn-44/c 2023-12-15T23:09:11.786 DEBUG:boto:Data: 2023-12-15T23:09:11.786 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.786 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.786 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.786 DEBUG:boto:Params: {} 2023-12-15T23:09:11.786 DEBUG:boto:Token: None 2023-12-15T23:09:11.786 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c 2023-12-15T23:09:11.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6X553LGfjrHs22YE7tSHhM6jzU= 2023-12-15T23:09:11.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6X553LGfjrHs22YE7tSHhM6jzU=', 'Content-Length': '0'} 2023-12-15T23:09:11.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000099d00a59eb72bd9-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.830 DEBUG:boto:path=/kskgfn-44/c 2023-12-15T23:09:11.831 DEBUG:boto:auth_path=/kskgfn-44/c 2023-12-15T23:09:11.831 DEBUG:boto:Method: GET 2023-12-15T23:09:11.831 DEBUG:boto:Path: /kskgfn-44/c 2023-12-15T23:09:11.831 DEBUG:boto:Data: 2023-12-15T23:09:11.832 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.832 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.832 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.832 DEBUG:boto:Params: {} 2023-12-15T23:09:11.832 DEBUG:boto:Token: None 2023-12-15T23:09:11.832 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/c 2023-12-15T23:09:11.832 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6X553LGfjrHs22YE7tSHhM6jzU= 2023-12-15T23:09:11.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6X553LGfjrHs22YE7tSHhM6jzU=', 'Content-Length': '0'} 2023-12-15T23:09:11.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002c3ee6f8fa63f37-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.835 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.835 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.835 DEBUG:boto:path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.835 DEBUG:boto:auth_path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.835 DEBUG:boto:Method: GET 2023-12-15T23:09:11.836 DEBUG:boto:Path: /kskgfn-44/?prefix=c 2023-12-15T23:09:11.836 DEBUG:boto:Data: 2023-12-15T23:09:11.836 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.836 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.836 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.836 DEBUG:boto:Params: {} 2023-12-15T23:09:11.836 DEBUG:boto:Token: None 2023-12-15T23:09:11.836 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.837 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.839 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de6074f623bf6758-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.881 DEBUG:boto:b'kskgfn-44c1000falsec2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.882 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.882 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.882 DEBUG:boto:path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.882 DEBUG:boto:auth_path=/kskgfn-44/?prefix=c 2023-12-15T23:09:11.883 DEBUG:boto:Method: GET 2023-12-15T23:09:11.883 DEBUG:boto:Path: /kskgfn-44/?prefix=c 2023-12-15T23:09:11.883 DEBUG:boto:Data: 2023-12-15T23:09:11.883 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.883 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.883 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.883 DEBUG:boto:Params: {} 2023-12-15T23:09:11.883 DEBUG:boto:Token: None 2023-12-15T23:09:11.884 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f14385994ae5f47b-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.886 DEBUG:boto:b'kskgfn-44c1000falsec2023-12-15T23:09:05.655Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:11.887 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:11.887 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.887 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.887 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.887 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.887 DEBUG:boto:Method: GET 2023-12-15T23:09:11.887 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.887 DEBUG:boto:Data: 2023-12-15T23:09:11.888 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.888 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.888 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.888 DEBUG:boto:Params: {} 2023-12-15T23:09:11.888 DEBUG:boto:Token: None 2023-12-15T23:09:11.888 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.888 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE= 2023-12-15T23:09:11.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE=', 'Content-Length': '0'} 2023-12-15T23:09:11.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083360539124bff9b-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.933 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.934 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.934 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.934 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.934 DEBUG:boto:Method: GET 2023-12-15T23:09:11.934 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.934 DEBUG:boto:Data: 2023-12-15T23:09:11.934 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.934 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.934 DEBUG:boto:Params: {} 2023-12-15T23:09:11.935 DEBUG:boto:Token: None 2023-12-15T23:09:11.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE= 2023-12-15T23:09:11.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE=', 'Content-Length': '0'} 2023-12-15T23:09:11.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002011f6d7f68244fb-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.938 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.938 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.938 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.938 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.938 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.938 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.938 DEBUG:boto:Data: 2023-12-15T23:09:11.938 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.938 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.938 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.939 DEBUG:boto:Params: {} 2023-12-15T23:09:11.939 DEBUG:boto:Token: None 2023-12-15T23:09:11.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cxXv60QrBql1S0dPHPAePqK+ocY= 2023-12-15T23:09:11.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cxXv60QrBql1S0dPHPAePqK+ocY=', 'Content-Length': '0'} 2023-12-15T23:09:11.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c53cb29712f44ca-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.941 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.941 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.941 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.941 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.941 DEBUG:boto:Method: HEAD 2023-12-15T23:09:11.941 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.941 DEBUG:boto:Data: 2023-12-15T23:09:11.942 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.942 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.942 DEBUG:boto:Params: {} 2023-12-15T23:09:11.942 DEBUG:boto:Token: None 2023-12-15T23:09:11.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cxXv60QrBql1S0dPHPAePqK+ocY= 2023-12-15T23:09:11.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cxXv60QrBql1S0dPHPAePqK+ocY=', 'Content-Length': '0'} 2023-12-15T23:09:11.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0f61624147a9bb4-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:11.945 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.945 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.945 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.945 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.945 DEBUG:boto:Method: GET 2023-12-15T23:09:11.946 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.946 DEBUG:boto:Data: 2023-12-15T23:09:11.946 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.946 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.946 DEBUG:boto:Params: {} 2023-12-15T23:09:11.946 DEBUG:boto:Token: None 2023-12-15T23:09:11.946 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE= 2023-12-15T23:09:11.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE=', 'Content-Length': '0'} 2023-12-15T23:09:11.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025ae29cb83bbe145-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.989 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:11.989 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:11.990 DEBUG:boto:path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.990 DEBUG:boto:auth_path=/kskgfn-44/d?versionId=null 2023-12-15T23:09:11.990 DEBUG:boto:Method: GET 2023-12-15T23:09:11.990 DEBUG:boto:Path: /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.990 DEBUG:boto:Data: 2023-12-15T23:09:11.990 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:11.990 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.990 DEBUG:boto:Params: {} 2023-12-15T23:09:11.990 DEBUG:boto:Token: None 2023-12-15T23:09:11.990 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/d?versionId=null 2023-12-15T23:09:11.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE= 2023-12-15T23:09:11.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nK0QrRe1BQH5Q4WPSQ2z3QjO0kE=', 'Content-Length': '0'} 2023-12-15T23:09:11.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e29d3e3af84fe8a3-00657cdc97-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:11.993 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:11.993 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:11.993 DEBUG:boto:path=/kskgfn-44/?prefix=d 2023-12-15T23:09:11.993 DEBUG:boto:auth_path=/kskgfn-44/?prefix=d 2023-12-15T23:09:11.993 DEBUG:boto:Method: GET 2023-12-15T23:09:11.993 DEBUG:boto:Path: /kskgfn-44/?prefix=d 2023-12-15T23:09:11.993 DEBUG:boto:Data: 2023-12-15T23:09:11.994 DEBUG:boto:Headers: {} 2023-12-15T23:09:11.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:11.994 DEBUG:boto:Port: 8000 2023-12-15T23:09:11.994 DEBUG:boto:Params: {} 2023-12-15T23:09:11.994 DEBUG:boto:Token: None 2023-12-15T23:09:11.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:11 GMT /kskgfn-44/ 2023-12-15T23:09:11.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs= 2023-12-15T23:09:11.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wSo1oEcHVkQpO5Tv5V07tJSOLqs=', 'Content-Length': '0'} 2023-12-15T23:09:11.996 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8125cc97acdaeed-00657cdc97-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.037 DEBUG:boto:b'kskgfn-44d1000falsed2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:12.039 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:12.039 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:12.039 DEBUG:boto:path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.039 DEBUG:boto:auth_path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.040 DEBUG:boto:Method: GET 2023-12-15T23:09:12.040 DEBUG:boto:Path: /kskgfn-44/?prefix=d 2023-12-15T23:09:12.040 DEBUG:boto:Data: 2023-12-15T23:09:12.040 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.040 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:12.040 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.040 DEBUG:boto:Params: {} 2023-12-15T23:09:12.041 DEBUG:boto:Token: None 2023-12-15T23:09:12.042 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/ 2023-12-15T23:09:12.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo= 2023-12-15T23:09:12.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo=', 'Content-Length': '0'} 2023-12-15T23:09:12.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba5382f5182a47c7-00657cdc98-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.045 DEBUG:boto:b'kskgfn-44d1000falsed2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:12.045 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:12.045 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:12.046 DEBUG:boto:Method: HEAD 2023-12-15T23:09:12.046 DEBUG:boto:Path: /kskgfn-44/d 2023-12-15T23:09:12.046 DEBUG:boto:Data: 2023-12-15T23:09:12.046 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:12.046 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.046 DEBUG:boto:Params: {} 2023-12-15T23:09:12.046 DEBUG:boto:Token: None 2023-12-15T23:09:12.046 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/d 2023-12-15T23:09:12.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WOVVbWkrIvbAGRmPMuF5VSb9OU0= 2023-12-15T23:09:12.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WOVVbWkrIvbAGRmPMuF5VSb9OU0=', 'Content-Length': '0'} 2023-12-15T23:09:12.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047b4d772c4872ebe-00657cdc98-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.050 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:12.050 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:12.050 DEBUG:boto:Method: HEAD 2023-12-15T23:09:12.050 DEBUG:boto:Path: /kskgfn-44/d 2023-12-15T23:09:12.050 DEBUG:boto:Data: 2023-12-15T23:09:12.050 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:12.050 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.050 DEBUG:boto:Params: {} 2023-12-15T23:09:12.050 DEBUG:boto:Token: None 2023-12-15T23:09:12.051 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/d 2023-12-15T23:09:12.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WOVVbWkrIvbAGRmPMuF5VSb9OU0= 2023-12-15T23:09:12.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WOVVbWkrIvbAGRmPMuF5VSb9OU0=', 'Content-Length': '0'} 2023-12-15T23:09:12.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006df051f5c16a0a79-00657cdc98-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:12.053 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:12.053 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:12.053 DEBUG:boto:Method: GET 2023-12-15T23:09:12.054 DEBUG:boto:Path: /kskgfn-44/d 2023-12-15T23:09:12.054 DEBUG:boto:Data: 2023-12-15T23:09:12.054 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:12.054 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.054 DEBUG:boto:Params: {} 2023-12-15T23:09:12.054 DEBUG:boto:Token: None 2023-12-15T23:09:12.054 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/d 2023-12-15T23:09:12.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/A5u1QjoL2SixXZRpKByBjJ/KW0= 2023-12-15T23:09:12.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/A5u1QjoL2SixXZRpKByBjJ/KW0=', 'Content-Length': '0'} 2023-12-15T23:09:12.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-44:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a714a5045c6b77b9-00657cdc98-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.102 DEBUG:boto:path=/kskgfn-44/d 2023-12-15T23:09:12.102 DEBUG:boto:auth_path=/kskgfn-44/d 2023-12-15T23:09:12.102 DEBUG:boto:Method: GET 2023-12-15T23:09:12.102 DEBUG:boto:Path: /kskgfn-44/d 2023-12-15T23:09:12.102 DEBUG:boto:Data: 2023-12-15T23:09:12.102 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.102 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:12.102 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.102 DEBUG:boto:Params: {} 2023-12-15T23:09:12.103 DEBUG:boto:Token: None 2023-12-15T23:09:12.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/d 2023-12-15T23:09:12.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/A5u1QjoL2SixXZRpKByBjJ/KW0= 2023-12-15T23:09:12.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/A5u1QjoL2SixXZRpKByBjJ/KW0=', 'Content-Length': '0'} 2023-12-15T23:09:12.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019c70f2ad04dbf85-00657cdc98-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.105 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:12.106 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:12.106 DEBUG:boto:path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.106 DEBUG:boto:auth_path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.106 DEBUG:boto:Method: GET 2023-12-15T23:09:12.106 DEBUG:boto:Path: /kskgfn-44/?prefix=d 2023-12-15T23:09:12.106 DEBUG:boto:Data: 2023-12-15T23:09:12.106 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:12.106 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.106 DEBUG:boto:Params: {} 2023-12-15T23:09:12.106 DEBUG:boto:Token: None 2023-12-15T23:09:12.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/ 2023-12-15T23:09:12.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo= 2023-12-15T23:09:12.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo=', 'Content-Length': '0'} 2023-12-15T23:09:12.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000549ee116431cf166-00657cdc98-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.109 DEBUG:boto:b'kskgfn-44d1000falsed2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:12.109 DEBUG:boto:path=/kskgfn-44/ 2023-12-15T23:09:12.110 DEBUG:boto:auth_path=/kskgfn-44/ 2023-12-15T23:09:12.110 DEBUG:boto:path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.110 DEBUG:boto:auth_path=/kskgfn-44/?prefix=d 2023-12-15T23:09:12.110 DEBUG:boto:Method: GET 2023-12-15T23:09:12.110 DEBUG:boto:Path: /kskgfn-44/?prefix=d 2023-12-15T23:09:12.110 DEBUG:boto:Data: 2023-12-15T23:09:12.110 DEBUG:boto:Headers: {} 2023-12-15T23:09:12.110 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:12.110 DEBUG:boto:Port: 8000 2023-12-15T23:09:12.110 DEBUG:boto:Params: {} 2023-12-15T23:09:12.110 DEBUG:boto:Token: None 2023-12-15T23:09:12.111 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:12 GMT /kskgfn-44/ 2023-12-15T23:09:12.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo= 2023-12-15T23:09:12.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:12 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atDt1lKtj07lJT2KDZaPmQ3mKTo=', 'Content-Length': '0'} 2023-12-15T23:09:12.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a46cc93f3289409-00657cdc98-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:12 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:12.113 DEBUG:boto:b'kskgfn-44d1000falsed2023-12-15T23:09:05.665Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:12.114 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-44 zones={test-zone2, test-zone1} 2023-12-15T23:09:12.114 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:12.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:12.115 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:12.167 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:12.168 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:12.224 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:12.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:12.224 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:12.269 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:12.269 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:12.315 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T23:09:12.316 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:12.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:12.316 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:12.360 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:12.360 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:12.405 INFO:teuthology.orchestra.run.smithi093.stdout:[{"op_id":"1#00000000001.53.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1098019638144217973","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:08:54.145288759Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14"}]},{"op_id":"5#00000000001.34.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17503832275066497331","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:08:54.215207975Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14"}]},{"op_id":"8#00000000001.27.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15663731451380069406","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:08:54.205086054Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14"}]},{"op_id":"10#00000000001.28.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2423159435316739128","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:08:54.157281066Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-43:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14"}]}] 2023-12-15T23:09:12.405 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:12.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:12.406 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:12.685 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.684+0000 7f4ef1e7e640 -1 req 8516514785110073847 0.002999943s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.689 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.689+0000 7f4ee2e60640 -1 req 9197391316525364872 0.001999963s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-32:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-32:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.736 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.735+0000 7f4eacdf4640 -1 req 285499327481554678 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-5:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.9,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-5:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.9,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.782 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.781+0000 7f4e89dae640 -1 req 9850598197962241940 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-4:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.4,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-4:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.4,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.826 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.825+0000 7f4e74d84640 -1 req 6685334562340938058 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-41:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-41:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.835 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.834+0000 7f4e73d82640 -1 req 16663153343604741537 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-3:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.3,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-3:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.3,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.918 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.917+0000 7f4f40f1c640 -1 req 15414590638020320786 0.001999963s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.925 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.925+0000 7f4f5cf54640 -1 req 4379815139569218760 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-31:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-31:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.962 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.961+0000 7f4f4d735640 -1 req 2361459732942842864 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-30:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-30:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:12.972 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:12.971+0000 7f4f33f02640 -1 req 516206415714213631 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.013 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.013+0000 7f4f3ef18640 -1 req 7362282701242310435 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.016 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.016+0000 7f4f226df640 -1 req 13349848762041174121 0.002999944s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-22:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.26,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-22:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.26,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.054 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.053+0000 7f4f216dd640 -1 req 9432269958748252470 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-24:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.28,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-24:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.28,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.061 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.058+0000 7f4f21ede640 -1 req 13092882302410190317 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-21:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.25,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-21:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.25,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.098+0000 7f4f0b6b1640 -1 req 11679663534367639798 0.001999962s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-19:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.23,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-19:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.23,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.107 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:13.106+0000 7f4ee5665640 -1 req 7764745847063712957 0.002999943s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-23:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.27,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-23:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.27,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:13.170 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.171 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:13.254 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:13.254 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:13.297 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T23:09:13.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2023-12-15T23:09:13.302 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=kskgfn-45 2023-12-15T23:09:13.302 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:13.302 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:13.303 DEBUG:boto:Method: PUT 2023-12-15T23:09:13.303 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:13.303 DEBUG:boto:Data: 2023-12-15T23:09:13.303 DEBUG:boto:Headers: {} 2023-12-15T23:09:13.303 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.303 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.303 DEBUG:boto:Params: {} 2023-12-15T23:09:13.304 DEBUG:boto:Token: None 2023-12-15T23:09:13.304 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/ 2023-12-15T23:09:13.304 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jxI3Sg0OvT9N0elwZEo54qc43io= 2023-12-15T23:09:13.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jxI3Sg0OvT9N0elwZEo54qc43io=', 'Content-Length': '0'} 2023-12-15T23:09:13.320 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a20f57f43273fbf3-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.320 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:13.321 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:13.321 DEBUG:boto:Method: HEAD 2023-12-15T23:09:13.321 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:13.321 DEBUG:boto:Data: 2023-12-15T23:09:13.321 DEBUG:boto:Headers: {} 2023-12-15T23:09:13.321 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.321 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.321 DEBUG:boto:Params: {} 2023-12-15T23:09:13.321 DEBUG:boto:Token: None 2023-12-15T23:09:13.322 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/ 2023-12-15T23:09:13.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04= 2023-12-15T23:09:13.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04=', 'Content-Length': '0'} 2023-12-15T23:09:13.324 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b5ee3d3f8037faa8-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.324 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:13.324 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:13.324 DEBUG:boto:Method: PUT 2023-12-15T23:09:13.324 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:13.324 DEBUG:boto:Data: 2023-12-15T23:09:13.325 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:13.325 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.325 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.325 DEBUG:boto:Params: {} 2023-12-15T23:09:13.325 DEBUG:boto:Token: None 2023-12-15T23:09:13.325 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/a 2023-12-15T23:09:13.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TyzBPIFISHvKbfo6sHpxNNKu5Aw= 2023-12-15T23:09:13.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TyzBPIFISHvKbfo6sHpxNNKu5Aw='} 2023-12-15T23:09:13.331 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e2ec98292a44b1c0-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.331 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:13.331 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:13.331 DEBUG:boto:Method: HEAD 2023-12-15T23:09:13.332 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:13.332 DEBUG:boto:Data: 2023-12-15T23:09:13.332 DEBUG:boto:Headers: {} 2023-12-15T23:09:13.332 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.332 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.332 DEBUG:boto:Params: {} 2023-12-15T23:09:13.332 DEBUG:boto:Token: None 2023-12-15T23:09:13.332 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/ 2023-12-15T23:09:13.332 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04= 2023-12-15T23:09:13.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04=', 'Content-Length': '0'} 2023-12-15T23:09:13.334 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008d088ec42589ecdc-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.335 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:13.335 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:13.335 DEBUG:boto:Method: PUT 2023-12-15T23:09:13.335 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:13.335 DEBUG:boto:Data: 2023-12-15T23:09:13.335 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:13.335 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.335 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.335 DEBUG:boto:Params: {} 2023-12-15T23:09:13.336 DEBUG:boto:Token: None 2023-12-15T23:09:13.336 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/b 2023-12-15T23:09:13.336 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mPDiCXFw9UIN2fbOMfMKyaMElD0= 2023-12-15T23:09:13.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mPDiCXFw9UIN2fbOMfMKyaMElD0='} 2023-12-15T23:09:13.381 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000de36bb803dc86911-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.382 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:13.382 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:13.382 DEBUG:boto:Method: HEAD 2023-12-15T23:09:13.382 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:13.382 DEBUG:boto:Data: 2023-12-15T23:09:13.382 DEBUG:boto:Headers: {} 2023-12-15T23:09:13.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.382 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.382 DEBUG:boto:Params: {} 2023-12-15T23:09:13.383 DEBUG:boto:Token: None 2023-12-15T23:09:13.383 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/ 2023-12-15T23:09:13.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04= 2023-12-15T23:09:13.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04=', 'Content-Length': '0'} 2023-12-15T23:09:13.385 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000495be12c38c9ec8f-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.385 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:13.385 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:13.385 DEBUG:boto:Method: PUT 2023-12-15T23:09:13.386 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:13.386 DEBUG:boto:Data: 2023-12-15T23:09:13.386 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:13.386 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.386 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.386 DEBUG:boto:Params: {} 2023-12-15T23:09:13.386 DEBUG:boto:Token: None 2023-12-15T23:09:13.386 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/c 2023-12-15T23:09:13.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zImqiHET3+8Yz2aDw6RjCquVHZk= 2023-12-15T23:09:13.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zImqiHET3+8Yz2aDw6RjCquVHZk='} 2023-12-15T23:09:13.391 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016397feed916a088-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.391 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:13.391 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:13.392 DEBUG:boto:Method: HEAD 2023-12-15T23:09:13.392 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:13.392 DEBUG:boto:Data: 2023-12-15T23:09:13.392 DEBUG:boto:Headers: {} 2023-12-15T23:09:13.392 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.392 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.392 DEBUG:boto:Params: {} 2023-12-15T23:09:13.392 DEBUG:boto:Token: None 2023-12-15T23:09:13.392 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/ 2023-12-15T23:09:13.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04= 2023-12-15T23:09:13.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Q5JegExcohS7HQdSh7wA3nTe04=', 'Content-Length': '0'} 2023-12-15T23:09:13.394 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d27c735507013df6-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.395 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:13.395 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:13.395 DEBUG:boto:Method: PUT 2023-12-15T23:09:13.395 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:13.395 DEBUG:boto:Data: 2023-12-15T23:09:13.395 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:13.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:13.395 DEBUG:boto:Port: 8000 2023-12-15T23:09:13.395 DEBUG:boto:Params: {} 2023-12-15T23:09:13.395 DEBUG:boto:Token: None 2023-12-15T23:09:13.396 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:13 GMT /kskgfn-45/d 2023-12-15T23:09:13.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lMgPL4+y3rC6C4r91V3h8GHKLQA= 2023-12-15T23:09:13.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lMgPL4+y3rC6C4r91V3h8GHKLQA='} 2023-12-15T23:09:13.438 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000077a83351a8e38eaf-00657cdc99-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:13.438 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.439 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:13.484 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:13.485 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:13.514 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:09:13.530 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681753.318763_352.1","last_update":"2023-12-15T23:09:13.318763Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:09:13.530 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681753.318763_352.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:13.530 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:09:13.530 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:13.530 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:13.583 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:13.583 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:13.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:13.615+0000 7f6434522800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:13.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:13.616+0000 7f6434522800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:09:13.632 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681753.318763_352.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:13.318763Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:13Z"} 2023-12-15T23:09:13.633 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681753.318763_352.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:09:13.318763Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:09:13Z"} 2023-12-15T23:09:13.633 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681753.318763_352.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:09:13.318763Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:09:13.633 DEBUG:rgw_multi.tests:log_status={0: '1_1702681753.318763_352.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:13.633 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681753.318763_352.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:09:13.634 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:09:13.634 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-45 2023-12-15T23:09:13.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:13.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:13.634 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:13.689 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:13.690 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:13.722 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:13.721+0000 7f8631dab800 1 waiting to reach incremental sync.. 2023-12-15T23:09:18.724 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:18.723+0000 7f8631dab800 1 bucket sync caught up with source: 2023-12-15T23:09:18.724 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.33.6, , , , 00000000001.31.6, , , 00000000001.38.6, , 00000000001.24.6] 2023-12-15T23:09:18.725 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.33.6, , , , 00000000001.31.6, , , 00000000001.38.6, , 00000000001.24.6] 2023-12-15T23:09:18.725 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:18.723+0000 7f8631dab800 0 bucket checkpoint complete 2023-12-15T23:09:18.743 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-45 2023-12-15T23:09:18.743 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:18.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:18.743 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:18.808 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:18.808 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:18.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:18.850+0000 7f72c0daf800 1 bucket sync caught up with source: 2023-12-15T23:09:18.851 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.118.6, , , , 00000000001.95.6, , , 00000000001.69.6, , 00000000001.58.6] 2023-12-15T23:09:18.851 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.118.6, , , , 00000000001.95.6, , , 00000000001.69.6, , 00000000001.58.6] 2023-12-15T23:09:18.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:18.850+0000 7f72c0daf800 0 bucket checkpoint complete 2023-12-15T23:09:18.867 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:18.867 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.867 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.867 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.867 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:18.867 DEBUG:boto:Data: 2023-12-15T23:09:18.868 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.868 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.868 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.868 DEBUG:boto:Params: {} 2023-12-15T23:09:18.868 DEBUG:boto:Token: None 2023-12-15T23:09:18.868 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/ 2023-12-15T23:09:18.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2nxL01ptq8SMI168klO6pRaxskQ= 2023-12-15T23:09:18.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2nxL01ptq8SMI168klO6pRaxskQ=', 'Content-Length': '0'} 2023-12-15T23:09:18.871 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000072d54e16d8a015ae-00657cdc9e-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.872 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.872 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.872 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.872 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:18.872 DEBUG:boto:Data: 2023-12-15T23:09:18.873 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.873 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.873 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.873 DEBUG:boto:Params: {} 2023-12-15T23:09:18.873 DEBUG:boto:Token: None 2023-12-15T23:09:18.873 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/ 2023-12-15T23:09:18.873 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2nxL01ptq8SMI168klO6pRaxskQ= 2023-12-15T23:09:18.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2nxL01ptq8SMI168klO6pRaxskQ=', 'Content-Length': '0'} 2023-12-15T23:09:18.875 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000d5cc4b2557b12f-00657cdc9e-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.876 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:09:18.876 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.876 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.876 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.876 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.876 DEBUG:boto:Method: GET 2023-12-15T23:09:18.876 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.876 DEBUG:boto:Data: 2023-12-15T23:09:18.876 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.876 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.877 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.877 DEBUG:boto:Params: {} 2023-12-15T23:09:18.877 DEBUG:boto:Token: None 2023-12-15T23:09:18.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/?versions 2023-12-15T23:09:18.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A= 2023-12-15T23:09:18.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A=', 'Content-Length': '0'} 2023-12-15T23:09:18.879 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c4e310b11b529a3-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.879 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.880 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:18.880 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:18.880 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:18.880 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:18.880 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:09:18.880 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.881 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.881 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.881 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.881 DEBUG:boto:Method: GET 2023-12-15T23:09:18.881 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.881 DEBUG:boto:Data: 2023-12-15T23:09:18.881 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.881 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.881 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.881 DEBUG:boto:Params: {} 2023-12-15T23:09:18.882 DEBUG:boto:Token: None 2023-12-15T23:09:18.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/?versions 2023-12-15T23:09:18.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A= 2023-12-15T23:09:18.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A=', 'Content-Length': '0'} 2023-12-15T23:09:18.884 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057e137d7a6af0d2d-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.884 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.885 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:18.885 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:18.885 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:18.885 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:18.885 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.885 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.886 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.886 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.886 DEBUG:boto:Method: GET 2023-12-15T23:09:18.886 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.886 DEBUG:boto:Data: 2023-12-15T23:09:18.886 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.886 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.886 DEBUG:boto:Params: {} 2023-12-15T23:09:18.886 DEBUG:boto:Token: None 2023-12-15T23:09:18.886 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/?versions 2023-12-15T23:09:18.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A= 2023-12-15T23:09:18.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A=', 'Content-Length': '0'} 2023-12-15T23:09:18.889 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000adb21ee2db4dd5f9-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.889 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.889 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.890 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.890 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.890 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.890 DEBUG:boto:Method: GET 2023-12-15T23:09:18.890 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:18.890 DEBUG:boto:Data: 2023-12-15T23:09:18.890 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.890 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.890 DEBUG:boto:Params: {} 2023-12-15T23:09:18.890 DEBUG:boto:Token: None 2023-12-15T23:09:18.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/?versions 2023-12-15T23:09:18.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A= 2023-12-15T23:09:18.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hO/8qi2wiPkHNVPvUKEJbf7bx5A=', 'Content-Length': '0'} 2023-12-15T23:09:18.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032919aa8203b63ba-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.893 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:18.894 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.894 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.894 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.894 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.894 DEBUG:boto:Method: GET 2023-12-15T23:09:18.894 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.895 DEBUG:boto:Data: 2023-12-15T23:09:18.895 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.895 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.895 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.895 DEBUG:boto:Params: {} 2023-12-15T23:09:18.895 DEBUG:boto:Token: None 2023-12-15T23:09:18.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw= 2023-12-15T23:09:18.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw=', 'Content-Length': '0'} 2023-12-15T23:09:18.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000208fefdd115a1194-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.898 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.898 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.898 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.898 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.898 DEBUG:boto:Method: GET 2023-12-15T23:09:18.898 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.898 DEBUG:boto:Data: 2023-12-15T23:09:18.898 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.898 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.899 DEBUG:boto:Params: {} 2023-12-15T23:09:18.899 DEBUG:boto:Token: None 2023-12-15T23:09:18.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw= 2023-12-15T23:09:18.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw=', 'Content-Length': '0'} 2023-12-15T23:09:18.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb76d756608f462a-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.901 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.901 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.902 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.902 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.902 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.902 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.902 DEBUG:boto:Data: 2023-12-15T23:09:18.902 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.902 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.902 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.902 DEBUG:boto:Params: {} 2023-12-15T23:09:18.902 DEBUG:boto:Token: None 2023-12-15T23:09:18.903 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O386DRTk5wEwc0bbKAbSLX1dwNg= 2023-12-15T23:09:18.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O386DRTk5wEwc0bbKAbSLX1dwNg=', 'Content-Length': '0'} 2023-12-15T23:09:18.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8d39bea55f72e1f-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.905 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.905 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.905 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.905 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.905 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.905 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.905 DEBUG:boto:Data: 2023-12-15T23:09:18.906 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.906 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.906 DEBUG:boto:Params: {} 2023-12-15T23:09:18.906 DEBUG:boto:Token: None 2023-12-15T23:09:18.906 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O386DRTk5wEwc0bbKAbSLX1dwNg= 2023-12-15T23:09:18.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O386DRTk5wEwc0bbKAbSLX1dwNg=', 'Content-Length': '0'} 2023-12-15T23:09:18.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a71de6e81bd02fab-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.908 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:18.908 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.908 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.909 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.909 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.909 DEBUG:boto:Method: GET 2023-12-15T23:09:18.909 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.909 DEBUG:boto:Data: 2023-12-15T23:09:18.909 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.909 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.909 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.909 DEBUG:boto:Params: {} 2023-12-15T23:09:18.909 DEBUG:boto:Token: None 2023-12-15T23:09:18.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw= 2023-12-15T23:09:18.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw=', 'Content-Length': '0'} 2023-12-15T23:09:18.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6a47b3c169eaf96-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.953 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.953 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.954 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.954 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:18.954 DEBUG:boto:Method: GET 2023-12-15T23:09:18.954 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.954 DEBUG:boto:Data: 2023-12-15T23:09:18.954 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.954 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.954 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.954 DEBUG:boto:Params: {} 2023-12-15T23:09:18.954 DEBUG:boto:Token: None 2023-12-15T23:09:18.955 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:18.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw= 2023-12-15T23:09:18.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a6UDd9WpfPcFpqoEl5++yfyYKw=', 'Content-Length': '0'} 2023-12-15T23:09:18.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000917c15a58cf4531c-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.957 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.957 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.957 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:18.958 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:18.958 DEBUG:boto:Method: GET 2023-12-15T23:09:18.958 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:18.958 DEBUG:boto:Data: 2023-12-15T23:09:18.958 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.958 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.958 DEBUG:boto:Params: {} 2023-12-15T23:09:18.958 DEBUG:boto:Token: None 2023-12-15T23:09:18.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/ 2023-12-15T23:09:18.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIcxV0DcyIv8UdoHea3iuxk+JgE= 2023-12-15T23:09:18.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIcxV0DcyIv8UdoHea3iuxk+JgE=', 'Content-Length': '0'} 2023-12-15T23:09:18.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027e05ffcd7faa0af-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.961 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.961 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:18.962 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:18.962 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:18.962 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:18.962 DEBUG:boto:Method: GET 2023-12-15T23:09:18.962 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:18.962 DEBUG:boto:Data: 2023-12-15T23:09:18.962 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.962 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.962 DEBUG:boto:Params: {} 2023-12-15T23:09:18.963 DEBUG:boto:Token: None 2023-12-15T23:09:18.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/ 2023-12-15T23:09:18.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIcxV0DcyIv8UdoHea3iuxk+JgE= 2023-12-15T23:09:18.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIcxV0DcyIv8UdoHea3iuxk+JgE=', 'Content-Length': '0'} 2023-12-15T23:09:18.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cece8f2f7afe16d9-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.965 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:18.965 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.966 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.966 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.966 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:18.966 DEBUG:boto:Data: 2023-12-15T23:09:18.966 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.966 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.966 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.966 DEBUG:boto:Params: {} 2023-12-15T23:09:18.966 DEBUG:boto:Token: None 2023-12-15T23:09:18.966 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a 2023-12-15T23:09:18.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nH3UptVncUfSMGdzOHUSB1Ipcv4= 2023-12-15T23:09:18.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nH3UptVncUfSMGdzOHUSB1Ipcv4=', 'Content-Length': '0'} 2023-12-15T23:09:18.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e87cc0c50ab8488d-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.969 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.969 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.969 DEBUG:boto:Method: HEAD 2023-12-15T23:09:18.969 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:18.970 DEBUG:boto:Data: 2023-12-15T23:09:18.970 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:18.970 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.970 DEBUG:boto:Params: {} 2023-12-15T23:09:18.970 DEBUG:boto:Token: None 2023-12-15T23:09:18.970 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a 2023-12-15T23:09:18.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nH3UptVncUfSMGdzOHUSB1Ipcv4= 2023-12-15T23:09:18.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nH3UptVncUfSMGdzOHUSB1Ipcv4=', 'Content-Length': '0'} 2023-12-15T23:09:18.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000888a90f0603b4e9e-00657cdc9e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:18.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:18.973 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:18.973 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:18.973 DEBUG:boto:Method: GET 2023-12-15T23:09:18.973 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:18.974 DEBUG:boto:Data: 2023-12-15T23:09:18.974 DEBUG:boto:Headers: {} 2023-12-15T23:09:18.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:18.974 DEBUG:boto:Port: 8000 2023-12-15T23:09:18.974 DEBUG:boto:Params: {} 2023-12-15T23:09:18.974 DEBUG:boto:Token: None 2023-12-15T23:09:18.974 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:18 GMT /kskgfn-45/a 2023-12-15T23:09:18.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SAvPbJov/k24SOQCqVTXVYt+j/E= 2023-12-15T23:09:18.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SAvPbJov/k24SOQCqVTXVYt+j/E=', 'Content-Length': '0'} 2023-12-15T23:09:18.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e966e4f51eff919-00657cdc9e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.018 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:19.060 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:19.060 DEBUG:boto:Method: GET 2023-12-15T23:09:19.060 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:19.060 DEBUG:boto:Data: 2023-12-15T23:09:19.060 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.060 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.060 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.060 DEBUG:boto:Params: {} 2023-12-15T23:09:19.060 DEBUG:boto:Token: None 2023-12-15T23:09:19.061 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/a 2023-12-15T23:09:19.061 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wv8rLcVjylByIa/Ilnclmtrg9XE= 2023-12-15T23:09:19.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wv8rLcVjylByIa/Ilnclmtrg9XE=', 'Content-Length': '0'} 2023-12-15T23:09:19.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060c175b8772adaac-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.064 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.064 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.064 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:19.064 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:19.064 DEBUG:boto:Method: GET 2023-12-15T23:09:19.064 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:19.065 DEBUG:boto:Data: 2023-12-15T23:09:19.065 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.065 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.065 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.065 DEBUG:boto:Params: {} 2023-12-15T23:09:19.065 DEBUG:boto:Token: None 2023-12-15T23:09:19.065 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.065 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.068 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029b420fcbaf36c8f-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.068 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.068 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.068 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.069 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:19.069 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:19.069 DEBUG:boto:Method: GET 2023-12-15T23:09:19.069 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:19.069 DEBUG:boto:Data: 2023-12-15T23:09:19.069 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.069 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.069 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.069 DEBUG:boto:Params: {} 2023-12-15T23:09:19.070 DEBUG:boto:Token: None 2023-12-15T23:09:19.070 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b3a55e818d4e76a-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.073 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:19.073 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.073 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.073 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.073 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.073 DEBUG:boto:Method: GET 2023-12-15T23:09:19.074 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.074 DEBUG:boto:Data: 2023-12-15T23:09:19.074 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.074 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.074 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.074 DEBUG:boto:Params: {} 2023-12-15T23:09:19.074 DEBUG:boto:Token: None 2023-12-15T23:09:19.074 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE= 2023-12-15T23:09:19.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE=', 'Content-Length': '0'} 2023-12-15T23:09:19.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009604b610c689b956-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.117 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.118 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.118 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.118 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.118 DEBUG:boto:Method: GET 2023-12-15T23:09:19.118 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.118 DEBUG:boto:Data: 2023-12-15T23:09:19.118 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.118 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.118 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.118 DEBUG:boto:Params: {} 2023-12-15T23:09:19.118 DEBUG:boto:Token: None 2023-12-15T23:09:19.119 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE= 2023-12-15T23:09:19.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE=', 'Content-Length': '0'} 2023-12-15T23:09:19.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000498a915d2a71ede9-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.121 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.121 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.121 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.121 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.121 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.121 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.122 DEBUG:boto:Data: 2023-12-15T23:09:19.122 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.122 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.122 DEBUG:boto:Params: {} 2023-12-15T23:09:19.122 DEBUG:boto:Token: None 2023-12-15T23:09:19.122 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:16bSgSZRUOOSi5tkx3iqvVPsaRo= 2023-12-15T23:09:19.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:16bSgSZRUOOSi5tkx3iqvVPsaRo=', 'Content-Length': '0'} 2023-12-15T23:09:19.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4defb20c2f9f5ca-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.124 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.125 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.125 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.125 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.125 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.125 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.125 DEBUG:boto:Data: 2023-12-15T23:09:19.125 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.125 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.125 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.125 DEBUG:boto:Params: {} 2023-12-15T23:09:19.125 DEBUG:boto:Token: None 2023-12-15T23:09:19.126 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:16bSgSZRUOOSi5tkx3iqvVPsaRo= 2023-12-15T23:09:19.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:16bSgSZRUOOSi5tkx3iqvVPsaRo=', 'Content-Length': '0'} 2023-12-15T23:09:19.128 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000058117e5268b5e7d-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:19.128 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.128 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.128 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.128 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.128 DEBUG:boto:Method: GET 2023-12-15T23:09:19.128 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.129 DEBUG:boto:Data: 2023-12-15T23:09:19.129 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.129 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.129 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.129 DEBUG:boto:Params: {} 2023-12-15T23:09:19.129 DEBUG:boto:Token: None 2023-12-15T23:09:19.129 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.129 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE= 2023-12-15T23:09:19.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE=', 'Content-Length': '0'} 2023-12-15T23:09:19.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001343d350c6bdddd3-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.177 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.178 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.178 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.178 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:19.178 DEBUG:boto:Method: GET 2023-12-15T23:09:19.178 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.178 DEBUG:boto:Data: 2023-12-15T23:09:19.178 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.178 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.178 DEBUG:boto:Params: {} 2023-12-15T23:09:19.178 DEBUG:boto:Token: None 2023-12-15T23:09:19.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:19.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE= 2023-12-15T23:09:19.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W83yxqFL7p7D8FDoqhWvwVpxZOE=', 'Content-Length': '0'} 2023-12-15T23:09:19.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7790488f6513a94-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.181 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.181 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.181 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.181 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.181 DEBUG:boto:Method: GET 2023-12-15T23:09:19.181 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:19.182 DEBUG:boto:Data: 2023-12-15T23:09:19.182 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.182 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.182 DEBUG:boto:Params: {} 2023-12-15T23:09:19.182 DEBUG:boto:Token: None 2023-12-15T23:09:19.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd36b96ff2b95dc5-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.185 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.185 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.185 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.186 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.186 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.186 DEBUG:boto:Method: GET 2023-12-15T23:09:19.186 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:19.186 DEBUG:boto:Data: 2023-12-15T23:09:19.186 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.186 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.186 DEBUG:boto:Params: {} 2023-12-15T23:09:19.186 DEBUG:boto:Token: None 2023-12-15T23:09:19.186 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006129b0e26b92733b-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.189 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.189 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.190 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.190 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.190 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:19.190 DEBUG:boto:Data: 2023-12-15T23:09:19.190 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.190 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.190 DEBUG:boto:Params: {} 2023-12-15T23:09:19.190 DEBUG:boto:Token: None 2023-12-15T23:09:19.190 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b 2023-12-15T23:09:19.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QHiHtRi8vZoDHDQpJhiw+Cmo6Cw= 2023-12-15T23:09:19.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QHiHtRi8vZoDHDQpJhiw+Cmo6Cw=', 'Content-Length': '0'} 2023-12-15T23:09:19.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b088c6f0055913a4-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.193 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.193 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.193 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.193 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:19.193 DEBUG:boto:Data: 2023-12-15T23:09:19.193 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.193 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.193 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.194 DEBUG:boto:Params: {} 2023-12-15T23:09:19.194 DEBUG:boto:Token: None 2023-12-15T23:09:19.194 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b 2023-12-15T23:09:19.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QHiHtRi8vZoDHDQpJhiw+Cmo6Cw= 2023-12-15T23:09:19.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QHiHtRi8vZoDHDQpJhiw+Cmo6Cw=', 'Content-Length': '0'} 2023-12-15T23:09:19.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c07068e8263060f1-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:19.196 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.196 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.196 DEBUG:boto:Method: GET 2023-12-15T23:09:19.196 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:19.196 DEBUG:boto:Data: 2023-12-15T23:09:19.197 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.197 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.197 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.197 DEBUG:boto:Params: {} 2023-12-15T23:09:19.197 DEBUG:boto:Token: None 2023-12-15T23:09:19.197 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b 2023-12-15T23:09:19.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JcaYxCAAoCnke5lWJYZ33jUrJjo= 2023-12-15T23:09:19.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JcaYxCAAoCnke5lWJYZ33jUrJjo=', 'Content-Length': '0'} 2023-12-15T23:09:19.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d69418bf4f7c9272-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.245 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:19.246 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:19.246 DEBUG:boto:Method: GET 2023-12-15T23:09:19.246 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:19.246 DEBUG:boto:Data: 2023-12-15T23:09:19.246 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.246 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.246 DEBUG:boto:Params: {} 2023-12-15T23:09:19.246 DEBUG:boto:Token: None 2023-12-15T23:09:19.246 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/b 2023-12-15T23:09:19.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JcaYxCAAoCnke5lWJYZ33jUrJjo= 2023-12-15T23:09:19.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JcaYxCAAoCnke5lWJYZ33jUrJjo=', 'Content-Length': '0'} 2023-12-15T23:09:19.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd457157bf16a15d-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.249 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.249 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.249 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.249 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.249 DEBUG:boto:Method: GET 2023-12-15T23:09:19.249 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:19.249 DEBUG:boto:Data: 2023-12-15T23:09:19.250 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.250 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.250 DEBUG:boto:Params: {} 2023-12-15T23:09:19.250 DEBUG:boto:Token: None 2023-12-15T23:09:19.250 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.252 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a894b89d55786e7d-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.253 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.253 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.253 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.253 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.253 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:19.253 DEBUG:boto:Method: GET 2023-12-15T23:09:19.254 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:19.254 DEBUG:boto:Data: 2023-12-15T23:09:19.254 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.254 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.254 DEBUG:boto:Params: {} 2023-12-15T23:09:19.254 DEBUG:boto:Token: None 2023-12-15T23:09:19.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.257 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a231648e28be6e9a-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.257 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:19.257 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.257 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.258 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.258 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.258 DEBUG:boto:Method: GET 2023-12-15T23:09:19.258 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.258 DEBUG:boto:Data: 2023-12-15T23:09:19.258 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.258 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.258 DEBUG:boto:Params: {} 2023-12-15T23:09:19.258 DEBUG:boto:Token: None 2023-12-15T23:09:19.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc= 2023-12-15T23:09:19.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc=', 'Content-Length': '0'} 2023-12-15T23:09:19.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000659ac39390d3ba3-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.305 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.306 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.306 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.306 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.306 DEBUG:boto:Method: GET 2023-12-15T23:09:19.306 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.306 DEBUG:boto:Data: 2023-12-15T23:09:19.306 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.306 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.306 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.306 DEBUG:boto:Params: {} 2023-12-15T23:09:19.307 DEBUG:boto:Token: None 2023-12-15T23:09:19.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc= 2023-12-15T23:09:19.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc=', 'Content-Length': '0'} 2023-12-15T23:09:19.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048291de6e6312a63-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.309 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.309 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.309 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.309 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.309 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.310 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.310 DEBUG:boto:Data: 2023-12-15T23:09:19.310 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.310 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.310 DEBUG:boto:Params: {} 2023-12-15T23:09:19.310 DEBUG:boto:Token: None 2023-12-15T23:09:19.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nC+IGfdfArS9NotiZnxH866Qrpg= 2023-12-15T23:09:19.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nC+IGfdfArS9NotiZnxH866Qrpg=', 'Content-Length': '0'} 2023-12-15T23:09:19.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac0469157b0f1e59-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.312 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.313 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.313 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.313 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.313 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.313 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.313 DEBUG:boto:Data: 2023-12-15T23:09:19.313 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.313 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.313 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.313 DEBUG:boto:Params: {} 2023-12-15T23:09:19.314 DEBUG:boto:Token: None 2023-12-15T23:09:19.314 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nC+IGfdfArS9NotiZnxH866Qrpg= 2023-12-15T23:09:19.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nC+IGfdfArS9NotiZnxH866Qrpg=', 'Content-Length': '0'} 2023-12-15T23:09:19.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021620bf4d27637b6-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:19.316 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.316 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.316 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.316 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.317 DEBUG:boto:Method: GET 2023-12-15T23:09:19.317 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.317 DEBUG:boto:Data: 2023-12-15T23:09:19.317 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.317 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.317 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.317 DEBUG:boto:Params: {} 2023-12-15T23:09:19.317 DEBUG:boto:Token: None 2023-12-15T23:09:19.317 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc= 2023-12-15T23:09:19.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc=', 'Content-Length': '0'} 2023-12-15T23:09:19.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef28bcb87a5cbe48-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.366 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.366 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.366 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.366 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:19.366 DEBUG:boto:Method: GET 2023-12-15T23:09:19.366 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.366 DEBUG:boto:Data: 2023-12-15T23:09:19.366 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.367 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.367 DEBUG:boto:Params: {} 2023-12-15T23:09:19.367 DEBUG:boto:Token: None 2023-12-15T23:09:19.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:19.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc= 2023-12-15T23:09:19.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ONkl4BM5V1ZJHpj72JHI35jwyCc=', 'Content-Length': '0'} 2023-12-15T23:09:19.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096858fec5b4405cd-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.369 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.369 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.369 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.369 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.370 DEBUG:boto:Method: GET 2023-12-15T23:09:19.370 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:19.370 DEBUG:boto:Data: 2023-12-15T23:09:19.370 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.370 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.370 DEBUG:boto:Params: {} 2023-12-15T23:09:19.370 DEBUG:boto:Token: None 2023-12-15T23:09:19.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000404e14a20b222562-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.373 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.373 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.373 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.373 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.373 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.374 DEBUG:boto:Method: GET 2023-12-15T23:09:19.374 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:19.374 DEBUG:boto:Data: 2023-12-15T23:09:19.374 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.374 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.374 DEBUG:boto:Params: {} 2023-12-15T23:09:19.374 DEBUG:boto:Token: None 2023-12-15T23:09:19.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9b92dcb91f9beba-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.378 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.378 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.378 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.378 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.378 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:19.378 DEBUG:boto:Data: 2023-12-15T23:09:19.378 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.378 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.379 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.379 DEBUG:boto:Params: {} 2023-12-15T23:09:19.379 DEBUG:boto:Token: None 2023-12-15T23:09:19.379 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c 2023-12-15T23:09:19.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m/n6EdTyQRKdyrktHUJ1rHYEoXI= 2023-12-15T23:09:19.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m/n6EdTyQRKdyrktHUJ1rHYEoXI=', 'Content-Length': '0'} 2023-12-15T23:09:19.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beebc2e1d4e2cc5a-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.381 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.381 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.381 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.381 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:19.382 DEBUG:boto:Data: 2023-12-15T23:09:19.382 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.382 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.382 DEBUG:boto:Params: {} 2023-12-15T23:09:19.382 DEBUG:boto:Token: None 2023-12-15T23:09:19.382 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c 2023-12-15T23:09:19.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m/n6EdTyQRKdyrktHUJ1rHYEoXI= 2023-12-15T23:09:19.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m/n6EdTyQRKdyrktHUJ1rHYEoXI=', 'Content-Length': '0'} 2023-12-15T23:09:19.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c744c9404ce14962-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:19.384 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.384 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.385 DEBUG:boto:Method: GET 2023-12-15T23:09:19.385 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:19.385 DEBUG:boto:Data: 2023-12-15T23:09:19.385 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.385 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.385 DEBUG:boto:Params: {} 2023-12-15T23:09:19.385 DEBUG:boto:Token: None 2023-12-15T23:09:19.385 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c 2023-12-15T23:09:19.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PCB+9husDyZwrC9I7w2CJxqgJ0o= 2023-12-15T23:09:19.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PCB+9husDyZwrC9I7w2CJxqgJ0o=', 'Content-Length': '0'} 2023-12-15T23:09:19.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f728b2a945451df-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.429 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:19.430 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:19.430 DEBUG:boto:Method: GET 2023-12-15T23:09:19.430 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:19.430 DEBUG:boto:Data: 2023-12-15T23:09:19.430 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.430 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.430 DEBUG:boto:Params: {} 2023-12-15T23:09:19.430 DEBUG:boto:Token: None 2023-12-15T23:09:19.430 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/c 2023-12-15T23:09:19.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PCB+9husDyZwrC9I7w2CJxqgJ0o= 2023-12-15T23:09:19.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PCB+9husDyZwrC9I7w2CJxqgJ0o=', 'Content-Length': '0'} 2023-12-15T23:09:19.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dba8bb2cd69bd5b-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.433 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.433 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.433 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.433 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.433 DEBUG:boto:Method: GET 2023-12-15T23:09:19.434 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:19.434 DEBUG:boto:Data: 2023-12-15T23:09:19.434 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.434 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.434 DEBUG:boto:Params: {} 2023-12-15T23:09:19.434 DEBUG:boto:Token: None 2023-12-15T23:09:19.434 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000353f88b4e752dd3c-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.437 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.437 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.437 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.438 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.438 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:19.438 DEBUG:boto:Method: GET 2023-12-15T23:09:19.438 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:19.438 DEBUG:boto:Data: 2023-12-15T23:09:19.438 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.438 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.438 DEBUG:boto:Params: {} 2023-12-15T23:09:19.438 DEBUG:boto:Token: None 2023-12-15T23:09:19.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6e94fe0c35402d9-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.441 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:19.442 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.442 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.442 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.442 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.442 DEBUG:boto:Method: GET 2023-12-15T23:09:19.442 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.442 DEBUG:boto:Data: 2023-12-15T23:09:19.442 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.443 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.443 DEBUG:boto:Params: {} 2023-12-15T23:09:19.443 DEBUG:boto:Token: None 2023-12-15T23:09:19.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs= 2023-12-15T23:09:19.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs=', 'Content-Length': '0'} 2023-12-15T23:09:19.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6dcbd2e50a14a4b-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.485 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.486 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.486 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.486 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.486 DEBUG:boto:Method: GET 2023-12-15T23:09:19.486 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.486 DEBUG:boto:Data: 2023-12-15T23:09:19.486 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.486 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.486 DEBUG:boto:Params: {} 2023-12-15T23:09:19.486 DEBUG:boto:Token: None 2023-12-15T23:09:19.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs= 2023-12-15T23:09:19.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs=', 'Content-Length': '0'} 2023-12-15T23:09:19.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b70aae9f6313fb-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.489 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.489 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.489 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.489 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.489 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.490 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.490 DEBUG:boto:Data: 2023-12-15T23:09:19.490 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.490 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.490 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.490 DEBUG:boto:Params: {} 2023-12-15T23:09:19.490 DEBUG:boto:Token: None 2023-12-15T23:09:19.490 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TpKf4IpJZ8+7Nzq16Zd3Z9C4bno= 2023-12-15T23:09:19.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TpKf4IpJZ8+7Nzq16Zd3Z9C4bno=', 'Content-Length': '0'} 2023-12-15T23:09:19.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d77d22df53203d3-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.493 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.493 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.493 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.493 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.493 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.493 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.493 DEBUG:boto:Data: 2023-12-15T23:09:19.493 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.493 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.493 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.493 DEBUG:boto:Params: {} 2023-12-15T23:09:19.494 DEBUG:boto:Token: None 2023-12-15T23:09:19.494 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.494 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TpKf4IpJZ8+7Nzq16Zd3Z9C4bno= 2023-12-15T23:09:19.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TpKf4IpJZ8+7Nzq16Zd3Z9C4bno=', 'Content-Length': '0'} 2023-12-15T23:09:19.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e66e0c14ec01fb91-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:19.496 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.496 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.496 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.496 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.497 DEBUG:boto:Method: GET 2023-12-15T23:09:19.497 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.497 DEBUG:boto:Data: 2023-12-15T23:09:19.497 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.497 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.497 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.497 DEBUG:boto:Params: {} 2023-12-15T23:09:19.497 DEBUG:boto:Token: None 2023-12-15T23:09:19.497 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.497 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs= 2023-12-15T23:09:19.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs=', 'Content-Length': '0'} 2023-12-15T23:09:19.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009abaa97fbeb3e941-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.541 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.542 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.542 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.542 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:19.542 DEBUG:boto:Method: GET 2023-12-15T23:09:19.542 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.542 DEBUG:boto:Data: 2023-12-15T23:09:19.542 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.542 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.542 DEBUG:boto:Params: {} 2023-12-15T23:09:19.542 DEBUG:boto:Token: None 2023-12-15T23:09:19.543 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:19.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs= 2023-12-15T23:09:19.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fo5xbXoYSXegVxijjJiQBTFmZGs=', 'Content-Length': '0'} 2023-12-15T23:09:19.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b45da8c690732313-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.545 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.545 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.545 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.545 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.546 DEBUG:boto:Method: GET 2023-12-15T23:09:19.546 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:19.546 DEBUG:boto:Data: 2023-12-15T23:09:19.546 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.546 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.546 DEBUG:boto:Params: {} 2023-12-15T23:09:19.546 DEBUG:boto:Token: None 2023-12-15T23:09:19.546 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.546 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000dc4298edbf8801b-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.549 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.549 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.549 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.550 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.550 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.550 DEBUG:boto:Method: GET 2023-12-15T23:09:19.550 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:19.550 DEBUG:boto:Data: 2023-12-15T23:09:19.550 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.550 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.550 DEBUG:boto:Params: {} 2023-12-15T23:09:19.550 DEBUG:boto:Token: None 2023-12-15T23:09:19.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025b8cf87799efda8-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.553 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.553 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.553 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.553 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.554 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:19.554 DEBUG:boto:Data: 2023-12-15T23:09:19.554 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.554 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.554 DEBUG:boto:Params: {} 2023-12-15T23:09:19.554 DEBUG:boto:Token: None 2023-12-15T23:09:19.554 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d 2023-12-15T23:09:19.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xxf1qutWfd8txOJelem7FbknWGU= 2023-12-15T23:09:19.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xxf1qutWfd8txOJelem7FbknWGU=', 'Content-Length': '0'} 2023-12-15T23:09:19.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032a1ff668885fe5c-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.556 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.556 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.556 DEBUG:boto:Method: HEAD 2023-12-15T23:09:19.557 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:19.557 DEBUG:boto:Data: 2023-12-15T23:09:19.557 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.557 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.557 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.557 DEBUG:boto:Params: {} 2023-12-15T23:09:19.557 DEBUG:boto:Token: None 2023-12-15T23:09:19.557 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d 2023-12-15T23:09:19.557 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xxf1qutWfd8txOJelem7FbknWGU= 2023-12-15T23:09:19.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xxf1qutWfd8txOJelem7FbknWGU=', 'Content-Length': '0'} 2023-12-15T23:09:19.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000552c271336c3a419-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:19.560 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.560 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.560 DEBUG:boto:Method: GET 2023-12-15T23:09:19.560 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:19.560 DEBUG:boto:Data: 2023-12-15T23:09:19.560 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.560 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.560 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.560 DEBUG:boto:Params: {} 2023-12-15T23:09:19.560 DEBUG:boto:Token: None 2023-12-15T23:09:19.560 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d 2023-12-15T23:09:19.561 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CEaC8W0Yae4fRybhFN3euXxIhs8= 2023-12-15T23:09:19.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CEaC8W0Yae4fRybhFN3euXxIhs8=', 'Content-Length': '0'} 2023-12-15T23:09:19.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077095f20b46524e2-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.605 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:19.605 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:19.606 DEBUG:boto:Method: GET 2023-12-15T23:09:19.606 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:19.606 DEBUG:boto:Data: 2023-12-15T23:09:19.606 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.606 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.606 DEBUG:boto:Params: {} 2023-12-15T23:09:19.606 DEBUG:boto:Token: None 2023-12-15T23:09:19.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/d 2023-12-15T23:09:19.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CEaC8W0Yae4fRybhFN3euXxIhs8= 2023-12-15T23:09:19.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CEaC8W0Yae4fRybhFN3euXxIhs8=', 'Content-Length': '0'} 2023-12-15T23:09:19.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2e50a2f2a6e6765-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.609 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.609 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.609 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.609 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.609 DEBUG:boto:Method: GET 2023-12-15T23:09:19.609 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:19.609 DEBUG:boto:Data: 2023-12-15T23:09:19.610 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:19.610 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.610 DEBUG:boto:Params: {} 2023-12-15T23:09:19.610 DEBUG:boto:Token: None 2023-12-15T23:09:19.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007873d09615388f8-00657cdc9f-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.613 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.613 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:19.613 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:19.613 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.613 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:19.613 DEBUG:boto:Method: GET 2023-12-15T23:09:19.613 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:19.613 DEBUG:boto:Data: 2023-12-15T23:09:19.614 DEBUG:boto:Headers: {} 2023-12-15T23:09:19.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:19.614 DEBUG:boto:Port: 8000 2023-12-15T23:09:19.614 DEBUG:boto:Params: {} 2023-12-15T23:09:19.614 DEBUG:boto:Token: None 2023-12-15T23:09:19.614 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:19 GMT /kskgfn-45/ 2023-12-15T23:09:19.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54= 2023-12-15T23:09:19.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BMAd0V3G8brqQYjKiJGvk0Pcw54=', 'Content-Length': '0'} 2023-12-15T23:09:19.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093e60560f5409449-00657cdc9f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:19.617 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:19.617 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:19.618 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.618 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:19.669 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:19.669 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:19.722 INFO:teuthology.orchestra.run.smithi093.stdout:{"layout":{"resharding":"None","current_index":{"gen":0,"layout":{"type":"Normal","normal":{"num_shards":11,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}}]}} 2023-12-15T23:09:19.722 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-45', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:19.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-45', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:19.723 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-45 --gen 0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:19.771 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:19.771 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:19.817 INFO:teuthology.orchestra.run.smithi093.stdout:[{"op_id":"1#00000000001.33.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16351611649645654464","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:09:13.327609580Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"5#00000000001.31.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8622197912419667631","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:09:13.397977607Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"8#00000000001.38.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1601451806328004744","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:09:13.388366224Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"10#00000000001.24.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16012191684629129489","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2023-12-15T23:09:13.337852060Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]}] 2023-12-15T23:09:19.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'kskgfn-45', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'kskgfn-45', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.818 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket kskgfn-45 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:19.864 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:19.864 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:19.905 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:09:19.905 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-45 2023-12-15T23:09:19.911 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 4 2023-12-15T23:09:19.952 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:19.952 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:19.995 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:19.995 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:20.038 INFO:teuthology.orchestra.run.smithi093.stdout:{"layout":{"resharding":"None","current_index":{"gen":1,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2023-12-15T23:09:20.039 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-45', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:20.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-45', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:09:20.039 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-45 --gen 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:09:20.124 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:20.125 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:20.167 INFO:teuthology.orchestra.run.smithi093.stdout:[] 2023-12-15T23:09:20.167 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:20.167 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:20.167 DEBUG:boto:Method: HEAD 2023-12-15T23:09:20.167 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:20.167 DEBUG:boto:Data: 2023-12-15T23:09:20.167 DEBUG:boto:Headers: {} 2023-12-15T23:09:20.168 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.168 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.168 DEBUG:boto:Params: {} 2023-12-15T23:09:20.168 DEBUG:boto:Token: None 2023-12-15T23:09:20.168 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/ 2023-12-15T23:09:20.168 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA= 2023-12-15T23:09:20.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA=', 'Content-Length': '0'} 2023-12-15T23:09:20.170 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d4681a10ab73b37-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.170 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:20.171 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:20.171 DEBUG:boto:Method: PUT 2023-12-15T23:09:20.171 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:20.171 DEBUG:boto:Data: 2023-12-15T23:09:20.171 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:20.171 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.171 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.171 DEBUG:boto:Params: {} 2023-12-15T23:09:20.171 DEBUG:boto:Token: None 2023-12-15T23:09:20.171 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/e 2023-12-15T23:09:20.172 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k8Ej3TedngkW38lSeu1WW9efCkY= 2023-12-15T23:09:20.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k8Ej3TedngkW38lSeu1WW9efCkY='} 2023-12-15T23:09:20.177 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e574815cf1e3b961-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.177 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:20.177 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:20.178 DEBUG:boto:Method: HEAD 2023-12-15T23:09:20.178 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:20.178 DEBUG:boto:Data: 2023-12-15T23:09:20.178 DEBUG:boto:Headers: {} 2023-12-15T23:09:20.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.178 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.178 DEBUG:boto:Params: {} 2023-12-15T23:09:20.178 DEBUG:boto:Token: None 2023-12-15T23:09:20.178 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/ 2023-12-15T23:09:20.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA= 2023-12-15T23:09:20.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA=', 'Content-Length': '0'} 2023-12-15T23:09:20.180 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a5b50ab90ad47ba3-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.181 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:20.181 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:20.181 DEBUG:boto:Method: PUT 2023-12-15T23:09:20.181 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:20.181 DEBUG:boto:Data: 2023-12-15T23:09:20.181 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:20.181 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.181 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.182 DEBUG:boto:Params: {} 2023-12-15T23:09:20.182 DEBUG:boto:Token: None 2023-12-15T23:09:20.182 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/f 2023-12-15T23:09:20.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IfQ3DjQGegTJs7oTEd7HkGzPXk4= 2023-12-15T23:09:20.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IfQ3DjQGegTJs7oTEd7HkGzPXk4='} 2023-12-15T23:09:20.226 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001df100727ae518f5-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.227 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:20.227 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:20.227 DEBUG:boto:Method: HEAD 2023-12-15T23:09:20.227 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:20.227 DEBUG:boto:Data: 2023-12-15T23:09:20.227 DEBUG:boto:Headers: {} 2023-12-15T23:09:20.227 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.227 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.228 DEBUG:boto:Params: {} 2023-12-15T23:09:20.228 DEBUG:boto:Token: None 2023-12-15T23:09:20.228 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/ 2023-12-15T23:09:20.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA= 2023-12-15T23:09:20.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA=', 'Content-Length': '0'} 2023-12-15T23:09:20.230 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000081374234a0dc50c-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.230 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:20.230 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:20.230 DEBUG:boto:Method: PUT 2023-12-15T23:09:20.230 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:20.230 DEBUG:boto:Data: 2023-12-15T23:09:20.231 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:20.231 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.231 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.231 DEBUG:boto:Params: {} 2023-12-15T23:09:20.231 DEBUG:boto:Token: None 2023-12-15T23:09:20.231 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/g 2023-12-15T23:09:20.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/5isl76RD5kLfcrmmYP5QkLtezg= 2023-12-15T23:09:20.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/5isl76RD5kLfcrmmYP5QkLtezg='} 2023-12-15T23:09:20.236 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f3a68006a1cc083-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.237 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:20.237 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:20.237 DEBUG:boto:Method: HEAD 2023-12-15T23:09:20.237 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:20.237 DEBUG:boto:Data: 2023-12-15T23:09:20.237 DEBUG:boto:Headers: {} 2023-12-15T23:09:20.237 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.237 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.237 DEBUG:boto:Params: {} 2023-12-15T23:09:20.237 DEBUG:boto:Token: None 2023-12-15T23:09:20.238 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/ 2023-12-15T23:09:20.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA= 2023-12-15T23:09:20.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duhMnSHB36cH+qpgmyvb21jzXbA=', 'Content-Length': '0'} 2023-12-15T23:09:20.239 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f62deb00a8acd7e-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.239 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:20.240 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:20.240 DEBUG:boto:Method: PUT 2023-12-15T23:09:20.240 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:20.240 DEBUG:boto:Data: 2023-12-15T23:09:20.240 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:20.240 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:20.240 DEBUG:boto:Port: 8000 2023-12-15T23:09:20.240 DEBUG:boto:Params: {} 2023-12-15T23:09:20.240 DEBUG:boto:Token: None 2023-12-15T23:09:20.240 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:20 GMT /kskgfn-45/h 2023-12-15T23:09:20.241 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmwG2pJMi4y12KSoQKTIN2k6QSw= 2023-12-15T23:09:20.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmwG2pJMi4y12KSoQKTIN2k6QSw='} 2023-12-15T23:09:20.290 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ff3f4f82ae00dcd2-00657cdca0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:20.290 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-45 2023-12-15T23:09:20.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:20.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:20.290 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:20.350 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:20.350 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:20.387 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:20.386+0000 7fec5df26800 1 waiting to reach latest gen 1, on 0.. 2023-12-15T23:09:25.389 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:25.387+0000 7fec5df26800 1 bucket sync caught up with source: 2023-12-15T23:09:25.389 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.24.6, 00000000002.66.6, 00000000002.21.6] 2023-12-15T23:09:25.389 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.24.6, 00000000002.66.6, 00000000002.21.6] 2023-12-15T23:09:25.389 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:25.387+0000 7fec5df26800 0 bucket checkpoint complete 2023-12-15T23:09:25.407 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-45 2023-12-15T23:09:25.408 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:25.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:25.408 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:25.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:25.508+0000 7f7cdbe2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:09:25.509 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.118.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000001.69.6, , 00000000001.58.6] 2023-12-15T23:09:25.509 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:30.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:30.509+0000 7f7cdbe2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:09:30.512 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.118.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000001.69.6, , 00000000001.58.6] 2023-12-15T23:09:30.512 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:35.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:35.511+0000 7f7cdbe2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:09:35.512 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.118.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:35.512 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:40.512+0000 7f7cdbe2f800 1 bucket sync caught up with source: 2023-12-15T23:09:40.514 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:40.514 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:40.512+0000 7f7cdbe2f800 0 bucket checkpoint complete 2023-12-15T23:09:40.532 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:40.532 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.532 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.532 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.532 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:40.532 DEBUG:boto:Data: 2023-12-15T23:09:40.533 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.533 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.533 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.533 DEBUG:boto:Params: {} 2023-12-15T23:09:40.533 DEBUG:boto:Token: None 2023-12-15T23:09:40.533 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Bn/tNflIxHeVmvzVoAZMucOSQd4= 2023-12-15T23:09:40.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Bn/tNflIxHeVmvzVoAZMucOSQd4=', 'Content-Length': '0'} 2023-12-15T23:09:40.536 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1c74a36be980a62-00657cdcb4-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.537 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.537 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.537 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.537 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:40.537 DEBUG:boto:Data: 2023-12-15T23:09:40.537 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.537 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.537 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.537 DEBUG:boto:Params: {} 2023-12-15T23:09:40.537 DEBUG:boto:Token: None 2023-12-15T23:09:40.538 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Bn/tNflIxHeVmvzVoAZMucOSQd4= 2023-12-15T23:09:40.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Bn/tNflIxHeVmvzVoAZMucOSQd4=', 'Content-Length': '0'} 2023-12-15T23:09:40.540 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c21fee037409ad79-00657cdcb4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.540 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:09:40.540 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.540 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.541 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.541 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.541 DEBUG:boto:Method: GET 2023-12-15T23:09:40.541 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.541 DEBUG:boto:Data: 2023-12-15T23:09:40.541 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.541 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.541 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.541 DEBUG:boto:Params: {} 2023-12-15T23:09:40.541 DEBUG:boto:Token: None 2023-12-15T23:09:40.542 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/?versions 2023-12-15T23:09:40.542 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc= 2023-12-15T23:09:40.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc=', 'Content-Length': '0'} 2023-12-15T23:09:40.544 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2cb9f8fe1859436-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.544 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:09:40.546 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:09:40.546 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.547 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.547 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.547 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.547 DEBUG:boto:Method: GET 2023-12-15T23:09:40.547 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.547 DEBUG:boto:Data: 2023-12-15T23:09:40.547 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.547 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.547 DEBUG:boto:Params: {} 2023-12-15T23:09:40.548 DEBUG:boto:Token: None 2023-12-15T23:09:40.548 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/?versions 2023-12-15T23:09:40.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc= 2023-12-15T23:09:40.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc=', 'Content-Length': '0'} 2023-12-15T23:09:40.550 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdbca248df961a81-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.550 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:09:40.551 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:09:40.552 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:09:40.552 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.552 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.552 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.552 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.552 DEBUG:boto:Method: GET 2023-12-15T23:09:40.552 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.552 DEBUG:boto:Data: 2023-12-15T23:09:40.552 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.552 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.553 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.553 DEBUG:boto:Params: {} 2023-12-15T23:09:40.553 DEBUG:boto:Token: None 2023-12-15T23:09:40.553 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/?versions 2023-12-15T23:09:40.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc= 2023-12-15T23:09:40.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc=', 'Content-Length': '0'} 2023-12-15T23:09:40.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2243c18093d7172-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.556 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.557 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.557 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.557 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.557 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.557 DEBUG:boto:Method: GET 2023-12-15T23:09:40.557 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:40.557 DEBUG:boto:Data: 2023-12-15T23:09:40.557 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.557 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.558 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.558 DEBUG:boto:Params: {} 2023-12-15T23:09:40.558 DEBUG:boto:Token: None 2023-12-15T23:09:40.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/?versions 2023-12-15T23:09:40.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc= 2023-12-15T23:09:40.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGqztXy+XuxMZ2Rfc++8GZ7VAmc=', 'Content-Length': '0'} 2023-12-15T23:09:40.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6f3b9a01a735119-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.560 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:40.561 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.561 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.561 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.562 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.562 DEBUG:boto:Method: GET 2023-12-15T23:09:40.562 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.562 DEBUG:boto:Data: 2023-12-15T23:09:40.562 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.562 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.562 DEBUG:boto:Params: {} 2023-12-15T23:09:40.562 DEBUG:boto:Token: None 2023-12-15T23:09:40.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI= 2023-12-15T23:09:40.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI=', 'Content-Length': '0'} 2023-12-15T23:09:40.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be33d7f4028118d1-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.565 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.565 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.565 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.565 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.565 DEBUG:boto:Method: GET 2023-12-15T23:09:40.566 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.566 DEBUG:boto:Data: 2023-12-15T23:09:40.566 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.566 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.566 DEBUG:boto:Params: {} 2023-12-15T23:09:40.566 DEBUG:boto:Token: None 2023-12-15T23:09:40.566 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.566 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI= 2023-12-15T23:09:40.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI=', 'Content-Length': '0'} 2023-12-15T23:09:40.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008259733273d033b2-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.569 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.569 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.569 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.569 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.569 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.569 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.569 DEBUG:boto:Data: 2023-12-15T23:09:40.569 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.570 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.570 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.570 DEBUG:boto:Params: {} 2023-12-15T23:09:40.570 DEBUG:boto:Token: None 2023-12-15T23:09:40.570 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.570 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7U+xSu1LQqMquZqwTgF+244Btx4= 2023-12-15T23:09:40.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7U+xSu1LQqMquZqwTgF+244Btx4=', 'Content-Length': '0'} 2023-12-15T23:09:40.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adc1d853ebbe43b3-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.573 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.573 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.573 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.573 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.573 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.573 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.573 DEBUG:boto:Data: 2023-12-15T23:09:40.573 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.573 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.574 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.574 DEBUG:boto:Params: {} 2023-12-15T23:09:40.574 DEBUG:boto:Token: None 2023-12-15T23:09:40.574 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7U+xSu1LQqMquZqwTgF+244Btx4= 2023-12-15T23:09:40.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7U+xSu1LQqMquZqwTgF+244Btx4=', 'Content-Length': '0'} 2023-12-15T23:09:40.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000126de90f12085fe3-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:40.576 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.576 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.577 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.577 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.577 DEBUG:boto:Method: GET 2023-12-15T23:09:40.577 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.577 DEBUG:boto:Data: 2023-12-15T23:09:40.577 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.577 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.577 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.577 DEBUG:boto:Params: {} 2023-12-15T23:09:40.578 DEBUG:boto:Token: None 2023-12-15T23:09:40.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI= 2023-12-15T23:09:40.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI=', 'Content-Length': '0'} 2023-12-15T23:09:40.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045175e466e00a158-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.581 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.581 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.581 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.581 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:40.581 DEBUG:boto:Method: GET 2023-12-15T23:09:40.581 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.581 DEBUG:boto:Data: 2023-12-15T23:09:40.581 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.581 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.582 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.582 DEBUG:boto:Params: {} 2023-12-15T23:09:40.582 DEBUG:boto:Token: None 2023-12-15T23:09:40.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:40.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI= 2023-12-15T23:09:40.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:omd8z9abyMVSLaf6Mkd73DdVugI=', 'Content-Length': '0'} 2023-12-15T23:09:40.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9a9837049450997-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.585 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.585 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.585 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.585 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.585 DEBUG:boto:Method: GET 2023-12-15T23:09:40.585 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:40.585 DEBUG:boto:Data: 2023-12-15T23:09:40.585 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.585 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.585 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.586 DEBUG:boto:Params: {} 2023-12-15T23:09:40.586 DEBUG:boto:Token: None 2023-12-15T23:09:40.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068fede5ac5764999-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.588 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.589 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.589 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.589 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.589 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.589 DEBUG:boto:Method: GET 2023-12-15T23:09:40.589 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:40.590 DEBUG:boto:Data: 2023-12-15T23:09:40.590 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.590 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.590 DEBUG:boto:Params: {} 2023-12-15T23:09:40.590 DEBUG:boto:Token: None 2023-12-15T23:09:40.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.592 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000382e791505657bfe-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.592 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.593 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.593 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.593 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.593 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:40.593 DEBUG:boto:Data: 2023-12-15T23:09:40.593 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.593 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.594 DEBUG:boto:Params: {} 2023-12-15T23:09:40.594 DEBUG:boto:Token: None 2023-12-15T23:09:40.594 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a 2023-12-15T23:09:40.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b44qgTZ7LV+Hb2m9Z0wBVX6m5tc= 2023-12-15T23:09:40.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b44qgTZ7LV+Hb2m9Z0wBVX6m5tc=', 'Content-Length': '0'} 2023-12-15T23:09:40.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000633c69631965cda6-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.597 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.597 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.597 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.597 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:40.597 DEBUG:boto:Data: 2023-12-15T23:09:40.597 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.597 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.597 DEBUG:boto:Params: {} 2023-12-15T23:09:40.598 DEBUG:boto:Token: None 2023-12-15T23:09:40.598 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a 2023-12-15T23:09:40.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b44qgTZ7LV+Hb2m9Z0wBVX6m5tc= 2023-12-15T23:09:40.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b44qgTZ7LV+Hb2m9Z0wBVX6m5tc=', 'Content-Length': '0'} 2023-12-15T23:09:40.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d7589e089880bd9-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:40.600 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.600 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.601 DEBUG:boto:Method: GET 2023-12-15T23:09:40.601 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:40.601 DEBUG:boto:Data: 2023-12-15T23:09:40.601 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.601 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.601 DEBUG:boto:Params: {} 2023-12-15T23:09:40.601 DEBUG:boto:Token: None 2023-12-15T23:09:40.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a 2023-12-15T23:09:40.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWeaKwnKTpN+J2Z+gz2dtk9MBHc= 2023-12-15T23:09:40.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWeaKwnKTpN+J2Z+gz2dtk9MBHc=', 'Content-Length': '0'} 2023-12-15T23:09:40.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000520a9f44a693720c-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.645 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:40.646 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:40.646 DEBUG:boto:Method: GET 2023-12-15T23:09:40.646 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:40.646 DEBUG:boto:Data: 2023-12-15T23:09:40.646 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.646 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.646 DEBUG:boto:Params: {} 2023-12-15T23:09:40.646 DEBUG:boto:Token: None 2023-12-15T23:09:40.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/a 2023-12-15T23:09:40.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWeaKwnKTpN+J2Z+gz2dtk9MBHc= 2023-12-15T23:09:40.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWeaKwnKTpN+J2Z+gz2dtk9MBHc=', 'Content-Length': '0'} 2023-12-15T23:09:40.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d214d92c652bf457-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.649 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.649 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.649 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.650 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.650 DEBUG:boto:Method: GET 2023-12-15T23:09:40.650 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:40.650 DEBUG:boto:Data: 2023-12-15T23:09:40.650 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.650 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.650 DEBUG:boto:Params: {} 2023-12-15T23:09:40.650 DEBUG:boto:Token: None 2023-12-15T23:09:40.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ac777f4b00d2411-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.697 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.698 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.698 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.698 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.698 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:40.698 DEBUG:boto:Method: GET 2023-12-15T23:09:40.698 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:40.698 DEBUG:boto:Data: 2023-12-15T23:09:40.698 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.699 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.699 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.699 DEBUG:boto:Params: {} 2023-12-15T23:09:40.699 DEBUG:boto:Token: None 2023-12-15T23:09:40.699 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8328cfa9cc4c0a1-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.701 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.701 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:40.702 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.702 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.702 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.702 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.702 DEBUG:boto:Method: GET 2023-12-15T23:09:40.702 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.702 DEBUG:boto:Data: 2023-12-15T23:09:40.702 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.703 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.703 DEBUG:boto:Params: {} 2023-12-15T23:09:40.703 DEBUG:boto:Token: None 2023-12-15T23:09:40.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE= 2023-12-15T23:09:40.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE=', 'Content-Length': '0'} 2023-12-15T23:09:40.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083712dcee92a3b8e-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.749 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.750 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.750 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.750 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.750 DEBUG:boto:Method: GET 2023-12-15T23:09:40.750 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.750 DEBUG:boto:Data: 2023-12-15T23:09:40.750 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.750 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.750 DEBUG:boto:Params: {} 2023-12-15T23:09:40.751 DEBUG:boto:Token: None 2023-12-15T23:09:40.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE= 2023-12-15T23:09:40.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE=', 'Content-Length': '0'} 2023-12-15T23:09:40.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7aecf1d4c8764c0-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.753 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.753 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.753 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.754 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.754 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.754 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.754 DEBUG:boto:Data: 2023-12-15T23:09:40.754 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.754 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.754 DEBUG:boto:Params: {} 2023-12-15T23:09:40.754 DEBUG:boto:Token: None 2023-12-15T23:09:40.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lMAcCQMFHkZrurSbAMULy30SGxk= 2023-12-15T23:09:40.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lMAcCQMFHkZrurSbAMULy30SGxk=', 'Content-Length': '0'} 2023-12-15T23:09:40.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d64c1f80662348f2-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.757 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.757 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.757 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.757 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.758 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.758 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.758 DEBUG:boto:Data: 2023-12-15T23:09:40.758 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.758 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.758 DEBUG:boto:Params: {} 2023-12-15T23:09:40.758 DEBUG:boto:Token: None 2023-12-15T23:09:40.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lMAcCQMFHkZrurSbAMULy30SGxk= 2023-12-15T23:09:40.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lMAcCQMFHkZrurSbAMULy30SGxk=', 'Content-Length': '0'} 2023-12-15T23:09:40.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8afde0c417a1447-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:40.761 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.761 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.761 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.762 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.762 DEBUG:boto:Method: GET 2023-12-15T23:09:40.762 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.762 DEBUG:boto:Data: 2023-12-15T23:09:40.762 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.762 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.762 DEBUG:boto:Params: {} 2023-12-15T23:09:40.762 DEBUG:boto:Token: None 2023-12-15T23:09:40.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE= 2023-12-15T23:09:40.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE=', 'Content-Length': '0'} 2023-12-15T23:09:40.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069f6121c8c6786ab-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.805 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.806 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.806 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.806 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:40.806 DEBUG:boto:Method: GET 2023-12-15T23:09:40.806 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.806 DEBUG:boto:Data: 2023-12-15T23:09:40.807 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.807 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.807 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.807 DEBUG:boto:Params: {} 2023-12-15T23:09:40.807 DEBUG:boto:Token: None 2023-12-15T23:09:40.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:40.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE= 2023-12-15T23:09:40.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YaYKHZJlukUTCxyzpcLjIFwgqiE=', 'Content-Length': '0'} 2023-12-15T23:09:40.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066f60ec52cb0c5cc-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.810 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.810 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.810 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.810 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.810 DEBUG:boto:Method: GET 2023-12-15T23:09:40.810 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:40.810 DEBUG:boto:Data: 2023-12-15T23:09:40.811 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.811 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.811 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.811 DEBUG:boto:Params: {} 2023-12-15T23:09:40.811 DEBUG:boto:Token: None 2023-12-15T23:09:40.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007491d89ad401ad9e-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.857 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.858 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.858 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.858 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.858 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.858 DEBUG:boto:Method: GET 2023-12-15T23:09:40.858 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:40.858 DEBUG:boto:Data: 2023-12-15T23:09:40.859 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.859 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.859 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.859 DEBUG:boto:Params: {} 2023-12-15T23:09:40.859 DEBUG:boto:Token: None 2023-12-15T23:09:40.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e833ffd5bb08ee8-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.861 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.862 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.862 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.862 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.862 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:40.862 DEBUG:boto:Data: 2023-12-15T23:09:40.862 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.862 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.862 DEBUG:boto:Params: {} 2023-12-15T23:09:40.862 DEBUG:boto:Token: None 2023-12-15T23:09:40.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b 2023-12-15T23:09:40.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+m3DLnKmVb8AH03FfOaRkBt9To= 2023-12-15T23:09:40.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+m3DLnKmVb8AH03FfOaRkBt9To=', 'Content-Length': '0'} 2023-12-15T23:09:40.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032f34ecf3ba9ae0a-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.865 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.865 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.865 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.865 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:40.865 DEBUG:boto:Data: 2023-12-15T23:09:40.865 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.866 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.866 DEBUG:boto:Params: {} 2023-12-15T23:09:40.866 DEBUG:boto:Token: None 2023-12-15T23:09:40.866 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b 2023-12-15T23:09:40.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+m3DLnKmVb8AH03FfOaRkBt9To= 2023-12-15T23:09:40.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+m3DLnKmVb8AH03FfOaRkBt9To=', 'Content-Length': '0'} 2023-12-15T23:09:40.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034ca2871b522c066-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.868 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:40.868 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.868 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.869 DEBUG:boto:Method: GET 2023-12-15T23:09:40.869 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:40.869 DEBUG:boto:Data: 2023-12-15T23:09:40.869 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.869 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.869 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.869 DEBUG:boto:Params: {} 2023-12-15T23:09:40.869 DEBUG:boto:Token: None 2023-12-15T23:09:40.869 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b 2023-12-15T23:09:40.869 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fZ+g3ZVDgmFIAIhXqQpAOnP2tqY= 2023-12-15T23:09:40.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fZ+g3ZVDgmFIAIhXqQpAOnP2tqY=', 'Content-Length': '0'} 2023-12-15T23:09:40.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000403b864886ed32f0-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.914 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:40.914 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:40.914 DEBUG:boto:Method: GET 2023-12-15T23:09:40.914 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:40.914 DEBUG:boto:Data: 2023-12-15T23:09:40.914 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.914 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.915 DEBUG:boto:Params: {} 2023-12-15T23:09:40.915 DEBUG:boto:Token: None 2023-12-15T23:09:40.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/b 2023-12-15T23:09:40.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fZ+g3ZVDgmFIAIhXqQpAOnP2tqY= 2023-12-15T23:09:40.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fZ+g3ZVDgmFIAIhXqQpAOnP2tqY=', 'Content-Length': '0'} 2023-12-15T23:09:40.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1d6cb66322fb745-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.917 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.918 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.918 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.918 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.918 DEBUG:boto:Method: GET 2023-12-15T23:09:40.918 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:40.918 DEBUG:boto:Data: 2023-12-15T23:09:40.918 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.918 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.918 DEBUG:boto:Params: {} 2023-12-15T23:09:40.919 DEBUG:boto:Token: None 2023-12-15T23:09:40.919 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb77ce041f10fa59-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.921 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.922 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:40.922 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:40.922 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.922 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:40.922 DEBUG:boto:Method: GET 2023-12-15T23:09:40.922 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:40.922 DEBUG:boto:Data: 2023-12-15T23:09:40.922 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.922 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.923 DEBUG:boto:Params: {} 2023-12-15T23:09:40.923 DEBUG:boto:Token: None 2023-12-15T23:09:40.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/ 2023-12-15T23:09:40.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg= 2023-12-15T23:09:40.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ajqd4qIV7bIc64d6vDrQmaePdDg=', 'Content-Length': '0'} 2023-12-15T23:09:40.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b474be3ee71c0180-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.925 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:40.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:40.926 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:40.926 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:40.926 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.926 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.926 DEBUG:boto:Method: GET 2023-12-15T23:09:40.926 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.926 DEBUG:boto:Data: 2023-12-15T23:09:40.927 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.927 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.927 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.927 DEBUG:boto:Params: {} 2023-12-15T23:09:40.927 DEBUG:boto:Token: None 2023-12-15T23:09:40.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU= 2023-12-15T23:09:40.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU=', 'Content-Length': '0'} 2023-12-15T23:09:40.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053f85af35c56419d-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.969 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:40.970 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:40.970 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.970 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.970 DEBUG:boto:Method: GET 2023-12-15T23:09:40.970 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.970 DEBUG:boto:Data: 2023-12-15T23:09:40.970 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.970 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.970 DEBUG:boto:Params: {} 2023-12-15T23:09:40.971 DEBUG:boto:Token: None 2023-12-15T23:09:40.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU= 2023-12-15T23:09:40.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU=', 'Content-Length': '0'} 2023-12-15T23:09:40.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030aa3805abdfb74d-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.973 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:40.973 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:40.974 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.974 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.974 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.974 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.974 DEBUG:boto:Data: 2023-12-15T23:09:40.974 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.974 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.974 DEBUG:boto:Params: {} 2023-12-15T23:09:40.974 DEBUG:boto:Token: None 2023-12-15T23:09:40.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IdO7PhvY/3MVdM17JGGKVuAbUYk= 2023-12-15T23:09:40.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IdO7PhvY/3MVdM17JGGKVuAbUYk=', 'Content-Length': '0'} 2023-12-15T23:09:40.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028fcf1e448e6453e-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.977 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:40.977 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:40.977 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.977 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.977 DEBUG:boto:Method: HEAD 2023-12-15T23:09:40.977 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.977 DEBUG:boto:Data: 2023-12-15T23:09:40.977 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:40.978 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.978 DEBUG:boto:Params: {} 2023-12-15T23:09:40.978 DEBUG:boto:Token: None 2023-12-15T23:09:40.978 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IdO7PhvY/3MVdM17JGGKVuAbUYk= 2023-12-15T23:09:40.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IdO7PhvY/3MVdM17JGGKVuAbUYk=', 'Content-Length': '0'} 2023-12-15T23:09:40.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c22fa24c81f0545-00657cdcb4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:40.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:40.981 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:40.981 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:40.981 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.981 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:40.981 DEBUG:boto:Method: GET 2023-12-15T23:09:40.981 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.981 DEBUG:boto:Data: 2023-12-15T23:09:40.981 DEBUG:boto:Headers: {} 2023-12-15T23:09:40.981 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:40.981 DEBUG:boto:Port: 8000 2023-12-15T23:09:40.981 DEBUG:boto:Params: {} 2023-12-15T23:09:40.982 DEBUG:boto:Token: None 2023-12-15T23:09:40.982 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:40 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:40.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU= 2023-12-15T23:09:40.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzVC/qBnMSpNuMz9zVEHNw0HHXU=', 'Content-Length': '0'} 2023-12-15T23:09:40.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000675d53192281827e-00657cdcb4-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.025 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:41.026 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:41.026 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:41.026 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:41.026 DEBUG:boto:Method: GET 2023-12-15T23:09:41.026 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:41.026 DEBUG:boto:Data: 2023-12-15T23:09:41.026 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.026 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.026 DEBUG:boto:Params: {} 2023-12-15T23:09:41.027 DEBUG:boto:Token: None 2023-12-15T23:09:41.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:41.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OOXGkM7836YJDgQGYm35noGPdgk= 2023-12-15T23:09:41.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OOXGkM7836YJDgQGYm35noGPdgk=', 'Content-Length': '0'} 2023-12-15T23:09:41.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f16c919757e66611-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.029 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.029 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.029 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.030 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.030 DEBUG:boto:Method: GET 2023-12-15T23:09:41.030 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:41.030 DEBUG:boto:Data: 2023-12-15T23:09:41.030 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.030 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.030 DEBUG:boto:Params: {} 2023-12-15T23:09:41.030 DEBUG:boto:Token: None 2023-12-15T23:09:41.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048db2dbe37c4c43f-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.033 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.033 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.034 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.034 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.034 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.034 DEBUG:boto:Method: GET 2023-12-15T23:09:41.034 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:41.034 DEBUG:boto:Data: 2023-12-15T23:09:41.034 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.035 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.035 DEBUG:boto:Params: {} 2023-12-15T23:09:41.035 DEBUG:boto:Token: None 2023-12-15T23:09:41.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7895c8d3814a763-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.037 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.038 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:41.038 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:41.038 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.038 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:41.038 DEBUG:boto:Data: 2023-12-15T23:09:41.038 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.038 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.038 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.039 DEBUG:boto:Params: {} 2023-12-15T23:09:41.039 DEBUG:boto:Token: None 2023-12-15T23:09:41.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/c 2023-12-15T23:09:41.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MEqGuZvm0N60piJjtydPBoS7nfk= 2023-12-15T23:09:41.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MEqGuZvm0N60piJjtydPBoS7nfk=', 'Content-Length': '0'} 2023-12-15T23:09:41.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d289df1a6908759b-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.041 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:41.041 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:41.041 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.041 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:41.042 DEBUG:boto:Data: 2023-12-15T23:09:41.042 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.042 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.042 DEBUG:boto:Params: {} 2023-12-15T23:09:41.042 DEBUG:boto:Token: None 2023-12-15T23:09:41.042 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/c 2023-12-15T23:09:41.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MEqGuZvm0N60piJjtydPBoS7nfk= 2023-12-15T23:09:41.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MEqGuZvm0N60piJjtydPBoS7nfk=', 'Content-Length': '0'} 2023-12-15T23:09:41.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077c4ee97e5068308-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:41.044 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:41.045 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:41.045 DEBUG:boto:Method: GET 2023-12-15T23:09:41.045 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:41.045 DEBUG:boto:Data: 2023-12-15T23:09:41.045 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.045 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.045 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.045 DEBUG:boto:Params: {} 2023-12-15T23:09:41.045 DEBUG:boto:Token: None 2023-12-15T23:09:41.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/c 2023-12-15T23:09:41.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5sTDj0JPrNrUcBrXEEoCzfQFpJI= 2023-12-15T23:09:41.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5sTDj0JPrNrUcBrXEEoCzfQFpJI=', 'Content-Length': '0'} 2023-12-15T23:09:41.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6ef8bd895d192a0-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.089 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:41.090 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:41.090 DEBUG:boto:Method: GET 2023-12-15T23:09:41.090 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:41.090 DEBUG:boto:Data: 2023-12-15T23:09:41.090 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.090 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.090 DEBUG:boto:Params: {} 2023-12-15T23:09:41.090 DEBUG:boto:Token: None 2023-12-15T23:09:41.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/c 2023-12-15T23:09:41.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5sTDj0JPrNrUcBrXEEoCzfQFpJI= 2023-12-15T23:09:41.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5sTDj0JPrNrUcBrXEEoCzfQFpJI=', 'Content-Length': '0'} 2023-12-15T23:09:41.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d68f5ffd63ad478-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.093 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.093 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.093 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.093 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.093 DEBUG:boto:Method: GET 2023-12-15T23:09:41.093 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:41.094 DEBUG:boto:Data: 2023-12-15T23:09:41.094 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.094 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.094 DEBUG:boto:Params: {} 2023-12-15T23:09:41.094 DEBUG:boto:Token: None 2023-12-15T23:09:41.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046d2e7f3e5aa37c6-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.097 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.097 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.097 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.097 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.097 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:41.097 DEBUG:boto:Method: GET 2023-12-15T23:09:41.097 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:41.097 DEBUG:boto:Data: 2023-12-15T23:09:41.098 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.098 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.098 DEBUG:boto:Params: {} 2023-12-15T23:09:41.098 DEBUG:boto:Token: None 2023-12-15T23:09:41.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1d6b1b0c4ffb3c5-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.100 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:41.101 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.101 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.101 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.101 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.101 DEBUG:boto:Method: GET 2023-12-15T23:09:41.101 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.101 DEBUG:boto:Data: 2023-12-15T23:09:41.101 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.102 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.102 DEBUG:boto:Params: {} 2023-12-15T23:09:41.102 DEBUG:boto:Token: None 2023-12-15T23:09:41.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI= 2023-12-15T23:09:41.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI=', 'Content-Length': '0'} 2023-12-15T23:09:41.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e6c0836336eb485-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.145 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.146 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.146 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.146 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.146 DEBUG:boto:Method: GET 2023-12-15T23:09:41.146 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.146 DEBUG:boto:Data: 2023-12-15T23:09:41.146 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.146 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.146 DEBUG:boto:Params: {} 2023-12-15T23:09:41.146 DEBUG:boto:Token: None 2023-12-15T23:09:41.147 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI= 2023-12-15T23:09:41.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI=', 'Content-Length': '0'} 2023-12-15T23:09:41.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e36ee8d37f37430f-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.149 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.149 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.149 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.149 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.149 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.150 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.150 DEBUG:boto:Data: 2023-12-15T23:09:41.150 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.150 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.150 DEBUG:boto:Params: {} 2023-12-15T23:09:41.150 DEBUG:boto:Token: None 2023-12-15T23:09:41.150 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W5tfrtIQgEQoOzh7u0FpU5IIYDA= 2023-12-15T23:09:41.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W5tfrtIQgEQoOzh7u0FpU5IIYDA=', 'Content-Length': '0'} 2023-12-15T23:09:41.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d97bcd7d37fd080-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.152 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.152 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.152 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.153 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.153 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.153 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.153 DEBUG:boto:Data: 2023-12-15T23:09:41.153 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.153 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.153 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.153 DEBUG:boto:Params: {} 2023-12-15T23:09:41.153 DEBUG:boto:Token: None 2023-12-15T23:09:41.154 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W5tfrtIQgEQoOzh7u0FpU5IIYDA= 2023-12-15T23:09:41.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W5tfrtIQgEQoOzh7u0FpU5IIYDA=', 'Content-Length': '0'} 2023-12-15T23:09:41.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f47734032a165ec2-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:41.156 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.156 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.156 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.156 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.156 DEBUG:boto:Method: GET 2023-12-15T23:09:41.157 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.157 DEBUG:boto:Data: 2023-12-15T23:09:41.157 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.157 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.157 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.157 DEBUG:boto:Params: {} 2023-12-15T23:09:41.157 DEBUG:boto:Token: None 2023-12-15T23:09:41.157 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.157 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI= 2023-12-15T23:09:41.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI=', 'Content-Length': '0'} 2023-12-15T23:09:41.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000161407dc21d031e3-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.205 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.206 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.206 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.206 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:41.206 DEBUG:boto:Method: GET 2023-12-15T23:09:41.206 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.206 DEBUG:boto:Data: 2023-12-15T23:09:41.206 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.206 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.206 DEBUG:boto:Params: {} 2023-12-15T23:09:41.207 DEBUG:boto:Token: None 2023-12-15T23:09:41.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:41.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI= 2023-12-15T23:09:41.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OYUooFhyjSYwvtDsu9clLjFKufI=', 'Content-Length': '0'} 2023-12-15T23:09:41.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096cb404918a85651-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.209 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.209 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.209 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.209 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.209 DEBUG:boto:Method: GET 2023-12-15T23:09:41.209 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:41.209 DEBUG:boto:Data: 2023-12-15T23:09:41.210 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.210 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.210 DEBUG:boto:Params: {} 2023-12-15T23:09:41.210 DEBUG:boto:Token: None 2023-12-15T23:09:41.210 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ea49e117879fcd2-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.213 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.213 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.213 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.213 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.213 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.213 DEBUG:boto:Method: GET 2023-12-15T23:09:41.214 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:41.214 DEBUG:boto:Data: 2023-12-15T23:09:41.214 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.214 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.214 DEBUG:boto:Params: {} 2023-12-15T23:09:41.214 DEBUG:boto:Token: None 2023-12-15T23:09:41.214 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a7ec65c28282012-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.216 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.217 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.217 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.217 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.217 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:41.217 DEBUG:boto:Data: 2023-12-15T23:09:41.217 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.217 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.217 DEBUG:boto:Params: {} 2023-12-15T23:09:41.218 DEBUG:boto:Token: None 2023-12-15T23:09:41.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d 2023-12-15T23:09:41.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ot3LVH7jcw9cX54AbU9VEc+5oRA= 2023-12-15T23:09:41.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ot3LVH7jcw9cX54AbU9VEc+5oRA=', 'Content-Length': '0'} 2023-12-15T23:09:41.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a79ebe952f6c0f31-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.220 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.220 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.220 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.220 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:41.220 DEBUG:boto:Data: 2023-12-15T23:09:41.220 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.220 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.221 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.221 DEBUG:boto:Params: {} 2023-12-15T23:09:41.221 DEBUG:boto:Token: None 2023-12-15T23:09:41.221 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d 2023-12-15T23:09:41.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ot3LVH7jcw9cX54AbU9VEc+5oRA= 2023-12-15T23:09:41.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ot3LVH7jcw9cX54AbU9VEc+5oRA=', 'Content-Length': '0'} 2023-12-15T23:09:41.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe122e743f0ae1ec-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.223 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:41.223 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.223 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.223 DEBUG:boto:Method: GET 2023-12-15T23:09:41.223 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:41.224 DEBUG:boto:Data: 2023-12-15T23:09:41.224 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.224 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.224 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.224 DEBUG:boto:Params: {} 2023-12-15T23:09:41.224 DEBUG:boto:Token: None 2023-12-15T23:09:41.224 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d 2023-12-15T23:09:41.224 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ENV4H6SwPoui2i84SlyGKKTQiY8= 2023-12-15T23:09:41.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ENV4H6SwPoui2i84SlyGKKTQiY8=', 'Content-Length': '0'} 2023-12-15T23:09:41.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008b279fcd803c30e-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.273 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:41.274 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:41.274 DEBUG:boto:Method: GET 2023-12-15T23:09:41.274 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:41.274 DEBUG:boto:Data: 2023-12-15T23:09:41.274 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.274 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.274 DEBUG:boto:Params: {} 2023-12-15T23:09:41.274 DEBUG:boto:Token: None 2023-12-15T23:09:41.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/d 2023-12-15T23:09:41.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ENV4H6SwPoui2i84SlyGKKTQiY8= 2023-12-15T23:09:41.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ENV4H6SwPoui2i84SlyGKKTQiY8=', 'Content-Length': '0'} 2023-12-15T23:09:41.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002baff7142c4d57e3-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.277 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.277 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.277 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.277 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.277 DEBUG:boto:Method: GET 2023-12-15T23:09:41.277 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:41.277 DEBUG:boto:Data: 2023-12-15T23:09:41.277 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.277 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.278 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.278 DEBUG:boto:Params: {} 2023-12-15T23:09:41.278 DEBUG:boto:Token: None 2023-12-15T23:09:41.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000927b0ccdcf217f57-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.281 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.281 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.281 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.281 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.281 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:41.281 DEBUG:boto:Method: GET 2023-12-15T23:09:41.281 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:41.282 DEBUG:boto:Data: 2023-12-15T23:09:41.282 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.282 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.282 DEBUG:boto:Params: {} 2023-12-15T23:09:41.282 DEBUG:boto:Token: None 2023-12-15T23:09:41.282 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bf2b572e7040336-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.284 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:41.285 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.285 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.285 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.285 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.285 DEBUG:boto:Method: GET 2023-12-15T23:09:41.285 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.285 DEBUG:boto:Data: 2023-12-15T23:09:41.286 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.286 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.286 DEBUG:boto:Params: {} 2023-12-15T23:09:41.286 DEBUG:boto:Token: None 2023-12-15T23:09:41.286 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo= 2023-12-15T23:09:41.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo=', 'Content-Length': '0'} 2023-12-15T23:09:41.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a24798330b96cb63-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.329 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.330 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.330 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.330 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.330 DEBUG:boto:Method: GET 2023-12-15T23:09:41.330 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.330 DEBUG:boto:Data: 2023-12-15T23:09:41.330 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.330 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.330 DEBUG:boto:Params: {} 2023-12-15T23:09:41.330 DEBUG:boto:Token: None 2023-12-15T23:09:41.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo= 2023-12-15T23:09:41.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo=', 'Content-Length': '0'} 2023-12-15T23:09:41.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3fda6d833b577d6-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.333 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.333 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.333 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.333 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.333 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.333 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.333 DEBUG:boto:Data: 2023-12-15T23:09:41.333 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.334 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.334 DEBUG:boto:Params: {} 2023-12-15T23:09:41.334 DEBUG:boto:Token: None 2023-12-15T23:09:41.334 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FRkySrX0GQBSHOMer1D4GUS65jM= 2023-12-15T23:09:41.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FRkySrX0GQBSHOMer1D4GUS65jM=', 'Content-Length': '0'} 2023-12-15T23:09:41.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b866ff2d025c9458-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.336 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.337 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.337 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.337 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.337 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.337 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.337 DEBUG:boto:Data: 2023-12-15T23:09:41.337 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.337 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.337 DEBUG:boto:Params: {} 2023-12-15T23:09:41.338 DEBUG:boto:Token: None 2023-12-15T23:09:41.338 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FRkySrX0GQBSHOMer1D4GUS65jM= 2023-12-15T23:09:41.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FRkySrX0GQBSHOMer1D4GUS65jM=', 'Content-Length': '0'} 2023-12-15T23:09:41.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099351767f45564c1-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:41.340 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.340 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.340 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.341 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.341 DEBUG:boto:Method: GET 2023-12-15T23:09:41.341 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.341 DEBUG:boto:Data: 2023-12-15T23:09:41.341 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.341 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.341 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.341 DEBUG:boto:Params: {} 2023-12-15T23:09:41.341 DEBUG:boto:Token: None 2023-12-15T23:09:41.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo= 2023-12-15T23:09:41.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo=', 'Content-Length': '0'} 2023-12-15T23:09:41.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ac5ddb31da66481-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.389 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.390 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.390 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.390 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:41.390 DEBUG:boto:Method: GET 2023-12-15T23:09:41.390 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.390 DEBUG:boto:Data: 2023-12-15T23:09:41.390 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.390 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.391 DEBUG:boto:Params: {} 2023-12-15T23:09:41.391 DEBUG:boto:Token: None 2023-12-15T23:09:41.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:41.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo= 2023-12-15T23:09:41.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f6n0wkIt0cFwHWr0lOuv/PfE2Zo=', 'Content-Length': '0'} 2023-12-15T23:09:41.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071e74da2c9989732-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.393 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.393 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.394 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.394 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.394 DEBUG:boto:Method: GET 2023-12-15T23:09:41.394 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:41.394 DEBUG:boto:Data: 2023-12-15T23:09:41.394 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.394 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.394 DEBUG:boto:Params: {} 2023-12-15T23:09:41.395 DEBUG:boto:Token: None 2023-12-15T23:09:41.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040c9fc64968bab9a-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.397 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.398 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.398 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.398 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.398 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.398 DEBUG:boto:Method: GET 2023-12-15T23:09:41.398 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:41.398 DEBUG:boto:Data: 2023-12-15T23:09:41.398 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.399 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.399 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.399 DEBUG:boto:Params: {} 2023-12-15T23:09:41.399 DEBUG:boto:Token: None 2023-12-15T23:09:41.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8fb21dcdaee59c1-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.402 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.402 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.402 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.402 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.402 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:41.403 DEBUG:boto:Data: 2023-12-15T23:09:41.403 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.403 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.403 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.403 DEBUG:boto:Params: {} 2023-12-15T23:09:41.403 DEBUG:boto:Token: None 2023-12-15T23:09:41.403 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e 2023-12-15T23:09:41.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6r/hXdaGJPz0vPmJqHrNtFar9/Y= 2023-12-15T23:09:41.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6r/hXdaGJPz0vPmJqHrNtFar9/Y=', 'Content-Length': '0'} 2023-12-15T23:09:41.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043123958369de6d4-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.406 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.406 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.406 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.406 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:41.406 DEBUG:boto:Data: 2023-12-15T23:09:41.406 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.406 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.406 DEBUG:boto:Params: {} 2023-12-15T23:09:41.406 DEBUG:boto:Token: None 2023-12-15T23:09:41.407 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e 2023-12-15T23:09:41.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6r/hXdaGJPz0vPmJqHrNtFar9/Y= 2023-12-15T23:09:41.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6r/hXdaGJPz0vPmJqHrNtFar9/Y=', 'Content-Length': '0'} 2023-12-15T23:09:41.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034d541fa6668fb66-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:41.409 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.409 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.410 DEBUG:boto:Method: GET 2023-12-15T23:09:41.410 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:41.410 DEBUG:boto:Data: 2023-12-15T23:09:41.410 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.410 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.410 DEBUG:boto:Params: {} 2023-12-15T23:09:41.410 DEBUG:boto:Token: None 2023-12-15T23:09:41.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e 2023-12-15T23:09:41.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XPfcXaJgQwOx/znnYWmbGqJmJI4= 2023-12-15T23:09:41.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XPfcXaJgQwOx/znnYWmbGqJmJI4=', 'Content-Length': '0'} 2023-12-15T23:09:41.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019aadb8d59bd3b61-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.453 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:41.454 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:41.454 DEBUG:boto:Method: GET 2023-12-15T23:09:41.454 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:41.454 DEBUG:boto:Data: 2023-12-15T23:09:41.454 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.454 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.454 DEBUG:boto:Params: {} 2023-12-15T23:09:41.454 DEBUG:boto:Token: None 2023-12-15T23:09:41.454 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/e 2023-12-15T23:09:41.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XPfcXaJgQwOx/znnYWmbGqJmJI4= 2023-12-15T23:09:41.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XPfcXaJgQwOx/znnYWmbGqJmJI4=', 'Content-Length': '0'} 2023-12-15T23:09:41.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f72524e6f2a2af6a-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.457 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.457 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.457 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.457 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.457 DEBUG:boto:Method: GET 2023-12-15T23:09:41.457 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:41.457 DEBUG:boto:Data: 2023-12-15T23:09:41.457 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.457 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.457 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.458 DEBUG:boto:Params: {} 2023-12-15T23:09:41.458 DEBUG:boto:Token: None 2023-12-15T23:09:41.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6fe13fc29af6981-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.501 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.502 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.502 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.502 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.502 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:41.502 DEBUG:boto:Method: GET 2023-12-15T23:09:41.502 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:41.502 DEBUG:boto:Data: 2023-12-15T23:09:41.502 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.503 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.503 DEBUG:boto:Params: {} 2023-12-15T23:09:41.503 DEBUG:boto:Token: None 2023-12-15T23:09:41.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000333f41f02f0b2e5-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.505 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:41.506 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.506 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.506 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.506 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.506 DEBUG:boto:Method: GET 2023-12-15T23:09:41.506 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.506 DEBUG:boto:Data: 2023-12-15T23:09:41.506 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.506 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.506 DEBUG:boto:Params: {} 2023-12-15T23:09:41.507 DEBUG:boto:Token: None 2023-12-15T23:09:41.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk= 2023-12-15T23:09:41.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk=', 'Content-Length': '0'} 2023-12-15T23:09:41.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007045dc45b3eaf7fe-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.549 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.549 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.550 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.550 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.550 DEBUG:boto:Method: GET 2023-12-15T23:09:41.550 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.550 DEBUG:boto:Data: 2023-12-15T23:09:41.550 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.550 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.550 DEBUG:boto:Params: {} 2023-12-15T23:09:41.551 DEBUG:boto:Token: None 2023-12-15T23:09:41.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk= 2023-12-15T23:09:41.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk=', 'Content-Length': '0'} 2023-12-15T23:09:41.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dccfd5802e7b0d7-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.553 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.553 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.553 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.553 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.553 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.553 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.554 DEBUG:boto:Data: 2023-12-15T23:09:41.554 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.554 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.554 DEBUG:boto:Params: {} 2023-12-15T23:09:41.554 DEBUG:boto:Token: None 2023-12-15T23:09:41.554 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/xjbBu2Q4tYI9B0RHuKdTdT4v90= 2023-12-15T23:09:41.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/xjbBu2Q4tYI9B0RHuKdTdT4v90=', 'Content-Length': '0'} 2023-12-15T23:09:41.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004758f72da6350b6e-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.557 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.557 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.557 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.557 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.557 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.557 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.558 DEBUG:boto:Data: 2023-12-15T23:09:41.558 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.558 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.558 DEBUG:boto:Params: {} 2023-12-15T23:09:41.558 DEBUG:boto:Token: None 2023-12-15T23:09:41.558 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/xjbBu2Q4tYI9B0RHuKdTdT4v90= 2023-12-15T23:09:41.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/xjbBu2Q4tYI9B0RHuKdTdT4v90=', 'Content-Length': '0'} 2023-12-15T23:09:41.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aacdf1c64242f19f-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:41.560 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.561 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.561 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.561 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.561 DEBUG:boto:Method: GET 2023-12-15T23:09:41.561 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.561 DEBUG:boto:Data: 2023-12-15T23:09:41.562 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.562 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.562 DEBUG:boto:Params: {} 2023-12-15T23:09:41.562 DEBUG:boto:Token: None 2023-12-15T23:09:41.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk= 2023-12-15T23:09:41.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk=', 'Content-Length': '0'} 2023-12-15T23:09:41.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067c79eb225eaa825-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.605 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.606 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.606 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.606 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:41.606 DEBUG:boto:Method: GET 2023-12-15T23:09:41.606 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.606 DEBUG:boto:Data: 2023-12-15T23:09:41.606 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.606 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.606 DEBUG:boto:Params: {} 2023-12-15T23:09:41.607 DEBUG:boto:Token: None 2023-12-15T23:09:41.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:41.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk= 2023-12-15T23:09:41.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vWpTDAjCsJx076zCHf+L0/vB6jk=', 'Content-Length': '0'} 2023-12-15T23:09:41.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c007f77095ef6d7b-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.609 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.609 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.609 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.609 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.610 DEBUG:boto:Method: GET 2023-12-15T23:09:41.610 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:41.610 DEBUG:boto:Data: 2023-12-15T23:09:41.610 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.610 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.610 DEBUG:boto:Params: {} 2023-12-15T23:09:41.610 DEBUG:boto:Token: None 2023-12-15T23:09:41.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb0f5f57703e22db-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.657 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.658 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.658 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.658 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.658 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.658 DEBUG:boto:Method: GET 2023-12-15T23:09:41.658 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:41.659 DEBUG:boto:Data: 2023-12-15T23:09:41.659 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.659 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.659 DEBUG:boto:Params: {} 2023-12-15T23:09:41.659 DEBUG:boto:Token: None 2023-12-15T23:09:41.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe61660fdf6587b0-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.662 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.662 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.662 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.662 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.662 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:41.662 DEBUG:boto:Data: 2023-12-15T23:09:41.662 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.662 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.663 DEBUG:boto:Params: {} 2023-12-15T23:09:41.663 DEBUG:boto:Token: None 2023-12-15T23:09:41.663 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f 2023-12-15T23:09:41.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:feQmhviTdMhk4Y/Izapw6Z2mHMo= 2023-12-15T23:09:41.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:feQmhviTdMhk4Y/Izapw6Z2mHMo=', 'Content-Length': '0'} 2023-12-15T23:09:41.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef96d806f229ceea-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.665 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.665 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.665 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.665 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:41.666 DEBUG:boto:Data: 2023-12-15T23:09:41.666 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.666 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.666 DEBUG:boto:Params: {} 2023-12-15T23:09:41.666 DEBUG:boto:Token: None 2023-12-15T23:09:41.666 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f 2023-12-15T23:09:41.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:feQmhviTdMhk4Y/Izapw6Z2mHMo= 2023-12-15T23:09:41.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:feQmhviTdMhk4Y/Izapw6Z2mHMo=', 'Content-Length': '0'} 2023-12-15T23:09:41.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007deb5cb9d67dc52b-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:41.669 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.669 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.669 DEBUG:boto:Method: GET 2023-12-15T23:09:41.669 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:41.669 DEBUG:boto:Data: 2023-12-15T23:09:41.669 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.670 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.670 DEBUG:boto:Params: {} 2023-12-15T23:09:41.670 DEBUG:boto:Token: None 2023-12-15T23:09:41.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f 2023-12-15T23:09:41.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ql7jUPYHHtB+4GCLu8LMly/nbx0= 2023-12-15T23:09:41.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ql7jUPYHHtB+4GCLu8LMly/nbx0=', 'Content-Length': '0'} 2023-12-15T23:09:41.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008856fb93ebe40dd-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.717 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:41.718 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:41.718 DEBUG:boto:Method: GET 2023-12-15T23:09:41.718 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:41.718 DEBUG:boto:Data: 2023-12-15T23:09:41.718 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.718 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.718 DEBUG:boto:Params: {} 2023-12-15T23:09:41.719 DEBUG:boto:Token: None 2023-12-15T23:09:41.719 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/f 2023-12-15T23:09:41.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ql7jUPYHHtB+4GCLu8LMly/nbx0= 2023-12-15T23:09:41.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ql7jUPYHHtB+4GCLu8LMly/nbx0=', 'Content-Length': '0'} 2023-12-15T23:09:41.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e81b9e513a03bb9-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.722 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.722 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.722 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.722 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.722 DEBUG:boto:Method: GET 2023-12-15T23:09:41.722 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:41.722 DEBUG:boto:Data: 2023-12-15T23:09:41.722 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.722 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.723 DEBUG:boto:Params: {} 2023-12-15T23:09:41.723 DEBUG:boto:Token: None 2023-12-15T23:09:41.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034a8ac4608ea578b-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.726 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.726 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.726 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.726 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.726 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:41.726 DEBUG:boto:Method: GET 2023-12-15T23:09:41.727 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:41.727 DEBUG:boto:Data: 2023-12-15T23:09:41.727 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.727 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.727 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.727 DEBUG:boto:Params: {} 2023-12-15T23:09:41.728 DEBUG:boto:Token: None 2023-12-15T23:09:41.728 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.728 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0308a81a4eaff6f-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.730 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:41.731 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.731 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.731 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.731 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.731 DEBUG:boto:Method: GET 2023-12-15T23:09:41.731 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.731 DEBUG:boto:Data: 2023-12-15T23:09:41.731 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.731 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.731 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.732 DEBUG:boto:Params: {} 2023-12-15T23:09:41.732 DEBUG:boto:Token: None 2023-12-15T23:09:41.732 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.732 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE= 2023-12-15T23:09:41.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE=', 'Content-Length': '0'} 2023-12-15T23:09:41.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034c24c27ad2334fa-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.778 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.778 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.778 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.778 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.778 DEBUG:boto:Method: GET 2023-12-15T23:09:41.778 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.778 DEBUG:boto:Data: 2023-12-15T23:09:41.778 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.779 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.779 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.779 DEBUG:boto:Params: {} 2023-12-15T23:09:41.779 DEBUG:boto:Token: None 2023-12-15T23:09:41.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE= 2023-12-15T23:09:41.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE=', 'Content-Length': '0'} 2023-12-15T23:09:41.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000444dd0c01051e428-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.781 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.781 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.782 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.782 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.782 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.782 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.782 DEBUG:boto:Data: 2023-12-15T23:09:41.782 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.782 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.782 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.783 DEBUG:boto:Params: {} 2023-12-15T23:09:41.783 DEBUG:boto:Token: None 2023-12-15T23:09:41.783 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Lt6G5wEyTAtymYzu2SkEvF4g1Q= 2023-12-15T23:09:41.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Lt6G5wEyTAtymYzu2SkEvF4g1Q=', 'Content-Length': '0'} 2023-12-15T23:09:41.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034aed7aa32e7501f-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.785 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.785 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.785 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.785 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.785 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.785 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.786 DEBUG:boto:Data: 2023-12-15T23:09:41.786 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.786 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.786 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.786 DEBUG:boto:Params: {} 2023-12-15T23:09:41.786 DEBUG:boto:Token: None 2023-12-15T23:09:41.786 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0Lt6G5wEyTAtymYzu2SkEvF4g1Q= 2023-12-15T23:09:41.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0Lt6G5wEyTAtymYzu2SkEvF4g1Q=', 'Content-Length': '0'} 2023-12-15T23:09:41.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e782ae60cb11d81-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.789 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:41.789 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.789 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.789 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.789 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.789 DEBUG:boto:Method: GET 2023-12-15T23:09:41.789 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.790 DEBUG:boto:Data: 2023-12-15T23:09:41.790 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.790 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.790 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.790 DEBUG:boto:Params: {} 2023-12-15T23:09:41.790 DEBUG:boto:Token: None 2023-12-15T23:09:41.790 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE= 2023-12-15T23:09:41.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE=', 'Content-Length': '0'} 2023-12-15T23:09:41.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8df61ca3f9faedb-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.837 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.838 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.838 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.838 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:41.838 DEBUG:boto:Method: GET 2023-12-15T23:09:41.838 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.838 DEBUG:boto:Data: 2023-12-15T23:09:41.838 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.838 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.838 DEBUG:boto:Params: {} 2023-12-15T23:09:41.838 DEBUG:boto:Token: None 2023-12-15T23:09:41.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:41.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE= 2023-12-15T23:09:41.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p8VNyw1qstt2XGDB0/U+VGnSOE=', 'Content-Length': '0'} 2023-12-15T23:09:41.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfbfebb6431bebd7-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.841 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.841 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.841 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.841 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.841 DEBUG:boto:Method: GET 2023-12-15T23:09:41.841 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:41.842 DEBUG:boto:Data: 2023-12-15T23:09:41.842 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.842 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.842 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.842 DEBUG:boto:Params: {} 2023-12-15T23:09:41.842 DEBUG:boto:Token: None 2023-12-15T23:09:41.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012639afd491ada4a-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.845 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.845 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.845 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.845 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.845 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.845 DEBUG:boto:Method: GET 2023-12-15T23:09:41.846 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:41.846 DEBUG:boto:Data: 2023-12-15T23:09:41.846 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.846 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.846 DEBUG:boto:Params: {} 2023-12-15T23:09:41.846 DEBUG:boto:Token: None 2023-12-15T23:09:41.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000280135efaef3d20f-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.848 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.849 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.849 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.849 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.849 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:41.849 DEBUG:boto:Data: 2023-12-15T23:09:41.849 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.849 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.849 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.850 DEBUG:boto:Params: {} 2023-12-15T23:09:41.850 DEBUG:boto:Token: None 2023-12-15T23:09:41.850 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g 2023-12-15T23:09:41.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QRqEJQaB5O52FaJKg0zuTYbOPGo= 2023-12-15T23:09:41.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QRqEJQaB5O52FaJKg0zuTYbOPGo=', 'Content-Length': '0'} 2023-12-15T23:09:41.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000755d657b37ef48d4-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.852 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.852 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.852 DEBUG:boto:Method: HEAD 2023-12-15T23:09:41.852 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:41.852 DEBUG:boto:Data: 2023-12-15T23:09:41.853 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.853 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.853 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.853 DEBUG:boto:Params: {} 2023-12-15T23:09:41.853 DEBUG:boto:Token: None 2023-12-15T23:09:41.853 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g 2023-12-15T23:09:41.853 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QRqEJQaB5O52FaJKg0zuTYbOPGo= 2023-12-15T23:09:41.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QRqEJQaB5O52FaJKg0zuTYbOPGo=', 'Content-Length': '0'} 2023-12-15T23:09:41.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050e999606d0410fc-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:41.856 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.856 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.856 DEBUG:boto:Method: GET 2023-12-15T23:09:41.856 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:41.856 DEBUG:boto:Data: 2023-12-15T23:09:41.856 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.856 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.856 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.856 DEBUG:boto:Params: {} 2023-12-15T23:09:41.856 DEBUG:boto:Token: None 2023-12-15T23:09:41.856 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g 2023-12-15T23:09:41.857 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AIEMfwcAtsxdINHnTIDwuodqWis= 2023-12-15T23:09:41.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AIEMfwcAtsxdINHnTIDwuodqWis=', 'Content-Length': '0'} 2023-12-15T23:09:41.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1e69f9f505c3acf-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.901 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:41.902 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:41.902 DEBUG:boto:Method: GET 2023-12-15T23:09:41.902 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:41.902 DEBUG:boto:Data: 2023-12-15T23:09:41.902 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.902 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.902 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.902 DEBUG:boto:Params: {} 2023-12-15T23:09:41.902 DEBUG:boto:Token: None 2023-12-15T23:09:41.902 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/g 2023-12-15T23:09:41.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AIEMfwcAtsxdINHnTIDwuodqWis= 2023-12-15T23:09:41.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AIEMfwcAtsxdINHnTIDwuodqWis=', 'Content-Length': '0'} 2023-12-15T23:09:41.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006b8f55a1704428f-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.905 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.905 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.905 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.905 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.905 DEBUG:boto:Method: GET 2023-12-15T23:09:41.905 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:41.905 DEBUG:boto:Data: 2023-12-15T23:09:41.905 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.906 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.906 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.906 DEBUG:boto:Params: {} 2023-12-15T23:09:41.906 DEBUG:boto:Token: None 2023-12-15T23:09:41.906 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.908 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009744fd07076e1fba-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.953 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.954 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:41.954 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:41.954 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.954 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:41.954 DEBUG:boto:Method: GET 2023-12-15T23:09:41.954 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:41.954 DEBUG:boto:Data: 2023-12-15T23:09:41.955 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.955 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:41.955 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.955 DEBUG:boto:Params: {} 2023-12-15T23:09:41.955 DEBUG:boto:Token: None 2023-12-15T23:09:41.955 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/ 2023-12-15T23:09:41.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA= 2023-12-15T23:09:41.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkzfm76EeWVm4cGO3njBXN1LNbA=', 'Content-Length': '0'} 2023-12-15T23:09:41.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f07e073e0249bc9-00657cdcb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:41.958 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:41.958 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:41.958 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:41.958 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:41.958 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:41.958 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:41.959 DEBUG:boto:Method: GET 2023-12-15T23:09:41.959 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:41.959 DEBUG:boto:Data: 2023-12-15T23:09:41.959 DEBUG:boto:Headers: {} 2023-12-15T23:09:41.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:41.959 DEBUG:boto:Port: 8000 2023-12-15T23:09:41.959 DEBUG:boto:Params: {} 2023-12-15T23:09:41.959 DEBUG:boto:Token: None 2023-12-15T23:09:41.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:41 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:41.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PP0E4bVVPlUolR1nnZC6IeeTIRs= 2023-12-15T23:09:41.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:41 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PP0E4bVVPlUolR1nnZC6IeeTIRs=', 'Content-Length': '0'} 2023-12-15T23:09:41.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037d223a9aaff09b2-00657cdcb5-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:41 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.010 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.010 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.010 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.010 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.010 DEBUG:boto:Method: GET 2023-12-15T23:09:42.010 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.010 DEBUG:boto:Data: 2023-12-15T23:09:42.010 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.011 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.011 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.011 DEBUG:boto:Params: {} 2023-12-15T23:09:42.011 DEBUG:boto:Token: None 2023-12-15T23:09:42.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY= 2023-12-15T23:09:42.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY=', 'Content-Length': '0'} 2023-12-15T23:09:42.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efa3db7e1eb2b45d-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.014 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.014 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.014 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.014 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.014 DEBUG:boto:Method: HEAD 2023-12-15T23:09:42.014 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.014 DEBUG:boto:Data: 2023-12-15T23:09:42.014 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.014 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.014 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.015 DEBUG:boto:Params: {} 2023-12-15T23:09:42.015 DEBUG:boto:Token: None 2023-12-15T23:09:42.015 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8cC1v3HNwSBM6WfDHmOaH+lP/wY= 2023-12-15T23:09:42.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8cC1v3HNwSBM6WfDHmOaH+lP/wY=', 'Content-Length': '0'} 2023-12-15T23:09:42.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057de13a18a3eb1e8-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.018 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.018 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.018 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.018 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.018 DEBUG:boto:Method: HEAD 2023-12-15T23:09:42.018 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.018 DEBUG:boto:Data: 2023-12-15T23:09:42.018 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.018 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.018 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.019 DEBUG:boto:Params: {} 2023-12-15T23:09:42.019 DEBUG:boto:Token: None 2023-12-15T23:09:42.019 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8cC1v3HNwSBM6WfDHmOaH+lP/wY= 2023-12-15T23:09:42.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8cC1v3HNwSBM6WfDHmOaH+lP/wY=', 'Content-Length': '0'} 2023-12-15T23:09:42.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ba0bb867c6dcf6e-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.021 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:42.021 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.022 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.022 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.022 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.022 DEBUG:boto:Method: GET 2023-12-15T23:09:42.022 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.022 DEBUG:boto:Data: 2023-12-15T23:09:42.022 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.022 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.022 DEBUG:boto:Params: {} 2023-12-15T23:09:42.022 DEBUG:boto:Token: None 2023-12-15T23:09:42.022 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY= 2023-12-15T23:09:42.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY=', 'Content-Length': '0'} 2023-12-15T23:09:42.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de1fa57f66d989af-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.065 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.066 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.066 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.066 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:42.066 DEBUG:boto:Method: GET 2023-12-15T23:09:42.066 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.066 DEBUG:boto:Data: 2023-12-15T23:09:42.066 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.066 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.066 DEBUG:boto:Params: {} 2023-12-15T23:09:42.066 DEBUG:boto:Token: None 2023-12-15T23:09:42.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:42.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY= 2023-12-15T23:09:42.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VGvZQnP7SFYu7Rownr5JYueL+XY=', 'Content-Length': '0'} 2023-12-15T23:09:42.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046e95b0169076244-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.069 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:42.069 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:42.069 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.069 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.070 DEBUG:boto:Method: GET 2023-12-15T23:09:42.070 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:42.070 DEBUG:boto:Data: 2023-12-15T23:09:42.070 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.070 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.070 DEBUG:boto:Params: {} 2023-12-15T23:09:42.070 DEBUG:boto:Token: None 2023-12-15T23:09:42.070 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/ 2023-12-15T23:09:42.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA= 2023-12-15T23:09:42.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA=', 'Content-Length': '0'} 2023-12-15T23:09:42.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095b414956c98d8d0-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.113 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:42.114 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:42.114 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:42.114 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.114 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.114 DEBUG:boto:Method: GET 2023-12-15T23:09:42.114 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:42.114 DEBUG:boto:Data: 2023-12-15T23:09:42.115 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.115 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.115 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.115 DEBUG:boto:Params: {} 2023-12-15T23:09:42.115 DEBUG:boto:Token: None 2023-12-15T23:09:42.115 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/ 2023-12-15T23:09:42.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA= 2023-12-15T23:09:42.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA=', 'Content-Length': '0'} 2023-12-15T23:09:42.117 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004a1ec2032a2e7a6-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.117 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:42.118 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.118 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.118 DEBUG:boto:Method: HEAD 2023-12-15T23:09:42.118 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:42.118 DEBUG:boto:Data: 2023-12-15T23:09:42.118 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.118 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.118 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.118 DEBUG:boto:Params: {} 2023-12-15T23:09:42.119 DEBUG:boto:Token: None 2023-12-15T23:09:42.119 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h 2023-12-15T23:09:42.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SEP8S2A8T34kBpS+UzwRoOPiLlY= 2023-12-15T23:09:42.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SEP8S2A8T34kBpS+UzwRoOPiLlY=', 'Content-Length': '0'} 2023-12-15T23:09:42.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068115b71f6d177f1-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.122 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.122 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.122 DEBUG:boto:Method: HEAD 2023-12-15T23:09:42.122 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:42.123 DEBUG:boto:Data: 2023-12-15T23:09:42.123 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.123 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.123 DEBUG:boto:Params: {} 2023-12-15T23:09:42.123 DEBUG:boto:Token: None 2023-12-15T23:09:42.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h 2023-12-15T23:09:42.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SEP8S2A8T34kBpS+UzwRoOPiLlY= 2023-12-15T23:09:42.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SEP8S2A8T34kBpS+UzwRoOPiLlY=', 'Content-Length': '0'} 2023-12-15T23:09:42.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060a43a73f963ab41-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:42.126 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.126 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.126 DEBUG:boto:Method: GET 2023-12-15T23:09:42.126 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:42.126 DEBUG:boto:Data: 2023-12-15T23:09:42.127 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.127 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.127 DEBUG:boto:Params: {} 2023-12-15T23:09:42.127 DEBUG:boto:Token: None 2023-12-15T23:09:42.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h 2023-12-15T23:09:42.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WztGX3B1qHQufGugItPMfVCPwcA= 2023-12-15T23:09:42.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WztGX3B1qHQufGugItPMfVCPwcA=', 'Content-Length': '0'} 2023-12-15T23:09:42.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e07dfb315bf86791-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.173 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:42.173 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:42.174 DEBUG:boto:Method: GET 2023-12-15T23:09:42.174 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:42.174 DEBUG:boto:Data: 2023-12-15T23:09:42.174 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.174 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.174 DEBUG:boto:Params: {} 2023-12-15T23:09:42.174 DEBUG:boto:Token: None 2023-12-15T23:09:42.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/h 2023-12-15T23:09:42.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WztGX3B1qHQufGugItPMfVCPwcA= 2023-12-15T23:09:42.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WztGX3B1qHQufGugItPMfVCPwcA=', 'Content-Length': '0'} 2023-12-15T23:09:42.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1f0a7361523bb51-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.177 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:42.177 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:42.177 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.177 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.177 DEBUG:boto:Method: GET 2023-12-15T23:09:42.177 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:42.177 DEBUG:boto:Data: 2023-12-15T23:09:42.177 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.177 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:42.178 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.178 DEBUG:boto:Params: {} 2023-12-15T23:09:42.178 DEBUG:boto:Token: None 2023-12-15T23:09:42.178 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/ 2023-12-15T23:09:42.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA= 2023-12-15T23:09:42.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA=', 'Content-Length': '0'} 2023-12-15T23:09:42.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020729d24078b7cfc-00657cdcb6-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.225 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:42.226 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:42.226 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:42.226 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.226 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:42.226 DEBUG:boto:Method: GET 2023-12-15T23:09:42.226 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:42.226 DEBUG:boto:Data: 2023-12-15T23:09:42.226 DEBUG:boto:Headers: {} 2023-12-15T23:09:42.227 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:42.227 DEBUG:boto:Port: 8000 2023-12-15T23:09:42.227 DEBUG:boto:Params: {} 2023-12-15T23:09:42.227 DEBUG:boto:Token: None 2023-12-15T23:09:42.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:42 GMT /kskgfn-45/ 2023-12-15T23:09:42.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA= 2023-12-15T23:09:42.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQRH/CNfTSqrQu4uCymmVt0aZpA=', 'Content-Length': '0'} 2023-12-15T23:09:42.229 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a210c6bd6eaf2cc-00657cdcb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:42.230 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:42.230 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:42.230 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'kskgfn-45', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:42.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'kskgfn-45', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:42.231 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket kskgfn-45 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:42.285 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:42.327 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:09:42.327 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-45 2023-12-15T23:09:42.329 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 8 2023-12-15T23:09:42.360 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:42.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:42.361 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:42.404 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:42.404 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:42.447 INFO:teuthology.orchestra.run.smithi093.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2023-12-15T23:09:42.447 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-45 2023-12-15T23:09:42.447 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:42.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:42.448 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:42.508 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:42.508 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:42.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:42.544+0000 7f538793a800 1 waiting to reach latest gen 2, on 1.. 2023-12-15T23:09:47.546 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:47.545+0000 7f538793a800 1 bucket sync caught up with empty source 2023-12-15T23:09:47.546 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:47.545+0000 7f538793a800 0 bucket checkpoint complete 2023-12-15T23:09:47.564 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-45 2023-12-15T23:09:47.564 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:47.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:47.564 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:47.625 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:47.625 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:47.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:47.663+0000 7f5455726800 1 bucket sync caught up with source: 2023-12-15T23:09:47.664 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:47.664 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.123.6, , , 00000000001.77.6, 00000000001.95.6, , , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:09:47.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:09:47.663+0000 7f5455726800 0 bucket checkpoint complete 2023-12-15T23:09:47.678 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:47.678 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.679 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.679 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.679 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:47.679 DEBUG:boto:Data: 2023-12-15T23:09:47.679 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.679 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.679 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.679 DEBUG:boto:Params: {} 2023-12-15T23:09:47.679 DEBUG:boto:Token: None 2023-12-15T23:09:47.680 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ek/I/lo00smOgPMtLtnUV5mulmo= 2023-12-15T23:09:47.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ek/I/lo00smOgPMtLtnUV5mulmo=', 'Content-Length': '0'} 2023-12-15T23:09:47.682 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c389b8177f06965a-00657cdcbb-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.682 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.683 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.683 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.683 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:47.683 DEBUG:boto:Data: 2023-12-15T23:09:47.683 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.683 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.683 DEBUG:boto:Params: {} 2023-12-15T23:09:47.683 DEBUG:boto:Token: None 2023-12-15T23:09:47.683 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.684 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ek/I/lo00smOgPMtLtnUV5mulmo= 2023-12-15T23:09:47.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ek/I/lo00smOgPMtLtnUV5mulmo=', 'Content-Length': '0'} 2023-12-15T23:09:47.685 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001241d587774c640b-00657cdcbb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.686 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:09:47.686 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.686 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.686 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.686 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.686 DEBUG:boto:Method: GET 2023-12-15T23:09:47.686 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.686 DEBUG:boto:Data: 2023-12-15T23:09:47.686 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.686 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.687 DEBUG:boto:Params: {} 2023-12-15T23:09:47.687 DEBUG:boto:Token: None 2023-12-15T23:09:47.687 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/?versions 2023-12-15T23:09:47.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU= 2023-12-15T23:09:47.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU=', 'Content-Length': '0'} 2023-12-15T23:09:47.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a7d8248a1f3c365-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.689 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.690 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:47.690 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:47.690 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:09:47.691 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:09:47.691 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.691 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.691 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.691 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.691 DEBUG:boto:Method: GET 2023-12-15T23:09:47.692 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.692 DEBUG:boto:Data: 2023-12-15T23:09:47.692 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.692 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.692 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.692 DEBUG:boto:Params: {} 2023-12-15T23:09:47.692 DEBUG:boto:Token: None 2023-12-15T23:09:47.692 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/?versions 2023-12-15T23:09:47.692 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU= 2023-12-15T23:09:47.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU=', 'Content-Length': '0'} 2023-12-15T23:09:47.694 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009aba8d88305c2d36-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.694 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:09:47.695 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:09:47.695 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.696 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.696 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.696 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.696 DEBUG:boto:Method: GET 2023-12-15T23:09:47.696 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.696 DEBUG:boto:Data: 2023-12-15T23:09:47.696 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.696 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.696 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.696 DEBUG:boto:Params: {} 2023-12-15T23:09:47.697 DEBUG:boto:Token: None 2023-12-15T23:09:47.697 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/?versions 2023-12-15T23:09:47.697 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU= 2023-12-15T23:09:47.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU=', 'Content-Length': '0'} 2023-12-15T23:09:47.699 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086b94602c063d9f4-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.699 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.700 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.700 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.700 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.700 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.700 DEBUG:boto:Method: GET 2023-12-15T23:09:47.700 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:09:47.701 DEBUG:boto:Data: 2023-12-15T23:09:47.701 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.701 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.701 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.701 DEBUG:boto:Params: {} 2023-12-15T23:09:47.701 DEBUG:boto:Token: None 2023-12-15T23:09:47.701 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/?versions 2023-12-15T23:09:47.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU= 2023-12-15T23:09:47.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4k4fAFaCbKUpH+eKFvfQcFuJqBU=', 'Content-Length': '0'} 2023-12-15T23:09:47.703 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc067420e74de6b7-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.703 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.704 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:47.704 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.704 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.704 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.704 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.705 DEBUG:boto:Method: GET 2023-12-15T23:09:47.705 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.705 DEBUG:boto:Data: 2023-12-15T23:09:47.705 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.705 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.705 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.705 DEBUG:boto:Params: {} 2023-12-15T23:09:47.705 DEBUG:boto:Token: None 2023-12-15T23:09:47.705 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.705 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI= 2023-12-15T23:09:47.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI=', 'Content-Length': '0'} 2023-12-15T23:09:47.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063934c8828bf65b1-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.708 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.708 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.708 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.708 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.708 DEBUG:boto:Method: GET 2023-12-15T23:09:47.708 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.709 DEBUG:boto:Data: 2023-12-15T23:09:47.709 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.709 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.709 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.709 DEBUG:boto:Params: {} 2023-12-15T23:09:47.709 DEBUG:boto:Token: None 2023-12-15T23:09:47.709 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.709 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI= 2023-12-15T23:09:47.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI=', 'Content-Length': '0'} 2023-12-15T23:09:47.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dab9187371079cba-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.753 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.753 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.754 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.754 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.754 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.754 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.754 DEBUG:boto:Data: 2023-12-15T23:09:47.754 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.754 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.754 DEBUG:boto:Params: {} 2023-12-15T23:09:47.754 DEBUG:boto:Token: None 2023-12-15T23:09:47.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HrFjGJaRXAdGOvIqhWJ1r/EUM+s= 2023-12-15T23:09:47.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HrFjGJaRXAdGOvIqhWJ1r/EUM+s=', 'Content-Length': '0'} 2023-12-15T23:09:47.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e43dadeb89e24a0-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.757 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.757 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.757 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.757 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.757 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.757 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.757 DEBUG:boto:Data: 2023-12-15T23:09:47.757 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.757 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.757 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.758 DEBUG:boto:Params: {} 2023-12-15T23:09:47.758 DEBUG:boto:Token: None 2023-12-15T23:09:47.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HrFjGJaRXAdGOvIqhWJ1r/EUM+s= 2023-12-15T23:09:47.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HrFjGJaRXAdGOvIqhWJ1r/EUM+s=', 'Content-Length': '0'} 2023-12-15T23:09:47.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034afe2c3bbe291ff-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:47.760 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.760 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.760 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.760 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.761 DEBUG:boto:Method: GET 2023-12-15T23:09:47.761 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.761 DEBUG:boto:Data: 2023-12-15T23:09:47.761 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.761 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.761 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.761 DEBUG:boto:Params: {} 2023-12-15T23:09:47.761 DEBUG:boto:Token: None 2023-12-15T23:09:47.761 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI= 2023-12-15T23:09:47.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI=', 'Content-Length': '0'} 2023-12-15T23:09:47.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017e2fd278f28be11-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.764 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.764 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.764 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.764 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:09:47.764 DEBUG:boto:Method: GET 2023-12-15T23:09:47.764 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.764 DEBUG:boto:Data: 2023-12-15T23:09:47.764 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.764 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.764 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.764 DEBUG:boto:Params: {} 2023-12-15T23:09:47.765 DEBUG:boto:Token: None 2023-12-15T23:09:47.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:09:47.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI= 2023-12-15T23:09:47.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4l37SXlcM7yxW4xL0xYVkmNYBI=', 'Content-Length': '0'} 2023-12-15T23:09:47.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc1359a2c47a26d1-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.767 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.768 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.768 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.768 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.768 DEBUG:boto:Method: GET 2023-12-15T23:09:47.768 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:47.768 DEBUG:boto:Data: 2023-12-15T23:09:47.768 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.768 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.768 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.768 DEBUG:boto:Params: {} 2023-12-15T23:09:47.769 DEBUG:boto:Token: None 2023-12-15T23:09:47.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0db3f1cb0af8c84-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.771 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.772 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.772 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.772 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.772 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.772 DEBUG:boto:Method: GET 2023-12-15T23:09:47.772 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:47.772 DEBUG:boto:Data: 2023-12-15T23:09:47.772 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.772 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.772 DEBUG:boto:Params: {} 2023-12-15T23:09:47.773 DEBUG:boto:Token: None 2023-12-15T23:09:47.773 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdbbed7802dae316-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.775 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.775 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.775 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.775 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.775 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:47.776 DEBUG:boto:Data: 2023-12-15T23:09:47.776 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.776 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.776 DEBUG:boto:Params: {} 2023-12-15T23:09:47.776 DEBUG:boto:Token: None 2023-12-15T23:09:47.776 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a 2023-12-15T23:09:47.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K4TTdaXyMyUPbNOM0rOb9t0jY1I= 2023-12-15T23:09:47.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K4TTdaXyMyUPbNOM0rOb9t0jY1I=', 'Content-Length': '0'} 2023-12-15T23:09:47.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbc6249a4c04c405-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.779 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.779 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.779 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.779 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:47.779 DEBUG:boto:Data: 2023-12-15T23:09:47.779 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.779 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.779 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.779 DEBUG:boto:Params: {} 2023-12-15T23:09:47.779 DEBUG:boto:Token: None 2023-12-15T23:09:47.780 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a 2023-12-15T23:09:47.780 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K4TTdaXyMyUPbNOM0rOb9t0jY1I= 2023-12-15T23:09:47.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K4TTdaXyMyUPbNOM0rOb9t0jY1I=', 'Content-Length': '0'} 2023-12-15T23:09:47.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063cb096c3e84abd2-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:09:47.782 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.783 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.783 DEBUG:boto:Method: GET 2023-12-15T23:09:47.783 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:47.783 DEBUG:boto:Data: 2023-12-15T23:09:47.783 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.783 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.783 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.783 DEBUG:boto:Params: {} 2023-12-15T23:09:47.783 DEBUG:boto:Token: None 2023-12-15T23:09:47.783 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a 2023-12-15T23:09:47.784 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sNl/WJxX2cDGeykxphdAWwUlfWI= 2023-12-15T23:09:47.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sNl/WJxX2cDGeykxphdAWwUlfWI=', 'Content-Length': '0'} 2023-12-15T23:09:47.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016030f99eddea8be-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.829 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:09:47.830 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:09:47.830 DEBUG:boto:Method: GET 2023-12-15T23:09:47.830 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:09:47.830 DEBUG:boto:Data: 2023-12-15T23:09:47.830 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.830 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.830 DEBUG:boto:Params: {} 2023-12-15T23:09:47.830 DEBUG:boto:Token: None 2023-12-15T23:09:47.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/a 2023-12-15T23:09:47.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sNl/WJxX2cDGeykxphdAWwUlfWI= 2023-12-15T23:09:47.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sNl/WJxX2cDGeykxphdAWwUlfWI=', 'Content-Length': '0'} 2023-12-15T23:09:47.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055a12bcaba00e81c-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.833 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.833 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.833 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.833 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.833 DEBUG:boto:Method: GET 2023-12-15T23:09:47.833 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:47.833 DEBUG:boto:Data: 2023-12-15T23:09:47.834 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.834 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.834 DEBUG:boto:Params: {} 2023-12-15T23:09:47.834 DEBUG:boto:Token: None 2023-12-15T23:09:47.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.836 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000790a7d1d5b10076d-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.837 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.837 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.837 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.837 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.837 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:09:47.837 DEBUG:boto:Method: GET 2023-12-15T23:09:47.837 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:09:47.837 DEBUG:boto:Data: 2023-12-15T23:09:47.838 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.838 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.838 DEBUG:boto:Params: {} 2023-12-15T23:09:47.838 DEBUG:boto:Token: None 2023-12-15T23:09:47.838 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.838 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002537a83d3d2e821a-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.840 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.840 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:47.841 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.841 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.841 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.841 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.841 DEBUG:boto:Method: GET 2023-12-15T23:09:47.841 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.841 DEBUG:boto:Data: 2023-12-15T23:09:47.841 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.841 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.841 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.841 DEBUG:boto:Params: {} 2023-12-15T23:09:47.842 DEBUG:boto:Token: None 2023-12-15T23:09:47.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k= 2023-12-15T23:09:47.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k=', 'Content-Length': '0'} 2023-12-15T23:09:47.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aab909b3897664b1-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.885 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.886 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.886 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.886 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.886 DEBUG:boto:Method: GET 2023-12-15T23:09:47.886 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.886 DEBUG:boto:Data: 2023-12-15T23:09:47.886 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.886 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.886 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.886 DEBUG:boto:Params: {} 2023-12-15T23:09:47.886 DEBUG:boto:Token: None 2023-12-15T23:09:47.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k= 2023-12-15T23:09:47.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k=', 'Content-Length': '0'} 2023-12-15T23:09:47.888 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecda5e383559a945-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.889 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.889 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.889 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.889 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.889 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.889 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.889 DEBUG:boto:Data: 2023-12-15T23:09:47.889 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.889 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.889 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.890 DEBUG:boto:Params: {} 2023-12-15T23:09:47.890 DEBUG:boto:Token: None 2023-12-15T23:09:47.890 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:quTW68f+5ZoTBJHEVlkvpKFc7r0= 2023-12-15T23:09:47.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:quTW68f+5ZoTBJHEVlkvpKFc7r0=', 'Content-Length': '0'} 2023-12-15T23:09:47.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000501afe3177e22792-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.892 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.892 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.892 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.892 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.892 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.892 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.892 DEBUG:boto:Data: 2023-12-15T23:09:47.893 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.893 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.893 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.893 DEBUG:boto:Params: {} 2023-12-15T23:09:47.893 DEBUG:boto:Token: None 2023-12-15T23:09:47.893 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:quTW68f+5ZoTBJHEVlkvpKFc7r0= 2023-12-15T23:09:47.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:quTW68f+5ZoTBJHEVlkvpKFc7r0=', 'Content-Length': '0'} 2023-12-15T23:09:47.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072f291e95aca6825-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:47.896 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.896 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.896 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.896 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.896 DEBUG:boto:Method: GET 2023-12-15T23:09:47.896 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.896 DEBUG:boto:Data: 2023-12-15T23:09:47.896 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.896 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.896 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.897 DEBUG:boto:Params: {} 2023-12-15T23:09:47.897 DEBUG:boto:Token: None 2023-12-15T23:09:47.897 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k= 2023-12-15T23:09:47.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k=', 'Content-Length': '0'} 2023-12-15T23:09:47.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef532542ba1d9457-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.941 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.942 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.942 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.942 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:09:47.942 DEBUG:boto:Method: GET 2023-12-15T23:09:47.942 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.942 DEBUG:boto:Data: 2023-12-15T23:09:47.942 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.942 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.942 DEBUG:boto:Params: {} 2023-12-15T23:09:47.942 DEBUG:boto:Token: None 2023-12-15T23:09:47.943 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:09:47.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k= 2023-12-15T23:09:47.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:szejd8rU0EzwOiP1f9P93NfK57k=', 'Content-Length': '0'} 2023-12-15T23:09:47.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000830849261dd5e8ee-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.945 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.945 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.945 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:47.945 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:47.945 DEBUG:boto:Method: GET 2023-12-15T23:09:47.945 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:47.945 DEBUG:boto:Data: 2023-12-15T23:09:47.945 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.945 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.945 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.946 DEBUG:boto:Params: {} 2023-12-15T23:09:47.946 DEBUG:boto:Token: None 2023-12-15T23:09:47.946 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdddf607171216ad-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.989 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.990 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:47.990 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:47.990 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:47.990 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:47.990 DEBUG:boto:Method: GET 2023-12-15T23:09:47.990 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:47.990 DEBUG:boto:Data: 2023-12-15T23:09:47.991 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.991 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.991 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.991 DEBUG:boto:Params: {} 2023-12-15T23:09:47.991 DEBUG:boto:Token: None 2023-12-15T23:09:47.991 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/ 2023-12-15T23:09:47.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU= 2023-12-15T23:09:47.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mnk9R0jpLaPnNiH2vPCy/dkNeFU=', 'Content-Length': '0'} 2023-12-15T23:09:47.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6de7b91558e4763-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.993 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:47.994 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.994 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.994 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.994 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:47.994 DEBUG:boto:Data: 2023-12-15T23:09:47.994 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:47.994 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.994 DEBUG:boto:Params: {} 2023-12-15T23:09:47.995 DEBUG:boto:Token: None 2023-12-15T23:09:47.995 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b 2023-12-15T23:09:47.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mxOKzoHXMFN18V+fuJmrWlM/uJE= 2023-12-15T23:09:47.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mxOKzoHXMFN18V+fuJmrWlM/uJE=', 'Content-Length': '0'} 2023-12-15T23:09:47.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000211dcfd2d3f76f9c-00657cdcbb-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:47.997 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:47.997 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:47.997 DEBUG:boto:Method: HEAD 2023-12-15T23:09:47.997 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:47.997 DEBUG:boto:Data: 2023-12-15T23:09:47.997 DEBUG:boto:Headers: {} 2023-12-15T23:09:47.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:47.998 DEBUG:boto:Port: 8000 2023-12-15T23:09:47.998 DEBUG:boto:Params: {} 2023-12-15T23:09:47.998 DEBUG:boto:Token: None 2023-12-15T23:09:47.998 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:47 GMT /kskgfn-45/b 2023-12-15T23:09:47.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mxOKzoHXMFN18V+fuJmrWlM/uJE= 2023-12-15T23:09:47.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mxOKzoHXMFN18V+fuJmrWlM/uJE=', 'Content-Length': '0'} 2023-12-15T23:09:48.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009211dac15c1e2bb-00657cdcbb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:09:48.000 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:48.000 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:48.000 DEBUG:boto:Method: GET 2023-12-15T23:09:48.000 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:48.001 DEBUG:boto:Data: 2023-12-15T23:09:48.001 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.001 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.001 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.001 DEBUG:boto:Params: {} 2023-12-15T23:09:48.001 DEBUG:boto:Token: None 2023-12-15T23:09:48.001 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/b 2023-12-15T23:09:48.001 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1bg2OBWZGth0mdFZngGUXdVwjk= 2023-12-15T23:09:48.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1bg2OBWZGth0mdFZngGUXdVwjk=', 'Content-Length': '0'} 2023-12-15T23:09:48.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b407a3b6f2febdc0-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.045 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:09:48.045 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:09:48.046 DEBUG:boto:Method: GET 2023-12-15T23:09:48.046 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:09:48.046 DEBUG:boto:Data: 2023-12-15T23:09:48.046 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.046 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.046 DEBUG:boto:Params: {} 2023-12-15T23:09:48.046 DEBUG:boto:Token: None 2023-12-15T23:09:48.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/b 2023-12-15T23:09:48.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1bg2OBWZGth0mdFZngGUXdVwjk= 2023-12-15T23:09:48.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1bg2OBWZGth0mdFZngGUXdVwjk=', 'Content-Length': '0'} 2023-12-15T23:09:48.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049d513c2e0b5d1b2-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.048 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.048 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.048 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:48.049 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:48.049 DEBUG:boto:Method: GET 2023-12-15T23:09:48.049 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:48.049 DEBUG:boto:Data: 2023-12-15T23:09:48.049 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.049 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.049 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.049 DEBUG:boto:Params: {} 2023-12-15T23:09:48.049 DEBUG:boto:Token: None 2023-12-15T23:09:48.049 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000030ad5e2ec94ffbd-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.052 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.052 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.052 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.052 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:09:48.052 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:09:48.053 DEBUG:boto:Method: GET 2023-12-15T23:09:48.053 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:09:48.053 DEBUG:boto:Data: 2023-12-15T23:09:48.053 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.053 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.053 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.053 DEBUG:boto:Params: {} 2023-12-15T23:09:48.053 DEBUG:boto:Token: None 2023-12-15T23:09:48.053 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.053 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d34c2fb590731430-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.055 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:48.056 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.056 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.056 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.056 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.056 DEBUG:boto:Method: GET 2023-12-15T23:09:48.056 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.056 DEBUG:boto:Data: 2023-12-15T23:09:48.056 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.057 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.057 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.057 DEBUG:boto:Params: {} 2023-12-15T23:09:48.057 DEBUG:boto:Token: None 2023-12-15T23:09:48.057 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.057 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg= 2023-12-15T23:09:48.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg=', 'Content-Length': '0'} 2023-12-15T23:09:48.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001449e58e2dd45b81-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.105 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.106 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.106 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.106 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.106 DEBUG:boto:Method: GET 2023-12-15T23:09:48.106 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.106 DEBUG:boto:Data: 2023-12-15T23:09:48.106 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.106 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.106 DEBUG:boto:Params: {} 2023-12-15T23:09:48.106 DEBUG:boto:Token: None 2023-12-15T23:09:48.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg= 2023-12-15T23:09:48.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg=', 'Content-Length': '0'} 2023-12-15T23:09:48.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaf8308eec9af97d-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.109 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.109 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.109 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.109 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.109 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.109 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.110 DEBUG:boto:Data: 2023-12-15T23:09:48.110 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.110 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.110 DEBUG:boto:Params: {} 2023-12-15T23:09:48.110 DEBUG:boto:Token: None 2023-12-15T23:09:48.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yP+3ihhz9Klpt4bFnrlu459M/Lg= 2023-12-15T23:09:48.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yP+3ihhz9Klpt4bFnrlu459M/Lg=', 'Content-Length': '0'} 2023-12-15T23:09:48.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ac87522d1e52f6d-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.112 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.112 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.112 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.113 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.113 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.113 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.113 DEBUG:boto:Data: 2023-12-15T23:09:48.113 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.113 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.113 DEBUG:boto:Params: {} 2023-12-15T23:09:48.113 DEBUG:boto:Token: None 2023-12-15T23:09:48.113 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yP+3ihhz9Klpt4bFnrlu459M/Lg= 2023-12-15T23:09:48.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yP+3ihhz9Klpt4bFnrlu459M/Lg=', 'Content-Length': '0'} 2023-12-15T23:09:48.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012509e1a8c359798-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:48.116 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.116 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.116 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.116 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.116 DEBUG:boto:Method: GET 2023-12-15T23:09:48.116 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.116 DEBUG:boto:Data: 2023-12-15T23:09:48.116 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.116 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.116 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.116 DEBUG:boto:Params: {} 2023-12-15T23:09:48.117 DEBUG:boto:Token: None 2023-12-15T23:09:48.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg= 2023-12-15T23:09:48.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg=', 'Content-Length': '0'} 2023-12-15T23:09:48.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000057a0f290b0aa41e-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.161 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.161 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.162 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.162 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:09:48.162 DEBUG:boto:Method: GET 2023-12-15T23:09:48.162 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.162 DEBUG:boto:Data: 2023-12-15T23:09:48.162 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.162 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.162 DEBUG:boto:Params: {} 2023-12-15T23:09:48.162 DEBUG:boto:Token: None 2023-12-15T23:09:48.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:09:48.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg= 2023-12-15T23:09:48.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9UOMwe6X6f5viBnrQfSJeb7CJjg=', 'Content-Length': '0'} 2023-12-15T23:09:48.164 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072c088aa31983d16-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.165 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.165 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.165 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.165 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.165 DEBUG:boto:Method: GET 2023-12-15T23:09:48.165 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:48.165 DEBUG:boto:Data: 2023-12-15T23:09:48.165 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.165 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.166 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.166 DEBUG:boto:Params: {} 2023-12-15T23:09:48.166 DEBUG:boto:Token: None 2023-12-15T23:09:48.166 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.166 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007182ee2e4fbc619e-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.168 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.169 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.169 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.169 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.169 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.169 DEBUG:boto:Method: GET 2023-12-15T23:09:48.169 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:48.169 DEBUG:boto:Data: 2023-12-15T23:09:48.169 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.170 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.170 DEBUG:boto:Params: {} 2023-12-15T23:09:48.170 DEBUG:boto:Token: None 2023-12-15T23:09:48.170 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.170 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f10f9400a752432-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.172 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.172 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.172 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.173 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.173 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:48.173 DEBUG:boto:Data: 2023-12-15T23:09:48.173 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.173 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.173 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.173 DEBUG:boto:Params: {} 2023-12-15T23:09:48.173 DEBUG:boto:Token: None 2023-12-15T23:09:48.173 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c 2023-12-15T23:09:48.173 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uQ4VJl7tAlOC+9MtTWsMX/Omd9U= 2023-12-15T23:09:48.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uQ4VJl7tAlOC+9MtTWsMX/Omd9U=', 'Content-Length': '0'} 2023-12-15T23:09:48.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3f6754803457ac7-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.176 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.176 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.176 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.176 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:48.176 DEBUG:boto:Data: 2023-12-15T23:09:48.176 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.176 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.176 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.176 DEBUG:boto:Params: {} 2023-12-15T23:09:48.176 DEBUG:boto:Token: None 2023-12-15T23:09:48.177 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c 2023-12-15T23:09:48.177 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uQ4VJl7tAlOC+9MtTWsMX/Omd9U= 2023-12-15T23:09:48.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uQ4VJl7tAlOC+9MtTWsMX/Omd9U=', 'Content-Length': '0'} 2023-12-15T23:09:48.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ba0fbfd5d7bedc4-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:09:48.179 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.179 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.179 DEBUG:boto:Method: GET 2023-12-15T23:09:48.179 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:48.179 DEBUG:boto:Data: 2023-12-15T23:09:48.179 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.179 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.180 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.180 DEBUG:boto:Params: {} 2023-12-15T23:09:48.180 DEBUG:boto:Token: None 2023-12-15T23:09:48.180 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c 2023-12-15T23:09:48.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0QOPxkxe6e83nW/aG0M7/BdJa+A= 2023-12-15T23:09:48.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0QOPxkxe6e83nW/aG0M7/BdJa+A=', 'Content-Length': '0'} 2023-12-15T23:09:48.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000331272c8b412c0c9-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.225 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:09:48.225 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:09:48.226 DEBUG:boto:Method: GET 2023-12-15T23:09:48.226 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:09:48.226 DEBUG:boto:Data: 2023-12-15T23:09:48.226 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.226 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.226 DEBUG:boto:Params: {} 2023-12-15T23:09:48.226 DEBUG:boto:Token: None 2023-12-15T23:09:48.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/c 2023-12-15T23:09:48.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0QOPxkxe6e83nW/aG0M7/BdJa+A= 2023-12-15T23:09:48.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0QOPxkxe6e83nW/aG0M7/BdJa+A=', 'Content-Length': '0'} 2023-12-15T23:09:48.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df1a033bcd3018ad-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.229 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.229 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.229 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.229 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.229 DEBUG:boto:Method: GET 2023-12-15T23:09:48.229 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:48.229 DEBUG:boto:Data: 2023-12-15T23:09:48.229 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.229 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.230 DEBUG:boto:Params: {} 2023-12-15T23:09:48.230 DEBUG:boto:Token: None 2023-12-15T23:09:48.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c83185a935b97baf-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.232 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.233 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.233 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.233 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.233 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:09:48.233 DEBUG:boto:Method: GET 2023-12-15T23:09:48.233 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:09:48.233 DEBUG:boto:Data: 2023-12-15T23:09:48.233 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.233 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.233 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.233 DEBUG:boto:Params: {} 2023-12-15T23:09:48.234 DEBUG:boto:Token: None 2023-12-15T23:09:48.234 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000747a018e9a121e68-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.236 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:48.237 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.237 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.237 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.237 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.237 DEBUG:boto:Method: GET 2023-12-15T23:09:48.237 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.237 DEBUG:boto:Data: 2023-12-15T23:09:48.237 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.238 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.238 DEBUG:boto:Params: {} 2023-12-15T23:09:48.238 DEBUG:boto:Token: None 2023-12-15T23:09:48.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc= 2023-12-15T23:09:48.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc=', 'Content-Length': '0'} 2023-12-15T23:09:48.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f8f91aff70d7e7c-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.281 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.282 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.282 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.282 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.282 DEBUG:boto:Method: GET 2023-12-15T23:09:48.282 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.282 DEBUG:boto:Data: 2023-12-15T23:09:48.282 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.282 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.282 DEBUG:boto:Params: {} 2023-12-15T23:09:48.282 DEBUG:boto:Token: None 2023-12-15T23:09:48.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc= 2023-12-15T23:09:48.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc=', 'Content-Length': '0'} 2023-12-15T23:09:48.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091b1b9798f4b2a9b-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.285 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.285 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.285 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.285 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.285 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.285 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.286 DEBUG:boto:Data: 2023-12-15T23:09:48.286 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.286 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.286 DEBUG:boto:Params: {} 2023-12-15T23:09:48.286 DEBUG:boto:Token: None 2023-12-15T23:09:48.286 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:okPngy4cZFYVnjszntcF2J41fjE= 2023-12-15T23:09:48.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:okPngy4cZFYVnjszntcF2J41fjE=', 'Content-Length': '0'} 2023-12-15T23:09:48.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f5b2afab75b4c8e-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.288 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.288 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.289 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.289 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.289 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.289 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.289 DEBUG:boto:Data: 2023-12-15T23:09:48.289 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.289 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.289 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.289 DEBUG:boto:Params: {} 2023-12-15T23:09:48.289 DEBUG:boto:Token: None 2023-12-15T23:09:48.290 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.290 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:okPngy4cZFYVnjszntcF2J41fjE= 2023-12-15T23:09:48.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:okPngy4cZFYVnjszntcF2J41fjE=', 'Content-Length': '0'} 2023-12-15T23:09:48.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e88c513706225f91-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:48.292 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.292 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.292 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.292 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.292 DEBUG:boto:Method: GET 2023-12-15T23:09:48.292 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.292 DEBUG:boto:Data: 2023-12-15T23:09:48.292 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.293 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.293 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.293 DEBUG:boto:Params: {} 2023-12-15T23:09:48.293 DEBUG:boto:Token: None 2023-12-15T23:09:48.293 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.293 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc= 2023-12-15T23:09:48.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc=', 'Content-Length': '0'} 2023-12-15T23:09:48.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000da332e9f43ac547-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.337 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.338 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.338 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.338 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:09:48.338 DEBUG:boto:Method: GET 2023-12-15T23:09:48.338 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.338 DEBUG:boto:Data: 2023-12-15T23:09:48.338 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.338 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.338 DEBUG:boto:Params: {} 2023-12-15T23:09:48.338 DEBUG:boto:Token: None 2023-12-15T23:09:48.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:09:48.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc= 2023-12-15T23:09:48.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wIY0SJFN3p+0GPeG+fsxulqoWOc=', 'Content-Length': '0'} 2023-12-15T23:09:48.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055285054bec41584-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.341 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.341 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.341 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.341 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.341 DEBUG:boto:Method: GET 2023-12-15T23:09:48.341 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:48.342 DEBUG:boto:Data: 2023-12-15T23:09:48.342 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.342 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.342 DEBUG:boto:Params: {} 2023-12-15T23:09:48.342 DEBUG:boto:Token: None 2023-12-15T23:09:48.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.344 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f394bdae8612ebed-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.345 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.345 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.345 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.345 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.345 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.345 DEBUG:boto:Method: GET 2023-12-15T23:09:48.345 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:48.346 DEBUG:boto:Data: 2023-12-15T23:09:48.346 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.346 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.346 DEBUG:boto:Params: {} 2023-12-15T23:09:48.346 DEBUG:boto:Token: None 2023-12-15T23:09:48.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e754588287b01ca4-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.348 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.349 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.349 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.349 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.349 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:48.349 DEBUG:boto:Data: 2023-12-15T23:09:48.349 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.349 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.349 DEBUG:boto:Params: {} 2023-12-15T23:09:48.350 DEBUG:boto:Token: None 2023-12-15T23:09:48.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d 2023-12-15T23:09:48.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VnbTFJWQes8KMe11ntTuOPEIgBk= 2023-12-15T23:09:48.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VnbTFJWQes8KMe11ntTuOPEIgBk=', 'Content-Length': '0'} 2023-12-15T23:09:48.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065996b8ce063ac91-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.352 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.352 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.352 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.352 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:48.352 DEBUG:boto:Data: 2023-12-15T23:09:48.352 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.352 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.352 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.352 DEBUG:boto:Params: {} 2023-12-15T23:09:48.353 DEBUG:boto:Token: None 2023-12-15T23:09:48.353 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d 2023-12-15T23:09:48.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VnbTFJWQes8KMe11ntTuOPEIgBk= 2023-12-15T23:09:48.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VnbTFJWQes8KMe11ntTuOPEIgBk=', 'Content-Length': '0'} 2023-12-15T23:09:48.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6835663972f3f5f-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:09:48.355 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.355 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.355 DEBUG:boto:Method: GET 2023-12-15T23:09:48.355 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:48.355 DEBUG:boto:Data: 2023-12-15T23:09:48.355 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.355 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.355 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.355 DEBUG:boto:Params: {} 2023-12-15T23:09:48.356 DEBUG:boto:Token: None 2023-12-15T23:09:48.356 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d 2023-12-15T23:09:48.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muHyaHCkBJCC/W/dP0XoP2FoDcI= 2023-12-15T23:09:48.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muHyaHCkBJCC/W/dP0XoP2FoDcI=', 'Content-Length': '0'} 2023-12-15T23:09:48.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e21c25e9c38d2c0f-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.401 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:09:48.401 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:09:48.402 DEBUG:boto:Method: GET 2023-12-15T23:09:48.402 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:09:48.402 DEBUG:boto:Data: 2023-12-15T23:09:48.402 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.402 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.402 DEBUG:boto:Params: {} 2023-12-15T23:09:48.402 DEBUG:boto:Token: None 2023-12-15T23:09:48.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/d 2023-12-15T23:09:48.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muHyaHCkBJCC/W/dP0XoP2FoDcI= 2023-12-15T23:09:48.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muHyaHCkBJCC/W/dP0XoP2FoDcI=', 'Content-Length': '0'} 2023-12-15T23:09:48.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb85b1b79ed2c5f-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.404 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.405 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.405 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.405 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.405 DEBUG:boto:Method: GET 2023-12-15T23:09:48.405 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:48.405 DEBUG:boto:Data: 2023-12-15T23:09:48.405 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.405 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.405 DEBUG:boto:Params: {} 2023-12-15T23:09:48.405 DEBUG:boto:Token: None 2023-12-15T23:09:48.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.408 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000184bda9556c80a49-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.408 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.408 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.409 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.409 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.409 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:09:48.409 DEBUG:boto:Method: GET 2023-12-15T23:09:48.409 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:09:48.409 DEBUG:boto:Data: 2023-12-15T23:09:48.409 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.409 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.409 DEBUG:boto:Params: {} 2023-12-15T23:09:48.410 DEBUG:boto:Token: None 2023-12-15T23:09:48.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004197b29f164248d6-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.412 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:48.412 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.412 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.413 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.413 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.413 DEBUG:boto:Method: GET 2023-12-15T23:09:48.413 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.413 DEBUG:boto:Data: 2023-12-15T23:09:48.413 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.413 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.413 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.413 DEBUG:boto:Params: {} 2023-12-15T23:09:48.413 DEBUG:boto:Token: None 2023-12-15T23:09:48.413 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY= 2023-12-15T23:09:48.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY=', 'Content-Length': '0'} 2023-12-15T23:09:48.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000194981cc6cab8633-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.457 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.458 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.458 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.458 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.458 DEBUG:boto:Method: GET 2023-12-15T23:09:48.458 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.458 DEBUG:boto:Data: 2023-12-15T23:09:48.458 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.458 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.458 DEBUG:boto:Params: {} 2023-12-15T23:09:48.459 DEBUG:boto:Token: None 2023-12-15T23:09:48.459 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY= 2023-12-15T23:09:48.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY=', 'Content-Length': '0'} 2023-12-15T23:09:48.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a4235c9d8ac43c0-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.461 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.461 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.461 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.461 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.461 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.461 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.461 DEBUG:boto:Data: 2023-12-15T23:09:48.461 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.462 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.462 DEBUG:boto:Params: {} 2023-12-15T23:09:48.462 DEBUG:boto:Token: None 2023-12-15T23:09:48.462 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:34cCf61BKojtABWGlkMHtCPb3DI= 2023-12-15T23:09:48.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:34cCf61BKojtABWGlkMHtCPb3DI=', 'Content-Length': '0'} 2023-12-15T23:09:48.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038e21aa2a4fdd9c3-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.464 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.464 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.464 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.464 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.464 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.464 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.464 DEBUG:boto:Data: 2023-12-15T23:09:48.465 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.465 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.465 DEBUG:boto:Params: {} 2023-12-15T23:09:48.465 DEBUG:boto:Token: None 2023-12-15T23:09:48.465 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:34cCf61BKojtABWGlkMHtCPb3DI= 2023-12-15T23:09:48.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:34cCf61BKojtABWGlkMHtCPb3DI=', 'Content-Length': '0'} 2023-12-15T23:09:48.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000707d25a70e7312e6-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:48.467 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.467 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.467 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.468 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.468 DEBUG:boto:Method: GET 2023-12-15T23:09:48.468 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.468 DEBUG:boto:Data: 2023-12-15T23:09:48.468 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.468 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.468 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.468 DEBUG:boto:Params: {} 2023-12-15T23:09:48.468 DEBUG:boto:Token: None 2023-12-15T23:09:48.468 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.468 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY= 2023-12-15T23:09:48.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY=', 'Content-Length': '0'} 2023-12-15T23:09:48.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1dc7414f923b4d2-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.513 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.514 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.514 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.514 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:09:48.514 DEBUG:boto:Method: GET 2023-12-15T23:09:48.514 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.514 DEBUG:boto:Data: 2023-12-15T23:09:48.514 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.514 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.514 DEBUG:boto:Params: {} 2023-12-15T23:09:48.514 DEBUG:boto:Token: None 2023-12-15T23:09:48.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:09:48.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY= 2023-12-15T23:09:48.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91cMN2oDE424o2gWPuJZ9PVK3sY=', 'Content-Length': '0'} 2023-12-15T23:09:48.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007050969ab45e539b-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.517 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.517 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.517 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.517 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.517 DEBUG:boto:Method: GET 2023-12-15T23:09:48.517 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:48.517 DEBUG:boto:Data: 2023-12-15T23:09:48.517 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.517 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.518 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.518 DEBUG:boto:Params: {} 2023-12-15T23:09:48.518 DEBUG:boto:Token: None 2023-12-15T23:09:48.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.520 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031ca6cb6fa25c844-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.521 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.521 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.521 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.521 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.521 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.521 DEBUG:boto:Method: GET 2023-12-15T23:09:48.521 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:48.522 DEBUG:boto:Data: 2023-12-15T23:09:48.522 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.522 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.522 DEBUG:boto:Params: {} 2023-12-15T23:09:48.522 DEBUG:boto:Token: None 2023-12-15T23:09:48.522 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073ff2862196d918d-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.524 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.525 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.525 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.525 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.525 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:48.525 DEBUG:boto:Data: 2023-12-15T23:09:48.525 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.525 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.525 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.526 DEBUG:boto:Params: {} 2023-12-15T23:09:48.526 DEBUG:boto:Token: None 2023-12-15T23:09:48.526 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e 2023-12-15T23:09:48.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Rn7lts+ApjHVTC07BZM2pVm9uRs= 2023-12-15T23:09:48.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Rn7lts+ApjHVTC07BZM2pVm9uRs=', 'Content-Length': '0'} 2023-12-15T23:09:48.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebd80d973b6bf6b2-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.528 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.528 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.528 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.528 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:48.528 DEBUG:boto:Data: 2023-12-15T23:09:48.528 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.528 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.528 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.528 DEBUG:boto:Params: {} 2023-12-15T23:09:48.529 DEBUG:boto:Token: None 2023-12-15T23:09:48.529 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e 2023-12-15T23:09:48.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Rn7lts+ApjHVTC07BZM2pVm9uRs= 2023-12-15T23:09:48.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Rn7lts+ApjHVTC07BZM2pVm9uRs=', 'Content-Length': '0'} 2023-12-15T23:09:48.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094bf9dae0d16026a-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.531 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:09:48.531 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.531 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.531 DEBUG:boto:Method: GET 2023-12-15T23:09:48.531 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:48.531 DEBUG:boto:Data: 2023-12-15T23:09:48.531 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.531 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.531 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.532 DEBUG:boto:Params: {} 2023-12-15T23:09:48.532 DEBUG:boto:Token: None 2023-12-15T23:09:48.532 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e 2023-12-15T23:09:48.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FEsc5YK+fyhJ9e56HUWG4C1HT3I= 2023-12-15T23:09:48.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FEsc5YK+fyhJ9e56HUWG4C1HT3I=', 'Content-Length': '0'} 2023-12-15T23:09:48.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f3cf5b1795aa490-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.577 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:09:48.578 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:09:48.578 DEBUG:boto:Method: GET 2023-12-15T23:09:48.578 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:09:48.578 DEBUG:boto:Data: 2023-12-15T23:09:48.578 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.578 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.578 DEBUG:boto:Params: {} 2023-12-15T23:09:48.578 DEBUG:boto:Token: None 2023-12-15T23:09:48.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/e 2023-12-15T23:09:48.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FEsc5YK+fyhJ9e56HUWG4C1HT3I= 2023-12-15T23:09:48.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FEsc5YK+fyhJ9e56HUWG4C1HT3I=', 'Content-Length': '0'} 2023-12-15T23:09:48.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004019d77bc0bdc48b-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.580 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.581 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.581 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.581 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.581 DEBUG:boto:Method: GET 2023-12-15T23:09:48.581 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:48.581 DEBUG:boto:Data: 2023-12-15T23:09:48.581 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.581 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.581 DEBUG:boto:Params: {} 2023-12-15T23:09:48.582 DEBUG:boto:Token: None 2023-12-15T23:09:48.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ff392c6008473b7-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.584 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.585 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.585 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.585 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.585 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:09:48.585 DEBUG:boto:Method: GET 2023-12-15T23:09:48.585 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:09:48.585 DEBUG:boto:Data: 2023-12-15T23:09:48.585 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.586 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.586 DEBUG:boto:Params: {} 2023-12-15T23:09:48.586 DEBUG:boto:Token: None 2023-12-15T23:09:48.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec9f0dc4ca094d25-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.588 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:48.588 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.588 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.589 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.589 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.589 DEBUG:boto:Method: GET 2023-12-15T23:09:48.589 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.589 DEBUG:boto:Data: 2023-12-15T23:09:48.589 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.589 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.589 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.589 DEBUG:boto:Params: {} 2023-12-15T23:09:48.589 DEBUG:boto:Token: None 2023-12-15T23:09:48.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw= 2023-12-15T23:09:48.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw=', 'Content-Length': '0'} 2023-12-15T23:09:48.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9821e20b50b6a9b-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.634 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.634 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.634 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.634 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.634 DEBUG:boto:Method: GET 2023-12-15T23:09:48.635 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.635 DEBUG:boto:Data: 2023-12-15T23:09:48.635 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.635 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.635 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.635 DEBUG:boto:Params: {} 2023-12-15T23:09:48.635 DEBUG:boto:Token: None 2023-12-15T23:09:48.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw= 2023-12-15T23:09:48.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw=', 'Content-Length': '0'} 2023-12-15T23:09:48.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b10f3839f82eb192-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.638 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.638 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.638 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.638 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.638 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.639 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.639 DEBUG:boto:Data: 2023-12-15T23:09:48.639 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.639 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.639 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.639 DEBUG:boto:Params: {} 2023-12-15T23:09:48.639 DEBUG:boto:Token: None 2023-12-15T23:09:48.639 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQN18l5J2HhpfQrqSQHDN368Jac= 2023-12-15T23:09:48.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQN18l5J2HhpfQrqSQHDN368Jac=', 'Content-Length': '0'} 2023-12-15T23:09:48.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010bdde4cffa3fc14-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.642 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.642 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.642 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.642 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.642 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.642 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.642 DEBUG:boto:Data: 2023-12-15T23:09:48.642 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.642 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.643 DEBUG:boto:Params: {} 2023-12-15T23:09:48.643 DEBUG:boto:Token: None 2023-12-15T23:09:48.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQN18l5J2HhpfQrqSQHDN368Jac= 2023-12-15T23:09:48.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQN18l5J2HhpfQrqSQHDN368Jac=', 'Content-Length': '0'} 2023-12-15T23:09:48.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053203eb28768d2f5-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.645 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:48.645 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.645 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.645 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.645 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.645 DEBUG:boto:Method: GET 2023-12-15T23:09:48.645 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.646 DEBUG:boto:Data: 2023-12-15T23:09:48.646 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.646 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.646 DEBUG:boto:Params: {} 2023-12-15T23:09:48.646 DEBUG:boto:Token: None 2023-12-15T23:09:48.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw= 2023-12-15T23:09:48.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw=', 'Content-Length': '0'} 2023-12-15T23:09:48.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000995e5fdb205770cf-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.689 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.689 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.690 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.690 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:09:48.690 DEBUG:boto:Method: GET 2023-12-15T23:09:48.690 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.690 DEBUG:boto:Data: 2023-12-15T23:09:48.690 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.690 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.690 DEBUG:boto:Params: {} 2023-12-15T23:09:48.690 DEBUG:boto:Token: None 2023-12-15T23:09:48.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:09:48.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw= 2023-12-15T23:09:48.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:flMGgljQUAKCvawb57imxZ92Duw=', 'Content-Length': '0'} 2023-12-15T23:09:48.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000953b2f096c2fd9dc-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.693 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.693 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.693 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.693 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.693 DEBUG:boto:Method: GET 2023-12-15T23:09:48.693 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:48.694 DEBUG:boto:Data: 2023-12-15T23:09:48.694 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.694 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.694 DEBUG:boto:Params: {} 2023-12-15T23:09:48.694 DEBUG:boto:Token: None 2023-12-15T23:09:48.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043b73a5455d12455-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.697 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.697 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.697 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.697 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.697 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.698 DEBUG:boto:Method: GET 2023-12-15T23:09:48.698 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:48.698 DEBUG:boto:Data: 2023-12-15T23:09:48.698 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.698 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.698 DEBUG:boto:Params: {} 2023-12-15T23:09:48.698 DEBUG:boto:Token: None 2023-12-15T23:09:48.698 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb9cbbbbcf62fa82-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.701 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.701 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.701 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.702 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.702 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:48.702 DEBUG:boto:Data: 2023-12-15T23:09:48.702 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.702 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.702 DEBUG:boto:Params: {} 2023-12-15T23:09:48.702 DEBUG:boto:Token: None 2023-12-15T23:09:48.702 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f 2023-12-15T23:09:48.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRNLySt/wTK+zemlGxZo2gBrYjA= 2023-12-15T23:09:48.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRNLySt/wTK+zemlGxZo2gBrYjA=', 'Content-Length': '0'} 2023-12-15T23:09:48.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e1c8578ec8c3292-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.705 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.705 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.705 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.705 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:48.705 DEBUG:boto:Data: 2023-12-15T23:09:48.705 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.705 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.705 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.705 DEBUG:boto:Params: {} 2023-12-15T23:09:48.706 DEBUG:boto:Token: None 2023-12-15T23:09:48.706 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f 2023-12-15T23:09:48.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRNLySt/wTK+zemlGxZo2gBrYjA= 2023-12-15T23:09:48.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRNLySt/wTK+zemlGxZo2gBrYjA=', 'Content-Length': '0'} 2023-12-15T23:09:48.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d4f52f330620b9b-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:09:48.708 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.708 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.708 DEBUG:boto:Method: GET 2023-12-15T23:09:48.708 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:48.708 DEBUG:boto:Data: 2023-12-15T23:09:48.708 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.708 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.708 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.709 DEBUG:boto:Params: {} 2023-12-15T23:09:48.709 DEBUG:boto:Token: None 2023-12-15T23:09:48.709 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f 2023-12-15T23:09:48.709 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CeMDiGtiL0kPyf8IH5sF1+VdS14= 2023-12-15T23:09:48.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CeMDiGtiL0kPyf8IH5sF1+VdS14=', 'Content-Length': '0'} 2023-12-15T23:09:48.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e54bdb4919277b6f-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.753 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:09:48.754 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:09:48.754 DEBUG:boto:Method: GET 2023-12-15T23:09:48.754 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:09:48.754 DEBUG:boto:Data: 2023-12-15T23:09:48.754 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.754 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.754 DEBUG:boto:Params: {} 2023-12-15T23:09:48.754 DEBUG:boto:Token: None 2023-12-15T23:09:48.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/f 2023-12-15T23:09:48.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CeMDiGtiL0kPyf8IH5sF1+VdS14= 2023-12-15T23:09:48.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CeMDiGtiL0kPyf8IH5sF1+VdS14=', 'Content-Length': '0'} 2023-12-15T23:09:48.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c344020e3ebcb1e-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.757 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.757 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.757 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.757 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.757 DEBUG:boto:Method: GET 2023-12-15T23:09:48.757 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:48.757 DEBUG:boto:Data: 2023-12-15T23:09:48.757 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.757 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.758 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.758 DEBUG:boto:Params: {} 2023-12-15T23:09:48.758 DEBUG:boto:Token: None 2023-12-15T23:09:48.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.760 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dac0cccbe490ac1-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.761 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.761 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.761 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.761 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.761 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:09:48.761 DEBUG:boto:Method: GET 2023-12-15T23:09:48.761 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:09:48.761 DEBUG:boto:Data: 2023-12-15T23:09:48.762 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.762 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.762 DEBUG:boto:Params: {} 2023-12-15T23:09:48.762 DEBUG:boto:Token: None 2023-12-15T23:09:48.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000376810bcc4a649c3-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.764 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:48.765 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.765 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.765 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.765 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.765 DEBUG:boto:Method: GET 2023-12-15T23:09:48.765 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.765 DEBUG:boto:Data: 2023-12-15T23:09:48.766 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.766 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.766 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.766 DEBUG:boto:Params: {} 2023-12-15T23:09:48.766 DEBUG:boto:Token: None 2023-12-15T23:09:48.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM= 2023-12-15T23:09:48.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM=', 'Content-Length': '0'} 2023-12-15T23:09:48.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f9190767d01bdf7-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.809 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.810 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.810 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.810 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.810 DEBUG:boto:Method: GET 2023-12-15T23:09:48.810 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.810 DEBUG:boto:Data: 2023-12-15T23:09:48.810 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.810 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.810 DEBUG:boto:Params: {} 2023-12-15T23:09:48.811 DEBUG:boto:Token: None 2023-12-15T23:09:48.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM= 2023-12-15T23:09:48.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM=', 'Content-Length': '0'} 2023-12-15T23:09:48.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006974b0f6b24aff2a-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.813 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.813 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.813 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.813 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.814 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.814 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.814 DEBUG:boto:Data: 2023-12-15T23:09:48.814 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.814 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.814 DEBUG:boto:Params: {} 2023-12-15T23:09:48.814 DEBUG:boto:Token: None 2023-12-15T23:09:48.814 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PX/T3IHa2+cxIpKanldupDs8kOs= 2023-12-15T23:09:48.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PX/T3IHa2+cxIpKanldupDs8kOs=', 'Content-Length': '0'} 2023-12-15T23:09:48.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050ab42dcf4b9c439-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.816 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.817 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.817 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.817 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.817 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.817 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.817 DEBUG:boto:Data: 2023-12-15T23:09:48.817 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.817 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.817 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.817 DEBUG:boto:Params: {} 2023-12-15T23:09:48.818 DEBUG:boto:Token: None 2023-12-15T23:09:48.818 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PX/T3IHa2+cxIpKanldupDs8kOs= 2023-12-15T23:09:48.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PX/T3IHa2+cxIpKanldupDs8kOs=', 'Content-Length': '0'} 2023-12-15T23:09:48.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f2428cf0158279d-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.820 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:48.820 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.820 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.820 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.820 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.820 DEBUG:boto:Method: GET 2023-12-15T23:09:48.820 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.821 DEBUG:boto:Data: 2023-12-15T23:09:48.821 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.821 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.821 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.821 DEBUG:boto:Params: {} 2023-12-15T23:09:48.821 DEBUG:boto:Token: None 2023-12-15T23:09:48.821 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.821 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM= 2023-12-15T23:09:48.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM=', 'Content-Length': '0'} 2023-12-15T23:09:48.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e4a2dca9709f90-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.865 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.866 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.866 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.866 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:09:48.866 DEBUG:boto:Method: GET 2023-12-15T23:09:48.866 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.866 DEBUG:boto:Data: 2023-12-15T23:09:48.866 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.866 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.866 DEBUG:boto:Params: {} 2023-12-15T23:09:48.866 DEBUG:boto:Token: None 2023-12-15T23:09:48.867 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:09:48.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM= 2023-12-15T23:09:48.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fvEIJF5TfZqxFWTFvDrXhLsCZiM=', 'Content-Length': '0'} 2023-12-15T23:09:48.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008abff71856f35da-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.869 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.870 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.870 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.870 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.870 DEBUG:boto:Method: GET 2023-12-15T23:09:48.870 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:48.870 DEBUG:boto:Data: 2023-12-15T23:09:48.870 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.871 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.871 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.871 DEBUG:boto:Params: {} 2023-12-15T23:09:48.871 DEBUG:boto:Token: None 2023-12-15T23:09:48.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aaf80b04d9597b01-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.874 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.875 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.875 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.875 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.875 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.875 DEBUG:boto:Method: GET 2023-12-15T23:09:48.875 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:48.875 DEBUG:boto:Data: 2023-12-15T23:09:48.875 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.875 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.876 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.876 DEBUG:boto:Params: {} 2023-12-15T23:09:48.876 DEBUG:boto:Token: None 2023-12-15T23:09:48.876 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.876 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.878 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3ab4d7ef82f18c8-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.878 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.879 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.879 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.879 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.879 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:48.879 DEBUG:boto:Data: 2023-12-15T23:09:48.879 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.879 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.880 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.880 DEBUG:boto:Params: {} 2023-12-15T23:09:48.880 DEBUG:boto:Token: None 2023-12-15T23:09:48.880 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g 2023-12-15T23:09:48.880 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PCXSwazxorKLbYGQwyNjGTnfEi4= 2023-12-15T23:09:48.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PCXSwazxorKLbYGQwyNjGTnfEi4=', 'Content-Length': '0'} 2023-12-15T23:09:48.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfd0e473574bf5d4-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.883 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.883 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.883 DEBUG:boto:Method: HEAD 2023-12-15T23:09:48.883 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:48.883 DEBUG:boto:Data: 2023-12-15T23:09:48.883 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.883 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.883 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.883 DEBUG:boto:Params: {} 2023-12-15T23:09:48.884 DEBUG:boto:Token: None 2023-12-15T23:09:48.884 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g 2023-12-15T23:09:48.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PCXSwazxorKLbYGQwyNjGTnfEi4= 2023-12-15T23:09:48.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PCXSwazxorKLbYGQwyNjGTnfEi4=', 'Content-Length': '0'} 2023-12-15T23:09:48.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004440ca49623f20b4-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:09:48.886 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.886 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.887 DEBUG:boto:Method: GET 2023-12-15T23:09:48.887 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:48.887 DEBUG:boto:Data: 2023-12-15T23:09:48.887 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.887 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.887 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.887 DEBUG:boto:Params: {} 2023-12-15T23:09:48.887 DEBUG:boto:Token: None 2023-12-15T23:09:48.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g 2023-12-15T23:09:48.888 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v/oINwTroD52Z7s2Y32xu2lhB/w= 2023-12-15T23:09:48.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v/oINwTroD52Z7s2Y32xu2lhB/w=', 'Content-Length': '0'} 2023-12-15T23:09:48.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d5adc7dfb3a2e2-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.933 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:09:48.934 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:09:48.934 DEBUG:boto:Method: GET 2023-12-15T23:09:48.934 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:09:48.934 DEBUG:boto:Data: 2023-12-15T23:09:48.934 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.934 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.934 DEBUG:boto:Params: {} 2023-12-15T23:09:48.935 DEBUG:boto:Token: None 2023-12-15T23:09:48.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/g 2023-12-15T23:09:48.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v/oINwTroD52Z7s2Y32xu2lhB/w= 2023-12-15T23:09:48.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v/oINwTroD52Z7s2Y32xu2lhB/w=', 'Content-Length': '0'} 2023-12-15T23:09:48.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcf6d8a23039399d-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.937 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.937 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.938 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.938 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.938 DEBUG:boto:Method: GET 2023-12-15T23:09:48.938 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:48.938 DEBUG:boto:Data: 2023-12-15T23:09:48.938 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.938 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.938 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.939 DEBUG:boto:Params: {} 2023-12-15T23:09:48.939 DEBUG:boto:Token: None 2023-12-15T23:09:48.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a4a577f2443e5f9-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.941 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.942 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:48.942 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:48.942 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.942 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:09:48.942 DEBUG:boto:Method: GET 2023-12-15T23:09:48.942 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:09:48.942 DEBUG:boto:Data: 2023-12-15T23:09:48.942 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.943 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.943 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.943 DEBUG:boto:Params: {} 2023-12-15T23:09:48.943 DEBUG:boto:Token: None 2023-12-15T23:09:48.943 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/ 2023-12-15T23:09:48.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y= 2023-12-15T23:09:48.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+5frxfHGaefpIknuwDseL8Jpj5Y=', 'Content-Length': '0'} 2023-12-15T23:09:48.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f4e1a47a407e994-00657cdcbc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.946 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:48.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:48.946 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:48.946 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:48.946 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:48.947 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:48.947 DEBUG:boto:Method: GET 2023-12-15T23:09:48.947 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:48.947 DEBUG:boto:Data: 2023-12-15T23:09:48.947 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.947 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:48.947 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.947 DEBUG:boto:Params: {} 2023-12-15T23:09:48.947 DEBUG:boto:Token: None 2023-12-15T23:09:48.948 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:48.948 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a9AVmenjxY1NurdhTBgpZsA5uQk= 2023-12-15T23:09:48.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a9AVmenjxY1NurdhTBgpZsA5uQk=', 'Content-Length': '0'} 2023-12-15T23:09:48.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a513d9c6e0303d64-00657cdcbc-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:48.997 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:48.998 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:48.998 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:48.998 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:48.998 DEBUG:boto:Method: GET 2023-12-15T23:09:48.998 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:48.998 DEBUG:boto:Data: 2023-12-15T23:09:48.998 DEBUG:boto:Headers: {} 2023-12-15T23:09:48.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:48.999 DEBUG:boto:Port: 8000 2023-12-15T23:09:48.999 DEBUG:boto:Params: {} 2023-12-15T23:09:48.999 DEBUG:boto:Token: None 2023-12-15T23:09:48.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:48 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:48.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a9AVmenjxY1NurdhTBgpZsA5uQk= 2023-12-15T23:09:48.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a9AVmenjxY1NurdhTBgpZsA5uQk=', 'Content-Length': '0'} 2023-12-15T23:09:49.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9c172b52fa1db49-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.002 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.002 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.002 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.002 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.002 DEBUG:boto:Method: HEAD 2023-12-15T23:09:49.002 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.002 DEBUG:boto:Data: 2023-12-15T23:09:49.003 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.003 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.003 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.003 DEBUG:boto:Params: {} 2023-12-15T23:09:49.003 DEBUG:boto:Token: None 2023-12-15T23:09:49.003 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Ikun+jPSBpI3lcuDoTQDjAwd+U= 2023-12-15T23:09:49.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Ikun+jPSBpI3lcuDoTQDjAwd+U=', 'Content-Length': '0'} 2023-12-15T23:09:49.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095f1a98e01a11264-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.006 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.006 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.006 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.006 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.006 DEBUG:boto:Method: HEAD 2023-12-15T23:09:49.006 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.006 DEBUG:boto:Data: 2023-12-15T23:09:49.007 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.007 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.007 DEBUG:boto:Params: {} 2023-12-15T23:09:49.007 DEBUG:boto:Token: None 2023-12-15T23:09:49.007 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Ikun+jPSBpI3lcuDoTQDjAwd+U= 2023-12-15T23:09:49.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Ikun+jPSBpI3lcuDoTQDjAwd+U=', 'Content-Length': '0'} 2023-12-15T23:09:49.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f73a5367cf8e23ca-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:49.010 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.010 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.010 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.010 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.010 DEBUG:boto:Method: GET 2023-12-15T23:09:49.011 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.011 DEBUG:boto:Data: 2023-12-15T23:09:49.011 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.011 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.011 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.011 DEBUG:boto:Params: {} 2023-12-15T23:09:49.011 DEBUG:boto:Token: None 2023-12-15T23:09:49.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.012 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iFJ5ZE8uSRGywHO4/hYZk6rWCE= 2023-12-15T23:09:49.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iFJ5ZE8uSRGywHO4/hYZk6rWCE=', 'Content-Length': '0'} 2023-12-15T23:09:49.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da20182bf9a8f0f2-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.057 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.058 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.058 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.058 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:09:49.058 DEBUG:boto:Method: GET 2023-12-15T23:09:49.058 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.058 DEBUG:boto:Data: 2023-12-15T23:09:49.058 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.058 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.058 DEBUG:boto:Params: {} 2023-12-15T23:09:49.059 DEBUG:boto:Token: None 2023-12-15T23:09:49.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:09:49.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iFJ5ZE8uSRGywHO4/hYZk6rWCE= 2023-12-15T23:09:49.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iFJ5ZE8uSRGywHO4/hYZk6rWCE=', 'Content-Length': '0'} 2023-12-15T23:09:49.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039dc3fcd6e51588c-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.061 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:49.061 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:49.062 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.062 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.062 DEBUG:boto:Method: GET 2023-12-15T23:09:49.062 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:49.062 DEBUG:boto:Data: 2023-12-15T23:09:49.062 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.062 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.062 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.062 DEBUG:boto:Params: {} 2023-12-15T23:09:49.062 DEBUG:boto:Token: None 2023-12-15T23:09:49.062 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/ 2023-12-15T23:09:49.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA= 2023-12-15T23:09:49.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA=', 'Content-Length': '0'} 2023-12-15T23:09:49.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008afefee9aa29861c-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.065 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:49.065 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:49.066 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:49.066 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.066 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.066 DEBUG:boto:Method: GET 2023-12-15T23:09:49.066 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:49.066 DEBUG:boto:Data: 2023-12-15T23:09:49.066 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.066 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.066 DEBUG:boto:Params: {} 2023-12-15T23:09:49.066 DEBUG:boto:Token: None 2023-12-15T23:09:49.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/ 2023-12-15T23:09:49.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA= 2023-12-15T23:09:49.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA=', 'Content-Length': '0'} 2023-12-15T23:09:49.069 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056c7d0ea55abc2e5-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.069 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:49.069 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.070 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.070 DEBUG:boto:Method: HEAD 2023-12-15T23:09:49.070 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:49.070 DEBUG:boto:Data: 2023-12-15T23:09:49.070 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.070 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.070 DEBUG:boto:Params: {} 2023-12-15T23:09:49.070 DEBUG:boto:Token: None 2023-12-15T23:09:49.071 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h 2023-12-15T23:09:49.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mzd3B4BvD6qhqhh6mw+k3LWNlgc= 2023-12-15T23:09:49.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mzd3B4BvD6qhqhh6mw+k3LWNlgc=', 'Content-Length': '0'} 2023-12-15T23:09:49.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005a35d1e39df8c1a-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.073 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.073 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.073 DEBUG:boto:Method: HEAD 2023-12-15T23:09:49.073 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:49.073 DEBUG:boto:Data: 2023-12-15T23:09:49.073 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.073 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.074 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.074 DEBUG:boto:Params: {} 2023-12-15T23:09:49.074 DEBUG:boto:Token: None 2023-12-15T23:09:49.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h 2023-12-15T23:09:49.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mzd3B4BvD6qhqhh6mw+k3LWNlgc= 2023-12-15T23:09:49.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mzd3B4BvD6qhqhh6mw+k3LWNlgc=', 'Content-Length': '0'} 2023-12-15T23:09:49.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058e1398ff190b563-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:09:49.077 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.077 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.077 DEBUG:boto:Method: GET 2023-12-15T23:09:49.077 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:49.077 DEBUG:boto:Data: 2023-12-15T23:09:49.077 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.077 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.077 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.078 DEBUG:boto:Params: {} 2023-12-15T23:09:49.078 DEBUG:boto:Token: None 2023-12-15T23:09:49.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h 2023-12-15T23:09:49.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aqNg/EIakpr/ggS5XArNRPJYJgM= 2023-12-15T23:09:49.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aqNg/EIakpr/ggS5XArNRPJYJgM=', 'Content-Length': '0'} 2023-12-15T23:09:49.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009495e7bf28ee1e29-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.121 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:09:49.122 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:09:49.122 DEBUG:boto:Method: GET 2023-12-15T23:09:49.122 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:09:49.122 DEBUG:boto:Data: 2023-12-15T23:09:49.122 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.122 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.122 DEBUG:boto:Params: {} 2023-12-15T23:09:49.122 DEBUG:boto:Token: None 2023-12-15T23:09:49.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/h 2023-12-15T23:09:49.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aqNg/EIakpr/ggS5XArNRPJYJgM= 2023-12-15T23:09:49.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aqNg/EIakpr/ggS5XArNRPJYJgM=', 'Content-Length': '0'} 2023-12-15T23:09:49.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048631faca5ddbe35-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.126 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:49.126 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:49.126 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.126 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.126 DEBUG:boto:Method: GET 2023-12-15T23:09:49.126 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:49.126 DEBUG:boto:Data: 2023-12-15T23:09:49.126 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:09:49.127 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.127 DEBUG:boto:Params: {} 2023-12-15T23:09:49.127 DEBUG:boto:Token: None 2023-12-15T23:09:49.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/ 2023-12-15T23:09:49.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA= 2023-12-15T23:09:49.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA=', 'Content-Length': '0'} 2023-12-15T23:09:49.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e566b3cfddda496-00657cdcbd-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.129 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:49.130 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:49.130 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:49.130 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.130 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:09:49.130 DEBUG:boto:Method: GET 2023-12-15T23:09:49.130 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:09:49.130 DEBUG:boto:Data: 2023-12-15T23:09:49.130 DEBUG:boto:Headers: {} 2023-12-15T23:09:49.131 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:49.131 DEBUG:boto:Port: 8000 2023-12-15T23:09:49.131 DEBUG:boto:Params: {} 2023-12-15T23:09:49.131 DEBUG:boto:Token: None 2023-12-15T23:09:49.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:09:49 GMT /kskgfn-45/ 2023-12-15T23:09:49.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA= 2023-12-15T23:09:49.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S5V+1HHu1Piu8+sn6yFJBXg2DfA=', 'Content-Length': '0'} 2023-12-15T23:09:49.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006986b76470cb2509-00657cdcbd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:49.133 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:09:49.134 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:09:49.134 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.134 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:49.183 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:49.183 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:49.336 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.335+0000 7f4f49f2e640 -1 req 439979590040032951 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.342 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.342+0000 7f4f41f1e640 -1 req 12327574660359595474 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-32:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-32:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.385 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.385+0000 7f4ef6e88640 -1 req 3493378763112464458 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-5:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.9,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-5:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.9,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.429 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.429+0000 7f4f1ded6640 -1 req 4849843994774779882 0.000999982s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-4:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.4,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-4:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.4,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.500 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.501 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:49.543 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:49.543 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:49.584 INFO:teuthology.orchestra.run.smithi093.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":3,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2023-12-15T23:09:49.584 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.584 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:49.773 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.772+0000 7f4eec673640 -1 req 146191419767001454 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-41:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-41:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.775 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.774+0000 7f4ee2e60640 -1 req 7760511001940133497 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-3:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.3,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-3:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.3,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.825 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.824+0000 7f4ed8e4c640 -1 req 11445970619487473816 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-2:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.2,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.863 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.862+0000 7f4eeae70640 -1 req 17564503902400961228 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-31:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-31:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.871 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:49.871+0000 7f4ec862b640 -1 req 5262036619034151938 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-30:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-30:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:49.935 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:49.935 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:50.017 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:50.017 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:50.058 INFO:teuthology.orchestra.run.smithi093.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":3,"hash_type":"Mod"}}},"logs":[{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":3,"hash_type":"Mod"}}}}]}} 2023-12-15T23:09:50.059 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:50.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:09:50.059 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:09:50.140 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:50.140 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:50.214 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.213+0000 7f4e895ad640 -1 req 16803034459992742680 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-1:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.1,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.214 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.213+0000 7f4eab5f1640 -1 req 1875364013792115921 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.216 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.215+0000 7f4ea7dea640 -1 req 6689962127314875793 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-22:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.26,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-22:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.26,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.218 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.218+0000 7f4f6df76640 -1 req 7978423059132981456 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-24:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.28,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-24:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.28,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.219 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.218+0000 7f4e7ed98640 -1 req 12511381756046142775 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-21:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.25,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-21:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.25,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.261 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.260+0000 7f4e7ad90640 -1 req 9195833251259101211 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-19:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.23,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-19:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.23,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.304 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.303+0000 7f4f51f3e640 -1 req 3781942472808113711 0.000000000s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-23:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.27,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-23:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.27,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.306 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:09:50.306+0000 7f4f57f4a640 -1 req 14592433124866669720 0.000999981s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=kskgfn-20:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4346.24,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} returned ret=-2 2023-12-15T23:09:50.368 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:50.368 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:50.368 DEBUG:boto:Method: HEAD 2023-12-15T23:09:50.368 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:50.369 DEBUG:boto:Data: 2023-12-15T23:09:50.369 DEBUG:boto:Headers: {} 2023-12-15T23:09:50.369 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.369 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.369 DEBUG:boto:Params: {} 2023-12-15T23:09:50.369 DEBUG:boto:Token: None 2023-12-15T23:09:50.369 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/ 2023-12-15T23:09:50.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4= 2023-12-15T23:09:50.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4=', 'Content-Length': '0'} 2023-12-15T23:09:50.372 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fe5315b20822741b-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.372 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:09:50.372 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:09:50.372 DEBUG:boto:Method: PUT 2023-12-15T23:09:50.372 DEBUG:boto:Path: /kskgfn-45/i 2023-12-15T23:09:50.372 DEBUG:boto:Data: 2023-12-15T23:09:50.372 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:50.373 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.373 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.373 DEBUG:boto:Params: {} 2023-12-15T23:09:50.373 DEBUG:boto:Token: None 2023-12-15T23:09:50.373 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/i 2023-12-15T23:09:50.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7/OCs+3BLUeqniicbaVx4LnIyG0= 2023-12-15T23:09:50.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7/OCs+3BLUeqniicbaVx4LnIyG0='} 2023-12-15T23:09:50.378 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000229fb1913a072db9-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.378 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:50.378 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:50.378 DEBUG:boto:Method: HEAD 2023-12-15T23:09:50.378 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:50.378 DEBUG:boto:Data: 2023-12-15T23:09:50.379 DEBUG:boto:Headers: {} 2023-12-15T23:09:50.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.379 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.379 DEBUG:boto:Params: {} 2023-12-15T23:09:50.379 DEBUG:boto:Token: None 2023-12-15T23:09:50.379 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/ 2023-12-15T23:09:50.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4= 2023-12-15T23:09:50.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4=', 'Content-Length': '0'} 2023-12-15T23:09:50.381 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4776832c4da04a3-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.381 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:09:50.381 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:09:50.381 DEBUG:boto:Method: PUT 2023-12-15T23:09:50.381 DEBUG:boto:Path: /kskgfn-45/j 2023-12-15T23:09:50.381 DEBUG:boto:Data: 2023-12-15T23:09:50.381 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:50.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.382 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.382 DEBUG:boto:Params: {} 2023-12-15T23:09:50.382 DEBUG:boto:Token: None 2023-12-15T23:09:50.382 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/j 2023-12-15T23:09:50.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7YGz9oIpYQBSIjx+5wXoTjokkIc= 2023-12-15T23:09:50.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7YGz9oIpYQBSIjx+5wXoTjokkIc='} 2023-12-15T23:09:50.425 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af41fc87ed4f5845-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.426 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:50.426 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:50.426 DEBUG:boto:Method: HEAD 2023-12-15T23:09:50.426 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:50.426 DEBUG:boto:Data: 2023-12-15T23:09:50.426 DEBUG:boto:Headers: {} 2023-12-15T23:09:50.426 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.426 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.426 DEBUG:boto:Params: {} 2023-12-15T23:09:50.426 DEBUG:boto:Token: None 2023-12-15T23:09:50.427 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/ 2023-12-15T23:09:50.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4= 2023-12-15T23:09:50.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4=', 'Content-Length': '0'} 2023-12-15T23:09:50.428 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000082cf499ee299b508-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.429 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:09:50.429 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:09:50.429 DEBUG:boto:Method: PUT 2023-12-15T23:09:50.429 DEBUG:boto:Path: /kskgfn-45/k 2023-12-15T23:09:50.429 DEBUG:boto:Data: 2023-12-15T23:09:50.429 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:50.429 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.429 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.429 DEBUG:boto:Params: {} 2023-12-15T23:09:50.429 DEBUG:boto:Token: None 2023-12-15T23:09:50.430 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/k 2023-12-15T23:09:50.430 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:80o4FB5prQrf5MWac5exIawuXlE= 2023-12-15T23:09:50.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:80o4FB5prQrf5MWac5exIawuXlE='} 2023-12-15T23:09:50.435 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000da2b852155b81075-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.435 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:09:50.435 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:09:50.435 DEBUG:boto:Method: HEAD 2023-12-15T23:09:50.435 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:09:50.435 DEBUG:boto:Data: 2023-12-15T23:09:50.435 DEBUG:boto:Headers: {} 2023-12-15T23:09:50.436 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.436 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.436 DEBUG:boto:Params: {} 2023-12-15T23:09:50.436 DEBUG:boto:Token: None 2023-12-15T23:09:50.436 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/ 2023-12-15T23:09:50.436 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4= 2023-12-15T23:09:50.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D/6S4td7yOG6ivLYCx/IP7qQRT4=', 'Content-Length': '0'} 2023-12-15T23:09:50.438 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ce4f26b423cdded-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.438 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:09:50.438 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:09:50.439 DEBUG:boto:Method: PUT 2023-12-15T23:09:50.439 DEBUG:boto:Path: /kskgfn-45/l 2023-12-15T23:09:50.439 DEBUG:boto:Data: 2023-12-15T23:09:50.439 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:09:50.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:09:50.439 DEBUG:boto:Port: 8000 2023-12-15T23:09:50.439 DEBUG:boto:Params: {} 2023-12-15T23:09:50.439 DEBUG:boto:Token: None 2023-12-15T23:09:50.439 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:09:50 GMT /kskgfn-45/l 2023-12-15T23:09:50.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0ejDl62hUQuzPoqWRx0hP0IyHp8= 2023-12-15T23:09:50.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:09:50 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0ejDl62hUQuzPoqWRx0hP0IyHp8='} 2023-12-15T23:09:50.485 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cc68b502aae7fc61-00657cdcbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:09:50.486 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-45 2023-12-15T23:09:50.486 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:50.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:09:50.486 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:09:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:09:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:09:50.583 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:50.582+0000 7ff004f29800 1 waiting for incremental sync to catch up: 2023-12-15T23:09:50.583 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , ] 2023-12-15T23:09:50.583 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000002.27.6, 00000000003.45.6] 2023-12-15T23:09:55.584 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:09:55.583+0000 7ff004f29800 1 waiting for incremental sync to catch up: 2023-12-15T23:09:55.585 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000002.43.6, 00000000002.27.6, ] 2023-12-15T23:09:55.585 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000002.27.6, 00000000003.45.6] 2023-12-15T23:10:00.585 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:00.584+0000 7ff004f29800 1 bucket sync caught up with source: 2023-12-15T23:10:00.586 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000002.43.6, 00000000002.27.6, 00000000003.45.6] 2023-12-15T23:10:00.586 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000002.27.6, 00000000003.45.6] 2023-12-15T23:10:00.586 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:00.584+0000 7ff004f29800 0 bucket checkpoint complete 2023-12-15T23:10:00.604 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-45 2023-12-15T23:10:00.604 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:00.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:00.605 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:10:00.667 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:00.667 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:00.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:10:00.703+0000 7fdde440f800 1 bucket sync caught up with source: 2023-12-15T23:10:00.705 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.81.6, 00000000002.123.6, 00000000001.59.6, , 00000000002.89.6, 00000000001.95.6, 00000000001.70.6, , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:10:00.705 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.81.6, 00000000002.123.6, 00000000001.59.6, , 00000000002.89.6, 00000000001.95.6, 00000000001.70.6, , 00000000002.79.6, , 00000000002.63.6] 2023-12-15T23:10:00.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:10:00.703+0000 7fdde440f800 0 bucket checkpoint complete 2023-12-15T23:10:00.720 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:10:00.720 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.720 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.720 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.720 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:10:00.720 DEBUG:boto:Data: 2023-12-15T23:10:00.720 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.720 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.720 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.721 DEBUG:boto:Params: {} 2023-12-15T23:10:00.721 DEBUG:boto:Token: None 2023-12-15T23:10:00.721 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.721 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BevKavK4UGZPep3+wGQEjWICHwo= 2023-12-15T23:10:00.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BevKavK4UGZPep3+wGQEjWICHwo=', 'Content-Length': '0'} 2023-12-15T23:10:00.723 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001fa2e95a82816768-00657cdcc8-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.724 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.724 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.724 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.724 DEBUG:boto:Path: /kskgfn-45/ 2023-12-15T23:10:00.724 DEBUG:boto:Data: 2023-12-15T23:10:00.724 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.724 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.724 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.724 DEBUG:boto:Params: {} 2023-12-15T23:10:00.725 DEBUG:boto:Token: None 2023-12-15T23:10:00.725 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.725 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BevKavK4UGZPep3+wGQEjWICHwo= 2023-12-15T23:10:00.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BevKavK4UGZPep3+wGQEjWICHwo=', 'Content-Length': '0'} 2023-12-15T23:10:00.727 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4a1fbdd9ab8f397-00657cdcc8-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.727 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:10:00.727 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.727 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.728 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.728 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.728 DEBUG:boto:Method: GET 2023-12-15T23:10:00.728 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.728 DEBUG:boto:Data: 2023-12-15T23:10:00.728 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.728 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.728 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.728 DEBUG:boto:Params: {} 2023-12-15T23:10:00.728 DEBUG:boto:Token: None 2023-12-15T23:10:00.729 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/?versions 2023-12-15T23:10:00.729 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs= 2023-12-15T23:10:00.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs=', 'Content-Length': '0'} 2023-12-15T23:10:00.731 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094cc5e93177af3a9-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.731 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.732 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:10:00.732 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=i 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=j 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=k 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:o=l 2023-12-15T23:10:00.733 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:10:00.734 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.734 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.734 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.734 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.734 DEBUG:boto:Method: GET 2023-12-15T23:10:00.734 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.734 DEBUG:boto:Data: 2023-12-15T23:10:00.734 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.734 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.734 DEBUG:boto:Params: {} 2023-12-15T23:10:00.735 DEBUG:boto:Token: None 2023-12-15T23:10:00.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/?versions 2023-12-15T23:10:00.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs= 2023-12-15T23:10:00.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs=', 'Content-Length': '0'} 2023-12-15T23:10:00.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000844a5384c63b4509-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.737 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:10:00.738 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:10:00.739 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:10:00.739 DEBUG:tasks.rgw_multi.zone_rados:o=i 2023-12-15T23:10:00.739 DEBUG:tasks.rgw_multi.zone_rados:o=j 2023-12-15T23:10:00.739 DEBUG:tasks.rgw_multi.zone_rados:o=k 2023-12-15T23:10:00.739 DEBUG:tasks.rgw_multi.zone_rados:o=l 2023-12-15T23:10:00.739 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.739 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.739 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.739 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.739 DEBUG:boto:Method: GET 2023-12-15T23:10:00.739 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.740 DEBUG:boto:Data: 2023-12-15T23:10:00.740 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.740 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.740 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.740 DEBUG:boto:Params: {} 2023-12-15T23:10:00.740 DEBUG:boto:Token: None 2023-12-15T23:10:00.740 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/?versions 2023-12-15T23:10:00.740 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs= 2023-12-15T23:10:00.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs=', 'Content-Length': '0'} 2023-12-15T23:10:00.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a744ca948d8f4530-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.743 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.743 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.744 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.744 DEBUG:boto:path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.744 DEBUG:boto:auth_path=/kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.744 DEBUG:boto:Method: GET 2023-12-15T23:10:00.744 DEBUG:boto:Path: /kskgfn-45/?versions&max-keys=999 2023-12-15T23:10:00.744 DEBUG:boto:Data: 2023-12-15T23:10:00.744 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.744 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.744 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.744 DEBUG:boto:Params: {} 2023-12-15T23:10:00.745 DEBUG:boto:Token: None 2023-12-15T23:10:00.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/?versions 2023-12-15T23:10:00.745 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs= 2023-12-15T23:10:00.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SMLIAvrcfclZaT2qFKUKHEIUiAs=', 'Content-Length': '0'} 2023-12-15T23:10:00.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bf2a927a0b67702-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.747 DEBUG:boto:b'kskgfn-45999falseanulltrue2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalinulltrue2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaljnulltrue2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalknulltrue2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormallnulltrue2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:00.748 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.748 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.748 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.748 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.749 DEBUG:boto:Method: GET 2023-12-15T23:10:00.749 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.749 DEBUG:boto:Data: 2023-12-15T23:10:00.749 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.749 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.749 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.749 DEBUG:boto:Params: {} 2023-12-15T23:10:00.749 DEBUG:boto:Token: None 2023-12-15T23:10:00.749 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0= 2023-12-15T23:10:00.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0=', 'Content-Length': '0'} 2023-12-15T23:10:00.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0435c89cbd5cdd2-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.793 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.794 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.794 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.794 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.794 DEBUG:boto:Method: GET 2023-12-15T23:10:00.794 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.794 DEBUG:boto:Data: 2023-12-15T23:10:00.794 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.794 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.794 DEBUG:boto:Params: {} 2023-12-15T23:10:00.795 DEBUG:boto:Token: None 2023-12-15T23:10:00.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0= 2023-12-15T23:10:00.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0=', 'Content-Length': '0'} 2023-12-15T23:10:00.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000600a3cc3800f45c4-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.797 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.797 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.797 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.797 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.797 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.798 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.798 DEBUG:boto:Data: 2023-12-15T23:10:00.798 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.798 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.798 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.798 DEBUG:boto:Params: {} 2023-12-15T23:10:00.798 DEBUG:boto:Token: None 2023-12-15T23:10:00.798 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZQW1qYDhiZhh2JioZ3TNdYLagZE= 2023-12-15T23:10:00.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZQW1qYDhiZhh2JioZ3TNdYLagZE=', 'Content-Length': '0'} 2023-12-15T23:10:00.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8b4bd9f214add61-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.800 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.801 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.801 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.801 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.801 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.801 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.801 DEBUG:boto:Data: 2023-12-15T23:10:00.801 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.801 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.801 DEBUG:boto:Params: {} 2023-12-15T23:10:00.802 DEBUG:boto:Token: None 2023-12-15T23:10:00.802 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZQW1qYDhiZhh2JioZ3TNdYLagZE= 2023-12-15T23:10:00.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZQW1qYDhiZhh2JioZ3TNdYLagZE=', 'Content-Length': '0'} 2023-12-15T23:10:00.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049e0be48dc57ae7a-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:00.804 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.805 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.805 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.805 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.805 DEBUG:boto:Method: GET 2023-12-15T23:10:00.805 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.805 DEBUG:boto:Data: 2023-12-15T23:10:00.805 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.805 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.805 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.805 DEBUG:boto:Params: {} 2023-12-15T23:10:00.805 DEBUG:boto:Token: None 2023-12-15T23:10:00.806 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.806 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0= 2023-12-15T23:10:00.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0=', 'Content-Length': '0'} 2023-12-15T23:10:00.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000458cb59b9b9c5f62-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.849 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.850 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.850 DEBUG:boto:path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.850 DEBUG:boto:auth_path=/kskgfn-45/a?versionId=null 2023-12-15T23:10:00.850 DEBUG:boto:Method: GET 2023-12-15T23:10:00.850 DEBUG:boto:Path: /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.850 DEBUG:boto:Data: 2023-12-15T23:10:00.850 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.850 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.850 DEBUG:boto:Params: {} 2023-12-15T23:10:00.850 DEBUG:boto:Token: None 2023-12-15T23:10:00.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a?versionId=null 2023-12-15T23:10:00.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0= 2023-12-15T23:10:00.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R4RgBy7NOSs3n/een+rGv/8ANA0=', 'Content-Length': '0'} 2023-12-15T23:10:00.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e150445cb432d17c-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.854 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.854 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.854 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.854 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.854 DEBUG:boto:Method: GET 2023-12-15T23:10:00.854 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:10:00.854 DEBUG:boto:Data: 2023-12-15T23:10:00.854 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.854 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.855 DEBUG:boto:Params: {} 2023-12-15T23:10:00.855 DEBUG:boto:Token: None 2023-12-15T23:10:00.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98= 2023-12-15T23:10:00.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98=', 'Content-Length': '0'} 2023-12-15T23:10:00.857 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fff52997f12aa69e-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.858 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.858 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.858 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.858 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.858 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.858 DEBUG:boto:Method: GET 2023-12-15T23:10:00.859 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:10:00.859 DEBUG:boto:Data: 2023-12-15T23:10:00.859 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.859 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.859 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.859 DEBUG:boto:Params: {} 2023-12-15T23:10:00.859 DEBUG:boto:Token: None 2023-12-15T23:10:00.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98= 2023-12-15T23:10:00.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98=', 'Content-Length': '0'} 2023-12-15T23:10:00.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074494ef7209af7eb-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.861 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.862 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.862 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.862 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.862 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:10:00.862 DEBUG:boto:Data: 2023-12-15T23:10:00.862 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.862 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.862 DEBUG:boto:Params: {} 2023-12-15T23:10:00.863 DEBUG:boto:Token: None 2023-12-15T23:10:00.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a 2023-12-15T23:10:00.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hj1fGySY38YnlAPchKuOdsFDk6o= 2023-12-15T23:10:00.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hj1fGySY38YnlAPchKuOdsFDk6o=', 'Content-Length': '0'} 2023-12-15T23:10:00.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7c2329dde0bf34a-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.865 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.865 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.865 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.865 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:10:00.866 DEBUG:boto:Data: 2023-12-15T23:10:00.866 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.866 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.866 DEBUG:boto:Params: {} 2023-12-15T23:10:00.866 DEBUG:boto:Token: None 2023-12-15T23:10:00.866 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a 2023-12-15T23:10:00.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hj1fGySY38YnlAPchKuOdsFDk6o= 2023-12-15T23:10:00.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hj1fGySY38YnlAPchKuOdsFDk6o=', 'Content-Length': '0'} 2023-12-15T23:10:00.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009de6fd79d87d20c6-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:00.869 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.869 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.869 DEBUG:boto:Method: GET 2023-12-15T23:10:00.869 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:10:00.869 DEBUG:boto:Data: 2023-12-15T23:10:00.870 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.870 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.870 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.870 DEBUG:boto:Params: {} 2023-12-15T23:10:00.870 DEBUG:boto:Token: None 2023-12-15T23:10:00.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a 2023-12-15T23:10:00.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jd6dYaFVONNOp+j4TmAq+VdIj+Y= 2023-12-15T23:10:00.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jd6dYaFVONNOp+j4TmAq+VdIj+Y=', 'Content-Length': '0'} 2023-12-15T23:10:00.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090aed9784bd5e648-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.913 DEBUG:boto:path=/kskgfn-45/a 2023-12-15T23:10:00.914 DEBUG:boto:auth_path=/kskgfn-45/a 2023-12-15T23:10:00.914 DEBUG:boto:Method: GET 2023-12-15T23:10:00.914 DEBUG:boto:Path: /kskgfn-45/a 2023-12-15T23:10:00.914 DEBUG:boto:Data: 2023-12-15T23:10:00.914 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.914 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.914 DEBUG:boto:Params: {} 2023-12-15T23:10:00.914 DEBUG:boto:Token: None 2023-12-15T23:10:00.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/a 2023-12-15T23:10:00.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jd6dYaFVONNOp+j4TmAq+VdIj+Y= 2023-12-15T23:10:00.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jd6dYaFVONNOp+j4TmAq+VdIj+Y=', 'Content-Length': '0'} 2023-12-15T23:10:00.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bfdf950edffd8f5-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.917 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.917 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.917 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.918 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.918 DEBUG:boto:Method: GET 2023-12-15T23:10:00.918 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:10:00.918 DEBUG:boto:Data: 2023-12-15T23:10:00.918 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.918 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.918 DEBUG:boto:Params: {} 2023-12-15T23:10:00.918 DEBUG:boto:Token: None 2023-12-15T23:10:00.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98= 2023-12-15T23:10:00.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98=', 'Content-Length': '0'} 2023-12-15T23:10:00.922 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000308044dd2851b3ed-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.922 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.922 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:00.922 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:00.923 DEBUG:boto:path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.923 DEBUG:boto:auth_path=/kskgfn-45/?prefix=a 2023-12-15T23:10:00.923 DEBUG:boto:Method: GET 2023-12-15T23:10:00.923 DEBUG:boto:Path: /kskgfn-45/?prefix=a 2023-12-15T23:10:00.923 DEBUG:boto:Data: 2023-12-15T23:10:00.923 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.923 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.923 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.923 DEBUG:boto:Params: {} 2023-12-15T23:10:00.923 DEBUG:boto:Token: None 2023-12-15T23:10:00.924 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/ 2023-12-15T23:10:00.924 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98= 2023-12-15T23:10:00.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MRzVkf1qy9+WI2yVKuZTkuI8X98=', 'Content-Length': '0'} 2023-12-15T23:10:00.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049a63ca35b1683e7-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.926 DEBUG:boto:b'kskgfn-45a1000falsea2023-12-15T23:09:13.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:00.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:00.926 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:00.926 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:00.926 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.926 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.926 DEBUG:boto:Method: GET 2023-12-15T23:10:00.927 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.927 DEBUG:boto:Data: 2023-12-15T23:10:00.927 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.927 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.927 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.927 DEBUG:boto:Params: {} 2023-12-15T23:10:00.927 DEBUG:boto:Token: None 2023-12-15T23:10:00.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4= 2023-12-15T23:10:00.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4=', 'Content-Length': '0'} 2023-12-15T23:10:00.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd231b3863173b26-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.973 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:00.974 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:00.974 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.974 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.974 DEBUG:boto:Method: GET 2023-12-15T23:10:00.974 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.974 DEBUG:boto:Data: 2023-12-15T23:10:00.974 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.974 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.974 DEBUG:boto:Params: {} 2023-12-15T23:10:00.975 DEBUG:boto:Token: None 2023-12-15T23:10:00.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4= 2023-12-15T23:10:00.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4=', 'Content-Length': '0'} 2023-12-15T23:10:00.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0b5760b6fdfcadd-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.977 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:00.977 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:00.977 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.977 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.977 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.978 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.978 DEBUG:boto:Data: 2023-12-15T23:10:00.978 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.978 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.978 DEBUG:boto:Params: {} 2023-12-15T23:10:00.978 DEBUG:boto:Token: None 2023-12-15T23:10:00.978 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oUWnZfpsnkSSHslrkqzkPlDZEKc= 2023-12-15T23:10:00.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oUWnZfpsnkSSHslrkqzkPlDZEKc=', 'Content-Length': '0'} 2023-12-15T23:10:00.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005719535fa2fd580a-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.980 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:00.981 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:00.981 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.981 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.981 DEBUG:boto:Method: HEAD 2023-12-15T23:10:00.981 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.981 DEBUG:boto:Data: 2023-12-15T23:10:00.981 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.981 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:00.981 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.981 DEBUG:boto:Params: {} 2023-12-15T23:10:00.981 DEBUG:boto:Token: None 2023-12-15T23:10:00.982 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oUWnZfpsnkSSHslrkqzkPlDZEKc= 2023-12-15T23:10:00.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oUWnZfpsnkSSHslrkqzkPlDZEKc=', 'Content-Length': '0'} 2023-12-15T23:10:00.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000460573080771a6bb-00657cdcc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:00.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:00.984 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:00.984 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:00.984 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.984 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:00.984 DEBUG:boto:Method: GET 2023-12-15T23:10:00.984 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.984 DEBUG:boto:Data: 2023-12-15T23:10:00.984 DEBUG:boto:Headers: {} 2023-12-15T23:10:00.985 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:00.985 DEBUG:boto:Port: 8000 2023-12-15T23:10:00.985 DEBUG:boto:Params: {} 2023-12-15T23:10:00.985 DEBUG:boto:Token: None 2023-12-15T23:10:00.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:00 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:00.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4= 2023-12-15T23:10:00.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iKExoYIkz/ekJrTZzsKha84Emp4=', 'Content-Length': '0'} 2023-12-15T23:10:00.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd8779c59c7d5b6d-00657cdcc8-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.029 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:01.030 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:01.030 DEBUG:boto:path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:01.030 DEBUG:boto:auth_path=/kskgfn-45/b?versionId=null 2023-12-15T23:10:01.030 DEBUG:boto:Method: GET 2023-12-15T23:10:01.030 DEBUG:boto:Path: /kskgfn-45/b?versionId=null 2023-12-15T23:10:01.030 DEBUG:boto:Data: 2023-12-15T23:10:01.030 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.030 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.030 DEBUG:boto:Params: {} 2023-12-15T23:10:01.031 DEBUG:boto:Token: None 2023-12-15T23:10:01.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/b?versionId=null 2023-12-15T23:10:01.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gbhBGx7CC92oKQjP3ctl6f+ZoBg= 2023-12-15T23:10:01.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gbhBGx7CC92oKQjP3ctl6f+ZoBg=', 'Content-Length': '0'} 2023-12-15T23:10:01.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000215c208bc94b3be-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.033 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.033 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.033 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.033 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.033 DEBUG:boto:Method: GET 2023-12-15T23:10:01.033 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:10:01.033 DEBUG:boto:Data: 2023-12-15T23:10:01.034 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.034 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.034 DEBUG:boto:Params: {} 2023-12-15T23:10:01.034 DEBUG:boto:Token: None 2023-12-15T23:10:01.034 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.036 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f47a6d335148b84b-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.037 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.037 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.037 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.037 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.037 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.038 DEBUG:boto:Method: GET 2023-12-15T23:10:01.038 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:10:01.038 DEBUG:boto:Data: 2023-12-15T23:10:01.038 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.038 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.038 DEBUG:boto:Params: {} 2023-12-15T23:10:01.038 DEBUG:boto:Token: None 2023-12-15T23:10:01.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.040 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0598d88cd52c6ae-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.041 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.041 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:01.041 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:01.041 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.041 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:10:01.041 DEBUG:boto:Data: 2023-12-15T23:10:01.041 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.042 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.042 DEBUG:boto:Params: {} 2023-12-15T23:10:01.042 DEBUG:boto:Token: None 2023-12-15T23:10:01.042 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/b 2023-12-15T23:10:01.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RDLH9rHsoHIH5KD8SvnodlH2Jv0= 2023-12-15T23:10:01.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RDLH9rHsoHIH5KD8SvnodlH2Jv0=', 'Content-Length': '0'} 2023-12-15T23:10:01.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a0d83ecd26a73d2-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.044 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:01.044 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:01.044 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.045 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:10:01.045 DEBUG:boto:Data: 2023-12-15T23:10:01.045 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.045 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.045 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.045 DEBUG:boto:Params: {} 2023-12-15T23:10:01.045 DEBUG:boto:Token: None 2023-12-15T23:10:01.045 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/b 2023-12-15T23:10:01.045 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RDLH9rHsoHIH5KD8SvnodlH2Jv0= 2023-12-15T23:10:01.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RDLH9rHsoHIH5KD8SvnodlH2Jv0=', 'Content-Length': '0'} 2023-12-15T23:10:01.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff8a447a1f06532a-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:01.047 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:01.048 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:01.048 DEBUG:boto:Method: GET 2023-12-15T23:10:01.048 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:10:01.048 DEBUG:boto:Data: 2023-12-15T23:10:01.048 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.048 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.048 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.048 DEBUG:boto:Params: {} 2023-12-15T23:10:01.048 DEBUG:boto:Token: None 2023-12-15T23:10:01.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/b 2023-12-15T23:10:01.049 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/gmhv9KEuC9znVFoXUvybDnDbI= 2023-12-15T23:10:01.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/gmhv9KEuC9znVFoXUvybDnDbI=', 'Content-Length': '0'} 2023-12-15T23:10:01.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000229ecd5644fb03aa-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.097 DEBUG:boto:path=/kskgfn-45/b 2023-12-15T23:10:01.098 DEBUG:boto:auth_path=/kskgfn-45/b 2023-12-15T23:10:01.098 DEBUG:boto:Method: GET 2023-12-15T23:10:01.098 DEBUG:boto:Path: /kskgfn-45/b 2023-12-15T23:10:01.098 DEBUG:boto:Data: 2023-12-15T23:10:01.098 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.098 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.098 DEBUG:boto:Params: {} 2023-12-15T23:10:01.098 DEBUG:boto:Token: None 2023-12-15T23:10:01.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/b 2023-12-15T23:10:01.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/gmhv9KEuC9znVFoXUvybDnDbI= 2023-12-15T23:10:01.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/gmhv9KEuC9znVFoXUvybDnDbI=', 'Content-Length': '0'} 2023-12-15T23:10:01.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d1074f8929dfce9-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.100 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.101 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.101 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.101 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.101 DEBUG:boto:Method: GET 2023-12-15T23:10:01.101 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:10:01.101 DEBUG:boto:Data: 2023-12-15T23:10:01.101 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.101 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.101 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.101 DEBUG:boto:Params: {} 2023-12-15T23:10:01.102 DEBUG:boto:Token: None 2023-12-15T23:10:01.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000723e0bfac612a4fb-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.104 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.104 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.105 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.105 DEBUG:boto:path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.105 DEBUG:boto:auth_path=/kskgfn-45/?prefix=b 2023-12-15T23:10:01.105 DEBUG:boto:Method: GET 2023-12-15T23:10:01.105 DEBUG:boto:Path: /kskgfn-45/?prefix=b 2023-12-15T23:10:01.105 DEBUG:boto:Data: 2023-12-15T23:10:01.105 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.105 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.105 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.105 DEBUG:boto:Params: {} 2023-12-15T23:10:01.106 DEBUG:boto:Token: None 2023-12-15T23:10:01.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.108 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000194eaaa89211e9d0-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.108 DEBUG:boto:b'kskgfn-45b1000falseb2023-12-15T23:09:13.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:01.108 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.108 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.109 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.109 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.109 DEBUG:boto:Method: GET 2023-12-15T23:10:01.109 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.109 DEBUG:boto:Data: 2023-12-15T23:10:01.109 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.109 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.109 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.109 DEBUG:boto:Params: {} 2023-12-15T23:10:01.109 DEBUG:boto:Token: None 2023-12-15T23:10:01.109 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34= 2023-12-15T23:10:01.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34=', 'Content-Length': '0'} 2023-12-15T23:10:01.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a5443cfbb0f66c8-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.153 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.154 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.154 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.154 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.154 DEBUG:boto:Method: GET 2023-12-15T23:10:01.154 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.154 DEBUG:boto:Data: 2023-12-15T23:10:01.154 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.154 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.154 DEBUG:boto:Params: {} 2023-12-15T23:10:01.154 DEBUG:boto:Token: None 2023-12-15T23:10:01.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34= 2023-12-15T23:10:01.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34=', 'Content-Length': '0'} 2023-12-15T23:10:01.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a6420fe5dd421c9-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.157 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.157 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.157 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.157 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.157 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.157 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.158 DEBUG:boto:Data: 2023-12-15T23:10:01.158 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.158 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.158 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.158 DEBUG:boto:Params: {} 2023-12-15T23:10:01.158 DEBUG:boto:Token: None 2023-12-15T23:10:01.158 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gF4K/5/bwFBOuNrQfdxjZarvGiU= 2023-12-15T23:10:01.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gF4K/5/bwFBOuNrQfdxjZarvGiU=', 'Content-Length': '0'} 2023-12-15T23:10:01.160 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c8cc8e9ab82e51c-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.160 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.160 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.160 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.161 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.161 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.161 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.161 DEBUG:boto:Data: 2023-12-15T23:10:01.161 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.161 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.161 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.161 DEBUG:boto:Params: {} 2023-12-15T23:10:01.161 DEBUG:boto:Token: None 2023-12-15T23:10:01.161 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gF4K/5/bwFBOuNrQfdxjZarvGiU= 2023-12-15T23:10:01.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gF4K/5/bwFBOuNrQfdxjZarvGiU=', 'Content-Length': '0'} 2023-12-15T23:10:01.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054e3705e6c40347c-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.163 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:01.164 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.164 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.164 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.164 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.164 DEBUG:boto:Method: GET 2023-12-15T23:10:01.164 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.164 DEBUG:boto:Data: 2023-12-15T23:10:01.164 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.164 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.164 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.165 DEBUG:boto:Params: {} 2023-12-15T23:10:01.165 DEBUG:boto:Token: None 2023-12-15T23:10:01.165 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.165 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34= 2023-12-15T23:10:01.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34=', 'Content-Length': '0'} 2023-12-15T23:10:01.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6798445add37ab8-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.210 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.210 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.210 DEBUG:boto:path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.210 DEBUG:boto:auth_path=/kskgfn-45/c?versionId=null 2023-12-15T23:10:01.210 DEBUG:boto:Method: GET 2023-12-15T23:10:01.210 DEBUG:boto:Path: /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.210 DEBUG:boto:Data: 2023-12-15T23:10:01.210 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.210 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.210 DEBUG:boto:Params: {} 2023-12-15T23:10:01.211 DEBUG:boto:Token: None 2023-12-15T23:10:01.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c?versionId=null 2023-12-15T23:10:01.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34= 2023-12-15T23:10:01.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dsAejEBK0VPcp9eScjP0Z6H8v34=', 'Content-Length': '0'} 2023-12-15T23:10:01.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fef814faa696ea9-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.213 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.213 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.213 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.213 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.213 DEBUG:boto:Method: GET 2023-12-15T23:10:01.214 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:10:01.214 DEBUG:boto:Data: 2023-12-15T23:10:01.214 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.214 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.214 DEBUG:boto:Params: {} 2023-12-15T23:10:01.214 DEBUG:boto:Token: None 2023-12-15T23:10:01.214 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078978394e4230c02-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.217 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.217 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.217 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.217 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.217 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.217 DEBUG:boto:Method: GET 2023-12-15T23:10:01.217 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:10:01.218 DEBUG:boto:Data: 2023-12-15T23:10:01.218 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.218 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.218 DEBUG:boto:Params: {} 2023-12-15T23:10:01.218 DEBUG:boto:Token: None 2023-12-15T23:10:01.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.220 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000675ba3bcc5487c3f-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.220 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.221 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.221 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.221 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.221 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:10:01.221 DEBUG:boto:Data: 2023-12-15T23:10:01.221 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.221 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.222 DEBUG:boto:Params: {} 2023-12-15T23:10:01.222 DEBUG:boto:Token: None 2023-12-15T23:10:01.222 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c 2023-12-15T23:10:01.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yj2fw1dFRWmp+IGOVnZZ/oSGf0A= 2023-12-15T23:10:01.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yj2fw1dFRWmp+IGOVnZZ/oSGf0A=', 'Content-Length': '0'} 2023-12-15T23:10:01.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbe34dcfe0896029-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.224 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.224 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.224 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.224 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:10:01.224 DEBUG:boto:Data: 2023-12-15T23:10:01.224 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.224 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.225 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.225 DEBUG:boto:Params: {} 2023-12-15T23:10:01.225 DEBUG:boto:Token: None 2023-12-15T23:10:01.225 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c 2023-12-15T23:10:01.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yj2fw1dFRWmp+IGOVnZZ/oSGf0A= 2023-12-15T23:10:01.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yj2fw1dFRWmp+IGOVnZZ/oSGf0A=', 'Content-Length': '0'} 2023-12-15T23:10:01.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e69b6f4e32fa942-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:01.227 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.227 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.227 DEBUG:boto:Method: GET 2023-12-15T23:10:01.227 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:10:01.227 DEBUG:boto:Data: 2023-12-15T23:10:01.227 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.227 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.228 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.228 DEBUG:boto:Params: {} 2023-12-15T23:10:01.228 DEBUG:boto:Token: None 2023-12-15T23:10:01.228 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c 2023-12-15T23:10:01.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D0GyBUdDdvtHtrHQI4jyRIkqpD4= 2023-12-15T23:10:01.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D0GyBUdDdvtHtrHQI4jyRIkqpD4=', 'Content-Length': '0'} 2023-12-15T23:10:01.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000979fb33f8ce5b5ec-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.273 DEBUG:boto:path=/kskgfn-45/c 2023-12-15T23:10:01.274 DEBUG:boto:auth_path=/kskgfn-45/c 2023-12-15T23:10:01.274 DEBUG:boto:Method: GET 2023-12-15T23:10:01.274 DEBUG:boto:Path: /kskgfn-45/c 2023-12-15T23:10:01.274 DEBUG:boto:Data: 2023-12-15T23:10:01.274 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.274 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.274 DEBUG:boto:Params: {} 2023-12-15T23:10:01.274 DEBUG:boto:Token: None 2023-12-15T23:10:01.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/c 2023-12-15T23:10:01.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D0GyBUdDdvtHtrHQI4jyRIkqpD4= 2023-12-15T23:10:01.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D0GyBUdDdvtHtrHQI4jyRIkqpD4=', 'Content-Length': '0'} 2023-12-15T23:10:01.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8fc44184fc7a7a4-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.277 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.277 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.277 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.277 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.277 DEBUG:boto:Method: GET 2023-12-15T23:10:01.277 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:10:01.277 DEBUG:boto:Data: 2023-12-15T23:10:01.277 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.277 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.277 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.278 DEBUG:boto:Params: {} 2023-12-15T23:10:01.278 DEBUG:boto:Token: None 2023-12-15T23:10:01.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3ea0b8ca593f807-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.280 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.281 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.281 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.281 DEBUG:boto:path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.281 DEBUG:boto:auth_path=/kskgfn-45/?prefix=c 2023-12-15T23:10:01.281 DEBUG:boto:Method: GET 2023-12-15T23:10:01.281 DEBUG:boto:Path: /kskgfn-45/?prefix=c 2023-12-15T23:10:01.281 DEBUG:boto:Data: 2023-12-15T23:10:01.281 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.281 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.282 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.282 DEBUG:boto:Params: {} 2023-12-15T23:10:01.282 DEBUG:boto:Token: None 2023-12-15T23:10:01.282 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000518aad6608d2abb8-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.284 DEBUG:boto:b'kskgfn-45c1000falsec2023-12-15T23:09:13.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:01.285 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.285 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.285 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.285 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.285 DEBUG:boto:Method: GET 2023-12-15T23:10:01.285 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.285 DEBUG:boto:Data: 2023-12-15T23:10:01.285 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.285 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.285 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.286 DEBUG:boto:Params: {} 2023-12-15T23:10:01.286 DEBUG:boto:Token: None 2023-12-15T23:10:01.286 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0= 2023-12-15T23:10:01.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0=', 'Content-Length': '0'} 2023-12-15T23:10:01.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fcf68a3d4819447-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.329 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.330 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.330 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.330 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.330 DEBUG:boto:Method: GET 2023-12-15T23:10:01.330 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.330 DEBUG:boto:Data: 2023-12-15T23:10:01.330 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.330 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.330 DEBUG:boto:Params: {} 2023-12-15T23:10:01.330 DEBUG:boto:Token: None 2023-12-15T23:10:01.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0= 2023-12-15T23:10:01.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0=', 'Content-Length': '0'} 2023-12-15T23:10:01.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4272ea10032931b-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.333 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.333 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.333 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.333 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.333 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.333 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.333 DEBUG:boto:Data: 2023-12-15T23:10:01.334 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.334 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.334 DEBUG:boto:Params: {} 2023-12-15T23:10:01.334 DEBUG:boto:Token: None 2023-12-15T23:10:01.334 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SyIzoWEeG6JB+dviTX2sSeLlQ+U= 2023-12-15T23:10:01.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SyIzoWEeG6JB+dviTX2sSeLlQ+U=', 'Content-Length': '0'} 2023-12-15T23:10:01.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000213fa2232c5d6c84-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.336 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.336 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.336 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.337 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.337 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.337 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.337 DEBUG:boto:Data: 2023-12-15T23:10:01.337 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.337 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.337 DEBUG:boto:Params: {} 2023-12-15T23:10:01.337 DEBUG:boto:Token: None 2023-12-15T23:10:01.337 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SyIzoWEeG6JB+dviTX2sSeLlQ+U= 2023-12-15T23:10:01.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SyIzoWEeG6JB+dviTX2sSeLlQ+U=', 'Content-Length': '0'} 2023-12-15T23:10:01.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef0daf959ad2090e-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:01.340 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.340 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.340 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.340 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.340 DEBUG:boto:Method: GET 2023-12-15T23:10:01.340 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.340 DEBUG:boto:Data: 2023-12-15T23:10:01.340 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.340 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.341 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.341 DEBUG:boto:Params: {} 2023-12-15T23:10:01.341 DEBUG:boto:Token: None 2023-12-15T23:10:01.341 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0= 2023-12-15T23:10:01.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0=', 'Content-Length': '0'} 2023-12-15T23:10:01.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000333dedca0095d23f-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.389 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.390 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.390 DEBUG:boto:path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.390 DEBUG:boto:auth_path=/kskgfn-45/d?versionId=null 2023-12-15T23:10:01.390 DEBUG:boto:Method: GET 2023-12-15T23:10:01.390 DEBUG:boto:Path: /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.390 DEBUG:boto:Data: 2023-12-15T23:10:01.390 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.390 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.390 DEBUG:boto:Params: {} 2023-12-15T23:10:01.390 DEBUG:boto:Token: None 2023-12-15T23:10:01.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d?versionId=null 2023-12-15T23:10:01.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0= 2023-12-15T23:10:01.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9iq+4E3WQ/F/edaSTuJz2mpoY0=', 'Content-Length': '0'} 2023-12-15T23:10:01.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7b1c54a515b94c5-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.393 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.393 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.393 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.393 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.393 DEBUG:boto:Method: GET 2023-12-15T23:10:01.393 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:10:01.393 DEBUG:boto:Data: 2023-12-15T23:10:01.393 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.393 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.393 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.394 DEBUG:boto:Params: {} 2023-12-15T23:10:01.394 DEBUG:boto:Token: None 2023-12-15T23:10:01.394 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.396 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ad0e8a64770e132-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.396 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.397 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.397 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.397 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.397 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.397 DEBUG:boto:Method: GET 2023-12-15T23:10:01.397 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:10:01.397 DEBUG:boto:Data: 2023-12-15T23:10:01.397 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.397 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.398 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.398 DEBUG:boto:Params: {} 2023-12-15T23:10:01.398 DEBUG:boto:Token: None 2023-12-15T23:10:01.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000112576982084632c-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.401 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.401 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.401 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.401 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.401 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:10:01.401 DEBUG:boto:Data: 2023-12-15T23:10:01.401 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.402 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.402 DEBUG:boto:Params: {} 2023-12-15T23:10:01.402 DEBUG:boto:Token: None 2023-12-15T23:10:01.402 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d 2023-12-15T23:10:01.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GL+X7FsOKZ7j9WYP7OaoW71fLVM= 2023-12-15T23:10:01.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GL+X7FsOKZ7j9WYP7OaoW71fLVM=', 'Content-Length': '0'} 2023-12-15T23:10:01.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008588fdd833813cf3-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.404 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.404 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.404 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.404 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:10:01.404 DEBUG:boto:Data: 2023-12-15T23:10:01.404 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.405 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.405 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.405 DEBUG:boto:Params: {} 2023-12-15T23:10:01.405 DEBUG:boto:Token: None 2023-12-15T23:10:01.405 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d 2023-12-15T23:10:01.405 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GL+X7FsOKZ7j9WYP7OaoW71fLVM= 2023-12-15T23:10:01.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GL+X7FsOKZ7j9WYP7OaoW71fLVM=', 'Content-Length': '0'} 2023-12-15T23:10:01.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebdd3f43e557d9ba-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:01.407 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.408 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.408 DEBUG:boto:Method: GET 2023-12-15T23:10:01.408 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:10:01.408 DEBUG:boto:Data: 2023-12-15T23:10:01.408 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.408 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.408 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.408 DEBUG:boto:Params: {} 2023-12-15T23:10:01.408 DEBUG:boto:Token: None 2023-12-15T23:10:01.408 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d 2023-12-15T23:10:01.409 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YmQhgztGA0STAS0oEwsSPoZy470= 2023-12-15T23:10:01.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YmQhgztGA0STAS0oEwsSPoZy470=', 'Content-Length': '0'} 2023-12-15T23:10:01.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009927eadd32bba52b-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.457 DEBUG:boto:path=/kskgfn-45/d 2023-12-15T23:10:01.458 DEBUG:boto:auth_path=/kskgfn-45/d 2023-12-15T23:10:01.458 DEBUG:boto:Method: GET 2023-12-15T23:10:01.458 DEBUG:boto:Path: /kskgfn-45/d 2023-12-15T23:10:01.458 DEBUG:boto:Data: 2023-12-15T23:10:01.458 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.458 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.458 DEBUG:boto:Params: {} 2023-12-15T23:10:01.458 DEBUG:boto:Token: None 2023-12-15T23:10:01.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/d 2023-12-15T23:10:01.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YmQhgztGA0STAS0oEwsSPoZy470= 2023-12-15T23:10:01.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YmQhgztGA0STAS0oEwsSPoZy470=', 'Content-Length': '0'} 2023-12-15T23:10:01.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000709c50b10a7ba1ea-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.461 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.461 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.461 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.461 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.461 DEBUG:boto:Method: GET 2023-12-15T23:10:01.461 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:10:01.461 DEBUG:boto:Data: 2023-12-15T23:10:01.461 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.462 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.462 DEBUG:boto:Params: {} 2023-12-15T23:10:01.462 DEBUG:boto:Token: None 2023-12-15T23:10:01.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009184825edf06ad44-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.464 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.465 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.465 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.465 DEBUG:boto:path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.465 DEBUG:boto:auth_path=/kskgfn-45/?prefix=d 2023-12-15T23:10:01.465 DEBUG:boto:Method: GET 2023-12-15T23:10:01.465 DEBUG:boto:Path: /kskgfn-45/?prefix=d 2023-12-15T23:10:01.465 DEBUG:boto:Data: 2023-12-15T23:10:01.465 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.466 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.466 DEBUG:boto:Params: {} 2023-12-15T23:10:01.466 DEBUG:boto:Token: None 2023-12-15T23:10:01.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b976c3896266adac-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.468 DEBUG:boto:b'kskgfn-45d1000falsed2023-12-15T23:09:13.397Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:10:01.469 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.469 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.469 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.469 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.469 DEBUG:boto:Method: GET 2023-12-15T23:10:01.469 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.469 DEBUG:boto:Data: 2023-12-15T23:10:01.469 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.469 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.469 DEBUG:boto:Params: {} 2023-12-15T23:10:01.470 DEBUG:boto:Token: None 2023-12-15T23:10:01.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs= 2023-12-15T23:10:01.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs=', 'Content-Length': '0'} 2023-12-15T23:10:01.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083512ec9806af4fc-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.513 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.514 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.514 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.514 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.514 DEBUG:boto:Method: GET 2023-12-15T23:10:01.514 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.514 DEBUG:boto:Data: 2023-12-15T23:10:01.514 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.514 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.514 DEBUG:boto:Params: {} 2023-12-15T23:10:01.515 DEBUG:boto:Token: None 2023-12-15T23:10:01.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs= 2023-12-15T23:10:01.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs=', 'Content-Length': '0'} 2023-12-15T23:10:01.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000222b58d80efedcc8-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.517 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.517 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.517 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.517 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.518 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.518 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.518 DEBUG:boto:Data: 2023-12-15T23:10:01.518 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.518 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.518 DEBUG:boto:Params: {} 2023-12-15T23:10:01.518 DEBUG:boto:Token: None 2023-12-15T23:10:01.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ltRUBv+hq9Q2FJDfVSMWuhulqKg= 2023-12-15T23:10:01.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ltRUBv+hq9Q2FJDfVSMWuhulqKg=', 'Content-Length': '0'} 2023-12-15T23:10:01.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f15ef8625e91fdb1-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.520 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.520 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.521 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.521 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.521 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.521 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.521 DEBUG:boto:Data: 2023-12-15T23:10:01.521 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.521 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.521 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.521 DEBUG:boto:Params: {} 2023-12-15T23:10:01.521 DEBUG:boto:Token: None 2023-12-15T23:10:01.521 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ltRUBv+hq9Q2FJDfVSMWuhulqKg= 2023-12-15T23:10:01.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ltRUBv+hq9Q2FJDfVSMWuhulqKg=', 'Content-Length': '0'} 2023-12-15T23:10:01.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d5f9ff6ec80022d-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:10:01.524 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.524 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.524 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.524 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.524 DEBUG:boto:Method: GET 2023-12-15T23:10:01.524 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.524 DEBUG:boto:Data: 2023-12-15T23:10:01.524 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.525 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.525 DEBUG:boto:Params: {} 2023-12-15T23:10:01.525 DEBUG:boto:Token: None 2023-12-15T23:10:01.525 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.525 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs= 2023-12-15T23:10:01.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs=', 'Content-Length': '0'} 2023-12-15T23:10:01.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c0820c6432071e0-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.569 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.570 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.570 DEBUG:boto:path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.570 DEBUG:boto:auth_path=/kskgfn-45/e?versionId=null 2023-12-15T23:10:01.570 DEBUG:boto:Method: GET 2023-12-15T23:10:01.570 DEBUG:boto:Path: /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.570 DEBUG:boto:Data: 2023-12-15T23:10:01.570 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.570 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.570 DEBUG:boto:Params: {} 2023-12-15T23:10:01.570 DEBUG:boto:Token: None 2023-12-15T23:10:01.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e?versionId=null 2023-12-15T23:10:01.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs= 2023-12-15T23:10:01.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uIlJGBy82rasC9GOzRxM8dB+hFs=', 'Content-Length': '0'} 2023-12-15T23:10:01.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cea79685fe7b7932-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.573 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.573 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.573 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.573 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.573 DEBUG:boto:Method: GET 2023-12-15T23:10:01.574 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:10:01.574 DEBUG:boto:Data: 2023-12-15T23:10:01.574 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.574 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.574 DEBUG:boto:Params: {} 2023-12-15T23:10:01.574 DEBUG:boto:Token: None 2023-12-15T23:10:01.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.576 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a78fbe70fe0398ba-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.577 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.577 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.577 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.577 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.577 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.577 DEBUG:boto:Method: GET 2023-12-15T23:10:01.578 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:10:01.578 DEBUG:boto:Data: 2023-12-15T23:10:01.578 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.578 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.578 DEBUG:boto:Params: {} 2023-12-15T23:10:01.578 DEBUG:boto:Token: None 2023-12-15T23:10:01.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000100b3d386393edf0-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.580 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.581 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.581 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.581 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.581 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:10:01.581 DEBUG:boto:Data: 2023-12-15T23:10:01.581 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.582 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.582 DEBUG:boto:Params: {} 2023-12-15T23:10:01.582 DEBUG:boto:Token: None 2023-12-15T23:10:01.582 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e 2023-12-15T23:10:01.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8PqtWQ2g01beUwb2AapEykXZBBc= 2023-12-15T23:10:01.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8PqtWQ2g01beUwb2AapEykXZBBc=', 'Content-Length': '0'} 2023-12-15T23:10:01.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000419c03b94d02085e-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.584 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.584 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.584 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.585 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:10:01.585 DEBUG:boto:Data: 2023-12-15T23:10:01.585 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.585 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.585 DEBUG:boto:Params: {} 2023-12-15T23:10:01.585 DEBUG:boto:Token: None 2023-12-15T23:10:01.585 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e 2023-12-15T23:10:01.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8PqtWQ2g01beUwb2AapEykXZBBc= 2023-12-15T23:10:01.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8PqtWQ2g01beUwb2AapEykXZBBc=', 'Content-Length': '0'} 2023-12-15T23:10:01.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016178da8f04cc629-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.587 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:10:01.588 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.588 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.588 DEBUG:boto:Method: GET 2023-12-15T23:10:01.588 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:10:01.588 DEBUG:boto:Data: 2023-12-15T23:10:01.588 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.588 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.588 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.588 DEBUG:boto:Params: {} 2023-12-15T23:10:01.588 DEBUG:boto:Token: None 2023-12-15T23:10:01.589 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e 2023-12-15T23:10:01.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PlaBIsKrHJPFxxFFhaoPWOLDnvE= 2023-12-15T23:10:01.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PlaBIsKrHJPFxxFFhaoPWOLDnvE=', 'Content-Length': '0'} 2023-12-15T23:10:01.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee12bffd69adfe1d-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.633 DEBUG:boto:path=/kskgfn-45/e 2023-12-15T23:10:01.634 DEBUG:boto:auth_path=/kskgfn-45/e 2023-12-15T23:10:01.634 DEBUG:boto:Method: GET 2023-12-15T23:10:01.634 DEBUG:boto:Path: /kskgfn-45/e 2023-12-15T23:10:01.634 DEBUG:boto:Data: 2023-12-15T23:10:01.634 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.634 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.634 DEBUG:boto:Params: {} 2023-12-15T23:10:01.634 DEBUG:boto:Token: None 2023-12-15T23:10:01.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/e 2023-12-15T23:10:01.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PlaBIsKrHJPFxxFFhaoPWOLDnvE= 2023-12-15T23:10:01.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PlaBIsKrHJPFxxFFhaoPWOLDnvE=', 'Content-Length': '0'} 2023-12-15T23:10:01.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d46fa12289ad5e-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.637 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.637 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.637 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.637 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.637 DEBUG:boto:Method: GET 2023-12-15T23:10:01.637 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:10:01.637 DEBUG:boto:Data: 2023-12-15T23:10:01.637 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.637 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.638 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.638 DEBUG:boto:Params: {} 2023-12-15T23:10:01.638 DEBUG:boto:Token: None 2023-12-15T23:10:01.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000050cce18032a21c4-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.640 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.641 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.641 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.641 DEBUG:boto:path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.641 DEBUG:boto:auth_path=/kskgfn-45/?prefix=e 2023-12-15T23:10:01.641 DEBUG:boto:Method: GET 2023-12-15T23:10:01.641 DEBUG:boto:Path: /kskgfn-45/?prefix=e 2023-12-15T23:10:01.641 DEBUG:boto:Data: 2023-12-15T23:10:01.641 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.641 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.642 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.642 DEBUG:boto:Params: {} 2023-12-15T23:10:01.642 DEBUG:boto:Token: None 2023-12-15T23:10:01.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.644 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e473d7bf510039d-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.644 DEBUG:boto:b'kskgfn-45e1000falsee2023-12-15T23:09:20.173Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.645 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:10:01.645 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.645 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.645 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.645 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.645 DEBUG:boto:Method: GET 2023-12-15T23:10:01.645 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.645 DEBUG:boto:Data: 2023-12-15T23:10:01.645 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.646 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.646 DEBUG:boto:Params: {} 2023-12-15T23:10:01.646 DEBUG:boto:Token: None 2023-12-15T23:10:01.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc= 2023-12-15T23:10:01.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc=', 'Content-Length': '0'} 2023-12-15T23:10:01.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b406df548e4791c6-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.693 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.694 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.694 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.694 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.694 DEBUG:boto:Method: GET 2023-12-15T23:10:01.694 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.694 DEBUG:boto:Data: 2023-12-15T23:10:01.694 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.694 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.694 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.694 DEBUG:boto:Params: {} 2023-12-15T23:10:01.695 DEBUG:boto:Token: None 2023-12-15T23:10:01.695 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc= 2023-12-15T23:10:01.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc=', 'Content-Length': '0'} 2023-12-15T23:10:01.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c22f17263a787aa7-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.697 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.697 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.698 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.698 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.698 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.698 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.698 DEBUG:boto:Data: 2023-12-15T23:10:01.698 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.698 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.698 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.698 DEBUG:boto:Params: {} 2023-12-15T23:10:01.698 DEBUG:boto:Token: None 2023-12-15T23:10:01.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jv2CBYO8dz9dGU2bule4Qr3DxGc= 2023-12-15T23:10:01.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jv2CBYO8dz9dGU2bule4Qr3DxGc=', 'Content-Length': '0'} 2023-12-15T23:10:01.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3ce6692782a59a7-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.701 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.701 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.701 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.701 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.701 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.701 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.701 DEBUG:boto:Data: 2023-12-15T23:10:01.701 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.701 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.702 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.702 DEBUG:boto:Params: {} 2023-12-15T23:10:01.702 DEBUG:boto:Token: None 2023-12-15T23:10:01.702 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Jv2CBYO8dz9dGU2bule4Qr3DxGc= 2023-12-15T23:10:01.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Jv2CBYO8dz9dGU2bule4Qr3DxGc=', 'Content-Length': '0'} 2023-12-15T23:10:01.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000160da6145beed7b2-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.704 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:10:01.705 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.705 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.705 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.705 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.705 DEBUG:boto:Method: GET 2023-12-15T23:10:01.705 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.705 DEBUG:boto:Data: 2023-12-15T23:10:01.705 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.705 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.705 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.705 DEBUG:boto:Params: {} 2023-12-15T23:10:01.706 DEBUG:boto:Token: None 2023-12-15T23:10:01.706 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc= 2023-12-15T23:10:01.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc=', 'Content-Length': '0'} 2023-12-15T23:10:01.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c29b03f593fcc2b-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.749 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.750 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.750 DEBUG:boto:path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.750 DEBUG:boto:auth_path=/kskgfn-45/f?versionId=null 2023-12-15T23:10:01.750 DEBUG:boto:Method: GET 2023-12-15T23:10:01.750 DEBUG:boto:Path: /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.750 DEBUG:boto:Data: 2023-12-15T23:10:01.750 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.750 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.750 DEBUG:boto:Params: {} 2023-12-15T23:10:01.750 DEBUG:boto:Token: None 2023-12-15T23:10:01.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f?versionId=null 2023-12-15T23:10:01.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc= 2023-12-15T23:10:01.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aDLIzxX84WdcmBT32RNpFp9LASc=', 'Content-Length': '0'} 2023-12-15T23:10:01.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037c1fab2e15ccd3b-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.753 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.753 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.753 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.753 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.754 DEBUG:boto:Method: GET 2023-12-15T23:10:01.754 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:10:01.754 DEBUG:boto:Data: 2023-12-15T23:10:01.754 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.754 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.754 DEBUG:boto:Params: {} 2023-12-15T23:10:01.754 DEBUG:boto:Token: None 2023-12-15T23:10:01.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f085dafc05c865b-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.757 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.758 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.758 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.758 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.758 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.758 DEBUG:boto:Method: GET 2023-12-15T23:10:01.758 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:10:01.758 DEBUG:boto:Data: 2023-12-15T23:10:01.758 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.759 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.759 DEBUG:boto:Params: {} 2023-12-15T23:10:01.759 DEBUG:boto:Token: None 2023-12-15T23:10:01.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015f77547fa8c16fe-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.761 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.761 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.762 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.762 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.762 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:10:01.762 DEBUG:boto:Data: 2023-12-15T23:10:01.762 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.762 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.762 DEBUG:boto:Params: {} 2023-12-15T23:10:01.762 DEBUG:boto:Token: None 2023-12-15T23:10:01.763 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f 2023-12-15T23:10:01.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oUtvDiLWX4+1mqkJkhnWRB91ZFU= 2023-12-15T23:10:01.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oUtvDiLWX4+1mqkJkhnWRB91ZFU=', 'Content-Length': '0'} 2023-12-15T23:10:01.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092c90c214f55084a-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.765 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.765 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.765 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.765 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:10:01.765 DEBUG:boto:Data: 2023-12-15T23:10:01.765 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.765 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.765 DEBUG:boto:Params: {} 2023-12-15T23:10:01.766 DEBUG:boto:Token: None 2023-12-15T23:10:01.766 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f 2023-12-15T23:10:01.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oUtvDiLWX4+1mqkJkhnWRB91ZFU= 2023-12-15T23:10:01.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oUtvDiLWX4+1mqkJkhnWRB91ZFU=', 'Content-Length': '0'} 2023-12-15T23:10:01.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004decaca8a2c578bb-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:10:01.768 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.768 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.768 DEBUG:boto:Method: GET 2023-12-15T23:10:01.768 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:10:01.768 DEBUG:boto:Data: 2023-12-15T23:10:01.768 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.768 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.769 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.769 DEBUG:boto:Params: {} 2023-12-15T23:10:01.769 DEBUG:boto:Token: None 2023-12-15T23:10:01.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f 2023-12-15T23:10:01.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IgDOlcmxqxH+Zj/r+zae/lXPFds= 2023-12-15T23:10:01.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IgDOlcmxqxH+Zj/r+zae/lXPFds=', 'Content-Length': '0'} 2023-12-15T23:10:01.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ee93ea3aa7c23e4-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.817 DEBUG:boto:path=/kskgfn-45/f 2023-12-15T23:10:01.818 DEBUG:boto:auth_path=/kskgfn-45/f 2023-12-15T23:10:01.818 DEBUG:boto:Method: GET 2023-12-15T23:10:01.818 DEBUG:boto:Path: /kskgfn-45/f 2023-12-15T23:10:01.818 DEBUG:boto:Data: 2023-12-15T23:10:01.818 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.818 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.818 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.818 DEBUG:boto:Params: {} 2023-12-15T23:10:01.818 DEBUG:boto:Token: None 2023-12-15T23:10:01.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/f 2023-12-15T23:10:01.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IgDOlcmxqxH+Zj/r+zae/lXPFds= 2023-12-15T23:10:01.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IgDOlcmxqxH+Zj/r+zae/lXPFds=', 'Content-Length': '0'} 2023-12-15T23:10:01.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0bfae9a4dc49cb6-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.821 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.821 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.821 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.821 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.822 DEBUG:boto:Method: GET 2023-12-15T23:10:01.822 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:10:01.822 DEBUG:boto:Data: 2023-12-15T23:10:01.822 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.822 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.822 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.822 DEBUG:boto:Params: {} 2023-12-15T23:10:01.822 DEBUG:boto:Token: None 2023-12-15T23:10:01.822 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.822 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044a93df673a259c7-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.825 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.825 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.825 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.825 DEBUG:boto:path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.826 DEBUG:boto:auth_path=/kskgfn-45/?prefix=f 2023-12-15T23:10:01.826 DEBUG:boto:Method: GET 2023-12-15T23:10:01.826 DEBUG:boto:Path: /kskgfn-45/?prefix=f 2023-12-15T23:10:01.826 DEBUG:boto:Data: 2023-12-15T23:10:01.826 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.826 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.826 DEBUG:boto:Params: {} 2023-12-15T23:10:01.826 DEBUG:boto:Token: None 2023-12-15T23:10:01.827 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.827 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.829 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048bda9d514bc67c7-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.829 DEBUG:boto:b'kskgfn-45f1000falsef2023-12-15T23:09:20.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:10:01.830 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.830 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.830 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.830 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.830 DEBUG:boto:Method: GET 2023-12-15T23:10:01.830 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.830 DEBUG:boto:Data: 2023-12-15T23:10:01.830 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.830 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.830 DEBUG:boto:Params: {} 2023-12-15T23:10:01.831 DEBUG:boto:Token: None 2023-12-15T23:10:01.831 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw= 2023-12-15T23:10:01.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw=', 'Content-Length': '0'} 2023-12-15T23:10:01.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d666a4387fb7ce3d-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.873 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.874 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.874 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.874 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.874 DEBUG:boto:Method: GET 2023-12-15T23:10:01.874 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.874 DEBUG:boto:Data: 2023-12-15T23:10:01.874 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.874 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.874 DEBUG:boto:Params: {} 2023-12-15T23:10:01.875 DEBUG:boto:Token: None 2023-12-15T23:10:01.875 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw= 2023-12-15T23:10:01.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw=', 'Content-Length': '0'} 2023-12-15T23:10:01.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5e464aed38e23e2-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.877 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.877 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.877 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.877 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.877 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.878 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.878 DEBUG:boto:Data: 2023-12-15T23:10:01.878 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.878 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.878 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.878 DEBUG:boto:Params: {} 2023-12-15T23:10:01.878 DEBUG:boto:Token: None 2023-12-15T23:10:01.878 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jsFaAH8WM+W+o9191M+8XB/sh2k= 2023-12-15T23:10:01.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jsFaAH8WM+W+o9191M+8XB/sh2k=', 'Content-Length': '0'} 2023-12-15T23:10:01.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f5126d37453c4ff-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.881 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.881 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.881 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.881 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.881 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.881 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.881 DEBUG:boto:Data: 2023-12-15T23:10:01.881 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.881 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.881 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.882 DEBUG:boto:Params: {} 2023-12-15T23:10:01.882 DEBUG:boto:Token: None 2023-12-15T23:10:01.882 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jsFaAH8WM+W+o9191M+8XB/sh2k= 2023-12-15T23:10:01.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jsFaAH8WM+W+o9191M+8XB/sh2k=', 'Content-Length': '0'} 2023-12-15T23:10:01.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c4f949ee810bed6-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.884 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:10:01.884 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.884 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.884 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.885 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.885 DEBUG:boto:Method: GET 2023-12-15T23:10:01.885 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.885 DEBUG:boto:Data: 2023-12-15T23:10:01.885 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.885 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.885 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.885 DEBUG:boto:Params: {} 2023-12-15T23:10:01.885 DEBUG:boto:Token: None 2023-12-15T23:10:01.885 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw= 2023-12-15T23:10:01.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw=', 'Content-Length': '0'} 2023-12-15T23:10:01.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2916a7167834b9a-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.929 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.930 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.930 DEBUG:boto:path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.930 DEBUG:boto:auth_path=/kskgfn-45/g?versionId=null 2023-12-15T23:10:01.930 DEBUG:boto:Method: GET 2023-12-15T23:10:01.930 DEBUG:boto:Path: /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.930 DEBUG:boto:Data: 2023-12-15T23:10:01.930 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.930 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.930 DEBUG:boto:Params: {} 2023-12-15T23:10:01.930 DEBUG:boto:Token: None 2023-12-15T23:10:01.931 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g?versionId=null 2023-12-15T23:10:01.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw= 2023-12-15T23:10:01.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKL+wj8q20aTj3xQCxiI50vD0Dw=', 'Content-Length': '0'} 2023-12-15T23:10:01.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3552e2c4d439809-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.933 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.933 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.933 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.933 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.933 DEBUG:boto:Method: GET 2023-12-15T23:10:01.934 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:10:01.934 DEBUG:boto:Data: 2023-12-15T23:10:01.934 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.934 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.934 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.934 DEBUG:boto:Params: {} 2023-12-15T23:10:01.934 DEBUG:boto:Token: None 2023-12-15T23:10:01.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5b4f3f0bf25f04d-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.937 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.937 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.937 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.937 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.938 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.938 DEBUG:boto:Method: GET 2023-12-15T23:10:01.938 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:10:01.938 DEBUG:boto:Data: 2023-12-15T23:10:01.938 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.938 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.938 DEBUG:boto:Params: {} 2023-12-15T23:10:01.938 DEBUG:boto:Token: None 2023-12-15T23:10:01.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:01.940 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf05550cf2130de2-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.941 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:01.941 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.941 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.941 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.941 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:10:01.941 DEBUG:boto:Data: 2023-12-15T23:10:01.942 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.942 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.942 DEBUG:boto:Params: {} 2023-12-15T23:10:01.942 DEBUG:boto:Token: None 2023-12-15T23:10:01.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g 2023-12-15T23:10:01.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KKPgtEYaLq0N6EDJReEFyGa2Bf4= 2023-12-15T23:10:01.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KKPgtEYaLq0N6EDJReEFyGa2Bf4=', 'Content-Length': '0'} 2023-12-15T23:10:01.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090bb04cc8986689c-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.944 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.944 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.944 DEBUG:boto:Method: HEAD 2023-12-15T23:10:01.944 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:10:01.944 DEBUG:boto:Data: 2023-12-15T23:10:01.945 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.945 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.945 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.945 DEBUG:boto:Params: {} 2023-12-15T23:10:01.945 DEBUG:boto:Token: None 2023-12-15T23:10:01.945 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g 2023-12-15T23:10:01.945 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KKPgtEYaLq0N6EDJReEFyGa2Bf4= 2023-12-15T23:10:01.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KKPgtEYaLq0N6EDJReEFyGa2Bf4=', 'Content-Length': '0'} 2023-12-15T23:10:01.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c7f27078dbae004-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:10:01.947 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.947 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.947 DEBUG:boto:Method: GET 2023-12-15T23:10:01.948 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:10:01.948 DEBUG:boto:Data: 2023-12-15T23:10:01.948 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.948 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.948 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.948 DEBUG:boto:Params: {} 2023-12-15T23:10:01.948 DEBUG:boto:Token: None 2023-12-15T23:10:01.948 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g 2023-12-15T23:10:01.948 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/ZfMw0f+yiRyQXXk8FlsemJ4d8= 2023-12-15T23:10:01.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/ZfMw0f+yiRyQXXk8FlsemJ4d8=', 'Content-Length': '0'} 2023-12-15T23:10:01.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f55f48b6afd6acc-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.993 DEBUG:boto:path=/kskgfn-45/g 2023-12-15T23:10:01.994 DEBUG:boto:auth_path=/kskgfn-45/g 2023-12-15T23:10:01.994 DEBUG:boto:Method: GET 2023-12-15T23:10:01.994 DEBUG:boto:Path: /kskgfn-45/g 2023-12-15T23:10:01.994 DEBUG:boto:Data: 2023-12-15T23:10:01.994 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:01.994 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.994 DEBUG:boto:Params: {} 2023-12-15T23:10:01.994 DEBUG:boto:Token: None 2023-12-15T23:10:01.995 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/g 2023-12-15T23:10:01.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/ZfMw0f+yiRyQXXk8FlsemJ4d8= 2023-12-15T23:10:01.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/ZfMw0f+yiRyQXXk8FlsemJ4d8=', 'Content-Length': '0'} 2023-12-15T23:10:01.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028ccef5029b3ca45-00657cdcc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:01 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:01.997 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:01.997 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:01.997 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.997 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:10:01.997 DEBUG:boto:Method: GET 2023-12-15T23:10:01.997 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:10:01.997 DEBUG:boto:Data: 2023-12-15T23:10:01.998 DEBUG:boto:Headers: {} 2023-12-15T23:10:01.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:01.998 DEBUG:boto:Port: 8000 2023-12-15T23:10:01.998 DEBUG:boto:Params: {} 2023-12-15T23:10:01.998 DEBUG:boto:Token: None 2023-12-15T23:10:01.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:01 GMT /kskgfn-45/ 2023-12-15T23:10:01.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ= 2023-12-15T23:10:01.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:01 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CFlGPAXAPtGkSP3+e2GMGJtg5AQ=', 'Content-Length': '0'} 2023-12-15T23:10:02.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016b267d7dab5e55e-00657cdcc9-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.001 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.001 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.001 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.001 DEBUG:boto:path=/kskgfn-45/?prefix=g 2023-12-15T23:10:02.001 DEBUG:boto:auth_path=/kskgfn-45/?prefix=g 2023-12-15T23:10:02.001 DEBUG:boto:Method: GET 2023-12-15T23:10:02.001 DEBUG:boto:Path: /kskgfn-45/?prefix=g 2023-12-15T23:10:02.002 DEBUG:boto:Data: 2023-12-15T23:10:02.002 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.002 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.002 DEBUG:boto:Params: {} 2023-12-15T23:10:02.002 DEBUG:boto:Token: None 2023-12-15T23:10:02.002 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea377d1f1914ca57-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.005 DEBUG:boto:b'kskgfn-45g1000falseg2023-12-15T23:09:20.233Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:10:02.005 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.005 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.005 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.005 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.005 DEBUG:boto:Method: GET 2023-12-15T23:10:02.005 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.006 DEBUG:boto:Data: 2023-12-15T23:10:02.006 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.006 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.006 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.006 DEBUG:boto:Params: {} 2023-12-15T23:10:02.006 DEBUG:boto:Token: None 2023-12-15T23:10:02.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.006 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0= 2023-12-15T23:10:02.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0=', 'Content-Length': '0'} 2023-12-15T23:10:02.008 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b70510177eb57636-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.049 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.050 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.050 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.050 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.050 DEBUG:boto:Method: GET 2023-12-15T23:10:02.050 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.050 DEBUG:boto:Data: 2023-12-15T23:10:02.050 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.050 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.050 DEBUG:boto:Params: {} 2023-12-15T23:10:02.051 DEBUG:boto:Token: None 2023-12-15T23:10:02.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0= 2023-12-15T23:10:02.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0=', 'Content-Length': '0'} 2023-12-15T23:10:02.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ae1d98b579ca8a4-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.053 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.053 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.053 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.054 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.054 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.054 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.054 DEBUG:boto:Data: 2023-12-15T23:10:02.054 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.054 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.054 DEBUG:boto:Params: {} 2023-12-15T23:10:02.054 DEBUG:boto:Token: None 2023-12-15T23:10:02.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dtj3iSFYrU0NU9A0GkTKs5oWpPI= 2023-12-15T23:10:02.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dtj3iSFYrU0NU9A0GkTKs5oWpPI=', 'Content-Length': '0'} 2023-12-15T23:10:02.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e225f2a4ca260b27-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.057 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.057 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.057 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.057 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.057 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.057 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.058 DEBUG:boto:Data: 2023-12-15T23:10:02.058 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.058 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.058 DEBUG:boto:Params: {} 2023-12-15T23:10:02.058 DEBUG:boto:Token: None 2023-12-15T23:10:02.058 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dtj3iSFYrU0NU9A0GkTKs5oWpPI= 2023-12-15T23:10:02.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dtj3iSFYrU0NU9A0GkTKs5oWpPI=', 'Content-Length': '0'} 2023-12-15T23:10:02.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faf8f04ceef0b0d3-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:10:02.061 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.061 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.061 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.061 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.061 DEBUG:boto:Method: GET 2023-12-15T23:10:02.061 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.061 DEBUG:boto:Data: 2023-12-15T23:10:02.061 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.061 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.062 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.062 DEBUG:boto:Params: {} 2023-12-15T23:10:02.062 DEBUG:boto:Token: None 2023-12-15T23:10:02.062 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0= 2023-12-15T23:10:02.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0=', 'Content-Length': '0'} 2023-12-15T23:10:02.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5770882bdc6faba-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.105 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.106 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.106 DEBUG:boto:path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.106 DEBUG:boto:auth_path=/kskgfn-45/h?versionId=null 2023-12-15T23:10:02.106 DEBUG:boto:Method: GET 2023-12-15T23:10:02.106 DEBUG:boto:Path: /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.106 DEBUG:boto:Data: 2023-12-15T23:10:02.106 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.106 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.106 DEBUG:boto:Params: {} 2023-12-15T23:10:02.106 DEBUG:boto:Token: None 2023-12-15T23:10:02.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h?versionId=null 2023-12-15T23:10:02.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0= 2023-12-15T23:10:02.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kTQkiAT/wuce/LVvKCunXzZyE0=', 'Content-Length': '0'} 2023-12-15T23:10:02.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd932ccf1c7bf220-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.109 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.109 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.109 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.110 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.110 DEBUG:boto:Method: GET 2023-12-15T23:10:02.110 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:10:02.110 DEBUG:boto:Data: 2023-12-15T23:10:02.110 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.110 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.110 DEBUG:boto:Params: {} 2023-12-15T23:10:02.110 DEBUG:boto:Token: None 2023-12-15T23:10:02.110 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016b68ac8f9c9520c-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.115 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.115 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.115 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.115 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.115 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.115 DEBUG:boto:Method: GET 2023-12-15T23:10:02.115 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:10:02.116 DEBUG:boto:Data: 2023-12-15T23:10:02.116 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.116 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.116 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.116 DEBUG:boto:Params: {} 2023-12-15T23:10:02.116 DEBUG:boto:Token: None 2023-12-15T23:10:02.116 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.116 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b88c90774691b388-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.118 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.119 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.119 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.119 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.119 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:10:02.119 DEBUG:boto:Data: 2023-12-15T23:10:02.119 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.119 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.119 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.120 DEBUG:boto:Params: {} 2023-12-15T23:10:02.120 DEBUG:boto:Token: None 2023-12-15T23:10:02.120 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h 2023-12-15T23:10:02.120 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9h6J2D7daIk8rP+kJOGwJiQB86A= 2023-12-15T23:10:02.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9h6J2D7daIk8rP+kJOGwJiQB86A=', 'Content-Length': '0'} 2023-12-15T23:10:02.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018a3881f4dedd287-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.122 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.122 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.123 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.123 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:10:02.123 DEBUG:boto:Data: 2023-12-15T23:10:02.123 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.123 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.123 DEBUG:boto:Params: {} 2023-12-15T23:10:02.123 DEBUG:boto:Token: None 2023-12-15T23:10:02.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h 2023-12-15T23:10:02.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9h6J2D7daIk8rP+kJOGwJiQB86A= 2023-12-15T23:10:02.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9h6J2D7daIk8rP+kJOGwJiQB86A=', 'Content-Length': '0'} 2023-12-15T23:10:02.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fa011ec0d7195f4-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:10:02.126 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.126 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.126 DEBUG:boto:Method: GET 2023-12-15T23:10:02.126 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:10:02.126 DEBUG:boto:Data: 2023-12-15T23:10:02.126 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.127 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.127 DEBUG:boto:Params: {} 2023-12-15T23:10:02.127 DEBUG:boto:Token: None 2023-12-15T23:10:02.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h 2023-12-15T23:10:02.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4Rf2WFxMY1X9F7aa0MNWQjy/50= 2023-12-15T23:10:02.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4Rf2WFxMY1X9F7aa0MNWQjy/50=', 'Content-Length': '0'} 2023-12-15T23:10:02.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004367d90320128f9a-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.170 DEBUG:boto:path=/kskgfn-45/h 2023-12-15T23:10:02.170 DEBUG:boto:auth_path=/kskgfn-45/h 2023-12-15T23:10:02.170 DEBUG:boto:Method: GET 2023-12-15T23:10:02.170 DEBUG:boto:Path: /kskgfn-45/h 2023-12-15T23:10:02.170 DEBUG:boto:Data: 2023-12-15T23:10:02.170 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.170 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.170 DEBUG:boto:Params: {} 2023-12-15T23:10:02.170 DEBUG:boto:Token: None 2023-12-15T23:10:02.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/h 2023-12-15T23:10:02.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4Rf2WFxMY1X9F7aa0MNWQjy/50= 2023-12-15T23:10:02.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4Rf2WFxMY1X9F7aa0MNWQjy/50=', 'Content-Length': '0'} 2023-12-15T23:10:02.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa1e66e4db74bfe3-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.173 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.173 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.173 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.174 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.174 DEBUG:boto:Method: GET 2023-12-15T23:10:02.174 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:10:02.174 DEBUG:boto:Data: 2023-12-15T23:10:02.174 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.174 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.174 DEBUG:boto:Params: {} 2023-12-15T23:10:02.174 DEBUG:boto:Token: None 2023-12-15T23:10:02.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dd1175cbd65c887-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.177 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.177 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.177 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.178 DEBUG:boto:path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.178 DEBUG:boto:auth_path=/kskgfn-45/?prefix=h 2023-12-15T23:10:02.178 DEBUG:boto:Method: GET 2023-12-15T23:10:02.178 DEBUG:boto:Path: /kskgfn-45/?prefix=h 2023-12-15T23:10:02.178 DEBUG:boto:Data: 2023-12-15T23:10:02.178 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.178 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.178 DEBUG:boto:Params: {} 2023-12-15T23:10:02.178 DEBUG:boto:Token: None 2023-12-15T23:10:02.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed6faed448c2caf6-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.181 DEBUG:boto:b'kskgfn-45h1000falseh2023-12-15T23:09:20.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2023-12-15T23:10:02.181 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.182 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.182 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.182 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.182 DEBUG:boto:Method: GET 2023-12-15T23:10:02.182 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.182 DEBUG:boto:Data: 2023-12-15T23:10:02.182 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.182 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.182 DEBUG:boto:Params: {} 2023-12-15T23:10:02.182 DEBUG:boto:Token: None 2023-12-15T23:10:02.183 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM= 2023-12-15T23:10:02.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM=', 'Content-Length': '0'} 2023-12-15T23:10:02.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009aa6d755946d6963-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.225 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.225 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.226 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.226 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.226 DEBUG:boto:Method: GET 2023-12-15T23:10:02.226 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.226 DEBUG:boto:Data: 2023-12-15T23:10:02.226 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.226 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.226 DEBUG:boto:Params: {} 2023-12-15T23:10:02.226 DEBUG:boto:Token: None 2023-12-15T23:10:02.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM= 2023-12-15T23:10:02.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM=', 'Content-Length': '0'} 2023-12-15T23:10:02.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c8633a26b377361-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.229 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.229 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.229 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.229 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.229 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.230 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.230 DEBUG:boto:Data: 2023-12-15T23:10:02.230 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.230 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.230 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.230 DEBUG:boto:Params: {} 2023-12-15T23:10:02.230 DEBUG:boto:Token: None 2023-12-15T23:10:02.230 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLmfqtjj3dAMvZGANnqM+8yu2aM= 2023-12-15T23:10:02.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLmfqtjj3dAMvZGANnqM+8yu2aM=', 'Content-Length': '0'} 2023-12-15T23:10:02.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0dacecc7714dd26-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.232 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.233 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.233 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.233 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.233 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.233 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.233 DEBUG:boto:Data: 2023-12-15T23:10:02.233 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.233 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.233 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.233 DEBUG:boto:Params: {} 2023-12-15T23:10:02.234 DEBUG:boto:Token: None 2023-12-15T23:10:02.234 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLmfqtjj3dAMvZGANnqM+8yu2aM= 2023-12-15T23:10:02.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLmfqtjj3dAMvZGANnqM+8yu2aM=', 'Content-Length': '0'} 2023-12-15T23:10:02.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdc023112b7fedfa-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2023-12-15T23:10:02.236 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.236 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.236 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.236 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.237 DEBUG:boto:Method: GET 2023-12-15T23:10:02.237 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.237 DEBUG:boto:Data: 2023-12-15T23:10:02.237 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.237 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.237 DEBUG:boto:Params: {} 2023-12-15T23:10:02.237 DEBUG:boto:Token: None 2023-12-15T23:10:02.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM= 2023-12-15T23:10:02.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM=', 'Content-Length': '0'} 2023-12-15T23:10:02.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a713039b067128b-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.285 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.286 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.286 DEBUG:boto:path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.286 DEBUG:boto:auth_path=/kskgfn-45/i?versionId=null 2023-12-15T23:10:02.286 DEBUG:boto:Method: GET 2023-12-15T23:10:02.286 DEBUG:boto:Path: /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.286 DEBUG:boto:Data: 2023-12-15T23:10:02.286 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.286 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.286 DEBUG:boto:Params: {} 2023-12-15T23:10:02.287 DEBUG:boto:Token: None 2023-12-15T23:10:02.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i?versionId=null 2023-12-15T23:10:02.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM= 2023-12-15T23:10:02.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOO+ovtruO4QJkTyNQHOLXiF8LM=', 'Content-Length': '0'} 2023-12-15T23:10:02.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000336c08f525d0addc-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.289 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.290 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.290 DEBUG:boto:path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.290 DEBUG:boto:auth_path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.290 DEBUG:boto:Method: GET 2023-12-15T23:10:02.290 DEBUG:boto:Path: /kskgfn-45/?prefix=i 2023-12-15T23:10:02.290 DEBUG:boto:Data: 2023-12-15T23:10:02.290 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.291 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.291 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.291 DEBUG:boto:Params: {} 2023-12-15T23:10:02.291 DEBUG:boto:Token: None 2023-12-15T23:10:02.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.292 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0978206735759a5-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.337 DEBUG:boto:b'kskgfn-45i1000falsei2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.338 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.338 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.338 DEBUG:boto:path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.338 DEBUG:boto:auth_path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.338 DEBUG:boto:Method: GET 2023-12-15T23:10:02.338 DEBUG:boto:Path: /kskgfn-45/?prefix=i 2023-12-15T23:10:02.339 DEBUG:boto:Data: 2023-12-15T23:10:02.339 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.339 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.339 DEBUG:boto:Params: {} 2023-12-15T23:10:02.339 DEBUG:boto:Token: None 2023-12-15T23:10:02.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087009976d4b655c5-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.342 DEBUG:boto:b'kskgfn-45i1000falsei2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.342 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.342 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.342 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.342 DEBUG:boto:Path: /kskgfn-45/i 2023-12-15T23:10:02.342 DEBUG:boto:Data: 2023-12-15T23:10:02.342 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.343 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.343 DEBUG:boto:Params: {} 2023-12-15T23:10:02.343 DEBUG:boto:Token: None 2023-12-15T23:10:02.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i 2023-12-15T23:10:02.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bxZHcsHge3kv8by10yYZ0vyTz5Q= 2023-12-15T23:10:02.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bxZHcsHge3kv8by10yYZ0vyTz5Q=', 'Content-Length': '0'} 2023-12-15T23:10:02.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087e174df25fc3c61-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.345 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.345 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.345 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.345 DEBUG:boto:Path: /kskgfn-45/i 2023-12-15T23:10:02.346 DEBUG:boto:Data: 2023-12-15T23:10:02.346 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.346 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.346 DEBUG:boto:Params: {} 2023-12-15T23:10:02.346 DEBUG:boto:Token: None 2023-12-15T23:10:02.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i 2023-12-15T23:10:02.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bxZHcsHge3kv8by10yYZ0vyTz5Q= 2023-12-15T23:10:02.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bxZHcsHge3kv8by10yYZ0vyTz5Q=', 'Content-Length': '0'} 2023-12-15T23:10:02.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000720f462bc95489f5-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2023-12-15T23:10:02.348 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.348 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.349 DEBUG:boto:Method: GET 2023-12-15T23:10:02.349 DEBUG:boto:Path: /kskgfn-45/i 2023-12-15T23:10:02.349 DEBUG:boto:Data: 2023-12-15T23:10:02.349 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.349 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.349 DEBUG:boto:Params: {} 2023-12-15T23:10:02.349 DEBUG:boto:Token: None 2023-12-15T23:10:02.349 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i 2023-12-15T23:10:02.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8IFezXX9IryIBveTbxMk0vE1+H4= 2023-12-15T23:10:02.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8IFezXX9IryIBveTbxMk0vE1+H4=', 'Content-Length': '0'} 2023-12-15T23:10:02.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f46fbe80d6cce127-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.397 DEBUG:boto:path=/kskgfn-45/i 2023-12-15T23:10:02.398 DEBUG:boto:auth_path=/kskgfn-45/i 2023-12-15T23:10:02.398 DEBUG:boto:Method: GET 2023-12-15T23:10:02.398 DEBUG:boto:Path: /kskgfn-45/i 2023-12-15T23:10:02.398 DEBUG:boto:Data: 2023-12-15T23:10:02.398 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.398 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.398 DEBUG:boto:Params: {} 2023-12-15T23:10:02.398 DEBUG:boto:Token: None 2023-12-15T23:10:02.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/i 2023-12-15T23:10:02.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8IFezXX9IryIBveTbxMk0vE1+H4= 2023-12-15T23:10:02.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8IFezXX9IryIBveTbxMk0vE1+H4=', 'Content-Length': '0'} 2023-12-15T23:10:02.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061c26d85404063f6-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.401 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.401 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.402 DEBUG:boto:path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.402 DEBUG:boto:auth_path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.402 DEBUG:boto:Method: GET 2023-12-15T23:10:02.402 DEBUG:boto:Path: /kskgfn-45/?prefix=i 2023-12-15T23:10:02.402 DEBUG:boto:Data: 2023-12-15T23:10:02.402 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.402 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.402 DEBUG:boto:Params: {} 2023-12-15T23:10:02.402 DEBUG:boto:Token: None 2023-12-15T23:10:02.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063754f6bc78ea5d5-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.405 DEBUG:boto:b'kskgfn-45i1000falsei2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.406 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.406 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.406 DEBUG:boto:path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.406 DEBUG:boto:auth_path=/kskgfn-45/?prefix=i 2023-12-15T23:10:02.406 DEBUG:boto:Method: GET 2023-12-15T23:10:02.406 DEBUG:boto:Path: /kskgfn-45/?prefix=i 2023-12-15T23:10:02.406 DEBUG:boto:Data: 2023-12-15T23:10:02.406 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.406 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.407 DEBUG:boto:Params: {} 2023-12-15T23:10:02.407 DEBUG:boto:Token: None 2023-12-15T23:10:02.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db251aa1d55e0a1a-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.409 DEBUG:boto:b'kskgfn-45i1000falsei2023-12-15T23:09:50.375Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2023-12-15T23:10:02.410 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.410 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.410 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.410 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.410 DEBUG:boto:Method: GET 2023-12-15T23:10:02.410 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.410 DEBUG:boto:Data: 2023-12-15T23:10:02.410 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.410 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.410 DEBUG:boto:Params: {} 2023-12-15T23:10:02.411 DEBUG:boto:Token: None 2023-12-15T23:10:02.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc= 2023-12-15T23:10:02.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc=', 'Content-Length': '0'} 2023-12-15T23:10:02.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cce128b0f0ebb8ce-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.453 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.454 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.454 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.454 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.454 DEBUG:boto:Method: GET 2023-12-15T23:10:02.454 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.454 DEBUG:boto:Data: 2023-12-15T23:10:02.454 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.454 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.454 DEBUG:boto:Params: {} 2023-12-15T23:10:02.454 DEBUG:boto:Token: None 2023-12-15T23:10:02.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc= 2023-12-15T23:10:02.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc=', 'Content-Length': '0'} 2023-12-15T23:10:02.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ef2149992858661-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.457 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.457 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.457 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.457 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.457 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.458 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.458 DEBUG:boto:Data: 2023-12-15T23:10:02.458 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.458 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.458 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.458 DEBUG:boto:Params: {} 2023-12-15T23:10:02.458 DEBUG:boto:Token: None 2023-12-15T23:10:02.458 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oHSqzTxgjpxCPPXR6nUaC+w0V5M= 2023-12-15T23:10:02.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oHSqzTxgjpxCPPXR6nUaC+w0V5M=', 'Content-Length': '0'} 2023-12-15T23:10:02.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da95137e7814cec3-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.460 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.460 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.460 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.461 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.461 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.461 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.461 DEBUG:boto:Data: 2023-12-15T23:10:02.461 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.461 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.461 DEBUG:boto:Params: {} 2023-12-15T23:10:02.461 DEBUG:boto:Token: None 2023-12-15T23:10:02.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oHSqzTxgjpxCPPXR6nUaC+w0V5M= 2023-12-15T23:10:02.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oHSqzTxgjpxCPPXR6nUaC+w0V5M=', 'Content-Length': '0'} 2023-12-15T23:10:02.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008693d0dc8a9d8ad2-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.464 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2023-12-15T23:10:02.464 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.464 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.464 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.464 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.464 DEBUG:boto:Method: GET 2023-12-15T23:10:02.464 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.464 DEBUG:boto:Data: 2023-12-15T23:10:02.464 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.464 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.464 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.464 DEBUG:boto:Params: {} 2023-12-15T23:10:02.465 DEBUG:boto:Token: None 2023-12-15T23:10:02.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc= 2023-12-15T23:10:02.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc=', 'Content-Length': '0'} 2023-12-15T23:10:02.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abd9c2a41b8eecde-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.509 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.510 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.510 DEBUG:boto:path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.510 DEBUG:boto:auth_path=/kskgfn-45/j?versionId=null 2023-12-15T23:10:02.510 DEBUG:boto:Method: GET 2023-12-15T23:10:02.510 DEBUG:boto:Path: /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.510 DEBUG:boto:Data: 2023-12-15T23:10:02.510 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.510 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.510 DEBUG:boto:Params: {} 2023-12-15T23:10:02.510 DEBUG:boto:Token: None 2023-12-15T23:10:02.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j?versionId=null 2023-12-15T23:10:02.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc= 2023-12-15T23:10:02.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VRrNj44oCUlDUkfhA1WpFGsi2Rc=', 'Content-Length': '0'} 2023-12-15T23:10:02.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d3db897096e14f-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.513 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.513 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.513 DEBUG:boto:path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.513 DEBUG:boto:auth_path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.513 DEBUG:boto:Method: GET 2023-12-15T23:10:02.514 DEBUG:boto:Path: /kskgfn-45/?prefix=j 2023-12-15T23:10:02.514 DEBUG:boto:Data: 2023-12-15T23:10:02.514 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.514 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.514 DEBUG:boto:Params: {} 2023-12-15T23:10:02.514 DEBUG:boto:Token: None 2023-12-15T23:10:02.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dfb57a90884dcf7-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.517 DEBUG:boto:b'kskgfn-45j1000falsej2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.517 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.517 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.517 DEBUG:boto:path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.518 DEBUG:boto:auth_path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.518 DEBUG:boto:Method: GET 2023-12-15T23:10:02.518 DEBUG:boto:Path: /kskgfn-45/?prefix=j 2023-12-15T23:10:02.518 DEBUG:boto:Data: 2023-12-15T23:10:02.518 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.520 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.520 DEBUG:boto:Params: {} 2023-12-15T23:10:02.520 DEBUG:boto:Token: None 2023-12-15T23:10:02.520 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.520 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000200f9ef542dbf600-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.523 DEBUG:boto:b'kskgfn-45j1000falsej2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.523 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.523 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.523 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.523 DEBUG:boto:Path: /kskgfn-45/j 2023-12-15T23:10:02.523 DEBUG:boto:Data: 2023-12-15T23:10:02.523 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.524 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.524 DEBUG:boto:Params: {} 2023-12-15T23:10:02.524 DEBUG:boto:Token: None 2023-12-15T23:10:02.524 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j 2023-12-15T23:10:02.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8lnHDz7Ugnjo5Qz51fLR5buGFLE= 2023-12-15T23:10:02.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8lnHDz7Ugnjo5Qz51fLR5buGFLE=', 'Content-Length': '0'} 2023-12-15T23:10:02.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007720888715464e75-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.526 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.526 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.526 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.526 DEBUG:boto:Path: /kskgfn-45/j 2023-12-15T23:10:02.527 DEBUG:boto:Data: 2023-12-15T23:10:02.527 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.527 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.527 DEBUG:boto:Params: {} 2023-12-15T23:10:02.527 DEBUG:boto:Token: None 2023-12-15T23:10:02.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j 2023-12-15T23:10:02.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8lnHDz7Ugnjo5Qz51fLR5buGFLE= 2023-12-15T23:10:02.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8lnHDz7Ugnjo5Qz51fLR5buGFLE=', 'Content-Length': '0'} 2023-12-15T23:10:02.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee3b44643124b767-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2023-12-15T23:10:02.529 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.530 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.530 DEBUG:boto:Method: GET 2023-12-15T23:10:02.530 DEBUG:boto:Path: /kskgfn-45/j 2023-12-15T23:10:02.530 DEBUG:boto:Data: 2023-12-15T23:10:02.530 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.530 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.530 DEBUG:boto:Params: {} 2023-12-15T23:10:02.530 DEBUG:boto:Token: None 2023-12-15T23:10:02.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j 2023-12-15T23:10:02.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+TGFB/eD4B1sjzCEBZNYqBcs4dc= 2023-12-15T23:10:02.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+TGFB/eD4B1sjzCEBZNYqBcs4dc=', 'Content-Length': '0'} 2023-12-15T23:10:02.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cad296b063ff410d-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.573 DEBUG:boto:path=/kskgfn-45/j 2023-12-15T23:10:02.574 DEBUG:boto:auth_path=/kskgfn-45/j 2023-12-15T23:10:02.574 DEBUG:boto:Method: GET 2023-12-15T23:10:02.574 DEBUG:boto:Path: /kskgfn-45/j 2023-12-15T23:10:02.574 DEBUG:boto:Data: 2023-12-15T23:10:02.574 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.574 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.574 DEBUG:boto:Params: {} 2023-12-15T23:10:02.574 DEBUG:boto:Token: None 2023-12-15T23:10:02.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/j 2023-12-15T23:10:02.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+TGFB/eD4B1sjzCEBZNYqBcs4dc= 2023-12-15T23:10:02.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+TGFB/eD4B1sjzCEBZNYqBcs4dc=', 'Content-Length': '0'} 2023-12-15T23:10:02.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005360a6ae8f3cd60f-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.577 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.577 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.577 DEBUG:boto:path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.577 DEBUG:boto:auth_path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.577 DEBUG:boto:Method: GET 2023-12-15T23:10:02.577 DEBUG:boto:Path: /kskgfn-45/?prefix=j 2023-12-15T23:10:02.577 DEBUG:boto:Data: 2023-12-15T23:10:02.577 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.577 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.577 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.577 DEBUG:boto:Params: {} 2023-12-15T23:10:02.578 DEBUG:boto:Token: None 2023-12-15T23:10:02.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.580 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005defea626c4b8eec-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.621 DEBUG:boto:b'kskgfn-45j1000falsej2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.622 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.622 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.622 DEBUG:boto:path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.622 DEBUG:boto:auth_path=/kskgfn-45/?prefix=j 2023-12-15T23:10:02.622 DEBUG:boto:Method: GET 2023-12-15T23:10:02.622 DEBUG:boto:Path: /kskgfn-45/?prefix=j 2023-12-15T23:10:02.622 DEBUG:boto:Data: 2023-12-15T23:10:02.622 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.623 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.623 DEBUG:boto:Params: {} 2023-12-15T23:10:02.623 DEBUG:boto:Token: None 2023-12-15T23:10:02.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.625 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025a74124f8af6d9d-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.625 DEBUG:boto:b'kskgfn-45j1000falsej2023-12-15T23:09:50.384Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2023-12-15T23:10:02.625 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.626 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.626 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.626 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.626 DEBUG:boto:Method: GET 2023-12-15T23:10:02.626 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.626 DEBUG:boto:Data: 2023-12-15T23:10:02.626 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.626 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.626 DEBUG:boto:Params: {} 2023-12-15T23:10:02.626 DEBUG:boto:Token: None 2023-12-15T23:10:02.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us= 2023-12-15T23:10:02.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us=', 'Content-Length': '0'} 2023-12-15T23:10:02.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004398f472cf50581-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.673 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.674 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.674 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.674 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.674 DEBUG:boto:Method: GET 2023-12-15T23:10:02.674 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.674 DEBUG:boto:Data: 2023-12-15T23:10:02.674 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.674 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.674 DEBUG:boto:Params: {} 2023-12-15T23:10:02.674 DEBUG:boto:Token: None 2023-12-15T23:10:02.675 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us= 2023-12-15T23:10:02.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us=', 'Content-Length': '0'} 2023-12-15T23:10:02.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c09cbe71e2cc5d4-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.677 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.677 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.677 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.677 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.677 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.678 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.678 DEBUG:boto:Data: 2023-12-15T23:10:02.678 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.678 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.678 DEBUG:boto:Params: {} 2023-12-15T23:10:02.678 DEBUG:boto:Token: None 2023-12-15T23:10:02.678 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yszlg8MBZfZBk2+RUs+62ugK2P4= 2023-12-15T23:10:02.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yszlg8MBZfZBk2+RUs+62ugK2P4=', 'Content-Length': '0'} 2023-12-15T23:10:02.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069e01b04489c8fff-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.680 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.681 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.681 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.681 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.681 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.681 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.681 DEBUG:boto:Data: 2023-12-15T23:10:02.681 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.681 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.681 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.681 DEBUG:boto:Params: {} 2023-12-15T23:10:02.681 DEBUG:boto:Token: None 2023-12-15T23:10:02.682 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yszlg8MBZfZBk2+RUs+62ugK2P4= 2023-12-15T23:10:02.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yszlg8MBZfZBk2+RUs+62ugK2P4=', 'Content-Length': '0'} 2023-12-15T23:10:02.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9ea14e6665eb99b-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.684 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2023-12-15T23:10:02.684 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.684 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.684 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.684 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.684 DEBUG:boto:Method: GET 2023-12-15T23:10:02.684 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.684 DEBUG:boto:Data: 2023-12-15T23:10:02.685 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.685 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.685 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.685 DEBUG:boto:Params: {} 2023-12-15T23:10:02.685 DEBUG:boto:Token: None 2023-12-15T23:10:02.685 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us= 2023-12-15T23:10:02.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us=', 'Content-Length': '0'} 2023-12-15T23:10:02.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000157b2eb2be81706d-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.729 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.730 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.730 DEBUG:boto:path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.730 DEBUG:boto:auth_path=/kskgfn-45/k?versionId=null 2023-12-15T23:10:02.730 DEBUG:boto:Method: GET 2023-12-15T23:10:02.730 DEBUG:boto:Path: /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.730 DEBUG:boto:Data: 2023-12-15T23:10:02.730 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.730 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.730 DEBUG:boto:Params: {} 2023-12-15T23:10:02.730 DEBUG:boto:Token: None 2023-12-15T23:10:02.731 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k?versionId=null 2023-12-15T23:10:02.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us= 2023-12-15T23:10:02.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDUrtGyEYGOKgVQwzHu5jbqz1Us=', 'Content-Length': '0'} 2023-12-15T23:10:02.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042f5dafe2a2292b3-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.733 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.733 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.733 DEBUG:boto:path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.733 DEBUG:boto:auth_path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.733 DEBUG:boto:Method: GET 2023-12-15T23:10:02.733 DEBUG:boto:Path: /kskgfn-45/?prefix=k 2023-12-15T23:10:02.734 DEBUG:boto:Data: 2023-12-15T23:10:02.734 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.734 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.734 DEBUG:boto:Params: {} 2023-12-15T23:10:02.734 DEBUG:boto:Token: None 2023-12-15T23:10:02.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000365880b07f703f8f-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.781 DEBUG:boto:b'kskgfn-45k1000falsek2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.782 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.782 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.782 DEBUG:boto:path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.782 DEBUG:boto:auth_path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.782 DEBUG:boto:Method: GET 2023-12-15T23:10:02.782 DEBUG:boto:Path: /kskgfn-45/?prefix=k 2023-12-15T23:10:02.782 DEBUG:boto:Data: 2023-12-15T23:10:02.783 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.783 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.783 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.783 DEBUG:boto:Params: {} 2023-12-15T23:10:02.783 DEBUG:boto:Token: None 2023-12-15T23:10:02.783 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.785 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059fec80764030b93-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.785 DEBUG:boto:b'kskgfn-45k1000falsek2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.786 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.786 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.786 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.786 DEBUG:boto:Path: /kskgfn-45/k 2023-12-15T23:10:02.786 DEBUG:boto:Data: 2023-12-15T23:10:02.786 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.786 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.786 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.787 DEBUG:boto:Params: {} 2023-12-15T23:10:02.787 DEBUG:boto:Token: None 2023-12-15T23:10:02.787 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k 2023-12-15T23:10:02.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nuctdz/nYOWgATYv7uiTqv8dOL8= 2023-12-15T23:10:02.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nuctdz/nYOWgATYv7uiTqv8dOL8=', 'Content-Length': '0'} 2023-12-15T23:10:02.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6e5f2d9e9c07966-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.789 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.789 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.789 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.790 DEBUG:boto:Path: /kskgfn-45/k 2023-12-15T23:10:02.790 DEBUG:boto:Data: 2023-12-15T23:10:02.790 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.790 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.790 DEBUG:boto:Params: {} 2023-12-15T23:10:02.790 DEBUG:boto:Token: None 2023-12-15T23:10:02.790 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k 2023-12-15T23:10:02.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nuctdz/nYOWgATYv7uiTqv8dOL8= 2023-12-15T23:10:02.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nuctdz/nYOWgATYv7uiTqv8dOL8=', 'Content-Length': '0'} 2023-12-15T23:10:02.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008599fa4a6998cd9e-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2023-12-15T23:10:02.792 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.793 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.793 DEBUG:boto:Method: GET 2023-12-15T23:10:02.793 DEBUG:boto:Path: /kskgfn-45/k 2023-12-15T23:10:02.793 DEBUG:boto:Data: 2023-12-15T23:10:02.793 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.793 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.793 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.793 DEBUG:boto:Params: {} 2023-12-15T23:10:02.793 DEBUG:boto:Token: None 2023-12-15T23:10:02.793 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k 2023-12-15T23:10:02.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DqWGxyEG+WSqnXzBBO15s7rnjjo= 2023-12-15T23:10:02.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DqWGxyEG+WSqnXzBBO15s7rnjjo=', 'Content-Length': '0'} 2023-12-15T23:10:02.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000791b6a470950d1fd-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.837 DEBUG:boto:path=/kskgfn-45/k 2023-12-15T23:10:02.838 DEBUG:boto:auth_path=/kskgfn-45/k 2023-12-15T23:10:02.838 DEBUG:boto:Method: GET 2023-12-15T23:10:02.838 DEBUG:boto:Path: /kskgfn-45/k 2023-12-15T23:10:02.838 DEBUG:boto:Data: 2023-12-15T23:10:02.838 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.838 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.838 DEBUG:boto:Params: {} 2023-12-15T23:10:02.838 DEBUG:boto:Token: None 2023-12-15T23:10:02.838 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/k 2023-12-15T23:10:02.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DqWGxyEG+WSqnXzBBO15s7rnjjo= 2023-12-15T23:10:02.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DqWGxyEG+WSqnXzBBO15s7rnjjo=', 'Content-Length': '0'} 2023-12-15T23:10:02.840 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c634d1d052a571eb-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.841 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.841 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.841 DEBUG:boto:path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.841 DEBUG:boto:auth_path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.841 DEBUG:boto:Method: GET 2023-12-15T23:10:02.841 DEBUG:boto:Path: /kskgfn-45/?prefix=k 2023-12-15T23:10:02.841 DEBUG:boto:Data: 2023-12-15T23:10:02.841 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.841 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.842 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.842 DEBUG:boto:Params: {} 2023-12-15T23:10:02.842 DEBUG:boto:Token: None 2023-12-15T23:10:02.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.844 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f54ecb1fbabbe502-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.844 DEBUG:boto:b'kskgfn-45k1000falsek2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.845 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.845 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.845 DEBUG:boto:path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.845 DEBUG:boto:auth_path=/kskgfn-45/?prefix=k 2023-12-15T23:10:02.845 DEBUG:boto:Method: GET 2023-12-15T23:10:02.845 DEBUG:boto:Path: /kskgfn-45/?prefix=k 2023-12-15T23:10:02.845 DEBUG:boto:Data: 2023-12-15T23:10:02.845 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.845 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.845 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.846 DEBUG:boto:Params: {} 2023-12-15T23:10:02.846 DEBUG:boto:Token: None 2023-12-15T23:10:02.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000624d645f04bd4d89-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.848 DEBUG:boto:b'kskgfn-45k1000falsek2023-12-15T23:09:50.431Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2023-12-15T23:10:02.849 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.849 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.849 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.849 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.849 DEBUG:boto:Method: GET 2023-12-15T23:10:02.849 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.849 DEBUG:boto:Data: 2023-12-15T23:10:02.849 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.849 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.849 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.850 DEBUG:boto:Params: {} 2023-12-15T23:10:02.850 DEBUG:boto:Token: None 2023-12-15T23:10:02.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc= 2023-12-15T23:10:02.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc=', 'Content-Length': '0'} 2023-12-15T23:10:02.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018b380b5fec0b198-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.893 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.894 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.894 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.894 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.894 DEBUG:boto:Method: GET 2023-12-15T23:10:02.894 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.894 DEBUG:boto:Data: 2023-12-15T23:10:02.894 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.894 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.894 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.894 DEBUG:boto:Params: {} 2023-12-15T23:10:02.894 DEBUG:boto:Token: None 2023-12-15T23:10:02.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc= 2023-12-15T23:10:02.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc=', 'Content-Length': '0'} 2023-12-15T23:10:02.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db602c8b209bb456-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.897 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.897 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.897 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.897 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.897 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.897 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.897 DEBUG:boto:Data: 2023-12-15T23:10:02.897 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.897 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.898 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.898 DEBUG:boto:Params: {} 2023-12-15T23:10:02.898 DEBUG:boto:Token: None 2023-12-15T23:10:02.898 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.898 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oOGs6DbPf4ZxysxJC1ZeIT/FOR4= 2023-12-15T23:10:02.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oOGs6DbPf4ZxysxJC1ZeIT/FOR4=', 'Content-Length': '0'} 2023-12-15T23:10:02.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051f33f3ba9ad145a-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.900 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.900 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.900 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.900 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.900 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.900 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.901 DEBUG:boto:Data: 2023-12-15T23:10:02.901 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.901 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.901 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.901 DEBUG:boto:Params: {} 2023-12-15T23:10:02.901 DEBUG:boto:Token: None 2023-12-15T23:10:02.901 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oOGs6DbPf4ZxysxJC1ZeIT/FOR4= 2023-12-15T23:10:02.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oOGs6DbPf4ZxysxJC1ZeIT/FOR4=', 'Content-Length': '0'} 2023-12-15T23:10:02.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000328ff122460112a2-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2023-12-15T23:10:02.903 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.904 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.904 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.904 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.904 DEBUG:boto:Method: GET 2023-12-15T23:10:02.904 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.904 DEBUG:boto:Data: 2023-12-15T23:10:02.904 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.904 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.904 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.904 DEBUG:boto:Params: {} 2023-12-15T23:10:02.904 DEBUG:boto:Token: None 2023-12-15T23:10:02.905 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.905 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc= 2023-12-15T23:10:02.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc=', 'Content-Length': '0'} 2023-12-15T23:10:02.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d07933aec87ee3ea-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.949 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.950 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.950 DEBUG:boto:path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.950 DEBUG:boto:auth_path=/kskgfn-45/l?versionId=null 2023-12-15T23:10:02.950 DEBUG:boto:Method: GET 2023-12-15T23:10:02.950 DEBUG:boto:Path: /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.950 DEBUG:boto:Data: 2023-12-15T23:10:02.950 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.950 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.950 DEBUG:boto:Params: {} 2023-12-15T23:10:02.950 DEBUG:boto:Token: None 2023-12-15T23:10:02.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l?versionId=null 2023-12-15T23:10:02.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc= 2023-12-15T23:10:02.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Ywc2ECechoL+Rz6GMUpJLKlSEc=', 'Content-Length': '0'} 2023-12-15T23:10:02.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd350d90d749ee2e-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.953 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.953 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.953 DEBUG:boto:path=/kskgfn-45/?prefix=l 2023-12-15T23:10:02.953 DEBUG:boto:auth_path=/kskgfn-45/?prefix=l 2023-12-15T23:10:02.953 DEBUG:boto:Method: GET 2023-12-15T23:10:02.953 DEBUG:boto:Path: /kskgfn-45/?prefix=l 2023-12-15T23:10:02.953 DEBUG:boto:Data: 2023-12-15T23:10:02.953 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.954 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.954 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.954 DEBUG:boto:Params: {} 2023-12-15T23:10:02.954 DEBUG:boto:Token: None 2023-12-15T23:10:02.954 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000060d044168f1074a-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.957 DEBUG:boto:b'kskgfn-45l1000falsel2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.957 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:02.957 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:02.957 DEBUG:boto:path=/kskgfn-45/?prefix=l 2023-12-15T23:10:02.957 DEBUG:boto:auth_path=/kskgfn-45/?prefix=l 2023-12-15T23:10:02.957 DEBUG:boto:Method: GET 2023-12-15T23:10:02.957 DEBUG:boto:Path: /kskgfn-45/?prefix=l 2023-12-15T23:10:02.957 DEBUG:boto:Data: 2023-12-15T23:10:02.958 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.958 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.958 DEBUG:boto:Params: {} 2023-12-15T23:10:02.958 DEBUG:boto:Token: None 2023-12-15T23:10:02.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/ 2023-12-15T23:10:02.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk= 2023-12-15T23:10:02.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P9eaE6ILc5dYQiIXH0WHIBGZ7dk=', 'Content-Length': '0'} 2023-12-15T23:10:02.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8593c5e13b2eb2a-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.960 DEBUG:boto:b'kskgfn-45l1000falsel2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:02.961 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.961 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.961 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.961 DEBUG:boto:Path: /kskgfn-45/l 2023-12-15T23:10:02.961 DEBUG:boto:Data: 2023-12-15T23:10:02.961 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.961 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.962 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.962 DEBUG:boto:Params: {} 2023-12-15T23:10:02.962 DEBUG:boto:Token: None 2023-12-15T23:10:02.962 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l 2023-12-15T23:10:02.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sXhtL5FnxTgzLoBiIJIWs08bHU= 2023-12-15T23:10:02.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sXhtL5FnxTgzLoBiIJIWs08bHU=', 'Content-Length': '0'} 2023-12-15T23:10:02.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093f23af33832082f-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.964 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.964 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.964 DEBUG:boto:Method: HEAD 2023-12-15T23:10:02.964 DEBUG:boto:Path: /kskgfn-45/l 2023-12-15T23:10:02.965 DEBUG:boto:Data: 2023-12-15T23:10:02.965 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.965 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:02.965 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.965 DEBUG:boto:Params: {} 2023-12-15T23:10:02.965 DEBUG:boto:Token: None 2023-12-15T23:10:02.965 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l 2023-12-15T23:10:02.965 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sXhtL5FnxTgzLoBiIJIWs08bHU= 2023-12-15T23:10:02.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sXhtL5FnxTgzLoBiIJIWs08bHU=', 'Content-Length': '0'} 2023-12-15T23:10:02.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fbabf5e7bea7813-00657cdcca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:02.967 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2023-12-15T23:10:02.967 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:02.967 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:02.968 DEBUG:boto:Method: GET 2023-12-15T23:10:02.968 DEBUG:boto:Path: /kskgfn-45/l 2023-12-15T23:10:02.968 DEBUG:boto:Data: 2023-12-15T23:10:02.968 DEBUG:boto:Headers: {} 2023-12-15T23:10:02.968 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:02.968 DEBUG:boto:Port: 8000 2023-12-15T23:10:02.968 DEBUG:boto:Params: {} 2023-12-15T23:10:02.968 DEBUG:boto:Token: None 2023-12-15T23:10:02.968 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:02 GMT /kskgfn-45/l 2023-12-15T23:10:02.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b61CBonzgQZuYAQjrzXOYnRR4mk= 2023-12-15T23:10:02.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:02 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b61CBonzgQZuYAQjrzXOYnRR4mk=', 'Content-Length': '0'} 2023-12-15T23:10:02.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000491dd1f665112659-00657cdcca-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:02 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.013 DEBUG:boto:path=/kskgfn-45/l 2023-12-15T23:10:03.014 DEBUG:boto:auth_path=/kskgfn-45/l 2023-12-15T23:10:03.014 DEBUG:boto:Method: GET 2023-12-15T23:10:03.014 DEBUG:boto:Path: /kskgfn-45/l 2023-12-15T23:10:03.014 DEBUG:boto:Data: 2023-12-15T23:10:03.014 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.014 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.014 DEBUG:boto:Params: {} 2023-12-15T23:10:03.014 DEBUG:boto:Token: None 2023-12-15T23:10:03.014 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-45/l 2023-12-15T23:10:03.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iRnNko8zcbQ90eEzzZPME20mnt4= 2023-12-15T23:10:03.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iRnNko8zcbQ90eEzzZPME20mnt4=', 'Content-Length': '0'} 2023-12-15T23:10:03.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:09:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008425673256a0bd8a-00657cdccb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.016 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:03.017 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:03.017 DEBUG:boto:path=/kskgfn-45/?prefix=l 2023-12-15T23:10:03.017 DEBUG:boto:auth_path=/kskgfn-45/?prefix=l 2023-12-15T23:10:03.017 DEBUG:boto:Method: GET 2023-12-15T23:10:03.017 DEBUG:boto:Path: /kskgfn-45/?prefix=l 2023-12-15T23:10:03.017 DEBUG:boto:Data: 2023-12-15T23:10:03.017 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.017 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:03.017 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.017 DEBUG:boto:Params: {} 2023-12-15T23:10:03.018 DEBUG:boto:Token: None 2023-12-15T23:10:03.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-45/ 2023-12-15T23:10:03.018 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4utoBFVB38uAbs7vktk+i8xIQOo= 2023-12-15T23:10:03.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4utoBFVB38uAbs7vktk+i8xIQOo=', 'Content-Length': '0'} 2023-12-15T23:10:03.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002887d7dbbaba64d1-00657cdccb-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.020 DEBUG:boto:b'kskgfn-45l1000falsel2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:03.020 DEBUG:boto:path=/kskgfn-45/ 2023-12-15T23:10:03.021 DEBUG:boto:auth_path=/kskgfn-45/ 2023-12-15T23:10:03.021 DEBUG:boto:path=/kskgfn-45/?prefix=l 2023-12-15T23:10:03.021 DEBUG:boto:auth_path=/kskgfn-45/?prefix=l 2023-12-15T23:10:03.021 DEBUG:boto:Method: GET 2023-12-15T23:10:03.021 DEBUG:boto:Path: /kskgfn-45/?prefix=l 2023-12-15T23:10:03.021 DEBUG:boto:Data: 2023-12-15T23:10:03.021 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.021 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.021 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.021 DEBUG:boto:Params: {} 2023-12-15T23:10:03.021 DEBUG:boto:Token: None 2023-12-15T23:10:03.022 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-45/ 2023-12-15T23:10:03.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4utoBFVB38uAbs7vktk+i8xIQOo= 2023-12-15T23:10:03.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4utoBFVB38uAbs7vktk+i8xIQOo=', 'Content-Length': '0'} 2023-12-15T23:10:03.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000941a0fd525a4f606-00657cdccb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.024 DEBUG:boto:b'kskgfn-45l1000falsel2023-12-15T23:09:50.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:03.024 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-45 zones={test-zone2, test-zone1} 2023-12-15T23:10:03.025 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'kskgfn-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.025 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket kskgfn-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:10:03.076 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:03.076 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:03.130 INFO:teuthology.orchestra.run.smithi093.stdout:[{"op_id":"0#00000000002.43.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15720805302485389429","op":"write","object":"k","instance":"","state":"complete","index_ver":2,"timestamp":"2023-12-15T23:09:50.431661560Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"1#00000000002.27.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12628652490855766085","op":"write","object":"j","instance":"","state":"complete","index_ver":2,"timestamp":"2023-12-15T23:09:50.384108327Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"2#00000000002.43.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2494907955888467385","op":"write","object":"i","instance":"","state":"complete","index_ver":2,"timestamp":"2023-12-15T23:09:50.375206527Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]},{"op_id":"2#00000000003.45.6","op_tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14729221604377099361","op":"write","object":"l","instance":"","state":"complete","index_ver":3,"timestamp":"2023-12-15T23:09:50.441401975Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-45:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16"}]}] 2023-12-15T23:10:03.132 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_index_log_trim ... ok 2023-12-15T23:10:03.133 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:03.134 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:03.134 DEBUG:boto:Method: PUT 2023-12-15T23:10:03.134 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:03.134 DEBUG:boto:Data: 2023-12-15T23:10:03.134 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.134 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.134 DEBUG:boto:Params: {} 2023-12-15T23:10:03.134 DEBUG:boto:Token: None 2023-12-15T23:10:03.134 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/ 2023-12-15T23:10:03.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SQ+9eqF0orj1TJiTOKwVHOo1QvE= 2023-12-15T23:10:03.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SQ+9eqF0orj1TJiTOKwVHOo1QvE=', 'Content-Length': '0'} 2023-12-15T23:10:03.157 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c9678538b11bcae8-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.158 DEBUG:rgw_multi.tests:created bucket=kskgfn-46 2023-12-15T23:10:03.158 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.158 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:10:03.204 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:03.204 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:03.237 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:10:03.252 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681803.155850_369.1","last_update":"2023-12-15T23:10:03.155850Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:10:03.252 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681803.155850_369.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:10:03.253 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:10:03.253 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:10:03.253 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:10:03.306 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:03.306 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:03.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:03.340+0000 7f63ec69d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:10:03.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:03.341+0000 7f63ec69d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:10:03.358 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681803.155850_369.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:10:03.155850Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:10:03Z"} 2023-12-15T23:10:03.358 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681803.155850_369.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:10:03.155850Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:10:03Z"} 2023-12-15T23:10:03.359 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681803.155850_369.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:10:03.155850Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:10:03.359 DEBUG:rgw_multi.tests:log_status={0: '1_1702681803.155850_369.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:10:03.359 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681803.155850_369.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:10:03.359 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:10:03.359 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:03.359 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:03.359 DEBUG:boto:Method: HEAD 2023-12-15T23:10:03.360 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:03.360 DEBUG:boto:Data: 2023-12-15T23:10:03.360 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.360 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.360 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.360 DEBUG:boto:Params: {} 2023-12-15T23:10:03.360 DEBUG:boto:Token: None 2023-12-15T23:10:03.360 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/ 2023-12-15T23:10:03.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI= 2023-12-15T23:10:03.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI=', 'Content-Length': '0'} 2023-12-15T23:10:03.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000077177af9f0b93caa-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.363 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:03.363 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:03.363 DEBUG:boto:Method: PUT 2023-12-15T23:10:03.364 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:10:03.364 DEBUG:boto:Data: 2023-12-15T23:10:03.364 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:03.364 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.364 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.364 DEBUG:boto:Params: {} 2023-12-15T23:10:03.364 DEBUG:boto:Token: None 2023-12-15T23:10:03.364 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/a 2023-12-15T23:10:03.364 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zsmmyjjLXnVwj0WB+kPZjgyAuxE= 2023-12-15T23:10:03.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zsmmyjjLXnVwj0WB+kPZjgyAuxE='} 2023-12-15T23:10:03.410 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f8d1d50c4cb0cc79-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.410 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:03.410 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:03.410 DEBUG:boto:Method: HEAD 2023-12-15T23:10:03.410 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:03.410 DEBUG:boto:Data: 2023-12-15T23:10:03.410 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.410 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.410 DEBUG:boto:Params: {} 2023-12-15T23:10:03.411 DEBUG:boto:Token: None 2023-12-15T23:10:03.411 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/ 2023-12-15T23:10:03.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI= 2023-12-15T23:10:03.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI=', 'Content-Length': '0'} 2023-12-15T23:10:03.413 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000592f7aad9381a0ba-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.413 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:03.414 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:03.414 DEBUG:boto:Method: PUT 2023-12-15T23:10:03.414 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:10:03.414 DEBUG:boto:Data: 2023-12-15T23:10:03.414 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:03.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.414 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.414 DEBUG:boto:Params: {} 2023-12-15T23:10:03.414 DEBUG:boto:Token: None 2023-12-15T23:10:03.415 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/b 2023-12-15T23:10:03.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gq2xZjPoHTt+G8/WPraJeA+HD5I= 2023-12-15T23:10:03.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gq2xZjPoHTt+G8/WPraJeA+HD5I='} 2023-12-15T23:10:03.421 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000c36a4c37e1bf930-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.421 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:03.422 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:03.422 DEBUG:boto:Method: HEAD 2023-12-15T23:10:03.422 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:03.422 DEBUG:boto:Data: 2023-12-15T23:10:03.422 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.422 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.422 DEBUG:boto:Params: {} 2023-12-15T23:10:03.422 DEBUG:boto:Token: None 2023-12-15T23:10:03.423 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/ 2023-12-15T23:10:03.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI= 2023-12-15T23:10:03.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI=', 'Content-Length': '0'} 2023-12-15T23:10:03.425 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bee68ae527ba67d8-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.425 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:03.425 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:03.425 DEBUG:boto:Method: PUT 2023-12-15T23:10:03.426 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:10:03.426 DEBUG:boto:Data: 2023-12-15T23:10:03.426 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:03.426 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.426 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.426 DEBUG:boto:Params: {} 2023-12-15T23:10:03.426 DEBUG:boto:Token: None 2023-12-15T23:10:03.426 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/c 2023-12-15T23:10:03.426 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5CKfYgAX9ZaJqORMMSwgvVc06tg= 2023-12-15T23:10:03.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5CKfYgAX9ZaJqORMMSwgvVc06tg='} 2023-12-15T23:10:03.433 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000137fdea691e5e547-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.433 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:03.433 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:03.433 DEBUG:boto:Method: HEAD 2023-12-15T23:10:03.433 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:03.433 DEBUG:boto:Data: 2023-12-15T23:10:03.433 DEBUG:boto:Headers: {} 2023-12-15T23:10:03.433 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.434 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.434 DEBUG:boto:Params: {} 2023-12-15T23:10:03.434 DEBUG:boto:Token: None 2023-12-15T23:10:03.434 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/ 2023-12-15T23:10:03.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI= 2023-12-15T23:10:03.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:etFtEWnfcEydWlkmrfi/JBB5hLI=', 'Content-Length': '0'} 2023-12-15T23:10:03.436 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1b0ffca70125a15-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.436 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:03.437 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:03.437 DEBUG:boto:Method: PUT 2023-12-15T23:10:03.437 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:10:03.437 DEBUG:boto:Data: 2023-12-15T23:10:03.437 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:03.437 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:03.437 DEBUG:boto:Port: 8000 2023-12-15T23:10:03.437 DEBUG:boto:Params: {} 2023-12-15T23:10:03.437 DEBUG:boto:Token: None 2023-12-15T23:10:03.438 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:03 GMT /kskgfn-46/d 2023-12-15T23:10:03.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CDf1WKmQ3SFgTeMW7PlkI5zZfeE= 2023-12-15T23:10:03.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CDf1WKmQ3SFgTeMW7PlkI5zZfeE='} 2023-12-15T23:10:03.482 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d9c92c26e5cb637-00657cdccb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:03.482 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-46 2023-12-15T23:10:03.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:03.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:03.482 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-46 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:10:03.537 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:03.538 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:03.573 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:03.572+0000 7f57e7526800 1 waiting to reach incremental sync.. 2023-12-15T23:10:08.575 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:08.575+0000 7f57e7526800 1 bucket sync caught up with source: 2023-12-15T23:10:08.576 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.18.6, , , , 00000000001.29.6, , , 00000000001.20.6, , 00000000001.32.6] 2023-12-15T23:10:08.576 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, 00000000001.18.6, , , , 00000000001.29.6, , , 00000000001.20.6, , 00000000001.32.6] 2023-12-15T23:10:08.576 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:08.575+0000 7f57e7526800 0 bucket checkpoint complete 2023-12-15T23:10:08.596 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-46 2023-12-15T23:10:08.596 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:08.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:08.597 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-46 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:10:08.657 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:08.657 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:08.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:10:08.694+0000 7f0f53d2f800 1 bucket sync caught up with source: 2023-12-15T23:10:08.695 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.64.6, , , , 00000000001.53.6, , , 00000000001.66.6, , 00000000001.70.6] 2023-12-15T23:10:08.696 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.64.6, , , , 00000000001.53.6, , , 00000000001.66.6, , 00000000001.70.6] 2023-12-15T23:10:08.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:10:08.694+0000 7f0f53d2f800 0 bucket checkpoint complete 2023-12-15T23:10:08.710 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-46 zones={test-zone2, test-zone1} 2023-12-15T23:10:08.710 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.711 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.711 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.711 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:08.711 DEBUG:boto:Data: 2023-12-15T23:10:08.711 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.712 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.712 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.712 DEBUG:boto:Params: {} 2023-12-15T23:10:08.712 DEBUG:boto:Token: None 2023-12-15T23:10:08.713 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pc4kzQGlFdF2iGZ7n4ltlwSql1c= 2023-12-15T23:10:08.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pc4kzQGlFdF2iGZ7n4ltlwSql1c=', 'Content-Length': '0'} 2023-12-15T23:10:08.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009d040b6175009b48-00657cdcd0-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.716 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.716 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.717 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.717 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:08.717 DEBUG:boto:Data: 2023-12-15T23:10:08.717 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.718 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.718 DEBUG:boto:Params: {} 2023-12-15T23:10:08.718 DEBUG:boto:Token: None 2023-12-15T23:10:08.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pc4kzQGlFdF2iGZ7n4ltlwSql1c= 2023-12-15T23:10:08.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pc4kzQGlFdF2iGZ7n4ltlwSql1c=', 'Content-Length': '0'} 2023-12-15T23:10:08.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bf58da95478c812d-00657cdcd0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.722 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:10:08.722 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.722 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.722 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.723 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.723 DEBUG:boto:Method: GET 2023-12-15T23:10:08.723 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.723 DEBUG:boto:Data: 2023-12-15T23:10:08.723 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.724 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.724 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.724 DEBUG:boto:Params: {} 2023-12-15T23:10:08.724 DEBUG:boto:Token: None 2023-12-15T23:10:08.725 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/?versions 2023-12-15T23:10:08.725 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo= 2023-12-15T23:10:08.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo=', 'Content-Length': '0'} 2023-12-15T23:10:08.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000458f6e2400d3905a-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.728 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.729 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:10:08.729 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:10:08.730 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:10:08.730 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:10:08.730 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:10:08.730 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.730 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.731 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.731 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.731 DEBUG:boto:Method: GET 2023-12-15T23:10:08.731 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.731 DEBUG:boto:Data: 2023-12-15T23:10:08.732 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.732 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.732 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.732 DEBUG:boto:Params: {} 2023-12-15T23:10:08.732 DEBUG:boto:Token: None 2023-12-15T23:10:08.733 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/?versions 2023-12-15T23:10:08.733 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo= 2023-12-15T23:10:08.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo=', 'Content-Length': '0'} 2023-12-15T23:10:08.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d81cf7c44b2c9a77-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.736 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.737 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:10:08.737 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:10:08.737 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:10:08.737 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:10:08.738 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.738 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.738 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.738 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.739 DEBUG:boto:Method: GET 2023-12-15T23:10:08.739 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.739 DEBUG:boto:Data: 2023-12-15T23:10:08.739 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.739 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.740 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.740 DEBUG:boto:Params: {} 2023-12-15T23:10:08.740 DEBUG:boto:Token: None 2023-12-15T23:10:08.740 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/?versions 2023-12-15T23:10:08.740 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo= 2023-12-15T23:10:08.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo=', 'Content-Length': '0'} 2023-12-15T23:10:08.743 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef05c66c8c38a82c-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.743 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.744 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.744 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.745 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.745 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.745 DEBUG:boto:Method: GET 2023-12-15T23:10:08.745 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:10:08.746 DEBUG:boto:Data: 2023-12-15T23:10:08.746 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.746 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.746 DEBUG:boto:Params: {} 2023-12-15T23:10:08.747 DEBUG:boto:Token: None 2023-12-15T23:10:08.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/?versions 2023-12-15T23:10:08.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo= 2023-12-15T23:10:08.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZO0q5Nja25P0lomNdjqwfVKxCo=', 'Content-Length': '0'} 2023-12-15T23:10:08.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005aace1ffada0b79b-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.750 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:08.751 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.751 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.752 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.752 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.752 DEBUG:boto:Method: GET 2023-12-15T23:10:08.752 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.752 DEBUG:boto:Data: 2023-12-15T23:10:08.753 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.753 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.753 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.753 DEBUG:boto:Params: {} 2023-12-15T23:10:08.754 DEBUG:boto:Token: None 2023-12-15T23:10:08.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU= 2023-12-15T23:10:08.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU=', 'Content-Length': '0'} 2023-12-15T23:10:08.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008143838fe9d8c61c-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.757 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.757 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.757 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.757 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.758 DEBUG:boto:Method: GET 2023-12-15T23:10:08.758 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.758 DEBUG:boto:Data: 2023-12-15T23:10:08.758 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.758 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.758 DEBUG:boto:Params: {} 2023-12-15T23:10:08.758 DEBUG:boto:Token: None 2023-12-15T23:10:08.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU= 2023-12-15T23:10:08.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU=', 'Content-Length': '0'} 2023-12-15T23:10:08.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b6049cc0f990649-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.761 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.761 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.761 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.761 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.761 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.761 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.761 DEBUG:boto:Data: 2023-12-15T23:10:08.761 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.761 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.762 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.762 DEBUG:boto:Params: {} 2023-12-15T23:10:08.762 DEBUG:boto:Token: None 2023-12-15T23:10:08.762 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d27DBNSi5zURxjrj7Va643R+D+4= 2023-12-15T23:10:08.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d27DBNSi5zURxjrj7Va643R+D+4=', 'Content-Length': '0'} 2023-12-15T23:10:08.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f1a89daf238420a-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.764 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.764 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.765 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.765 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.765 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.765 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.765 DEBUG:boto:Data: 2023-12-15T23:10:08.765 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.765 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.765 DEBUG:boto:Params: {} 2023-12-15T23:10:08.765 DEBUG:boto:Token: None 2023-12-15T23:10:08.765 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d27DBNSi5zURxjrj7Va643R+D+4= 2023-12-15T23:10:08.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d27DBNSi5zURxjrj7Va643R+D+4=', 'Content-Length': '0'} 2023-12-15T23:10:08.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078c64f6d63f9c247-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:08.768 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.768 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.768 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.768 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.768 DEBUG:boto:Method: GET 2023-12-15T23:10:08.768 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.769 DEBUG:boto:Data: 2023-12-15T23:10:08.769 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.769 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.769 DEBUG:boto:Params: {} 2023-12-15T23:10:08.769 DEBUG:boto:Token: None 2023-12-15T23:10:08.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU= 2023-12-15T23:10:08.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU=', 'Content-Length': '0'} 2023-12-15T23:10:08.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b4f03493386a1f1-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.771 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.772 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.772 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.772 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:10:08.772 DEBUG:boto:Method: GET 2023-12-15T23:10:08.772 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.772 DEBUG:boto:Data: 2023-12-15T23:10:08.772 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.772 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.772 DEBUG:boto:Params: {} 2023-12-15T23:10:08.773 DEBUG:boto:Token: None 2023-12-15T23:10:08.773 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:10:08.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU= 2023-12-15T23:10:08.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jT7F9ywAAxpSFFv9NERyIkKLmvU=', 'Content-Length': '0'} 2023-12-15T23:10:08.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000312f1f32549691d8-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.775 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.775 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.775 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.775 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.775 DEBUG:boto:Method: GET 2023-12-15T23:10:08.775 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:10:08.776 DEBUG:boto:Data: 2023-12-15T23:10:08.776 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.776 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.776 DEBUG:boto:Params: {} 2023-12-15T23:10:08.776 DEBUG:boto:Token: None 2023-12-15T23:10:08.776 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8= 2023-12-15T23:10:08.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8=', 'Content-Length': '0'} 2023-12-15T23:10:08.779 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027faf447798bdf79-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.779 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.779 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.779 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.779 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.779 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.780 DEBUG:boto:Method: GET 2023-12-15T23:10:08.780 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:10:08.780 DEBUG:boto:Data: 2023-12-15T23:10:08.780 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.780 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.780 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.780 DEBUG:boto:Params: {} 2023-12-15T23:10:08.780 DEBUG:boto:Token: None 2023-12-15T23:10:08.780 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.780 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8= 2023-12-15T23:10:08.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8=', 'Content-Length': '0'} 2023-12-15T23:10:08.783 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000804685e02ae6a1de-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.783 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.783 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.783 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.784 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.784 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:10:08.784 DEBUG:boto:Data: 2023-12-15T23:10:08.784 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.784 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.784 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.784 DEBUG:boto:Params: {} 2023-12-15T23:10:08.784 DEBUG:boto:Token: None 2023-12-15T23:10:08.784 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a 2023-12-15T23:10:08.784 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JxqR9NKbYsD6BpM5HZ43tqE6INc= 2023-12-15T23:10:08.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JxqR9NKbYsD6BpM5HZ43tqE6INc=', 'Content-Length': '0'} 2023-12-15T23:10:08.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000613d8682179f1390-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.787 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.787 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.787 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.787 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:10:08.787 DEBUG:boto:Data: 2023-12-15T23:10:08.787 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.787 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.787 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.787 DEBUG:boto:Params: {} 2023-12-15T23:10:08.787 DEBUG:boto:Token: None 2023-12-15T23:10:08.788 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a 2023-12-15T23:10:08.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JxqR9NKbYsD6BpM5HZ43tqE6INc= 2023-12-15T23:10:08.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JxqR9NKbYsD6BpM5HZ43tqE6INc=', 'Content-Length': '0'} 2023-12-15T23:10:08.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a59256143e5bd4cd-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.790 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:10:08.790 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.790 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.790 DEBUG:boto:Method: GET 2023-12-15T23:10:08.790 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:10:08.790 DEBUG:boto:Data: 2023-12-15T23:10:08.791 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.791 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.791 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.791 DEBUG:boto:Params: {} 2023-12-15T23:10:08.791 DEBUG:boto:Token: None 2023-12-15T23:10:08.791 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a 2023-12-15T23:10:08.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wE5UDZXqA324ZAApjlWXFMpgKpU= 2023-12-15T23:10:08.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wE5UDZXqA324ZAApjlWXFMpgKpU=', 'Content-Length': '0'} 2023-12-15T23:10:08.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e17ef26d24c6661-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.841 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:10:08.841 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:10:08.842 DEBUG:boto:Method: GET 2023-12-15T23:10:08.842 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:10:08.842 DEBUG:boto:Data: 2023-12-15T23:10:08.842 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.842 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.842 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.842 DEBUG:boto:Params: {} 2023-12-15T23:10:08.842 DEBUG:boto:Token: None 2023-12-15T23:10:08.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/a 2023-12-15T23:10:08.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wE5UDZXqA324ZAApjlWXFMpgKpU= 2023-12-15T23:10:08.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wE5UDZXqA324ZAApjlWXFMpgKpU=', 'Content-Length': '0'} 2023-12-15T23:10:08.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060785de97adb0b8b-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.844 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.845 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.845 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.845 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.845 DEBUG:boto:Method: GET 2023-12-15T23:10:08.845 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:10:08.845 DEBUG:boto:Data: 2023-12-15T23:10:08.845 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.845 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.845 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.845 DEBUG:boto:Params: {} 2023-12-15T23:10:08.846 DEBUG:boto:Token: None 2023-12-15T23:10:08.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8= 2023-12-15T23:10:08.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8=', 'Content-Length': '0'} 2023-12-15T23:10:08.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c5b6e8bfc020464-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.848 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.849 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.849 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.849 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.849 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:10:08.849 DEBUG:boto:Method: GET 2023-12-15T23:10:08.849 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:10:08.849 DEBUG:boto:Data: 2023-12-15T23:10:08.849 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.849 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.850 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.850 DEBUG:boto:Params: {} 2023-12-15T23:10:08.850 DEBUG:boto:Token: None 2023-12-15T23:10:08.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8= 2023-12-15T23:10:08.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8=', 'Content-Length': '0'} 2023-12-15T23:10:08.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea542c464f0060ba-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.853 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:08.853 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:08.853 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.853 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.853 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.854 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.854 DEBUG:boto:Method: GET 2023-12-15T23:10:08.854 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.854 DEBUG:boto:Data: 2023-12-15T23:10:08.854 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.855 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.855 DEBUG:boto:Params: {} 2023-12-15T23:10:08.855 DEBUG:boto:Token: None 2023-12-15T23:10:08.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY= 2023-12-15T23:10:08.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY=', 'Content-Length': '0'} 2023-12-15T23:10:08.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3c8aee3698461fc-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.897 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.898 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.898 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.898 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.898 DEBUG:boto:Method: GET 2023-12-15T23:10:08.898 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.898 DEBUG:boto:Data: 2023-12-15T23:10:08.898 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.898 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.898 DEBUG:boto:Params: {} 2023-12-15T23:10:08.898 DEBUG:boto:Token: None 2023-12-15T23:10:08.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY= 2023-12-15T23:10:08.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY=', 'Content-Length': '0'} 2023-12-15T23:10:08.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000429fb371fafe7fe3-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.902 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.902 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.902 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.902 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.902 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.902 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.902 DEBUG:boto:Data: 2023-12-15T23:10:08.902 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.902 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.902 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.902 DEBUG:boto:Params: {} 2023-12-15T23:10:08.903 DEBUG:boto:Token: None 2023-12-15T23:10:08.903 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V+d8JCzgx0beSZmtxB/rxymri/0= 2023-12-15T23:10:08.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V+d8JCzgx0beSZmtxB/rxymri/0=', 'Content-Length': '0'} 2023-12-15T23:10:08.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002930f6b57666de83-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.905 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.905 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.905 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.905 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.905 DEBUG:boto:Method: HEAD 2023-12-15T23:10:08.905 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.906 DEBUG:boto:Data: 2023-12-15T23:10:08.906 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.906 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.906 DEBUG:boto:Params: {} 2023-12-15T23:10:08.906 DEBUG:boto:Token: None 2023-12-15T23:10:08.906 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V+d8JCzgx0beSZmtxB/rxymri/0= 2023-12-15T23:10:08.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V+d8JCzgx0beSZmtxB/rxymri/0=', 'Content-Length': '0'} 2023-12-15T23:10:08.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0ebf149c0af0dff-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:08.909 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.909 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.909 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.909 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.909 DEBUG:boto:Method: GET 2023-12-15T23:10:08.909 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.909 DEBUG:boto:Data: 2023-12-15T23:10:08.909 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.909 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.910 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.910 DEBUG:boto:Params: {} 2023-12-15T23:10:08.910 DEBUG:boto:Token: None 2023-12-15T23:10:08.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY= 2023-12-15T23:10:08.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY=', 'Content-Length': '0'} 2023-12-15T23:10:08.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0de3a99d83d87b8-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.953 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:08.954 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:08.954 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.954 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:10:08.954 DEBUG:boto:Method: GET 2023-12-15T23:10:08.954 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.954 DEBUG:boto:Data: 2023-12-15T23:10:08.954 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.955 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:08.955 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.955 DEBUG:boto:Params: {} 2023-12-15T23:10:08.955 DEBUG:boto:Token: None 2023-12-15T23:10:08.955 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:10:08.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY= 2023-12-15T23:10:08.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ytABy7p6J13BSLWl4XfwGdkdmRY=', 'Content-Length': '0'} 2023-12-15T23:10:08.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000731fd0f40f2100dc-00657cdcd0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:08.958 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:08.958 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:08.958 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:10:08.958 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:10:08.958 DEBUG:boto:Method: GET 2023-12-15T23:10:08.958 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:10:08.958 DEBUG:boto:Data: 2023-12-15T23:10:08.958 DEBUG:boto:Headers: {} 2023-12-15T23:10:08.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:08.958 DEBUG:boto:Port: 8000 2023-12-15T23:10:08.958 DEBUG:boto:Params: {} 2023-12-15T23:10:08.959 DEBUG:boto:Token: None 2023-12-15T23:10:08.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:08 GMT /kskgfn-46/ 2023-12-15T23:10:08.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8= 2023-12-15T23:10:08.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W8kx9K8YGBuBqHT6M2lJxD4NZA8=', 'Content-Length': '0'} 2023-12-15T23:10:08.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ae00a20c9f2e24a-00657cdcd0-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.001 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.002 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.002 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.002 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.002 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.002 DEBUG:boto:Method: GET 2023-12-15T23:10:09.002 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:10:09.002 DEBUG:boto:Data: 2023-12-15T23:10:09.002 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.002 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.003 DEBUG:boto:Params: {} 2023-12-15T23:10:09.003 DEBUG:boto:Token: None 2023-12-15T23:10:09.003 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b6773143bccda50-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.006 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.006 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:09.006 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:09.006 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.006 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:10:09.006 DEBUG:boto:Data: 2023-12-15T23:10:09.006 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.006 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.007 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.007 DEBUG:boto:Params: {} 2023-12-15T23:10:09.007 DEBUG:boto:Token: None 2023-12-15T23:10:09.007 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/b 2023-12-15T23:10:09.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YlO5Acje6CaZWtJ0I+EIsPQa3IQ= 2023-12-15T23:10:09.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YlO5Acje6CaZWtJ0I+EIsPQa3IQ=', 'Content-Length': '0'} 2023-12-15T23:10:09.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f6e84f6843406a-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.009 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:09.009 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:09.009 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.009 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:10:09.010 DEBUG:boto:Data: 2023-12-15T23:10:09.010 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.010 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.010 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.010 DEBUG:boto:Params: {} 2023-12-15T23:10:09.010 DEBUG:boto:Token: None 2023-12-15T23:10:09.010 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/b 2023-12-15T23:10:09.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YlO5Acje6CaZWtJ0I+EIsPQa3IQ= 2023-12-15T23:10:09.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YlO5Acje6CaZWtJ0I+EIsPQa3IQ=', 'Content-Length': '0'} 2023-12-15T23:10:09.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d4ea065b4ceef32-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:10:09.013 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:09.013 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:09.013 DEBUG:boto:Method: GET 2023-12-15T23:10:09.013 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:10:09.013 DEBUG:boto:Data: 2023-12-15T23:10:09.013 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.013 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.013 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.013 DEBUG:boto:Params: {} 2023-12-15T23:10:09.014 DEBUG:boto:Token: None 2023-12-15T23:10:09.014 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/b 2023-12-15T23:10:09.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:176+qDs4/oe8Z0znRL1eqfDb9WY= 2023-12-15T23:10:09.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:176+qDs4/oe8Z0znRL1eqfDb9WY=', 'Content-Length': '0'} 2023-12-15T23:10:09.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003120062e166c08fb-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.057 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:10:09.058 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:10:09.058 DEBUG:boto:Method: GET 2023-12-15T23:10:09.058 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:10:09.058 DEBUG:boto:Data: 2023-12-15T23:10:09.058 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.058 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.058 DEBUG:boto:Params: {} 2023-12-15T23:10:09.058 DEBUG:boto:Token: None 2023-12-15T23:10:09.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/b 2023-12-15T23:10:09.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:176+qDs4/oe8Z0znRL1eqfDb9WY= 2023-12-15T23:10:09.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:176+qDs4/oe8Z0znRL1eqfDb9WY=', 'Content-Length': '0'} 2023-12-15T23:10:09.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005648a2d49c532e06-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.062 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.062 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.062 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.063 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.063 DEBUG:boto:Method: GET 2023-12-15T23:10:09.063 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:10:09.063 DEBUG:boto:Data: 2023-12-15T23:10:09.063 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.063 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.063 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.063 DEBUG:boto:Params: {} 2023-12-15T23:10:09.063 DEBUG:boto:Token: None 2023-12-15T23:10:09.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.064 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000136ae9a6d27854d7-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.066 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.066 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.066 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.066 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.067 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:10:09.067 DEBUG:boto:Method: GET 2023-12-15T23:10:09.067 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:10:09.067 DEBUG:boto:Data: 2023-12-15T23:10:09.067 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.067 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.067 DEBUG:boto:Params: {} 2023-12-15T23:10:09.067 DEBUG:boto:Token: None 2023-12-15T23:10:09.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.068 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036f2301bd0a0f7c0-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.070 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:09.071 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.071 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.071 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.071 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.071 DEBUG:boto:Method: GET 2023-12-15T23:10:09.071 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.071 DEBUG:boto:Data: 2023-12-15T23:10:09.072 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.072 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.072 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.072 DEBUG:boto:Params: {} 2023-12-15T23:10:09.072 DEBUG:boto:Token: None 2023-12-15T23:10:09.072 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY= 2023-12-15T23:10:09.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY=', 'Content-Length': '0'} 2023-12-15T23:10:09.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a0eb90eb0f49820-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.117 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.118 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.118 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.118 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.118 DEBUG:boto:Method: GET 2023-12-15T23:10:09.118 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.118 DEBUG:boto:Data: 2023-12-15T23:10:09.118 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.118 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.118 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.118 DEBUG:boto:Params: {} 2023-12-15T23:10:09.118 DEBUG:boto:Token: None 2023-12-15T23:10:09.119 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY= 2023-12-15T23:10:09.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY=', 'Content-Length': '0'} 2023-12-15T23:10:09.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093a8f305a3347317-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.120 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.121 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.121 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.121 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.121 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.121 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.121 DEBUG:boto:Data: 2023-12-15T23:10:09.121 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.121 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.121 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.121 DEBUG:boto:Params: {} 2023-12-15T23:10:09.122 DEBUG:boto:Token: None 2023-12-15T23:10:09.122 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:l7xNSca1Hr77xepmrmNw6+woPdU= 2023-12-15T23:10:09.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:l7xNSca1Hr77xepmrmNw6+woPdU=', 'Content-Length': '0'} 2023-12-15T23:10:09.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d8ecae6fd58754-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.124 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.124 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.124 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.124 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.124 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.124 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.124 DEBUG:boto:Data: 2023-12-15T23:10:09.124 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.125 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.125 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.125 DEBUG:boto:Params: {} 2023-12-15T23:10:09.125 DEBUG:boto:Token: None 2023-12-15T23:10:09.125 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:l7xNSca1Hr77xepmrmNw6+woPdU= 2023-12-15T23:10:09.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:l7xNSca1Hr77xepmrmNw6+woPdU=', 'Content-Length': '0'} 2023-12-15T23:10:09.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6a6b07b1881c3b0-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.127 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:09.127 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.127 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.127 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.127 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.127 DEBUG:boto:Method: GET 2023-12-15T23:10:09.128 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.128 DEBUG:boto:Data: 2023-12-15T23:10:09.128 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.128 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.128 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.128 DEBUG:boto:Params: {} 2023-12-15T23:10:09.128 DEBUG:boto:Token: None 2023-12-15T23:10:09.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY= 2023-12-15T23:10:09.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY=', 'Content-Length': '0'} 2023-12-15T23:10:09.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a0509a599672583-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.173 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.174 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.174 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.174 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:10:09.174 DEBUG:boto:Method: GET 2023-12-15T23:10:09.174 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.174 DEBUG:boto:Data: 2023-12-15T23:10:09.174 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.174 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.174 DEBUG:boto:Params: {} 2023-12-15T23:10:09.174 DEBUG:boto:Token: None 2023-12-15T23:10:09.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:10:09.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY= 2023-12-15T23:10:09.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tswyG0uQTT5RLyBTCRHot629elY=', 'Content-Length': '0'} 2023-12-15T23:10:09.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f6da554114c17c1-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.177 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.177 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.177 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.177 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.177 DEBUG:boto:Method: GET 2023-12-15T23:10:09.177 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:10:09.177 DEBUG:boto:Data: 2023-12-15T23:10:09.177 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.177 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.177 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.178 DEBUG:boto:Params: {} 2023-12-15T23:10:09.178 DEBUG:boto:Token: None 2023-12-15T23:10:09.178 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.180 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca81d47cf946c357-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.180 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.181 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.181 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.181 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.181 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.181 DEBUG:boto:Method: GET 2023-12-15T23:10:09.181 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:10:09.181 DEBUG:boto:Data: 2023-12-15T23:10:09.182 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.182 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.182 DEBUG:boto:Params: {} 2023-12-15T23:10:09.182 DEBUG:boto:Token: None 2023-12-15T23:10:09.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009fe3cc17c94e055-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.185 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.185 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.185 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.185 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.186 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:10:09.186 DEBUG:boto:Data: 2023-12-15T23:10:09.186 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.186 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.186 DEBUG:boto:Params: {} 2023-12-15T23:10:09.186 DEBUG:boto:Token: None 2023-12-15T23:10:09.186 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c 2023-12-15T23:10:09.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SL7we/Fpudlqh0RoUxFPhY7sBrk= 2023-12-15T23:10:09.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SL7we/Fpudlqh0RoUxFPhY7sBrk=', 'Content-Length': '0'} 2023-12-15T23:10:09.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a90687aab3523159-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.188 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.188 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.189 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.189 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:10:09.189 DEBUG:boto:Data: 2023-12-15T23:10:09.189 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.189 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.189 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.189 DEBUG:boto:Params: {} 2023-12-15T23:10:09.189 DEBUG:boto:Token: None 2023-12-15T23:10:09.189 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c 2023-12-15T23:10:09.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SL7we/Fpudlqh0RoUxFPhY7sBrk= 2023-12-15T23:10:09.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SL7we/Fpudlqh0RoUxFPhY7sBrk=', 'Content-Length': '0'} 2023-12-15T23:10:09.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b08667f3ce253bd-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:10:09.191 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.191 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.192 DEBUG:boto:Method: GET 2023-12-15T23:10:09.192 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:10:09.192 DEBUG:boto:Data: 2023-12-15T23:10:09.192 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.192 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.192 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.192 DEBUG:boto:Params: {} 2023-12-15T23:10:09.192 DEBUG:boto:Token: None 2023-12-15T23:10:09.192 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c 2023-12-15T23:10:09.192 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CqFluLNPv+yWjkxPf+ffjUIqxYk= 2023-12-15T23:10:09.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CqFluLNPv+yWjkxPf+ffjUIqxYk=', 'Content-Length': '0'} 2023-12-15T23:10:09.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f1b5eb97f64bcdd-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.237 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:10:09.238 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:10:09.238 DEBUG:boto:Method: GET 2023-12-15T23:10:09.238 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:10:09.238 DEBUG:boto:Data: 2023-12-15T23:10:09.238 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.238 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.238 DEBUG:boto:Params: {} 2023-12-15T23:10:09.238 DEBUG:boto:Token: None 2023-12-15T23:10:09.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/c 2023-12-15T23:10:09.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CqFluLNPv+yWjkxPf+ffjUIqxYk= 2023-12-15T23:10:09.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CqFluLNPv+yWjkxPf+ffjUIqxYk=', 'Content-Length': '0'} 2023-12-15T23:10:09.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e933718cbbfd7973-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.241 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.241 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.241 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.241 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.241 DEBUG:boto:Method: GET 2023-12-15T23:10:09.241 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:10:09.241 DEBUG:boto:Data: 2023-12-15T23:10:09.241 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.241 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.241 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.242 DEBUG:boto:Params: {} 2023-12-15T23:10:09.242 DEBUG:boto:Token: None 2023-12-15T23:10:09.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006df922bec6cd3f9c-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.285 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.286 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.286 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.286 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.286 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:10:09.286 DEBUG:boto:Method: GET 2023-12-15T23:10:09.286 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:10:09.286 DEBUG:boto:Data: 2023-12-15T23:10:09.286 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.287 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.287 DEBUG:boto:Params: {} 2023-12-15T23:10:09.287 DEBUG:boto:Token: None 2023-12-15T23:10:09.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006993f5883b6b45d9-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.290 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:09.290 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.290 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.290 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.290 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.291 DEBUG:boto:Method: GET 2023-12-15T23:10:09.291 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.291 DEBUG:boto:Data: 2023-12-15T23:10:09.291 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.291 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.291 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.291 DEBUG:boto:Params: {} 2023-12-15T23:10:09.291 DEBUG:boto:Token: None 2023-12-15T23:10:09.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw= 2023-12-15T23:10:09.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw=', 'Content-Length': '0'} 2023-12-15T23:10:09.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000289074fd259ff509-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.337 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.337 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.338 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.338 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.338 DEBUG:boto:Method: GET 2023-12-15T23:10:09.338 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.338 DEBUG:boto:Data: 2023-12-15T23:10:09.338 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.338 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.338 DEBUG:boto:Params: {} 2023-12-15T23:10:09.338 DEBUG:boto:Token: None 2023-12-15T23:10:09.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw= 2023-12-15T23:10:09.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw=', 'Content-Length': '0'} 2023-12-15T23:10:09.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059c87762890b4ca9-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.341 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.341 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.341 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.341 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.341 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.342 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.342 DEBUG:boto:Data: 2023-12-15T23:10:09.342 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.342 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.342 DEBUG:boto:Params: {} 2023-12-15T23:10:09.342 DEBUG:boto:Token: None 2023-12-15T23:10:09.342 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yt4pCv3rmMnLLMyr9XwfbvNriEE= 2023-12-15T23:10:09.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yt4pCv3rmMnLLMyr9XwfbvNriEE=', 'Content-Length': '0'} 2023-12-15T23:10:09.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c95af3383ec35536-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.345 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.345 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.345 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.345 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.345 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.345 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.345 DEBUG:boto:Data: 2023-12-15T23:10:09.346 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.346 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.346 DEBUG:boto:Params: {} 2023-12-15T23:10:09.346 DEBUG:boto:Token: None 2023-12-15T23:10:09.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yt4pCv3rmMnLLMyr9XwfbvNriEE= 2023-12-15T23:10:09.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yt4pCv3rmMnLLMyr9XwfbvNriEE=', 'Content-Length': '0'} 2023-12-15T23:10:09.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a8b5b55bc062835-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:09.348 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.349 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.349 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.349 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.349 DEBUG:boto:Method: GET 2023-12-15T23:10:09.349 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.349 DEBUG:boto:Data: 2023-12-15T23:10:09.349 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.349 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.349 DEBUG:boto:Params: {} 2023-12-15T23:10:09.349 DEBUG:boto:Token: None 2023-12-15T23:10:09.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw= 2023-12-15T23:10:09.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw=', 'Content-Length': '0'} 2023-12-15T23:10:09.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069edce9acf787d0e-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.393 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.394 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.394 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.394 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:10:09.394 DEBUG:boto:Method: GET 2023-12-15T23:10:09.394 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.394 DEBUG:boto:Data: 2023-12-15T23:10:09.394 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.394 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.394 DEBUG:boto:Params: {} 2023-12-15T23:10:09.394 DEBUG:boto:Token: None 2023-12-15T23:10:09.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:10:09.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw= 2023-12-15T23:10:09.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j8b3m6n7Ckk0LK7i/KjVVBb7QQw=', 'Content-Length': '0'} 2023-12-15T23:10:09.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066468171a4a03075-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.397 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.397 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.397 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.397 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.397 DEBUG:boto:Method: GET 2023-12-15T23:10:09.398 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:10:09.398 DEBUG:boto:Data: 2023-12-15T23:10:09.398 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.398 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.398 DEBUG:boto:Params: {} 2023-12-15T23:10:09.398 DEBUG:boto:Token: None 2023-12-15T23:10:09.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb0dfa6a3931af58-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.441 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.442 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.442 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.442 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.442 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.442 DEBUG:boto:Method: GET 2023-12-15T23:10:09.442 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:10:09.442 DEBUG:boto:Data: 2023-12-15T23:10:09.442 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.442 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.443 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.443 DEBUG:boto:Params: {} 2023-12-15T23:10:09.443 DEBUG:boto:Token: None 2023-12-15T23:10:09.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012ad07ab70f14ee1-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.446 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.446 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.446 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.446 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.446 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:10:09.446 DEBUG:boto:Data: 2023-12-15T23:10:09.446 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.447 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.447 DEBUG:boto:Params: {} 2023-12-15T23:10:09.447 DEBUG:boto:Token: None 2023-12-15T23:10:09.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d 2023-12-15T23:10:09.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OlgP99qh/mXCE6uJgkq6yLP12QQ= 2023-12-15T23:10:09.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OlgP99qh/mXCE6uJgkq6yLP12QQ=', 'Content-Length': '0'} 2023-12-15T23:10:09.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084f54bb1f4a64b60-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.449 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.449 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.449 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.450 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:10:09.450 DEBUG:boto:Data: 2023-12-15T23:10:09.450 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.450 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.450 DEBUG:boto:Params: {} 2023-12-15T23:10:09.450 DEBUG:boto:Token: None 2023-12-15T23:10:09.450 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d 2023-12-15T23:10:09.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OlgP99qh/mXCE6uJgkq6yLP12QQ= 2023-12-15T23:10:09.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OlgP99qh/mXCE6uJgkq6yLP12QQ=', 'Content-Length': '0'} 2023-12-15T23:10:09.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b15b538d004a609-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:10:09.453 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.453 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.453 DEBUG:boto:Method: GET 2023-12-15T23:10:09.453 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:10:09.453 DEBUG:boto:Data: 2023-12-15T23:10:09.453 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.454 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.454 DEBUG:boto:Params: {} 2023-12-15T23:10:09.454 DEBUG:boto:Token: None 2023-12-15T23:10:09.454 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d 2023-12-15T23:10:09.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5l+g5mDqyM8598ay/Puual/q+8s= 2023-12-15T23:10:09.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5l+g5mDqyM8598ay/Puual/q+8s=', 'Content-Length': '0'} 2023-12-15T23:10:09.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028a0dc558f401e2f-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.498 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:10:09.498 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:10:09.498 DEBUG:boto:Method: GET 2023-12-15T23:10:09.498 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:10:09.498 DEBUG:boto:Data: 2023-12-15T23:10:09.498 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.498 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.498 DEBUG:boto:Params: {} 2023-12-15T23:10:09.498 DEBUG:boto:Token: None 2023-12-15T23:10:09.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/d 2023-12-15T23:10:09.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5l+g5mDqyM8598ay/Puual/q+8s= 2023-12-15T23:10:09.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5l+g5mDqyM8598ay/Puual/q+8s=', 'Content-Length': '0'} 2023-12-15T23:10:09.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b2346a6c559ecb3-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.501 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.501 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.501 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.501 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.501 DEBUG:boto:Method: GET 2023-12-15T23:10:09.502 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:10:09.502 DEBUG:boto:Data: 2023-12-15T23:10:09.502 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:10:09.502 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.502 DEBUG:boto:Params: {} 2023-12-15T23:10:09.502 DEBUG:boto:Token: None 2023-12-15T23:10:09.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000eff3186ec1cb70e-00657cdcd1-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.505 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.506 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.506 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.506 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.506 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:10:09.506 DEBUG:boto:Method: GET 2023-12-15T23:10:09.506 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:10:09.506 DEBUG:boto:Data: 2023-12-15T23:10:09.507 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.507 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.507 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.507 DEBUG:boto:Params: {} 2023-12-15T23:10:09.507 DEBUG:boto:Token: None 2023-12-15T23:10:09.508 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.508 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA= 2023-12-15T23:10:09.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djn0v7HQsYfAdb6p4Pj3lJ5/bsA=', 'Content-Length': '0'} 2023-12-15T23:10:09.510 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096890bff24c35aa9-00657cdcd1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.511 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:10:09.511 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-46 zones={test-zone2, test-zone1} 2023-12-15T23:10:09.511 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'kskgfn-46', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:10:09.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'kskgfn-46', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:10:09.512 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket kskgfn-46 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:10:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:09.608 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:10:09.608 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-46 2023-12-15T23:10:09.613 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 4 2023-12-15T23:10:09.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'reshard', '--bucket', 'kskgfn-46', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:10:09.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'reshard', '--bucket', 'kskgfn-46', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:10:09.663 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket reshard --bucket kskgfn-46 --num-shards 3 --yes-i-really-mean-it --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:10:09.716 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:09.716 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:09.762 INFO:teuthology.orchestra.run.smithi188.stdout:tenant: 2023-12-15T23:10:09.762 INFO:teuthology.orchestra.run.smithi188.stdout:bucket name: kskgfn-46 2023-12-15T23:10:09.767 INFO:teuthology.orchestra.run.smithi188.stdout:total entries: 4 2023-12-15T23:10:09.808 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.808 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.809 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.809 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:09.809 DEBUG:boto:Data: 2023-12-15T23:10:09.809 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.809 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.809 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.809 DEBUG:boto:Params: {} 2023-12-15T23:10:09.809 DEBUG:boto:Token: None 2023-12-15T23:10:09.810 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo= 2023-12-15T23:10:09.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo=', 'Content-Length': '0'} 2023-12-15T23:10:09.812 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085fd88967830d3fc-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.812 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:10:09.812 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:10:09.812 DEBUG:boto:Method: PUT 2023-12-15T23:10:09.812 DEBUG:boto:Path: /kskgfn-46/e 2023-12-15T23:10:09.812 DEBUG:boto:Data: 2023-12-15T23:10:09.812 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:09.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.813 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.813 DEBUG:boto:Params: {} 2023-12-15T23:10:09.813 DEBUG:boto:Token: None 2023-12-15T23:10:09.813 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/e 2023-12-15T23:10:09.813 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:40C4o/SRvNutwWKoB7TeaKhb7Ao= 2023-12-15T23:10:09.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:40C4o/SRvNutwWKoB7TeaKhb7Ao='} 2023-12-15T23:10:09.818 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e43c52b8d7c80f13-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.819 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.819 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.819 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.819 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:09.819 DEBUG:boto:Data: 2023-12-15T23:10:09.819 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.819 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.819 DEBUG:boto:Params: {} 2023-12-15T23:10:09.820 DEBUG:boto:Token: None 2023-12-15T23:10:09.820 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo= 2023-12-15T23:10:09.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo=', 'Content-Length': '0'} 2023-12-15T23:10:09.821 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000799f9b20d4867f89-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.822 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:10:09.822 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:10:09.822 DEBUG:boto:Method: PUT 2023-12-15T23:10:09.822 DEBUG:boto:Path: /kskgfn-46/f 2023-12-15T23:10:09.822 DEBUG:boto:Data: 2023-12-15T23:10:09.822 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:09.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.822 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.823 DEBUG:boto:Params: {} 2023-12-15T23:10:09.823 DEBUG:boto:Token: None 2023-12-15T23:10:09.823 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/f 2023-12-15T23:10:09.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N4v7OecAV935GAh/KRNM7FNpKOs= 2023-12-15T23:10:09.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N4v7OecAV935GAh/KRNM7FNpKOs='} 2023-12-15T23:10:09.829 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b0c8071b7577e2f8-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.829 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.829 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.829 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.829 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:09.829 DEBUG:boto:Data: 2023-12-15T23:10:09.829 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.829 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.829 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.830 DEBUG:boto:Params: {} 2023-12-15T23:10:09.830 DEBUG:boto:Token: None 2023-12-15T23:10:09.830 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo= 2023-12-15T23:10:09.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo=', 'Content-Length': '0'} 2023-12-15T23:10:09.831 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a3b3e76fe171a9d5-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.831 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:10:09.832 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:10:09.832 DEBUG:boto:Method: PUT 2023-12-15T23:10:09.832 DEBUG:boto:Path: /kskgfn-46/g 2023-12-15T23:10:09.832 DEBUG:boto:Data: 2023-12-15T23:10:09.832 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:09.832 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.832 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.832 DEBUG:boto:Params: {} 2023-12-15T23:10:09.832 DEBUG:boto:Token: None 2023-12-15T23:10:09.833 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/g 2023-12-15T23:10:09.833 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CEab2kGrHdAXLNyN2mHbUXJi8ro= 2023-12-15T23:10:09.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CEab2kGrHdAXLNyN2mHbUXJi8ro='} 2023-12-15T23:10:09.878 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000003b568aee701d364-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.878 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:10:09.878 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:10:09.878 DEBUG:boto:Method: HEAD 2023-12-15T23:10:09.878 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:10:09.878 DEBUG:boto:Data: 2023-12-15T23:10:09.878 DEBUG:boto:Headers: {} 2023-12-15T23:10:09.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.878 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.878 DEBUG:boto:Params: {} 2023-12-15T23:10:09.879 DEBUG:boto:Token: None 2023-12-15T23:10:09.879 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/ 2023-12-15T23:10:09.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo= 2023-12-15T23:10:09.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0sEhYgbseKniC9a024p67bov1fo=', 'Content-Length': '0'} 2023-12-15T23:10:09.881 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0e62009e4ed2388-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.881 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:10:09.881 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:10:09.881 DEBUG:boto:Method: PUT 2023-12-15T23:10:09.881 DEBUG:boto:Path: /kskgfn-46/h 2023-12-15T23:10:09.881 DEBUG:boto:Data: 2023-12-15T23:10:09.881 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:10:09.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:10:09.882 DEBUG:boto:Port: 8000 2023-12-15T23:10:09.882 DEBUG:boto:Params: {} 2023-12-15T23:10:09.882 DEBUG:boto:Token: None 2023-12-15T23:10:09.882 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:10:09 GMT /kskgfn-46/h 2023-12-15T23:10:09.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eFiCTwCZP7XbXFVhPmt09p10dPY= 2023-12-15T23:10:09.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:10:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eFiCTwCZP7XbXFVhPmt09p10dPY='} 2023-12-15T23:10:09.886 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c3f4313319c6ab3a-00657cdcd1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:10:09.886 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-46 2023-12-15T23:10:09.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:09.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:10:09.887 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-46 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:10:09.941 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:10:09.942 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:10:09.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:09.976+0000 7fc278d2f800 1 waiting to reach latest gen 1, on 0.. 2023-12-15T23:10:14.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:14.977+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:14.979 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.40.6] 2023-12-15T23:10:14.979 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:19.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:19.977+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:19.980 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:19.980 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:24.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:24.979+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:24.981 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:24.981 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:29.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:29.980+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:29.982 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:29.982 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:34.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:34.981+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:34.982 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:34.982 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:39.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:39.982+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:39.983 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:39.983 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:44.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:44.983+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:44.984 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:44.984 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:49.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:49.984+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:49.985 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:49.985 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:54.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:54.985+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:54.986 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:54.986 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:10:59.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:10:59.985+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:10:59.987 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:10:59.987 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:04.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:04.987+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:11:04.988 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:11:04.988 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:09.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:09.987+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:11:09.989 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:11:09.989 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:14.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:14.988+0000 7fc278d2f800 1 waiting for incremental sync to catch up: 2023-12-15T23:11:14.990 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, , 00000000002.40.6] 2023-12-15T23:11:14.990 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:19.990 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:19.989+0000 7fc278d2f800 1 bucket sync caught up with source: 2023-12-15T23:11:19.991 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:19.991 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.60.6, 00000000002.29.6, 00000000002.40.6] 2023-12-15T23:11:19.991 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:19.989+0000 7fc278d2f800 0 bucket checkpoint complete 2023-12-15T23:11:20.008 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-46 2023-12-15T23:11:20.009 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:11:20.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:11:20.009 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-46 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:11:20.067 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:20.068 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:20.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:11:20.105+0000 7f8a0e53d800 1 waiting for incremental sync to catch up: 2023-12-15T23:11:20.106 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000003.122.6, , 00000000002.132.6] 2023-12-15T23:11:20.107 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000003.122.6, 00000000002.56.6, 00000000002.132.6] 2023-12-15T23:11:25.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:11:25.106+0000 7f8a0e53d800 1 bucket sync caught up with source: 2023-12-15T23:11:25.108 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000003.122.6, 00000000002.56.6, 00000000002.132.6] 2023-12-15T23:11:25.108 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000003.122.6, 00000000002.56.6, 00000000002.132.6] 2023-12-15T23:11:25.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:11:25.106+0000 7f8a0e53d800 0 bucket checkpoint complete 2023-12-15T23:11:25.129 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-46 zones={test-zone2, test-zone1} 2023-12-15T23:11:25.129 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.130 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.130 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.130 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:11:25.130 DEBUG:boto:Data: 2023-12-15T23:11:25.130 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.130 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.130 DEBUG:boto:Params: {} 2023-12-15T23:11:25.131 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:11:25.131 DEBUG:boto:Token: None 2023-12-15T23:11:25.131 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+ZztgJaOmRZBiFX+OhcjRQ3HSk= 2023-12-15T23:11:25.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+ZztgJaOmRZBiFX+OhcjRQ3HSk=', 'Content-Length': '0'} 2023-12-15T23:11:25.135 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f2fee2e8abd483a-00657cdd1d-4788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.135 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.135 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.135 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.135 DEBUG:boto:Path: /kskgfn-46/ 2023-12-15T23:11:25.135 DEBUG:boto:Data: 2023-12-15T23:11:25.135 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.135 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.135 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.136 DEBUG:boto:Params: {} 2023-12-15T23:11:25.136 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:11:25.136 DEBUG:boto:Token: None 2023-12-15T23:11:25.136 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v+ZztgJaOmRZBiFX+OhcjRQ3HSk= 2023-12-15T23:11:25.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v+ZztgJaOmRZBiFX+OhcjRQ3HSk=', 'Content-Length': '0'} 2023-12-15T23:11:25.139 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ebc91cf611f80519-00657cdd1d-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.140 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:11:25.140 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.140 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.140 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.140 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.140 DEBUG:boto:Method: GET 2023-12-15T23:11:25.140 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.140 DEBUG:boto:Data: 2023-12-15T23:11:25.140 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.140 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.141 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.141 DEBUG:boto:Params: {} 2023-12-15T23:11:25.141 DEBUG:boto:Token: None 2023-12-15T23:11:25.141 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/?versions 2023-12-15T23:11:25.141 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0= 2023-12-15T23:11:25.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0=', 'Content-Length': '0'} 2023-12-15T23:11:25.143 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb56e6451ef7f489-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.143 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.144 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:11:25.144 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:11:25.144 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:11:25.144 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:11:25.144 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:11:25.145 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:11:25.145 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:11:25.145 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:11:25.145 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:11:25.145 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.145 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.145 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.145 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.145 DEBUG:boto:Method: GET 2023-12-15T23:11:25.145 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.146 DEBUG:boto:Data: 2023-12-15T23:11:25.146 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.146 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.146 DEBUG:boto:Params: {} 2023-12-15T23:11:25.146 DEBUG:boto:Token: None 2023-12-15T23:11:25.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/?versions 2023-12-15T23:11:25.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0= 2023-12-15T23:11:25.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0=', 'Content-Length': '0'} 2023-12-15T23:11:25.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000202dcd163d302ea9-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.148 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:11:25.149 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:11:25.150 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:11:25.150 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:11:25.150 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.150 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.150 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.150 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.150 DEBUG:boto:Method: GET 2023-12-15T23:11:25.150 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.150 DEBUG:boto:Data: 2023-12-15T23:11:25.150 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.150 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.151 DEBUG:boto:Params: {} 2023-12-15T23:11:25.151 DEBUG:boto:Token: None 2023-12-15T23:11:25.151 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/?versions 2023-12-15T23:11:25.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0= 2023-12-15T23:11:25.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0=', 'Content-Length': '0'} 2023-12-15T23:11:25.153 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000644b251a71b6f847-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.153 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.154 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.154 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.154 DEBUG:boto:path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.154 DEBUG:boto:auth_path=/kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.154 DEBUG:boto:Method: GET 2023-12-15T23:11:25.154 DEBUG:boto:Path: /kskgfn-46/?versions&max-keys=999 2023-12-15T23:11:25.154 DEBUG:boto:Data: 2023-12-15T23:11:25.155 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.155 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.155 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.155 DEBUG:boto:Params: {} 2023-12-15T23:11:25.155 DEBUG:boto:Token: None 2023-12-15T23:11:25.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/?versions 2023-12-15T23:11:25.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0= 2023-12-15T23:11:25.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XKuvdALpLA59f+d9PUysahtkQu0=', 'Content-Length': '0'} 2023-12-15T23:11:25.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc258f1c1b346d5-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.157 DEBUG:boto:b'kskgfn-46999falseanulltrue2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:11:25.158 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.158 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.158 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.158 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.158 DEBUG:boto:Method: GET 2023-12-15T23:11:25.158 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.158 DEBUG:boto:Data: 2023-12-15T23:11:25.159 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.159 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.159 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.159 DEBUG:boto:Params: {} 2023-12-15T23:11:25.159 DEBUG:boto:Token: None 2023-12-15T23:11:25.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U= 2023-12-15T23:11:25.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U=', 'Content-Length': '0'} 2023-12-15T23:11:25.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001834bbd7fb5e2eea-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.162 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.162 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.162 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.162 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.162 DEBUG:boto:Method: GET 2023-12-15T23:11:25.162 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.162 DEBUG:boto:Data: 2023-12-15T23:11:25.162 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.163 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.163 DEBUG:boto:Params: {} 2023-12-15T23:11:25.163 DEBUG:boto:Token: None 2023-12-15T23:11:25.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U= 2023-12-15T23:11:25.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U=', 'Content-Length': '0'} 2023-12-15T23:11:25.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b768fd79be38772-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.166 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.166 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.166 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.166 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.166 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.166 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.166 DEBUG:boto:Data: 2023-12-15T23:11:25.166 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.166 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.166 DEBUG:boto:Params: {} 2023-12-15T23:11:25.167 DEBUG:boto:Token: None 2023-12-15T23:11:25.167 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VFguR/qnfLfHgFDLEMRCIdEOP6o= 2023-12-15T23:11:25.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VFguR/qnfLfHgFDLEMRCIdEOP6o=', 'Content-Length': '0'} 2023-12-15T23:11:25.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b53dc6f700b7678-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.169 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.169 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.169 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.170 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.170 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.170 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.170 DEBUG:boto:Data: 2023-12-15T23:11:25.170 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.170 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.170 DEBUG:boto:Params: {} 2023-12-15T23:11:25.170 DEBUG:boto:Token: None 2023-12-15T23:11:25.170 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VFguR/qnfLfHgFDLEMRCIdEOP6o= 2023-12-15T23:11:25.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VFguR/qnfLfHgFDLEMRCIdEOP6o=', 'Content-Length': '0'} 2023-12-15T23:11:25.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d4dc1d4e2aab856-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:11:25.173 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.173 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.173 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.173 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.173 DEBUG:boto:Method: GET 2023-12-15T23:11:25.173 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.174 DEBUG:boto:Data: 2023-12-15T23:11:25.174 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.174 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.174 DEBUG:boto:Params: {} 2023-12-15T23:11:25.174 DEBUG:boto:Token: None 2023-12-15T23:11:25.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U= 2023-12-15T23:11:25.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U=', 'Content-Length': '0'} 2023-12-15T23:11:25.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000560e98835844bf61-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.217 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.218 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.218 DEBUG:boto:path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.218 DEBUG:boto:auth_path=/kskgfn-46/a?versionId=null 2023-12-15T23:11:25.218 DEBUG:boto:Method: GET 2023-12-15T23:11:25.218 DEBUG:boto:Path: /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.218 DEBUG:boto:Data: 2023-12-15T23:11:25.218 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.218 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.218 DEBUG:boto:Params: {} 2023-12-15T23:11:25.218 DEBUG:boto:Token: None 2023-12-15T23:11:25.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a?versionId=null 2023-12-15T23:11:25.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U= 2023-12-15T23:11:25.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NsTw5AdlnNlCFFfab5R6GReY1/U=', 'Content-Length': '0'} 2023-12-15T23:11:25.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8c779e41d43271-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.221 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.221 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.221 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.221 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.221 DEBUG:boto:Method: GET 2023-12-15T23:11:25.221 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:11:25.221 DEBUG:boto:Data: 2023-12-15T23:11:25.222 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.222 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.222 DEBUG:boto:Params: {} 2023-12-15T23:11:25.222 DEBUG:boto:Token: None 2023-12-15T23:11:25.222 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.224 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000105844086454565f-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.225 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.225 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.225 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.225 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.225 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.225 DEBUG:boto:Method: GET 2023-12-15T23:11:25.225 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:11:25.226 DEBUG:boto:Data: 2023-12-15T23:11:25.226 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.226 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.226 DEBUG:boto:Params: {} 2023-12-15T23:11:25.226 DEBUG:boto:Token: None 2023-12-15T23:11:25.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.228 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000316006dc6945872e-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.228 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.229 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.229 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.229 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.229 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:11:25.229 DEBUG:boto:Data: 2023-12-15T23:11:25.229 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.229 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.229 DEBUG:boto:Params: {} 2023-12-15T23:11:25.229 DEBUG:boto:Token: None 2023-12-15T23:11:25.230 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a 2023-12-15T23:11:25.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b4bM+CSveQJuhuvY4Fz9HrWeVls= 2023-12-15T23:11:25.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b4bM+CSveQJuhuvY4Fz9HrWeVls=', 'Content-Length': '0'} 2023-12-15T23:11:25.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003593637de884f6ac-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.232 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.232 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.232 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.232 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:11:25.232 DEBUG:boto:Data: 2023-12-15T23:11:25.232 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.233 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.233 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.233 DEBUG:boto:Params: {} 2023-12-15T23:11:25.233 DEBUG:boto:Token: None 2023-12-15T23:11:25.233 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a 2023-12-15T23:11:25.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b4bM+CSveQJuhuvY4Fz9HrWeVls= 2023-12-15T23:11:25.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b4bM+CSveQJuhuvY4Fz9HrWeVls=', 'Content-Length': '0'} 2023-12-15T23:11:25.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006059b5b7c1ed189d-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:11:25.236 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.236 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.236 DEBUG:boto:Method: GET 2023-12-15T23:11:25.236 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:11:25.236 DEBUG:boto:Data: 2023-12-15T23:11:25.236 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.236 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.236 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.236 DEBUG:boto:Params: {} 2023-12-15T23:11:25.237 DEBUG:boto:Token: None 2023-12-15T23:11:25.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a 2023-12-15T23:11:25.237 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bzmarP5N5FRhug74Ae13KYx3fwc= 2023-12-15T23:11:25.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bzmarP5N5FRhug74Ae13KYx3fwc=', 'Content-Length': '0'} 2023-12-15T23:11:25.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000838af0819f3e1c67-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.281 DEBUG:boto:path=/kskgfn-46/a 2023-12-15T23:11:25.282 DEBUG:boto:auth_path=/kskgfn-46/a 2023-12-15T23:11:25.282 DEBUG:boto:Method: GET 2023-12-15T23:11:25.282 DEBUG:boto:Path: /kskgfn-46/a 2023-12-15T23:11:25.282 DEBUG:boto:Data: 2023-12-15T23:11:25.282 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.282 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.282 DEBUG:boto:Params: {} 2023-12-15T23:11:25.282 DEBUG:boto:Token: None 2023-12-15T23:11:25.282 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/a 2023-12-15T23:11:25.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bzmarP5N5FRhug74Ae13KYx3fwc= 2023-12-15T23:11:25.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bzmarP5N5FRhug74Ae13KYx3fwc=', 'Content-Length': '0'} 2023-12-15T23:11:25.284 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000058e1b7f5326370e-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.285 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.285 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.285 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.285 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.285 DEBUG:boto:Method: GET 2023-12-15T23:11:25.285 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:11:25.285 DEBUG:boto:Data: 2023-12-15T23:11:25.285 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.286 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.286 DEBUG:boto:Params: {} 2023-12-15T23:11:25.286 DEBUG:boto:Token: None 2023-12-15T23:11:25.286 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.288 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065ea89e97a600ac7-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.329 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.330 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.330 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.330 DEBUG:boto:path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.330 DEBUG:boto:auth_path=/kskgfn-46/?prefix=a 2023-12-15T23:11:25.330 DEBUG:boto:Method: GET 2023-12-15T23:11:25.330 DEBUG:boto:Path: /kskgfn-46/?prefix=a 2023-12-15T23:11:25.330 DEBUG:boto:Data: 2023-12-15T23:11:25.330 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.331 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.331 DEBUG:boto:Params: {} 2023-12-15T23:11:25.331 DEBUG:boto:Token: None 2023-12-15T23:11:25.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000893b0ecbe3a70346-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.333 DEBUG:boto:b'kskgfn-46a1000falsea2023-12-15T23:10:03.366Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:11:25.334 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.334 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.334 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.334 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.334 DEBUG:boto:Method: GET 2023-12-15T23:11:25.334 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.334 DEBUG:boto:Data: 2023-12-15T23:11:25.334 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.334 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.335 DEBUG:boto:Params: {} 2023-12-15T23:11:25.335 DEBUG:boto:Token: None 2023-12-15T23:11:25.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE= 2023-12-15T23:11:25.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE=', 'Content-Length': '0'} 2023-12-15T23:11:25.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba163a522a47df6a-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.381 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.382 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.382 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.382 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.382 DEBUG:boto:Method: GET 2023-12-15T23:11:25.382 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.382 DEBUG:boto:Data: 2023-12-15T23:11:25.382 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.382 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.382 DEBUG:boto:Params: {} 2023-12-15T23:11:25.382 DEBUG:boto:Token: None 2023-12-15T23:11:25.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE= 2023-12-15T23:11:25.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE=', 'Content-Length': '0'} 2023-12-15T23:11:25.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b7a823c42100fd4-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.385 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.385 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.385 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.386 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.386 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.386 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.386 DEBUG:boto:Data: 2023-12-15T23:11:25.386 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.386 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.386 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.386 DEBUG:boto:Params: {} 2023-12-15T23:11:25.386 DEBUG:boto:Token: None 2023-12-15T23:11:25.386 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/0WF37JRKlqutCDxt00DdELvNHg= 2023-12-15T23:11:25.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/0WF37JRKlqutCDxt00DdELvNHg=', 'Content-Length': '0'} 2023-12-15T23:11:25.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e294bfff9d5b13d-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.389 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.389 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.389 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.389 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.389 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.389 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.389 DEBUG:boto:Data: 2023-12-15T23:11:25.389 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.389 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.389 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.389 DEBUG:boto:Params: {} 2023-12-15T23:11:25.390 DEBUG:boto:Token: None 2023-12-15T23:11:25.390 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/0WF37JRKlqutCDxt00DdELvNHg= 2023-12-15T23:11:25.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/0WF37JRKlqutCDxt00DdELvNHg=', 'Content-Length': '0'} 2023-12-15T23:11:25.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000135b508d529f0d8-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:11:25.392 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.392 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.392 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.393 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.393 DEBUG:boto:Method: GET 2023-12-15T23:11:25.393 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.393 DEBUG:boto:Data: 2023-12-15T23:11:25.393 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.393 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.393 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.393 DEBUG:boto:Params: {} 2023-12-15T23:11:25.393 DEBUG:boto:Token: None 2023-12-15T23:11:25.393 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE= 2023-12-15T23:11:25.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE=', 'Content-Length': '0'} 2023-12-15T23:11:25.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000593b784ab9c088ce-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.441 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.442 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.442 DEBUG:boto:path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.442 DEBUG:boto:auth_path=/kskgfn-46/b?versionId=null 2023-12-15T23:11:25.442 DEBUG:boto:Method: GET 2023-12-15T23:11:25.442 DEBUG:boto:Path: /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.442 DEBUG:boto:Data: 2023-12-15T23:11:25.442 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.442 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.442 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.442 DEBUG:boto:Params: {} 2023-12-15T23:11:25.442 DEBUG:boto:Token: None 2023-12-15T23:11:25.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b?versionId=null 2023-12-15T23:11:25.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE= 2023-12-15T23:11:25.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAfaVVwoC2DtnUOwjxaPJL6bOpE=', 'Content-Length': '0'} 2023-12-15T23:11:25.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000385471f47eb9cb40-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.446 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.446 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.446 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.446 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.446 DEBUG:boto:Method: GET 2023-12-15T23:11:25.446 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:11:25.446 DEBUG:boto:Data: 2023-12-15T23:11:25.446 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.446 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.447 DEBUG:boto:Params: {} 2023-12-15T23:11:25.447 DEBUG:boto:Token: None 2023-12-15T23:11:25.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fab9d9719418d6f-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.489 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.490 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.490 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.490 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.490 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.490 DEBUG:boto:Method: GET 2023-12-15T23:11:25.490 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:11:25.490 DEBUG:boto:Data: 2023-12-15T23:11:25.491 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.491 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.491 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.491 DEBUG:boto:Params: {} 2023-12-15T23:11:25.491 DEBUG:boto:Token: None 2023-12-15T23:11:25.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cda596eaae1b02b6-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.494 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.494 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.494 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.494 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.494 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:11:25.494 DEBUG:boto:Data: 2023-12-15T23:11:25.494 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.494 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.495 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.495 DEBUG:boto:Params: {} 2023-12-15T23:11:25.495 DEBUG:boto:Token: None 2023-12-15T23:11:25.495 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b 2023-12-15T23:11:25.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ljmDcbtw5w4xfxm1w+ycbH9fFB8= 2023-12-15T23:11:25.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ljmDcbtw5w4xfxm1w+ycbH9fFB8=', 'Content-Length': '0'} 2023-12-15T23:11:25.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a1e5d109667bb4d-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.498 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.498 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.498 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.498 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:11:25.498 DEBUG:boto:Data: 2023-12-15T23:11:25.498 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.498 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.498 DEBUG:boto:Params: {} 2023-12-15T23:11:25.498 DEBUG:boto:Token: None 2023-12-15T23:11:25.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b 2023-12-15T23:11:25.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ljmDcbtw5w4xfxm1w+ycbH9fFB8= 2023-12-15T23:11:25.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ljmDcbtw5w4xfxm1w+ycbH9fFB8=', 'Content-Length': '0'} 2023-12-15T23:11:25.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcbc35499dafb84c-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.501 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:11:25.501 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.501 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.501 DEBUG:boto:Method: GET 2023-12-15T23:11:25.501 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:11:25.501 DEBUG:boto:Data: 2023-12-15T23:11:25.501 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.501 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.502 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.502 DEBUG:boto:Params: {} 2023-12-15T23:11:25.502 DEBUG:boto:Token: None 2023-12-15T23:11:25.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b 2023-12-15T23:11:25.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mgrggsb4IFy1Oh5YICOApzEftXQ= 2023-12-15T23:11:25.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mgrggsb4IFy1Oh5YICOApzEftXQ=', 'Content-Length': '0'} 2023-12-15T23:11:25.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034874e3a6c254596-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.549 DEBUG:boto:path=/kskgfn-46/b 2023-12-15T23:11:25.550 DEBUG:boto:auth_path=/kskgfn-46/b 2023-12-15T23:11:25.550 DEBUG:boto:Method: GET 2023-12-15T23:11:25.550 DEBUG:boto:Path: /kskgfn-46/b 2023-12-15T23:11:25.550 DEBUG:boto:Data: 2023-12-15T23:11:25.550 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.550 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.550 DEBUG:boto:Params: {} 2023-12-15T23:11:25.550 DEBUG:boto:Token: None 2023-12-15T23:11:25.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/b 2023-12-15T23:11:25.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mgrggsb4IFy1Oh5YICOApzEftXQ= 2023-12-15T23:11:25.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mgrggsb4IFy1Oh5YICOApzEftXQ=', 'Content-Length': '0'} 2023-12-15T23:11:25.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f99d009efeb75d22-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.553 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.553 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.553 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.553 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.554 DEBUG:boto:Method: GET 2023-12-15T23:11:25.554 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:11:25.554 DEBUG:boto:Data: 2023-12-15T23:11:25.554 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.554 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.554 DEBUG:boto:Params: {} 2023-12-15T23:11:25.554 DEBUG:boto:Token: None 2023-12-15T23:11:25.554 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d17ae268ef6494b6-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.556 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.557 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.557 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.557 DEBUG:boto:path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.557 DEBUG:boto:auth_path=/kskgfn-46/?prefix=b 2023-12-15T23:11:25.557 DEBUG:boto:Method: GET 2023-12-15T23:11:25.557 DEBUG:boto:Path: /kskgfn-46/?prefix=b 2023-12-15T23:11:25.557 DEBUG:boto:Data: 2023-12-15T23:11:25.558 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.558 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.558 DEBUG:boto:Params: {} 2023-12-15T23:11:25.558 DEBUG:boto:Token: None 2023-12-15T23:11:25.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f54dd862be3f035f-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.560 DEBUG:boto:b'kskgfn-46b1000falseb2023-12-15T23:10:03.416Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:11:25.561 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.561 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.561 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.561 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.561 DEBUG:boto:Method: GET 2023-12-15T23:11:25.561 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.561 DEBUG:boto:Data: 2023-12-15T23:11:25.561 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.562 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.562 DEBUG:boto:Params: {} 2023-12-15T23:11:25.562 DEBUG:boto:Token: None 2023-12-15T23:11:25.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk= 2023-12-15T23:11:25.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk=', 'Content-Length': '0'} 2023-12-15T23:11:25.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050fd960f2d186701-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.605 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.606 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.606 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.606 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.606 DEBUG:boto:Method: GET 2023-12-15T23:11:25.606 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.606 DEBUG:boto:Data: 2023-12-15T23:11:25.606 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.606 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.606 DEBUG:boto:Params: {} 2023-12-15T23:11:25.607 DEBUG:boto:Token: None 2023-12-15T23:11:25.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk= 2023-12-15T23:11:25.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk=', 'Content-Length': '0'} 2023-12-15T23:11:25.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a954298f839b2cdb-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.609 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.609 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.609 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.610 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.610 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.610 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.610 DEBUG:boto:Data: 2023-12-15T23:11:25.610 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.610 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.610 DEBUG:boto:Params: {} 2023-12-15T23:11:25.610 DEBUG:boto:Token: None 2023-12-15T23:11:25.610 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TsT10HloVwL+tMmaD6u9wn79Epo= 2023-12-15T23:11:25.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TsT10HloVwL+tMmaD6u9wn79Epo=', 'Content-Length': '0'} 2023-12-15T23:11:25.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000db4e0e5055e80e7-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.613 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.613 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.613 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.613 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.613 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.613 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.613 DEBUG:boto:Data: 2023-12-15T23:11:25.613 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.613 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.614 DEBUG:boto:Params: {} 2023-12-15T23:11:25.614 DEBUG:boto:Token: None 2023-12-15T23:11:25.614 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TsT10HloVwL+tMmaD6u9wn79Epo= 2023-12-15T23:11:25.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TsT10HloVwL+tMmaD6u9wn79Epo=', 'Content-Length': '0'} 2023-12-15T23:11:25.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000558bc69b410a59cb-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:11:25.616 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.616 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.616 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.616 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.616 DEBUG:boto:Method: GET 2023-12-15T23:11:25.616 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.616 DEBUG:boto:Data: 2023-12-15T23:11:25.617 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.617 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.617 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.617 DEBUG:boto:Params: {} 2023-12-15T23:11:25.617 DEBUG:boto:Token: None 2023-12-15T23:11:25.617 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk= 2023-12-15T23:11:25.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk=', 'Content-Length': '0'} 2023-12-15T23:11:25.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090a6dbafb2a8af25-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.661 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.662 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.662 DEBUG:boto:path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.662 DEBUG:boto:auth_path=/kskgfn-46/c?versionId=null 2023-12-15T23:11:25.662 DEBUG:boto:Method: GET 2023-12-15T23:11:25.662 DEBUG:boto:Path: /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.662 DEBUG:boto:Data: 2023-12-15T23:11:25.662 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.662 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.662 DEBUG:boto:Params: {} 2023-12-15T23:11:25.662 DEBUG:boto:Token: None 2023-12-15T23:11:25.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c?versionId=null 2023-12-15T23:11:25.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk= 2023-12-15T23:11:25.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X8sN5Hrkxc+8KVi2v0PxjHQbnIk=', 'Content-Length': '0'} 2023-12-15T23:11:25.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab6e56de845bb4d9-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.665 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.665 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.665 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.665 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.665 DEBUG:boto:Method: GET 2023-12-15T23:11:25.665 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:11:25.665 DEBUG:boto:Data: 2023-12-15T23:11:25.666 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.666 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.666 DEBUG:boto:Params: {} 2023-12-15T23:11:25.666 DEBUG:boto:Token: None 2023-12-15T23:11:25.666 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.668 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c76b6f279f165a1-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.668 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.669 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.669 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.669 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.669 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.669 DEBUG:boto:Method: GET 2023-12-15T23:11:25.669 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:11:25.669 DEBUG:boto:Data: 2023-12-15T23:11:25.670 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.670 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.670 DEBUG:boto:Params: {} 2023-12-15T23:11:25.670 DEBUG:boto:Token: None 2023-12-15T23:11:25.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.672 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000415fe9797a33b1a0-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.672 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.673 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.673 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.673 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.673 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:11:25.673 DEBUG:boto:Data: 2023-12-15T23:11:25.673 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.673 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.673 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.673 DEBUG:boto:Params: {} 2023-12-15T23:11:25.673 DEBUG:boto:Token: None 2023-12-15T23:11:25.674 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c 2023-12-15T23:11:25.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YkxCNRoH50rcq14H6rhK+pOevro= 2023-12-15T23:11:25.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YkxCNRoH50rcq14H6rhK+pOevro=', 'Content-Length': '0'} 2023-12-15T23:11:25.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008c0feecca3d007d-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.676 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.676 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.676 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.676 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:11:25.676 DEBUG:boto:Data: 2023-12-15T23:11:25.676 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.676 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.676 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.676 DEBUG:boto:Params: {} 2023-12-15T23:11:25.677 DEBUG:boto:Token: None 2023-12-15T23:11:25.677 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c 2023-12-15T23:11:25.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YkxCNRoH50rcq14H6rhK+pOevro= 2023-12-15T23:11:25.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YkxCNRoH50rcq14H6rhK+pOevro=', 'Content-Length': '0'} 2023-12-15T23:11:25.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bce725f2e33f2032-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:11:25.679 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.679 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.679 DEBUG:boto:Method: GET 2023-12-15T23:11:25.679 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:11:25.679 DEBUG:boto:Data: 2023-12-15T23:11:25.679 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.680 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.680 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.680 DEBUG:boto:Params: {} 2023-12-15T23:11:25.680 DEBUG:boto:Token: None 2023-12-15T23:11:25.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c 2023-12-15T23:11:25.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mBpo8FaQ7m6KdtwOeB3s1164Zzk= 2023-12-15T23:11:25.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBpo8FaQ7m6KdtwOeB3s1164Zzk=', 'Content-Length': '0'} 2023-12-15T23:11:25.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f2769bf2c83fea6-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.729 DEBUG:boto:path=/kskgfn-46/c 2023-12-15T23:11:25.730 DEBUG:boto:auth_path=/kskgfn-46/c 2023-12-15T23:11:25.730 DEBUG:boto:Method: GET 2023-12-15T23:11:25.730 DEBUG:boto:Path: /kskgfn-46/c 2023-12-15T23:11:25.730 DEBUG:boto:Data: 2023-12-15T23:11:25.730 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.730 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.730 DEBUG:boto:Params: {} 2023-12-15T23:11:25.730 DEBUG:boto:Token: None 2023-12-15T23:11:25.730 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/c 2023-12-15T23:11:25.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mBpo8FaQ7m6KdtwOeB3s1164Zzk= 2023-12-15T23:11:25.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBpo8FaQ7m6KdtwOeB3s1164Zzk=', 'Content-Length': '0'} 2023-12-15T23:11:25.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c9887deb19f76fa-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.733 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.733 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.733 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.733 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.733 DEBUG:boto:Method: GET 2023-12-15T23:11:25.733 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:11:25.733 DEBUG:boto:Data: 2023-12-15T23:11:25.733 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.733 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.733 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.734 DEBUG:boto:Params: {} 2023-12-15T23:11:25.734 DEBUG:boto:Token: None 2023-12-15T23:11:25.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012e48a4768d2e432-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.736 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.736 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.736 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.737 DEBUG:boto:path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.737 DEBUG:boto:auth_path=/kskgfn-46/?prefix=c 2023-12-15T23:11:25.737 DEBUG:boto:Method: GET 2023-12-15T23:11:25.737 DEBUG:boto:Path: /kskgfn-46/?prefix=c 2023-12-15T23:11:25.737 DEBUG:boto:Data: 2023-12-15T23:11:25.737 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.737 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.737 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.737 DEBUG:boto:Params: {} 2023-12-15T23:11:25.737 DEBUG:boto:Token: None 2023-12-15T23:11:25.738 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f382897c302ec34-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.740 DEBUG:boto:b'kskgfn-46c1000falsec2023-12-15T23:10:03.428Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:11:25.741 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.741 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.741 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.741 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.741 DEBUG:boto:Method: GET 2023-12-15T23:11:25.741 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.741 DEBUG:boto:Data: 2023-12-15T23:11:25.741 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.741 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.741 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.742 DEBUG:boto:Params: {} 2023-12-15T23:11:25.742 DEBUG:boto:Token: None 2023-12-15T23:11:25.742 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8= 2023-12-15T23:11:25.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8=', 'Content-Length': '0'} 2023-12-15T23:11:25.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c32ec2d9d93cf810-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.785 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.786 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.786 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.786 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.786 DEBUG:boto:Method: GET 2023-12-15T23:11:25.786 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.786 DEBUG:boto:Data: 2023-12-15T23:11:25.786 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.786 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.786 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.786 DEBUG:boto:Params: {} 2023-12-15T23:11:25.786 DEBUG:boto:Token: None 2023-12-15T23:11:25.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8= 2023-12-15T23:11:25.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8=', 'Content-Length': '0'} 2023-12-15T23:11:25.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8089db9db3733d9-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.789 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.789 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.789 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.789 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.789 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.790 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.790 DEBUG:boto:Data: 2023-12-15T23:11:25.790 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.790 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.790 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.790 DEBUG:boto:Params: {} 2023-12-15T23:11:25.790 DEBUG:boto:Token: None 2023-12-15T23:11:25.790 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dkAlj9tUHlbF/SrNzqim/avGjH8= 2023-12-15T23:11:25.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dkAlj9tUHlbF/SrNzqim/avGjH8=', 'Content-Length': '0'} 2023-12-15T23:11:25.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b59078e969aca73-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.793 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.793 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.793 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.793 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.793 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.793 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.793 DEBUG:boto:Data: 2023-12-15T23:11:25.793 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.793 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.793 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.794 DEBUG:boto:Params: {} 2023-12-15T23:11:25.794 DEBUG:boto:Token: None 2023-12-15T23:11:25.794 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dkAlj9tUHlbF/SrNzqim/avGjH8= 2023-12-15T23:11:25.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dkAlj9tUHlbF/SrNzqim/avGjH8=', 'Content-Length': '0'} 2023-12-15T23:11:25.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebd0c7220043b9d9-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.796 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:11:25.796 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.796 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.797 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.797 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.797 DEBUG:boto:Method: GET 2023-12-15T23:11:25.797 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.797 DEBUG:boto:Data: 2023-12-15T23:11:25.797 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.797 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.797 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.797 DEBUG:boto:Params: {} 2023-12-15T23:11:25.797 DEBUG:boto:Token: None 2023-12-15T23:11:25.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8= 2023-12-15T23:11:25.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8=', 'Content-Length': '0'} 2023-12-15T23:11:25.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc1c3630efe61f04-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.845 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.846 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.846 DEBUG:boto:path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.846 DEBUG:boto:auth_path=/kskgfn-46/d?versionId=null 2023-12-15T23:11:25.846 DEBUG:boto:Method: GET 2023-12-15T23:11:25.846 DEBUG:boto:Path: /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.846 DEBUG:boto:Data: 2023-12-15T23:11:25.846 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.846 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.846 DEBUG:boto:Params: {} 2023-12-15T23:11:25.846 DEBUG:boto:Token: None 2023-12-15T23:11:25.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d?versionId=null 2023-12-15T23:11:25.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8= 2023-12-15T23:11:25.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wm+wIT2SXDMagrHXWECrDeyzNo8=', 'Content-Length': '0'} 2023-12-15T23:11:25.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4fc66cd1993f8cd-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.849 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.849 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.849 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.849 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.849 DEBUG:boto:Method: GET 2023-12-15T23:11:25.849 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:11:25.850 DEBUG:boto:Data: 2023-12-15T23:11:25.850 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.850 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.850 DEBUG:boto:Params: {} 2023-12-15T23:11:25.850 DEBUG:boto:Token: None 2023-12-15T23:11:25.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c157969fb58b1df-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.852 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.853 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.853 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.853 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.853 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.853 DEBUG:boto:Method: GET 2023-12-15T23:11:25.853 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:11:25.853 DEBUG:boto:Data: 2023-12-15T23:11:25.853 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.854 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.854 DEBUG:boto:Params: {} 2023-12-15T23:11:25.854 DEBUG:boto:Token: None 2023-12-15T23:11:25.854 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1e1ceebd82b05cf-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.856 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.856 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.856 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.857 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.857 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:11:25.857 DEBUG:boto:Data: 2023-12-15T23:11:25.857 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.857 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.857 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.857 DEBUG:boto:Params: {} 2023-12-15T23:11:25.857 DEBUG:boto:Token: None 2023-12-15T23:11:25.857 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d 2023-12-15T23:11:25.857 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J9vfpn+/Kn44wGZrydqknxa86K4= 2023-12-15T23:11:25.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J9vfpn+/Kn44wGZrydqknxa86K4=', 'Content-Length': '0'} 2023-12-15T23:11:25.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e21c273dc43e1ad-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.860 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.860 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.860 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.860 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:11:25.860 DEBUG:boto:Data: 2023-12-15T23:11:25.860 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.860 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.860 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.860 DEBUG:boto:Params: {} 2023-12-15T23:11:25.860 DEBUG:boto:Token: None 2023-12-15T23:11:25.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d 2023-12-15T23:11:25.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J9vfpn+/Kn44wGZrydqknxa86K4= 2023-12-15T23:11:25.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J9vfpn+/Kn44wGZrydqknxa86K4=', 'Content-Length': '0'} 2023-12-15T23:11:25.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080201a5576c36a88-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:11:25.863 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.863 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.863 DEBUG:boto:Method: GET 2023-12-15T23:11:25.864 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:11:25.864 DEBUG:boto:Data: 2023-12-15T23:11:25.864 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.864 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.864 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.864 DEBUG:boto:Params: {} 2023-12-15T23:11:25.864 DEBUG:boto:Token: None 2023-12-15T23:11:25.864 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d 2023-12-15T23:11:25.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t8SKfLqdheQ/Kr9tbnnv9LQzcbU= 2023-12-15T23:11:25.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t8SKfLqdheQ/Kr9tbnnv9LQzcbU=', 'Content-Length': '0'} 2023-12-15T23:11:25.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da4a05737a331e48-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.909 DEBUG:boto:path=/kskgfn-46/d 2023-12-15T23:11:25.909 DEBUG:boto:auth_path=/kskgfn-46/d 2023-12-15T23:11:25.910 DEBUG:boto:Method: GET 2023-12-15T23:11:25.910 DEBUG:boto:Path: /kskgfn-46/d 2023-12-15T23:11:25.910 DEBUG:boto:Data: 2023-12-15T23:11:25.910 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.910 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.910 DEBUG:boto:Params: {} 2023-12-15T23:11:25.910 DEBUG:boto:Token: None 2023-12-15T23:11:25.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/d 2023-12-15T23:11:25.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t8SKfLqdheQ/Kr9tbnnv9LQzcbU= 2023-12-15T23:11:25.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t8SKfLqdheQ/Kr9tbnnv9LQzcbU=', 'Content-Length': '0'} 2023-12-15T23:11:25.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000035316867a8b9b70-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.913 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.913 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.913 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.913 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.913 DEBUG:boto:Method: GET 2023-12-15T23:11:25.913 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:11:25.913 DEBUG:boto:Data: 2023-12-15T23:11:25.914 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.914 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.914 DEBUG:boto:Params: {} 2023-12-15T23:11:25.914 DEBUG:boto:Token: None 2023-12-15T23:11:25.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.916 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000529cdae3255ac9f3-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.916 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.917 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:25.917 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:25.917 DEBUG:boto:path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.917 DEBUG:boto:auth_path=/kskgfn-46/?prefix=d 2023-12-15T23:11:25.917 DEBUG:boto:Method: GET 2023-12-15T23:11:25.917 DEBUG:boto:Path: /kskgfn-46/?prefix=d 2023-12-15T23:11:25.917 DEBUG:boto:Data: 2023-12-15T23:11:25.918 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.918 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.918 DEBUG:boto:Params: {} 2023-12-15T23:11:25.918 DEBUG:boto:Token: None 2023-12-15T23:11:25.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/ 2023-12-15T23:11:25.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4= 2023-12-15T23:11:25.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAG5jMwo83cGRr88sH4L8ipmsg4=', 'Content-Length': '0'} 2023-12-15T23:11:25.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5889c2761682150-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.920 DEBUG:boto:b'kskgfn-46d1000falsed2023-12-15T23:10:03.439Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:25.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:11:25.921 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:25.921 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:25.921 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.921 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.921 DEBUG:boto:Method: GET 2023-12-15T23:11:25.921 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.921 DEBUG:boto:Data: 2023-12-15T23:11:25.922 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.922 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.922 DEBUG:boto:Params: {} 2023-12-15T23:11:25.922 DEBUG:boto:Token: None 2023-12-15T23:11:25.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4= 2023-12-15T23:11:25.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4=', 'Content-Length': '0'} 2023-12-15T23:11:25.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fb481b3088cba8f-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.965 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:25.965 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:25.966 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.966 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.966 DEBUG:boto:Method: GET 2023-12-15T23:11:25.966 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.966 DEBUG:boto:Data: 2023-12-15T23:11:25.966 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.966 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.966 DEBUG:boto:Params: {} 2023-12-15T23:11:25.966 DEBUG:boto:Token: None 2023-12-15T23:11:25.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4= 2023-12-15T23:11:25.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4=', 'Content-Length': '0'} 2023-12-15T23:11:25.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ca43ae7d19e1e17-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.969 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:25.969 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:25.969 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.969 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.969 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.969 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.969 DEBUG:boto:Data: 2023-12-15T23:11:25.969 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.970 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.970 DEBUG:boto:Params: {} 2023-12-15T23:11:25.970 DEBUG:boto:Token: None 2023-12-15T23:11:25.970 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6anSlFCruUguTyEbz4YObA4IDoQ= 2023-12-15T23:11:25.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6anSlFCruUguTyEbz4YObA4IDoQ=', 'Content-Length': '0'} 2023-12-15T23:11:25.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012176ccf3773b50a-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.972 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:25.972 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:25.973 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.973 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.973 DEBUG:boto:Method: HEAD 2023-12-15T23:11:25.973 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.973 DEBUG:boto:Data: 2023-12-15T23:11:25.973 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.973 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:25.973 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.973 DEBUG:boto:Params: {} 2023-12-15T23:11:25.973 DEBUG:boto:Token: None 2023-12-15T23:11:25.973 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6anSlFCruUguTyEbz4YObA4IDoQ= 2023-12-15T23:11:25.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6anSlFCruUguTyEbz4YObA4IDoQ=', 'Content-Length': '0'} 2023-12-15T23:11:25.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058e8a92ac1d34939-00657cdd1d-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:25.976 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:11:25.976 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:25.976 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:25.976 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.976 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:25.976 DEBUG:boto:Method: GET 2023-12-15T23:11:25.976 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.976 DEBUG:boto:Data: 2023-12-15T23:11:25.977 DEBUG:boto:Headers: {} 2023-12-15T23:11:25.977 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:25.977 DEBUG:boto:Port: 8000 2023-12-15T23:11:25.977 DEBUG:boto:Params: {} 2023-12-15T23:11:25.977 DEBUG:boto:Token: None 2023-12-15T23:11:25.977 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:25 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:25.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4= 2023-12-15T23:11:25.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OrAcr6W8StK0zoS1r9VRLZvyNr4=', 'Content-Length': '0'} 2023-12-15T23:11:25.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e250cbc443a3ecee-00657cdd1d-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.021 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:26.022 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:26.022 DEBUG:boto:path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:26.022 DEBUG:boto:auth_path=/kskgfn-46/e?versionId=null 2023-12-15T23:11:26.022 DEBUG:boto:Method: GET 2023-12-15T23:11:26.022 DEBUG:boto:Path: /kskgfn-46/e?versionId=null 2023-12-15T23:11:26.022 DEBUG:boto:Data: 2023-12-15T23:11:26.022 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.022 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.022 DEBUG:boto:Params: {} 2023-12-15T23:11:26.023 DEBUG:boto:Token: None 2023-12-15T23:11:26.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/e?versionId=null 2023-12-15T23:11:26.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wjkjm5BEBSEYTmikMPtJgeSfIRg= 2023-12-15T23:11:26.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wjkjm5BEBSEYTmikMPtJgeSfIRg=', 'Content-Length': '0'} 2023-12-15T23:11:26.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063e705a598ad010e-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.025 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.025 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.025 DEBUG:boto:path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.025 DEBUG:boto:auth_path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.025 DEBUG:boto:Method: GET 2023-12-15T23:11:26.025 DEBUG:boto:Path: /kskgfn-46/?prefix=e 2023-12-15T23:11:26.026 DEBUG:boto:Data: 2023-12-15T23:11:26.026 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.026 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.026 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.026 DEBUG:boto:Params: {} 2023-12-15T23:11:26.026 DEBUG:boto:Token: None 2023-12-15T23:11:26.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.028 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002289777fd3e37013-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.029 DEBUG:boto:b'kskgfn-46e1000falsee2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.029 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.029 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.030 DEBUG:boto:path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.030 DEBUG:boto:auth_path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.030 DEBUG:boto:Method: GET 2023-12-15T23:11:26.030 DEBUG:boto:Path: /kskgfn-46/?prefix=e 2023-12-15T23:11:26.030 DEBUG:boto:Data: 2023-12-15T23:11:26.030 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.030 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.030 DEBUG:boto:Params: {} 2023-12-15T23:11:26.030 DEBUG:boto:Token: None 2023-12-15T23:11:26.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051c0a103b414aff6-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.033 DEBUG:boto:b'kskgfn-46e1000falsee2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.033 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:26.033 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:26.033 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.033 DEBUG:boto:Path: /kskgfn-46/e 2023-12-15T23:11:26.033 DEBUG:boto:Data: 2023-12-15T23:11:26.033 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.033 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.034 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.034 DEBUG:boto:Params: {} 2023-12-15T23:11:26.034 DEBUG:boto:Token: None 2023-12-15T23:11:26.034 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/e 2023-12-15T23:11:26.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jWrLH2nKqCMkGrybY85NVjgflMc= 2023-12-15T23:11:26.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jWrLH2nKqCMkGrybY85NVjgflMc=', 'Content-Length': '0'} 2023-12-15T23:11:26.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c213a86a28e5e87-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.036 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:26.036 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:26.036 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.036 DEBUG:boto:Path: /kskgfn-46/e 2023-12-15T23:11:26.036 DEBUG:boto:Data: 2023-12-15T23:11:26.037 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.037 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.037 DEBUG:boto:Params: {} 2023-12-15T23:11:26.037 DEBUG:boto:Token: None 2023-12-15T23:11:26.037 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/e 2023-12-15T23:11:26.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jWrLH2nKqCMkGrybY85NVjgflMc= 2023-12-15T23:11:26.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jWrLH2nKqCMkGrybY85NVjgflMc=', 'Content-Length': '0'} 2023-12-15T23:11:26.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d5563122c62812e-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:11:26.039 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:26.039 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:26.040 DEBUG:boto:Method: GET 2023-12-15T23:11:26.040 DEBUG:boto:Path: /kskgfn-46/e 2023-12-15T23:11:26.040 DEBUG:boto:Data: 2023-12-15T23:11:26.040 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.040 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.040 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.040 DEBUG:boto:Params: {} 2023-12-15T23:11:26.040 DEBUG:boto:Token: None 2023-12-15T23:11:26.040 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/e 2023-12-15T23:11:26.040 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ak1pLGT7IkYXT5iWcZfSAJRqx5A= 2023-12-15T23:11:26.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ak1pLGT7IkYXT5iWcZfSAJRqx5A=', 'Content-Length': '0'} 2023-12-15T23:11:26.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f6b0a69bb475da5-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.085 DEBUG:boto:path=/kskgfn-46/e 2023-12-15T23:11:26.086 DEBUG:boto:auth_path=/kskgfn-46/e 2023-12-15T23:11:26.086 DEBUG:boto:Method: GET 2023-12-15T23:11:26.086 DEBUG:boto:Path: /kskgfn-46/e 2023-12-15T23:11:26.086 DEBUG:boto:Data: 2023-12-15T23:11:26.086 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.086 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.086 DEBUG:boto:Params: {} 2023-12-15T23:11:26.086 DEBUG:boto:Token: None 2023-12-15T23:11:26.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/e 2023-12-15T23:11:26.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ak1pLGT7IkYXT5iWcZfSAJRqx5A= 2023-12-15T23:11:26.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ak1pLGT7IkYXT5iWcZfSAJRqx5A=', 'Content-Length': '0'} 2023-12-15T23:11:26.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1ba6cf505a8456f-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.089 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.089 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.089 DEBUG:boto:path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.089 DEBUG:boto:auth_path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.089 DEBUG:boto:Method: GET 2023-12-15T23:11:26.089 DEBUG:boto:Path: /kskgfn-46/?prefix=e 2023-12-15T23:11:26.089 DEBUG:boto:Data: 2023-12-15T23:11:26.089 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.089 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.090 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.090 DEBUG:boto:Params: {} 2023-12-15T23:11:26.090 DEBUG:boto:Token: None 2023-12-15T23:11:26.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.092 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060cbb9823ad2d11b-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.093 DEBUG:boto:b'kskgfn-46e1000falsee2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.093 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.093 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.093 DEBUG:boto:path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.093 DEBUG:boto:auth_path=/kskgfn-46/?prefix=e 2023-12-15T23:11:26.093 DEBUG:boto:Method: GET 2023-12-15T23:11:26.094 DEBUG:boto:Path: /kskgfn-46/?prefix=e 2023-12-15T23:11:26.094 DEBUG:boto:Data: 2023-12-15T23:11:26.094 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.094 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.094 DEBUG:boto:Params: {} 2023-12-15T23:11:26.094 DEBUG:boto:Token: None 2023-12-15T23:11:26.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024b47d8378673b75-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.096 DEBUG:boto:b'kskgfn-46e1000falsee2023-12-15T23:10:09.815Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:11:26.097 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.097 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.097 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.097 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.097 DEBUG:boto:Method: GET 2023-12-15T23:11:26.098 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.098 DEBUG:boto:Data: 2023-12-15T23:11:26.098 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.098 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.098 DEBUG:boto:Params: {} 2023-12-15T23:11:26.098 DEBUG:boto:Token: None 2023-12-15T23:11:26.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498= 2023-12-15T23:11:26.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498=', 'Content-Length': '0'} 2023-12-15T23:11:26.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff1b3c6e2dcfdb40-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.141 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.142 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.142 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.142 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.142 DEBUG:boto:Method: GET 2023-12-15T23:11:26.142 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.142 DEBUG:boto:Data: 2023-12-15T23:11:26.142 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.143 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.143 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.143 DEBUG:boto:Params: {} 2023-12-15T23:11:26.143 DEBUG:boto:Token: None 2023-12-15T23:11:26.143 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498= 2023-12-15T23:11:26.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498=', 'Content-Length': '0'} 2023-12-15T23:11:26.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7de75a57c847c21-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.146 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.146 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.146 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.146 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.146 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.146 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.147 DEBUG:boto:Data: 2023-12-15T23:11:26.147 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.147 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.147 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.147 DEBUG:boto:Params: {} 2023-12-15T23:11:26.147 DEBUG:boto:Token: None 2023-12-15T23:11:26.147 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vDub7V+KHiv7W966ZEHntDtxvzA= 2023-12-15T23:11:26.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vDub7V+KHiv7W966ZEHntDtxvzA=', 'Content-Length': '0'} 2023-12-15T23:11:26.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004041ecf94f53337b-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.149 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.150 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.150 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.150 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.150 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.150 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.150 DEBUG:boto:Data: 2023-12-15T23:11:26.150 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.150 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.151 DEBUG:boto:Params: {} 2023-12-15T23:11:26.151 DEBUG:boto:Token: None 2023-12-15T23:11:26.151 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vDub7V+KHiv7W966ZEHntDtxvzA= 2023-12-15T23:11:26.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vDub7V+KHiv7W966ZEHntDtxvzA=', 'Content-Length': '0'} 2023-12-15T23:11:26.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9132d042f97d05d-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.153 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:11:26.154 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.154 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.154 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.154 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.154 DEBUG:boto:Method: GET 2023-12-15T23:11:26.154 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.154 DEBUG:boto:Data: 2023-12-15T23:11:26.154 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.155 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.155 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.155 DEBUG:boto:Params: {} 2023-12-15T23:11:26.155 DEBUG:boto:Token: None 2023-12-15T23:11:26.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498= 2023-12-15T23:11:26.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498=', 'Content-Length': '0'} 2023-12-15T23:11:26.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d7f97db5199a50b-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.205 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.206 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.206 DEBUG:boto:path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.206 DEBUG:boto:auth_path=/kskgfn-46/f?versionId=null 2023-12-15T23:11:26.206 DEBUG:boto:Method: GET 2023-12-15T23:11:26.206 DEBUG:boto:Path: /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.206 DEBUG:boto:Data: 2023-12-15T23:11:26.206 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.207 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.207 DEBUG:boto:Params: {} 2023-12-15T23:11:26.207 DEBUG:boto:Token: None 2023-12-15T23:11:26.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f?versionId=null 2023-12-15T23:11:26.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498= 2023-12-15T23:11:26.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oPp6hBe215Gg+8id7xq2eMi6498=', 'Content-Length': '0'} 2023-12-15T23:11:26.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bcf0e045e08b5c0-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.210 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.210 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.210 DEBUG:boto:path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.210 DEBUG:boto:auth_path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.210 DEBUG:boto:Method: GET 2023-12-15T23:11:26.210 DEBUG:boto:Path: /kskgfn-46/?prefix=f 2023-12-15T23:11:26.210 DEBUG:boto:Data: 2023-12-15T23:11:26.210 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.211 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.211 DEBUG:boto:Params: {} 2023-12-15T23:11:26.211 DEBUG:boto:Token: None 2023-12-15T23:11:26.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007005254883929b9a-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.213 DEBUG:boto:b'kskgfn-46f1000falsef2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.214 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.214 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.214 DEBUG:boto:path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.214 DEBUG:boto:auth_path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.214 DEBUG:boto:Method: GET 2023-12-15T23:11:26.214 DEBUG:boto:Path: /kskgfn-46/?prefix=f 2023-12-15T23:11:26.215 DEBUG:boto:Data: 2023-12-15T23:11:26.215 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.215 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.215 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.215 DEBUG:boto:Params: {} 2023-12-15T23:11:26.215 DEBUG:boto:Token: None 2023-12-15T23:11:26.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000137438e698b6bbbb-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.218 DEBUG:boto:b'kskgfn-46f1000falsef2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.218 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.218 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.218 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.218 DEBUG:boto:Path: /kskgfn-46/f 2023-12-15T23:11:26.219 DEBUG:boto:Data: 2023-12-15T23:11:26.219 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.219 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.219 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.219 DEBUG:boto:Params: {} 2023-12-15T23:11:26.219 DEBUG:boto:Token: None 2023-12-15T23:11:26.219 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f 2023-12-15T23:11:26.220 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2H2mwemA8SoMZ+1XSft/GzaKB1I= 2023-12-15T23:11:26.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2H2mwemA8SoMZ+1XSft/GzaKB1I=', 'Content-Length': '0'} 2023-12-15T23:11:26.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dda3efb3f50fd9dd-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.222 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.222 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.222 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.222 DEBUG:boto:Path: /kskgfn-46/f 2023-12-15T23:11:26.222 DEBUG:boto:Data: 2023-12-15T23:11:26.222 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.223 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.223 DEBUG:boto:Params: {} 2023-12-15T23:11:26.223 DEBUG:boto:Token: None 2023-12-15T23:11:26.223 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f 2023-12-15T23:11:26.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2H2mwemA8SoMZ+1XSft/GzaKB1I= 2023-12-15T23:11:26.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2H2mwemA8SoMZ+1XSft/GzaKB1I=', 'Content-Length': '0'} 2023-12-15T23:11:26.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061c5d72080477d6d-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.225 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:11:26.225 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.225 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.226 DEBUG:boto:Method: GET 2023-12-15T23:11:26.226 DEBUG:boto:Path: /kskgfn-46/f 2023-12-15T23:11:26.226 DEBUG:boto:Data: 2023-12-15T23:11:26.226 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.226 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.226 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.226 DEBUG:boto:Params: {} 2023-12-15T23:11:26.226 DEBUG:boto:Token: None 2023-12-15T23:11:26.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f 2023-12-15T23:11:26.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oH58wVUO5ewxFt+scjl2fV69Jzs= 2023-12-15T23:11:26.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oH58wVUO5ewxFt+scjl2fV69Jzs=', 'Content-Length': '0'} 2023-12-15T23:11:26.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac083e307237892b-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.269 DEBUG:boto:path=/kskgfn-46/f 2023-12-15T23:11:26.269 DEBUG:boto:auth_path=/kskgfn-46/f 2023-12-15T23:11:26.270 DEBUG:boto:Method: GET 2023-12-15T23:11:26.270 DEBUG:boto:Path: /kskgfn-46/f 2023-12-15T23:11:26.270 DEBUG:boto:Data: 2023-12-15T23:11:26.270 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.270 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.270 DEBUG:boto:Params: {} 2023-12-15T23:11:26.270 DEBUG:boto:Token: None 2023-12-15T23:11:26.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/f 2023-12-15T23:11:26.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oH58wVUO5ewxFt+scjl2fV69Jzs= 2023-12-15T23:11:26.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oH58wVUO5ewxFt+scjl2fV69Jzs=', 'Content-Length': '0'} 2023-12-15T23:11:26.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6e438d527107701-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.273 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.273 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.273 DEBUG:boto:path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.274 DEBUG:boto:auth_path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.274 DEBUG:boto:Method: GET 2023-12-15T23:11:26.274 DEBUG:boto:Path: /kskgfn-46/?prefix=f 2023-12-15T23:11:26.274 DEBUG:boto:Data: 2023-12-15T23:11:26.274 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.274 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.274 DEBUG:boto:Params: {} 2023-12-15T23:11:26.275 DEBUG:boto:Token: None 2023-12-15T23:11:26.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dcb28f3b2b029bf-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.277 DEBUG:boto:b'kskgfn-46f1000falsef2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.278 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.278 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.278 DEBUG:boto:path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.278 DEBUG:boto:auth_path=/kskgfn-46/?prefix=f 2023-12-15T23:11:26.278 DEBUG:boto:Method: GET 2023-12-15T23:11:26.278 DEBUG:boto:Path: /kskgfn-46/?prefix=f 2023-12-15T23:11:26.278 DEBUG:boto:Data: 2023-12-15T23:11:26.278 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.279 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.279 DEBUG:boto:Params: {} 2023-12-15T23:11:26.279 DEBUG:boto:Token: None 2023-12-15T23:11:26.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.281 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030e05d2b7088e681-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.281 DEBUG:boto:b'kskgfn-46f1000falsef2023-12-15T23:10:09.824Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:11:26.282 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.282 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.282 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.282 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.282 DEBUG:boto:Method: GET 2023-12-15T23:11:26.283 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.283 DEBUG:boto:Data: 2023-12-15T23:11:26.283 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.283 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.283 DEBUG:boto:Params: {} 2023-12-15T23:11:26.283 DEBUG:boto:Token: None 2023-12-15T23:11:26.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s= 2023-12-15T23:11:26.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s=', 'Content-Length': '0'} 2023-12-15T23:11:26.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4c670a12d02ae56-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.329 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.330 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.330 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.330 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.330 DEBUG:boto:Method: GET 2023-12-15T23:11:26.330 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.330 DEBUG:boto:Data: 2023-12-15T23:11:26.330 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.330 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.331 DEBUG:boto:Params: {} 2023-12-15T23:11:26.331 DEBUG:boto:Token: None 2023-12-15T23:11:26.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s= 2023-12-15T23:11:26.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s=', 'Content-Length': '0'} 2023-12-15T23:11:26.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001db25780d854ae66-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.334 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.334 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.334 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.334 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.334 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.334 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.334 DEBUG:boto:Data: 2023-12-15T23:11:26.334 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.335 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.335 DEBUG:boto:Params: {} 2023-12-15T23:11:26.335 DEBUG:boto:Token: None 2023-12-15T23:11:26.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VOMlWqGvfWVv+jkO7617n28NMeo= 2023-12-15T23:11:26.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VOMlWqGvfWVv+jkO7617n28NMeo=', 'Content-Length': '0'} 2023-12-15T23:11:26.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000532e213d26592e8c-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.338 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.338 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.338 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.338 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.338 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.338 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.338 DEBUG:boto:Data: 2023-12-15T23:11:26.339 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.339 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.339 DEBUG:boto:Params: {} 2023-12-15T23:11:26.339 DEBUG:boto:Token: None 2023-12-15T23:11:26.339 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VOMlWqGvfWVv+jkO7617n28NMeo= 2023-12-15T23:11:26.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VOMlWqGvfWVv+jkO7617n28NMeo=', 'Content-Length': '0'} 2023-12-15T23:11:26.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c250d5c188c3263d-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:11:26.342 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.342 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.342 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.342 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.342 DEBUG:boto:Method: GET 2023-12-15T23:11:26.343 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.343 DEBUG:boto:Data: 2023-12-15T23:11:26.343 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.343 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.343 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.343 DEBUG:boto:Params: {} 2023-12-15T23:11:26.343 DEBUG:boto:Token: None 2023-12-15T23:11:26.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s= 2023-12-15T23:11:26.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s=', 'Content-Length': '0'} 2023-12-15T23:11:26.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7e852e64b975815-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.389 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.390 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.390 DEBUG:boto:path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.390 DEBUG:boto:auth_path=/kskgfn-46/g?versionId=null 2023-12-15T23:11:26.390 DEBUG:boto:Method: GET 2023-12-15T23:11:26.390 DEBUG:boto:Path: /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.390 DEBUG:boto:Data: 2023-12-15T23:11:26.390 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.390 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.390 DEBUG:boto:Params: {} 2023-12-15T23:11:26.391 DEBUG:boto:Token: None 2023-12-15T23:11:26.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g?versionId=null 2023-12-15T23:11:26.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s= 2023-12-15T23:11:26.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T02Kn3vECeaVUQVH3xGSh1y/a5s=', 'Content-Length': '0'} 2023-12-15T23:11:26.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6ecaa5c5b990b00-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.393 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.394 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.394 DEBUG:boto:path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.394 DEBUG:boto:auth_path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.394 DEBUG:boto:Method: GET 2023-12-15T23:11:26.394 DEBUG:boto:Path: /kskgfn-46/?prefix=g 2023-12-15T23:11:26.394 DEBUG:boto:Data: 2023-12-15T23:11:26.394 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.394 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.394 DEBUG:boto:Params: {} 2023-12-15T23:11:26.395 DEBUG:boto:Token: None 2023-12-15T23:11:26.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007928842fc15c8a65-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.437 DEBUG:boto:b'kskgfn-46g1000falseg2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.438 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.438 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.438 DEBUG:boto:path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.438 DEBUG:boto:auth_path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.438 DEBUG:boto:Method: GET 2023-12-15T23:11:26.439 DEBUG:boto:Path: /kskgfn-46/?prefix=g 2023-12-15T23:11:26.439 DEBUG:boto:Data: 2023-12-15T23:11:26.439 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.439 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.439 DEBUG:boto:Params: {} 2023-12-15T23:11:26.439 DEBUG:boto:Token: None 2023-12-15T23:11:26.439 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.440 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027f14f53875954e7-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.442 DEBUG:boto:b'kskgfn-46g1000falseg2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.442 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.442 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.443 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.443 DEBUG:boto:Path: /kskgfn-46/g 2023-12-15T23:11:26.443 DEBUG:boto:Data: 2023-12-15T23:11:26.443 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.443 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.443 DEBUG:boto:Params: {} 2023-12-15T23:11:26.443 DEBUG:boto:Token: None 2023-12-15T23:11:26.444 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g 2023-12-15T23:11:26.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SVcIYK0nm6CtQPS6S2EuCLjgisA= 2023-12-15T23:11:26.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SVcIYK0nm6CtQPS6S2EuCLjgisA=', 'Content-Length': '0'} 2023-12-15T23:11:26.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001651bb2d4668bc32-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.446 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.446 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.446 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.447 DEBUG:boto:Path: /kskgfn-46/g 2023-12-15T23:11:26.447 DEBUG:boto:Data: 2023-12-15T23:11:26.447 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.447 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.447 DEBUG:boto:Params: {} 2023-12-15T23:11:26.447 DEBUG:boto:Token: None 2023-12-15T23:11:26.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g 2023-12-15T23:11:26.448 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SVcIYK0nm6CtQPS6S2EuCLjgisA= 2023-12-15T23:11:26.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SVcIYK0nm6CtQPS6S2EuCLjgisA=', 'Content-Length': '0'} 2023-12-15T23:11:26.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cdcb04c46027ade-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:11:26.450 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.450 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.450 DEBUG:boto:Method: GET 2023-12-15T23:11:26.450 DEBUG:boto:Path: /kskgfn-46/g 2023-12-15T23:11:26.450 DEBUG:boto:Data: 2023-12-15T23:11:26.450 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.451 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.451 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.451 DEBUG:boto:Params: {} 2023-12-15T23:11:26.451 DEBUG:boto:Token: None 2023-12-15T23:11:26.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g 2023-12-15T23:11:26.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e4Z83UokezhsWvgQaFf1izvho9c= 2023-12-15T23:11:26.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e4Z83UokezhsWvgQaFf1izvho9c=', 'Content-Length': '0'} 2023-12-15T23:11:26.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd87840ec1c2faff-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.493 DEBUG:boto:path=/kskgfn-46/g 2023-12-15T23:11:26.494 DEBUG:boto:auth_path=/kskgfn-46/g 2023-12-15T23:11:26.494 DEBUG:boto:Method: GET 2023-12-15T23:11:26.494 DEBUG:boto:Path: /kskgfn-46/g 2023-12-15T23:11:26.494 DEBUG:boto:Data: 2023-12-15T23:11:26.494 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.494 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.494 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.494 DEBUG:boto:Params: {} 2023-12-15T23:11:26.494 DEBUG:boto:Token: None 2023-12-15T23:11:26.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/g 2023-12-15T23:11:26.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e4Z83UokezhsWvgQaFf1izvho9c= 2023-12-15T23:11:26.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e4Z83UokezhsWvgQaFf1izvho9c=', 'Content-Length': '0'} 2023-12-15T23:11:26.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d53bb2a72fc922b-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.497 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.497 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.498 DEBUG:boto:path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.498 DEBUG:boto:auth_path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.498 DEBUG:boto:Method: GET 2023-12-15T23:11:26.498 DEBUG:boto:Path: /kskgfn-46/?prefix=g 2023-12-15T23:11:26.498 DEBUG:boto:Data: 2023-12-15T23:11:26.498 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.498 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.498 DEBUG:boto:Params: {} 2023-12-15T23:11:26.498 DEBUG:boto:Token: None 2023-12-15T23:11:26.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da9a6d7d36ae4f7f-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.545 DEBUG:boto:b'kskgfn-46g1000falseg2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.546 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.546 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.546 DEBUG:boto:path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.546 DEBUG:boto:auth_path=/kskgfn-46/?prefix=g 2023-12-15T23:11:26.546 DEBUG:boto:Method: GET 2023-12-15T23:11:26.546 DEBUG:boto:Path: /kskgfn-46/?prefix=g 2023-12-15T23:11:26.546 DEBUG:boto:Data: 2023-12-15T23:11:26.546 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.547 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.547 DEBUG:boto:Params: {} 2023-12-15T23:11:26.547 DEBUG:boto:Token: None 2023-12-15T23:11:26.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019a8da2bd273f0b0-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.550 DEBUG:boto:b'kskgfn-46g1000falseg2023-12-15T23:10:09.834Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.550 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:11:26.550 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.550 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.550 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.550 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.550 DEBUG:boto:Method: GET 2023-12-15T23:11:26.550 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.551 DEBUG:boto:Data: 2023-12-15T23:11:26.551 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.551 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.551 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.551 DEBUG:boto:Params: {} 2023-12-15T23:11:26.551 DEBUG:boto:Token: None 2023-12-15T23:11:26.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y= 2023-12-15T23:11:26.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.554 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fc3c1dc1acaa3f1-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.601 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.602 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.602 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.602 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.602 DEBUG:boto:Method: GET 2023-12-15T23:11:26.602 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.602 DEBUG:boto:Data: 2023-12-15T23:11:26.602 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.602 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.602 DEBUG:boto:Params: {} 2023-12-15T23:11:26.602 DEBUG:boto:Token: None 2023-12-15T23:11:26.603 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y= 2023-12-15T23:11:26.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000825c7073fc462eca-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.605 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.605 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.605 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.605 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.606 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.606 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.606 DEBUG:boto:Data: 2023-12-15T23:11:26.606 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.606 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.606 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.606 DEBUG:boto:Params: {} 2023-12-15T23:11:26.606 DEBUG:boto:Token: None 2023-12-15T23:11:26.606 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Og/NQ3d7fe/t8lMfdPCr5yJRVsw= 2023-12-15T23:11:26.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Og/NQ3d7fe/t8lMfdPCr5yJRVsw=', 'Content-Length': '0'} 2023-12-15T23:11:26.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000f11c6d273e411f-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.609 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.609 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.609 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.609 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.609 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.609 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.609 DEBUG:boto:Data: 2023-12-15T23:11:26.609 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.610 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.610 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.610 DEBUG:boto:Params: {} 2023-12-15T23:11:26.610 DEBUG:boto:Token: None 2023-12-15T23:11:26.610 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Og/NQ3d7fe/t8lMfdPCr5yJRVsw= 2023-12-15T23:11:26.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Og/NQ3d7fe/t8lMfdPCr5yJRVsw=', 'Content-Length': '0'} 2023-12-15T23:11:26.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000972a23b242750fb2-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:11:26.612 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.612 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.613 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.613 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.613 DEBUG:boto:Method: GET 2023-12-15T23:11:26.613 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.613 DEBUG:boto:Data: 2023-12-15T23:11:26.613 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.613 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.613 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.613 DEBUG:boto:Params: {} 2023-12-15T23:11:26.613 DEBUG:boto:Token: None 2023-12-15T23:11:26.614 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y= 2023-12-15T23:11:26.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000919acd784de66f3a-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.657 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.657 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.658 DEBUG:boto:path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.658 DEBUG:boto:auth_path=/kskgfn-46/h?versionId=null 2023-12-15T23:11:26.658 DEBUG:boto:Method: GET 2023-12-15T23:11:26.658 DEBUG:boto:Path: /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.658 DEBUG:boto:Data: 2023-12-15T23:11:26.658 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.658 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.658 DEBUG:boto:Params: {} 2023-12-15T23:11:26.658 DEBUG:boto:Token: None 2023-12-15T23:11:26.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h?versionId=null 2023-12-15T23:11:26.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y= 2023-12-15T23:11:26.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3/ZVsO8vIZLV9cuQpw80yc9wu8Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002001db8233e02e3-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.661 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.661 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.661 DEBUG:boto:path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.661 DEBUG:boto:auth_path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.662 DEBUG:boto:Method: GET 2023-12-15T23:11:26.662 DEBUG:boto:Path: /kskgfn-46/?prefix=h 2023-12-15T23:11:26.662 DEBUG:boto:Data: 2023-12-15T23:11:26.662 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.662 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.662 DEBUG:boto:Params: {} 2023-12-15T23:11:26.662 DEBUG:boto:Token: None 2023-12-15T23:11:26.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfae262fc5e50fcd-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.705 DEBUG:boto:b'kskgfn-46h1000falseh2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.706 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.706 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.706 DEBUG:boto:path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.706 DEBUG:boto:auth_path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.706 DEBUG:boto:Method: GET 2023-12-15T23:11:26.706 DEBUG:boto:Path: /kskgfn-46/?prefix=h 2023-12-15T23:11:26.706 DEBUG:boto:Data: 2023-12-15T23:11:26.706 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.707 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.707 DEBUG:boto:Params: {} 2023-12-15T23:11:26.707 DEBUG:boto:Token: None 2023-12-15T23:11:26.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000444eeb78214fc559-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.709 DEBUG:boto:b'kskgfn-46h1000falseh2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.710 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.710 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.710 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.710 DEBUG:boto:Path: /kskgfn-46/h 2023-12-15T23:11:26.710 DEBUG:boto:Data: 2023-12-15T23:11:26.710 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.710 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.710 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.710 DEBUG:boto:Params: {} 2023-12-15T23:11:26.711 DEBUG:boto:Token: None 2023-12-15T23:11:26.711 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h 2023-12-15T23:11:26.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQLpz+O07c1iKtTbHCzku/OqL5Y= 2023-12-15T23:11:26.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQLpz+O07c1iKtTbHCzku/OqL5Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c34c6a8e8ea11181-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.713 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.713 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.714 DEBUG:boto:Method: HEAD 2023-12-15T23:11:26.714 DEBUG:boto:Path: /kskgfn-46/h 2023-12-15T23:11:26.714 DEBUG:boto:Data: 2023-12-15T23:11:26.714 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.714 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.714 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.714 DEBUG:boto:Params: {} 2023-12-15T23:11:26.714 DEBUG:boto:Token: None 2023-12-15T23:11:26.714 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h 2023-12-15T23:11:26.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQLpz+O07c1iKtTbHCzku/OqL5Y= 2023-12-15T23:11:26.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQLpz+O07c1iKtTbHCzku/OqL5Y=', 'Content-Length': '0'} 2023-12-15T23:11:26.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9802577d23a5a37-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.717 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:11:26.717 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.717 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.717 DEBUG:boto:Method: GET 2023-12-15T23:11:26.717 DEBUG:boto:Path: /kskgfn-46/h 2023-12-15T23:11:26.718 DEBUG:boto:Data: 2023-12-15T23:11:26.718 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.718 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.718 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.718 DEBUG:boto:Params: {} 2023-12-15T23:11:26.718 DEBUG:boto:Token: None 2023-12-15T23:11:26.718 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h 2023-12-15T23:11:26.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZFUjqF3tbnBSrBCNNjKEePg2xIc= 2023-12-15T23:11:26.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZFUjqF3tbnBSrBCNNjKEePg2xIc=', 'Content-Length': '0'} 2023-12-15T23:11:26.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-46:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abe3b2fe346c74ec-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.761 DEBUG:boto:path=/kskgfn-46/h 2023-12-15T23:11:26.762 DEBUG:boto:auth_path=/kskgfn-46/h 2023-12-15T23:11:26.762 DEBUG:boto:Method: GET 2023-12-15T23:11:26.762 DEBUG:boto:Path: /kskgfn-46/h 2023-12-15T23:11:26.762 DEBUG:boto:Data: 2023-12-15T23:11:26.762 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.762 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.762 DEBUG:boto:Params: {} 2023-12-15T23:11:26.762 DEBUG:boto:Token: None 2023-12-15T23:11:26.763 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/h 2023-12-15T23:11:26.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZFUjqF3tbnBSrBCNNjKEePg2xIc= 2023-12-15T23:11:26.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZFUjqF3tbnBSrBCNNjKEePg2xIc=', 'Content-Length': '0'} 2023-12-15T23:11:26.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:10:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000417a3aa8795a3651-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.765 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.765 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.765 DEBUG:boto:path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.765 DEBUG:boto:auth_path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.765 DEBUG:boto:Method: GET 2023-12-15T23:11:26.766 DEBUG:boto:Path: /kskgfn-46/?prefix=h 2023-12-15T23:11:26.766 DEBUG:boto:Data: 2023-12-15T23:11:26.766 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.766 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:26.766 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.766 DEBUG:boto:Params: {} 2023-12-15T23:11:26.766 DEBUG:boto:Token: None 2023-12-15T23:11:26.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086bfc98a179435a6-00657cdd1e-4788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.769 DEBUG:boto:b'kskgfn-46h1000falseh2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.769 DEBUG:boto:path=/kskgfn-46/ 2023-12-15T23:11:26.769 DEBUG:boto:auth_path=/kskgfn-46/ 2023-12-15T23:11:26.769 DEBUG:boto:path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.769 DEBUG:boto:auth_path=/kskgfn-46/?prefix=h 2023-12-15T23:11:26.770 DEBUG:boto:Method: GET 2023-12-15T23:11:26.770 DEBUG:boto:Path: /kskgfn-46/?prefix=h 2023-12-15T23:11:26.770 DEBUG:boto:Data: 2023-12-15T23:11:26.770 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.770 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.770 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.770 DEBUG:boto:Params: {} 2023-12-15T23:11:26.770 DEBUG:boto:Token: None 2023-12-15T23:11:26.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-46/ 2023-12-15T23:11:26.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g= 2023-12-15T23:11:26.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NuqbKahLh3mbzdPCj6Lk45RZi8g=', 'Content-Length': '0'} 2023-12-15T23:11:26.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d855dbc4f84ac456-00657cdd1e-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.773 DEBUG:boto:b'kskgfn-46h1000falseh2023-12-15T23:10:09.884Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:11:26.773 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-46 zones={test-zone2, test-zone1} 2023-12-15T23:11:26.774 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_incremental ... ok 2023-12-15T23:11:26.775 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:26.775 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:26.775 DEBUG:boto:Method: PUT 2023-12-15T23:11:26.775 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:26.775 DEBUG:boto:Data: 2023-12-15T23:11:26.775 DEBUG:boto:Headers: {} 2023-12-15T23:11:26.775 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:26.775 DEBUG:boto:Port: 8000 2023-12-15T23:11:26.775 DEBUG:boto:Params: {} 2023-12-15T23:11:26.776 DEBUG:boto:Token: None 2023-12-15T23:11:26.776 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:11:26 GMT /kskgfn-47/ 2023-12-15T23:11:26.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:76G94q3/W/vSXdNqmlZBJoSt1PA= 2023-12-15T23:11:26.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:26 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:76G94q3/W/vSXdNqmlZBJoSt1PA=', 'Content-Length': '0'} 2023-12-15T23:11:26.794 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000edee29542601b478-00657cdd1e-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:26 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:26.794 DEBUG:rgw_multi.tests:created bucket=kskgfn-47 2023-12-15T23:11:26.794 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:26.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:26.795 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:11:26.845 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:26.845 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:26.880 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:11:26.896 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681886.791103_377.1","last_update":"2023-12-15T23:11:26.791103Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:11:26.896 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681886.791103_377.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:11:26.896 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:11:26.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:26.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:26.897 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:11:26.950 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:26.950 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:26.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:26.982+0000 7f70d6216800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:11:26.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:26.983+0000 7f70d6216800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:11:27.000 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681886.782867_374.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:26.782867Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:11:26Z"} 2023-12-15T23:11:27.000 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681886.782867_374.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:26.782867Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:11:26Z"} 2023-12-15T23:11:27.001 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681886.782867_374.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:11:26.782867Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:11:27.001 DEBUG:rgw_multi.tests:log_status={0: '1_1702681886.791103_377.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:11:27.001 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681886.782867_374.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:11:27.001 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702681886.791103_377.1 target=1_1702681886.782867_374.1 2023-12-15T23:11:32.002 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:32.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:11:32.003 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:11:32.055 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:32.056 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:32.087 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:32.086+0000 7f0a17540800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:11:32.089 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:32.088+0000 7f0a17540800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:11:32.106 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681886.791103_377.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:26.791103Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:11:32Z"} 2023-12-15T23:11:32.106 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681886.791103_377.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:26.791103Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:11:32Z"} 2023-12-15T23:11:32.106 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681886.791103_377.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:11:26.791103Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:11:32.106 DEBUG:rgw_multi.tests:log_status={0: '1_1702681886.791103_377.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:11:32.106 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681886.791103_377.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:11:32.106 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:11:32.107 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:11:32.107 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:11:32.107 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:11:32.107+0000 7f4f9d852640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 89891) UID: 0 2023-12-15T23:11:32.108 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:11:32.107+0000 7f4fa340f880 -1 shutting down 2023-12-15T23:11:35.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:11:38.208 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:11:38.208 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.209 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.209 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.209 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.209 DEBUG:boto:Data: 2023-12-15T23:11:38.209 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.210 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.210 DEBUG:boto:Params: {} 2023-12-15T23:11:38.210 DEBUG:boto:Token: None 2023-12-15T23:11:38.210 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.213 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f4a9dab1a416c5b-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.214 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:11:38.214 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:11:38.214 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.214 DEBUG:boto:Path: /kskgfn-47/a 2023-12-15T23:11:38.214 DEBUG:boto:Data: 2023-12-15T23:11:38.214 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.214 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.215 DEBUG:boto:Params: {} 2023-12-15T23:11:38.215 DEBUG:boto:Token: None 2023-12-15T23:11:38.215 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/a 2023-12-15T23:11:38.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XjhOsjXA3GfYWCkwe699miJaLoY= 2023-12-15T23:11:38.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XjhOsjXA3GfYWCkwe699miJaLoY='} 2023-12-15T23:11:38.223 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000080a307441bda3525-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.223 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.223 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.223 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.224 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.224 DEBUG:boto:Data: 2023-12-15T23:11:38.224 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.224 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.224 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.224 DEBUG:boto:Params: {} 2023-12-15T23:11:38.224 DEBUG:boto:Token: None 2023-12-15T23:11:38.224 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.224 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.226 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c791999131aef41b-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.227 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:11:38.227 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:11:38.227 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.227 DEBUG:boto:Path: /kskgfn-47/b 2023-12-15T23:11:38.227 DEBUG:boto:Data: 2023-12-15T23:11:38.227 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.227 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.227 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.227 DEBUG:boto:Params: {} 2023-12-15T23:11:38.228 DEBUG:boto:Token: None 2023-12-15T23:11:38.228 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/b 2023-12-15T23:11:38.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E/gqXEPUe46qnjw/EhOscY08Jd8= 2023-12-15T23:11:38.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E/gqXEPUe46qnjw/EhOscY08Jd8='} 2023-12-15T23:11:38.270 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e1c576b7ced7f142-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.270 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.270 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.270 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.270 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.270 DEBUG:boto:Data: 2023-12-15T23:11:38.270 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.271 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.271 DEBUG:boto:Params: {} 2023-12-15T23:11:38.271 DEBUG:boto:Token: None 2023-12-15T23:11:38.271 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.273 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003a6889b9e0b2bcf9-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.273 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:11:38.274 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:11:38.274 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.274 DEBUG:boto:Path: /kskgfn-47/c 2023-12-15T23:11:38.274 DEBUG:boto:Data: 2023-12-15T23:11:38.274 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.274 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.274 DEBUG:boto:Params: {} 2023-12-15T23:11:38.274 DEBUG:boto:Token: None 2023-12-15T23:11:38.275 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/c 2023-12-15T23:11:38.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LqwmnygqmBXi62g4uEhbGSJrvOk= 2023-12-15T23:11:38.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LqwmnygqmBXi62g4uEhbGSJrvOk='} 2023-12-15T23:11:38.280 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000008f1b7b6c6e1c913-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.281 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.281 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.281 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.281 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.281 DEBUG:boto:Data: 2023-12-15T23:11:38.281 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.281 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.281 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.281 DEBUG:boto:Params: {} 2023-12-15T23:11:38.281 DEBUG:boto:Token: None 2023-12-15T23:11:38.282 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.284 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000612e2a11b6e0c97b-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.284 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:11:38.284 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:11:38.284 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.284 DEBUG:boto:Path: /kskgfn-47/d 2023-12-15T23:11:38.284 DEBUG:boto:Data: 2023-12-15T23:11:38.285 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.285 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.285 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.285 DEBUG:boto:Params: {} 2023-12-15T23:11:38.285 DEBUG:boto:Token: None 2023-12-15T23:11:38.285 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/d 2023-12-15T23:11:38.285 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3R3LFeJD7i1P57wzVUHXjOy13sc= 2023-12-15T23:11:38.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3R3LFeJD7i1P57wzVUHXjOy13sc='} 2023-12-15T23:11:38.291 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000409d76e2c15b8dd8-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'kskgfn-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:11:38.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'kskgfn-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:11:38.293 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket kskgfn-47 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:11:38.346 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:38.346 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:38.391 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:11:38.392 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-47 2023-12-15T23:11:38.396 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 4 2023-12-15T23:11:38.443 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.443 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.443 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.443 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.443 DEBUG:boto:Data: 2023-12-15T23:11:38.443 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.444 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.444 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.444 DEBUG:boto:Params: {} 2023-12-15T23:11:38.444 DEBUG:boto:Token: None 2023-12-15T23:11:38.444 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.446 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000041614b06af854d09-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.446 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:11:38.446 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:11:38.447 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.447 DEBUG:boto:Path: /kskgfn-47/e 2023-12-15T23:11:38.447 DEBUG:boto:Data: 2023-12-15T23:11:38.447 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.447 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.447 DEBUG:boto:Params: {} 2023-12-15T23:11:38.447 DEBUG:boto:Token: None 2023-12-15T23:11:38.447 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/e 2023-12-15T23:11:38.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wkgD1hhJkMDHUXcz716+26Z02jQ= 2023-12-15T23:11:38.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wkgD1hhJkMDHUXcz716+26Z02jQ='} 2023-12-15T23:11:38.490 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000900dca71b296f89c-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.490 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.490 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.490 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.490 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.490 DEBUG:boto:Data: 2023-12-15T23:11:38.490 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.491 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.491 DEBUG:boto:Params: {} 2023-12-15T23:11:38.491 DEBUG:boto:Token: None 2023-12-15T23:11:38.491 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.492 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d0d5e099cfc5a48-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.493 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:11:38.493 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:11:38.493 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.493 DEBUG:boto:Path: /kskgfn-47/f 2023-12-15T23:11:38.493 DEBUG:boto:Data: 2023-12-15T23:11:38.493 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.493 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.493 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.494 DEBUG:boto:Params: {} 2023-12-15T23:11:38.494 DEBUG:boto:Token: None 2023-12-15T23:11:38.494 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/f 2023-12-15T23:11:38.494 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WO/5ifrw0keDaUGLP8OYQ6yQH5Q= 2023-12-15T23:11:38.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WO/5ifrw0keDaUGLP8OYQ6yQH5Q='} 2023-12-15T23:11:38.499 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002e943ad8d0f6c0cd-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.499 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.499 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.499 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.499 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.500 DEBUG:boto:Data: 2023-12-15T23:11:38.500 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.500 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.500 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.500 DEBUG:boto:Params: {} 2023-12-15T23:11:38.500 DEBUG:boto:Token: None 2023-12-15T23:11:38.500 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.500 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.502 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005eee7fa2fc42b616-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.503 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:11:38.503 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:11:38.503 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.503 DEBUG:boto:Path: /kskgfn-47/g 2023-12-15T23:11:38.503 DEBUG:boto:Data: 2023-12-15T23:11:38.503 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.503 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.503 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.503 DEBUG:boto:Params: {} 2023-12-15T23:11:38.503 DEBUG:boto:Token: None 2023-12-15T23:11:38.503 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/g 2023-12-15T23:11:38.504 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nwzp8eaRwXXWpHu/qb/mrWpU3O4= 2023-12-15T23:11:38.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nwzp8eaRwXXWpHu/qb/mrWpU3O4='} 2023-12-15T23:11:38.546 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fb102deeda3267bf-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.546 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:11:38.546 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:11:38.546 DEBUG:boto:Method: HEAD 2023-12-15T23:11:38.546 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:11:38.546 DEBUG:boto:Data: 2023-12-15T23:11:38.546 DEBUG:boto:Headers: {} 2023-12-15T23:11:38.546 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.546 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.547 DEBUG:boto:Params: {} 2023-12-15T23:11:38.547 DEBUG:boto:Token: None 2023-12-15T23:11:38.547 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/ 2023-12-15T23:11:38.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k= 2023-12-15T23:11:38.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RkQDjvkXKI60SOXraqlafG3Xz5k=', 'Content-Length': '0'} 2023-12-15T23:11:38.549 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a6d949196b4b97f-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.549 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:11:38.549 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:11:38.550 DEBUG:boto:Method: PUT 2023-12-15T23:11:38.550 DEBUG:boto:Path: /kskgfn-47/h 2023-12-15T23:11:38.550 DEBUG:boto:Data: 2023-12-15T23:11:38.550 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:11:38.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:11:38.550 DEBUG:boto:Port: 8000 2023-12-15T23:11:38.550 DEBUG:boto:Params: {} 2023-12-15T23:11:38.550 DEBUG:boto:Token: None 2023-12-15T23:11:38.550 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:11:38 GMT /kskgfn-47/h 2023-12-15T23:11:38.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gidmo1oDpMBxDgiI9sQunCq3IPQ= 2023-12-15T23:11:38.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:11:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gidmo1oDpMBxDgiI9sQunCq3IPQ='} 2023-12-15T23:11:38.554 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000754f6c168d468293-00657cdd2a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:11:38.555 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:11:38.555 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:11:38.558 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:11:38.558 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:38.579 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:11:38.579 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:11:38.579 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:11:38.579 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:11:38.580 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:11:39.581 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:11:39.601 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:11:39.601 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:11:39.601 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:11:39.602 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:11:39.602 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-47 2023-12-15T23:11:39.603 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:11:39.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:11:39.603 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:11:39.696 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:11:39.697 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:11:39.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:39.729+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:11:41.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T23:11:44.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:44.730+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:11:49.731 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:49.730+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:11:54.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:54.731+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:11:59.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:11:59.733+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:04.734 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:04.733+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:09.735 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:09.734+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:14.736 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:14.735+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:19.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:19.736+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:24.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:24.736+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:29.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:29.737+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:34.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:34.738+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:39.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:39.739+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:44.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:44.740+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:49.742 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:49.741+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:54.743 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:54.742+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:12:59.744 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:12:59.742+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:04.745 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:04.743+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:09.745 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:09.744+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:14.746 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:14.745+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:19.747 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:19.746+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:24.747+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:29.749 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:29.747+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:34.750 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:34.748+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:39.750 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:39.749+0000 7f7efab20800 1 waiting to reach incremental sync.. 2023-12-15T23:13:39.758 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:13:39.757+0000 7fa7ab4ca640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:13:44.116 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:13:44.114+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:13:44.752 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:44.751+0000 7f7efab20800 1 bucket sync caught up with source: 2023-12-15T23:13:44.752 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000003.39.6, 00000000002.27.6, 00000000002.26.6] 2023-12-15T23:13:44.752 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000003.39.6, 00000000002.27.6, 00000000002.26.6] 2023-12-15T23:13:44.752 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:44.751+0000 7f7efab20800 0 bucket checkpoint complete 2023-12-15T23:13:44.772 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-47 2023-12-15T23:13:44.772 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:44.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:44.773 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:13:44.833 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:44.834 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:44.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:13:44.874+0000 7f6e51f3b800 1 bucket sync caught up with source: 2023-12-15T23:13:44.875 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.63.6, , , 00000000001.44.6, 00000000001.59.6, , , 00000000002.86.6, , 00000000002.34.6] 2023-12-15T23:13:44.875 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.63.6, , , 00000000001.44.6, 00000000001.59.6, , , 00000000002.86.6, , 00000000002.34.6] 2023-12-15T23:13:44.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:13:44.874+0000 7f6e51f3b800 0 bucket checkpoint complete 2023-12-15T23:13:44.891 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-47 zones={test-zone2, test-zone1} 2023-12-15T23:13:44.892 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.892 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.892 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.892 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:13:44.892 DEBUG:boto:Data: 2023-12-15T23:13:44.892 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.892 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.892 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.892 DEBUG:boto:Params: {} 2023-12-15T23:13:44.893 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:13:44.893 DEBUG:boto:Token: None 2023-12-15T23:13:44.893 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/ 2023-12-15T23:13:44.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o9firIRHbgFEetQ+ZGorjGzQOYs= 2023-12-15T23:13:44.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o9firIRHbgFEetQ+ZGorjGzQOYs=', 'Content-Length': '0'} 2023-12-15T23:13:44.900 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2c09a9c1acd3939-00657cdda8-5178-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.900 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.900 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.900 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.900 DEBUG:boto:Path: /kskgfn-47/ 2023-12-15T23:13:44.900 DEBUG:boto:Data: 2023-12-15T23:13:44.900 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.900 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.900 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.900 DEBUG:boto:Params: {} 2023-12-15T23:13:44.901 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:13:44.901 DEBUG:boto:Token: None 2023-12-15T23:13:44.901 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/ 2023-12-15T23:13:44.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o9firIRHbgFEetQ+ZGorjGzQOYs= 2023-12-15T23:13:44.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o9firIRHbgFEetQ+ZGorjGzQOYs=', 'Content-Length': '0'} 2023-12-15T23:13:44.904 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bfe8662ae5785b77-00657cdda8-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.905 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:13:44.905 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.905 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.905 DEBUG:boto:path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.905 DEBUG:boto:auth_path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.905 DEBUG:boto:Method: GET 2023-12-15T23:13:44.905 DEBUG:boto:Path: /kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.906 DEBUG:boto:Data: 2023-12-15T23:13:44.906 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.906 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.906 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.906 DEBUG:boto:Params: {} 2023-12-15T23:13:44.906 DEBUG:boto:Token: None 2023-12-15T23:13:44.906 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/?versions 2023-12-15T23:13:44.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw= 2023-12-15T23:13:44.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw=', 'Content-Length': '0'} 2023-12-15T23:13:44.909 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030ceefc800855d2c-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.909 DEBUG:boto:b'kskgfn-47999falseanulltrue2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.910 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:13:44.910 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:13:44.911 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:13:44.911 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.911 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.911 DEBUG:boto:path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.911 DEBUG:boto:auth_path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.912 DEBUG:boto:Method: GET 2023-12-15T23:13:44.912 DEBUG:boto:Path: /kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.912 DEBUG:boto:Data: 2023-12-15T23:13:44.912 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.912 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.912 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.912 DEBUG:boto:Params: {} 2023-12-15T23:13:44.912 DEBUG:boto:Token: None 2023-12-15T23:13:44.912 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/?versions 2023-12-15T23:13:44.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw= 2023-12-15T23:13:44.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw=', 'Content-Length': '0'} 2023-12-15T23:13:44.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000380b6ac50af068ba-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.915 DEBUG:boto:b'kskgfn-47999falseanulltrue2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.915 DEBUG:tasks.rgw_multi.zone_rados:o=a 2023-12-15T23:13:44.915 DEBUG:tasks.rgw_multi.zone_rados:o=b 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=c 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=d 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=e 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=f 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=g 2023-12-15T23:13:44.916 DEBUG:tasks.rgw_multi.zone_rados:o=h 2023-12-15T23:13:44.916 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.916 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.916 DEBUG:boto:path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.916 DEBUG:boto:auth_path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.916 DEBUG:boto:Method: GET 2023-12-15T23:13:44.916 DEBUG:boto:Path: /kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.917 DEBUG:boto:Data: 2023-12-15T23:13:44.917 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.917 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.917 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.917 DEBUG:boto:Params: {} 2023-12-15T23:13:44.917 DEBUG:boto:Token: None 2023-12-15T23:13:44.917 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/?versions 2023-12-15T23:13:44.917 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw= 2023-12-15T23:13:44.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw=', 'Content-Length': '0'} 2023-12-15T23:13:44.920 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff41381aa893e0c4-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.920 DEBUG:boto:b'kskgfn-47999falseanulltrue2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.920 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.920 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.921 DEBUG:boto:path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.921 DEBUG:boto:auth_path=/kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.921 DEBUG:boto:Method: GET 2023-12-15T23:13:44.921 DEBUG:boto:Path: /kskgfn-47/?versions&max-keys=999 2023-12-15T23:13:44.921 DEBUG:boto:Data: 2023-12-15T23:13:44.921 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.921 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.921 DEBUG:boto:Params: {} 2023-12-15T23:13:44.921 DEBUG:boto:Token: None 2023-12-15T23:13:44.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/?versions 2023-12-15T23:13:44.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw= 2023-12-15T23:13:44.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BF5q2izVn12+gHoTpCkDkNRjTOw=', 'Content-Length': '0'} 2023-12-15T23:13:44.924 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abf11c521532e342-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.924 DEBUG:boto:b'kskgfn-47999falseanulltrue2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalbnulltrue2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalcnulltrue2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormaldnulltrue2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalenulltrue2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalfnulltrue2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalgnulltrue2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalhnulltrue2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:13:44.925 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.925 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.925 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.925 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.925 DEBUG:boto:Method: GET 2023-12-15T23:13:44.925 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.925 DEBUG:boto:Data: 2023-12-15T23:13:44.925 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.925 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.925 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.926 DEBUG:boto:Params: {} 2023-12-15T23:13:44.926 DEBUG:boto:Token: None 2023-12-15T23:13:44.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw= 2023-12-15T23:13:44.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw=', 'Content-Length': '0'} 2023-12-15T23:13:44.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5459cbca5571ed3-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.929 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.929 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.929 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.929 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.929 DEBUG:boto:Method: GET 2023-12-15T23:13:44.929 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.930 DEBUG:boto:Data: 2023-12-15T23:13:44.930 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.930 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.930 DEBUG:boto:Params: {} 2023-12-15T23:13:44.930 DEBUG:boto:Token: None 2023-12-15T23:13:44.930 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw= 2023-12-15T23:13:44.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw=', 'Content-Length': '0'} 2023-12-15T23:13:44.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e270efd1bf614176-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.932 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.933 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.933 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.933 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.933 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.933 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.933 DEBUG:boto:Data: 2023-12-15T23:13:44.933 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.933 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.933 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.933 DEBUG:boto:Params: {} 2023-12-15T23:13:44.933 DEBUG:boto:Token: None 2023-12-15T23:13:44.934 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8gGaAZkb7EYq4GU/Zga68DBA5I= 2023-12-15T23:13:44.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8gGaAZkb7EYq4GU/Zga68DBA5I=', 'Content-Length': '0'} 2023-12-15T23:13:44.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099ac4adc161ea0c3-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.936 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.936 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.936 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.936 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.936 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.936 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.936 DEBUG:boto:Data: 2023-12-15T23:13:44.937 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.937 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.937 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.937 DEBUG:boto:Params: {} 2023-12-15T23:13:44.937 DEBUG:boto:Token: None 2023-12-15T23:13:44.937 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.937 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8gGaAZkb7EYq4GU/Zga68DBA5I= 2023-12-15T23:13:44.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8gGaAZkb7EYq4GU/Zga68DBA5I=', 'Content-Length': '0'} 2023-12-15T23:13:44.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d38fa70129ff32c8-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.939 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:13:44.939 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.939 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.940 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.940 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.940 DEBUG:boto:Method: GET 2023-12-15T23:13:44.940 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.940 DEBUG:boto:Data: 2023-12-15T23:13:44.940 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.940 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.940 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.940 DEBUG:boto:Params: {} 2023-12-15T23:13:44.940 DEBUG:boto:Token: None 2023-12-15T23:13:44.940 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.941 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw= 2023-12-15T23:13:44.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw=', 'Content-Length': '0'} 2023-12-15T23:13:44.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ece6876771f0df8d-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.943 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.943 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.943 DEBUG:boto:path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.943 DEBUG:boto:auth_path=/kskgfn-47/a?versionId=null 2023-12-15T23:13:44.943 DEBUG:boto:Method: GET 2023-12-15T23:13:44.944 DEBUG:boto:Path: /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.944 DEBUG:boto:Data: 2023-12-15T23:13:44.944 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.944 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.944 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.944 DEBUG:boto:Params: {} 2023-12-15T23:13:44.944 DEBUG:boto:Token: None 2023-12-15T23:13:44.944 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a?versionId=null 2023-12-15T23:13:44.944 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw= 2023-12-15T23:13:44.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9F9CGM0q4KB9zpeS88m33JPS5Fw=', 'Content-Length': '0'} 2023-12-15T23:13:44.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000649276ac851242c4-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.947 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.947 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.947 DEBUG:boto:path=/kskgfn-47/?prefix=a 2023-12-15T23:13:44.947 DEBUG:boto:auth_path=/kskgfn-47/?prefix=a 2023-12-15T23:13:44.947 DEBUG:boto:Method: GET 2023-12-15T23:13:44.947 DEBUG:boto:Path: /kskgfn-47/?prefix=a 2023-12-15T23:13:44.947 DEBUG:boto:Data: 2023-12-15T23:13:44.948 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.948 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.948 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.948 DEBUG:boto:Params: {} 2023-12-15T23:13:44.948 DEBUG:boto:Token: None 2023-12-15T23:13:44.948 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/ 2023-12-15T23:13:44.948 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yhwGPZZrsgOADQt9VbKySVO5tLg= 2023-12-15T23:13:44.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yhwGPZZrsgOADQt9VbKySVO5tLg=', 'Content-Length': '0'} 2023-12-15T23:13:44.951 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c2df75c8ade2461-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.951 DEBUG:boto:b'kskgfn-47a1000falsea2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.951 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:44.952 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:44.952 DEBUG:boto:path=/kskgfn-47/?prefix=a 2023-12-15T23:13:44.952 DEBUG:boto:auth_path=/kskgfn-47/?prefix=a 2023-12-15T23:13:44.952 DEBUG:boto:Method: GET 2023-12-15T23:13:44.952 DEBUG:boto:Path: /kskgfn-47/?prefix=a 2023-12-15T23:13:44.952 DEBUG:boto:Data: 2023-12-15T23:13:44.952 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.952 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.952 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.952 DEBUG:boto:Params: {} 2023-12-15T23:13:44.953 DEBUG:boto:Token: None 2023-12-15T23:13:44.953 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/ 2023-12-15T23:13:44.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yhwGPZZrsgOADQt9VbKySVO5tLg= 2023-12-15T23:13:44.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yhwGPZZrsgOADQt9VbKySVO5tLg=', 'Content-Length': '0'} 2023-12-15T23:13:44.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9350bd1ae65b276-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.955 DEBUG:boto:b'kskgfn-47a1000falsea2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:44.955 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.955 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.955 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.955 DEBUG:boto:Path: /kskgfn-47/a 2023-12-15T23:13:44.956 DEBUG:boto:Data: 2023-12-15T23:13:44.956 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.956 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.956 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.956 DEBUG:boto:Params: {} 2023-12-15T23:13:44.956 DEBUG:boto:Token: None 2023-12-15T23:13:44.956 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a 2023-12-15T23:13:44.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H3g9VqM6KiUDHQd4NsHzpCJaW/k= 2023-12-15T23:13:44.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H3g9VqM6KiUDHQd4NsHzpCJaW/k=', 'Content-Length': '0'} 2023-12-15T23:13:44.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce76a711e5cde578-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.959 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.959 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.959 DEBUG:boto:Method: HEAD 2023-12-15T23:13:44.959 DEBUG:boto:Path: /kskgfn-47/a 2023-12-15T23:13:44.959 DEBUG:boto:Data: 2023-12-15T23:13:44.959 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.959 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:44.960 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.960 DEBUG:boto:Params: {} 2023-12-15T23:13:44.960 DEBUG:boto:Token: None 2023-12-15T23:13:44.960 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a 2023-12-15T23:13:44.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H3g9VqM6KiUDHQd4NsHzpCJaW/k= 2023-12-15T23:13:44.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H3g9VqM6KiUDHQd4NsHzpCJaW/k=', 'Content-Length': '0'} 2023-12-15T23:13:44.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7e881692372356c-00657cdda8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:44.962 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2023-12-15T23:13:44.962 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:44.962 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:44.962 DEBUG:boto:Method: GET 2023-12-15T23:13:44.963 DEBUG:boto:Path: /kskgfn-47/a 2023-12-15T23:13:44.963 DEBUG:boto:Data: 2023-12-15T23:13:44.963 DEBUG:boto:Headers: {} 2023-12-15T23:13:44.963 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:44.963 DEBUG:boto:Port: 8000 2023-12-15T23:13:44.963 DEBUG:boto:Params: {} 2023-12-15T23:13:44.963 DEBUG:boto:Token: None 2023-12-15T23:13:44.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:44 GMT /kskgfn-47/a 2023-12-15T23:13:44.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pafz0+2ZVmBEpZvIGsbd/2+0nVo= 2023-12-15T23:13:44.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pafz0+2ZVmBEpZvIGsbd/2+0nVo=', 'Content-Length': '0'} 2023-12-15T23:13:44.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbc587ff9bb4c1eb-00657cdda8-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.009 DEBUG:boto:path=/kskgfn-47/a 2023-12-15T23:13:45.010 DEBUG:boto:auth_path=/kskgfn-47/a 2023-12-15T23:13:45.010 DEBUG:boto:Method: GET 2023-12-15T23:13:45.010 DEBUG:boto:Path: /kskgfn-47/a 2023-12-15T23:13:45.010 DEBUG:boto:Data: 2023-12-15T23:13:45.010 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.010 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.010 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.011 DEBUG:boto:Params: {} 2023-12-15T23:13:45.011 DEBUG:boto:Token: None 2023-12-15T23:13:45.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/a 2023-12-15T23:13:45.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N0o3aWh7uwmaLWpobrr7aAvq5UM= 2023-12-15T23:13:45.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N0o3aWh7uwmaLWpobrr7aAvq5UM=', 'Content-Length': '0'} 2023-12-15T23:13:45.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8b798ae3835e68b-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.014 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.014 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.014 DEBUG:boto:path=/kskgfn-47/?prefix=a 2023-12-15T23:13:45.014 DEBUG:boto:auth_path=/kskgfn-47/?prefix=a 2023-12-15T23:13:45.014 DEBUG:boto:Method: GET 2023-12-15T23:13:45.015 DEBUG:boto:Path: /kskgfn-47/?prefix=a 2023-12-15T23:13:45.015 DEBUG:boto:Data: 2023-12-15T23:13:45.015 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.015 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.015 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.015 DEBUG:boto:Params: {} 2023-12-15T23:13:45.015 DEBUG:boto:Token: None 2023-12-15T23:13:45.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b301f63d3f956b15-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.018 DEBUG:boto:b'kskgfn-47a1000falsea2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.018 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.018 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.018 DEBUG:boto:path=/kskgfn-47/?prefix=a 2023-12-15T23:13:45.019 DEBUG:boto:auth_path=/kskgfn-47/?prefix=a 2023-12-15T23:13:45.019 DEBUG:boto:Method: GET 2023-12-15T23:13:45.019 DEBUG:boto:Path: /kskgfn-47/?prefix=a 2023-12-15T23:13:45.019 DEBUG:boto:Data: 2023-12-15T23:13:45.019 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.019 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.019 DEBUG:boto:Params: {} 2023-12-15T23:13:45.019 DEBUG:boto:Token: None 2023-12-15T23:13:45.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028c1d92ffa2d04fa-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.061 DEBUG:boto:b'kskgfn-47a1000falsea2023-12-15T23:11:38.217Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:13:45.062 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.062 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.062 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.062 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.062 DEBUG:boto:Method: GET 2023-12-15T23:13:45.062 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.062 DEBUG:boto:Data: 2023-12-15T23:13:45.062 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.063 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.063 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.063 DEBUG:boto:Params: {} 2023-12-15T23:13:45.063 DEBUG:boto:Token: None 2023-12-15T23:13:45.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU= 2023-12-15T23:13:45.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU=', 'Content-Length': '0'} 2023-12-15T23:13:45.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005adcf64855e7ae41-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.105 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.106 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.106 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.106 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.106 DEBUG:boto:Method: GET 2023-12-15T23:13:45.106 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.106 DEBUG:boto:Data: 2023-12-15T23:13:45.106 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.106 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.106 DEBUG:boto:Params: {} 2023-12-15T23:13:45.107 DEBUG:boto:Token: None 2023-12-15T23:13:45.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU= 2023-12-15T23:13:45.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU=', 'Content-Length': '0'} 2023-12-15T23:13:45.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0d0664d609a4f85-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.109 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.109 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.109 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.110 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.110 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.110 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.110 DEBUG:boto:Data: 2023-12-15T23:13:45.110 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.110 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.110 DEBUG:boto:Params: {} 2023-12-15T23:13:45.110 DEBUG:boto:Token: None 2023-12-15T23:13:45.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9SuZAtozGQT79DGz8Tmg4CQ5IX0= 2023-12-15T23:13:45.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9SuZAtozGQT79DGz8Tmg4CQ5IX0=', 'Content-Length': '0'} 2023-12-15T23:13:45.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b23b2397c851d5f2-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.112 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.113 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.113 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.113 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.113 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.113 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.113 DEBUG:boto:Data: 2023-12-15T23:13:45.113 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.113 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.113 DEBUG:boto:Params: {} 2023-12-15T23:13:45.114 DEBUG:boto:Token: None 2023-12-15T23:13:45.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9SuZAtozGQT79DGz8Tmg4CQ5IX0= 2023-12-15T23:13:45.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9SuZAtozGQT79DGz8Tmg4CQ5IX0=', 'Content-Length': '0'} 2023-12-15T23:13:45.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa9630e72a7313f0-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:13:45.116 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.116 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.117 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.117 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.117 DEBUG:boto:Method: GET 2023-12-15T23:13:45.117 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.117 DEBUG:boto:Data: 2023-12-15T23:13:45.117 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.117 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.117 DEBUG:boto:Params: {} 2023-12-15T23:13:45.117 DEBUG:boto:Token: None 2023-12-15T23:13:45.118 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU= 2023-12-15T23:13:45.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU=', 'Content-Length': '0'} 2023-12-15T23:13:45.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066bd49fa0f9401e4-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.162 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.162 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.162 DEBUG:boto:path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.162 DEBUG:boto:auth_path=/kskgfn-47/b?versionId=null 2023-12-15T23:13:45.162 DEBUG:boto:Method: GET 2023-12-15T23:13:45.162 DEBUG:boto:Path: /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.162 DEBUG:boto:Data: 2023-12-15T23:13:45.162 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.162 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.162 DEBUG:boto:Params: {} 2023-12-15T23:13:45.163 DEBUG:boto:Token: None 2023-12-15T23:13:45.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b?versionId=null 2023-12-15T23:13:45.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU= 2023-12-15T23:13:45.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TIaTz0ABo4m2PlD/b3KkO2/7TYU=', 'Content-Length': '0'} 2023-12-15T23:13:45.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec091267df0e4e4f-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.165 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.165 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.165 DEBUG:boto:path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.166 DEBUG:boto:auth_path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.166 DEBUG:boto:Method: GET 2023-12-15T23:13:45.166 DEBUG:boto:Path: /kskgfn-47/?prefix=b 2023-12-15T23:13:45.166 DEBUG:boto:Data: 2023-12-15T23:13:45.166 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.166 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.166 DEBUG:boto:Params: {} 2023-12-15T23:13:45.166 DEBUG:boto:Token: None 2023-12-15T23:13:45.166 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009cb1cefb4852f378-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.169 DEBUG:boto:b'kskgfn-47b1000falseb2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.170 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.170 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.170 DEBUG:boto:path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.170 DEBUG:boto:auth_path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.170 DEBUG:boto:Method: GET 2023-12-15T23:13:45.170 DEBUG:boto:Path: /kskgfn-47/?prefix=b 2023-12-15T23:13:45.170 DEBUG:boto:Data: 2023-12-15T23:13:45.170 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.170 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.171 DEBUG:boto:Params: {} 2023-12-15T23:13:45.171 DEBUG:boto:Token: None 2023-12-15T23:13:45.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a35da4a42454382a-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.173 DEBUG:boto:b'kskgfn-47b1000falseb2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.174 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.174 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.174 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.174 DEBUG:boto:Path: /kskgfn-47/b 2023-12-15T23:13:45.174 DEBUG:boto:Data: 2023-12-15T23:13:45.174 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.174 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.174 DEBUG:boto:Params: {} 2023-12-15T23:13:45.175 DEBUG:boto:Token: None 2023-12-15T23:13:45.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b 2023-12-15T23:13:45.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e5qKSaMiLEdY/E8rhOCdMgSs2Kk= 2023-12-15T23:13:45.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e5qKSaMiLEdY/E8rhOCdMgSs2Kk=', 'Content-Length': '0'} 2023-12-15T23:13:45.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dfc9e248ff41d1c-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.177 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.177 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.178 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.178 DEBUG:boto:Path: /kskgfn-47/b 2023-12-15T23:13:45.178 DEBUG:boto:Data: 2023-12-15T23:13:45.178 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.178 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.178 DEBUG:boto:Params: {} 2023-12-15T23:13:45.178 DEBUG:boto:Token: None 2023-12-15T23:13:45.178 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b 2023-12-15T23:13:45.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e5qKSaMiLEdY/E8rhOCdMgSs2Kk= 2023-12-15T23:13:45.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e5qKSaMiLEdY/E8rhOCdMgSs2Kk=', 'Content-Length': '0'} 2023-12-15T23:13:45.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e54a18b6321403ef-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2023-12-15T23:13:45.181 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.181 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.181 DEBUG:boto:Method: GET 2023-12-15T23:13:45.182 DEBUG:boto:Path: /kskgfn-47/b 2023-12-15T23:13:45.182 DEBUG:boto:Data: 2023-12-15T23:13:45.182 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.182 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.182 DEBUG:boto:Params: {} 2023-12-15T23:13:45.182 DEBUG:boto:Token: None 2023-12-15T23:13:45.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b 2023-12-15T23:13:45.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Vym2woz73jIyoQ1t3dVVDdYoZFY= 2023-12-15T23:13:45.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Vym2woz73jIyoQ1t3dVVDdYoZFY=', 'Content-Length': '0'} 2023-12-15T23:13:45.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ee7ba61435d8f19-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.225 DEBUG:boto:path=/kskgfn-47/b 2023-12-15T23:13:45.226 DEBUG:boto:auth_path=/kskgfn-47/b 2023-12-15T23:13:45.226 DEBUG:boto:Method: GET 2023-12-15T23:13:45.226 DEBUG:boto:Path: /kskgfn-47/b 2023-12-15T23:13:45.226 DEBUG:boto:Data: 2023-12-15T23:13:45.226 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.226 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.226 DEBUG:boto:Params: {} 2023-12-15T23:13:45.226 DEBUG:boto:Token: None 2023-12-15T23:13:45.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/b 2023-12-15T23:13:45.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Vym2woz73jIyoQ1t3dVVDdYoZFY= 2023-12-15T23:13:45.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Vym2woz73jIyoQ1t3dVVDdYoZFY=', 'Content-Length': '0'} 2023-12-15T23:13:45.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bda971d2083c2c6f-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.229 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.229 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.229 DEBUG:boto:path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.229 DEBUG:boto:auth_path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.230 DEBUG:boto:Method: GET 2023-12-15T23:13:45.230 DEBUG:boto:Path: /kskgfn-47/?prefix=b 2023-12-15T23:13:45.230 DEBUG:boto:Data: 2023-12-15T23:13:45.230 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.230 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.230 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.230 DEBUG:boto:Params: {} 2023-12-15T23:13:45.230 DEBUG:boto:Token: None 2023-12-15T23:13:45.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006943fa18b6a288cc-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.233 DEBUG:boto:b'kskgfn-47b1000falseb2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.234 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.234 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.234 DEBUG:boto:path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.234 DEBUG:boto:auth_path=/kskgfn-47/?prefix=b 2023-12-15T23:13:45.234 DEBUG:boto:Method: GET 2023-12-15T23:13:45.234 DEBUG:boto:Path: /kskgfn-47/?prefix=b 2023-12-15T23:13:45.234 DEBUG:boto:Data: 2023-12-15T23:13:45.234 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.234 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.234 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.234 DEBUG:boto:Params: {} 2023-12-15T23:13:45.235 DEBUG:boto:Token: None 2023-12-15T23:13:45.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a300cd22875d60c-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.237 DEBUG:boto:b'kskgfn-47b1000falseb2023-12-15T23:11:38.229Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:13:45.238 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.238 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.238 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.238 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.238 DEBUG:boto:Method: GET 2023-12-15T23:13:45.238 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.238 DEBUG:boto:Data: 2023-12-15T23:13:45.239 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.239 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.239 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.239 DEBUG:boto:Params: {} 2023-12-15T23:13:45.239 DEBUG:boto:Token: None 2023-12-15T23:13:45.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ= 2023-12-15T23:13:45.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ=', 'Content-Length': '0'} 2023-12-15T23:13:45.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000778c03f7b482d08e-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.281 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.282 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.282 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.282 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.282 DEBUG:boto:Method: GET 2023-12-15T23:13:45.282 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.282 DEBUG:boto:Data: 2023-12-15T23:13:45.282 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.282 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.282 DEBUG:boto:Params: {} 2023-12-15T23:13:45.282 DEBUG:boto:Token: None 2023-12-15T23:13:45.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ= 2023-12-15T23:13:45.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ=', 'Content-Length': '0'} 2023-12-15T23:13:45.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da60e1ffb3aac47d-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.285 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.285 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.285 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.285 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.285 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.286 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.286 DEBUG:boto:Data: 2023-12-15T23:13:45.286 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.286 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.286 DEBUG:boto:Params: {} 2023-12-15T23:13:45.286 DEBUG:boto:Token: None 2023-12-15T23:13:45.286 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2OeB8WcwBve1SJdsShDvEriTB7I= 2023-12-15T23:13:45.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2OeB8WcwBve1SJdsShDvEriTB7I=', 'Content-Length': '0'} 2023-12-15T23:13:45.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec049a381443006a-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.288 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.288 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.289 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.289 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.289 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.289 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.289 DEBUG:boto:Data: 2023-12-15T23:13:45.289 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.289 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.289 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.289 DEBUG:boto:Params: {} 2023-12-15T23:13:45.289 DEBUG:boto:Token: None 2023-12-15T23:13:45.289 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.290 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2OeB8WcwBve1SJdsShDvEriTB7I= 2023-12-15T23:13:45.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2OeB8WcwBve1SJdsShDvEriTB7I=', 'Content-Length': '0'} 2023-12-15T23:13:45.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d32fc7287edfd62-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.291 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:13:45.291 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.292 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.292 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.292 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.292 DEBUG:boto:Method: GET 2023-12-15T23:13:45.292 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.292 DEBUG:boto:Data: 2023-12-15T23:13:45.292 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.292 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.292 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.292 DEBUG:boto:Params: {} 2023-12-15T23:13:45.292 DEBUG:boto:Token: None 2023-12-15T23:13:45.293 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.293 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ= 2023-12-15T23:13:45.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ=', 'Content-Length': '0'} 2023-12-15T23:13:45.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034fa32d458562890-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.337 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.338 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.338 DEBUG:boto:path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.338 DEBUG:boto:auth_path=/kskgfn-47/c?versionId=null 2023-12-15T23:13:45.338 DEBUG:boto:Method: GET 2023-12-15T23:13:45.338 DEBUG:boto:Path: /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.338 DEBUG:boto:Data: 2023-12-15T23:13:45.338 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.338 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.338 DEBUG:boto:Params: {} 2023-12-15T23:13:45.338 DEBUG:boto:Token: None 2023-12-15T23:13:45.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c?versionId=null 2023-12-15T23:13:45.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ= 2023-12-15T23:13:45.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zT0StfmjgNdxW/NEehXCRJOZYQQ=', 'Content-Length': '0'} 2023-12-15T23:13:45.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea8ab90148c8c000-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.341 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.341 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.341 DEBUG:boto:path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.341 DEBUG:boto:auth_path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.341 DEBUG:boto:Method: GET 2023-12-15T23:13:45.341 DEBUG:boto:Path: /kskgfn-47/?prefix=c 2023-12-15T23:13:45.341 DEBUG:boto:Data: 2023-12-15T23:13:45.341 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.341 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.342 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.342 DEBUG:boto:Params: {} 2023-12-15T23:13:45.342 DEBUG:boto:Token: None 2023-12-15T23:13:45.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e0e5a6b086b860e-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.345 DEBUG:boto:b'kskgfn-47c1000falsec2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.345 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.345 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.345 DEBUG:boto:path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.346 DEBUG:boto:auth_path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.346 DEBUG:boto:Method: GET 2023-12-15T23:13:45.346 DEBUG:boto:Path: /kskgfn-47/?prefix=c 2023-12-15T23:13:45.346 DEBUG:boto:Data: 2023-12-15T23:13:45.346 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.346 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.346 DEBUG:boto:Params: {} 2023-12-15T23:13:45.346 DEBUG:boto:Token: None 2023-12-15T23:13:45.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b29d929c43baed7-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.349 DEBUG:boto:b'kskgfn-47c1000falsec2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.349 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.349 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.349 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.349 DEBUG:boto:Path: /kskgfn-47/c 2023-12-15T23:13:45.349 DEBUG:boto:Data: 2023-12-15T23:13:45.350 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.350 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.350 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.350 DEBUG:boto:Params: {} 2023-12-15T23:13:45.350 DEBUG:boto:Token: None 2023-12-15T23:13:45.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c 2023-12-15T23:13:45.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfYx23JsXcn249bMWrC04hZxPQ4= 2023-12-15T23:13:45.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfYx23JsXcn249bMWrC04hZxPQ4=', 'Content-Length': '0'} 2023-12-15T23:13:45.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dfe7a9c044efe29-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.352 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.352 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.352 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.352 DEBUG:boto:Path: /kskgfn-47/c 2023-12-15T23:13:45.352 DEBUG:boto:Data: 2023-12-15T23:13:45.353 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.353 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.353 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.353 DEBUG:boto:Params: {} 2023-12-15T23:13:45.353 DEBUG:boto:Token: None 2023-12-15T23:13:45.353 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c 2023-12-15T23:13:45.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfYx23JsXcn249bMWrC04hZxPQ4= 2023-12-15T23:13:45.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfYx23JsXcn249bMWrC04hZxPQ4=', 'Content-Length': '0'} 2023-12-15T23:13:45.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056f81d0b1a9665fb-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2023-12-15T23:13:45.355 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.355 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.356 DEBUG:boto:Method: GET 2023-12-15T23:13:45.356 DEBUG:boto:Path: /kskgfn-47/c 2023-12-15T23:13:45.356 DEBUG:boto:Data: 2023-12-15T23:13:45.356 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.356 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.356 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.356 DEBUG:boto:Params: {} 2023-12-15T23:13:45.356 DEBUG:boto:Token: None 2023-12-15T23:13:45.356 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c 2023-12-15T23:13:45.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qhXo4qZZ0kdCEnF3tvSFQufduqU= 2023-12-15T23:13:45.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qhXo4qZZ0kdCEnF3tvSFQufduqU=', 'Content-Length': '0'} 2023-12-15T23:13:45.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038425d2838db6436-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.402 DEBUG:boto:path=/kskgfn-47/c 2023-12-15T23:13:45.402 DEBUG:boto:auth_path=/kskgfn-47/c 2023-12-15T23:13:45.402 DEBUG:boto:Method: GET 2023-12-15T23:13:45.402 DEBUG:boto:Path: /kskgfn-47/c 2023-12-15T23:13:45.402 DEBUG:boto:Data: 2023-12-15T23:13:45.402 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.402 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.402 DEBUG:boto:Params: {} 2023-12-15T23:13:45.403 DEBUG:boto:Token: None 2023-12-15T23:13:45.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/c 2023-12-15T23:13:45.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qhXo4qZZ0kdCEnF3tvSFQufduqU= 2023-12-15T23:13:45.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qhXo4qZZ0kdCEnF3tvSFQufduqU=', 'Content-Length': '0'} 2023-12-15T23:13:45.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ad90b5eb390fec7-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.405 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.405 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.405 DEBUG:boto:path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.406 DEBUG:boto:auth_path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.406 DEBUG:boto:Method: GET 2023-12-15T23:13:45.406 DEBUG:boto:Path: /kskgfn-47/?prefix=c 2023-12-15T23:13:45.406 DEBUG:boto:Data: 2023-12-15T23:13:45.406 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.406 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.406 DEBUG:boto:Params: {} 2023-12-15T23:13:45.406 DEBUG:boto:Token: None 2023-12-15T23:13:45.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9c8e4f80140ea09-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.409 DEBUG:boto:b'kskgfn-47c1000falsec2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.410 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.410 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.410 DEBUG:boto:path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.410 DEBUG:boto:auth_path=/kskgfn-47/?prefix=c 2023-12-15T23:13:45.410 DEBUG:boto:Method: GET 2023-12-15T23:13:45.410 DEBUG:boto:Path: /kskgfn-47/?prefix=c 2023-12-15T23:13:45.410 DEBUG:boto:Data: 2023-12-15T23:13:45.411 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.411 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.411 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.411 DEBUG:boto:Params: {} 2023-12-15T23:13:45.411 DEBUG:boto:Token: None 2023-12-15T23:13:45.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7668d189ddbaf9a-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.413 DEBUG:boto:b'kskgfn-47c1000falsec2023-12-15T23:11:38.276Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:13:45.414 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.414 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.414 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.414 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.414 DEBUG:boto:Method: GET 2023-12-15T23:13:45.414 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.414 DEBUG:boto:Data: 2023-12-15T23:13:45.414 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.415 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.415 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.415 DEBUG:boto:Params: {} 2023-12-15T23:13:45.415 DEBUG:boto:Token: None 2023-12-15T23:13:45.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A= 2023-12-15T23:13:45.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A=', 'Content-Length': '0'} 2023-12-15T23:13:45.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a24f22a2699b9c80-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.457 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.457 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.458 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.458 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.458 DEBUG:boto:Method: GET 2023-12-15T23:13:45.458 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.458 DEBUG:boto:Data: 2023-12-15T23:13:45.458 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.458 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.458 DEBUG:boto:Params: {} 2023-12-15T23:13:45.458 DEBUG:boto:Token: None 2023-12-15T23:13:45.459 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A= 2023-12-15T23:13:45.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A=', 'Content-Length': '0'} 2023-12-15T23:13:45.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3ace423c8bad1d6-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.461 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.461 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.461 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.461 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.461 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.461 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.461 DEBUG:boto:Data: 2023-12-15T23:13:45.462 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.462 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.462 DEBUG:boto:Params: {} 2023-12-15T23:13:45.462 DEBUG:boto:Token: None 2023-12-15T23:13:45.462 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wr9McCp6IfJ/kwSyTcrOpIyXFKo= 2023-12-15T23:13:45.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wr9McCp6IfJ/kwSyTcrOpIyXFKo=', 'Content-Length': '0'} 2023-12-15T23:13:45.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ae15f2598d85d65-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.465 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.465 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.465 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.465 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.465 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.465 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.465 DEBUG:boto:Data: 2023-12-15T23:13:45.465 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.466 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.466 DEBUG:boto:Params: {} 2023-12-15T23:13:45.466 DEBUG:boto:Token: None 2023-12-15T23:13:45.466 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wr9McCp6IfJ/kwSyTcrOpIyXFKo= 2023-12-15T23:13:45.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wr9McCp6IfJ/kwSyTcrOpIyXFKo=', 'Content-Length': '0'} 2023-12-15T23:13:45.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cd3867232f1e43a-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:13:45.468 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.469 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.469 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.469 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.469 DEBUG:boto:Method: GET 2023-12-15T23:13:45.469 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.469 DEBUG:boto:Data: 2023-12-15T23:13:45.469 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.469 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.469 DEBUG:boto:Params: {} 2023-12-15T23:13:45.470 DEBUG:boto:Token: None 2023-12-15T23:13:45.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A= 2023-12-15T23:13:45.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A=', 'Content-Length': '0'} 2023-12-15T23:13:45.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ac52b92424c03f6-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.513 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.514 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.514 DEBUG:boto:path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.514 DEBUG:boto:auth_path=/kskgfn-47/d?versionId=null 2023-12-15T23:13:45.514 DEBUG:boto:Method: GET 2023-12-15T23:13:45.514 DEBUG:boto:Path: /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.514 DEBUG:boto:Data: 2023-12-15T23:13:45.514 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.514 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.514 DEBUG:boto:Params: {} 2023-12-15T23:13:45.515 DEBUG:boto:Token: None 2023-12-15T23:13:45.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d?versionId=null 2023-12-15T23:13:45.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A= 2023-12-15T23:13:45.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3K/Q2e24EGWboQiJ2WOZ6vq+q1A=', 'Content-Length': '0'} 2023-12-15T23:13:45.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e0d87bffc61d428-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.517 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.517 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.517 DEBUG:boto:path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.518 DEBUG:boto:auth_path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.518 DEBUG:boto:Method: GET 2023-12-15T23:13:45.518 DEBUG:boto:Path: /kskgfn-47/?prefix=d 2023-12-15T23:13:45.518 DEBUG:boto:Data: 2023-12-15T23:13:45.518 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.518 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.518 DEBUG:boto:Params: {} 2023-12-15T23:13:45.518 DEBUG:boto:Token: None 2023-12-15T23:13:45.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008579d0b2eb044132-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.521 DEBUG:boto:b'kskgfn-47d1000falsed2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.522 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.522 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.522 DEBUG:boto:path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.522 DEBUG:boto:auth_path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.522 DEBUG:boto:Method: GET 2023-12-15T23:13:45.522 DEBUG:boto:Path: /kskgfn-47/?prefix=d 2023-12-15T23:13:45.522 DEBUG:boto:Data: 2023-12-15T23:13:45.522 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.523 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.523 DEBUG:boto:Params: {} 2023-12-15T23:13:45.523 DEBUG:boto:Token: None 2023-12-15T23:13:45.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.525 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000712ee799b8143b35-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.525 DEBUG:boto:b'kskgfn-47d1000falsed2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.526 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.526 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.526 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.526 DEBUG:boto:Path: /kskgfn-47/d 2023-12-15T23:13:45.526 DEBUG:boto:Data: 2023-12-15T23:13:45.526 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.526 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.526 DEBUG:boto:Params: {} 2023-12-15T23:13:45.526 DEBUG:boto:Token: None 2023-12-15T23:13:45.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d 2023-12-15T23:13:45.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:knejit2Ty2jOySPYOtNsX3rTJzk= 2023-12-15T23:13:45.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:knejit2Ty2jOySPYOtNsX3rTJzk=', 'Content-Length': '0'} 2023-12-15T23:13:45.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004aa43f7b9ff7df5b-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.529 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.529 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.529 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.529 DEBUG:boto:Path: /kskgfn-47/d 2023-12-15T23:13:45.529 DEBUG:boto:Data: 2023-12-15T23:13:45.529 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.529 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.529 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.530 DEBUG:boto:Params: {} 2023-12-15T23:13:45.530 DEBUG:boto:Token: None 2023-12-15T23:13:45.530 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d 2023-12-15T23:13:45.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:knejit2Ty2jOySPYOtNsX3rTJzk= 2023-12-15T23:13:45.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:knejit2Ty2jOySPYOtNsX3rTJzk=', 'Content-Length': '0'} 2023-12-15T23:13:45.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029bfb905ad19fa35-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2023-12-15T23:13:45.532 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.532 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.532 DEBUG:boto:Method: GET 2023-12-15T23:13:45.532 DEBUG:boto:Path: /kskgfn-47/d 2023-12-15T23:13:45.532 DEBUG:boto:Data: 2023-12-15T23:13:45.533 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.533 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.533 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.533 DEBUG:boto:Params: {} 2023-12-15T23:13:45.533 DEBUG:boto:Token: None 2023-12-15T23:13:45.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d 2023-12-15T23:13:45.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FPgffSsEsTOP15W/9+CVd5CsX9A= 2023-12-15T23:13:45.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FPgffSsEsTOP15W/9+CVd5CsX9A=', 'Content-Length': '0'} 2023-12-15T23:13:45.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a01143ee1ac31e2c-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.577 DEBUG:boto:path=/kskgfn-47/d 2023-12-15T23:13:45.578 DEBUG:boto:auth_path=/kskgfn-47/d 2023-12-15T23:13:45.578 DEBUG:boto:Method: GET 2023-12-15T23:13:45.578 DEBUG:boto:Path: /kskgfn-47/d 2023-12-15T23:13:45.578 DEBUG:boto:Data: 2023-12-15T23:13:45.578 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.578 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.578 DEBUG:boto:Params: {} 2023-12-15T23:13:45.578 DEBUG:boto:Token: None 2023-12-15T23:13:45.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/d 2023-12-15T23:13:45.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FPgffSsEsTOP15W/9+CVd5CsX9A= 2023-12-15T23:13:45.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FPgffSsEsTOP15W/9+CVd5CsX9A=', 'Content-Length': '0'} 2023-12-15T23:13:45.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e26e7281f88ebc9-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.581 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.581 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.581 DEBUG:boto:path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.581 DEBUG:boto:auth_path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.581 DEBUG:boto:Method: GET 2023-12-15T23:13:45.581 DEBUG:boto:Path: /kskgfn-47/?prefix=d 2023-12-15T23:13:45.581 DEBUG:boto:Data: 2023-12-15T23:13:45.581 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.582 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.582 DEBUG:boto:Params: {} 2023-12-15T23:13:45.582 DEBUG:boto:Token: None 2023-12-15T23:13:45.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3f510126c13e938-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.585 DEBUG:boto:b'kskgfn-47d1000falsed2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.585 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.585 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.585 DEBUG:boto:path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.585 DEBUG:boto:auth_path=/kskgfn-47/?prefix=d 2023-12-15T23:13:45.585 DEBUG:boto:Method: GET 2023-12-15T23:13:45.586 DEBUG:boto:Path: /kskgfn-47/?prefix=d 2023-12-15T23:13:45.586 DEBUG:boto:Data: 2023-12-15T23:13:45.586 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.586 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.586 DEBUG:boto:Params: {} 2023-12-15T23:13:45.586 DEBUG:boto:Token: None 2023-12-15T23:13:45.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007eb43687d8012585-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.588 DEBUG:boto:b'kskgfn-47d1000falsed2023-12-15T23:11:38.287Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:13:45.589 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.589 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.589 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.589 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.589 DEBUG:boto:Method: GET 2023-12-15T23:13:45.589 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.589 DEBUG:boto:Data: 2023-12-15T23:13:45.589 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.590 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.590 DEBUG:boto:Params: {} 2023-12-15T23:13:45.590 DEBUG:boto:Token: None 2023-12-15T23:13:45.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI= 2023-12-15T23:13:45.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI=', 'Content-Length': '0'} 2023-12-15T23:13:45.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007033a3835b9b49d8-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.633 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.634 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.634 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.634 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.634 DEBUG:boto:Method: GET 2023-12-15T23:13:45.634 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.634 DEBUG:boto:Data: 2023-12-15T23:13:45.634 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.634 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.634 DEBUG:boto:Params: {} 2023-12-15T23:13:45.634 DEBUG:boto:Token: None 2023-12-15T23:13:45.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI= 2023-12-15T23:13:45.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI=', 'Content-Length': '0'} 2023-12-15T23:13:45.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084941c4f1d4eef5e-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.637 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.637 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.637 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.637 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.637 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.637 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.637 DEBUG:boto:Data: 2023-12-15T23:13:45.637 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.638 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.638 DEBUG:boto:Params: {} 2023-12-15T23:13:45.638 DEBUG:boto:Token: None 2023-12-15T23:13:45.638 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iREp2Oe48dREM/0vU5FpvLSuHj0= 2023-12-15T23:13:45.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iREp2Oe48dREM/0vU5FpvLSuHj0=', 'Content-Length': '0'} 2023-12-15T23:13:45.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086a074b3061baa60-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.640 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.640 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.640 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.640 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.640 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.640 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.641 DEBUG:boto:Data: 2023-12-15T23:13:45.641 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.641 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.641 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.641 DEBUG:boto:Params: {} 2023-12-15T23:13:45.641 DEBUG:boto:Token: None 2023-12-15T23:13:45.641 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.641 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iREp2Oe48dREM/0vU5FpvLSuHj0= 2023-12-15T23:13:45.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iREp2Oe48dREM/0vU5FpvLSuHj0=', 'Content-Length': '0'} 2023-12-15T23:13:45.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1b4d17bc57a79d9-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:13:45.644 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.644 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.644 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.644 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.644 DEBUG:boto:Method: GET 2023-12-15T23:13:45.644 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.644 DEBUG:boto:Data: 2023-12-15T23:13:45.644 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.644 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.644 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.644 DEBUG:boto:Params: {} 2023-12-15T23:13:45.644 DEBUG:boto:Token: None 2023-12-15T23:13:45.645 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.645 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI= 2023-12-15T23:13:45.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI=', 'Content-Length': '0'} 2023-12-15T23:13:45.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce4e6ac643519356-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.689 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.690 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.690 DEBUG:boto:path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.690 DEBUG:boto:auth_path=/kskgfn-47/e?versionId=null 2023-12-15T23:13:45.690 DEBUG:boto:Method: GET 2023-12-15T23:13:45.690 DEBUG:boto:Path: /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.690 DEBUG:boto:Data: 2023-12-15T23:13:45.690 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.690 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.690 DEBUG:boto:Params: {} 2023-12-15T23:13:45.690 DEBUG:boto:Token: None 2023-12-15T23:13:45.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e?versionId=null 2023-12-15T23:13:45.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI= 2023-12-15T23:13:45.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5qsxToivjSEoDnLLx3uqZO3HPI=', 'Content-Length': '0'} 2023-12-15T23:13:45.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a4c1a20cb5f2fa2-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.693 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.693 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.693 DEBUG:boto:path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.693 DEBUG:boto:auth_path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.693 DEBUG:boto:Method: GET 2023-12-15T23:13:45.693 DEBUG:boto:Path: /kskgfn-47/?prefix=e 2023-12-15T23:13:45.693 DEBUG:boto:Data: 2023-12-15T23:13:45.694 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.694 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.694 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.694 DEBUG:boto:Params: {} 2023-12-15T23:13:45.694 DEBUG:boto:Token: None 2023-12-15T23:13:45.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a720fe10318e593e-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.737 DEBUG:boto:b'kskgfn-47e1000falsee2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.738 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.738 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.738 DEBUG:boto:path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.738 DEBUG:boto:auth_path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.738 DEBUG:boto:Method: GET 2023-12-15T23:13:45.738 DEBUG:boto:Path: /kskgfn-47/?prefix=e 2023-12-15T23:13:45.738 DEBUG:boto:Data: 2023-12-15T23:13:45.738 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.739 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.739 DEBUG:boto:Params: {} 2023-12-15T23:13:45.739 DEBUG:boto:Token: None 2023-12-15T23:13:45.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092afd69161a2dc90-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.741 DEBUG:boto:b'kskgfn-47e1000falsee2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.742 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.742 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.742 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.742 DEBUG:boto:Path: /kskgfn-47/e 2023-12-15T23:13:45.742 DEBUG:boto:Data: 2023-12-15T23:13:45.742 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.742 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.742 DEBUG:boto:Params: {} 2023-12-15T23:13:45.743 DEBUG:boto:Token: None 2023-12-15T23:13:45.743 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e 2023-12-15T23:13:45.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HX2/NXSbzHvxAvDn+k7Xpps3cXk= 2023-12-15T23:13:45.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HX2/NXSbzHvxAvDn+k7Xpps3cXk=', 'Content-Length': '0'} 2023-12-15T23:13:45.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b0d109701467b3b-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.745 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.745 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.745 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.745 DEBUG:boto:Path: /kskgfn-47/e 2023-12-15T23:13:45.745 DEBUG:boto:Data: 2023-12-15T23:13:45.746 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.746 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.746 DEBUG:boto:Params: {} 2023-12-15T23:13:45.746 DEBUG:boto:Token: None 2023-12-15T23:13:45.746 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e 2023-12-15T23:13:45.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HX2/NXSbzHvxAvDn+k7Xpps3cXk= 2023-12-15T23:13:45.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HX2/NXSbzHvxAvDn+k7Xpps3cXk=', 'Content-Length': '0'} 2023-12-15T23:13:45.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008461f02062321c94-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2023-12-15T23:13:45.748 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.748 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.748 DEBUG:boto:Method: GET 2023-12-15T23:13:45.749 DEBUG:boto:Path: /kskgfn-47/e 2023-12-15T23:13:45.749 DEBUG:boto:Data: 2023-12-15T23:13:45.749 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.749 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.749 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.749 DEBUG:boto:Params: {} 2023-12-15T23:13:45.749 DEBUG:boto:Token: None 2023-12-15T23:13:45.749 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e 2023-12-15T23:13:45.749 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n0eKPFCoQ6LFQen2NWl7GKegWSA= 2023-12-15T23:13:45.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n0eKPFCoQ6LFQen2NWl7GKegWSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c052095f9285e9dd-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.794 DEBUG:boto:path=/kskgfn-47/e 2023-12-15T23:13:45.794 DEBUG:boto:auth_path=/kskgfn-47/e 2023-12-15T23:13:45.794 DEBUG:boto:Method: GET 2023-12-15T23:13:45.794 DEBUG:boto:Path: /kskgfn-47/e 2023-12-15T23:13:45.794 DEBUG:boto:Data: 2023-12-15T23:13:45.794 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.794 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.794 DEBUG:boto:Params: {} 2023-12-15T23:13:45.794 DEBUG:boto:Token: None 2023-12-15T23:13:45.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/e 2023-12-15T23:13:45.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n0eKPFCoQ6LFQen2NWl7GKegWSA= 2023-12-15T23:13:45.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n0eKPFCoQ6LFQen2NWl7GKegWSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000049e3bac4e468a1a-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.797 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.797 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.797 DEBUG:boto:path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.797 DEBUG:boto:auth_path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.797 DEBUG:boto:Method: GET 2023-12-15T23:13:45.797 DEBUG:boto:Path: /kskgfn-47/?prefix=e 2023-12-15T23:13:45.797 DEBUG:boto:Data: 2023-12-15T23:13:45.797 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.797 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.798 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.798 DEBUG:boto:Params: {} 2023-12-15T23:13:45.798 DEBUG:boto:Token: None 2023-12-15T23:13:45.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.801 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000547600204c2e0820-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.801 DEBUG:boto:b'kskgfn-47e1000falsee2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.801 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.801 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.801 DEBUG:boto:path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.801 DEBUG:boto:auth_path=/kskgfn-47/?prefix=e 2023-12-15T23:13:45.802 DEBUG:boto:Method: GET 2023-12-15T23:13:45.802 DEBUG:boto:Path: /kskgfn-47/?prefix=e 2023-12-15T23:13:45.802 DEBUG:boto:Data: 2023-12-15T23:13:45.802 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.802 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.802 DEBUG:boto:Params: {} 2023-12-15T23:13:45.802 DEBUG:boto:Token: None 2023-12-15T23:13:45.802 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6c6f50904ea2e74-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.804 DEBUG:boto:b'kskgfn-47e1000falsee2023-12-15T23:11:38.449Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.805 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:13:45.805 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.805 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.805 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.805 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.805 DEBUG:boto:Method: GET 2023-12-15T23:13:45.805 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.805 DEBUG:boto:Data: 2023-12-15T23:13:45.805 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.806 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.806 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.806 DEBUG:boto:Params: {} 2023-12-15T23:13:45.806 DEBUG:boto:Token: None 2023-12-15T23:13:45.806 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.806 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU= 2023-12-15T23:13:45.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU=', 'Content-Length': '0'} 2023-12-15T23:13:45.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000322c86b6c9cf4ca9-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.849 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.850 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.850 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.850 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.850 DEBUG:boto:Method: GET 2023-12-15T23:13:45.850 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.850 DEBUG:boto:Data: 2023-12-15T23:13:45.850 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.850 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.850 DEBUG:boto:Params: {} 2023-12-15T23:13:45.850 DEBUG:boto:Token: None 2023-12-15T23:13:45.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU= 2023-12-15T23:13:45.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU=', 'Content-Length': '0'} 2023-12-15T23:13:45.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf3ef73500b665ad-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.853 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.853 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.853 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.853 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.853 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.853 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.853 DEBUG:boto:Data: 2023-12-15T23:13:45.854 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.854 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.854 DEBUG:boto:Params: {} 2023-12-15T23:13:45.854 DEBUG:boto:Token: None 2023-12-15T23:13:45.854 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NIwkVmfXjoFxAykaGZkY5qMqb/4= 2023-12-15T23:13:45.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NIwkVmfXjoFxAykaGZkY5qMqb/4=', 'Content-Length': '0'} 2023-12-15T23:13:45.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076722f11ab1992f1-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.857 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.857 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.857 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.857 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.857 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.857 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.857 DEBUG:boto:Data: 2023-12-15T23:13:45.857 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.857 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.857 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.857 DEBUG:boto:Params: {} 2023-12-15T23:13:45.858 DEBUG:boto:Token: None 2023-12-15T23:13:45.858 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.858 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NIwkVmfXjoFxAykaGZkY5qMqb/4= 2023-12-15T23:13:45.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NIwkVmfXjoFxAykaGZkY5qMqb/4=', 'Content-Length': '0'} 2023-12-15T23:13:45.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048152790a95db1cd-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:13:45.860 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.860 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.860 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.860 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.860 DEBUG:boto:Method: GET 2023-12-15T23:13:45.861 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.861 DEBUG:boto:Data: 2023-12-15T23:13:45.861 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.861 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.861 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.861 DEBUG:boto:Params: {} 2023-12-15T23:13:45.861 DEBUG:boto:Token: None 2023-12-15T23:13:45.861 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU= 2023-12-15T23:13:45.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU=', 'Content-Length': '0'} 2023-12-15T23:13:45.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040e3dbc1db52d396-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.905 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.906 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.906 DEBUG:boto:path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.906 DEBUG:boto:auth_path=/kskgfn-47/f?versionId=null 2023-12-15T23:13:45.906 DEBUG:boto:Method: GET 2023-12-15T23:13:45.906 DEBUG:boto:Path: /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.906 DEBUG:boto:Data: 2023-12-15T23:13:45.906 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.906 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.906 DEBUG:boto:Params: {} 2023-12-15T23:13:45.906 DEBUG:boto:Token: None 2023-12-15T23:13:45.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f?versionId=null 2023-12-15T23:13:45.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU= 2023-12-15T23:13:45.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T7jTmWp0aith3lzJTI/Yrq629UU=', 'Content-Length': '0'} 2023-12-15T23:13:45.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b90cca498938e0bf-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.909 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.909 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.909 DEBUG:boto:path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.909 DEBUG:boto:auth_path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.909 DEBUG:boto:Method: GET 2023-12-15T23:13:45.910 DEBUG:boto:Path: /kskgfn-47/?prefix=f 2023-12-15T23:13:45.910 DEBUG:boto:Data: 2023-12-15T23:13:45.910 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.910 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.910 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.910 DEBUG:boto:Params: {} 2023-12-15T23:13:45.910 DEBUG:boto:Token: None 2023-12-15T23:13:45.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b5ac09938cb4b1d-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.913 DEBUG:boto:b'kskgfn-47f1000falsef2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.913 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.913 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.913 DEBUG:boto:path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.913 DEBUG:boto:auth_path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.914 DEBUG:boto:Method: GET 2023-12-15T23:13:45.914 DEBUG:boto:Path: /kskgfn-47/?prefix=f 2023-12-15T23:13:45.914 DEBUG:boto:Data: 2023-12-15T23:13:45.914 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.914 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.914 DEBUG:boto:Params: {} 2023-12-15T23:13:45.914 DEBUG:boto:Token: None 2023-12-15T23:13:45.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eabb4eb7337028ce-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.917 DEBUG:boto:b'kskgfn-47f1000falsef2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.917 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.917 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.917 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.917 DEBUG:boto:Path: /kskgfn-47/f 2023-12-15T23:13:45.918 DEBUG:boto:Data: 2023-12-15T23:13:45.918 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.918 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.918 DEBUG:boto:Params: {} 2023-12-15T23:13:45.918 DEBUG:boto:Token: None 2023-12-15T23:13:45.918 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f 2023-12-15T23:13:45.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37://jMI3bh3Ms9WByEaVcFm54v2FM= 2023-12-15T23:13:45.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37://jMI3bh3Ms9WByEaVcFm54v2FM=', 'Content-Length': '0'} 2023-12-15T23:13:45.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbd8a68a29dcd800-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.921 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.921 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.921 DEBUG:boto:Method: HEAD 2023-12-15T23:13:45.921 DEBUG:boto:Path: /kskgfn-47/f 2023-12-15T23:13:45.921 DEBUG:boto:Data: 2023-12-15T23:13:45.921 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.921 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.921 DEBUG:boto:Params: {} 2023-12-15T23:13:45.921 DEBUG:boto:Token: None 2023-12-15T23:13:45.922 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f 2023-12-15T23:13:45.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37://jMI3bh3Ms9WByEaVcFm54v2FM= 2023-12-15T23:13:45.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37://jMI3bh3Ms9WByEaVcFm54v2FM=', 'Content-Length': '0'} 2023-12-15T23:13:45.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cafb8bdde54c68de-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2023-12-15T23:13:45.924 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.925 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.925 DEBUG:boto:Method: GET 2023-12-15T23:13:45.925 DEBUG:boto:Path: /kskgfn-47/f 2023-12-15T23:13:45.925 DEBUG:boto:Data: 2023-12-15T23:13:45.925 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.925 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.925 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.925 DEBUG:boto:Params: {} 2023-12-15T23:13:45.925 DEBUG:boto:Token: None 2023-12-15T23:13:45.925 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f 2023-12-15T23:13:45.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5UWCI55E7V3BMIQcfz3Jx3ydJIs= 2023-12-15T23:13:45.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5UWCI55E7V3BMIQcfz3Jx3ydJIs=', 'Content-Length': '0'} 2023-12-15T23:13:45.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2b16c45b1b44531-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.969 DEBUG:boto:path=/kskgfn-47/f 2023-12-15T23:13:45.970 DEBUG:boto:auth_path=/kskgfn-47/f 2023-12-15T23:13:45.970 DEBUG:boto:Method: GET 2023-12-15T23:13:45.970 DEBUG:boto:Path: /kskgfn-47/f 2023-12-15T23:13:45.970 DEBUG:boto:Data: 2023-12-15T23:13:45.970 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.970 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.970 DEBUG:boto:Params: {} 2023-12-15T23:13:45.970 DEBUG:boto:Token: None 2023-12-15T23:13:45.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/f 2023-12-15T23:13:45.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5UWCI55E7V3BMIQcfz3Jx3ydJIs= 2023-12-15T23:13:45.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5UWCI55E7V3BMIQcfz3Jx3ydJIs=', 'Content-Length': '0'} 2023-12-15T23:13:45.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047d5323edc57d1d7-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.973 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.973 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.973 DEBUG:boto:path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.973 DEBUG:boto:auth_path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.973 DEBUG:boto:Method: GET 2023-12-15T23:13:45.973 DEBUG:boto:Path: /kskgfn-47/?prefix=f 2023-12-15T23:13:45.973 DEBUG:boto:Data: 2023-12-15T23:13:45.974 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.974 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.974 DEBUG:boto:Params: {} 2023-12-15T23:13:45.974 DEBUG:boto:Token: None 2023-12-15T23:13:45.974 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.976 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e08090b5af3a6d61-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.977 DEBUG:boto:b'kskgfn-47f1000falsef2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.977 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:45.977 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:45.977 DEBUG:boto:path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.977 DEBUG:boto:auth_path=/kskgfn-47/?prefix=f 2023-12-15T23:13:45.977 DEBUG:boto:Method: GET 2023-12-15T23:13:45.977 DEBUG:boto:Path: /kskgfn-47/?prefix=f 2023-12-15T23:13:45.977 DEBUG:boto:Data: 2023-12-15T23:13:45.977 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:45.978 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.978 DEBUG:boto:Params: {} 2023-12-15T23:13:45.978 DEBUG:boto:Token: None 2023-12-15T23:13:45.978 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/ 2023-12-15T23:13:45.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA= 2023-12-15T23:13:45.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HpRvHGzVum/l9SquHLdOrwbiSA=', 'Content-Length': '0'} 2023-12-15T23:13:45.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b2371191b1f2bc5-00657cdda9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:45.980 DEBUG:boto:b'kskgfn-47f1000falsef2023-12-15T23:11:38.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:45.980 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:13:45.980 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:45.980 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:45.981 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:45.981 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:45.981 DEBUG:boto:Method: GET 2023-12-15T23:13:45.981 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:45.981 DEBUG:boto:Data: 2023-12-15T23:13:45.981 DEBUG:boto:Headers: {} 2023-12-15T23:13:45.981 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:45.981 DEBUG:boto:Port: 8000 2023-12-15T23:13:45.981 DEBUG:boto:Params: {} 2023-12-15T23:13:45.981 DEBUG:boto:Token: None 2023-12-15T23:13:45.981 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:45 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:45.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:234+w2HTGOzL6+d8ZzFqBDvyk+8= 2023-12-15T23:13:45.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:234+w2HTGOzL6+d8ZzFqBDvyk+8=', 'Content-Length': '0'} 2023-12-15T23:13:45.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055926df02a973764-00657cdda9-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.025 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.026 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.026 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.026 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.026 DEBUG:boto:Method: GET 2023-12-15T23:13:46.026 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.026 DEBUG:boto:Data: 2023-12-15T23:13:46.026 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.026 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.026 DEBUG:boto:Params: {} 2023-12-15T23:13:46.027 DEBUG:boto:Token: None 2023-12-15T23:13:46.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns= 2023-12-15T23:13:46.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns=', 'Content-Length': '0'} 2023-12-15T23:13:46.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba5f1bf70ad046c1-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.029 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.029 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.029 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.030 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.030 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.030 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.030 DEBUG:boto:Data: 2023-12-15T23:13:46.030 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.030 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.030 DEBUG:boto:Params: {} 2023-12-15T23:13:46.030 DEBUG:boto:Token: None 2023-12-15T23:13:46.030 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6LAg5bNCifjf9G4zWervvMf1eAA= 2023-12-15T23:13:46.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6LAg5bNCifjf9G4zWervvMf1eAA=', 'Content-Length': '0'} 2023-12-15T23:13:46.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b47e1205afad0e10-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.033 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.033 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.033 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.033 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.033 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.033 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.033 DEBUG:boto:Data: 2023-12-15T23:13:46.034 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.034 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.034 DEBUG:boto:Params: {} 2023-12-15T23:13:46.034 DEBUG:boto:Token: None 2023-12-15T23:13:46.034 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6LAg5bNCifjf9G4zWervvMf1eAA= 2023-12-15T23:13:46.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6LAg5bNCifjf9G4zWervvMf1eAA=', 'Content-Length': '0'} 2023-12-15T23:13:46.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003201a56bcc20cbcf-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:13:46.036 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.036 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.037 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.037 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.037 DEBUG:boto:Method: GET 2023-12-15T23:13:46.037 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.037 DEBUG:boto:Data: 2023-12-15T23:13:46.037 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.037 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.037 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.037 DEBUG:boto:Params: {} 2023-12-15T23:13:46.037 DEBUG:boto:Token: None 2023-12-15T23:13:46.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns= 2023-12-15T23:13:46.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns=', 'Content-Length': '0'} 2023-12-15T23:13:46.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097d4e1a953055ec7-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.081 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.082 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.082 DEBUG:boto:path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.082 DEBUG:boto:auth_path=/kskgfn-47/g?versionId=null 2023-12-15T23:13:46.082 DEBUG:boto:Method: GET 2023-12-15T23:13:46.082 DEBUG:boto:Path: /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.082 DEBUG:boto:Data: 2023-12-15T23:13:46.082 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.082 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.082 DEBUG:boto:Params: {} 2023-12-15T23:13:46.083 DEBUG:boto:Token: None 2023-12-15T23:13:46.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g?versionId=null 2023-12-15T23:13:46.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns= 2023-12-15T23:13:46.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fRB5I+rteT3oMt5y9gyqdZIemns=', 'Content-Length': '0'} 2023-12-15T23:13:46.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005e0e54ac857aeb6-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.085 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.085 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.085 DEBUG:boto:path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.085 DEBUG:boto:auth_path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.086 DEBUG:boto:Method: GET 2023-12-15T23:13:46.086 DEBUG:boto:Path: /kskgfn-47/?prefix=g 2023-12-15T23:13:46.086 DEBUG:boto:Data: 2023-12-15T23:13:46.086 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.086 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.086 DEBUG:boto:Params: {} 2023-12-15T23:13:46.086 DEBUG:boto:Token: None 2023-12-15T23:13:46.086 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a457a7aa5c252ae6-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.089 DEBUG:boto:b'kskgfn-47g1000falseg2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.090 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.090 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.090 DEBUG:boto:path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.090 DEBUG:boto:auth_path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.090 DEBUG:boto:Method: GET 2023-12-15T23:13:46.090 DEBUG:boto:Path: /kskgfn-47/?prefix=g 2023-12-15T23:13:46.090 DEBUG:boto:Data: 2023-12-15T23:13:46.090 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.090 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.091 DEBUG:boto:Params: {} 2023-12-15T23:13:46.091 DEBUG:boto:Token: None 2023-12-15T23:13:46.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043d56d62d2ac5225-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.093 DEBUG:boto:b'kskgfn-47g1000falseg2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.093 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.094 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.094 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.094 DEBUG:boto:Path: /kskgfn-47/g 2023-12-15T23:13:46.094 DEBUG:boto:Data: 2023-12-15T23:13:46.094 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.094 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.094 DEBUG:boto:Params: {} 2023-12-15T23:13:46.094 DEBUG:boto:Token: None 2023-12-15T23:13:46.094 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g 2023-12-15T23:13:46.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nxTrj4FqEckresLJ7hYlUYBvG+w= 2023-12-15T23:13:46.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nxTrj4FqEckresLJ7hYlUYBvG+w=', 'Content-Length': '0'} 2023-12-15T23:13:46.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074f25e325444d24c-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.097 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.097 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.097 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.097 DEBUG:boto:Path: /kskgfn-47/g 2023-12-15T23:13:46.097 DEBUG:boto:Data: 2023-12-15T23:13:46.097 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.097 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.097 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.097 DEBUG:boto:Params: {} 2023-12-15T23:13:46.098 DEBUG:boto:Token: None 2023-12-15T23:13:46.098 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g 2023-12-15T23:13:46.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nxTrj4FqEckresLJ7hYlUYBvG+w= 2023-12-15T23:13:46.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nxTrj4FqEckresLJ7hYlUYBvG+w=', 'Content-Length': '0'} 2023-12-15T23:13:46.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bca7e30271db6dd-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2023-12-15T23:13:46.100 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.100 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.100 DEBUG:boto:Method: GET 2023-12-15T23:13:46.100 DEBUG:boto:Path: /kskgfn-47/g 2023-12-15T23:13:46.100 DEBUG:boto:Data: 2023-12-15T23:13:46.100 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.100 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.100 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.101 DEBUG:boto:Params: {} 2023-12-15T23:13:46.101 DEBUG:boto:Token: None 2023-12-15T23:13:46.101 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g 2023-12-15T23:13:46.101 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PcbEudBBxZBdGQdqFGgOQ1gmYes= 2023-12-15T23:13:46.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PcbEudBBxZBdGQdqFGgOQ1gmYes=', 'Content-Length': '0'} 2023-12-15T23:13:46.103 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f7f9ae7272801d9-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.149 DEBUG:boto:path=/kskgfn-47/g 2023-12-15T23:13:46.149 DEBUG:boto:auth_path=/kskgfn-47/g 2023-12-15T23:13:46.150 DEBUG:boto:Method: GET 2023-12-15T23:13:46.150 DEBUG:boto:Path: /kskgfn-47/g 2023-12-15T23:13:46.150 DEBUG:boto:Data: 2023-12-15T23:13:46.150 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.150 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.150 DEBUG:boto:Params: {} 2023-12-15T23:13:46.150 DEBUG:boto:Token: None 2023-12-15T23:13:46.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/g 2023-12-15T23:13:46.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PcbEudBBxZBdGQdqFGgOQ1gmYes= 2023-12-15T23:13:46.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PcbEudBBxZBdGQdqFGgOQ1gmYes=', 'Content-Length': '0'} 2023-12-15T23:13:46.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e5c99d9898122f0-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.152 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.153 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.153 DEBUG:boto:path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.153 DEBUG:boto:auth_path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.153 DEBUG:boto:Method: GET 2023-12-15T23:13:46.153 DEBUG:boto:Path: /kskgfn-47/?prefix=g 2023-12-15T23:13:46.153 DEBUG:boto:Data: 2023-12-15T23:13:46.153 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.153 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.153 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.153 DEBUG:boto:Params: {} 2023-12-15T23:13:46.154 DEBUG:boto:Token: None 2023-12-15T23:13:46.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000092c3231c47621dd-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.157 DEBUG:boto:b'kskgfn-47g1000falseg2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.157 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.157 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.157 DEBUG:boto:path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.157 DEBUG:boto:auth_path=/kskgfn-47/?prefix=g 2023-12-15T23:13:46.158 DEBUG:boto:Method: GET 2023-12-15T23:13:46.158 DEBUG:boto:Path: /kskgfn-47/?prefix=g 2023-12-15T23:13:46.158 DEBUG:boto:Data: 2023-12-15T23:13:46.158 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.158 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.158 DEBUG:boto:Params: {} 2023-12-15T23:13:46.158 DEBUG:boto:Token: None 2023-12-15T23:13:46.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d616ae21fdad27ea-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.161 DEBUG:boto:b'kskgfn-47g1000falseg2023-12-15T23:11:38.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:13:46.161 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.161 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.161 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.162 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.162 DEBUG:boto:Method: GET 2023-12-15T23:13:46.162 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.162 DEBUG:boto:Data: 2023-12-15T23:13:46.162 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.162 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.162 DEBUG:boto:Params: {} 2023-12-15T23:13:46.162 DEBUG:boto:Token: None 2023-12-15T23:13:46.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw= 2023-12-15T23:13:46.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw=', 'Content-Length': '0'} 2023-12-15T23:13:46.164 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004249fb1204de13cb-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.205 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.206 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.206 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.206 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.206 DEBUG:boto:Method: GET 2023-12-15T23:13:46.206 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.206 DEBUG:boto:Data: 2023-12-15T23:13:46.206 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.206 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.206 DEBUG:boto:Params: {} 2023-12-15T23:13:46.207 DEBUG:boto:Token: None 2023-12-15T23:13:46.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw= 2023-12-15T23:13:46.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw=', 'Content-Length': '0'} 2023-12-15T23:13:46.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a298c7332e3cb80-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.209 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.209 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.209 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.210 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.210 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.210 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.210 DEBUG:boto:Data: 2023-12-15T23:13:46.210 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.210 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.210 DEBUG:boto:Params: {} 2023-12-15T23:13:46.210 DEBUG:boto:Token: None 2023-12-15T23:13:46.210 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GvVH7QOar69B+tlE2OC8vFEpr9s= 2023-12-15T23:13:46.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GvVH7QOar69B+tlE2OC8vFEpr9s=', 'Content-Length': '0'} 2023-12-15T23:13:46.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a20ed7ec70cae1a-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.213 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.213 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.213 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.213 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.213 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.213 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.213 DEBUG:boto:Data: 2023-12-15T23:13:46.213 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.213 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.213 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.214 DEBUG:boto:Params: {} 2023-12-15T23:13:46.214 DEBUG:boto:Token: None 2023-12-15T23:13:46.214 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GvVH7QOar69B+tlE2OC8vFEpr9s= 2023-12-15T23:13:46.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GvVH7QOar69B+tlE2OC8vFEpr9s=', 'Content-Length': '0'} 2023-12-15T23:13:46.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a590f6f90a6de2e-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:13:46.216 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.216 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.216 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.216 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.216 DEBUG:boto:Method: GET 2023-12-15T23:13:46.216 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.216 DEBUG:boto:Data: 2023-12-15T23:13:46.217 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.217 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.217 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.217 DEBUG:boto:Params: {} 2023-12-15T23:13:46.217 DEBUG:boto:Token: None 2023-12-15T23:13:46.217 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.217 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw= 2023-12-15T23:13:46.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw=', 'Content-Length': '0'} 2023-12-15T23:13:46.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051af8128ebd4ab3c-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.261 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.262 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.262 DEBUG:boto:path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.262 DEBUG:boto:auth_path=/kskgfn-47/h?versionId=null 2023-12-15T23:13:46.262 DEBUG:boto:Method: GET 2023-12-15T23:13:46.262 DEBUG:boto:Path: /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.262 DEBUG:boto:Data: 2023-12-15T23:13:46.262 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.262 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.262 DEBUG:boto:Params: {} 2023-12-15T23:13:46.262 DEBUG:boto:Token: None 2023-12-15T23:13:46.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h?versionId=null 2023-12-15T23:13:46.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw= 2023-12-15T23:13:46.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P+n0kqYWsu6vSC8gP54LSNn6byw=', 'Content-Length': '0'} 2023-12-15T23:13:46.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7650a14175fdeac-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.265 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.265 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.265 DEBUG:boto:path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.265 DEBUG:boto:auth_path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.265 DEBUG:boto:Method: GET 2023-12-15T23:13:46.265 DEBUG:boto:Path: /kskgfn-47/?prefix=h 2023-12-15T23:13:46.266 DEBUG:boto:Data: 2023-12-15T23:13:46.266 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.266 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.266 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.266 DEBUG:boto:Params: {} 2023-12-15T23:13:46.266 DEBUG:boto:Token: None 2023-12-15T23:13:46.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002951e82d5b7d1355-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.269 DEBUG:boto:b'kskgfn-47h1000falseh2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.270 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.270 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.270 DEBUG:boto:path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.270 DEBUG:boto:auth_path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.270 DEBUG:boto:Method: GET 2023-12-15T23:13:46.270 DEBUG:boto:Path: /kskgfn-47/?prefix=h 2023-12-15T23:13:46.270 DEBUG:boto:Data: 2023-12-15T23:13:46.270 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.271 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.271 DEBUG:boto:Params: {} 2023-12-15T23:13:46.271 DEBUG:boto:Token: None 2023-12-15T23:13:46.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab3684a4e3a58381-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.273 DEBUG:boto:b'kskgfn-47h1000falseh2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.273 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.274 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.274 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.274 DEBUG:boto:Path: /kskgfn-47/h 2023-12-15T23:13:46.274 DEBUG:boto:Data: 2023-12-15T23:13:46.274 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.274 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.274 DEBUG:boto:Params: {} 2023-12-15T23:13:46.274 DEBUG:boto:Token: None 2023-12-15T23:13:46.274 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h 2023-12-15T23:13:46.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0SyCWJ/bxjFFlAWpCNesqMOazYU= 2023-12-15T23:13:46.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0SyCWJ/bxjFFlAWpCNesqMOazYU=', 'Content-Length': '0'} 2023-12-15T23:13:46.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bfa7d20a4722804-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.277 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.277 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.277 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.277 DEBUG:boto:Path: /kskgfn-47/h 2023-12-15T23:13:46.277 DEBUG:boto:Data: 2023-12-15T23:13:46.277 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.277 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.277 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.278 DEBUG:boto:Params: {} 2023-12-15T23:13:46.278 DEBUG:boto:Token: None 2023-12-15T23:13:46.278 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h 2023-12-15T23:13:46.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0SyCWJ/bxjFFlAWpCNesqMOazYU= 2023-12-15T23:13:46.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0SyCWJ/bxjFFlAWpCNesqMOazYU=', 'Content-Length': '0'} 2023-12-15T23:13:46.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a30adce0302d2d2d-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.280 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2023-12-15T23:13:46.280 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.280 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.280 DEBUG:boto:Method: GET 2023-12-15T23:13:46.280 DEBUG:boto:Path: /kskgfn-47/h 2023-12-15T23:13:46.280 DEBUG:boto:Data: 2023-12-15T23:13:46.280 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.280 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.281 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.281 DEBUG:boto:Params: {} 2023-12-15T23:13:46.281 DEBUG:boto:Token: None 2023-12-15T23:13:46.281 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h 2023-12-15T23:13:46.281 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IYO8xlT/NShrgTDuN7a3RsQYNGk= 2023-12-15T23:13:46.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IYO8xlT/NShrgTDuN7a3RsQYNGk=', 'Content-Length': '0'} 2023-12-15T23:13:46.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-47:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000672645cce6c9c64e-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.325 DEBUG:boto:path=/kskgfn-47/h 2023-12-15T23:13:46.326 DEBUG:boto:auth_path=/kskgfn-47/h 2023-12-15T23:13:46.326 DEBUG:boto:Method: GET 2023-12-15T23:13:46.326 DEBUG:boto:Path: /kskgfn-47/h 2023-12-15T23:13:46.326 DEBUG:boto:Data: 2023-12-15T23:13:46.326 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.326 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.326 DEBUG:boto:Params: {} 2023-12-15T23:13:46.326 DEBUG:boto:Token: None 2023-12-15T23:13:46.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/h 2023-12-15T23:13:46.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IYO8xlT/NShrgTDuN7a3RsQYNGk= 2023-12-15T23:13:46.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IYO8xlT/NShrgTDuN7a3RsQYNGk=', 'Content-Length': '0'} 2023-12-15T23:13:46.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:11:38 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f70f0c201d91b0cd-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.329 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.329 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.329 DEBUG:boto:path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.329 DEBUG:boto:auth_path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.329 DEBUG:boto:Method: GET 2023-12-15T23:13:46.329 DEBUG:boto:Path: /kskgfn-47/?prefix=h 2023-12-15T23:13:46.329 DEBUG:boto:Data: 2023-12-15T23:13:46.329 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.329 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.330 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.330 DEBUG:boto:Params: {} 2023-12-15T23:13:46.330 DEBUG:boto:Token: None 2023-12-15T23:13:46.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079d0fa50a681939c-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.333 DEBUG:boto:b'kskgfn-47h1000falseh2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.333 DEBUG:boto:path=/kskgfn-47/ 2023-12-15T23:13:46.334 DEBUG:boto:auth_path=/kskgfn-47/ 2023-12-15T23:13:46.334 DEBUG:boto:path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.334 DEBUG:boto:auth_path=/kskgfn-47/?prefix=h 2023-12-15T23:13:46.334 DEBUG:boto:Method: GET 2023-12-15T23:13:46.334 DEBUG:boto:Path: /kskgfn-47/?prefix=h 2023-12-15T23:13:46.334 DEBUG:boto:Data: 2023-12-15T23:13:46.334 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.334 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.334 DEBUG:boto:Params: {} 2023-12-15T23:13:46.334 DEBUG:boto:Token: None 2023-12-15T23:13:46.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-47/ 2023-12-15T23:13:46.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc= 2023-12-15T23:13:46.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MvdI8MIoCef6fU2GUBGLjav6Kdc=', 'Content-Length': '0'} 2023-12-15T23:13:46.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a75081cc8fbeea4-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.337 DEBUG:boto:b'kskgfn-47h1000falseh2023-12-15T23:11:38.552Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:46.337 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-47 zones={test-zone2, test-zone1} 2023-12-15T23:13:46.338 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_full ... ok 2023-12-15T23:13:46.339 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.339 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:13:46.393 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:46.393 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:46.430 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:13:46.447 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702681898.400970_382.1","last_update":"2023-12-15T23:11:38.400970Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:13:46.448 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702681898.400970_382.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.448 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:13:46.448 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.448 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:13:46.501 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:46.501 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:46.532 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:46.531+0000 7f2c76d46800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:13:46.534 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:46.533+0000 7f2c76d46800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:13:46.550 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681898.400970_382.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:38.400970Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:13:46Z"} 2023-12-15T23:13:46.550 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702681898.400970_382.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:11:38.400970Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:13:46Z"} 2023-12-15T23:13:46.550 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702681898.400970_382.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:11:38.400970Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:13:46.550 DEBUG:rgw_multi.tests:log_status={0: '1_1702681898.400970_382.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.551 DEBUG:rgw_multi.tests:sync_status={0: '1_1702681898.400970_382.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.551 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:13:46.551 DEBUG:boto:path=/ 2023-12-15T23:13:46.551 DEBUG:boto:auth_path=/ 2023-12-15T23:13:46.551 DEBUG:boto:Method: GET 2023-12-15T23:13:46.551 DEBUG:boto:Path: / 2023-12-15T23:13:46.551 DEBUG:boto:Data: 2023-12-15T23:13:46.551 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.551 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.551 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.551 DEBUG:boto:Params: {} 2023-12-15T23:13:46.552 DEBUG:boto:Token: None 2023-12-15T23:13:46.552 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT / 2023-12-15T23:13:46.552 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1+1vDwsyS0LJLf3GO4eZ9YQdG+I= 2023-12-15T23:13:46.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1+1vDwsyS0LJLf3GO4eZ9YQdG+I=', 'Content-Length': '0'} 2023-12-15T23:13:46.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f33cab43db31194a-00657cddaa-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.557 DEBUG:boto:path=/ 2023-12-15T23:13:46.557 DEBUG:boto:auth_path=/ 2023-12-15T23:13:46.557 DEBUG:boto:Method: GET 2023-12-15T23:13:46.557 DEBUG:boto:Path: / 2023-12-15T23:13:46.557 DEBUG:boto:Data: 2023-12-15T23:13:46.558 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.558 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:46.558 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.558 DEBUG:boto:Params: {} 2023-12-15T23:13:46.558 DEBUG:boto:Token: None 2023-12-15T23:13:46.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:46 GMT / 2023-12-15T23:13:46.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1+1vDwsyS0LJLf3GO4eZ9YQdG+I= 2023-12-15T23:13:46.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1+1vDwsyS0LJLf3GO4eZ9YQdG+I=', 'Content-Length': '0'} 2023-12-15T23:13:46.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef42e86c664a7c6b-00657cddaa-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.562 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2023-12-15T23:13:46.562 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.563 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.563 DEBUG:boto:Method: PUT 2023-12-15T23:13:46.563 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.563 DEBUG:boto:Data: 2023-12-15T23:13:46.563 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.563 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.563 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.563 DEBUG:boto:Params: {} 2023-12-15T23:13:46.563 DEBUG:boto:Token: None 2023-12-15T23:13:46.564 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.564 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DRdMXoSKJ5mrqKqfqRDOflxyHVg= 2023-12-15T23:13:46.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DRdMXoSKJ5mrqKqfqRDOflxyHVg=', 'Content-Length': '0'} 2023-12-15T23:13:46.585 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000050f21d42caf717fe-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.585 DEBUG:rgw_multi.tests:created bucket=kskgfn-48 2023-12-15T23:13:46.585 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.585 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:13:46.633 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:46.633 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:46.663 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:13:46.679 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702682026.582588_387.1","last_update":"2023-12-15T23:13:46.582588Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:13:46.679 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.679 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:13:46.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.680 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:13:46.727 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:46.728 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:46.758 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:46.757+0000 7f19e972d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:13:46.759 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:46.758+0000 7f19e972d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:13:46.775 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:13:46Z"} 2023-12-15T23:13:46.775 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:13:46Z"} 2023-12-15T23:13:46.775 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:13:46.775 DEBUG:rgw_multi.tests:log_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.775 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:13:46.775 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:13:46.775 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:13:46.776 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:13:46.823 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:46.823 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:46.867 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000001","obj00000000000000000005","obj00000000000000000012","obj00000000000000000004","obj00000000000000000011","obj00000000000000000000","obj00000000000000000010","obj00000000000000000003","obj00000000000000000013","obj00000000000000000002","obj00000000000000000006"]} 2023-12-15T23:13:46.867 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.868 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.868 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.868 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.868 DEBUG:boto:Data: 2023-12-15T23:13:46.868 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.868 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.868 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.868 DEBUG:boto:Params: {} 2023-12-15T23:13:46.868 DEBUG:boto:Token: None 2023-12-15T23:13:46.868 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.869 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas= 2023-12-15T23:13:46.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas=', 'Content-Length': '0'} 2023-12-15T23:13:46.871 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bca0cbeaced7019a-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.871 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:46.871 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:46.871 DEBUG:boto:Method: PUT 2023-12-15T23:13:46.871 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:46.872 DEBUG:boto:Data: 2023-12-15T23:13:46.872 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:46.872 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.872 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.872 DEBUG:boto:Params: {} 2023-12-15T23:13:46.872 DEBUG:boto:Token: None 2023-12-15T23:13:46.872 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:46.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X0F3DleSQVYHyy3guUthwpAyvXE= 2023-12-15T23:13:46.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X0F3DleSQVYHyy3guUthwpAyvXE='} 2023-12-15T23:13:46.921 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc9b70004f42146b-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.922 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.922 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.922 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.922 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.922 DEBUG:boto:Data: 2023-12-15T23:13:46.922 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.922 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.922 DEBUG:boto:Params: {} 2023-12-15T23:13:46.923 DEBUG:boto:Token: None 2023-12-15T23:13:46.923 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas= 2023-12-15T23:13:46.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas=', 'Content-Length': '0'} 2023-12-15T23:13:46.925 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001bf4550a1c2552dc-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.925 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:46.925 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:46.925 DEBUG:boto:Method: PUT 2023-12-15T23:13:46.925 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:46.925 DEBUG:boto:Data: 2023-12-15T23:13:46.926 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:46.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.926 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.926 DEBUG:boto:Params: {} 2023-12-15T23:13:46.926 DEBUG:boto:Token: None 2023-12-15T23:13:46.926 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:46.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:plTwbOwh2bn+uSTlZA2XpQyLT0o= 2023-12-15T23:13:46.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:plTwbOwh2bn+uSTlZA2XpQyLT0o='} 2023-12-15T23:13:46.932 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009ba0353ef7910c62-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.932 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.932 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.932 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.933 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.933 DEBUG:boto:Data: 2023-12-15T23:13:46.933 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.933 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.933 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.933 DEBUG:boto:Params: {} 2023-12-15T23:13:46.933 DEBUG:boto:Token: None 2023-12-15T23:13:46.933 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas= 2023-12-15T23:13:46.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas=', 'Content-Length': '0'} 2023-12-15T23:13:46.935 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e75889d32e228f6d-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.936 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:46.936 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:46.936 DEBUG:boto:Method: PUT 2023-12-15T23:13:46.936 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:46.936 DEBUG:boto:Data: 2023-12-15T23:13:46.936 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:46.936 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.936 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.936 DEBUG:boto:Params: {} 2023-12-15T23:13:46.937 DEBUG:boto:Token: None 2023-12-15T23:13:46.937 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:46.937 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dlrGRDHg2ZOh6/OrXv9Q2ekzCAM= 2023-12-15T23:13:46.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dlrGRDHg2ZOh6/OrXv9Q2ekzCAM='} 2023-12-15T23:13:46.944 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000014d2f27bf70fe2da-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.944 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.944 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.944 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.944 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.944 DEBUG:boto:Data: 2023-12-15T23:13:46.944 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.944 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.944 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.945 DEBUG:boto:Params: {} 2023-12-15T23:13:46.945 DEBUG:boto:Token: None 2023-12-15T23:13:46.945 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.945 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas= 2023-12-15T23:13:46.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas=', 'Content-Length': '0'} 2023-12-15T23:13:46.947 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006fe34b65274a3534-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.947 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:46.947 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:46.947 DEBUG:boto:Method: PUT 2023-12-15T23:13:46.948 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:46.948 DEBUG:boto:Data: 2023-12-15T23:13:46.948 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:46.948 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.948 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.948 DEBUG:boto:Params: {} 2023-12-15T23:13:46.948 DEBUG:boto:Token: None 2023-12-15T23:13:46.948 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:46.948 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jsS9KOnRtZWT4o74ueZuEG8N+PM= 2023-12-15T23:13:46.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jsS9KOnRtZWT4o74ueZuEG8N+PM='} 2023-12-15T23:13:46.997 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ed2b72f5ca7fc26-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:46.998 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:46.998 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:46.998 DEBUG:boto:Method: HEAD 2023-12-15T23:13:46.998 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:46.998 DEBUG:boto:Data: 2023-12-15T23:13:46.998 DEBUG:boto:Headers: {} 2023-12-15T23:13:46.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:46.998 DEBUG:boto:Port: 8000 2023-12-15T23:13:46.998 DEBUG:boto:Params: {} 2023-12-15T23:13:46.999 DEBUG:boto:Token: None 2023-12-15T23:13:46.999 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:46 GMT /kskgfn-48/ 2023-12-15T23:13:46.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas= 2023-12-15T23:13:46.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zQQ3Orjor9qQjI5BNr6ZhESglas=', 'Content-Length': '0'} 2023-12-15T23:13:47.001 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000338454099b41df62-00657cddaa-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.001 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:47.001 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:47.001 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.001 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:47.001 DEBUG:boto:Data: 2023-12-15T23:13:47.001 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.001 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.002 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.002 DEBUG:boto:Params: {} 2023-12-15T23:13:47.002 DEBUG:boto:Token: None 2023-12-15T23:13:47.002 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:47.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PE7zGD/Xsl5iMj2IOSge+buIYdI= 2023-12-15T23:13:47.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PE7zGD/Xsl5iMj2IOSge+buIYdI='} 2023-12-15T23:13:47.007 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ace7468054093dc-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.007 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:47.007 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:47.007 DEBUG:boto:Method: HEAD 2023-12-15T23:13:47.007 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:47.007 DEBUG:boto:Data: 2023-12-15T23:13:47.008 DEBUG:boto:Headers: {} 2023-12-15T23:13:47.008 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.008 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.008 DEBUG:boto:Params: {} 2023-12-15T23:13:47.008 DEBUG:boto:Token: None 2023-12-15T23:13:47.008 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/ 2023-12-15T23:13:47.008 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo= 2023-12-15T23:13:47.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo=', 'Content-Length': '0'} 2023-12-15T23:13:47.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fef8d7be0a58b03d-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.010 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:47.010 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:47.010 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.011 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:47.011 DEBUG:boto:Data: 2023-12-15T23:13:47.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.011 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.011 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.011 DEBUG:boto:Params: {} 2023-12-15T23:13:47.011 DEBUG:boto:Token: None 2023-12-15T23:13:47.011 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:47.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iixm45ncAgeenelhCKho2eIU3QI= 2023-12-15T23:13:47.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iixm45ncAgeenelhCKho2eIU3QI='} 2023-12-15T23:13:47.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e6b5cce7b86b7033-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.054 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:47.054 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:47.054 DEBUG:boto:Method: HEAD 2023-12-15T23:13:47.054 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:47.054 DEBUG:boto:Data: 2023-12-15T23:13:47.054 DEBUG:boto:Headers: {} 2023-12-15T23:13:47.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.055 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.055 DEBUG:boto:Params: {} 2023-12-15T23:13:47.055 DEBUG:boto:Token: None 2023-12-15T23:13:47.055 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/ 2023-12-15T23:13:47.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo= 2023-12-15T23:13:47.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo=', 'Content-Length': '0'} 2023-12-15T23:13:47.057 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000acfe357016d68102-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.057 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:47.058 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:47.058 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.058 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:47.058 DEBUG:boto:Data: 2023-12-15T23:13:47.058 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.058 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.058 DEBUG:boto:Params: {} 2023-12-15T23:13:47.058 DEBUG:boto:Token: None 2023-12-15T23:13:47.059 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:47.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tT/+KCGZExthzPlaM0tWS23RsS8= 2023-12-15T23:13:47.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tT/+KCGZExthzPlaM0tWS23RsS8='} 2023-12-15T23:13:47.064 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001876ef8deef743ca-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.064 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:47.065 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:47.065 DEBUG:boto:Method: HEAD 2023-12-15T23:13:47.065 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:47.065 DEBUG:boto:Data: 2023-12-15T23:13:47.065 DEBUG:boto:Headers: {} 2023-12-15T23:13:47.065 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.065 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.065 DEBUG:boto:Params: {} 2023-12-15T23:13:47.065 DEBUG:boto:Token: None 2023-12-15T23:13:47.066 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/ 2023-12-15T23:13:47.066 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo= 2023-12-15T23:13:47.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo=', 'Content-Length': '0'} 2023-12-15T23:13:47.068 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006cddfc16902c19ea-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.068 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:47.068 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:47.068 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.068 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:47.068 DEBUG:boto:Data: 2023-12-15T23:13:47.069 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.069 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.069 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.069 DEBUG:boto:Params: {} 2023-12-15T23:13:47.069 DEBUG:boto:Token: None 2023-12-15T23:13:47.069 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:47.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oTLlXR3BSQQrVwIST+oa3tie35E= 2023-12-15T23:13:47.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oTLlXR3BSQQrVwIST+oa3tie35E='} 2023-12-15T23:13:47.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af05334e40c47f42-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.074 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:47.074 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:47.075 DEBUG:boto:Method: HEAD 2023-12-15T23:13:47.075 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:47.075 DEBUG:boto:Data: 2023-12-15T23:13:47.075 DEBUG:boto:Headers: {} 2023-12-15T23:13:47.075 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.075 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.075 DEBUG:boto:Params: {} 2023-12-15T23:13:47.075 DEBUG:boto:Token: None 2023-12-15T23:13:47.075 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/ 2023-12-15T23:13:47.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo= 2023-12-15T23:13:47.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo=', 'Content-Length': '0'} 2023-12-15T23:13:47.078 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ef9384e3bda89c23-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.078 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:47.078 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:47.078 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.078 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:47.078 DEBUG:boto:Data: 2023-12-15T23:13:47.078 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.079 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.079 DEBUG:boto:Params: {} 2023-12-15T23:13:47.079 DEBUG:boto:Token: None 2023-12-15T23:13:47.079 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:47.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pmG2/2uGl3Ex1pOCOSyRHlV9D4s= 2023-12-15T23:13:47.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pmG2/2uGl3Ex1pOCOSyRHlV9D4s='} 2023-12-15T23:13:47.121 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b9e00c456112447-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.122 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:47.122 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:47.122 DEBUG:boto:Method: HEAD 2023-12-15T23:13:47.122 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:47.122 DEBUG:boto:Data: 2023-12-15T23:13:47.122 DEBUG:boto:Headers: {} 2023-12-15T23:13:47.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.122 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.122 DEBUG:boto:Params: {} 2023-12-15T23:13:47.123 DEBUG:boto:Token: None 2023-12-15T23:13:47.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/ 2023-12-15T23:13:47.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo= 2023-12-15T23:13:47.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Vd9DA0agsqIiSINxN5DKe18MKo=', 'Content-Length': '0'} 2023-12-15T23:13:47.125 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b2fa0d74b12d45f2-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.125 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:47.125 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:47.125 DEBUG:boto:Method: PUT 2023-12-15T23:13:47.125 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:47.126 DEBUG:boto:Data: 2023-12-15T23:13:47.126 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:13:47.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:47.126 DEBUG:boto:Port: 8000 2023-12-15T23:13:47.126 DEBUG:boto:Params: {} 2023-12-15T23:13:47.126 DEBUG:boto:Token: None 2023-12-15T23:13:47.126 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:13:47 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:47.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:64JrZ9yPJrYYg6itd6J0OaI/MsE= 2023-12-15T23:13:47.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:13:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:64JrZ9yPJrYYg6itd6J0OaI/MsE='} 2023-12-15T23:13:47.132 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000066f62cd8bc1d71ef-00657cddab-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:47.132 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-48 2023-12-15T23:13:47.132 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:47.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:47.133 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-48 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:13:47.187 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:47.187 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:47.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:47.222+0000 7f3c24731800 1 waiting to reach incremental sync.. 2023-12-15T23:13:52.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:52.223+0000 7f3c24731800 1 bucket sync caught up with source: 2023-12-15T23:13:52.226 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.30.6, 00000000001.41.6, 00000000001.39.6, 00000000001.136.6, 00000000001.37.6, 00000000001.29.6, 00000000001.69.6, 00000000001.16.6, 00000000001.37.6, 00000000001.39.6, ] 2023-12-15T23:13:52.226 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.30.6, 00000000001.41.6, 00000000001.39.6, 00000000001.136.6, 00000000001.37.6, 00000000001.29.6, 00000000001.69.6, 00000000001.16.6, 00000000001.37.6, 00000000001.39.6, ] 2023-12-15T23:13:52.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:13:52.223+0000 7f3c24731800 0 bucket checkpoint complete 2023-12-15T23:13:52.244 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-48 2023-12-15T23:13:52.244 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:52.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:13:52.244 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-48 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:13:52.305 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:13:52.306 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:13:52.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:13:52.343+0000 7f63f531e800 1 waiting to reach incremental sync.. 2023-12-15T23:13:57.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:13:57.345+0000 7f63f531e800 1 bucket sync caught up with source: 2023-12-15T23:13:57.347 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000001.67.6, 00000000001.107.6, 00000000001.81.6, 00000000001.131.6, 00000000001.72.6, 00000000001.39.6, 00000000001.112.6, 00000000001.49.6, 00000000001.105.6, 00000000001.70.6, ] 2023-12-15T23:13:57.347 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000001.67.6, 00000000001.107.6, 00000000001.81.6, 00000000001.131.6, 00000000001.72.6, 00000000001.39.6, 00000000001.112.6, 00000000001.49.6, 00000000001.105.6, 00000000001.70.6, ] 2023-12-15T23:13:57.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:13:57.345+0000 7f63f531e800 0 bucket checkpoint complete 2023-12-15T23:13:57.365 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-48 zones={test-zone2, test-zone1} 2023-12-15T23:13:57.365 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.366 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.366 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.366 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:57.366 DEBUG:boto:Data: 2023-12-15T23:13:57.366 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.366 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.366 DEBUG:boto:Params: {} 2023-12-15T23:13:57.366 DEBUG:boto:Token: None 2023-12-15T23:13:57.366 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GE7tMLTBZ6LcTdgp2D614Dn/sRo= 2023-12-15T23:13:57.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GE7tMLTBZ6LcTdgp2D614Dn/sRo=', 'Content-Length': '0'} 2023-12-15T23:13:57.369 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b374c78821df0a93-00657cddb5-5178-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.369 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.370 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.370 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.370 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:13:57.370 DEBUG:boto:Data: 2023-12-15T23:13:57.370 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.370 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.370 DEBUG:boto:Params: {} 2023-12-15T23:13:57.370 DEBUG:boto:Token: None 2023-12-15T23:13:57.370 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GE7tMLTBZ6LcTdgp2D614Dn/sRo= 2023-12-15T23:13:57.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GE7tMLTBZ6LcTdgp2D614Dn/sRo=', 'Content-Length': '0'} 2023-12-15T23:13:57.373 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1eaf8d82b4640b7-00657cddb5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.373 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:13:57.373 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.373 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.374 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.374 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.374 DEBUG:boto:Method: GET 2023-12-15T23:13:57.374 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.374 DEBUG:boto:Data: 2023-12-15T23:13:57.374 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.374 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.374 DEBUG:boto:Params: {} 2023-12-15T23:13:57.374 DEBUG:boto:Token: None 2023-12-15T23:13:57.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/?versions 2023-12-15T23:13:57.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM= 2023-12-15T23:13:57.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM=', 'Content-Length': '0'} 2023-12-15T23:13:57.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a91c202f469c153c-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.377 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2023-12-15T23:13:57.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2023-12-15T23:13:57.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2023-12-15T23:13:57.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2023-12-15T23:13:57.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2023-12-15T23:13:57.379 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:13:57.379 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.379 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.379 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.379 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.379 DEBUG:boto:Method: GET 2023-12-15T23:13:57.379 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.379 DEBUG:boto:Data: 2023-12-15T23:13:57.380 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.380 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.380 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.380 DEBUG:boto:Params: {} 2023-12-15T23:13:57.380 DEBUG:boto:Token: None 2023-12-15T23:13:57.380 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/?versions 2023-12-15T23:13:57.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM= 2023-12-15T23:13:57.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM=', 'Content-Length': '0'} 2023-12-15T23:13:57.383 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd595ad3b55230d1-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.383 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.383 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2023-12-15T23:13:57.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2023-12-15T23:13:57.384 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.384 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.384 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.385 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.385 DEBUG:boto:Method: GET 2023-12-15T23:13:57.385 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.385 DEBUG:boto:Data: 2023-12-15T23:13:57.385 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.385 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.385 DEBUG:boto:Params: {} 2023-12-15T23:13:57.385 DEBUG:boto:Token: None 2023-12-15T23:13:57.385 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/?versions 2023-12-15T23:13:57.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM= 2023-12-15T23:13:57.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM=', 'Content-Length': '0'} 2023-12-15T23:13:57.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f3bdd70899febe3-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.388 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.389 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.389 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.389 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.389 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.389 DEBUG:boto:Method: GET 2023-12-15T23:13:57.389 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:13:57.389 DEBUG:boto:Data: 2023-12-15T23:13:57.389 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.389 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.389 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.390 DEBUG:boto:Params: {} 2023-12-15T23:13:57.390 DEBUG:boto:Token: None 2023-12-15T23:13:57.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/?versions 2023-12-15T23:13:57.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM= 2023-12-15T23:13:57.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gENJLFE8pnlWB5WDqag06WPJGPM=', 'Content-Length': '0'} 2023-12-15T23:13:57.392 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b36d2c76bb66853-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.392 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:13:57.393 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.393 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.393 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.393 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.394 DEBUG:boto:Method: GET 2023-12-15T23:13:57.394 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.394 DEBUG:boto:Data: 2023-12-15T23:13:57.394 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.394 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.394 DEBUG:boto:Params: {} 2023-12-15T23:13:57.394 DEBUG:boto:Token: None 2023-12-15T23:13:57.394 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s= 2023-12-15T23:13:57.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s=', 'Content-Length': '0'} 2023-12-15T23:13:57.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef1884d729143288-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.397 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.397 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.397 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.397 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.397 DEBUG:boto:Method: GET 2023-12-15T23:13:57.397 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.397 DEBUG:boto:Data: 2023-12-15T23:13:57.397 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.398 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.398 DEBUG:boto:Params: {} 2023-12-15T23:13:57.400 DEBUG:boto:Token: None 2023-12-15T23:13:57.400 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s= 2023-12-15T23:13:57.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s=', 'Content-Length': '0'} 2023-12-15T23:13:57.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000329c8669ba07cfda-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.403 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.403 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.403 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.403 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.403 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.403 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.403 DEBUG:boto:Data: 2023-12-15T23:13:57.403 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.403 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.403 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.403 DEBUG:boto:Params: {} 2023-12-15T23:13:57.404 DEBUG:boto:Token: None 2023-12-15T23:13:57.404 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIo8Tt66uFtt/mIQKdEkLSAhh8Y= 2023-12-15T23:13:57.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIo8Tt66uFtt/mIQKdEkLSAhh8Y=', 'Content-Length': '0'} 2023-12-15T23:13:57.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fba6f32dacb6a990-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.406 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.406 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.406 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.406 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.406 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.406 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.406 DEBUG:boto:Data: 2023-12-15T23:13:57.406 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.407 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.407 DEBUG:boto:Params: {} 2023-12-15T23:13:57.407 DEBUG:boto:Token: None 2023-12-15T23:13:57.407 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WIo8Tt66uFtt/mIQKdEkLSAhh8Y= 2023-12-15T23:13:57.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WIo8Tt66uFtt/mIQKdEkLSAhh8Y=', 'Content-Length': '0'} 2023-12-15T23:13:57.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030a79edcd6bfb816-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:13:57.409 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.409 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.409 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.409 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.409 DEBUG:boto:Method: GET 2023-12-15T23:13:57.410 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.410 DEBUG:boto:Data: 2023-12-15T23:13:57.410 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.410 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.410 DEBUG:boto:Params: {} 2023-12-15T23:13:57.410 DEBUG:boto:Token: None 2023-12-15T23:13:57.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s= 2023-12-15T23:13:57.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s=', 'Content-Length': '0'} 2023-12-15T23:13:57.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2c8b5e9a31e7ab1-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.453 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.454 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.454 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.454 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.454 DEBUG:boto:Method: GET 2023-12-15T23:13:57.454 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.454 DEBUG:boto:Data: 2023-12-15T23:13:57.454 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.454 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.454 DEBUG:boto:Params: {} 2023-12-15T23:13:57.454 DEBUG:boto:Token: None 2023-12-15T23:13:57.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:13:57.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s= 2023-12-15T23:13:57.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R1DGg4cNsaNlKugPmK1rX3y+T2s=', 'Content-Length': '0'} 2023-12-15T23:13:57.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089f49f960e623c68-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.457 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.457 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.457 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.457 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.457 DEBUG:boto:Method: GET 2023-12-15T23:13:57.457 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.458 DEBUG:boto:Data: 2023-12-15T23:13:57.458 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.458 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.458 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.458 DEBUG:boto:Params: {} 2023-12-15T23:13:57.458 DEBUG:boto:Token: None 2023-12-15T23:13:57.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000991a3becae41c07-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.461 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.461 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.461 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.461 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.461 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.462 DEBUG:boto:Method: GET 2023-12-15T23:13:57.462 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.462 DEBUG:boto:Data: 2023-12-15T23:13:57.462 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.462 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.462 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.462 DEBUG:boto:Params: {} 2023-12-15T23:13:57.462 DEBUG:boto:Token: None 2023-12-15T23:13:57.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efce1bf9c9e8cc61-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.465 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.465 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.465 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.465 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.466 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.466 DEBUG:boto:Data: 2023-12-15T23:13:57.466 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.466 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.466 DEBUG:boto:Params: {} 2023-12-15T23:13:57.466 DEBUG:boto:Token: None 2023-12-15T23:13:57.466 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZZyy0MUDA10Z9OZL/1LMAM4P72Q= 2023-12-15T23:13:57.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZZyy0MUDA10Z9OZL/1LMAM4P72Q=', 'Content-Length': '0'} 2023-12-15T23:13:57.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000941c2a49b9ca7adb-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.468 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.468 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.468 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.469 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.469 DEBUG:boto:Data: 2023-12-15T23:13:57.469 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.469 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.469 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.469 DEBUG:boto:Params: {} 2023-12-15T23:13:57.469 DEBUG:boto:Token: None 2023-12-15T23:13:57.469 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZZyy0MUDA10Z9OZL/1LMAM4P72Q= 2023-12-15T23:13:57.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZZyy0MUDA10Z9OZL/1LMAM4P72Q=', 'Content-Length': '0'} 2023-12-15T23:13:57.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f6431135815992c-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:13:57.472 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.472 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.472 DEBUG:boto:Method: GET 2023-12-15T23:13:57.472 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.472 DEBUG:boto:Data: 2023-12-15T23:13:57.472 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.472 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.472 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.472 DEBUG:boto:Params: {} 2023-12-15T23:13:57.472 DEBUG:boto:Token: None 2023-12-15T23:13:57.473 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:auNMoFZmaQ+iR+3z8w4rqHJkurc= 2023-12-15T23:13:57.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:auNMoFZmaQ+iR+3z8w4rqHJkurc=', 'Content-Length': '0'} 2023-12-15T23:13:57.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000907e9a608d9a6126-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.517 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.518 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.518 DEBUG:boto:Method: GET 2023-12-15T23:13:57.518 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.518 DEBUG:boto:Data: 2023-12-15T23:13:57.518 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.518 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.518 DEBUG:boto:Params: {} 2023-12-15T23:13:57.518 DEBUG:boto:Token: None 2023-12-15T23:13:57.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:13:57.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:auNMoFZmaQ+iR+3z8w4rqHJkurc= 2023-12-15T23:13:57.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:auNMoFZmaQ+iR+3z8w4rqHJkurc=', 'Content-Length': '0'} 2023-12-15T23:13:57.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000517171a697f467c3-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.521 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.521 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.521 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.521 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.521 DEBUG:boto:Method: GET 2023-12-15T23:13:57.521 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.521 DEBUG:boto:Data: 2023-12-15T23:13:57.521 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.521 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.521 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.522 DEBUG:boto:Params: {} 2023-12-15T23:13:57.522 DEBUG:boto:Token: None 2023-12-15T23:13:57.522 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7a3b3d0ba5864e9-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.525 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.525 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.525 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.525 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.525 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.525 DEBUG:boto:Method: GET 2023-12-15T23:13:57.526 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:13:57.526 DEBUG:boto:Data: 2023-12-15T23:13:57.526 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.526 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.526 DEBUG:boto:Params: {} 2023-12-15T23:13:57.526 DEBUG:boto:Token: None 2023-12-15T23:13:57.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b5c223f0e2880ec-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.529 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:13:47.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:13:57.529 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.530 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.530 DEBUG:boto:Method: GET 2023-12-15T23:13:57.530 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.530 DEBUG:boto:Data: 2023-12-15T23:13:57.530 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.530 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.530 DEBUG:boto:Params: {} 2023-12-15T23:13:57.530 DEBUG:boto:Token: None 2023-12-15T23:13:57.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M= 2023-12-15T23:13:57.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M=', 'Content-Length': '0'} 2023-12-15T23:13:57.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a97b350889c368fd-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.533 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.533 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.533 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.533 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.533 DEBUG:boto:Method: GET 2023-12-15T23:13:57.533 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.533 DEBUG:boto:Data: 2023-12-15T23:13:57.533 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.534 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.534 DEBUG:boto:Params: {} 2023-12-15T23:13:57.534 DEBUG:boto:Token: None 2023-12-15T23:13:57.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M= 2023-12-15T23:13:57.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M=', 'Content-Length': '0'} 2023-12-15T23:13:57.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001307c2d9f8f4362f-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.536 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.536 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.536 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.537 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.537 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.537 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.537 DEBUG:boto:Data: 2023-12-15T23:13:57.537 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.537 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.537 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.537 DEBUG:boto:Params: {} 2023-12-15T23:13:57.537 DEBUG:boto:Token: None 2023-12-15T23:13:57.537 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lmuKptzfrCF56nNW2G311HDi+74= 2023-12-15T23:13:57.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lmuKptzfrCF56nNW2G311HDi+74=', 'Content-Length': '0'} 2023-12-15T23:13:57.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000794b640823fd089e-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.540 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.540 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.540 DEBUG:boto:Data: 2023-12-15T23:13:57.541 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.541 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.541 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.541 DEBUG:boto:Params: {} 2023-12-15T23:13:57.541 DEBUG:boto:Token: None 2023-12-15T23:13:57.541 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.541 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lmuKptzfrCF56nNW2G311HDi+74= 2023-12-15T23:13:57.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lmuKptzfrCF56nNW2G311HDi+74=', 'Content-Length': '0'} 2023-12-15T23:13:57.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a2473a9f5ba2c13-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:13:57.543 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.543 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.544 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.544 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.544 DEBUG:boto:Method: GET 2023-12-15T23:13:57.544 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.544 DEBUG:boto:Data: 2023-12-15T23:13:57.544 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.544 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.544 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.544 DEBUG:boto:Params: {} 2023-12-15T23:13:57.544 DEBUG:boto:Token: None 2023-12-15T23:13:57.545 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M= 2023-12-15T23:13:57.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M=', 'Content-Length': '0'} 2023-12-15T23:13:57.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065363cd102ce3779-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.589 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.590 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.590 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.590 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.590 DEBUG:boto:Method: GET 2023-12-15T23:13:57.590 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.590 DEBUG:boto:Data: 2023-12-15T23:13:57.590 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.590 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.590 DEBUG:boto:Params: {} 2023-12-15T23:13:57.590 DEBUG:boto:Token: None 2023-12-15T23:13:57.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:13:57.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M= 2023-12-15T23:13:57.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6hD/euJK2OA9qqm7wPOBvI+rf7M=', 'Content-Length': '0'} 2023-12-15T23:13:57.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000885178959843b315-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.593 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.593 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.593 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.593 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.593 DEBUG:boto:Method: GET 2023-12-15T23:13:57.593 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.593 DEBUG:boto:Data: 2023-12-15T23:13:57.594 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.594 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.594 DEBUG:boto:Params: {} 2023-12-15T23:13:57.594 DEBUG:boto:Token: None 2023-12-15T23:13:57.594 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.596 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000481053c9af99a542-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.637 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.638 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.638 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.638 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.638 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.638 DEBUG:boto:Method: GET 2023-12-15T23:13:57.639 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.639 DEBUG:boto:Data: 2023-12-15T23:13:57.639 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.639 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.639 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.639 DEBUG:boto:Params: {} 2023-12-15T23:13:57.639 DEBUG:boto:Token: None 2023-12-15T23:13:57.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7d76eece20c2145-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.642 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.642 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.642 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.643 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.643 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.643 DEBUG:boto:Data: 2023-12-15T23:13:57.643 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.643 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.643 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.643 DEBUG:boto:Params: {} 2023-12-15T23:13:57.643 DEBUG:boto:Token: None 2023-12-15T23:13:57.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CWVOLoIBdGORLz4MIi+4EtyTucI= 2023-12-15T23:13:57.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CWVOLoIBdGORLz4MIi+4EtyTucI=', 'Content-Length': '0'} 2023-12-15T23:13:57.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c620a4cdf9c86943-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.645 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.645 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.646 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.646 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.646 DEBUG:boto:Data: 2023-12-15T23:13:57.646 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.646 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.646 DEBUG:boto:Params: {} 2023-12-15T23:13:57.646 DEBUG:boto:Token: None 2023-12-15T23:13:57.646 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CWVOLoIBdGORLz4MIi+4EtyTucI= 2023-12-15T23:13:57.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CWVOLoIBdGORLz4MIi+4EtyTucI=', 'Content-Length': '0'} 2023-12-15T23:13:57.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d02a63c5dd6bb0c-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:13:57.648 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.649 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.649 DEBUG:boto:Method: GET 2023-12-15T23:13:57.649 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.649 DEBUG:boto:Data: 2023-12-15T23:13:57.649 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.649 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.649 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.649 DEBUG:boto:Params: {} 2023-12-15T23:13:57.649 DEBUG:boto:Token: None 2023-12-15T23:13:57.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6a+flIv11nTtWBOco2z13YGeey0= 2023-12-15T23:13:57.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6a+flIv11nTtWBOco2z13YGeey0=', 'Content-Length': '0'} 2023-12-15T23:13:57.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020f97fd4b489560b-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.693 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.694 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.694 DEBUG:boto:Method: GET 2023-12-15T23:13:57.694 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.694 DEBUG:boto:Data: 2023-12-15T23:13:57.694 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.694 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.694 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.694 DEBUG:boto:Params: {} 2023-12-15T23:13:57.694 DEBUG:boto:Token: None 2023-12-15T23:13:57.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:13:57.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6a+flIv11nTtWBOco2z13YGeey0= 2023-12-15T23:13:57.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6a+flIv11nTtWBOco2z13YGeey0=', 'Content-Length': '0'} 2023-12-15T23:13:57.696 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015c168a84276d22c-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.697 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.697 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.697 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.697 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.697 DEBUG:boto:Method: GET 2023-12-15T23:13:57.697 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.697 DEBUG:boto:Data: 2023-12-15T23:13:57.697 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.697 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.697 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.698 DEBUG:boto:Params: {} 2023-12-15T23:13:57.698 DEBUG:boto:Token: None 2023-12-15T23:13:57.698 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b49188ae2b0552b3-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.701 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.701 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.701 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.701 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.701 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.701 DEBUG:boto:Method: GET 2023-12-15T23:13:57.701 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:13:57.701 DEBUG:boto:Data: 2023-12-15T23:13:57.701 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.702 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.702 DEBUG:boto:Params: {} 2023-12-15T23:13:57.702 DEBUG:boto:Token: None 2023-12-15T23:13:57.702 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2db25a4379f883c-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.705 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:13:47.080Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:13:57.705 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.705 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.706 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.706 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.706 DEBUG:boto:Method: GET 2023-12-15T23:13:57.706 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.706 DEBUG:boto:Data: 2023-12-15T23:13:57.706 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.706 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.706 DEBUG:boto:Params: {} 2023-12-15T23:13:57.706 DEBUG:boto:Token: None 2023-12-15T23:13:57.706 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM= 2023-12-15T23:13:57.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM=', 'Content-Length': '0'} 2023-12-15T23:13:57.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d2ae648e23e4bab-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.709 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.709 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.709 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.709 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.709 DEBUG:boto:Method: GET 2023-12-15T23:13:57.710 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.710 DEBUG:boto:Data: 2023-12-15T23:13:57.710 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.710 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.710 DEBUG:boto:Params: {} 2023-12-15T23:13:57.710 DEBUG:boto:Token: None 2023-12-15T23:13:57.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM= 2023-12-15T23:13:57.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM=', 'Content-Length': '0'} 2023-12-15T23:13:57.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076a40edfbf0aaeb0-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.713 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.713 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.713 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.713 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.713 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.713 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.714 DEBUG:boto:Data: 2023-12-15T23:13:57.714 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.714 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.714 DEBUG:boto:Params: {} 2023-12-15T23:13:57.714 DEBUG:boto:Token: None 2023-12-15T23:13:57.714 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.714 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p9xxitdLKPo+MAjpRLRG7w+VQdY= 2023-12-15T23:13:57.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p9xxitdLKPo+MAjpRLRG7w+VQdY=', 'Content-Length': '0'} 2023-12-15T23:13:57.716 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078dff0f30909c378-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.717 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.717 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.717 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.717 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.717 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.717 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.717 DEBUG:boto:Data: 2023-12-15T23:13:57.717 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.717 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.717 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.717 DEBUG:boto:Params: {} 2023-12-15T23:13:57.718 DEBUG:boto:Token: None 2023-12-15T23:13:57.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p9xxitdLKPo+MAjpRLRG7w+VQdY= 2023-12-15T23:13:57.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p9xxitdLKPo+MAjpRLRG7w+VQdY=', 'Content-Length': '0'} 2023-12-15T23:13:57.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5a9a69d73501d44-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:13:57.720 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.720 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.720 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.721 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.721 DEBUG:boto:Method: GET 2023-12-15T23:13:57.721 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.721 DEBUG:boto:Data: 2023-12-15T23:13:57.721 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.721 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.721 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.721 DEBUG:boto:Params: {} 2023-12-15T23:13:57.721 DEBUG:boto:Token: None 2023-12-15T23:13:57.721 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.721 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM= 2023-12-15T23:13:57.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM=', 'Content-Length': '0'} 2023-12-15T23:13:57.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6bcb67dc3f2b796-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.765 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.766 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.766 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.766 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.766 DEBUG:boto:Method: GET 2023-12-15T23:13:57.766 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.766 DEBUG:boto:Data: 2023-12-15T23:13:57.766 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.766 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.766 DEBUG:boto:Params: {} 2023-12-15T23:13:57.766 DEBUG:boto:Token: None 2023-12-15T23:13:57.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:13:57.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM= 2023-12-15T23:13:57.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I6LeMj9QThTtol3P328kq2aGONM=', 'Content-Length': '0'} 2023-12-15T23:13:57.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009689273fb2bd7e74-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.769 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.769 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.769 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.769 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.770 DEBUG:boto:Method: GET 2023-12-15T23:13:57.770 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.770 DEBUG:boto:Data: 2023-12-15T23:13:57.770 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.770 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.770 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.770 DEBUG:boto:Params: {} 2023-12-15T23:13:57.770 DEBUG:boto:Token: None 2023-12-15T23:13:57.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000225b7a993e2e61c3-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.813 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.814 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.814 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.814 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.814 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.814 DEBUG:boto:Method: GET 2023-12-15T23:13:57.814 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.815 DEBUG:boto:Data: 2023-12-15T23:13:57.815 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.815 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.815 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.815 DEBUG:boto:Params: {} 2023-12-15T23:13:57.815 DEBUG:boto:Token: None 2023-12-15T23:13:57.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007eed7b0136991d5f-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.818 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.818 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.818 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.819 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.819 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.819 DEBUG:boto:Data: 2023-12-15T23:13:57.819 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.819 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.819 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.819 DEBUG:boto:Params: {} 2023-12-15T23:13:57.819 DEBUG:boto:Token: None 2023-12-15T23:13:57.819 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:loaiz8D4qomexIm4Ne4YpHG6y1o= 2023-12-15T23:13:57.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:loaiz8D4qomexIm4Ne4YpHG6y1o=', 'Content-Length': '0'} 2023-12-15T23:13:57.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b531a4f8c7dffcf-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.822 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.822 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.822 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.822 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.822 DEBUG:boto:Data: 2023-12-15T23:13:57.822 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.822 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.823 DEBUG:boto:Params: {} 2023-12-15T23:13:57.823 DEBUG:boto:Token: None 2023-12-15T23:13:57.823 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:loaiz8D4qomexIm4Ne4YpHG6y1o= 2023-12-15T23:13:57.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:loaiz8D4qomexIm4Ne4YpHG6y1o=', 'Content-Length': '0'} 2023-12-15T23:13:57.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026dd92a11e1570b3-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:13:57.825 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.825 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.826 DEBUG:boto:Method: GET 2023-12-15T23:13:57.826 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.826 DEBUG:boto:Data: 2023-12-15T23:13:57.826 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.826 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.826 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.826 DEBUG:boto:Params: {} 2023-12-15T23:13:57.826 DEBUG:boto:Token: None 2023-12-15T23:13:57.826 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dnGBZw5/3kQCotfgRjvm22xbUpk= 2023-12-15T23:13:57.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dnGBZw5/3kQCotfgRjvm22xbUpk=', 'Content-Length': '0'} 2023-12-15T23:13:57.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062eeff3c65b32910-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.870 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.870 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.870 DEBUG:boto:Method: GET 2023-12-15T23:13:57.870 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.870 DEBUG:boto:Data: 2023-12-15T23:13:57.870 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.870 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.870 DEBUG:boto:Params: {} 2023-12-15T23:13:57.870 DEBUG:boto:Token: None 2023-12-15T23:13:57.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:13:57.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dnGBZw5/3kQCotfgRjvm22xbUpk= 2023-12-15T23:13:57.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dnGBZw5/3kQCotfgRjvm22xbUpk=', 'Content-Length': '0'} 2023-12-15T23:13:57.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032d879a178d184a2-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.873 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.873 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.873 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.873 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.873 DEBUG:boto:Method: GET 2023-12-15T23:13:57.874 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.874 DEBUG:boto:Data: 2023-12-15T23:13:57.874 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.874 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.874 DEBUG:boto:Params: {} 2023-12-15T23:13:57.874 DEBUG:boto:Token: None 2023-12-15T23:13:57.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.876 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000671b6c6856684010-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.917 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.918 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:57.918 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:57.918 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.918 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.918 DEBUG:boto:Method: GET 2023-12-15T23:13:57.918 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:13:57.918 DEBUG:boto:Data: 2023-12-15T23:13:57.918 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.919 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.919 DEBUG:boto:Params: {} 2023-12-15T23:13:57.919 DEBUG:boto:Token: None 2023-12-15T23:13:57.919 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/ 2023-12-15T23:13:57.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM= 2023-12-15T23:13:57.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMiEJyQoyR8uLnxk3qZjtRoPvcM=', 'Content-Length': '0'} 2023-12-15T23:13:57.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040989493c023b5fd-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.922 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:13:46.950Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:57.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:13:57.922 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.922 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.922 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.922 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.922 DEBUG:boto:Method: GET 2023-12-15T23:13:57.922 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.922 DEBUG:boto:Data: 2023-12-15T23:13:57.923 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.923 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.923 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.923 DEBUG:boto:Params: {} 2023-12-15T23:13:57.923 DEBUG:boto:Token: None 2023-12-15T23:13:57.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ= 2023-12-15T23:13:57.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ=', 'Content-Length': '0'} 2023-12-15T23:13:57.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a0e3f8312a02a4e-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.925 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.925 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.926 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.926 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.926 DEBUG:boto:Method: GET 2023-12-15T23:13:57.926 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.926 DEBUG:boto:Data: 2023-12-15T23:13:57.926 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.926 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.926 DEBUG:boto:Params: {} 2023-12-15T23:13:57.926 DEBUG:boto:Token: None 2023-12-15T23:13:57.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ= 2023-12-15T23:13:57.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ=', 'Content-Length': '0'} 2023-12-15T23:13:57.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7d2f2637505b498-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.969 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.970 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.970 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.970 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.970 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.970 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.970 DEBUG:boto:Data: 2023-12-15T23:13:57.970 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.970 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.970 DEBUG:boto:Params: {} 2023-12-15T23:13:57.971 DEBUG:boto:Token: None 2023-12-15T23:13:57.971 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ARkB6ZcacMprAci0fXuFx75fC1g= 2023-12-15T23:13:57.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ARkB6ZcacMprAci0fXuFx75fC1g=', 'Content-Length': '0'} 2023-12-15T23:13:57.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002885a9a61c73a8d8-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.973 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.973 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.973 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.973 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.973 DEBUG:boto:Method: HEAD 2023-12-15T23:13:57.973 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.973 DEBUG:boto:Data: 2023-12-15T23:13:57.974 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:57.974 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.974 DEBUG:boto:Params: {} 2023-12-15T23:13:57.974 DEBUG:boto:Token: None 2023-12-15T23:13:57.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ARkB6ZcacMprAci0fXuFx75fC1g= 2023-12-15T23:13:57.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ARkB6ZcacMprAci0fXuFx75fC1g=', 'Content-Length': '0'} 2023-12-15T23:13:57.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000820455434ce43f45-00657cddb5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:57.976 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:13:57.976 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.976 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:57.976 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.976 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.976 DEBUG:boto:Method: GET 2023-12-15T23:13:57.976 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.977 DEBUG:boto:Data: 2023-12-15T23:13:57.977 DEBUG:boto:Headers: {} 2023-12-15T23:13:57.977 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:57.977 DEBUG:boto:Port: 8000 2023-12-15T23:13:57.977 DEBUG:boto:Params: {} 2023-12-15T23:13:57.977 DEBUG:boto:Token: None 2023-12-15T23:13:57.977 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:57 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:57.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ= 2023-12-15T23:13:57.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+fDhFN2ejmQ2xI2PH4Dc81qEFNQ=', 'Content-Length': '0'} 2023-12-15T23:13:57.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b659eb38b966a32-00657cddb5-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.021 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.022 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.022 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:58.022 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:58.022 DEBUG:boto:Method: GET 2023-12-15T23:13:58.022 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:58.022 DEBUG:boto:Data: 2023-12-15T23:13:58.022 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.022 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.022 DEBUG:boto:Params: {} 2023-12-15T23:13:58.023 DEBUG:boto:Token: None 2023-12-15T23:13:58.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:13:58.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QZ8ciL5mqcVZnDLxXOjL0uyoCSQ= 2023-12-15T23:13:58.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QZ8ciL5mqcVZnDLxXOjL0uyoCSQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000787229c83c63713f-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.025 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.025 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.025 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.025 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.026 DEBUG:boto:Method: GET 2023-12-15T23:13:58.026 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.026 DEBUG:boto:Data: 2023-12-15T23:13:58.026 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.026 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.026 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.026 DEBUG:boto:Params: {} 2023-12-15T23:13:58.026 DEBUG:boto:Token: None 2023-12-15T23:13:58.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089de83343777e1fd-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.029 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.030 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.030 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.030 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.030 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.030 DEBUG:boto:Method: GET 2023-12-15T23:13:58.030 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.030 DEBUG:boto:Data: 2023-12-15T23:13:58.030 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.031 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.031 DEBUG:boto:Params: {} 2023-12-15T23:13:58.031 DEBUG:boto:Token: None 2023-12-15T23:13:58.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd5697832a9337fa-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.033 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.034 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.034 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.034 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.034 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.034 DEBUG:boto:Data: 2023-12-15T23:13:58.034 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.034 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.034 DEBUG:boto:Params: {} 2023-12-15T23:13:58.034 DEBUG:boto:Token: None 2023-12-15T23:13:58.035 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YdSZbPQHHZ2bC9P6XsQ4DhV6GKQ= 2023-12-15T23:13:58.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YdSZbPQHHZ2bC9P6XsQ4DhV6GKQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000111cc546ab44f06-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.037 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.037 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.037 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.037 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.037 DEBUG:boto:Data: 2023-12-15T23:13:58.037 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.038 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.038 DEBUG:boto:Params: {} 2023-12-15T23:13:58.038 DEBUG:boto:Token: None 2023-12-15T23:13:58.038 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YdSZbPQHHZ2bC9P6XsQ4DhV6GKQ= 2023-12-15T23:13:58.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YdSZbPQHHZ2bC9P6XsQ4DhV6GKQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d946c7d806bcbbcb-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:13:58.040 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.040 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.040 DEBUG:boto:Method: GET 2023-12-15T23:13:58.040 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.041 DEBUG:boto:Data: 2023-12-15T23:13:58.041 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.041 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.041 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.041 DEBUG:boto:Params: {} 2023-12-15T23:13:58.041 DEBUG:boto:Token: None 2023-12-15T23:13:58.041 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dg2jSoUfLAnGOMhfgjLEMdwIaiU= 2023-12-15T23:13:58.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dg2jSoUfLAnGOMhfgjLEMdwIaiU=', 'Content-Length': '0'} 2023-12-15T23:13:58.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d327b6805bea621-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.085 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.086 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.086 DEBUG:boto:Method: GET 2023-12-15T23:13:58.086 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.086 DEBUG:boto:Data: 2023-12-15T23:13:58.086 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.086 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.086 DEBUG:boto:Params: {} 2023-12-15T23:13:58.086 DEBUG:boto:Token: None 2023-12-15T23:13:58.086 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:13:58.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dg2jSoUfLAnGOMhfgjLEMdwIaiU= 2023-12-15T23:13:58.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dg2jSoUfLAnGOMhfgjLEMdwIaiU=', 'Content-Length': '0'} 2023-12-15T23:13:58.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070ee32c108d52ade-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.089 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.089 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.089 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.089 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.089 DEBUG:boto:Method: GET 2023-12-15T23:13:58.089 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.090 DEBUG:boto:Data: 2023-12-15T23:13:58.090 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.090 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.090 DEBUG:boto:Params: {} 2023-12-15T23:13:58.090 DEBUG:boto:Token: None 2023-12-15T23:13:58.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000615078bb4f0c431d-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.133 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.134 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.134 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.134 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.134 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.134 DEBUG:boto:Method: GET 2023-12-15T23:13:58.134 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:13:58.134 DEBUG:boto:Data: 2023-12-15T23:13:58.134 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.135 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.135 DEBUG:boto:Params: {} 2023-12-15T23:13:58.135 DEBUG:boto:Token: None 2023-12-15T23:13:58.135 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000346bd8d75723addc-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.138 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:13:47.128Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.138 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:13:58.138 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.138 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.138 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.138 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.138 DEBUG:boto:Method: GET 2023-12-15T23:13:58.138 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.138 DEBUG:boto:Data: 2023-12-15T23:13:58.139 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.139 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.139 DEBUG:boto:Params: {} 2023-12-15T23:13:58.139 DEBUG:boto:Token: None 2023-12-15T23:13:58.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ= 2023-12-15T23:13:58.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa4e1f9954c481c1-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.142 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.142 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.142 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.142 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.142 DEBUG:boto:Method: GET 2023-12-15T23:13:58.142 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.142 DEBUG:boto:Data: 2023-12-15T23:13:58.142 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.143 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.143 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.143 DEBUG:boto:Params: {} 2023-12-15T23:13:58.143 DEBUG:boto:Token: None 2023-12-15T23:13:58.143 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ= 2023-12-15T23:13:58.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000433b1ae52dda40c0-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.146 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.146 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.146 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.146 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.146 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.146 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.146 DEBUG:boto:Data: 2023-12-15T23:13:58.146 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.146 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.146 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.146 DEBUG:boto:Params: {} 2023-12-15T23:13:58.147 DEBUG:boto:Token: None 2023-12-15T23:13:58.147 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Ui1Yq5MNOBaF2aq3Fq2nZ6BwD0= 2023-12-15T23:13:58.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Ui1Yq5MNOBaF2aq3Fq2nZ6BwD0=', 'Content-Length': '0'} 2023-12-15T23:13:58.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074b1cf6a388b343a-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.149 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.149 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.149 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.150 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.150 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.150 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.150 DEBUG:boto:Data: 2023-12-15T23:13:58.150 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.150 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.150 DEBUG:boto:Params: {} 2023-12-15T23:13:58.150 DEBUG:boto:Token: None 2023-12-15T23:13:58.150 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Ui1Yq5MNOBaF2aq3Fq2nZ6BwD0= 2023-12-15T23:13:58.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Ui1Yq5MNOBaF2aq3Fq2nZ6BwD0=', 'Content-Length': '0'} 2023-12-15T23:13:58.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000054eaac1ca1ea786-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.153 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:13:58.153 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.153 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.153 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.153 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.153 DEBUG:boto:Method: GET 2023-12-15T23:13:58.154 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.154 DEBUG:boto:Data: 2023-12-15T23:13:58.154 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.154 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.154 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.154 DEBUG:boto:Params: {} 2023-12-15T23:13:58.154 DEBUG:boto:Token: None 2023-12-15T23:13:58.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ= 2023-12-15T23:13:58.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cf77cfa047f7438-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.197 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.198 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.198 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.198 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.198 DEBUG:boto:Method: GET 2023-12-15T23:13:58.198 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.198 DEBUG:boto:Data: 2023-12-15T23:13:58.198 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.198 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.198 DEBUG:boto:Params: {} 2023-12-15T23:13:58.198 DEBUG:boto:Token: None 2023-12-15T23:13:58.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:13:58.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ= 2023-12-15T23:13:58.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4Ga2ip3rWo1X0yny9m7WuO0xpdQ=', 'Content-Length': '0'} 2023-12-15T23:13:58.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a5b01388ff09d4a-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.201 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.201 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.202 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.202 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.202 DEBUG:boto:Method: GET 2023-12-15T23:13:58.202 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.202 DEBUG:boto:Data: 2023-12-15T23:13:58.202 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.202 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.202 DEBUG:boto:Params: {} 2023-12-15T23:13:58.202 DEBUG:boto:Token: None 2023-12-15T23:13:58.202 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007674a6de6f1dd990-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.249 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.250 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.250 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.250 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.250 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.250 DEBUG:boto:Method: GET 2023-12-15T23:13:58.250 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.250 DEBUG:boto:Data: 2023-12-15T23:13:58.250 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.251 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.251 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.251 DEBUG:boto:Params: {} 2023-12-15T23:13:58.251 DEBUG:boto:Token: None 2023-12-15T23:13:58.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046b87cd25934d9d6-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.254 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.254 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.254 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.254 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.254 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.255 DEBUG:boto:Data: 2023-12-15T23:13:58.255 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.255 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.255 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.255 DEBUG:boto:Params: {} 2023-12-15T23:13:58.255 DEBUG:boto:Token: None 2023-12-15T23:13:58.255 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ABpiOnfOTDjE1sK10O/tRy4XZp0= 2023-12-15T23:13:58.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ABpiOnfOTDjE1sK10O/tRy4XZp0=', 'Content-Length': '0'} 2023-12-15T23:13:58.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075e0e592287e1501-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.258 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.258 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.258 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.258 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.258 DEBUG:boto:Data: 2023-12-15T23:13:58.258 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.258 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.258 DEBUG:boto:Params: {} 2023-12-15T23:13:58.258 DEBUG:boto:Token: None 2023-12-15T23:13:58.258 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ABpiOnfOTDjE1sK10O/tRy4XZp0= 2023-12-15T23:13:58.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ABpiOnfOTDjE1sK10O/tRy4XZp0=', 'Content-Length': '0'} 2023-12-15T23:13:58.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6efa40d623acb2d-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:13:58.261 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.261 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.261 DEBUG:boto:Method: GET 2023-12-15T23:13:58.261 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.261 DEBUG:boto:Data: 2023-12-15T23:13:58.261 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.262 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.262 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.262 DEBUG:boto:Params: {} 2023-12-15T23:13:58.262 DEBUG:boto:Token: None 2023-12-15T23:13:58.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0N8z/bT+UMOzKNrxl72aBdlcH+E= 2023-12-15T23:13:58.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0N8z/bT+UMOzKNrxl72aBdlcH+E=', 'Content-Length': '0'} 2023-12-15T23:13:58.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc968e8e8e7b30f8-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.309 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.310 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.310 DEBUG:boto:Method: GET 2023-12-15T23:13:58.310 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.310 DEBUG:boto:Data: 2023-12-15T23:13:58.310 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.310 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.310 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.310 DEBUG:boto:Params: {} 2023-12-15T23:13:58.310 DEBUG:boto:Token: None 2023-12-15T23:13:58.310 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:13:58.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0N8z/bT+UMOzKNrxl72aBdlcH+E= 2023-12-15T23:13:58.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0N8z/bT+UMOzKNrxl72aBdlcH+E=', 'Content-Length': '0'} 2023-12-15T23:13:58.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000605fd33ce4ccb015-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.313 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.313 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.313 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.313 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.313 DEBUG:boto:Method: GET 2023-12-15T23:13:58.314 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.314 DEBUG:boto:Data: 2023-12-15T23:13:58.314 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.314 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.314 DEBUG:boto:Params: {} 2023-12-15T23:13:58.314 DEBUG:boto:Token: None 2023-12-15T23:13:58.314 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022f37dc833c05af5-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.317 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.317 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.318 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.318 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.318 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.318 DEBUG:boto:Method: GET 2023-12-15T23:13:58.318 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:13:58.318 DEBUG:boto:Data: 2023-12-15T23:13:58.318 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.318 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.318 DEBUG:boto:Params: {} 2023-12-15T23:13:58.318 DEBUG:boto:Token: None 2023-12-15T23:13:58.319 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008eda19d2e645930-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.321 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:13:46.938Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:13:58.322 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.322 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.322 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.322 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.322 DEBUG:boto:Method: GET 2023-12-15T23:13:58.322 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.322 DEBUG:boto:Data: 2023-12-15T23:13:58.322 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.322 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.322 DEBUG:boto:Params: {} 2023-12-15T23:13:58.322 DEBUG:boto:Token: None 2023-12-15T23:13:58.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0= 2023-12-15T23:13:58.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0=', 'Content-Length': '0'} 2023-12-15T23:13:58.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085ffae49921a52bc-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.325 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.325 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.325 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.326 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.326 DEBUG:boto:Method: GET 2023-12-15T23:13:58.326 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.326 DEBUG:boto:Data: 2023-12-15T23:13:58.326 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.326 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.326 DEBUG:boto:Params: {} 2023-12-15T23:13:58.326 DEBUG:boto:Token: None 2023-12-15T23:13:58.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0= 2023-12-15T23:13:58.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0=', 'Content-Length': '0'} 2023-12-15T23:13:58.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c78b89e0160a3b6-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.329 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.329 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.329 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.329 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.329 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.329 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.329 DEBUG:boto:Data: 2023-12-15T23:13:58.329 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.329 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.329 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.329 DEBUG:boto:Params: {} 2023-12-15T23:13:58.330 DEBUG:boto:Token: None 2023-12-15T23:13:58.330 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YRoGkjFgZRZrfyVzwjcX9BkFR8Q= 2023-12-15T23:13:58.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YRoGkjFgZRZrfyVzwjcX9BkFR8Q=', 'Content-Length': '0'} 2023-12-15T23:13:58.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000159516ce07c45955-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.332 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.332 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.333 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.333 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.333 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.333 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.333 DEBUG:boto:Data: 2023-12-15T23:13:58.333 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.333 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.333 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.333 DEBUG:boto:Params: {} 2023-12-15T23:13:58.333 DEBUG:boto:Token: None 2023-12-15T23:13:58.333 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YRoGkjFgZRZrfyVzwjcX9BkFR8Q= 2023-12-15T23:13:58.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YRoGkjFgZRZrfyVzwjcX9BkFR8Q=', 'Content-Length': '0'} 2023-12-15T23:13:58.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016058dd2b52e503b-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:13:58.336 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.336 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.336 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.336 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.336 DEBUG:boto:Method: GET 2023-12-15T23:13:58.336 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.336 DEBUG:boto:Data: 2023-12-15T23:13:58.336 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.337 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.337 DEBUG:boto:Params: {} 2023-12-15T23:13:58.337 DEBUG:boto:Token: None 2023-12-15T23:13:58.337 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0= 2023-12-15T23:13:58.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0=', 'Content-Length': '0'} 2023-12-15T23:13:58.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c91250c8fea593d6-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.381 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.381 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.382 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.382 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.382 DEBUG:boto:Method: GET 2023-12-15T23:13:58.382 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.382 DEBUG:boto:Data: 2023-12-15T23:13:58.382 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.382 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.382 DEBUG:boto:Params: {} 2023-12-15T23:13:58.382 DEBUG:boto:Token: None 2023-12-15T23:13:58.382 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:13:58.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0= 2023-12-15T23:13:58.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uVQPKivHf8yNEAnpavjR3qlJbE0=', 'Content-Length': '0'} 2023-12-15T23:13:58.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002eff084116f2594a-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.384 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.385 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.385 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.385 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.385 DEBUG:boto:Method: GET 2023-12-15T23:13:58.385 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.385 DEBUG:boto:Data: 2023-12-15T23:13:58.385 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.385 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.385 DEBUG:boto:Params: {} 2023-12-15T23:13:58.385 DEBUG:boto:Token: None 2023-12-15T23:13:58.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aed85d0dc22b8eef-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.430 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.430 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.430 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.430 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.430 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.430 DEBUG:boto:Method: GET 2023-12-15T23:13:58.430 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.431 DEBUG:boto:Data: 2023-12-15T23:13:58.431 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.431 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.431 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.431 DEBUG:boto:Params: {} 2023-12-15T23:13:58.431 DEBUG:boto:Token: None 2023-12-15T23:13:58.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f226cc9c59ef0542-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.434 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.434 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.435 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.435 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.435 DEBUG:boto:Data: 2023-12-15T23:13:58.435 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.435 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.435 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.435 DEBUG:boto:Params: {} 2023-12-15T23:13:58.435 DEBUG:boto:Token: None 2023-12-15T23:13:58.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xkcufRsw8XKJ6cyM5ubZZjHyuWg= 2023-12-15T23:13:58.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xkcufRsw8XKJ6cyM5ubZZjHyuWg=', 'Content-Length': '0'} 2023-12-15T23:13:58.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000699ad670427f00f0-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.438 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.438 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.438 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.438 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.438 DEBUG:boto:Data: 2023-12-15T23:13:58.438 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.438 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.438 DEBUG:boto:Params: {} 2023-12-15T23:13:58.438 DEBUG:boto:Token: None 2023-12-15T23:13:58.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xkcufRsw8XKJ6cyM5ubZZjHyuWg= 2023-12-15T23:13:58.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xkcufRsw8XKJ6cyM5ubZZjHyuWg=', 'Content-Length': '0'} 2023-12-15T23:13:58.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060249bab063f2b4a-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:13:58.441 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.441 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.441 DEBUG:boto:Method: GET 2023-12-15T23:13:58.441 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.441 DEBUG:boto:Data: 2023-12-15T23:13:58.441 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.441 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.441 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.441 DEBUG:boto:Params: {} 2023-12-15T23:13:58.442 DEBUG:boto:Token: None 2023-12-15T23:13:58.442 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W1EckxDks91/2t2r9oRzKUGms2I= 2023-12-15T23:13:58.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W1EckxDks91/2t2r9oRzKUGms2I=', 'Content-Length': '0'} 2023-12-15T23:13:58.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020838ffab8b5728e-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.485 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.486 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.486 DEBUG:boto:Method: GET 2023-12-15T23:13:58.486 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.486 DEBUG:boto:Data: 2023-12-15T23:13:58.486 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.486 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.486 DEBUG:boto:Params: {} 2023-12-15T23:13:58.486 DEBUG:boto:Token: None 2023-12-15T23:13:58.486 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:13:58.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W1EckxDks91/2t2r9oRzKUGms2I= 2023-12-15T23:13:58.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W1EckxDks91/2t2r9oRzKUGms2I=', 'Content-Length': '0'} 2023-12-15T23:13:58.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a545b6e5f2c14733-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.489 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.489 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.489 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.489 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.489 DEBUG:boto:Method: GET 2023-12-15T23:13:58.489 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.489 DEBUG:boto:Data: 2023-12-15T23:13:58.489 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.489 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.489 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.489 DEBUG:boto:Params: {} 2023-12-15T23:13:58.490 DEBUG:boto:Token: None 2023-12-15T23:13:58.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd5767fd357e3b4e-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.533 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.534 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.534 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.534 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.534 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.534 DEBUG:boto:Method: GET 2023-12-15T23:13:58.534 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:13:58.534 DEBUG:boto:Data: 2023-12-15T23:13:58.534 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.534 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.534 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.535 DEBUG:boto:Params: {} 2023-12-15T23:13:58.535 DEBUG:boto:Token: None 2023-12-15T23:13:58.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f17069e7d0b41eda-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.537 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:13:47.013Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:13:58.538 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.538 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.538 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.538 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.538 DEBUG:boto:Method: GET 2023-12-15T23:13:58.538 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.538 DEBUG:boto:Data: 2023-12-15T23:13:58.538 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.539 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.539 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.539 DEBUG:boto:Params: {} 2023-12-15T23:13:58.539 DEBUG:boto:Token: None 2023-12-15T23:13:58.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E= 2023-12-15T23:13:58.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E=', 'Content-Length': '0'} 2023-12-15T23:13:58.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026398d49fff05fe5-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.541 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.542 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.542 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.542 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.542 DEBUG:boto:Method: GET 2023-12-15T23:13:58.542 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.542 DEBUG:boto:Data: 2023-12-15T23:13:58.542 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.542 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.542 DEBUG:boto:Params: {} 2023-12-15T23:13:58.543 DEBUG:boto:Token: None 2023-12-15T23:13:58.543 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E= 2023-12-15T23:13:58.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E=', 'Content-Length': '0'} 2023-12-15T23:13:58.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2212db817ffb6cd-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.585 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.586 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.586 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.586 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.586 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.586 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.586 DEBUG:boto:Data: 2023-12-15T23:13:58.586 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.586 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.586 DEBUG:boto:Params: {} 2023-12-15T23:13:58.586 DEBUG:boto:Token: None 2023-12-15T23:13:58.587 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oiBsOCN2Mw35rQxjz4IJZg+U0fU= 2023-12-15T23:13:58.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oiBsOCN2Mw35rQxjz4IJZg+U0fU=', 'Content-Length': '0'} 2023-12-15T23:13:58.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd3faf2e0b10e260-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.589 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.589 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.589 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.589 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.589 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.589 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.589 DEBUG:boto:Data: 2023-12-15T23:13:58.589 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.590 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.590 DEBUG:boto:Params: {} 2023-12-15T23:13:58.590 DEBUG:boto:Token: None 2023-12-15T23:13:58.590 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oiBsOCN2Mw35rQxjz4IJZg+U0fU= 2023-12-15T23:13:58.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oiBsOCN2Mw35rQxjz4IJZg+U0fU=', 'Content-Length': '0'} 2023-12-15T23:13:58.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000453e7355f913a67b-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:13:58.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.593 DEBUG:boto:Method: GET 2023-12-15T23:13:58.593 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.593 DEBUG:boto:Data: 2023-12-15T23:13:58.593 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.593 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.593 DEBUG:boto:Params: {} 2023-12-15T23:13:58.593 DEBUG:boto:Token: None 2023-12-15T23:13:58.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E= 2023-12-15T23:13:58.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E=', 'Content-Length': '0'} 2023-12-15T23:13:58.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a6f5c87208b7907-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.637 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.638 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.638 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.638 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.638 DEBUG:boto:Method: GET 2023-12-15T23:13:58.638 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.638 DEBUG:boto:Data: 2023-12-15T23:13:58.638 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.639 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.639 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.639 DEBUG:boto:Params: {} 2023-12-15T23:13:58.639 DEBUG:boto:Token: None 2023-12-15T23:13:58.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:13:58.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E= 2023-12-15T23:13:58.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m6XO1Gm4eU5RKcwz0eVDcmsgd9E=', 'Content-Length': '0'} 2023-12-15T23:13:58.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f95bc8980c3a0c3-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.641 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.641 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.641 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.642 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.642 DEBUG:boto:Method: GET 2023-12-15T23:13:58.642 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.642 DEBUG:boto:Data: 2023-12-15T23:13:58.642 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.642 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.642 DEBUG:boto:Params: {} 2023-12-15T23:13:58.642 DEBUG:boto:Token: None 2023-12-15T23:13:58.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b2a789cd5fff45e-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.645 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.645 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.646 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.646 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.646 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.646 DEBUG:boto:Method: GET 2023-12-15T23:13:58.646 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.646 DEBUG:boto:Data: 2023-12-15T23:13:58.646 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.646 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.646 DEBUG:boto:Params: {} 2023-12-15T23:13:58.646 DEBUG:boto:Token: None 2023-12-15T23:13:58.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d05e3c8c743c076-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.649 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.649 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.650 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.650 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.650 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.650 DEBUG:boto:Data: 2023-12-15T23:13:58.650 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.650 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.650 DEBUG:boto:Params: {} 2023-12-15T23:13:58.650 DEBUG:boto:Token: None 2023-12-15T23:13:58.650 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAlTCrB41XSVJ9U9aiHqnTtyNPc= 2023-12-15T23:13:58.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAlTCrB41XSVJ9U9aiHqnTtyNPc=', 'Content-Length': '0'} 2023-12-15T23:13:58.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac7fa7a6afb367c1-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.653 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.653 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.653 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.653 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.653 DEBUG:boto:Data: 2023-12-15T23:13:58.653 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.653 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.653 DEBUG:boto:Params: {} 2023-12-15T23:13:58.654 DEBUG:boto:Token: None 2023-12-15T23:13:58.654 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mAlTCrB41XSVJ9U9aiHqnTtyNPc= 2023-12-15T23:13:58.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mAlTCrB41XSVJ9U9aiHqnTtyNPc=', 'Content-Length': '0'} 2023-12-15T23:13:58.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6cd15da2979974c-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:13:58.656 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.656 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.656 DEBUG:boto:Method: GET 2023-12-15T23:13:58.656 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.656 DEBUG:boto:Data: 2023-12-15T23:13:58.656 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.656 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.656 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.656 DEBUG:boto:Params: {} 2023-12-15T23:13:58.656 DEBUG:boto:Token: None 2023-12-15T23:13:58.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B7snnkJJLaRDSdgwa73RgY9Cu3E= 2023-12-15T23:13:58.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B7snnkJJLaRDSdgwa73RgY9Cu3E=', 'Content-Length': '0'} 2023-12-15T23:13:58.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb013a810f4eaf7a-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.701 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.702 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.702 DEBUG:boto:Method: GET 2023-12-15T23:13:58.702 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.702 DEBUG:boto:Data: 2023-12-15T23:13:58.702 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.702 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.702 DEBUG:boto:Params: {} 2023-12-15T23:13:58.702 DEBUG:boto:Token: None 2023-12-15T23:13:58.702 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:13:58.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B7snnkJJLaRDSdgwa73RgY9Cu3E= 2023-12-15T23:13:58.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B7snnkJJLaRDSdgwa73RgY9Cu3E=', 'Content-Length': '0'} 2023-12-15T23:13:58.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089d0256f595539a2-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.704 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.705 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.705 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.705 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.705 DEBUG:boto:Method: GET 2023-12-15T23:13:58.705 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.705 DEBUG:boto:Data: 2023-12-15T23:13:58.705 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.705 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.705 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.705 DEBUG:boto:Params: {} 2023-12-15T23:13:58.706 DEBUG:boto:Token: None 2023-12-15T23:13:58.706 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.708 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000950c1b82c796614b-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.749 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.750 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.750 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.750 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.750 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.750 DEBUG:boto:Method: GET 2023-12-15T23:13:58.750 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:13:58.750 DEBUG:boto:Data: 2023-12-15T23:13:58.751 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.751 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.751 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.751 DEBUG:boto:Params: {} 2023-12-15T23:13:58.751 DEBUG:boto:Token: None 2023-12-15T23:13:58.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.754 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034b78175244b0430-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.754 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:13:47.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:13:58.754 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.754 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.754 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.754 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.755 DEBUG:boto:Method: GET 2023-12-15T23:13:58.755 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.755 DEBUG:boto:Data: 2023-12-15T23:13:58.755 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.755 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.755 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.755 DEBUG:boto:Params: {} 2023-12-15T23:13:58.755 DEBUG:boto:Token: None 2023-12-15T23:13:58.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY= 2023-12-15T23:13:58.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY=', 'Content-Length': '0'} 2023-12-15T23:13:58.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e532d0c2c1879cf4-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.757 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.758 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.758 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.758 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.758 DEBUG:boto:Method: GET 2023-12-15T23:13:58.758 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.758 DEBUG:boto:Data: 2023-12-15T23:13:58.758 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.758 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.758 DEBUG:boto:Params: {} 2023-12-15T23:13:58.758 DEBUG:boto:Token: None 2023-12-15T23:13:58.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY= 2023-12-15T23:13:58.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY=', 'Content-Length': '0'} 2023-12-15T23:13:58.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001631283991cb6588-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.761 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.761 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.761 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.761 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.761 DEBUG:boto:Data: 2023-12-15T23:13:58.761 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.762 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.762 DEBUG:boto:Params: {} 2023-12-15T23:13:58.762 DEBUG:boto:Token: None 2023-12-15T23:13:58.762 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6H8uTXaRSjdaSKQ8Gi9MR8nyncI= 2023-12-15T23:13:58.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6H8uTXaRSjdaSKQ8Gi9MR8nyncI=', 'Content-Length': '0'} 2023-12-15T23:13:58.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4bc97952017c63c-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.764 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.764 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.764 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.764 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.765 DEBUG:boto:Data: 2023-12-15T23:13:58.765 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.765 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.765 DEBUG:boto:Params: {} 2023-12-15T23:13:58.765 DEBUG:boto:Token: None 2023-12-15T23:13:58.765 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6H8uTXaRSjdaSKQ8Gi9MR8nyncI= 2023-12-15T23:13:58.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6H8uTXaRSjdaSKQ8Gi9MR8nyncI=', 'Content-Length': '0'} 2023-12-15T23:13:58.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089ae155a6141d46d-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:13:58.767 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.768 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.768 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.768 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.768 DEBUG:boto:Method: GET 2023-12-15T23:13:58.768 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.768 DEBUG:boto:Data: 2023-12-15T23:13:58.768 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.768 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.768 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.768 DEBUG:boto:Params: {} 2023-12-15T23:13:58.768 DEBUG:boto:Token: None 2023-12-15T23:13:58.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY= 2023-12-15T23:13:58.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY=', 'Content-Length': '0'} 2023-12-15T23:13:58.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006643003f58800058-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.813 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.814 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.814 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.814 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.814 DEBUG:boto:Method: GET 2023-12-15T23:13:58.814 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.814 DEBUG:boto:Data: 2023-12-15T23:13:58.814 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.814 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.814 DEBUG:boto:Params: {} 2023-12-15T23:13:58.815 DEBUG:boto:Token: None 2023-12-15T23:13:58.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:13:58.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY= 2023-12-15T23:13:58.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nwTelDQvZjDinI82al9w3WcgWXY=', 'Content-Length': '0'} 2023-12-15T23:13:58.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080fae4292b493eb1-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.817 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.817 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.817 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.817 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.817 DEBUG:boto:Method: GET 2023-12-15T23:13:58.818 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.818 DEBUG:boto:Data: 2023-12-15T23:13:58.818 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.818 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.818 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.818 DEBUG:boto:Params: {} 2023-12-15T23:13:58.818 DEBUG:boto:Token: None 2023-12-15T23:13:58.818 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052290a69403259de-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.821 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.822 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.822 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.822 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.822 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.822 DEBUG:boto:Method: GET 2023-12-15T23:13:58.822 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.822 DEBUG:boto:Data: 2023-12-15T23:13:58.822 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.822 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.822 DEBUG:boto:Params: {} 2023-12-15T23:13:58.822 DEBUG:boto:Token: None 2023-12-15T23:13:58.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ed2c65b446f90cf-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.825 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.825 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.825 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.826 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.826 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.826 DEBUG:boto:Data: 2023-12-15T23:13:58.826 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.826 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.826 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.826 DEBUG:boto:Params: {} 2023-12-15T23:13:58.826 DEBUG:boto:Token: None 2023-12-15T23:13:58.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7RWINIVvQKuH9cXNaHd12q9DeJw= 2023-12-15T23:13:58.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7RWINIVvQKuH9cXNaHd12q9DeJw=', 'Content-Length': '0'} 2023-12-15T23:13:58.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097340ef258b4d03c-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.829 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.829 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.829 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.829 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.829 DEBUG:boto:Data: 2023-12-15T23:13:58.829 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.829 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.829 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.829 DEBUG:boto:Params: {} 2023-12-15T23:13:58.829 DEBUG:boto:Token: None 2023-12-15T23:13:58.832 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.833 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7RWINIVvQKuH9cXNaHd12q9DeJw= 2023-12-15T23:13:58.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7RWINIVvQKuH9cXNaHd12q9DeJw=', 'Content-Length': '0'} 2023-12-15T23:13:58.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008166cc05021fd8b8-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.835 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:13:58.835 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.835 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.835 DEBUG:boto:Method: GET 2023-12-15T23:13:58.835 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.835 DEBUG:boto:Data: 2023-12-15T23:13:58.836 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.836 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.836 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.836 DEBUG:boto:Params: {} 2023-12-15T23:13:58.836 DEBUG:boto:Token: None 2023-12-15T23:13:58.836 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.836 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cFqLn+n/UtOsq4f6ec1QZpI6Sk= 2023-12-15T23:13:58.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cFqLn+n/UtOsq4f6ec1QZpI6Sk=', 'Content-Length': '0'} 2023-12-15T23:13:58.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bf0c5ce28d3f2a1-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.881 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.882 DEBUG:boto:Method: GET 2023-12-15T23:13:58.882 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.882 DEBUG:boto:Data: 2023-12-15T23:13:58.882 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.882 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.882 DEBUG:boto:Params: {} 2023-12-15T23:13:58.882 DEBUG:boto:Token: None 2023-12-15T23:13:58.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:13:58.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cFqLn+n/UtOsq4f6ec1QZpI6Sk= 2023-12-15T23:13:58.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cFqLn+n/UtOsq4f6ec1QZpI6Sk=', 'Content-Length': '0'} 2023-12-15T23:13:58.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1315451966b6ab6-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.885 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.886 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.886 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.886 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.886 DEBUG:boto:Method: GET 2023-12-15T23:13:58.886 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.886 DEBUG:boto:Data: 2023-12-15T23:13:58.886 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.886 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.886 DEBUG:boto:Params: {} 2023-12-15T23:13:58.886 DEBUG:boto:Token: None 2023-12-15T23:13:58.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.889 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abefce37e9db01bd-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.929 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.930 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:58.930 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:58.930 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.930 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.930 DEBUG:boto:Method: GET 2023-12-15T23:13:58.930 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:13:58.930 DEBUG:boto:Data: 2023-12-15T23:13:58.930 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.930 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.931 DEBUG:boto:Params: {} 2023-12-15T23:13:58.931 DEBUG:boto:Token: None 2023-12-15T23:13:58.931 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/ 2023-12-15T23:13:58.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU= 2023-12-15T23:13:58.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZFxwf5oAvzNuSfYKIcC8AyYgVU=', 'Content-Length': '0'} 2023-12-15T23:13:58.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a482899f5a2adae4-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.934 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:13:46.927Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:58.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:13:58.934 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.934 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.934 DEBUG:boto:Method: GET 2023-12-15T23:13:58.934 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.935 DEBUG:boto:Data: 2023-12-15T23:13:58.935 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.935 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.935 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.935 DEBUG:boto:Params: {} 2023-12-15T23:13:58.935 DEBUG:boto:Token: None 2023-12-15T23:13:58.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4= 2023-12-15T23:13:58.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4=', 'Content-Length': '0'} 2023-12-15T23:13:58.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b875ddd7a2a3ae2-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.938 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.938 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.938 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.938 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.938 DEBUG:boto:Method: GET 2023-12-15T23:13:58.938 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.938 DEBUG:boto:Data: 2023-12-15T23:13:58.938 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.938 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.939 DEBUG:boto:Params: {} 2023-12-15T23:13:58.939 DEBUG:boto:Token: None 2023-12-15T23:13:58.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4= 2023-12-15T23:13:58.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4=', 'Content-Length': '0'} 2023-12-15T23:13:58.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0897ef663b99906-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.981 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.981 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.982 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.982 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.982 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.982 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.982 DEBUG:boto:Data: 2023-12-15T23:13:58.982 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.982 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.982 DEBUG:boto:Params: {} 2023-12-15T23:13:58.982 DEBUG:boto:Token: None 2023-12-15T23:13:58.983 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vbN+Whsc8bjrqeV/Vj8ni6ka1Tw= 2023-12-15T23:13:58.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vbN+Whsc8bjrqeV/Vj8ni6ka1Tw=', 'Content-Length': '0'} 2023-12-15T23:13:58.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cbe9871b71a7407-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.985 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.985 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.985 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.985 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.985 DEBUG:boto:Method: HEAD 2023-12-15T23:13:58.985 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.985 DEBUG:boto:Data: 2023-12-15T23:13:58.986 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:58.986 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.986 DEBUG:boto:Params: {} 2023-12-15T23:13:58.986 DEBUG:boto:Token: None 2023-12-15T23:13:58.986 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vbN+Whsc8bjrqeV/Vj8ni6ka1Tw= 2023-12-15T23:13:58.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vbN+Whsc8bjrqeV/Vj8ni6ka1Tw=', 'Content-Length': '0'} 2023-12-15T23:13:58.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000389f95ea87d912a9-00657cddb6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:58.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:13:58.989 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.989 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:58.989 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.989 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.989 DEBUG:boto:Method: GET 2023-12-15T23:13:58.989 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.989 DEBUG:boto:Data: 2023-12-15T23:13:58.989 DEBUG:boto:Headers: {} 2023-12-15T23:13:58.989 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:58.989 DEBUG:boto:Port: 8000 2023-12-15T23:13:58.989 DEBUG:boto:Params: {} 2023-12-15T23:13:58.990 DEBUG:boto:Token: None 2023-12-15T23:13:58.990 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:58 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:58.990 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4= 2023-12-15T23:13:58.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QhCh+BdnUn4PDWgXvu2Xq+8FVf4=', 'Content-Length': '0'} 2023-12-15T23:13:58.992 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b16c0ded9462a7c-00657cddb6-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.033 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.036 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.036 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:59.036 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:59.036 DEBUG:boto:Method: GET 2023-12-15T23:13:59.037 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:59.037 DEBUG:boto:Data: 2023-12-15T23:13:59.037 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.037 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.037 DEBUG:boto:Params: {} 2023-12-15T23:13:59.037 DEBUG:boto:Token: None 2023-12-15T23:13:59.037 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:13:59.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nURAp86RLDjAXGzvQwvBz6jw3fw= 2023-12-15T23:13:59.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nURAp86RLDjAXGzvQwvBz6jw3fw=', 'Content-Length': '0'} 2023-12-15T23:13:59.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3a3030217ac4e26-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.040 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.040 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.040 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.040 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.040 DEBUG:boto:Method: GET 2023-12-15T23:13:59.040 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.040 DEBUG:boto:Data: 2023-12-15T23:13:59.040 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.040 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.041 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.041 DEBUG:boto:Params: {} 2023-12-15T23:13:59.041 DEBUG:boto:Token: None 2023-12-15T23:13:59.041 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.043 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a3c3ef6e9a50225-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.044 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.044 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.044 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.045 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.045 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.045 DEBUG:boto:Method: GET 2023-12-15T23:13:59.045 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.045 DEBUG:boto:Data: 2023-12-15T23:13:59.045 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.045 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.045 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.045 DEBUG:boto:Params: {} 2023-12-15T23:13:59.045 DEBUG:boto:Token: None 2023-12-15T23:13:59.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.048 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ac0f8cd5b196095-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.048 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.049 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.049 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.049 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.049 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.049 DEBUG:boto:Data: 2023-12-15T23:13:59.049 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.049 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.049 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.049 DEBUG:boto:Params: {} 2023-12-15T23:13:59.049 DEBUG:boto:Token: None 2023-12-15T23:13:59.050 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MgvtieYS5CpGC0WDVQPNJYaEXZQ= 2023-12-15T23:13:59.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MgvtieYS5CpGC0WDVQPNJYaEXZQ=', 'Content-Length': '0'} 2023-12-15T23:13:59.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007af1d23a487c7ac3-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.052 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.052 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.052 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.052 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.052 DEBUG:boto:Data: 2023-12-15T23:13:59.052 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.052 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.052 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.053 DEBUG:boto:Params: {} 2023-12-15T23:13:59.053 DEBUG:boto:Token: None 2023-12-15T23:13:59.053 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.053 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MgvtieYS5CpGC0WDVQPNJYaEXZQ= 2023-12-15T23:13:59.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MgvtieYS5CpGC0WDVQPNJYaEXZQ=', 'Content-Length': '0'} 2023-12-15T23:13:59.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001771ec6892e82967-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:13:59.056 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.056 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.056 DEBUG:boto:Method: GET 2023-12-15T23:13:59.056 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.056 DEBUG:boto:Data: 2023-12-15T23:13:59.056 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.056 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.056 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.056 DEBUG:boto:Params: {} 2023-12-15T23:13:59.057 DEBUG:boto:Token: None 2023-12-15T23:13:59.057 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.057 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cI6zdykz/WSD1iNHa2TiOjz6yGY= 2023-12-15T23:13:59.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cI6zdykz/WSD1iNHa2TiOjz6yGY=', 'Content-Length': '0'} 2023-12-15T23:13:59.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab37fb6fa3db798b-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.101 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.102 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.102 DEBUG:boto:Method: GET 2023-12-15T23:13:59.102 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.102 DEBUG:boto:Data: 2023-12-15T23:13:59.102 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.102 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.102 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.102 DEBUG:boto:Params: {} 2023-12-15T23:13:59.102 DEBUG:boto:Token: None 2023-12-15T23:13:59.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:13:59.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cI6zdykz/WSD1iNHa2TiOjz6yGY= 2023-12-15T23:13:59.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cI6zdykz/WSD1iNHa2TiOjz6yGY=', 'Content-Length': '0'} 2023-12-15T23:13:59.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baf1b6b2ba5f35b0-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.105 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.105 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.105 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.105 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.106 DEBUG:boto:Method: GET 2023-12-15T23:13:59.106 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.106 DEBUG:boto:Data: 2023-12-15T23:13:59.106 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.106 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.106 DEBUG:boto:Params: {} 2023-12-15T23:13:59.106 DEBUG:boto:Token: None 2023-12-15T23:13:59.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009be6894908e6758e-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.149 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.150 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.150 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.150 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.150 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.150 DEBUG:boto:Method: GET 2023-12-15T23:13:59.150 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:13:59.150 DEBUG:boto:Data: 2023-12-15T23:13:59.151 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.151 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.151 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.151 DEBUG:boto:Params: {} 2023-12-15T23:13:59.151 DEBUG:boto:Token: None 2023-12-15T23:13:59.151 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf64ede578ec0659-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.154 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:13:46.874Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:13:59.154 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.154 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.154 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.155 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.155 DEBUG:boto:Method: GET 2023-12-15T23:13:59.155 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.155 DEBUG:boto:Data: 2023-12-15T23:13:59.155 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.155 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.155 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.155 DEBUG:boto:Params: {} 2023-12-15T23:13:59.155 DEBUG:boto:Token: None 2023-12-15T23:13:59.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.156 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE= 2023-12-15T23:13:59.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE=', 'Content-Length': '0'} 2023-12-15T23:13:59.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae739edf97bb0b3c-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.158 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.158 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.158 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.158 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.158 DEBUG:boto:Method: GET 2023-12-15T23:13:59.158 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.158 DEBUG:boto:Data: 2023-12-15T23:13:59.158 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.159 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.159 DEBUG:boto:Params: {} 2023-12-15T23:13:59.159 DEBUG:boto:Token: None 2023-12-15T23:13:59.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE= 2023-12-15T23:13:59.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE=', 'Content-Length': '0'} 2023-12-15T23:13:59.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8f65b80280c519f-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.161 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.161 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.162 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.162 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.162 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.162 DEBUG:boto:Data: 2023-12-15T23:13:59.162 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.162 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.162 DEBUG:boto:Params: {} 2023-12-15T23:13:59.162 DEBUG:boto:Token: None 2023-12-15T23:13:59.163 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1R2CLrE8MaUd+d7La6+8d7bidrg= 2023-12-15T23:13:59.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1R2CLrE8MaUd+d7La6+8d7bidrg=', 'Content-Length': '0'} 2023-12-15T23:13:59.164 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5274119f3abe685-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.165 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.165 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.165 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.165 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.165 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.165 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.165 DEBUG:boto:Data: 2023-12-15T23:13:59.166 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.166 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.166 DEBUG:boto:Params: {} 2023-12-15T23:13:59.166 DEBUG:boto:Token: None 2023-12-15T23:13:59.166 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.166 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1R2CLrE8MaUd+d7La6+8d7bidrg= 2023-12-15T23:13:59.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1R2CLrE8MaUd+d7La6+8d7bidrg=', 'Content-Length': '0'} 2023-12-15T23:13:59.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089db85fdaf07ccb9-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:13:59.168 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.168 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.169 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.169 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.169 DEBUG:boto:Method: GET 2023-12-15T23:13:59.169 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.169 DEBUG:boto:Data: 2023-12-15T23:13:59.169 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.169 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.169 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.169 DEBUG:boto:Params: {} 2023-12-15T23:13:59.169 DEBUG:boto:Token: None 2023-12-15T23:13:59.170 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.170 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE= 2023-12-15T23:13:59.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE=', 'Content-Length': '0'} 2023-12-15T23:13:59.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c62d73528b4afdc-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.213 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.213 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.214 DEBUG:boto:Method: GET 2023-12-15T23:13:59.214 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.214 DEBUG:boto:Data: 2023-12-15T23:13:59.214 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.214 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.214 DEBUG:boto:Params: {} 2023-12-15T23:13:59.214 DEBUG:boto:Token: None 2023-12-15T23:13:59.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:13:59.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE= 2023-12-15T23:13:59.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PmYQC2bVPQ+MukyjKjdLJbNXrfE=', 'Content-Length': '0'} 2023-12-15T23:13:59.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1178fd59f6d8d3c-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.217 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.217 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.217 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.217 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.217 DEBUG:boto:Method: GET 2023-12-15T23:13:59.218 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.218 DEBUG:boto:Data: 2023-12-15T23:13:59.218 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.218 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.218 DEBUG:boto:Params: {} 2023-12-15T23:13:59.218 DEBUG:boto:Token: None 2023-12-15T23:13:59.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091207a0311d52e45-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.261 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.262 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.262 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.262 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.262 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.262 DEBUG:boto:Method: GET 2023-12-15T23:13:59.262 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.262 DEBUG:boto:Data: 2023-12-15T23:13:59.262 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.263 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.263 DEBUG:boto:Params: {} 2023-12-15T23:13:59.263 DEBUG:boto:Token: None 2023-12-15T23:13:59.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9d9225fd55ddb92-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.266 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.266 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.266 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.266 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.266 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.266 DEBUG:boto:Data: 2023-12-15T23:13:59.266 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.267 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.267 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.267 DEBUG:boto:Params: {} 2023-12-15T23:13:59.267 DEBUG:boto:Token: None 2023-12-15T23:13:59.267 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upHA8DeEnzXtTMiFHGfbqXWrBvs= 2023-12-15T23:13:59.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upHA8DeEnzXtTMiFHGfbqXWrBvs=', 'Content-Length': '0'} 2023-12-15T23:13:59.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ddb3c9d1164e0c6-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.269 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.269 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.269 DEBUG:boto:Method: HEAD 2023-12-15T23:13:59.270 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.270 DEBUG:boto:Data: 2023-12-15T23:13:59.270 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.270 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.270 DEBUG:boto:Params: {} 2023-12-15T23:13:59.270 DEBUG:boto:Token: None 2023-12-15T23:13:59.270 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upHA8DeEnzXtTMiFHGfbqXWrBvs= 2023-12-15T23:13:59.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upHA8DeEnzXtTMiFHGfbqXWrBvs=', 'Content-Length': '0'} 2023-12-15T23:13:59.272 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d31e1b37eea4ef3a-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:13:59.273 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.273 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.273 DEBUG:boto:Method: GET 2023-12-15T23:13:59.273 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.273 DEBUG:boto:Data: 2023-12-15T23:13:59.273 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.273 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.274 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.274 DEBUG:boto:Params: {} 2023-12-15T23:13:59.274 DEBUG:boto:Token: None 2023-12-15T23:13:59.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnCTJkczqeeF1bJ5R6FMLpwN2tU= 2023-12-15T23:13:59.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnCTJkczqeeF1bJ5R6FMLpwN2tU=', 'Content-Length': '0'} 2023-12-15T23:13:59.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3683aab92296ce0-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.317 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.317 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.318 DEBUG:boto:Method: GET 2023-12-15T23:13:59.318 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.318 DEBUG:boto:Data: 2023-12-15T23:13:59.318 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.318 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.318 DEBUG:boto:Params: {} 2023-12-15T23:13:59.318 DEBUG:boto:Token: None 2023-12-15T23:13:59.318 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:13:59.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnCTJkczqeeF1bJ5R6FMLpwN2tU= 2023-12-15T23:13:59.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnCTJkczqeeF1bJ5R6FMLpwN2tU=', 'Content-Length': '0'} 2023-12-15T23:13:59.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:13:47 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db1815cb2820e08c-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.321 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.321 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.321 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.321 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.321 DEBUG:boto:Method: GET 2023-12-15T23:13:59.321 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.321 DEBUG:boto:Data: 2023-12-15T23:13:59.321 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:13:59.322 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.322 DEBUG:boto:Params: {} 2023-12-15T23:13:59.322 DEBUG:boto:Token: None 2023-12-15T23:13:59.322 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e610e084a3c871ec-00657cddb7-5178-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.325 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.325 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:13:59.325 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:13:59.325 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.325 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.325 DEBUG:boto:Method: GET 2023-12-15T23:13:59.325 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:13:59.326 DEBUG:boto:Data: 2023-12-15T23:13:59.326 DEBUG:boto:Headers: {} 2023-12-15T23:13:59.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:13:59.326 DEBUG:boto:Port: 8000 2023-12-15T23:13:59.326 DEBUG:boto:Params: {} 2023-12-15T23:13:59.326 DEBUG:boto:Token: None 2023-12-15T23:13:59.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:13:59 GMT /kskgfn-48/ 2023-12-15T23:13:59.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20= 2023-12-15T23:13:59.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:13:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yOMNKNlQlmqkLKBhYSuyU4v9Y20=', 'Content-Length': '0'} 2023-12-15T23:13:59.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009b8cf43e17c0147-00657cddb7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:13:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:13:59.329 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:13:47.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:13:59.329 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-48 zones={test-zone2, test-zone1} 2023-12-15T23:13:59.330 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:13:59.330 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:13:59.331 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:13:59.330+0000 7fa7c9506640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 103598) UID: 0 2023-12-15T23:13:59.331 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:13:59.330+0000 7fa7ccd65880 -1 shutting down 2023-12-15T23:14:05.430 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:14:05.431 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:05.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:05.431 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:05.487 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:05.487 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:05.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:14:05.534 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:05.534 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:05.539 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 10 2023-12-15T23:14:05.581 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:05.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:05.582 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:05.629 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:05.629 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:05.671 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000007","obj00000000000000000016","obj00000000000000000024","obj00000000000000000020","obj00000000000000000028","obj00000000000000000000","obj00000000000000000032","obj00000000000000000001","obj00000000000000000010","obj00000000000000000019","obj00000000000000000013","obj00000000000000000021","obj00000000000000000030","obj00000000000000000026","obj00000000000000000033","obj00000000000000000004","obj00000000000000000076"]} 2023-12-15T23:14:05.671 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.671 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.671 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.671 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.671 DEBUG:boto:Data: 2023-12-15T23:14:05.672 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.672 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.672 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.672 DEBUG:boto:Params: {} 2023-12-15T23:14:05.672 DEBUG:boto:Token: None 2023-12-15T23:14:05.672 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.672 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.675 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5f61d806a4106a9-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.675 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:05.675 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:05.675 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.675 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:05.676 DEBUG:boto:Data: 2023-12-15T23:14:05.676 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.676 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.676 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.676 DEBUG:boto:Params: {} 2023-12-15T23:14:05.676 DEBUG:boto:Token: None 2023-12-15T23:14:05.676 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:05.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PQp1Ibzscuq+fYrrxsNkvQN2pXE= 2023-12-15T23:14:05.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PQp1Ibzscuq+fYrrxsNkvQN2pXE='} 2023-12-15T23:14:05.682 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d412d91072899a4a-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.683 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.683 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.683 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.683 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.683 DEBUG:boto:Data: 2023-12-15T23:14:05.683 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.683 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.683 DEBUG:boto:Params: {} 2023-12-15T23:14:05.684 DEBUG:boto:Token: None 2023-12-15T23:14:05.684 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.684 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.686 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009835207b2efcfdde-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.686 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:05.686 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:05.686 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.686 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:05.686 DEBUG:boto:Data: 2023-12-15T23:14:05.686 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.687 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.687 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.687 DEBUG:boto:Params: {} 2023-12-15T23:14:05.687 DEBUG:boto:Token: None 2023-12-15T23:14:05.687 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:05.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Reac15UKf06AzF2QuM26rq/UvXs= 2023-12-15T23:14:05.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Reac15UKf06AzF2QuM26rq/UvXs='} 2023-12-15T23:14:05.730 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000d40dfe28751ee37-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.730 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.730 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.730 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.730 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.730 DEBUG:boto:Data: 2023-12-15T23:14:05.730 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.730 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.730 DEBUG:boto:Params: {} 2023-12-15T23:14:05.731 DEBUG:boto:Token: None 2023-12-15T23:14:05.731 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.733 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c0b5c66bb917b3bb-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:05.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:05.734 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.734 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:05.734 DEBUG:boto:Data: 2023-12-15T23:14:05.734 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.734 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.734 DEBUG:boto:Params: {} 2023-12-15T23:14:05.734 DEBUG:boto:Token: None 2023-12-15T23:14:05.734 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:05.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qsQPbQkcGjzpKJGtFm35OJvsZRg= 2023-12-15T23:14:05.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qsQPbQkcGjzpKJGtFm35OJvsZRg='} 2023-12-15T23:14:05.743 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ab6bf22d4a23c507-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.743 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.743 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.743 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.743 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.743 DEBUG:boto:Data: 2023-12-15T23:14:05.743 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.743 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.743 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.744 DEBUG:boto:Params: {} 2023-12-15T23:14:05.744 DEBUG:boto:Token: None 2023-12-15T23:14:05.744 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.744 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ad636c59ff3e6e2-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.746 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:05.746 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:05.747 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.747 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:05.747 DEBUG:boto:Data: 2023-12-15T23:14:05.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.747 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.747 DEBUG:boto:Params: {} 2023-12-15T23:14:05.747 DEBUG:boto:Token: None 2023-12-15T23:14:05.747 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:05.748 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bjyhMN8764OnXyz5UU83xv+0BfE= 2023-12-15T23:14:05.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bjyhMN8764OnXyz5UU83xv+0BfE='} 2023-12-15T23:14:05.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000276b824c68c17b58-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.790 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.790 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.790 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.790 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.790 DEBUG:boto:Data: 2023-12-15T23:14:05.790 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.791 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.791 DEBUG:boto:Params: {} 2023-12-15T23:14:05.791 DEBUG:boto:Token: None 2023-12-15T23:14:05.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.793 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000036c1865ddbb3aca2-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.793 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:05.793 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:05.794 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.794 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:05.794 DEBUG:boto:Data: 2023-12-15T23:14:05.794 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.794 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.794 DEBUG:boto:Params: {} 2023-12-15T23:14:05.794 DEBUG:boto:Token: None 2023-12-15T23:14:05.794 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:05.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ytzp00/ucOis8wcYoHRpVOMQub4= 2023-12-15T23:14:05.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ytzp00/ucOis8wcYoHRpVOMQub4='} 2023-12-15T23:14:05.799 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003f70c2df8a51b91f-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.800 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.800 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.800 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.800 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.800 DEBUG:boto:Data: 2023-12-15T23:14:05.800 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.800 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.800 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.800 DEBUG:boto:Params: {} 2023-12-15T23:14:05.800 DEBUG:boto:Token: None 2023-12-15T23:14:05.801 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.801 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.803 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ff59b222b624460-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.803 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:05.804 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:05.804 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.804 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:05.804 DEBUG:boto:Data: 2023-12-15T23:14:05.804 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.804 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.804 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.804 DEBUG:boto:Params: {} 2023-12-15T23:14:05.804 DEBUG:boto:Token: None 2023-12-15T23:14:05.804 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:05.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HbL0t9iYKxwUk9yqrqbJRD4vvBA= 2023-12-15T23:14:05.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HbL0t9iYKxwUk9yqrqbJRD4vvBA='} 2023-12-15T23:14:05.849 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000036f4aaa8960e49df-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.850 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.850 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.850 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.850 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.850 DEBUG:boto:Data: 2023-12-15T23:14:05.850 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.850 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.850 DEBUG:boto:Params: {} 2023-12-15T23:14:05.850 DEBUG:boto:Token: None 2023-12-15T23:14:05.851 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.853 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006be9cb64d4ab3121-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.853 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:05.854 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:05.854 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.854 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:05.854 DEBUG:boto:Data: 2023-12-15T23:14:05.854 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.854 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.854 DEBUG:boto:Params: {} 2023-12-15T23:14:05.854 DEBUG:boto:Token: None 2023-12-15T23:14:05.854 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:05.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w87RpIffTZy3BvPpfzXmWz2fhBI= 2023-12-15T23:14:05.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w87RpIffTZy3BvPpfzXmWz2fhBI='} 2023-12-15T23:14:05.859 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000519261c37c58a747-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.860 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.860 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.860 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.860 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.860 DEBUG:boto:Data: 2023-12-15T23:14:05.860 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.860 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.860 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.860 DEBUG:boto:Params: {} 2023-12-15T23:14:05.860 DEBUG:boto:Token: None 2023-12-15T23:14:05.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.863 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c196f78a365282f3-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.863 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:05.863 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:05.863 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.863 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:05.863 DEBUG:boto:Data: 2023-12-15T23:14:05.863 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.864 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.864 DEBUG:boto:Params: {} 2023-12-15T23:14:05.864 DEBUG:boto:Token: None 2023-12-15T23:14:05.864 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:05.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y1w4+zSwlswZ7wNkITkECUurPnM= 2023-12-15T23:14:05.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y1w4+zSwlswZ7wNkITkECUurPnM='} 2023-12-15T23:14:05.906 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000653df13cf65ba2b9-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.906 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.906 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.906 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.906 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.906 DEBUG:boto:Data: 2023-12-15T23:14:05.906 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.907 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.907 DEBUG:boto:Params: {} 2023-12-15T23:14:05.907 DEBUG:boto:Token: None 2023-12-15T23:14:05.907 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.909 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000890044dabd520eba-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.910 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:05.910 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:05.910 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.910 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:05.910 DEBUG:boto:Data: 2023-12-15T23:14:05.910 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.910 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.910 DEBUG:boto:Params: {} 2023-12-15T23:14:05.910 DEBUG:boto:Token: None 2023-12-15T23:14:05.911 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:05.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:caGpSpyqCOuA0iF/PppuHEpzdFg= 2023-12-15T23:14:05.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:caGpSpyqCOuA0iF/PppuHEpzdFg='} 2023-12-15T23:14:05.917 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c422fea89a83e83-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.917 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.917 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.918 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.918 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.918 DEBUG:boto:Data: 2023-12-15T23:14:05.918 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.918 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.918 DEBUG:boto:Params: {} 2023-12-15T23:14:05.918 DEBUG:boto:Token: None 2023-12-15T23:14:05.918 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.920 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005cc9edc9270e3e85-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.921 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:05.921 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:05.921 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.921 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:05.921 DEBUG:boto:Data: 2023-12-15T23:14:05.921 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.922 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.922 DEBUG:boto:Params: {} 2023-12-15T23:14:05.922 DEBUG:boto:Token: None 2023-12-15T23:14:05.922 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:05.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MVYMsZ6QhS5Gp3XvYCJEL9TUCBc= 2023-12-15T23:14:05.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MVYMsZ6QhS5Gp3XvYCJEL9TUCBc='} 2023-12-15T23:14:05.927 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000861f0873a64de100-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.927 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.927 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.927 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.927 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.927 DEBUG:boto:Data: 2023-12-15T23:14:05.928 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.928 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.928 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.928 DEBUG:boto:Params: {} 2023-12-15T23:14:05.928 DEBUG:boto:Token: None 2023-12-15T23:14:05.928 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.928 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.930 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ac200c36a78628ff-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.931 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:05.931 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:05.931 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.931 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:05.931 DEBUG:boto:Data: 2023-12-15T23:14:05.931 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.931 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.931 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.931 DEBUG:boto:Params: {} 2023-12-15T23:14:05.932 DEBUG:boto:Token: None 2023-12-15T23:14:05.932 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:05.932 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n/zR/2+06011qn1i47v6VSa2WAs= 2023-12-15T23:14:05.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n/zR/2+06011qn1i47v6VSa2WAs='} 2023-12-15T23:14:05.973 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a76cf212255fe820-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.974 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.974 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.974 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.974 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.974 DEBUG:boto:Data: 2023-12-15T23:14:05.974 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.974 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.974 DEBUG:boto:Params: {} 2023-12-15T23:14:05.975 DEBUG:boto:Token: None 2023-12-15T23:14:05.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b87dd75d3997e3f5-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.977 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:05.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:05.978 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.978 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:05.978 DEBUG:boto:Data: 2023-12-15T23:14:05.978 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.978 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.978 DEBUG:boto:Params: {} 2023-12-15T23:14:05.978 DEBUG:boto:Token: None 2023-12-15T23:14:05.979 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:05.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8pFsO20yISrE964RYpn+W7R92tU= 2023-12-15T23:14:05.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8pFsO20yISrE964RYpn+W7R92tU='} 2023-12-15T23:14:05.984 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000933e0fb3d1fc089b-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.984 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.984 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.984 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.985 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.985 DEBUG:boto:Data: 2023-12-15T23:14:05.985 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.985 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.985 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.985 DEBUG:boto:Params: {} 2023-12-15T23:14:05.985 DEBUG:boto:Token: None 2023-12-15T23:14:05.985 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.987 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083eaacd53849476c-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.988 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:05.988 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:05.988 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.988 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:05.988 DEBUG:boto:Data: 2023-12-15T23:14:05.988 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.988 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.988 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.988 DEBUG:boto:Params: {} 2023-12-15T23:14:05.988 DEBUG:boto:Token: None 2023-12-15T23:14:05.989 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:05.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sXR/xN15n+VxpAuy1z+W+BieWaM= 2023-12-15T23:14:05.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sXR/xN15n+VxpAuy1z+W+BieWaM='} 2023-12-15T23:14:05.995 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000073f1d2b2c2ba3fea-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.995 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:05.995 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:05.995 DEBUG:boto:Method: HEAD 2023-12-15T23:14:05.995 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:05.996 DEBUG:boto:Data: 2023-12-15T23:14:05.996 DEBUG:boto:Headers: {} 2023-12-15T23:14:05.996 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.996 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.996 DEBUG:boto:Params: {} 2023-12-15T23:14:05.996 DEBUG:boto:Token: None 2023-12-15T23:14:05.996 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/ 2023-12-15T23:14:05.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8= 2023-12-15T23:14:05.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e8h8tX92nfkDtZ+h6M4G5IIieK8=', 'Content-Length': '0'} 2023-12-15T23:14:05.998 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000371ea7331e6c2993-00657cddbd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:05.998 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:05.998 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:05.999 DEBUG:boto:Method: PUT 2023-12-15T23:14:05.999 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:05.999 DEBUG:boto:Data: 2023-12-15T23:14:05.999 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:05.999 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:05.999 DEBUG:boto:Port: 8000 2023-12-15T23:14:05.999 DEBUG:boto:Params: {} 2023-12-15T23:14:05.999 DEBUG:boto:Token: None 2023-12-15T23:14:05.999 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:05 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:06.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z+xDIoQnixexXyopArX+985nwwg= 2023-12-15T23:14:06.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z+xDIoQnixexXyopArX+985nwwg='} 2023-12-15T23:14:06.042 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006f9b42d4b6164cf-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.042 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.042 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.042 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.042 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.042 DEBUG:boto:Data: 2023-12-15T23:14:06.042 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.042 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.042 DEBUG:boto:Params: {} 2023-12-15T23:14:06.043 DEBUG:boto:Token: None 2023-12-15T23:14:06.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.045 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002597a9e3f9c771c3-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.045 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.045 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.046 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.046 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.046 DEBUG:boto:Data: 2023-12-15T23:14:06.046 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.046 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.046 DEBUG:boto:Params: {} 2023-12-15T23:14:06.046 DEBUG:boto:Token: None 2023-12-15T23:14:06.046 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V1HPyMupGRyT38Atkh2IJXlMc8c= 2023-12-15T23:14:06.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V1HPyMupGRyT38Atkh2IJXlMc8c='} 2023-12-15T23:14:06.053 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009855dc2b787e4edf-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.053 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.053 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.053 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.053 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.054 DEBUG:boto:Data: 2023-12-15T23:14:06.054 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.054 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.054 DEBUG:boto:Params: {} 2023-12-15T23:14:06.054 DEBUG:boto:Token: None 2023-12-15T23:14:06.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.057 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001a2427fe8eeb2787-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.057 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:06.057 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:06.057 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.058 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:06.058 DEBUG:boto:Data: 2023-12-15T23:14:06.058 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.058 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.058 DEBUG:boto:Params: {} 2023-12-15T23:14:06.058 DEBUG:boto:Token: None 2023-12-15T23:14:06.058 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:06.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZuDqYfC1IXWkcBkaMmSIYe9Qzzc= 2023-12-15T23:14:06.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZuDqYfC1IXWkcBkaMmSIYe9Qzzc='} 2023-12-15T23:14:06.064 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c97cbc3f12691a2-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.064 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:06.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:06.064 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:06.113 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:06.113 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:06.157 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:06.157 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:06.165 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 22 2023-12-15T23:14:06.220 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:06.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:06.220 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:06.267 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:06.267 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000005","obj00000000000000000010","obj00000000000000000016","obj00000000000000000021","obj00000000000000000004","obj00000000000000000025","obj00000000000000000030","obj00000000000000000015","obj00000000000000000019","obj00000000000000000003","obj00000000000000000009","obj00000000000000000014","obj00000000000000000012","obj00000000000000000002","obj00000000000000000000","obj00000000000000000006","obj00000000000000000011","obj00000000000000000001","obj00000000000000000007"]} 2023-12-15T23:14:06.308 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.309 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.309 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.309 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.309 DEBUG:boto:Data: 2023-12-15T23:14:06.309 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.309 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.309 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.309 DEBUG:boto:Params: {} 2023-12-15T23:14:06.309 DEBUG:boto:Token: None 2023-12-15T23:14:06.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.312 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb681797702d2c4e-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.313 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:06.313 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:06.313 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.313 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:06.313 DEBUG:boto:Data: 2023-12-15T23:14:06.313 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.313 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.313 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.313 DEBUG:boto:Params: {} 2023-12-15T23:14:06.313 DEBUG:boto:Token: None 2023-12-15T23:14:06.313 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:06.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QWLcBpDeB49MG0pbf6xx+8F4wik= 2023-12-15T23:14:06.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QWLcBpDeB49MG0pbf6xx+8F4wik='} 2023-12-15T23:14:06.320 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b2e06d5e8cedffb-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.320 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.320 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.320 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.320 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.320 DEBUG:boto:Data: 2023-12-15T23:14:06.320 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.321 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.321 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.321 DEBUG:boto:Params: {} 2023-12-15T23:14:06.321 DEBUG:boto:Token: None 2023-12-15T23:14:06.321 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.323 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fcbf422d6e2a3f0a-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.323 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.324 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.324 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.324 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.324 DEBUG:boto:Data: 2023-12-15T23:14:06.324 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.324 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.324 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.324 DEBUG:boto:Params: {} 2023-12-15T23:14:06.324 DEBUG:boto:Token: None 2023-12-15T23:14:06.324 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.324 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3vYIAGKve73RWyPupnm31MSm/Is= 2023-12-15T23:14:06.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3vYIAGKve73RWyPupnm31MSm/Is='} 2023-12-15T23:14:06.370 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bc88637cca5887b5-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.370 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.370 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.370 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.370 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.370 DEBUG:boto:Data: 2023-12-15T23:14:06.370 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.370 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.371 DEBUG:boto:Params: {} 2023-12-15T23:14:06.371 DEBUG:boto:Token: None 2023-12-15T23:14:06.371 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.373 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000010166a891eff38c0-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.373 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.373 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.373 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.373 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.373 DEBUG:boto:Data: 2023-12-15T23:14:06.374 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.374 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.374 DEBUG:boto:Params: {} 2023-12-15T23:14:06.374 DEBUG:boto:Token: None 2023-12-15T23:14:06.374 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:06.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V1HPyMupGRyT38Atkh2IJXlMc8c= 2023-12-15T23:14:06.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V1HPyMupGRyT38Atkh2IJXlMc8c='} 2023-12-15T23:14:06.380 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004114c0066e43dd15-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.380 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.380 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.381 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.381 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.381 DEBUG:boto:Data: 2023-12-15T23:14:06.381 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.381 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.381 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.381 DEBUG:boto:Params: {} 2023-12-15T23:14:06.381 DEBUG:boto:Token: None 2023-12-15T23:14:06.381 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.384 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f3ace2c1e81c6a4-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.384 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:06.384 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:06.384 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.385 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:06.385 DEBUG:boto:Data: 2023-12-15T23:14:06.385 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.385 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.385 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.385 DEBUG:boto:Params: {} 2023-12-15T23:14:06.385 DEBUG:boto:Token: None 2023-12-15T23:14:06.385 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:06.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HX1aqfV4ituwV4LVwGWJ6BcPdB4= 2023-12-15T23:14:06.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HX1aqfV4ituwV4LVwGWJ6BcPdB4='} 2023-12-15T23:14:06.395 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075e27bd578d7cd60-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.396 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.396 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.396 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.396 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.396 DEBUG:boto:Data: 2023-12-15T23:14:06.396 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.396 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.396 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.396 DEBUG:boto:Params: {} 2023-12-15T23:14:06.396 DEBUG:boto:Token: None 2023-12-15T23:14:06.397 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.397 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.399 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000048867a06c751ea5d-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.399 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:06.400 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:06.400 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.400 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:06.400 DEBUG:boto:Data: 2023-12-15T23:14:06.400 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.400 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.400 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.400 DEBUG:boto:Params: {} 2023-12-15T23:14:06.400 DEBUG:boto:Token: None 2023-12-15T23:14:06.401 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:06.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZVGrS/q4/QC1C6i0WL66q1IWIkU= 2023-12-15T23:14:06.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZVGrS/q4/QC1C6i0WL66q1IWIkU='} 2023-12-15T23:14:06.449 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004dc8e7514a72e871-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.450 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.450 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.450 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.450 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.450 DEBUG:boto:Data: 2023-12-15T23:14:06.450 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.450 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.450 DEBUG:boto:Params: {} 2023-12-15T23:14:06.451 DEBUG:boto:Token: None 2023-12-15T23:14:06.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.453 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b63236785c88cef-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.453 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:06.453 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:06.453 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.454 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:06.454 DEBUG:boto:Data: 2023-12-15T23:14:06.454 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.454 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.454 DEBUG:boto:Params: {} 2023-12-15T23:14:06.454 DEBUG:boto:Token: None 2023-12-15T23:14:06.454 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:06.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NFNHxJXo/x7NGpratQcwAd6YTbU= 2023-12-15T23:14:06.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NFNHxJXo/x7NGpratQcwAd6YTbU='} 2023-12-15T23:14:06.461 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007f6c92c5647f4889-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.461 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.461 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.461 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.461 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.461 DEBUG:boto:Data: 2023-12-15T23:14:06.461 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.462 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.462 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.462 DEBUG:boto:Params: {} 2023-12-15T23:14:06.462 DEBUG:boto:Token: None 2023-12-15T23:14:06.462 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.464 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a39c5da84f35364-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.465 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:06.465 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:06.465 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.465 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:06.465 DEBUG:boto:Data: 2023-12-15T23:14:06.465 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.465 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.465 DEBUG:boto:Params: {} 2023-12-15T23:14:06.465 DEBUG:boto:Token: None 2023-12-15T23:14:06.466 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:06.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FcBK5kdakwutMlDRa6Cp6G7Z5GQ= 2023-12-15T23:14:06.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FcBK5kdakwutMlDRa6Cp6G7Z5GQ='} 2023-12-15T23:14:06.472 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c64a9a4afe885690-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.472 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.473 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.473 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.473 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.473 DEBUG:boto:Data: 2023-12-15T23:14:06.473 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.473 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.473 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.473 DEBUG:boto:Params: {} 2023-12-15T23:14:06.473 DEBUG:boto:Token: None 2023-12-15T23:14:06.473 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.474 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.476 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002667c171b1fba9ff-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.476 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:06.476 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:06.476 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.476 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:06.476 DEBUG:boto:Data: 2023-12-15T23:14:06.476 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.476 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.477 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.477 DEBUG:boto:Params: {} 2023-12-15T23:14:06.477 DEBUG:boto:Token: None 2023-12-15T23:14:06.477 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:06.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E3gCQX5VHJArtKZgr6K+UyV75pE= 2023-12-15T23:14:06.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E3gCQX5VHJArtKZgr6K+UyV75pE='} 2023-12-15T23:14:06.522 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e92996c6ae30ea2d-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.522 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.522 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.522 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.522 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.522 DEBUG:boto:Data: 2023-12-15T23:14:06.522 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.522 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.523 DEBUG:boto:Params: {} 2023-12-15T23:14:06.523 DEBUG:boto:Token: None 2023-12-15T23:14:06.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.525 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c1248ee089b184ff-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.525 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:06.526 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:06.526 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.526 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:06.526 DEBUG:boto:Data: 2023-12-15T23:14:06.526 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.526 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.526 DEBUG:boto:Params: {} 2023-12-15T23:14:06.526 DEBUG:boto:Token: None 2023-12-15T23:14:06.526 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:06.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5tv3x46mR6hVwInCq7WNxDgmQGU= 2023-12-15T23:14:06.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5tv3x46mR6hVwInCq7WNxDgmQGU='} 2023-12-15T23:14:06.533 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7059d9cc749af4e-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.533 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.533 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.533 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.533 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.534 DEBUG:boto:Data: 2023-12-15T23:14:06.534 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.534 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.534 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.534 DEBUG:boto:Params: {} 2023-12-15T23:14:06.534 DEBUG:boto:Token: None 2023-12-15T23:14:06.534 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.536 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a4111d51aef5e389-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.537 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:06.537 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:06.537 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.537 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:06.537 DEBUG:boto:Data: 2023-12-15T23:14:06.537 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.537 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.537 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.538 DEBUG:boto:Params: {} 2023-12-15T23:14:06.538 DEBUG:boto:Token: None 2023-12-15T23:14:06.538 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:06.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IN9U/S8qqL7OdmpUHR2EWvcRmvU= 2023-12-15T23:14:06.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IN9U/S8qqL7OdmpUHR2EWvcRmvU='} 2023-12-15T23:14:06.543 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008d4f447b68f75ab0-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.544 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.544 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.544 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.544 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.544 DEBUG:boto:Data: 2023-12-15T23:14:06.544 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.544 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.544 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.544 DEBUG:boto:Params: {} 2023-12-15T23:14:06.544 DEBUG:boto:Token: None 2023-12-15T23:14:06.545 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.547 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c00e953cfa986e79-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.547 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:06.547 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:06.547 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.547 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:06.547 DEBUG:boto:Data: 2023-12-15T23:14:06.547 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.547 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.548 DEBUG:boto:Params: {} 2023-12-15T23:14:06.548 DEBUG:boto:Token: None 2023-12-15T23:14:06.548 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:06.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ySQ5uNUZp8dZSudP+2bI9gK4Xxo= 2023-12-15T23:14:06.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ySQ5uNUZp8dZSudP+2bI9gK4Xxo='} 2023-12-15T23:14:06.589 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000755706b0f39642c4-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.590 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.590 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.590 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.590 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.590 DEBUG:boto:Data: 2023-12-15T23:14:06.590 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.590 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.590 DEBUG:boto:Params: {} 2023-12-15T23:14:06.591 DEBUG:boto:Token: None 2023-12-15T23:14:06.591 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.593 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ca802db0208ac69-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.594 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:06.594 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:06.594 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.594 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:06.594 DEBUG:boto:Data: 2023-12-15T23:14:06.594 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.594 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.594 DEBUG:boto:Params: {} 2023-12-15T23:14:06.594 DEBUG:boto:Token: None 2023-12-15T23:14:06.595 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:06.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F4Px/mb0vEPp19vbXfsROuZGCpc= 2023-12-15T23:14:06.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F4Px/mb0vEPp19vbXfsROuZGCpc='} 2023-12-15T23:14:06.600 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a6302bb4b05196a-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.600 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.600 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.600 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.600 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.601 DEBUG:boto:Data: 2023-12-15T23:14:06.601 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.601 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.601 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.601 DEBUG:boto:Params: {} 2023-12-15T23:14:06.601 DEBUG:boto:Token: None 2023-12-15T23:14:06.601 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.603 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000706489b56f896a7e-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.604 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:06.604 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:06.604 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.604 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:06.604 DEBUG:boto:Data: 2023-12-15T23:14:06.604 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.604 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.604 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.604 DEBUG:boto:Params: {} 2023-12-15T23:14:06.605 DEBUG:boto:Token: None 2023-12-15T23:14:06.605 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:06.605 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gL4RPb1O78Xdnlv54J7HF69yktg= 2023-12-15T23:14:06.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gL4RPb1O78Xdnlv54J7HF69yktg='} 2023-12-15T23:14:06.612 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000088377d1e4512dbef-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.612 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.612 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.612 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.612 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.612 DEBUG:boto:Data: 2023-12-15T23:14:06.612 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.612 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.612 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.612 DEBUG:boto:Params: {} 2023-12-15T23:14:06.613 DEBUG:boto:Token: None 2023-12-15T23:14:06.613 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.615 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1f2bd1e26f4cefb-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.616 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:06.616 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:06.616 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.616 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:06.616 DEBUG:boto:Data: 2023-12-15T23:14:06.616 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.616 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.616 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.616 DEBUG:boto:Params: {} 2023-12-15T23:14:06.616 DEBUG:boto:Token: None 2023-12-15T23:14:06.617 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:06.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5anTmFVu8ougTqxFlg05VafIRTE= 2023-12-15T23:14:06.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5anTmFVu8ougTqxFlg05VafIRTE='} 2023-12-15T23:14:06.662 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000063e00f28868a5a6-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.662 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.662 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.662 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.662 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.662 DEBUG:boto:Data: 2023-12-15T23:14:06.662 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.662 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.662 DEBUG:boto:Params: {} 2023-12-15T23:14:06.663 DEBUG:boto:Token: None 2023-12-15T23:14:06.663 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.665 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000011a9c735fc048b60-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.666 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:06.666 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:06.666 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.666 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:06.666 DEBUG:boto:Data: 2023-12-15T23:14:06.666 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.666 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.666 DEBUG:boto:Params: {} 2023-12-15T23:14:06.667 DEBUG:boto:Token: None 2023-12-15T23:14:06.667 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:06.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YkzVNWsezh/oivabwDiDAiB4MXI= 2023-12-15T23:14:06.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YkzVNWsezh/oivabwDiDAiB4MXI='} 2023-12-15T23:14:06.673 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b0fc8f866679ebd-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.673 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.674 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.674 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.674 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.674 DEBUG:boto:Data: 2023-12-15T23:14:06.674 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.674 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.674 DEBUG:boto:Params: {} 2023-12-15T23:14:06.674 DEBUG:boto:Token: None 2023-12-15T23:14:06.674 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000159349909b717b-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.677 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:06.678 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:06.678 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.678 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:06.678 DEBUG:boto:Data: 2023-12-15T23:14:06.678 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.678 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.678 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.678 DEBUG:boto:Params: {} 2023-12-15T23:14:06.678 DEBUG:boto:Token: None 2023-12-15T23:14:06.679 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:06.679 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rqL2XLSJlxPjgDstIAPLk4fjd6k= 2023-12-15T23:14:06.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rqL2XLSJlxPjgDstIAPLk4fjd6k='} 2023-12-15T23:14:06.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031b653372b49e92f-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.722 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.722 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.722 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.722 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.722 DEBUG:boto:Data: 2023-12-15T23:14:06.722 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.722 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.723 DEBUG:boto:Params: {} 2023-12-15T23:14:06.723 DEBUG:boto:Token: None 2023-12-15T23:14:06.723 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.725 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e4e034cee3f250e-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:06.725 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:06.725 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.725 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:06.725 DEBUG:boto:Data: 2023-12-15T23:14:06.726 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.726 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.726 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.726 DEBUG:boto:Params: {} 2023-12-15T23:14:06.726 DEBUG:boto:Token: None 2023-12-15T23:14:06.726 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:06.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dB1yDXtveVqnjnWEs3o3HYJJMTU= 2023-12-15T23:14:06.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dB1yDXtveVqnjnWEs3o3HYJJMTU='} 2023-12-15T23:14:06.733 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006db74ba682b3ca69-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.733 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.733 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.733 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.733 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.734 DEBUG:boto:Data: 2023-12-15T23:14:06.734 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.734 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.734 DEBUG:boto:Params: {} 2023-12-15T23:14:06.734 DEBUG:boto:Token: None 2023-12-15T23:14:06.734 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.736 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000053ad1ffa4769ca56-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.736 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:06.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:06.737 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.737 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:06.737 DEBUG:boto:Data: 2023-12-15T23:14:06.737 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.737 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.737 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.737 DEBUG:boto:Params: {} 2023-12-15T23:14:06.737 DEBUG:boto:Token: None 2023-12-15T23:14:06.738 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:06.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BRd13S8Iq88ufVoHQhk71sjsgDs= 2023-12-15T23:14:06.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BRd13S8Iq88ufVoHQhk71sjsgDs='} 2023-12-15T23:14:06.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ce277d4bcca0871-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.743 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:06.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:06.743 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:06.792 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:06.792 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:06.833 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:06.833 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:06.841 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 27 2023-12-15T23:14:06.901 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:06.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:06.901 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 23 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:06.948 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:06.948 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:06.988 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000058","obj00000000000000000026","obj00000000000000000011","obj00000000000000000046","obj00000000000000000014","obj00000000000000000050","obj00000000000000000032","obj00000000000000000002","obj00000000000000000039","obj00000000000000000007","obj00000000000000000006","obj00000000000000000040","obj00000000000000000009","obj00000000000000000045","obj00000000000000000013","obj00000000000000000012","obj00000000000000000033","obj00000000000000000001","obj00000000000000000000","obj00000000000000000021","obj00000000000000000003","obj00000000000000000055","obj00000000000000000008"]} 2023-12-15T23:14:06.988 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.988 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:06.988 DEBUG:boto:Method: HEAD 2023-12-15T23:14:06.988 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:06.989 DEBUG:boto:Data: 2023-12-15T23:14:06.989 DEBUG:boto:Headers: {} 2023-12-15T23:14:06.989 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.989 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.989 DEBUG:boto:Params: {} 2023-12-15T23:14:06.989 DEBUG:boto:Token: None 2023-12-15T23:14:06.989 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/ 2023-12-15T23:14:06.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM= 2023-12-15T23:14:06.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GPPssM6GoqGZfojypDXN6p9pgaM=', 'Content-Length': '0'} 2023-12-15T23:14:06.992 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dac688b4d55b9437-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.992 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.992 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.992 DEBUG:boto:Method: PUT 2023-12-15T23:14:06.992 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.993 DEBUG:boto:Data: 2023-12-15T23:14:06.993 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:06.993 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:06.993 DEBUG:boto:Port: 8000 2023-12-15T23:14:06.993 DEBUG:boto:Params: {} 2023-12-15T23:14:06.993 DEBUG:boto:Token: None 2023-12-15T23:14:06.993 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:06 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:06.993 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3vYIAGKve73RWyPupnm31MSm/Is= 2023-12-15T23:14:06.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:06 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3vYIAGKve73RWyPupnm31MSm/Is='} 2023-12-15T23:14:06.999 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c91d22a00b3f5bf-00657cddbe-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:06 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:06.999 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:06.999 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.000 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.000 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.000 DEBUG:boto:Data: 2023-12-15T23:14:07.000 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.000 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.000 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.000 DEBUG:boto:Params: {} 2023-12-15T23:14:07.000 DEBUG:boto:Token: None 2023-12-15T23:14:07.000 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.000 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.003 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8c54e4e401e4d71-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.003 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:07.003 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:07.003 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.003 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:07.003 DEBUG:boto:Data: 2023-12-15T23:14:07.003 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.004 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.004 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.004 DEBUG:boto:Params: {} 2023-12-15T23:14:07.004 DEBUG:boto:Token: None 2023-12-15T23:14:07.004 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:07.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x0AAu2AwTppjjp8kXMEIoI1s6FI= 2023-12-15T23:14:07.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x0AAu2AwTppjjp8kXMEIoI1s6FI='} 2023-12-15T23:14:07.046 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d12f1efb9482f42-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.046 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.046 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.046 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.046 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.046 DEBUG:boto:Data: 2023-12-15T23:14:07.046 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.046 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.046 DEBUG:boto:Params: {} 2023-12-15T23:14:07.047 DEBUG:boto:Token: None 2023-12-15T23:14:07.047 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.049 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069f7dd44f7e1f9e2-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.049 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:07.050 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:07.050 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.050 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:07.050 DEBUG:boto:Data: 2023-12-15T23:14:07.050 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.050 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.050 DEBUG:boto:Params: {} 2023-12-15T23:14:07.050 DEBUG:boto:Token: None 2023-12-15T23:14:07.050 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:07.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IAlfD7yhxKUSaOtHHks4IEY7Rvw= 2023-12-15T23:14:07.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IAlfD7yhxKUSaOtHHks4IEY7Rvw='} 2023-12-15T23:14:07.056 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2ade241a10dafe6-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.056 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.056 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.056 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.056 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.057 DEBUG:boto:Data: 2023-12-15T23:14:07.057 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.057 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.057 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.057 DEBUG:boto:Params: {} 2023-12-15T23:14:07.057 DEBUG:boto:Token: None 2023-12-15T23:14:07.057 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.057 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.059 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d9efbf592e3b8c68-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.060 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:07.060 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:07.060 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.060 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:07.060 DEBUG:boto:Data: 2023-12-15T23:14:07.060 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.060 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.060 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.061 DEBUG:boto:Params: {} 2023-12-15T23:14:07.061 DEBUG:boto:Token: None 2023-12-15T23:14:07.061 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:07.061 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Bo/E+b0pURL/07gc8JN0WthL5ZI= 2023-12-15T23:14:07.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Bo/E+b0pURL/07gc8JN0WthL5ZI='} 2023-12-15T23:14:07.066 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000094eea14da987ad35-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.066 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.066 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.066 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.066 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.066 DEBUG:boto:Data: 2023-12-15T23:14:07.066 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.066 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.066 DEBUG:boto:Params: {} 2023-12-15T23:14:07.067 DEBUG:boto:Token: None 2023-12-15T23:14:07.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.069 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009261e8e0ea7ad5bb-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.069 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:07.069 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:07.069 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.070 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:07.070 DEBUG:boto:Data: 2023-12-15T23:14:07.070 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.070 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.070 DEBUG:boto:Params: {} 2023-12-15T23:14:07.070 DEBUG:boto:Token: None 2023-12-15T23:14:07.070 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:07.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eBmb4qG+/TU2zstc/OCLMvZh2Lg= 2023-12-15T23:14:07.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eBmb4qG+/TU2zstc/OCLMvZh2Lg='} 2023-12-15T23:14:07.113 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005989a4e3d12bb858-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.114 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.114 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.114 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.114 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.114 DEBUG:boto:Data: 2023-12-15T23:14:07.114 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.114 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.114 DEBUG:boto:Params: {} 2023-12-15T23:14:07.115 DEBUG:boto:Token: None 2023-12-15T23:14:07.115 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.117 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae036bfa8d412597-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:07.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:07.118 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.118 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:07.118 DEBUG:boto:Data: 2023-12-15T23:14:07.118 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.118 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.118 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.118 DEBUG:boto:Params: {} 2023-12-15T23:14:07.118 DEBUG:boto:Token: None 2023-12-15T23:14:07.119 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:07.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rmhUhBa+5LSbkMPlBoyXCFkTU/I= 2023-12-15T23:14:07.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rmhUhBa+5LSbkMPlBoyXCFkTU/I='} 2023-12-15T23:14:07.124 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c89568626fb4c4e-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.124 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.124 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.124 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.124 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.124 DEBUG:boto:Data: 2023-12-15T23:14:07.125 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.125 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.125 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.125 DEBUG:boto:Params: {} 2023-12-15T23:14:07.125 DEBUG:boto:Token: None 2023-12-15T23:14:07.125 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.128 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca4b541585d0aeb4-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.128 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.128 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.128 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.128 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.128 DEBUG:boto:Data: 2023-12-15T23:14:07.128 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.128 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.128 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.128 DEBUG:boto:Params: {} 2023-12-15T23:14:07.129 DEBUG:boto:Token: None 2023-12-15T23:14:07.129 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.129 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HbqL9vb226mbO2naZRSgU/GoCgs= 2023-12-15T23:14:07.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HbqL9vb226mbO2naZRSgU/GoCgs='} 2023-12-15T23:14:07.136 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c13ab6b266793c24-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.136 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.136 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.136 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.137 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.137 DEBUG:boto:Data: 2023-12-15T23:14:07.137 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.137 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.137 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.137 DEBUG:boto:Params: {} 2023-12-15T23:14:07.137 DEBUG:boto:Token: None 2023-12-15T23:14:07.137 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.137 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.140 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3b12b29da5061c5-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.140 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:07.140 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:07.140 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.140 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:07.140 DEBUG:boto:Data: 2023-12-15T23:14:07.140 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.140 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.141 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.141 DEBUG:boto:Params: {} 2023-12-15T23:14:07.141 DEBUG:boto:Token: None 2023-12-15T23:14:07.141 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:07.141 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lZ8kqC/L0iXLH92K9EN+3GiEtEs= 2023-12-15T23:14:07.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lZ8kqC/L0iXLH92K9EN+3GiEtEs='} 2023-12-15T23:14:07.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006e259f251751ea9-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.186 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.186 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.186 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.186 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.186 DEBUG:boto:Data: 2023-12-15T23:14:07.186 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.186 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.186 DEBUG:boto:Params: {} 2023-12-15T23:14:07.187 DEBUG:boto:Token: None 2023-12-15T23:14:07.187 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.189 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df752099078d6e92-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.190 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:07.190 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:07.190 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.190 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:07.190 DEBUG:boto:Data: 2023-12-15T23:14:07.190 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.190 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.190 DEBUG:boto:Params: {} 2023-12-15T23:14:07.191 DEBUG:boto:Token: None 2023-12-15T23:14:07.191 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:07.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Xg3zt3snXMT8Hmde89w7vdxtCI= 2023-12-15T23:14:07.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Xg3zt3snXMT8Hmde89w7vdxtCI='} 2023-12-15T23:14:07.197 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000092ccf393cfe586e7-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.197 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.197 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.197 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.197 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.197 DEBUG:boto:Data: 2023-12-15T23:14:07.198 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.198 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.198 DEBUG:boto:Params: {} 2023-12-15T23:14:07.198 DEBUG:boto:Token: None 2023-12-15T23:14:07.198 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.200 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a6d2521cd8d30a0a-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.201 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:07.201 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:07.201 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.201 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:07.201 DEBUG:boto:Data: 2023-12-15T23:14:07.201 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.201 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.201 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.202 DEBUG:boto:Params: {} 2023-12-15T23:14:07.202 DEBUG:boto:Token: None 2023-12-15T23:14:07.202 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:07.202 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SnoxUGpGIaroBx6fwkbJObf2kII= 2023-12-15T23:14:07.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SnoxUGpGIaroBx6fwkbJObf2kII='} 2023-12-15T23:14:07.245 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f05c5843bbdfd6b1-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.246 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.246 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.246 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.246 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.246 DEBUG:boto:Data: 2023-12-15T23:14:07.246 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.246 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.246 DEBUG:boto:Params: {} 2023-12-15T23:14:07.246 DEBUG:boto:Token: None 2023-12-15T23:14:07.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.249 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079d1f82ba8b205eb-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.250 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.250 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.250 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.250 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.250 DEBUG:boto:Data: 2023-12-15T23:14:07.250 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.250 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.250 DEBUG:boto:Params: {} 2023-12-15T23:14:07.250 DEBUG:boto:Token: None 2023-12-15T23:14:07.251 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B96YMPk8vjefVLl5wXDDaqepLzU= 2023-12-15T23:14:07.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B96YMPk8vjefVLl5wXDDaqepLzU='} 2023-12-15T23:14:07.256 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a7a05a26827e7bc2-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.256 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.256 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.256 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.256 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.256 DEBUG:boto:Data: 2023-12-15T23:14:07.256 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.257 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.257 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.257 DEBUG:boto:Params: {} 2023-12-15T23:14:07.257 DEBUG:boto:Token: None 2023-12-15T23:14:07.257 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.257 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.259 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bf7be11b3e02f60d-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.260 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:07.260 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:07.260 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.260 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:07.260 DEBUG:boto:Data: 2023-12-15T23:14:07.260 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.260 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.260 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.260 DEBUG:boto:Params: {} 2023-12-15T23:14:07.261 DEBUG:boto:Token: None 2023-12-15T23:14:07.261 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:07.261 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P0xyPHqthjb6+IJjo9m8N2eFHaU= 2023-12-15T23:14:07.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P0xyPHqthjb6+IJjo9m8N2eFHaU='} 2023-12-15T23:14:07.266 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f4041bd32370d06c-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.266 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.266 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.267 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.267 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.267 DEBUG:boto:Data: 2023-12-15T23:14:07.267 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.267 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.267 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.267 DEBUG:boto:Params: {} 2023-12-15T23:14:07.267 DEBUG:boto:Token: None 2023-12-15T23:14:07.267 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.268 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.270 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002e651c4b26b74ec-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.270 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:07.270 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:07.270 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.270 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:07.270 DEBUG:boto:Data: 2023-12-15T23:14:07.270 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.271 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.271 DEBUG:boto:Params: {} 2023-12-15T23:14:07.271 DEBUG:boto:Token: None 2023-12-15T23:14:07.271 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:07.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6QSN6YFqfPpXj5taR9Lzf24YhrA= 2023-12-15T23:14:07.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6QSN6YFqfPpXj5taR9Lzf24YhrA='} 2023-12-15T23:14:07.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000de64ec586e210fb0-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.314 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.314 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.314 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.314 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.314 DEBUG:boto:Data: 2023-12-15T23:14:07.314 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.314 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.314 DEBUG:boto:Params: {} 2023-12-15T23:14:07.315 DEBUG:boto:Token: None 2023-12-15T23:14:07.315 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.317 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a32a4e64505a8975-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.317 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:07.317 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:07.317 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.318 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:07.318 DEBUG:boto:Data: 2023-12-15T23:14:07.318 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.318 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.318 DEBUG:boto:Params: {} 2023-12-15T23:14:07.318 DEBUG:boto:Token: None 2023-12-15T23:14:07.318 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:07.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w0vfI2jGlfc9OF61geYbsX7Fi/E= 2023-12-15T23:14:07.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w0vfI2jGlfc9OF61geYbsX7Fi/E='} 2023-12-15T23:14:07.325 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c86c95eb802315f-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.325 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.325 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.325 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.325 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.326 DEBUG:boto:Data: 2023-12-15T23:14:07.326 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.326 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.326 DEBUG:boto:Params: {} 2023-12-15T23:14:07.326 DEBUG:boto:Token: None 2023-12-15T23:14:07.326 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.328 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b7f767a6c791352a-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.329 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:07.329 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:07.329 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.329 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:07.329 DEBUG:boto:Data: 2023-12-15T23:14:07.329 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.329 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.329 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.330 DEBUG:boto:Params: {} 2023-12-15T23:14:07.330 DEBUG:boto:Token: None 2023-12-15T23:14:07.330 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:07.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9HRRz0aev38JrEVuVQ09qwck5sI= 2023-12-15T23:14:07.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9HRRz0aev38JrEVuVQ09qwck5sI='} 2023-12-15T23:14:07.337 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a08f4e443e7c1d89-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.338 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.338 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.338 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.338 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.338 DEBUG:boto:Data: 2023-12-15T23:14:07.338 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.338 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.338 DEBUG:boto:Params: {} 2023-12-15T23:14:07.339 DEBUG:boto:Token: None 2023-12-15T23:14:07.339 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.341 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f657e9e3321cd515-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.341 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:07.342 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:07.342 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.342 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:07.342 DEBUG:boto:Data: 2023-12-15T23:14:07.342 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.342 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.342 DEBUG:boto:Params: {} 2023-12-15T23:14:07.342 DEBUG:boto:Token: None 2023-12-15T23:14:07.342 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:07.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:06haGIBbO7Eiq3R4Txcgb8OFrAQ= 2023-12-15T23:14:07.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:06haGIBbO7Eiq3R4Txcgb8OFrAQ='} 2023-12-15T23:14:07.386 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000a011728732ab71e-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.386 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.386 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.386 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.386 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.386 DEBUG:boto:Data: 2023-12-15T23:14:07.386 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.386 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.386 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.386 DEBUG:boto:Params: {} 2023-12-15T23:14:07.387 DEBUG:boto:Token: None 2023-12-15T23:14:07.387 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.389 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005e21ee6912d04e26-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.389 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:07.389 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:07.390 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.390 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:07.390 DEBUG:boto:Data: 2023-12-15T23:14:07.390 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.390 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.390 DEBUG:boto:Params: {} 2023-12-15T23:14:07.390 DEBUG:boto:Token: None 2023-12-15T23:14:07.390 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:07.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zkJZpExllVXd1DnSKJBY0bU2mak= 2023-12-15T23:14:07.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zkJZpExllVXd1DnSKJBY0bU2mak='} 2023-12-15T23:14:07.397 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e5d2a02336d7f0fd-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.397 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.397 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.397 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.397 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.397 DEBUG:boto:Data: 2023-12-15T23:14:07.398 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.398 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.398 DEBUG:boto:Params: {} 2023-12-15T23:14:07.398 DEBUG:boto:Token: None 2023-12-15T23:14:07.398 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.400 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087cd03a1aa210805-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.401 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:07.401 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:07.401 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.401 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:07.401 DEBUG:boto:Data: 2023-12-15T23:14:07.401 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.401 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.401 DEBUG:boto:Params: {} 2023-12-15T23:14:07.402 DEBUG:boto:Token: None 2023-12-15T23:14:07.402 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:07.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5gBoj5Q1FRUDKhwZVWjyKyFW0qY= 2023-12-15T23:14:07.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5gBoj5Q1FRUDKhwZVWjyKyFW0qY='} 2023-12-15T23:14:07.407 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b72fd01f6b5510b2-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.407 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.407 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.407 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.407 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.407 DEBUG:boto:Data: 2023-12-15T23:14:07.407 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.407 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.407 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.408 DEBUG:boto:Params: {} 2023-12-15T23:14:07.408 DEBUG:boto:Token: None 2023-12-15T23:14:07.408 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.408 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000917ca23cd50e7d68-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.410 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:07.410 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:07.410 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.411 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:07.411 DEBUG:boto:Data: 2023-12-15T23:14:07.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.411 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.411 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.411 DEBUG:boto:Params: {} 2023-12-15T23:14:07.411 DEBUG:boto:Token: None 2023-12-15T23:14:07.411 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:07.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2ajxAjhZI48Pp6H6Aj2d3I1x1VU= 2023-12-15T23:14:07.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2ajxAjhZI48Pp6H6Aj2d3I1x1VU='} 2023-12-15T23:14:07.453 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fda535115bed21de-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.454 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.454 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.454 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.454 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.454 DEBUG:boto:Data: 2023-12-15T23:14:07.454 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.454 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.454 DEBUG:boto:Params: {} 2023-12-15T23:14:07.454 DEBUG:boto:Token: None 2023-12-15T23:14:07.455 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.457 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002d34355cc86673e6-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.457 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:07.458 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:07.458 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.458 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:07.458 DEBUG:boto:Data: 2023-12-15T23:14:07.458 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.458 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.458 DEBUG:boto:Params: {} 2023-12-15T23:14:07.458 DEBUG:boto:Token: None 2023-12-15T23:14:07.459 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:07.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B/nav7hH6ALGWCl0NSASsN0wx+c= 2023-12-15T23:14:07.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B/nav7hH6ALGWCl0NSASsN0wx+c='} 2023-12-15T23:14:07.465 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000012f156a8f91bdcee-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.465 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.465 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.465 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.465 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.465 DEBUG:boto:Data: 2023-12-15T23:14:07.465 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.465 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.465 DEBUG:boto:Params: {} 2023-12-15T23:14:07.466 DEBUG:boto:Token: None 2023-12-15T23:14:07.466 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.468 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000885356980d692750-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.468 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.468 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.468 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.469 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.469 DEBUG:boto:Data: 2023-12-15T23:14:07.469 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.469 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.469 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.469 DEBUG:boto:Params: {} 2023-12-15T23:14:07.469 DEBUG:boto:Token: None 2023-12-15T23:14:07.469 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O3pobR42nBj0st1w9koJ/KZxijk= 2023-12-15T23:14:07.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O3pobR42nBj0st1w9koJ/KZxijk='} 2023-12-15T23:14:07.476 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d6e9e4604f7cd254-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:07.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:07.476 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:07.525 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:07.525 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:07.575 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:07.575 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:07.585 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 34 2023-12-15T23:14:07.649 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:07.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:07.649 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 29 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:07.697 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:07.697 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:07.739 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000006","obj00000000000000000059","obj00000000000000000027","obj00000000000000000004","obj00000000000000000011","obj00000000000000000002","obj00000000000000000019","obj00000000000000000049","obj00000000000000000017","obj00000000000000000008","obj00000000000000000015","obj00000000000000000031","obj00000000000000000022","obj00000000000000000013","obj00000000000000000020","obj00000000000000000037","obj00000000000000000005","obj00000000000000000012","obj00000000000000000003","obj00000000000000000042","obj00000000000000000010","obj00000000000000000001","obj00000000000000000009","obj00000000000000000025","obj00000000000000000016","obj00000000000000000000","obj00000000000000000014","obj00000000000000000030","obj00000000000000000021"]} 2023-12-15T23:14:07.739 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.740 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.740 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.740 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.740 DEBUG:boto:Data: 2023-12-15T23:14:07.740 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.740 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.740 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.740 DEBUG:boto:Params: {} 2023-12-15T23:14:07.740 DEBUG:boto:Token: None 2023-12-15T23:14:07.740 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.741 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.743 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000177c0211bee828f1-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.743 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:07.744 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:07.744 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.744 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:07.744 DEBUG:boto:Data: 2023-12-15T23:14:07.744 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.744 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.744 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.744 DEBUG:boto:Params: {} 2023-12-15T23:14:07.744 DEBUG:boto:Token: None 2023-12-15T23:14:07.744 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:07.745 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:11PiiLO9FWDIr2GldFmoOKiDBhs= 2023-12-15T23:14:07.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:11PiiLO9FWDIr2GldFmoOKiDBhs='} 2023-12-15T23:14:07.789 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006f9dae34f3bb350d-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.790 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.790 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.790 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.790 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.790 DEBUG:boto:Data: 2023-12-15T23:14:07.790 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.790 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.790 DEBUG:boto:Params: {} 2023-12-15T23:14:07.790 DEBUG:boto:Token: None 2023-12-15T23:14:07.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.793 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c22271623dfd43f2-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.793 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:07.793 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:07.794 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.794 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:07.794 DEBUG:boto:Data: 2023-12-15T23:14:07.794 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.794 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.794 DEBUG:boto:Params: {} 2023-12-15T23:14:07.794 DEBUG:boto:Token: None 2023-12-15T23:14:07.794 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:07.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3RoY5IZO0kFBlbFi44ieHuCG2eQ= 2023-12-15T23:14:07.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3RoY5IZO0kFBlbFi44ieHuCG2eQ='} 2023-12-15T23:14:07.801 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f423302e93da994-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.801 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.801 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.801 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.801 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.801 DEBUG:boto:Data: 2023-12-15T23:14:07.801 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.801 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.802 DEBUG:boto:Params: {} 2023-12-15T23:14:07.802 DEBUG:boto:Token: None 2023-12-15T23:14:07.802 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.804 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001ca8f231bcc5f780-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.804 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:07.805 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:07.805 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.805 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:07.805 DEBUG:boto:Data: 2023-12-15T23:14:07.805 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.805 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.805 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.805 DEBUG:boto:Params: {} 2023-12-15T23:14:07.805 DEBUG:boto:Token: None 2023-12-15T23:14:07.805 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:07.806 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AOVHY/e0QDkbK7U0HqdZ/xSCeuc= 2023-12-15T23:14:07.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AOVHY/e0QDkbK7U0HqdZ/xSCeuc='} 2023-12-15T23:14:07.811 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000023e9f9809c4f88c7-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.811 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.811 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.811 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.811 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.811 DEBUG:boto:Data: 2023-12-15T23:14:07.811 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.811 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.811 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.811 DEBUG:boto:Params: {} 2023-12-15T23:14:07.812 DEBUG:boto:Token: None 2023-12-15T23:14:07.812 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.812 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.814 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d37e4bc04348d092-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.814 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:07.814 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:07.814 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.815 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:07.815 DEBUG:boto:Data: 2023-12-15T23:14:07.815 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.815 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.815 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.815 DEBUG:boto:Params: {} 2023-12-15T23:14:07.815 DEBUG:boto:Token: None 2023-12-15T23:14:07.815 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:07.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CoZ3/RvyZeDyov/mws219Sa7xxo= 2023-12-15T23:14:07.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CoZ3/RvyZeDyov/mws219Sa7xxo='} 2023-12-15T23:14:07.858 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005cb4871d2d548cb7-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.858 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.858 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.858 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.858 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.858 DEBUG:boto:Data: 2023-12-15T23:14:07.858 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.858 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.859 DEBUG:boto:Params: {} 2023-12-15T23:14:07.859 DEBUG:boto:Token: None 2023-12-15T23:14:07.859 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.861 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000032fcf5fb2eff4326-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.862 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.862 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.862 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.862 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.862 DEBUG:boto:Data: 2023-12-15T23:14:07.862 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.862 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.863 DEBUG:boto:Params: {} 2023-12-15T23:14:07.863 DEBUG:boto:Token: None 2023-12-15T23:14:07.863 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:07.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B96YMPk8vjefVLl5wXDDaqepLzU= 2023-12-15T23:14:07.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B96YMPk8vjefVLl5wXDDaqepLzU='} 2023-12-15T23:14:07.869 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e2a3c998d3850a30-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.869 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.869 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.869 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.869 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.869 DEBUG:boto:Data: 2023-12-15T23:14:07.870 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.870 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.870 DEBUG:boto:Params: {} 2023-12-15T23:14:07.870 DEBUG:boto:Token: None 2023-12-15T23:14:07.870 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.873 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004322b19ea8ecbec6-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.873 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:07.873 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:07.873 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.873 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:07.874 DEBUG:boto:Data: 2023-12-15T23:14:07.874 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.874 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.874 DEBUG:boto:Params: {} 2023-12-15T23:14:07.874 DEBUG:boto:Token: None 2023-12-15T23:14:07.874 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:07.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5WXGq3jHxodf0xaIPzM7jC+x17I= 2023-12-15T23:14:07.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5WXGq3jHxodf0xaIPzM7jC+x17I='} 2023-12-15T23:14:07.918 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000046c77f960bf5f28e-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.918 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.918 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.918 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.918 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.918 DEBUG:boto:Data: 2023-12-15T23:14:07.918 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.918 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.919 DEBUG:boto:Params: {} 2023-12-15T23:14:07.919 DEBUG:boto:Token: None 2023-12-15T23:14:07.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.921 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000834bc81a3b4f77bb-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.922 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.922 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.922 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.922 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.922 DEBUG:boto:Data: 2023-12-15T23:14:07.922 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.922 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.922 DEBUG:boto:Params: {} 2023-12-15T23:14:07.922 DEBUG:boto:Token: None 2023-12-15T23:14:07.923 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:07.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HbqL9vb226mbO2naZRSgU/GoCgs= 2023-12-15T23:14:07.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HbqL9vb226mbO2naZRSgU/GoCgs='} 2023-12-15T23:14:07.929 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c75691fbebbd83cd-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.929 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.929 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.929 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.930 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.930 DEBUG:boto:Data: 2023-12-15T23:14:07.930 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.930 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.930 DEBUG:boto:Params: {} 2023-12-15T23:14:07.930 DEBUG:boto:Token: None 2023-12-15T23:14:07.930 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.933 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006058adc0ba8d6636-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.933 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:07.933 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:07.933 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.933 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:07.933 DEBUG:boto:Data: 2023-12-15T23:14:07.934 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.934 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.934 DEBUG:boto:Params: {} 2023-12-15T23:14:07.934 DEBUG:boto:Token: None 2023-12-15T23:14:07.934 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:07.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Bs9bHQ4RskrLhLVdelkMdYusUpY= 2023-12-15T23:14:07.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Bs9bHQ4RskrLhLVdelkMdYusUpY='} 2023-12-15T23:14:07.941 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075efc1a1c765a00b-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.941 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.941 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.941 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.941 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.942 DEBUG:boto:Data: 2023-12-15T23:14:07.942 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.942 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.942 DEBUG:boto:Params: {} 2023-12-15T23:14:07.942 DEBUG:boto:Token: None 2023-12-15T23:14:07.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.944 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014cd1a1ef7a7c0f2-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.945 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.945 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.945 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.945 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.945 DEBUG:boto:Data: 2023-12-15T23:14:07.945 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.945 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.945 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.946 DEBUG:boto:Params: {} 2023-12-15T23:14:07.946 DEBUG:boto:Token: None 2023-12-15T23:14:07.946 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:07.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:O3pobR42nBj0st1w9koJ/KZxijk= 2023-12-15T23:14:07.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:O3pobR42nBj0st1w9koJ/KZxijk='} 2023-12-15T23:14:07.990 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000944fcca7b4cfd31-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.990 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:07.990 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:07.990 DEBUG:boto:Method: HEAD 2023-12-15T23:14:07.990 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:07.990 DEBUG:boto:Data: 2023-12-15T23:14:07.990 DEBUG:boto:Headers: {} 2023-12-15T23:14:07.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.990 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.990 DEBUG:boto:Params: {} 2023-12-15T23:14:07.991 DEBUG:boto:Token: None 2023-12-15T23:14:07.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/ 2023-12-15T23:14:07.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g= 2023-12-15T23:14:07.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVUMaFkivI/zv04aumyp0hMqi3g=', 'Content-Length': '0'} 2023-12-15T23:14:07.993 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047c8c67b7d9be26d-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:07.994 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:07.994 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:07.994 DEBUG:boto:Method: PUT 2023-12-15T23:14:07.994 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:07.994 DEBUG:boto:Data: 2023-12-15T23:14:07.994 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:07.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:07.994 DEBUG:boto:Port: 8000 2023-12-15T23:14:07.994 DEBUG:boto:Params: {} 2023-12-15T23:14:07.994 DEBUG:boto:Token: None 2023-12-15T23:14:07.995 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:07 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:07.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+jIfruORFo+X5wvubPLbxurHmRg= 2023-12-15T23:14:07.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+jIfruORFo+X5wvubPLbxurHmRg='} 2023-12-15T23:14:08.001 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000037ba43f3ec9e3cfd-00657cddbf-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.001 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.001 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.001 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.001 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.002 DEBUG:boto:Data: 2023-12-15T23:14:08.002 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.002 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.002 DEBUG:boto:Params: {} 2023-12-15T23:14:08.002 DEBUG:boto:Token: None 2023-12-15T23:14:08.002 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.005 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b7071635086c533f-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.005 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:08.005 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:08.005 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.005 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:08.005 DEBUG:boto:Data: 2023-12-15T23:14:08.006 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.006 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.006 DEBUG:boto:Params: {} 2023-12-15T23:14:08.006 DEBUG:boto:Token: None 2023-12-15T23:14:08.006 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:08.006 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZIAKqSuLpyTEwu3Ns3mizvn0CY= 2023-12-15T23:14:08.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZIAKqSuLpyTEwu3Ns3mizvn0CY='} 2023-12-15T23:14:08.013 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000d6d1d643794fa53-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.013 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.013 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.013 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.013 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.013 DEBUG:boto:Data: 2023-12-15T23:14:08.013 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.014 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.014 DEBUG:boto:Params: {} 2023-12-15T23:14:08.014 DEBUG:boto:Token: None 2023-12-15T23:14:08.014 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.016 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000169244b85f729fa2-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.017 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:08.017 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:08.017 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.017 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:08.017 DEBUG:boto:Data: 2023-12-15T23:14:08.017 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.017 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.017 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.017 DEBUG:boto:Params: {} 2023-12-15T23:14:08.018 DEBUG:boto:Token: None 2023-12-15T23:14:08.018 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:08.018 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:spt4FxhquRz0vitAWNtQvRCvcgo= 2023-12-15T23:14:08.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:spt4FxhquRz0vitAWNtQvRCvcgo='} 2023-12-15T23:14:08.061 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2c90b1d0ed0d88d-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.062 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.062 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.062 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.062 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.062 DEBUG:boto:Data: 2023-12-15T23:14:08.062 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.062 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.062 DEBUG:boto:Params: {} 2023-12-15T23:14:08.063 DEBUG:boto:Token: None 2023-12-15T23:14:08.063 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.065 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000166732c148ce0910-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.065 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:08.066 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:08.066 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.066 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:08.066 DEBUG:boto:Data: 2023-12-15T23:14:08.066 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.066 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.066 DEBUG:boto:Params: {} 2023-12-15T23:14:08.066 DEBUG:boto:Token: None 2023-12-15T23:14:08.066 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:08.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bMGwh80d+BcEy450meZyll2gQto= 2023-12-15T23:14:08.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bMGwh80d+BcEy450meZyll2gQto='} 2023-12-15T23:14:08.071 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000061c452f939371380-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.072 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.072 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.072 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.072 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.072 DEBUG:boto:Data: 2023-12-15T23:14:08.072 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.072 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.072 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.072 DEBUG:boto:Params: {} 2023-12-15T23:14:08.072 DEBUG:boto:Token: None 2023-12-15T23:14:08.073 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.075 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000059772c3858151432-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.075 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.076 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.076 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.076 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.076 DEBUG:boto:Data: 2023-12-15T23:14:08.076 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.076 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.076 DEBUG:boto:Params: {} 2023-12-15T23:14:08.076 DEBUG:boto:Token: None 2023-12-15T23:14:08.076 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ew2dlHD4zWmQChUL2inpjLYcB/I= 2023-12-15T23:14:08.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ew2dlHD4zWmQChUL2inpjLYcB/I='} 2023-12-15T23:14:08.122 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a5c9a2f69aaff5ff-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.122 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.122 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.122 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.122 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.122 DEBUG:boto:Data: 2023-12-15T23:14:08.122 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.122 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.123 DEBUG:boto:Params: {} 2023-12-15T23:14:08.123 DEBUG:boto:Token: None 2023-12-15T23:14:08.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.125 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c01559dbf32aa176-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.125 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:08.125 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:08.126 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.126 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:08.126 DEBUG:boto:Data: 2023-12-15T23:14:08.126 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.126 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.126 DEBUG:boto:Params: {} 2023-12-15T23:14:08.126 DEBUG:boto:Token: None 2023-12-15T23:14:08.126 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:08.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Et35RKmXVz4wydshUess/GXI+k= 2023-12-15T23:14:08.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Et35RKmXVz4wydshUess/GXI+k='} 2023-12-15T23:14:08.133 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f696f3860643c5ce-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.133 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.133 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.133 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.134 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.134 DEBUG:boto:Data: 2023-12-15T23:14:08.134 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.134 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.134 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.134 DEBUG:boto:Params: {} 2023-12-15T23:14:08.134 DEBUG:boto:Token: None 2023-12-15T23:14:08.134 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.137 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000095ad32a0e4fb6a9c-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.137 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:08.137 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:08.137 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.137 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:08.137 DEBUG:boto:Data: 2023-12-15T23:14:08.137 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.137 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.138 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.138 DEBUG:boto:Params: {} 2023-12-15T23:14:08.138 DEBUG:boto:Token: None 2023-12-15T23:14:08.138 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:08.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CN/dy5mTTtgyPrbjgu9Gwo3AXVs= 2023-12-15T23:14:08.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CN/dy5mTTtgyPrbjgu9Gwo3AXVs='} 2023-12-15T23:14:08.144 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d831089195a8ac3-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.144 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.144 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.145 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.145 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.145 DEBUG:boto:Data: 2023-12-15T23:14:08.145 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.145 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.145 DEBUG:boto:Params: {} 2023-12-15T23:14:08.145 DEBUG:boto:Token: None 2023-12-15T23:14:08.145 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.145 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.148 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ffe64cacd1d55bc-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.148 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:08.148 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:08.149 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.149 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:08.149 DEBUG:boto:Data: 2023-12-15T23:14:08.149 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.149 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.149 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.149 DEBUG:boto:Params: {} 2023-12-15T23:14:08.149 DEBUG:boto:Token: None 2023-12-15T23:14:08.149 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:08.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HRJ5+hUQpjjPN6Xa52ujrZdtpPo= 2023-12-15T23:14:08.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HRJ5+hUQpjjPN6Xa52ujrZdtpPo='} 2023-12-15T23:14:08.194 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bbc93395bd91792b-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.194 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.194 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.194 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.194 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.194 DEBUG:boto:Data: 2023-12-15T23:14:08.194 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.194 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.194 DEBUG:boto:Params: {} 2023-12-15T23:14:08.194 DEBUG:boto:Token: None 2023-12-15T23:14:08.195 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.197 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000164e137ee68bf83d-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.198 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.198 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.198 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.198 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.198 DEBUG:boto:Data: 2023-12-15T23:14:08.198 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.198 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.198 DEBUG:boto:Params: {} 2023-12-15T23:14:08.198 DEBUG:boto:Token: None 2023-12-15T23:14:08.198 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VHVea6EMxqM+GfI7l81i1OSRyh4= 2023-12-15T23:14:08.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VHVea6EMxqM+GfI7l81i1OSRyh4='} 2023-12-15T23:14:08.205 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007160404606b822c5-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.205 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.205 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.205 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.205 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.205 DEBUG:boto:Data: 2023-12-15T23:14:08.206 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.206 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.206 DEBUG:boto:Params: {} 2023-12-15T23:14:08.206 DEBUG:boto:Token: None 2023-12-15T23:14:08.206 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.209 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f3b6555f4068583a-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.209 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:08.209 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:08.210 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.210 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:08.210 DEBUG:boto:Data: 2023-12-15T23:14:08.210 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.210 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.210 DEBUG:boto:Params: {} 2023-12-15T23:14:08.210 DEBUG:boto:Token: None 2023-12-15T23:14:08.210 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:08.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GkHSec7ha2MeAcIJH1/QJwVKas0= 2023-12-15T23:14:08.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GkHSec7ha2MeAcIJH1/QJwVKas0='} 2023-12-15T23:14:08.217 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a2e78d4e9440b87a-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.217 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.217 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.217 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.217 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.217 DEBUG:boto:Data: 2023-12-15T23:14:08.217 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.218 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.218 DEBUG:boto:Params: {} 2023-12-15T23:14:08.218 DEBUG:boto:Token: None 2023-12-15T23:14:08.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.220 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c2cf78887aab518-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.221 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.221 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.221 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.221 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.221 DEBUG:boto:Data: 2023-12-15T23:14:08.221 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.221 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.221 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.221 DEBUG:boto:Params: {} 2023-12-15T23:14:08.221 DEBUG:boto:Token: None 2023-12-15T23:14:08.222 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2mQDeSnB6rs1Ut0TizHZ8lzVm7s= 2023-12-15T23:14:08.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2mQDeSnB6rs1Ut0TizHZ8lzVm7s='} 2023-12-15T23:14:08.266 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000018f4ae23ebd71da7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.266 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.266 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.266 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.266 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.266 DEBUG:boto:Data: 2023-12-15T23:14:08.266 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.266 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.266 DEBUG:boto:Params: {} 2023-12-15T23:14:08.267 DEBUG:boto:Token: None 2023-12-15T23:14:08.267 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.269 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000edb8d99c4ecdc2b7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.270 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:08.270 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:08.270 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.270 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:08.270 DEBUG:boto:Data: 2023-12-15T23:14:08.270 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.270 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.270 DEBUG:boto:Params: {} 2023-12-15T23:14:08.270 DEBUG:boto:Token: None 2023-12-15T23:14:08.271 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:08.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MSbVzLamZ3PS6kO0PRv2vHE5EQo= 2023-12-15T23:14:08.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MSbVzLamZ3PS6kO0PRv2vHE5EQo='} 2023-12-15T23:14:08.277 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe508d463b97c0e0-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.277 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.277 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.277 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.277 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.277 DEBUG:boto:Data: 2023-12-15T23:14:08.277 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.278 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.278 DEBUG:boto:Params: {} 2023-12-15T23:14:08.278 DEBUG:boto:Token: None 2023-12-15T23:14:08.278 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.278 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.280 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000052adacd6c5aaeda-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.281 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:08.281 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:08.281 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.281 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:08.281 DEBUG:boto:Data: 2023-12-15T23:14:08.281 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.281 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.281 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.281 DEBUG:boto:Params: {} 2023-12-15T23:14:08.282 DEBUG:boto:Token: None 2023-12-15T23:14:08.282 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:08.282 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H5nMCEZbMdJn+AOFfNt32AS98ig= 2023-12-15T23:14:08.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H5nMCEZbMdJn+AOFfNt32AS98ig='} 2023-12-15T23:14:08.287 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009a8e58d3849c51b6-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.287 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.287 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.287 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.287 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.287 DEBUG:boto:Data: 2023-12-15T23:14:08.287 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.287 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.287 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.288 DEBUG:boto:Params: {} 2023-12-15T23:14:08.288 DEBUG:boto:Token: None 2023-12-15T23:14:08.288 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.288 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.290 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '117'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004099751f334c00d1-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.291 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:08.291 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:08.291 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.291 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:08.291 DEBUG:boto:Data: 2023-12-15T23:14:08.291 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.291 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.291 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.291 DEBUG:boto:Params: {} 2023-12-15T23:14:08.292 DEBUG:boto:Token: None 2023-12-15T23:14:08.292 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:08.292 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1XMo/DD+5dzJEIW/vEe2Njb6fk= 2023-12-15T23:14:08.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1XMo/DD+5dzJEIW/vEe2Njb6fk='} 2023-12-15T23:14:08.334 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f6161d29f354bab2-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.334 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.334 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.334 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.334 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.334 DEBUG:boto:Data: 2023-12-15T23:14:08.334 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.334 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.334 DEBUG:boto:Params: {} 2023-12-15T23:14:08.334 DEBUG:boto:Token: None 2023-12-15T23:14:08.335 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.337 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '117'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d074302e3640dd9a-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.337 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:08.338 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:08.338 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.338 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:08.338 DEBUG:boto:Data: 2023-12-15T23:14:08.338 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.338 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.338 DEBUG:boto:Params: {} 2023-12-15T23:14:08.338 DEBUG:boto:Token: None 2023-12-15T23:14:08.338 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:08.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mogmH6GIWn6xvYDJLUzLvhfV02c= 2023-12-15T23:14:08.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mogmH6GIWn6xvYDJLUzLvhfV02c='} 2023-12-15T23:14:08.344 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d11aa69315000ef-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.344 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.344 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.344 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.344 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.344 DEBUG:boto:Data: 2023-12-15T23:14:08.344 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.344 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.344 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.344 DEBUG:boto:Params: {} 2023-12-15T23:14:08.345 DEBUG:boto:Token: None 2023-12-15T23:14:08.345 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.345 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.347 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000539481892737e8ed-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.347 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.347 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.348 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.348 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.348 DEBUG:boto:Data: 2023-12-15T23:14:08.348 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.348 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.348 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.348 DEBUG:boto:Params: {} 2023-12-15T23:14:08.348 DEBUG:boto:Token: None 2023-12-15T23:14:08.348 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.349 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iSLSqlZVTDSYG07rDtsh0RsD3vk= 2023-12-15T23:14:08.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iSLSqlZVTDSYG07rDtsh0RsD3vk='} 2023-12-15T23:14:08.355 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001d5b6f5d466b694a-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.355 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.355 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.355 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.355 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.355 DEBUG:boto:Data: 2023-12-15T23:14:08.355 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.355 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.355 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.356 DEBUG:boto:Params: {} 2023-12-15T23:14:08.356 DEBUG:boto:Token: None 2023-12-15T23:14:08.356 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.358 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c1c8b54e38cea9ce-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.358 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:08.359 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:08.359 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.359 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:08.359 DEBUG:boto:Data: 2023-12-15T23:14:08.359 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.359 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.359 DEBUG:boto:Params: {} 2023-12-15T23:14:08.359 DEBUG:boto:Token: None 2023-12-15T23:14:08.359 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:08.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:88N9We5CXNSR1/CJddDWvARp1sk= 2023-12-15T23:14:08.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:88N9We5CXNSR1/CJddDWvARp1sk='} 2023-12-15T23:14:08.402 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000023901946849709a7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.402 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.402 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.402 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.402 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.402 DEBUG:boto:Data: 2023-12-15T23:14:08.402 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.402 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.402 DEBUG:boto:Params: {} 2023-12-15T23:14:08.403 DEBUG:boto:Token: None 2023-12-15T23:14:08.403 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.405 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000059091322e16bd30a-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.406 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:08.406 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:08.406 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.406 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:08.406 DEBUG:boto:Data: 2023-12-15T23:14:08.406 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.406 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.406 DEBUG:boto:Params: {} 2023-12-15T23:14:08.407 DEBUG:boto:Token: None 2023-12-15T23:14:08.407 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:08.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Rc53xqBKlf6HEwx/MCqGkgAsETA= 2023-12-15T23:14:08.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Rc53xqBKlf6HEwx/MCqGkgAsETA='} 2023-12-15T23:14:08.412 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d71fdec57e5d8e7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.412 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:08.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:08.412 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:08.461 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:08.461 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:08.507 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:08.507 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:08.519 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 41 2023-12-15T23:14:08.592 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:08.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:08.593 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 31 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:08.681 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000019","obj00000000000000000006","obj00000000000000000467","obj00000000000000000005","obj00000000000000000056","obj00000000000000000004","obj00000000000000000023","obj00000000000000000317","obj00000000000000000022","obj00000000000000000000","obj00000000000000000021","obj00000000000000000009","obj00000000000000000271","obj00000000000000000008","obj00000000000000000018","obj00000000000000000007","obj00000000000000000017","obj00000000000000000162","obj00000000000000000016","obj00000000000000000003","obj00000000000000000423","obj00000000000000000002","obj00000000000000000012","obj00000000000000000001","obj00000000000000000011","obj00000000000000000283","obj00000000000000000010","obj00000000000000000061","obj00000000000000000050","obj00000000000000000029","obj00000000000000000133"]} 2023-12-15T23:14:08.681 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.681 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.681 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.681 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.682 DEBUG:boto:Data: 2023-12-15T23:14:08.682 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.682 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.682 DEBUG:boto:Params: {} 2023-12-15T23:14:08.682 DEBUG:boto:Token: None 2023-12-15T23:14:08.682 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.685 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '123'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f0a5328d98a2ce60-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.686 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:08.686 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:08.686 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.686 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:08.686 DEBUG:boto:Data: 2023-12-15T23:14:08.686 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.686 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.686 DEBUG:boto:Params: {} 2023-12-15T23:14:08.686 DEBUG:boto:Token: None 2023-12-15T23:14:08.687 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:08.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Abqavg+D0dzG9y3b/bV7Bj2iFI= 2023-12-15T23:14:08.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Abqavg+D0dzG9y3b/bV7Bj2iFI='} 2023-12-15T23:14:08.692 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eacde861bd72d3aa-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.692 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.692 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.692 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.692 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.692 DEBUG:boto:Data: 2023-12-15T23:14:08.693 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.693 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.693 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.693 DEBUG:boto:Params: {} 2023-12-15T23:14:08.693 DEBUG:boto:Token: None 2023-12-15T23:14:08.693 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.693 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.696 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c884616934204184-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.696 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:08.696 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:08.696 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.697 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:08.697 DEBUG:boto:Data: 2023-12-15T23:14:08.697 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.697 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.697 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.697 DEBUG:boto:Params: {} 2023-12-15T23:14:08.697 DEBUG:boto:Token: None 2023-12-15T23:14:08.697 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:08.697 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K6yvB3YVNOYfWOb+kO+lIoK6ULg= 2023-12-15T23:14:08.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K6yvB3YVNOYfWOb+kO+lIoK6ULg='} 2023-12-15T23:14:08.705 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a65c6c8962668f5-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.705 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.705 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.705 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.705 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.705 DEBUG:boto:Data: 2023-12-15T23:14:08.705 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.706 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.706 DEBUG:boto:Params: {} 2023-12-15T23:14:08.706 DEBUG:boto:Token: None 2023-12-15T23:14:08.706 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.708 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000943642831bbaa66f-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.709 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.709 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.709 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.709 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.709 DEBUG:boto:Data: 2023-12-15T23:14:08.709 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.709 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.709 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.710 DEBUG:boto:Params: {} 2023-12-15T23:14:08.710 DEBUG:boto:Token: None 2023-12-15T23:14:08.710 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:08.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ew2dlHD4zWmQChUL2inpjLYcB/I= 2023-12-15T23:14:08.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ew2dlHD4zWmQChUL2inpjLYcB/I='} 2023-12-15T23:14:08.754 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e6100aebb63d68b1-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.754 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.754 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.754 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.754 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.754 DEBUG:boto:Data: 2023-12-15T23:14:08.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.755 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.755 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.755 DEBUG:boto:Params: {} 2023-12-15T23:14:08.755 DEBUG:boto:Token: None 2023-12-15T23:14:08.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.758 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf8230bd9a96749d-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.758 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:08.758 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:08.759 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.759 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:08.759 DEBUG:boto:Data: 2023-12-15T23:14:08.759 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.759 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.759 DEBUG:boto:Params: {} 2023-12-15T23:14:08.759 DEBUG:boto:Token: None 2023-12-15T23:14:08.760 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:08.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EL3KLaJYWKEt5X+PuDGdE3JSZ/8= 2023-12-15T23:14:08.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EL3KLaJYWKEt5X+PuDGdE3JSZ/8='} 2023-12-15T23:14:08.765 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e191df5ad979992b-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.765 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.765 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.766 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.766 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.766 DEBUG:boto:Data: 2023-12-15T23:14:08.766 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.766 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.766 DEBUG:boto:Params: {} 2023-12-15T23:14:08.766 DEBUG:boto:Token: None 2023-12-15T23:14:08.767 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.769 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f82168d6d25b1d7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.770 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:08.770 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:08.770 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.770 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:08.770 DEBUG:boto:Data: 2023-12-15T23:14:08.770 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.770 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.770 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.770 DEBUG:boto:Params: {} 2023-12-15T23:14:08.771 DEBUG:boto:Token: None 2023-12-15T23:14:08.771 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:08.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m3bponhX6VGIffoabYdUiyw6USo= 2023-12-15T23:14:08.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m3bponhX6VGIffoabYdUiyw6USo='} 2023-12-15T23:14:08.813 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002760ef747c8e80dd-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.814 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.814 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.814 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.814 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.814 DEBUG:boto:Data: 2023-12-15T23:14:08.814 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.814 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.815 DEBUG:boto:Params: {} 2023-12-15T23:14:08.815 DEBUG:boto:Token: None 2023-12-15T23:14:08.815 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.817 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003aa91739fbc4243b-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.818 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:08.818 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:08.818 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.818 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:08.818 DEBUG:boto:Data: 2023-12-15T23:14:08.818 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.818 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.819 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.819 DEBUG:boto:Params: {} 2023-12-15T23:14:08.819 DEBUG:boto:Token: None 2023-12-15T23:14:08.819 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:08.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V9/wU1Mc62eoo3iAAvh9p5jWlXY= 2023-12-15T23:14:08.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V9/wU1Mc62eoo3iAAvh9p5jWlXY='} 2023-12-15T23:14:08.825 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000584f1cb9029259a7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.825 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.825 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.825 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.825 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.825 DEBUG:boto:Data: 2023-12-15T23:14:08.826 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.826 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.826 DEBUG:boto:Params: {} 2023-12-15T23:14:08.826 DEBUG:boto:Token: None 2023-12-15T23:14:08.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.829 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d7f7caca3a7a573-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.829 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.829 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.829 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.829 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.830 DEBUG:boto:Data: 2023-12-15T23:14:08.830 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.830 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.830 DEBUG:boto:Params: {} 2023-12-15T23:14:08.830 DEBUG:boto:Token: None 2023-12-15T23:14:08.830 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:08.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VHVea6EMxqM+GfI7l81i1OSRyh4= 2023-12-15T23:14:08.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VHVea6EMxqM+GfI7l81i1OSRyh4='} 2023-12-15T23:14:08.874 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002531283c67ccfec9-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.874 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.874 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.874 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.874 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.874 DEBUG:boto:Data: 2023-12-15T23:14:08.874 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.875 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.875 DEBUG:boto:Params: {} 2023-12-15T23:14:08.875 DEBUG:boto:Token: None 2023-12-15T23:14:08.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.878 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000626f2e62d8e17d2e-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.878 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:08.878 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:08.878 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.878 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:08.878 DEBUG:boto:Data: 2023-12-15T23:14:08.879 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.879 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.879 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.879 DEBUG:boto:Params: {} 2023-12-15T23:14:08.879 DEBUG:boto:Token: None 2023-12-15T23:14:08.879 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:08.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zIlaB6SECHDY/1JcAZwrxTGrNe8= 2023-12-15T23:14:08.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zIlaB6SECHDY/1JcAZwrxTGrNe8='} 2023-12-15T23:14:08.887 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000507eeca537ca2fdb-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.887 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.887 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.887 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.888 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.888 DEBUG:boto:Data: 2023-12-15T23:14:08.888 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.888 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.888 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.888 DEBUG:boto:Params: {} 2023-12-15T23:14:08.888 DEBUG:boto:Token: None 2023-12-15T23:14:08.888 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.889 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.891 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d58751e1f807bcd7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.892 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.892 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.892 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.892 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.892 DEBUG:boto:Data: 2023-12-15T23:14:08.892 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.892 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.892 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.893 DEBUG:boto:Params: {} 2023-12-15T23:14:08.893 DEBUG:boto:Token: None 2023-12-15T23:14:08.893 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:08.893 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2mQDeSnB6rs1Ut0TizHZ8lzVm7s= 2023-12-15T23:14:08.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2mQDeSnB6rs1Ut0TizHZ8lzVm7s='} 2023-12-15T23:14:08.937 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d48be78b87f0bb54-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.938 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.938 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.938 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.938 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.938 DEBUG:boto:Data: 2023-12-15T23:14:08.938 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.939 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.939 DEBUG:boto:Params: {} 2023-12-15T23:14:08.939 DEBUG:boto:Token: None 2023-12-15T23:14:08.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.941 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d87f068515116000-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.942 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.942 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.942 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.942 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.942 DEBUG:boto:Data: 2023-12-15T23:14:08.942 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.943 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.943 DEBUG:boto:Params: {} 2023-12-15T23:14:08.943 DEBUG:boto:Token: None 2023-12-15T23:14:08.943 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:08.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iSLSqlZVTDSYG07rDtsh0RsD3vk= 2023-12-15T23:14:08.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iSLSqlZVTDSYG07rDtsh0RsD3vk='} 2023-12-15T23:14:08.949 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ffd2767aa57ac77-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.950 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.950 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.950 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.950 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.950 DEBUG:boto:Data: 2023-12-15T23:14:08.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.950 DEBUG:boto:Params: {} 2023-12-15T23:14:08.951 DEBUG:boto:Token: None 2023-12-15T23:14:08.951 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:08.954 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ebc0163970e99d13-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.954 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:08.954 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:08.954 DEBUG:boto:Method: PUT 2023-12-15T23:14:08.954 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:08.954 DEBUG:boto:Data: 2023-12-15T23:14:08.954 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:08.955 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.955 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.955 DEBUG:boto:Params: {} 2023-12-15T23:14:08.955 DEBUG:boto:Token: None 2023-12-15T23:14:08.955 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:08.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n096W4GdZJVIXwXNwpCrUOysmTY= 2023-12-15T23:14:08.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n096W4GdZJVIXwXNwpCrUOysmTY='} 2023-12-15T23:14:08.998 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b98d2f1361e961a7-00657cddc0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:08.998 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:08.998 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:08.998 DEBUG:boto:Method: HEAD 2023-12-15T23:14:08.998 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:08.998 DEBUG:boto:Data: 2023-12-15T23:14:08.998 DEBUG:boto:Headers: {} 2023-12-15T23:14:08.999 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:08.999 DEBUG:boto:Port: 8000 2023-12-15T23:14:08.999 DEBUG:boto:Params: {} 2023-12-15T23:14:08.999 DEBUG:boto:Token: None 2023-12-15T23:14:08.999 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:08 GMT /kskgfn-48/ 2023-12-15T23:14:08.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48= 2023-12-15T23:14:08.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2XHybsrbWAJG8NiWT+zGbYEIb48=', 'Content-Length': '0'} 2023-12-15T23:14:09.002 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009060b8323a393416-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.002 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:09.002 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:09.003 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.003 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:09.003 DEBUG:boto:Data: 2023-12-15T23:14:09.003 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.003 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.003 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.003 DEBUG:boto:Params: {} 2023-12-15T23:14:09.003 DEBUG:boto:Token: None 2023-12-15T23:14:09.004 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:09.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DlkF+wUq1kHhmsnUU8ehI8+6/Hk= 2023-12-15T23:14:09.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DlkF+wUq1kHhmsnUU8ehI8+6/Hk='} 2023-12-15T23:14:09.011 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d03da54b3d6a8ec4-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.011 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.011 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.011 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.011 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.011 DEBUG:boto:Data: 2023-12-15T23:14:09.011 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.011 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.012 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.012 DEBUG:boto:Params: {} 2023-12-15T23:14:09.012 DEBUG:boto:Token: None 2023-12-15T23:14:09.012 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.012 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.015 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a263dea18bcdb2f1-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.015 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:09.015 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:09.016 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.016 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:09.016 DEBUG:boto:Data: 2023-12-15T23:14:09.016 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.016 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.016 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.016 DEBUG:boto:Params: {} 2023-12-15T23:14:09.016 DEBUG:boto:Token: None 2023-12-15T23:14:09.017 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:09.017 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KicUCHaPo+Y+ZDM+UT7JPz67cRI= 2023-12-15T23:14:09.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KicUCHaPo+Y+ZDM+UT7JPz67cRI='} 2023-12-15T23:14:09.061 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ac108d8f353bd604-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.062 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.062 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.062 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.062 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.062 DEBUG:boto:Data: 2023-12-15T23:14:09.062 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.062 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.063 DEBUG:boto:Params: {} 2023-12-15T23:14:09.063 DEBUG:boto:Token: None 2023-12-15T23:14:09.063 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.066 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000495eaa1a2669cb5e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.066 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:09.066 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:09.067 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.067 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:09.067 DEBUG:boto:Data: 2023-12-15T23:14:09.067 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.067 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.067 DEBUG:boto:Params: {} 2023-12-15T23:14:09.067 DEBUG:boto:Token: None 2023-12-15T23:14:09.068 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:09.068 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FhMue6OgT2l1LVsWIOCOEoMkxWw= 2023-12-15T23:14:09.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FhMue6OgT2l1LVsWIOCOEoMkxWw='} 2023-12-15T23:14:09.073 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d1a86a8a49371314-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.073 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.073 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.073 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.073 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.073 DEBUG:boto:Data: 2023-12-15T23:14:09.073 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.074 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.074 DEBUG:boto:Params: {} 2023-12-15T23:14:09.074 DEBUG:boto:Token: None 2023-12-15T23:14:09.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.077 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c79b71e73e3b7f01-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.077 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.077 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.077 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.077 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.078 DEBUG:boto:Data: 2023-12-15T23:14:09.078 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.078 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.078 DEBUG:boto:Params: {} 2023-12-15T23:14:09.078 DEBUG:boto:Token: None 2023-12-15T23:14:09.078 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U75O/pmRRfe5qtBWG1XHzVTsq1Q= 2023-12-15T23:14:09.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U75O/pmRRfe5qtBWG1XHzVTsq1Q='} 2023-12-15T23:14:09.122 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006006b895b2678674-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.122 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.122 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.122 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.122 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.122 DEBUG:boto:Data: 2023-12-15T23:14:09.122 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.122 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.123 DEBUG:boto:Params: {} 2023-12-15T23:14:09.123 DEBUG:boto:Token: None 2023-12-15T23:14:09.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000806ed10b55035d75-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.126 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.126 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.126 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.126 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.127 DEBUG:boto:Data: 2023-12-15T23:14:09.127 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.127 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.127 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.127 DEBUG:boto:Params: {} 2023-12-15T23:14:09.127 DEBUG:boto:Token: None 2023-12-15T23:14:09.127 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wydeS+4YDTHWW06KS24mvpPWhj0= 2023-12-15T23:14:09.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wydeS+4YDTHWW06KS24mvpPWhj0='} 2023-12-15T23:14:09.134 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004c7b301125387d7-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.134 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.134 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.134 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.134 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.135 DEBUG:boto:Data: 2023-12-15T23:14:09.135 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.135 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.135 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.135 DEBUG:boto:Params: {} 2023-12-15T23:14:09.135 DEBUG:boto:Token: None 2023-12-15T23:14:09.135 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.138 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000052a575e40f291b46-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.138 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:09.138 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:09.138 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.139 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:09.139 DEBUG:boto:Data: 2023-12-15T23:14:09.139 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.139 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.139 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.139 DEBUG:boto:Params: {} 2023-12-15T23:14:09.139 DEBUG:boto:Token: None 2023-12-15T23:14:09.139 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:09.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nDyNBxX33fZmQUlWHWO8CqWhb/E= 2023-12-15T23:14:09.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nDyNBxX33fZmQUlWHWO8CqWhb/E='} 2023-12-15T23:14:09.182 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000fa918e40e9e2f9e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.182 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.182 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.182 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.182 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.182 DEBUG:boto:Data: 2023-12-15T23:14:09.182 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.183 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.183 DEBUG:boto:Params: {} 2023-12-15T23:14:09.183 DEBUG:boto:Token: None 2023-12-15T23:14:09.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.185 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005c84938815d2e474-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.186 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:09.186 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:09.186 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.186 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:09.186 DEBUG:boto:Data: 2023-12-15T23:14:09.186 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.187 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.187 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.187 DEBUG:boto:Params: {} 2023-12-15T23:14:09.187 DEBUG:boto:Token: None 2023-12-15T23:14:09.187 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:09.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m4fql5KiiXdOYmlk7D/e+UJkU+4= 2023-12-15T23:14:09.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m4fql5KiiXdOYmlk7D/e+UJkU+4='} 2023-12-15T23:14:09.192 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fab2630bc04398c1-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.192 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.192 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.192 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.192 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.193 DEBUG:boto:Data: 2023-12-15T23:14:09.193 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.193 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.193 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.193 DEBUG:boto:Params: {} 2023-12-15T23:14:09.193 DEBUG:boto:Token: None 2023-12-15T23:14:09.193 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.196 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b551ecdfd5e7dfed-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.196 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:09.196 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:09.196 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.196 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:09.197 DEBUG:boto:Data: 2023-12-15T23:14:09.197 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.197 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.197 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.197 DEBUG:boto:Params: {} 2023-12-15T23:14:09.197 DEBUG:boto:Token: None 2023-12-15T23:14:09.197 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:09.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xhmqj3CPuHcGNBAf8kLbSfUO70k= 2023-12-15T23:14:09.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xhmqj3CPuHcGNBAf8kLbSfUO70k='} 2023-12-15T23:14:09.241 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000d633a55a588ec98-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.242 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.242 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.242 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.242 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.242 DEBUG:boto:Data: 2023-12-15T23:14:09.242 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.242 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.243 DEBUG:boto:Params: {} 2023-12-15T23:14:09.243 DEBUG:boto:Token: None 2023-12-15T23:14:09.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.243 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.246 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e9df3c61d6711ab5-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.246 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:09.246 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:09.246 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.247 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:09.247 DEBUG:boto:Data: 2023-12-15T23:14:09.247 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.247 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.247 DEBUG:boto:Params: {} 2023-12-15T23:14:09.247 DEBUG:boto:Token: None 2023-12-15T23:14:09.247 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:09.248 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PX/U4U6EkVOOSubfT1bv89zusvg= 2023-12-15T23:14:09.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PX/U4U6EkVOOSubfT1bv89zusvg='} 2023-12-15T23:14:09.254 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b836dafb51f22bf-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.254 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.254 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.254 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.254 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.254 DEBUG:boto:Data: 2023-12-15T23:14:09.255 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.255 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.255 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.255 DEBUG:boto:Params: {} 2023-12-15T23:14:09.255 DEBUG:boto:Token: None 2023-12-15T23:14:09.255 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.260 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b4d662f77aa008b9-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.261 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:09.261 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:09.261 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.261 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:09.261 DEBUG:boto:Data: 2023-12-15T23:14:09.261 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.262 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.262 DEBUG:boto:Params: {} 2023-12-15T23:14:09.262 DEBUG:boto:Token: None 2023-12-15T23:14:09.262 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:09.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jofY+tSViHtxDshjaGJZVYlEjBQ= 2023-12-15T23:14:09.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jofY+tSViHtxDshjaGJZVYlEjBQ='} 2023-12-15T23:14:09.306 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b6b4bcbd4cd64fe0-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.306 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.306 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.306 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.306 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.306 DEBUG:boto:Data: 2023-12-15T23:14:09.306 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.307 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.307 DEBUG:boto:Params: {} 2023-12-15T23:14:09.307 DEBUG:boto:Token: None 2023-12-15T23:14:09.307 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.310 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003882d70049d824e8-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.310 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:09.310 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:09.311 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.311 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:09.311 DEBUG:boto:Data: 2023-12-15T23:14:09.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.311 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.311 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.311 DEBUG:boto:Params: {} 2023-12-15T23:14:09.311 DEBUG:boto:Token: None 2023-12-15T23:14:09.311 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:09.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KB2mX7P4+GsqafFeVzRr0erGNXM= 2023-12-15T23:14:09.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KB2mX7P4+GsqafFeVzRr0erGNXM='} 2023-12-15T23:14:09.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b5b090acdf152090-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.318 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.318 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.318 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.318 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.318 DEBUG:boto:Data: 2023-12-15T23:14:09.318 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.319 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.319 DEBUG:boto:Params: {} 2023-12-15T23:14:09.319 DEBUG:boto:Token: None 2023-12-15T23:14:09.319 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004b3bc9b1d77fb738-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.322 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:09.322 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:09.323 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.323 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:09.323 DEBUG:boto:Data: 2023-12-15T23:14:09.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.323 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.323 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.323 DEBUG:boto:Params: {} 2023-12-15T23:14:09.323 DEBUG:boto:Token: None 2023-12-15T23:14:09.324 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:09.324 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4c8I7x4MByBqOrPlRLKLPDaSzmk= 2023-12-15T23:14:09.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4c8I7x4MByBqOrPlRLKLPDaSzmk='} 2023-12-15T23:14:09.365 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003af3a165b6049940-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.366 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.366 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.366 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.366 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.366 DEBUG:boto:Data: 2023-12-15T23:14:09.366 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.366 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.366 DEBUG:boto:Params: {} 2023-12-15T23:14:09.367 DEBUG:boto:Token: None 2023-12-15T23:14:09.367 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.370 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '50'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009aea54d5b128724e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.370 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:09.370 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:09.370 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.370 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:09.371 DEBUG:boto:Data: 2023-12-15T23:14:09.371 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.371 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.371 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.371 DEBUG:boto:Params: {} 2023-12-15T23:14:09.371 DEBUG:boto:Token: None 2023-12-15T23:14:09.371 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:09.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEiSPE7ZdWRPQ8UcuRGRzcuXWWg= 2023-12-15T23:14:09.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEiSPE7ZdWRPQ8UcuRGRzcuXWWg='} 2023-12-15T23:14:09.376 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000076ecd9ab93db704d-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.377 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.377 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.377 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.377 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.377 DEBUG:boto:Data: 2023-12-15T23:14:09.377 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.377 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.377 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.377 DEBUG:boto:Params: {} 2023-12-15T23:14:09.378 DEBUG:boto:Token: None 2023-12-15T23:14:09.378 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.381 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007cbe3f5de96d335e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.381 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:09.381 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:09.381 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.381 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:09.381 DEBUG:boto:Data: 2023-12-15T23:14:09.381 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.382 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.382 DEBUG:boto:Params: {} 2023-12-15T23:14:09.382 DEBUG:boto:Token: None 2023-12-15T23:14:09.382 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:09.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FjQL/62UjPXj6bHWqOXk/zjAvDQ= 2023-12-15T23:14:09.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FjQL/62UjPXj6bHWqOXk/zjAvDQ='} 2023-12-15T23:14:09.429 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f9743b4e15f5e08e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.430 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.430 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.430 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.430 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.430 DEBUG:boto:Data: 2023-12-15T23:14:09.430 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.430 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.430 DEBUG:boto:Params: {} 2023-12-15T23:14:09.431 DEBUG:boto:Token: None 2023-12-15T23:14:09.431 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.433 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081c9cd42c860ad64-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.434 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:09.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:09.434 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.434 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:09.434 DEBUG:boto:Data: 2023-12-15T23:14:09.434 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.434 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.434 DEBUG:boto:Params: {} 2023-12-15T23:14:09.435 DEBUG:boto:Token: None 2023-12-15T23:14:09.435 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:09.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BefWvjtGL9TLr5uHFNC368vlDpk= 2023-12-15T23:14:09.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BefWvjtGL9TLr5uHFNC368vlDpk='} 2023-12-15T23:14:09.440 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe8edc1caff24ea1-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.440 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.441 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.441 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.441 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.441 DEBUG:boto:Data: 2023-12-15T23:14:09.441 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.441 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.441 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.441 DEBUG:boto:Params: {} 2023-12-15T23:14:09.441 DEBUG:boto:Token: None 2023-12-15T23:14:09.442 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.444 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f5b8358c4aaa2e4b-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.444 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:09.445 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:09.445 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.445 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:09.445 DEBUG:boto:Data: 2023-12-15T23:14:09.445 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.445 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.445 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.445 DEBUG:boto:Params: {} 2023-12-15T23:14:09.446 DEBUG:boto:Token: None 2023-12-15T23:14:09.446 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:09.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ipHhatQak4PU+aY1p2plGyRsr/c= 2023-12-15T23:14:09.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ipHhatQak4PU+aY1p2plGyRsr/c='} 2023-12-15T23:14:09.452 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f98d3bb568688c2-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.453 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.453 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.453 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.453 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.453 DEBUG:boto:Data: 2023-12-15T23:14:09.453 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.453 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.453 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.453 DEBUG:boto:Params: {} 2023-12-15T23:14:09.454 DEBUG:boto:Token: None 2023-12-15T23:14:09.454 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.456 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005adb2092e5040748-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.457 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:09.457 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:09.457 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.457 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:09.457 DEBUG:boto:Data: 2023-12-15T23:14:09.457 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.457 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.458 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.458 DEBUG:boto:Params: {} 2023-12-15T23:14:09.458 DEBUG:boto:Token: None 2023-12-15T23:14:09.458 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:09.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Xcx7I0Qdva4dnS17y52EHseeQ4= 2023-12-15T23:14:09.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Xcx7I0Qdva4dnS17y52EHseeQ4='} 2023-12-15T23:14:09.502 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000419fd52f424bf67e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.502 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:09.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:09.502 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:09.555 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:09.555 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:09.604 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:14:09.604 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-48 2023-12-15T23:14:09.618 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 53 2023-12-15T23:14:09.700 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:09.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:09.700 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 37 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:09.748 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:09.748 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:09.788 INFO:teuthology.orchestra.run.smithi093.stdout:{"objs":["obj00000000000000000060","obj00000000000000000000","obj00000000000000000011","obj00000000000000000001","obj00000000000000000033","obj00000000000000000065","obj00000000000000000005","obj00000000000000000016","obj00000000000000000048","obj00000000000000000015","obj00000000000000000026","obj00000000000000000030","obj00000000000000000062","obj00000000000000000009","obj00000000000000000040","obj00000000000000000024","obj00000000000000000012","obj00000000000000000002","obj00000000000000000013","obj00000000000000000045","obj00000000000000000006","obj00000000000000000017","obj00000000000000000007","obj00000000000000000039","obj00000000000000000027","obj00000000000000000010","obj00000000000000000021","obj00000000000000000053","obj00000000000000000020","obj00000000000000000004","obj00000000000000000036","obj00000000000000000003","obj00000000000000000014","obj00000000000000000019","obj00000000000000000057","obj00000000000000000018","obj00000000000000000008"]} 2023-12-15T23:14:09.788 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.789 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.789 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.789 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.789 DEBUG:boto:Data: 2023-12-15T23:14:09.789 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.789 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.789 DEBUG:boto:Params: {} 2023-12-15T23:14:09.790 DEBUG:boto:Token: None 2023-12-15T23:14:09.790 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.793 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd354ad0f6b46946-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.793 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:09.794 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:09.794 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.794 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:09.794 DEBUG:boto:Data: 2023-12-15T23:14:09.794 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.794 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.794 DEBUG:boto:Params: {} 2023-12-15T23:14:09.795 DEBUG:boto:Token: None 2023-12-15T23:14:09.795 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:09.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OBS3sCtoMKRe0tc/IrX3EFP7WGo= 2023-12-15T23:14:09.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OBS3sCtoMKRe0tc/IrX3EFP7WGo='} 2023-12-15T23:14:09.801 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ebfeb955907c176b-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.802 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.802 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.802 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.802 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.802 DEBUG:boto:Data: 2023-12-15T23:14:09.802 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.802 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.802 DEBUG:boto:Params: {} 2023-12-15T23:14:09.803 DEBUG:boto:Token: None 2023-12-15T23:14:09.803 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.806 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc13c93efdb73de9-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.806 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:09.806 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:09.806 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.806 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:09.806 DEBUG:boto:Data: 2023-12-15T23:14:09.806 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.807 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.807 DEBUG:boto:Params: {} 2023-12-15T23:14:09.807 DEBUG:boto:Token: None 2023-12-15T23:14:09.807 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:09.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7c+Q/1Qgm4nv57PJO8WFbb/+tX4= 2023-12-15T23:14:09.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7c+Q/1Qgm4nv57PJO8WFbb/+tX4='} 2023-12-15T23:14:09.814 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b4fb1640ccfa789e-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.814 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.814 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.814 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.814 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.814 DEBUG:boto:Data: 2023-12-15T23:14:09.815 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.815 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.815 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.815 DEBUG:boto:Params: {} 2023-12-15T23:14:09.815 DEBUG:boto:Token: None 2023-12-15T23:14:09.815 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.818 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a898fea9068cd1fa-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.819 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:09.819 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:09.819 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.819 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:09.819 DEBUG:boto:Data: 2023-12-15T23:14:09.819 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.820 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.820 DEBUG:boto:Params: {} 2023-12-15T23:14:09.820 DEBUG:boto:Token: None 2023-12-15T23:14:09.820 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:09.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qfXt++1ow/dEVFeGLicw4CyRvE8= 2023-12-15T23:14:09.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qfXt++1ow/dEVFeGLicw4CyRvE8='} 2023-12-15T23:14:09.862 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c27b104730ed754-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.862 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.862 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.862 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.862 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.862 DEBUG:boto:Data: 2023-12-15T23:14:09.862 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.863 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.863 DEBUG:boto:Params: {} 2023-12-15T23:14:09.863 DEBUG:boto:Token: None 2023-12-15T23:14:09.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.866 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005bc678d99737e1c0-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.867 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:09.867 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:09.867 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.867 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:09.867 DEBUG:boto:Data: 2023-12-15T23:14:09.867 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.867 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.867 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.867 DEBUG:boto:Params: {} 2023-12-15T23:14:09.868 DEBUG:boto:Token: None 2023-12-15T23:14:09.868 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:09.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ULAn84CS7fx0Bf/60fhO17hIVgI= 2023-12-15T23:14:09.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ULAn84CS7fx0Bf/60fhO17hIVgI='} 2023-12-15T23:14:09.875 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e39b481c40cce7b1-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.875 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.875 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.875 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.875 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.875 DEBUG:boto:Data: 2023-12-15T23:14:09.875 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.875 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.875 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.876 DEBUG:boto:Params: {} 2023-12-15T23:14:09.876 DEBUG:boto:Token: None 2023-12-15T23:14:09.876 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.876 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.879 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db550b786b776bcc-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.879 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.880 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.880 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.880 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.880 DEBUG:boto:Data: 2023-12-15T23:14:09.880 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.880 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.880 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.880 DEBUG:boto:Params: {} 2023-12-15T23:14:09.880 DEBUG:boto:Token: None 2023-12-15T23:14:09.881 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:09.881 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U75O/pmRRfe5qtBWG1XHzVTsq1Q= 2023-12-15T23:14:09.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U75O/pmRRfe5qtBWG1XHzVTsq1Q='} 2023-12-15T23:14:09.926 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003fcc4ffbfdfdd794-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.926 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.926 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.926 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.926 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.926 DEBUG:boto:Data: 2023-12-15T23:14:09.926 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.926 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.927 DEBUG:boto:Params: {} 2023-12-15T23:14:09.927 DEBUG:boto:Token: None 2023-12-15T23:14:09.927 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.930 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b1a7038c511aaf87-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.930 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.930 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.930 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.931 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.931 DEBUG:boto:Data: 2023-12-15T23:14:09.931 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.931 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.931 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.931 DEBUG:boto:Params: {} 2023-12-15T23:14:09.931 DEBUG:boto:Token: None 2023-12-15T23:14:09.931 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:09.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wydeS+4YDTHWW06KS24mvpPWhj0= 2023-12-15T23:14:09.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wydeS+4YDTHWW06KS24mvpPWhj0='} 2023-12-15T23:14:09.938 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b526e409440860f-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.938 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.938 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.938 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.938 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.939 DEBUG:boto:Data: 2023-12-15T23:14:09.939 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.939 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.939 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.939 DEBUG:boto:Params: {} 2023-12-15T23:14:09.939 DEBUG:boto:Token: None 2023-12-15T23:14:09.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.942 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002a1f01da0aec560-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.942 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:09.942 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:09.943 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.943 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:09.943 DEBUG:boto:Data: 2023-12-15T23:14:09.943 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.943 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.943 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.943 DEBUG:boto:Params: {} 2023-12-15T23:14:09.943 DEBUG:boto:Token: None 2023-12-15T23:14:09.944 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:09.944 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vaQdAG0pNyOyQVt4uNgza2YRNYA= 2023-12-15T23:14:09.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vaQdAG0pNyOyQVt4uNgza2YRNYA='} 2023-12-15T23:14:09.990 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002b68b3e2a05196cb-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.990 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:09.990 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:09.990 DEBUG:boto:Method: HEAD 2023-12-15T23:14:09.990 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:09.990 DEBUG:boto:Data: 2023-12-15T23:14:09.990 DEBUG:boto:Headers: {} 2023-12-15T23:14:09.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.991 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.991 DEBUG:boto:Params: {} 2023-12-15T23:14:09.991 DEBUG:boto:Token: None 2023-12-15T23:14:09.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/ 2023-12-15T23:14:09.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw= 2023-12-15T23:14:09.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K1wDcUIprEWwtMlHm6YQUKuZNOw=', 'Content-Length': '0'} 2023-12-15T23:14:09.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d859597c42a201e5-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:09.994 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:09.995 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:09.995 DEBUG:boto:Method: PUT 2023-12-15T23:14:09.995 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:09.995 DEBUG:boto:Data: 2023-12-15T23:14:09.995 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:09.995 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:09.995 DEBUG:boto:Port: 8000 2023-12-15T23:14:09.995 DEBUG:boto:Params: {} 2023-12-15T23:14:09.995 DEBUG:boto:Token: None 2023-12-15T23:14:09.996 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:09 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:09.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gNMJ7rhcd71TJ+VtBBAuz0skQO8= 2023-12-15T23:14:09.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:09 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gNMJ7rhcd71TJ+VtBBAuz0skQO8='} 2023-12-15T23:14:10.002 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1183974366a4e15-00657cddc1-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.002 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.002 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.002 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.002 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.003 DEBUG:boto:Data: 2023-12-15T23:14:10.003 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.003 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.003 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.003 DEBUG:boto:Params: {} 2023-12-15T23:14:10.003 DEBUG:boto:Token: None 2023-12-15T23:14:10.003 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.006 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049db060fed6b42fa-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.006 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:10.007 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:10.007 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.007 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:10.007 DEBUG:boto:Data: 2023-12-15T23:14:10.007 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.007 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.007 DEBUG:boto:Params: {} 2023-12-15T23:14:10.008 DEBUG:boto:Token: None 2023-12-15T23:14:10.008 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:10.008 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qBE3vfdw2B2Gh/kN4Y+o6DPlm/Q= 2023-12-15T23:14:10.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qBE3vfdw2B2Gh/kN4Y+o6DPlm/Q='} 2023-12-15T23:14:10.050 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000344636ca8a562ef3-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.050 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.050 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.050 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.050 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.050 DEBUG:boto:Data: 2023-12-15T23:14:10.050 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.050 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.051 DEBUG:boto:Params: {} 2023-12-15T23:14:10.051 DEBUG:boto:Token: None 2023-12-15T23:14:10.051 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.054 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e146f201ec5c7224-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.054 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:10.054 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:10.054 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.054 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:10.054 DEBUG:boto:Data: 2023-12-15T23:14:10.055 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.055 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.055 DEBUG:boto:Params: {} 2023-12-15T23:14:10.055 DEBUG:boto:Token: None 2023-12-15T23:14:10.055 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:10.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SbALLQ1NRksWr1gMDvAbbNo7LW4= 2023-12-15T23:14:10.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SbALLQ1NRksWr1gMDvAbbNo7LW4='} 2023-12-15T23:14:10.060 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f8ec9ece09ad2303-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.061 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.061 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.061 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.061 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.061 DEBUG:boto:Data: 2023-12-15T23:14:10.061 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.061 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.062 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.062 DEBUG:boto:Params: {} 2023-12-15T23:14:10.062 DEBUG:boto:Token: None 2023-12-15T23:14:10.062 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.065 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000a7053c6ff5758e1-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.065 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:10.065 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:10.066 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.066 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:10.066 DEBUG:boto:Data: 2023-12-15T23:14:10.066 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.066 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.066 DEBUG:boto:Params: {} 2023-12-15T23:14:10.066 DEBUG:boto:Token: None 2023-12-15T23:14:10.066 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:10.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vxH8YLst47+kVAUk4qcxDV5bxeQ= 2023-12-15T23:14:10.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vxH8YLst47+kVAUk4qcxDV5bxeQ='} 2023-12-15T23:14:10.113 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b74a2d4a70a1003b-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.114 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.114 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.114 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.114 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.114 DEBUG:boto:Data: 2023-12-15T23:14:10.114 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.114 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.115 DEBUG:boto:Params: {} 2023-12-15T23:14:10.115 DEBUG:boto:Token: None 2023-12-15T23:14:10.115 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.118 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069694d075adccf09-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:10.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:10.119 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.119 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:10.119 DEBUG:boto:Data: 2023-12-15T23:14:10.119 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.119 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.119 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.119 DEBUG:boto:Params: {} 2023-12-15T23:14:10.119 DEBUG:boto:Token: None 2023-12-15T23:14:10.119 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:10.120 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u7xW+U4/Rd7v8GvQWmtGjYFcDX4= 2023-12-15T23:14:10.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u7xW+U4/Rd7v8GvQWmtGjYFcDX4='} 2023-12-15T23:14:10.125 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003f54288a5f135bca-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.126 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.126 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.126 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.126 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.126 DEBUG:boto:Data: 2023-12-15T23:14:10.126 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.126 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.126 DEBUG:boto:Params: {} 2023-12-15T23:14:10.127 DEBUG:boto:Token: None 2023-12-15T23:14:10.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.130 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b162dc3add6f147-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.130 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:10.130 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:10.130 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.130 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:10.131 DEBUG:boto:Data: 2023-12-15T23:14:10.131 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.131 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.131 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.131 DEBUG:boto:Params: {} 2023-12-15T23:14:10.131 DEBUG:boto:Token: None 2023-12-15T23:14:10.131 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:10.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4GZDB+/4X16iKi/bF6GwN4OvDR4= 2023-12-15T23:14:10.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4GZDB+/4X16iKi/bF6GwN4OvDR4='} 2023-12-15T23:14:10.178 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c95c970d9612f16f-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.178 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.178 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.178 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.178 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.178 DEBUG:boto:Data: 2023-12-15T23:14:10.178 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.178 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.179 DEBUG:boto:Params: {} 2023-12-15T23:14:10.179 DEBUG:boto:Token: None 2023-12-15T23:14:10.179 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.182 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007132ec89c7c4ba3f-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.182 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:10.182 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:10.182 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.182 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:10.182 DEBUG:boto:Data: 2023-12-15T23:14:10.183 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.183 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.183 DEBUG:boto:Params: {} 2023-12-15T23:14:10.183 DEBUG:boto:Token: None 2023-12-15T23:14:10.183 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:10.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SM/5H9rCpVmjK1fTnF/6s3tjIWk= 2023-12-15T23:14:10.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SM/5H9rCpVmjK1fTnF/6s3tjIWk='} 2023-12-15T23:14:10.190 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a27f919e4066a58a-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.190 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.190 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.190 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.191 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.191 DEBUG:boto:Data: 2023-12-15T23:14:10.191 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.191 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.191 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.191 DEBUG:boto:Params: {} 2023-12-15T23:14:10.191 DEBUG:boto:Token: None 2023-12-15T23:14:10.191 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.194 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009870896b26dc237b-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.195 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:10.195 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:10.195 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.195 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:10.195 DEBUG:boto:Data: 2023-12-15T23:14:10.195 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.195 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.195 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.195 DEBUG:boto:Params: {} 2023-12-15T23:14:10.195 DEBUG:boto:Token: None 2023-12-15T23:14:10.196 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:10.196 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xpKcWTvupt2o3452JQhlUti49Q4= 2023-12-15T23:14:10.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xpKcWTvupt2o3452JQhlUti49Q4='} 2023-12-15T23:14:10.237 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003cf49221457a2401-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.238 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.238 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.238 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.238 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.238 DEBUG:boto:Data: 2023-12-15T23:14:10.238 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.238 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.238 DEBUG:boto:Params: {} 2023-12-15T23:14:10.239 DEBUG:boto:Token: None 2023-12-15T23:14:10.239 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.242 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbc899210e5b880e-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.242 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:10.242 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:10.242 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.243 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:10.243 DEBUG:boto:Data: 2023-12-15T23:14:10.243 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.243 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.243 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.243 DEBUG:boto:Params: {} 2023-12-15T23:14:10.243 DEBUG:boto:Token: None 2023-12-15T23:14:10.243 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:10.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TP9HFMUM93eeNBV764bOcN7AhyM= 2023-12-15T23:14:10.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TP9HFMUM93eeNBV764bOcN7AhyM='} 2023-12-15T23:14:10.250 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004032183d30e38113-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.250 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.250 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.250 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.250 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.250 DEBUG:boto:Data: 2023-12-15T23:14:10.251 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.251 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.251 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.251 DEBUG:boto:Params: {} 2023-12-15T23:14:10.251 DEBUG:boto:Token: None 2023-12-15T23:14:10.251 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.254 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031a548996dee3f17-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.255 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:10.255 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:10.255 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.255 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:10.255 DEBUG:boto:Data: 2023-12-15T23:14:10.255 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.255 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.255 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.256 DEBUG:boto:Params: {} 2023-12-15T23:14:10.256 DEBUG:boto:Token: None 2023-12-15T23:14:10.256 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:10.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z7k2/Y+oT+ysTW6GwmwCluvUiqA= 2023-12-15T23:14:10.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z7k2/Y+oT+ysTW6GwmwCluvUiqA='} 2023-12-15T23:14:10.302 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000011a723a6a18ed562-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.302 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.302 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.302 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.302 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.302 DEBUG:boto:Data: 2023-12-15T23:14:10.302 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.303 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.303 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.303 DEBUG:boto:Params: {} 2023-12-15T23:14:10.303 DEBUG:boto:Token: None 2023-12-15T23:14:10.303 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.306 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000098dd9a1495e96fc4-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.306 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:10.307 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:10.307 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.307 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:10.307 DEBUG:boto:Data: 2023-12-15T23:14:10.307 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.307 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.307 DEBUG:boto:Params: {} 2023-12-15T23:14:10.307 DEBUG:boto:Token: None 2023-12-15T23:14:10.308 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:10.308 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PoY4267vtRLyD/EtbmCVA6YPIKo= 2023-12-15T23:14:10.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PoY4267vtRLyD/EtbmCVA6YPIKo='} 2023-12-15T23:14:10.315 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000201f663e5a65ec2a-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.315 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.315 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.315 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.315 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.316 DEBUG:boto:Data: 2023-12-15T23:14:10.316 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.316 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.316 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.316 DEBUG:boto:Params: {} 2023-12-15T23:14:10.316 DEBUG:boto:Token: None 2023-12-15T23:14:10.316 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.316 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.319 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058b23e92d98cb111-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.320 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:10.320 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:10.320 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.320 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:10.320 DEBUG:boto:Data: 2023-12-15T23:14:10.320 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.320 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.320 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.320 DEBUG:boto:Params: {} 2023-12-15T23:14:10.321 DEBUG:boto:Token: None 2023-12-15T23:14:10.321 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:10.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wUfU2eKio3b/smrS6u2EghS3dMU= 2023-12-15T23:14:10.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wUfU2eKio3b/smrS6u2EghS3dMU='} 2023-12-15T23:14:10.370 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e7f542858df34b27-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.370 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.370 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.370 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.370 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.370 DEBUG:boto:Data: 2023-12-15T23:14:10.370 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.371 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.371 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.371 DEBUG:boto:Params: {} 2023-12-15T23:14:10.371 DEBUG:boto:Token: None 2023-12-15T23:14:10.371 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.374 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc8438c547489a36-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.375 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:10.375 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:10.375 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.375 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:10.375 DEBUG:boto:Data: 2023-12-15T23:14:10.375 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.375 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.375 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.375 DEBUG:boto:Params: {} 2023-12-15T23:14:10.376 DEBUG:boto:Token: None 2023-12-15T23:14:10.376 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:10.376 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:32cwxN/G6CQIJG9fyOMVCvhxnWQ= 2023-12-15T23:14:10.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:32cwxN/G6CQIJG9fyOMVCvhxnWQ='} 2023-12-15T23:14:10.381 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000856bb858307aa5d5-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.381 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.381 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.381 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.382 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.382 DEBUG:boto:Data: 2023-12-15T23:14:10.382 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.382 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.382 DEBUG:boto:Params: {} 2023-12-15T23:14:10.382 DEBUG:boto:Token: None 2023-12-15T23:14:10.382 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.385 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081bda03809cf48cf-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.386 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:10.386 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:10.386 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.386 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:10.386 DEBUG:boto:Data: 2023-12-15T23:14:10.386 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.386 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.387 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.387 DEBUG:boto:Params: {} 2023-12-15T23:14:10.387 DEBUG:boto:Token: None 2023-12-15T23:14:10.387 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:10.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iGwlDLqJT9IhbGoeQJPhDeecz8U= 2023-12-15T23:14:10.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iGwlDLqJT9IhbGoeQJPhDeecz8U='} 2023-12-15T23:14:10.434 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f1c117fdb11f08f-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.434 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.434 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.434 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.434 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.434 DEBUG:boto:Data: 2023-12-15T23:14:10.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.434 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.435 DEBUG:boto:Params: {} 2023-12-15T23:14:10.435 DEBUG:boto:Token: None 2023-12-15T23:14:10.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.438 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007e28606621021ac7-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.439 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:10.439 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:10.439 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.439 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:10.439 DEBUG:boto:Data: 2023-12-15T23:14:10.439 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.439 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.439 DEBUG:boto:Params: {} 2023-12-15T23:14:10.440 DEBUG:boto:Token: None 2023-12-15T23:14:10.440 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:10.440 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2t7BqdFZz2OLQVsvtzwOYLDxzpo= 2023-12-15T23:14:10.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2t7BqdFZz2OLQVsvtzwOYLDxzpo='} 2023-12-15T23:14:10.447 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003e676b6d75ded975-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.447 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.447 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.447 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.447 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.447 DEBUG:boto:Data: 2023-12-15T23:14:10.447 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.447 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.448 DEBUG:boto:Params: {} 2023-12-15T23:14:10.448 DEBUG:boto:Token: None 2023-12-15T23:14:10.448 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.448 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.451 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000055e369bc32d964af-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.451 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:10.451 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:10.452 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.452 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:10.452 DEBUG:boto:Data: 2023-12-15T23:14:10.452 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.452 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.452 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.452 DEBUG:boto:Params: {} 2023-12-15T23:14:10.452 DEBUG:boto:Token: None 2023-12-15T23:14:10.452 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:10.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LhcX+3LzRE/wWBDk2GptRNWYUkY= 2023-12-15T23:14:10.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LhcX+3LzRE/wWBDk2GptRNWYUkY='} 2023-12-15T23:14:10.497 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000203e01bf8cd22439-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.498 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.498 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.498 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.498 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.498 DEBUG:boto:Data: 2023-12-15T23:14:10.498 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.499 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.499 DEBUG:boto:Params: {} 2023-12-15T23:14:10.499 DEBUG:boto:Token: None 2023-12-15T23:14:10.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.502 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a66bb9ed3b4abd66-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.503 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:10.503 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:10.503 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.503 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:10.503 DEBUG:boto:Data: 2023-12-15T23:14:10.503 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.503 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.503 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.503 DEBUG:boto:Params: {} 2023-12-15T23:14:10.504 DEBUG:boto:Token: None 2023-12-15T23:14:10.504 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:10.504 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mJHEsMoGWfotK1IyXa26Gd7Vaeg= 2023-12-15T23:14:10.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mJHEsMoGWfotK1IyXa26Gd7Vaeg='} 2023-12-15T23:14:10.510 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001ccac0c713422f5a-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.510 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.511 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.511 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.511 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.511 DEBUG:boto:Data: 2023-12-15T23:14:10.511 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.511 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.511 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.511 DEBUG:boto:Params: {} 2023-12-15T23:14:10.511 DEBUG:boto:Token: None 2023-12-15T23:14:10.512 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.512 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.517 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000aa2032dda758c838-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.517 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:10.517 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:10.517 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.517 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:10.517 DEBUG:boto:Data: 2023-12-15T23:14:10.517 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.517 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.517 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.518 DEBUG:boto:Params: {} 2023-12-15T23:14:10.518 DEBUG:boto:Token: None 2023-12-15T23:14:10.518 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:10.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:el2KTqOtu+/WRcFKt7A8cvH8QEE= 2023-12-15T23:14:10.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:el2KTqOtu+/WRcFKt7A8cvH8QEE='} 2023-12-15T23:14:10.561 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000076db94e9b8ae8bcd-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.562 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.562 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.562 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.562 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.562 DEBUG:boto:Data: 2023-12-15T23:14:10.562 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.562 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.562 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.562 DEBUG:boto:Params: {} 2023-12-15T23:14:10.563 DEBUG:boto:Token: None 2023-12-15T23:14:10.563 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.566 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5c57743771fc1d5-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.566 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:10.566 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:10.566 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.566 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:10.566 DEBUG:boto:Data: 2023-12-15T23:14:10.567 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.567 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.567 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.567 DEBUG:boto:Params: {} 2023-12-15T23:14:10.567 DEBUG:boto:Token: None 2023-12-15T23:14:10.567 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:10.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V8Sdl60CFaC0yNFZOrehPoMmqXU= 2023-12-15T23:14:10.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V8Sdl60CFaC0yNFZOrehPoMmqXU='} 2023-12-15T23:14:10.573 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cb046638ef981835-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.574 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.574 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.574 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.574 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.574 DEBUG:boto:Data: 2023-12-15T23:14:10.574 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.574 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.574 DEBUG:boto:Params: {} 2023-12-15T23:14:10.574 DEBUG:boto:Token: None 2023-12-15T23:14:10.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.577 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000514c2e1d7b9fc703-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.578 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:10.578 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:10.578 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.578 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:10.578 DEBUG:boto:Data: 2023-12-15T23:14:10.578 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.578 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.578 DEBUG:boto:Params: {} 2023-12-15T23:14:10.579 DEBUG:boto:Token: None 2023-12-15T23:14:10.579 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:10.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F9Sv3wp+YczboFr5i9S4VZCjApY= 2023-12-15T23:14:10.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F9Sv3wp+YczboFr5i9S4VZCjApY='} 2023-12-15T23:14:10.622 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d49e351beaec18ac-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.622 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.622 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.622 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.622 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.622 DEBUG:boto:Data: 2023-12-15T23:14:10.622 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.622 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.622 DEBUG:boto:Params: {} 2023-12-15T23:14:10.623 DEBUG:boto:Token: None 2023-12-15T23:14:10.623 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.626 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b4013c1eaa3c2be-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.626 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:10.626 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:10.626 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.627 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:10.627 DEBUG:boto:Data: 2023-12-15T23:14:10.627 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.627 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.627 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.627 DEBUG:boto:Params: {} 2023-12-15T23:14:10.627 DEBUG:boto:Token: None 2023-12-15T23:14:10.627 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:10.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+xCWhdEWnvMxAsZBTSDtVwr/lKM= 2023-12-15T23:14:10.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+xCWhdEWnvMxAsZBTSDtVwr/lKM='} 2023-12-15T23:14:10.634 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c8e953b6f94c3678-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.634 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.635 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.635 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.635 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.635 DEBUG:boto:Data: 2023-12-15T23:14:10.635 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.635 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.635 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.635 DEBUG:boto:Params: {} 2023-12-15T23:14:10.635 DEBUG:boto:Token: None 2023-12-15T23:14:10.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.638 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf7ecacfdc727573-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.639 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:10.639 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:10.639 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.639 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:10.639 DEBUG:boto:Data: 2023-12-15T23:14:10.639 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.639 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.639 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.640 DEBUG:boto:Params: {} 2023-12-15T23:14:10.640 DEBUG:boto:Token: None 2023-12-15T23:14:10.640 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:10.640 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rW7zJrqoNBi9TaeYjbR6Qy9YB3E= 2023-12-15T23:14:10.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rW7zJrqoNBi9TaeYjbR6Qy9YB3E='} 2023-12-15T23:14:10.682 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d2da4fbba9eb6777-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.682 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.682 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.682 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.682 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.682 DEBUG:boto:Data: 2023-12-15T23:14:10.682 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.682 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.682 DEBUG:boto:Params: {} 2023-12-15T23:14:10.683 DEBUG:boto:Token: None 2023-12-15T23:14:10.683 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.686 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f37281097724f518-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.686 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:10.686 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:10.686 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.686 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:10.686 DEBUG:boto:Data: 2023-12-15T23:14:10.686 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.687 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.687 DEBUG:boto:Params: {} 2023-12-15T23:14:10.687 DEBUG:boto:Token: None 2023-12-15T23:14:10.687 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:10.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YHddwvY3www4hmNxRRPbVkxdigU= 2023-12-15T23:14:10.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YHddwvY3www4hmNxRRPbVkxdigU='} 2023-12-15T23:14:10.694 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068d66bb5871ab6be-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.694 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.694 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.695 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.695 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.695 DEBUG:boto:Data: 2023-12-15T23:14:10.695 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.695 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.695 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.695 DEBUG:boto:Params: {} 2023-12-15T23:14:10.695 DEBUG:boto:Token: None 2023-12-15T23:14:10.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.696 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.699 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d5571ce9befd84f6-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.699 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:10.699 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:10.699 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.699 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:10.699 DEBUG:boto:Data: 2023-12-15T23:14:10.699 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.699 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.700 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.700 DEBUG:boto:Params: {} 2023-12-15T23:14:10.700 DEBUG:boto:Token: None 2023-12-15T23:14:10.700 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:10.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iM+jCcl89tTPd7S5orUyUbgD0TA= 2023-12-15T23:14:10.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iM+jCcl89tTPd7S5orUyUbgD0TA='} 2023-12-15T23:14:10.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007e5e256ab45e5bcb-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.742 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.742 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.742 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.742 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.742 DEBUG:boto:Data: 2023-12-15T23:14:10.742 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.742 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.742 DEBUG:boto:Params: {} 2023-12-15T23:14:10.743 DEBUG:boto:Token: None 2023-12-15T23:14:10.743 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000033dd6829ca4e52a3-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.746 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:10.746 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:10.746 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.746 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:10.747 DEBUG:boto:Data: 2023-12-15T23:14:10.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.747 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.747 DEBUG:boto:Params: {} 2023-12-15T23:14:10.747 DEBUG:boto:Token: None 2023-12-15T23:14:10.747 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:10.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xvnr82DDwopz4BSvgRrC8XE5f0I= 2023-12-15T23:14:10.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xvnr82DDwopz4BSvgRrC8XE5f0I='} 2023-12-15T23:14:10.753 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b527756b8e80ba94-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.753 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.754 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.754 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.754 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.754 DEBUG:boto:Data: 2023-12-15T23:14:10.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.754 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.754 DEBUG:boto:Params: {} 2023-12-15T23:14:10.754 DEBUG:boto:Token: None 2023-12-15T23:14:10.754 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.757 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004029a2c75a562aee-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.758 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:10.758 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:10.758 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.758 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:10.758 DEBUG:boto:Data: 2023-12-15T23:14:10.758 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.758 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.758 DEBUG:boto:Params: {} 2023-12-15T23:14:10.758 DEBUG:boto:Token: None 2023-12-15T23:14:10.759 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:10.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:87umpxyCF81Tp5Rm0oMXgY6+VuQ= 2023-12-15T23:14:10.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:87umpxyCF81Tp5Rm0oMXgY6+VuQ='} 2023-12-15T23:14:10.802 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000033dca60a66c01707-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.802 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:10.802 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:10.802 DEBUG:boto:Method: HEAD 2023-12-15T23:14:10.802 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:10.802 DEBUG:boto:Data: 2023-12-15T23:14:10.802 DEBUG:boto:Headers: {} 2023-12-15T23:14:10.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.803 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.803 DEBUG:boto:Params: {} 2023-12-15T23:14:10.803 DEBUG:boto:Token: None 2023-12-15T23:14:10.803 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/ 2023-12-15T23:14:10.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc= 2023-12-15T23:14:10.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZ/2e9Ecq4fQq7l96EPxYvYaVFc=', 'Content-Length': '0'} 2023-12-15T23:14:10.806 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000032a470c6493ee41f-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.806 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:10.806 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:10.806 DEBUG:boto:Method: PUT 2023-12-15T23:14:10.806 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:10.806 DEBUG:boto:Data: 2023-12-15T23:14:10.806 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:14:10.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:10.807 DEBUG:boto:Port: 8000 2023-12-15T23:14:10.807 DEBUG:boto:Params: {} 2023-12-15T23:14:10.807 DEBUG:boto:Token: None 2023-12-15T23:14:10.807 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:14:10 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:10.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oZ8Nx/j9RidunGYun2sb8UXbk/I= 2023-12-15T23:14:10.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:14:10 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oZ8Nx/j9RidunGYun2sb8UXbk/I='} 2023-12-15T23:14:10.813 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000046394f662033741c-00657cddc2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:10.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:10.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:14:10.814 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:14:10.871 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:10.871 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:10.950 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 2 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000001.41.6 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 2 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000001.136.6 2023-12-15T23:14:10.951 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 2 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000001.29.6 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 2 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000001.69.6 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 2 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000001.37.6 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 2 2023-12-15T23:14:10.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000001.39.6 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 2 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000001.30.6 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 2 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 2 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position=00000000001.37.6 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000001.16.6 2023-12-15T23:14:10.953 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 2 2023-12-15T23:14:10.954 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 2 2023-12-15T23:14:10.954 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000001.39.6 2023-12-15T23:14:10.954 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.996 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.997 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:10.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000001.82.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000021 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:05.796129+0000 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.82.6 op=0 op_state=1 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:10.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000001.82.6 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000001.19.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000033 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:05.912309+0000 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.19.6 op=0 op_state=1 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: : injecting data sync error on key=obj00000000000000000033 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000001.19.6 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: parsed entry: id=00000000002.35.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8/obj00000000000000000010 2023-12-15T23:14:11.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: entry->timestamp=2023-12-15T23:14:05.806396+0000 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.35.6 op=0 op_state=1 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000001.140.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000026 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:05.923637+0000 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.140.6 op=0 op_state=1 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000033 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000010]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000010[0] 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position=00000000002.35.6 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000026]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000026[0] 2023-12-15T23:14:11.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000001.140.6 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000030 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:05.749209+0000 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.48.6 op=0 op_state=1 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000030]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000030[0] 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000001.48.6 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000001.41.6 iter->object=obj00000000000000000076 iter->instance= name=obj00000000000000000076 instance= ns= 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000076 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:05.678502+0000 2023-12-15T23:14:11.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000076]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.41.6 op=0 op_state=1 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000076]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000076[0] 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000001.41.6 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000002.21.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000001 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:05.933419+0000 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.21.6 op=0 op_state=1 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000002.21.6 2023-12-15T23:14:11.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.999+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000021]: success 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.999+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:1 marker=00000000001.82.6 timestamp=2023-12-15T23:14:05.796129+0000 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.999+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000076]: success 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:10.999+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:1 marker=00000000001.41.6 timestamp=2023-12-15T23:14:05.678502+0000 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.000+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000030]: success 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.000+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12:1 marker=00000000001.48.6 timestamp=2023-12-15T23:14:05.749209+0000 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.000+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.000+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:1 marker=00000000002.21.6 timestamp=2023-12-15T23:14:05.933419+0000 2023-12-15T23:14:11.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.001+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000010]: success 2023-12-15T23:14:11.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.001+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8:1 marker=00000000002.35.6 timestamp=2023-12-15T23:14:05.806396+0000 2023-12-15T23:14:11.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.001+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000026]: success 2023-12-15T23:14:11.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.001+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:1 marker=00000000001.140.6 timestamp=2023-12-15T23:14:05.923637+0000 2023-12-15T23:14:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000001.45.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2023-12-15T23:14:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000024 2023-12-15T23:14:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:05.688681+0000 2023-12-15T23:14:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.45.6 op=0 op_state=1 2023-12-15T23:14:11.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: : injecting data sync error on key=obj00000000000000000024 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000001.45.6 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000001.34.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000007 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:06.048113+0000 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.34.6 op=0 op_state=1 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000001.43.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000016 2023-12-15T23:14:11.032 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:06.060067+0000 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.43.6 op=0 op_state=1 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000001.43.6 iter->object=obj00000000000000000032 iter->instance= name=obj00000000000000000032 instance= ns= 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000032 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:05.980364+0000 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000032]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.43.6 op=0 op_state=1 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000020 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:06.001289+0000 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.54.6 op=0 op_state=1 2023-12-15T23:14:11.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000001.52.6 iter->object=obj00000000000000000028 iter->instance= name=obj00000000000000000028 instance= ns= 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000028 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:05.736293+0000 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000028]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.52.6 op=0 op_state=1 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000024 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000007]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000007[0] 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000001.34.6 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000016]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000016[0] 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000001.43.6 2023-12-15T23:14:11.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000032]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000032[0] 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000001.43.6 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: : injecting data sync error on key=obj00000000000000000020 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000001.54.6 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000028]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000028[0] 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000001.52.6 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.029+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000020 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.18.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2023-12-15T23:14:11.035 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000013 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:05.990319+0000 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.18.6 op=0 op_state=1 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000001.46.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000019 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:05.856266+0000 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.46.6 op=0 op_state=1 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: : injecting data sync error on key=obj00000000000000000013 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.18.6 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000019]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000019[0] 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000001.46.6 2023-12-15T23:14:11.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.037 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.030+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000013 2023-12-15T23:14:11.038 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000002.47.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000004 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:05.865873+0000 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.47.6 op=0 op_state=1 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000004]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000004[0] 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.031+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000002.47.6 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.032+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: a sync operation returned error 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.032+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: backing out with sync_status=-5 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.032+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.032+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.034+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.034+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.034+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.035+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000016]: success 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.035+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:1 marker=00000000001.43.6 timestamp=2023-12-15T23:14:06.060067+0000 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.035+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000007]: success 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.035+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0:1 marker=00000000001.34.6 timestamp=2023-12-15T23:14:06.048113+0000 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.036+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000032]: success 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.036+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6:1 marker=00000000001.43.6 timestamp=2023-12-15T23:14:05.980364+0000 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.037+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000019]: success 2023-12-15T23:14:11.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.037+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:1 marker=00000000001.46.6 timestamp=2023-12-15T23:14:05.856266+0000 2023-12-15T23:14:11.041 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.038+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000028]: success 2023-12-15T23:14:11.041 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.038+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:1 marker=00000000001.52.6 timestamp=2023-12-15T23:14:05.736293+0000 2023-12-15T23:14:11.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.071+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: a sync operation returned error 2023-12-15T23:14:11.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.071+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: backing out with sync_status=-5 2023-12-15T23:14:11.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.071+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.071+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.071+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: a sync operation returned error 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: a sync operation returned error 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: backing out with sync_status=-5 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: backing out with sync_status=-5 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.074 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.075 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.072+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.073+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.073+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.074+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.074+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.074+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.074+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000004]: success 2023-12-15T23:14:11.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:1 marker=00000000002.47.6 timestamp=2023-12-15T23:14:05.865873+0000 2023-12-15T23:14:11.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000001.19.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2023-12-15T23:14:11.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000033 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:05.912309+0000 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.19.6 op=0 op_state=1 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: : injecting data sync error on key=obj00000000000000000033 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000001.19.6 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.079 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.077+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000033 2023-12-15T23:14:11.115 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000001.45.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2023-12-15T23:14:11.115 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000024 2023-12-15T23:14:11.115 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:05.688681+0000 2023-12-15T23:14:11.115 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.45.6 op=0 op_state=1 2023-12-15T23:14:11.116 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000024[0] 2023-12-15T23:14:11.116 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.114+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000001.45.6 2023-12-15T23:14:11.117 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.18.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2023-12-15T23:14:11.117 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000013 2023-12-15T23:14:11.117 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:05.990319+0000 2023-12-15T23:14:11.117 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.18.6 op=0 op_state=1 2023-12-15T23:14:11.117 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000013[0] 2023-12-15T23:14:11.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.116+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.18.6 2023-12-15T23:14:11.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2023-12-15T23:14:11.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000020 2023-12-15T23:14:11.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:06.001289+0000 2023-12-15T23:14:11.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.54.6 op=0 op_state=1 2023-12-15T23:14:11.119 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000020[0] 2023-12-15T23:14:11.119 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.117+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000001.54.6 2023-12-15T23:14:11.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: a sync operation returned error 2023-12-15T23:14:11.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: backing out with sync_status=-5 2023-12-15T23:14:11.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000024]: success 2023-12-15T23:14:11.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2:1 marker=00000000001.45.6 timestamp=2023-12-15T23:14:05.688681+0000 2023-12-15T23:14:11.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.119+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.123 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.122+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000020]: success 2023-12-15T23:14:11.123 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.122+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:1 marker=00000000001.54.6 timestamp=2023-12-15T23:14:06.001289+0000 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000001.19.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000033 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:05.912309+0000 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.19.6 op=0 op_state=1 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000033[0] 2023-12-15T23:14:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.161+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000001.19.6 2023-12-15T23:14:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.166+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000013]: success 2023-12-15T23:14:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.166+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:1 marker=00000000002.18.6 timestamp=2023-12-15T23:14:05.990319+0000 2023-12-15T23:14:11.171 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.170+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000033]: success 2023-12-15T23:14:11.171 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.170+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:1 marker=00000000001.19.6 timestamp=2023-12-15T23:14:05.912309+0000 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.216 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.207+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.218 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.208+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.209+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000010 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:06.668522+0000 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.50.6 op=0 op_state=1 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000002.87.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000005 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:06.456006+0000 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.87.6 op=0 op_state=1 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000010]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000010[0] 2023-12-15T23:14:11.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000002.50.6 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000021 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:06.528232+0000 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.43.6 op=0 op_state=1 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000005]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000005[0] 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000002.87.6 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000002.43.6 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.210+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000030 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:06.467284+0000 2023-12-15T23:14:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.61.6 op=0 op_state=1 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000002.30.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000004 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:06.680339+0000 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.30.6 op=0 op_state=1 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000030]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000030[0] 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000002.61.6 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000002.42.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000015 2023-12-15T23:14:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:06.539940+0000 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.42.6 op=0 op_state=1 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000004]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000004[0] 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000002.30.6 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000015]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000015[0] 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000002.42.6 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.211+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.212+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.212+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.212+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.212+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket shard: 0 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.212+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000002.64.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000012 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:06.727744+0000 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.64.6 op=0 op_state=1 2023-12-15T23:14:11.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000012]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000012[0] 2023-12-15T23:14:11.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000002.64.6 2023-12-15T23:14:11.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000010]: success 2023-12-15T23:14:11.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.213+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:2 marker=00000000002.50.6 timestamp=2023-12-15T23:14:06.668522+0000 2023-12-15T23:14:11.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.214+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000021]: success 2023-12-15T23:14:11.226 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.214+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:2 marker=00000000002.43.6 timestamp=2023-12-15T23:14:06.528232+0000 2023-12-15T23:14:11.229 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000002.26.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2023-12-15T23:14:11.229 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000011 2023-12-15T23:14:11.229 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:06.326287+0000 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.26.6 op=0 op_state=1 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000011]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000011[0] 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000002.26.6 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: parsed entry: id=00000000002.32.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18/obj00000000000000000007 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: entry->timestamp=2023-12-15T23:14:06.375798+0000 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.32.6 op=0 op_state=1 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000004]: success 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:2 marker=00000000002.30.6 timestamp=2023-12-15T23:14:06.680339+0000 2023-12-15T23:14:11.230 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000007]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000007[0] 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position=00000000002.32.6 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000002.83.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000001 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:06.606516+0000 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.83.6 op=0 op_state=1 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.52.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000000 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:06.478712+0000 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.52.6 op=0 op_state=1 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000002.83.6 2023-12-15T23:14:11.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000000]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000000[0] 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.52.6 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000002.38.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000006 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:06.402295+0000 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.38.6 op=0 op_state=1 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000002.32.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000002 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:06.315439+0000 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.32.6 op=0 op_state=1 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000006]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000006[0] 2023-12-15T23:14:11.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000002.38.6 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000030]: success 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6:2 marker=00000000002.61.6 timestamp=2023-12-15T23:14:06.467284+0000 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000002]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000002[0] 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.215+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000002.32.6 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.218+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000007]: success 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.218+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18:2 marker=00000000002.32.6 timestamp=2023-12-15T23:14:06.375798+0000 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.218+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.218+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17:2 marker=00000000002.83.6 timestamp=2023-12-15T23:14:06.606516+0000 2023-12-15T23:14:11.233 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.223+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000005]: success 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.223+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0:2 marker=00000000002.87.6 timestamp=2023-12-15T23:14:06.456006+0000 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.224+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000015]: success 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.224+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:2 marker=00000000002.42.6 timestamp=2023-12-15T23:14:06.539940+0000 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.224+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000012]: success 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.224+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12:2 marker=00000000002.64.6 timestamp=2023-12-15T23:14:06.727744+0000 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.225+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000000]: success 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.225+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:2 marker=00000000002.52.6 timestamp=2023-12-15T23:14:06.478712+0000 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.226+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000011]: success 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.226+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:2 marker=00000000002.26.6 timestamp=2023-12-15T23:14:06.326287+0000 2023-12-15T23:14:11.234 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.226+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000002]: success 2023-12-15T23:14:11.235 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.226+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:2 marker=00000000002.32.6 timestamp=2023-12-15T23:14:06.315439+0000 2023-12-15T23:14:11.235 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.229+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000006]: success 2023-12-15T23:14:11.235 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.229+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:2 marker=00000000002.38.6 timestamp=2023-12-15T23:14:06.402295+0000 2023-12-15T23:14:11.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: parsed entry: id=00000000001.73.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2023-12-15T23:14:11.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000025 2023-12-15T23:14:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: entry->timestamp=2023-12-15T23:14:06.739211+0000 2023-12-15T23:14:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.73.6 op=0 op_state=1 2023-12-15T23:14:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000025]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000025[0] 2023-12-15T23:14:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.250+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000001.73.6 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000002.28.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000003 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:06.389816+0000 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.28.6 op=0 op_state=1 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000003]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000003[0] 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000002.28.6 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000001.63.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000009 2023-12-15T23:14:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:06.618625+0000 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.63.6 op=0 op_state=1 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: parsed entry: id=00000000002.31.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8/obj00000000000000000019 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: entry->timestamp=2023-12-15T23:14:06.549594+0000 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.31.6 op=0 op_state=1 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000009]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000009[0] 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000001.63.6 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000019]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000019[0] 2023-12-15T23:14:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.251+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position=00000000002.31.6 2023-12-15T23:14:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.253+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000019]: success 2023-12-15T23:14:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.253+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8:2 marker=00000000002.31.6 timestamp=2023-12-15T23:14:06.549594+0000 2023-12-15T23:14:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000001.51.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000014 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:06.596286+0000 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.51.6 op=0 op_state=1 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000014]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000014[0] 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.254+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000001.51.6 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.255+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000025]: success 2023-12-15T23:14:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.255+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5:2 marker=00000000001.73.6 timestamp=2023-12-15T23:14:06.739211+0000 2023-12-15T23:14:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.256+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000009]: success 2023-12-15T23:14:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.256+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:2 marker=00000000001.63.6 timestamp=2023-12-15T23:14:06.618625+0000 2023-12-15T23:14:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.262+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000003]: success 2023-12-15T23:14:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.262+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:2 marker=00000000002.28.6 timestamp=2023-12-15T23:14:06.389816+0000 2023-12-15T23:14:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.263+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000014]: success 2023-12-15T23:14:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.263+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:2 marker=00000000001.51.6 timestamp=2023-12-15T23:14:06.596286+0000 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.306+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.318 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.307+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.319 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.320 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.308+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: parsed entry: id=00000000001.34.6 iter->object=obj00000000000000000050 iter->instance= name=obj00000000000000000050 instance= ns= 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.309+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000050 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: entry->timestamp=2023-12-15T23:14:07.403334+0000 2023-12-15T23:14:11.322 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000050]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.34.6 op=0 op_state=1 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000050]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000050[0] 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000001.34.6 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.323 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000001.54.6 iter->object=obj00000000000000000046 iter->instance= name=obj00000000000000000046 instance= ns= 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000046 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:07.052475+0000 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000046]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.54.6 op=0 op_state=1 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: parsed entry: id=00000000001.30.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8/obj00000000000000000039 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: entry->timestamp=2023-12-15T23:14:07.062561+0000 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.30.6 op=0 op_state=1 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.324 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000046]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000046[0] 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.310+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000001.54.6 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000007 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:07.142654+0000 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.57.6 op=0 op_state=1 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000039]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000039[0] 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position=00000000001.30.6 2023-12-15T23:14:11.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000007]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000007[0] 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000002.57.6 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000001.91.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000040 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:07.262429+0000 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.91.6 op=0 op_state=1 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000040]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000040[0] 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000001.91.6 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000001.39.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000045 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:07.120436+0000 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.39.6 op=0 op_state=1 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.311+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket shard: 0 2023-12-15T23:14:11.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000045]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000045[0] 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000001.39.6 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket shard: 0 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket shard: 0 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket shard: 0 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.312+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000002.93.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000001 2023-12-15T23:14:11.328 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:07.392240+0000 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.93.6 op=0 op_state=1 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.314+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000002.93.6 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20/obj00000000000000000003 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: entry->timestamp=2023-12-15T23:14:07.344176+0000 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.51.6 op=0 op_state=1 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000003]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000003[0] 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position=00000000002.51.6 2023-12-15T23:14:11.329 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: parsed entry: id=00000000002.60.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000021 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: entry->timestamp=2023-12-15T23:14:07.412931+0000 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.60.6 op=0 op_state=1 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position=00000000002.60.6 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18/obj00000000000000000000 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: entry->timestamp=2023-12-15T23:14:07.460349+0000 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.330 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000000]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000000[0] 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: parsed entry: id=00000000002.78.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22/obj00000000000000000008 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: entry->timestamp=2023-12-15T23:14:07.252363+0000 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.315+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.78.6 op=0 op_state=1 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000050]: success 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5:3 marker=00000000001.34.6 timestamp=2023-12-15T23:14:07.403334+0000 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000008]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000008[0] 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position=00000000002.78.6 2023-12-15T23:14:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000033 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:07.005633+0000 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.58.6 op=0 op_state=1 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000033]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000033[0] 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000002.58.6 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000007]: success 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:3 marker=00000000002.57.6 timestamp=2023-12-15T23:14:07.142654+0000 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.316+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17:3 marker=00000000002.93.6 timestamp=2023-12-15T23:14:07.392240+0000 2023-12-15T23:14:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.317+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000003]: success 2023-12-15T23:14:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.317+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20:3 marker=00000000002.51.6 timestamp=2023-12-15T23:14:07.344176+0000 2023-12-15T23:14:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000000]: success 2023-12-15T23:14:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18:3 marker=00000000002.48.6 timestamp=2023-12-15T23:14:07.460349+0000 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000021]: success 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19:3 marker=00000000002.60.6 timestamp=2023-12-15T23:14:07.412931+0000 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000033]: success 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.318+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:3 marker=00000000002.58.6 timestamp=2023-12-15T23:14:07.005633+0000 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.320+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000039]: success 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.320+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8:3 marker=00000000001.30.6 timestamp=2023-12-15T23:14:07.062561+0000 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.320+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000040]: success 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.320+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:3 marker=00000000001.91.6 timestamp=2023-12-15T23:14:07.262429+0000 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.321+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000046]: success 2023-12-15T23:14:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.321+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:3 marker=00000000001.54.6 timestamp=2023-12-15T23:14:07.052475+0000 2023-12-15T23:14:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.323+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000045]: success 2023-12-15T23:14:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.323+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:3 marker=00000000001.39.6 timestamp=2023-12-15T23:14:07.120436+0000 2023-12-15T23:14:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.326+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000008]: success 2023-12-15T23:14:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.326+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22:3 marker=00000000002.78.6 timestamp=2023-12-15T23:14:07.252363+0000 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000002.149.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000026 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:07.331867+0000 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.149.6 op=0 op_state=1 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000026]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000026[0] 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000002.149.6 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000014 2023-12-15T23:14:11.351 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:07.319996+0000 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.49.6 op=0 op_state=1 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000001.47.6 iter->object=obj00000000000000000058 iter->instance= name=obj00000000000000000058 instance= ns= 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000058 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:07.203450+0000 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000058]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.47.6 op=0 op_state=1 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000014]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000014[0] 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000002.49.6 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000058]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000058[0] 2023-12-15T23:14:11.352 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.349+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000001.47.6 2023-12-15T23:14:11.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2023-12-15T23:14:11.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000011 2023-12-15T23:14:11.355 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:06.994811+0000 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000011[0] 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000002.71.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000002 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:07.130504+0000 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.71.6 op=0 op_state=1 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000002]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000002[0] 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.350+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000002.71.6 2023-12-15T23:14:11.356 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000006 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:07.072045+0000 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.51.6 op=0 op_state=1 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000006]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000006[0] 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.51.6 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000002.95.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000009 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:07.470995+0000 2023-12-15T23:14:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.95.6 op=0 op_state=1 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000009]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000009[0] 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.351+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000002.95.6 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000026]: success 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:3 marker=00000000002.149.6 timestamp=2023-12-15T23:14:07.331867+0000 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000014]: success 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:3 marker=00000000002.49.6 timestamp=2023-12-15T23:14:07.319996+0000 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: success 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2:3 marker=00000000002.48.6 timestamp=2023-12-15T23:14:06.994811+0000 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000002]: success 2023-12-15T23:14:11.358 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.352+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:3 marker=00000000002.71.6 timestamp=2023-12-15T23:14:07.130504+0000 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.147.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000013 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:07.272567+0000 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.147.6 op=0 op_state=1 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000013]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000013[0] 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.147.6 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000009]: success 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12:3 marker=00000000002.95.6 timestamp=2023-12-15T23:14:07.470995+0000 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000006]: success 2023-12-15T23:14:11.359 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.353+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:3 marker=00000000002.51.6 timestamp=2023-12-15T23:14:07.072045+0000 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.354+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000013]: success 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.354+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:3 marker=00000000002.147.6 timestamp=2023-12-15T23:14:07.272567+0000 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000002.73.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000012 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:07.192431+0000 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.73.6 op=0 op_state=1 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000012]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000012[0] 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000002.73.6 2023-12-15T23:14:11.361 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000058]: success 2023-12-15T23:14:11.362 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.355+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0:3 marker=00000000001.47.6 timestamp=2023-12-15T23:14:07.203450+0000 2023-12-15T23:14:11.362 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.357+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000012]: success 2023-12-15T23:14:11.362 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.357+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:3 marker=00000000002.73.6 timestamp=2023-12-15T23:14:07.192431+0000 2023-12-15T23:14:11.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.414+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:11.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.415+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.416+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket shard: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket shard: 0 2023-12-15T23:14:11.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket shard: 0 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket shard: 0 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000022 iter->instance= name=obj00000000000000000022 instance= ns= 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000022 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:07.807135+0000 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000022]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.53.6 op=0 op_state=1 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000022]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000022[0] 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000002.53.6 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000001.35.6 iter->object=obj00000000000000000031 iter->instance= name=obj00000000000000000031 instance= ns= 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000031 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:08.068236+0000 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.35.6 op=0 op_state=1 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.417+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: : injecting data sync error on key=obj00000000000000000031 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000001.35.6 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000002.26.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000013 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:08.293354+0000 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.26.6 op=0 op_state=1 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000031 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000013]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000013[0] 2023-12-15T23:14:11.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000002.26.6 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.418+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000001.68.6 iter->object=obj00000000000000000037 iter->instance= name=obj00000000000000000037 instance= ns= 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000037 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:08.340158+0000 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000037]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.68.6 op=0 op_state=1 2023-12-15T23:14:11.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000020 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:07.875907+0000 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.56.6 op=0 op_state=1 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000005 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:08.151064+0000 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.43.6 op=0 op_state=1 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket shard: 0 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket shard: 0 2023-12-15T23:14:11.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000037]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000037[0] 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000001.68.6 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: : injecting data sync error on key=obj00000000000000000020 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.56.6 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000002.87.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000012 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:08.350061+0000 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.87.6 op=0 op_state=1 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000005]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000005[0] 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000002.43.6 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.439 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000020 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: : injecting data sync error on key=obj00000000000000000012 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000002.87.6 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket shard: 0 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000012 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket shard: 0 2023-12-15T23:14:11.440 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket shard: 0 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.419+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.420+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.420+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.420+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket shard: 0 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.420+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000027 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:07.746104+0000 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.66.6 op=0 op_state=1 2023-12-15T23:14:11.441 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: parsed entry: id=00000000001.60.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8/obj00000000000000000017 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: entry->timestamp=2023-12-15T23:14:08.408459+0000 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.60.6 op=0 op_state=1 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000027]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000027[0] 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000001.66.6 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000017]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000017[0] 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.421+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position=00000000001.60.6 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: a sync operation returned error 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2023-12-15T23:14:11.442 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23/obj00000000000000000025 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: entry->timestamp=2023-12-15T23:14:08.019375+0000 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.58.6 op=0 op_state=1 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000013]: success 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:4 marker=00000000002.26.6 timestamp=2023-12-15T23:14:08.293354+0000 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000025]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000025[0] 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position=00000000002.58.6 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: backing out with sync_status=-5 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.422+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: a sync operation returned error 2023-12-15T23:14:11.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: backing out with sync_status=-5 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24/obj00000000000000000016 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: entry->timestamp=2023-12-15T23:14:08.223165+0000 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.51.6 op=0 op_state=1 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: parsed entry: id=00000000002.37.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26/obj00000000000000000014 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: entry->timestamp=2023-12-15T23:14:08.007777+0000 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.37.6 op=0 op_state=1 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000016]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000016[0] 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position=00000000002.51.6 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000014]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000014[0] 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position=00000000002.37.6 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000005]: success 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:4 marker=00000000002.43.6 timestamp=2023-12-15T23:14:08.151064+0000 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25/obj00000000000000000000 2023-12-15T23:14:11.445 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: entry->timestamp=2023-12-15T23:14:08.078331+0000 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.53.6 op=0 op_state=1 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000000]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000000[0] 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.423+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: listing bilog for incremental sync; position=00000000002.53.6 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000022]: success 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12:4 marker=00000000002.53.6 timestamp=2023-12-15T23:14:07.807135+0000 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000025]: success 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23:4 marker=00000000002.58.6 timestamp=2023-12-15T23:14:08.019375+0000 2023-12-15T23:14:11.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.424+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000016]: success 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24:4 marker=00000000002.51.6 timestamp=2023-12-15T23:14:08.223165+0000 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000014]: success 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26:4 marker=00000000002.37.6 timestamp=2023-12-15T23:14:08.007777+0000 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000037]: success 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:4 marker=00000000001.68.6 timestamp=2023-12-15T23:14:08.340158+0000 2023-12-15T23:14:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000000]: success 2023-12-15T23:14:11.448 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.425+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25:4 marker=00000000002.53.6 timestamp=2023-12-15T23:14:08.078331+0000 2023-12-15T23:14:11.448 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.428+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000027]: success 2023-12-15T23:14:11.448 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.428+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2:4 marker=00000000001.66.6 timestamp=2023-12-15T23:14:07.746104+0000 2023-12-15T23:14:11.448 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.431+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:entry[obj00000000000000000017]: success 2023-12-15T23:14:11.449 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.431+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8:4 marker=00000000001.60.6 timestamp=2023-12-15T23:14:08.408459+0000 2023-12-15T23:14:11.457 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000019 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:08.361180+0000 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: parsed entry: id=00000000002.47.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000002 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: entry->timestamp=2023-12-15T23:14:07.924438+0000 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.47.6 op=0 op_state=1 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: : injecting data sync error on key=obj00000000000000000019 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.458 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000002]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000002[0] 2023-12-15T23:14:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000002.47.6 2023-12-15T23:14:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.456+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000019 2023-12-15T23:14:11.463 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000004 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:08.128144+0000 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.56.6 op=0 op_state=1 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000004]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000004[0] 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000002.56.6 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000002.26.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000008 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:07.864664+0000 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.26.6 op=0 op_state=1 2023-12-15T23:14:11.464 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000001.42.6 iter->object=obj00000000000000000049 iter->instance= name=obj00000000000000000049 instance= ns= 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000049 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:07.816992+0000 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.42.6 op=0 op_state=1 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000015 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:07.795975+0000 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.57.6 op=0 op_state=1 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000011 2023-12-15T23:14:11.465 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:07.996388+0000 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.59.6 op=0 op_state=1 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000008]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000008[0] 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000002.26.6 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: : injecting data sync error on key=obj00000000000000000049 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000001.42.6 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000015]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000015[0] 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.57.6 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000011]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000011[0] 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000002.59.6 2023-12-15T23:14:11.466 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.457+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000049 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000001.39.6 iter->object=obj00000000000000000059 iter->instance= name=obj00000000000000000059 instance= ns= 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000059 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:08.283395+0000 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000059]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.39.6 op=0 op_state=1 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000059]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000059[0] 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000001.39.6 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000002]: success 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.458+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5:4 marker=00000000002.47.6 timestamp=2023-12-15T23:14:07.924438+0000 2023-12-15T23:14:11.467 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: parsed entry: id=00000000002.155.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18/obj00000000000000000003 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: entry->timestamp=2023-12-15T23:14:08.272282+0000 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.155.6 op=0 op_state=1 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000003]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000003[0] 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.459+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position=00000000002.155.6 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: parsed entry: id=00000000002.85.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22/obj00000000000000000009 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: entry->timestamp=2023-12-15T23:14:07.947532+0000 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.85.6 op=0 op_state=1 2023-12-15T23:14:11.468 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: parsed entry: id=00000000002.23.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21/obj00000000000000000001 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: entry->timestamp=2023-12-15T23:14:08.212062+0000 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.23.6 op=0 op_state=1 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: parsed entry: id=00000000002.35.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20/obj00000000000000000010 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: entry->timestamp=2023-12-15T23:14:07.936117+0000 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.35.6 op=0 op_state=1 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000009]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000009[0] 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position=00000000002.85.6 2023-12-15T23:14:11.469 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000004]: success 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:4 marker=00000000002.56.6 timestamp=2023-12-15T23:14:08.128144+0000 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000008]: success 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:4 marker=00000000002.26.6 timestamp=2023-12-15T23:14:07.864664+0000 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position=00000000002.23.6 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000010]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000010[0] 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.460+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position=00000000002.35.6 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000015]: success 2023-12-15T23:14:11.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:4 marker=00000000002.57.6 timestamp=2023-12-15T23:14:07.795975+0000 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000011]: success 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:4 marker=00000000002.59.6 timestamp=2023-12-15T23:14:07.996388+0000 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: a sync operation returned error 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: backing out with sync_status=-5 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000003]: success 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.461+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18:4 marker=00000000002.155.6 timestamp=2023-12-15T23:14:08.272282+0000 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21:4 marker=00000000002.23.6 timestamp=2023-12-15T23:14:08.212062+0000 2023-12-15T23:14:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000009]: success 2023-12-15T23:14:11.472 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22:4 marker=00000000002.85.6 timestamp=2023-12-15T23:14:07.947532+0000 2023-12-15T23:14:11.472 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000010]: success 2023-12-15T23:14:11.472 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.462+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20:4 marker=00000000002.35.6 timestamp=2023-12-15T23:14:07.936117+0000 2023-12-15T23:14:11.474 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: parsed entry: id=00000000002.69.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28/obj00000000000000000021 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: entry->timestamp=2023-12-15T23:14:08.200229+0000 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.69.6 op=0 op_state=1 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.463+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: listing bilog for incremental sync; position=00000000002.69.6 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2023-12-15T23:14:11.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27/obj00000000000000000030 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: entry->timestamp=2023-12-15T23:14:08.139837+0000 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.49.6 op=0 op_state=1 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000030]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000030[0] 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.464+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position=00000000002.49.6 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000059]: success 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:4 marker=00000000001.39.6 timestamp=2023-12-15T23:14:08.283395+0000 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000021]: success 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28:4 marker=00000000002.69.6 timestamp=2023-12-15T23:14:08.200229+0000 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000030]: success 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.465+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27:4 marker=00000000002.49.6 timestamp=2023-12-15T23:14:08.139837+0000 2023-12-15T23:14:11.476 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000020 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:07.875907+0000 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.56.6 op=0 op_state=1 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000020[0] 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.56.6 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000002.87.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000012 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:08.350061+0000 2023-12-15T23:14:11.477 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.87.6 op=0 op_state=1 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000012[0] 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.467+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000002.87.6 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.468+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000020]: success 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.468+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:4 marker=00000000002.56.6 timestamp=2023-12-15T23:14:07.875907+0000 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.469+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000012]: success 2023-12-15T23:14:11.478 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.469+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17:4 marker=00000000002.87.6 timestamp=2023-12-15T23:14:08.350061+0000 2023-12-15T23:14:11.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.499+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: a sync operation returned error 2023-12-15T23:14:11.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.499+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: backing out with sync_status=-5 2023-12-15T23:14:11.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.499+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.499+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.501 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: a sync operation returned error 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: backing out with sync_status=-5 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.502 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.500+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.501+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.501+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.503 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.501+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000001.35.6 iter->object=obj00000000000000000031 iter->instance= name=obj00000000000000000031 instance= ns= 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000031 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:08.068236+0000 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.35.6 op=0 op_state=1 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000031[0] 2023-12-15T23:14:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.507+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000001.35.6 2023-12-15T23:14:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.512+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000031]: success 2023-12-15T23:14:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.512+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:4 marker=00000000001.35.6 timestamp=2023-12-15T23:14:08.068236+0000 2023-12-15T23:14:11.543 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.543 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000019 2023-12-15T23:14:11.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:08.361180+0000 2023-12-15T23:14:11.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000019[0] 2023-12-15T23:14:11.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.542+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000001.42.6 iter->object=obj00000000000000000049 iter->instance= name=obj00000000000000000049 instance= ns= 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000049 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:07.816992+0000 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.42.6 op=0 op_state=1 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000049[0] 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.543+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000001.42.6 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.544+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000019]: success 2023-12-15T23:14:11.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.544+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6:4 marker=00000000002.48.6 timestamp=2023-12-15T23:14:08.361180+0000 2023-12-15T23:14:11.548 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.547+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000049]: success 2023-12-15T23:14:11.548 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.547+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:4 marker=00000000001.42.6 timestamp=2023-12-15T23:14:07.816992+0000 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.590+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.608 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.609 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.591+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.610 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000467 iter->instance= name=obj00000000000000000467 instance= ns= 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000467 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:08.688399+0000 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000467]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.66.6 op=0 op_state=1 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000467]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000467[0] 2023-12-15T23:14:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000001.66.6 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.592+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000001.37.6 iter->object=obj00000000000000000056 iter->instance= name=obj00000000000000000056 instance= ns= 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000056 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:08.772727+0000 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000056]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.37.6 op=0 op_state=1 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000056]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000056[0] 2023-12-15T23:14:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000001.37.6 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000002.39.6 iter->object=obj00000000000000000023 iter->instance= name=obj00000000000000000023 instance= ns= 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000023 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:09.069285+0000 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000023]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.39.6 op=0 op_state=1 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000001.36.6 iter->object=obj00000000000000000317 iter->instance= name=obj00000000000000000317 instance= ns= 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000317 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:08.761309+0000 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.36.6 op=0 op_state=1 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000023]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000023[0] 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000002.39.6 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000000 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:08.711569+0000 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.57.6 op=0 op_state=1 2023-12-15T23:14:11.614 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.593+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: : injecting data sync error on key=obj00000000000000000317 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000001.36.6 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000000]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000000[0] 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000002.57.6 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000021 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:08.832446+0000 2023-12-15T23:14:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.58.6 op=0 op_state=1 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000317 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.58.6 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket shard: 0 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.594+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket shard: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket shard: 0 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket shard: 0 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.595+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket shard: 0 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket shard: 0 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket shard: 0 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket shard: 0 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket shard: 0 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: sync status for source bucket shard: 0 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket shard: 0 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.596+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: sync status for source bucket shard: 0 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000001.27.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000162 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:08.821117+0000 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.27.6 op=0 op_state=1 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000162]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000162[0] 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000001.27.6 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2023-12-15T23:14:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18/obj00000000000000000016 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: entry->timestamp=2023-12-15T23:14:08.894703+0000 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.58.6 op=0 op_state=1 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000016]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000016[0] 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.597+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position=00000000002.58.6 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000003 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: entry->timestamp=2023-12-15T23:14:09.018650+0000 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.44.6 op=0 op_state=1 2023-12-15T23:14:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: : injecting data sync error on key=obj00000000000000000003 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.598+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position=00000000002.44.6 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000003 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000005 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:09.080091+0000 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.43.6 op=0 op_state=1 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000423 iter->instance= name=obj00000000000000000423 instance= ns= 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20/obj00000000000000000423 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: entry->timestamp=2023-12-15T23:14:09.188928+0000 2023-12-15T23:14:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000423]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.79.6 op=0 op_state=1 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: : injecting data sync error on key=obj00000000000000000005 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000002.43.6 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000423]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000423[0] 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position=00000000001.79.6 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.92.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000018 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:09.436654+0000 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.92.6 op=0 op_state=1 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000000]: success 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:5 marker=00000000002.57.6 timestamp=2023-12-15T23:14:08.711569+0000 2023-12-15T23:14:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000009 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:08.699096+0000 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.41.6 op=0 op_state=1 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24/obj00000000000000000011 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: entry->timestamp=2023-12-15T23:14:09.447637+0000 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.599+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.56.6 op=0 op_state=1 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000005 2023-12-15T23:14:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: : injecting data sync error on key=obj00000000000000000018 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.92.6 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000467]: success 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2:5 marker=00000000001.66.6 timestamp=2023-12-15T23:14:08.688399+0000 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23/obj00000000000000000001 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: entry->timestamp=2023-12-15T23:14:09.313175+0000 2023-12-15T23:14:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000009]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000009[0] 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000002.41.6 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000056]: success 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:5 marker=00000000001.37.6 timestamp=2023-12-15T23:14:08.772727+0000 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000011]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000011[0] 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position=00000000002.56.6 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000018 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: : injecting data sync error on key=obj00000000000000000001 2023-12-15T23:14:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23/obj00000000000000000001 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22/obj00000000000000000012 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: entry->timestamp=2023-12-15T23:14:08.945163+0000 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.45.6 op=0 op_state=1 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26/obj00000000000000000010 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: entry->timestamp=2023-12-15T23:14:09.249236+0000 2023-12-15T23:14:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.44.6 op=0 op_state=1 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: parsed entry: id=00000000001.47.6 iter->object=obj00000000000000000061 iter->instance= name=obj00000000000000000061 instance= ns= 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27/obj00000000000000000061 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: entry->timestamp=2023-12-15T23:14:09.141221+0000 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.600+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.47.6 op=0 op_state=1 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000012]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000012[0] 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position=00000000002.45.6 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: parsed entry: id=00000000001.42.6 iter->object=obj00000000000000000029 iter->instance= name=obj00000000000000000029 instance= ns= 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29/obj00000000000000000029 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: entry->timestamp=2023-12-15T23:14:09.199409+0000 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000029]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.42.6 op=0 op_state=1 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000021]: success 2023-12-15T23:14:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:5 marker=00000000002.58.6 timestamp=2023-12-15T23:14:08.832446+0000 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000010]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000010[0] 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position=00000000002.44.6 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: : injecting data sync error on key=obj00000000000000000061 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position=00000000001.47.6 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000029]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000029[0] 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: listing bilog for incremental sync; position=00000000001.42.6 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27/obj00000000000000000061 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000016]: success 2023-12-15T23:14:11.629 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.601+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18:5 marker=00000000002.58.6 timestamp=2023-12-15T23:14:08.894703+0000 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000011]: success 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24:5 marker=00000000002.56.6 timestamp=2023-12-15T23:14:09.447637+0000 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000009]: success 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:5 marker=00000000002.41.6 timestamp=2023-12-15T23:14:08.699096+0000 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000023]: success 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.603+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6:5 marker=00000000002.39.6 timestamp=2023-12-15T23:14:09.069285+0000 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000010]: success 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26:5 marker=00000000002.44.6 timestamp=2023-12-15T23:14:09.249236+0000 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000012]: success 2023-12-15T23:14:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22:5 marker=00000000002.45.6 timestamp=2023-12-15T23:14:08.945163+0000 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: a sync operation returned error 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: backing out with sync_status=-5 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.604+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.606+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000162]: success 2023-12-15T23:14:11.631 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.606+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17:5 marker=00000000001.27.6 timestamp=2023-12-15T23:14:08.821117+0000 2023-12-15T23:14:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.606+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.607+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket shard: 0 2023-12-15T23:14:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.607+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.607+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000029]: success 2023-12-15T23:14:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.607+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29:5 marker=00000000001.42.6 timestamp=2023-12-15T23:14:09.199409+0000 2023-12-15T23:14:11.633 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.633 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000019 2023-12-15T23:14:11.633 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:09.264175+0000 2023-12-15T23:14:11.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.45.6 op=0 op_state=1 2023-12-15T23:14:11.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: : injecting data sync error on key=obj00000000000000000019 2023-12-15T23:14:11.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000002.45.6 2023-12-15T23:14:11.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.634 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.632+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000019 2023-12-15T23:14:11.635 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000002.39.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2023-12-15T23:14:11.635 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000006 2023-12-15T23:14:11.635 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:08.957021+0000 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.39.6 op=0 op_state=1 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000006]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000006[0] 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.633+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000002.39.6 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000001.81.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:09.325643+0000 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.81.6 op=0 op_state=1 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: : injecting data sync error on key=obj00000000000000000271 2023-12-15T23:14:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000001.81.6 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000002.62.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000008 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:08.880997+0000 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.62.6 op=0 op_state=1 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000008]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000008[0] 2023-12-15T23:14:11.637 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.634+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000002.62.6 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000002.93.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000007 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:09.005395+0000 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.93.6 op=0 op_state=1 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000007]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000007[0] 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000002.93.6 2023-12-15T23:14:11.639 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000006]: success 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.635+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:5 marker=00000000002.39.6 timestamp=2023-12-15T23:14:08.957021+0000 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000008]: success 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:5 marker=00000000002.62.6 timestamp=2023-12-15T23:14:08.880997+0000 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000002.46.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000017 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:09.128979+0000 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.46.6 op=0 op_state=1 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000017]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000017[0] 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000002.46.6 2023-12-15T23:14:11.640 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: a sync operation returned error 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: backing out with sync_status=-5 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000007]: success 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.636+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:5 marker=00000000002.93.6 timestamp=2023-12-15T23:14:09.005395+0000 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.637+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000017]: success 2023-12-15T23:14:11.641 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.637+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:5 marker=00000000002.46.6 timestamp=2023-12-15T23:14:09.128979+0000 2023-12-15T23:14:11.643 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.640+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.643 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.640+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.640+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: parsed entry: id=00000000002.62.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21/obj00000000000000000002 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: entry->timestamp=2023-12-15T23:14:09.459668+0000 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.62.6 op=0 op_state=1 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000002]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000002[0] 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position=00000000002.62.6 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: parsed entry: id=00000000001.41.6 iter->object=obj00000000000000000283 iter->instance= name=obj00000000000000000283 instance= ns= 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25/obj00000000000000000283 2023-12-15T23:14:11.644 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: entry->timestamp=2023-12-15T23:14:09.383943+0000 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000283]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.41.6 op=0 op_state=1 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: parsed entry: id=00000000001.46.6 iter->object=obj00000000000000000133 iter->instance= name=obj00000000000000000133 instance= ns= 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30/obj00000000000000000133 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: entry->timestamp=2023-12-15T23:14:09.373106+0000 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000133]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.46.6 op=0 op_state=1 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000283]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000283[0] 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: listing bilog for incremental sync; position=00000000001.41.6 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000133]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000133[0] 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: listing bilog for incremental sync; position=00000000001.46.6 2023-12-15T23:14:11.645 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: a sync operation returned error 2023-12-15T23:14:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: backing out with sync_status=-5 2023-12-15T23:14:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.646 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.641+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: a sync operation returned error 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: a sync operation returned error 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: backing out with sync_status=-5 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: backing out with sync_status=-5 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000002]: success 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.643+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21:5 marker=00000000002.62.6 timestamp=2023-12-15T23:14:09.459668+0000 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: a sync operation returned error 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: backing out with sync_status=-5 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:11.649 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.644+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.645+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000423]: success 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20:5 marker=00000000001.79.6 timestamp=2023-12-15T23:14:09.188928+0000 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:entry[obj00000000000000000283]: success 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25:5 marker=00000000001.41.6 timestamp=2023-12-15T23:14:09.383943+0000 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.646+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.647+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket shard: 0 2023-12-15T23:14:11.650 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.647+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.651 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.648+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.648+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.648+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.648+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: parsed entry: id=00000000001.47.6 iter->object=obj00000000000000000061 iter->instance= name=obj00000000000000000061 instance= ns= 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27/obj00000000000000000061 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: entry->timestamp=2023-12-15T23:14:09.141221+0000 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.47.6 op=0 op_state=1 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000061[0] 2023-12-15T23:14:11.652 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.650+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position=00000000001.47.6 2023-12-15T23:14:11.656 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.655+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000061]: success 2023-12-15T23:14:11.656 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.655+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27:5 marker=00000000001.47.6 timestamp=2023-12-15T23:14:09.141221+0000 2023-12-15T23:14:11.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.674+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: a sync operation returned error 2023-12-15T23:14:11.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.674+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: backing out with sync_status=-5 2023-12-15T23:14:11.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.674+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.674+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.675+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.676 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.675+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.676 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.675+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.678 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.677+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: a sync operation returned error 2023-12-15T23:14:11.678 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.677+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: backing out with sync_status=-5 2023-12-15T23:14:11.678 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.677+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.678 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.677+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.681 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.680+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.682 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.681+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.682 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.681+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000001.36.6 iter->object=obj00000000000000000317 iter->instance= name=obj00000000000000000317 instance= ns= 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000317 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:08.761309+0000 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.36.6 op=0 op_state=1 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000317[0] 2023-12-15T23:14:11.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.682+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000001.36.6 2023-12-15T23:14:11.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000003 2023-12-15T23:14:11.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: entry->timestamp=2023-12-15T23:14:09.018650+0000 2023-12-15T23:14:11.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.44.6 op=0 op_state=1 2023-12-15T23:14:11.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000003[0] 2023-12-15T23:14:11.688 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.686+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position=00000000002.44.6 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000133]: success 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30:5 marker=00000000001.46.6 timestamp=2023-12-15T23:14:09.373106+0000 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000317]: success 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:5 marker=00000000001.36.6 timestamp=2023-12-15T23:14:08.761309+0000 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000003]: success 2023-12-15T23:14:11.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.687+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19:5 marker=00000000002.44.6 timestamp=2023-12-15T23:14:09.018650+0000 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23/obj00000000000000000001 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: entry->timestamp=2023-12-15T23:14:09.313175+0000 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.48.6 op=0 op_state=1 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.689+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position=00000000002.48.6 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000005 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:09.080091+0000 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.43.6 op=0 op_state=1 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000005[0] 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000002.43.6 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.92.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000018 2023-12-15T23:14:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:09.436654+0000 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.92.6 op=0 op_state=1 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000018[0] 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.92.6 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.690+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23:5 marker=00000000002.48.6 timestamp=2023-12-15T23:14:09.313175+0000 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.692+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000005]: success 2023-12-15T23:14:11.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.692+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:5 marker=00000000002.43.6 timestamp=2023-12-15T23:14:09.080091+0000 2023-12-15T23:14:11.697 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.696+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000018]: success 2023-12-15T23:14:11.698 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.696+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:5 marker=00000000002.92.6 timestamp=2023-12-15T23:14:09.436654+0000 2023-12-15T23:14:11.718 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.718 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000019 2023-12-15T23:14:11.718 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:09.264175+0000 2023-12-15T23:14:11.718 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.45.6 op=0 op_state=1 2023-12-15T23:14:11.719 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000019[0] 2023-12-15T23:14:11.719 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.717+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000002.45.6 2023-12-15T23:14:11.720 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.719+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000019]: success 2023-12-15T23:14:11.721 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.719+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0:5 marker=00000000002.45.6 timestamp=2023-12-15T23:14:09.264175+0000 2023-12-15T23:14:11.725 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000001.81.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2023-12-15T23:14:11.725 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.725 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:09.325643+0000 2023-12-15T23:14:11.725 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.81.6 op=0 op_state=1 2023-12-15T23:14:11.726 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: : injecting data sync error on key=obj00000000000000000271 2023-12-15T23:14:11.726 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000001.81.6 2023-12-15T23:14:11.726 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.726 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.724+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.766+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: a sync operation returned error 2023-12-15T23:14:11.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.766+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: backing out with sync_status=-5 2023-12-15T23:14:11.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.766+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.766+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.766+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.767+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.767+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.810 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000001.81.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2023-12-15T23:14:11.810 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.810 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:09.325643+0000 2023-12-15T23:14:11.810 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.81.6 op=0 op_state=1 2023-12-15T23:14:11.811 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: : injecting data sync error on key=obj00000000000000000271 2023-12-15T23:14:11.811 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000001.81.6 2023-12-15T23:14:11.811 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.811 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.809+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.851+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: a sync operation returned error 2023-12-15T23:14:11.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.851+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: backing out with sync_status=-5 2023-12-15T23:14:11.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.851+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:11.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.851+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:11.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.851+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.852+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.852+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.895 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: parsed entry: id=00000000001.81.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2023-12-15T23:14:11.895 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12/obj00000000000000000271 2023-12-15T23:14:11.895 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: entry->timestamp=2023-12-15T23:14:09.325643+0000 2023-12-15T23:14:11.895 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.81.6 op=0 op_state=1 2023-12-15T23:14:11.895 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000271[0] 2023-12-15T23:14:11.896 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.894+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position=00000000001.81.6 2023-12-15T23:14:11.901 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.899+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:entry[obj00000000000000000271]: success 2023-12-15T23:14:11.901 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.899+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12:5 marker=00000000001.81.6 timestamp=2023-12-15T23:14:09.325643+0000 2023-12-15T23:14:11.960 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: sync status for source bucket shard: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.942+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.961 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: sync status for source bucket shard: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: sync status for source bucket shard: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: sync status for source bucket shard: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: sync status for source bucket shard: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: sync status for source bucket shard: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: sync status for source bucket shard: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.943+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: sync status for source bucket shard: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: sync status for source bucket shard: 0 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:8]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.963 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: sync status for source bucket shard: 0 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: sync status for source bucket shard: 0 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: parsed entry: id=00000000002.52.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2/obj00000000000000000011 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: entry->timestamp=2023-12-15T23:14:10.629534+0000 2023-12-15T23:14:11.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.52.6 op=0 op_state=1 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000011[0] 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: listing bilog for incremental sync; position=00000000002.52.6 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: sync status for source bucket shard: 0 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:12]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1/obj00000000000000000000 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: entry->timestamp=2023-12-15T23:14:09.796764+0000 2023-12-15T23:14:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.944+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.54.6 op=0 op_state=1 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000000]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000000[0] 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: listing bilog for incremental sync; position=00000000002.54.6 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: sync status for source bucket shard: 0 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: sync status for source bucket shard: 0 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: parsed entry: id=00000000002.35.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2023-12-15T23:14:11.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3/obj00000000000000000001 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: entry->timestamp=2023-12-15T23:14:10.454179+0000 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.35.6 op=0 op_state=1 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000001]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000001[0] 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: listing bilog for incremental sync; position=00000000002.35.6 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4/obj00000000000000000033 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: entry->timestamp=2023-12-15T23:14:10.322630+0000 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.67.6 op=0 op_state=1 2023-12-15T23:14:11.967 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000033]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000033[0] 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: listing bilog for incremental sync; position=00000000002.67.6 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: parsed entry: id=00000000001.50.6 iter->object=obj00000000000000000060 iter->instance= name=obj00000000000000000060 instance= ns= 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0/obj00000000000000000060 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: entry->timestamp=2023-12-15T23:14:10.009437+0000 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000060]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.50.6 op=0 op_state=1 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.945+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000060]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000060[0] 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: listing bilog for incremental sync; position=00000000001.50.6 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.968 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: parsed entry: id=00000000002.91.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7/obj00000000000000000016 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: entry->timestamp=2023-12-15T23:14:09.869480+0000 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.91.6 op=0 op_state=1 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000016]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000016[0] 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: listing bilog for incremental sync; position=00000000002.91.6 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.946+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: sync status for source bucket shard: 0 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: parsed entry: id=00000000002.102.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2023-12-15T23:14:11.969 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9/obj00000000000000000015 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: entry->timestamp=2023-12-15T23:14:10.505626+0000 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.102.6 op=0 op_state=1 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: sync status for source bucket shard: 0 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: parsed entry: id=00000000002.93.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6/obj00000000000000000005 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: entry->timestamp=2023-12-15T23:14:09.882370+0000 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.93.6 op=0 op_state=1 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.970 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000015]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000015[0] 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: listing bilog for incremental sync; position=00000000002.102.6 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: parsed entry: id=00000000002.44.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10/obj00000000000000000026 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: entry->timestamp=2023-12-15T23:14:10.808651+0000 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.44.6 op=0 op_state=1 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.971 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000005]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000005[0] 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: listing bilog for incremental sync; position=00000000002.93.6 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000026]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000026[0] 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: listing bilog for incremental sync; position=00000000002.44.6 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:entry[obj00000000000000000011]: success 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:2:6 marker=00000000002.52.6 timestamp=2023-12-15T23:14:10.629534+0000 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: sync status for source bucket shard: 0 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.947+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: sync status for source bucket shard: 0 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.972 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: sync status for source bucket shard: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: sync status for source bucket shard: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.973 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:entry[obj00000000000000000000]: success 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:1:6 marker=00000000002.54.6 timestamp=2023-12-15T23:14:09.796764+0000 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: sync status for source bucket shard: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: sync status for source bucket shard: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: sync status for source bucket shard: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.974 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.948+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: sync status for source bucket shard: 0 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: sync status for source bucket shard: 0 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: sync status for source bucket shard: 0 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:25]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: sync status for source bucket shard: 0 2023-12-15T23:14:11.975 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: sync status for source bucket shard: 0 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.949+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: sync status for source bucket shard: 0 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: sync status for source bucket shard: 0 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: sync status for source bucket shard: 0 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: sync status for source bucket shard: 0 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:entry[obj00000000000000000001]: success 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:3:6 marker=00000000002.35.6 timestamp=2023-12-15T23:14:10.454179+0000 2023-12-15T23:14:11.976 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: sync status for source bucket shard: 0 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:entry[obj00000000000000000033]: success 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:4:6 marker=00000000002.67.6 timestamp=2023-12-15T23:14:10.322630+0000 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: sync status for source bucket shard: 0 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.950+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: sync status for source bucket shard: 0 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.951+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: listing bilog for incremental sync; position= 2023-12-15T23:14:11.977 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: parsed entry: id=00000000002.64.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16/obj00000000000000000012 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: entry->timestamp=2023-12-15T23:14:10.701537+0000 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.64.6 op=0 op_state=1 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000012]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000012[0] 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: listing bilog for incremental sync; position=00000000002.64.6 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21/obj00000000000000000017 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: entry->timestamp=2023-12-15T23:14:09.933119+0000 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.63.6 op=0 op_state=1 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: parsed entry: id=00000000002.77.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2023-12-15T23:14:11.978 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13/obj00000000000000000009 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: entry->timestamp=2023-12-15T23:14:10.132905+0000 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.77.6 op=0 op_state=1 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000017]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000017[0] 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: listing bilog for incremental sync; position=00000000002.63.6 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:entry[obj00000000000000000005]: success 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:6:6 marker=00000000002.93.6 timestamp=2023-12-15T23:14:09.882370+0000 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17/obj00000000000000000002 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: entry->timestamp=2023-12-15T23:14:10.688850+0000 2023-12-15T23:14:11.979 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.57.6 op=0 op_state=1 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: parsed entry: id=00000000002.71.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20/obj00000000000000000006 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: entry->timestamp=2023-12-15T23:14:10.068421+0000 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.952+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.71.6 op=0 op_state=1 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:entry[obj00000000000000000016]: success 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:7:6 marker=00000000002.91.6 timestamp=2023-12-15T23:14:09.869480+0000 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000009]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000009[0] 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: listing bilog for incremental sync; position=00000000002.77.6 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:entry[obj00000000000000000015]: success 2023-12-15T23:14:11.980 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:9:6 marker=00000000002.102.6 timestamp=2023-12-15T23:14:10.505626+0000 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:entry[obj00000000000000000026]: success 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:10:6 marker=00000000002.44.6 timestamp=2023-12-15T23:14:10.808651+0000 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22/obj00000000000000000007 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: entry->timestamp=2023-12-15T23:14:10.185003+0000 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.65.6 op=0 op_state=1 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000002]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000002[0] 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: listing bilog for incremental sync; position=00000000002.57.6 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2023-12-15T23:14:11.981 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000045 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: entry->timestamp=2023-12-15T23:14:10.569129+0000 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.41.6 op=0 op_state=1 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000006]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000006[0] 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: listing bilog for incremental sync; position=00000000002.71.6 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: parsed entry: id=00000000002.95.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18/obj00000000000000000013 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: entry->timestamp=2023-12-15T23:14:10.309335+0000 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.95.6 op=0 op_state=1 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000007]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000007[0] 2023-12-15T23:14:11.982 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: listing bilog for incremental sync; position=00000000002.65.6 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: : injecting data sync error on key=obj00000000000000000045 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position=00000000002.41.6 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000013]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000013[0] 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: listing bilog for incremental sync; position=00000000002.95.6 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.953+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000045 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23/obj00000000000000000039 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: entry->timestamp=2023-12-15T23:14:09.997394+0000 2023-12-15T23:14:11.983 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.49.6 op=0 op_state=1 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: parsed entry: id=00000000002.33.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24/obj00000000000000000027 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: entry->timestamp=2023-12-15T23:14:09.821677+0000 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.33.6 op=0 op_state=1 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000039]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000039[0] 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: listing bilog for incremental sync; position=00000000002.49.6 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000027]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000027[0] 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: listing bilog for incremental sync; position=00000000002.33.6 2023-12-15T23:14:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:entry[obj00000000000000000060]: success 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:0:6 marker=00000000001.50.6 timestamp=2023-12-15T23:14:10.009437+0000 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000053 iter->instance= name=obj00000000000000000053 instance= ns= 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27/obj00000000000000000053 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: entry->timestamp=2023-12-15T23:14:10.760619+0000 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000053]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.53.6 op=0 op_state=1 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000053]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000053[0] 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: listing bilog for incremental sync; position=00000000002.53.6 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29/obj00000000000000000004 2023-12-15T23:14:11.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: entry->timestamp=2023-12-15T23:14:10.245166+0000 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.67.6 op=0 op_state=1 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33/obj00000000000000000019 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: entry->timestamp=2023-12-15T23:14:10.580709+0000 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.51.6 op=0 op_state=1 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: parsed entry: id=00000000001.63.6 iter->object=obj00000000000000000036 iter->instance= name=obj00000000000000000036 instance= ns= 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.954+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30/obj00000000000000000036 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: entry->timestamp=2023-12-15T23:14:10.057081+0000 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000036]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.63.6 op=0 op_state=1 2023-12-15T23:14:11.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000004]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000004[0] 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: listing bilog for incremental sync; position=00000000002.67.6 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:entry[obj00000000000000000019]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000019[0] 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: listing bilog for incremental sync; position=00000000002.51.6 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000036]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000036[0] 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: listing bilog for incremental sync; position=00000000001.63.6 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:entry[obj00000000000000000012]: success 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:16:6 marker=00000000002.64.6 timestamp=2023-12-15T23:14:10.701537+0000 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.955+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:entry[obj00000000000000000017]: success 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.956+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:21:6 marker=00000000002.63.6 timestamp=2023-12-15T23:14:09.933119+0000 2023-12-15T23:14:11.987 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.956+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:entry[obj00000000000000000009]: success 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.956+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:13:6 marker=00000000002.77.6 timestamp=2023-12-15T23:14:10.132905+0000 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.956+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:entry[obj00000000000000000002]: success 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.956+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:17:6 marker=00000000002.57.6 timestamp=2023-12-15T23:14:10.688850+0000 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:entry[obj00000000000000000007]: success 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:22:6 marker=00000000002.65.6 timestamp=2023-12-15T23:14:10.185003+0000 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:entry[obj00000000000000000006]: success 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:20:6 marker=00000000002.71.6 timestamp=2023-12-15T23:14:10.068421+0000 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:entry[obj00000000000000000039]: success 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.957+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:23:6 marker=00000000002.49.6 timestamp=2023-12-15T23:14:09.997394+0000 2023-12-15T23:14:11.988 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:entry[obj00000000000000000019]: success 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:33:6 marker=00000000002.51.6 timestamp=2023-12-15T23:14:10.580709+0000 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:entry[obj00000000000000000027]: success 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:24:6 marker=00000000002.33.6 timestamp=2023-12-15T23:14:09.821677+0000 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:entry[obj00000000000000000004]: success 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:29:6 marker=00000000002.67.6 timestamp=2023-12-15T23:14:10.245166+0000 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:entry[obj00000000000000000013]: success 2023-12-15T23:14:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.958+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:18:6 marker=00000000002.95.6 timestamp=2023-12-15T23:14:10.309335+0000 2023-12-15T23:14:11.991 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.963+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:entry[obj00000000000000000036]: success 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.963+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:30:6 marker=00000000001.63.6 timestamp=2023-12-15T23:14:10.057081+0000 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.963+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:entry[obj00000000000000000053]: success 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.963+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:27:6 marker=00000000002.53.6 timestamp=2023-12-15T23:14:10.760619+0000 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000065 iter->instance= name=obj00000000000000000065 instance= ns= 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000065 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: entry->timestamp=2023-12-15T23:14:10.641444+0000 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.56.6 op=0 op_state=1 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: : injecting data sync error on key=obj00000000000000000065 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000001.56.6 2023-12-15T23:14:11.992 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.985+0000 7f36d4530800 0 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: ERROR: failed to sync object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000065 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14/obj00000000000000000040 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: entry->timestamp=2023-12-15T23:14:10.121203+0000 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.51.6 op=0 op_state=1 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000040]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000040[0] 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.986+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: listing bilog for incremental sync; position=00000000002.51.6 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.987+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:entry[obj00000000000000000040]: success 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.987+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:14:6 marker=00000000002.51.6 timestamp=2023-12-15T23:14:10.121203+0000 2023-12-15T23:14:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: parsed entry: id=00000000002.100.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11/obj00000000000000000030 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: entry->timestamp=2023-12-15T23:14:10.388924+0000 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.100.6 op=0 op_state=1 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15/obj00000000000000000024 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: entry->timestamp=2023-12-15T23:14:10.748811+0000 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.53.6 op=0 op_state=1 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000030]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000030[0] 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: listing bilog for incremental sync; position=00000000002.100.6 2023-12-15T23:14:11.994 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000024]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000024[0] 2023-12-15T23:14:11.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.988+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: listing bilog for incremental sync; position=00000000002.53.6 2023-12-15T23:14:11.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.989+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:entry[obj00000000000000000024]: success 2023-12-15T23:14:11.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.989+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:15:6 marker=00000000002.53.6 timestamp=2023-12-15T23:14:10.748811+0000 2023-12-15T23:14:11.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.990+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:entry[obj00000000000000000030]: success 2023-12-15T23:14:11.995 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.990+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:11:6 marker=00000000002.100.6 timestamp=2023-12-15T23:14:10.388924+0000 2023-12-15T23:14:11.998 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: parsed entry: id=00000000002.42.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31/obj00000000000000000003 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: entry->timestamp=2023-12-15T23:14:10.258077+0000 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.42.6 op=0 op_state=1 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:entry[obj00000000000000000003]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000003[0] 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.993+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: listing bilog for incremental sync; position=00000000002.42.6 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26/obj00000000000000000021 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: entry->timestamp=2023-12-15T23:14:09.808961+0000 2023-12-15T23:14:11.999 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.55.6 op=0 op_state=1 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000021]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000021[0] 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: listing bilog for incremental sync; position=00000000002.55.6 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: parsed entry: id=00000000002.160.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28/obj00000000000000000020 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: entry->timestamp=2023-12-15T23:14:09.945346+0000 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.160.6 op=0 op_state=1 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: parsed entry: id=00000000002.69.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32/obj00000000000000000014 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: entry->timestamp=2023-12-15T23:14:10.519701+0000 2023-12-15T23:14:12.000 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.69.6 op=0 op_state=1 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: parsed entry: id=00000000002.104.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35/obj00000000000000000018 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: entry->timestamp=2023-12-15T23:14:10.197560+0000 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.104.6 op=0 op_state=1 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: parsed entry: id=00000000001.34.6 iter->object=obj00000000000000000057 iter->instance= name=obj00000000000000000057 instance= ns= 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34/obj00000000000000000057 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: entry->timestamp=2023-12-15T23:14:10.377636+0000 2023-12-15T23:14:12.001 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:entry[obj00000000000000000057]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.34.6 op=0 op_state=1 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000020]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000020[0] 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: listing bilog for incremental sync; position=00000000002.160.6 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:entry[obj00000000000000000014]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000014[0] 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: listing bilog for incremental sync; position=00000000002.69.6 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:entry[obj00000000000000000018]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000018[0] 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: listing bilog for incremental sync; position=00000000002.104.6 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:entry[obj00000000000000000057]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000057[0] 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.994+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: listing bilog for incremental sync; position=00000000001.34.6 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:entry[obj00000000000000000003]: success 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:31:6 marker=00000000002.42.6 timestamp=2023-12-15T23:14:10.258077+0000 2023-12-15T23:14:12.002 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: parsed entry: id=00000000002.36.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36/obj00000000000000000008 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: entry->timestamp=2023-12-15T23:14:10.441937+0000 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.36.6 op=0 op_state=1 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:entry[obj00000000000000000008]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000008[0] 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.995+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: listing bilog for incremental sync; position=00000000002.36.6 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:entry[obj00000000000000000021]: success 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:26:6 marker=00000000002.55.6 timestamp=2023-12-15T23:14:09.808961+0000 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:entry[obj00000000000000000020]: success 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:28:6 marker=00000000002.160.6 timestamp=2023-12-15T23:14:09.945346+0000 2023-12-15T23:14:12.003 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:entry[obj00000000000000000014]: success 2023-12-15T23:14:12.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:32:6 marker=00000000002.69.6 timestamp=2023-12-15T23:14:10.519701+0000 2023-12-15T23:14:12.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:entry[obj00000000000000000018]: success 2023-12-15T23:14:12.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:35:6 marker=00000000002.104.6 timestamp=2023-12-15T23:14:10.197560+0000 2023-12-15T23:14:12.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:entry[obj00000000000000000008]: success 2023-12-15T23:14:12.004 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.997+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:36:6 marker=00000000002.36.6 timestamp=2023-12-15T23:14:10.441937+0000 2023-12-15T23:14:12.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.998+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: a sync operation returned error 2023-12-15T23:14:12.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.998+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: backing out with sync_status=-5 2023-12-15T23:14:12.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.998+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:12.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.998+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:12.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.998+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:12.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.999+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: sync status for source bucket shard: 0 2023-12-15T23:14:12.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:11.999+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position= 2023-12-15T23:14:12.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.000+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:entry[obj00000000000000000057]: success 2023-12-15T23:14:12.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.000+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:34:6 marker=00000000001.34.6 timestamp=2023-12-15T23:14:10.377636+0000 2023-12-15T23:14:12.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.027+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: a sync operation returned error 2023-12-15T23:14:12.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.027+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: backing out with sync_status=-5 2023-12-15T23:14:12.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.027+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: incremental sync on bucket failed, retcode=-5 2023-12-15T23:14:12.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.027+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: ERROR: incremental sync failed. error: -5 2023-12-15T23:14:12.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.027+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:14:12.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: sync status for source bucket shard: 0 2023-12-15T23:14:12.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.028+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position= 2023-12-15T23:14:12.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2023-12-15T23:14:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19/obj00000000000000000045 2023-12-15T23:14:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: entry->timestamp=2023-12-15T23:14:10.569129+0000 2023-12-15T23:14:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000002.41.6 op=0 op_state=1 2023-12-15T23:14:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000045[0] 2023-12-15T23:14:12.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.041+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: listing bilog for incremental sync; position=00000000002.41.6 2023-12-15T23:14:12.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.043+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:entry[obj00000000000000000045]: success 2023-12-15T23:14:12.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.043+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:19:6 marker=00000000002.41.6 timestamp=2023-12-15T23:14:10.569129+0000 2023-12-15T23:14:12.071 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000065 iter->instance= name=obj00000000000000000065 instance= ns= 2023-12-15T23:14:12.071 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: syncing object: kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5/obj00000000000000000065 2023-12-15T23:14:12.071 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: entry->timestamp=2023-12-15T23:14:10.641444+0000 2023-12-15T23:14:12.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=00000000001.56.6 op=0 op_state=1 2023-12-15T23:14:12.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 5 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-48[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19])/obj00000000000000000065[0] 2023-12-15T23:14:12.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.070+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: listing bilog for incremental sync; position=00000000001.56.6 2023-12-15T23:14:12.116 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.115+0000 7f36d4530800 10 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:entry[obj00000000000000000065]: success 2023-12-15T23:14:12.116 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:12.115+0000 7f36d4530800 20 RGW-SYNC:bucket[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19<-kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]:inc_sync[kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5]: updating marker marker_oid=bucket.sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19:5:6 marker=00000000001.56.6 timestamp=2023-12-15T23:14:10.641444+0000 2023-12-15T23:14:12.139 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:12.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:12.140 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:12.189 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:12.189 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:12.238 INFO:teuthology.orchestra.run.smithi093.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:09.796764Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17005233020144981867","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.454179Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2323296379982718009","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.688850Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7554343852360513214","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.258077Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1272024618337490274","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.245166Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4625786418355208467","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:09.882370Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4597137263355090836","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.068421Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13207418654957830203","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.185003Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11709237665057908106","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.441937Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4496680870825875829","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.132905Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14509638184089088367","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.249236Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1982548862398571199","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.629534Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14477194522490844792","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.701537Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9105756636812565451","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.309335Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2314681151482358826","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.519701Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8564602847921867725","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.505626Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2074682539611664218","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.869480Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16400781754183247793","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:09.933119Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6580443229185934863","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.197560Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4392296208190284801","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.580709Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15320741376382736556","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.945346Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3127947727142491851","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.808961Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13041041613554088094","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:07.807135Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2587873791674648775","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.069285Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15107442092180706068","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.748811Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13053531149769423508","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:08.019375Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17494526446927927437","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.808651Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.5060162956372964380","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:09.821677Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2028784789822035796","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000028","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:05.736293Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12352232679325025543","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.199409Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.964678884711263384","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.388924Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2241685955357569167","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:08.068236Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7044846947474543488","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:05.980364Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10609935037127985307","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.322630Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16714338733435079463","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.057081Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17936886023672636163","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:08.340158Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4400485679693299951","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.997394Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13913934220053073429","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.121203Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4563316897198857162","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.569129Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14628929884330137653","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000046","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:07.052475Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12875195681224896486","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:07.816992Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6680112706681605303","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:07.403334Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13199997866209513650","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.760619Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3737044354414417671","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:08.772727Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2837531048828371165","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000057","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.377636Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9613980518462432725","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:07.203450Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17319815314898146993","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:08.283395Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.11136936594019996086","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.009437Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3766758381874196211","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.141221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1128460549409877918","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.641444Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15193543960316045175","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:05.678502Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15281515150285838922","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.373106Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8569463521922478157","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:08.821117Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6363336379435473319","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:09.325643Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4247916331758033216","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:09.383943Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.17975057219304415374","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:08.761309Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16254018111445506347","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.188928Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18064609957457926337","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000467","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:08.688399Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16919434881588712362","flags":0,"pending_map":[],"versioned_epoch":0}] 2023-12-15T23:14:12.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:12.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-48', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:12.239 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-48 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:12.288 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:12.288 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:12.331 INFO:teuthology.orchestra.run.smithi188.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.796764Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_X4RCBLikpXJ57vz8foi9M6U4yu_nfJZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.454179Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CKQC40Wg9_Ra2EYkulH_WbYiDm4MDJk","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.688850Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_-ScAO8Qy2m0Iq3pF_v_QnyVunY4S7xx","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.258077Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aUIuqRGXmfEyeNRBflaJ9n4H1S4Mt6q","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.245166Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_AtZP6am7M9mk-2r6IHJ-ZX0a-EhYZDY","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.882370Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_RzcirwkM2CsqPzptSD9i0ZzQLEnH0qC","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.068421Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aT75d2g3E1PJRrh9CD_vv5eWXXqMRTD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.185003Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_4x_FIZLw9_-FKw31a4e711PGyaFI8Yl","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.441937Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9sLkHrEmrzxwERAgY2VBelEXSX5aAPg","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.132905Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_OhFLaIijqxhWzMbIvaczkXhK1QRXRwm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:09.249236Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_OXgA4m2lTDxjQT8qIMMLg4Ns52etQBR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.629534Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aJ7EC74qoOsMv57e_hvUQM9Mr9chGu8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.701537Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Sfu-D_KZMshbRzRI8xfnVouhHiZjsVx","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.309335Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Od1v1GqbesmzZnk4TruVdDPaLDyO8YF","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.519701Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_C2NZUSCUtmac8skuvF8MIiKErJIJg_3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.505626Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QxFRAOCwH-UZIxyJyXOvn42sevebMCH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.869480Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jFgcVj9KTtmFO1FFjNUzvxYYv-85mDR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.933119Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_t6nUWUBon2IOI19vdYacoT1vI14xVHV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.197560Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hcrvG4jL-GrxNh5RgEznSYmYnxsk4SK","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.580709Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_VSOBWHOnMgObcTY-_878kLK8n8Fx9DT","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:09.945346Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1Vofig_N5_BmmcFf9XwLdUEoMrMom81","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.808961Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2X0nigfLxX-DWjSrTtSFAduybKDRbes","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:07.807135Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9IvmBjQCu9QyWSM76fy7Ja6GOsDsqcA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.069285Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_puX_b0xVssXnORxSvDGUAcSSBwsVgfQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:10.748811Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ZukhcYsWb2WyDQ76f_LMtx8TlaL-2gO","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:08.019375Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_fRfCHammyrl3syNJ-PBuY7JDicbzCwT","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.808651Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ltomol41-pHBj2jhbYuftDs544ZfOh8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:09.821677Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_k3Js9F420JfKCPFjGMKc7sNfSgXHyZP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000028","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:05.736293Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_0Bfbr-5Cm0WeotLZo-zhes_hDrT65Wd","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.199409Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__UDZ9C6DkpHALtj2_gFj6HK2aPGg8sh","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.388924Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_tHD06qEdirPKM6wSkyiFz1-Y2tUrQW0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:08.068236Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_zAQCz4K910tWHFpmTgYc1QLY5e5XRdG","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:05.980364Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hLI-gcdpdnuJtWvIt9jrg-R8OgCXBPH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.322630Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_WasiJZbnCBHTbfUMOyj_wbQSbJ9Rcw3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.057081Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_coaxsDpdBXii2-bMH6kzIa_34AfZtyT","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:08.340158Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_nDHNZud0m9FR6ae_9l_hRWXLLee7UVQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:09.997394Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2zwJC-ZvnnER4OeD9-ILNq_7tdgG4a8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":34},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.121203Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__JzsYT4VXU0oFqp1HHyB3i0uiQKUAZh","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.569129Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pW88hIjGKMBz4UpBqQfG6G4JDA5wfNb","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000046","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:07.052475Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bsCbj3cF9OWDGUx-6sGlyy7GLIE2UIE","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:07.816992Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Q_lasdLm6u2_PFTYtMlBrC5mIiVLLNr","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:07.403334Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Sg2LsdQoLPTi9deFoylRrnxLL8034Nn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:10.760619Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_EAs85rvMNoqyYorMzYjjIyoo5TP0DAZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:08.772727Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_zYlW5M4Mhws0URlm-t9fszVWeszl59Z","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000057","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.377636Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_yEGnnlczf6HuFHhOP5QzQTIoOKtE-39","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:07.203450Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CSUbTYtBtr0njtJ7qqGKK_WoF_ftWk2","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:08.283395Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__Lqumvr4fxexudYHtp4o1fnAxS8MAOJ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:10.009437Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_mwRan9NR1C4xU26022ruldeOOtI0ciW","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.141221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rjx5CLh9e-MmVTRyCbetxcnv6-UWmyA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:10.641444Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8i2nD41UAycndl7ZuHUWk7dfZCHy8rX","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:05.678502Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_otVXhGFP5og-bi8J47WK-UdPoJr5xUB","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.373106Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_7RQhiTZcNOw93B74fLs2QFmcsxnk3zi","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:08.821117Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_UG3HAY-pIn3nb92lUIUDf4qVWvAaEvu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:14:09.325643Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_P6qIshPfAw-QXVHg3BlGguvN-xsLluO","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.383943Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_fvy8kgQmN8ig7GR5EnG58vt-MznCt_v","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:14:08.761309Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QyD5zR4_QZDyS5AV3Dci7xwQm3f9N6A","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:14:09.188928Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9NYkMRybmmhs2gd3gfZ60BqF1DuOuac","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000467","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:14:08.688399Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_k_YixHtPosPmXpyQdOuDkdBZbMW9UsU","flags":0,"pending_map":[],"versioned_epoch":0}] 2023-12-15T23:14:12.332 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:14:12.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:14:12.334 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:14:12.334 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:12.352 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:14:12.352 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:14:12.352 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:14:12.352 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:14:12.352 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:14:13.354 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.373 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:14:13.373 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:14:13.374 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:14:13.375 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:14:13.375 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-48 2023-12-15T23:14:13.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:14:13.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:14:13.376 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-48 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:14:13.470 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:13.470 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:13.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:13.509+0000 7f5c10146800 1 bucket sync caught up with source: 2023-12-15T23:14:13.511 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.50.6, 00000000002.54.6, 00000000002.52.6, 00000000002.35.6, 00000000002.67.6, 00000000001.56.6, 00000000002.93.6, 00000000002.91.6, , 00000000002.102.6, 00000000002.44.6, 00000000002.100.6, , 00000000002.77.6, 00000000002.51.6, 00000000002.53.6, 00000000002.64.6, 00000000002.57.6, 00000000002.95.6, 00000000002.41.6, 00000000002.71.6, 00000000002.63.6, 00000000002.65.6, 00000000002.49.6, 00000000002.33.6, , 00000000002.55.6, 00000000002.53.6, 00000000002.160.6, 00000000002.67.6, 00000000001.63.6, 00000000002.42.6, 00000000002.69.6, 00000000002.51.6, 00000000001.34.6, 00000000002.104.6, 00000000002.36.6] 2023-12-15T23:14:13.511 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.50.6, 00000000002.54.6, 00000000002.52.6, 00000000002.35.6, 00000000002.67.6, 00000000001.56.6, 00000000002.93.6, 00000000002.91.6, , 00000000002.102.6, 00000000002.44.6, 00000000002.100.6, , 00000000002.77.6, 00000000002.51.6, 00000000002.53.6, 00000000002.64.6, 00000000002.57.6, 00000000002.95.6, 00000000002.41.6, 00000000002.71.6, 00000000002.63.6, 00000000002.65.6, 00000000002.49.6, 00000000002.33.6, , 00000000002.55.6, 00000000002.53.6, 00000000002.160.6, 00000000002.67.6, 00000000001.63.6, 00000000002.42.6, 00000000002.69.6, 00000000002.51.6, 00000000001.34.6, 00000000002.104.6, 00000000002.36.6] 2023-12-15T23:14:13.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:13.509+0000 7f5c10146800 0 bucket checkpoint complete 2023-12-15T23:14:13.525 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-48 2023-12-15T23:14:13.525 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:14:13.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:14:13.526 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-48 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:14:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:13.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:14:13.628+0000 7fda3b73d800 1 bucket sync caught up with source: 2023-12-15T23:14:13.629 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [00000000005.75.6, 00000000007.119.6, 00000000004.87.6, 00000000009.147.6, 00000000005.92.6, 00000000008.53.6, 00000000008.126.6, 00000000006.59.6, 00000000006.115.6, 00000000007.90.6, 00000000003.83.6] 2023-12-15T23:14:13.630 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [00000000005.75.6, 00000000007.119.6, 00000000004.87.6, 00000000009.147.6, 00000000005.92.6, 00000000008.53.6, 00000000008.126.6, 00000000006.59.6, 00000000006.115.6, 00000000007.90.6, 00000000003.83.6] 2023-12-15T23:14:13.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:14:13.628+0000 7fda3b73d800 0 bucket checkpoint complete 2023-12-15T23:14:13.645 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-48 zones={test-zone2, test-zone1} 2023-12-15T23:14:13.645 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.645 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.646 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.646 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:13.646 DEBUG:boto:Data: 2023-12-15T23:14:13.646 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.646 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.646 DEBUG:boto:Params: {} 2023-12-15T23:14:13.646 DEBUG:boto:Token: None 2023-12-15T23:14:13.647 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/ 2023-12-15T23:14:13.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM= 2023-12-15T23:14:13.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM=', 'Content-Length': '0'} 2023-12-15T23:14:13.647 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2023-12-15T23:14:13.648 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:14:13.818 DEBUG:boto:Token: None 2023-12-15T23:14:13.818 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/ 2023-12-15T23:14:13.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM= 2023-12-15T23:14:13.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM=', 'Content-Length': '0'} 2023-12-15T23:14:13.824 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005452daabc5da96cf-00657cddc5-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.824 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.824 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.824 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.825 DEBUG:boto:Path: /kskgfn-48/ 2023-12-15T23:14:13.825 DEBUG:boto:Data: 2023-12-15T23:14:13.825 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.825 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.825 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.825 DEBUG:boto:Params: {} 2023-12-15T23:14:13.825 DEBUG:boto:Token: None 2023-12-15T23:14:13.825 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/ 2023-12-15T23:14:13.825 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM= 2023-12-15T23:14:13.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KMLNQQEStfpXzFEtt0zWuv791SM=', 'Content-Length': '0'} 2023-12-15T23:14:13.829 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014e8e213b701ece1-00657cddc5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.829 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:14:13.829 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.830 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.830 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.830 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.830 DEBUG:boto:Method: GET 2023-12-15T23:14:13.830 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.830 DEBUG:boto:Data: 2023-12-15T23:14:13.830 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.830 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.830 DEBUG:boto:Params: {} 2023-12-15T23:14:13.831 DEBUG:boto:Token: None 2023-12-15T23:14:13.831 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/?versions 2023-12-15T23:14:13.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE= 2023-12-15T23:14:13.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE=', 'Content-Length': '0'} 2023-12-15T23:14:13.834 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f4a7cc669636fb0-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.834 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000028nulltrue2023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000046nulltrue2023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000057nulltrue2023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.837 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2023-12-15T23:14:13.838 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2023-12-15T23:14:13.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000028 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2023-12-15T23:14:13.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000046 2023-12-15T23:14:13.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000057 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2023-12-15T23:14:13.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000467 2023-12-15T23:14:13.843 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:14:13.844 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.844 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.844 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.844 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.844 DEBUG:boto:Method: GET 2023-12-15T23:14:13.844 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.844 DEBUG:boto:Data: 2023-12-15T23:14:13.844 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.844 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.845 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.845 DEBUG:boto:Params: {} 2023-12-15T23:14:13.845 DEBUG:boto:Token: None 2023-12-15T23:14:13.845 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/?versions 2023-12-15T23:14:13.845 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE= 2023-12-15T23:14:13.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE=', 'Content-Length': '0'} 2023-12-15T23:14:13.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000334a69456761b67f-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.849 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000028nulltrue2023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000046nulltrue2023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000057nulltrue2023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.852 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2023-12-15T23:14:13.853 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2023-12-15T23:14:13.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2023-12-15T23:14:13.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000028 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2023-12-15T23:14:13.856 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000046 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000057 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2023-12-15T23:14:13.857 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2023-12-15T23:14:13.858 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000467 2023-12-15T23:14:13.858 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.859 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.859 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.859 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.859 DEBUG:boto:Method: GET 2023-12-15T23:14:13.859 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.859 DEBUG:boto:Data: 2023-12-15T23:14:13.859 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.859 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.859 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.860 DEBUG:boto:Params: {} 2023-12-15T23:14:13.860 DEBUG:boto:Token: None 2023-12-15T23:14:13.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/?versions 2023-12-15T23:14:13.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE= 2023-12-15T23:14:13.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE=', 'Content-Length': '0'} 2023-12-15T23:14:13.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009efee602656432da-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.863 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000028nulltrue2023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000046nulltrue2023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000057nulltrue2023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.866 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.866 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.866 DEBUG:boto:path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.866 DEBUG:boto:auth_path=/kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.867 DEBUG:boto:Method: GET 2023-12-15T23:14:13.867 DEBUG:boto:Path: /kskgfn-48/?versions&max-keys=999 2023-12-15T23:14:13.867 DEBUG:boto:Data: 2023-12-15T23:14:13.867 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.867 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.867 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.867 DEBUG:boto:Params: {} 2023-12-15T23:14:13.867 DEBUG:boto:Token: None 2023-12-15T23:14:13.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/?versions 2023-12-15T23:14:13.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE= 2023-12-15T23:14:13.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iMJzFojQhHB28fLyZ9i0E7XOnmE=', 'Content-Length': '0'} 2023-12-15T23:14:13.872 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc73e481c77268aa-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.872 DEBUG:boto:b'kskgfn-48999falseobj00000000000000000000nulltrue2023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000001nulltrue2023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000002nulltrue2023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000003nulltrue2023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000004nulltrue2023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000005nulltrue2023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000006nulltrue2023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000007nulltrue2023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000008nulltrue2023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000009nulltrue2023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000010nulltrue2023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000011nulltrue2023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000012nulltrue2023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000013nulltrue2023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000014nulltrue2023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000015nulltrue2023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000016nulltrue2023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000017nulltrue2023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000018nulltrue2023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000019nulltrue2023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000020nulltrue2023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000021nulltrue2023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000022nulltrue2023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000023nulltrue2023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000024nulltrue2023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000025nulltrue2023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000026nulltrue2023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000027nulltrue2023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000028nulltrue2023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000029nulltrue2023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000030nulltrue2023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000031nulltrue2023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000032nulltrue2023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000033nulltrue2023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000036nulltrue2023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000037nulltrue2023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000039nulltrue2023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000040nulltrue2023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000045nulltrue2023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000046nulltrue2023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000049nulltrue2023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000050nulltrue2023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000053nulltrue2023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000056nulltrue2023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000057nulltrue2023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000058nulltrue2023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000059nulltrue2023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000060nulltrue2023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000061nulltrue2023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000065nulltrue2023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000076nulltrue2023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000133nulltrue2023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000162nulltrue2023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000271nulltrue2023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000283nulltrue2023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000317nulltrue2023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000423nulltrue2023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj00000000000000000467nulltrue2023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:14:13.876 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.876 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.876 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.876 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.876 DEBUG:boto:Method: GET 2023-12-15T23:14:13.876 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.876 DEBUG:boto:Data: 2023-12-15T23:14:13.876 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.877 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.877 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.877 DEBUG:boto:Params: {} 2023-12-15T23:14:13.877 DEBUG:boto:Token: None 2023-12-15T23:14:13.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk= 2023-12-15T23:14:13.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk=', 'Content-Length': '0'} 2023-12-15T23:14:13.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043b04abec7366297-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.921 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.922 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.922 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.922 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.922 DEBUG:boto:Method: GET 2023-12-15T23:14:13.922 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.922 DEBUG:boto:Data: 2023-12-15T23:14:13.922 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.923 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.923 DEBUG:boto:Params: {} 2023-12-15T23:14:13.923 DEBUG:boto:Token: None 2023-12-15T23:14:13.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk= 2023-12-15T23:14:13.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk=', 'Content-Length': '0'} 2023-12-15T23:14:13.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062d47c67cd169a08-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.925 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.925 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.926 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.926 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.926 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.926 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.926 DEBUG:boto:Data: 2023-12-15T23:14:13.926 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.926 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.926 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.926 DEBUG:boto:Params: {} 2023-12-15T23:14:13.926 DEBUG:boto:Token: None 2023-12-15T23:14:13.926 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KouvdNqonCFCE2M6QVQyCkNfK9o= 2023-12-15T23:14:13.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KouvdNqonCFCE2M6QVQyCkNfK9o=', 'Content-Length': '0'} 2023-12-15T23:14:13.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7c88042999ada9b-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.929 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.929 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.929 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.929 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.929 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.929 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.929 DEBUG:boto:Data: 2023-12-15T23:14:13.929 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.929 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.930 DEBUG:boto:Params: {} 2023-12-15T23:14:13.930 DEBUG:boto:Token: None 2023-12-15T23:14:13.930 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KouvdNqonCFCE2M6QVQyCkNfK9o= 2023-12-15T23:14:13.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KouvdNqonCFCE2M6QVQyCkNfK9o=', 'Content-Length': '0'} 2023-12-15T23:14:13.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c4eb0c3f333c357-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:14:13.932 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.932 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.933 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.933 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.933 DEBUG:boto:Method: GET 2023-12-15T23:14:13.933 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.933 DEBUG:boto:Data: 2023-12-15T23:14:13.933 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.933 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.933 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.933 DEBUG:boto:Params: {} 2023-12-15T23:14:13.933 DEBUG:boto:Token: None 2023-12-15T23:14:13.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk= 2023-12-15T23:14:13.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk=', 'Content-Length': '0'} 2023-12-15T23:14:13.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f953e8400220033-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.977 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.978 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.978 DEBUG:boto:Method: GET 2023-12-15T23:14:13.978 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.978 DEBUG:boto:Data: 2023-12-15T23:14:13.978 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.978 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.978 DEBUG:boto:Params: {} 2023-12-15T23:14:13.979 DEBUG:boto:Token: None 2023-12-15T23:14:13.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000?versionId=null 2023-12-15T23:14:13.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk= 2023-12-15T23:14:13.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUhNDQX7HLmuD+k3O6Lduxy/vJk=', 'Content-Length': '0'} 2023-12-15T23:14:13.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007183b2bcb489dcaa-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.981 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.981 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.981 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.981 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.981 DEBUG:boto:Method: GET 2023-12-15T23:14:13.981 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.982 DEBUG:boto:Data: 2023-12-15T23:14:13.982 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.982 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.982 DEBUG:boto:Params: {} 2023-12-15T23:14:13.982 DEBUG:boto:Token: None 2023-12-15T23:14:13.982 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/ 2023-12-15T23:14:13.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+UcjKvqWyn+tCNOYIpXmkQWX+IM= 2023-12-15T23:14:13.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+UcjKvqWyn+tCNOYIpXmkQWX+IM=', 'Content-Length': '0'} 2023-12-15T23:14:13.984 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070596bfe3c1dece7-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.985 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.985 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:13.985 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:13.985 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.985 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.985 DEBUG:boto:Method: GET 2023-12-15T23:14:13.986 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:13.986 DEBUG:boto:Data: 2023-12-15T23:14:13.986 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.986 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.986 DEBUG:boto:Params: {} 2023-12-15T23:14:13.986 DEBUG:boto:Token: None 2023-12-15T23:14:13.986 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/ 2023-12-15T23:14:13.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+UcjKvqWyn+tCNOYIpXmkQWX+IM= 2023-12-15T23:14:13.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+UcjKvqWyn+tCNOYIpXmkQWX+IM=', 'Content-Length': '0'} 2023-12-15T23:14:13.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000536ff2f667b1baef-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.990 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:13.990 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.991 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.991 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.991 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.991 DEBUG:boto:Data: 2023-12-15T23:14:13.991 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.991 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.991 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.991 DEBUG:boto:Params: {} 2023-12-15T23:14:13.991 DEBUG:boto:Token: None 2023-12-15T23:14:13.992 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.992 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jyKDsaOh2Gg3kjgqB10lEa4eXmU= 2023-12-15T23:14:13.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jyKDsaOh2Gg3kjgqB10lEa4eXmU=', 'Content-Length': '0'} 2023-12-15T23:14:13.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbb2d92d06d83fd9-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.994 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.994 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.994 DEBUG:boto:Method: HEAD 2023-12-15T23:14:13.994 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.994 DEBUG:boto:Data: 2023-12-15T23:14:13.994 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:13.994 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.994 DEBUG:boto:Params: {} 2023-12-15T23:14:13.994 DEBUG:boto:Token: None 2023-12-15T23:14:13.995 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jyKDsaOh2Gg3kjgqB10lEa4eXmU= 2023-12-15T23:14:13.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jyKDsaOh2Gg3kjgqB10lEa4eXmU=', 'Content-Length': '0'} 2023-12-15T23:14:13.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000072cefee91c4af73-00657cddc5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:13.997 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2023-12-15T23:14:13.997 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.997 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.997 DEBUG:boto:Method: GET 2023-12-15T23:14:13.997 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.997 DEBUG:boto:Data: 2023-12-15T23:14:13.998 DEBUG:boto:Headers: {} 2023-12-15T23:14:13.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:13.998 DEBUG:boto:Port: 8000 2023-12-15T23:14:13.998 DEBUG:boto:Params: {} 2023-12-15T23:14:13.998 DEBUG:boto:Token: None 2023-12-15T23:14:13.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:13 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:13.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IgR0pzrPd6s0oZ9uBEtEn0S1caU= 2023-12-15T23:14:13.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IgR0pzrPd6s0oZ9uBEtEn0S1caU=', 'Content-Length': '0'} 2023-12-15T23:14:14.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067277ac985404ccc-00657cddc5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.000 DEBUG:boto:path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:14.001 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000000 2023-12-15T23:14:14.001 DEBUG:boto:Method: GET 2023-12-15T23:14:14.001 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:14.001 DEBUG:boto:Data: 2023-12-15T23:14:14.001 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.001 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.001 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.001 DEBUG:boto:Params: {} 2023-12-15T23:14:14.002 DEBUG:boto:Token: None 2023-12-15T23:14:14.002 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000000 2023-12-15T23:14:14.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Agt3ewyXL8hereTtf9mTiIVRZQ= 2023-12-15T23:14:14.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Agt3ewyXL8hereTtf9mTiIVRZQ=', 'Content-Length': '0'} 2023-12-15T23:14:14.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eccda0602c8540c8-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.004 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.004 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.004 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.004 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.005 DEBUG:boto:Method: GET 2023-12-15T23:14:14.005 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.005 DEBUG:boto:Data: 2023-12-15T23:14:14.005 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.005 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.005 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.005 DEBUG:boto:Params: {} 2023-12-15T23:14:14.005 DEBUG:boto:Token: None 2023-12-15T23:14:14.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.006 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.008 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be78b76ed4c5a3a6-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.008 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.008 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.009 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.009 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.009 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.009 DEBUG:boto:Method: GET 2023-12-15T23:14:14.009 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000000 2023-12-15T23:14:14.009 DEBUG:boto:Data: 2023-12-15T23:14:14.009 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.009 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.009 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.009 DEBUG:boto:Params: {} 2023-12-15T23:14:14.010 DEBUG:boto:Token: None 2023-12-15T23:14:14.010 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.013 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cb044cbbe290884-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.013 DEBUG:boto:b'kskgfn-48obj000000000000000000001000falseobj000000000000000000002023-12-15T23:14:09.796Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:14:14.014 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.014 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.014 DEBUG:boto:Method: GET 2023-12-15T23:14:14.015 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.015 DEBUG:boto:Data: 2023-12-15T23:14:14.015 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.015 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.015 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.015 DEBUG:boto:Params: {} 2023-12-15T23:14:14.015 DEBUG:boto:Token: None 2023-12-15T23:14:14.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.016 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0= 2023-12-15T23:14:14.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0=', 'Content-Length': '0'} 2023-12-15T23:14:14.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a06151b428f9934-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.018 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.018 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.018 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.018 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.018 DEBUG:boto:Method: GET 2023-12-15T23:14:14.018 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.018 DEBUG:boto:Data: 2023-12-15T23:14:14.019 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.019 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.019 DEBUG:boto:Params: {} 2023-12-15T23:14:14.019 DEBUG:boto:Token: None 2023-12-15T23:14:14.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0= 2023-12-15T23:14:14.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0=', 'Content-Length': '0'} 2023-12-15T23:14:14.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7d6152890b99725-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.022 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.022 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.022 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.022 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.022 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.022 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.022 DEBUG:boto:Data: 2023-12-15T23:14:14.023 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.023 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.023 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.023 DEBUG:boto:Params: {} 2023-12-15T23:14:14.023 DEBUG:boto:Token: None 2023-12-15T23:14:14.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:feFzyJ7Y+DhAL69MuKGov3gOd9U= 2023-12-15T23:14:14.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:feFzyJ7Y+DhAL69MuKGov3gOd9U=', 'Content-Length': '0'} 2023-12-15T23:14:14.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b260fe5fb2372a43-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.025 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.025 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.025 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.026 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.026 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.026 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.026 DEBUG:boto:Data: 2023-12-15T23:14:14.026 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.026 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.026 DEBUG:boto:Params: {} 2023-12-15T23:14:14.026 DEBUG:boto:Token: None 2023-12-15T23:14:14.027 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:feFzyJ7Y+DhAL69MuKGov3gOd9U= 2023-12-15T23:14:14.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:feFzyJ7Y+DhAL69MuKGov3gOd9U=', 'Content-Length': '0'} 2023-12-15T23:14:14.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca52276805ecfc14-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:14:14.029 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.029 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.029 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.029 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.029 DEBUG:boto:Method: GET 2023-12-15T23:14:14.030 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.030 DEBUG:boto:Data: 2023-12-15T23:14:14.030 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.030 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.030 DEBUG:boto:Params: {} 2023-12-15T23:14:14.030 DEBUG:boto:Token: None 2023-12-15T23:14:14.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0= 2023-12-15T23:14:14.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0=', 'Content-Length': '0'} 2023-12-15T23:14:14.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baed0643d2bb6895-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.073 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.074 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.074 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.074 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.074 DEBUG:boto:Method: GET 2023-12-15T23:14:14.074 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.074 DEBUG:boto:Data: 2023-12-15T23:14:14.074 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.074 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.074 DEBUG:boto:Params: {} 2023-12-15T23:14:14.075 DEBUG:boto:Token: None 2023-12-15T23:14:14.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001?versionId=null 2023-12-15T23:14:14.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0= 2023-12-15T23:14:14.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MNfQ2Qubp4Wq8is/nBOWMqWuP/0=', 'Content-Length': '0'} 2023-12-15T23:14:14.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b68748027cf6e0a3-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.077 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.077 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.077 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.077 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.077 DEBUG:boto:Method: GET 2023-12-15T23:14:14.078 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.078 DEBUG:boto:Data: 2023-12-15T23:14:14.078 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.078 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.078 DEBUG:boto:Params: {} 2023-12-15T23:14:14.078 DEBUG:boto:Token: None 2023-12-15T23:14:14.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006be1386deefc50b2-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.081 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.081 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.081 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.082 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.082 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.082 DEBUG:boto:Method: GET 2023-12-15T23:14:14.082 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.082 DEBUG:boto:Data: 2023-12-15T23:14:14.082 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.082 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.082 DEBUG:boto:Params: {} 2023-12-15T23:14:14.082 DEBUG:boto:Token: None 2023-12-15T23:14:14.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000737f60f1916f5905-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.087 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.088 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.088 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.088 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.088 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.088 DEBUG:boto:Data: 2023-12-15T23:14:14.088 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.088 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.088 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.088 DEBUG:boto:Params: {} 2023-12-15T23:14:14.089 DEBUG:boto:Token: None 2023-12-15T23:14:14.089 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.089 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SxE9fiE2DBmHIbBu55iqNL+inwg= 2023-12-15T23:14:14.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SxE9fiE2DBmHIbBu55iqNL+inwg=', 'Content-Length': '0'} 2023-12-15T23:14:14.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027af7277c04ae90b-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.091 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.091 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.091 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.091 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.091 DEBUG:boto:Data: 2023-12-15T23:14:14.091 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.091 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.092 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.092 DEBUG:boto:Params: {} 2023-12-15T23:14:14.092 DEBUG:boto:Token: None 2023-12-15T23:14:14.092 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SxE9fiE2DBmHIbBu55iqNL+inwg= 2023-12-15T23:14:14.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SxE9fiE2DBmHIbBu55iqNL+inwg=', 'Content-Length': '0'} 2023-12-15T23:14:14.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d07315a4a55ad55a-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2023-12-15T23:14:14.094 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.095 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.095 DEBUG:boto:Method: GET 2023-12-15T23:14:14.095 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.095 DEBUG:boto:Data: 2023-12-15T23:14:14.095 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.095 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.095 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.095 DEBUG:boto:Params: {} 2023-12-15T23:14:14.096 DEBUG:boto:Token: None 2023-12-15T23:14:14.096 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2r2UVqVX+hT0nfYE0dEvk2KqLCk= 2023-12-15T23:14:14.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2r2UVqVX+hT0nfYE0dEvk2KqLCk=', 'Content-Length': '0'} 2023-12-15T23:14:14.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017e8f3211dc084b6-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.098 DEBUG:boto:path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.098 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.098 DEBUG:boto:Method: GET 2023-12-15T23:14:14.098 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.098 DEBUG:boto:Data: 2023-12-15T23:14:14.099 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.099 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.099 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.099 DEBUG:boto:Params: {} 2023-12-15T23:14:14.099 DEBUG:boto:Token: None 2023-12-15T23:14:14.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000001 2023-12-15T23:14:14.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2r2UVqVX+hT0nfYE0dEvk2KqLCk= 2023-12-15T23:14:14.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2r2UVqVX+hT0nfYE0dEvk2KqLCk=', 'Content-Length': '0'} 2023-12-15T23:14:14.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091b7e5e8b9d1115d-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.102 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.102 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.102 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.102 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.102 DEBUG:boto:Method: GET 2023-12-15T23:14:14.102 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.102 DEBUG:boto:Data: 2023-12-15T23:14:14.102 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.103 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.103 DEBUG:boto:Params: {} 2023-12-15T23:14:14.103 DEBUG:boto:Token: None 2023-12-15T23:14:14.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.105 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bccf33df9b736d9c-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.105 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.106 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.106 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.106 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.106 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.106 DEBUG:boto:Method: GET 2023-12-15T23:14:14.106 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000001 2023-12-15T23:14:14.106 DEBUG:boto:Data: 2023-12-15T23:14:14.106 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.107 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.107 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.107 DEBUG:boto:Params: {} 2023-12-15T23:14:14.107 DEBUG:boto:Token: None 2023-12-15T23:14:14.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.111 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9e6d3781af33a55-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.153 DEBUG:boto:b'kskgfn-48obj000000000000000000011000falseobj000000000000000000012023-12-15T23:14:10.454Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:14:14.154 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.154 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.154 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.154 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.154 DEBUG:boto:Method: GET 2023-12-15T23:14:14.154 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.155 DEBUG:boto:Data: 2023-12-15T23:14:14.155 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.155 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.155 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.155 DEBUG:boto:Params: {} 2023-12-15T23:14:14.155 DEBUG:boto:Token: None 2023-12-15T23:14:14.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw= 2023-12-15T23:14:14.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw=', 'Content-Length': '0'} 2023-12-15T23:14:14.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067621e9798061094-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.158 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.158 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.158 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.159 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.159 DEBUG:boto:Method: GET 2023-12-15T23:14:14.159 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.159 DEBUG:boto:Data: 2023-12-15T23:14:14.159 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.159 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.159 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.159 DEBUG:boto:Params: {} 2023-12-15T23:14:14.159 DEBUG:boto:Token: None 2023-12-15T23:14:14.160 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.160 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw= 2023-12-15T23:14:14.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw=', 'Content-Length': '0'} 2023-12-15T23:14:14.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2b3d05a0b9c02b0-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.162 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.162 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.162 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.163 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.163 DEBUG:boto:Data: 2023-12-15T23:14:14.163 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.163 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.163 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.163 DEBUG:boto:Params: {} 2023-12-15T23:14:14.163 DEBUG:boto:Token: None 2023-12-15T23:14:14.163 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+BfVjccYv9FE06jenKyOQBO7ZQ= 2023-12-15T23:14:14.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+BfVjccYv9FE06jenKyOQBO7ZQ=', 'Content-Length': '0'} 2023-12-15T23:14:14.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099f6a9bcba2b311a-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.166 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.166 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.166 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.166 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.166 DEBUG:boto:Data: 2023-12-15T23:14:14.166 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.167 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.167 DEBUG:boto:Params: {} 2023-12-15T23:14:14.167 DEBUG:boto:Token: None 2023-12-15T23:14:14.167 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H+BfVjccYv9FE06jenKyOQBO7ZQ= 2023-12-15T23:14:14.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H+BfVjccYv9FE06jenKyOQBO7ZQ=', 'Content-Length': '0'} 2023-12-15T23:14:14.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7a3b9ed5d7b10b5-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.169 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:14:14.169 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.169 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.169 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.170 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.170 DEBUG:boto:Method: GET 2023-12-15T23:14:14.170 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.170 DEBUG:boto:Data: 2023-12-15T23:14:14.170 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.170 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.170 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.170 DEBUG:boto:Params: {} 2023-12-15T23:14:14.170 DEBUG:boto:Token: None 2023-12-15T23:14:14.170 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw= 2023-12-15T23:14:14.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw=', 'Content-Length': '0'} 2023-12-15T23:14:14.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022b59dc6783cd5c7-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.213 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.214 DEBUG:boto:Method: GET 2023-12-15T23:14:14.214 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.214 DEBUG:boto:Data: 2023-12-15T23:14:14.214 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.214 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.214 DEBUG:boto:Params: {} 2023-12-15T23:14:14.215 DEBUG:boto:Token: None 2023-12-15T23:14:14.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002?versionId=null 2023-12-15T23:14:14.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw= 2023-12-15T23:14:14.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:49lD6dvG7zyDML5oXbZBVYFftaw=', 'Content-Length': '0'} 2023-12-15T23:14:14.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066e2bbbdc39def0d-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.217 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.217 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.217 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.218 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.218 DEBUG:boto:Method: GET 2023-12-15T23:14:14.218 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.218 DEBUG:boto:Data: 2023-12-15T23:14:14.218 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.218 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.218 DEBUG:boto:Params: {} 2023-12-15T23:14:14.218 DEBUG:boto:Token: None 2023-12-15T23:14:14.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027de82fc6359beae-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.221 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.221 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.221 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.222 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.222 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.222 DEBUG:boto:Method: GET 2023-12-15T23:14:14.222 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.222 DEBUG:boto:Data: 2023-12-15T23:14:14.222 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.222 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.222 DEBUG:boto:Params: {} 2023-12-15T23:14:14.222 DEBUG:boto:Token: None 2023-12-15T23:14:14.222 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be1c23b0da68b45b-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.226 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.227 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.227 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.227 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.227 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.227 DEBUG:boto:Data: 2023-12-15T23:14:14.227 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.227 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.227 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.227 DEBUG:boto:Params: {} 2023-12-15T23:14:14.228 DEBUG:boto:Token: None 2023-12-15T23:14:14.228 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZMWFJont3duWXJrZwJ3dg+oYwAk= 2023-12-15T23:14:14.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZMWFJont3duWXJrZwJ3dg+oYwAk=', 'Content-Length': '0'} 2023-12-15T23:14:14.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f9e90e6a7fd2e64-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.230 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.231 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.231 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.231 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.231 DEBUG:boto:Data: 2023-12-15T23:14:14.231 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.231 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.231 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.231 DEBUG:boto:Params: {} 2023-12-15T23:14:14.231 DEBUG:boto:Token: None 2023-12-15T23:14:14.231 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZMWFJont3duWXJrZwJ3dg+oYwAk= 2023-12-15T23:14:14.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZMWFJont3duWXJrZwJ3dg+oYwAk=', 'Content-Length': '0'} 2023-12-15T23:14:14.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cfa0b2ad3fe9acd-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.234 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2023-12-15T23:14:14.234 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.234 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.234 DEBUG:boto:Method: GET 2023-12-15T23:14:14.234 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.235 DEBUG:boto:Data: 2023-12-15T23:14:14.235 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.235 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.235 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.235 DEBUG:boto:Params: {} 2023-12-15T23:14:14.235 DEBUG:boto:Token: None 2023-12-15T23:14:14.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ejWZ1A7bax4KLPLXw7Ksrb50cMA= 2023-12-15T23:14:14.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ejWZ1A7bax4KLPLXw7Ksrb50cMA=', 'Content-Length': '0'} 2023-12-15T23:14:14.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4e7f17c5ba1fec6-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.237 DEBUG:boto:path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.238 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.238 DEBUG:boto:Method: GET 2023-12-15T23:14:14.238 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.238 DEBUG:boto:Data: 2023-12-15T23:14:14.238 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.238 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.238 DEBUG:boto:Params: {} 2023-12-15T23:14:14.238 DEBUG:boto:Token: None 2023-12-15T23:14:14.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000002 2023-12-15T23:14:14.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ejWZ1A7bax4KLPLXw7Ksrb50cMA= 2023-12-15T23:14:14.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ejWZ1A7bax4KLPLXw7Ksrb50cMA=', 'Content-Length': '0'} 2023-12-15T23:14:14.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000effcf4c3d062100-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.281 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.282 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.282 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.282 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.282 DEBUG:boto:Method: GET 2023-12-15T23:14:14.282 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.282 DEBUG:boto:Data: 2023-12-15T23:14:14.282 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.282 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.282 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.282 DEBUG:boto:Params: {} 2023-12-15T23:14:14.282 DEBUG:boto:Token: None 2023-12-15T23:14:14.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071a799f51e3c9ca4-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.285 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.286 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.286 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.286 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.286 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.286 DEBUG:boto:Method: GET 2023-12-15T23:14:14.286 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000002 2023-12-15T23:14:14.286 DEBUG:boto:Data: 2023-12-15T23:14:14.286 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.287 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.287 DEBUG:boto:Params: {} 2023-12-15T23:14:14.287 DEBUG:boto:Token: None 2023-12-15T23:14:14.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d511f2f3c6868193-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.291 DEBUG:boto:b'kskgfn-48obj000000000000000000021000falseobj000000000000000000022023-12-15T23:14:10.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.291 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:14:14.291 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.291 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.292 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.292 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.292 DEBUG:boto:Method: GET 2023-12-15T23:14:14.292 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.292 DEBUG:boto:Data: 2023-12-15T23:14:14.292 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.292 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.292 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.292 DEBUG:boto:Params: {} 2023-12-15T23:14:14.292 DEBUG:boto:Token: None 2023-12-15T23:14:14.293 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.293 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo= 2023-12-15T23:14:14.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo=', 'Content-Length': '0'} 2023-12-15T23:14:14.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a86902bceac43b91-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.295 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.295 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.295 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.295 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.295 DEBUG:boto:Method: GET 2023-12-15T23:14:14.295 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.296 DEBUG:boto:Data: 2023-12-15T23:14:14.296 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.296 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.296 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.296 DEBUG:boto:Params: {} 2023-12-15T23:14:14.296 DEBUG:boto:Token: None 2023-12-15T23:14:14.296 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.296 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo= 2023-12-15T23:14:14.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo=', 'Content-Length': '0'} 2023-12-15T23:14:14.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050af9c5b2fc71ca9-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.298 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.298 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.299 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.299 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.299 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.299 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.299 DEBUG:boto:Data: 2023-12-15T23:14:14.299 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.299 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.299 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.299 DEBUG:boto:Params: {} 2023-12-15T23:14:14.299 DEBUG:boto:Token: None 2023-12-15T23:14:14.299 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.300 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hpP4HMlOxF/WlxhCeXg1nGb6DYM= 2023-12-15T23:14:14.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hpP4HMlOxF/WlxhCeXg1nGb6DYM=', 'Content-Length': '0'} 2023-12-15T23:14:14.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033206e685fe01b72-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.301 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.302 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.302 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.302 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.302 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.302 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.302 DEBUG:boto:Data: 2023-12-15T23:14:14.302 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.302 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.302 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.302 DEBUG:boto:Params: {} 2023-12-15T23:14:14.303 DEBUG:boto:Token: None 2023-12-15T23:14:14.303 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hpP4HMlOxF/WlxhCeXg1nGb6DYM= 2023-12-15T23:14:14.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hpP4HMlOxF/WlxhCeXg1nGb6DYM=', 'Content-Length': '0'} 2023-12-15T23:14:14.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f2b55742f42b964-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:14:14.305 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.305 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.305 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.305 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.305 DEBUG:boto:Method: GET 2023-12-15T23:14:14.305 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.305 DEBUG:boto:Data: 2023-12-15T23:14:14.305 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.306 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.306 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.306 DEBUG:boto:Params: {} 2023-12-15T23:14:14.306 DEBUG:boto:Token: None 2023-12-15T23:14:14.306 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.306 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo= 2023-12-15T23:14:14.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo=', 'Content-Length': '0'} 2023-12-15T23:14:14.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002536fd1865691a67-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.349 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.350 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.350 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.350 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.350 DEBUG:boto:Method: GET 2023-12-15T23:14:14.350 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.350 DEBUG:boto:Data: 2023-12-15T23:14:14.350 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.350 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.350 DEBUG:boto:Params: {} 2023-12-15T23:14:14.351 DEBUG:boto:Token: None 2023-12-15T23:14:14.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003?versionId=null 2023-12-15T23:14:14.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo= 2023-12-15T23:14:14.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zpIhisIt/ltTonpHUFASUF2aWo=', 'Content-Length': '0'} 2023-12-15T23:14:14.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046b62800a72120c5-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.353 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.353 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.353 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.353 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.353 DEBUG:boto:Method: GET 2023-12-15T23:14:14.353 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.353 DEBUG:boto:Data: 2023-12-15T23:14:14.354 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.354 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.354 DEBUG:boto:Params: {} 2023-12-15T23:14:14.354 DEBUG:boto:Token: None 2023-12-15T23:14:14.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000707e6ecfb741f21c-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.357 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.357 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.357 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.357 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.357 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.357 DEBUG:boto:Method: GET 2023-12-15T23:14:14.358 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.358 DEBUG:boto:Data: 2023-12-15T23:14:14.358 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.358 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.358 DEBUG:boto:Params: {} 2023-12-15T23:14:14.358 DEBUG:boto:Token: None 2023-12-15T23:14:14.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a78bc592f4a043d-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.362 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.362 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.363 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.363 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.363 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.363 DEBUG:boto:Data: 2023-12-15T23:14:14.363 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.363 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.363 DEBUG:boto:Params: {} 2023-12-15T23:14:14.363 DEBUG:boto:Token: None 2023-12-15T23:14:14.364 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.364 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z3qDNoFS+31W9S4FXcPLsQppNRE= 2023-12-15T23:14:14.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z3qDNoFS+31W9S4FXcPLsQppNRE=', 'Content-Length': '0'} 2023-12-15T23:14:14.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6463899ff46e8da-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.366 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.366 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.366 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.366 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.366 DEBUG:boto:Data: 2023-12-15T23:14:14.366 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.366 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.366 DEBUG:boto:Params: {} 2023-12-15T23:14:14.367 DEBUG:boto:Token: None 2023-12-15T23:14:14.367 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z3qDNoFS+31W9S4FXcPLsQppNRE= 2023-12-15T23:14:14.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z3qDNoFS+31W9S4FXcPLsQppNRE=', 'Content-Length': '0'} 2023-12-15T23:14:14.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c94c5855c148a82e-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2023-12-15T23:14:14.369 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.369 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.369 DEBUG:boto:Method: GET 2023-12-15T23:14:14.369 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.369 DEBUG:boto:Data: 2023-12-15T23:14:14.369 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.369 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.369 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.369 DEBUG:boto:Params: {} 2023-12-15T23:14:14.370 DEBUG:boto:Token: None 2023-12-15T23:14:14.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4n57k+Moh7fVNfAeweQ1I6D8MEg= 2023-12-15T23:14:14.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4n57k+Moh7fVNfAeweQ1I6D8MEg=', 'Content-Length': '0'} 2023-12-15T23:14:14.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031574010e901edd2-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.372 DEBUG:boto:path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.372 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.372 DEBUG:boto:Method: GET 2023-12-15T23:14:14.372 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.372 DEBUG:boto:Data: 2023-12-15T23:14:14.372 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.372 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.372 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.372 DEBUG:boto:Params: {} 2023-12-15T23:14:14.372 DEBUG:boto:Token: None 2023-12-15T23:14:14.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000003 2023-12-15T23:14:14.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4n57k+Moh7fVNfAeweQ1I6D8MEg= 2023-12-15T23:14:14.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4n57k+Moh7fVNfAeweQ1I6D8MEg=', 'Content-Length': '0'} 2023-12-15T23:14:14.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d011b103b2b55b6c-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.375 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.375 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.375 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.375 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.375 DEBUG:boto:Method: GET 2023-12-15T23:14:14.375 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.376 DEBUG:boto:Data: 2023-12-15T23:14:14.376 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.376 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.376 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.376 DEBUG:boto:Params: {} 2023-12-15T23:14:14.376 DEBUG:boto:Token: None 2023-12-15T23:14:14.376 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.376 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000284fc32b77ee59b8-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.378 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.379 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.379 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.379 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.379 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.379 DEBUG:boto:Method: GET 2023-12-15T23:14:14.379 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000003 2023-12-15T23:14:14.379 DEBUG:boto:Data: 2023-12-15T23:14:14.379 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.380 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.380 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.380 DEBUG:boto:Params: {} 2023-12-15T23:14:14.380 DEBUG:boto:Token: None 2023-12-15T23:14:14.380 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034501c309d95b079-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.384 DEBUG:boto:b'kskgfn-48obj000000000000000000031000falseobj000000000000000000032023-12-15T23:14:10.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:14:14.385 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.385 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.385 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.385 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.385 DEBUG:boto:Method: GET 2023-12-15T23:14:14.385 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.385 DEBUG:boto:Data: 2023-12-15T23:14:14.385 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.385 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.385 DEBUG:boto:Params: {} 2023-12-15T23:14:14.386 DEBUG:boto:Token: None 2023-12-15T23:14:14.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww= 2023-12-15T23:14:14.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww=', 'Content-Length': '0'} 2023-12-15T23:14:14.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071c7b2fb94522c26-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.429 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.429 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.430 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.430 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.430 DEBUG:boto:Method: GET 2023-12-15T23:14:14.430 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.430 DEBUG:boto:Data: 2023-12-15T23:14:14.430 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.430 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.430 DEBUG:boto:Params: {} 2023-12-15T23:14:14.430 DEBUG:boto:Token: None 2023-12-15T23:14:14.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww= 2023-12-15T23:14:14.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww=', 'Content-Length': '0'} 2023-12-15T23:14:14.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f16cabc865667b5-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.433 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.433 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.433 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.433 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.433 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.433 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.434 DEBUG:boto:Data: 2023-12-15T23:14:14.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.434 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.434 DEBUG:boto:Params: {} 2023-12-15T23:14:14.434 DEBUG:boto:Token: None 2023-12-15T23:14:14.434 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iPXEGfukZD2vCl5zUNawajuOang= 2023-12-15T23:14:14.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iPXEGfukZD2vCl5zUNawajuOang=', 'Content-Length': '0'} 2023-12-15T23:14:14.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2d9f8d3bd592ded-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.436 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.436 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.437 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.437 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.437 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.437 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.437 DEBUG:boto:Data: 2023-12-15T23:14:14.437 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.437 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.437 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.437 DEBUG:boto:Params: {} 2023-12-15T23:14:14.437 DEBUG:boto:Token: None 2023-12-15T23:14:14.438 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iPXEGfukZD2vCl5zUNawajuOang= 2023-12-15T23:14:14.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iPXEGfukZD2vCl5zUNawajuOang=', 'Content-Length': '0'} 2023-12-15T23:14:14.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ce833adad9366c9-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.440 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:14:14.440 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.440 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.440 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.440 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.441 DEBUG:boto:Method: GET 2023-12-15T23:14:14.441 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.441 DEBUG:boto:Data: 2023-12-15T23:14:14.441 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.441 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.441 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.441 DEBUG:boto:Params: {} 2023-12-15T23:14:14.441 DEBUG:boto:Token: None 2023-12-15T23:14:14.441 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww= 2023-12-15T23:14:14.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww=', 'Content-Length': '0'} 2023-12-15T23:14:14.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5ef765ce0cd39d0-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.444 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.444 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.444 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.444 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.444 DEBUG:boto:Method: GET 2023-12-15T23:14:14.444 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.444 DEBUG:boto:Data: 2023-12-15T23:14:14.444 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.444 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.444 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.445 DEBUG:boto:Params: {} 2023-12-15T23:14:14.445 DEBUG:boto:Token: None 2023-12-15T23:14:14.445 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004?versionId=null 2023-12-15T23:14:14.445 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww= 2023-12-15T23:14:14.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I5Py7n0OQeBEZovdFfbG91J1rww=', 'Content-Length': '0'} 2023-12-15T23:14:14.447 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aba1bbad5fccc5e4-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.447 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.448 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.448 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.448 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.448 DEBUG:boto:Method: GET 2023-12-15T23:14:14.448 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.448 DEBUG:boto:Data: 2023-12-15T23:14:14.448 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.448 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.448 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.448 DEBUG:boto:Params: {} 2023-12-15T23:14:14.449 DEBUG:boto:Token: None 2023-12-15T23:14:14.449 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.449 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d184da7d0c388688-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.451 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.451 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.452 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.452 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.452 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.452 DEBUG:boto:Method: GET 2023-12-15T23:14:14.452 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.452 DEBUG:boto:Data: 2023-12-15T23:14:14.452 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.452 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.452 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.452 DEBUG:boto:Params: {} 2023-12-15T23:14:14.452 DEBUG:boto:Token: None 2023-12-15T23:14:14.453 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.457 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea512d80c5c3ab20-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.457 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.457 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.457 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.457 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.457 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.458 DEBUG:boto:Data: 2023-12-15T23:14:14.458 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.458 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.458 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.458 DEBUG:boto:Params: {} 2023-12-15T23:14:14.458 DEBUG:boto:Token: None 2023-12-15T23:14:14.458 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cd3Ex+0jtErgC/b+lEggAqvpgi8= 2023-12-15T23:14:14.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cd3Ex+0jtErgC/b+lEggAqvpgi8=', 'Content-Length': '0'} 2023-12-15T23:14:14.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009666a3117f1f7d5f-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.460 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.460 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.460 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.461 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.461 DEBUG:boto:Data: 2023-12-15T23:14:14.461 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.461 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.461 DEBUG:boto:Params: {} 2023-12-15T23:14:14.461 DEBUG:boto:Token: None 2023-12-15T23:14:14.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cd3Ex+0jtErgC/b+lEggAqvpgi8= 2023-12-15T23:14:14.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cd3Ex+0jtErgC/b+lEggAqvpgi8=', 'Content-Length': '0'} 2023-12-15T23:14:14.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091b0770069ea08a0-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2023-12-15T23:14:14.464 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.464 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.464 DEBUG:boto:Method: GET 2023-12-15T23:14:14.464 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.464 DEBUG:boto:Data: 2023-12-15T23:14:14.464 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.464 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.464 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.464 DEBUG:boto:Params: {} 2023-12-15T23:14:14.464 DEBUG:boto:Token: None 2023-12-15T23:14:14.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jlKu3mZMIQkwzy/YDrzQCvwogMA= 2023-12-15T23:14:14.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jlKu3mZMIQkwzy/YDrzQCvwogMA=', 'Content-Length': '0'} 2023-12-15T23:14:14.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000097db43b9190d715-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.467 DEBUG:boto:path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.467 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.467 DEBUG:boto:Method: GET 2023-12-15T23:14:14.467 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.467 DEBUG:boto:Data: 2023-12-15T23:14:14.468 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.468 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.468 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.468 DEBUG:boto:Params: {} 2023-12-15T23:14:14.468 DEBUG:boto:Token: None 2023-12-15T23:14:14.468 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000004 2023-12-15T23:14:14.468 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jlKu3mZMIQkwzy/YDrzQCvwogMA= 2023-12-15T23:14:14.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jlKu3mZMIQkwzy/YDrzQCvwogMA=', 'Content-Length': '0'} 2023-12-15T23:14:14.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008dfaf7807736b70-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.513 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.514 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.514 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.514 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.514 DEBUG:boto:Method: GET 2023-12-15T23:14:14.514 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.514 DEBUG:boto:Data: 2023-12-15T23:14:14.514 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.514 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.514 DEBUG:boto:Params: {} 2023-12-15T23:14:14.514 DEBUG:boto:Token: None 2023-12-15T23:14:14.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3810f856e4398ff-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.517 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.517 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.518 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.518 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.518 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.518 DEBUG:boto:Method: GET 2023-12-15T23:14:14.518 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000004 2023-12-15T23:14:14.518 DEBUG:boto:Data: 2023-12-15T23:14:14.518 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.518 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.518 DEBUG:boto:Params: {} 2023-12-15T23:14:14.518 DEBUG:boto:Token: None 2023-12-15T23:14:14.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037fdd24891fa9f2f-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.522 DEBUG:boto:b'kskgfn-48obj000000000000000000041000falseobj000000000000000000042023-12-15T23:14:10.245Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:14:14.523 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.523 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.523 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.523 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.523 DEBUG:boto:Method: GET 2023-12-15T23:14:14.523 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.523 DEBUG:boto:Data: 2023-12-15T23:14:14.523 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.523 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.524 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.524 DEBUG:boto:Params: {} 2023-12-15T23:14:14.524 DEBUG:boto:Token: None 2023-12-15T23:14:14.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY= 2023-12-15T23:14:14.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY=', 'Content-Length': '0'} 2023-12-15T23:14:14.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a055a2d12b14b510-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.527 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.527 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.527 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.527 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.527 DEBUG:boto:Method: GET 2023-12-15T23:14:14.527 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.527 DEBUG:boto:Data: 2023-12-15T23:14:14.527 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.527 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.528 DEBUG:boto:Params: {} 2023-12-15T23:14:14.528 DEBUG:boto:Token: None 2023-12-15T23:14:14.528 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY= 2023-12-15T23:14:14.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY=', 'Content-Length': '0'} 2023-12-15T23:14:14.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af8987e01e4ba7fe-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.530 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.530 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.530 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.530 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.531 DEBUG:boto:Data: 2023-12-15T23:14:14.531 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.531 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.531 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.531 DEBUG:boto:Params: {} 2023-12-15T23:14:14.531 DEBUG:boto:Token: None 2023-12-15T23:14:14.531 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:97BVspOdY83xWQNimE0/32WDbjM= 2023-12-15T23:14:14.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:97BVspOdY83xWQNimE0/32WDbjM=', 'Content-Length': '0'} 2023-12-15T23:14:14.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ff1f0a46a1515a6-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.534 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.534 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.534 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.534 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.534 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.534 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.534 DEBUG:boto:Data: 2023-12-15T23:14:14.535 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.535 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.535 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.535 DEBUG:boto:Params: {} 2023-12-15T23:14:14.535 DEBUG:boto:Token: None 2023-12-15T23:14:14.535 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:97BVspOdY83xWQNimE0/32WDbjM= 2023-12-15T23:14:14.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:97BVspOdY83xWQNimE0/32WDbjM=', 'Content-Length': '0'} 2023-12-15T23:14:14.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b171086921fcec8c-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:14:14.537 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.538 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.538 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.538 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.538 DEBUG:boto:Method: GET 2023-12-15T23:14:14.538 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.538 DEBUG:boto:Data: 2023-12-15T23:14:14.538 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.538 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.538 DEBUG:boto:Params: {} 2023-12-15T23:14:14.538 DEBUG:boto:Token: None 2023-12-15T23:14:14.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY= 2023-12-15T23:14:14.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY=', 'Content-Length': '0'} 2023-12-15T23:14:14.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065148733b9201f4f-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.581 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.582 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.582 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.582 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.582 DEBUG:boto:Method: GET 2023-12-15T23:14:14.582 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.582 DEBUG:boto:Data: 2023-12-15T23:14:14.582 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.582 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.582 DEBUG:boto:Params: {} 2023-12-15T23:14:14.583 DEBUG:boto:Token: None 2023-12-15T23:14:14.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005?versionId=null 2023-12-15T23:14:14.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY= 2023-12-15T23:14:14.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I23d1FZNxKEl3SUDmeRafvG57wY=', 'Content-Length': '0'} 2023-12-15T23:14:14.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f41dc8abce6497c-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.585 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.585 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.585 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.585 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.585 DEBUG:boto:Method: GET 2023-12-15T23:14:14.586 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.586 DEBUG:boto:Data: 2023-12-15T23:14:14.586 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.586 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.586 DEBUG:boto:Params: {} 2023-12-15T23:14:14.586 DEBUG:boto:Token: None 2023-12-15T23:14:14.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3c40b11e85880d9-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.589 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.589 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.589 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.590 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.590 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.590 DEBUG:boto:Method: GET 2023-12-15T23:14:14.590 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.590 DEBUG:boto:Data: 2023-12-15T23:14:14.590 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.590 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.590 DEBUG:boto:Params: {} 2023-12-15T23:14:14.590 DEBUG:boto:Token: None 2023-12-15T23:14:14.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c94321a187c7750-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.594 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.595 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.595 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.595 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.595 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.595 DEBUG:boto:Data: 2023-12-15T23:14:14.595 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.595 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.595 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.595 DEBUG:boto:Params: {} 2023-12-15T23:14:14.595 DEBUG:boto:Token: None 2023-12-15T23:14:14.596 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XODrxJ4embh3a3ADOk+D0Uz0Crs= 2023-12-15T23:14:14.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XODrxJ4embh3a3ADOk+D0Uz0Crs=', 'Content-Length': '0'} 2023-12-15T23:14:14.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ed192318664ee40-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.598 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.598 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.598 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.598 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.598 DEBUG:boto:Data: 2023-12-15T23:14:14.598 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.599 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.599 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.599 DEBUG:boto:Params: {} 2023-12-15T23:14:14.599 DEBUG:boto:Token: None 2023-12-15T23:14:14.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XODrxJ4embh3a3ADOk+D0Uz0Crs= 2023-12-15T23:14:14.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XODrxJ4embh3a3ADOk+D0Uz0Crs=', 'Content-Length': '0'} 2023-12-15T23:14:14.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a763d52279054bc-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2023-12-15T23:14:14.601 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.601 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.601 DEBUG:boto:Method: GET 2023-12-15T23:14:14.602 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.602 DEBUG:boto:Data: 2023-12-15T23:14:14.602 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.602 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.602 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.602 DEBUG:boto:Params: {} 2023-12-15T23:14:14.602 DEBUG:boto:Token: None 2023-12-15T23:14:14.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2nJzRHrj6ryaKTvQMLcQ8DCGnCk= 2023-12-15T23:14:14.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2nJzRHrj6ryaKTvQMLcQ8DCGnCk=', 'Content-Length': '0'} 2023-12-15T23:14:14.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e96fd040b1e6f5b9-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.604 DEBUG:boto:path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.605 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.605 DEBUG:boto:Method: GET 2023-12-15T23:14:14.605 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.605 DEBUG:boto:Data: 2023-12-15T23:14:14.605 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.605 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.605 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.605 DEBUG:boto:Params: {} 2023-12-15T23:14:14.605 DEBUG:boto:Token: None 2023-12-15T23:14:14.605 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000005 2023-12-15T23:14:14.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2nJzRHrj6ryaKTvQMLcQ8DCGnCk= 2023-12-15T23:14:14.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2nJzRHrj6ryaKTvQMLcQ8DCGnCk=', 'Content-Length': '0'} 2023-12-15T23:14:14.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bc94d372ab52db3-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.608 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.608 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.608 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.608 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.608 DEBUG:boto:Method: GET 2023-12-15T23:14:14.608 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.608 DEBUG:boto:Data: 2023-12-15T23:14:14.608 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.609 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.609 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.609 DEBUG:boto:Params: {} 2023-12-15T23:14:14.609 DEBUG:boto:Token: None 2023-12-15T23:14:14.609 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.611 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4c232fc403d0b27-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.612 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.612 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.612 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.612 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.612 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.612 DEBUG:boto:Method: GET 2023-12-15T23:14:14.612 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000005 2023-12-15T23:14:14.613 DEBUG:boto:Data: 2023-12-15T23:14:14.613 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.613 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.613 DEBUG:boto:Params: {} 2023-12-15T23:14:14.613 DEBUG:boto:Token: None 2023-12-15T23:14:14.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090c8635de4c83339-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.617 DEBUG:boto:b'kskgfn-48obj000000000000000000051000falseobj000000000000000000052023-12-15T23:14:09.882Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.617 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2023-12-15T23:14:14.617 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.617 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.617 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.618 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.618 DEBUG:boto:Method: GET 2023-12-15T23:14:14.618 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.618 DEBUG:boto:Data: 2023-12-15T23:14:14.618 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.618 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.618 DEBUG:boto:Params: {} 2023-12-15T23:14:14.618 DEBUG:boto:Token: None 2023-12-15T23:14:14.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g= 2023-12-15T23:14:14.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g=', 'Content-Length': '0'} 2023-12-15T23:14:14.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000041d05788a308433-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.621 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.621 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.621 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.621 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.621 DEBUG:boto:Method: GET 2023-12-15T23:14:14.622 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.622 DEBUG:boto:Data: 2023-12-15T23:14:14.622 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.622 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.622 DEBUG:boto:Params: {} 2023-12-15T23:14:14.622 DEBUG:boto:Token: None 2023-12-15T23:14:14.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g= 2023-12-15T23:14:14.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g=', 'Content-Length': '0'} 2023-12-15T23:14:14.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006831f85fb08f710-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.625 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.625 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.625 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.625 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.625 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.625 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.626 DEBUG:boto:Data: 2023-12-15T23:14:14.626 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.626 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.626 DEBUG:boto:Params: {} 2023-12-15T23:14:14.626 DEBUG:boto:Token: None 2023-12-15T23:14:14.626 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YeowyKomIEo6Eg7WYeP3gIRND9Q= 2023-12-15T23:14:14.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YeowyKomIEo6Eg7WYeP3gIRND9Q=', 'Content-Length': '0'} 2023-12-15T23:14:14.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a59386325a74f11-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.629 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.629 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.629 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.629 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.629 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.629 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.629 DEBUG:boto:Data: 2023-12-15T23:14:14.629 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.629 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.630 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.630 DEBUG:boto:Params: {} 2023-12-15T23:14:14.630 DEBUG:boto:Token: None 2023-12-15T23:14:14.630 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YeowyKomIEo6Eg7WYeP3gIRND9Q= 2023-12-15T23:14:14.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YeowyKomIEo6Eg7WYeP3gIRND9Q=', 'Content-Length': '0'} 2023-12-15T23:14:14.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c04703c66b78bef2-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2023-12-15T23:14:14.633 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.633 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.633 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.633 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.633 DEBUG:boto:Method: GET 2023-12-15T23:14:14.633 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.633 DEBUG:boto:Data: 2023-12-15T23:14:14.633 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.633 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.633 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.634 DEBUG:boto:Params: {} 2023-12-15T23:14:14.634 DEBUG:boto:Token: None 2023-12-15T23:14:14.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.634 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g= 2023-12-15T23:14:14.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g=', 'Content-Length': '0'} 2023-12-15T23:14:14.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9e97d47389d9fa6-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.636 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.637 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.637 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.637 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.637 DEBUG:boto:Method: GET 2023-12-15T23:14:14.637 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.637 DEBUG:boto:Data: 2023-12-15T23:14:14.637 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.637 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.637 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.637 DEBUG:boto:Params: {} 2023-12-15T23:14:14.638 DEBUG:boto:Token: None 2023-12-15T23:14:14.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006?versionId=null 2023-12-15T23:14:14.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g= 2023-12-15T23:14:14.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JF/V35tHteMExoLorPk8G8R041g=', 'Content-Length': '0'} 2023-12-15T23:14:14.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085682901dd19f350-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.640 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.640 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.640 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.640 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.640 DEBUG:boto:Method: GET 2023-12-15T23:14:14.640 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.640 DEBUG:boto:Data: 2023-12-15T23:14:14.640 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.641 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.641 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.641 DEBUG:boto:Params: {} 2023-12-15T23:14:14.641 DEBUG:boto:Token: None 2023-12-15T23:14:14.641 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.641 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000309a5a4488cfda73-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.644 DEBUG:boto:b'kskgfn-48obj000000000000000000061000falseobj000000000000000000062023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.644 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.644 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.644 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.644 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.644 DEBUG:boto:Method: GET 2023-12-15T23:14:14.644 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.644 DEBUG:boto:Data: 2023-12-15T23:14:14.644 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.645 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.645 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.645 DEBUG:boto:Params: {} 2023-12-15T23:14:14.645 DEBUG:boto:Token: None 2023-12-15T23:14:14.645 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.645 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.648 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c4537b7f7869804-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.649 DEBUG:boto:b'kskgfn-48obj000000000000000000061000falseobj000000000000000000062023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.649 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.649 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.649 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.649 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.649 DEBUG:boto:Data: 2023-12-15T23:14:14.649 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.649 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.650 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.650 DEBUG:boto:Params: {} 2023-12-15T23:14:14.650 DEBUG:boto:Token: None 2023-12-15T23:14:14.650 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:87NjfwtX5Vw9PTnBgpNHB8i5d+8= 2023-12-15T23:14:14.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:87NjfwtX5Vw9PTnBgpNHB8i5d+8=', 'Content-Length': '0'} 2023-12-15T23:14:14.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034f771daeecab3ee-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.652 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.652 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.652 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.652 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.653 DEBUG:boto:Data: 2023-12-15T23:14:14.653 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.653 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.653 DEBUG:boto:Params: {} 2023-12-15T23:14:14.653 DEBUG:boto:Token: None 2023-12-15T23:14:14.653 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:87NjfwtX5Vw9PTnBgpNHB8i5d+8= 2023-12-15T23:14:14.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:87NjfwtX5Vw9PTnBgpNHB8i5d+8=', 'Content-Length': '0'} 2023-12-15T23:14:14.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dfa07b35c38ddd9-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2023-12-15T23:14:14.656 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.656 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.656 DEBUG:boto:Method: GET 2023-12-15T23:14:14.656 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.656 DEBUG:boto:Data: 2023-12-15T23:14:14.656 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.656 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.657 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.657 DEBUG:boto:Params: {} 2023-12-15T23:14:14.657 DEBUG:boto:Token: None 2023-12-15T23:14:14.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YrS2bIj85V7RJhtkmlxA9Myyf8E= 2023-12-15T23:14:14.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YrS2bIj85V7RJhtkmlxA9Myyf8E=', 'Content-Length': '0'} 2023-12-15T23:14:14.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009969db7603e93b03-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.659 DEBUG:boto:path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.659 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.660 DEBUG:boto:Method: GET 2023-12-15T23:14:14.660 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.660 DEBUG:boto:Data: 2023-12-15T23:14:14.660 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.660 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.660 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.660 DEBUG:boto:Params: {} 2023-12-15T23:14:14.660 DEBUG:boto:Token: None 2023-12-15T23:14:14.660 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000006 2023-12-15T23:14:14.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YrS2bIj85V7RJhtkmlxA9Myyf8E= 2023-12-15T23:14:14.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YrS2bIj85V7RJhtkmlxA9Myyf8E=', 'Content-Length': '0'} 2023-12-15T23:14:14.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039276d94b279a9fe-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.662 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.663 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.663 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.663 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.663 DEBUG:boto:Method: GET 2023-12-15T23:14:14.663 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.663 DEBUG:boto:Data: 2023-12-15T23:14:14.663 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.663 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.663 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.663 DEBUG:boto:Params: {} 2023-12-15T23:14:14.663 DEBUG:boto:Token: None 2023-12-15T23:14:14.664 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.664 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.666 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cbc5a2e1098f09a-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.666 DEBUG:boto:b'kskgfn-48obj000000000000000000061000falseobj000000000000000000062023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.666 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.666 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.666 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.667 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.667 DEBUG:boto:Method: GET 2023-12-15T23:14:14.667 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000006 2023-12-15T23:14:14.667 DEBUG:boto:Data: 2023-12-15T23:14:14.667 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.667 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.667 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.667 DEBUG:boto:Params: {} 2023-12-15T23:14:14.667 DEBUG:boto:Token: None 2023-12-15T23:14:14.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.668 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001814380cce87351b-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.671 DEBUG:boto:b'kskgfn-48obj000000000000000000061000falseobj000000000000000000062023-12-15T23:14:10.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2023-12-15T23:14:14.672 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.672 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.672 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.672 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.672 DEBUG:boto:Method: GET 2023-12-15T23:14:14.672 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.672 DEBUG:boto:Data: 2023-12-15T23:14:14.672 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.672 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.672 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.672 DEBUG:boto:Params: {} 2023-12-15T23:14:14.672 DEBUG:boto:Token: None 2023-12-15T23:14:14.673 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw= 2023-12-15T23:14:14.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw=', 'Content-Length': '0'} 2023-12-15T23:14:14.674 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6c02ee3cb8f549d-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.721 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.722 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.722 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.722 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.722 DEBUG:boto:Method: GET 2023-12-15T23:14:14.722 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.722 DEBUG:boto:Data: 2023-12-15T23:14:14.722 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.722 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.722 DEBUG:boto:Params: {} 2023-12-15T23:14:14.722 DEBUG:boto:Token: None 2023-12-15T23:14:14.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw= 2023-12-15T23:14:14.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw=', 'Content-Length': '0'} 2023-12-15T23:14:14.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e88315e44a36ad9-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.725 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.725 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.725 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.725 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.725 DEBUG:boto:Data: 2023-12-15T23:14:14.725 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.725 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.726 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.726 DEBUG:boto:Params: {} 2023-12-15T23:14:14.726 DEBUG:boto:Token: None 2023-12-15T23:14:14.726 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iBO4AAXj5nTe96lhh5ZHhn8Urss= 2023-12-15T23:14:14.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iBO4AAXj5nTe96lhh5ZHhn8Urss=', 'Content-Length': '0'} 2023-12-15T23:14:14.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f92e7a06cfec9fd-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.728 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.728 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.728 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.728 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.728 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.728 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.728 DEBUG:boto:Data: 2023-12-15T23:14:14.728 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.729 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.729 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.729 DEBUG:boto:Params: {} 2023-12-15T23:14:14.729 DEBUG:boto:Token: None 2023-12-15T23:14:14.729 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.729 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iBO4AAXj5nTe96lhh5ZHhn8Urss= 2023-12-15T23:14:14.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iBO4AAXj5nTe96lhh5ZHhn8Urss=', 'Content-Length': '0'} 2023-12-15T23:14:14.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c38c7a40e92db136-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2023-12-15T23:14:14.731 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.731 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.731 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.731 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.731 DEBUG:boto:Method: GET 2023-12-15T23:14:14.731 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.732 DEBUG:boto:Data: 2023-12-15T23:14:14.732 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.732 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.732 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.732 DEBUG:boto:Params: {} 2023-12-15T23:14:14.732 DEBUG:boto:Token: None 2023-12-15T23:14:14.732 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.732 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw= 2023-12-15T23:14:14.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw=', 'Content-Length': '0'} 2023-12-15T23:14:14.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000336b59044b95c0d7-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.734 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.734 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.734 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.735 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.735 DEBUG:boto:Method: GET 2023-12-15T23:14:14.735 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.735 DEBUG:boto:Data: 2023-12-15T23:14:14.735 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.735 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.735 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.735 DEBUG:boto:Params: {} 2023-12-15T23:14:14.735 DEBUG:boto:Token: None 2023-12-15T23:14:14.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007?versionId=null 2023-12-15T23:14:14.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw= 2023-12-15T23:14:14.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLYImpFrZxHIiZqjryuaj53/jRw=', 'Content-Length': '0'} 2023-12-15T23:14:14.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d704f90c32e4d028-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.738 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.738 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.738 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.738 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.738 DEBUG:boto:Method: GET 2023-12-15T23:14:14.738 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.738 DEBUG:boto:Data: 2023-12-15T23:14:14.738 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.739 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.739 DEBUG:boto:Params: {} 2023-12-15T23:14:14.739 DEBUG:boto:Token: None 2023-12-15T23:14:14.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae94010633511dfe-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.741 DEBUG:boto:b'kskgfn-48obj000000000000000000071000falseobj000000000000000000072023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.742 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.742 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.742 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.742 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.742 DEBUG:boto:Method: GET 2023-12-15T23:14:14.742 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.742 DEBUG:boto:Data: 2023-12-15T23:14:14.742 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.742 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.742 DEBUG:boto:Params: {} 2023-12-15T23:14:14.743 DEBUG:boto:Token: None 2023-12-15T23:14:14.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7fe58ecd709c56d-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.793 DEBUG:boto:b'kskgfn-48obj000000000000000000071000falseobj000000000000000000072023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.794 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.794 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.794 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.794 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.794 DEBUG:boto:Data: 2023-12-15T23:14:14.795 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.795 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.795 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.795 DEBUG:boto:Params: {} 2023-12-15T23:14:14.795 DEBUG:boto:Token: None 2023-12-15T23:14:14.795 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j4/35dYTraHisMeGLi7E9IuMwl8= 2023-12-15T23:14:14.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j4/35dYTraHisMeGLi7E9IuMwl8=', 'Content-Length': '0'} 2023-12-15T23:14:14.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5844b6b8ad8868a-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.798 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.798 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.798 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.798 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.798 DEBUG:boto:Data: 2023-12-15T23:14:14.798 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.799 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.799 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.799 DEBUG:boto:Params: {} 2023-12-15T23:14:14.799 DEBUG:boto:Token: None 2023-12-15T23:14:14.799 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j4/35dYTraHisMeGLi7E9IuMwl8= 2023-12-15T23:14:14.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j4/35dYTraHisMeGLi7E9IuMwl8=', 'Content-Length': '0'} 2023-12-15T23:14:14.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0e207a82b44e75e-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2023-12-15T23:14:14.801 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.802 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.802 DEBUG:boto:Method: GET 2023-12-15T23:14:14.802 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.802 DEBUG:boto:Data: 2023-12-15T23:14:14.802 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.802 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.802 DEBUG:boto:Params: {} 2023-12-15T23:14:14.802 DEBUG:boto:Token: None 2023-12-15T23:14:14.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VmuYXdXG7dBgjmCUGh4R1HnaOwA= 2023-12-15T23:14:14.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VmuYXdXG7dBgjmCUGh4R1HnaOwA=', 'Content-Length': '0'} 2023-12-15T23:14:14.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005acddae7968762cd-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.845 DEBUG:boto:path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.846 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.846 DEBUG:boto:Method: GET 2023-12-15T23:14:14.846 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.846 DEBUG:boto:Data: 2023-12-15T23:14:14.846 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.846 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.846 DEBUG:boto:Params: {} 2023-12-15T23:14:14.846 DEBUG:boto:Token: None 2023-12-15T23:14:14.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000007 2023-12-15T23:14:14.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VmuYXdXG7dBgjmCUGh4R1HnaOwA= 2023-12-15T23:14:14.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VmuYXdXG7dBgjmCUGh4R1HnaOwA=', 'Content-Length': '0'} 2023-12-15T23:14:14.848 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ff9114811d93608-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.849 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.849 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.849 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.849 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.849 DEBUG:boto:Method: GET 2023-12-15T23:14:14.849 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.849 DEBUG:boto:Data: 2023-12-15T23:14:14.849 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.850 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.850 DEBUG:boto:Params: {} 2023-12-15T23:14:14.850 DEBUG:boto:Token: None 2023-12-15T23:14:14.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007136c461c054a6b3-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.853 DEBUG:boto:b'kskgfn-48obj000000000000000000071000falseobj000000000000000000072023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.853 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.853 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.853 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.853 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.853 DEBUG:boto:Method: GET 2023-12-15T23:14:14.853 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000007 2023-12-15T23:14:14.853 DEBUG:boto:Data: 2023-12-15T23:14:14.854 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.854 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.854 DEBUG:boto:Params: {} 2023-12-15T23:14:14.854 DEBUG:boto:Token: None 2023-12-15T23:14:14.854 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004076414fa59bd832-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.858 DEBUG:boto:b'kskgfn-48obj000000000000000000071000falseobj000000000000000000072023-12-15T23:14:10.185Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.858 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2023-12-15T23:14:14.859 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.859 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.859 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.859 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.859 DEBUG:boto:Method: GET 2023-12-15T23:14:14.859 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.859 DEBUG:boto:Data: 2023-12-15T23:14:14.859 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.859 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.859 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.859 DEBUG:boto:Params: {} 2023-12-15T23:14:14.860 DEBUG:boto:Token: None 2023-12-15T23:14:14.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4= 2023-12-15T23:14:14.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4=', 'Content-Length': '0'} 2023-12-15T23:14:14.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011fe36d04988dde0-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.862 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.862 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.862 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.862 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.862 DEBUG:boto:Method: GET 2023-12-15T23:14:14.862 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.862 DEBUG:boto:Data: 2023-12-15T23:14:14.863 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.863 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.863 DEBUG:boto:Params: {} 2023-12-15T23:14:14.863 DEBUG:boto:Token: None 2023-12-15T23:14:14.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4= 2023-12-15T23:14:14.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4=', 'Content-Length': '0'} 2023-12-15T23:14:14.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a02f9a88a9dc089-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.865 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.865 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.865 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.865 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.866 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.866 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.866 DEBUG:boto:Data: 2023-12-15T23:14:14.866 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.866 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.866 DEBUG:boto:Params: {} 2023-12-15T23:14:14.866 DEBUG:boto:Token: None 2023-12-15T23:14:14.866 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zgCUb61x0uuVTt29hog3jFJE3V0= 2023-12-15T23:14:14.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zgCUb61x0uuVTt29hog3jFJE3V0=', 'Content-Length': '0'} 2023-12-15T23:14:14.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006079a6bea37f59c4-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.868 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.869 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.869 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.869 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.869 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.869 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.869 DEBUG:boto:Data: 2023-12-15T23:14:14.870 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.870 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.870 DEBUG:boto:Params: {} 2023-12-15T23:14:14.870 DEBUG:boto:Token: None 2023-12-15T23:14:14.870 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zgCUb61x0uuVTt29hog3jFJE3V0= 2023-12-15T23:14:14.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zgCUb61x0uuVTt29hog3jFJE3V0=', 'Content-Length': '0'} 2023-12-15T23:14:14.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090bad9d8f37f63b9-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2023-12-15T23:14:14.873 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.873 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.873 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.873 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.873 DEBUG:boto:Method: GET 2023-12-15T23:14:14.873 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.873 DEBUG:boto:Data: 2023-12-15T23:14:14.873 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.873 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.873 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.873 DEBUG:boto:Params: {} 2023-12-15T23:14:14.874 DEBUG:boto:Token: None 2023-12-15T23:14:14.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4= 2023-12-15T23:14:14.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4=', 'Content-Length': '0'} 2023-12-15T23:14:14.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eda7f953a74d033-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.876 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.876 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.876 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.876 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.876 DEBUG:boto:Method: GET 2023-12-15T23:14:14.876 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.877 DEBUG:boto:Data: 2023-12-15T23:14:14.877 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.877 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.877 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.877 DEBUG:boto:Params: {} 2023-12-15T23:14:14.877 DEBUG:boto:Token: None 2023-12-15T23:14:14.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008?versionId=null 2023-12-15T23:14:14.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4= 2023-12-15T23:14:14.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lCCcQp8tQ3uf5VpKjAzAI3+tec4=', 'Content-Length': '0'} 2023-12-15T23:14:14.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb758406b28b4108-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.880 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.880 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.880 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.880 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.880 DEBUG:boto:Method: GET 2023-12-15T23:14:14.880 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.880 DEBUG:boto:Data: 2023-12-15T23:14:14.881 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.881 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.881 DEBUG:boto:Params: {} 2023-12-15T23:14:14.881 DEBUG:boto:Token: None 2023-12-15T23:14:14.881 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.881 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.883 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e926825b99da423c-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.884 DEBUG:boto:b'kskgfn-48obj000000000000000000081000falseobj000000000000000000082023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.884 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.884 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.884 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.884 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.885 DEBUG:boto:Method: GET 2023-12-15T23:14:14.885 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.885 DEBUG:boto:Data: 2023-12-15T23:14:14.885 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.885 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.885 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.885 DEBUG:boto:Params: {} 2023-12-15T23:14:14.886 DEBUG:boto:Token: None 2023-12-15T23:14:14.886 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000751f2bea4e7d71aa-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.890 DEBUG:boto:b'kskgfn-48obj000000000000000000081000falseobj000000000000000000082023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.891 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.891 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.891 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.891 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.891 DEBUG:boto:Data: 2023-12-15T23:14:14.891 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.891 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.891 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.891 DEBUG:boto:Params: {} 2023-12-15T23:14:14.891 DEBUG:boto:Token: None 2023-12-15T23:14:14.892 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.892 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qxNrVok8V2cJc6KB/Q9tC2PpGeo= 2023-12-15T23:14:14.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qxNrVok8V2cJc6KB/Q9tC2PpGeo=', 'Content-Length': '0'} 2023-12-15T23:14:14.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1a12e91136f106d-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.893 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.894 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.894 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.894 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.894 DEBUG:boto:Data: 2023-12-15T23:14:14.894 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.894 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.894 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.894 DEBUG:boto:Params: {} 2023-12-15T23:14:14.894 DEBUG:boto:Token: None 2023-12-15T23:14:14.895 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qxNrVok8V2cJc6KB/Q9tC2PpGeo= 2023-12-15T23:14:14.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qxNrVok8V2cJc6KB/Q9tC2PpGeo=', 'Content-Length': '0'} 2023-12-15T23:14:14.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000576353ce169a03c7-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2023-12-15T23:14:14.897 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.897 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.897 DEBUG:boto:Method: GET 2023-12-15T23:14:14.897 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.897 DEBUG:boto:Data: 2023-12-15T23:14:14.897 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.897 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.898 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.898 DEBUG:boto:Params: {} 2023-12-15T23:14:14.898 DEBUG:boto:Token: None 2023-12-15T23:14:14.898 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.898 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IUd1ol4eO0bxnMbS1+cBEaQxfco= 2023-12-15T23:14:14.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IUd1ol4eO0bxnMbS1+cBEaQxfco=', 'Content-Length': '0'} 2023-12-15T23:14:14.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000228719da1d48adba-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.900 DEBUG:boto:path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.900 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.900 DEBUG:boto:Method: GET 2023-12-15T23:14:14.900 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.900 DEBUG:boto:Data: 2023-12-15T23:14:14.900 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.901 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.901 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.901 DEBUG:boto:Params: {} 2023-12-15T23:14:14.901 DEBUG:boto:Token: None 2023-12-15T23:14:14.901 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000008 2023-12-15T23:14:14.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IUd1ol4eO0bxnMbS1+cBEaQxfco= 2023-12-15T23:14:14.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IUd1ol4eO0bxnMbS1+cBEaQxfco=', 'Content-Length': '0'} 2023-12-15T23:14:14.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031724edbc966159c-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.945 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.946 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.946 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.946 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.946 DEBUG:boto:Method: GET 2023-12-15T23:14:14.946 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.946 DEBUG:boto:Data: 2023-12-15T23:14:14.946 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.946 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.946 DEBUG:boto:Params: {} 2023-12-15T23:14:14.946 DEBUG:boto:Token: None 2023-12-15T23:14:14.947 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000442a64d465daedcb-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.949 DEBUG:boto:b'kskgfn-48obj000000000000000000081000falseobj000000000000000000082023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.949 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:14.950 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:14.950 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.950 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.950 DEBUG:boto:Method: GET 2023-12-15T23:14:14.950 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000008 2023-12-15T23:14:14.950 DEBUG:boto:Data: 2023-12-15T23:14:14.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.950 DEBUG:boto:Params: {} 2023-12-15T23:14:14.951 DEBUG:boto:Token: None 2023-12-15T23:14:14.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/ 2023-12-15T23:14:14.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8= 2023-12-15T23:14:14.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q/tQM9Ym0D8nybikMliGONdqzW8=', 'Content-Length': '0'} 2023-12-15T23:14:14.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006412c328874bd219-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.954 DEBUG:boto:b'kskgfn-48obj000000000000000000081000falseobj000000000000000000082023-12-15T23:14:10.441Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:14.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2023-12-15T23:14:14.955 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.955 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.955 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.955 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.955 DEBUG:boto:Method: GET 2023-12-15T23:14:14.955 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.955 DEBUG:boto:Data: 2023-12-15T23:14:14.956 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.956 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.956 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.956 DEBUG:boto:Params: {} 2023-12-15T23:14:14.956 DEBUG:boto:Token: None 2023-12-15T23:14:14.956 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po= 2023-12-15T23:14:14.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po=', 'Content-Length': '0'} 2023-12-15T23:14:14.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d08cbf2c4e866ec5-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.958 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.958 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.958 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.959 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.959 DEBUG:boto:Method: GET 2023-12-15T23:14:14.959 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.959 DEBUG:boto:Data: 2023-12-15T23:14:14.959 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.959 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.959 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.959 DEBUG:boto:Params: {} 2023-12-15T23:14:14.959 DEBUG:boto:Token: None 2023-12-15T23:14:14.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po= 2023-12-15T23:14:14.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po=', 'Content-Length': '0'} 2023-12-15T23:14:14.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0b42903a5145e22-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.961 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.962 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.962 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.962 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.962 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.962 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.962 DEBUG:boto:Data: 2023-12-15T23:14:14.962 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.962 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.962 DEBUG:boto:Params: {} 2023-12-15T23:14:14.962 DEBUG:boto:Token: None 2023-12-15T23:14:14.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rE6rtqoeD+1a8dLyOfCrH9vb55U= 2023-12-15T23:14:14.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rE6rtqoeD+1a8dLyOfCrH9vb55U=', 'Content-Length': '0'} 2023-12-15T23:14:14.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004921b7f7e4e4674c-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.964 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.965 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.965 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.965 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.965 DEBUG:boto:Method: HEAD 2023-12-15T23:14:14.965 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.965 DEBUG:boto:Data: 2023-12-15T23:14:14.965 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.965 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:14.965 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.965 DEBUG:boto:Params: {} 2023-12-15T23:14:14.966 DEBUG:boto:Token: None 2023-12-15T23:14:14.966 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rE6rtqoeD+1a8dLyOfCrH9vb55U= 2023-12-15T23:14:14.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rE6rtqoeD+1a8dLyOfCrH9vb55U=', 'Content-Length': '0'} 2023-12-15T23:14:14.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005ff8a37ff98e3fd-00657cddc6-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:14.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2023-12-15T23:14:14.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.968 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:14.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.968 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.968 DEBUG:boto:Method: GET 2023-12-15T23:14:14.968 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.968 DEBUG:boto:Data: 2023-12-15T23:14:14.968 DEBUG:boto:Headers: {} 2023-12-15T23:14:14.968 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:14.969 DEBUG:boto:Port: 8000 2023-12-15T23:14:14.969 DEBUG:boto:Params: {} 2023-12-15T23:14:14.969 DEBUG:boto:Token: None 2023-12-15T23:14:14.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:14 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:14.969 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po= 2023-12-15T23:14:14.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mr7abA/3oaohfStdZeuU3mYD3po=', 'Content-Length': '0'} 2023-12-15T23:14:14.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3860144d76626d0-00657cddc6-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.014 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.014 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:15.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:15.014 DEBUG:boto:Method: GET 2023-12-15T23:14:15.014 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:15.014 DEBUG:boto:Data: 2023-12-15T23:14:15.014 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.014 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.015 DEBUG:boto:Params: {} 2023-12-15T23:14:15.015 DEBUG:boto:Token: None 2023-12-15T23:14:15.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000009?versionId=null 2023-12-15T23:14:15.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fh12xcmukwz/2iknfcj2NLFeGSc= 2023-12-15T23:14:15.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fh12xcmukwz/2iknfcj2NLFeGSc=', 'Content-Length': '0'} 2023-12-15T23:14:15.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e54182954ac5bb5c-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.017 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.017 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.017 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.017 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.018 DEBUG:boto:Method: GET 2023-12-15T23:14:15.018 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.018 DEBUG:boto:Data: 2023-12-15T23:14:15.018 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.018 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.018 DEBUG:boto:Params: {} 2023-12-15T23:14:15.018 DEBUG:boto:Token: None 2023-12-15T23:14:15.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000281fec2d6f163a1b-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.021 DEBUG:boto:b'kskgfn-48obj000000000000000000091000falseobj000000000000000000092023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.021 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.021 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.022 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.022 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.022 DEBUG:boto:Method: GET 2023-12-15T23:14:15.022 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.022 DEBUG:boto:Data: 2023-12-15T23:14:15.022 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.022 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.023 DEBUG:boto:Params: {} 2023-12-15T23:14:15.023 DEBUG:boto:Token: None 2023-12-15T23:14:15.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.027 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058c5a000ca0224f1-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.027 DEBUG:boto:b'kskgfn-48obj000000000000000000091000falseobj000000000000000000092023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.027 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.027 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.027 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.028 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.028 DEBUG:boto:Data: 2023-12-15T23:14:15.028 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.028 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.028 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.028 DEBUG:boto:Params: {} 2023-12-15T23:14:15.028 DEBUG:boto:Token: None 2023-12-15T23:14:15.028 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.028 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zLJbpiZ58ltDgc+N0hT9hxwgfes= 2023-12-15T23:14:15.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zLJbpiZ58ltDgc+N0hT9hxwgfes=', 'Content-Length': '0'} 2023-12-15T23:14:15.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000230e8b9213a0b575-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.030 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.030 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.030 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.031 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.031 DEBUG:boto:Data: 2023-12-15T23:14:15.031 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.031 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.031 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.031 DEBUG:boto:Params: {} 2023-12-15T23:14:15.031 DEBUG:boto:Token: None 2023-12-15T23:14:15.031 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zLJbpiZ58ltDgc+N0hT9hxwgfes= 2023-12-15T23:14:15.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zLJbpiZ58ltDgc+N0hT9hxwgfes=', 'Content-Length': '0'} 2023-12-15T23:14:15.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1dbca0841ee381e-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2023-12-15T23:14:15.034 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.034 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.034 DEBUG:boto:Method: GET 2023-12-15T23:14:15.034 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.034 DEBUG:boto:Data: 2023-12-15T23:14:15.034 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.034 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.034 DEBUG:boto:Params: {} 2023-12-15T23:14:15.034 DEBUG:boto:Token: None 2023-12-15T23:14:15.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R0tnM4JMLf8Wyb/5TPlTbfT1Xh0= 2023-12-15T23:14:15.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R0tnM4JMLf8Wyb/5TPlTbfT1Xh0=', 'Content-Length': '0'} 2023-12-15T23:14:15.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfd0694eb82501d7-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.037 DEBUG:boto:path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.037 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.037 DEBUG:boto:Method: GET 2023-12-15T23:14:15.037 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.037 DEBUG:boto:Data: 2023-12-15T23:14:15.037 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.037 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.038 DEBUG:boto:Params: {} 2023-12-15T23:14:15.038 DEBUG:boto:Token: None 2023-12-15T23:14:15.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000009 2023-12-15T23:14:15.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R0tnM4JMLf8Wyb/5TPlTbfT1Xh0= 2023-12-15T23:14:15.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R0tnM4JMLf8Wyb/5TPlTbfT1Xh0=', 'Content-Length': '0'} 2023-12-15T23:14:15.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dfb22940d4b115d-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.085 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.086 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.086 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.086 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.086 DEBUG:boto:Method: GET 2023-12-15T23:14:15.086 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.086 DEBUG:boto:Data: 2023-12-15T23:14:15.086 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.086 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.086 DEBUG:boto:Params: {} 2023-12-15T23:14:15.087 DEBUG:boto:Token: None 2023-12-15T23:14:15.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037d557dd4fa27b18-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.089 DEBUG:boto:b'kskgfn-48obj000000000000000000091000falseobj000000000000000000092023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.089 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.090 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.090 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.090 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.090 DEBUG:boto:Method: GET 2023-12-15T23:14:15.090 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000009 2023-12-15T23:14:15.090 DEBUG:boto:Data: 2023-12-15T23:14:15.090 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.090 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.091 DEBUG:boto:Params: {} 2023-12-15T23:14:15.091 DEBUG:boto:Token: None 2023-12-15T23:14:15.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067ad3ff09fce3f9b-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.095 DEBUG:boto:b'kskgfn-48obj000000000000000000091000falseobj000000000000000000092023-12-15T23:14:10.132Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:14:15.095 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.095 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.095 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.095 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.095 DEBUG:boto:Method: GET 2023-12-15T23:14:15.096 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.096 DEBUG:boto:Data: 2023-12-15T23:14:15.096 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.096 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.096 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.096 DEBUG:boto:Params: {} 2023-12-15T23:14:15.096 DEBUG:boto:Token: None 2023-12-15T23:14:15.096 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs= 2023-12-15T23:14:15.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs=', 'Content-Length': '0'} 2023-12-15T23:14:15.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5efc3734856684a-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.099 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.099 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.099 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.099 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.099 DEBUG:boto:Method: GET 2023-12-15T23:14:15.099 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.099 DEBUG:boto:Data: 2023-12-15T23:14:15.099 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.099 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.100 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.100 DEBUG:boto:Params: {} 2023-12-15T23:14:15.100 DEBUG:boto:Token: None 2023-12-15T23:14:15.100 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.100 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs= 2023-12-15T23:14:15.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs=', 'Content-Length': '0'} 2023-12-15T23:14:15.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f337b5bb501d4650-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.102 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.102 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.102 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.103 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.103 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.103 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.103 DEBUG:boto:Data: 2023-12-15T23:14:15.103 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.103 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.103 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.103 DEBUG:boto:Params: {} 2023-12-15T23:14:15.103 DEBUG:boto:Token: None 2023-12-15T23:14:15.104 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.104 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RVl4n4QMSa8VcdctWdsKaPbARKA= 2023-12-15T23:14:15.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RVl4n4QMSa8VcdctWdsKaPbARKA=', 'Content-Length': '0'} 2023-12-15T23:14:15.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009794c30170cc89f5-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.106 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.106 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.106 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.106 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.106 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.106 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.106 DEBUG:boto:Data: 2023-12-15T23:14:15.106 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.106 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.107 DEBUG:boto:Params: {} 2023-12-15T23:14:15.107 DEBUG:boto:Token: None 2023-12-15T23:14:15.107 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RVl4n4QMSa8VcdctWdsKaPbARKA= 2023-12-15T23:14:15.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RVl4n4QMSa8VcdctWdsKaPbARKA=', 'Content-Length': '0'} 2023-12-15T23:14:15.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014cc2065f795e677-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:14:15.110 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.110 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.110 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.110 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.110 DEBUG:boto:Method: GET 2023-12-15T23:14:15.110 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.110 DEBUG:boto:Data: 2023-12-15T23:14:15.111 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.111 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.111 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.111 DEBUG:boto:Params: {} 2023-12-15T23:14:15.111 DEBUG:boto:Token: None 2023-12-15T23:14:15.111 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs= 2023-12-15T23:14:15.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs=', 'Content-Length': '0'} 2023-12-15T23:14:15.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e524e8799fa51ccc-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.153 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.154 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.154 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.154 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.154 DEBUG:boto:Method: GET 2023-12-15T23:14:15.154 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.154 DEBUG:boto:Data: 2023-12-15T23:14:15.154 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.154 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.155 DEBUG:boto:Params: {} 2023-12-15T23:14:15.155 DEBUG:boto:Token: None 2023-12-15T23:14:15.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010?versionId=null 2023-12-15T23:14:15.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs= 2023-12-15T23:14:15.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whSwzf47YH4o+jcj2XOThLeVIfs=', 'Content-Length': '0'} 2023-12-15T23:14:15.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c96fefea8223b865-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.157 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.158 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.158 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.158 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.158 DEBUG:boto:Method: GET 2023-12-15T23:14:15.158 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.158 DEBUG:boto:Data: 2023-12-15T23:14:15.158 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.158 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.158 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.159 DEBUG:boto:Params: {} 2023-12-15T23:14:15.159 DEBUG:boto:Token: None 2023-12-15T23:14:15.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002df1631acd7e293a-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.162 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.162 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.162 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.162 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.162 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.162 DEBUG:boto:Method: GET 2023-12-15T23:14:15.163 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.163 DEBUG:boto:Data: 2023-12-15T23:14:15.163 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.163 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.163 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.163 DEBUG:boto:Params: {} 2023-12-15T23:14:15.163 DEBUG:boto:Token: None 2023-12-15T23:14:15.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.164 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.167 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005699c0aeb60c9f03-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.168 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.168 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.168 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.168 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.168 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.168 DEBUG:boto:Data: 2023-12-15T23:14:15.168 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.169 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.169 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.169 DEBUG:boto:Params: {} 2023-12-15T23:14:15.169 DEBUG:boto:Token: None 2023-12-15T23:14:15.169 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.169 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zojpQK9eE8gvpaIxWx4oDxRbIa0= 2023-12-15T23:14:15.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zojpQK9eE8gvpaIxWx4oDxRbIa0=', 'Content-Length': '0'} 2023-12-15T23:14:15.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac76918e86c4bcc8-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.171 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.172 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.172 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.172 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.172 DEBUG:boto:Data: 2023-12-15T23:14:15.172 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.172 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.172 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.172 DEBUG:boto:Params: {} 2023-12-15T23:14:15.172 DEBUG:boto:Token: None 2023-12-15T23:14:15.173 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.173 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zojpQK9eE8gvpaIxWx4oDxRbIa0= 2023-12-15T23:14:15.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zojpQK9eE8gvpaIxWx4oDxRbIa0=', 'Content-Length': '0'} 2023-12-15T23:14:15.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae5091369d9b9d3e-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.175 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2023-12-15T23:14:15.175 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.175 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.175 DEBUG:boto:Method: GET 2023-12-15T23:14:15.175 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.176 DEBUG:boto:Data: 2023-12-15T23:14:15.176 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.176 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.176 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.176 DEBUG:boto:Params: {} 2023-12-15T23:14:15.176 DEBUG:boto:Token: None 2023-12-15T23:14:15.176 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.176 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yBMC1jbvx53l3547Ca+OIM48eMQ= 2023-12-15T23:14:15.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yBMC1jbvx53l3547Ca+OIM48eMQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2c42a5d0e65a108-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.178 DEBUG:boto:path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.178 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.179 DEBUG:boto:Method: GET 2023-12-15T23:14:15.179 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.179 DEBUG:boto:Data: 2023-12-15T23:14:15.179 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.179 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.179 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.179 DEBUG:boto:Params: {} 2023-12-15T23:14:15.179 DEBUG:boto:Token: None 2023-12-15T23:14:15.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000010 2023-12-15T23:14:15.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yBMC1jbvx53l3547Ca+OIM48eMQ= 2023-12-15T23:14:15.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yBMC1jbvx53l3547Ca+OIM48eMQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000914a8879a3640031-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.182 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.182 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.182 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.182 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.182 DEBUG:boto:Method: GET 2023-12-15T23:14:15.182 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.183 DEBUG:boto:Data: 2023-12-15T23:14:15.183 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.183 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.183 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.183 DEBUG:boto:Params: {} 2023-12-15T23:14:15.183 DEBUG:boto:Token: None 2023-12-15T23:14:15.183 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005903e310b852b7d1-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.229 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.230 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.230 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.230 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.230 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.230 DEBUG:boto:Method: GET 2023-12-15T23:14:15.231 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000010 2023-12-15T23:14:15.231 DEBUG:boto:Data: 2023-12-15T23:14:15.231 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.231 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.231 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.231 DEBUG:boto:Params: {} 2023-12-15T23:14:15.231 DEBUG:boto:Token: None 2023-12-15T23:14:15.231 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.235 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047ca7db85edecf6b-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.235 DEBUG:boto:b'kskgfn-48obj000000000000000000101000falseobj000000000000000000102023-12-15T23:14:09.249Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:14:15.236 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.236 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.236 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.236 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.236 DEBUG:boto:Method: GET 2023-12-15T23:14:15.236 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.236 DEBUG:boto:Data: 2023-12-15T23:14:15.237 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.237 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.237 DEBUG:boto:Params: {} 2023-12-15T23:14:15.237 DEBUG:boto:Token: None 2023-12-15T23:14:15.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.237 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4= 2023-12-15T23:14:15.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4=', 'Content-Length': '0'} 2023-12-15T23:14:15.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a83f652d13320d8-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.240 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.240 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.240 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.240 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.240 DEBUG:boto:Method: GET 2023-12-15T23:14:15.240 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.240 DEBUG:boto:Data: 2023-12-15T23:14:15.241 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.241 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.241 DEBUG:boto:Params: {} 2023-12-15T23:14:15.241 DEBUG:boto:Token: None 2023-12-15T23:14:15.241 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.241 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4= 2023-12-15T23:14:15.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4=', 'Content-Length': '0'} 2023-12-15T23:14:15.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a1a377bf5f8da44-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.244 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.244 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.244 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.244 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.244 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.244 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.244 DEBUG:boto:Data: 2023-12-15T23:14:15.245 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.245 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.245 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.245 DEBUG:boto:Params: {} 2023-12-15T23:14:15.245 DEBUG:boto:Token: None 2023-12-15T23:14:15.245 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.245 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gNw821VEwt4DdLvK4ZBc4Nmq9oQ= 2023-12-15T23:14:15.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gNw821VEwt4DdLvK4ZBc4Nmq9oQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091cde29b807b748c-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.247 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.247 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.247 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.248 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.248 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.248 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.248 DEBUG:boto:Data: 2023-12-15T23:14:15.248 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.248 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.248 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.248 DEBUG:boto:Params: {} 2023-12-15T23:14:15.248 DEBUG:boto:Token: None 2023-12-15T23:14:15.249 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.249 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gNw821VEwt4DdLvK4ZBc4Nmq9oQ= 2023-12-15T23:14:15.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gNw821VEwt4DdLvK4ZBc4Nmq9oQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004da3577086f72e40-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:14:15.251 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.251 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.251 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.251 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.251 DEBUG:boto:Method: GET 2023-12-15T23:14:15.251 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.251 DEBUG:boto:Data: 2023-12-15T23:14:15.252 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.252 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.252 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.252 DEBUG:boto:Params: {} 2023-12-15T23:14:15.252 DEBUG:boto:Token: None 2023-12-15T23:14:15.252 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.252 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4= 2023-12-15T23:14:15.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4=', 'Content-Length': '0'} 2023-12-15T23:14:15.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000557eda5620667d26-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.254 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.254 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.255 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.255 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.255 DEBUG:boto:Method: GET 2023-12-15T23:14:15.255 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.255 DEBUG:boto:Data: 2023-12-15T23:14:15.255 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.255 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.255 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.256 DEBUG:boto:Params: {} 2023-12-15T23:14:15.256 DEBUG:boto:Token: None 2023-12-15T23:14:15.256 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011?versionId=null 2023-12-15T23:14:15.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4= 2023-12-15T23:14:15.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+a4aXJrF/6ZM3LkgbS6ihuyDMz4=', 'Content-Length': '0'} 2023-12-15T23:14:15.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003609c4e19e930868-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.301 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.302 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.302 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.302 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.302 DEBUG:boto:Method: GET 2023-12-15T23:14:15.302 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.302 DEBUG:boto:Data: 2023-12-15T23:14:15.302 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.302 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.302 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.302 DEBUG:boto:Params: {} 2023-12-15T23:14:15.303 DEBUG:boto:Token: None 2023-12-15T23:14:15.303 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b1536860f09a858-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.306 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.306 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.306 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.306 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.307 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.307 DEBUG:boto:Method: GET 2023-12-15T23:14:15.307 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.307 DEBUG:boto:Data: 2023-12-15T23:14:15.307 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.307 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.307 DEBUG:boto:Params: {} 2023-12-15T23:14:15.307 DEBUG:boto:Token: None 2023-12-15T23:14:15.308 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.308 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d13298d85cda5f27-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.312 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.312 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.312 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.312 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.312 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.313 DEBUG:boto:Data: 2023-12-15T23:14:15.313 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.313 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.313 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.313 DEBUG:boto:Params: {} 2023-12-15T23:14:15.313 DEBUG:boto:Token: None 2023-12-15T23:14:15.313 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R5uy0zcddUfJOCNMhPhJNrcWjK0= 2023-12-15T23:14:15.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R5uy0zcddUfJOCNMhPhJNrcWjK0=', 'Content-Length': '0'} 2023-12-15T23:14:15.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000df600466b4077d9-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.316 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.316 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.316 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.316 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.316 DEBUG:boto:Data: 2023-12-15T23:14:15.316 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.316 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.316 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.316 DEBUG:boto:Params: {} 2023-12-15T23:14:15.317 DEBUG:boto:Token: None 2023-12-15T23:14:15.317 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R5uy0zcddUfJOCNMhPhJNrcWjK0= 2023-12-15T23:14:15.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R5uy0zcddUfJOCNMhPhJNrcWjK0=', 'Content-Length': '0'} 2023-12-15T23:14:15.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b3306e5b9497719-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2023-12-15T23:14:15.319 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.319 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.319 DEBUG:boto:Method: GET 2023-12-15T23:14:15.319 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.320 DEBUG:boto:Data: 2023-12-15T23:14:15.320 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.320 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.320 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.320 DEBUG:boto:Params: {} 2023-12-15T23:14:15.320 DEBUG:boto:Token: None 2023-12-15T23:14:15.320 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ar9BoTIXXfBve+DU4No8NIw7XkU= 2023-12-15T23:14:15.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ar9BoTIXXfBve+DU4No8NIw7XkU=', 'Content-Length': '0'} 2023-12-15T23:14:15.322 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002472343af9bdf2bc-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.322 DEBUG:boto:path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.322 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.323 DEBUG:boto:Method: GET 2023-12-15T23:14:15.323 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.323 DEBUG:boto:Data: 2023-12-15T23:14:15.323 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.323 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.323 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.323 DEBUG:boto:Params: {} 2023-12-15T23:14:15.323 DEBUG:boto:Token: None 2023-12-15T23:14:15.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000011 2023-12-15T23:14:15.324 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ar9BoTIXXfBve+DU4No8NIw7XkU= 2023-12-15T23:14:15.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ar9BoTIXXfBve+DU4No8NIw7XkU=', 'Content-Length': '0'} 2023-12-15T23:14:15.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000991ae985078642-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.326 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.326 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.326 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.326 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.326 DEBUG:boto:Method: GET 2023-12-15T23:14:15.326 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.326 DEBUG:boto:Data: 2023-12-15T23:14:15.327 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.327 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.327 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.327 DEBUG:boto:Params: {} 2023-12-15T23:14:15.327 DEBUG:boto:Token: None 2023-12-15T23:14:15.327 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa17ef12ea449027-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.373 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.374 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.374 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.374 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.374 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.374 DEBUG:boto:Method: GET 2023-12-15T23:14:15.374 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000011 2023-12-15T23:14:15.374 DEBUG:boto:Data: 2023-12-15T23:14:15.374 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.375 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.375 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.375 DEBUG:boto:Params: {} 2023-12-15T23:14:15.375 DEBUG:boto:Token: None 2023-12-15T23:14:15.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.379 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aff851646f70b63d-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.379 DEBUG:boto:b'kskgfn-48obj000000000000000000111000falseobj000000000000000000112023-12-15T23:14:10.629Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:14:15.379 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.379 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.379 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.380 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.380 DEBUG:boto:Method: GET 2023-12-15T23:14:15.380 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.380 DEBUG:boto:Data: 2023-12-15T23:14:15.380 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.380 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.380 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.380 DEBUG:boto:Params: {} 2023-12-15T23:14:15.380 DEBUG:boto:Token: None 2023-12-15T23:14:15.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4= 2023-12-15T23:14:15.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4=', 'Content-Length': '0'} 2023-12-15T23:14:15.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017fc11d6ebfe8766-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.383 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.383 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.383 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.384 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.384 DEBUG:boto:Method: GET 2023-12-15T23:14:15.384 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.384 DEBUG:boto:Data: 2023-12-15T23:14:15.384 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.384 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.384 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.384 DEBUG:boto:Params: {} 2023-12-15T23:14:15.384 DEBUG:boto:Token: None 2023-12-15T23:14:15.385 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4= 2023-12-15T23:14:15.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4=', 'Content-Length': '0'} 2023-12-15T23:14:15.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9386f706b5a99ca-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.433 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.434 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.434 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.434 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.434 DEBUG:boto:Data: 2023-12-15T23:14:15.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.434 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.435 DEBUG:boto:Params: {} 2023-12-15T23:14:15.435 DEBUG:boto:Token: None 2023-12-15T23:14:15.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ppa+XiG1BsjU9kPY7XLH6l7zSlw= 2023-12-15T23:14:15.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ppa+XiG1BsjU9kPY7XLH6l7zSlw=', 'Content-Length': '0'} 2023-12-15T23:14:15.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ecc32a284f1845d-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.438 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.438 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.438 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.438 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.438 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.438 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.438 DEBUG:boto:Data: 2023-12-15T23:14:15.439 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.439 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.439 DEBUG:boto:Params: {} 2023-12-15T23:14:15.439 DEBUG:boto:Token: None 2023-12-15T23:14:15.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ppa+XiG1BsjU9kPY7XLH6l7zSlw= 2023-12-15T23:14:15.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ppa+XiG1BsjU9kPY7XLH6l7zSlw=', 'Content-Length': '0'} 2023-12-15T23:14:15.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098ca31aea1e151da-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:14:15.441 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.442 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.442 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.442 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.442 DEBUG:boto:Method: GET 2023-12-15T23:14:15.442 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.442 DEBUG:boto:Data: 2023-12-15T23:14:15.442 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.442 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.442 DEBUG:boto:Params: {} 2023-12-15T23:14:15.443 DEBUG:boto:Token: None 2023-12-15T23:14:15.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4= 2023-12-15T23:14:15.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4=', 'Content-Length': '0'} 2023-12-15T23:14:15.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000182b7fbabeeff77f-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.446 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.446 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.446 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.446 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.446 DEBUG:boto:Method: GET 2023-12-15T23:14:15.446 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.446 DEBUG:boto:Data: 2023-12-15T23:14:15.446 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.446 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.447 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.447 DEBUG:boto:Params: {} 2023-12-15T23:14:15.447 DEBUG:boto:Token: None 2023-12-15T23:14:15.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012?versionId=null 2023-12-15T23:14:15.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4= 2023-12-15T23:14:15.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yPkQyhmUaRc00rCxFcZ3o/m7ZI4=', 'Content-Length': '0'} 2023-12-15T23:14:15.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047656ed88b0c23e9-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.450 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.450 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.450 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.450 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.450 DEBUG:boto:Method: GET 2023-12-15T23:14:15.450 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.451 DEBUG:boto:Data: 2023-12-15T23:14:15.451 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.451 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.451 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.451 DEBUG:boto:Params: {} 2023-12-15T23:14:15.451 DEBUG:boto:Token: None 2023-12-15T23:14:15.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000579cda78972430cb-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.454 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.454 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.454 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.454 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.455 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.455 DEBUG:boto:Method: GET 2023-12-15T23:14:15.455 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.455 DEBUG:boto:Data: 2023-12-15T23:14:15.455 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.455 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.455 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.455 DEBUG:boto:Params: {} 2023-12-15T23:14:15.456 DEBUG:boto:Token: None 2023-12-15T23:14:15.456 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.456 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a24c71660837310-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.460 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.460 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.460 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.460 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.461 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.461 DEBUG:boto:Data: 2023-12-15T23:14:15.461 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.461 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.461 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.461 DEBUG:boto:Params: {} 2023-12-15T23:14:15.461 DEBUG:boto:Token: None 2023-12-15T23:14:15.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZOfssRPxMqvK1IDHSZ4uUByb4o= 2023-12-15T23:14:15.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZOfssRPxMqvK1IDHSZ4uUByb4o=', 'Content-Length': '0'} 2023-12-15T23:14:15.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015f1ff252d844980-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.464 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.464 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.464 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.464 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.464 DEBUG:boto:Data: 2023-12-15T23:14:15.464 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.464 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.465 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.465 DEBUG:boto:Params: {} 2023-12-15T23:14:15.465 DEBUG:boto:Token: None 2023-12-15T23:14:15.465 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iZOfssRPxMqvK1IDHSZ4uUByb4o= 2023-12-15T23:14:15.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iZOfssRPxMqvK1IDHSZ4uUByb4o=', 'Content-Length': '0'} 2023-12-15T23:14:15.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b10981848a090095-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2023-12-15T23:14:15.468 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.468 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.468 DEBUG:boto:Method: GET 2023-12-15T23:14:15.468 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.468 DEBUG:boto:Data: 2023-12-15T23:14:15.468 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.468 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.468 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.468 DEBUG:boto:Params: {} 2023-12-15T23:14:15.469 DEBUG:boto:Token: None 2023-12-15T23:14:15.469 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwV/zSpOLXC/PkHgbSdFPZ/7YDM= 2023-12-15T23:14:15.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwV/zSpOLXC/PkHgbSdFPZ/7YDM=', 'Content-Length': '0'} 2023-12-15T23:14:15.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085c0db8e5a1b75c8-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.471 DEBUG:boto:path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.471 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.471 DEBUG:boto:Method: GET 2023-12-15T23:14:15.472 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.472 DEBUG:boto:Data: 2023-12-15T23:14:15.472 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.472 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.472 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.472 DEBUG:boto:Params: {} 2023-12-15T23:14:15.472 DEBUG:boto:Token: None 2023-12-15T23:14:15.472 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000012 2023-12-15T23:14:15.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwV/zSpOLXC/PkHgbSdFPZ/7YDM= 2023-12-15T23:14:15.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwV/zSpOLXC/PkHgbSdFPZ/7YDM=', 'Content-Length': '0'} 2023-12-15T23:14:15.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a0f784673074172-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.517 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.518 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.518 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.518 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.518 DEBUG:boto:Method: GET 2023-12-15T23:14:15.518 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.518 DEBUG:boto:Data: 2023-12-15T23:14:15.518 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.518 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.518 DEBUG:boto:Params: {} 2023-12-15T23:14:15.519 DEBUG:boto:Token: None 2023-12-15T23:14:15.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059c4380cdb683d6e-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.521 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.522 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.522 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.522 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.522 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.522 DEBUG:boto:Method: GET 2023-12-15T23:14:15.522 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000012 2023-12-15T23:14:15.522 DEBUG:boto:Data: 2023-12-15T23:14:15.523 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.523 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.523 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.523 DEBUG:boto:Params: {} 2023-12-15T23:14:15.523 DEBUG:boto:Token: None 2023-12-15T23:14:15.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cf95517969e50b8-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.527 DEBUG:boto:b'kskgfn-48obj000000000000000000121000falseobj000000000000000000122023-12-15T23:14:10.701Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:14:15.528 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.528 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.528 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.528 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.528 DEBUG:boto:Method: GET 2023-12-15T23:14:15.528 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.528 DEBUG:boto:Data: 2023-12-15T23:14:15.529 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.529 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.529 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.529 DEBUG:boto:Params: {} 2023-12-15T23:14:15.529 DEBUG:boto:Token: None 2023-12-15T23:14:15.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k= 2023-12-15T23:14:15.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k=', 'Content-Length': '0'} 2023-12-15T23:14:15.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5fbad85c48e3088-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.531 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.532 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.532 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.532 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.532 DEBUG:boto:Method: GET 2023-12-15T23:14:15.532 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.532 DEBUG:boto:Data: 2023-12-15T23:14:15.532 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.532 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.532 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.533 DEBUG:boto:Params: {} 2023-12-15T23:14:15.533 DEBUG:boto:Token: None 2023-12-15T23:14:15.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k= 2023-12-15T23:14:15.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k=', 'Content-Length': '0'} 2023-12-15T23:14:15.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092c482657b8a03ed-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.535 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.536 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.536 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.536 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.536 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.536 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.536 DEBUG:boto:Data: 2023-12-15T23:14:15.536 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.536 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.536 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.536 DEBUG:boto:Params: {} 2023-12-15T23:14:15.537 DEBUG:boto:Token: None 2023-12-15T23:14:15.537 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wocIL4nCuCgKHjriywdqJSLcBAo= 2023-12-15T23:14:15.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wocIL4nCuCgKHjriywdqJSLcBAo=', 'Content-Length': '0'} 2023-12-15T23:14:15.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b57744647c92494-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.539 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.539 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.539 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.539 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.539 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.539 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.540 DEBUG:boto:Data: 2023-12-15T23:14:15.540 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.540 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.540 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.540 DEBUG:boto:Params: {} 2023-12-15T23:14:15.540 DEBUG:boto:Token: None 2023-12-15T23:14:15.540 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.540 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wocIL4nCuCgKHjriywdqJSLcBAo= 2023-12-15T23:14:15.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wocIL4nCuCgKHjriywdqJSLcBAo=', 'Content-Length': '0'} 2023-12-15T23:14:15.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c94af5c70b733f7c-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:14:15.543 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.543 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.543 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.543 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.543 DEBUG:boto:Method: GET 2023-12-15T23:14:15.543 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.543 DEBUG:boto:Data: 2023-12-15T23:14:15.544 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.544 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.544 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.544 DEBUG:boto:Params: {} 2023-12-15T23:14:15.544 DEBUG:boto:Token: None 2023-12-15T23:14:15.544 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k= 2023-12-15T23:14:15.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k=', 'Content-Length': '0'} 2023-12-15T23:14:15.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006460b73c81ba9c31-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.546 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.546 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.546 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.547 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.547 DEBUG:boto:Method: GET 2023-12-15T23:14:15.547 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.547 DEBUG:boto:Data: 2023-12-15T23:14:15.547 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.547 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.547 DEBUG:boto:Params: {} 2023-12-15T23:14:15.548 DEBUG:boto:Token: None 2023-12-15T23:14:15.548 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013?versionId=null 2023-12-15T23:14:15.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k= 2023-12-15T23:14:15.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SRSslTDrEw527z9wbhiXCvP178k=', 'Content-Length': '0'} 2023-12-15T23:14:15.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000348e5478065e8be4-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.593 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.594 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.594 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.594 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.594 DEBUG:boto:Method: GET 2023-12-15T23:14:15.594 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.594 DEBUG:boto:Data: 2023-12-15T23:14:15.594 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.594 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.594 DEBUG:boto:Params: {} 2023-12-15T23:14:15.595 DEBUG:boto:Token: None 2023-12-15T23:14:15.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca1f535df4ba92fc-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.600 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.600 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.601 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.601 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.601 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.601 DEBUG:boto:Method: GET 2023-12-15T23:14:15.601 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.601 DEBUG:boto:Data: 2023-12-15T23:14:15.601 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.601 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.601 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.601 DEBUG:boto:Params: {} 2023-12-15T23:14:15.601 DEBUG:boto:Token: None 2023-12-15T23:14:15.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.605 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006faacd82ae8aea01-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.606 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.606 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.606 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.606 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.606 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.606 DEBUG:boto:Data: 2023-12-15T23:14:15.607 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.607 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.607 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.607 DEBUG:boto:Params: {} 2023-12-15T23:14:15.607 DEBUG:boto:Token: None 2023-12-15T23:14:15.607 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Szl2IMZdRvOZhxqJIRSjZiiVy0M= 2023-12-15T23:14:15.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Szl2IMZdRvOZhxqJIRSjZiiVy0M=', 'Content-Length': '0'} 2023-12-15T23:14:15.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000628e8ba96ead872f-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.609 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.609 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.609 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.610 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.610 DEBUG:boto:Data: 2023-12-15T23:14:15.610 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.610 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.610 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.610 DEBUG:boto:Params: {} 2023-12-15T23:14:15.610 DEBUG:boto:Token: None 2023-12-15T23:14:15.610 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Szl2IMZdRvOZhxqJIRSjZiiVy0M= 2023-12-15T23:14:15.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Szl2IMZdRvOZhxqJIRSjZiiVy0M=', 'Content-Length': '0'} 2023-12-15T23:14:15.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbd752511b609ffd-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2023-12-15T23:14:15.612 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.613 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.613 DEBUG:boto:Method: GET 2023-12-15T23:14:15.613 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.613 DEBUG:boto:Data: 2023-12-15T23:14:15.613 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.613 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.613 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.613 DEBUG:boto:Params: {} 2023-12-15T23:14:15.613 DEBUG:boto:Token: None 2023-12-15T23:14:15.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6oleW6qChF9GZTmHfafjxZ/PY2Q= 2023-12-15T23:14:15.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6oleW6qChF9GZTmHfafjxZ/PY2Q=', 'Content-Length': '0'} 2023-12-15T23:14:15.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fb950431fa4309d-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.662 DEBUG:boto:path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.662 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.662 DEBUG:boto:Method: GET 2023-12-15T23:14:15.662 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.662 DEBUG:boto:Data: 2023-12-15T23:14:15.662 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.662 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.662 DEBUG:boto:Params: {} 2023-12-15T23:14:15.663 DEBUG:boto:Token: None 2023-12-15T23:14:15.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000013 2023-12-15T23:14:15.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6oleW6qChF9GZTmHfafjxZ/PY2Q= 2023-12-15T23:14:15.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6oleW6qChF9GZTmHfafjxZ/PY2Q=', 'Content-Length': '0'} 2023-12-15T23:14:15.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8fbd15534ebbc17-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.665 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.665 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.665 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.666 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.666 DEBUG:boto:Method: GET 2023-12-15T23:14:15.666 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.666 DEBUG:boto:Data: 2023-12-15T23:14:15.666 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.666 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.666 DEBUG:boto:Params: {} 2023-12-15T23:14:15.666 DEBUG:boto:Token: None 2023-12-15T23:14:15.666 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e94a633c80704d3-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.669 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.670 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.670 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.670 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.670 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.670 DEBUG:boto:Method: GET 2023-12-15T23:14:15.670 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000013 2023-12-15T23:14:15.670 DEBUG:boto:Data: 2023-12-15T23:14:15.671 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.671 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.671 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.671 DEBUG:boto:Params: {} 2023-12-15T23:14:15.671 DEBUG:boto:Token: None 2023-12-15T23:14:15.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.675 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000486bf9a22ff55fb5-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.675 DEBUG:boto:b'kskgfn-48obj000000000000000000131000falseobj000000000000000000132023-12-15T23:14:10.309Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2023-12-15T23:14:15.675 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.676 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.676 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.676 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.676 DEBUG:boto:Method: GET 2023-12-15T23:14:15.676 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.676 DEBUG:boto:Data: 2023-12-15T23:14:15.676 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.676 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.676 DEBUG:boto:Params: {} 2023-12-15T23:14:15.676 DEBUG:boto:Token: None 2023-12-15T23:14:15.677 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk= 2023-12-15T23:14:15.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk=', 'Content-Length': '0'} 2023-12-15T23:14:15.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b7ce7a83ca63bfe-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.679 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.680 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.680 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.680 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.680 DEBUG:boto:Method: GET 2023-12-15T23:14:15.680 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.680 DEBUG:boto:Data: 2023-12-15T23:14:15.680 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.680 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.680 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.680 DEBUG:boto:Params: {} 2023-12-15T23:14:15.681 DEBUG:boto:Token: None 2023-12-15T23:14:15.681 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.681 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk= 2023-12-15T23:14:15.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk=', 'Content-Length': '0'} 2023-12-15T23:14:15.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f0918ff206d606f-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.726 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.726 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.726 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.726 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.726 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.726 DEBUG:boto:Data: 2023-12-15T23:14:15.726 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.726 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.726 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.726 DEBUG:boto:Params: {} 2023-12-15T23:14:15.726 DEBUG:boto:Token: None 2023-12-15T23:14:15.727 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ClgRcY2G7LtDFr/diLopa/61Iw= 2023-12-15T23:14:15.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ClgRcY2G7LtDFr/diLopa/61Iw=', 'Content-Length': '0'} 2023-12-15T23:14:15.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a7f9e8b9705e5b6-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.729 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.729 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.729 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.729 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.729 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.730 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.730 DEBUG:boto:Data: 2023-12-15T23:14:15.730 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.730 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.730 DEBUG:boto:Params: {} 2023-12-15T23:14:15.730 DEBUG:boto:Token: None 2023-12-15T23:14:15.730 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ClgRcY2G7LtDFr/diLopa/61Iw= 2023-12-15T23:14:15.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ClgRcY2G7LtDFr/diLopa/61Iw=', 'Content-Length': '0'} 2023-12-15T23:14:15.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028595fd265df1708-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.733 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2023-12-15T23:14:15.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.733 DEBUG:boto:Method: GET 2023-12-15T23:14:15.734 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.734 DEBUG:boto:Data: 2023-12-15T23:14:15.734 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.734 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.734 DEBUG:boto:Params: {} 2023-12-15T23:14:15.734 DEBUG:boto:Token: None 2023-12-15T23:14:15.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk= 2023-12-15T23:14:15.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk=', 'Content-Length': '0'} 2023-12-15T23:14:15.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000705cf2e78b2c68ea-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.737 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.737 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.737 DEBUG:boto:Method: GET 2023-12-15T23:14:15.737 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.737 DEBUG:boto:Data: 2023-12-15T23:14:15.737 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.737 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.738 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.738 DEBUG:boto:Params: {} 2023-12-15T23:14:15.738 DEBUG:boto:Token: None 2023-12-15T23:14:15.738 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014?versionId=null 2023-12-15T23:14:15.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk= 2023-12-15T23:14:15.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgnuJPA+Qq1ARSR7PNDQybtaClk=', 'Content-Length': '0'} 2023-12-15T23:14:15.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf7f9ec0c9240c1e-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.740 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.741 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.741 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.741 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.741 DEBUG:boto:Method: GET 2023-12-15T23:14:15.741 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.741 DEBUG:boto:Data: 2023-12-15T23:14:15.741 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.741 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.741 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.741 DEBUG:boto:Params: {} 2023-12-15T23:14:15.741 DEBUG:boto:Token: None 2023-12-15T23:14:15.742 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.744 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0788c4712a39350-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.744 DEBUG:boto:b'kskgfn-48obj000000000000000000141000falseobj000000000000000000142023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.745 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.745 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.745 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.745 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.745 DEBUG:boto:Method: GET 2023-12-15T23:14:15.745 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.745 DEBUG:boto:Data: 2023-12-15T23:14:15.746 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.746 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.746 DEBUG:boto:Params: {} 2023-12-15T23:14:15.746 DEBUG:boto:Token: None 2023-12-15T23:14:15.746 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e15de5ae31d4500-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.750 DEBUG:boto:b'kskgfn-48obj000000000000000000141000falseobj000000000000000000142023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.750 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.750 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.750 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.750 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.751 DEBUG:boto:Data: 2023-12-15T23:14:15.751 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.751 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.751 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.751 DEBUG:boto:Params: {} 2023-12-15T23:14:15.751 DEBUG:boto:Token: None 2023-12-15T23:14:15.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Aoj8pHIm/DoTkrcEtNCkv/IozWw= 2023-12-15T23:14:15.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Aoj8pHIm/DoTkrcEtNCkv/IozWw=', 'Content-Length': '0'} 2023-12-15T23:14:15.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d6f6f7b8842cc0a-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.754 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.754 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.754 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.754 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.754 DEBUG:boto:Data: 2023-12-15T23:14:15.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.754 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.754 DEBUG:boto:Params: {} 2023-12-15T23:14:15.754 DEBUG:boto:Token: None 2023-12-15T23:14:15.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Aoj8pHIm/DoTkrcEtNCkv/IozWw= 2023-12-15T23:14:15.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Aoj8pHIm/DoTkrcEtNCkv/IozWw=', 'Content-Length': '0'} 2023-12-15T23:14:15.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033cc4ee90570c2c7-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2023-12-15T23:14:15.758 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.758 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.758 DEBUG:boto:Method: GET 2023-12-15T23:14:15.758 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.758 DEBUG:boto:Data: 2023-12-15T23:14:15.758 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.758 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.758 DEBUG:boto:Params: {} 2023-12-15T23:14:15.758 DEBUG:boto:Token: None 2023-12-15T23:14:15.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V5QPinqaMw2MKlvcw6dal5Fu8Cc= 2023-12-15T23:14:15.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V5QPinqaMw2MKlvcw6dal5Fu8Cc=', 'Content-Length': '0'} 2023-12-15T23:14:15.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008357c745e25a7cda-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.761 DEBUG:boto:path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.761 DEBUG:boto:Method: GET 2023-12-15T23:14:15.761 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.761 DEBUG:boto:Data: 2023-12-15T23:14:15.761 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.762 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.762 DEBUG:boto:Params: {} 2023-12-15T23:14:15.762 DEBUG:boto:Token: None 2023-12-15T23:14:15.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000014 2023-12-15T23:14:15.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V5QPinqaMw2MKlvcw6dal5Fu8Cc= 2023-12-15T23:14:15.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V5QPinqaMw2MKlvcw6dal5Fu8Cc=', 'Content-Length': '0'} 2023-12-15T23:14:15.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077b4c8229cad4480-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.764 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.764 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.764 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.765 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.765 DEBUG:boto:Method: GET 2023-12-15T23:14:15.765 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.765 DEBUG:boto:Data: 2023-12-15T23:14:15.765 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.765 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.765 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.765 DEBUG:boto:Params: {} 2023-12-15T23:14:15.765 DEBUG:boto:Token: None 2023-12-15T23:14:15.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.768 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fe741890f63b737-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.768 DEBUG:boto:b'kskgfn-48obj000000000000000000141000falseobj000000000000000000142023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.769 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.769 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.769 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.769 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.769 DEBUG:boto:Method: GET 2023-12-15T23:14:15.769 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000014 2023-12-15T23:14:15.769 DEBUG:boto:Data: 2023-12-15T23:14:15.769 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.769 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.769 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.770 DEBUG:boto:Params: {} 2023-12-15T23:14:15.770 DEBUG:boto:Token: None 2023-12-15T23:14:15.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000734b8c97fcca2a71-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.774 DEBUG:boto:b'kskgfn-48obj000000000000000000141000falseobj000000000000000000142023-12-15T23:14:10.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2023-12-15T23:14:15.774 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.774 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.774 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.774 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.774 DEBUG:boto:Method: GET 2023-12-15T23:14:15.774 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.775 DEBUG:boto:Data: 2023-12-15T23:14:15.775 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.775 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.775 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.775 DEBUG:boto:Params: {} 2023-12-15T23:14:15.775 DEBUG:boto:Token: None 2023-12-15T23:14:15.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw= 2023-12-15T23:14:15.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw=', 'Content-Length': '0'} 2023-12-15T23:14:15.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001da4263210ff4227-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.778 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.778 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.778 DEBUG:boto:Method: GET 2023-12-15T23:14:15.778 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.778 DEBUG:boto:Data: 2023-12-15T23:14:15.778 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.778 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.779 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.779 DEBUG:boto:Params: {} 2023-12-15T23:14:15.779 DEBUG:boto:Token: None 2023-12-15T23:14:15.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw= 2023-12-15T23:14:15.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw=', 'Content-Length': '0'} 2023-12-15T23:14:15.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb513d8137f7d943-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.821 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.822 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.822 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.822 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.822 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.822 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.822 DEBUG:boto:Data: 2023-12-15T23:14:15.822 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.822 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.822 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.822 DEBUG:boto:Params: {} 2023-12-15T23:14:15.822 DEBUG:boto:Token: None 2023-12-15T23:14:15.823 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tUoz5q+Ifyjg5+45HAh6PKGlPXc= 2023-12-15T23:14:15.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tUoz5q+Ifyjg5+45HAh6PKGlPXc=', 'Content-Length': '0'} 2023-12-15T23:14:15.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000948d9d966895f4ec-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.825 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.825 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.826 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.826 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.826 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.826 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.826 DEBUG:boto:Data: 2023-12-15T23:14:15.826 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.826 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.826 DEBUG:boto:Params: {} 2023-12-15T23:14:15.826 DEBUG:boto:Token: None 2023-12-15T23:14:15.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.827 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tUoz5q+Ifyjg5+45HAh6PKGlPXc= 2023-12-15T23:14:15.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tUoz5q+Ifyjg5+45HAh6PKGlPXc=', 'Content-Length': '0'} 2023-12-15T23:14:15.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f66547270cb35525-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2023-12-15T23:14:15.829 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.829 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.829 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.829 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.829 DEBUG:boto:Method: GET 2023-12-15T23:14:15.829 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.829 DEBUG:boto:Data: 2023-12-15T23:14:15.830 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.830 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.830 DEBUG:boto:Params: {} 2023-12-15T23:14:15.830 DEBUG:boto:Token: None 2023-12-15T23:14:15.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw= 2023-12-15T23:14:15.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw=', 'Content-Length': '0'} 2023-12-15T23:14:15.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071a4af3d1f489b71-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.832 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.833 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.833 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.833 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.833 DEBUG:boto:Method: GET 2023-12-15T23:14:15.833 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.833 DEBUG:boto:Data: 2023-12-15T23:14:15.833 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.833 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.833 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.833 DEBUG:boto:Params: {} 2023-12-15T23:14:15.834 DEBUG:boto:Token: None 2023-12-15T23:14:15.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015?versionId=null 2023-12-15T23:14:15.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw= 2023-12-15T23:14:15.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kI3tX6yBkXBNBHZ3f+Ys7GFYuKw=', 'Content-Length': '0'} 2023-12-15T23:14:15.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091f31e2498b5c54c-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.836 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.836 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.836 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.836 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.836 DEBUG:boto:Method: GET 2023-12-15T23:14:15.836 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.836 DEBUG:boto:Data: 2023-12-15T23:14:15.837 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.837 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.837 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.837 DEBUG:boto:Params: {} 2023-12-15T23:14:15.837 DEBUG:boto:Token: None 2023-12-15T23:14:15.837 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.837 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.840 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a34d60794cbe82ab-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.840 DEBUG:boto:b'kskgfn-48obj000000000000000000151000falseobj000000000000000000152023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.840 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.840 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.841 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.841 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.841 DEBUG:boto:Method: GET 2023-12-15T23:14:15.841 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.841 DEBUG:boto:Data: 2023-12-15T23:14:15.841 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.841 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.841 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.841 DEBUG:boto:Params: {} 2023-12-15T23:14:15.841 DEBUG:boto:Token: None 2023-12-15T23:14:15.841 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.845 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000178481441a73836d-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.845 DEBUG:boto:b'kskgfn-48obj000000000000000000151000falseobj000000000000000000152023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.845 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.846 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.846 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.846 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.846 DEBUG:boto:Data: 2023-12-15T23:14:15.846 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.846 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.846 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.846 DEBUG:boto:Params: {} 2023-12-15T23:14:15.846 DEBUG:boto:Token: None 2023-12-15T23:14:15.846 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yvo8vaI63mpFR6liYEnTL1Zfxrk= 2023-12-15T23:14:15.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yvo8vaI63mpFR6liYEnTL1Zfxrk=', 'Content-Length': '0'} 2023-12-15T23:14:15.848 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a59958c7d6c47737-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.848 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.849 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.849 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.849 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.849 DEBUG:boto:Data: 2023-12-15T23:14:15.849 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.849 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.849 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.849 DEBUG:boto:Params: {} 2023-12-15T23:14:15.849 DEBUG:boto:Token: None 2023-12-15T23:14:15.850 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yvo8vaI63mpFR6liYEnTL1Zfxrk= 2023-12-15T23:14:15.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yvo8vaI63mpFR6liYEnTL1Zfxrk=', 'Content-Length': '0'} 2023-12-15T23:14:15.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000774459d2f3bab292-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2023-12-15T23:14:15.852 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.852 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.852 DEBUG:boto:Method: GET 2023-12-15T23:14:15.852 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.852 DEBUG:boto:Data: 2023-12-15T23:14:15.852 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.853 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.853 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.853 DEBUG:boto:Params: {} 2023-12-15T23:14:15.853 DEBUG:boto:Token: None 2023-12-15T23:14:15.853 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.853 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M7Nu/Twz2GM38dBUCfSVcMYNOxQ= 2023-12-15T23:14:15.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M7Nu/Twz2GM38dBUCfSVcMYNOxQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6a85fc555b03614-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.856 DEBUG:boto:path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.856 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.856 DEBUG:boto:Method: GET 2023-12-15T23:14:15.856 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.856 DEBUG:boto:Data: 2023-12-15T23:14:15.856 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.856 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.856 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.856 DEBUG:boto:Params: {} 2023-12-15T23:14:15.857 DEBUG:boto:Token: None 2023-12-15T23:14:15.857 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000015 2023-12-15T23:14:15.857 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M7Nu/Twz2GM38dBUCfSVcMYNOxQ= 2023-12-15T23:14:15.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M7Nu/Twz2GM38dBUCfSVcMYNOxQ=', 'Content-Length': '0'} 2023-12-15T23:14:15.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c3c1d3eec580fd2-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.859 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.859 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.859 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.859 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.859 DEBUG:boto:Method: GET 2023-12-15T23:14:15.859 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.860 DEBUG:boto:Data: 2023-12-15T23:14:15.860 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.860 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.860 DEBUG:boto:Params: {} 2023-12-15T23:14:15.860 DEBUG:boto:Token: None 2023-12-15T23:14:15.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071bac010f045f4d0-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.863 DEBUG:boto:b'kskgfn-48obj000000000000000000151000falseobj000000000000000000152023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.863 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.863 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.863 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.864 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.864 DEBUG:boto:Method: GET 2023-12-15T23:14:15.864 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000015 2023-12-15T23:14:15.864 DEBUG:boto:Data: 2023-12-15T23:14:15.864 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.864 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.864 DEBUG:boto:Params: {} 2023-12-15T23:14:15.864 DEBUG:boto:Token: None 2023-12-15T23:14:15.864 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba1cbe4001ac8a97-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.868 DEBUG:boto:b'kskgfn-48obj000000000000000000151000falseobj000000000000000000152023-12-15T23:14:10.505Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2023-12-15T23:14:15.869 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.869 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.869 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.869 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.869 DEBUG:boto:Method: GET 2023-12-15T23:14:15.869 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.869 DEBUG:boto:Data: 2023-12-15T23:14:15.870 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.870 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.870 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.870 DEBUG:boto:Params: {} 2023-12-15T23:14:15.870 DEBUG:boto:Token: None 2023-12-15T23:14:15.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU= 2023-12-15T23:14:15.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU=', 'Content-Length': '0'} 2023-12-15T23:14:15.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2c213e3dc49de65-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.914 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.914 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.914 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.914 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.914 DEBUG:boto:Method: GET 2023-12-15T23:14:15.914 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.914 DEBUG:boto:Data: 2023-12-15T23:14:15.914 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.914 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.915 DEBUG:boto:Params: {} 2023-12-15T23:14:15.915 DEBUG:boto:Token: None 2023-12-15T23:14:15.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU= 2023-12-15T23:14:15.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU=', 'Content-Length': '0'} 2023-12-15T23:14:15.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c155164ded0571b2-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.917 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.917 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.917 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.918 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.918 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.918 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.918 DEBUG:boto:Data: 2023-12-15T23:14:15.918 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.918 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.918 DEBUG:boto:Params: {} 2023-12-15T23:14:15.918 DEBUG:boto:Token: None 2023-12-15T23:14:15.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvvYms8OUo7Eqa2XnDZ406RisOI= 2023-12-15T23:14:15.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvvYms8OUo7Eqa2XnDZ406RisOI=', 'Content-Length': '0'} 2023-12-15T23:14:15.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088d31c8f14a5c639-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.921 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.921 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.921 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.921 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.921 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.921 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.921 DEBUG:boto:Data: 2023-12-15T23:14:15.921 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.922 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.922 DEBUG:boto:Params: {} 2023-12-15T23:14:15.922 DEBUG:boto:Token: None 2023-12-15T23:14:15.922 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvvYms8OUo7Eqa2XnDZ406RisOI= 2023-12-15T23:14:15.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvvYms8OUo7Eqa2XnDZ406RisOI=', 'Content-Length': '0'} 2023-12-15T23:14:15.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ebfc7a5669bc44e-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2023-12-15T23:14:15.924 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.924 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.925 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.925 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.925 DEBUG:boto:Method: GET 2023-12-15T23:14:15.925 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.925 DEBUG:boto:Data: 2023-12-15T23:14:15.925 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.925 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.925 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.925 DEBUG:boto:Params: {} 2023-12-15T23:14:15.925 DEBUG:boto:Token: None 2023-12-15T23:14:15.925 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU= 2023-12-15T23:14:15.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU=', 'Content-Length': '0'} 2023-12-15T23:14:15.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d21b6daec52b4e6-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.928 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.928 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.928 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.929 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.929 DEBUG:boto:Method: GET 2023-12-15T23:14:15.929 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.929 DEBUG:boto:Data: 2023-12-15T23:14:15.929 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.929 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.929 DEBUG:boto:Params: {} 2023-12-15T23:14:15.929 DEBUG:boto:Token: None 2023-12-15T23:14:15.929 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016?versionId=null 2023-12-15T23:14:15.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU= 2023-12-15T23:14:15.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qA0CBGs/vxHZyCEp8wpaFR3GezU=', 'Content-Length': '0'} 2023-12-15T23:14:15.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000daebd7c5f79a2247-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.932 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.932 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.932 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.932 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.932 DEBUG:boto:Method: GET 2023-12-15T23:14:15.932 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.932 DEBUG:boto:Data: 2023-12-15T23:14:15.933 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.933 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.933 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.933 DEBUG:boto:Params: {} 2023-12-15T23:14:15.933 DEBUG:boto:Token: None 2023-12-15T23:14:15.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.936 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d5d8738d93ca7d7-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.936 DEBUG:boto:b'kskgfn-48obj000000000000000000161000falseobj000000000000000000162023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.936 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.936 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:15.936 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.937 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.937 DEBUG:boto:Method: GET 2023-12-15T23:14:15.937 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:15.937 DEBUG:boto:Data: 2023-12-15T23:14:15.937 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.937 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.937 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.937 DEBUG:boto:Params: {} 2023-12-15T23:14:15.937 DEBUG:boto:Token: None 2023-12-15T23:14:15.937 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/ 2023-12-15T23:14:15.938 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE= 2023-12-15T23:14:15.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DV1XbFxaBt0P07PQIbl4dmMawuE=', 'Content-Length': '0'} 2023-12-15T23:14:15.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009fa6422839ee55b-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.941 DEBUG:boto:b'kskgfn-48obj000000000000000000161000falseobj000000000000000000162023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:15.941 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.941 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.942 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.942 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.942 DEBUG:boto:Data: 2023-12-15T23:14:15.942 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.942 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.942 DEBUG:boto:Params: {} 2023-12-15T23:14:15.942 DEBUG:boto:Token: None 2023-12-15T23:14:15.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4kbzp0o/Zq5/7vbGkygDJyxia6c= 2023-12-15T23:14:15.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4kbzp0o/Zq5/7vbGkygDJyxia6c=', 'Content-Length': '0'} 2023-12-15T23:14:15.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091f071dab9c65b8b-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.945 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.945 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.945 DEBUG:boto:Method: HEAD 2023-12-15T23:14:15.945 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.945 DEBUG:boto:Data: 2023-12-15T23:14:15.945 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.945 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.946 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.946 DEBUG:boto:Params: {} 2023-12-15T23:14:15.946 DEBUG:boto:Token: None 2023-12-15T23:14:15.946 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4kbzp0o/Zq5/7vbGkygDJyxia6c= 2023-12-15T23:14:15.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4kbzp0o/Zq5/7vbGkygDJyxia6c=', 'Content-Length': '0'} 2023-12-15T23:14:15.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000362e03b935388d2-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2023-12-15T23:14:15.948 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.948 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.948 DEBUG:boto:Method: GET 2023-12-15T23:14:15.949 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.949 DEBUG:boto:Data: 2023-12-15T23:14:15.949 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.949 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:15.949 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.949 DEBUG:boto:Params: {} 2023-12-15T23:14:15.949 DEBUG:boto:Token: None 2023-12-15T23:14:15.949 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jX3L3BYAnPV8jM2KdHV7Dh7gQYA= 2023-12-15T23:14:15.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jX3L3BYAnPV8jM2KdHV7Dh7gQYA=', 'Content-Length': '0'} 2023-12-15T23:14:15.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b55475a1a29e6c5e-00657cddc7-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.952 DEBUG:boto:path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.952 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.952 DEBUG:boto:Method: GET 2023-12-15T23:14:15.952 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.952 DEBUG:boto:Data: 2023-12-15T23:14:15.952 DEBUG:boto:Headers: {} 2023-12-15T23:14:15.952 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:15.952 DEBUG:boto:Port: 8000 2023-12-15T23:14:15.952 DEBUG:boto:Params: {} 2023-12-15T23:14:15.953 DEBUG:boto:Token: None 2023-12-15T23:14:15.953 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:15 GMT /kskgfn-48/obj00000000000000000016 2023-12-15T23:14:15.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jX3L3BYAnPV8jM2KdHV7Dh7gQYA= 2023-12-15T23:14:15.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jX3L3BYAnPV8jM2KdHV7Dh7gQYA=', 'Content-Length': '0'} 2023-12-15T23:14:15.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b8bfd6379227d59-00657cddc7-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:15.955 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:15.955 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.014 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.014 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.014 DEBUG:boto:Method: GET 2023-12-15T23:14:16.015 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.015 DEBUG:boto:Data: 2023-12-15T23:14:16.015 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.015 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.015 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.015 DEBUG:boto:Params: {} 2023-12-15T23:14:16.015 DEBUG:boto:Token: None 2023-12-15T23:14:16.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030d6bcc080a9c689-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.018 DEBUG:boto:b'kskgfn-48obj000000000000000000161000falseobj000000000000000000162023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.019 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.019 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.019 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.019 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.019 DEBUG:boto:Method: GET 2023-12-15T23:14:16.019 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000016 2023-12-15T23:14:16.019 DEBUG:boto:Data: 2023-12-15T23:14:16.019 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.019 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.020 DEBUG:boto:Params: {} 2023-12-15T23:14:16.020 DEBUG:boto:Token: None 2023-12-15T23:14:16.020 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.023 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000639236761a23ce7c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.024 DEBUG:boto:b'kskgfn-48obj000000000000000000161000falseobj000000000000000000162023-12-15T23:14:09.869Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2023-12-15T23:14:16.024 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.024 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.024 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.024 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.024 DEBUG:boto:Method: GET 2023-12-15T23:14:16.025 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.025 DEBUG:boto:Data: 2023-12-15T23:14:16.025 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.025 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.025 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.025 DEBUG:boto:Params: {} 2023-12-15T23:14:16.025 DEBUG:boto:Token: None 2023-12-15T23:14:16.025 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.025 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk= 2023-12-15T23:14:16.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk=', 'Content-Length': '0'} 2023-12-15T23:14:16.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059f61ee872f74b94-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.028 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.028 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.028 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.028 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.028 DEBUG:boto:Method: GET 2023-12-15T23:14:16.028 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.029 DEBUG:boto:Data: 2023-12-15T23:14:16.029 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.029 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.029 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.029 DEBUG:boto:Params: {} 2023-12-15T23:14:16.029 DEBUG:boto:Token: None 2023-12-15T23:14:16.029 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.029 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk= 2023-12-15T23:14:16.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk=', 'Content-Length': '0'} 2023-12-15T23:14:16.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000124c56965a605f6c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.032 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.032 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.032 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.032 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.032 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.032 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.032 DEBUG:boto:Data: 2023-12-15T23:14:16.032 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.032 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.032 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.032 DEBUG:boto:Params: {} 2023-12-15T23:14:16.033 DEBUG:boto:Token: None 2023-12-15T23:14:16.033 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.033 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SQDbYzlQpbDsJgT8N0nIk/R9tzs= 2023-12-15T23:14:16.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SQDbYzlQpbDsJgT8N0nIk/R9tzs=', 'Content-Length': '0'} 2023-12-15T23:14:16.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1a8e1c7265ccb88-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.035 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.035 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.035 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.035 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.035 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.035 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.035 DEBUG:boto:Data: 2023-12-15T23:14:16.035 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.036 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.036 DEBUG:boto:Params: {} 2023-12-15T23:14:16.036 DEBUG:boto:Token: None 2023-12-15T23:14:16.036 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.036 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SQDbYzlQpbDsJgT8N0nIk/R9tzs= 2023-12-15T23:14:16.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SQDbYzlQpbDsJgT8N0nIk/R9tzs=', 'Content-Length': '0'} 2023-12-15T23:14:16.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f384209300e02dc-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.038 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2023-12-15T23:14:16.038 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.038 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.038 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.039 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.039 DEBUG:boto:Method: GET 2023-12-15T23:14:16.039 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.039 DEBUG:boto:Data: 2023-12-15T23:14:16.039 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.039 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.039 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.039 DEBUG:boto:Params: {} 2023-12-15T23:14:16.039 DEBUG:boto:Token: None 2023-12-15T23:14:16.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.040 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk= 2023-12-15T23:14:16.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk=', 'Content-Length': '0'} 2023-12-15T23:14:16.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049fba5d2a899f8d4-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.042 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.042 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.042 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.042 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.042 DEBUG:boto:Method: GET 2023-12-15T23:14:16.042 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.042 DEBUG:boto:Data: 2023-12-15T23:14:16.042 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.043 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.043 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.043 DEBUG:boto:Params: {} 2023-12-15T23:14:16.043 DEBUG:boto:Token: None 2023-12-15T23:14:16.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017?versionId=null 2023-12-15T23:14:16.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk= 2023-12-15T23:14:16.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eOxZgjd5ccw5BR0hRvQ70eV3BCk=', 'Content-Length': '0'} 2023-12-15T23:14:16.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c6ba45bec394774-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.085 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.086 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.086 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.086 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.086 DEBUG:boto:Method: GET 2023-12-15T23:14:16.086 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.086 DEBUG:boto:Data: 2023-12-15T23:14:16.086 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.086 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.086 DEBUG:boto:Params: {} 2023-12-15T23:14:16.086 DEBUG:boto:Token: None 2023-12-15T23:14:16.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007106b37499c6395a-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.089 DEBUG:boto:b'kskgfn-48obj000000000000000000171000falseobj000000000000000000172023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.090 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.090 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.090 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.090 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.090 DEBUG:boto:Method: GET 2023-12-15T23:14:16.090 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.090 DEBUG:boto:Data: 2023-12-15T23:14:16.090 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.090 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.090 DEBUG:boto:Params: {} 2023-12-15T23:14:16.091 DEBUG:boto:Token: None 2023-12-15T23:14:16.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fc7c5b7c9eda79e-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.094 DEBUG:boto:b'kskgfn-48obj000000000000000000171000falseobj000000000000000000172023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.095 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.095 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.095 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.095 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.095 DEBUG:boto:Data: 2023-12-15T23:14:16.095 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.095 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.095 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.095 DEBUG:boto:Params: {} 2023-12-15T23:14:16.095 DEBUG:boto:Token: None 2023-12-15T23:14:16.096 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cx9glySYTIhXKq0vYS2S3nTRmig= 2023-12-15T23:14:16.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cx9glySYTIhXKq0vYS2S3nTRmig=', 'Content-Length': '0'} 2023-12-15T23:14:16.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000479939531aa15b07-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.098 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.098 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.098 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.098 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.098 DEBUG:boto:Data: 2023-12-15T23:14:16.098 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.098 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.098 DEBUG:boto:Params: {} 2023-12-15T23:14:16.099 DEBUG:boto:Token: None 2023-12-15T23:14:16.099 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cx9glySYTIhXKq0vYS2S3nTRmig= 2023-12-15T23:14:16.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cx9glySYTIhXKq0vYS2S3nTRmig=', 'Content-Length': '0'} 2023-12-15T23:14:16.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e677fe8385f09b0c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2023-12-15T23:14:16.101 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.101 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.101 DEBUG:boto:Method: GET 2023-12-15T23:14:16.101 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.101 DEBUG:boto:Data: 2023-12-15T23:14:16.101 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.101 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.102 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.102 DEBUG:boto:Params: {} 2023-12-15T23:14:16.102 DEBUG:boto:Token: None 2023-12-15T23:14:16.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PLfoPBw37442ETXk4ToeJLS6+aE= 2023-12-15T23:14:16.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PLfoPBw37442ETXk4ToeJLS6+aE=', 'Content-Length': '0'} 2023-12-15T23:14:16.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5cd94b4008883d3-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.149 DEBUG:boto:path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.150 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.150 DEBUG:boto:Method: GET 2023-12-15T23:14:16.150 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.150 DEBUG:boto:Data: 2023-12-15T23:14:16.150 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.150 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.150 DEBUG:boto:Params: {} 2023-12-15T23:14:16.150 DEBUG:boto:Token: None 2023-12-15T23:14:16.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000017 2023-12-15T23:14:16.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PLfoPBw37442ETXk4ToeJLS6+aE= 2023-12-15T23:14:16.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PLfoPBw37442ETXk4ToeJLS6+aE=', 'Content-Length': '0'} 2023-12-15T23:14:16.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002664175850e5093-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.152 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.153 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.153 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.153 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.153 DEBUG:boto:Method: GET 2023-12-15T23:14:16.153 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.153 DEBUG:boto:Data: 2023-12-15T23:14:16.153 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.153 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.153 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.153 DEBUG:boto:Params: {} 2023-12-15T23:14:16.153 DEBUG:boto:Token: None 2023-12-15T23:14:16.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1676f9a3604d3ac-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.156 DEBUG:boto:b'kskgfn-48obj000000000000000000171000falseobj000000000000000000172023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.156 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.157 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.157 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.157 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.157 DEBUG:boto:Method: GET 2023-12-15T23:14:16.157 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000017 2023-12-15T23:14:16.157 DEBUG:boto:Data: 2023-12-15T23:14:16.157 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.157 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.157 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.157 DEBUG:boto:Params: {} 2023-12-15T23:14:16.158 DEBUG:boto:Token: None 2023-12-15T23:14:16.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b88e9853d12dcec7-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.161 DEBUG:boto:b'kskgfn-48obj000000000000000000171000falseobj000000000000000000172023-12-15T23:14:09.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.162 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2023-12-15T23:14:16.162 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.162 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.162 DEBUG:boto:Method: GET 2023-12-15T23:14:16.162 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.162 DEBUG:boto:Data: 2023-12-15T23:14:16.163 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.163 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.163 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.163 DEBUG:boto:Params: {} 2023-12-15T23:14:16.163 DEBUG:boto:Token: None 2023-12-15T23:14:16.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8= 2023-12-15T23:14:16.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8=', 'Content-Length': '0'} 2023-12-15T23:14:16.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000037808b8ed293409-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.166 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.166 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.166 DEBUG:boto:Method: GET 2023-12-15T23:14:16.166 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.166 DEBUG:boto:Data: 2023-12-15T23:14:16.166 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.166 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.166 DEBUG:boto:Params: {} 2023-12-15T23:14:16.167 DEBUG:boto:Token: None 2023-12-15T23:14:16.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8= 2023-12-15T23:14:16.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8=', 'Content-Length': '0'} 2023-12-15T23:14:16.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053eaf7c07eb47bd1-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.213 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.214 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.214 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.214 DEBUG:boto:Data: 2023-12-15T23:14:16.214 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.214 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.214 DEBUG:boto:Params: {} 2023-12-15T23:14:16.214 DEBUG:boto:Token: None 2023-12-15T23:14:16.215 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LL11Qe14nUbLm5xVQpzoSQdh4Hs= 2023-12-15T23:14:16.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LL11Qe14nUbLm5xVQpzoSQdh4Hs=', 'Content-Length': '0'} 2023-12-15T23:14:16.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002621bfde4af0ba94-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.217 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.217 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.217 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.218 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.218 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.218 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.218 DEBUG:boto:Data: 2023-12-15T23:14:16.218 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.218 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.218 DEBUG:boto:Params: {} 2023-12-15T23:14:16.218 DEBUG:boto:Token: None 2023-12-15T23:14:16.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LL11Qe14nUbLm5xVQpzoSQdh4Hs= 2023-12-15T23:14:16.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LL11Qe14nUbLm5xVQpzoSQdh4Hs=', 'Content-Length': '0'} 2023-12-15T23:14:16.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0bd715be7c84f9b-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2023-12-15T23:14:16.220 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.221 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.221 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.221 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.221 DEBUG:boto:Method: GET 2023-12-15T23:14:16.221 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.221 DEBUG:boto:Data: 2023-12-15T23:14:16.221 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.221 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.221 DEBUG:boto:Params: {} 2023-12-15T23:14:16.222 DEBUG:boto:Token: None 2023-12-15T23:14:16.222 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8= 2023-12-15T23:14:16.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8=', 'Content-Length': '0'} 2023-12-15T23:14:16.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092548a828f5332dc-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.224 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.224 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.224 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.224 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.225 DEBUG:boto:Method: GET 2023-12-15T23:14:16.225 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.225 DEBUG:boto:Data: 2023-12-15T23:14:16.225 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.225 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.225 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.225 DEBUG:boto:Params: {} 2023-12-15T23:14:16.225 DEBUG:boto:Token: None 2023-12-15T23:14:16.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018?versionId=null 2023-12-15T23:14:16.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8= 2023-12-15T23:14:16.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke+y9+km2mG+jEGxwHrlCu4PeP8=', 'Content-Length': '0'} 2023-12-15T23:14:16.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d8f3c359738d2a5-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.227 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.228 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.228 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.228 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.228 DEBUG:boto:Method: GET 2023-12-15T23:14:16.228 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.228 DEBUG:boto:Data: 2023-12-15T23:14:16.228 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.228 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.228 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.228 DEBUG:boto:Params: {} 2023-12-15T23:14:16.228 DEBUG:boto:Token: None 2023-12-15T23:14:16.229 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.229 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003513858754f9a968-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.231 DEBUG:boto:b'kskgfn-48obj000000000000000000181000falseobj000000000000000000182023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.232 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.232 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.232 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.232 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.232 DEBUG:boto:Method: GET 2023-12-15T23:14:16.232 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.232 DEBUG:boto:Data: 2023-12-15T23:14:16.232 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.232 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.232 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.232 DEBUG:boto:Params: {} 2023-12-15T23:14:16.233 DEBUG:boto:Token: None 2023-12-15T23:14:16.233 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070240ccadcf94ef3-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.236 DEBUG:boto:b'kskgfn-48obj000000000000000000181000falseobj000000000000000000182023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.237 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.237 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.237 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.237 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.237 DEBUG:boto:Data: 2023-12-15T23:14:16.237 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.237 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.237 DEBUG:boto:Params: {} 2023-12-15T23:14:16.238 DEBUG:boto:Token: None 2023-12-15T23:14:16.238 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oliR3TmhBaqz4JiU7rGYqaJJFjk= 2023-12-15T23:14:16.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oliR3TmhBaqz4JiU7rGYqaJJFjk=', 'Content-Length': '0'} 2023-12-15T23:14:16.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c97cc0b514c32fc-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.240 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.240 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.241 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.241 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.241 DEBUG:boto:Data: 2023-12-15T23:14:16.241 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.241 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.241 DEBUG:boto:Params: {} 2023-12-15T23:14:16.241 DEBUG:boto:Token: None 2023-12-15T23:14:16.241 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.241 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oliR3TmhBaqz4JiU7rGYqaJJFjk= 2023-12-15T23:14:16.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oliR3TmhBaqz4JiU7rGYqaJJFjk=', 'Content-Length': '0'} 2023-12-15T23:14:16.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcbb5c60ee7125d1-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2023-12-15T23:14:16.244 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.244 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.244 DEBUG:boto:Method: GET 2023-12-15T23:14:16.244 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.244 DEBUG:boto:Data: 2023-12-15T23:14:16.244 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.244 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.244 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.244 DEBUG:boto:Params: {} 2023-12-15T23:14:16.244 DEBUG:boto:Token: None 2023-12-15T23:14:16.244 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.245 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rehY9ljKnoAmFR4nLVxsKm7I7y0= 2023-12-15T23:14:16.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rehY9ljKnoAmFR4nLVxsKm7I7y0=', 'Content-Length': '0'} 2023-12-15T23:14:16.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab7347870cef7f13-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.247 DEBUG:boto:path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.247 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.247 DEBUG:boto:Method: GET 2023-12-15T23:14:16.247 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.247 DEBUG:boto:Data: 2023-12-15T23:14:16.247 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.248 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.248 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.248 DEBUG:boto:Params: {} 2023-12-15T23:14:16.248 DEBUG:boto:Token: None 2023-12-15T23:14:16.248 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000018 2023-12-15T23:14:16.248 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rehY9ljKnoAmFR4nLVxsKm7I7y0= 2023-12-15T23:14:16.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rehY9ljKnoAmFR4nLVxsKm7I7y0=', 'Content-Length': '0'} 2023-12-15T23:14:16.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002db711fa651f1419-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.250 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.250 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.250 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.250 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.250 DEBUG:boto:Method: GET 2023-12-15T23:14:16.250 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.251 DEBUG:boto:Data: 2023-12-15T23:14:16.251 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.251 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.251 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.251 DEBUG:boto:Params: {} 2023-12-15T23:14:16.251 DEBUG:boto:Token: None 2023-12-15T23:14:16.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048e19ab50362a8ac-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.297 DEBUG:boto:b'kskgfn-48obj000000000000000000181000falseobj000000000000000000182023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.298 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.298 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.298 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.298 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.298 DEBUG:boto:Method: GET 2023-12-15T23:14:16.298 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000018 2023-12-15T23:14:16.298 DEBUG:boto:Data: 2023-12-15T23:14:16.298 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.298 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.298 DEBUG:boto:Params: {} 2023-12-15T23:14:16.299 DEBUG:boto:Token: None 2023-12-15T23:14:16.299 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee3e6250ca5ba4ed-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.303 DEBUG:boto:b'kskgfn-48obj000000000000000000181000falseobj000000000000000000182023-12-15T23:14:10.197Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.303 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2023-12-15T23:14:16.303 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.303 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.303 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.303 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.303 DEBUG:boto:Method: GET 2023-12-15T23:14:16.303 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.304 DEBUG:boto:Data: 2023-12-15T23:14:16.304 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.304 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.304 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.304 DEBUG:boto:Params: {} 2023-12-15T23:14:16.304 DEBUG:boto:Token: None 2023-12-15T23:14:16.304 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.304 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI= 2023-12-15T23:14:16.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI=', 'Content-Length': '0'} 2023-12-15T23:14:16.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086845c3e1d78b971-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.307 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.307 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.307 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.307 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.307 DEBUG:boto:Method: GET 2023-12-15T23:14:16.307 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.307 DEBUG:boto:Data: 2023-12-15T23:14:16.307 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.307 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.308 DEBUG:boto:Params: {} 2023-12-15T23:14:16.308 DEBUG:boto:Token: None 2023-12-15T23:14:16.308 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.308 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI= 2023-12-15T23:14:16.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI=', 'Content-Length': '0'} 2023-12-15T23:14:16.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025b435a01d890a38-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.310 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.310 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.311 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.311 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.311 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.311 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.311 DEBUG:boto:Data: 2023-12-15T23:14:16.311 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.311 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.311 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.311 DEBUG:boto:Params: {} 2023-12-15T23:14:16.311 DEBUG:boto:Token: None 2023-12-15T23:14:16.311 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z7XKBxqYeyzmtOiptiFF4W83+rs= 2023-12-15T23:14:16.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z7XKBxqYeyzmtOiptiFF4W83+rs=', 'Content-Length': '0'} 2023-12-15T23:14:16.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076bc63c03982192e-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.314 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.314 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.314 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.314 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.315 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.315 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.315 DEBUG:boto:Data: 2023-12-15T23:14:16.315 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.315 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.315 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.315 DEBUG:boto:Params: {} 2023-12-15T23:14:16.315 DEBUG:boto:Token: None 2023-12-15T23:14:16.315 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z7XKBxqYeyzmtOiptiFF4W83+rs= 2023-12-15T23:14:16.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z7XKBxqYeyzmtOiptiFF4W83+rs=', 'Content-Length': '0'} 2023-12-15T23:14:16.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca842bd02ca37a57-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2023-12-15T23:14:16.318 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.318 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.318 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.318 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.318 DEBUG:boto:Method: GET 2023-12-15T23:14:16.318 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.318 DEBUG:boto:Data: 2023-12-15T23:14:16.318 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.318 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.318 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.319 DEBUG:boto:Params: {} 2023-12-15T23:14:16.319 DEBUG:boto:Token: None 2023-12-15T23:14:16.319 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI= 2023-12-15T23:14:16.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI=', 'Content-Length': '0'} 2023-12-15T23:14:16.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000723d67e371eb2faf-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.361 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.362 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.362 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.362 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.362 DEBUG:boto:Method: GET 2023-12-15T23:14:16.362 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.362 DEBUG:boto:Data: 2023-12-15T23:14:16.362 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.362 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.362 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.362 DEBUG:boto:Params: {} 2023-12-15T23:14:16.362 DEBUG:boto:Token: None 2023-12-15T23:14:16.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019?versionId=null 2023-12-15T23:14:16.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI= 2023-12-15T23:14:16.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2+FbMXETotN0EVxOIc2M+jeSMRI=', 'Content-Length': '0'} 2023-12-15T23:14:16.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000852c6aecb9904201-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.365 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.365 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.366 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.366 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.366 DEBUG:boto:Method: GET 2023-12-15T23:14:16.366 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.366 DEBUG:boto:Data: 2023-12-15T23:14:16.366 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.366 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.366 DEBUG:boto:Params: {} 2023-12-15T23:14:16.366 DEBUG:boto:Token: None 2023-12-15T23:14:16.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc41de9aa00dce1-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.369 DEBUG:boto:b'kskgfn-48obj000000000000000000191000falseobj000000000000000000192023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.370 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.370 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.370 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.370 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.370 DEBUG:boto:Method: GET 2023-12-15T23:14:16.370 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.370 DEBUG:boto:Data: 2023-12-15T23:14:16.370 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.370 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.370 DEBUG:boto:Params: {} 2023-12-15T23:14:16.371 DEBUG:boto:Token: None 2023-12-15T23:14:16.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.375 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f37ca7512baa9c4d-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.375 DEBUG:boto:b'kskgfn-48obj000000000000000000191000falseobj000000000000000000192023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.375 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.375 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.375 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.375 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.375 DEBUG:boto:Data: 2023-12-15T23:14:16.376 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.376 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.376 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.376 DEBUG:boto:Params: {} 2023-12-15T23:14:16.376 DEBUG:boto:Token: None 2023-12-15T23:14:16.376 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.376 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Al5rIB5rW3mr0g/9ETiRCTs7kbw= 2023-12-15T23:14:16.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Al5rIB5rW3mr0g/9ETiRCTs7kbw=', 'Content-Length': '0'} 2023-12-15T23:14:16.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b25e721ce3b49788-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.379 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.379 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.379 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.379 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.379 DEBUG:boto:Data: 2023-12-15T23:14:16.379 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.379 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.379 DEBUG:boto:Params: {} 2023-12-15T23:14:16.379 DEBUG:boto:Token: None 2023-12-15T23:14:16.380 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Al5rIB5rW3mr0g/9ETiRCTs7kbw= 2023-12-15T23:14:16.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Al5rIB5rW3mr0g/9ETiRCTs7kbw=', 'Content-Length': '0'} 2023-12-15T23:14:16.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd87519527e03760-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.382 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2023-12-15T23:14:16.383 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.383 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.383 DEBUG:boto:Method: GET 2023-12-15T23:14:16.383 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.383 DEBUG:boto:Data: 2023-12-15T23:14:16.383 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.383 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.383 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.383 DEBUG:boto:Params: {} 2023-12-15T23:14:16.383 DEBUG:boto:Token: None 2023-12-15T23:14:16.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EJf2RtuPMtBUmzYPmAk9c1zMaDY= 2023-12-15T23:14:16.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EJf2RtuPMtBUmzYPmAk9c1zMaDY=', 'Content-Length': '0'} 2023-12-15T23:14:16.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000899caaf7f2c8ac62-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.386 DEBUG:boto:path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.386 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.386 DEBUG:boto:Method: GET 2023-12-15T23:14:16.386 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.386 DEBUG:boto:Data: 2023-12-15T23:14:16.386 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.387 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.387 DEBUG:boto:Params: {} 2023-12-15T23:14:16.387 DEBUG:boto:Token: None 2023-12-15T23:14:16.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000019 2023-12-15T23:14:16.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EJf2RtuPMtBUmzYPmAk9c1zMaDY= 2023-12-15T23:14:16.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EJf2RtuPMtBUmzYPmAk9c1zMaDY=', 'Content-Length': '0'} 2023-12-15T23:14:16.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb6d6b7bcbd5a03-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.389 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.389 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.389 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.390 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.390 DEBUG:boto:Method: GET 2023-12-15T23:14:16.390 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.390 DEBUG:boto:Data: 2023-12-15T23:14:16.390 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.390 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.390 DEBUG:boto:Params: {} 2023-12-15T23:14:16.390 DEBUG:boto:Token: None 2023-12-15T23:14:16.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d62961d7151e369-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.433 DEBUG:boto:b'kskgfn-48obj000000000000000000191000falseobj000000000000000000192023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.434 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.434 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.434 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.434 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.434 DEBUG:boto:Method: GET 2023-12-15T23:14:16.434 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000019 2023-12-15T23:14:16.434 DEBUG:boto:Data: 2023-12-15T23:14:16.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.435 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.435 DEBUG:boto:Params: {} 2023-12-15T23:14:16.435 DEBUG:boto:Token: None 2023-12-15T23:14:16.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ff033e625fe568a-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.439 DEBUG:boto:b'kskgfn-48obj000000000000000000191000falseobj000000000000000000192023-12-15T23:14:10.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2023-12-15T23:14:16.439 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.439 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.439 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.439 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.439 DEBUG:boto:Method: GET 2023-12-15T23:14:16.440 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.440 DEBUG:boto:Data: 2023-12-15T23:14:16.440 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.440 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.440 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.440 DEBUG:boto:Params: {} 2023-12-15T23:14:16.440 DEBUG:boto:Token: None 2023-12-15T23:14:16.440 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.440 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g= 2023-12-15T23:14:16.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g=', 'Content-Length': '0'} 2023-12-15T23:14:16.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000592126ceba7286db-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.443 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.443 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.443 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.443 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.443 DEBUG:boto:Method: GET 2023-12-15T23:14:16.443 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.444 DEBUG:boto:Data: 2023-12-15T23:14:16.444 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.444 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.444 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.444 DEBUG:boto:Params: {} 2023-12-15T23:14:16.444 DEBUG:boto:Token: None 2023-12-15T23:14:16.444 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g= 2023-12-15T23:14:16.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g=', 'Content-Length': '0'} 2023-12-15T23:14:16.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006364e65b5d0cd57f-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.489 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.490 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.490 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.490 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.490 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.490 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.490 DEBUG:boto:Data: 2023-12-15T23:14:16.490 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.490 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.490 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.490 DEBUG:boto:Params: {} 2023-12-15T23:14:16.490 DEBUG:boto:Token: None 2023-12-15T23:14:16.491 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+WnR15iXOvEC2XwwKj6r1u82B8= 2023-12-15T23:14:16.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+WnR15iXOvEC2XwwKj6r1u82B8=', 'Content-Length': '0'} 2023-12-15T23:14:16.492 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac1b91fd5bafa981-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.493 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.493 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.493 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.494 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.494 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.494 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.494 DEBUG:boto:Data: 2023-12-15T23:14:16.494 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.494 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.494 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.494 DEBUG:boto:Params: {} 2023-12-15T23:14:16.494 DEBUG:boto:Token: None 2023-12-15T23:14:16.495 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+WnR15iXOvEC2XwwKj6r1u82B8= 2023-12-15T23:14:16.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+WnR15iXOvEC2XwwKj6r1u82B8=', 'Content-Length': '0'} 2023-12-15T23:14:16.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e29e3d8a7b65581-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2023-12-15T23:14:16.497 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.497 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.497 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.497 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.497 DEBUG:boto:Method: GET 2023-12-15T23:14:16.497 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.497 DEBUG:boto:Data: 2023-12-15T23:14:16.498 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.498 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.498 DEBUG:boto:Params: {} 2023-12-15T23:14:16.498 DEBUG:boto:Token: None 2023-12-15T23:14:16.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.498 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g= 2023-12-15T23:14:16.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g=', 'Content-Length': '0'} 2023-12-15T23:14:16.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aae3138198ae352-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.501 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.501 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.501 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.501 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.501 DEBUG:boto:Method: GET 2023-12-15T23:14:16.501 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.501 DEBUG:boto:Data: 2023-12-15T23:14:16.501 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.501 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.502 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.502 DEBUG:boto:Params: {} 2023-12-15T23:14:16.502 DEBUG:boto:Token: None 2023-12-15T23:14:16.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020?versionId=null 2023-12-15T23:14:16.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g= 2023-12-15T23:14:16.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ObssSHKdT6dQJ9dMc5094QG1J3g=', 'Content-Length': '0'} 2023-12-15T23:14:16.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e30b7928805580d-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.504 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.504 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.504 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.504 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.504 DEBUG:boto:Method: GET 2023-12-15T23:14:16.505 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.505 DEBUG:boto:Data: 2023-12-15T23:14:16.505 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.505 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.505 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.505 DEBUG:boto:Params: {} 2023-12-15T23:14:16.505 DEBUG:boto:Token: None 2023-12-15T23:14:16.505 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.505 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000812c6ca212709cde-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.508 DEBUG:boto:b'kskgfn-48obj000000000000000000201000falseobj000000000000000000202023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.508 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.508 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.508 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.509 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.509 DEBUG:boto:Method: GET 2023-12-15T23:14:16.509 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.509 DEBUG:boto:Data: 2023-12-15T23:14:16.509 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.509 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.509 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.509 DEBUG:boto:Params: {} 2023-12-15T23:14:16.509 DEBUG:boto:Token: None 2023-12-15T23:14:16.509 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbad38f6243c0c93-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.513 DEBUG:boto:b'kskgfn-48obj000000000000000000201000falseobj000000000000000000202023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.514 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.514 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.514 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.514 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.514 DEBUG:boto:Data: 2023-12-15T23:14:16.514 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.514 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.514 DEBUG:boto:Params: {} 2023-12-15T23:14:16.514 DEBUG:boto:Token: None 2023-12-15T23:14:16.515 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:me7u0/NbRMZU99QLtblHOxgsyl0= 2023-12-15T23:14:16.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:me7u0/NbRMZU99QLtblHOxgsyl0=', 'Content-Length': '0'} 2023-12-15T23:14:16.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075deffe2af68e1c4-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.517 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.517 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.517 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.517 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.517 DEBUG:boto:Data: 2023-12-15T23:14:16.517 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.517 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.518 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.518 DEBUG:boto:Params: {} 2023-12-15T23:14:16.518 DEBUG:boto:Token: None 2023-12-15T23:14:16.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:me7u0/NbRMZU99QLtblHOxgsyl0= 2023-12-15T23:14:16.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:me7u0/NbRMZU99QLtblHOxgsyl0=', 'Content-Length': '0'} 2023-12-15T23:14:16.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007881a7d5ae5ec9b6-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.520 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2023-12-15T23:14:16.520 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.520 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.520 DEBUG:boto:Method: GET 2023-12-15T23:14:16.520 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.520 DEBUG:boto:Data: 2023-12-15T23:14:16.520 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.521 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.521 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.521 DEBUG:boto:Params: {} 2023-12-15T23:14:16.521 DEBUG:boto:Token: None 2023-12-15T23:14:16.521 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.521 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5w+a71+YECqmUIwQfhnG28//3b8= 2023-12-15T23:14:16.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5w+a71+YECqmUIwQfhnG28//3b8=', 'Content-Length': '0'} 2023-12-15T23:14:16.523 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcad9b01208405c8-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.523 DEBUG:boto:path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.523 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.523 DEBUG:boto:Method: GET 2023-12-15T23:14:16.523 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.524 DEBUG:boto:Data: 2023-12-15T23:14:16.524 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.524 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.524 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.524 DEBUG:boto:Params: {} 2023-12-15T23:14:16.524 DEBUG:boto:Token: None 2023-12-15T23:14:16.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000020 2023-12-15T23:14:16.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5w+a71+YECqmUIwQfhnG28//3b8= 2023-12-15T23:14:16.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5w+a71+YECqmUIwQfhnG28//3b8=', 'Content-Length': '0'} 2023-12-15T23:14:16.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d21946872a68e004-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.526 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.527 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.527 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.527 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.527 DEBUG:boto:Method: GET 2023-12-15T23:14:16.527 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.527 DEBUG:boto:Data: 2023-12-15T23:14:16.527 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.527 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.527 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.527 DEBUG:boto:Params: {} 2023-12-15T23:14:16.527 DEBUG:boto:Token: None 2023-12-15T23:14:16.528 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea7865c662e5c185-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.530 DEBUG:boto:b'kskgfn-48obj000000000000000000201000falseobj000000000000000000202023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.531 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.531 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.531 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.531 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.531 DEBUG:boto:Method: GET 2023-12-15T23:14:16.531 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000020 2023-12-15T23:14:16.531 DEBUG:boto:Data: 2023-12-15T23:14:16.531 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.531 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.532 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.532 DEBUG:boto:Params: {} 2023-12-15T23:14:16.532 DEBUG:boto:Token: None 2023-12-15T23:14:16.532 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e62ffc6f1822bef-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.536 DEBUG:boto:b'kskgfn-48obj000000000000000000201000falseobj000000000000000000202023-12-15T23:14:09.945Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2023-12-15T23:14:16.536 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.536 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.536 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.536 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.536 DEBUG:boto:Method: GET 2023-12-15T23:14:16.536 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.536 DEBUG:boto:Data: 2023-12-15T23:14:16.537 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.537 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.537 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.537 DEBUG:boto:Params: {} 2023-12-15T23:14:16.537 DEBUG:boto:Token: None 2023-12-15T23:14:16.537 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ= 2023-12-15T23:14:16.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000614e07140e2ef3d5-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.540 DEBUG:boto:Method: GET 2023-12-15T23:14:16.540 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.540 DEBUG:boto:Data: 2023-12-15T23:14:16.540 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.540 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.540 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.540 DEBUG:boto:Params: {} 2023-12-15T23:14:16.541 DEBUG:boto:Token: None 2023-12-15T23:14:16.541 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.541 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ= 2023-12-15T23:14:16.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001baaff588018771c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.585 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.586 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.586 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.586 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.586 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.586 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.586 DEBUG:boto:Data: 2023-12-15T23:14:16.586 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.586 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.586 DEBUG:boto:Params: {} 2023-12-15T23:14:16.586 DEBUG:boto:Token: None 2023-12-15T23:14:16.587 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5APTtEMh5EmvvNH59bgyIiyb6Xo= 2023-12-15T23:14:16.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5APTtEMh5EmvvNH59bgyIiyb6Xo=', 'Content-Length': '0'} 2023-12-15T23:14:16.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e571ee9e200d9128-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.589 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.589 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.589 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.589 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.589 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.589 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.589 DEBUG:boto:Data: 2023-12-15T23:14:16.590 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.590 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.590 DEBUG:boto:Params: {} 2023-12-15T23:14:16.590 DEBUG:boto:Token: None 2023-12-15T23:14:16.590 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5APTtEMh5EmvvNH59bgyIiyb6Xo= 2023-12-15T23:14:16.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5APTtEMh5EmvvNH59bgyIiyb6Xo=', 'Content-Length': '0'} 2023-12-15T23:14:16.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077e2d38339cf31ba-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2023-12-15T23:14:16.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.593 DEBUG:boto:Method: GET 2023-12-15T23:14:16.593 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.593 DEBUG:boto:Data: 2023-12-15T23:14:16.593 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.593 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.593 DEBUG:boto:Params: {} 2023-12-15T23:14:16.593 DEBUG:boto:Token: None 2023-12-15T23:14:16.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ= 2023-12-15T23:14:16.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb8413f14a6525d7-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.596 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.596 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.596 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.596 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.596 DEBUG:boto:Method: GET 2023-12-15T23:14:16.596 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.596 DEBUG:boto:Data: 2023-12-15T23:14:16.596 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.596 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.596 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.597 DEBUG:boto:Params: {} 2023-12-15T23:14:16.597 DEBUG:boto:Token: None 2023-12-15T23:14:16.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021?versionId=null 2023-12-15T23:14:16.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ= 2023-12-15T23:14:16.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gLsBridolgMR3TYO8pbn06qTyEQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008965e2fb5a9ca7ad-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.599 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.599 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.599 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.599 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.599 DEBUG:boto:Method: GET 2023-12-15T23:14:16.599 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.599 DEBUG:boto:Data: 2023-12-15T23:14:16.599 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.599 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.599 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.600 DEBUG:boto:Params: {} 2023-12-15T23:14:16.600 DEBUG:boto:Token: None 2023-12-15T23:14:16.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a57cf7d8c90960a-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.603 DEBUG:boto:b'kskgfn-48obj000000000000000000211000falseobj000000000000000000212023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.603 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.603 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.603 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.603 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.603 DEBUG:boto:Method: GET 2023-12-15T23:14:16.603 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.603 DEBUG:boto:Data: 2023-12-15T23:14:16.603 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.604 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.604 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.604 DEBUG:boto:Params: {} 2023-12-15T23:14:16.604 DEBUG:boto:Token: None 2023-12-15T23:14:16.604 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f541663b5c51db2-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.608 DEBUG:boto:b'kskgfn-48obj000000000000000000211000falseobj000000000000000000212023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.608 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.608 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.608 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.608 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.608 DEBUG:boto:Data: 2023-12-15T23:14:16.608 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.609 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.609 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.609 DEBUG:boto:Params: {} 2023-12-15T23:14:16.609 DEBUG:boto:Token: None 2023-12-15T23:14:16.609 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nI0r5pxKotr+7dsxx4z9REARht0= 2023-12-15T23:14:16.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nI0r5pxKotr+7dsxx4z9REARht0=', 'Content-Length': '0'} 2023-12-15T23:14:16.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aacc77220019b9c-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.611 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.611 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.611 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.611 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.611 DEBUG:boto:Data: 2023-12-15T23:14:16.611 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.612 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.612 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.612 DEBUG:boto:Params: {} 2023-12-15T23:14:16.612 DEBUG:boto:Token: None 2023-12-15T23:14:16.612 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.612 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nI0r5pxKotr+7dsxx4z9REARht0= 2023-12-15T23:14:16.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nI0r5pxKotr+7dsxx4z9REARht0=', 'Content-Length': '0'} 2023-12-15T23:14:16.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c54854810a4162c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2023-12-15T23:14:16.614 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.614 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.614 DEBUG:boto:Method: GET 2023-12-15T23:14:16.615 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.615 DEBUG:boto:Data: 2023-12-15T23:14:16.615 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.615 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.615 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.615 DEBUG:boto:Params: {} 2023-12-15T23:14:16.615 DEBUG:boto:Token: None 2023-12-15T23:14:16.615 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TOR2LAtraQIAXb2rAWuhEbDcxW0= 2023-12-15T23:14:16.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TOR2LAtraQIAXb2rAWuhEbDcxW0=', 'Content-Length': '0'} 2023-12-15T23:14:16.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e22c2bf6fb47d487-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.665 DEBUG:boto:path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.666 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.666 DEBUG:boto:Method: GET 2023-12-15T23:14:16.666 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.666 DEBUG:boto:Data: 2023-12-15T23:14:16.666 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.666 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.666 DEBUG:boto:Params: {} 2023-12-15T23:14:16.666 DEBUG:boto:Token: None 2023-12-15T23:14:16.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000021 2023-12-15T23:14:16.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TOR2LAtraQIAXb2rAWuhEbDcxW0= 2023-12-15T23:14:16.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TOR2LAtraQIAXb2rAWuhEbDcxW0=', 'Content-Length': '0'} 2023-12-15T23:14:16.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a641e18dc57daf2-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.669 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.669 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.669 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.669 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.670 DEBUG:boto:Method: GET 2023-12-15T23:14:16.670 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.670 DEBUG:boto:Data: 2023-12-15T23:14:16.670 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.670 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.670 DEBUG:boto:Params: {} 2023-12-15T23:14:16.670 DEBUG:boto:Token: None 2023-12-15T23:14:16.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e2a23748854e87a-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.673 DEBUG:boto:b'kskgfn-48obj000000000000000000211000falseobj000000000000000000212023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.673 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.673 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.673 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.673 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.674 DEBUG:boto:Method: GET 2023-12-15T23:14:16.674 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000021 2023-12-15T23:14:16.674 DEBUG:boto:Data: 2023-12-15T23:14:16.674 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.674 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.674 DEBUG:boto:Params: {} 2023-12-15T23:14:16.674 DEBUG:boto:Token: None 2023-12-15T23:14:16.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0558ed0a0d2ab6b-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.678 DEBUG:boto:b'kskgfn-48obj000000000000000000211000falseobj000000000000000000212023-12-15T23:14:09.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2023-12-15T23:14:16.678 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.678 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.679 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.679 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.679 DEBUG:boto:Method: GET 2023-12-15T23:14:16.679 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.679 DEBUG:boto:Data: 2023-12-15T23:14:16.679 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.679 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.679 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.679 DEBUG:boto:Params: {} 2023-12-15T23:14:16.679 DEBUG:boto:Token: None 2023-12-15T23:14:16.679 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0= 2023-12-15T23:14:16.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0=', 'Content-Length': '0'} 2023-12-15T23:14:16.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007567c0d407abf9f3-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.682 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.682 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.683 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.683 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.683 DEBUG:boto:Method: GET 2023-12-15T23:14:16.683 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.683 DEBUG:boto:Data: 2023-12-15T23:14:16.683 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.683 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.683 DEBUG:boto:Params: {} 2023-12-15T23:14:16.683 DEBUG:boto:Token: None 2023-12-15T23:14:16.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.684 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0= 2023-12-15T23:14:16.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0=', 'Content-Length': '0'} 2023-12-15T23:14:16.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cd22d86e20faa6c-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.729 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.730 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.730 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.730 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.730 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.730 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.730 DEBUG:boto:Data: 2023-12-15T23:14:16.730 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.730 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.730 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.730 DEBUG:boto:Params: {} 2023-12-15T23:14:16.730 DEBUG:boto:Token: None 2023-12-15T23:14:16.731 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K2JEmKder7ZbqLiHr/34sqbfaqQ= 2023-12-15T23:14:16.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K2JEmKder7ZbqLiHr/34sqbfaqQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093a34b8fbce0ea9b-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.733 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.734 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.734 DEBUG:boto:Data: 2023-12-15T23:14:16.734 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.734 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.734 DEBUG:boto:Params: {} 2023-12-15T23:14:16.734 DEBUG:boto:Token: None 2023-12-15T23:14:16.734 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K2JEmKder7ZbqLiHr/34sqbfaqQ= 2023-12-15T23:14:16.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K2JEmKder7ZbqLiHr/34sqbfaqQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1793d0e374d8975-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.737 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2023-12-15T23:14:16.737 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.737 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.737 DEBUG:boto:Method: GET 2023-12-15T23:14:16.737 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.737 DEBUG:boto:Data: 2023-12-15T23:14:16.737 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.737 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.738 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.738 DEBUG:boto:Params: {} 2023-12-15T23:14:16.738 DEBUG:boto:Token: None 2023-12-15T23:14:16.738 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0= 2023-12-15T23:14:16.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0=', 'Content-Length': '0'} 2023-12-15T23:14:16.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cb8a7e34b4a515f-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.740 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.740 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.741 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.741 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.741 DEBUG:boto:Method: GET 2023-12-15T23:14:16.741 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.741 DEBUG:boto:Data: 2023-12-15T23:14:16.741 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.741 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.741 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.741 DEBUG:boto:Params: {} 2023-12-15T23:14:16.741 DEBUG:boto:Token: None 2023-12-15T23:14:16.742 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022?versionId=null 2023-12-15T23:14:16.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0= 2023-12-15T23:14:16.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ds6M09WGIvKCgpjb2/Uy+EQ/oq0=', 'Content-Length': '0'} 2023-12-15T23:14:16.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b60746ef5769d7a2-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.744 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.744 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.745 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.745 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.745 DEBUG:boto:Method: GET 2023-12-15T23:14:16.745 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.745 DEBUG:boto:Data: 2023-12-15T23:14:16.745 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.745 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.745 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.745 DEBUG:boto:Params: {} 2023-12-15T23:14:16.745 DEBUG:boto:Token: None 2023-12-15T23:14:16.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e765cf87fcbc2e1-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.748 DEBUG:boto:b'kskgfn-48obj000000000000000000221000falseobj000000000000000000222023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.748 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.748 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.749 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.749 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.749 DEBUG:boto:Method: GET 2023-12-15T23:14:16.749 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.749 DEBUG:boto:Data: 2023-12-15T23:14:16.749 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.749 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.749 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.749 DEBUG:boto:Params: {} 2023-12-15T23:14:16.749 DEBUG:boto:Token: None 2023-12-15T23:14:16.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015c1d7507b36c6bc-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.753 DEBUG:boto:b'kskgfn-48obj000000000000000000221000falseobj000000000000000000222023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.754 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.754 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.754 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.754 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.754 DEBUG:boto:Data: 2023-12-15T23:14:16.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.754 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.754 DEBUG:boto:Params: {} 2023-12-15T23:14:16.755 DEBUG:boto:Token: None 2023-12-15T23:14:16.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QInIi+Ht/puhqV7y3H/FFHXfv8s= 2023-12-15T23:14:16.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QInIi+Ht/puhqV7y3H/FFHXfv8s=', 'Content-Length': '0'} 2023-12-15T23:14:16.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000231a5b4f22587923-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.757 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.757 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.757 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.758 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.758 DEBUG:boto:Data: 2023-12-15T23:14:16.758 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.758 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.758 DEBUG:boto:Params: {} 2023-12-15T23:14:16.758 DEBUG:boto:Token: None 2023-12-15T23:14:16.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QInIi+Ht/puhqV7y3H/FFHXfv8s= 2023-12-15T23:14:16.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QInIi+Ht/puhqV7y3H/FFHXfv8s=', 'Content-Length': '0'} 2023-12-15T23:14:16.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003697ab26646ce7ec-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2023-12-15T23:14:16.761 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.761 DEBUG:boto:Method: GET 2023-12-15T23:14:16.761 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.761 DEBUG:boto:Data: 2023-12-15T23:14:16.761 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.762 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.762 DEBUG:boto:Params: {} 2023-12-15T23:14:16.762 DEBUG:boto:Token: None 2023-12-15T23:14:16.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u10pnVhpFSw9DEm94Duz2F2Coio= 2023-12-15T23:14:16.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u10pnVhpFSw9DEm94Duz2F2Coio=', 'Content-Length': '0'} 2023-12-15T23:14:16.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009705365b525572b-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.764 DEBUG:boto:path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.765 DEBUG:boto:Method: GET 2023-12-15T23:14:16.765 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.765 DEBUG:boto:Data: 2023-12-15T23:14:16.765 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.765 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.765 DEBUG:boto:Params: {} 2023-12-15T23:14:16.765 DEBUG:boto:Token: None 2023-12-15T23:14:16.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000022 2023-12-15T23:14:16.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u10pnVhpFSw9DEm94Duz2F2Coio= 2023-12-15T23:14:16.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u10pnVhpFSw9DEm94Duz2F2Coio=', 'Content-Length': '0'} 2023-12-15T23:14:16.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067267710000d4cac-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.768 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.768 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.768 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.768 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.768 DEBUG:boto:Method: GET 2023-12-15T23:14:16.768 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.769 DEBUG:boto:Data: 2023-12-15T23:14:16.769 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.769 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.769 DEBUG:boto:Params: {} 2023-12-15T23:14:16.769 DEBUG:boto:Token: None 2023-12-15T23:14:16.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4e5b90ab81b9975-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.772 DEBUG:boto:b'kskgfn-48obj000000000000000000221000falseobj000000000000000000222023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.772 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.772 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.772 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.772 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.772 DEBUG:boto:Method: GET 2023-12-15T23:14:16.772 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000022 2023-12-15T23:14:16.773 DEBUG:boto:Data: 2023-12-15T23:14:16.773 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.773 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.773 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.773 DEBUG:boto:Params: {} 2023-12-15T23:14:16.773 DEBUG:boto:Token: None 2023-12-15T23:14:16.773 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfab1705143f9bf2-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.777 DEBUG:boto:b'kskgfn-48obj000000000000000000221000falseobj000000000000000000222023-12-15T23:14:07.807Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2023-12-15T23:14:16.778 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.778 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.778 DEBUG:boto:Method: GET 2023-12-15T23:14:16.778 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.778 DEBUG:boto:Data: 2023-12-15T23:14:16.778 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.778 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.778 DEBUG:boto:Params: {} 2023-12-15T23:14:16.778 DEBUG:boto:Token: None 2023-12-15T23:14:16.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM= 2023-12-15T23:14:16.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM=', 'Content-Length': '0'} 2023-12-15T23:14:16.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cdc64367eff3748-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.781 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.781 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.781 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.781 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.782 DEBUG:boto:Method: GET 2023-12-15T23:14:16.782 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.782 DEBUG:boto:Data: 2023-12-15T23:14:16.782 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.782 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.782 DEBUG:boto:Params: {} 2023-12-15T23:14:16.782 DEBUG:boto:Token: None 2023-12-15T23:14:16.782 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM= 2023-12-15T23:14:16.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM=', 'Content-Length': '0'} 2023-12-15T23:14:16.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7388338017ef306-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.785 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.785 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.785 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.785 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.785 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.785 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.785 DEBUG:boto:Data: 2023-12-15T23:14:16.785 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.785 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.785 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.786 DEBUG:boto:Params: {} 2023-12-15T23:14:16.786 DEBUG:boto:Token: None 2023-12-15T23:14:16.786 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:44k6V+ofvnoaZ6rxea94v9MTrIs= 2023-12-15T23:14:16.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:44k6V+ofvnoaZ6rxea94v9MTrIs=', 'Content-Length': '0'} 2023-12-15T23:14:16.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9f0363e6b35199a-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.788 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.788 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.788 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.788 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.788 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.789 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.789 DEBUG:boto:Data: 2023-12-15T23:14:16.789 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.789 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.789 DEBUG:boto:Params: {} 2023-12-15T23:14:16.789 DEBUG:boto:Token: None 2023-12-15T23:14:16.789 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:44k6V+ofvnoaZ6rxea94v9MTrIs= 2023-12-15T23:14:16.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:44k6V+ofvnoaZ6rxea94v9MTrIs=', 'Content-Length': '0'} 2023-12-15T23:14:16.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f57037635ecbbb27-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2023-12-15T23:14:16.792 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.792 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.792 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.792 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.792 DEBUG:boto:Method: GET 2023-12-15T23:14:16.792 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.793 DEBUG:boto:Data: 2023-12-15T23:14:16.793 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.793 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.793 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.793 DEBUG:boto:Params: {} 2023-12-15T23:14:16.793 DEBUG:boto:Token: None 2023-12-15T23:14:16.793 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.793 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM= 2023-12-15T23:14:16.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM=', 'Content-Length': '0'} 2023-12-15T23:14:16.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab0aac4f67453a1d-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.796 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.796 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.796 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.796 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.796 DEBUG:boto:Method: GET 2023-12-15T23:14:16.796 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.796 DEBUG:boto:Data: 2023-12-15T23:14:16.796 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.796 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.796 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.796 DEBUG:boto:Params: {} 2023-12-15T23:14:16.797 DEBUG:boto:Token: None 2023-12-15T23:14:16.797 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023?versionId=null 2023-12-15T23:14:16.797 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM= 2023-12-15T23:14:16.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCI99EXmMF+Aj4cVYCoyHweFeuM=', 'Content-Length': '0'} 2023-12-15T23:14:16.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000550c7852f72e9ed3-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.799 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.799 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.799 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.799 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.799 DEBUG:boto:Method: GET 2023-12-15T23:14:16.799 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.799 DEBUG:boto:Data: 2023-12-15T23:14:16.800 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.800 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.800 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.800 DEBUG:boto:Params: {} 2023-12-15T23:14:16.800 DEBUG:boto:Token: None 2023-12-15T23:14:16.800 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.800 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086e81e4a469af54f-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.803 DEBUG:boto:b'kskgfn-48obj000000000000000000231000falseobj000000000000000000232023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.803 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.803 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.803 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.803 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.803 DEBUG:boto:Method: GET 2023-12-15T23:14:16.803 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.804 DEBUG:boto:Data: 2023-12-15T23:14:16.804 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.804 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.804 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.804 DEBUG:boto:Params: {} 2023-12-15T23:14:16.804 DEBUG:boto:Token: None 2023-12-15T23:14:16.804 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.804 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094578425a9edc70a-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.808 DEBUG:boto:b'kskgfn-48obj000000000000000000231000falseobj000000000000000000232023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.809 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.809 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.809 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.809 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.809 DEBUG:boto:Data: 2023-12-15T23:14:16.809 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.809 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.809 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.809 DEBUG:boto:Params: {} 2023-12-15T23:14:16.809 DEBUG:boto:Token: None 2023-12-15T23:14:16.810 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KZbJ+7Re2BpAIN8J6Yl+QqSdAaQ= 2023-12-15T23:14:16.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KZbJ+7Re2BpAIN8J6Yl+QqSdAaQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5c3993001f195b0-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.812 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.812 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.812 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.812 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.813 DEBUG:boto:Data: 2023-12-15T23:14:16.813 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.813 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.813 DEBUG:boto:Params: {} 2023-12-15T23:14:16.813 DEBUG:boto:Token: None 2023-12-15T23:14:16.813 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.813 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KZbJ+7Re2BpAIN8J6Yl+QqSdAaQ= 2023-12-15T23:14:16.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KZbJ+7Re2BpAIN8J6Yl+QqSdAaQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009aefcd1fff4b15b7-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2023-12-15T23:14:16.816 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.816 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.816 DEBUG:boto:Method: GET 2023-12-15T23:14:16.816 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.816 DEBUG:boto:Data: 2023-12-15T23:14:16.817 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.817 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.817 DEBUG:boto:Params: {} 2023-12-15T23:14:16.817 DEBUG:boto:Token: None 2023-12-15T23:14:16.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gGSF0h8yCULgjJqIuLiPT0DOSoQ= 2023-12-15T23:14:16.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gGSF0h8yCULgjJqIuLiPT0DOSoQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d773d06d8b25b5a3-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.820 DEBUG:boto:path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.820 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.820 DEBUG:boto:Method: GET 2023-12-15T23:14:16.820 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.820 DEBUG:boto:Data: 2023-12-15T23:14:16.820 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.820 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.820 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.820 DEBUG:boto:Params: {} 2023-12-15T23:14:16.821 DEBUG:boto:Token: None 2023-12-15T23:14:16.821 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000023 2023-12-15T23:14:16.821 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gGSF0h8yCULgjJqIuLiPT0DOSoQ= 2023-12-15T23:14:16.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gGSF0h8yCULgjJqIuLiPT0DOSoQ=', 'Content-Length': '0'} 2023-12-15T23:14:16.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000822a78385bcdb93e-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.865 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.866 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.866 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.866 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.866 DEBUG:boto:Method: GET 2023-12-15T23:14:16.866 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.866 DEBUG:boto:Data: 2023-12-15T23:14:16.866 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.866 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.866 DEBUG:boto:Params: {} 2023-12-15T23:14:16.867 DEBUG:boto:Token: None 2023-12-15T23:14:16.867 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009927a5518f10e6b2-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.869 DEBUG:boto:b'kskgfn-48obj000000000000000000231000falseobj000000000000000000232023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.870 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.870 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.870 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.870 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.870 DEBUG:boto:Method: GET 2023-12-15T23:14:16.870 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000023 2023-12-15T23:14:16.870 DEBUG:boto:Data: 2023-12-15T23:14:16.870 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.870 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.870 DEBUG:boto:Params: {} 2023-12-15T23:14:16.871 DEBUG:boto:Token: None 2023-12-15T23:14:16.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066d9774502e67aaf-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.874 DEBUG:boto:b'kskgfn-48obj000000000000000000231000falseobj000000000000000000232023-12-15T23:14:09.069Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2023-12-15T23:14:16.875 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.875 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.875 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.875 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.875 DEBUG:boto:Method: GET 2023-12-15T23:14:16.875 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.875 DEBUG:boto:Data: 2023-12-15T23:14:16.876 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.876 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.876 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.876 DEBUG:boto:Params: {} 2023-12-15T23:14:16.876 DEBUG:boto:Token: None 2023-12-15T23:14:16.876 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.876 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI= 2023-12-15T23:14:16.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI=', 'Content-Length': '0'} 2023-12-15T23:14:16.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3632c2eda4a3be7-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.879 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.879 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.879 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.879 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.879 DEBUG:boto:Method: GET 2023-12-15T23:14:16.879 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.879 DEBUG:boto:Data: 2023-12-15T23:14:16.879 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.879 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.879 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.879 DEBUG:boto:Params: {} 2023-12-15T23:14:16.880 DEBUG:boto:Token: None 2023-12-15T23:14:16.880 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.880 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI= 2023-12-15T23:14:16.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI=', 'Content-Length': '0'} 2023-12-15T23:14:16.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f99cbc635bc917a-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.882 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.882 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.882 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.882 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.882 DEBUG:boto:Data: 2023-12-15T23:14:16.882 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.883 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.883 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.883 DEBUG:boto:Params: {} 2023-12-15T23:14:16.883 DEBUG:boto:Token: None 2023-12-15T23:14:16.883 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOvRUSzdYU3Tc2aBw2Kjkyinz/E= 2023-12-15T23:14:16.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOvRUSzdYU3Tc2aBw2Kjkyinz/E=', 'Content-Length': '0'} 2023-12-15T23:14:16.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0cda48656a524ec-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.885 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.885 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.885 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.885 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.886 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.886 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.886 DEBUG:boto:Data: 2023-12-15T23:14:16.886 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.886 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.886 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.886 DEBUG:boto:Params: {} 2023-12-15T23:14:16.886 DEBUG:boto:Token: None 2023-12-15T23:14:16.886 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cOvRUSzdYU3Tc2aBw2Kjkyinz/E= 2023-12-15T23:14:16.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cOvRUSzdYU3Tc2aBw2Kjkyinz/E=', 'Content-Length': '0'} 2023-12-15T23:14:16.888 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046231b62bd2aa082-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2023-12-15T23:14:16.889 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.889 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.889 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.889 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.889 DEBUG:boto:Method: GET 2023-12-15T23:14:16.889 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.889 DEBUG:boto:Data: 2023-12-15T23:14:16.889 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.889 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.889 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.890 DEBUG:boto:Params: {} 2023-12-15T23:14:16.890 DEBUG:boto:Token: None 2023-12-15T23:14:16.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI= 2023-12-15T23:14:16.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI=', 'Content-Length': '0'} 2023-12-15T23:14:16.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003835e76dd502ecc0-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.933 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.934 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.934 DEBUG:boto:Method: GET 2023-12-15T23:14:16.934 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.934 DEBUG:boto:Data: 2023-12-15T23:14:16.934 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.934 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.934 DEBUG:boto:Params: {} 2023-12-15T23:14:16.935 DEBUG:boto:Token: None 2023-12-15T23:14:16.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024?versionId=null 2023-12-15T23:14:16.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI= 2023-12-15T23:14:16.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHXonJ00F93jFafsRl/kDmrQpNI=', 'Content-Length': '0'} 2023-12-15T23:14:16.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083cfc8c0edccdbe3-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.937 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.937 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.937 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.937 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.937 DEBUG:boto:Method: GET 2023-12-15T23:14:16.937 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.937 DEBUG:boto:Data: 2023-12-15T23:14:16.937 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.937 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.938 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.938 DEBUG:boto:Params: {} 2023-12-15T23:14:16.938 DEBUG:boto:Token: None 2023-12-15T23:14:16.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.938 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.940 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006f0f832d0a9dedd-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.940 DEBUG:boto:b'kskgfn-48obj000000000000000000241000falseobj000000000000000000242023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.941 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.941 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.941 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.941 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.941 DEBUG:boto:Method: GET 2023-12-15T23:14:16.941 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.941 DEBUG:boto:Data: 2023-12-15T23:14:16.941 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.942 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.942 DEBUG:boto:Params: {} 2023-12-15T23:14:16.942 DEBUG:boto:Token: None 2023-12-15T23:14:16.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa92800c45e1e39e-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.946 DEBUG:boto:b'kskgfn-48obj000000000000000000241000falseobj000000000000000000242023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.946 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.946 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.946 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.946 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.947 DEBUG:boto:Data: 2023-12-15T23:14:16.947 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.947 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.947 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.947 DEBUG:boto:Params: {} 2023-12-15T23:14:16.947 DEBUG:boto:Token: None 2023-12-15T23:14:16.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ocyTcfLBQEfnRs+FBt6JcctPBE0= 2023-12-15T23:14:16.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ocyTcfLBQEfnRs+FBt6JcctPBE0=', 'Content-Length': '0'} 2023-12-15T23:14:16.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a39339879f01aca4-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.949 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.950 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.950 DEBUG:boto:Method: HEAD 2023-12-15T23:14:16.950 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.950 DEBUG:boto:Data: 2023-12-15T23:14:16.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.950 DEBUG:boto:Params: {} 2023-12-15T23:14:16.950 DEBUG:boto:Token: None 2023-12-15T23:14:16.950 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.950 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ocyTcfLBQEfnRs+FBt6JcctPBE0= 2023-12-15T23:14:16.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ocyTcfLBQEfnRs+FBt6JcctPBE0=', 'Content-Length': '0'} 2023-12-15T23:14:16.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d3d5b18f95ad1ed-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2023-12-15T23:14:16.953 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.953 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.953 DEBUG:boto:Method: GET 2023-12-15T23:14:16.953 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.953 DEBUG:boto:Data: 2023-12-15T23:14:16.953 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.953 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.953 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.953 DEBUG:boto:Params: {} 2023-12-15T23:14:16.953 DEBUG:boto:Token: None 2023-12-15T23:14:16.953 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1/SZFWPhb35EjLkcT1q6OOOI+U= 2023-12-15T23:14:16.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1/SZFWPhb35EjLkcT1q6OOOI+U=', 'Content-Length': '0'} 2023-12-15T23:14:16.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079031a1591404f15-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.956 DEBUG:boto:path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.956 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.956 DEBUG:boto:Method: GET 2023-12-15T23:14:16.956 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.956 DEBUG:boto:Data: 2023-12-15T23:14:16.956 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.956 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.956 DEBUG:boto:Params: {} 2023-12-15T23:14:16.956 DEBUG:boto:Token: None 2023-12-15T23:14:16.957 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000024 2023-12-15T23:14:16.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1/SZFWPhb35EjLkcT1q6OOOI+U= 2023-12-15T23:14:16.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1/SZFWPhb35EjLkcT1q6OOOI+U=', 'Content-Length': '0'} 2023-12-15T23:14:16.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000813d5964c07c94a8-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.959 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.959 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.959 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.959 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.959 DEBUG:boto:Method: GET 2023-12-15T23:14:16.959 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.959 DEBUG:boto:Data: 2023-12-15T23:14:16.959 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.960 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.960 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.960 DEBUG:boto:Params: {} 2023-12-15T23:14:16.960 DEBUG:boto:Token: None 2023-12-15T23:14:16.960 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038ffe6b26d06c4dc-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.963 DEBUG:boto:b'kskgfn-48obj000000000000000000241000falseobj000000000000000000242023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.963 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:16.963 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:16.963 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.963 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.963 DEBUG:boto:Method: GET 2023-12-15T23:14:16.963 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000024 2023-12-15T23:14:16.963 DEBUG:boto:Data: 2023-12-15T23:14:16.964 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.964 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.964 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.964 DEBUG:boto:Params: {} 2023-12-15T23:14:16.964 DEBUG:boto:Token: None 2023-12-15T23:14:16.964 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/ 2023-12-15T23:14:16.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU= 2023-12-15T23:14:16.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kqEJpBLthA3HEnmSfVcOLExYXlU=', 'Content-Length': '0'} 2023-12-15T23:14:16.968 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e052ff13d0886e5e-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.968 DEBUG:boto:b'kskgfn-48obj000000000000000000241000falseobj000000000000000000242023-12-15T23:14:10.748Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:16.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2023-12-15T23:14:16.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:16.968 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:16.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.969 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.969 DEBUG:boto:Method: GET 2023-12-15T23:14:16.969 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.969 DEBUG:boto:Data: 2023-12-15T23:14:16.969 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.969 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:16.969 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.969 DEBUG:boto:Params: {} 2023-12-15T23:14:16.969 DEBUG:boto:Token: None 2023-12-15T23:14:16.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.969 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ywe8Ppdi0voqUfn9OVbwfs1B7wA= 2023-12-15T23:14:16.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ywe8Ppdi0voqUfn9OVbwfs1B7wA=', 'Content-Length': '0'} 2023-12-15T23:14:16.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b7378bec62b647d-00657cddc8-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:16.972 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:16.972 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:16.972 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.972 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.972 DEBUG:boto:Method: GET 2023-12-15T23:14:16.972 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.973 DEBUG:boto:Data: 2023-12-15T23:14:16.973 DEBUG:boto:Headers: {} 2023-12-15T23:14:16.973 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:16.973 DEBUG:boto:Port: 8000 2023-12-15T23:14:16.973 DEBUG:boto:Params: {} 2023-12-15T23:14:16.973 DEBUG:boto:Token: None 2023-12-15T23:14:16.973 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:16 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:16.973 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ywe8Ppdi0voqUfn9OVbwfs1B7wA= 2023-12-15T23:14:16.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ywe8Ppdi0voqUfn9OVbwfs1B7wA=', 'Content-Length': '0'} 2023-12-15T23:14:16.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000121ac4c16e6c38a7-00657cddc8-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.017 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.018 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.018 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.018 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.018 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.018 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.018 DEBUG:boto:Data: 2023-12-15T23:14:17.018 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.018 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.018 DEBUG:boto:Params: {} 2023-12-15T23:14:17.018 DEBUG:boto:Token: None 2023-12-15T23:14:17.018 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uxeuXtrSpB5XhMvHUUElpUdCH6c= 2023-12-15T23:14:17.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uxeuXtrSpB5XhMvHUUElpUdCH6c=', 'Content-Length': '0'} 2023-12-15T23:14:17.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad3b656c781495be-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.021 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.021 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.021 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.021 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.021 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.021 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.021 DEBUG:boto:Data: 2023-12-15T23:14:17.021 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.021 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.021 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.022 DEBUG:boto:Params: {} 2023-12-15T23:14:17.022 DEBUG:boto:Token: None 2023-12-15T23:14:17.022 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uxeuXtrSpB5XhMvHUUElpUdCH6c= 2023-12-15T23:14:17.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uxeuXtrSpB5XhMvHUUElpUdCH6c=', 'Content-Length': '0'} 2023-12-15T23:14:17.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d79c105a2f7e774f-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2023-12-15T23:14:17.024 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.024 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.024 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.024 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.024 DEBUG:boto:Method: GET 2023-12-15T23:14:17.025 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.025 DEBUG:boto:Data: 2023-12-15T23:14:17.025 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.025 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.025 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.025 DEBUG:boto:Params: {} 2023-12-15T23:14:17.025 DEBUG:boto:Token: None 2023-12-15T23:14:17.025 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.025 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kzs7eEa8+dhRwsXRdTxrOHWHvV0= 2023-12-15T23:14:17.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kzs7eEa8+dhRwsXRdTxrOHWHvV0=', 'Content-Length': '0'} 2023-12-15T23:14:17.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093a978a1e7ba27d5-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.027 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.028 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.028 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.028 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.028 DEBUG:boto:Method: GET 2023-12-15T23:14:17.028 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.028 DEBUG:boto:Data: 2023-12-15T23:14:17.028 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.028 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.028 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.028 DEBUG:boto:Params: {} 2023-12-15T23:14:17.028 DEBUG:boto:Token: None 2023-12-15T23:14:17.028 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025?versionId=null 2023-12-15T23:14:17.029 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kzs7eEa8+dhRwsXRdTxrOHWHvV0= 2023-12-15T23:14:17.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kzs7eEa8+dhRwsXRdTxrOHWHvV0=', 'Content-Length': '0'} 2023-12-15T23:14:17.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bad8151c956c2ee-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.031 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.031 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.031 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.031 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.031 DEBUG:boto:Method: GET 2023-12-15T23:14:17.031 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.031 DEBUG:boto:Data: 2023-12-15T23:14:17.031 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.031 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.031 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.031 DEBUG:boto:Params: {} 2023-12-15T23:14:17.031 DEBUG:boto:Token: None 2023-12-15T23:14:17.032 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.032 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b485cceca68cc69-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.034 DEBUG:boto:b'kskgfn-48obj000000000000000000251000falseobj000000000000000000252023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.035 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.035 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.035 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.035 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.035 DEBUG:boto:Method: GET 2023-12-15T23:14:17.035 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.035 DEBUG:boto:Data: 2023-12-15T23:14:17.035 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.035 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.035 DEBUG:boto:Params: {} 2023-12-15T23:14:17.036 DEBUG:boto:Token: None 2023-12-15T23:14:17.036 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.036 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.039 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031e577e258ae4573-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.039 DEBUG:boto:b'kskgfn-48obj000000000000000000251000falseobj000000000000000000252023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.040 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.040 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.040 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.040 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.040 DEBUG:boto:Data: 2023-12-15T23:14:17.040 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.040 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.040 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.040 DEBUG:boto:Params: {} 2023-12-15T23:14:17.041 DEBUG:boto:Token: None 2023-12-15T23:14:17.041 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pXIEPS3O1smkUjhlfAGZaCmka/0= 2023-12-15T23:14:17.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pXIEPS3O1smkUjhlfAGZaCmka/0=', 'Content-Length': '0'} 2023-12-15T23:14:17.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dca501923783dea9-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.043 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.043 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.043 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.043 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.043 DEBUG:boto:Data: 2023-12-15T23:14:17.043 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.043 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.043 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.043 DEBUG:boto:Params: {} 2023-12-15T23:14:17.044 DEBUG:boto:Token: None 2023-12-15T23:14:17.044 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.044 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pXIEPS3O1smkUjhlfAGZaCmka/0= 2023-12-15T23:14:17.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pXIEPS3O1smkUjhlfAGZaCmka/0=', 'Content-Length': '0'} 2023-12-15T23:14:17.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abe858d316a06383-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.046 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2023-12-15T23:14:17.046 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.046 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.046 DEBUG:boto:Method: GET 2023-12-15T23:14:17.046 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.046 DEBUG:boto:Data: 2023-12-15T23:14:17.046 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.046 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.046 DEBUG:boto:Params: {} 2023-12-15T23:14:17.047 DEBUG:boto:Token: None 2023-12-15T23:14:17.047 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RVPIosu2sKTsNrIBo/nAz/5HCMc= 2023-12-15T23:14:17.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RVPIosu2sKTsNrIBo/nAz/5HCMc=', 'Content-Length': '0'} 2023-12-15T23:14:17.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2278d549cc3cb71-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.089 DEBUG:boto:path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.090 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.090 DEBUG:boto:Method: GET 2023-12-15T23:14:17.090 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.090 DEBUG:boto:Data: 2023-12-15T23:14:17.090 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.090 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.090 DEBUG:boto:Params: {} 2023-12-15T23:14:17.090 DEBUG:boto:Token: None 2023-12-15T23:14:17.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000025 2023-12-15T23:14:17.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RVPIosu2sKTsNrIBo/nAz/5HCMc= 2023-12-15T23:14:17.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RVPIosu2sKTsNrIBo/nAz/5HCMc=', 'Content-Length': '0'} 2023-12-15T23:14:17.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052ea0dbcbcb10b47-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.093 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.093 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.093 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.093 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.093 DEBUG:boto:Method: GET 2023-12-15T23:14:17.093 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.093 DEBUG:boto:Data: 2023-12-15T23:14:17.093 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.093 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.093 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.093 DEBUG:boto:Params: {} 2023-12-15T23:14:17.094 DEBUG:boto:Token: None 2023-12-15T23:14:17.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.096 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008417c53558cb735a-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.096 DEBUG:boto:b'kskgfn-48obj000000000000000000251000falseobj000000000000000000252023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.097 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.097 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.097 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.097 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.097 DEBUG:boto:Method: GET 2023-12-15T23:14:17.097 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000025 2023-12-15T23:14:17.097 DEBUG:boto:Data: 2023-12-15T23:14:17.097 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.097 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.097 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.097 DEBUG:boto:Params: {} 2023-12-15T23:14:17.098 DEBUG:boto:Token: None 2023-12-15T23:14:17.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008dafca416952584f-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.101 DEBUG:boto:b'kskgfn-48obj000000000000000000251000falseobj000000000000000000252023-12-15T23:14:08.019Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.102 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2023-12-15T23:14:17.102 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.102 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.102 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.102 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.102 DEBUG:boto:Method: GET 2023-12-15T23:14:17.102 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.102 DEBUG:boto:Data: 2023-12-15T23:14:17.102 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.103 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.103 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.103 DEBUG:boto:Params: {} 2023-12-15T23:14:17.103 DEBUG:boto:Token: None 2023-12-15T23:14:17.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU= 2023-12-15T23:14:17.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU=', 'Content-Length': '0'} 2023-12-15T23:14:17.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001228cf95a205d5fd-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.105 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.105 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.106 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.106 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.106 DEBUG:boto:Method: GET 2023-12-15T23:14:17.106 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.106 DEBUG:boto:Data: 2023-12-15T23:14:17.106 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.106 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.106 DEBUG:boto:Params: {} 2023-12-15T23:14:17.106 DEBUG:boto:Token: None 2023-12-15T23:14:17.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU= 2023-12-15T23:14:17.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU=', 'Content-Length': '0'} 2023-12-15T23:14:17.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000376aec01bbadfab8-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.109 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.109 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.109 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.109 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.109 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.110 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.110 DEBUG:boto:Data: 2023-12-15T23:14:17.110 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.110 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.110 DEBUG:boto:Params: {} 2023-12-15T23:14:17.110 DEBUG:boto:Token: None 2023-12-15T23:14:17.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BCCEo+kNpau1L4IdLO04xvGb+CU= 2023-12-15T23:14:17.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BCCEo+kNpau1L4IdLO04xvGb+CU=', 'Content-Length': '0'} 2023-12-15T23:14:17.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a71613c29886dc3-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.112 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.112 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.112 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.113 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.113 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.113 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.113 DEBUG:boto:Data: 2023-12-15T23:14:17.113 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.113 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.113 DEBUG:boto:Params: {} 2023-12-15T23:14:17.113 DEBUG:boto:Token: None 2023-12-15T23:14:17.113 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BCCEo+kNpau1L4IdLO04xvGb+CU= 2023-12-15T23:14:17.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BCCEo+kNpau1L4IdLO04xvGb+CU=', 'Content-Length': '0'} 2023-12-15T23:14:17.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cd81a15ebd12b98-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2023-12-15T23:14:17.116 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.116 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.116 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.116 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.116 DEBUG:boto:Method: GET 2023-12-15T23:14:17.116 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.116 DEBUG:boto:Data: 2023-12-15T23:14:17.117 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.117 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.117 DEBUG:boto:Params: {} 2023-12-15T23:14:17.117 DEBUG:boto:Token: None 2023-12-15T23:14:17.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU= 2023-12-15T23:14:17.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU=', 'Content-Length': '0'} 2023-12-15T23:14:17.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffceb67b3925caba-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.119 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.119 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.120 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.120 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.120 DEBUG:boto:Method: GET 2023-12-15T23:14:17.120 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.120 DEBUG:boto:Data: 2023-12-15T23:14:17.120 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.120 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.120 DEBUG:boto:Params: {} 2023-12-15T23:14:17.120 DEBUG:boto:Token: None 2023-12-15T23:14:17.120 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026?versionId=null 2023-12-15T23:14:17.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU= 2023-12-15T23:14:17.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L70vDE9GJ4XyzaBNgqYPhq8LKbU=', 'Content-Length': '0'} 2023-12-15T23:14:17.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006a085500e9ec192-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.123 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.123 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.123 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.123 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.123 DEBUG:boto:Method: GET 2023-12-15T23:14:17.123 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.123 DEBUG:boto:Data: 2023-12-15T23:14:17.124 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.124 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.124 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.124 DEBUG:boto:Params: {} 2023-12-15T23:14:17.124 DEBUG:boto:Token: None 2023-12-15T23:14:17.124 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e365eb0f62c25ab8-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.127 DEBUG:boto:b'kskgfn-48obj000000000000000000261000falseobj000000000000000000262023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.127 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.127 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.127 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.127 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.127 DEBUG:boto:Method: GET 2023-12-15T23:14:17.127 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.128 DEBUG:boto:Data: 2023-12-15T23:14:17.128 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.128 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.128 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.128 DEBUG:boto:Params: {} 2023-12-15T23:14:17.128 DEBUG:boto:Token: None 2023-12-15T23:14:17.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b468f2b3da8b0a46-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.132 DEBUG:boto:b'kskgfn-48obj000000000000000000261000falseobj000000000000000000262023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.133 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.133 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.133 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.133 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.133 DEBUG:boto:Data: 2023-12-15T23:14:17.133 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.133 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.133 DEBUG:boto:Params: {} 2023-12-15T23:14:17.134 DEBUG:boto:Token: None 2023-12-15T23:14:17.134 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmXerWdrhqfNeuXG0iCpqv66xS4= 2023-12-15T23:14:17.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmXerWdrhqfNeuXG0iCpqv66xS4=', 'Content-Length': '0'} 2023-12-15T23:14:17.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ff32e960d2391f6-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.136 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.136 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.136 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.136 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.136 DEBUG:boto:Data: 2023-12-15T23:14:17.136 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.136 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.136 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.136 DEBUG:boto:Params: {} 2023-12-15T23:14:17.137 DEBUG:boto:Token: None 2023-12-15T23:14:17.137 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.137 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kmXerWdrhqfNeuXG0iCpqv66xS4= 2023-12-15T23:14:17.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kmXerWdrhqfNeuXG0iCpqv66xS4=', 'Content-Length': '0'} 2023-12-15T23:14:17.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000397b6e52c725287-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.139 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2023-12-15T23:14:17.139 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.139 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.139 DEBUG:boto:Method: GET 2023-12-15T23:14:17.139 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.139 DEBUG:boto:Data: 2023-12-15T23:14:17.139 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.139 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.140 DEBUG:boto:Params: {} 2023-12-15T23:14:17.140 DEBUG:boto:Token: None 2023-12-15T23:14:17.140 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.140 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iN5ie0pRL5l6jpKVoGgJ3f6JZhw= 2023-12-15T23:14:17.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iN5ie0pRL5l6jpKVoGgJ3f6JZhw=', 'Content-Length': '0'} 2023-12-15T23:14:17.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e99816b75999f7a3-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.142 DEBUG:boto:path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.142 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.142 DEBUG:boto:Method: GET 2023-12-15T23:14:17.142 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.143 DEBUG:boto:Data: 2023-12-15T23:14:17.143 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.143 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.143 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.143 DEBUG:boto:Params: {} 2023-12-15T23:14:17.143 DEBUG:boto:Token: None 2023-12-15T23:14:17.143 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000026 2023-12-15T23:14:17.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iN5ie0pRL5l6jpKVoGgJ3f6JZhw= 2023-12-15T23:14:17.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iN5ie0pRL5l6jpKVoGgJ3f6JZhw=', 'Content-Length': '0'} 2023-12-15T23:14:17.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005945b9b07c2e60af-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.186 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.186 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.186 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.186 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.186 DEBUG:boto:Method: GET 2023-12-15T23:14:17.186 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.186 DEBUG:boto:Data: 2023-12-15T23:14:17.186 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.187 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.187 DEBUG:boto:Params: {} 2023-12-15T23:14:17.187 DEBUG:boto:Token: None 2023-12-15T23:14:17.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000994ddbb127efbe9a-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.190 DEBUG:boto:b'kskgfn-48obj000000000000000000261000falseobj000000000000000000262023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.190 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.190 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.190 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.191 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.191 DEBUG:boto:Method: GET 2023-12-15T23:14:17.191 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000026 2023-12-15T23:14:17.191 DEBUG:boto:Data: 2023-12-15T23:14:17.191 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.191 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.191 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.191 DEBUG:boto:Params: {} 2023-12-15T23:14:17.191 DEBUG:boto:Token: None 2023-12-15T23:14:17.192 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.192 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.195 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088bfec843d8441f7-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.195 DEBUG:boto:b'kskgfn-48obj000000000000000000261000falseobj000000000000000000262023-12-15T23:14:10.808Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2023-12-15T23:14:17.196 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.196 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.196 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.196 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.196 DEBUG:boto:Method: GET 2023-12-15T23:14:17.196 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.196 DEBUG:boto:Data: 2023-12-15T23:14:17.197 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.197 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.197 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.197 DEBUG:boto:Params: {} 2023-12-15T23:14:17.197 DEBUG:boto:Token: None 2023-12-15T23:14:17.197 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs= 2023-12-15T23:14:17.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs=', 'Content-Length': '0'} 2023-12-15T23:14:17.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000623f86b0684aabe4-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.241 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.242 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.242 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.242 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.242 DEBUG:boto:Method: GET 2023-12-15T23:14:17.242 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.242 DEBUG:boto:Data: 2023-12-15T23:14:17.242 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.243 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.243 DEBUG:boto:Params: {} 2023-12-15T23:14:17.243 DEBUG:boto:Token: None 2023-12-15T23:14:17.243 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.243 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs= 2023-12-15T23:14:17.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs=', 'Content-Length': '0'} 2023-12-15T23:14:17.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c18bcff4fdd7d2d6-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.246 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.246 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.246 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.246 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.246 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.247 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.247 DEBUG:boto:Data: 2023-12-15T23:14:17.247 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.247 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.247 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.247 DEBUG:boto:Params: {} 2023-12-15T23:14:17.247 DEBUG:boto:Token: None 2023-12-15T23:14:17.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8VHrwb4aaBj9ufWLig76IXH4huc= 2023-12-15T23:14:17.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8VHrwb4aaBj9ufWLig76IXH4huc=', 'Content-Length': '0'} 2023-12-15T23:14:17.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dc3a558b82cc418-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.250 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.250 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.250 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.250 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.250 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.250 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.250 DEBUG:boto:Data: 2023-12-15T23:14:17.251 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.251 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.251 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.251 DEBUG:boto:Params: {} 2023-12-15T23:14:17.251 DEBUG:boto:Token: None 2023-12-15T23:14:17.251 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8VHrwb4aaBj9ufWLig76IXH4huc= 2023-12-15T23:14:17.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8VHrwb4aaBj9ufWLig76IXH4huc=', 'Content-Length': '0'} 2023-12-15T23:14:17.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018edb83059f86abd-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2023-12-15T23:14:17.254 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.254 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.254 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.254 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.254 DEBUG:boto:Method: GET 2023-12-15T23:14:17.255 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.255 DEBUG:boto:Data: 2023-12-15T23:14:17.255 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.255 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.255 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.255 DEBUG:boto:Params: {} 2023-12-15T23:14:17.255 DEBUG:boto:Token: None 2023-12-15T23:14:17.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs= 2023-12-15T23:14:17.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs=', 'Content-Length': '0'} 2023-12-15T23:14:17.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae10df3d731fc003-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.258 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.258 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.258 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.258 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.258 DEBUG:boto:Method: GET 2023-12-15T23:14:17.258 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.258 DEBUG:boto:Data: 2023-12-15T23:14:17.258 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.259 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.259 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.259 DEBUG:boto:Params: {} 2023-12-15T23:14:17.259 DEBUG:boto:Token: None 2023-12-15T23:14:17.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027?versionId=null 2023-12-15T23:14:17.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs= 2023-12-15T23:14:17.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z+hGvwS9jKcErpshzlPoNeovnRs=', 'Content-Length': '0'} 2023-12-15T23:14:17.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c66fb0ae83b5b9f9-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.305 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.306 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.306 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.306 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.306 DEBUG:boto:Method: GET 2023-12-15T23:14:17.306 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.306 DEBUG:boto:Data: 2023-12-15T23:14:17.306 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.306 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.306 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.307 DEBUG:boto:Params: {} 2023-12-15T23:14:17.307 DEBUG:boto:Token: None 2023-12-15T23:14:17.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.310 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026224d8a9398f3f2-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.310 DEBUG:boto:b'kskgfn-48obj000000000000000000271000falseobj000000000000000000272023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.310 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.310 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.310 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.311 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.311 DEBUG:boto:Method: GET 2023-12-15T23:14:17.311 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.311 DEBUG:boto:Data: 2023-12-15T23:14:17.311 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.311 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.311 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.311 DEBUG:boto:Params: {} 2023-12-15T23:14:17.311 DEBUG:boto:Token: None 2023-12-15T23:14:17.312 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008d2a340566d3b32-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.315 DEBUG:boto:b'kskgfn-48obj000000000000000000271000falseobj000000000000000000272023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.316 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.316 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.316 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.316 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.316 DEBUG:boto:Data: 2023-12-15T23:14:17.316 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.316 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.317 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.317 DEBUG:boto:Params: {} 2023-12-15T23:14:17.317 DEBUG:boto:Token: None 2023-12-15T23:14:17.317 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0UoA+1Wi6Xt2lOmo3GFOCuk0wqk= 2023-12-15T23:14:17.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0UoA+1Wi6Xt2lOmo3GFOCuk0wqk=', 'Content-Length': '0'} 2023-12-15T23:14:17.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084c021e430e3cb9d-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.320 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.320 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.320 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.320 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.320 DEBUG:boto:Data: 2023-12-15T23:14:17.320 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.320 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.320 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.320 DEBUG:boto:Params: {} 2023-12-15T23:14:17.321 DEBUG:boto:Token: None 2023-12-15T23:14:17.321 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0UoA+1Wi6Xt2lOmo3GFOCuk0wqk= 2023-12-15T23:14:17.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0UoA+1Wi6Xt2lOmo3GFOCuk0wqk=', 'Content-Length': '0'} 2023-12-15T23:14:17.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000095ec835b5d98b39-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2023-12-15T23:14:17.324 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.324 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.324 DEBUG:boto:Method: GET 2023-12-15T23:14:17.324 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.324 DEBUG:boto:Data: 2023-12-15T23:14:17.324 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.324 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.325 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.325 DEBUG:boto:Params: {} 2023-12-15T23:14:17.325 DEBUG:boto:Token: None 2023-12-15T23:14:17.325 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yaTuSY0dRdDc61QLtU07Oba8pac= 2023-12-15T23:14:17.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yaTuSY0dRdDc61QLtU07Oba8pac=', 'Content-Length': '0'} 2023-12-15T23:14:17.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006296a005936ebf75-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.369 DEBUG:boto:path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.370 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.370 DEBUG:boto:Method: GET 2023-12-15T23:14:17.370 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.370 DEBUG:boto:Data: 2023-12-15T23:14:17.370 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.370 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.370 DEBUG:boto:Params: {} 2023-12-15T23:14:17.370 DEBUG:boto:Token: None 2023-12-15T23:14:17.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000027 2023-12-15T23:14:17.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yaTuSY0dRdDc61QLtU07Oba8pac= 2023-12-15T23:14:17.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yaTuSY0dRdDc61QLtU07Oba8pac=', 'Content-Length': '0'} 2023-12-15T23:14:17.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a92dcdd3579332b6-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.373 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.373 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.373 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.374 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.374 DEBUG:boto:Method: GET 2023-12-15T23:14:17.374 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.374 DEBUG:boto:Data: 2023-12-15T23:14:17.374 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.374 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.374 DEBUG:boto:Params: {} 2023-12-15T23:14:17.374 DEBUG:boto:Token: None 2023-12-15T23:14:17.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000669a4d291e17fa56-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.377 DEBUG:boto:b'kskgfn-48obj000000000000000000271000falseobj000000000000000000272023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.378 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.378 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.378 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.378 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.378 DEBUG:boto:Method: GET 2023-12-15T23:14:17.378 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000027 2023-12-15T23:14:17.378 DEBUG:boto:Data: 2023-12-15T23:14:17.378 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.379 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.379 DEBUG:boto:Params: {} 2023-12-15T23:14:17.379 DEBUG:boto:Token: None 2023-12-15T23:14:17.379 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.383 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dde2ea0741754d5-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.383 DEBUG:boto:b'kskgfn-48obj000000000000000000271000falseobj000000000000000000272023-12-15T23:14:09.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2023-12-15T23:14:17.383 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.384 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.384 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.384 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.384 DEBUG:boto:Method: GET 2023-12-15T23:14:17.384 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.384 DEBUG:boto:Data: 2023-12-15T23:14:17.384 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.384 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.384 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.385 DEBUG:boto:Params: {} 2023-12-15T23:14:17.385 DEBUG:boto:Token: None 2023-12-15T23:14:17.385 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw= 2023-12-15T23:14:17.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw=', 'Content-Length': '0'} 2023-12-15T23:14:17.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aaf6667e01aed6f9-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.388 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.388 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.388 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.388 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.388 DEBUG:boto:Method: GET 2023-12-15T23:14:17.388 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.388 DEBUG:boto:Data: 2023-12-15T23:14:17.389 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.389 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.389 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.389 DEBUG:boto:Params: {} 2023-12-15T23:14:17.389 DEBUG:boto:Token: None 2023-12-15T23:14:17.389 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.389 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw= 2023-12-15T23:14:17.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw=', 'Content-Length': '0'} 2023-12-15T23:14:17.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a6b0e342b38be7d-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.433 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.434 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.434 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.434 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.434 DEBUG:boto:Data: 2023-12-15T23:14:17.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.435 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.435 DEBUG:boto:Params: {} 2023-12-15T23:14:17.435 DEBUG:boto:Token: None 2023-12-15T23:14:17.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E23UqCaF20TmQre/GXCgg/ZuWbc= 2023-12-15T23:14:17.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E23UqCaF20TmQre/GXCgg/ZuWbc=', 'Content-Length': '0'} 2023-12-15T23:14:17.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff87edc6ebfb68c4-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.438 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.438 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.438 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.438 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.438 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.438 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.438 DEBUG:boto:Data: 2023-12-15T23:14:17.438 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.439 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.439 DEBUG:boto:Params: {} 2023-12-15T23:14:17.439 DEBUG:boto:Token: None 2023-12-15T23:14:17.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E23UqCaF20TmQre/GXCgg/ZuWbc= 2023-12-15T23:14:17.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E23UqCaF20TmQre/GXCgg/ZuWbc=', 'Content-Length': '0'} 2023-12-15T23:14:17.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b81cd9207b752eef-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2023-12-15T23:14:17.442 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.442 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.442 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.442 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.442 DEBUG:boto:Method: GET 2023-12-15T23:14:17.442 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.443 DEBUG:boto:Data: 2023-12-15T23:14:17.443 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.443 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.443 DEBUG:boto:Params: {} 2023-12-15T23:14:17.443 DEBUG:boto:Token: None 2023-12-15T23:14:17.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw= 2023-12-15T23:14:17.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw=', 'Content-Length': '0'} 2023-12-15T23:14:17.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000947cdeb2d2105c98-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.446 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.446 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.447 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.447 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.447 DEBUG:boto:Method: GET 2023-12-15T23:14:17.447 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.447 DEBUG:boto:Data: 2023-12-15T23:14:17.447 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.447 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.447 DEBUG:boto:Params: {} 2023-12-15T23:14:17.447 DEBUG:boto:Token: None 2023-12-15T23:14:17.448 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028?versionId=null 2023-12-15T23:14:17.448 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw= 2023-12-15T23:14:17.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KqVT7z8MmD+AZJ5wedkAW/MJojw=', 'Content-Length': '0'} 2023-12-15T23:14:17.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d297394b420b9ad3-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.451 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.451 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.451 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.451 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.451 DEBUG:boto:Method: GET 2023-12-15T23:14:17.451 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.451 DEBUG:boto:Data: 2023-12-15T23:14:17.451 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.452 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.452 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.452 DEBUG:boto:Params: {} 2023-12-15T23:14:17.452 DEBUG:boto:Token: None 2023-12-15T23:14:17.452 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.452 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6a6fadd9ea694a8-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.497 DEBUG:boto:b'kskgfn-48obj000000000000000000281000falseobj000000000000000000282023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.498 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.498 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.498 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.498 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.498 DEBUG:boto:Method: GET 2023-12-15T23:14:17.498 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.498 DEBUG:boto:Data: 2023-12-15T23:14:17.499 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.499 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.499 DEBUG:boto:Params: {} 2023-12-15T23:14:17.499 DEBUG:boto:Token: None 2023-12-15T23:14:17.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.503 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000757090f78cba4ebf-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.503 DEBUG:boto:b'kskgfn-48obj000000000000000000281000falseobj000000000000000000282023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.504 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.504 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.504 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.504 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.504 DEBUG:boto:Data: 2023-12-15T23:14:17.504 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.505 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.505 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.505 DEBUG:boto:Params: {} 2023-12-15T23:14:17.505 DEBUG:boto:Token: None 2023-12-15T23:14:17.505 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.505 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7hws2AbWP7DmumrKfyCakBvOWl4= 2023-12-15T23:14:17.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7hws2AbWP7DmumrKfyCakBvOWl4=', 'Content-Length': '0'} 2023-12-15T23:14:17.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdad4a64812cc4e4-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.508 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.508 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.508 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.508 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.508 DEBUG:boto:Data: 2023-12-15T23:14:17.508 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.508 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.509 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.509 DEBUG:boto:Params: {} 2023-12-15T23:14:17.509 DEBUG:boto:Token: None 2023-12-15T23:14:17.509 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.509 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7hws2AbWP7DmumrKfyCakBvOWl4= 2023-12-15T23:14:17.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7hws2AbWP7DmumrKfyCakBvOWl4=', 'Content-Length': '0'} 2023-12-15T23:14:17.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aeb66f73dbcc74e-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2023-12-15T23:14:17.512 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.512 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.512 DEBUG:boto:Method: GET 2023-12-15T23:14:17.512 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.512 DEBUG:boto:Data: 2023-12-15T23:14:17.512 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.512 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.513 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.513 DEBUG:boto:Params: {} 2023-12-15T23:14:17.513 DEBUG:boto:Token: None 2023-12-15T23:14:17.513 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.513 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FDeG4JzJPK6y/slZPipRGgDXikw= 2023-12-15T23:14:17.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FDeG4JzJPK6y/slZPipRGgDXikw=', 'Content-Length': '0'} 2023-12-15T23:14:17.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033a144167275ea42-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.516 DEBUG:boto:path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.516 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.516 DEBUG:boto:Method: GET 2023-12-15T23:14:17.516 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.516 DEBUG:boto:Data: 2023-12-15T23:14:17.516 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.516 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.516 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.516 DEBUG:boto:Params: {} 2023-12-15T23:14:17.517 DEBUG:boto:Token: None 2023-12-15T23:14:17.517 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000028 2023-12-15T23:14:17.517 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FDeG4JzJPK6y/slZPipRGgDXikw= 2023-12-15T23:14:17.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FDeG4JzJPK6y/slZPipRGgDXikw=', 'Content-Length': '0'} 2023-12-15T23:14:17.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069908deb7c6a3d19-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.565 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.566 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.566 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.566 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.566 DEBUG:boto:Method: GET 2023-12-15T23:14:17.566 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.566 DEBUG:boto:Data: 2023-12-15T23:14:17.566 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.566 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.567 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.567 DEBUG:boto:Params: {} 2023-12-15T23:14:17.567 DEBUG:boto:Token: None 2023-12-15T23:14:17.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004480aa55a45c4a13-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.570 DEBUG:boto:b'kskgfn-48obj000000000000000000281000falseobj000000000000000000282023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.570 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.570 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.570 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.570 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.571 DEBUG:boto:Method: GET 2023-12-15T23:14:17.571 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000028 2023-12-15T23:14:17.571 DEBUG:boto:Data: 2023-12-15T23:14:17.571 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.571 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.571 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.571 DEBUG:boto:Params: {} 2023-12-15T23:14:17.571 DEBUG:boto:Token: None 2023-12-15T23:14:17.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.575 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b8069d7a94984e4-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.575 DEBUG:boto:b'kskgfn-48obj000000000000000000281000falseobj000000000000000000282023-12-15T23:14:05.736Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2023-12-15T23:14:17.576 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.576 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.576 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.576 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.576 DEBUG:boto:Method: GET 2023-12-15T23:14:17.577 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.577 DEBUG:boto:Data: 2023-12-15T23:14:17.577 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.577 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.577 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.577 DEBUG:boto:Params: {} 2023-12-15T23:14:17.577 DEBUG:boto:Token: None 2023-12-15T23:14:17.577 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q= 2023-12-15T23:14:17.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q=', 'Content-Length': '0'} 2023-12-15T23:14:17.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cadcf5d2b5ad26eb-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.580 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.580 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.580 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.581 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.581 DEBUG:boto:Method: GET 2023-12-15T23:14:17.581 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.581 DEBUG:boto:Data: 2023-12-15T23:14:17.581 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.581 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.581 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.581 DEBUG:boto:Params: {} 2023-12-15T23:14:17.581 DEBUG:boto:Token: None 2023-12-15T23:14:17.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q= 2023-12-15T23:14:17.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q=', 'Content-Length': '0'} 2023-12-15T23:14:17.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006afb588c8af93417-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.584 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.584 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.584 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.584 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.584 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.585 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.585 DEBUG:boto:Data: 2023-12-15T23:14:17.585 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.585 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.585 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.585 DEBUG:boto:Params: {} 2023-12-15T23:14:17.585 DEBUG:boto:Token: None 2023-12-15T23:14:17.585 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BkK02oioNMeqHt1hRh6/F5/yPOM= 2023-12-15T23:14:17.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BkK02oioNMeqHt1hRh6/F5/yPOM=', 'Content-Length': '0'} 2023-12-15T23:14:17.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eeba102fb814c33c-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.588 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.588 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.588 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.588 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.588 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.588 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.589 DEBUG:boto:Data: 2023-12-15T23:14:17.589 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.589 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.589 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.589 DEBUG:boto:Params: {} 2023-12-15T23:14:17.589 DEBUG:boto:Token: None 2023-12-15T23:14:17.589 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BkK02oioNMeqHt1hRh6/F5/yPOM= 2023-12-15T23:14:17.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BkK02oioNMeqHt1hRh6/F5/yPOM=', 'Content-Length': '0'} 2023-12-15T23:14:17.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074809b627cb211b7-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2023-12-15T23:14:17.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.592 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.592 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.592 DEBUG:boto:Method: GET 2023-12-15T23:14:17.592 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.593 DEBUG:boto:Data: 2023-12-15T23:14:17.593 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.593 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.593 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.593 DEBUG:boto:Params: {} 2023-12-15T23:14:17.593 DEBUG:boto:Token: None 2023-12-15T23:14:17.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q= 2023-12-15T23:14:17.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q=', 'Content-Length': '0'} 2023-12-15T23:14:17.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8146cad0987b132-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.596 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.596 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.596 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.596 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.596 DEBUG:boto:Method: GET 2023-12-15T23:14:17.596 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.597 DEBUG:boto:Data: 2023-12-15T23:14:17.597 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.597 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.597 DEBUG:boto:Params: {} 2023-12-15T23:14:17.597 DEBUG:boto:Token: None 2023-12-15T23:14:17.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029?versionId=null 2023-12-15T23:14:17.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q= 2023-12-15T23:14:17.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sS1evj6F4bLoOWBMnpE+enjvn3Q=', 'Content-Length': '0'} 2023-12-15T23:14:17.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007642439717bf9031-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.600 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.600 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.600 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.600 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.600 DEBUG:boto:Method: GET 2023-12-15T23:14:17.601 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.601 DEBUG:boto:Data: 2023-12-15T23:14:17.601 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.601 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.601 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.601 DEBUG:boto:Params: {} 2023-12-15T23:14:17.601 DEBUG:boto:Token: None 2023-12-15T23:14:17.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.604 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028c21e409d986d3f-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.604 DEBUG:boto:b'kskgfn-48obj000000000000000000291000falseobj000000000000000000292023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.604 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.605 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.605 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.605 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.605 DEBUG:boto:Method: GET 2023-12-15T23:14:17.605 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.605 DEBUG:boto:Data: 2023-12-15T23:14:17.605 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.605 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.605 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.605 DEBUG:boto:Params: {} 2023-12-15T23:14:17.606 DEBUG:boto:Token: None 2023-12-15T23:14:17.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.609 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8202f9111a8b326-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.609 DEBUG:boto:b'kskgfn-48obj000000000000000000291000falseobj000000000000000000292023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.610 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.610 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.610 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.610 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.610 DEBUG:boto:Data: 2023-12-15T23:14:17.610 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.610 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.610 DEBUG:boto:Params: {} 2023-12-15T23:14:17.611 DEBUG:boto:Token: None 2023-12-15T23:14:17.611 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UjCddLf/viMQPqDPanP/wSpWkvc= 2023-12-15T23:14:17.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UjCddLf/viMQPqDPanP/wSpWkvc=', 'Content-Length': '0'} 2023-12-15T23:14:17.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5f4f71ed346c1bb-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.613 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.613 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.613 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.613 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.614 DEBUG:boto:Data: 2023-12-15T23:14:17.614 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.614 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.614 DEBUG:boto:Params: {} 2023-12-15T23:14:17.614 DEBUG:boto:Token: None 2023-12-15T23:14:17.614 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UjCddLf/viMQPqDPanP/wSpWkvc= 2023-12-15T23:14:17.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UjCddLf/viMQPqDPanP/wSpWkvc=', 'Content-Length': '0'} 2023-12-15T23:14:17.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007149cc4f02e33848-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2023-12-15T23:14:17.617 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.617 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.617 DEBUG:boto:Method: GET 2023-12-15T23:14:17.617 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.617 DEBUG:boto:Data: 2023-12-15T23:14:17.617 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.617 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.617 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.617 DEBUG:boto:Params: {} 2023-12-15T23:14:17.618 DEBUG:boto:Token: None 2023-12-15T23:14:17.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.618 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L/za8YW4QqZufWdKZIKunmNQXJ8= 2023-12-15T23:14:17.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L/za8YW4QqZufWdKZIKunmNQXJ8=', 'Content-Length': '0'} 2023-12-15T23:14:17.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000103ac75845003b61-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.620 DEBUG:boto:path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.621 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.621 DEBUG:boto:Method: GET 2023-12-15T23:14:17.621 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.621 DEBUG:boto:Data: 2023-12-15T23:14:17.621 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.621 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.621 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.621 DEBUG:boto:Params: {} 2023-12-15T23:14:17.621 DEBUG:boto:Token: None 2023-12-15T23:14:17.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000029 2023-12-15T23:14:17.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L/za8YW4QqZufWdKZIKunmNQXJ8= 2023-12-15T23:14:17.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L/za8YW4QqZufWdKZIKunmNQXJ8=', 'Content-Length': '0'} 2023-12-15T23:14:17.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005563b5d6b4e0f355-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.665 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.666 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.666 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.666 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.666 DEBUG:boto:Method: GET 2023-12-15T23:14:17.666 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.666 DEBUG:boto:Data: 2023-12-15T23:14:17.666 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.666 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.666 DEBUG:boto:Params: {} 2023-12-15T23:14:17.667 DEBUG:boto:Token: None 2023-12-15T23:14:17.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035d87cdd587a2b0e-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.669 DEBUG:boto:b'kskgfn-48obj000000000000000000291000falseobj000000000000000000292023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.670 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.670 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.670 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.670 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.670 DEBUG:boto:Method: GET 2023-12-15T23:14:17.670 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000029 2023-12-15T23:14:17.670 DEBUG:boto:Data: 2023-12-15T23:14:17.670 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.671 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.671 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.671 DEBUG:boto:Params: {} 2023-12-15T23:14:17.671 DEBUG:boto:Token: None 2023-12-15T23:14:17.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.674 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000747f1470b4337b67-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.675 DEBUG:boto:b'kskgfn-48obj000000000000000000291000falseobj000000000000000000292023-12-15T23:14:09.199Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2023-12-15T23:14:17.675 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.675 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.675 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.675 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.676 DEBUG:boto:Method: GET 2023-12-15T23:14:17.676 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.676 DEBUG:boto:Data: 2023-12-15T23:14:17.676 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.676 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.676 DEBUG:boto:Params: {} 2023-12-15T23:14:17.676 DEBUG:boto:Token: None 2023-12-15T23:14:17.676 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI= 2023-12-15T23:14:17.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI=', 'Content-Length': '0'} 2023-12-15T23:14:17.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008bc0729be04991a-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.722 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.722 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.722 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.722 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.722 DEBUG:boto:Method: GET 2023-12-15T23:14:17.722 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.722 DEBUG:boto:Data: 2023-12-15T23:14:17.722 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.722 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.722 DEBUG:boto:Params: {} 2023-12-15T23:14:17.723 DEBUG:boto:Token: None 2023-12-15T23:14:17.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI= 2023-12-15T23:14:17.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI=', 'Content-Length': '0'} 2023-12-15T23:14:17.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6d472f4b03fb49c-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.725 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.726 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.726 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.726 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.726 DEBUG:boto:Data: 2023-12-15T23:14:17.726 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.726 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.726 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.726 DEBUG:boto:Params: {} 2023-12-15T23:14:17.726 DEBUG:boto:Token: None 2023-12-15T23:14:17.726 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OuYcJ1qJW7Hj8AMWBQEMubByJxM= 2023-12-15T23:14:17.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OuYcJ1qJW7Hj8AMWBQEMubByJxM=', 'Content-Length': '0'} 2023-12-15T23:14:17.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067b14357aeb4f065-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.729 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.729 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.729 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.729 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.729 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.729 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.729 DEBUG:boto:Data: 2023-12-15T23:14:17.729 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.730 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.730 DEBUG:boto:Params: {} 2023-12-15T23:14:17.730 DEBUG:boto:Token: None 2023-12-15T23:14:17.730 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OuYcJ1qJW7Hj8AMWBQEMubByJxM= 2023-12-15T23:14:17.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OuYcJ1qJW7Hj8AMWBQEMubByJxM=', 'Content-Length': '0'} 2023-12-15T23:14:17.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081646a2f495f0ed9-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2023-12-15T23:14:17.732 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.733 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.733 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.733 DEBUG:boto:Method: GET 2023-12-15T23:14:17.733 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.733 DEBUG:boto:Data: 2023-12-15T23:14:17.733 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.733 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.733 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.733 DEBUG:boto:Params: {} 2023-12-15T23:14:17.734 DEBUG:boto:Token: None 2023-12-15T23:14:17.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI= 2023-12-15T23:14:17.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI=', 'Content-Length': '0'} 2023-12-15T23:14:17.736 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003381394b03aca8ce-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.736 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.736 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.736 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.737 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.737 DEBUG:boto:Method: GET 2023-12-15T23:14:17.737 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.737 DEBUG:boto:Data: 2023-12-15T23:14:17.737 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.737 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.737 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.737 DEBUG:boto:Params: {} 2023-12-15T23:14:17.737 DEBUG:boto:Token: None 2023-12-15T23:14:17.737 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030?versionId=null 2023-12-15T23:14:17.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI= 2023-12-15T23:14:17.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wmNu6vfs9HEV5E5k3ShLy4NcXTI=', 'Content-Length': '0'} 2023-12-15T23:14:17.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd2fe72fb32a39b7-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.740 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.740 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.740 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.740 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.740 DEBUG:boto:Method: GET 2023-12-15T23:14:17.740 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.741 DEBUG:boto:Data: 2023-12-15T23:14:17.741 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.741 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.741 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.741 DEBUG:boto:Params: {} 2023-12-15T23:14:17.741 DEBUG:boto:Token: None 2023-12-15T23:14:17.741 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.741 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.744 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7d6253498f35805-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.744 DEBUG:boto:b'kskgfn-48obj000000000000000000301000falseobj000000000000000000302023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.744 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.744 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.744 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.745 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.745 DEBUG:boto:Method: GET 2023-12-15T23:14:17.745 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.745 DEBUG:boto:Data: 2023-12-15T23:14:17.745 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.745 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.745 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.745 DEBUG:boto:Params: {} 2023-12-15T23:14:17.745 DEBUG:boto:Token: None 2023-12-15T23:14:17.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.749 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000597e5943063478c2-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.750 DEBUG:boto:b'kskgfn-48obj000000000000000000301000falseobj000000000000000000302023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.750 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.750 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.750 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.750 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.750 DEBUG:boto:Data: 2023-12-15T23:14:17.750 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.751 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.751 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.751 DEBUG:boto:Params: {} 2023-12-15T23:14:17.751 DEBUG:boto:Token: None 2023-12-15T23:14:17.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yBXMCYWaGReE5d+Fd747dgNgtck= 2023-12-15T23:14:17.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yBXMCYWaGReE5d+Fd747dgNgtck=', 'Content-Length': '0'} 2023-12-15T23:14:17.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb16d5ec64153cab-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.753 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.753 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.753 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.754 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.754 DEBUG:boto:Data: 2023-12-15T23:14:17.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.754 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.754 DEBUG:boto:Params: {} 2023-12-15T23:14:17.754 DEBUG:boto:Token: None 2023-12-15T23:14:17.754 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yBXMCYWaGReE5d+Fd747dgNgtck= 2023-12-15T23:14:17.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yBXMCYWaGReE5d+Fd747dgNgtck=', 'Content-Length': '0'} 2023-12-15T23:14:17.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013fca02c8cfd6883-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2023-12-15T23:14:17.757 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.757 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.757 DEBUG:boto:Method: GET 2023-12-15T23:14:17.757 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.757 DEBUG:boto:Data: 2023-12-15T23:14:17.757 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.758 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.758 DEBUG:boto:Params: {} 2023-12-15T23:14:17.758 DEBUG:boto:Token: None 2023-12-15T23:14:17.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LU6njwRebsyMf0S59XyVO8Pi1eQ= 2023-12-15T23:14:17.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LU6njwRebsyMf0S59XyVO8Pi1eQ=', 'Content-Length': '0'} 2023-12-15T23:14:17.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b117243a083ce99a-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.760 DEBUG:boto:path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.761 DEBUG:boto:Method: GET 2023-12-15T23:14:17.761 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.761 DEBUG:boto:Data: 2023-12-15T23:14:17.761 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.761 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.761 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.761 DEBUG:boto:Params: {} 2023-12-15T23:14:17.761 DEBUG:boto:Token: None 2023-12-15T23:14:17.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000030 2023-12-15T23:14:17.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LU6njwRebsyMf0S59XyVO8Pi1eQ= 2023-12-15T23:14:17.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LU6njwRebsyMf0S59XyVO8Pi1eQ=', 'Content-Length': '0'} 2023-12-15T23:14:17.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093ee0f4494a2da94-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.764 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.764 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.764 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.764 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.764 DEBUG:boto:Method: GET 2023-12-15T23:14:17.764 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.764 DEBUG:boto:Data: 2023-12-15T23:14:17.764 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.765 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.765 DEBUG:boto:Params: {} 2023-12-15T23:14:17.765 DEBUG:boto:Token: None 2023-12-15T23:14:17.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d395605e998a16b-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.767 DEBUG:boto:b'kskgfn-48obj000000000000000000301000falseobj000000000000000000302023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.768 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.768 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.768 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.768 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.768 DEBUG:boto:Method: GET 2023-12-15T23:14:17.768 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000030 2023-12-15T23:14:17.768 DEBUG:boto:Data: 2023-12-15T23:14:17.768 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.769 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.769 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.769 DEBUG:boto:Params: {} 2023-12-15T23:14:17.769 DEBUG:boto:Token: None 2023-12-15T23:14:17.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8a3d9b497c705d8-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.773 DEBUG:boto:b'kskgfn-48obj000000000000000000301000falseobj000000000000000000302023-12-15T23:14:10.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2023-12-15T23:14:17.773 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.773 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.774 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.774 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.774 DEBUG:boto:Method: GET 2023-12-15T23:14:17.774 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.774 DEBUG:boto:Data: 2023-12-15T23:14:17.774 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.774 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.774 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.774 DEBUG:boto:Params: {} 2023-12-15T23:14:17.774 DEBUG:boto:Token: None 2023-12-15T23:14:17.774 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw= 2023-12-15T23:14:17.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw=', 'Content-Length': '0'} 2023-12-15T23:14:17.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067f2346cfcd8a15f-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.777 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.778 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.778 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.778 DEBUG:boto:Method: GET 2023-12-15T23:14:17.778 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.778 DEBUG:boto:Data: 2023-12-15T23:14:17.778 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.778 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.778 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.778 DEBUG:boto:Params: {} 2023-12-15T23:14:17.779 DEBUG:boto:Token: None 2023-12-15T23:14:17.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw= 2023-12-15T23:14:17.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw=', 'Content-Length': '0'} 2023-12-15T23:14:17.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a957ac9450aa59ab-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.781 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.781 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.781 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.781 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.782 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.782 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.782 DEBUG:boto:Data: 2023-12-15T23:14:17.782 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.782 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.782 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.782 DEBUG:boto:Params: {} 2023-12-15T23:14:17.782 DEBUG:boto:Token: None 2023-12-15T23:14:17.782 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3RQfojZ0RFh2zF5Q73MUvGySxQU= 2023-12-15T23:14:17.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3RQfojZ0RFh2zF5Q73MUvGySxQU=', 'Content-Length': '0'} 2023-12-15T23:14:17.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000783d2f0190bf1e82-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.785 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.785 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.785 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.785 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.785 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.785 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.785 DEBUG:boto:Data: 2023-12-15T23:14:17.785 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.785 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.785 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.786 DEBUG:boto:Params: {} 2023-12-15T23:14:17.786 DEBUG:boto:Token: None 2023-12-15T23:14:17.786 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3RQfojZ0RFh2zF5Q73MUvGySxQU= 2023-12-15T23:14:17.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3RQfojZ0RFh2zF5Q73MUvGySxQU=', 'Content-Length': '0'} 2023-12-15T23:14:17.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5c4fed6f95d0a7f-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2023-12-15T23:14:17.789 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.789 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.789 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.789 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.789 DEBUG:boto:Method: GET 2023-12-15T23:14:17.789 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.789 DEBUG:boto:Data: 2023-12-15T23:14:17.789 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.789 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.789 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.789 DEBUG:boto:Params: {} 2023-12-15T23:14:17.790 DEBUG:boto:Token: None 2023-12-15T23:14:17.790 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw= 2023-12-15T23:14:17.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw=', 'Content-Length': '0'} 2023-12-15T23:14:17.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5d85855a5c00084-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.792 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.792 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.792 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.792 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.792 DEBUG:boto:Method: GET 2023-12-15T23:14:17.793 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.793 DEBUG:boto:Data: 2023-12-15T23:14:17.793 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.793 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.793 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.793 DEBUG:boto:Params: {} 2023-12-15T23:14:17.793 DEBUG:boto:Token: None 2023-12-15T23:14:17.793 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031?versionId=null 2023-12-15T23:14:17.793 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw= 2023-12-15T23:14:17.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5autaeedakynaaCS0vZl/JZVUw=', 'Content-Length': '0'} 2023-12-15T23:14:17.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cf7091f49162e27-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.796 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.796 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.796 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.796 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.796 DEBUG:boto:Method: GET 2023-12-15T23:14:17.796 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.797 DEBUG:boto:Data: 2023-12-15T23:14:17.797 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.797 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.797 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.797 DEBUG:boto:Params: {} 2023-12-15T23:14:17.797 DEBUG:boto:Token: None 2023-12-15T23:14:17.797 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.797 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.800 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e64dcc28e1f97b92-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.800 DEBUG:boto:b'kskgfn-48obj000000000000000000311000falseobj000000000000000000312023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.800 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.800 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.800 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.800 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.801 DEBUG:boto:Method: GET 2023-12-15T23:14:17.801 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.801 DEBUG:boto:Data: 2023-12-15T23:14:17.801 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.801 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.801 DEBUG:boto:Params: {} 2023-12-15T23:14:17.801 DEBUG:boto:Token: None 2023-12-15T23:14:17.801 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033b3cca773b3973f-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.805 DEBUG:boto:b'kskgfn-48obj000000000000000000311000falseobj000000000000000000312023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.806 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.806 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.806 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.806 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.806 DEBUG:boto:Data: 2023-12-15T23:14:17.806 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.806 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.806 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.806 DEBUG:boto:Params: {} 2023-12-15T23:14:17.807 DEBUG:boto:Token: None 2023-12-15T23:14:17.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4jW1+6UoQuwFedV+D7eE3iuJ3w= 2023-12-15T23:14:17.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4jW1+6UoQuwFedV+D7eE3iuJ3w=', 'Content-Length': '0'} 2023-12-15T23:14:17.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f3135c1d2bc83c8-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.809 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.809 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.810 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.810 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.810 DEBUG:boto:Data: 2023-12-15T23:14:17.810 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.810 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.810 DEBUG:boto:Params: {} 2023-12-15T23:14:17.810 DEBUG:boto:Token: None 2023-12-15T23:14:17.810 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k4jW1+6UoQuwFedV+D7eE3iuJ3w= 2023-12-15T23:14:17.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k4jW1+6UoQuwFedV+D7eE3iuJ3w=', 'Content-Length': '0'} 2023-12-15T23:14:17.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd87422ffffa8178-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2023-12-15T23:14:17.813 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.813 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.813 DEBUG:boto:Method: GET 2023-12-15T23:14:17.813 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.813 DEBUG:boto:Data: 2023-12-15T23:14:17.813 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.814 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.814 DEBUG:boto:Params: {} 2023-12-15T23:14:17.814 DEBUG:boto:Token: None 2023-12-15T23:14:17.814 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LvzaQjUnhvskQ7Bi6XFkfGVH4Q8= 2023-12-15T23:14:17.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LvzaQjUnhvskQ7Bi6XFkfGVH4Q8=', 'Content-Length': '0'} 2023-12-15T23:14:17.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adb6bb7938c3db59-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.816 DEBUG:boto:path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.817 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.817 DEBUG:boto:Method: GET 2023-12-15T23:14:17.817 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.817 DEBUG:boto:Data: 2023-12-15T23:14:17.817 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.817 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.817 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.817 DEBUG:boto:Params: {} 2023-12-15T23:14:17.817 DEBUG:boto:Token: None 2023-12-15T23:14:17.818 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000031 2023-12-15T23:14:17.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LvzaQjUnhvskQ7Bi6XFkfGVH4Q8= 2023-12-15T23:14:17.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LvzaQjUnhvskQ7Bi6XFkfGVH4Q8=', 'Content-Length': '0'} 2023-12-15T23:14:17.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d40ada8dd8fd4109-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.861 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.862 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.862 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.862 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.862 DEBUG:boto:Method: GET 2023-12-15T23:14:17.862 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.862 DEBUG:boto:Data: 2023-12-15T23:14:17.862 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.862 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.862 DEBUG:boto:Params: {} 2023-12-15T23:14:17.862 DEBUG:boto:Token: None 2023-12-15T23:14:17.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097b59122c3c34446-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.865 DEBUG:boto:b'kskgfn-48obj000000000000000000311000falseobj000000000000000000312023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.865 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.865 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.865 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.866 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.866 DEBUG:boto:Method: GET 2023-12-15T23:14:17.866 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000031 2023-12-15T23:14:17.866 DEBUG:boto:Data: 2023-12-15T23:14:17.866 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.866 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.866 DEBUG:boto:Params: {} 2023-12-15T23:14:17.866 DEBUG:boto:Token: None 2023-12-15T23:14:17.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000030f90bf5991d8ff-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.870 DEBUG:boto:b'kskgfn-48obj000000000000000000311000falseobj000000000000000000312023-12-15T23:14:08.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2023-12-15T23:14:17.871 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.871 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.871 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.871 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.871 DEBUG:boto:Method: GET 2023-12-15T23:14:17.871 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.871 DEBUG:boto:Data: 2023-12-15T23:14:17.871 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.872 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.872 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.872 DEBUG:boto:Params: {} 2023-12-15T23:14:17.872 DEBUG:boto:Token: None 2023-12-15T23:14:17.872 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo= 2023-12-15T23:14:17.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo=', 'Content-Length': '0'} 2023-12-15T23:14:17.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1000e1f71419a79-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.875 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.875 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.875 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.875 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.875 DEBUG:boto:Method: GET 2023-12-15T23:14:17.875 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.875 DEBUG:boto:Data: 2023-12-15T23:14:17.875 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.875 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.875 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.876 DEBUG:boto:Params: {} 2023-12-15T23:14:17.876 DEBUG:boto:Token: None 2023-12-15T23:14:17.876 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.876 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo= 2023-12-15T23:14:17.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo=', 'Content-Length': '0'} 2023-12-15T23:14:17.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933ee47cbf1c65b6-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.879 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.879 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.879 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.879 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.879 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.879 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.879 DEBUG:boto:Data: 2023-12-15T23:14:17.879 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.879 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.879 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.879 DEBUG:boto:Params: {} 2023-12-15T23:14:17.880 DEBUG:boto:Token: None 2023-12-15T23:14:17.880 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.880 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Dt80A0qicDbkgSqJer0+8Yq8Ww= 2023-12-15T23:14:17.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Dt80A0qicDbkgSqJer0+8Yq8Ww=', 'Content-Length': '0'} 2023-12-15T23:14:17.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f11df57e0755b6d-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.882 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.883 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.883 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.883 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.883 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.883 DEBUG:boto:Data: 2023-12-15T23:14:17.883 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.883 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.883 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.883 DEBUG:boto:Params: {} 2023-12-15T23:14:17.883 DEBUG:boto:Token: None 2023-12-15T23:14:17.883 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Dt80A0qicDbkgSqJer0+8Yq8Ww= 2023-12-15T23:14:17.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Dt80A0qicDbkgSqJer0+8Yq8Ww=', 'Content-Length': '0'} 2023-12-15T23:14:17.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf47bd28808b3899-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2023-12-15T23:14:17.886 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.887 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.887 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.887 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.887 DEBUG:boto:Method: GET 2023-12-15T23:14:17.887 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.887 DEBUG:boto:Data: 2023-12-15T23:14:17.887 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.887 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.887 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.887 DEBUG:boto:Params: {} 2023-12-15T23:14:17.888 DEBUG:boto:Token: None 2023-12-15T23:14:17.888 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.888 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo= 2023-12-15T23:14:17.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo=', 'Content-Length': '0'} 2023-12-15T23:14:17.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce06636a52bba01a-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.933 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.934 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.934 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.934 DEBUG:boto:Method: GET 2023-12-15T23:14:17.934 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.934 DEBUG:boto:Data: 2023-12-15T23:14:17.934 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.934 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.934 DEBUG:boto:Params: {} 2023-12-15T23:14:17.934 DEBUG:boto:Token: None 2023-12-15T23:14:17.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032?versionId=null 2023-12-15T23:14:17.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo= 2023-12-15T23:14:17.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEXnjpYNSdr7mVJ83Ye7ylERmTo=', 'Content-Length': '0'} 2023-12-15T23:14:17.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9ea01837c6e8cfe-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.937 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.937 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.937 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.937 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.937 DEBUG:boto:Method: GET 2023-12-15T23:14:17.937 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.938 DEBUG:boto:Data: 2023-12-15T23:14:17.938 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.938 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.938 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.938 DEBUG:boto:Params: {} 2023-12-15T23:14:17.938 DEBUG:boto:Token: None 2023-12-15T23:14:17.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.938 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.940 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c575b8de51a7fc4-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.940 DEBUG:boto:b'kskgfn-48obj000000000000000000321000falseobj000000000000000000322023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.941 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.941 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.941 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.941 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.941 DEBUG:boto:Method: GET 2023-12-15T23:14:17.941 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.941 DEBUG:boto:Data: 2023-12-15T23:14:17.941 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.942 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.942 DEBUG:boto:Params: {} 2023-12-15T23:14:17.942 DEBUG:boto:Token: None 2023-12-15T23:14:17.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd9dab8d7e60d5ae-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.946 DEBUG:boto:b'kskgfn-48obj000000000000000000321000falseobj000000000000000000322023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.946 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.946 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.946 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.947 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.947 DEBUG:boto:Data: 2023-12-15T23:14:17.947 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.947 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.947 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.947 DEBUG:boto:Params: {} 2023-12-15T23:14:17.947 DEBUG:boto:Token: None 2023-12-15T23:14:17.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6v3T46+XidIgYLNdM85kWUEn1DQ= 2023-12-15T23:14:17.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6v3T46+XidIgYLNdM85kWUEn1DQ=', 'Content-Length': '0'} 2023-12-15T23:14:17.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6e10ff5083ccb30-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.950 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.950 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.950 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.950 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.950 DEBUG:boto:Data: 2023-12-15T23:14:17.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.950 DEBUG:boto:Params: {} 2023-12-15T23:14:17.951 DEBUG:boto:Token: None 2023-12-15T23:14:17.951 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6v3T46+XidIgYLNdM85kWUEn1DQ= 2023-12-15T23:14:17.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6v3T46+XidIgYLNdM85kWUEn1DQ=', 'Content-Length': '0'} 2023-12-15T23:14:17.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b5aef3ff0b95365-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.953 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2023-12-15T23:14:17.953 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.953 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.953 DEBUG:boto:Method: GET 2023-12-15T23:14:17.954 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.954 DEBUG:boto:Data: 2023-12-15T23:14:17.954 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.954 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.954 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.954 DEBUG:boto:Params: {} 2023-12-15T23:14:17.954 DEBUG:boto:Token: None 2023-12-15T23:14:17.954 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YSGei/IXgQOEYhQhzmVLpnc77cI= 2023-12-15T23:14:17.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YSGei/IXgQOEYhQhzmVLpnc77cI=', 'Content-Length': '0'} 2023-12-15T23:14:17.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dd8b307c4419b0c-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.957 DEBUG:boto:path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.957 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.957 DEBUG:boto:Method: GET 2023-12-15T23:14:17.957 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.957 DEBUG:boto:Data: 2023-12-15T23:14:17.957 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.957 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.957 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.958 DEBUG:boto:Params: {} 2023-12-15T23:14:17.958 DEBUG:boto:Token: None 2023-12-15T23:14:17.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000032 2023-12-15T23:14:17.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YSGei/IXgQOEYhQhzmVLpnc77cI= 2023-12-15T23:14:17.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YSGei/IXgQOEYhQhzmVLpnc77cI=', 'Content-Length': '0'} 2023-12-15T23:14:17.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c23d13f266dff1ad-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.960 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.960 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.961 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.961 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.961 DEBUG:boto:Method: GET 2023-12-15T23:14:17.961 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.961 DEBUG:boto:Data: 2023-12-15T23:14:17.961 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.961 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.961 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.961 DEBUG:boto:Params: {} 2023-12-15T23:14:17.961 DEBUG:boto:Token: None 2023-12-15T23:14:17.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053cf363042a1d815-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.964 DEBUG:boto:b'kskgfn-48obj000000000000000000321000falseobj000000000000000000322023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.965 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:17.965 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:17.965 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.965 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.965 DEBUG:boto:Method: GET 2023-12-15T23:14:17.965 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000032 2023-12-15T23:14:17.965 DEBUG:boto:Data: 2023-12-15T23:14:17.966 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.966 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.966 DEBUG:boto:Params: {} 2023-12-15T23:14:17.966 DEBUG:boto:Token: None 2023-12-15T23:14:17.966 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/ 2023-12-15T23:14:17.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw= 2023-12-15T23:14:17.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7+C+GLlPW0EMfAZPsExUPhvVWw=', 'Content-Length': '0'} 2023-12-15T23:14:17.970 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000880389f0209e066e-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.970 DEBUG:boto:b'kskgfn-48obj000000000000000000321000falseobj000000000000000000322023-12-15T23:14:05.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:17.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2023-12-15T23:14:17.970 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.970 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.970 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.971 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.971 DEBUG:boto:Method: GET 2023-12-15T23:14:17.971 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.971 DEBUG:boto:Data: 2023-12-15T23:14:17.971 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.971 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.971 DEBUG:boto:Params: {} 2023-12-15T23:14:17.971 DEBUG:boto:Token: None 2023-12-15T23:14:17.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A= 2023-12-15T23:14:17.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A=', 'Content-Length': '0'} 2023-12-15T23:14:17.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068a98aeb031a1c87-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.974 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.974 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.974 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.974 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.974 DEBUG:boto:Method: GET 2023-12-15T23:14:17.974 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.974 DEBUG:boto:Data: 2023-12-15T23:14:17.975 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.975 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.975 DEBUG:boto:Params: {} 2023-12-15T23:14:17.975 DEBUG:boto:Token: None 2023-12-15T23:14:17.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A= 2023-12-15T23:14:17.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A=', 'Content-Length': '0'} 2023-12-15T23:14:17.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099fd50af23858aba-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.977 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.978 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.978 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.978 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.978 DEBUG:boto:Data: 2023-12-15T23:14:17.978 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.978 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.978 DEBUG:boto:Params: {} 2023-12-15T23:14:17.978 DEBUG:boto:Token: None 2023-12-15T23:14:17.979 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7m35q8EjmpobH/uRqcPpTi38jw= 2023-12-15T23:14:17.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7m35q8EjmpobH/uRqcPpTi38jw=', 'Content-Length': '0'} 2023-12-15T23:14:17.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e74efdcfc8ba4be0-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.981 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.981 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.981 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.981 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.981 DEBUG:boto:Method: HEAD 2023-12-15T23:14:17.981 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.981 DEBUG:boto:Data: 2023-12-15T23:14:17.981 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.981 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:17.982 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.982 DEBUG:boto:Params: {} 2023-12-15T23:14:17.982 DEBUG:boto:Token: None 2023-12-15T23:14:17.982 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7m35q8EjmpobH/uRqcPpTi38jw= 2023-12-15T23:14:17.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7m35q8EjmpobH/uRqcPpTi38jw=', 'Content-Length': '0'} 2023-12-15T23:14:17.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003b26162596591c4-00657cddc9-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:17.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2023-12-15T23:14:17.984 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.984 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:17.984 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.984 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.984 DEBUG:boto:Method: GET 2023-12-15T23:14:17.985 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.985 DEBUG:boto:Data: 2023-12-15T23:14:17.985 DEBUG:boto:Headers: {} 2023-12-15T23:14:17.985 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:17.985 DEBUG:boto:Port: 8000 2023-12-15T23:14:17.985 DEBUG:boto:Params: {} 2023-12-15T23:14:17.985 DEBUG:boto:Token: None 2023-12-15T23:14:17.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:17 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:17.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A= 2023-12-15T23:14:17.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:leqLocGw5IoGMZ5+E6ROp32sC+A=', 'Content-Length': '0'} 2023-12-15T23:14:17.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da3ea0c32261f35d-00657cddc9-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.029 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.030 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.030 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:18.030 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:18.030 DEBUG:boto:Method: GET 2023-12-15T23:14:18.030 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:18.030 DEBUG:boto:Data: 2023-12-15T23:14:18.030 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.030 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.030 DEBUG:boto:Params: {} 2023-12-15T23:14:18.030 DEBUG:boto:Token: None 2023-12-15T23:14:18.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000033?versionId=null 2023-12-15T23:14:18.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JpKKmZva89RiNEG+i0qXZ4dl2S4= 2023-12-15T23:14:18.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JpKKmZva89RiNEG+i0qXZ4dl2S4=', 'Content-Length': '0'} 2023-12-15T23:14:18.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7fb5193c9682148-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.033 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.033 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.033 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.033 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.033 DEBUG:boto:Method: GET 2023-12-15T23:14:18.033 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.034 DEBUG:boto:Data: 2023-12-15T23:14:18.034 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.034 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.034 DEBUG:boto:Params: {} 2023-12-15T23:14:18.034 DEBUG:boto:Token: None 2023-12-15T23:14:18.034 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.034 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.036 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c86e8fc9038cc92e-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.036 DEBUG:boto:b'kskgfn-48obj000000000000000000331000falseobj000000000000000000332023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.037 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.037 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.037 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.037 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.037 DEBUG:boto:Method: GET 2023-12-15T23:14:18.037 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.037 DEBUG:boto:Data: 2023-12-15T23:14:18.037 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.038 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.038 DEBUG:boto:Params: {} 2023-12-15T23:14:18.038 DEBUG:boto:Token: None 2023-12-15T23:14:18.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f133c539b6e738aa-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.042 DEBUG:boto:b'kskgfn-48obj000000000000000000331000falseobj000000000000000000332023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.042 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.042 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.042 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.042 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.042 DEBUG:boto:Data: 2023-12-15T23:14:18.042 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.043 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.043 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.043 DEBUG:boto:Params: {} 2023-12-15T23:14:18.043 DEBUG:boto:Token: None 2023-12-15T23:14:18.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BiooKLOfbt/AKhhcgNPB8cmhkwI= 2023-12-15T23:14:18.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BiooKLOfbt/AKhhcgNPB8cmhkwI=', 'Content-Length': '0'} 2023-12-15T23:14:18.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fba26f9adc1f6ee-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.045 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.045 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.045 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.045 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.046 DEBUG:boto:Data: 2023-12-15T23:14:18.046 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.046 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.046 DEBUG:boto:Params: {} 2023-12-15T23:14:18.046 DEBUG:boto:Token: None 2023-12-15T23:14:18.046 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BiooKLOfbt/AKhhcgNPB8cmhkwI= 2023-12-15T23:14:18.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BiooKLOfbt/AKhhcgNPB8cmhkwI=', 'Content-Length': '0'} 2023-12-15T23:14:18.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9edc5c20af0cfb1-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2023-12-15T23:14:18.048 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.048 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.048 DEBUG:boto:Method: GET 2023-12-15T23:14:18.049 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.049 DEBUG:boto:Data: 2023-12-15T23:14:18.049 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.049 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.049 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.049 DEBUG:boto:Params: {} 2023-12-15T23:14:18.049 DEBUG:boto:Token: None 2023-12-15T23:14:18.049 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.049 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQPvCTe4RIgaxTfBcKHDTbHM4wU= 2023-12-15T23:14:18.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQPvCTe4RIgaxTfBcKHDTbHM4wU=', 'Content-Length': '0'} 2023-12-15T23:14:18.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a6498d73b4ae1ed-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.051 DEBUG:boto:path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.051 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.052 DEBUG:boto:Method: GET 2023-12-15T23:14:18.052 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.052 DEBUG:boto:Data: 2023-12-15T23:14:18.052 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.052 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.052 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.052 DEBUG:boto:Params: {} 2023-12-15T23:14:18.052 DEBUG:boto:Token: None 2023-12-15T23:14:18.052 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000033 2023-12-15T23:14:18.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQPvCTe4RIgaxTfBcKHDTbHM4wU= 2023-12-15T23:14:18.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQPvCTe4RIgaxTfBcKHDTbHM4wU=', 'Content-Length': '0'} 2023-12-15T23:14:18.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007814444594cd1000-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.097 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.098 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.098 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.098 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.098 DEBUG:boto:Method: GET 2023-12-15T23:14:18.098 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.098 DEBUG:boto:Data: 2023-12-15T23:14:18.098 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.098 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.098 DEBUG:boto:Params: {} 2023-12-15T23:14:18.098 DEBUG:boto:Token: None 2023-12-15T23:14:18.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db518be3202b4bb7-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.101 DEBUG:boto:b'kskgfn-48obj000000000000000000331000falseobj000000000000000000332023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.102 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.102 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.102 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.102 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.102 DEBUG:boto:Method: GET 2023-12-15T23:14:18.102 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000033 2023-12-15T23:14:18.102 DEBUG:boto:Data: 2023-12-15T23:14:18.102 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.103 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.103 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.103 DEBUG:boto:Params: {} 2023-12-15T23:14:18.103 DEBUG:boto:Token: None 2023-12-15T23:14:18.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.107 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef5845da5b46c84d-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.107 DEBUG:boto:b'kskgfn-48obj000000000000000000331000falseobj000000000000000000332023-12-15T23:14:10.322Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2023-12-15T23:14:18.107 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.108 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.108 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.108 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.108 DEBUG:boto:Method: GET 2023-12-15T23:14:18.108 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.108 DEBUG:boto:Data: 2023-12-15T23:14:18.108 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.108 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.108 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.108 DEBUG:boto:Params: {} 2023-12-15T23:14:18.108 DEBUG:boto:Token: None 2023-12-15T23:14:18.109 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU= 2023-12-15T23:14:18.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU=', 'Content-Length': '0'} 2023-12-15T23:14:18.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074e32e2f0a4f26b9-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.111 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.111 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.111 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.111 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.111 DEBUG:boto:Method: GET 2023-12-15T23:14:18.112 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.112 DEBUG:boto:Data: 2023-12-15T23:14:18.112 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.112 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.112 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.112 DEBUG:boto:Params: {} 2023-12-15T23:14:18.112 DEBUG:boto:Token: None 2023-12-15T23:14:18.112 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.112 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU= 2023-12-15T23:14:18.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU=', 'Content-Length': '0'} 2023-12-15T23:14:18.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bed0b645f5a16d8-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.115 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.115 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.115 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.115 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.115 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.115 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.115 DEBUG:boto:Data: 2023-12-15T23:14:18.115 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.115 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.115 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.115 DEBUG:boto:Params: {} 2023-12-15T23:14:18.116 DEBUG:boto:Token: None 2023-12-15T23:14:18.116 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.116 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lxUE4pRgxzFL9xpPog/Me1Z0Dxg= 2023-12-15T23:14:18.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lxUE4pRgxzFL9xpPog/Me1Z0Dxg=', 'Content-Length': '0'} 2023-12-15T23:14:18.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae9f35cbf2cc364-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.118 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.118 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.118 DEBUG:boto:Data: 2023-12-15T23:14:18.118 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.119 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.119 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.119 DEBUG:boto:Params: {} 2023-12-15T23:14:18.119 DEBUG:boto:Token: None 2023-12-15T23:14:18.119 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lxUE4pRgxzFL9xpPog/Me1Z0Dxg= 2023-12-15T23:14:18.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lxUE4pRgxzFL9xpPog/Me1Z0Dxg=', 'Content-Length': '0'} 2023-12-15T23:14:18.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0ed680be0e19e43-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2023-12-15T23:14:18.121 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.122 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.122 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.122 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.122 DEBUG:boto:Method: GET 2023-12-15T23:14:18.122 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.122 DEBUG:boto:Data: 2023-12-15T23:14:18.122 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.122 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.122 DEBUG:boto:Params: {} 2023-12-15T23:14:18.122 DEBUG:boto:Token: None 2023-12-15T23:14:18.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU= 2023-12-15T23:14:18.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU=', 'Content-Length': '0'} 2023-12-15T23:14:18.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048a91d210acb9faa-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.165 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.166 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.166 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.166 DEBUG:boto:Method: GET 2023-12-15T23:14:18.166 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.166 DEBUG:boto:Data: 2023-12-15T23:14:18.166 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.166 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.166 DEBUG:boto:Params: {} 2023-12-15T23:14:18.167 DEBUG:boto:Token: None 2023-12-15T23:14:18.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036?versionId=null 2023-12-15T23:14:18.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU= 2023-12-15T23:14:18.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZRrXV1DWPgt0tKKU8SeYQ+Z4mqU=', 'Content-Length': '0'} 2023-12-15T23:14:18.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069e100eb3e8439c6-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.169 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.169 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.170 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.170 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.170 DEBUG:boto:Method: GET 2023-12-15T23:14:18.170 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.170 DEBUG:boto:Data: 2023-12-15T23:14:18.170 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.170 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.170 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.170 DEBUG:boto:Params: {} 2023-12-15T23:14:18.170 DEBUG:boto:Token: None 2023-12-15T23:14:18.170 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c4218167d6fdf3b-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.173 DEBUG:boto:b'kskgfn-48obj000000000000000000361000falseobj000000000000000000362023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.174 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.174 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.174 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.174 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.174 DEBUG:boto:Method: GET 2023-12-15T23:14:18.174 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.174 DEBUG:boto:Data: 2023-12-15T23:14:18.174 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.174 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.175 DEBUG:boto:Params: {} 2023-12-15T23:14:18.175 DEBUG:boto:Token: None 2023-12-15T23:14:18.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9c266b34cc2a82e-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.179 DEBUG:boto:b'kskgfn-48obj000000000000000000361000falseobj000000000000000000362023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.179 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.179 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.179 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.179 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.179 DEBUG:boto:Data: 2023-12-15T23:14:18.179 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.179 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.179 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.180 DEBUG:boto:Params: {} 2023-12-15T23:14:18.180 DEBUG:boto:Token: None 2023-12-15T23:14:18.180 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B46jIRFG7t74EiJMSTGoxLQ88vg= 2023-12-15T23:14:18.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B46jIRFG7t74EiJMSTGoxLQ88vg=', 'Content-Length': '0'} 2023-12-15T23:14:18.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f37eddc04e29670b-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.182 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.182 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.182 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.182 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.182 DEBUG:boto:Data: 2023-12-15T23:14:18.182 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.183 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.183 DEBUG:boto:Params: {} 2023-12-15T23:14:18.183 DEBUG:boto:Token: None 2023-12-15T23:14:18.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B46jIRFG7t74EiJMSTGoxLQ88vg= 2023-12-15T23:14:18.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B46jIRFG7t74EiJMSTGoxLQ88vg=', 'Content-Length': '0'} 2023-12-15T23:14:18.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb54e03415467a05-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2023-12-15T23:14:18.186 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.186 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.186 DEBUG:boto:Method: GET 2023-12-15T23:14:18.186 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.186 DEBUG:boto:Data: 2023-12-15T23:14:18.186 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.186 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.186 DEBUG:boto:Params: {} 2023-12-15T23:14:18.186 DEBUG:boto:Token: None 2023-12-15T23:14:18.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OCHFJl1RfqhQCyUDB1dKBEzsRBM= 2023-12-15T23:14:18.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OCHFJl1RfqhQCyUDB1dKBEzsRBM=', 'Content-Length': '0'} 2023-12-15T23:14:18.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021a0bd0a793368ad-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.189 DEBUG:boto:path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.189 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.189 DEBUG:boto:Method: GET 2023-12-15T23:14:18.189 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.189 DEBUG:boto:Data: 2023-12-15T23:14:18.189 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.189 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.189 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.189 DEBUG:boto:Params: {} 2023-12-15T23:14:18.190 DEBUG:boto:Token: None 2023-12-15T23:14:18.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000036 2023-12-15T23:14:18.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OCHFJl1RfqhQCyUDB1dKBEzsRBM= 2023-12-15T23:14:18.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OCHFJl1RfqhQCyUDB1dKBEzsRBM=', 'Content-Length': '0'} 2023-12-15T23:14:18.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec0d26f0f6be58ed-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.192 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.192 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.192 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.192 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.193 DEBUG:boto:Method: GET 2023-12-15T23:14:18.193 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.193 DEBUG:boto:Data: 2023-12-15T23:14:18.193 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.193 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.193 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.193 DEBUG:boto:Params: {} 2023-12-15T23:14:18.193 DEBUG:boto:Token: None 2023-12-15T23:14:18.193 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097674a5d1eeb7cb9-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.196 DEBUG:boto:b'kskgfn-48obj000000000000000000361000falseobj000000000000000000362023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.196 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.196 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.197 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.197 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.197 DEBUG:boto:Method: GET 2023-12-15T23:14:18.197 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000036 2023-12-15T23:14:18.197 DEBUG:boto:Data: 2023-12-15T23:14:18.197 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.197 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.197 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.197 DEBUG:boto:Params: {} 2023-12-15T23:14:18.197 DEBUG:boto:Token: None 2023-12-15T23:14:18.198 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091341d2223fb324f-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.201 DEBUG:boto:b'kskgfn-48obj000000000000000000361000falseobj000000000000000000362023-12-15T23:14:10.057Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.201 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2023-12-15T23:14:18.202 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.202 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.202 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.202 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.202 DEBUG:boto:Method: GET 2023-12-15T23:14:18.202 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.202 DEBUG:boto:Data: 2023-12-15T23:14:18.202 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.202 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.203 DEBUG:boto:Params: {} 2023-12-15T23:14:18.203 DEBUG:boto:Token: None 2023-12-15T23:14:18.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs= 2023-12-15T23:14:18.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs=', 'Content-Length': '0'} 2023-12-15T23:14:18.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007de7366ab5b04551-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.206 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.206 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.206 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.206 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.206 DEBUG:boto:Method: GET 2023-12-15T23:14:18.206 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.206 DEBUG:boto:Data: 2023-12-15T23:14:18.206 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.207 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.207 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.207 DEBUG:boto:Params: {} 2023-12-15T23:14:18.207 DEBUG:boto:Token: None 2023-12-15T23:14:18.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs= 2023-12-15T23:14:18.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs=', 'Content-Length': '0'} 2023-12-15T23:14:18.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086f1ce50be7b2aba-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.210 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.210 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.210 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.210 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.210 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.210 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.210 DEBUG:boto:Data: 2023-12-15T23:14:18.210 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.211 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.211 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.211 DEBUG:boto:Params: {} 2023-12-15T23:14:18.211 DEBUG:boto:Token: None 2023-12-15T23:14:18.211 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSjDyrZWAJQ3nYREcynMTB7eqvA= 2023-12-15T23:14:18.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSjDyrZWAJQ3nYREcynMTB7eqvA=', 'Content-Length': '0'} 2023-12-15T23:14:18.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db2d0e6a696a1b97-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.214 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.214 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.214 DEBUG:boto:Data: 2023-12-15T23:14:18.214 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.215 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.215 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.215 DEBUG:boto:Params: {} 2023-12-15T23:14:18.215 DEBUG:boto:Token: None 2023-12-15T23:14:18.215 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSjDyrZWAJQ3nYREcynMTB7eqvA= 2023-12-15T23:14:18.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSjDyrZWAJQ3nYREcynMTB7eqvA=', 'Content-Length': '0'} 2023-12-15T23:14:18.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010c6e5c621131017-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2023-12-15T23:14:18.217 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.218 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.218 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.218 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.218 DEBUG:boto:Method: GET 2023-12-15T23:14:18.218 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.218 DEBUG:boto:Data: 2023-12-15T23:14:18.218 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.218 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.218 DEBUG:boto:Params: {} 2023-12-15T23:14:18.218 DEBUG:boto:Token: None 2023-12-15T23:14:18.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs= 2023-12-15T23:14:18.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs=', 'Content-Length': '0'} 2023-12-15T23:14:18.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7fbe307f3ff71cf-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.261 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.262 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.262 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.262 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.262 DEBUG:boto:Method: GET 2023-12-15T23:14:18.262 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.262 DEBUG:boto:Data: 2023-12-15T23:14:18.262 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.262 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.262 DEBUG:boto:Params: {} 2023-12-15T23:14:18.263 DEBUG:boto:Token: None 2023-12-15T23:14:18.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037?versionId=null 2023-12-15T23:14:18.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs= 2023-12-15T23:14:18.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:273FuYKmz8+MiIGzXk8IGEHlNSs=', 'Content-Length': '0'} 2023-12-15T23:14:18.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077d3ea31941ac9f6-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.265 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.265 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.265 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.265 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.266 DEBUG:boto:Method: GET 2023-12-15T23:14:18.266 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.266 DEBUG:boto:Data: 2023-12-15T23:14:18.266 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.266 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.266 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.266 DEBUG:boto:Params: {} 2023-12-15T23:14:18.266 DEBUG:boto:Token: None 2023-12-15T23:14:18.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffebeba8b3cd727f-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.269 DEBUG:boto:b'kskgfn-48obj000000000000000000371000falseobj000000000000000000372023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.269 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.270 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.270 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.270 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.270 DEBUG:boto:Method: GET 2023-12-15T23:14:18.270 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.270 DEBUG:boto:Data: 2023-12-15T23:14:18.270 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.270 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.270 DEBUG:boto:Params: {} 2023-12-15T23:14:18.270 DEBUG:boto:Token: None 2023-12-15T23:14:18.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.275 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4e6fdf53ebd7456-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.275 DEBUG:boto:b'kskgfn-48obj000000000000000000371000falseobj000000000000000000372023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.275 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.275 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.275 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.276 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.276 DEBUG:boto:Data: 2023-12-15T23:14:18.276 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.276 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.276 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.276 DEBUG:boto:Params: {} 2023-12-15T23:14:18.276 DEBUG:boto:Token: None 2023-12-15T23:14:18.276 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.276 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4haZILZL1qFLeFjbq1t2swN1IM= 2023-12-15T23:14:18.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4haZILZL1qFLeFjbq1t2swN1IM=', 'Content-Length': '0'} 2023-12-15T23:14:18.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f635db62bae3e92-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.279 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.279 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.279 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.279 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.279 DEBUG:boto:Data: 2023-12-15T23:14:18.279 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.279 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.279 DEBUG:boto:Params: {} 2023-12-15T23:14:18.279 DEBUG:boto:Token: None 2023-12-15T23:14:18.280 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.280 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4haZILZL1qFLeFjbq1t2swN1IM= 2023-12-15T23:14:18.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4haZILZL1qFLeFjbq1t2swN1IM=', 'Content-Length': '0'} 2023-12-15T23:14:18.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd096e0c380da854-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2023-12-15T23:14:18.282 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.282 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.283 DEBUG:boto:Method: GET 2023-12-15T23:14:18.283 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.283 DEBUG:boto:Data: 2023-12-15T23:14:18.283 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.283 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.283 DEBUG:boto:Params: {} 2023-12-15T23:14:18.283 DEBUG:boto:Token: None 2023-12-15T23:14:18.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IXEdtbSdLtmKXlZd/16fVLB2qPY= 2023-12-15T23:14:18.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IXEdtbSdLtmKXlZd/16fVLB2qPY=', 'Content-Length': '0'} 2023-12-15T23:14:18.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000087e3ac78c915e87-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.286 DEBUG:boto:path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.286 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.286 DEBUG:boto:Method: GET 2023-12-15T23:14:18.286 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.286 DEBUG:boto:Data: 2023-12-15T23:14:18.286 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.287 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.287 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.287 DEBUG:boto:Params: {} 2023-12-15T23:14:18.287 DEBUG:boto:Token: None 2023-12-15T23:14:18.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000037 2023-12-15T23:14:18.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IXEdtbSdLtmKXlZd/16fVLB2qPY= 2023-12-15T23:14:18.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IXEdtbSdLtmKXlZd/16fVLB2qPY=', 'Content-Length': '0'} 2023-12-15T23:14:18.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c6cb4d597f78fbb-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.334 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.334 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.334 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.334 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.334 DEBUG:boto:Method: GET 2023-12-15T23:14:18.334 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.334 DEBUG:boto:Data: 2023-12-15T23:14:18.334 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.334 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.334 DEBUG:boto:Params: {} 2023-12-15T23:14:18.335 DEBUG:boto:Token: None 2023-12-15T23:14:18.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb28102b39de0e4d-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.338 DEBUG:boto:b'kskgfn-48obj000000000000000000371000falseobj000000000000000000372023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.338 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.338 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.338 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.338 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.338 DEBUG:boto:Method: GET 2023-12-15T23:14:18.338 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000037 2023-12-15T23:14:18.338 DEBUG:boto:Data: 2023-12-15T23:14:18.339 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.339 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.339 DEBUG:boto:Params: {} 2023-12-15T23:14:18.339 DEBUG:boto:Token: None 2023-12-15T23:14:18.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000045b37036f84f7a1-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.343 DEBUG:boto:b'kskgfn-48obj000000000000000000371000falseobj000000000000000000372023-12-15T23:14:08.340Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.343 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2023-12-15T23:14:18.343 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.344 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.344 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.344 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.344 DEBUG:boto:Method: GET 2023-12-15T23:14:18.344 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.344 DEBUG:boto:Data: 2023-12-15T23:14:18.344 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.344 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.344 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.344 DEBUG:boto:Params: {} 2023-12-15T23:14:18.344 DEBUG:boto:Token: None 2023-12-15T23:14:18.345 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.345 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY= 2023-12-15T23:14:18.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY=', 'Content-Length': '0'} 2023-12-15T23:14:18.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ca525e3ea225797-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.389 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.389 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.390 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.390 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.390 DEBUG:boto:Method: GET 2023-12-15T23:14:18.390 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.390 DEBUG:boto:Data: 2023-12-15T23:14:18.390 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.390 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.390 DEBUG:boto:Params: {} 2023-12-15T23:14:18.390 DEBUG:boto:Token: None 2023-12-15T23:14:18.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY= 2023-12-15T23:14:18.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY=', 'Content-Length': '0'} 2023-12-15T23:14:18.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b0e6e1a14836e81-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.393 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.393 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.393 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.393 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.393 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.393 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.394 DEBUG:boto:Data: 2023-12-15T23:14:18.394 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.394 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.394 DEBUG:boto:Params: {} 2023-12-15T23:14:18.394 DEBUG:boto:Token: None 2023-12-15T23:14:18.394 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+nF7o9q2W5uREijRNjrw89JH24U= 2023-12-15T23:14:18.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+nF7o9q2W5uREijRNjrw89JH24U=', 'Content-Length': '0'} 2023-12-15T23:14:18.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074247876bc3176c6-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.396 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.397 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.397 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.397 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.397 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.397 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.397 DEBUG:boto:Data: 2023-12-15T23:14:18.397 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.397 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.397 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.397 DEBUG:boto:Params: {} 2023-12-15T23:14:18.398 DEBUG:boto:Token: None 2023-12-15T23:14:18.398 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+nF7o9q2W5uREijRNjrw89JH24U= 2023-12-15T23:14:18.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+nF7o9q2W5uREijRNjrw89JH24U=', 'Content-Length': '0'} 2023-12-15T23:14:18.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca12c2de03274def-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2023-12-15T23:14:18.400 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.400 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.400 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.400 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.400 DEBUG:boto:Method: GET 2023-12-15T23:14:18.400 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.401 DEBUG:boto:Data: 2023-12-15T23:14:18.401 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.401 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.401 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.401 DEBUG:boto:Params: {} 2023-12-15T23:14:18.401 DEBUG:boto:Token: None 2023-12-15T23:14:18.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY= 2023-12-15T23:14:18.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY=', 'Content-Length': '0'} 2023-12-15T23:14:18.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bc68e97e25ec724-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.403 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.403 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.404 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.404 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.404 DEBUG:boto:Method: GET 2023-12-15T23:14:18.404 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.404 DEBUG:boto:Data: 2023-12-15T23:14:18.404 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.404 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.404 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.404 DEBUG:boto:Params: {} 2023-12-15T23:14:18.404 DEBUG:boto:Token: None 2023-12-15T23:14:18.405 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039?versionId=null 2023-12-15T23:14:18.405 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY= 2023-12-15T23:14:18.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8MnKlX8lOA7ITCCe4NWG2FJjfzY=', 'Content-Length': '0'} 2023-12-15T23:14:18.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a43204bf0f0a3be-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.407 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.407 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.407 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.407 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.407 DEBUG:boto:Method: GET 2023-12-15T23:14:18.407 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.407 DEBUG:boto:Data: 2023-12-15T23:14:18.407 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.407 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.407 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.408 DEBUG:boto:Params: {} 2023-12-15T23:14:18.408 DEBUG:boto:Token: None 2023-12-15T23:14:18.408 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.408 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069eaf4f45945a110-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.410 DEBUG:boto:b'kskgfn-48obj000000000000000000391000falseobj000000000000000000392023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.411 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.411 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.411 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.411 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.411 DEBUG:boto:Method: GET 2023-12-15T23:14:18.411 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.411 DEBUG:boto:Data: 2023-12-15T23:14:18.411 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.411 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.411 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.412 DEBUG:boto:Params: {} 2023-12-15T23:14:18.412 DEBUG:boto:Token: None 2023-12-15T23:14:18.412 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.416 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007db9d9c3f22a07dc-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.416 DEBUG:boto:b'kskgfn-48obj000000000000000000391000falseobj000000000000000000392023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.416 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.416 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.416 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.416 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.417 DEBUG:boto:Data: 2023-12-15T23:14:18.417 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.417 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.417 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.417 DEBUG:boto:Params: {} 2023-12-15T23:14:18.417 DEBUG:boto:Token: None 2023-12-15T23:14:18.417 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:au9+a3wsJAN5cLrniPN94bygdkQ= 2023-12-15T23:14:18.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:au9+a3wsJAN5cLrniPN94bygdkQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a466cdaaa0f8689b-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.419 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.419 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.419 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.419 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.420 DEBUG:boto:Data: 2023-12-15T23:14:18.420 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.420 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.420 DEBUG:boto:Params: {} 2023-12-15T23:14:18.420 DEBUG:boto:Token: None 2023-12-15T23:14:18.420 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:au9+a3wsJAN5cLrniPN94bygdkQ= 2023-12-15T23:14:18.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:au9+a3wsJAN5cLrniPN94bygdkQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d52f84a3f09fae91-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.422 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2023-12-15T23:14:18.422 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.422 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.422 DEBUG:boto:Method: GET 2023-12-15T23:14:18.423 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.423 DEBUG:boto:Data: 2023-12-15T23:14:18.423 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.423 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.423 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.423 DEBUG:boto:Params: {} 2023-12-15T23:14:18.423 DEBUG:boto:Token: None 2023-12-15T23:14:18.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZNVfuJ7LF4x0pymXv08sM2VOolw= 2023-12-15T23:14:18.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZNVfuJ7LF4x0pymXv08sM2VOolw=', 'Content-Length': '0'} 2023-12-15T23:14:18.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003f3c3f161bb3c5d-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.426 DEBUG:boto:path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.426 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.426 DEBUG:boto:Method: GET 2023-12-15T23:14:18.426 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.426 DEBUG:boto:Data: 2023-12-15T23:14:18.426 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.426 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.426 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.426 DEBUG:boto:Params: {} 2023-12-15T23:14:18.426 DEBUG:boto:Token: None 2023-12-15T23:14:18.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000039 2023-12-15T23:14:18.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZNVfuJ7LF4x0pymXv08sM2VOolw= 2023-12-15T23:14:18.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZNVfuJ7LF4x0pymXv08sM2VOolw=', 'Content-Length': '0'} 2023-12-15T23:14:18.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d679532214b6eea-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.469 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.470 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.470 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.470 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.470 DEBUG:boto:Method: GET 2023-12-15T23:14:18.470 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.470 DEBUG:boto:Data: 2023-12-15T23:14:18.470 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.470 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.470 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.470 DEBUG:boto:Params: {} 2023-12-15T23:14:18.470 DEBUG:boto:Token: None 2023-12-15T23:14:18.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054f95261253ad0cb-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.473 DEBUG:boto:b'kskgfn-48obj000000000000000000391000falseobj000000000000000000392023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.474 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.474 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.474 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.474 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.474 DEBUG:boto:Method: GET 2023-12-15T23:14:18.474 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000039 2023-12-15T23:14:18.474 DEBUG:boto:Data: 2023-12-15T23:14:18.474 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.475 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.475 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.475 DEBUG:boto:Params: {} 2023-12-15T23:14:18.475 DEBUG:boto:Token: None 2023-12-15T23:14:18.475 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000334e2599d1d56470-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.479 DEBUG:boto:b'kskgfn-48obj000000000000000000391000falseobj000000000000000000392023-12-15T23:14:09.997Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2023-12-15T23:14:18.479 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.480 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.480 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.480 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.480 DEBUG:boto:Method: GET 2023-12-15T23:14:18.480 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.480 DEBUG:boto:Data: 2023-12-15T23:14:18.480 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.480 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.480 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.480 DEBUG:boto:Params: {} 2023-12-15T23:14:18.480 DEBUG:boto:Token: None 2023-12-15T23:14:18.481 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.481 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY= 2023-12-15T23:14:18.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY=', 'Content-Length': '0'} 2023-12-15T23:14:18.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004c8ed67b390dcf9-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.529 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.530 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.530 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.530 DEBUG:boto:Method: GET 2023-12-15T23:14:18.530 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.530 DEBUG:boto:Data: 2023-12-15T23:14:18.530 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.530 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.530 DEBUG:boto:Params: {} 2023-12-15T23:14:18.531 DEBUG:boto:Token: None 2023-12-15T23:14:18.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY= 2023-12-15T23:14:18.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY=', 'Content-Length': '0'} 2023-12-15T23:14:18.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aad79cf3b7a6b550-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.533 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.533 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.533 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.533 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.534 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.534 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.534 DEBUG:boto:Data: 2023-12-15T23:14:18.534 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.534 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.534 DEBUG:boto:Params: {} 2023-12-15T23:14:18.534 DEBUG:boto:Token: None 2023-12-15T23:14:18.534 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kzZNQ9C27nbBWRt6pUA+j+JoxY= 2023-12-15T23:14:18.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kzZNQ9C27nbBWRt6pUA+j+JoxY=', 'Content-Length': '0'} 2023-12-15T23:14:18.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d3bba89e3bae64d-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.537 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.537 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.537 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.537 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.537 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.537 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.537 DEBUG:boto:Data: 2023-12-15T23:14:18.537 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.537 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.537 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.538 DEBUG:boto:Params: {} 2023-12-15T23:14:18.538 DEBUG:boto:Token: None 2023-12-15T23:14:18.538 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6kzZNQ9C27nbBWRt6pUA+j+JoxY= 2023-12-15T23:14:18.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6kzZNQ9C27nbBWRt6pUA+j+JoxY=', 'Content-Length': '0'} 2023-12-15T23:14:18.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002681ec179d5ef016-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2023-12-15T23:14:18.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.540 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.540 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.540 DEBUG:boto:Method: GET 2023-12-15T23:14:18.540 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.541 DEBUG:boto:Data: 2023-12-15T23:14:18.541 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.541 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.541 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.541 DEBUG:boto:Params: {} 2023-12-15T23:14:18.541 DEBUG:boto:Token: None 2023-12-15T23:14:18.541 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.541 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY= 2023-12-15T23:14:18.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY=', 'Content-Length': '0'} 2023-12-15T23:14:18.543 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ec93e08a0ec53e5-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.543 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.544 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.544 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.544 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.544 DEBUG:boto:Method: GET 2023-12-15T23:14:18.544 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.544 DEBUG:boto:Data: 2023-12-15T23:14:18.544 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.544 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.544 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.544 DEBUG:boto:Params: {} 2023-12-15T23:14:18.545 DEBUG:boto:Token: None 2023-12-15T23:14:18.545 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040?versionId=null 2023-12-15T23:14:18.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY= 2023-12-15T23:14:18.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2pK8YwJi0U+GfKhr5bTNg/1dBMY=', 'Content-Length': '0'} 2023-12-15T23:14:18.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008932d2c32a8d0da3-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.547 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.547 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.547 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.547 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.548 DEBUG:boto:Method: GET 2023-12-15T23:14:18.548 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.548 DEBUG:boto:Data: 2023-12-15T23:14:18.548 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.548 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.548 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.548 DEBUG:boto:Params: {} 2023-12-15T23:14:18.548 DEBUG:boto:Token: None 2023-12-15T23:14:18.548 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.551 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d89eaaff4f619b0a-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.551 DEBUG:boto:b'kskgfn-48obj000000000000000000401000falseobj000000000000000000402023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.551 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.551 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.552 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.552 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.552 DEBUG:boto:Method: GET 2023-12-15T23:14:18.552 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.552 DEBUG:boto:Data: 2023-12-15T23:14:18.552 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.552 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.552 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.552 DEBUG:boto:Params: {} 2023-12-15T23:14:18.552 DEBUG:boto:Token: None 2023-12-15T23:14:18.552 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045f4b27e7013a26b-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.556 DEBUG:boto:b'kskgfn-48obj000000000000000000401000falseobj000000000000000000402023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.556 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.556 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.557 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.557 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.557 DEBUG:boto:Data: 2023-12-15T23:14:18.557 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.557 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.557 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.557 DEBUG:boto:Params: {} 2023-12-15T23:14:18.557 DEBUG:boto:Token: None 2023-12-15T23:14:18.557 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6+6wUqOUuOYUj1IQ+SVjEA1z5FQ= 2023-12-15T23:14:18.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6+6wUqOUuOYUj1IQ+SVjEA1z5FQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a232ecaaf1d65c58-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.560 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.560 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.560 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.560 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.560 DEBUG:boto:Data: 2023-12-15T23:14:18.560 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.560 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.560 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.560 DEBUG:boto:Params: {} 2023-12-15T23:14:18.560 DEBUG:boto:Token: None 2023-12-15T23:14:18.561 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.561 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6+6wUqOUuOYUj1IQ+SVjEA1z5FQ= 2023-12-15T23:14:18.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6+6wUqOUuOYUj1IQ+SVjEA1z5FQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091ff7dc3f13807f4-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2023-12-15T23:14:18.563 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.563 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.563 DEBUG:boto:Method: GET 2023-12-15T23:14:18.563 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.563 DEBUG:boto:Data: 2023-12-15T23:14:18.563 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.563 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.563 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.563 DEBUG:boto:Params: {} 2023-12-15T23:14:18.564 DEBUG:boto:Token: None 2023-12-15T23:14:18.564 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.564 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:scferMlNc3ap1otgW/JPNSH2xMM= 2023-12-15T23:14:18.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:scferMlNc3ap1otgW/JPNSH2xMM=', 'Content-Length': '0'} 2023-12-15T23:14:18.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5608658b2a8d5e7-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.566 DEBUG:boto:path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.566 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.566 DEBUG:boto:Method: GET 2023-12-15T23:14:18.566 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.567 DEBUG:boto:Data: 2023-12-15T23:14:18.567 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.567 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.567 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.567 DEBUG:boto:Params: {} 2023-12-15T23:14:18.567 DEBUG:boto:Token: None 2023-12-15T23:14:18.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000040 2023-12-15T23:14:18.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:scferMlNc3ap1otgW/JPNSH2xMM= 2023-12-15T23:14:18.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:scferMlNc3ap1otgW/JPNSH2xMM=', 'Content-Length': '0'} 2023-12-15T23:14:18.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac15bec1dee927c8-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.609 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.610 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.610 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.610 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.610 DEBUG:boto:Method: GET 2023-12-15T23:14:18.610 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.610 DEBUG:boto:Data: 2023-12-15T23:14:18.610 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.610 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.610 DEBUG:boto:Params: {} 2023-12-15T23:14:18.611 DEBUG:boto:Token: None 2023-12-15T23:14:18.611 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f7a3b6445bb5324-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.613 DEBUG:boto:b'kskgfn-48obj000000000000000000401000falseobj000000000000000000402023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.614 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.614 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.614 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.614 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.614 DEBUG:boto:Method: GET 2023-12-15T23:14:18.614 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000040 2023-12-15T23:14:18.614 DEBUG:boto:Data: 2023-12-15T23:14:18.614 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.615 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.615 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.615 DEBUG:boto:Params: {} 2023-12-15T23:14:18.615 DEBUG:boto:Token: None 2023-12-15T23:14:18.615 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.619 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024e94b108cd9cd6d-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.619 DEBUG:boto:b'kskgfn-48obj000000000000000000401000falseobj000000000000000000402023-12-15T23:14:10.121Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2023-12-15T23:14:18.619 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.620 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.620 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.620 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.620 DEBUG:boto:Method: GET 2023-12-15T23:14:18.620 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.620 DEBUG:boto:Data: 2023-12-15T23:14:18.620 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.620 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.620 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.620 DEBUG:boto:Params: {} 2023-12-15T23:14:18.620 DEBUG:boto:Token: None 2023-12-15T23:14:18.621 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.621 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE= 2023-12-15T23:14:18.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE=', 'Content-Length': '0'} 2023-12-15T23:14:18.623 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0805facf614955d-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.665 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.666 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.666 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.666 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.666 DEBUG:boto:Method: GET 2023-12-15T23:14:18.666 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.666 DEBUG:boto:Data: 2023-12-15T23:14:18.666 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.666 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.667 DEBUG:boto:Params: {} 2023-12-15T23:14:18.667 DEBUG:boto:Token: None 2023-12-15T23:14:18.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE= 2023-12-15T23:14:18.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE=', 'Content-Length': '0'} 2023-12-15T23:14:18.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b97152dc985146f-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.669 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.669 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.670 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.670 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.670 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.670 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.670 DEBUG:boto:Data: 2023-12-15T23:14:18.670 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.670 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.670 DEBUG:boto:Params: {} 2023-12-15T23:14:18.670 DEBUG:boto:Token: None 2023-12-15T23:14:18.671 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ThZogYL5sx4fYcYmeKIt/ZE5jhM= 2023-12-15T23:14:18.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ThZogYL5sx4fYcYmeKIt/ZE5jhM=', 'Content-Length': '0'} 2023-12-15T23:14:18.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000935f0817ba9f01a5-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.673 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.673 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.673 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.673 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.673 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.673 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.674 DEBUG:boto:Data: 2023-12-15T23:14:18.674 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.674 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.674 DEBUG:boto:Params: {} 2023-12-15T23:14:18.674 DEBUG:boto:Token: None 2023-12-15T23:14:18.674 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ThZogYL5sx4fYcYmeKIt/ZE5jhM= 2023-12-15T23:14:18.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ThZogYL5sx4fYcYmeKIt/ZE5jhM=', 'Content-Length': '0'} 2023-12-15T23:14:18.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5bd792c3dca3818-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.677 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2023-12-15T23:14:18.677 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.677 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.677 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.677 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.677 DEBUG:boto:Method: GET 2023-12-15T23:14:18.678 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.678 DEBUG:boto:Data: 2023-12-15T23:14:18.678 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.678 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.678 DEBUG:boto:Params: {} 2023-12-15T23:14:18.678 DEBUG:boto:Token: None 2023-12-15T23:14:18.678 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE= 2023-12-15T23:14:18.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE=', 'Content-Length': '0'} 2023-12-15T23:14:18.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abd31c8e32a5a87b-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.681 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.681 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.681 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.681 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.681 DEBUG:boto:Method: GET 2023-12-15T23:14:18.682 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.682 DEBUG:boto:Data: 2023-12-15T23:14:18.682 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.682 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.682 DEBUG:boto:Params: {} 2023-12-15T23:14:18.682 DEBUG:boto:Token: None 2023-12-15T23:14:18.682 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045?versionId=null 2023-12-15T23:14:18.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE= 2023-12-15T23:14:18.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MflfFo6ZC9w8hOlst41P8SZnDgE=', 'Content-Length': '0'} 2023-12-15T23:14:18.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087e332268a58898e-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.685 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.685 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.685 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.685 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.685 DEBUG:boto:Method: GET 2023-12-15T23:14:18.685 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.685 DEBUG:boto:Data: 2023-12-15T23:14:18.686 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.686 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.686 DEBUG:boto:Params: {} 2023-12-15T23:14:18.686 DEBUG:boto:Token: None 2023-12-15T23:14:18.686 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031a69e639d37697c-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.689 DEBUG:boto:b'kskgfn-48obj000000000000000000451000falseobj000000000000000000452023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.689 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.690 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.690 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.690 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.690 DEBUG:boto:Method: GET 2023-12-15T23:14:18.690 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.690 DEBUG:boto:Data: 2023-12-15T23:14:18.690 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.690 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.690 DEBUG:boto:Params: {} 2023-12-15T23:14:18.691 DEBUG:boto:Token: None 2023-12-15T23:14:18.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.694 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb39b02a23d57905-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.695 DEBUG:boto:b'kskgfn-48obj000000000000000000451000falseobj000000000000000000452023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.695 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.695 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.695 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.695 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.695 DEBUG:boto:Data: 2023-12-15T23:14:18.695 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.696 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.696 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.696 DEBUG:boto:Params: {} 2023-12-15T23:14:18.696 DEBUG:boto:Token: None 2023-12-15T23:14:18.696 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.696 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xcK5jbDRUiDi3LP7GbSPH9XFj48= 2023-12-15T23:14:18.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xcK5jbDRUiDi3LP7GbSPH9XFj48=', 'Content-Length': '0'} 2023-12-15T23:14:18.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f0bb2aad5d184b3-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.698 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.699 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.699 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.699 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.699 DEBUG:boto:Data: 2023-12-15T23:14:18.699 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.699 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.699 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.699 DEBUG:boto:Params: {} 2023-12-15T23:14:18.699 DEBUG:boto:Token: None 2023-12-15T23:14:18.700 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xcK5jbDRUiDi3LP7GbSPH9XFj48= 2023-12-15T23:14:18.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xcK5jbDRUiDi3LP7GbSPH9XFj48=', 'Content-Length': '0'} 2023-12-15T23:14:18.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba8d77c2512ff244-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.702 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2023-12-15T23:14:18.702 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.702 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.702 DEBUG:boto:Method: GET 2023-12-15T23:14:18.702 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.702 DEBUG:boto:Data: 2023-12-15T23:14:18.703 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.703 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.703 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.703 DEBUG:boto:Params: {} 2023-12-15T23:14:18.703 DEBUG:boto:Token: None 2023-12-15T23:14:18.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FT4I1Hq+J3fBLNIALLSWjXctc9s= 2023-12-15T23:14:18.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FT4I1Hq+J3fBLNIALLSWjXctc9s=', 'Content-Length': '0'} 2023-12-15T23:14:18.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b85aa1b5ab0a2ec-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.705 DEBUG:boto:path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.706 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.706 DEBUG:boto:Method: GET 2023-12-15T23:14:18.706 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.706 DEBUG:boto:Data: 2023-12-15T23:14:18.706 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.706 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.706 DEBUG:boto:Params: {} 2023-12-15T23:14:18.706 DEBUG:boto:Token: None 2023-12-15T23:14:18.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000045 2023-12-15T23:14:18.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FT4I1Hq+J3fBLNIALLSWjXctc9s= 2023-12-15T23:14:18.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FT4I1Hq+J3fBLNIALLSWjXctc9s=', 'Content-Length': '0'} 2023-12-15T23:14:18.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000973137bae3c133ae-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.749 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.750 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.750 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.750 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.750 DEBUG:boto:Method: GET 2023-12-15T23:14:18.750 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.750 DEBUG:boto:Data: 2023-12-15T23:14:18.750 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.750 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.750 DEBUG:boto:Params: {} 2023-12-15T23:14:18.751 DEBUG:boto:Token: None 2023-12-15T23:14:18.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7f4c3e1ed0115cd-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.753 DEBUG:boto:b'kskgfn-48obj000000000000000000451000falseobj000000000000000000452023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.754 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.754 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.754 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.754 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.754 DEBUG:boto:Method: GET 2023-12-15T23:14:18.754 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000045 2023-12-15T23:14:18.754 DEBUG:boto:Data: 2023-12-15T23:14:18.754 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.755 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.755 DEBUG:boto:Params: {} 2023-12-15T23:14:18.755 DEBUG:boto:Token: None 2023-12-15T23:14:18.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.759 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c71198188beddd43-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.759 DEBUG:boto:b'kskgfn-48obj000000000000000000451000falseobj000000000000000000452023-12-15T23:14:10.569Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2023-12-15T23:14:18.759 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.760 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.760 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.760 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.760 DEBUG:boto:Method: GET 2023-12-15T23:14:18.760 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.760 DEBUG:boto:Data: 2023-12-15T23:14:18.760 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.760 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.760 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.760 DEBUG:boto:Params: {} 2023-12-15T23:14:18.761 DEBUG:boto:Token: None 2023-12-15T23:14:18.761 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4= 2023-12-15T23:14:18.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4=', 'Content-Length': '0'} 2023-12-15T23:14:18.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071ab23db6ed36cc9-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.763 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.764 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.764 DEBUG:boto:Method: GET 2023-12-15T23:14:18.764 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.764 DEBUG:boto:Data: 2023-12-15T23:14:18.764 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.764 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.764 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.765 DEBUG:boto:Params: {} 2023-12-15T23:14:18.765 DEBUG:boto:Token: None 2023-12-15T23:14:18.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4= 2023-12-15T23:14:18.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4=', 'Content-Length': '0'} 2023-12-15T23:14:18.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e172568f2d5bebb8-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.768 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.768 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.768 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.768 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.768 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.768 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.768 DEBUG:boto:Data: 2023-12-15T23:14:18.769 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.769 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.769 DEBUG:boto:Params: {} 2023-12-15T23:14:18.769 DEBUG:boto:Token: None 2023-12-15T23:14:18.769 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KWrY9Tp3kGqokPvnklvMpQE00eA= 2023-12-15T23:14:18.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KWrY9Tp3kGqokPvnklvMpQE00eA=', 'Content-Length': '0'} 2023-12-15T23:14:18.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c09e130e1175021c-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.772 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.772 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.772 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.772 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.772 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.772 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.772 DEBUG:boto:Data: 2023-12-15T23:14:18.772 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.772 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.773 DEBUG:boto:Params: {} 2023-12-15T23:14:18.773 DEBUG:boto:Token: None 2023-12-15T23:14:18.773 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KWrY9Tp3kGqokPvnklvMpQE00eA= 2023-12-15T23:14:18.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KWrY9Tp3kGqokPvnklvMpQE00eA=', 'Content-Length': '0'} 2023-12-15T23:14:18.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a36a9a0bc9a71ea2-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.775 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2023-12-15T23:14:18.775 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.776 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.776 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.776 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.776 DEBUG:boto:Method: GET 2023-12-15T23:14:18.776 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.776 DEBUG:boto:Data: 2023-12-15T23:14:18.776 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.776 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.776 DEBUG:boto:Params: {} 2023-12-15T23:14:18.777 DEBUG:boto:Token: None 2023-12-15T23:14:18.777 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.777 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4= 2023-12-15T23:14:18.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4=', 'Content-Length': '0'} 2023-12-15T23:14:18.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007ba47338e4838f6-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.779 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.779 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.779 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.779 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.780 DEBUG:boto:Method: GET 2023-12-15T23:14:18.780 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.780 DEBUG:boto:Data: 2023-12-15T23:14:18.780 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.780 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.780 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.780 DEBUG:boto:Params: {} 2023-12-15T23:14:18.780 DEBUG:boto:Token: None 2023-12-15T23:14:18.780 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046?versionId=null 2023-12-15T23:14:18.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4= 2023-12-15T23:14:18.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vIl1cgW81c2Cd7MVwV0n8CkmGp4=', 'Content-Length': '0'} 2023-12-15T23:14:18.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a31bc8485dab581-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.783 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.783 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.783 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.784 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.784 DEBUG:boto:Method: GET 2023-12-15T23:14:18.784 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.784 DEBUG:boto:Data: 2023-12-15T23:14:18.784 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.784 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.784 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.784 DEBUG:boto:Params: {} 2023-12-15T23:14:18.784 DEBUG:boto:Token: None 2023-12-15T23:14:18.785 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.787 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007914a80991f733af-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.787 DEBUG:boto:b'kskgfn-48obj000000000000000000461000falseobj000000000000000000462023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.788 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.788 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.788 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.788 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.788 DEBUG:boto:Method: GET 2023-12-15T23:14:18.788 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.789 DEBUG:boto:Data: 2023-12-15T23:14:18.789 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.789 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.789 DEBUG:boto:Params: {} 2023-12-15T23:14:18.789 DEBUG:boto:Token: None 2023-12-15T23:14:18.789 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db95318c517ea9d6-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.833 DEBUG:boto:b'kskgfn-48obj000000000000000000461000falseobj000000000000000000462023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.834 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.834 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.834 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.834 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.834 DEBUG:boto:Data: 2023-12-15T23:14:18.834 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.835 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.835 DEBUG:boto:Params: {} 2023-12-15T23:14:18.835 DEBUG:boto:Token: None 2023-12-15T23:14:18.835 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yc4nPgPXAMkv2CM+sn0txYF1dfo= 2023-12-15T23:14:18.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yc4nPgPXAMkv2CM+sn0txYF1dfo=', 'Content-Length': '0'} 2023-12-15T23:14:18.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a2cb24230255449-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.838 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.838 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.838 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.838 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.838 DEBUG:boto:Data: 2023-12-15T23:14:18.839 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.839 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.839 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.839 DEBUG:boto:Params: {} 2023-12-15T23:14:18.839 DEBUG:boto:Token: None 2023-12-15T23:14:18.839 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yc4nPgPXAMkv2CM+sn0txYF1dfo= 2023-12-15T23:14:18.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yc4nPgPXAMkv2CM+sn0txYF1dfo=', 'Content-Length': '0'} 2023-12-15T23:14:18.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5112e3c81a3097e-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.842 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2023-12-15T23:14:18.842 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.842 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.842 DEBUG:boto:Method: GET 2023-12-15T23:14:18.842 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.842 DEBUG:boto:Data: 2023-12-15T23:14:18.842 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.842 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.842 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.843 DEBUG:boto:Params: {} 2023-12-15T23:14:18.843 DEBUG:boto:Token: None 2023-12-15T23:14:18.843 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.843 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RbZBjKkU+36wo+0R7qoxqQJ0QLw= 2023-12-15T23:14:18.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RbZBjKkU+36wo+0R7qoxqQJ0QLw=', 'Content-Length': '0'} 2023-12-15T23:14:18.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000406ae408d1978ca0-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.886 DEBUG:boto:path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.886 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.886 DEBUG:boto:Method: GET 2023-12-15T23:14:18.886 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.886 DEBUG:boto:Data: 2023-12-15T23:14:18.886 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.886 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.886 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.886 DEBUG:boto:Params: {} 2023-12-15T23:14:18.887 DEBUG:boto:Token: None 2023-12-15T23:14:18.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000046 2023-12-15T23:14:18.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RbZBjKkU+36wo+0R7qoxqQJ0QLw= 2023-12-15T23:14:18.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RbZBjKkU+36wo+0R7qoxqQJ0QLw=', 'Content-Length': '0'} 2023-12-15T23:14:18.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a16f96bd4466fc69-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.890 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.890 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.890 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.890 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.890 DEBUG:boto:Method: GET 2023-12-15T23:14:18.890 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.891 DEBUG:boto:Data: 2023-12-15T23:14:18.891 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.891 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.891 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.891 DEBUG:boto:Params: {} 2023-12-15T23:14:18.891 DEBUG:boto:Token: None 2023-12-15T23:14:18.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030700a5555ad7232-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.894 DEBUG:boto:b'kskgfn-48obj000000000000000000461000falseobj000000000000000000462023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.894 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.895 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.895 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.895 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.895 DEBUG:boto:Method: GET 2023-12-15T23:14:18.895 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000046 2023-12-15T23:14:18.895 DEBUG:boto:Data: 2023-12-15T23:14:18.895 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.895 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.895 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.895 DEBUG:boto:Params: {} 2023-12-15T23:14:18.896 DEBUG:boto:Token: None 2023-12-15T23:14:18.896 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.896 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdfb6d9c93c8dd0a-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.900 DEBUG:boto:b'kskgfn-48obj000000000000000000461000falseobj000000000000000000462023-12-15T23:14:07.052Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2023-12-15T23:14:18.900 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.900 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.900 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.901 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.901 DEBUG:boto:Method: GET 2023-12-15T23:14:18.901 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.901 DEBUG:boto:Data: 2023-12-15T23:14:18.901 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.901 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.901 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.901 DEBUG:boto:Params: {} 2023-12-15T23:14:18.901 DEBUG:boto:Token: None 2023-12-15T23:14:18.901 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.902 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo= 2023-12-15T23:14:18.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo=', 'Content-Length': '0'} 2023-12-15T23:14:18.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e02925d55a44a6a2-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.904 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.904 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.904 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.904 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.905 DEBUG:boto:Method: GET 2023-12-15T23:14:18.905 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.905 DEBUG:boto:Data: 2023-12-15T23:14:18.905 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.905 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.905 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.905 DEBUG:boto:Params: {} 2023-12-15T23:14:18.905 DEBUG:boto:Token: None 2023-12-15T23:14:18.905 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.905 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo= 2023-12-15T23:14:18.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo=', 'Content-Length': '0'} 2023-12-15T23:14:18.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051f812d023573acc-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.949 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.950 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.950 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.950 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.950 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.950 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.950 DEBUG:boto:Data: 2023-12-15T23:14:18.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.950 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.950 DEBUG:boto:Params: {} 2023-12-15T23:14:18.951 DEBUG:boto:Token: None 2023-12-15T23:14:18.951 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:At6K3WO52+pnGbF32keE3/YYucs= 2023-12-15T23:14:18.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:At6K3WO52+pnGbF32keE3/YYucs=', 'Content-Length': '0'} 2023-12-15T23:14:18.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051baaf0c278b17e5-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.953 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.953 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.953 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.953 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.954 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.954 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.954 DEBUG:boto:Data: 2023-12-15T23:14:18.954 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.954 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.954 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.954 DEBUG:boto:Params: {} 2023-12-15T23:14:18.954 DEBUG:boto:Token: None 2023-12-15T23:14:18.954 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:At6K3WO52+pnGbF32keE3/YYucs= 2023-12-15T23:14:18.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:At6K3WO52+pnGbF32keE3/YYucs=', 'Content-Length': '0'} 2023-12-15T23:14:18.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008171e7d0b48f0416-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2023-12-15T23:14:18.957 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.957 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.957 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.957 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.957 DEBUG:boto:Method: GET 2023-12-15T23:14:18.958 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.958 DEBUG:boto:Data: 2023-12-15T23:14:18.958 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.958 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.958 DEBUG:boto:Params: {} 2023-12-15T23:14:18.958 DEBUG:boto:Token: None 2023-12-15T23:14:18.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.958 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo= 2023-12-15T23:14:18.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo=', 'Content-Length': '0'} 2023-12-15T23:14:18.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc85e3e0c25374ba-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.961 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.961 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.961 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.961 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.961 DEBUG:boto:Method: GET 2023-12-15T23:14:18.961 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.962 DEBUG:boto:Data: 2023-12-15T23:14:18.962 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.962 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.962 DEBUG:boto:Params: {} 2023-12-15T23:14:18.962 DEBUG:boto:Token: None 2023-12-15T23:14:18.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049?versionId=null 2023-12-15T23:14:18.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo= 2023-12-15T23:14:18.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bSkosDIFH1uuo4b+q5y722sLLAo=', 'Content-Length': '0'} 2023-12-15T23:14:18.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a5714d3ecd64703-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.964 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.965 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.965 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.965 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.965 DEBUG:boto:Method: GET 2023-12-15T23:14:18.965 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.965 DEBUG:boto:Data: 2023-12-15T23:14:18.965 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.965 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.965 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.965 DEBUG:boto:Params: {} 2023-12-15T23:14:18.966 DEBUG:boto:Token: None 2023-12-15T23:14:18.966 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.968 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d613edf8148c1dc3-00657cddca-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.968 DEBUG:boto:b'kskgfn-48obj000000000000000000491000falseobj000000000000000000492023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.969 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:18.969 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:18.969 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.969 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.969 DEBUG:boto:Method: GET 2023-12-15T23:14:18.969 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:18.969 DEBUG:boto:Data: 2023-12-15T23:14:18.969 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.970 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.970 DEBUG:boto:Params: {} 2023-12-15T23:14:18.970 DEBUG:boto:Token: None 2023-12-15T23:14:18.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/ 2023-12-15T23:14:18.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY= 2023-12-15T23:14:18.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AGJ8IuO1T6a8bgUB5l9wbIfCWUY=', 'Content-Length': '0'} 2023-12-15T23:14:18.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002372abe9ed1ed5a6-00657cddca-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.974 DEBUG:boto:b'kskgfn-48obj000000000000000000491000falseobj000000000000000000492023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:18.974 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.974 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.974 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.974 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.974 DEBUG:boto:Data: 2023-12-15T23:14:18.975 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.975 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.975 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.975 DEBUG:boto:Params: {} 2023-12-15T23:14:18.975 DEBUG:boto:Token: None 2023-12-15T23:14:18.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f8m/yjXJaiS+9XATYJfGKawTOcQ= 2023-12-15T23:14:18.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f8m/yjXJaiS+9XATYJfGKawTOcQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b15e4612831e7bf8-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.978 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.978 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.978 DEBUG:boto:Method: HEAD 2023-12-15T23:14:18.978 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.978 DEBUG:boto:Data: 2023-12-15T23:14:18.978 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:18.978 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.979 DEBUG:boto:Params: {} 2023-12-15T23:14:18.979 DEBUG:boto:Token: None 2023-12-15T23:14:18.979 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f8m/yjXJaiS+9XATYJfGKawTOcQ= 2023-12-15T23:14:18.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f8m/yjXJaiS+9XATYJfGKawTOcQ=', 'Content-Length': '0'} 2023-12-15T23:14:18.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000048de33e6c4cb03d-00657cddca-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:18.981 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2023-12-15T23:14:18.981 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.981 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.981 DEBUG:boto:Method: GET 2023-12-15T23:14:18.982 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.982 DEBUG:boto:Data: 2023-12-15T23:14:18.982 DEBUG:boto:Headers: {} 2023-12-15T23:14:18.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:18.982 DEBUG:boto:Port: 8000 2023-12-15T23:14:18.982 DEBUG:boto:Params: {} 2023-12-15T23:14:18.982 DEBUG:boto:Token: None 2023-12-15T23:14:18.982 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:18 GMT /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:18.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7xYCpxOtJomiU6jksDNvbBnT5g8= 2023-12-15T23:14:18.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7xYCpxOtJomiU6jksDNvbBnT5g8=', 'Content-Length': '0'} 2023-12-15T23:14:18.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd4b0351da655f2e-00657cddca-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.025 DEBUG:boto:path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:19.026 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000049 2023-12-15T23:14:19.026 DEBUG:boto:Method: GET 2023-12-15T23:14:19.026 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:19.026 DEBUG:boto:Data: 2023-12-15T23:14:19.026 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.026 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.026 DEBUG:boto:Params: {} 2023-12-15T23:14:19.026 DEBUG:boto:Token: None 2023-12-15T23:14:19.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000049 2023-12-15T23:14:19.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3JbjF+qwBVHxTPmjy9N0/Prn8Y= 2023-12-15T23:14:19.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3JbjF+qwBVHxTPmjy9N0/Prn8Y=', 'Content-Length': '0'} 2023-12-15T23:14:19.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba900ee5a55a4a5-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.029 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.029 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.029 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.029 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.030 DEBUG:boto:Method: GET 2023-12-15T23:14:19.030 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.030 DEBUG:boto:Data: 2023-12-15T23:14:19.030 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.030 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.030 DEBUG:boto:Params: {} 2023-12-15T23:14:19.030 DEBUG:boto:Token: None 2023-12-15T23:14:19.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a0af6b48369f9a0-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.033 DEBUG:boto:b'kskgfn-48obj000000000000000000491000falseobj000000000000000000492023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.034 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.034 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.034 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.034 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.034 DEBUG:boto:Method: GET 2023-12-15T23:14:19.034 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000049 2023-12-15T23:14:19.034 DEBUG:boto:Data: 2023-12-15T23:14:19.034 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.034 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.034 DEBUG:boto:Params: {} 2023-12-15T23:14:19.035 DEBUG:boto:Token: None 2023-12-15T23:14:19.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.039 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d27f360df175c98-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.039 DEBUG:boto:b'kskgfn-48obj000000000000000000491000falseobj000000000000000000492023-12-15T23:14:07.816Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2023-12-15T23:14:19.039 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.039 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.040 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.040 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.040 DEBUG:boto:Method: GET 2023-12-15T23:14:19.040 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.040 DEBUG:boto:Data: 2023-12-15T23:14:19.040 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.040 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.040 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.040 DEBUG:boto:Params: {} 2023-12-15T23:14:19.040 DEBUG:boto:Token: None 2023-12-15T23:14:19.040 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk= 2023-12-15T23:14:19.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk=', 'Content-Length': '0'} 2023-12-15T23:14:19.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a0d59a43cbb215d-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.043 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.043 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.043 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.043 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.043 DEBUG:boto:Method: GET 2023-12-15T23:14:19.044 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.044 DEBUG:boto:Data: 2023-12-15T23:14:19.044 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.044 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.044 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.044 DEBUG:boto:Params: {} 2023-12-15T23:14:19.044 DEBUG:boto:Token: None 2023-12-15T23:14:19.044 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.044 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk= 2023-12-15T23:14:19.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk=', 'Content-Length': '0'} 2023-12-15T23:14:19.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0a75cc494dc1047-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.089 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.090 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.090 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.090 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.090 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.090 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.090 DEBUG:boto:Data: 2023-12-15T23:14:19.090 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.090 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.090 DEBUG:boto:Params: {} 2023-12-15T23:14:19.091 DEBUG:boto:Token: None 2023-12-15T23:14:19.091 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kXYnAc0fyQgY70zwJ6UD4pYtr14= 2023-12-15T23:14:19.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kXYnAc0fyQgY70zwJ6UD4pYtr14=', 'Content-Length': '0'} 2023-12-15T23:14:19.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000004741c48b425c2-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.093 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.093 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.093 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.093 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.093 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.093 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.094 DEBUG:boto:Data: 2023-12-15T23:14:19.094 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.094 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.094 DEBUG:boto:Params: {} 2023-12-15T23:14:19.094 DEBUG:boto:Token: None 2023-12-15T23:14:19.094 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kXYnAc0fyQgY70zwJ6UD4pYtr14= 2023-12-15T23:14:19.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kXYnAc0fyQgY70zwJ6UD4pYtr14=', 'Content-Length': '0'} 2023-12-15T23:14:19.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006471b0f3b66b7028-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2023-12-15T23:14:19.096 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.096 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.097 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.097 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.097 DEBUG:boto:Method: GET 2023-12-15T23:14:19.097 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.097 DEBUG:boto:Data: 2023-12-15T23:14:19.097 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.097 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.097 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.097 DEBUG:boto:Params: {} 2023-12-15T23:14:19.097 DEBUG:boto:Token: None 2023-12-15T23:14:19.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk= 2023-12-15T23:14:19.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk=', 'Content-Length': '0'} 2023-12-15T23:14:19.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d62e9eb2c4b2e4ed-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.100 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.100 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.100 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.100 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.100 DEBUG:boto:Method: GET 2023-12-15T23:14:19.100 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.101 DEBUG:boto:Data: 2023-12-15T23:14:19.101 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.101 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.101 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.101 DEBUG:boto:Params: {} 2023-12-15T23:14:19.101 DEBUG:boto:Token: None 2023-12-15T23:14:19.101 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050?versionId=null 2023-12-15T23:14:19.101 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk= 2023-12-15T23:14:19.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZpPSsyOu2Gg2doVgnPpQ0TnZDk=', 'Content-Length': '0'} 2023-12-15T23:14:19.103 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b059202a953bcddc-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.104 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.104 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.104 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.104 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.104 DEBUG:boto:Method: GET 2023-12-15T23:14:19.104 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.104 DEBUG:boto:Data: 2023-12-15T23:14:19.104 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.104 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.104 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.104 DEBUG:boto:Params: {} 2023-12-15T23:14:19.105 DEBUG:boto:Token: None 2023-12-15T23:14:19.105 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.105 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.107 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ee954235580de1e-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.107 DEBUG:boto:b'kskgfn-48obj000000000000000000501000falseobj000000000000000000502023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.107 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.108 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.108 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.108 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.108 DEBUG:boto:Method: GET 2023-12-15T23:14:19.108 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.108 DEBUG:boto:Data: 2023-12-15T23:14:19.108 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.108 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.108 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.108 DEBUG:boto:Params: {} 2023-12-15T23:14:19.108 DEBUG:boto:Token: None 2023-12-15T23:14:19.109 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.112 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086e23270bd347bea-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.113 DEBUG:boto:b'kskgfn-48obj000000000000000000501000falseobj000000000000000000502023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.113 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.113 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.113 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.113 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.114 DEBUG:boto:Data: 2023-12-15T23:14:19.114 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.114 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.114 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.114 DEBUG:boto:Params: {} 2023-12-15T23:14:19.114 DEBUG:boto:Token: None 2023-12-15T23:14:19.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mI3QxV6FxGCLiJptEcuJi6PUMso= 2023-12-15T23:14:19.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mI3QxV6FxGCLiJptEcuJi6PUMso=', 'Content-Length': '0'} 2023-12-15T23:14:19.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004112a9b35c3cf015-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.116 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.116 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.117 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.117 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.117 DEBUG:boto:Data: 2023-12-15T23:14:19.117 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.117 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.117 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.117 DEBUG:boto:Params: {} 2023-12-15T23:14:19.117 DEBUG:boto:Token: None 2023-12-15T23:14:19.117 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mI3QxV6FxGCLiJptEcuJi6PUMso= 2023-12-15T23:14:19.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mI3QxV6FxGCLiJptEcuJi6PUMso=', 'Content-Length': '0'} 2023-12-15T23:14:19.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c40357365eae2b2-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2023-12-15T23:14:19.120 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.120 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.120 DEBUG:boto:Method: GET 2023-12-15T23:14:19.120 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.120 DEBUG:boto:Data: 2023-12-15T23:14:19.121 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.121 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.121 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.121 DEBUG:boto:Params: {} 2023-12-15T23:14:19.121 DEBUG:boto:Token: None 2023-12-15T23:14:19.121 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ekybIgwNuPTIQhELfNIyDrpvs20= 2023-12-15T23:14:19.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ekybIgwNuPTIQhELfNIyDrpvs20=', 'Content-Length': '0'} 2023-12-15T23:14:19.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0511ada9832e86a-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.123 DEBUG:boto:path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.124 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.124 DEBUG:boto:Method: GET 2023-12-15T23:14:19.124 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.124 DEBUG:boto:Data: 2023-12-15T23:14:19.124 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.124 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.124 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.124 DEBUG:boto:Params: {} 2023-12-15T23:14:19.124 DEBUG:boto:Token: None 2023-12-15T23:14:19.124 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000050 2023-12-15T23:14:19.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ekybIgwNuPTIQhELfNIyDrpvs20= 2023-12-15T23:14:19.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ekybIgwNuPTIQhELfNIyDrpvs20=', 'Content-Length': '0'} 2023-12-15T23:14:19.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d27bb4c6a5473d44-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.127 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.127 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.127 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.127 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.127 DEBUG:boto:Method: GET 2023-12-15T23:14:19.127 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.127 DEBUG:boto:Data: 2023-12-15T23:14:19.127 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.128 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.128 DEBUG:boto:Params: {} 2023-12-15T23:14:19.128 DEBUG:boto:Token: None 2023-12-15T23:14:19.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047e2434e0fd9aee0-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.131 DEBUG:boto:b'kskgfn-48obj000000000000000000501000falseobj000000000000000000502023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.131 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.131 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.131 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.131 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.131 DEBUG:boto:Method: GET 2023-12-15T23:14:19.132 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000050 2023-12-15T23:14:19.132 DEBUG:boto:Data: 2023-12-15T23:14:19.132 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.132 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.132 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.132 DEBUG:boto:Params: {} 2023-12-15T23:14:19.132 DEBUG:boto:Token: None 2023-12-15T23:14:19.132 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.132 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c6546e508901928-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.137 DEBUG:boto:b'kskgfn-48obj000000000000000000501000falseobj000000000000000000502023-12-15T23:14:07.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2023-12-15T23:14:19.137 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.138 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.138 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.138 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.138 DEBUG:boto:Method: GET 2023-12-15T23:14:19.138 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.138 DEBUG:boto:Data: 2023-12-15T23:14:19.138 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.138 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.138 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.138 DEBUG:boto:Params: {} 2023-12-15T23:14:19.138 DEBUG:boto:Token: None 2023-12-15T23:14:19.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E= 2023-12-15T23:14:19.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E=', 'Content-Length': '0'} 2023-12-15T23:14:19.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db94d61f229b7554-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.141 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.141 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.141 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.141 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.142 DEBUG:boto:Method: GET 2023-12-15T23:14:19.142 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.142 DEBUG:boto:Data: 2023-12-15T23:14:19.142 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.142 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.142 DEBUG:boto:Params: {} 2023-12-15T23:14:19.142 DEBUG:boto:Token: None 2023-12-15T23:14:19.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E= 2023-12-15T23:14:19.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E=', 'Content-Length': '0'} 2023-12-15T23:14:19.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050f5835a8930a14c-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.189 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.190 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.190 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.190 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.190 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.190 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.190 DEBUG:boto:Data: 2023-12-15T23:14:19.190 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.190 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.190 DEBUG:boto:Params: {} 2023-12-15T23:14:19.190 DEBUG:boto:Token: None 2023-12-15T23:14:19.191 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fY00vfRiXYCV7qt82+fIT2B/h24= 2023-12-15T23:14:19.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fY00vfRiXYCV7qt82+fIT2B/h24=', 'Content-Length': '0'} 2023-12-15T23:14:19.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f44090dda4f36f4-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.193 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.193 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.193 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.193 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.193 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.194 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.194 DEBUG:boto:Data: 2023-12-15T23:14:19.194 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.194 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.194 DEBUG:boto:Params: {} 2023-12-15T23:14:19.194 DEBUG:boto:Token: None 2023-12-15T23:14:19.194 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fY00vfRiXYCV7qt82+fIT2B/h24= 2023-12-15T23:14:19.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fY00vfRiXYCV7qt82+fIT2B/h24=', 'Content-Length': '0'} 2023-12-15T23:14:19.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008806d3cd505d7753-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2023-12-15T23:14:19.197 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.197 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.197 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.197 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.197 DEBUG:boto:Method: GET 2023-12-15T23:14:19.197 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.197 DEBUG:boto:Data: 2023-12-15T23:14:19.197 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.197 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.197 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.198 DEBUG:boto:Params: {} 2023-12-15T23:14:19.198 DEBUG:boto:Token: None 2023-12-15T23:14:19.198 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E= 2023-12-15T23:14:19.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E=', 'Content-Length': '0'} 2023-12-15T23:14:19.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029eaa50f304b11a0-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.200 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.200 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.201 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.201 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.201 DEBUG:boto:Method: GET 2023-12-15T23:14:19.201 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.201 DEBUG:boto:Data: 2023-12-15T23:14:19.201 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.201 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.201 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.201 DEBUG:boto:Params: {} 2023-12-15T23:14:19.201 DEBUG:boto:Token: None 2023-12-15T23:14:19.201 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053?versionId=null 2023-12-15T23:14:19.202 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E= 2023-12-15T23:14:19.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X+Md/qH74/sau+m1XHsVIGw1J5E=', 'Content-Length': '0'} 2023-12-15T23:14:19.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061566ebc5da7e26d-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.204 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.204 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.204 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.204 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.204 DEBUG:boto:Method: GET 2023-12-15T23:14:19.204 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.204 DEBUG:boto:Data: 2023-12-15T23:14:19.204 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.205 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.205 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.205 DEBUG:boto:Params: {} 2023-12-15T23:14:19.205 DEBUG:boto:Token: None 2023-12-15T23:14:19.205 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.205 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005801d7a061e0d6c3-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.208 DEBUG:boto:b'kskgfn-48obj000000000000000000531000falseobj000000000000000000532023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.208 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.208 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.208 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.208 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.209 DEBUG:boto:Method: GET 2023-12-15T23:14:19.209 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.209 DEBUG:boto:Data: 2023-12-15T23:14:19.209 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.209 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.209 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.209 DEBUG:boto:Params: {} 2023-12-15T23:14:19.209 DEBUG:boto:Token: None 2023-12-15T23:14:19.209 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.209 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052cb60c2814edb3e-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.213 DEBUG:boto:b'kskgfn-48obj000000000000000000531000falseobj000000000000000000532023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.214 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.214 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.214 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.214 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.214 DEBUG:boto:Data: 2023-12-15T23:14:19.214 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.214 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.214 DEBUG:boto:Params: {} 2023-12-15T23:14:19.214 DEBUG:boto:Token: None 2023-12-15T23:14:19.215 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eb+8xEKflVCwvjF4bQzEFXyIb9E= 2023-12-15T23:14:19.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eb+8xEKflVCwvjF4bQzEFXyIb9E=', 'Content-Length': '0'} 2023-12-15T23:14:19.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014a29bdfacc4c3eb-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.217 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.217 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.217 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.217 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.217 DEBUG:boto:Data: 2023-12-15T23:14:19.217 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.217 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.217 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.217 DEBUG:boto:Params: {} 2023-12-15T23:14:19.218 DEBUG:boto:Token: None 2023-12-15T23:14:19.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eb+8xEKflVCwvjF4bQzEFXyIb9E= 2023-12-15T23:14:19.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eb+8xEKflVCwvjF4bQzEFXyIb9E=', 'Content-Length': '0'} 2023-12-15T23:14:19.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae0e8ff9c422d79-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2023-12-15T23:14:19.220 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.220 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.220 DEBUG:boto:Method: GET 2023-12-15T23:14:19.220 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.220 DEBUG:boto:Data: 2023-12-15T23:14:19.221 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.221 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.221 DEBUG:boto:Params: {} 2023-12-15T23:14:19.221 DEBUG:boto:Token: None 2023-12-15T23:14:19.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vlaAMVQPWgIl8j9hG63b0f6Mh7c= 2023-12-15T23:14:19.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vlaAMVQPWgIl8j9hG63b0f6Mh7c=', 'Content-Length': '0'} 2023-12-15T23:14:19.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000313a188e755cba7b-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.224 DEBUG:boto:path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.224 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.224 DEBUG:boto:Method: GET 2023-12-15T23:14:19.224 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.224 DEBUG:boto:Data: 2023-12-15T23:14:19.224 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.224 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.224 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.224 DEBUG:boto:Params: {} 2023-12-15T23:14:19.225 DEBUG:boto:Token: None 2023-12-15T23:14:19.225 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000053 2023-12-15T23:14:19.225 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vlaAMVQPWgIl8j9hG63b0f6Mh7c= 2023-12-15T23:14:19.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vlaAMVQPWgIl8j9hG63b0f6Mh7c=', 'Content-Length': '0'} 2023-12-15T23:14:19.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075e10b303bc8cead-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.227 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.227 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.227 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.227 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.227 DEBUG:boto:Method: GET 2023-12-15T23:14:19.227 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.227 DEBUG:boto:Data: 2023-12-15T23:14:19.228 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.228 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.228 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.228 DEBUG:boto:Params: {} 2023-12-15T23:14:19.228 DEBUG:boto:Token: None 2023-12-15T23:14:19.228 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000031230df32448242-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.231 DEBUG:boto:b'kskgfn-48obj000000000000000000531000falseobj000000000000000000532023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.231 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.231 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.231 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.231 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.231 DEBUG:boto:Method: GET 2023-12-15T23:14:19.232 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000053 2023-12-15T23:14:19.232 DEBUG:boto:Data: 2023-12-15T23:14:19.232 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.232 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.232 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.232 DEBUG:boto:Params: {} 2023-12-15T23:14:19.232 DEBUG:boto:Token: None 2023-12-15T23:14:19.232 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.232 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc0a574e65adda62-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.236 DEBUG:boto:b'kskgfn-48obj000000000000000000531000falseobj000000000000000000532023-12-15T23:14:10.760Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2023-12-15T23:14:19.237 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.237 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.237 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.237 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.238 DEBUG:boto:Method: GET 2023-12-15T23:14:19.238 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.238 DEBUG:boto:Data: 2023-12-15T23:14:19.238 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.238 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.238 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.238 DEBUG:boto:Params: {} 2023-12-15T23:14:19.238 DEBUG:boto:Token: None 2023-12-15T23:14:19.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0= 2023-12-15T23:14:19.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0=', 'Content-Length': '0'} 2023-12-15T23:14:19.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc9385783ff4b113-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.281 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.282 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.282 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.282 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.282 DEBUG:boto:Method: GET 2023-12-15T23:14:19.282 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.282 DEBUG:boto:Data: 2023-12-15T23:14:19.282 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.283 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.283 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.283 DEBUG:boto:Params: {} 2023-12-15T23:14:19.283 DEBUG:boto:Token: None 2023-12-15T23:14:19.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0= 2023-12-15T23:14:19.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0=', 'Content-Length': '0'} 2023-12-15T23:14:19.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064ee980ac4c7024e-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.286 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.286 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.286 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.286 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.286 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.287 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.287 DEBUG:boto:Data: 2023-12-15T23:14:19.287 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.287 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.287 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.287 DEBUG:boto:Params: {} 2023-12-15T23:14:19.287 DEBUG:boto:Token: None 2023-12-15T23:14:19.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3MDpD44tm93GULeginq4941aPvY= 2023-12-15T23:14:19.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3MDpD44tm93GULeginq4941aPvY=', 'Content-Length': '0'} 2023-12-15T23:14:19.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f53ebd71ff2eb95-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.290 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.290 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.290 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.290 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.290 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.290 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.290 DEBUG:boto:Data: 2023-12-15T23:14:19.290 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.291 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.291 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.291 DEBUG:boto:Params: {} 2023-12-15T23:14:19.291 DEBUG:boto:Token: None 2023-12-15T23:14:19.291 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3MDpD44tm93GULeginq4941aPvY= 2023-12-15T23:14:19.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3MDpD44tm93GULeginq4941aPvY=', 'Content-Length': '0'} 2023-12-15T23:14:19.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c007f5639502c01-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.294 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2023-12-15T23:14:19.294 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.294 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.294 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.294 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.294 DEBUG:boto:Method: GET 2023-12-15T23:14:19.294 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.294 DEBUG:boto:Data: 2023-12-15T23:14:19.295 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.295 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.295 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.295 DEBUG:boto:Params: {} 2023-12-15T23:14:19.295 DEBUG:boto:Token: None 2023-12-15T23:14:19.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.296 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0= 2023-12-15T23:14:19.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0=', 'Content-Length': '0'} 2023-12-15T23:14:19.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea9bb1857cdc63df-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.298 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.298 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.299 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.299 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.299 DEBUG:boto:Method: GET 2023-12-15T23:14:19.299 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.299 DEBUG:boto:Data: 2023-12-15T23:14:19.299 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.299 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.299 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.299 DEBUG:boto:Params: {} 2023-12-15T23:14:19.299 DEBUG:boto:Token: None 2023-12-15T23:14:19.300 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056?versionId=null 2023-12-15T23:14:19.300 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0= 2023-12-15T23:14:19.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o55Ju00tmzK2vThrLofZtQo/bU0=', 'Content-Length': '0'} 2023-12-15T23:14:19.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1ce639862a34bb0-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.345 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.346 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.346 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.346 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.346 DEBUG:boto:Method: GET 2023-12-15T23:14:19.346 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.346 DEBUG:boto:Data: 2023-12-15T23:14:19.346 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.346 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.346 DEBUG:boto:Params: {} 2023-12-15T23:14:19.346 DEBUG:boto:Token: None 2023-12-15T23:14:19.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e12f3586402082c-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.350 DEBUG:boto:b'kskgfn-48obj000000000000000000561000falseobj000000000000000000562023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.350 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.350 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.350 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.350 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.350 DEBUG:boto:Method: GET 2023-12-15T23:14:19.350 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.350 DEBUG:boto:Data: 2023-12-15T23:14:19.351 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.351 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.351 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.351 DEBUG:boto:Params: {} 2023-12-15T23:14:19.351 DEBUG:boto:Token: None 2023-12-15T23:14:19.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.355 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000560cb850e2001946-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.355 DEBUG:boto:b'kskgfn-48obj000000000000000000561000falseobj000000000000000000562023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.356 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.356 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.356 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.356 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.356 DEBUG:boto:Data: 2023-12-15T23:14:19.356 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.356 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.356 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.356 DEBUG:boto:Params: {} 2023-12-15T23:14:19.356 DEBUG:boto:Token: None 2023-12-15T23:14:19.357 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fD3jteR8k+5uaOpdQyUvYVnhrYg= 2023-12-15T23:14:19.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fD3jteR8k+5uaOpdQyUvYVnhrYg=', 'Content-Length': '0'} 2023-12-15T23:14:19.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b288ea272b686897-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.359 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.359 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.359 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.360 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.360 DEBUG:boto:Data: 2023-12-15T23:14:19.360 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.360 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.360 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.360 DEBUG:boto:Params: {} 2023-12-15T23:14:19.360 DEBUG:boto:Token: None 2023-12-15T23:14:19.360 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fD3jteR8k+5uaOpdQyUvYVnhrYg= 2023-12-15T23:14:19.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fD3jteR8k+5uaOpdQyUvYVnhrYg=', 'Content-Length': '0'} 2023-12-15T23:14:19.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e163ad2da87210fa-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2023-12-15T23:14:19.363 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.363 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.363 DEBUG:boto:Method: GET 2023-12-15T23:14:19.363 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.363 DEBUG:boto:Data: 2023-12-15T23:14:19.363 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.364 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.364 DEBUG:boto:Params: {} 2023-12-15T23:14:19.364 DEBUG:boto:Token: None 2023-12-15T23:14:19.364 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.364 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Dvnb6QMITG3NH/4BZCqhw7FQxA= 2023-12-15T23:14:19.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Dvnb6QMITG3NH/4BZCqhw7FQxA=', 'Content-Length': '0'} 2023-12-15T23:14:19.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e03166a015cf4259-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.410 DEBUG:boto:path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.410 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.410 DEBUG:boto:Method: GET 2023-12-15T23:14:19.410 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.410 DEBUG:boto:Data: 2023-12-15T23:14:19.410 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.410 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.410 DEBUG:boto:Params: {} 2023-12-15T23:14:19.410 DEBUG:boto:Token: None 2023-12-15T23:14:19.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000056 2023-12-15T23:14:19.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1Dvnb6QMITG3NH/4BZCqhw7FQxA= 2023-12-15T23:14:19.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1Dvnb6QMITG3NH/4BZCqhw7FQxA=', 'Content-Length': '0'} 2023-12-15T23:14:19.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002e2394098b0d2c0-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.413 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.413 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.413 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.413 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.413 DEBUG:boto:Method: GET 2023-12-15T23:14:19.414 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.414 DEBUG:boto:Data: 2023-12-15T23:14:19.414 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.414 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.414 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.414 DEBUG:boto:Params: {} 2023-12-15T23:14:19.414 DEBUG:boto:Token: None 2023-12-15T23:14:19.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.417 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098b27f087a9c7a20-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.417 DEBUG:boto:b'kskgfn-48obj000000000000000000561000falseobj000000000000000000562023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.417 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.417 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.418 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.418 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.418 DEBUG:boto:Method: GET 2023-12-15T23:14:19.418 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000056 2023-12-15T23:14:19.418 DEBUG:boto:Data: 2023-12-15T23:14:19.418 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.418 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.418 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.418 DEBUG:boto:Params: {} 2023-12-15T23:14:19.418 DEBUG:boto:Token: None 2023-12-15T23:14:19.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a7da9ffb651e34b-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.423 DEBUG:boto:b'kskgfn-48obj000000000000000000561000falseobj000000000000000000562023-12-15T23:14:08.772Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2023-12-15T23:14:19.423 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.423 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.423 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.423 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.424 DEBUG:boto:Method: GET 2023-12-15T23:14:19.424 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.424 DEBUG:boto:Data: 2023-12-15T23:14:19.424 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.424 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.424 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.424 DEBUG:boto:Params: {} 2023-12-15T23:14:19.424 DEBUG:boto:Token: None 2023-12-15T23:14:19.424 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.424 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o= 2023-12-15T23:14:19.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o=', 'Content-Length': '0'} 2023-12-15T23:14:19.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b512bb2aed33e25a-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.427 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.427 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.427 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.428 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.428 DEBUG:boto:Method: GET 2023-12-15T23:14:19.428 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.428 DEBUG:boto:Data: 2023-12-15T23:14:19.428 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.428 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.428 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.428 DEBUG:boto:Params: {} 2023-12-15T23:14:19.428 DEBUG:boto:Token: None 2023-12-15T23:14:19.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.429 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o= 2023-12-15T23:14:19.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o=', 'Content-Length': '0'} 2023-12-15T23:14:19.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007604d0be943793dd-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.473 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.474 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.474 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.474 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.474 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.474 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.474 DEBUG:boto:Data: 2023-12-15T23:14:19.474 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.474 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.474 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.474 DEBUG:boto:Params: {} 2023-12-15T23:14:19.475 DEBUG:boto:Token: None 2023-12-15T23:14:19.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yoGu+U3SWrLYx4Wo/++r4fqrL9I= 2023-12-15T23:14:19.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yoGu+U3SWrLYx4Wo/++r4fqrL9I=', 'Content-Length': '0'} 2023-12-15T23:14:19.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e003c71cb002f60-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.477 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.477 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.477 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.477 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.477 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.478 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.478 DEBUG:boto:Data: 2023-12-15T23:14:19.478 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.478 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.478 DEBUG:boto:Params: {} 2023-12-15T23:14:19.478 DEBUG:boto:Token: None 2023-12-15T23:14:19.478 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yoGu+U3SWrLYx4Wo/++r4fqrL9I= 2023-12-15T23:14:19.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yoGu+U3SWrLYx4Wo/++r4fqrL9I=', 'Content-Length': '0'} 2023-12-15T23:14:19.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3edbe5e2b26ed83-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.481 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2023-12-15T23:14:19.481 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.481 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.481 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.481 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.481 DEBUG:boto:Method: GET 2023-12-15T23:14:19.481 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.482 DEBUG:boto:Data: 2023-12-15T23:14:19.482 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.482 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.482 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.482 DEBUG:boto:Params: {} 2023-12-15T23:14:19.482 DEBUG:boto:Token: None 2023-12-15T23:14:19.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o= 2023-12-15T23:14:19.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o=', 'Content-Length': '0'} 2023-12-15T23:14:19.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038753df9d09b9579-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.485 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.485 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.485 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.485 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.485 DEBUG:boto:Method: GET 2023-12-15T23:14:19.485 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.485 DEBUG:boto:Data: 2023-12-15T23:14:19.485 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.485 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.485 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.486 DEBUG:boto:Params: {} 2023-12-15T23:14:19.486 DEBUG:boto:Token: None 2023-12-15T23:14:19.486 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057?versionId=null 2023-12-15T23:14:19.486 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o= 2023-12-15T23:14:19.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UURR6T0f8yHaeeI8oiKpzINx1o=', 'Content-Length': '0'} 2023-12-15T23:14:19.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beef6418316e499f-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.488 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.488 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.489 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.489 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.489 DEBUG:boto:Method: GET 2023-12-15T23:14:19.489 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.489 DEBUG:boto:Data: 2023-12-15T23:14:19.489 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.489 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.489 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.489 DEBUG:boto:Params: {} 2023-12-15T23:14:19.490 DEBUG:boto:Token: None 2023-12-15T23:14:19.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d663e09f14d3b75b-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.492 DEBUG:boto:b'kskgfn-48obj000000000000000000571000falseobj000000000000000000572023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.493 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.493 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.493 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.493 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.493 DEBUG:boto:Method: GET 2023-12-15T23:14:19.493 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.493 DEBUG:boto:Data: 2023-12-15T23:14:19.493 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.493 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.494 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.494 DEBUG:boto:Params: {} 2023-12-15T23:14:19.494 DEBUG:boto:Token: None 2023-12-15T23:14:19.494 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.494 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e3d92189f901b6e-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.498 DEBUG:boto:b'kskgfn-48obj000000000000000000571000falseobj000000000000000000572023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.498 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.498 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.498 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.499 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.499 DEBUG:boto:Data: 2023-12-15T23:14:19.499 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.499 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.499 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.499 DEBUG:boto:Params: {} 2023-12-15T23:14:19.499 DEBUG:boto:Token: None 2023-12-15T23:14:19.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ql0JaEQLazq+WgQ88j7LApO52O8= 2023-12-15T23:14:19.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ql0JaEQLazq+WgQ88j7LApO52O8=', 'Content-Length': '0'} 2023-12-15T23:14:19.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077a4141d8bbaabfd-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.501 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.501 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.502 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.502 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.502 DEBUG:boto:Data: 2023-12-15T23:14:19.502 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.502 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.502 DEBUG:boto:Params: {} 2023-12-15T23:14:19.502 DEBUG:boto:Token: None 2023-12-15T23:14:19.502 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ql0JaEQLazq+WgQ88j7LApO52O8= 2023-12-15T23:14:19.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ql0JaEQLazq+WgQ88j7LApO52O8=', 'Content-Length': '0'} 2023-12-15T23:14:19.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000768a3d688163fb8a-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2023-12-15T23:14:19.505 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.505 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.505 DEBUG:boto:Method: GET 2023-12-15T23:14:19.505 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.505 DEBUG:boto:Data: 2023-12-15T23:14:19.506 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.506 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.506 DEBUG:boto:Params: {} 2023-12-15T23:14:19.506 DEBUG:boto:Token: None 2023-12-15T23:14:19.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/7Z9eWvZbEA/KtI5ZAd7FZxDp6o= 2023-12-15T23:14:19.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/7Z9eWvZbEA/KtI5ZAd7FZxDp6o=', 'Content-Length': '0'} 2023-12-15T23:14:19.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e96a82437975f392-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.509 DEBUG:boto:path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.509 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.509 DEBUG:boto:Method: GET 2023-12-15T23:14:19.509 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.509 DEBUG:boto:Data: 2023-12-15T23:14:19.509 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.509 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.509 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.509 DEBUG:boto:Params: {} 2023-12-15T23:14:19.510 DEBUG:boto:Token: None 2023-12-15T23:14:19.510 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000057 2023-12-15T23:14:19.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/7Z9eWvZbEA/KtI5ZAd7FZxDp6o= 2023-12-15T23:14:19.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/7Z9eWvZbEA/KtI5ZAd7FZxDp6o=', 'Content-Length': '0'} 2023-12-15T23:14:19.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4fb02d623050a46-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.512 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.513 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.513 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.513 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.513 DEBUG:boto:Method: GET 2023-12-15T23:14:19.513 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.513 DEBUG:boto:Data: 2023-12-15T23:14:19.513 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.513 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.513 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.514 DEBUG:boto:Params: {} 2023-12-15T23:14:19.514 DEBUG:boto:Token: None 2023-12-15T23:14:19.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f39077b0d505f822-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.517 DEBUG:boto:b'kskgfn-48obj000000000000000000571000falseobj000000000000000000572023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.517 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.517 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.517 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.517 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.517 DEBUG:boto:Method: GET 2023-12-15T23:14:19.517 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000057 2023-12-15T23:14:19.518 DEBUG:boto:Data: 2023-12-15T23:14:19.518 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.518 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.518 DEBUG:boto:Params: {} 2023-12-15T23:14:19.518 DEBUG:boto:Token: None 2023-12-15T23:14:19.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d779cb701c528be2-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.522 DEBUG:boto:b'kskgfn-48obj000000000000000000571000falseobj000000000000000000572023-12-15T23:14:10.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2023-12-15T23:14:19.523 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.523 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.523 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.523 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.523 DEBUG:boto:Method: GET 2023-12-15T23:14:19.523 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.523 DEBUG:boto:Data: 2023-12-15T23:14:19.524 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.524 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.524 DEBUG:boto:Params: {} 2023-12-15T23:14:19.524 DEBUG:boto:Token: None 2023-12-15T23:14:19.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM= 2023-12-15T23:14:19.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM=', 'Content-Length': '0'} 2023-12-15T23:14:19.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007da08bd9f7fac41e-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.527 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.527 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.527 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.527 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.527 DEBUG:boto:Method: GET 2023-12-15T23:14:19.527 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.527 DEBUG:boto:Data: 2023-12-15T23:14:19.528 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.528 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.528 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.528 DEBUG:boto:Params: {} 2023-12-15T23:14:19.528 DEBUG:boto:Token: None 2023-12-15T23:14:19.528 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM= 2023-12-15T23:14:19.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM=', 'Content-Length': '0'} 2023-12-15T23:14:19.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a43bd5bd97ae76ed-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.573 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.574 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.574 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.574 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.574 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.574 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.574 DEBUG:boto:Data: 2023-12-15T23:14:19.574 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.574 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.574 DEBUG:boto:Params: {} 2023-12-15T23:14:19.575 DEBUG:boto:Token: None 2023-12-15T23:14:19.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NcSaXHgZFxMLBWsOQFaV3zjiWQA= 2023-12-15T23:14:19.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NcSaXHgZFxMLBWsOQFaV3zjiWQA=', 'Content-Length': '0'} 2023-12-15T23:14:19.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e372058d17f4225-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.577 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.577 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.577 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.577 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.577 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.577 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.577 DEBUG:boto:Data: 2023-12-15T23:14:19.577 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.577 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.578 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.578 DEBUG:boto:Params: {} 2023-12-15T23:14:19.578 DEBUG:boto:Token: None 2023-12-15T23:14:19.578 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NcSaXHgZFxMLBWsOQFaV3zjiWQA= 2023-12-15T23:14:19.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NcSaXHgZFxMLBWsOQFaV3zjiWQA=', 'Content-Length': '0'} 2023-12-15T23:14:19.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c373531c82e02fc-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.580 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2023-12-15T23:14:19.581 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.581 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.581 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.581 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.581 DEBUG:boto:Method: GET 2023-12-15T23:14:19.581 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.581 DEBUG:boto:Data: 2023-12-15T23:14:19.581 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.581 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.581 DEBUG:boto:Params: {} 2023-12-15T23:14:19.582 DEBUG:boto:Token: None 2023-12-15T23:14:19.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM= 2023-12-15T23:14:19.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM=', 'Content-Length': '0'} 2023-12-15T23:14:19.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000528c801bc22cb75d-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.584 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.584 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.584 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.584 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.584 DEBUG:boto:Method: GET 2023-12-15T23:14:19.584 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.584 DEBUG:boto:Data: 2023-12-15T23:14:19.585 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.585 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.585 DEBUG:boto:Params: {} 2023-12-15T23:14:19.585 DEBUG:boto:Token: None 2023-12-15T23:14:19.585 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058?versionId=null 2023-12-15T23:14:19.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM= 2023-12-15T23:14:19.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAOQNDJ9vbt9eAC0QRJdKKkB2lM=', 'Content-Length': '0'} 2023-12-15T23:14:19.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb452376032575fb-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.587 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.588 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.588 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.588 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.588 DEBUG:boto:Method: GET 2023-12-15T23:14:19.588 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.588 DEBUG:boto:Data: 2023-12-15T23:14:19.588 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.588 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.588 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.588 DEBUG:boto:Params: {} 2023-12-15T23:14:19.588 DEBUG:boto:Token: None 2023-12-15T23:14:19.589 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be99144ceda615f3-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.592 DEBUG:boto:b'kskgfn-48obj000000000000000000581000falseobj000000000000000000582023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.592 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.592 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.592 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.592 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.592 DEBUG:boto:Method: GET 2023-12-15T23:14:19.592 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.592 DEBUG:boto:Data: 2023-12-15T23:14:19.593 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.593 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.593 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.593 DEBUG:boto:Params: {} 2023-12-15T23:14:19.593 DEBUG:boto:Token: None 2023-12-15T23:14:19.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082d63f2e74451f0a-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.598 DEBUG:boto:b'kskgfn-48obj000000000000000000581000falseobj000000000000000000582023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.598 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.598 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.598 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.598 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.598 DEBUG:boto:Data: 2023-12-15T23:14:19.598 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.599 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.599 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.599 DEBUG:boto:Params: {} 2023-12-15T23:14:19.599 DEBUG:boto:Token: None 2023-12-15T23:14:19.599 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+7X7qANV0QWdKrj5joCimKnjd6M= 2023-12-15T23:14:19.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+7X7qANV0QWdKrj5joCimKnjd6M=', 'Content-Length': '0'} 2023-12-15T23:14:19.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc408c35f26bfe7d-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.601 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.601 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.601 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.602 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.602 DEBUG:boto:Data: 2023-12-15T23:14:19.602 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.602 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.602 DEBUG:boto:Params: {} 2023-12-15T23:14:19.602 DEBUG:boto:Token: None 2023-12-15T23:14:19.602 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+7X7qANV0QWdKrj5joCimKnjd6M= 2023-12-15T23:14:19.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+7X7qANV0QWdKrj5joCimKnjd6M=', 'Content-Length': '0'} 2023-12-15T23:14:19.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbda635f8dfe6c93-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2023-12-15T23:14:19.605 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.605 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.605 DEBUG:boto:Method: GET 2023-12-15T23:14:19.605 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.605 DEBUG:boto:Data: 2023-12-15T23:14:19.605 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.605 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.605 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.605 DEBUG:boto:Params: {} 2023-12-15T23:14:19.606 DEBUG:boto:Token: None 2023-12-15T23:14:19.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duxfyq9/BqVH0dAewWM5z1jdTCg= 2023-12-15T23:14:19.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duxfyq9/BqVH0dAewWM5z1jdTCg=', 'Content-Length': '0'} 2023-12-15T23:14:19.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001da0ac5448a16df7-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.608 DEBUG:boto:path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.608 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.608 DEBUG:boto:Method: GET 2023-12-15T23:14:19.608 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.608 DEBUG:boto:Data: 2023-12-15T23:14:19.608 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.609 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.609 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.609 DEBUG:boto:Params: {} 2023-12-15T23:14:19.609 DEBUG:boto:Token: None 2023-12-15T23:14:19.609 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000058 2023-12-15T23:14:19.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:duxfyq9/BqVH0dAewWM5z1jdTCg= 2023-12-15T23:14:19.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:duxfyq9/BqVH0dAewWM5z1jdTCg=', 'Content-Length': '0'} 2023-12-15T23:14:19.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000516df3c1cd861633-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.611 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.612 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.612 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.612 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.612 DEBUG:boto:Method: GET 2023-12-15T23:14:19.612 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.612 DEBUG:boto:Data: 2023-12-15T23:14:19.612 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.612 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.612 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.612 DEBUG:boto:Params: {} 2023-12-15T23:14:19.612 DEBUG:boto:Token: None 2023-12-15T23:14:19.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.615 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1a8d1333ddc96cf-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.615 DEBUG:boto:b'kskgfn-48obj000000000000000000581000falseobj000000000000000000582023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.616 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.616 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.616 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.616 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.616 DEBUG:boto:Method: GET 2023-12-15T23:14:19.616 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000058 2023-12-15T23:14:19.616 DEBUG:boto:Data: 2023-12-15T23:14:19.616 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.616 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.616 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.617 DEBUG:boto:Params: {} 2023-12-15T23:14:19.617 DEBUG:boto:Token: None 2023-12-15T23:14:19.617 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.620 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049308cf8802d3b00-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.621 DEBUG:boto:b'kskgfn-48obj000000000000000000581000falseobj000000000000000000582023-12-15T23:14:07.203Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2023-12-15T23:14:19.621 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.621 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.621 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.621 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.622 DEBUG:boto:Method: GET 2023-12-15T23:14:19.622 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.622 DEBUG:boto:Data: 2023-12-15T23:14:19.622 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.622 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.622 DEBUG:boto:Params: {} 2023-12-15T23:14:19.622 DEBUG:boto:Token: None 2023-12-15T23:14:19.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw= 2023-12-15T23:14:19.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw=', 'Content-Length': '0'} 2023-12-15T23:14:19.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025d28604296f733f-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.625 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.625 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.625 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.626 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.626 DEBUG:boto:Method: GET 2023-12-15T23:14:19.626 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.626 DEBUG:boto:Data: 2023-12-15T23:14:19.626 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.626 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.626 DEBUG:boto:Params: {} 2023-12-15T23:14:19.627 DEBUG:boto:Token: None 2023-12-15T23:14:19.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw= 2023-12-15T23:14:19.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw=', 'Content-Length': '0'} 2023-12-15T23:14:19.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020e1dd069564dc67-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.629 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.629 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.630 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.630 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.630 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.630 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.630 DEBUG:boto:Data: 2023-12-15T23:14:19.630 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.630 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.630 DEBUG:boto:Params: {} 2023-12-15T23:14:19.630 DEBUG:boto:Token: None 2023-12-15T23:14:19.631 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kcFe1HovFzwYVaRKNOyEezMr8Ro= 2023-12-15T23:14:19.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kcFe1HovFzwYVaRKNOyEezMr8Ro=', 'Content-Length': '0'} 2023-12-15T23:14:19.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc8e5d4d1ae913a0-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.633 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.633 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.633 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.633 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.633 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.633 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.633 DEBUG:boto:Data: 2023-12-15T23:14:19.634 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.634 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.634 DEBUG:boto:Params: {} 2023-12-15T23:14:19.634 DEBUG:boto:Token: None 2023-12-15T23:14:19.634 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.634 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kcFe1HovFzwYVaRKNOyEezMr8Ro= 2023-12-15T23:14:19.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kcFe1HovFzwYVaRKNOyEezMr8Ro=', 'Content-Length': '0'} 2023-12-15T23:14:19.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023c5713960038d76-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2023-12-15T23:14:19.637 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.637 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.637 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.637 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.637 DEBUG:boto:Method: GET 2023-12-15T23:14:19.637 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.637 DEBUG:boto:Data: 2023-12-15T23:14:19.638 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.638 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.638 DEBUG:boto:Params: {} 2023-12-15T23:14:19.638 DEBUG:boto:Token: None 2023-12-15T23:14:19.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw= 2023-12-15T23:14:19.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw=', 'Content-Length': '0'} 2023-12-15T23:14:19.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014a8112c795f1333-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.641 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.641 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.642 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.642 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.642 DEBUG:boto:Method: GET 2023-12-15T23:14:19.642 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.642 DEBUG:boto:Data: 2023-12-15T23:14:19.642 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.642 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.642 DEBUG:boto:Params: {} 2023-12-15T23:14:19.643 DEBUG:boto:Token: None 2023-12-15T23:14:19.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059?versionId=null 2023-12-15T23:14:19.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw= 2023-12-15T23:14:19.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMpU/zlklxWMkPw/5t0vPRJyLuw=', 'Content-Length': '0'} 2023-12-15T23:14:19.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcfb6f530aa91a26-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.645 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.645 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.645 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.645 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.646 DEBUG:boto:Method: GET 2023-12-15T23:14:19.646 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.646 DEBUG:boto:Data: 2023-12-15T23:14:19.646 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.646 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.646 DEBUG:boto:Params: {} 2023-12-15T23:14:19.646 DEBUG:boto:Token: None 2023-12-15T23:14:19.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000298132741c2a9f66-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.649 DEBUG:boto:b'kskgfn-48obj000000000000000000591000falseobj000000000000000000592023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.650 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.650 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.650 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.650 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.650 DEBUG:boto:Method: GET 2023-12-15T23:14:19.650 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.650 DEBUG:boto:Data: 2023-12-15T23:14:19.650 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.650 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.650 DEBUG:boto:Params: {} 2023-12-15T23:14:19.651 DEBUG:boto:Token: None 2023-12-15T23:14:19.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.655 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cda2527781226075-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.655 DEBUG:boto:b'kskgfn-48obj000000000000000000591000falseobj000000000000000000592023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.655 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.656 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.656 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.656 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.656 DEBUG:boto:Data: 2023-12-15T23:14:19.656 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.656 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.656 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.656 DEBUG:boto:Params: {} 2023-12-15T23:14:19.656 DEBUG:boto:Token: None 2023-12-15T23:14:19.656 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PP1KoNBPEs3sefaxzCafc3U9CZM= 2023-12-15T23:14:19.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PP1KoNBPEs3sefaxzCafc3U9CZM=', 'Content-Length': '0'} 2023-12-15T23:14:19.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099390b107b290cfa-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.659 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.659 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.659 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.659 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.659 DEBUG:boto:Data: 2023-12-15T23:14:19.659 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.660 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.660 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.660 DEBUG:boto:Params: {} 2023-12-15T23:14:19.660 DEBUG:boto:Token: None 2023-12-15T23:14:19.660 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PP1KoNBPEs3sefaxzCafc3U9CZM= 2023-12-15T23:14:19.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PP1KoNBPEs3sefaxzCafc3U9CZM=', 'Content-Length': '0'} 2023-12-15T23:14:19.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015034d674390ad9f-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.662 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2023-12-15T23:14:19.663 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.663 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.663 DEBUG:boto:Method: GET 2023-12-15T23:14:19.663 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.663 DEBUG:boto:Data: 2023-12-15T23:14:19.663 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.663 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.663 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.663 DEBUG:boto:Params: {} 2023-12-15T23:14:19.664 DEBUG:boto:Token: None 2023-12-15T23:14:19.664 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.664 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yt1ASBCUfl9CWh04CaJluIHU6nA= 2023-12-15T23:14:19.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yt1ASBCUfl9CWh04CaJluIHU6nA=', 'Content-Length': '0'} 2023-12-15T23:14:19.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fd03f3e229160fa-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.709 DEBUG:boto:path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.710 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.710 DEBUG:boto:Method: GET 2023-12-15T23:14:19.710 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.710 DEBUG:boto:Data: 2023-12-15T23:14:19.710 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.710 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.710 DEBUG:boto:Params: {} 2023-12-15T23:14:19.710 DEBUG:boto:Token: None 2023-12-15T23:14:19.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000059 2023-12-15T23:14:19.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yt1ASBCUfl9CWh04CaJluIHU6nA= 2023-12-15T23:14:19.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yt1ASBCUfl9CWh04CaJluIHU6nA=', 'Content-Length': '0'} 2023-12-15T23:14:19.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a58165850e62c2a-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.713 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.713 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.713 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.713 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.713 DEBUG:boto:Method: GET 2023-12-15T23:14:19.714 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.714 DEBUG:boto:Data: 2023-12-15T23:14:19.714 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.714 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.714 DEBUG:boto:Params: {} 2023-12-15T23:14:19.714 DEBUG:boto:Token: None 2023-12-15T23:14:19.714 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.714 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cad89a53f998f8d6-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.717 DEBUG:boto:b'kskgfn-48obj000000000000000000591000falseobj000000000000000000592023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.718 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.718 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.718 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.718 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.718 DEBUG:boto:Method: GET 2023-12-15T23:14:19.718 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000059 2023-12-15T23:14:19.719 DEBUG:boto:Data: 2023-12-15T23:14:19.719 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.719 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.719 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.719 DEBUG:boto:Params: {} 2023-12-15T23:14:19.719 DEBUG:boto:Token: None 2023-12-15T23:14:19.719 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a14dbc4167e253d-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.723 DEBUG:boto:b'kskgfn-48obj000000000000000000591000falseobj000000000000000000592023-12-15T23:14:08.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2023-12-15T23:14:19.724 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.724 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.724 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.724 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.724 DEBUG:boto:Method: GET 2023-12-15T23:14:19.725 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.725 DEBUG:boto:Data: 2023-12-15T23:14:19.725 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.725 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.725 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.725 DEBUG:boto:Params: {} 2023-12-15T23:14:19.725 DEBUG:boto:Token: None 2023-12-15T23:14:19.725 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek= 2023-12-15T23:14:19.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek=', 'Content-Length': '0'} 2023-12-15T23:14:19.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc88b4ffb426c4b3-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.728 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.728 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.728 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.728 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.728 DEBUG:boto:Method: GET 2023-12-15T23:14:19.729 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.729 DEBUG:boto:Data: 2023-12-15T23:14:19.729 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.729 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.729 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.729 DEBUG:boto:Params: {} 2023-12-15T23:14:19.729 DEBUG:boto:Token: None 2023-12-15T23:14:19.729 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.729 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek= 2023-12-15T23:14:19.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek=', 'Content-Length': '0'} 2023-12-15T23:14:19.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062d855934654a31f-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.732 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.732 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.732 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.732 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.732 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.732 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.732 DEBUG:boto:Data: 2023-12-15T23:14:19.732 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.733 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.733 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.733 DEBUG:boto:Params: {} 2023-12-15T23:14:19.733 DEBUG:boto:Token: None 2023-12-15T23:14:19.733 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.733 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:g9CAxWaUHQQwSNzsSbLLEGXS8wc= 2023-12-15T23:14:19.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:g9CAxWaUHQQwSNzsSbLLEGXS8wc=', 'Content-Length': '0'} 2023-12-15T23:14:19.735 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000172977fb6a62ba9b-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.735 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.736 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.736 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.736 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.736 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.736 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.736 DEBUG:boto:Data: 2023-12-15T23:14:19.736 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.736 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.737 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.737 DEBUG:boto:Params: {} 2023-12-15T23:14:19.737 DEBUG:boto:Token: None 2023-12-15T23:14:19.737 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.737 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:g9CAxWaUHQQwSNzsSbLLEGXS8wc= 2023-12-15T23:14:19.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:g9CAxWaUHQQwSNzsSbLLEGXS8wc=', 'Content-Length': '0'} 2023-12-15T23:14:19.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd9d2b6bdcaa349d-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.739 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2023-12-15T23:14:19.740 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.740 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.740 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.740 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.740 DEBUG:boto:Method: GET 2023-12-15T23:14:19.740 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.740 DEBUG:boto:Data: 2023-12-15T23:14:19.740 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.740 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.741 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.741 DEBUG:boto:Params: {} 2023-12-15T23:14:19.741 DEBUG:boto:Token: None 2023-12-15T23:14:19.741 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.741 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek= 2023-12-15T23:14:19.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek=', 'Content-Length': '0'} 2023-12-15T23:14:19.743 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5b39c278ed6b532-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.743 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.743 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.744 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.744 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.744 DEBUG:boto:Method: GET 2023-12-15T23:14:19.744 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.744 DEBUG:boto:Data: 2023-12-15T23:14:19.744 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.744 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.744 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.744 DEBUG:boto:Params: {} 2023-12-15T23:14:19.744 DEBUG:boto:Token: None 2023-12-15T23:14:19.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060?versionId=null 2023-12-15T23:14:19.745 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek= 2023-12-15T23:14:19.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jxMOiREjDApPRapx5fWTdOnjbek=', 'Content-Length': '0'} 2023-12-15T23:14:19.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd9b53dccad3248f-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.747 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.747 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.747 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.747 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.747 DEBUG:boto:Method: GET 2023-12-15T23:14:19.747 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.747 DEBUG:boto:Data: 2023-12-15T23:14:19.747 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.748 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.748 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.748 DEBUG:boto:Params: {} 2023-12-15T23:14:19.748 DEBUG:boto:Token: None 2023-12-15T23:14:19.748 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.748 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc71b289e73dac7f-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.751 DEBUG:boto:b'kskgfn-48obj000000000000000000601000falseobj000000000000000000602023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.751 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.751 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.751 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.752 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.752 DEBUG:boto:Method: GET 2023-12-15T23:14:19.752 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.752 DEBUG:boto:Data: 2023-12-15T23:14:19.752 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.752 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.752 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.752 DEBUG:boto:Params: {} 2023-12-15T23:14:19.752 DEBUG:boto:Token: None 2023-12-15T23:14:19.753 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.753 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.756 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034c59b8d5fb918d4-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.756 DEBUG:boto:b'kskgfn-48obj000000000000000000601000falseobj000000000000000000602023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.757 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.757 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.757 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.757 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.757 DEBUG:boto:Data: 2023-12-15T23:14:19.758 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.758 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.758 DEBUG:boto:Params: {} 2023-12-15T23:14:19.758 DEBUG:boto:Token: None 2023-12-15T23:14:19.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tTsbqzdvuJ4fImouFyWecpwX348= 2023-12-15T23:14:19.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tTsbqzdvuJ4fImouFyWecpwX348=', 'Content-Length': '0'} 2023-12-15T23:14:19.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001847e45e4ea4b95f-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.760 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.761 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.761 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.761 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.761 DEBUG:boto:Data: 2023-12-15T23:14:19.761 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.761 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.762 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.762 DEBUG:boto:Params: {} 2023-12-15T23:14:19.762 DEBUG:boto:Token: None 2023-12-15T23:14:19.762 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tTsbqzdvuJ4fImouFyWecpwX348= 2023-12-15T23:14:19.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tTsbqzdvuJ4fImouFyWecpwX348=', 'Content-Length': '0'} 2023-12-15T23:14:19.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069bdf335445e2106-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.764 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2023-12-15T23:14:19.764 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.764 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.765 DEBUG:boto:Method: GET 2023-12-15T23:14:19.765 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.765 DEBUG:boto:Data: 2023-12-15T23:14:19.765 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.765 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.765 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.765 DEBUG:boto:Params: {} 2023-12-15T23:14:19.765 DEBUG:boto:Token: None 2023-12-15T23:14:19.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AjgdA3BldeNeZ+IPjMg7R53BOaE= 2023-12-15T23:14:19.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AjgdA3BldeNeZ+IPjMg7R53BOaE=', 'Content-Length': '0'} 2023-12-15T23:14:19.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d90a39ae787c670e-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.768 DEBUG:boto:path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.768 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.768 DEBUG:boto:Method: GET 2023-12-15T23:14:19.768 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.768 DEBUG:boto:Data: 2023-12-15T23:14:19.769 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.769 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.769 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.769 DEBUG:boto:Params: {} 2023-12-15T23:14:19.769 DEBUG:boto:Token: None 2023-12-15T23:14:19.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000060 2023-12-15T23:14:19.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AjgdA3BldeNeZ+IPjMg7R53BOaE= 2023-12-15T23:14:19.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AjgdA3BldeNeZ+IPjMg7R53BOaE=', 'Content-Length': '0'} 2023-12-15T23:14:19.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002468071641b2f6ff-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.813 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.814 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.814 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.814 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.814 DEBUG:boto:Method: GET 2023-12-15T23:14:19.814 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.814 DEBUG:boto:Data: 2023-12-15T23:14:19.814 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.815 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.815 DEBUG:boto:Params: {} 2023-12-15T23:14:19.815 DEBUG:boto:Token: None 2023-12-15T23:14:19.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fc4693d30a14683-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.818 DEBUG:boto:b'kskgfn-48obj000000000000000000601000falseobj000000000000000000602023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.818 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.818 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.819 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.819 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.819 DEBUG:boto:Method: GET 2023-12-15T23:14:19.819 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000060 2023-12-15T23:14:19.819 DEBUG:boto:Data: 2023-12-15T23:14:19.819 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.819 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.819 DEBUG:boto:Params: {} 2023-12-15T23:14:19.820 DEBUG:boto:Token: None 2023-12-15T23:14:19.820 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.824 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb4900669e51f222-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.824 DEBUG:boto:b'kskgfn-48obj000000000000000000601000falseobj000000000000000000602023-12-15T23:14:10.009Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2023-12-15T23:14:19.825 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.825 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.825 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.825 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.825 DEBUG:boto:Method: GET 2023-12-15T23:14:19.825 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.825 DEBUG:boto:Data: 2023-12-15T23:14:19.825 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.825 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.825 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.826 DEBUG:boto:Params: {} 2023-12-15T23:14:19.826 DEBUG:boto:Token: None 2023-12-15T23:14:19.826 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A= 2023-12-15T23:14:19.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A=', 'Content-Length': '0'} 2023-12-15T23:14:19.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d116b6e9102d814f-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.869 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.870 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.870 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.870 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.870 DEBUG:boto:Method: GET 2023-12-15T23:14:19.870 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.870 DEBUG:boto:Data: 2023-12-15T23:14:19.870 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.870 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.870 DEBUG:boto:Params: {} 2023-12-15T23:14:19.871 DEBUG:boto:Token: None 2023-12-15T23:14:19.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A= 2023-12-15T23:14:19.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A=', 'Content-Length': '0'} 2023-12-15T23:14:19.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a83aaf0d288cfa81-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.874 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.874 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.874 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.874 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.874 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.874 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.875 DEBUG:boto:Data: 2023-12-15T23:14:19.875 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.875 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.875 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.875 DEBUG:boto:Params: {} 2023-12-15T23:14:19.875 DEBUG:boto:Token: None 2023-12-15T23:14:19.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eWBHstRMhHvCNceXa9m+XVQ2ygg= 2023-12-15T23:14:19.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eWBHstRMhHvCNceXa9m+XVQ2ygg=', 'Content-Length': '0'} 2023-12-15T23:14:19.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ed7f97eef1b8397-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.877 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.877 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.878 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.878 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.878 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.878 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.878 DEBUG:boto:Data: 2023-12-15T23:14:19.878 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.878 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.878 DEBUG:boto:Params: {} 2023-12-15T23:14:19.878 DEBUG:boto:Token: None 2023-12-15T23:14:19.879 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eWBHstRMhHvCNceXa9m+XVQ2ygg= 2023-12-15T23:14:19.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eWBHstRMhHvCNceXa9m+XVQ2ygg=', 'Content-Length': '0'} 2023-12-15T23:14:19.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000682375cc3f892407-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2023-12-15T23:14:19.882 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.882 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.882 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.882 DEBUG:boto:Method: GET 2023-12-15T23:14:19.882 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.882 DEBUG:boto:Data: 2023-12-15T23:14:19.882 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.883 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.883 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.883 DEBUG:boto:Params: {} 2023-12-15T23:14:19.883 DEBUG:boto:Token: None 2023-12-15T23:14:19.883 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A= 2023-12-15T23:14:19.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A=', 'Content-Length': '0'} 2023-12-15T23:14:19.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aa33bd5bace2ad5-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.886 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.886 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.886 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.886 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.886 DEBUG:boto:Method: GET 2023-12-15T23:14:19.886 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.886 DEBUG:boto:Data: 2023-12-15T23:14:19.886 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.887 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.887 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.887 DEBUG:boto:Params: {} 2023-12-15T23:14:19.887 DEBUG:boto:Token: None 2023-12-15T23:14:19.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061?versionId=null 2023-12-15T23:14:19.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A= 2023-12-15T23:14:19.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UOVl5lUfR2KGFEI0a258gIiTh/A=', 'Content-Length': '0'} 2023-12-15T23:14:19.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ddeab1213e951bb-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.890 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.890 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.890 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.890 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.890 DEBUG:boto:Method: GET 2023-12-15T23:14:19.890 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.890 DEBUG:boto:Data: 2023-12-15T23:14:19.890 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.890 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.891 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.891 DEBUG:boto:Params: {} 2023-12-15T23:14:19.891 DEBUG:boto:Token: None 2023-12-15T23:14:19.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004881b0fcd30faf74-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.894 DEBUG:boto:b'kskgfn-48obj000000000000000000611000falseobj000000000000000000612023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.894 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.895 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.895 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.895 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.895 DEBUG:boto:Method: GET 2023-12-15T23:14:19.895 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.895 DEBUG:boto:Data: 2023-12-15T23:14:19.895 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.895 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.895 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.895 DEBUG:boto:Params: {} 2023-12-15T23:14:19.895 DEBUG:boto:Token: None 2023-12-15T23:14:19.896 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.896 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024ed720b2dff415a-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.941 DEBUG:boto:b'kskgfn-48obj000000000000000000611000falseobj000000000000000000612023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.942 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.942 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.942 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.942 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.942 DEBUG:boto:Data: 2023-12-15T23:14:19.942 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.942 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.943 DEBUG:boto:Params: {} 2023-12-15T23:14:19.943 DEBUG:boto:Token: None 2023-12-15T23:14:19.943 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6N4QhI3lw9dMnOhO/Ar78DmoyOQ= 2023-12-15T23:14:19.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6N4QhI3lw9dMnOhO/Ar78DmoyOQ=', 'Content-Length': '0'} 2023-12-15T23:14:19.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b78a89ce72934aa5-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.945 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.946 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.946 DEBUG:boto:Method: HEAD 2023-12-15T23:14:19.946 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.946 DEBUG:boto:Data: 2023-12-15T23:14:19.946 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.946 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.946 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.946 DEBUG:boto:Params: {} 2023-12-15T23:14:19.946 DEBUG:boto:Token: None 2023-12-15T23:14:19.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6N4QhI3lw9dMnOhO/Ar78DmoyOQ= 2023-12-15T23:14:19.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6N4QhI3lw9dMnOhO/Ar78DmoyOQ=', 'Content-Length': '0'} 2023-12-15T23:14:19.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075ed4f4f86305caf-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2023-12-15T23:14:19.949 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.950 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.950 DEBUG:boto:Method: GET 2023-12-15T23:14:19.950 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.950 DEBUG:boto:Data: 2023-12-15T23:14:19.950 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.950 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.950 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.950 DEBUG:boto:Params: {} 2023-12-15T23:14:19.951 DEBUG:boto:Token: None 2023-12-15T23:14:19.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eCQywSiRAS/2aLvNwAoQCTFZOPU= 2023-12-15T23:14:19.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eCQywSiRAS/2aLvNwAoQCTFZOPU=', 'Content-Length': '0'} 2023-12-15T23:14:19.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000611a35e47b28ebbf-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.953 DEBUG:boto:path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.954 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.954 DEBUG:boto:Method: GET 2023-12-15T23:14:19.954 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.954 DEBUG:boto:Data: 2023-12-15T23:14:19.954 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.954 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.954 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.954 DEBUG:boto:Params: {} 2023-12-15T23:14:19.954 DEBUG:boto:Token: None 2023-12-15T23:14:19.954 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000061 2023-12-15T23:14:19.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eCQywSiRAS/2aLvNwAoQCTFZOPU= 2023-12-15T23:14:19.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eCQywSiRAS/2aLvNwAoQCTFZOPU=', 'Content-Length': '0'} 2023-12-15T23:14:19.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000384d8c9075595051-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.957 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.958 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.958 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.958 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.958 DEBUG:boto:Method: GET 2023-12-15T23:14:19.958 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.958 DEBUG:boto:Data: 2023-12-15T23:14:19.958 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.958 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.959 DEBUG:boto:Params: {} 2023-12-15T23:14:19.959 DEBUG:boto:Token: None 2023-12-15T23:14:19.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000c725c821e68642-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.961 DEBUG:boto:b'kskgfn-48obj000000000000000000611000falseobj000000000000000000612023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.962 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:19.962 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:19.962 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.962 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.962 DEBUG:boto:Method: GET 2023-12-15T23:14:19.963 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000061 2023-12-15T23:14:19.963 DEBUG:boto:Data: 2023-12-15T23:14:19.963 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.963 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:19.963 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.963 DEBUG:boto:Params: {} 2023-12-15T23:14:19.963 DEBUG:boto:Token: None 2023-12-15T23:14:19.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/ 2023-12-15T23:14:19.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow= 2023-12-15T23:14:19.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bh9K2EuDXeX7dqDi7IXV0usqow=', 'Content-Length': '0'} 2023-12-15T23:14:19.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e54338e22b8dd4a0-00657cddcb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:19.967 DEBUG:boto:b'kskgfn-48obj000000000000000000611000falseobj000000000000000000612023-12-15T23:14:09.141Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:19.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2023-12-15T23:14:19.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:19.968 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:19.968 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:19.968 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:19.968 DEBUG:boto:Method: GET 2023-12-15T23:14:19.969 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:19.969 DEBUG:boto:Data: 2023-12-15T23:14:19.969 DEBUG:boto:Headers: {} 2023-12-15T23:14:19.969 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:19.969 DEBUG:boto:Port: 8000 2023-12-15T23:14:19.969 DEBUG:boto:Params: {} 2023-12-15T23:14:19.969 DEBUG:boto:Token: None 2023-12-15T23:14:19.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:19 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:19.969 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OEE8lqdQBWIi7Lc8wqz45Nuqrq4= 2023-12-15T23:14:19.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OEE8lqdQBWIi7Lc8wqz45Nuqrq4=', 'Content-Length': '0'} 2023-12-15T23:14:19.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000730a9ff030ebc99e-00657cddcb-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.013 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.014 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.014 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.014 DEBUG:boto:Method: GET 2023-12-15T23:14:20.014 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.014 DEBUG:boto:Data: 2023-12-15T23:14:20.014 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.014 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.014 DEBUG:boto:Params: {} 2023-12-15T23:14:20.015 DEBUG:boto:Token: None 2023-12-15T23:14:20.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w= 2023-12-15T23:14:20.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w=', 'Content-Length': '0'} 2023-12-15T23:14:20.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000683edc7c4d00e303-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.017 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.017 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.017 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.018 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.018 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.018 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.018 DEBUG:boto:Data: 2023-12-15T23:14:20.018 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.018 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.019 DEBUG:boto:Params: {} 2023-12-15T23:14:20.019 DEBUG:boto:Token: None 2023-12-15T23:14:20.019 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pE1tJK7Fk6Vu7gMGFDVHKyWwANc= 2023-12-15T23:14:20.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pE1tJK7Fk6Vu7gMGFDVHKyWwANc=', 'Content-Length': '0'} 2023-12-15T23:14:20.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f26541cfe2185c2-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.021 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.021 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.021 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.022 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.022 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.022 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.022 DEBUG:boto:Data: 2023-12-15T23:14:20.022 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.022 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.022 DEBUG:boto:Params: {} 2023-12-15T23:14:20.022 DEBUG:boto:Token: None 2023-12-15T23:14:20.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pE1tJK7Fk6Vu7gMGFDVHKyWwANc= 2023-12-15T23:14:20.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pE1tJK7Fk6Vu7gMGFDVHKyWwANc=', 'Content-Length': '0'} 2023-12-15T23:14:20.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023d55cce0a2ae599-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.025 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2023-12-15T23:14:20.025 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.025 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.025 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.025 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.025 DEBUG:boto:Method: GET 2023-12-15T23:14:20.026 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.026 DEBUG:boto:Data: 2023-12-15T23:14:20.026 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.026 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.026 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.026 DEBUG:boto:Params: {} 2023-12-15T23:14:20.026 DEBUG:boto:Token: None 2023-12-15T23:14:20.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w= 2023-12-15T23:14:20.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w=', 'Content-Length': '0'} 2023-12-15T23:14:20.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bc2b3e508567ce8-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.029 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.029 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.029 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.029 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.029 DEBUG:boto:Method: GET 2023-12-15T23:14:20.030 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.030 DEBUG:boto:Data: 2023-12-15T23:14:20.030 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.030 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.030 DEBUG:boto:Params: {} 2023-12-15T23:14:20.030 DEBUG:boto:Token: None 2023-12-15T23:14:20.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065?versionId=null 2023-12-15T23:14:20.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w= 2023-12-15T23:14:20.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YEbxRrH4KNN1nPQZfu1Xr1uBW1w=', 'Content-Length': '0'} 2023-12-15T23:14:20.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018bc5b6689383a26-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.033 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.033 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.033 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.033 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.034 DEBUG:boto:Method: GET 2023-12-15T23:14:20.034 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.034 DEBUG:boto:Data: 2023-12-15T23:14:20.034 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.034 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.034 DEBUG:boto:Params: {} 2023-12-15T23:14:20.034 DEBUG:boto:Token: None 2023-12-15T23:14:20.034 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba1e2240383fb43e-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.037 DEBUG:boto:b'kskgfn-48obj000000000000000000651000falseobj000000000000000000652023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.037 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.038 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.038 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.038 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.038 DEBUG:boto:Method: GET 2023-12-15T23:14:20.038 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.038 DEBUG:boto:Data: 2023-12-15T23:14:20.038 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.038 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.038 DEBUG:boto:Params: {} 2023-12-15T23:14:20.039 DEBUG:boto:Token: None 2023-12-15T23:14:20.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000061b2280ce7ffa590-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.043 DEBUG:boto:b'kskgfn-48obj000000000000000000651000falseobj000000000000000000652023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.043 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.043 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.043 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.043 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.043 DEBUG:boto:Data: 2023-12-15T23:14:20.044 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.044 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.044 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.044 DEBUG:boto:Params: {} 2023-12-15T23:14:20.044 DEBUG:boto:Token: None 2023-12-15T23:14:20.044 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.044 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n0c3OkY6TVwZwlWwMnVKz5aK9A8= 2023-12-15T23:14:20.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n0c3OkY6TVwZwlWwMnVKz5aK9A8=', 'Content-Length': '0'} 2023-12-15T23:14:20.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000849a9ff7f490793f-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.046 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.047 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.047 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.047 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.047 DEBUG:boto:Data: 2023-12-15T23:14:20.047 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.047 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.047 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.047 DEBUG:boto:Params: {} 2023-12-15T23:14:20.047 DEBUG:boto:Token: None 2023-12-15T23:14:20.047 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n0c3OkY6TVwZwlWwMnVKz5aK9A8= 2023-12-15T23:14:20.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n0c3OkY6TVwZwlWwMnVKz5aK9A8=', 'Content-Length': '0'} 2023-12-15T23:14:20.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001db357795b9ad5bc-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2023-12-15T23:14:20.050 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.050 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.050 DEBUG:boto:Method: GET 2023-12-15T23:14:20.050 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.050 DEBUG:boto:Data: 2023-12-15T23:14:20.050 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.050 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.051 DEBUG:boto:Params: {} 2023-12-15T23:14:20.051 DEBUG:boto:Token: None 2023-12-15T23:14:20.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9pixq47bGCyDJATmkD5LJh/Z4tE= 2023-12-15T23:14:20.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9pixq47bGCyDJATmkD5LJh/Z4tE=', 'Content-Length': '0'} 2023-12-15T23:14:20.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4e54f5e21e8d1e9-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.053 DEBUG:boto:path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.053 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.053 DEBUG:boto:Method: GET 2023-12-15T23:14:20.053 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.054 DEBUG:boto:Data: 2023-12-15T23:14:20.054 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.054 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.054 DEBUG:boto:Params: {} 2023-12-15T23:14:20.054 DEBUG:boto:Token: None 2023-12-15T23:14:20.054 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000065 2023-12-15T23:14:20.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9pixq47bGCyDJATmkD5LJh/Z4tE= 2023-12-15T23:14:20.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9pixq47bGCyDJATmkD5LJh/Z4tE=', 'Content-Length': '0'} 2023-12-15T23:14:20.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:10 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c580f3f8142a80c-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.057 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.057 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.057 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.057 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.057 DEBUG:boto:Method: GET 2023-12-15T23:14:20.057 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.057 DEBUG:boto:Data: 2023-12-15T23:14:20.057 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.058 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.058 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.058 DEBUG:boto:Params: {} 2023-12-15T23:14:20.058 DEBUG:boto:Token: None 2023-12-15T23:14:20.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053e32b11feb605d8-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.061 DEBUG:boto:b'kskgfn-48obj000000000000000000651000falseobj000000000000000000652023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.061 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.062 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.062 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.062 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.062 DEBUG:boto:Method: GET 2023-12-15T23:14:20.062 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000065 2023-12-15T23:14:20.062 DEBUG:boto:Data: 2023-12-15T23:14:20.062 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.062 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.062 DEBUG:boto:Params: {} 2023-12-15T23:14:20.063 DEBUG:boto:Token: None 2023-12-15T23:14:20.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005dd1785b4f2503c7-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.067 DEBUG:boto:b'kskgfn-48obj000000000000000000651000falseobj000000000000000000652023-12-15T23:14:10.641Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.067 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2023-12-15T23:14:20.067 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.067 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.068 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.068 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.068 DEBUG:boto:Method: GET 2023-12-15T23:14:20.068 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.068 DEBUG:boto:Data: 2023-12-15T23:14:20.068 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.068 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.068 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.068 DEBUG:boto:Params: {} 2023-12-15T23:14:20.068 DEBUG:boto:Token: None 2023-12-15T23:14:20.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI= 2023-12-15T23:14:20.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI=', 'Content-Length': '0'} 2023-12-15T23:14:20.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000148c76a551515311-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.071 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.072 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.072 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.072 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.072 DEBUG:boto:Method: GET 2023-12-15T23:14:20.072 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.072 DEBUG:boto:Data: 2023-12-15T23:14:20.072 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.072 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.072 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.073 DEBUG:boto:Params: {} 2023-12-15T23:14:20.073 DEBUG:boto:Token: None 2023-12-15T23:14:20.073 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI= 2023-12-15T23:14:20.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI=', 'Content-Length': '0'} 2023-12-15T23:14:20.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000711baf375cabc8ce-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.118 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.118 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.118 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.118 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.118 DEBUG:boto:Data: 2023-12-15T23:14:20.118 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.119 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.119 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.119 DEBUG:boto:Params: {} 2023-12-15T23:14:20.119 DEBUG:boto:Token: None 2023-12-15T23:14:20.119 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8gEejoMjJjUVW0xKVIbk88S+iYM= 2023-12-15T23:14:20.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8gEejoMjJjUVW0xKVIbk88S+iYM=', 'Content-Length': '0'} 2023-12-15T23:14:20.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084287cbb6b8a1227-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.122 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.122 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.122 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.122 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.122 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.122 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.122 DEBUG:boto:Data: 2023-12-15T23:14:20.122 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.122 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.123 DEBUG:boto:Params: {} 2023-12-15T23:14:20.123 DEBUG:boto:Token: None 2023-12-15T23:14:20.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8gEejoMjJjUVW0xKVIbk88S+iYM= 2023-12-15T23:14:20.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8gEejoMjJjUVW0xKVIbk88S+iYM=', 'Content-Length': '0'} 2023-12-15T23:14:20.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000797a9667d86876e9-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2023-12-15T23:14:20.126 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.126 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.126 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.126 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.126 DEBUG:boto:Method: GET 2023-12-15T23:14:20.127 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.127 DEBUG:boto:Data: 2023-12-15T23:14:20.127 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.127 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.127 DEBUG:boto:Params: {} 2023-12-15T23:14:20.127 DEBUG:boto:Token: None 2023-12-15T23:14:20.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI= 2023-12-15T23:14:20.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI=', 'Content-Length': '0'} 2023-12-15T23:14:20.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000971258358e734677-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.130 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.130 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.130 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.130 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.130 DEBUG:boto:Method: GET 2023-12-15T23:14:20.130 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.130 DEBUG:boto:Data: 2023-12-15T23:14:20.131 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.131 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.131 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.131 DEBUG:boto:Params: {} 2023-12-15T23:14:20.131 DEBUG:boto:Token: None 2023-12-15T23:14:20.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076?versionId=null 2023-12-15T23:14:20.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI= 2023-12-15T23:14:20.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7dUF1NvQNKpVLqp/yVHZTOrlzUI=', 'Content-Length': '0'} 2023-12-15T23:14:20.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d23b41dd17e1c45-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.134 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.134 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.134 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.134 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.134 DEBUG:boto:Method: GET 2023-12-15T23:14:20.134 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.134 DEBUG:boto:Data: 2023-12-15T23:14:20.134 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.135 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.135 DEBUG:boto:Params: {} 2023-12-15T23:14:20.135 DEBUG:boto:Token: None 2023-12-15T23:14:20.135 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.138 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b23b794ff45a3bd-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.185 DEBUG:boto:b'kskgfn-48obj000000000000000000761000falseobj000000000000000000762023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.186 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.186 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.186 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.186 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.186 DEBUG:boto:Method: GET 2023-12-15T23:14:20.186 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.187 DEBUG:boto:Data: 2023-12-15T23:14:20.187 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.187 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.187 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.187 DEBUG:boto:Params: {} 2023-12-15T23:14:20.187 DEBUG:boto:Token: None 2023-12-15T23:14:20.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.191 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceec4d59bbe68d1b-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.191 DEBUG:boto:b'kskgfn-48obj000000000000000000761000falseobj000000000000000000762023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.191 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.192 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.192 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.192 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.192 DEBUG:boto:Data: 2023-12-15T23:14:20.192 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.192 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.192 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.192 DEBUG:boto:Params: {} 2023-12-15T23:14:20.192 DEBUG:boto:Token: None 2023-12-15T23:14:20.193 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QrTbNk50OQp8zgd2NUiqTagM1CI= 2023-12-15T23:14:20.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QrTbNk50OQp8zgd2NUiqTagM1CI=', 'Content-Length': '0'} 2023-12-15T23:14:20.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb5835032aa39f67-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.195 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.196 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.196 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.196 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.196 DEBUG:boto:Data: 2023-12-15T23:14:20.196 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.196 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.196 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.196 DEBUG:boto:Params: {} 2023-12-15T23:14:20.196 DEBUG:boto:Token: None 2023-12-15T23:14:20.196 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QrTbNk50OQp8zgd2NUiqTagM1CI= 2023-12-15T23:14:20.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QrTbNk50OQp8zgd2NUiqTagM1CI=', 'Content-Length': '0'} 2023-12-15T23:14:20.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a3f3143cc7a142b-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2023-12-15T23:14:20.199 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.199 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.199 DEBUG:boto:Method: GET 2023-12-15T23:14:20.199 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.200 DEBUG:boto:Data: 2023-12-15T23:14:20.200 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.200 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.200 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.200 DEBUG:boto:Params: {} 2023-12-15T23:14:20.200 DEBUG:boto:Token: None 2023-12-15T23:14:20.200 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.200 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p8IL+vK7L52xJ44CEzeY9efw6h4= 2023-12-15T23:14:20.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p8IL+vK7L52xJ44CEzeY9efw6h4=', 'Content-Length': '0'} 2023-12-15T23:14:20.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cd227c8bf1d7571-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.203 DEBUG:boto:path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.203 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.203 DEBUG:boto:Method: GET 2023-12-15T23:14:20.203 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.204 DEBUG:boto:Data: 2023-12-15T23:14:20.204 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.204 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.204 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.204 DEBUG:boto:Params: {} 2023-12-15T23:14:20.204 DEBUG:boto:Token: None 2023-12-15T23:14:20.204 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000076 2023-12-15T23:14:20.204 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p8IL+vK7L52xJ44CEzeY9efw6h4= 2023-12-15T23:14:20.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p8IL+vK7L52xJ44CEzeY9efw6h4=', 'Content-Length': '0'} 2023-12-15T23:14:20.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b28d913c0e55fe2-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.250 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.250 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.250 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.250 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.250 DEBUG:boto:Method: GET 2023-12-15T23:14:20.250 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.250 DEBUG:boto:Data: 2023-12-15T23:14:20.250 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.251 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.251 DEBUG:boto:Params: {} 2023-12-15T23:14:20.251 DEBUG:boto:Token: None 2023-12-15T23:14:20.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3f6d6a395331fab-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.254 DEBUG:boto:b'kskgfn-48obj000000000000000000761000falseobj000000000000000000762023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.255 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.255 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.255 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.255 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.255 DEBUG:boto:Method: GET 2023-12-15T23:14:20.255 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000076 2023-12-15T23:14:20.255 DEBUG:boto:Data: 2023-12-15T23:14:20.255 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.255 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.255 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.256 DEBUG:boto:Params: {} 2023-12-15T23:14:20.256 DEBUG:boto:Token: None 2023-12-15T23:14:20.256 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.259 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000455c841f645b5bb3-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.260 DEBUG:boto:b'kskgfn-48obj000000000000000000761000falseobj000000000000000000762023-12-15T23:14:05.678Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2023-12-15T23:14:20.260 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.260 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.260 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.260 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.260 DEBUG:boto:Method: GET 2023-12-15T23:14:20.261 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.261 DEBUG:boto:Data: 2023-12-15T23:14:20.261 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.261 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.261 DEBUG:boto:Params: {} 2023-12-15T23:14:20.261 DEBUG:boto:Token: None 2023-12-15T23:14:20.261 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.261 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0= 2023-12-15T23:14:20.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0=', 'Content-Length': '0'} 2023-12-15T23:14:20.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a6425199ff0cd4d-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.306 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.306 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.306 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.306 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.306 DEBUG:boto:Method: GET 2023-12-15T23:14:20.306 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.306 DEBUG:boto:Data: 2023-12-15T23:14:20.307 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.307 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.307 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.307 DEBUG:boto:Params: {} 2023-12-15T23:14:20.307 DEBUG:boto:Token: None 2023-12-15T23:14:20.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0= 2023-12-15T23:14:20.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0=', 'Content-Length': '0'} 2023-12-15T23:14:20.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004860806acd9cef1e-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.309 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.309 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.310 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.310 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.310 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.310 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.310 DEBUG:boto:Data: 2023-12-15T23:14:20.310 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.310 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.310 DEBUG:boto:Params: {} 2023-12-15T23:14:20.310 DEBUG:boto:Token: None 2023-12-15T23:14:20.311 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKzycz9rfwY9DtAHZqZw6eMO6Hg= 2023-12-15T23:14:20.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKzycz9rfwY9DtAHZqZw6eMO6Hg=', 'Content-Length': '0'} 2023-12-15T23:14:20.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000707c0add7d6c3826-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.313 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.313 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.313 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.313 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.313 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.313 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.313 DEBUG:boto:Data: 2023-12-15T23:14:20.314 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.314 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.314 DEBUG:boto:Params: {} 2023-12-15T23:14:20.314 DEBUG:boto:Token: None 2023-12-15T23:14:20.314 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKzycz9rfwY9DtAHZqZw6eMO6Hg= 2023-12-15T23:14:20.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKzycz9rfwY9DtAHZqZw6eMO6Hg=', 'Content-Length': '0'} 2023-12-15T23:14:20.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f68c0c4aeeef700-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2023-12-15T23:14:20.316 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.317 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.317 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.317 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.317 DEBUG:boto:Method: GET 2023-12-15T23:14:20.317 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.317 DEBUG:boto:Data: 2023-12-15T23:14:20.317 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.317 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.317 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.317 DEBUG:boto:Params: {} 2023-12-15T23:14:20.318 DEBUG:boto:Token: None 2023-12-15T23:14:20.318 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0= 2023-12-15T23:14:20.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0=', 'Content-Length': '0'} 2023-12-15T23:14:20.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfc0063a50b521ff-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.320 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.320 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.320 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.320 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.320 DEBUG:boto:Method: GET 2023-12-15T23:14:20.321 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.321 DEBUG:boto:Data: 2023-12-15T23:14:20.321 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.321 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.321 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.321 DEBUG:boto:Params: {} 2023-12-15T23:14:20.321 DEBUG:boto:Token: None 2023-12-15T23:14:20.321 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133?versionId=null 2023-12-15T23:14:20.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0= 2023-12-15T23:14:20.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vCX6UsxI8ws3TeUBRfsk2u6Y2z0=', 'Content-Length': '0'} 2023-12-15T23:14:20.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eab1e57a5fddc7c8-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.323 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.323 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.324 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.324 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.324 DEBUG:boto:Method: GET 2023-12-15T23:14:20.324 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.324 DEBUG:boto:Data: 2023-12-15T23:14:20.324 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.324 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.324 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.324 DEBUG:boto:Params: {} 2023-12-15T23:14:20.325 DEBUG:boto:Token: None 2023-12-15T23:14:20.325 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.327 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000288cf79b5b7490b1-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.327 DEBUG:boto:b'kskgfn-48obj000000000000000001331000falseobj000000000000000001332023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.328 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.328 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.328 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.328 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.328 DEBUG:boto:Method: GET 2023-12-15T23:14:20.328 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.328 DEBUG:boto:Data: 2023-12-15T23:14:20.328 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.328 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.328 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.328 DEBUG:boto:Params: {} 2023-12-15T23:14:20.329 DEBUG:boto:Token: None 2023-12-15T23:14:20.329 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.329 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038532317d2fe2a02-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.333 DEBUG:boto:b'kskgfn-48obj000000000000000001331000falseobj000000000000000001332023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.333 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.333 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.333 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.333 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.334 DEBUG:boto:Data: 2023-12-15T23:14:20.334 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.334 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.334 DEBUG:boto:Params: {} 2023-12-15T23:14:20.334 DEBUG:boto:Token: None 2023-12-15T23:14:20.334 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cbC4jElPPt6uLFia82IvcOi9pEs= 2023-12-15T23:14:20.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cbC4jElPPt6uLFia82IvcOi9pEs=', 'Content-Length': '0'} 2023-12-15T23:14:20.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e285447dacba295-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.336 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.336 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.337 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.337 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.337 DEBUG:boto:Data: 2023-12-15T23:14:20.337 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.337 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.337 DEBUG:boto:Params: {} 2023-12-15T23:14:20.337 DEBUG:boto:Token: None 2023-12-15T23:14:20.337 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cbC4jElPPt6uLFia82IvcOi9pEs= 2023-12-15T23:14:20.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cbC4jElPPt6uLFia82IvcOi9pEs=', 'Content-Length': '0'} 2023-12-15T23:14:20.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f94fc14fe0fda2fd-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2023-12-15T23:14:20.340 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.340 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.340 DEBUG:boto:Method: GET 2023-12-15T23:14:20.340 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.340 DEBUG:boto:Data: 2023-12-15T23:14:20.340 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.340 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.340 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.340 DEBUG:boto:Params: {} 2023-12-15T23:14:20.341 DEBUG:boto:Token: None 2023-12-15T23:14:20.341 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LopeiJR8bLBApHCxqZZhciCh+6A= 2023-12-15T23:14:20.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LopeiJR8bLBApHCxqZZhciCh+6A=', 'Content-Length': '0'} 2023-12-15T23:14:20.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000005b0e39b299cb22-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.343 DEBUG:boto:path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.343 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.343 DEBUG:boto:Method: GET 2023-12-15T23:14:20.343 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.343 DEBUG:boto:Data: 2023-12-15T23:14:20.344 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.344 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.344 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.344 DEBUG:boto:Params: {} 2023-12-15T23:14:20.344 DEBUG:boto:Token: None 2023-12-15T23:14:20.344 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000133 2023-12-15T23:14:20.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LopeiJR8bLBApHCxqZZhciCh+6A= 2023-12-15T23:14:20.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LopeiJR8bLBApHCxqZZhciCh+6A=', 'Content-Length': '0'} 2023-12-15T23:14:20.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c739690d775da33e-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.346 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.347 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.347 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.347 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.347 DEBUG:boto:Method: GET 2023-12-15T23:14:20.347 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.347 DEBUG:boto:Data: 2023-12-15T23:14:20.347 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.347 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.347 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.347 DEBUG:boto:Params: {} 2023-12-15T23:14:20.347 DEBUG:boto:Token: None 2023-12-15T23:14:20.348 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.350 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de009eb2fd66ecf2-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.351 DEBUG:boto:b'kskgfn-48obj000000000000000001331000falseobj000000000000000001332023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.351 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.351 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.351 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.351 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.351 DEBUG:boto:Method: GET 2023-12-15T23:14:20.351 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000133 2023-12-15T23:14:20.351 DEBUG:boto:Data: 2023-12-15T23:14:20.352 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.352 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.352 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.352 DEBUG:boto:Params: {} 2023-12-15T23:14:20.352 DEBUG:boto:Token: None 2023-12-15T23:14:20.352 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.352 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c32e175f014bb727-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.356 DEBUG:boto:b'kskgfn-48obj000000000000000001331000falseobj000000000000000001332023-12-15T23:14:09.373Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2023-12-15T23:14:20.357 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.357 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.357 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.357 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.357 DEBUG:boto:Method: GET 2023-12-15T23:14:20.357 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.358 DEBUG:boto:Data: 2023-12-15T23:14:20.358 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.358 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.358 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.358 DEBUG:boto:Params: {} 2023-12-15T23:14:20.358 DEBUG:boto:Token: None 2023-12-15T23:14:20.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE= 2023-12-15T23:14:20.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE=', 'Content-Length': '0'} 2023-12-15T23:14:20.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7dc48d0fef35ce8-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.361 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.361 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.361 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.361 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.361 DEBUG:boto:Method: GET 2023-12-15T23:14:20.361 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.361 DEBUG:boto:Data: 2023-12-15T23:14:20.362 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.362 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.362 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.362 DEBUG:boto:Params: {} 2023-12-15T23:14:20.362 DEBUG:boto:Token: None 2023-12-15T23:14:20.362 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE= 2023-12-15T23:14:20.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE=', 'Content-Length': '0'} 2023-12-15T23:14:20.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba85c20cdcf98b45-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.405 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.406 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.406 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.406 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.406 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.406 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.406 DEBUG:boto:Data: 2023-12-15T23:14:20.406 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.406 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.406 DEBUG:boto:Params: {} 2023-12-15T23:14:20.407 DEBUG:boto:Token: None 2023-12-15T23:14:20.407 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/7GbyZMrr/0eKaIcNP0nw919N5c= 2023-12-15T23:14:20.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/7GbyZMrr/0eKaIcNP0nw919N5c=', 'Content-Length': '0'} 2023-12-15T23:14:20.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d00075b6dc6211be-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.409 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.409 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.409 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.409 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.410 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.410 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.410 DEBUG:boto:Data: 2023-12-15T23:14:20.410 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.410 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.410 DEBUG:boto:Params: {} 2023-12-15T23:14:20.410 DEBUG:boto:Token: None 2023-12-15T23:14:20.410 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/7GbyZMrr/0eKaIcNP0nw919N5c= 2023-12-15T23:14:20.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/7GbyZMrr/0eKaIcNP0nw919N5c=', 'Content-Length': '0'} 2023-12-15T23:14:20.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a06176eebc0b1e23-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2023-12-15T23:14:20.413 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.413 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.413 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.413 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.413 DEBUG:boto:Method: GET 2023-12-15T23:14:20.413 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.414 DEBUG:boto:Data: 2023-12-15T23:14:20.414 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.414 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.414 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.414 DEBUG:boto:Params: {} 2023-12-15T23:14:20.414 DEBUG:boto:Token: None 2023-12-15T23:14:20.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE= 2023-12-15T23:14:20.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE=', 'Content-Length': '0'} 2023-12-15T23:14:20.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026146d35f5caddf7-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.416 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.416 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.417 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.417 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.417 DEBUG:boto:Method: GET 2023-12-15T23:14:20.417 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.417 DEBUG:boto:Data: 2023-12-15T23:14:20.417 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.417 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.417 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.417 DEBUG:boto:Params: {} 2023-12-15T23:14:20.417 DEBUG:boto:Token: None 2023-12-15T23:14:20.417 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162?versionId=null 2023-12-15T23:14:20.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE= 2023-12-15T23:14:20.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:idWfF9d4MNwgn7gjEuhETCNUydE=', 'Content-Length': '0'} 2023-12-15T23:14:20.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000268deaa9441afab1-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.420 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.420 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.420 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.420 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.420 DEBUG:boto:Method: GET 2023-12-15T23:14:20.420 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.420 DEBUG:boto:Data: 2023-12-15T23:14:20.420 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.421 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.421 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.421 DEBUG:boto:Params: {} 2023-12-15T23:14:20.421 DEBUG:boto:Token: None 2023-12-15T23:14:20.421 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.421 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.424 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6205aa473bfcd2d-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.424 DEBUG:boto:b'kskgfn-48obj000000000000000001621000falseobj000000000000000001622023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.424 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.424 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.425 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.425 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.425 DEBUG:boto:Method: GET 2023-12-15T23:14:20.425 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.425 DEBUG:boto:Data: 2023-12-15T23:14:20.425 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.425 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.425 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.425 DEBUG:boto:Params: {} 2023-12-15T23:14:20.426 DEBUG:boto:Token: None 2023-12-15T23:14:20.426 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.426 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096a3e044e7248901-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.430 DEBUG:boto:b'kskgfn-48obj000000000000000001621000falseobj000000000000000001622023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.431 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.431 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.431 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.431 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.431 DEBUG:boto:Data: 2023-12-15T23:14:20.431 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.431 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.431 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.432 DEBUG:boto:Params: {} 2023-12-15T23:14:20.432 DEBUG:boto:Token: None 2023-12-15T23:14:20.432 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.432 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gG/auNOCUAQ8ELmKku+Ujx0gURA= 2023-12-15T23:14:20.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gG/auNOCUAQ8ELmKku+Ujx0gURA=', 'Content-Length': '0'} 2023-12-15T23:14:20.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0506f05a012aa21-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.434 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.434 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.434 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.434 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.434 DEBUG:boto:Data: 2023-12-15T23:14:20.434 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.434 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.435 DEBUG:boto:Params: {} 2023-12-15T23:14:20.435 DEBUG:boto:Token: None 2023-12-15T23:14:20.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gG/auNOCUAQ8ELmKku+Ujx0gURA= 2023-12-15T23:14:20.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gG/auNOCUAQ8ELmKku+Ujx0gURA=', 'Content-Length': '0'} 2023-12-15T23:14:20.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076208aa9cc5ed48d-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2023-12-15T23:14:20.437 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.437 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.438 DEBUG:boto:Method: GET 2023-12-15T23:14:20.438 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.438 DEBUG:boto:Data: 2023-12-15T23:14:20.438 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.438 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.438 DEBUG:boto:Params: {} 2023-12-15T23:14:20.438 DEBUG:boto:Token: None 2023-12-15T23:14:20.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j9ZblL+Z9ewa6AtwDgtf7UPKo+8= 2023-12-15T23:14:20.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j9ZblL+Z9ewa6AtwDgtf7UPKo+8=', 'Content-Length': '0'} 2023-12-15T23:14:20.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006197c635e04e584f-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.481 DEBUG:boto:path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.482 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.482 DEBUG:boto:Method: GET 2023-12-15T23:14:20.482 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.482 DEBUG:boto:Data: 2023-12-15T23:14:20.482 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.482 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.482 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.482 DEBUG:boto:Params: {} 2023-12-15T23:14:20.482 DEBUG:boto:Token: None 2023-12-15T23:14:20.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000162 2023-12-15T23:14:20.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j9ZblL+Z9ewa6AtwDgtf7UPKo+8= 2023-12-15T23:14:20.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j9ZblL+Z9ewa6AtwDgtf7UPKo+8=', 'Content-Length': '0'} 2023-12-15T23:14:20.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063c5ba4285798d4e-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.485 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.485 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.485 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.485 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.485 DEBUG:boto:Method: GET 2023-12-15T23:14:20.485 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.485 DEBUG:boto:Data: 2023-12-15T23:14:20.486 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.486 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.486 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.486 DEBUG:boto:Params: {} 2023-12-15T23:14:20.486 DEBUG:boto:Token: None 2023-12-15T23:14:20.486 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.486 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013de7ab9971cbc26-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.489 DEBUG:boto:b'kskgfn-48obj000000000000000001621000falseobj000000000000000001622023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.489 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.490 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.490 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.490 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.490 DEBUG:boto:Method: GET 2023-12-15T23:14:20.490 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000162 2023-12-15T23:14:20.490 DEBUG:boto:Data: 2023-12-15T23:14:20.490 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.490 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.490 DEBUG:boto:Params: {} 2023-12-15T23:14:20.491 DEBUG:boto:Token: None 2023-12-15T23:14:20.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.495 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d4c914f867f055d-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.495 DEBUG:boto:b'kskgfn-48obj000000000000000001621000falseobj000000000000000001622023-12-15T23:14:08.821Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2023-12-15T23:14:20.495 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.495 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.495 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.496 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.496 DEBUG:boto:Method: GET 2023-12-15T23:14:20.496 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.496 DEBUG:boto:Data: 2023-12-15T23:14:20.496 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.496 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.496 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.496 DEBUG:boto:Params: {} 2023-12-15T23:14:20.496 DEBUG:boto:Token: None 2023-12-15T23:14:20.496 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.497 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo= 2023-12-15T23:14:20.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo=', 'Content-Length': '0'} 2023-12-15T23:14:20.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53b174d0004e086-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.499 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.500 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.500 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.500 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.500 DEBUG:boto:Method: GET 2023-12-15T23:14:20.500 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.500 DEBUG:boto:Data: 2023-12-15T23:14:20.500 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.500 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.500 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.500 DEBUG:boto:Params: {} 2023-12-15T23:14:20.501 DEBUG:boto:Token: None 2023-12-15T23:14:20.501 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.501 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo= 2023-12-15T23:14:20.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo=', 'Content-Length': '0'} 2023-12-15T23:14:20.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008677c5ea28e8491c-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.545 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.546 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.546 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.546 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.546 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.546 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.546 DEBUG:boto:Data: 2023-12-15T23:14:20.546 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.546 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.546 DEBUG:boto:Params: {} 2023-12-15T23:14:20.546 DEBUG:boto:Token: None 2023-12-15T23:14:20.547 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h2tAFLla4c72CT2HkRnroWb2FTQ= 2023-12-15T23:14:20.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h2tAFLla4c72CT2HkRnroWb2FTQ=', 'Content-Length': '0'} 2023-12-15T23:14:20.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ceed021918bfc58-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.549 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.549 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.549 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.549 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.550 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.550 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.550 DEBUG:boto:Data: 2023-12-15T23:14:20.550 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.550 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.550 DEBUG:boto:Params: {} 2023-12-15T23:14:20.550 DEBUG:boto:Token: None 2023-12-15T23:14:20.550 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h2tAFLla4c72CT2HkRnroWb2FTQ= 2023-12-15T23:14:20.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h2tAFLla4c72CT2HkRnroWb2FTQ=', 'Content-Length': '0'} 2023-12-15T23:14:20.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c47d93b10eeacc5-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2023-12-15T23:14:20.553 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.553 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.553 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.553 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.553 DEBUG:boto:Method: GET 2023-12-15T23:14:20.553 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.554 DEBUG:boto:Data: 2023-12-15T23:14:20.554 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.554 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.554 DEBUG:boto:Params: {} 2023-12-15T23:14:20.554 DEBUG:boto:Token: None 2023-12-15T23:14:20.554 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo= 2023-12-15T23:14:20.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo=', 'Content-Length': '0'} 2023-12-15T23:14:20.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008787288d56d43650-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.556 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.557 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.557 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.557 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.557 DEBUG:boto:Method: GET 2023-12-15T23:14:20.557 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.557 DEBUG:boto:Data: 2023-12-15T23:14:20.557 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.557 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.557 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.558 DEBUG:boto:Params: {} 2023-12-15T23:14:20.558 DEBUG:boto:Token: None 2023-12-15T23:14:20.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271?versionId=null 2023-12-15T23:14:20.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo= 2023-12-15T23:14:20.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRmsF/Ca5jtdoaC05DwBgfV9LQo=', 'Content-Length': '0'} 2023-12-15T23:14:20.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016f363d2ae702d2f-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.560 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.561 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.561 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.561 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.561 DEBUG:boto:Method: GET 2023-12-15T23:14:20.561 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.561 DEBUG:boto:Data: 2023-12-15T23:14:20.561 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.561 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.561 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.561 DEBUG:boto:Params: {} 2023-12-15T23:14:20.562 DEBUG:boto:Token: None 2023-12-15T23:14:20.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002000bda421426187-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.564 DEBUG:boto:b'kskgfn-48obj000000000000000002711000falseobj000000000000000002712023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.565 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.565 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.565 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.565 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.565 DEBUG:boto:Method: GET 2023-12-15T23:14:20.565 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.565 DEBUG:boto:Data: 2023-12-15T23:14:20.565 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.566 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.566 DEBUG:boto:Params: {} 2023-12-15T23:14:20.566 DEBUG:boto:Token: None 2023-12-15T23:14:20.566 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.566 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcce83c94125039a-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.570 DEBUG:boto:b'kskgfn-48obj000000000000000002711000falseobj000000000000000002712023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.570 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.570 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.570 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.570 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.571 DEBUG:boto:Data: 2023-12-15T23:14:20.571 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.571 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.571 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.571 DEBUG:boto:Params: {} 2023-12-15T23:14:20.571 DEBUG:boto:Token: None 2023-12-15T23:14:20.571 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ewz/urTlsuPAkxwHO/ZSL/diWKg= 2023-12-15T23:14:20.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ewz/urTlsuPAkxwHO/ZSL/diWKg=', 'Content-Length': '0'} 2023-12-15T23:14:20.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d5b8861f3404426-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.574 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.574 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.574 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.574 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.574 DEBUG:boto:Data: 2023-12-15T23:14:20.574 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.574 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.574 DEBUG:boto:Params: {} 2023-12-15T23:14:20.575 DEBUG:boto:Token: None 2023-12-15T23:14:20.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ewz/urTlsuPAkxwHO/ZSL/diWKg= 2023-12-15T23:14:20.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ewz/urTlsuPAkxwHO/ZSL/diWKg=', 'Content-Length': '0'} 2023-12-15T23:14:20.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d878cf53e50758d0-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2023-12-15T23:14:20.577 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.577 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.578 DEBUG:boto:Method: GET 2023-12-15T23:14:20.578 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.578 DEBUG:boto:Data: 2023-12-15T23:14:20.578 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.578 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.578 DEBUG:boto:Params: {} 2023-12-15T23:14:20.578 DEBUG:boto:Token: None 2023-12-15T23:14:20.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgq6JzGZzjvGKJELaqHZooVp73U= 2023-12-15T23:14:20.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgq6JzGZzjvGKJELaqHZooVp73U=', 'Content-Length': '0'} 2023-12-15T23:14:20.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066c8c4a1f2a96e80-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.581 DEBUG:boto:path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.581 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.581 DEBUG:boto:Method: GET 2023-12-15T23:14:20.581 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.581 DEBUG:boto:Data: 2023-12-15T23:14:20.582 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.582 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.582 DEBUG:boto:Params: {} 2023-12-15T23:14:20.582 DEBUG:boto:Token: None 2023-12-15T23:14:20.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000271 2023-12-15T23:14:20.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgq6JzGZzjvGKJELaqHZooVp73U= 2023-12-15T23:14:20.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgq6JzGZzjvGKJELaqHZooVp73U=', 'Content-Length': '0'} 2023-12-15T23:14:20.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008eb991ca3742289-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.585 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.585 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.585 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.585 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.585 DEBUG:boto:Method: GET 2023-12-15T23:14:20.585 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.585 DEBUG:boto:Data: 2023-12-15T23:14:20.585 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.585 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.586 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.586 DEBUG:boto:Params: {} 2023-12-15T23:14:20.586 DEBUG:boto:Token: None 2023-12-15T23:14:20.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009356b98d78076e13-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.589 DEBUG:boto:b'kskgfn-48obj000000000000000002711000falseobj000000000000000002712023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.589 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.589 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.589 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.589 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.589 DEBUG:boto:Method: GET 2023-12-15T23:14:20.590 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000271 2023-12-15T23:14:20.590 DEBUG:boto:Data: 2023-12-15T23:14:20.590 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.590 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.590 DEBUG:boto:Params: {} 2023-12-15T23:14:20.590 DEBUG:boto:Token: None 2023-12-15T23:14:20.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3dcee6e6be2f1a8-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.594 DEBUG:boto:b'kskgfn-48obj000000000000000002711000falseobj000000000000000002712023-12-15T23:14:09.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2023-12-15T23:14:20.595 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.595 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.595 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.595 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.595 DEBUG:boto:Method: GET 2023-12-15T23:14:20.595 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.595 DEBUG:boto:Data: 2023-12-15T23:14:20.595 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.595 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.595 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.595 DEBUG:boto:Params: {} 2023-12-15T23:14:20.596 DEBUG:boto:Token: None 2023-12-15T23:14:20.596 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U= 2023-12-15T23:14:20.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U=', 'Content-Length': '0'} 2023-12-15T23:14:20.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000583a24f0c1b761c2-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.599 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.599 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.599 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.599 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.599 DEBUG:boto:Method: GET 2023-12-15T23:14:20.599 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.600 DEBUG:boto:Data: 2023-12-15T23:14:20.600 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.600 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.600 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.600 DEBUG:boto:Params: {} 2023-12-15T23:14:20.600 DEBUG:boto:Token: None 2023-12-15T23:14:20.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U= 2023-12-15T23:14:20.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U=', 'Content-Length': '0'} 2023-12-15T23:14:20.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a54b0129a949493b-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.645 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.646 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.646 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.646 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.646 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.646 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.646 DEBUG:boto:Data: 2023-12-15T23:14:20.646 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.646 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.646 DEBUG:boto:Params: {} 2023-12-15T23:14:20.647 DEBUG:boto:Token: None 2023-12-15T23:14:20.647 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:itYB/NIvHrG+sDx5mGrlLly+UUE= 2023-12-15T23:14:20.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:itYB/NIvHrG+sDx5mGrlLly+UUE=', 'Content-Length': '0'} 2023-12-15T23:14:20.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7742ab99974a332-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.649 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.649 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.650 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.650 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.650 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.650 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.650 DEBUG:boto:Data: 2023-12-15T23:14:20.650 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.650 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.650 DEBUG:boto:Params: {} 2023-12-15T23:14:20.650 DEBUG:boto:Token: None 2023-12-15T23:14:20.651 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:itYB/NIvHrG+sDx5mGrlLly+UUE= 2023-12-15T23:14:20.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:itYB/NIvHrG+sDx5mGrlLly+UUE=', 'Content-Length': '0'} 2023-12-15T23:14:20.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ce15953a9dc3abe-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2023-12-15T23:14:20.653 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.653 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.654 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.654 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.654 DEBUG:boto:Method: GET 2023-12-15T23:14:20.654 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.654 DEBUG:boto:Data: 2023-12-15T23:14:20.654 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.654 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.654 DEBUG:boto:Params: {} 2023-12-15T23:14:20.655 DEBUG:boto:Token: None 2023-12-15T23:14:20.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U= 2023-12-15T23:14:20.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U=', 'Content-Length': '0'} 2023-12-15T23:14:20.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000142f6168948af80f-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.657 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.657 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.658 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.658 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.658 DEBUG:boto:Method: GET 2023-12-15T23:14:20.658 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.658 DEBUG:boto:Data: 2023-12-15T23:14:20.658 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.658 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.658 DEBUG:boto:Params: {} 2023-12-15T23:14:20.658 DEBUG:boto:Token: None 2023-12-15T23:14:20.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283?versionId=null 2023-12-15T23:14:20.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U= 2023-12-15T23:14:20.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UvitxtsgzdyRDCRZJAhR57O/l1U=', 'Content-Length': '0'} 2023-12-15T23:14:20.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fcbd6fe1ff0d3be-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.662 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.662 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.662 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.662 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.662 DEBUG:boto:Method: GET 2023-12-15T23:14:20.662 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.662 DEBUG:boto:Data: 2023-12-15T23:14:20.662 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.662 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.663 DEBUG:boto:Params: {} 2023-12-15T23:14:20.663 DEBUG:boto:Token: None 2023-12-15T23:14:20.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba9d82f48b8dc4c8-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.666 DEBUG:boto:b'kskgfn-48obj000000000000000002831000falseobj000000000000000002832023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.666 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.666 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.666 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.666 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.666 DEBUG:boto:Method: GET 2023-12-15T23:14:20.667 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.667 DEBUG:boto:Data: 2023-12-15T23:14:20.667 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.667 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.667 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.667 DEBUG:boto:Params: {} 2023-12-15T23:14:20.667 DEBUG:boto:Token: None 2023-12-15T23:14:20.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f760a3adf5b52a2d-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.671 DEBUG:boto:b'kskgfn-48obj000000000000000002831000falseobj000000000000000002832023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.671 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.671 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.672 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.672 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.672 DEBUG:boto:Data: 2023-12-15T23:14:20.672 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.672 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.672 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.672 DEBUG:boto:Params: {} 2023-12-15T23:14:20.672 DEBUG:boto:Token: None 2023-12-15T23:14:20.672 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VM4Cq4x3BPFFXoWX3o+noASbhoQ= 2023-12-15T23:14:20.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VM4Cq4x3BPFFXoWX3o+noASbhoQ=', 'Content-Length': '0'} 2023-12-15T23:14:20.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3f782c64d7a78bb-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.675 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.675 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.675 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.676 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.676 DEBUG:boto:Data: 2023-12-15T23:14:20.676 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.676 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.676 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.676 DEBUG:boto:Params: {} 2023-12-15T23:14:20.676 DEBUG:boto:Token: None 2023-12-15T23:14:20.676 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VM4Cq4x3BPFFXoWX3o+noASbhoQ= 2023-12-15T23:14:20.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VM4Cq4x3BPFFXoWX3o+noASbhoQ=', 'Content-Length': '0'} 2023-12-15T23:14:20.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bca29a973c1f04f9-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2023-12-15T23:14:20.679 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.679 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.679 DEBUG:boto:Method: GET 2023-12-15T23:14:20.679 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.680 DEBUG:boto:Data: 2023-12-15T23:14:20.680 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.680 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.680 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.680 DEBUG:boto:Params: {} 2023-12-15T23:14:20.680 DEBUG:boto:Token: None 2023-12-15T23:14:20.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SXeAGlFvPovBhAJxtDhN5v9p390= 2023-12-15T23:14:20.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SXeAGlFvPovBhAJxtDhN5v9p390=', 'Content-Length': '0'} 2023-12-15T23:14:20.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e17a2ce8324f6c7a-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.725 DEBUG:boto:path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.726 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.726 DEBUG:boto:Method: GET 2023-12-15T23:14:20.726 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.726 DEBUG:boto:Data: 2023-12-15T23:14:20.726 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.726 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.726 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.726 DEBUG:boto:Params: {} 2023-12-15T23:14:20.726 DEBUG:boto:Token: None 2023-12-15T23:14:20.727 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000283 2023-12-15T23:14:20.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SXeAGlFvPovBhAJxtDhN5v9p390= 2023-12-15T23:14:20.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SXeAGlFvPovBhAJxtDhN5v9p390=', 'Content-Length': '0'} 2023-12-15T23:14:20.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c07287043c3a06b-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.730 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.730 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.730 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.730 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.730 DEBUG:boto:Method: GET 2023-12-15T23:14:20.730 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.730 DEBUG:boto:Data: 2023-12-15T23:14:20.730 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.731 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.731 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.731 DEBUG:boto:Params: {} 2023-12-15T23:14:20.731 DEBUG:boto:Token: None 2023-12-15T23:14:20.731 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b339545524bca498-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.734 DEBUG:boto:b'kskgfn-48obj000000000000000002831000falseobj000000000000000002832023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.734 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.734 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.735 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.735 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.735 DEBUG:boto:Method: GET 2023-12-15T23:14:20.735 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000283 2023-12-15T23:14:20.735 DEBUG:boto:Data: 2023-12-15T23:14:20.735 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.735 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.735 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.735 DEBUG:boto:Params: {} 2023-12-15T23:14:20.736 DEBUG:boto:Token: None 2023-12-15T23:14:20.736 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.736 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aea7aa1bc886406f-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.781 DEBUG:boto:b'kskgfn-48obj000000000000000002831000falseobj000000000000000002832023-12-15T23:14:09.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2023-12-15T23:14:20.782 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.782 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.782 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.782 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.782 DEBUG:boto:Method: GET 2023-12-15T23:14:20.783 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.783 DEBUG:boto:Data: 2023-12-15T23:14:20.783 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.783 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.783 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.783 DEBUG:boto:Params: {} 2023-12-15T23:14:20.783 DEBUG:boto:Token: None 2023-12-15T23:14:20.783 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.784 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg= 2023-12-15T23:14:20.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg=', 'Content-Length': '0'} 2023-12-15T23:14:20.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005656e7aaedacd796-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.786 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.786 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.786 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.787 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.787 DEBUG:boto:Method: GET 2023-12-15T23:14:20.787 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.787 DEBUG:boto:Data: 2023-12-15T23:14:20.787 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.787 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.787 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.787 DEBUG:boto:Params: {} 2023-12-15T23:14:20.787 DEBUG:boto:Token: None 2023-12-15T23:14:20.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg= 2023-12-15T23:14:20.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg=', 'Content-Length': '0'} 2023-12-15T23:14:20.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000feceed8f0b64f17c-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.790 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.790 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.791 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.791 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.791 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.791 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.791 DEBUG:boto:Data: 2023-12-15T23:14:20.791 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.791 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.791 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.791 DEBUG:boto:Params: {} 2023-12-15T23:14:20.791 DEBUG:boto:Token: None 2023-12-15T23:14:20.792 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.792 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m8XEVp9CjZnEoQnB88aQCfa/So0= 2023-12-15T23:14:20.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m8XEVp9CjZnEoQnB88aQCfa/So0=', 'Content-Length': '0'} 2023-12-15T23:14:20.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b74169ce72100a5a-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.794 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.794 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.794 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.795 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.795 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.795 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.795 DEBUG:boto:Data: 2023-12-15T23:14:20.795 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.795 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.795 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.795 DEBUG:boto:Params: {} 2023-12-15T23:14:20.795 DEBUG:boto:Token: None 2023-12-15T23:14:20.796 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.796 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m8XEVp9CjZnEoQnB88aQCfa/So0= 2023-12-15T23:14:20.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m8XEVp9CjZnEoQnB88aQCfa/So0=', 'Content-Length': '0'} 2023-12-15T23:14:20.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e9603b11b4146d5-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2023-12-15T23:14:20.798 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.798 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.798 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.798 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.799 DEBUG:boto:Method: GET 2023-12-15T23:14:20.799 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.799 DEBUG:boto:Data: 2023-12-15T23:14:20.799 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.799 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.799 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.799 DEBUG:boto:Params: {} 2023-12-15T23:14:20.799 DEBUG:boto:Token: None 2023-12-15T23:14:20.799 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.800 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg= 2023-12-15T23:14:20.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg=', 'Content-Length': '0'} 2023-12-15T23:14:20.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d956bd1a35daa895-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.845 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.846 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.846 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.846 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.846 DEBUG:boto:Method: GET 2023-12-15T23:14:20.846 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.846 DEBUG:boto:Data: 2023-12-15T23:14:20.846 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.846 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.846 DEBUG:boto:Params: {} 2023-12-15T23:14:20.847 DEBUG:boto:Token: None 2023-12-15T23:14:20.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317?versionId=null 2023-12-15T23:14:20.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg= 2023-12-15T23:14:20.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gwih0ZZm+Lj2x9XwwiuYuN1KHPg=', 'Content-Length': '0'} 2023-12-15T23:14:20.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000415dc99463444a6c-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.850 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.850 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.850 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.850 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.850 DEBUG:boto:Method: GET 2023-12-15T23:14:20.850 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.850 DEBUG:boto:Data: 2023-12-15T23:14:20.850 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.850 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.850 DEBUG:boto:Params: {} 2023-12-15T23:14:20.851 DEBUG:boto:Token: None 2023-12-15T23:14:20.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b11e21dd9e103ad-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.854 DEBUG:boto:b'kskgfn-48obj000000000000000003171000falseobj000000000000000003172023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.854 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.854 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.854 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.854 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.854 DEBUG:boto:Method: GET 2023-12-15T23:14:20.855 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.855 DEBUG:boto:Data: 2023-12-15T23:14:20.855 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.855 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.855 DEBUG:boto:Params: {} 2023-12-15T23:14:20.855 DEBUG:boto:Token: None 2023-12-15T23:14:20.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.859 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074f4a7fe80b18b46-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.859 DEBUG:boto:b'kskgfn-48obj000000000000000003171000falseobj000000000000000003172023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.860 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.860 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.860 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.860 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.860 DEBUG:boto:Data: 2023-12-15T23:14:20.860 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.860 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.860 DEBUG:boto:Params: {} 2023-12-15T23:14:20.860 DEBUG:boto:Token: None 2023-12-15T23:14:20.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iAeWMhQVpaqRPvfrWK3QuBptPtY= 2023-12-15T23:14:20.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iAeWMhQVpaqRPvfrWK3QuBptPtY=', 'Content-Length': '0'} 2023-12-15T23:14:20.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075ce18a7843297ff-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.863 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.863 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.863 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.863 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.864 DEBUG:boto:Data: 2023-12-15T23:14:20.864 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.864 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.864 DEBUG:boto:Params: {} 2023-12-15T23:14:20.864 DEBUG:boto:Token: None 2023-12-15T23:14:20.864 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iAeWMhQVpaqRPvfrWK3QuBptPtY= 2023-12-15T23:14:20.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iAeWMhQVpaqRPvfrWK3QuBptPtY=', 'Content-Length': '0'} 2023-12-15T23:14:20.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7b9bad926511f9c-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2023-12-15T23:14:20.867 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.867 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.867 DEBUG:boto:Method: GET 2023-12-15T23:14:20.867 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.867 DEBUG:boto:Data: 2023-12-15T23:14:20.867 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.867 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.867 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.867 DEBUG:boto:Params: {} 2023-12-15T23:14:20.868 DEBUG:boto:Token: None 2023-12-15T23:14:20.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vm7Rl7NtAeJLtWXmVzOKxfLuZ1o= 2023-12-15T23:14:20.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vm7Rl7NtAeJLtWXmVzOKxfLuZ1o=', 'Content-Length': '0'} 2023-12-15T23:14:20.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000411103bd03d614f8-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.918 DEBUG:boto:path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.918 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.918 DEBUG:boto:Method: GET 2023-12-15T23:14:20.918 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.918 DEBUG:boto:Data: 2023-12-15T23:14:20.918 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.918 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.918 DEBUG:boto:Params: {} 2023-12-15T23:14:20.918 DEBUG:boto:Token: None 2023-12-15T23:14:20.919 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000317 2023-12-15T23:14:20.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vm7Rl7NtAeJLtWXmVzOKxfLuZ1o= 2023-12-15T23:14:20.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vm7Rl7NtAeJLtWXmVzOKxfLuZ1o=', 'Content-Length': '0'} 2023-12-15T23:14:20.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019b7b5ecf1333989-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.921 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.921 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.921 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.921 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.922 DEBUG:boto:Method: GET 2023-12-15T23:14:20.922 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.922 DEBUG:boto:Data: 2023-12-15T23:14:20.922 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.922 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.922 DEBUG:boto:Params: {} 2023-12-15T23:14:20.922 DEBUG:boto:Token: None 2023-12-15T23:14:20.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069df635d6a6d465e-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.925 DEBUG:boto:b'kskgfn-48obj000000000000000003171000falseobj000000000000000003172023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.926 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.926 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.926 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.926 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.926 DEBUG:boto:Method: GET 2023-12-15T23:14:20.926 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000317 2023-12-15T23:14:20.926 DEBUG:boto:Data: 2023-12-15T23:14:20.926 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.926 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.927 DEBUG:boto:Params: {} 2023-12-15T23:14:20.927 DEBUG:boto:Token: None 2023-12-15T23:14:20.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:20.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:20.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060cceb11d7879317-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.931 DEBUG:boto:b'kskgfn-48obj000000000000000003171000falseobj000000000000000003172023-12-15T23:14:08.761Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:20.931 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2023-12-15T23:14:20.931 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.931 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.931 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.931 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.932 DEBUG:boto:Method: GET 2023-12-15T23:14:20.932 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.932 DEBUG:boto:Data: 2023-12-15T23:14:20.932 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.932 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.932 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.932 DEBUG:boto:Params: {} 2023-12-15T23:14:20.932 DEBUG:boto:Token: None 2023-12-15T23:14:20.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA= 2023-12-15T23:14:20.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA=', 'Content-Length': '0'} 2023-12-15T23:14:20.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007afb3ba51c26b4bb-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.935 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.935 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.935 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.935 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.935 DEBUG:boto:Method: GET 2023-12-15T23:14:20.936 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.936 DEBUG:boto:Data: 2023-12-15T23:14:20.936 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.936 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.936 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.936 DEBUG:boto:Params: {} 2023-12-15T23:14:20.936 DEBUG:boto:Token: None 2023-12-15T23:14:20.936 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.936 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA= 2023-12-15T23:14:20.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA=', 'Content-Length': '0'} 2023-12-15T23:14:20.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002fa0d49511476cd-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.939 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.939 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.939 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.939 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.939 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.939 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.939 DEBUG:boto:Data: 2023-12-15T23:14:20.939 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.940 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.940 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.940 DEBUG:boto:Params: {} 2023-12-15T23:14:20.940 DEBUG:boto:Token: None 2023-12-15T23:14:20.940 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.940 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gP6Y7n3FVmh/DCq+xpkPXOluacg= 2023-12-15T23:14:20.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gP6Y7n3FVmh/DCq+xpkPXOluacg=', 'Content-Length': '0'} 2023-12-15T23:14:20.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078ac70419f4bfd1a-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.942 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.943 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.943 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.943 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.943 DEBUG:boto:Method: HEAD 2023-12-15T23:14:20.943 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.943 DEBUG:boto:Data: 2023-12-15T23:14:20.943 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.943 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.943 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.944 DEBUG:boto:Params: {} 2023-12-15T23:14:20.944 DEBUG:boto:Token: None 2023-12-15T23:14:20.944 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.944 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gP6Y7n3FVmh/DCq+xpkPXOluacg= 2023-12-15T23:14:20.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gP6Y7n3FVmh/DCq+xpkPXOluacg=', 'Content-Length': '0'} 2023-12-15T23:14:20.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d038c939bf663ed6-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2023-12-15T23:14:20.946 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.946 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.947 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.947 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.947 DEBUG:boto:Method: GET 2023-12-15T23:14:20.947 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.947 DEBUG:boto:Data: 2023-12-15T23:14:20.947 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.947 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.947 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.947 DEBUG:boto:Params: {} 2023-12-15T23:14:20.947 DEBUG:boto:Token: None 2023-12-15T23:14:20.948 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.948 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA= 2023-12-15T23:14:20.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA=', 'Content-Length': '0'} 2023-12-15T23:14:20.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000422eef6b26164069-00657cddcc-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.994 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.994 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:20.994 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.994 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.995 DEBUG:boto:Method: GET 2023-12-15T23:14:20.995 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.995 DEBUG:boto:Data: 2023-12-15T23:14:20.995 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.995 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:20.995 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.995 DEBUG:boto:Params: {} 2023-12-15T23:14:20.995 DEBUG:boto:Token: None 2023-12-15T23:14:20.995 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/obj00000000000000000423?versionId=null 2023-12-15T23:14:20.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA= 2023-12-15T23:14:20.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nlfIQmPG1F8lcp0NcC6lvZ3QCmA=', 'Content-Length': '0'} 2023-12-15T23:14:20.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067e4d0619ec7d37e-00657cddcc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:20.998 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:20.998 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:20.998 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:20.998 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:20.998 DEBUG:boto:Method: GET 2023-12-15T23:14:20.998 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:20.999 DEBUG:boto:Data: 2023-12-15T23:14:20.999 DEBUG:boto:Headers: {} 2023-12-15T23:14:20.999 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:20.999 DEBUG:boto:Port: 8000 2023-12-15T23:14:20.999 DEBUG:boto:Params: {} 2023-12-15T23:14:20.999 DEBUG:boto:Token: None 2023-12-15T23:14:20.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:20 GMT /kskgfn-48/ 2023-12-15T23:14:20.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw= 2023-12-15T23:14:21.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xgz6y1H2+dgm/uA/qTT11OsiRyw=', 'Content-Length': '0'} 2023-12-15T23:14:21.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a2b3d5f70e961a9-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.002 DEBUG:boto:b'kskgfn-48obj000000000000000004231000falseobj000000000000000004232023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.003 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.003 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.003 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.003 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.003 DEBUG:boto:Method: GET 2023-12-15T23:14:21.003 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.003 DEBUG:boto:Data: 2023-12-15T23:14:21.003 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.003 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.003 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.004 DEBUG:boto:Params: {} 2023-12-15T23:14:21.004 DEBUG:boto:Token: None 2023-12-15T23:14:21.004 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.008 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9e2f5a75f5284c7-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.049 DEBUG:boto:b'kskgfn-48obj000000000000000004231000falseobj000000000000000004232023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.050 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.050 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.050 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.050 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.050 DEBUG:boto:Data: 2023-12-15T23:14:21.050 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.050 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.051 DEBUG:boto:Params: {} 2023-12-15T23:14:21.051 DEBUG:boto:Token: None 2023-12-15T23:14:21.051 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ueQ6HCTpacpMMPtikJ/EszNSoVc= 2023-12-15T23:14:21.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ueQ6HCTpacpMMPtikJ/EszNSoVc=', 'Content-Length': '0'} 2023-12-15T23:14:21.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009767976dc674cc1-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.053 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.053 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.053 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.053 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.053 DEBUG:boto:Data: 2023-12-15T23:14:21.054 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.054 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.054 DEBUG:boto:Params: {} 2023-12-15T23:14:21.054 DEBUG:boto:Token: None 2023-12-15T23:14:21.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ueQ6HCTpacpMMPtikJ/EszNSoVc= 2023-12-15T23:14:21.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ueQ6HCTpacpMMPtikJ/EszNSoVc=', 'Content-Length': '0'} 2023-12-15T23:14:21.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069f87abec8a4ab81-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2023-12-15T23:14:21.057 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.057 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.057 DEBUG:boto:Method: GET 2023-12-15T23:14:21.057 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.057 DEBUG:boto:Data: 2023-12-15T23:14:21.057 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.057 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.057 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.057 DEBUG:boto:Params: {} 2023-12-15T23:14:21.058 DEBUG:boto:Token: None 2023-12-15T23:14:21.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q5WSyGONtA1Gfk9FeK78ExSZuwk= 2023-12-15T23:14:21.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q5WSyGONtA1Gfk9FeK78ExSZuwk=', 'Content-Length': '0'} 2023-12-15T23:14:21.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005815d51e225f9744-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.060 DEBUG:boto:path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.060 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.060 DEBUG:boto:Method: GET 2023-12-15T23:14:21.060 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.060 DEBUG:boto:Data: 2023-12-15T23:14:21.060 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.061 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.061 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.061 DEBUG:boto:Params: {} 2023-12-15T23:14:21.061 DEBUG:boto:Token: None 2023-12-15T23:14:21.061 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000423 2023-12-15T23:14:21.061 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q5WSyGONtA1Gfk9FeK78ExSZuwk= 2023-12-15T23:14:21.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q5WSyGONtA1Gfk9FeK78ExSZuwk=', 'Content-Length': '0'} 2023-12-15T23:14:21.063 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005721b061ed00824c-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.063 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.064 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.064 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.064 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.064 DEBUG:boto:Method: GET 2023-12-15T23:14:21.064 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.064 DEBUG:boto:Data: 2023-12-15T23:14:21.064 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.064 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.064 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.064 DEBUG:boto:Params: {} 2023-12-15T23:14:21.064 DEBUG:boto:Token: None 2023-12-15T23:14:21.065 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.065 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0a10626d4b42c94-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.068 DEBUG:boto:b'kskgfn-48obj000000000000000004231000falseobj000000000000000004232023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.068 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.068 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.068 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.068 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.068 DEBUG:boto:Method: GET 2023-12-15T23:14:21.069 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000423 2023-12-15T23:14:21.069 DEBUG:boto:Data: 2023-12-15T23:14:21.069 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.069 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.069 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.069 DEBUG:boto:Params: {} 2023-12-15T23:14:21.069 DEBUG:boto:Token: None 2023-12-15T23:14:21.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000060b8a0ea6fb9b8a-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.073 DEBUG:boto:b'kskgfn-48obj000000000000000004231000falseobj000000000000000004232023-12-15T23:14:09.188Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2023-12-15T23:14:21.073 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.073 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.074 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.074 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.074 DEBUG:boto:Method: GET 2023-12-15T23:14:21.074 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.074 DEBUG:boto:Data: 2023-12-15T23:14:21.074 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.074 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.074 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.074 DEBUG:boto:Params: {} 2023-12-15T23:14:21.074 DEBUG:boto:Token: None 2023-12-15T23:14:21.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04= 2023-12-15T23:14:21.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04=', 'Content-Length': '0'} 2023-12-15T23:14:21.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e1c7c6267e30e91-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.077 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.078 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.078 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.078 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.078 DEBUG:boto:Method: GET 2023-12-15T23:14:21.078 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.078 DEBUG:boto:Data: 2023-12-15T23:14:21.078 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.078 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.078 DEBUG:boto:Params: {} 2023-12-15T23:14:21.079 DEBUG:boto:Token: None 2023-12-15T23:14:21.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04= 2023-12-15T23:14:21.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04=', 'Content-Length': '0'} 2023-12-15T23:14:21.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6910fe3611278a8-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.081 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.081 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.082 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.082 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.082 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.082 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.082 DEBUG:boto:Data: 2023-12-15T23:14:21.082 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.082 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.082 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.082 DEBUG:boto:Params: {} 2023-12-15T23:14:21.082 DEBUG:boto:Token: None 2023-12-15T23:14:21.083 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+lJAO+ybDruXut23oe10aRstfO8= 2023-12-15T23:14:21.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+lJAO+ybDruXut23oe10aRstfO8=', 'Content-Length': '0'} 2023-12-15T23:14:21.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060ef8d751aa36e7e-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.086 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.086 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.086 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.086 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.086 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.086 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.086 DEBUG:boto:Data: 2023-12-15T23:14:21.086 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.086 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.086 DEBUG:boto:Params: {} 2023-12-15T23:14:21.087 DEBUG:boto:Token: None 2023-12-15T23:14:21.087 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+lJAO+ybDruXut23oe10aRstfO8= 2023-12-15T23:14:21.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+lJAO+ybDruXut23oe10aRstfO8=', 'Content-Length': '0'} 2023-12-15T23:14:21.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000007f4e8949fd10c2-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2023-12-15T23:14:21.090 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.090 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.090 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.090 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.090 DEBUG:boto:Method: GET 2023-12-15T23:14:21.090 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.090 DEBUG:boto:Data: 2023-12-15T23:14:21.090 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.091 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.091 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.091 DEBUG:boto:Params: {} 2023-12-15T23:14:21.091 DEBUG:boto:Token: None 2023-12-15T23:14:21.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04= 2023-12-15T23:14:21.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04=', 'Content-Length': '0'} 2023-12-15T23:14:21.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014e00cdbaf58a2a8-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.094 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.094 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.094 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.094 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.095 DEBUG:boto:Method: GET 2023-12-15T23:14:21.095 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.095 DEBUG:boto:Data: 2023-12-15T23:14:21.095 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.095 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.095 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.095 DEBUG:boto:Params: {} 2023-12-15T23:14:21.095 DEBUG:boto:Token: None 2023-12-15T23:14:21.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467?versionId=null 2023-12-15T23:14:21.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04= 2023-12-15T23:14:21.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VY2FvQzp6hGBe/uvLF4nQfN+S04=', 'Content-Length': '0'} 2023-12-15T23:14:21.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a864baec38e8592-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.098 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.098 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.098 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.099 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.099 DEBUG:boto:Method: GET 2023-12-15T23:14:21.099 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.099 DEBUG:boto:Data: 2023-12-15T23:14:21.099 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.099 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.099 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.099 DEBUG:boto:Params: {} 2023-12-15T23:14:21.099 DEBUG:boto:Token: None 2023-12-15T23:14:21.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.100 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cef595d17ec75ec-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.102 DEBUG:boto:b'kskgfn-48obj000000000000000004671000falseobj000000000000000004672023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.102 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.103 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.103 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.103 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.103 DEBUG:boto:Method: GET 2023-12-15T23:14:21.103 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.103 DEBUG:boto:Data: 2023-12-15T23:14:21.103 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.103 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.103 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.103 DEBUG:boto:Params: {} 2023-12-15T23:14:21.103 DEBUG:boto:Token: None 2023-12-15T23:14:21.104 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.104 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.107 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7a12987ccda06fb-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.108 DEBUG:boto:b'kskgfn-48obj000000000000000004671000falseobj000000000000000004672023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.108 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.108 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.108 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.108 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.108 DEBUG:boto:Data: 2023-12-15T23:14:21.109 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.109 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.109 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.109 DEBUG:boto:Params: {} 2023-12-15T23:14:21.109 DEBUG:boto:Token: None 2023-12-15T23:14:21.109 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.109 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LK2xJsn8AdK7Yupj5B/dYtjkEZo= 2023-12-15T23:14:21.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LK2xJsn8AdK7Yupj5B/dYtjkEZo=', 'Content-Length': '0'} 2023-12-15T23:14:21.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000140d7f89342a9077-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.111 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.112 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.112 DEBUG:boto:Method: HEAD 2023-12-15T23:14:21.112 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.112 DEBUG:boto:Data: 2023-12-15T23:14:21.112 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.112 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.112 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.112 DEBUG:boto:Params: {} 2023-12-15T23:14:21.112 DEBUG:boto:Token: None 2023-12-15T23:14:21.112 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.113 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LK2xJsn8AdK7Yupj5B/dYtjkEZo= 2023-12-15T23:14:21.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LK2xJsn8AdK7Yupj5B/dYtjkEZo=', 'Content-Length': '0'} 2023-12-15T23:14:21.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000454370a1882280d3-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000467 2023-12-15T23:14:21.115 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.115 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.115 DEBUG:boto:Method: GET 2023-12-15T23:14:21.115 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.115 DEBUG:boto:Data: 2023-12-15T23:14:21.115 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.116 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.116 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.116 DEBUG:boto:Params: {} 2023-12-15T23:14:21.116 DEBUG:boto:Token: None 2023-12-15T23:14:21.116 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.116 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RbfCkgnqNlv1QVw6nb5GSp2PLxY= 2023-12-15T23:14:21.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RbfCkgnqNlv1QVw6nb5GSp2PLxY=', 'Content-Length': '0'} 2023-12-15T23:14:21.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-48:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.19'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7c6073e54f691cb-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.161 DEBUG:boto:path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.162 DEBUG:boto:auth_path=/kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.162 DEBUG:boto:Method: GET 2023-12-15T23:14:21.162 DEBUG:boto:Path: /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.162 DEBUG:boto:Data: 2023-12-15T23:14:21.162 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.162 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.162 DEBUG:boto:Params: {} 2023-12-15T23:14:21.162 DEBUG:boto:Token: None 2023-12-15T23:14:21.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/obj00000000000000000467 2023-12-15T23:14:21.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RbfCkgnqNlv1QVw6nb5GSp2PLxY= 2023-12-15T23:14:21.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RbfCkgnqNlv1QVw6nb5GSp2PLxY=', 'Content-Length': '0'} 2023-12-15T23:14:21.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:14:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000394169fc062554de-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.165 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.165 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.166 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.166 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.166 DEBUG:boto:Method: GET 2023-12-15T23:14:21.166 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.166 DEBUG:boto:Data: 2023-12-15T23:14:21.166 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:14:21.166 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.166 DEBUG:boto:Params: {} 2023-12-15T23:14:21.167 DEBUG:boto:Token: None 2023-12-15T23:14:21.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b6beadaa66158ad-00657cddcd-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.169 DEBUG:boto:b'kskgfn-48obj000000000000000004671000falseobj000000000000000004672023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.170 DEBUG:boto:path=/kskgfn-48/ 2023-12-15T23:14:21.170 DEBUG:boto:auth_path=/kskgfn-48/ 2023-12-15T23:14:21.170 DEBUG:boto:path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.170 DEBUG:boto:auth_path=/kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.170 DEBUG:boto:Method: GET 2023-12-15T23:14:21.170 DEBUG:boto:Path: /kskgfn-48/?prefix=obj00000000000000000467 2023-12-15T23:14:21.170 DEBUG:boto:Data: 2023-12-15T23:14:21.170 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.171 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.171 DEBUG:boto:Params: {} 2023-12-15T23:14:21.171 DEBUG:boto:Token: None 2023-12-15T23:14:21.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-48/ 2023-12-15T23:14:21.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw= 2023-12-15T23:14:21.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H/onuslKIr22DkNZYL7V24AmFBw=', 'Content-Length': '0'} 2023-12-15T23:14:21.175 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011e5e91d52bfcf09-00657cddcd-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.175 DEBUG:boto:b'kskgfn-48obj000000000000000004671000falseobj000000000000000004672023-12-15T23:14:08.688Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:14:21.175 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-48 zones={test-zone2, test-zone1} 2023-12-15T23:14:21.176 INFO:tasks.rgw_multisite_tests:Create several generations of objects, then run bucket sync ... ok 2023-12-15T23:14:21.178 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:14:21.178 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:14:21.178 DEBUG:boto:Method: PUT 2023-12-15T23:14:21.178 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:14:21.178 DEBUG:boto:Data: 2023-12-15T23:14:21.178 DEBUG:boto:Headers: {} 2023-12-15T23:14:21.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:14:21.179 DEBUG:boto:Port: 8000 2023-12-15T23:14:21.179 DEBUG:boto:Params: {} 2023-12-15T23:14:21.179 DEBUG:boto:Token: None 2023-12-15T23:14:21.179 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:14:21 GMT /kskgfn-49/ 2023-12-15T23:14:21.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PIQNhWCKt5wasMlzq5N/aSfYL5k= 2023-12-15T23:14:21.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:14:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PIQNhWCKt5wasMlzq5N/aSfYL5k=', 'Content-Length': '0'} 2023-12-15T23:14:21.200 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f8d0361df7e4d006-00657cddcd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:14:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:14:21.200 DEBUG:rgw_multi.tests:created bucket=kskgfn-49 2023-12-15T23:14:21.200 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:21.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:21.201 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:21.289 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:14:21.306 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702682061.197698_417.1","last_update":"2023-12-15T23:14:21.197698Z"},{"marker":"1_1702680871.620243_86.1","last_update":"2023-12-15T22:54:31.620243Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:14:21.307 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:21.307 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:14:21.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:21.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:21.307 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:21.362 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:21.362 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:21.394 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:21.393+0000 7fd707d2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:21.395 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:21.394+0000 7fd707d2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:21.411 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:21Z"} 2023-12-15T23:14:21.412 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:21Z"} 2023-12-15T23:14:21.412 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:21.412 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:21.412 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:21.412 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:26.413 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:26.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:26.414 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:26.466 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:26.467 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:26.499 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:26.498+0000 7fe5b288c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:26.500 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:26.499+0000 7fe5b288c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:26.517 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:26Z"} 2023-12-15T23:14:26.517 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:26Z"} 2023-12-15T23:14:26.518 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:26.518 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:26.518 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:26.518 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:31.519 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:31.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:31.519 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:31.572 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:31.572 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:31.604 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:31.603+0000 7f44fa937800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:31.605 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:31.604+0000 7f44fa937800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:31.621 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:31Z"} 2023-12-15T23:14:31.622 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:31Z"} 2023-12-15T23:14:31.622 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:31.622 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:31.622 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:31.622 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:36.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:36.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:36.625 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:36.677 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:36.677 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:36.709 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:36.708+0000 7f78c2932800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:36.711 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:36.710+0000 7f78c2932800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:36.728 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:36Z"} 2023-12-15T23:14:36.728 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:36Z"} 2023-12-15T23:14:36.728 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:36.728 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:36.728 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:36.728 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:41.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:41.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:41.730 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:41.783 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:41.783 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:41.815 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:41.814+0000 7fdf17cc0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:41.816 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:41.815+0000 7fdf17cc0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:41.833 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:41Z"} 2023-12-15T23:14:41.833 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:41Z"} 2023-12-15T23:14:41.833 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:41.833 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:41.834 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:41.834 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:46.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:46.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:46.835 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:46.888 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:46.888 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:46.921 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:46.919+0000 7ff6d9c9d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:46.922 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:46.920+0000 7ff6d9c9d800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:46.939 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:46Z"} 2023-12-15T23:14:46.939 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:46Z"} 2023-12-15T23:14:46.939 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:46.940 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:46.940 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:46.940 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:51.941 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:51.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:51.941 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:51.994 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:51.994 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:52.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:52.025+0000 7f7d7e52f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:52.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:52.026+0000 7f7d7e52f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:52.043 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:52Z"} 2023-12-15T23:14:52.043 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:52Z"} 2023-12-15T23:14:52.043 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:52.044 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:52.044 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:52.044 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:14:57.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:57.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:14:57.045 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:14:57.097 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:14:57.098 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:14:57.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:57.129+0000 7ffb6d546800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:57.132 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:14:57.131+0000 7ffb6d546800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:14:57.148 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:57Z"} 2023-12-15T23:14:57.148 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:14:57Z"} 2023-12-15T23:14:57.148 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:14:57.148 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:57.148 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:14:57.149 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:02.150 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:02.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:02.150 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:02.203 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:02.203 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:02.235 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:02.234+0000 7f1ab540f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:02.236 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:02.235+0000 7f1ab540f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:02.252 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:02Z"} 2023-12-15T23:15:02.252 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:02Z"} 2023-12-15T23:15:02.253 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:02.253 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:02.253 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:02.253 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:07.254 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:07.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:07.254 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:07.307 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:07.307 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:07.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:07.338+0000 7f1be6f2f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:07.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:07.340+0000 7f1be6f2f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:07.357 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:07Z"} 2023-12-15T23:15:07.357 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:07Z"} 2023-12-15T23:15:07.358 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:07.358 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:07.358 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:07.358 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:12.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:12.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:12.359 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:12.412 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:12.412 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:12.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:12.443+0000 7f34c131f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:12.446 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:12.445+0000 7f34c131f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:12.463 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:12Z"} 2023-12-15T23:15:12.463 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:12Z"} 2023-12-15T23:15:12.463 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:12.464 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:12.464 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:12.464 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:17.464 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:17.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:17.465 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:17.550 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:17.549+0000 7fe819d25800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:17.551 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:17.550+0000 7fe819d25800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:17.568 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:17Z"} 2023-12-15T23:15:17.568 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:17Z"} 2023-12-15T23:15:17.568 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:17.568 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:17.568 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:17.568 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:22.569 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:22.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:22.570 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:22.623 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:22.623 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:22.656 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:22.655+0000 7fe469b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:22.657 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:22.656+0000 7fe469b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:22.674 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:22Z"} 2023-12-15T23:15:22.674 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:22Z"} 2023-12-15T23:15:22.674 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:22.674 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:22.674 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:22.674 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:27.675 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:27.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:27.676 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:27.729 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:27.730 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:27.762 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:27.760+0000 7efca252c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:27.763 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:27.762+0000 7efca252c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:27.780 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:27Z"} 2023-12-15T23:15:27.780 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:27Z"} 2023-12-15T23:15:27.780 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:27.780 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:27.780 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:27.780 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:32.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:32.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:32.782 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:32.835 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:32.835 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:32.868 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:32.867+0000 7f5543e10800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:32.869 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:32.868+0000 7f5543e10800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:32.885 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:32Z"} 2023-12-15T23:15:32.886 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:32Z"} 2023-12-15T23:15:32.886 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:32.886 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:32.886 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:32.886 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:37.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:37.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:37.918 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:38.003+0000 7fb9dcd2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:38.006 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:38.004+0000 7fb9dcd2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:38.022 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:38Z"} 2023-12-15T23:15:38.023 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:38Z"} 2023-12-15T23:15:38.023 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:38.023 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:38.023 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:38.023 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:43.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:43.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:43.025 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:43.078 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:43.079 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:43.112 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:43.110+0000 7fd6dc922800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:43.113 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:43.111+0000 7fd6dc922800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:43.129 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:43Z"} 2023-12-15T23:15:43.130 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:43Z"} 2023-12-15T23:15:43.130 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:43.130 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:43.130 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:43.130 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:48.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:48.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:48.132 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:48.185 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:48.185 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:48.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:48.218+0000 7f1a6988c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:48.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:48.219+0000 7f1a6988c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:48.237 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:48Z"} 2023-12-15T23:15:48.237 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:48Z"} 2023-12-15T23:15:48.238 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:48.238 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:48.238 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:48.238 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:53.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:53.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:53.239 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:53.292 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:53.292 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:53.325 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:53.324+0000 7f1140fdc800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:53.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:53.325+0000 7f1140fdc800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:53.344 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:53Z"} 2023-12-15T23:15:53.344 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682026.582588_387.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:13:46.582588Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:53Z"} 2023-12-15T23:15:53.345 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682026.582588_387.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:13:46.582588Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:53.345 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:53.345 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682026.582588_387.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:53.345 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682026.582588_387.1 2023-12-15T23:15:58.346 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:58.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:15:58.346 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:15:58.397 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:15:58.398 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:15:58.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:58.428+0000 7f3306126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:58.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:15:58.429+0000 7f3306126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:15:58.446 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682045.527470_389.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:14:05.527470Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:58Z"} 2023-12-15T23:15:58.446 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682045.527470_389.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:14:05.527470Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:15:58Z"} 2023-12-15T23:15:58.446 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682045.527470_389.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:14:05.527470Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:15:58.447 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:58.447 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682045.527470_389.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:15:58.447 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682061.197698_417.1 target=1_1702682045.527470_389.1 2023-12-15T23:16:03.448 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:16:03.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:16:03.448 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:16:03.500 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:16:03.500 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:16:03.532 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:03.531+0000 7f17a7944800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:16:03.533 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:03.532+0000 7f17a7944800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:16:03.549 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682061.197698_417.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:14:21.197698Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:16:03Z"} 2023-12-15T23:16:03.549 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682061.197698_417.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:14:21.197698Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:16:03Z"} 2023-12-15T23:16:03.549 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682061.197698_417.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:14:21.197698Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:16:03.549 DEBUG:rgw_multi.tests:log_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:16:03.550 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682061.197698_417.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:16:03.550 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:16:03.550 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:03.550 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:03.550 DEBUG:boto:Method: HEAD 2023-12-15T23:16:03.550 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:03.550 DEBUG:boto:Data: 2023-12-15T23:16:03.551 DEBUG:boto:Headers: {} 2023-12-15T23:16:03.551 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.551 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.551 DEBUG:boto:Params: {} 2023-12-15T23:16:03.551 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:16:03.551 DEBUG:boto:Token: None 2023-12-15T23:16:03.552 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/ 2023-12-15T23:16:03.552 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI= 2023-12-15T23:16:03.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI=', 'Content-Length': '0'} 2023-12-15T23:16:03.556 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000010918fcac6a8c453-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.557 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:03.557 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:03.557 DEBUG:boto:Method: PUT 2023-12-15T23:16:03.557 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:16:03.557 DEBUG:boto:Data: 2023-12-15T23:16:03.557 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:03.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.558 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.558 DEBUG:boto:Params: {} 2023-12-15T23:16:03.558 DEBUG:boto:Token: None 2023-12-15T23:16:03.558 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/obj11 2023-12-15T23:16:03.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PCN2cYQOx/7bCsv7d1ZA14WPhwc= 2023-12-15T23:16:03.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PCN2cYQOx/7bCsv7d1ZA14WPhwc='} 2023-12-15T23:16:03.566 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000286678159d126373-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.567 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:03.567 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:03.567 DEBUG:boto:Method: HEAD 2023-12-15T23:16:03.567 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:03.567 DEBUG:boto:Data: 2023-12-15T23:16:03.567 DEBUG:boto:Headers: {} 2023-12-15T23:16:03.567 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.567 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.567 DEBUG:boto:Params: {} 2023-12-15T23:16:03.567 DEBUG:boto:Token: None 2023-12-15T23:16:03.568 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/ 2023-12-15T23:16:03.568 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI= 2023-12-15T23:16:03.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI=', 'Content-Length': '0'} 2023-12-15T23:16:03.570 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d802b5ae53c43e00-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.570 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:03.570 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:03.571 DEBUG:boto:Method: PUT 2023-12-15T23:16:03.571 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:16:03.571 DEBUG:boto:Data: 2023-12-15T23:16:03.571 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:03.571 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.571 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.571 DEBUG:boto:Params: {} 2023-12-15T23:16:03.571 DEBUG:boto:Token: None 2023-12-15T23:16:03.571 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/obj22 2023-12-15T23:16:03.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aSNJmSXsV/681iUWAUigZXZJ074= 2023-12-15T23:16:03.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aSNJmSXsV/681iUWAUigZXZJ074='} 2023-12-15T23:16:03.576 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005da47418b8f3c0e0-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.576 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:03.576 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:03.576 DEBUG:boto:Method: HEAD 2023-12-15T23:16:03.576 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:03.576 DEBUG:boto:Data: 2023-12-15T23:16:03.576 DEBUG:boto:Headers: {} 2023-12-15T23:16:03.576 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.576 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.576 DEBUG:boto:Params: {} 2023-12-15T23:16:03.577 DEBUG:boto:Token: None 2023-12-15T23:16:03.577 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/ 2023-12-15T23:16:03.577 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI= 2023-12-15T23:16:03.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI=', 'Content-Length': '0'} 2023-12-15T23:16:03.579 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002bcdec4f09736c1-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.579 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:03.579 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:03.579 DEBUG:boto:Method: PUT 2023-12-15T23:16:03.579 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:16:03.579 DEBUG:boto:Data: 2023-12-15T23:16:03.580 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:03.580 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.580 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.580 DEBUG:boto:Params: {} 2023-12-15T23:16:03.580 DEBUG:boto:Token: None 2023-12-15T23:16:03.580 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/obj33 2023-12-15T23:16:03.580 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T+VLsKfChjYxDqHkDeWII3H34Os= 2023-12-15T23:16:03.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T+VLsKfChjYxDqHkDeWII3H34Os='} 2023-12-15T23:16:03.626 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001dc19f6e2e8e019d-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.626 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:03.626 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:03.626 DEBUG:boto:Method: HEAD 2023-12-15T23:16:03.626 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:03.626 DEBUG:boto:Data: 2023-12-15T23:16:03.626 DEBUG:boto:Headers: {} 2023-12-15T23:16:03.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.626 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.626 DEBUG:boto:Params: {} 2023-12-15T23:16:03.626 DEBUG:boto:Token: None 2023-12-15T23:16:03.627 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/ 2023-12-15T23:16:03.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI= 2023-12-15T23:16:03.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI=', 'Content-Length': '0'} 2023-12-15T23:16:03.629 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5e7caf791e11000-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.629 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:03.629 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:03.629 DEBUG:boto:Method: PUT 2023-12-15T23:16:03.630 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:16:03.630 DEBUG:boto:Data: 2023-12-15T23:16:03.630 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:03.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.630 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.630 DEBUG:boto:Params: {} 2023-12-15T23:16:03.630 DEBUG:boto:Token: None 2023-12-15T23:16:03.630 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/obj44 2023-12-15T23:16:03.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JsfWQPj53/Z8yBl7Bk+Q0YiRNwI= 2023-12-15T23:16:03.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JsfWQPj53/Z8yBl7Bk+Q0YiRNwI='} 2023-12-15T23:16:03.637 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4ba4c28f2d6bb9a-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.637 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:03.637 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:03.637 DEBUG:boto:Method: HEAD 2023-12-15T23:16:03.637 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:03.637 DEBUG:boto:Data: 2023-12-15T23:16:03.637 DEBUG:boto:Headers: {} 2023-12-15T23:16:03.637 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.638 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.638 DEBUG:boto:Params: {} 2023-12-15T23:16:03.638 DEBUG:boto:Token: None 2023-12-15T23:16:03.638 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/ 2023-12-15T23:16:03.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI= 2023-12-15T23:16:03.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9rzYxSFq4qF57zyRdFey5gQFaI=', 'Content-Length': '0'} 2023-12-15T23:16:03.640 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f027070e63e83e29-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.640 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:03.641 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:03.641 DEBUG:boto:Method: PUT 2023-12-15T23:16:03.641 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:16:03.641 DEBUG:boto:Data: 2023-12-15T23:16:03.641 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:03.641 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:03.641 DEBUG:boto:Port: 8000 2023-12-15T23:16:03.641 DEBUG:boto:Params: {} 2023-12-15T23:16:03.641 DEBUG:boto:Token: None 2023-12-15T23:16:03.641 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:03 GMT /kskgfn-49/obj55 2023-12-15T23:16:03.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xe7the0a/pnF/oTpq1ncAkl+Osk= 2023-12-15T23:16:03.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:03 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xe7the0a/pnF/oTpq1ncAkl+Osk='} 2023-12-15T23:16:03.647 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000422eb71789333dc6-00657cde33-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:03.647 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:16:03.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:03.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:03.648 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:16:03.702 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:16:03.702 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:16:03.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:03.737+0000 7f4489d2f800 1 waiting to reach incremental sync.. 2023-12-15T23:16:08.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:08.738+0000 7f4489d2f800 1 waiting to reach incremental sync.. 2023-12-15T23:16:13.517 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:16:13.516+0000 7fca6d65b640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:16:13.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:13.738+0000 7f4489d2f800 1 waiting to reach incremental sync.. 2023-12-15T23:16:18.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:18.740+0000 7f4489d2f800 1 bucket sync caught up with source: 2023-12-15T23:16:18.742 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.38.6, 00000000002.82.6, 00000000002.69.6] 2023-12-15T23:16:18.742 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000001.38.6, 00000000002.82.6, 00000000002.69.6] 2023-12-15T23:16:18.742 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:18.740+0000 7f4489d2f800 0 bucket checkpoint complete 2023-12-15T23:16:18.762 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:16:18.762 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:18.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:18.762 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:16:18.823 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:16:18.824 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:16:18.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:16:18.864+0000 7fa3d8485800 1 bucket sync caught up with source: 2023-12-15T23:16:18.865 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.83.6, 00000000002.95.6, 00000000002.93.6] 2023-12-15T23:16:18.865 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000001.83.6, 00000000002.95.6, 00000000002.93.6] 2023-12-15T23:16:18.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:16:18.864+0000 7fa3d8485800 0 bucket checkpoint complete 2023-12-15T23:16:18.881 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:16:18.881 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.881 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.881 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.881 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:18.882 DEBUG:boto:Data: 2023-12-15T23:16:18.882 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.882 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.882 DEBUG:boto:Params: {} 2023-12-15T23:16:18.882 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:16:18.882 DEBUG:boto:Token: None 2023-12-15T23:16:18.883 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/ 2023-12-15T23:16:18.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ATejAfFUSoQpwLlHMkIU4MIm10o= 2023-12-15T23:16:18.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ATejAfFUSoQpwLlHMkIU4MIm10o=', 'Content-Length': '0'} 2023-12-15T23:16:18.887 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000481cac6e8487b401-00657cde42-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.887 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.887 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.888 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.888 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:18.888 DEBUG:boto:Data: 2023-12-15T23:16:18.888 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.888 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.888 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.888 DEBUG:boto:Params: {} 2023-12-15T23:16:18.888 DEBUG:boto:Token: None 2023-12-15T23:16:18.888 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/ 2023-12-15T23:16:18.888 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ATejAfFUSoQpwLlHMkIU4MIm10o= 2023-12-15T23:16:18.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ATejAfFUSoQpwLlHMkIU4MIm10o=', 'Content-Length': '0'} 2023-12-15T23:16:18.891 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d76400dbef5c4104-00657cde42-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.891 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:16:18.891 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.891 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.891 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.891 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.891 DEBUG:boto:Method: GET 2023-12-15T23:16:18.891 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.891 DEBUG:boto:Data: 2023-12-15T23:16:18.891 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.892 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.892 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.892 DEBUG:boto:Params: {} 2023-12-15T23:16:18.892 DEBUG:boto:Token: None 2023-12-15T23:16:18.892 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/?versions 2023-12-15T23:16:18.892 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo= 2023-12-15T23:16:18.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo=', 'Content-Length': '0'} 2023-12-15T23:16:18.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d54eba86f25c521-00657cde42-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.894 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:16:18.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:16:18.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:16:18.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:16:18.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:16:18.896 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:16:18.896 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.896 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.896 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.896 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.896 DEBUG:boto:Method: GET 2023-12-15T23:16:18.896 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.896 DEBUG:boto:Data: 2023-12-15T23:16:18.896 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.896 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.897 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.897 DEBUG:boto:Params: {} 2023-12-15T23:16:18.897 DEBUG:boto:Token: None 2023-12-15T23:16:18.897 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/?versions 2023-12-15T23:16:18.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo= 2023-12-15T23:16:18.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo=', 'Content-Length': '0'} 2023-12-15T23:16:18.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2ef607c37945e38-00657cde42-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.899 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:16:18.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:16:18.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:16:18.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:16:18.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:16:18.900 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.900 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.900 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.901 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.901 DEBUG:boto:Method: GET 2023-12-15T23:16:18.901 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.901 DEBUG:boto:Data: 2023-12-15T23:16:18.901 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.901 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.901 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.901 DEBUG:boto:Params: {} 2023-12-15T23:16:18.901 DEBUG:boto:Token: None 2023-12-15T23:16:18.901 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/?versions 2023-12-15T23:16:18.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo= 2023-12-15T23:16:18.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo=', 'Content-Length': '0'} 2023-12-15T23:16:18.904 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc59babe1c82e914-00657cde42-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.904 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.904 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.904 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.905 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.905 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.905 DEBUG:boto:Method: GET 2023-12-15T23:16:18.905 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:16:18.905 DEBUG:boto:Data: 2023-12-15T23:16:18.905 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.905 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.905 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.905 DEBUG:boto:Params: {} 2023-12-15T23:16:18.905 DEBUG:boto:Token: None 2023-12-15T23:16:18.906 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/?versions 2023-12-15T23:16:18.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo= 2023-12-15T23:16:18.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9BV8A6jWI8ySsQ2pXjbc8vQz4Lo=', 'Content-Length': '0'} 2023-12-15T23:16:18.908 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dab5267deb2c2cc-00657cde42-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.908 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.908 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:16:18.908 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.909 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.909 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.909 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.909 DEBUG:boto:Method: GET 2023-12-15T23:16:18.909 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.909 DEBUG:boto:Data: 2023-12-15T23:16:18.909 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.909 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.909 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.909 DEBUG:boto:Params: {} 2023-12-15T23:16:18.909 DEBUG:boto:Token: None 2023-12-15T23:16:18.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8= 2023-12-15T23:16:18.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8=', 'Content-Length': '0'} 2023-12-15T23:16:18.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000346b9b18377917a6-00657cde42-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.913 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.913 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.913 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.913 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.913 DEBUG:boto:Method: GET 2023-12-15T23:16:18.913 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.913 DEBUG:boto:Data: 2023-12-15T23:16:18.913 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.913 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.913 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.913 DEBUG:boto:Params: {} 2023-12-15T23:16:18.913 DEBUG:boto:Token: None 2023-12-15T23:16:18.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8= 2023-12-15T23:16:18.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8=', 'Content-Length': '0'} 2023-12-15T23:16:18.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e41a0591407f01f-00657cde42-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.958 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.958 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.958 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.958 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.958 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.958 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.958 DEBUG:boto:Data: 2023-12-15T23:16:18.958 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.958 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.958 DEBUG:boto:Params: {} 2023-12-15T23:16:18.958 DEBUG:boto:Token: None 2023-12-15T23:16:18.959 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bGNfXLWJk2tcc6az1NDE6f3BiEw= 2023-12-15T23:16:18.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bGNfXLWJk2tcc6az1NDE6f3BiEw=', 'Content-Length': '0'} 2023-12-15T23:16:18.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059c007ea3590abf1-00657cde42-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.961 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.961 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.961 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.961 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.961 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.961 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.961 DEBUG:boto:Data: 2023-12-15T23:16:18.961 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.962 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.962 DEBUG:boto:Params: {} 2023-12-15T23:16:18.962 DEBUG:boto:Token: None 2023-12-15T23:16:18.962 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bGNfXLWJk2tcc6az1NDE6f3BiEw= 2023-12-15T23:16:18.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bGNfXLWJk2tcc6az1NDE6f3BiEw=', 'Content-Length': '0'} 2023-12-15T23:16:18.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026f29943e68ec4e7-00657cde42-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:16:18.964 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.965 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.965 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.965 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.965 DEBUG:boto:Method: GET 2023-12-15T23:16:18.965 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.965 DEBUG:boto:Data: 2023-12-15T23:16:18.965 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.965 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.965 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.965 DEBUG:boto:Params: {} 2023-12-15T23:16:18.965 DEBUG:boto:Token: None 2023-12-15T23:16:18.966 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8= 2023-12-15T23:16:18.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8=', 'Content-Length': '0'} 2023-12-15T23:16:18.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aefbea5dfdc299d9-00657cde42-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.968 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.968 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.968 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.968 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.968 DEBUG:boto:Method: GET 2023-12-15T23:16:18.968 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.968 DEBUG:boto:Data: 2023-12-15T23:16:18.969 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.969 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.969 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.969 DEBUG:boto:Params: {} 2023-12-15T23:16:18.969 DEBUG:boto:Token: None 2023-12-15T23:16:18.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:16:18.969 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8= 2023-12-15T23:16:18.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4x9s8o6ZT07jYn3ApYOxCRJibT8=', 'Content-Length': '0'} 2023-12-15T23:16:18.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eed2ce2c68742578-00657cde42-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.971 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.972 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.972 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.972 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.972 DEBUG:boto:Method: GET 2023-12-15T23:16:18.972 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.972 DEBUG:boto:Data: 2023-12-15T23:16:18.972 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.972 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.972 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.972 DEBUG:boto:Params: {} 2023-12-15T23:16:18.972 DEBUG:boto:Token: None 2023-12-15T23:16:18.973 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/ 2023-12-15T23:16:18.973 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L1Ymyi4mJ72nJ0lM8kdN/A0eum4= 2023-12-15T23:16:18.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L1Ymyi4mJ72nJ0lM8kdN/A0eum4=', 'Content-Length': '0'} 2023-12-15T23:16:18.975 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000359cd9d4c2cfb0dc-00657cde42-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.975 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.975 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:18.975 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:18.976 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.976 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.976 DEBUG:boto:Method: GET 2023-12-15T23:16:18.976 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:16:18.976 DEBUG:boto:Data: 2023-12-15T23:16:18.976 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.976 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.976 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.976 DEBUG:boto:Params: {} 2023-12-15T23:16:18.977 DEBUG:boto:Token: None 2023-12-15T23:16:18.977 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/ 2023-12-15T23:16:18.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L1Ymyi4mJ72nJ0lM8kdN/A0eum4= 2023-12-15T23:16:18.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L1Ymyi4mJ72nJ0lM8kdN/A0eum4=', 'Content-Length': '0'} 2023-12-15T23:16:18.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018b027b3c73cf101-00657cde42-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.979 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:18.980 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.980 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.980 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.980 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:16:18.980 DEBUG:boto:Data: 2023-12-15T23:16:18.980 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.980 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.980 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.980 DEBUG:boto:Params: {} 2023-12-15T23:16:18.981 DEBUG:boto:Token: None 2023-12-15T23:16:18.981 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11 2023-12-15T23:16:18.981 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ln10FaLCD2+bYCNvK6z3pz81FZg= 2023-12-15T23:16:18.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ln10FaLCD2+bYCNvK6z3pz81FZg=', 'Content-Length': '0'} 2023-12-15T23:16:18.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfc604a503a17e5d-00657cde42-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.983 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.983 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.983 DEBUG:boto:Method: HEAD 2023-12-15T23:16:18.983 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:16:18.983 DEBUG:boto:Data: 2023-12-15T23:16:18.984 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.984 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:18.984 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.984 DEBUG:boto:Params: {} 2023-12-15T23:16:18.984 DEBUG:boto:Token: None 2023-12-15T23:16:18.984 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11 2023-12-15T23:16:18.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ln10FaLCD2+bYCNvK6z3pz81FZg= 2023-12-15T23:16:18.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ln10FaLCD2+bYCNvK6z3pz81FZg=', 'Content-Length': '0'} 2023-12-15T23:16:18.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e2633f8e3dfa20-00657cde42-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:18.986 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:16:18.986 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:18.986 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:18.987 DEBUG:boto:Method: GET 2023-12-15T23:16:18.987 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:16:18.987 DEBUG:boto:Data: 2023-12-15T23:16:18.987 DEBUG:boto:Headers: {} 2023-12-15T23:16:18.987 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:18.987 DEBUG:boto:Port: 8000 2023-12-15T23:16:18.987 DEBUG:boto:Params: {} 2023-12-15T23:16:18.987 DEBUG:boto:Token: None 2023-12-15T23:16:18.987 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:18 GMT /kskgfn-49/obj11 2023-12-15T23:16:18.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8eXC49kfPGmHyYG404jELD1a9ME= 2023-12-15T23:16:18.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8eXC49kfPGmHyYG404jELD1a9ME=', 'Content-Length': '0'} 2023-12-15T23:16:18.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006aa3c83ca2d08c9d-00657cde42-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.033 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:16:19.034 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:16:19.034 DEBUG:boto:Method: GET 2023-12-15T23:16:19.034 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:16:19.034 DEBUG:boto:Data: 2023-12-15T23:16:19.034 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.034 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.034 DEBUG:boto:Params: {} 2023-12-15T23:16:19.034 DEBUG:boto:Token: None 2023-12-15T23:16:19.034 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj11 2023-12-15T23:16:19.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jv5/ERoFL1B7lKYckdMmVExwp60= 2023-12-15T23:16:19.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jv5/ERoFL1B7lKYckdMmVExwp60=', 'Content-Length': '0'} 2023-12-15T23:16:19.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002216a8d272f0e8f6-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.037 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.037 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.037 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.037 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.038 DEBUG:boto:Method: GET 2023-12-15T23:16:19.038 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.038 DEBUG:boto:Data: 2023-12-15T23:16:19.038 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.038 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.038 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.038 DEBUG:boto:Params: {} 2023-12-15T23:16:19.038 DEBUG:boto:Token: None 2023-12-15T23:16:19.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad253ce71af08e90-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.041 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.041 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.041 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.042 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.042 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.042 DEBUG:boto:Method: GET 2023-12-15T23:16:19.042 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:16:19.042 DEBUG:boto:Data: 2023-12-15T23:16:19.042 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.042 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.042 DEBUG:boto:Params: {} 2023-12-15T23:16:19.042 DEBUG:boto:Token: None 2023-12-15T23:16:19.042 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002797252749b45e2d-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.045 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:16:19.045 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.045 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.045 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.046 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.046 DEBUG:boto:Method: GET 2023-12-15T23:16:19.046 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.046 DEBUG:boto:Data: 2023-12-15T23:16:19.046 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.046 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.046 DEBUG:boto:Params: {} 2023-12-15T23:16:19.046 DEBUG:boto:Token: None 2023-12-15T23:16:19.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o= 2023-12-15T23:16:19.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o=', 'Content-Length': '0'} 2023-12-15T23:16:19.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f35bfef2ec11d700-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.049 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.049 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.049 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.049 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.049 DEBUG:boto:Method: GET 2023-12-15T23:16:19.050 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.050 DEBUG:boto:Data: 2023-12-15T23:16:19.050 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.050 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.050 DEBUG:boto:Params: {} 2023-12-15T23:16:19.050 DEBUG:boto:Token: None 2023-12-15T23:16:19.050 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o= 2023-12-15T23:16:19.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o=', 'Content-Length': '0'} 2023-12-15T23:16:19.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b55cbe736246ef1b-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.052 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.052 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.053 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.053 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.053 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.053 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.053 DEBUG:boto:Data: 2023-12-15T23:16:19.053 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.053 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.053 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.053 DEBUG:boto:Params: {} 2023-12-15T23:16:19.053 DEBUG:boto:Token: None 2023-12-15T23:16:19.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eQTX917/fqkw/Sx2ouPGBGAc2eI= 2023-12-15T23:16:19.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eQTX917/fqkw/Sx2ouPGBGAc2eI=', 'Content-Length': '0'} 2023-12-15T23:16:19.055 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ff8fed82862d687-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.056 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.056 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.056 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.056 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.056 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.056 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.056 DEBUG:boto:Data: 2023-12-15T23:16:19.056 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.056 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.056 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.056 DEBUG:boto:Params: {} 2023-12-15T23:16:19.057 DEBUG:boto:Token: None 2023-12-15T23:16:19.057 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.057 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eQTX917/fqkw/Sx2ouPGBGAc2eI= 2023-12-15T23:16:19.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eQTX917/fqkw/Sx2ouPGBGAc2eI=', 'Content-Length': '0'} 2023-12-15T23:16:19.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3f241733b886fc7-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:16:19.059 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.059 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.059 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.059 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.059 DEBUG:boto:Method: GET 2023-12-15T23:16:19.059 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.059 DEBUG:boto:Data: 2023-12-15T23:16:19.059 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.060 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.060 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.060 DEBUG:boto:Params: {} 2023-12-15T23:16:19.060 DEBUG:boto:Token: None 2023-12-15T23:16:19.060 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o= 2023-12-15T23:16:19.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o=', 'Content-Length': '0'} 2023-12-15T23:16:19.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001508520a56636dc2-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.105 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.106 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.106 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.106 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.106 DEBUG:boto:Method: GET 2023-12-15T23:16:19.106 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.106 DEBUG:boto:Data: 2023-12-15T23:16:19.106 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.106 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.106 DEBUG:boto:Params: {} 2023-12-15T23:16:19.106 DEBUG:boto:Token: None 2023-12-15T23:16:19.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:16:19.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o= 2023-12-15T23:16:19.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IWJcwkS+0YbNhIDyedNfASazC8o=', 'Content-Length': '0'} 2023-12-15T23:16:19.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063ba3ade9ff68e5a-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.109 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.109 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.109 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.109 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.109 DEBUG:boto:Method: GET 2023-12-15T23:16:19.109 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.109 DEBUG:boto:Data: 2023-12-15T23:16:19.109 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.110 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.110 DEBUG:boto:Params: {} 2023-12-15T23:16:19.110 DEBUG:boto:Token: None 2023-12-15T23:16:19.110 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.112 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a34f78ab5fbb1721-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.112 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.113 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.113 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.113 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.113 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.113 DEBUG:boto:Method: GET 2023-12-15T23:16:19.113 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.113 DEBUG:boto:Data: 2023-12-15T23:16:19.113 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.114 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.114 DEBUG:boto:Params: {} 2023-12-15T23:16:19.114 DEBUG:boto:Token: None 2023-12-15T23:16:19.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.116 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000812155e8629add0e-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.116 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.117 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.117 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.117 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.117 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:16:19.117 DEBUG:boto:Data: 2023-12-15T23:16:19.117 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.117 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.117 DEBUG:boto:Params: {} 2023-12-15T23:16:19.118 DEBUG:boto:Token: None 2023-12-15T23:16:19.118 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22 2023-12-15T23:16:19.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+OJyqmWDS1Z/uI4DH7c5dv65WC8= 2023-12-15T23:16:19.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+OJyqmWDS1Z/uI4DH7c5dv65WC8=', 'Content-Length': '0'} 2023-12-15T23:16:19.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b60f291e6272186-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.120 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.120 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.120 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.120 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:16:19.120 DEBUG:boto:Data: 2023-12-15T23:16:19.120 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.120 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.121 DEBUG:boto:Params: {} 2023-12-15T23:16:19.121 DEBUG:boto:Token: None 2023-12-15T23:16:19.121 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22 2023-12-15T23:16:19.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+OJyqmWDS1Z/uI4DH7c5dv65WC8= 2023-12-15T23:16:19.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+OJyqmWDS1Z/uI4DH7c5dv65WC8=', 'Content-Length': '0'} 2023-12-15T23:16:19.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e273c2d8b24b8f1-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:16:19.123 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.123 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.123 DEBUG:boto:Method: GET 2023-12-15T23:16:19.123 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:16:19.123 DEBUG:boto:Data: 2023-12-15T23:16:19.123 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.124 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.124 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.124 DEBUG:boto:Params: {} 2023-12-15T23:16:19.124 DEBUG:boto:Token: None 2023-12-15T23:16:19.124 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22 2023-12-15T23:16:19.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4uNimV/S9MOUvfm5neSht9LFcb8= 2023-12-15T23:16:19.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4uNimV/S9MOUvfm5neSht9LFcb8=', 'Content-Length': '0'} 2023-12-15T23:16:19.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbde18a334d23bc7-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.169 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:16:19.170 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:16:19.170 DEBUG:boto:Method: GET 2023-12-15T23:16:19.170 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:16:19.170 DEBUG:boto:Data: 2023-12-15T23:16:19.170 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.170 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.170 DEBUG:boto:Params: {} 2023-12-15T23:16:19.170 DEBUG:boto:Token: None 2023-12-15T23:16:19.170 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj22 2023-12-15T23:16:19.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4uNimV/S9MOUvfm5neSht9LFcb8= 2023-12-15T23:16:19.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4uNimV/S9MOUvfm5neSht9LFcb8=', 'Content-Length': '0'} 2023-12-15T23:16:19.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc742490a84c3788-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.172 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.172 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.173 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.173 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.173 DEBUG:boto:Method: GET 2023-12-15T23:16:19.173 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.173 DEBUG:boto:Data: 2023-12-15T23:16:19.173 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.173 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.173 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.173 DEBUG:boto:Params: {} 2023-12-15T23:16:19.173 DEBUG:boto:Token: None 2023-12-15T23:16:19.173 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.176 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060fbc4875e598fbe-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.217 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.218 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.218 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.218 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.218 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.218 DEBUG:boto:Method: GET 2023-12-15T23:16:19.218 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:16:19.218 DEBUG:boto:Data: 2023-12-15T23:16:19.218 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.218 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.218 DEBUG:boto:Params: {} 2023-12-15T23:16:19.218 DEBUG:boto:Token: None 2023-12-15T23:16:19.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f42f9f8d746d5402-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.221 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:16:19.222 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.222 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.222 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.222 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.222 DEBUG:boto:Method: GET 2023-12-15T23:16:19.222 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.222 DEBUG:boto:Data: 2023-12-15T23:16:19.222 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.222 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.222 DEBUG:boto:Params: {} 2023-12-15T23:16:19.222 DEBUG:boto:Token: None 2023-12-15T23:16:19.223 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0= 2023-12-15T23:16:19.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0=', 'Content-Length': '0'} 2023-12-15T23:16:19.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000540bbb364c325e0f-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.225 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.225 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.226 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.226 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.226 DEBUG:boto:Method: GET 2023-12-15T23:16:19.226 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.226 DEBUG:boto:Data: 2023-12-15T23:16:19.226 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.226 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.226 DEBUG:boto:Params: {} 2023-12-15T23:16:19.226 DEBUG:boto:Token: None 2023-12-15T23:16:19.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0= 2023-12-15T23:16:19.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0=', 'Content-Length': '0'} 2023-12-15T23:16:19.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002220d6f3ab7d6330-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.229 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.229 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.229 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.229 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.230 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.230 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.230 DEBUG:boto:Data: 2023-12-15T23:16:19.230 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.230 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.230 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.230 DEBUG:boto:Params: {} 2023-12-15T23:16:19.230 DEBUG:boto:Token: None 2023-12-15T23:16:19.230 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nAzsk/cFNaCMQ/vayB3yHG4Ubjw= 2023-12-15T23:16:19.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nAzsk/cFNaCMQ/vayB3yHG4Ubjw=', 'Content-Length': '0'} 2023-12-15T23:16:19.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0572b4374587c05-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.233 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.233 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.233 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.233 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.233 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.234 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.234 DEBUG:boto:Data: 2023-12-15T23:16:19.234 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.234 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.234 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.234 DEBUG:boto:Params: {} 2023-12-15T23:16:19.234 DEBUG:boto:Token: None 2023-12-15T23:16:19.234 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nAzsk/cFNaCMQ/vayB3yHG4Ubjw= 2023-12-15T23:16:19.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nAzsk/cFNaCMQ/vayB3yHG4Ubjw=', 'Content-Length': '0'} 2023-12-15T23:16:19.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e22c1c3bf33655d3-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:16:19.237 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.237 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.237 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.237 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.237 DEBUG:boto:Method: GET 2023-12-15T23:16:19.237 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.237 DEBUG:boto:Data: 2023-12-15T23:16:19.238 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.238 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.238 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.238 DEBUG:boto:Params: {} 2023-12-15T23:16:19.238 DEBUG:boto:Token: None 2023-12-15T23:16:19.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0= 2023-12-15T23:16:19.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0=', 'Content-Length': '0'} 2023-12-15T23:16:19.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000019f320f6ea268a5-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.282 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.282 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.282 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.282 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.282 DEBUG:boto:Method: GET 2023-12-15T23:16:19.282 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.282 DEBUG:boto:Data: 2023-12-15T23:16:19.282 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.282 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.282 DEBUG:boto:Params: {} 2023-12-15T23:16:19.282 DEBUG:boto:Token: None 2023-12-15T23:16:19.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:16:19.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0= 2023-12-15T23:16:19.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qSsjb9Wn1DR3n7X4YXAIB1E/Pv0=', 'Content-Length': '0'} 2023-12-15T23:16:19.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e57412d2b94e97d-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.285 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.286 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.286 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.286 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.286 DEBUG:boto:Method: GET 2023-12-15T23:16:19.286 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.286 DEBUG:boto:Data: 2023-12-15T23:16:19.286 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.286 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.286 DEBUG:boto:Params: {} 2023-12-15T23:16:19.286 DEBUG:boto:Token: None 2023-12-15T23:16:19.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000866b4228bdde2ea0-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.289 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.290 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.290 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.290 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.290 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.290 DEBUG:boto:Method: GET 2023-12-15T23:16:19.290 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.290 DEBUG:boto:Data: 2023-12-15T23:16:19.290 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.290 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.290 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.290 DEBUG:boto:Params: {} 2023-12-15T23:16:19.291 DEBUG:boto:Token: None 2023-12-15T23:16:19.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4d84b2b74ffc3c3-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.293 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.293 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.294 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.294 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.294 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:16:19.294 DEBUG:boto:Data: 2023-12-15T23:16:19.294 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.294 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.294 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.294 DEBUG:boto:Params: {} 2023-12-15T23:16:19.294 DEBUG:boto:Token: None 2023-12-15T23:16:19.294 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33 2023-12-15T23:16:19.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uSYN78opqPc9/fmWWMN+ADVK9lg= 2023-12-15T23:16:19.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uSYN78opqPc9/fmWWMN+ADVK9lg=', 'Content-Length': '0'} 2023-12-15T23:16:19.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b689aa0535cebe84-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.297 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.297 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.297 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.298 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:16:19.298 DEBUG:boto:Data: 2023-12-15T23:16:19.298 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.298 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.298 DEBUG:boto:Params: {} 2023-12-15T23:16:19.298 DEBUG:boto:Token: None 2023-12-15T23:16:19.298 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33 2023-12-15T23:16:19.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uSYN78opqPc9/fmWWMN+ADVK9lg= 2023-12-15T23:16:19.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uSYN78opqPc9/fmWWMN+ADVK9lg=', 'Content-Length': '0'} 2023-12-15T23:16:19.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f52ffdcc6ecd122-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:16:19.301 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.301 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.301 DEBUG:boto:Method: GET 2023-12-15T23:16:19.301 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:16:19.301 DEBUG:boto:Data: 2023-12-15T23:16:19.301 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.301 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.301 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.301 DEBUG:boto:Params: {} 2023-12-15T23:16:19.302 DEBUG:boto:Token: None 2023-12-15T23:16:19.302 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33 2023-12-15T23:16:19.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L76IHTiFMu6wdTn3s5r4g1JwHHM= 2023-12-15T23:16:19.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L76IHTiFMu6wdTn3s5r4g1JwHHM=', 'Content-Length': '0'} 2023-12-15T23:16:19.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000805cf45d2bec8917-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.345 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:16:19.346 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:16:19.346 DEBUG:boto:Method: GET 2023-12-15T23:16:19.346 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:16:19.346 DEBUG:boto:Data: 2023-12-15T23:16:19.346 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.346 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.346 DEBUG:boto:Params: {} 2023-12-15T23:16:19.346 DEBUG:boto:Token: None 2023-12-15T23:16:19.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj33 2023-12-15T23:16:19.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L76IHTiFMu6wdTn3s5r4g1JwHHM= 2023-12-15T23:16:19.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L76IHTiFMu6wdTn3s5r4g1JwHHM=', 'Content-Length': '0'} 2023-12-15T23:16:19.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c14d6f0a803810f-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.349 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.349 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.349 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.349 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.350 DEBUG:boto:Method: GET 2023-12-15T23:16:19.350 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.350 DEBUG:boto:Data: 2023-12-15T23:16:19.350 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.350 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.350 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.350 DEBUG:boto:Params: {} 2023-12-15T23:16:19.350 DEBUG:boto:Token: None 2023-12-15T23:16:19.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000657af3834029657-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.393 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.394 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.394 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.394 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.394 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.394 DEBUG:boto:Method: GET 2023-12-15T23:16:19.394 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:16:19.394 DEBUG:boto:Data: 2023-12-15T23:16:19.395 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.395 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.395 DEBUG:boto:Params: {} 2023-12-15T23:16:19.395 DEBUG:boto:Token: None 2023-12-15T23:16:19.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dee9da8f9a7452c4-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.398 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.398 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:16:19.398 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.398 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.398 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.398 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.398 DEBUG:boto:Method: GET 2023-12-15T23:16:19.398 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.398 DEBUG:boto:Data: 2023-12-15T23:16:19.399 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.399 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.399 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.399 DEBUG:boto:Params: {} 2023-12-15T23:16:19.399 DEBUG:boto:Token: None 2023-12-15T23:16:19.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8= 2023-12-15T23:16:19.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8=', 'Content-Length': '0'} 2023-12-15T23:16:19.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc3bfa05ba4a7811-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.401 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.401 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.402 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.402 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.402 DEBUG:boto:Method: GET 2023-12-15T23:16:19.402 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.402 DEBUG:boto:Data: 2023-12-15T23:16:19.402 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.402 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.402 DEBUG:boto:Params: {} 2023-12-15T23:16:19.402 DEBUG:boto:Token: None 2023-12-15T23:16:19.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8= 2023-12-15T23:16:19.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8=', 'Content-Length': '0'} 2023-12-15T23:16:19.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022776b07924a6d51-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.405 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.405 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.405 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.405 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.405 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.405 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.405 DEBUG:boto:Data: 2023-12-15T23:16:19.405 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.405 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.405 DEBUG:boto:Params: {} 2023-12-15T23:16:19.406 DEBUG:boto:Token: None 2023-12-15T23:16:19.406 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HfkLjyuhOB14QuOH8hz6zhnJvww= 2023-12-15T23:16:19.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HfkLjyuhOB14QuOH8hz6zhnJvww=', 'Content-Length': '0'} 2023-12-15T23:16:19.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c2c1325528b708a-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.408 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.408 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.408 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.408 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.408 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.408 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.408 DEBUG:boto:Data: 2023-12-15T23:16:19.408 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.408 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.409 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.409 DEBUG:boto:Params: {} 2023-12-15T23:16:19.409 DEBUG:boto:Token: None 2023-12-15T23:16:19.409 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.409 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HfkLjyuhOB14QuOH8hz6zhnJvww= 2023-12-15T23:16:19.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HfkLjyuhOB14QuOH8hz6zhnJvww=', 'Content-Length': '0'} 2023-12-15T23:16:19.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c71f39f889b44811-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:16:19.411 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.411 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.411 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.411 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.411 DEBUG:boto:Method: GET 2023-12-15T23:16:19.412 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.412 DEBUG:boto:Data: 2023-12-15T23:16:19.412 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.412 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.412 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.412 DEBUG:boto:Params: {} 2023-12-15T23:16:19.412 DEBUG:boto:Token: None 2023-12-15T23:16:19.412 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8= 2023-12-15T23:16:19.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8=', 'Content-Length': '0'} 2023-12-15T23:16:19.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6c106667a15055d-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.457 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.458 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.458 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.458 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.458 DEBUG:boto:Method: GET 2023-12-15T23:16:19.458 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.458 DEBUG:boto:Data: 2023-12-15T23:16:19.458 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.458 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.458 DEBUG:boto:Params: {} 2023-12-15T23:16:19.458 DEBUG:boto:Token: None 2023-12-15T23:16:19.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:16:19.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8= 2023-12-15T23:16:19.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4HFgETyAfKnkvzZsmZ4JjZhoDK8=', 'Content-Length': '0'} 2023-12-15T23:16:19.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000342c8884debc3e42-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.461 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.461 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.461 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.461 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.461 DEBUG:boto:Method: GET 2023-12-15T23:16:19.461 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.461 DEBUG:boto:Data: 2023-12-15T23:16:19.461 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.461 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.461 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.461 DEBUG:boto:Params: {} 2023-12-15T23:16:19.462 DEBUG:boto:Token: None 2023-12-15T23:16:19.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.464 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c898ac919c73b4ce-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.464 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.465 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.465 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.465 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.465 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.465 DEBUG:boto:Method: GET 2023-12-15T23:16:19.465 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.465 DEBUG:boto:Data: 2023-12-15T23:16:19.465 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.465 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.465 DEBUG:boto:Params: {} 2023-12-15T23:16:19.466 DEBUG:boto:Token: None 2023-12-15T23:16:19.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000003eed3c4596893e-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.468 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.469 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.469 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.469 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.469 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:16:19.469 DEBUG:boto:Data: 2023-12-15T23:16:19.469 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.469 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.470 DEBUG:boto:Params: {} 2023-12-15T23:16:19.470 DEBUG:boto:Token: None 2023-12-15T23:16:19.470 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44 2023-12-15T23:16:19.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m+fua9+pKT3OuzCie3Qkdyn1JwQ= 2023-12-15T23:16:19.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m+fua9+pKT3OuzCie3Qkdyn1JwQ=', 'Content-Length': '0'} 2023-12-15T23:16:19.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9185cd4f88fa636-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.472 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.472 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.472 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.472 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:16:19.472 DEBUG:boto:Data: 2023-12-15T23:16:19.472 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.472 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.472 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.472 DEBUG:boto:Params: {} 2023-12-15T23:16:19.473 DEBUG:boto:Token: None 2023-12-15T23:16:19.473 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44 2023-12-15T23:16:19.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m+fua9+pKT3OuzCie3Qkdyn1JwQ= 2023-12-15T23:16:19.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m+fua9+pKT3OuzCie3Qkdyn1JwQ=', 'Content-Length': '0'} 2023-12-15T23:16:19.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec5bb84c41d5ee8b-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:16:19.475 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.475 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.475 DEBUG:boto:Method: GET 2023-12-15T23:16:19.475 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:16:19.475 DEBUG:boto:Data: 2023-12-15T23:16:19.475 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.476 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.476 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.476 DEBUG:boto:Params: {} 2023-12-15T23:16:19.476 DEBUG:boto:Token: None 2023-12-15T23:16:19.476 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44 2023-12-15T23:16:19.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1xIQqx6c3K9L9pTAg5y5ZH++Lkc= 2023-12-15T23:16:19.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1xIQqx6c3K9L9pTAg5y5ZH++Lkc=', 'Content-Length': '0'} 2023-12-15T23:16:19.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e49ae1f45668e927-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.521 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:16:19.522 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:16:19.522 DEBUG:boto:Method: GET 2023-12-15T23:16:19.522 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:16:19.522 DEBUG:boto:Data: 2023-12-15T23:16:19.522 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.522 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.522 DEBUG:boto:Params: {} 2023-12-15T23:16:19.522 DEBUG:boto:Token: None 2023-12-15T23:16:19.522 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj44 2023-12-15T23:16:19.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1xIQqx6c3K9L9pTAg5y5ZH++Lkc= 2023-12-15T23:16:19.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1xIQqx6c3K9L9pTAg5y5ZH++Lkc=', 'Content-Length': '0'} 2023-12-15T23:16:19.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5b466beb6bbe5b9-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.525 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.525 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.525 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.525 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.525 DEBUG:boto:Method: GET 2023-12-15T23:16:19.525 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.525 DEBUG:boto:Data: 2023-12-15T23:16:19.525 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.525 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.525 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.525 DEBUG:boto:Params: {} 2023-12-15T23:16:19.526 DEBUG:boto:Token: None 2023-12-15T23:16:19.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b922941235e8a7e-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.569 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.570 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.570 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.570 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.570 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.570 DEBUG:boto:Method: GET 2023-12-15T23:16:19.570 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:16:19.570 DEBUG:boto:Data: 2023-12-15T23:16:19.570 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.570 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.571 DEBUG:boto:Params: {} 2023-12-15T23:16:19.571 DEBUG:boto:Token: None 2023-12-15T23:16:19.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.573 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090b04ef68b6156b5-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.573 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:16:19.574 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.574 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.574 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.574 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.574 DEBUG:boto:Method: GET 2023-12-15T23:16:19.574 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.574 DEBUG:boto:Data: 2023-12-15T23:16:19.574 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.575 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.575 DEBUG:boto:Params: {} 2023-12-15T23:16:19.575 DEBUG:boto:Token: None 2023-12-15T23:16:19.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA= 2023-12-15T23:16:19.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA=', 'Content-Length': '0'} 2023-12-15T23:16:19.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1bdff0fba740032-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.578 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.578 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.578 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.578 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.578 DEBUG:boto:Method: GET 2023-12-15T23:16:19.578 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.578 DEBUG:boto:Data: 2023-12-15T23:16:19.578 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.578 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.579 DEBUG:boto:Params: {} 2023-12-15T23:16:19.579 DEBUG:boto:Token: None 2023-12-15T23:16:19.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA= 2023-12-15T23:16:19.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA=', 'Content-Length': '0'} 2023-12-15T23:16:19.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002ac73cb051a9e12-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.625 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.626 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.626 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.626 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.626 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.626 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.626 DEBUG:boto:Data: 2023-12-15T23:16:19.626 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.626 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.626 DEBUG:boto:Params: {} 2023-12-15T23:16:19.626 DEBUG:boto:Token: None 2023-12-15T23:16:19.627 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRkOAlP9GS5oPQy8BjBRb3NIzYY= 2023-12-15T23:16:19.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRkOAlP9GS5oPQy8BjBRb3NIzYY=', 'Content-Length': '0'} 2023-12-15T23:16:19.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b326af0294e65c1-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.629 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.629 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.629 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.629 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.629 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.630 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.630 DEBUG:boto:Data: 2023-12-15T23:16:19.630 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.630 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.630 DEBUG:boto:Params: {} 2023-12-15T23:16:19.630 DEBUG:boto:Token: None 2023-12-15T23:16:19.630 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LRkOAlP9GS5oPQy8BjBRb3NIzYY= 2023-12-15T23:16:19.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LRkOAlP9GS5oPQy8BjBRb3NIzYY=', 'Content-Length': '0'} 2023-12-15T23:16:19.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029b611d039bf4434-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:16:19.633 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.633 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.633 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.633 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.633 DEBUG:boto:Method: GET 2023-12-15T23:16:19.633 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.633 DEBUG:boto:Data: 2023-12-15T23:16:19.633 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.633 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.634 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.634 DEBUG:boto:Params: {} 2023-12-15T23:16:19.634 DEBUG:boto:Token: None 2023-12-15T23:16:19.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.634 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA= 2023-12-15T23:16:19.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA=', 'Content-Length': '0'} 2023-12-15T23:16:19.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ee8f264c37d2c3-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.681 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.682 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.682 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.682 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.682 DEBUG:boto:Method: GET 2023-12-15T23:16:19.682 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.682 DEBUG:boto:Data: 2023-12-15T23:16:19.682 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.682 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.682 DEBUG:boto:Params: {} 2023-12-15T23:16:19.683 DEBUG:boto:Token: None 2023-12-15T23:16:19.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:16:19.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA= 2023-12-15T23:16:19.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p90UXFRTlxoqh9VV56lItrNOfA=', 'Content-Length': '0'} 2023-12-15T23:16:19.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff645e232f3338dd-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.689 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.689 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.689 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.689 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.689 DEBUG:boto:Method: GET 2023-12-15T23:16:19.689 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.689 DEBUG:boto:Data: 2023-12-15T23:16:19.689 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.689 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.689 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.690 DEBUG:boto:Params: {} 2023-12-15T23:16:19.690 DEBUG:boto:Token: None 2023-12-15T23:16:19.690 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b918cb0f31166c08-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.692 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.693 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.693 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.693 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.693 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.693 DEBUG:boto:Method: GET 2023-12-15T23:16:19.693 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.693 DEBUG:boto:Data: 2023-12-15T23:16:19.693 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.693 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.693 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.694 DEBUG:boto:Params: {} 2023-12-15T23:16:19.694 DEBUG:boto:Token: None 2023-12-15T23:16:19.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.694 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015c27bcbcf9184f0-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.696 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.697 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.697 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.697 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.697 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:16:19.697 DEBUG:boto:Data: 2023-12-15T23:16:19.697 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.697 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.697 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.698 DEBUG:boto:Params: {} 2023-12-15T23:16:19.698 DEBUG:boto:Token: None 2023-12-15T23:16:19.698 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55 2023-12-15T23:16:19.698 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W2Tx3W3cjbcww5nAWAbn/EfIfAQ= 2023-12-15T23:16:19.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W2Tx3W3cjbcww5nAWAbn/EfIfAQ=', 'Content-Length': '0'} 2023-12-15T23:16:19.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021d9506a7cf8644d-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.700 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.701 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.701 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.701 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:16:19.701 DEBUG:boto:Data: 2023-12-15T23:16:19.701 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.701 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.701 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.701 DEBUG:boto:Params: {} 2023-12-15T23:16:19.701 DEBUG:boto:Token: None 2023-12-15T23:16:19.701 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55 2023-12-15T23:16:19.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W2Tx3W3cjbcww5nAWAbn/EfIfAQ= 2023-12-15T23:16:19.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W2Tx3W3cjbcww5nAWAbn/EfIfAQ=', 'Content-Length': '0'} 2023-12-15T23:16:19.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbd5e2e0fef02a05-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.704 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:16:19.704 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.704 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.704 DEBUG:boto:Method: GET 2023-12-15T23:16:19.704 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:16:19.704 DEBUG:boto:Data: 2023-12-15T23:16:19.704 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.704 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.705 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.705 DEBUG:boto:Params: {} 2023-12-15T23:16:19.705 DEBUG:boto:Token: None 2023-12-15T23:16:19.705 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55 2023-12-15T23:16:19.705 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D4x6sKiWM12bMAoCGJBHb1+lrhE= 2023-12-15T23:16:19.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D4x6sKiWM12bMAoCGJBHb1+lrhE=', 'Content-Length': '0'} 2023-12-15T23:16:19.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071641c9581928044-00657cde43-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.753 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:16:19.754 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:16:19.754 DEBUG:boto:Method: GET 2023-12-15T23:16:19.754 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:16:19.754 DEBUG:boto:Data: 2023-12-15T23:16:19.754 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.754 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.754 DEBUG:boto:Params: {} 2023-12-15T23:16:19.754 DEBUG:boto:Token: None 2023-12-15T23:16:19.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj55 2023-12-15T23:16:19.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D4x6sKiWM12bMAoCGJBHb1+lrhE= 2023-12-15T23:16:19.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D4x6sKiWM12bMAoCGJBHb1+lrhE=', 'Content-Length': '0'} 2023-12-15T23:16:19.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047be2e450ea7ff21-00657cde43-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.757 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.757 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.757 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.757 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.757 DEBUG:boto:Method: GET 2023-12-15T23:16:19.757 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.757 DEBUG:boto:Data: 2023-12-15T23:16:19.757 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.758 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:16:19.758 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.758 DEBUG:boto:Params: {} 2023-12-15T23:16:19.758 DEBUG:boto:Token: None 2023-12-15T23:16:19.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.760 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4bd27da8a151b3d-00657cde43-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.801 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.802 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.802 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.802 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.802 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.802 DEBUG:boto:Method: GET 2023-12-15T23:16:19.802 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:16:19.802 DEBUG:boto:Data: 2023-12-15T23:16:19.802 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.803 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.803 DEBUG:boto:Params: {} 2023-12-15T23:16:19.803 DEBUG:boto:Token: None 2023-12-15T23:16:19.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA= 2023-12-15T23:16:19.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EkDxsfKphfp47AAKNm8anXwrEAA=', 'Content-Length': '0'} 2023-12-15T23:16:19.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040d409533e117415-00657cde43-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.805 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:16:19.806 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:16:19.806 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:16:19.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:16:19.807 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:16:19.862 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:16:19.863 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:16:19.915 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:16:19.915 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:16:19.920 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 5 2023-12-15T23:16:19.963 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.963 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.963 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.964 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:19.964 DEBUG:boto:Data: 2023-12-15T23:16:19.964 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.964 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.964 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.964 DEBUG:boto:Params: {} 2023-12-15T23:16:19.964 DEBUG:boto:Token: None 2023-12-15T23:16:19.964 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:My1Zbn6espqF2yjsXfDmrWre48U= 2023-12-15T23:16:19.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:My1Zbn6espqF2yjsXfDmrWre48U=', 'Content-Length': '0'} 2023-12-15T23:16:19.967 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007c470f70c9731162-00657cde43-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.967 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:16:19.967 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:16:19.967 DEBUG:boto:Method: PUT 2023-12-15T23:16:19.967 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:16:19.967 DEBUG:boto:Data: 2023-12-15T23:16:19.967 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:19.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.968 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.968 DEBUG:boto:Params: {} 2023-12-15T23:16:19.968 DEBUG:boto:Token: None 2023-12-15T23:16:19.968 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj17 2023-12-15T23:16:19.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PeXjsFM48fas6SiHDPmHvn05DCw= 2023-12-15T23:16:19.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PeXjsFM48fas6SiHDPmHvn05DCw='} 2023-12-15T23:16:19.974 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000003772f01fd81e1c8-00657cde43-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.974 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:19.974 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:19.974 DEBUG:boto:Method: HEAD 2023-12-15T23:16:19.974 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:19.974 DEBUG:boto:Data: 2023-12-15T23:16:19.974 DEBUG:boto:Headers: {} 2023-12-15T23:16:19.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.974 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.975 DEBUG:boto:Params: {} 2023-12-15T23:16:19.975 DEBUG:boto:Token: None 2023-12-15T23:16:19.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/ 2023-12-15T23:16:19.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:My1Zbn6espqF2yjsXfDmrWre48U= 2023-12-15T23:16:19.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:My1Zbn6espqF2yjsXfDmrWre48U=', 'Content-Length': '0'} 2023-12-15T23:16:19.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009a645a1b7b20885b-00657cde43-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:19.977 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:16:19.978 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:16:19.978 DEBUG:boto:Method: PUT 2023-12-15T23:16:19.978 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:16:19.978 DEBUG:boto:Data: 2023-12-15T23:16:19.978 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:19.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:19.978 DEBUG:boto:Port: 8000 2023-12-15T23:16:19.978 DEBUG:boto:Params: {} 2023-12-15T23:16:19.978 DEBUG:boto:Token: None 2023-12-15T23:16:19.978 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:19 GMT /kskgfn-49/obj34 2023-12-15T23:16:19.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1OD3OlsUHpHFcsj9gGpMn+ceoj8= 2023-12-15T23:16:19.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:19 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1OD3OlsUHpHFcsj9gGpMn+ceoj8='} 2023-12-15T23:16:20.022 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000d07206ee9a87c19-00657cde43-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.022 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:20.022 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:20.022 DEBUG:boto:Method: HEAD 2023-12-15T23:16:20.022 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:20.022 DEBUG:boto:Data: 2023-12-15T23:16:20.022 DEBUG:boto:Headers: {} 2023-12-15T23:16:20.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.022 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.023 DEBUG:boto:Params: {} 2023-12-15T23:16:20.023 DEBUG:boto:Token: None 2023-12-15T23:16:20.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/ 2023-12-15T23:16:20.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8= 2023-12-15T23:16:20.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8=', 'Content-Length': '0'} 2023-12-15T23:16:20.025 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031c39caffbba1137-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.025 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:16:20.026 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:16:20.026 DEBUG:boto:Method: PUT 2023-12-15T23:16:20.026 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:16:20.026 DEBUG:boto:Data: 2023-12-15T23:16:20.026 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:20.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.026 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.026 DEBUG:boto:Params: {} 2023-12-15T23:16:20.026 DEBUG:boto:Token: None 2023-12-15T23:16:20.026 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/obj51 2023-12-15T23:16:20.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fdoneqJA6pPKuJ2slua33e/yqAU= 2023-12-15T23:16:20.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fdoneqJA6pPKuJ2slua33e/yqAU='} 2023-12-15T23:16:20.032 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d4d754ccb6a6d511-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.032 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:20.032 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:20.033 DEBUG:boto:Method: HEAD 2023-12-15T23:16:20.033 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:20.033 DEBUG:boto:Data: 2023-12-15T23:16:20.033 DEBUG:boto:Headers: {} 2023-12-15T23:16:20.033 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.033 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.033 DEBUG:boto:Params: {} 2023-12-15T23:16:20.033 DEBUG:boto:Token: None 2023-12-15T23:16:20.033 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/ 2023-12-15T23:16:20.033 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8= 2023-12-15T23:16:20.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8=', 'Content-Length': '0'} 2023-12-15T23:16:20.036 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000003c13ea978ed1eff-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.036 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:16:20.036 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:16:20.036 DEBUG:boto:Method: PUT 2023-12-15T23:16:20.036 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:16:20.036 DEBUG:boto:Data: 2023-12-15T23:16:20.036 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:20.036 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.037 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.037 DEBUG:boto:Params: {} 2023-12-15T23:16:20.037 DEBUG:boto:Token: None 2023-12-15T23:16:20.037 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/obj68 2023-12-15T23:16:20.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GgZS8e1Af8HvW78FxfIpNM5bPlo= 2023-12-15T23:16:20.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GgZS8e1Af8HvW78FxfIpNM5bPlo='} 2023-12-15T23:16:20.043 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ef6227b86cce442-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.043 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:16:20.043 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:16:20.043 DEBUG:boto:Method: HEAD 2023-12-15T23:16:20.043 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:16:20.043 DEBUG:boto:Data: 2023-12-15T23:16:20.043 DEBUG:boto:Headers: {} 2023-12-15T23:16:20.043 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.043 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.043 DEBUG:boto:Params: {} 2023-12-15T23:16:20.044 DEBUG:boto:Token: None 2023-12-15T23:16:20.044 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/ 2023-12-15T23:16:20.044 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8= 2023-12-15T23:16:20.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W7/4+Wp4hxzSjNKn8SvwkJ+n+c8=', 'Content-Length': '0'} 2023-12-15T23:16:20.046 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007918ef8ec3cd30cb-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.046 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:16:20.046 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:16:20.047 DEBUG:boto:Method: PUT 2023-12-15T23:16:20.047 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:16:20.047 DEBUG:boto:Data: 2023-12-15T23:16:20.047 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:16:20.047 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:16:20.047 DEBUG:boto:Port: 8000 2023-12-15T23:16:20.047 DEBUG:boto:Params: {} 2023-12-15T23:16:20.047 DEBUG:boto:Token: None 2023-12-15T23:16:20.047 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:16:20 GMT /kskgfn-49/obj85 2023-12-15T23:16:20.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MC5mOmru5R6lqT0oxwp3/APsa70= 2023-12-15T23:16:20.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:16:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MC5mOmru5R6lqT0oxwp3/APsa70='} 2023-12-15T23:16:20.094 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b421af694e83bf3-00657cde44-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:16:20.094 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:16:20.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:20.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:16:20.094 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:16:20.154 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:16:20.154 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:16:20.193 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:20.192+0000 7fc7e2135800 1 waiting to reach latest gen 1, on 0.. 2023-12-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:25.193+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:30.196 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:30.194+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:30.196 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:30.197 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:35.195+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:35.198 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:35.198 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:40.199 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:40.197+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:40.199 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:40.199 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:45.200 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:45.199+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:45.200 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:45.201 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:50.202 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:50.200+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:50.202 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:50.202 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:16:55.203 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:16:55.202+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:16:55.203 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:16:55.204 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:00.204 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:00.203+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:00.205 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:17:00.205 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:05.206 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:05.204+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:05.206 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:17:05.206 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:10.207 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:10.206+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:10.207 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:17:10.208 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:15.209 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:15.207+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:15.209 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:17:15.209 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:20.210 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:20.209+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:20.210 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, , , , ] 2023-12-15T23:17:20.210 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:25.212 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:25.209+0000 7fc7e2135800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:25.212 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:25.212 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:30.213 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:30.211+0000 7fc7e2135800 1 bucket sync caught up with source: 2023-12-15T23:17:30.213 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:30.213 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000001.86.6, , , , , , 00000000001.96.6, , 00000000001.54.6, , , , 00000000001.56.6, 00000000001.41.6, , , ] 2023-12-15T23:17:30.213 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:30.211+0000 7fc7e2135800 0 bucket checkpoint complete 2023-12-15T23:17:30.232 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:17:30.232 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:17:30.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:17:30.233 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:17:30.295 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:17:30.295 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:17:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:17:30.334+0000 7f6305340800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:30.335 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.140.6, 00000000001.126.6, , , 00000000001.150.6, , , 00000000001.83.6, 00000000002.95.6, 00000000003.99.6] 2023-12-15T23:17:30.335 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.140.6, 00000000001.126.6, , , 00000000001.150.6, , , 00000000001.83.6, 00000000003.101.6, 00000000003.99.6] 2023-12-15T23:17:35.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:17:35.335+0000 7f6305340800 1 bucket sync caught up with source: 2023-12-15T23:17:35.336 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000001.140.6, 00000000001.126.6, , , 00000000001.150.6, , , 00000000001.83.6, 00000000003.101.6, 00000000003.99.6] 2023-12-15T23:17:35.337 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000001.140.6, 00000000001.126.6, , , 00000000001.150.6, , , 00000000001.83.6, 00000000003.101.6, 00000000003.99.6] 2023-12-15T23:17:35.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:17:35.335+0000 7f6305340800 0 bucket checkpoint complete 2023-12-15T23:17:35.355 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:17:35.355 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.355 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.356 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.356 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:35.356 DEBUG:boto:Data: 2023-12-15T23:17:35.356 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.356 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.356 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.356 DEBUG:boto:Params: {} 2023-12-15T23:17:35.357 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:17:35.357 DEBUG:boto:Token: None 2023-12-15T23:17:35.357 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e+9ELkK85F0SWJxJvns0glEdm+Y= 2023-12-15T23:17:35.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e+9ELkK85F0SWJxJvns0glEdm+Y=', 'Content-Length': '0'} 2023-12-15T23:17:35.362 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000045aa220ab29a8496-00657cde8f-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.362 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.362 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.362 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.362 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:35.363 DEBUG:boto:Data: 2023-12-15T23:17:35.363 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.363 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.363 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.363 DEBUG:boto:Params: {} 2023-12-15T23:17:35.363 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:17:35.363 DEBUG:boto:Token: None 2023-12-15T23:17:35.363 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e+9ELkK85F0SWJxJvns0glEdm+Y= 2023-12-15T23:17:35.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e+9ELkK85F0SWJxJvns0glEdm+Y=', 'Content-Length': '0'} 2023-12-15T23:17:35.367 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e42d073e7fbccfc0-00657cde8f-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.367 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:17:35.368 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.368 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.368 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.368 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.368 DEBUG:boto:Method: GET 2023-12-15T23:17:35.368 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.368 DEBUG:boto:Data: 2023-12-15T23:17:35.368 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.368 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.368 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.369 DEBUG:boto:Params: {} 2023-12-15T23:17:35.369 DEBUG:boto:Token: None 2023-12-15T23:17:35.369 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/?versions 2023-12-15T23:17:35.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw= 2023-12-15T23:17:35.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw=', 'Content-Length': '0'} 2023-12-15T23:17:35.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ed4f8c464ddde2b-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.372 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.373 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:17:35.373 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:17:35.373 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:17:35.373 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:17:35.374 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:17:35.374 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.374 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.374 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.374 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.374 DEBUG:boto:Method: GET 2023-12-15T23:17:35.375 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.375 DEBUG:boto:Data: 2023-12-15T23:17:35.375 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.375 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.375 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.375 DEBUG:boto:Params: {} 2023-12-15T23:17:35.375 DEBUG:boto:Token: None 2023-12-15T23:17:35.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/?versions 2023-12-15T23:17:35.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw= 2023-12-15T23:17:35.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw=', 'Content-Length': '0'} 2023-12-15T23:17:35.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d436795f3802036-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.378 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:17:35.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:17:35.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:17:35.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:17:35.380 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.380 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.380 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.380 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.380 DEBUG:boto:Method: GET 2023-12-15T23:17:35.380 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.380 DEBUG:boto:Data: 2023-12-15T23:17:35.380 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.381 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.381 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.381 DEBUG:boto:Params: {} 2023-12-15T23:17:35.381 DEBUG:boto:Token: None 2023-12-15T23:17:35.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/?versions 2023-12-15T23:17:35.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw= 2023-12-15T23:17:35.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw=', 'Content-Length': '0'} 2023-12-15T23:17:35.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0c927bf097efcbc-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.384 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.385 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.385 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.385 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.385 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.385 DEBUG:boto:Method: GET 2023-12-15T23:17:35.385 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:17:35.385 DEBUG:boto:Data: 2023-12-15T23:17:35.385 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.386 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.386 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.386 DEBUG:boto:Params: {} 2023-12-15T23:17:35.386 DEBUG:boto:Token: None 2023-12-15T23:17:35.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/?versions 2023-12-15T23:17:35.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw= 2023-12-15T23:17:35.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qsc9UajJ+TTG5g60rUnZoB3OjHw=', 'Content-Length': '0'} 2023-12-15T23:17:35.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032ff206ccb57de1d-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.389 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:17:35.390 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.390 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.390 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.390 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.390 DEBUG:boto:Method: GET 2023-12-15T23:17:35.390 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.390 DEBUG:boto:Data: 2023-12-15T23:17:35.390 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.391 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.391 DEBUG:boto:Params: {} 2023-12-15T23:17:35.391 DEBUG:boto:Token: None 2023-12-15T23:17:35.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4= 2023-12-15T23:17:35.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4=', 'Content-Length': '0'} 2023-12-15T23:17:35.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b9546f11c74d6b9-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.394 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.394 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.394 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.394 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.394 DEBUG:boto:Method: GET 2023-12-15T23:17:35.394 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.394 DEBUG:boto:Data: 2023-12-15T23:17:35.394 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.395 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.395 DEBUG:boto:Params: {} 2023-12-15T23:17:35.395 DEBUG:boto:Token: None 2023-12-15T23:17:35.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4= 2023-12-15T23:17:35.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4=', 'Content-Length': '0'} 2023-12-15T23:17:35.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb15428bd536a3bd-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.397 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.398 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.398 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.398 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.398 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.398 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.398 DEBUG:boto:Data: 2023-12-15T23:17:35.398 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.398 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.398 DEBUG:boto:Params: {} 2023-12-15T23:17:35.398 DEBUG:boto:Token: None 2023-12-15T23:17:35.399 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tBxwsQbZVDM3GBl9EicdzkBI3wo= 2023-12-15T23:17:35.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tBxwsQbZVDM3GBl9EicdzkBI3wo=', 'Content-Length': '0'} 2023-12-15T23:17:35.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eef4b3ed4ad25265-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.401 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.401 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.401 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.402 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.402 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.402 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.402 DEBUG:boto:Data: 2023-12-15T23:17:35.402 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.402 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.402 DEBUG:boto:Params: {} 2023-12-15T23:17:35.402 DEBUG:boto:Token: None 2023-12-15T23:17:35.403 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tBxwsQbZVDM3GBl9EicdzkBI3wo= 2023-12-15T23:17:35.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tBxwsQbZVDM3GBl9EicdzkBI3wo=', 'Content-Length': '0'} 2023-12-15T23:17:35.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2cd3c61953d1375-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:17:35.405 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.405 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.405 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.405 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.405 DEBUG:boto:Method: GET 2023-12-15T23:17:35.406 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.406 DEBUG:boto:Data: 2023-12-15T23:17:35.406 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.406 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.406 DEBUG:boto:Params: {} 2023-12-15T23:17:35.406 DEBUG:boto:Token: None 2023-12-15T23:17:35.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4= 2023-12-15T23:17:35.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4=', 'Content-Length': '0'} 2023-12-15T23:17:35.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039fad6df9e777b85-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.449 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.450 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.450 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.450 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.450 DEBUG:boto:Method: GET 2023-12-15T23:17:35.450 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.450 DEBUG:boto:Data: 2023-12-15T23:17:35.450 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.450 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.450 DEBUG:boto:Params: {} 2023-12-15T23:17:35.450 DEBUG:boto:Token: None 2023-12-15T23:17:35.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:17:35.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4= 2023-12-15T23:17:35.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VfzkLenqhuYRij0QytPH5dlUyF4=', 'Content-Length': '0'} 2023-12-15T23:17:35.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0c6dbad9be8af4a-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.453 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.453 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.454 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.454 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.454 DEBUG:boto:Method: GET 2023-12-15T23:17:35.454 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.454 DEBUG:boto:Data: 2023-12-15T23:17:35.454 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.454 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.454 DEBUG:boto:Params: {} 2023-12-15T23:17:35.454 DEBUG:boto:Token: None 2023-12-15T23:17:35.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.457 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d50907f3b3b1938a-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.497 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.498 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.498 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.498 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.498 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.498 DEBUG:boto:Method: GET 2023-12-15T23:17:35.498 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.498 DEBUG:boto:Data: 2023-12-15T23:17:35.498 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.499 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.499 DEBUG:boto:Params: {} 2023-12-15T23:17:35.499 DEBUG:boto:Token: None 2023-12-15T23:17:35.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.502 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090154bee8c055dc6-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.502 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.502 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.502 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.502 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.502 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:17:35.503 DEBUG:boto:Data: 2023-12-15T23:17:35.503 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.503 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.503 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.503 DEBUG:boto:Params: {} 2023-12-15T23:17:35.503 DEBUG:boto:Token: None 2023-12-15T23:17:35.503 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11 2023-12-15T23:17:35.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MY8AjuFzNVTRN2RGMamgStsdCoA= 2023-12-15T23:17:35.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MY8AjuFzNVTRN2RGMamgStsdCoA=', 'Content-Length': '0'} 2023-12-15T23:17:35.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d5c1dd77fe63625-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.506 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.506 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.506 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.506 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:17:35.506 DEBUG:boto:Data: 2023-12-15T23:17:35.506 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.506 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.506 DEBUG:boto:Params: {} 2023-12-15T23:17:35.506 DEBUG:boto:Token: None 2023-12-15T23:17:35.507 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11 2023-12-15T23:17:35.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MY8AjuFzNVTRN2RGMamgStsdCoA= 2023-12-15T23:17:35.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MY8AjuFzNVTRN2RGMamgStsdCoA=', 'Content-Length': '0'} 2023-12-15T23:17:35.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005598667cba80f587-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:17:35.509 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.509 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.509 DEBUG:boto:Method: GET 2023-12-15T23:17:35.509 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:17:35.509 DEBUG:boto:Data: 2023-12-15T23:17:35.509 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.510 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.510 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.510 DEBUG:boto:Params: {} 2023-12-15T23:17:35.510 DEBUG:boto:Token: None 2023-12-15T23:17:35.510 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11 2023-12-15T23:17:35.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XmkbedAySBNPi6paF6eHqEWJ8hU= 2023-12-15T23:17:35.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XmkbedAySBNPi6paF6eHqEWJ8hU=', 'Content-Length': '0'} 2023-12-15T23:17:35.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f24143956c89ce5-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.558 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:17:35.558 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:17:35.558 DEBUG:boto:Method: GET 2023-12-15T23:17:35.558 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:17:35.558 DEBUG:boto:Data: 2023-12-15T23:17:35.558 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.558 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.558 DEBUG:boto:Params: {} 2023-12-15T23:17:35.558 DEBUG:boto:Token: None 2023-12-15T23:17:35.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj11 2023-12-15T23:17:35.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XmkbedAySBNPi6paF6eHqEWJ8hU= 2023-12-15T23:17:35.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XmkbedAySBNPi6paF6eHqEWJ8hU=', 'Content-Length': '0'} 2023-12-15T23:17:35.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093ab5510dc10aced-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.561 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.561 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.561 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.561 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.562 DEBUG:boto:Method: GET 2023-12-15T23:17:35.562 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.562 DEBUG:boto:Data: 2023-12-15T23:17:35.562 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.562 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.562 DEBUG:boto:Params: {} 2023-12-15T23:17:35.562 DEBUG:boto:Token: None 2023-12-15T23:17:35.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a615e82e38275ed8-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.565 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.565 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.565 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.566 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.566 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.566 DEBUG:boto:Method: GET 2023-12-15T23:17:35.566 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:17:35.566 DEBUG:boto:Data: 2023-12-15T23:17:35.566 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.566 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.566 DEBUG:boto:Params: {} 2023-12-15T23:17:35.566 DEBUG:boto:Token: None 2023-12-15T23:17:35.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fba34c0bcd21f3b8-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.569 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.570 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:17:35.570 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.570 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.570 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.570 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.570 DEBUG:boto:Method: GET 2023-12-15T23:17:35.570 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.571 DEBUG:boto:Data: 2023-12-15T23:17:35.571 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.571 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.571 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.571 DEBUG:boto:Params: {} 2023-12-15T23:17:35.571 DEBUG:boto:Token: None 2023-12-15T23:17:35.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI= 2023-12-15T23:17:35.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI=', 'Content-Length': '0'} 2023-12-15T23:17:35.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a638bc3b14d2661-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.573 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.574 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.574 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.574 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.574 DEBUG:boto:Method: GET 2023-12-15T23:17:35.574 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.574 DEBUG:boto:Data: 2023-12-15T23:17:35.574 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.574 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.574 DEBUG:boto:Params: {} 2023-12-15T23:17:35.575 DEBUG:boto:Token: None 2023-12-15T23:17:35.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI= 2023-12-15T23:17:35.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI=', 'Content-Length': '0'} 2023-12-15T23:17:35.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ac915d7444f0aec-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.617 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.618 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.618 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.618 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.618 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.618 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.618 DEBUG:boto:Data: 2023-12-15T23:17:35.618 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.618 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.618 DEBUG:boto:Params: {} 2023-12-15T23:17:35.619 DEBUG:boto:Token: None 2023-12-15T23:17:35.619 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KB6SCdAU//bmBMGEgD5kDJEwh/o= 2023-12-15T23:17:35.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KB6SCdAU//bmBMGEgD5kDJEwh/o=', 'Content-Length': '0'} 2023-12-15T23:17:35.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000061d7151557f7c55-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.621 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.621 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.621 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.621 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.621 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.621 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.621 DEBUG:boto:Data: 2023-12-15T23:17:35.622 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.622 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.622 DEBUG:boto:Params: {} 2023-12-15T23:17:35.622 DEBUG:boto:Token: None 2023-12-15T23:17:35.622 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KB6SCdAU//bmBMGEgD5kDJEwh/o= 2023-12-15T23:17:35.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KB6SCdAU//bmBMGEgD5kDJEwh/o=', 'Content-Length': '0'} 2023-12-15T23:17:35.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e78568f03146e4fd-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:17:35.625 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.625 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.625 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.625 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.625 DEBUG:boto:Method: GET 2023-12-15T23:17:35.625 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.625 DEBUG:boto:Data: 2023-12-15T23:17:35.625 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.625 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.625 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.626 DEBUG:boto:Params: {} 2023-12-15T23:17:35.626 DEBUG:boto:Token: None 2023-12-15T23:17:35.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI= 2023-12-15T23:17:35.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI=', 'Content-Length': '0'} 2023-12-15T23:17:35.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a31b4f2c1f7663b-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.669 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.670 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.670 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.670 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.670 DEBUG:boto:Method: GET 2023-12-15T23:17:35.670 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.670 DEBUG:boto:Data: 2023-12-15T23:17:35.670 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.670 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.670 DEBUG:boto:Params: {} 2023-12-15T23:17:35.671 DEBUG:boto:Token: None 2023-12-15T23:17:35.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:17:35.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI= 2023-12-15T23:17:35.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n6Czfa4jiGjvfzALzGgFzNYBBeI=', 'Content-Length': '0'} 2023-12-15T23:17:35.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075979ccf131301b2-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.673 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.673 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.673 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.673 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.673 DEBUG:boto:Method: GET 2023-12-15T23:17:35.674 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.674 DEBUG:boto:Data: 2023-12-15T23:17:35.674 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.674 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.674 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.674 DEBUG:boto:Params: {} 2023-12-15T23:17:35.674 DEBUG:boto:Token: None 2023-12-15T23:17:35.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.676 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdee2755c4fb30de-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.717 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.718 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.718 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.718 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.718 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.718 DEBUG:boto:Method: GET 2023-12-15T23:17:35.718 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.718 DEBUG:boto:Data: 2023-12-15T23:17:35.718 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.719 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.719 DEBUG:boto:Params: {} 2023-12-15T23:17:35.719 DEBUG:boto:Token: None 2023-12-15T23:17:35.719 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.722 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec5ef7b06c36af1c-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.722 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.722 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.722 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.722 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.723 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:17:35.723 DEBUG:boto:Data: 2023-12-15T23:17:35.723 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.723 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.723 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.723 DEBUG:boto:Params: {} 2023-12-15T23:17:35.723 DEBUG:boto:Token: None 2023-12-15T23:17:35.723 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17 2023-12-15T23:17:35.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+eA5lY6YOY9La+0/FZBDzX1Tg8s= 2023-12-15T23:17:35.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+eA5lY6YOY9La+0/FZBDzX1Tg8s=', 'Content-Length': '0'} 2023-12-15T23:17:35.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072fe95d984475b91-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.726 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.726 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.726 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.726 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:17:35.726 DEBUG:boto:Data: 2023-12-15T23:17:35.726 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.726 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.726 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.726 DEBUG:boto:Params: {} 2023-12-15T23:17:35.727 DEBUG:boto:Token: None 2023-12-15T23:17:35.727 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17 2023-12-15T23:17:35.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+eA5lY6YOY9La+0/FZBDzX1Tg8s= 2023-12-15T23:17:35.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+eA5lY6YOY9La+0/FZBDzX1Tg8s=', 'Content-Length': '0'} 2023-12-15T23:17:35.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b40590d1e2ba188c-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:17:35.729 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.729 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.729 DEBUG:boto:Method: GET 2023-12-15T23:17:35.729 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:17:35.729 DEBUG:boto:Data: 2023-12-15T23:17:35.730 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.730 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.730 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.730 DEBUG:boto:Params: {} 2023-12-15T23:17:35.730 DEBUG:boto:Token: None 2023-12-15T23:17:35.730 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17 2023-12-15T23:17:35.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0NUgDP87+MavztjNk95uE0EF+ng= 2023-12-15T23:17:35.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0NUgDP87+MavztjNk95uE0EF+ng=', 'Content-Length': '0'} 2023-12-15T23:17:35.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f854bf452667428-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.773 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:17:35.774 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:17:35.774 DEBUG:boto:Method: GET 2023-12-15T23:17:35.774 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:17:35.774 DEBUG:boto:Data: 2023-12-15T23:17:35.774 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.774 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.774 DEBUG:boto:Params: {} 2023-12-15T23:17:35.774 DEBUG:boto:Token: None 2023-12-15T23:17:35.774 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj17 2023-12-15T23:17:35.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0NUgDP87+MavztjNk95uE0EF+ng= 2023-12-15T23:17:35.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0NUgDP87+MavztjNk95uE0EF+ng=', 'Content-Length': '0'} 2023-12-15T23:17:35.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006011a9a4ceec652-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.777 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.777 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.777 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.777 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.777 DEBUG:boto:Method: GET 2023-12-15T23:17:35.778 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.778 DEBUG:boto:Data: 2023-12-15T23:17:35.778 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.778 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.778 DEBUG:boto:Params: {} 2023-12-15T23:17:35.778 DEBUG:boto:Token: None 2023-12-15T23:17:35.778 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fbe013c878e925f3-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.821 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.822 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.822 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.822 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.822 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.822 DEBUG:boto:Method: GET 2023-12-15T23:17:35.822 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:17:35.822 DEBUG:boto:Data: 2023-12-15T23:17:35.822 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.822 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.823 DEBUG:boto:Params: {} 2023-12-15T23:17:35.823 DEBUG:boto:Token: None 2023-12-15T23:17:35.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ceab205f4f0b9e95-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.825 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:17:35.826 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.826 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.826 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.826 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.826 DEBUG:boto:Method: GET 2023-12-15T23:17:35.826 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.826 DEBUG:boto:Data: 2023-12-15T23:17:35.826 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.827 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.827 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.827 DEBUG:boto:Params: {} 2023-12-15T23:17:35.827 DEBUG:boto:Token: None 2023-12-15T23:17:35.827 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.827 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls= 2023-12-15T23:17:35.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls=', 'Content-Length': '0'} 2023-12-15T23:17:35.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9d33114492d7fd1-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.829 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.829 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.829 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.830 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.830 DEBUG:boto:Method: GET 2023-12-15T23:17:35.830 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.830 DEBUG:boto:Data: 2023-12-15T23:17:35.830 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.830 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.830 DEBUG:boto:Params: {} 2023-12-15T23:17:35.830 DEBUG:boto:Token: None 2023-12-15T23:17:35.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls= 2023-12-15T23:17:35.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls=', 'Content-Length': '0'} 2023-12-15T23:17:35.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ed1892d01c60c0b-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.874 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.874 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.874 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.874 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.874 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.874 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.874 DEBUG:boto:Data: 2023-12-15T23:17:35.874 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.874 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.874 DEBUG:boto:Params: {} 2023-12-15T23:17:35.875 DEBUG:boto:Token: None 2023-12-15T23:17:35.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cwwrV+8AvS44NzpS11YIk4O4mI= 2023-12-15T23:17:35.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cwwrV+8AvS44NzpS11YIk4O4mI=', 'Content-Length': '0'} 2023-12-15T23:17:35.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092a809c761964c24-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.877 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.877 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.877 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.877 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.877 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.878 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.878 DEBUG:boto:Data: 2023-12-15T23:17:35.878 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.878 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.878 DEBUG:boto:Params: {} 2023-12-15T23:17:35.878 DEBUG:boto:Token: None 2023-12-15T23:17:35.878 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1cwwrV+8AvS44NzpS11YIk4O4mI= 2023-12-15T23:17:35.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1cwwrV+8AvS44NzpS11YIk4O4mI=', 'Content-Length': '0'} 2023-12-15T23:17:35.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007378cad1b0b593be-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:17:35.881 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.881 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.881 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.881 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.881 DEBUG:boto:Method: GET 2023-12-15T23:17:35.881 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.881 DEBUG:boto:Data: 2023-12-15T23:17:35.881 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.881 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.882 DEBUG:boto:Params: {} 2023-12-15T23:17:35.882 DEBUG:boto:Token: None 2023-12-15T23:17:35.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls= 2023-12-15T23:17:35.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls=', 'Content-Length': '0'} 2023-12-15T23:17:35.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f16a627e392abc2f-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.925 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.926 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.926 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.926 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.926 DEBUG:boto:Method: GET 2023-12-15T23:17:35.926 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.926 DEBUG:boto:Data: 2023-12-15T23:17:35.926 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.926 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.926 DEBUG:boto:Params: {} 2023-12-15T23:17:35.927 DEBUG:boto:Token: None 2023-12-15T23:17:35.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:17:35.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls= 2023-12-15T23:17:35.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1nPYQVwvVj/s5gPyp6XLGtQ7xls=', 'Content-Length': '0'} 2023-12-15T23:17:35.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099e0f41317eeafdf-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.929 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.929 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.929 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.929 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.930 DEBUG:boto:Method: GET 2023-12-15T23:17:35.930 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.930 DEBUG:boto:Data: 2023-12-15T23:17:35.930 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.930 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.930 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.930 DEBUG:boto:Params: {} 2023-12-15T23:17:35.930 DEBUG:boto:Token: None 2023-12-15T23:17:35.930 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008525e83662cb15b9-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.933 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.934 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.934 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.934 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.934 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.934 DEBUG:boto:Method: GET 2023-12-15T23:17:35.934 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.934 DEBUG:boto:Data: 2023-12-15T23:17:35.934 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.935 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.935 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.935 DEBUG:boto:Params: {} 2023-12-15T23:17:35.935 DEBUG:boto:Token: None 2023-12-15T23:17:35.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b295840921cb89f8-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.938 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.938 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.938 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.938 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.938 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:17:35.939 DEBUG:boto:Data: 2023-12-15T23:17:35.939 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.939 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.939 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.939 DEBUG:boto:Params: {} 2023-12-15T23:17:35.939 DEBUG:boto:Token: None 2023-12-15T23:17:35.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22 2023-12-15T23:17:35.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u0P0QMjl9kQWjGpmPCOOXYHbXpg= 2023-12-15T23:17:35.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u0P0QMjl9kQWjGpmPCOOXYHbXpg=', 'Content-Length': '0'} 2023-12-15T23:17:35.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d99f51fd6f1a1db-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.941 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.941 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.942 DEBUG:boto:Method: HEAD 2023-12-15T23:17:35.942 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:17:35.942 DEBUG:boto:Data: 2023-12-15T23:17:35.942 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.942 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.942 DEBUG:boto:Params: {} 2023-12-15T23:17:35.942 DEBUG:boto:Token: None 2023-12-15T23:17:35.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22 2023-12-15T23:17:35.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u0P0QMjl9kQWjGpmPCOOXYHbXpg= 2023-12-15T23:17:35.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u0P0QMjl9kQWjGpmPCOOXYHbXpg=', 'Content-Length': '0'} 2023-12-15T23:17:35.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a71d393c42dfcaf-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.944 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:17:35.944 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.944 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.945 DEBUG:boto:Method: GET 2023-12-15T23:17:35.945 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:17:35.945 DEBUG:boto:Data: 2023-12-15T23:17:35.945 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.945 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.945 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.945 DEBUG:boto:Params: {} 2023-12-15T23:17:35.945 DEBUG:boto:Token: None 2023-12-15T23:17:35.945 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22 2023-12-15T23:17:35.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1eb0aVi0hpHtW2wjO4HoajLLO8= 2023-12-15T23:17:35.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1eb0aVi0hpHtW2wjO4HoajLLO8=', 'Content-Length': '0'} 2023-12-15T23:17:35.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecf8e3d9dc8e3039-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.989 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:17:35.990 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:17:35.990 DEBUG:boto:Method: GET 2023-12-15T23:17:35.990 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:17:35.990 DEBUG:boto:Data: 2023-12-15T23:17:35.990 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.990 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.990 DEBUG:boto:Params: {} 2023-12-15T23:17:35.990 DEBUG:boto:Token: None 2023-12-15T23:17:35.990 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/obj22 2023-12-15T23:17:35.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1eb0aVi0hpHtW2wjO4HoajLLO8= 2023-12-15T23:17:35.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1eb0aVi0hpHtW2wjO4HoajLLO8=', 'Content-Length': '0'} 2023-12-15T23:17:35.992 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000def3ec8e4492c1df-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.993 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.993 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.993 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.993 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.993 DEBUG:boto:Method: GET 2023-12-15T23:17:35.993 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.993 DEBUG:boto:Data: 2023-12-15T23:17:35.994 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:35.994 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.994 DEBUG:boto:Params: {} 2023-12-15T23:17:35.994 DEBUG:boto:Token: None 2023-12-15T23:17:35.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.994 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:35.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcf0c775d3add91a-00657cde8f-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:35.997 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:35.997 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:35.997 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:35.997 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.998 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.998 DEBUG:boto:Method: GET 2023-12-15T23:17:35.998 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:17:35.998 DEBUG:boto:Data: 2023-12-15T23:17:35.998 DEBUG:boto:Headers: {} 2023-12-15T23:17:35.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:35.998 DEBUG:boto:Port: 8000 2023-12-15T23:17:35.998 DEBUG:boto:Params: {} 2023-12-15T23:17:35.998 DEBUG:boto:Token: None 2023-12-15T23:17:35.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:35 GMT /kskgfn-49/ 2023-12-15T23:17:35.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0= 2023-12-15T23:17:35.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/G2ae3E4Ra1mX7jM8Vif8Xfa1A0=', 'Content-Length': '0'} 2023-12-15T23:17:36.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060f2af7435f0bf37-00657cde8f-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.001 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.001 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:17:36.001 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.002 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.002 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.002 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.002 DEBUG:boto:Method: GET 2023-12-15T23:17:36.002 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.002 DEBUG:boto:Data: 2023-12-15T23:17:36.002 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.002 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.002 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.002 DEBUG:boto:Params: {} 2023-12-15T23:17:36.002 DEBUG:boto:Token: None 2023-12-15T23:17:36.003 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM= 2023-12-15T23:17:36.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM=', 'Content-Length': '0'} 2023-12-15T23:17:36.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa3bb47962a02a6e-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.005 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.005 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.005 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.006 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.006 DEBUG:boto:Method: GET 2023-12-15T23:17:36.006 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.006 DEBUG:boto:Data: 2023-12-15T23:17:36.006 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.006 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.006 DEBUG:boto:Params: {} 2023-12-15T23:17:36.006 DEBUG:boto:Token: None 2023-12-15T23:17:36.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM= 2023-12-15T23:17:36.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM=', 'Content-Length': '0'} 2023-12-15T23:17:36.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a7a571f61f40311-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.009 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.009 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.009 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.009 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.009 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.009 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.010 DEBUG:boto:Data: 2023-12-15T23:17:36.010 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.010 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.010 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.010 DEBUG:boto:Params: {} 2023-12-15T23:17:36.010 DEBUG:boto:Token: None 2023-12-15T23:17:36.010 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zu9JdNrddP90kZ/ufAuDKPnhlPQ= 2023-12-15T23:17:36.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zu9JdNrddP90kZ/ufAuDKPnhlPQ=', 'Content-Length': '0'} 2023-12-15T23:17:36.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4808d7b55929312-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.012 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.012 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.013 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.013 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.013 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.013 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.013 DEBUG:boto:Data: 2023-12-15T23:17:36.013 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.013 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.013 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.013 DEBUG:boto:Params: {} 2023-12-15T23:17:36.013 DEBUG:boto:Token: None 2023-12-15T23:17:36.014 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zu9JdNrddP90kZ/ufAuDKPnhlPQ= 2023-12-15T23:17:36.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zu9JdNrddP90kZ/ufAuDKPnhlPQ=', 'Content-Length': '0'} 2023-12-15T23:17:36.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e390669eac6867a-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:17:36.016 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.016 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.016 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.017 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.017 DEBUG:boto:Method: GET 2023-12-15T23:17:36.017 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.017 DEBUG:boto:Data: 2023-12-15T23:17:36.017 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.017 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.017 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.017 DEBUG:boto:Params: {} 2023-12-15T23:17:36.017 DEBUG:boto:Token: None 2023-12-15T23:17:36.017 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.018 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM= 2023-12-15T23:17:36.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM=', 'Content-Length': '0'} 2023-12-15T23:17:36.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5bad4fa03013c0b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.065 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.066 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.066 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.066 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.066 DEBUG:boto:Method: GET 2023-12-15T23:17:36.066 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.066 DEBUG:boto:Data: 2023-12-15T23:17:36.066 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.066 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.066 DEBUG:boto:Params: {} 2023-12-15T23:17:36.066 DEBUG:boto:Token: None 2023-12-15T23:17:36.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:17:36.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM= 2023-12-15T23:17:36.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91mQL3mYrmUMnoVuQ9wUMvb3DaM=', 'Content-Length': '0'} 2023-12-15T23:17:36.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000870109398e076d24-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.069 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.069 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.070 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.070 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.070 DEBUG:boto:Method: GET 2023-12-15T23:17:36.070 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.070 DEBUG:boto:Data: 2023-12-15T23:17:36.070 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.070 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.070 DEBUG:boto:Params: {} 2023-12-15T23:17:36.070 DEBUG:boto:Token: None 2023-12-15T23:17:36.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.073 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cebc1078fece1285-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.073 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.074 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.074 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.074 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.074 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.074 DEBUG:boto:Method: GET 2023-12-15T23:17:36.074 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.074 DEBUG:boto:Data: 2023-12-15T23:17:36.074 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.075 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.075 DEBUG:boto:Params: {} 2023-12-15T23:17:36.075 DEBUG:boto:Token: None 2023-12-15T23:17:36.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.077 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c38579d1d2061a1-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.078 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.078 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.078 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.078 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.078 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:17:36.078 DEBUG:boto:Data: 2023-12-15T23:17:36.079 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.079 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.079 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.079 DEBUG:boto:Params: {} 2023-12-15T23:17:36.079 DEBUG:boto:Token: None 2023-12-15T23:17:36.079 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33 2023-12-15T23:17:36.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+U9/+Ly8NPss3coXwqCb4xEhy8Q= 2023-12-15T23:17:36.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+U9/+Ly8NPss3coXwqCb4xEhy8Q=', 'Content-Length': '0'} 2023-12-15T23:17:36.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad14586e7124da2a-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.082 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.082 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.082 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.082 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:17:36.082 DEBUG:boto:Data: 2023-12-15T23:17:36.082 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.082 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.082 DEBUG:boto:Params: {} 2023-12-15T23:17:36.083 DEBUG:boto:Token: None 2023-12-15T23:17:36.083 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33 2023-12-15T23:17:36.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+U9/+Ly8NPss3coXwqCb4xEhy8Q= 2023-12-15T23:17:36.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+U9/+Ly8NPss3coXwqCb4xEhy8Q=', 'Content-Length': '0'} 2023-12-15T23:17:36.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061c0efc2fc77c3e1-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.085 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:17:36.085 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.085 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.086 DEBUG:boto:Method: GET 2023-12-15T23:17:36.086 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:17:36.086 DEBUG:boto:Data: 2023-12-15T23:17:36.086 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.086 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.086 DEBUG:boto:Params: {} 2023-12-15T23:17:36.086 DEBUG:boto:Token: None 2023-12-15T23:17:36.086 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33 2023-12-15T23:17:36.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2ftDz1nh0m35oAphSrKKFE9Fo+Q= 2023-12-15T23:17:36.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2ftDz1nh0m35oAphSrKKFE9Fo+Q=', 'Content-Length': '0'} 2023-12-15T23:17:36.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000812be8664e9faf85-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.129 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:17:36.130 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:17:36.130 DEBUG:boto:Method: GET 2023-12-15T23:17:36.130 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:17:36.130 DEBUG:boto:Data: 2023-12-15T23:17:36.130 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.130 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.130 DEBUG:boto:Params: {} 2023-12-15T23:17:36.130 DEBUG:boto:Token: None 2023-12-15T23:17:36.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj33 2023-12-15T23:17:36.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2ftDz1nh0m35oAphSrKKFE9Fo+Q= 2023-12-15T23:17:36.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2ftDz1nh0m35oAphSrKKFE9Fo+Q=', 'Content-Length': '0'} 2023-12-15T23:17:36.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000588ce298b0af2ca7-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.133 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.133 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.133 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.133 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.133 DEBUG:boto:Method: GET 2023-12-15T23:17:36.133 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.133 DEBUG:boto:Data: 2023-12-15T23:17:36.133 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.134 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.134 DEBUG:boto:Params: {} 2023-12-15T23:17:36.134 DEBUG:boto:Token: None 2023-12-15T23:17:36.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e642b95db4282bd9-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.137 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.137 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.137 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.137 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.138 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.138 DEBUG:boto:Method: GET 2023-12-15T23:17:36.138 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:17:36.138 DEBUG:boto:Data: 2023-12-15T23:17:36.138 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.138 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.138 DEBUG:boto:Params: {} 2023-12-15T23:17:36.138 DEBUG:boto:Token: None 2023-12-15T23:17:36.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba98bed599d17873-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.141 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:17:36.141 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.142 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.142 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.142 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.142 DEBUG:boto:Method: GET 2023-12-15T23:17:36.142 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.142 DEBUG:boto:Data: 2023-12-15T23:17:36.142 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.142 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.142 DEBUG:boto:Params: {} 2023-12-15T23:17:36.142 DEBUG:boto:Token: None 2023-12-15T23:17:36.143 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0= 2023-12-15T23:17:36.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0=', 'Content-Length': '0'} 2023-12-15T23:17:36.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2154b93dfd85f3b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.145 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.145 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.145 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.145 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.146 DEBUG:boto:Method: GET 2023-12-15T23:17:36.146 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.146 DEBUG:boto:Data: 2023-12-15T23:17:36.146 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.146 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.146 DEBUG:boto:Params: {} 2023-12-15T23:17:36.146 DEBUG:boto:Token: None 2023-12-15T23:17:36.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0= 2023-12-15T23:17:36.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0=', 'Content-Length': '0'} 2023-12-15T23:17:36.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000693f99b0f809b45d-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.149 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.149 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.149 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.149 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.149 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.149 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.149 DEBUG:boto:Data: 2023-12-15T23:17:36.149 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.149 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.149 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.149 DEBUG:boto:Params: {} 2023-12-15T23:17:36.150 DEBUG:boto:Token: None 2023-12-15T23:17:36.150 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EIwuUU1Kz+Ijluf+c21f9A+rcRE= 2023-12-15T23:17:36.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EIwuUU1Kz+Ijluf+c21f9A+rcRE=', 'Content-Length': '0'} 2023-12-15T23:17:36.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1d1d890287e0364-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.152 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.152 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.152 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.153 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.153 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.153 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.153 DEBUG:boto:Data: 2023-12-15T23:17:36.153 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.153 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.153 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.153 DEBUG:boto:Params: {} 2023-12-15T23:17:36.153 DEBUG:boto:Token: None 2023-12-15T23:17:36.153 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EIwuUU1Kz+Ijluf+c21f9A+rcRE= 2023-12-15T23:17:36.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EIwuUU1Kz+Ijluf+c21f9A+rcRE=', 'Content-Length': '0'} 2023-12-15T23:17:36.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cac20836664da3b8-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:17:36.156 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.156 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.156 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.157 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.157 DEBUG:boto:Method: GET 2023-12-15T23:17:36.157 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.157 DEBUG:boto:Data: 2023-12-15T23:17:36.157 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.157 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.157 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.157 DEBUG:boto:Params: {} 2023-12-15T23:17:36.157 DEBUG:boto:Token: None 2023-12-15T23:17:36.157 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.157 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0= 2023-12-15T23:17:36.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0=', 'Content-Length': '0'} 2023-12-15T23:17:36.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003497f860f8082848-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.201 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.202 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.202 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.202 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.202 DEBUG:boto:Method: GET 2023-12-15T23:17:36.202 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.202 DEBUG:boto:Data: 2023-12-15T23:17:36.202 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.202 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.202 DEBUG:boto:Params: {} 2023-12-15T23:17:36.203 DEBUG:boto:Token: None 2023-12-15T23:17:36.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:17:36.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0= 2023-12-15T23:17:36.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aN+VqsPTP3UXuQHBqaioBVZ54+0=', 'Content-Length': '0'} 2023-12-15T23:17:36.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d897832a23f9a29-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.205 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.205 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.206 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.206 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.206 DEBUG:boto:Method: GET 2023-12-15T23:17:36.206 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.206 DEBUG:boto:Data: 2023-12-15T23:17:36.206 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.206 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.206 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.206 DEBUG:boto:Params: {} 2023-12-15T23:17:36.206 DEBUG:boto:Token: None 2023-12-15T23:17:36.206 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a14809befbd240d5-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.209 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.210 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.210 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.210 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.210 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.210 DEBUG:boto:Method: GET 2023-12-15T23:17:36.210 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.210 DEBUG:boto:Data: 2023-12-15T23:17:36.210 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.210 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.210 DEBUG:boto:Params: {} 2023-12-15T23:17:36.211 DEBUG:boto:Token: None 2023-12-15T23:17:36.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070e95ec58ef631a6-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.213 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.214 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.214 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.214 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.214 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:17:36.214 DEBUG:boto:Data: 2023-12-15T23:17:36.214 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.214 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.214 DEBUG:boto:Params: {} 2023-12-15T23:17:36.215 DEBUG:boto:Token: None 2023-12-15T23:17:36.215 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34 2023-12-15T23:17:36.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2AkWpC5qAkw30gVo9kTYd2jZI9g= 2023-12-15T23:17:36.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2AkWpC5qAkw30gVo9kTYd2jZI9g=', 'Content-Length': '0'} 2023-12-15T23:17:36.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3ab88bb36903e2f-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.217 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.217 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.217 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.217 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:17:36.217 DEBUG:boto:Data: 2023-12-15T23:17:36.217 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.218 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.218 DEBUG:boto:Params: {} 2023-12-15T23:17:36.218 DEBUG:boto:Token: None 2023-12-15T23:17:36.218 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34 2023-12-15T23:17:36.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2AkWpC5qAkw30gVo9kTYd2jZI9g= 2023-12-15T23:17:36.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2AkWpC5qAkw30gVo9kTYd2jZI9g=', 'Content-Length': '0'} 2023-12-15T23:17:36.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dec3def89fe24e8-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:17:36.220 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.220 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.220 DEBUG:boto:Method: GET 2023-12-15T23:17:36.221 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:17:36.221 DEBUG:boto:Data: 2023-12-15T23:17:36.221 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.221 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.221 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.221 DEBUG:boto:Params: {} 2023-12-15T23:17:36.221 DEBUG:boto:Token: None 2023-12-15T23:17:36.221 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34 2023-12-15T23:17:36.221 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TYFnIUDA3l8qXoG5KnSNAcLLq+U= 2023-12-15T23:17:36.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TYFnIUDA3l8qXoG5KnSNAcLLq+U=', 'Content-Length': '0'} 2023-12-15T23:17:36.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007908cbd37cd9ea07-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.266 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:17:36.266 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:17:36.266 DEBUG:boto:Method: GET 2023-12-15T23:17:36.266 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:17:36.266 DEBUG:boto:Data: 2023-12-15T23:17:36.266 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.266 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.266 DEBUG:boto:Params: {} 2023-12-15T23:17:36.266 DEBUG:boto:Token: None 2023-12-15T23:17:36.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj34 2023-12-15T23:17:36.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TYFnIUDA3l8qXoG5KnSNAcLLq+U= 2023-12-15T23:17:36.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TYFnIUDA3l8qXoG5KnSNAcLLq+U=', 'Content-Length': '0'} 2023-12-15T23:17:36.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096ac59a8bfb5cbf2-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.269 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.270 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.270 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.270 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.270 DEBUG:boto:Method: GET 2023-12-15T23:17:36.270 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.270 DEBUG:boto:Data: 2023-12-15T23:17:36.270 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.270 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.270 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.270 DEBUG:boto:Params: {} 2023-12-15T23:17:36.271 DEBUG:boto:Token: None 2023-12-15T23:17:36.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a67ae425024799a6-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.313 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.314 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.314 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.314 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.314 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.314 DEBUG:boto:Method: GET 2023-12-15T23:17:36.314 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:17:36.314 DEBUG:boto:Data: 2023-12-15T23:17:36.314 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.315 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.315 DEBUG:boto:Params: {} 2023-12-15T23:17:36.315 DEBUG:boto:Token: None 2023-12-15T23:17:36.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d7c1596e4ebd8b9-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.318 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:17:36.318 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.318 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.318 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.318 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.318 DEBUG:boto:Method: GET 2023-12-15T23:17:36.318 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.319 DEBUG:boto:Data: 2023-12-15T23:17:36.319 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.319 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.319 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.319 DEBUG:boto:Params: {} 2023-12-15T23:17:36.319 DEBUG:boto:Token: None 2023-12-15T23:17:36.319 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8= 2023-12-15T23:17:36.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8=', 'Content-Length': '0'} 2023-12-15T23:17:36.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d44e570d753d765-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.322 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.322 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.322 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.322 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.322 DEBUG:boto:Method: GET 2023-12-15T23:17:36.322 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.322 DEBUG:boto:Data: 2023-12-15T23:17:36.322 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.322 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.322 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.322 DEBUG:boto:Params: {} 2023-12-15T23:17:36.323 DEBUG:boto:Token: None 2023-12-15T23:17:36.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8= 2023-12-15T23:17:36.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8=', 'Content-Length': '0'} 2023-12-15T23:17:36.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000782613f037379881-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.325 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.325 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.325 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.325 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.326 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.326 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.326 DEBUG:boto:Data: 2023-12-15T23:17:36.326 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.326 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.326 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.326 DEBUG:boto:Params: {} 2023-12-15T23:17:36.326 DEBUG:boto:Token: None 2023-12-15T23:17:36.326 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0XY4EXaCNYLNOeYvEF6tqEi9uYM= 2023-12-15T23:17:36.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0XY4EXaCNYLNOeYvEF6tqEi9uYM=', 'Content-Length': '0'} 2023-12-15T23:17:36.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023973ccc2dd49ec5-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.329 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.329 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.329 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.329 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.329 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.329 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.329 DEBUG:boto:Data: 2023-12-15T23:17:36.329 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.329 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.329 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.329 DEBUG:boto:Params: {} 2023-12-15T23:17:36.330 DEBUG:boto:Token: None 2023-12-15T23:17:36.330 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0XY4EXaCNYLNOeYvEF6tqEi9uYM= 2023-12-15T23:17:36.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0XY4EXaCNYLNOeYvEF6tqEi9uYM=', 'Content-Length': '0'} 2023-12-15T23:17:36.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050fd3c8f7f3249a6-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:17:36.332 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.332 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.332 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.332 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.332 DEBUG:boto:Method: GET 2023-12-15T23:17:36.332 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.332 DEBUG:boto:Data: 2023-12-15T23:17:36.333 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.333 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.333 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.333 DEBUG:boto:Params: {} 2023-12-15T23:17:36.333 DEBUG:boto:Token: None 2023-12-15T23:17:36.333 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.333 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8= 2023-12-15T23:17:36.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8=', 'Content-Length': '0'} 2023-12-15T23:17:36.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc3abfdaf92c5b29-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.377 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.377 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.378 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.378 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.378 DEBUG:boto:Method: GET 2023-12-15T23:17:36.378 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.378 DEBUG:boto:Data: 2023-12-15T23:17:36.378 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.378 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.378 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.378 DEBUG:boto:Params: {} 2023-12-15T23:17:36.378 DEBUG:boto:Token: None 2023-12-15T23:17:36.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:17:36.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8= 2023-12-15T23:17:36.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RN963eIKV5uYHr+2+4lNKx/b6w8=', 'Content-Length': '0'} 2023-12-15T23:17:36.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072001e8103a69177-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.381 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.381 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.381 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.381 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.381 DEBUG:boto:Method: GET 2023-12-15T23:17:36.381 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.381 DEBUG:boto:Data: 2023-12-15T23:17:36.381 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.382 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.382 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.382 DEBUG:boto:Params: {} 2023-12-15T23:17:36.382 DEBUG:boto:Token: None 2023-12-15T23:17:36.382 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e509c35cb3ce8b4e-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.425 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.426 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.426 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.426 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.426 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.426 DEBUG:boto:Method: GET 2023-12-15T23:17:36.426 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.426 DEBUG:boto:Data: 2023-12-15T23:17:36.426 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.427 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.427 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.427 DEBUG:boto:Params: {} 2023-12-15T23:17:36.427 DEBUG:boto:Token: None 2023-12-15T23:17:36.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053c0b44751f60fac-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.430 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.430 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.430 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.430 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.431 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:17:36.431 DEBUG:boto:Data: 2023-12-15T23:17:36.431 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.431 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.431 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.431 DEBUG:boto:Params: {} 2023-12-15T23:17:36.431 DEBUG:boto:Token: None 2023-12-15T23:17:36.431 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44 2023-12-15T23:17:36.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ii2Kq7YUqmgmitT0SsYeG2x1XUw= 2023-12-15T23:17:36.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ii2Kq7YUqmgmitT0SsYeG2x1XUw=', 'Content-Length': '0'} 2023-12-15T23:17:36.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf577ea4951bdc27-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.433 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.434 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.434 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.434 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:17:36.434 DEBUG:boto:Data: 2023-12-15T23:17:36.434 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.434 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.434 DEBUG:boto:Params: {} 2023-12-15T23:17:36.434 DEBUG:boto:Token: None 2023-12-15T23:17:36.434 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44 2023-12-15T23:17:36.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ii2Kq7YUqmgmitT0SsYeG2x1XUw= 2023-12-15T23:17:36.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ii2Kq7YUqmgmitT0SsYeG2x1XUw=', 'Content-Length': '0'} 2023-12-15T23:17:36.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008578fb7e7dacc284-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.436 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:17:36.437 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.437 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.437 DEBUG:boto:Method: GET 2023-12-15T23:17:36.437 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:17:36.437 DEBUG:boto:Data: 2023-12-15T23:17:36.437 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.437 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.437 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.437 DEBUG:boto:Params: {} 2023-12-15T23:17:36.437 DEBUG:boto:Token: None 2023-12-15T23:17:36.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44 2023-12-15T23:17:36.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MX3pQelo/xiHrYOZcPZqumk0pi0= 2023-12-15T23:17:36.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MX3pQelo/xiHrYOZcPZqumk0pi0=', 'Content-Length': '0'} 2023-12-15T23:17:36.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b49c15da944fe71b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.482 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:17:36.482 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:17:36.482 DEBUG:boto:Method: GET 2023-12-15T23:17:36.482 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:17:36.482 DEBUG:boto:Data: 2023-12-15T23:17:36.482 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.482 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.482 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.482 DEBUG:boto:Params: {} 2023-12-15T23:17:36.482 DEBUG:boto:Token: None 2023-12-15T23:17:36.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj44 2023-12-15T23:17:36.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MX3pQelo/xiHrYOZcPZqumk0pi0= 2023-12-15T23:17:36.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MX3pQelo/xiHrYOZcPZqumk0pi0=', 'Content-Length': '0'} 2023-12-15T23:17:36.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebf7632f4d477cc2-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.485 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.485 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.485 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.485 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.485 DEBUG:boto:Method: GET 2023-12-15T23:17:36.485 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.485 DEBUG:boto:Data: 2023-12-15T23:17:36.486 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.486 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.486 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.486 DEBUG:boto:Params: {} 2023-12-15T23:17:36.486 DEBUG:boto:Token: None 2023-12-15T23:17:36.486 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.486 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e17fdefd9e1877b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.489 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.489 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.489 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.490 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.490 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.490 DEBUG:boto:Method: GET 2023-12-15T23:17:36.490 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:17:36.490 DEBUG:boto:Data: 2023-12-15T23:17:36.490 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.490 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.490 DEBUG:boto:Params: {} 2023-12-15T23:17:36.490 DEBUG:boto:Token: None 2023-12-15T23:17:36.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008995f2b6808de4ec-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.493 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.493 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:17:36.494 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.494 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.494 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.494 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.494 DEBUG:boto:Method: GET 2023-12-15T23:17:36.494 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.494 DEBUG:boto:Data: 2023-12-15T23:17:36.494 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.494 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.494 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.494 DEBUG:boto:Params: {} 2023-12-15T23:17:36.495 DEBUG:boto:Token: None 2023-12-15T23:17:36.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg= 2023-12-15T23:17:36.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg=', 'Content-Length': '0'} 2023-12-15T23:17:36.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a8c133a3a558fd3-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.497 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.498 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.498 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.498 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.498 DEBUG:boto:Method: GET 2023-12-15T23:17:36.498 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.498 DEBUG:boto:Data: 2023-12-15T23:17:36.498 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.498 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.498 DEBUG:boto:Params: {} 2023-12-15T23:17:36.498 DEBUG:boto:Token: None 2023-12-15T23:17:36.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg= 2023-12-15T23:17:36.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg=', 'Content-Length': '0'} 2023-12-15T23:17:36.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003c08f3b9ef51f32-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.501 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.501 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.501 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.501 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.501 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.501 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.502 DEBUG:boto:Data: 2023-12-15T23:17:36.502 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.502 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.502 DEBUG:boto:Params: {} 2023-12-15T23:17:36.502 DEBUG:boto:Token: None 2023-12-15T23:17:36.502 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dNXGcylw7tkfJQhy9oWOiagsm4w= 2023-12-15T23:17:36.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dNXGcylw7tkfJQhy9oWOiagsm4w=', 'Content-Length': '0'} 2023-12-15T23:17:36.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e193069ef0e6bed4-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.504 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.505 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.505 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.505 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.505 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.505 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.505 DEBUG:boto:Data: 2023-12-15T23:17:36.505 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.505 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.505 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.505 DEBUG:boto:Params: {} 2023-12-15T23:17:36.506 DEBUG:boto:Token: None 2023-12-15T23:17:36.506 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dNXGcylw7tkfJQhy9oWOiagsm4w= 2023-12-15T23:17:36.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dNXGcylw7tkfJQhy9oWOiagsm4w=', 'Content-Length': '0'} 2023-12-15T23:17:36.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000403f78690cf7d1d9-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:17:36.508 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.508 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.508 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.508 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.508 DEBUG:boto:Method: GET 2023-12-15T23:17:36.508 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.509 DEBUG:boto:Data: 2023-12-15T23:17:36.509 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.509 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.509 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.509 DEBUG:boto:Params: {} 2023-12-15T23:17:36.509 DEBUG:boto:Token: None 2023-12-15T23:17:36.509 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.509 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg= 2023-12-15T23:17:36.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg=', 'Content-Length': '0'} 2023-12-15T23:17:36.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065f13644e6806e1b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.553 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.554 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.554 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.554 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.554 DEBUG:boto:Method: GET 2023-12-15T23:17:36.554 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.554 DEBUG:boto:Data: 2023-12-15T23:17:36.554 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.554 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.554 DEBUG:boto:Params: {} 2023-12-15T23:17:36.554 DEBUG:boto:Token: None 2023-12-15T23:17:36.555 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:17:36.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg= 2023-12-15T23:17:36.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZkRDuRQHvMjYkiRkm8WXwlIxRKg=', 'Content-Length': '0'} 2023-12-15T23:17:36.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094b740c5c3206f52-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.557 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.557 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.557 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.557 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.557 DEBUG:boto:Method: GET 2023-12-15T23:17:36.557 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.557 DEBUG:boto:Data: 2023-12-15T23:17:36.558 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.558 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.558 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.558 DEBUG:boto:Params: {} 2023-12-15T23:17:36.558 DEBUG:boto:Token: None 2023-12-15T23:17:36.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e20f6e93be0f2b26-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.605 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.606 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.606 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.606 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.606 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.606 DEBUG:boto:Method: GET 2023-12-15T23:17:36.606 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.606 DEBUG:boto:Data: 2023-12-15T23:17:36.606 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.607 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.607 DEBUG:boto:Params: {} 2023-12-15T23:17:36.607 DEBUG:boto:Token: None 2023-12-15T23:17:36.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.610 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcf8663d3c22dbe5-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.610 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.610 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.610 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.610 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.610 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:17:36.611 DEBUG:boto:Data: 2023-12-15T23:17:36.611 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.611 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.611 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.611 DEBUG:boto:Params: {} 2023-12-15T23:17:36.611 DEBUG:boto:Token: None 2023-12-15T23:17:36.611 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51 2023-12-15T23:17:36.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n9SuGTMoVnFlDiaTfqDYsVL9+dE= 2023-12-15T23:17:36.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n9SuGTMoVnFlDiaTfqDYsVL9+dE=', 'Content-Length': '0'} 2023-12-15T23:17:36.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ff58aa882ef02b2-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.613 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.613 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.613 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.614 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:17:36.614 DEBUG:boto:Data: 2023-12-15T23:17:36.614 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.614 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.614 DEBUG:boto:Params: {} 2023-12-15T23:17:36.614 DEBUG:boto:Token: None 2023-12-15T23:17:36.614 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51 2023-12-15T23:17:36.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n9SuGTMoVnFlDiaTfqDYsVL9+dE= 2023-12-15T23:17:36.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n9SuGTMoVnFlDiaTfqDYsVL9+dE=', 'Content-Length': '0'} 2023-12-15T23:17:36.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000845777850373eebc-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:17:36.617 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.617 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.617 DEBUG:boto:Method: GET 2023-12-15T23:17:36.617 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:17:36.617 DEBUG:boto:Data: 2023-12-15T23:17:36.617 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.617 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.617 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.617 DEBUG:boto:Params: {} 2023-12-15T23:17:36.618 DEBUG:boto:Token: None 2023-12-15T23:17:36.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51 2023-12-15T23:17:36.618 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yzxna3aZUFkhAOtcWnTs52EEifE= 2023-12-15T23:17:36.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yzxna3aZUFkhAOtcWnTs52EEifE=', 'Content-Length': '0'} 2023-12-15T23:17:36.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000463c9f845327f6cb-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.665 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:17:36.666 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:17:36.666 DEBUG:boto:Method: GET 2023-12-15T23:17:36.666 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:17:36.666 DEBUG:boto:Data: 2023-12-15T23:17:36.666 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.666 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.666 DEBUG:boto:Params: {} 2023-12-15T23:17:36.666 DEBUG:boto:Token: None 2023-12-15T23:17:36.666 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj51 2023-12-15T23:17:36.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yzxna3aZUFkhAOtcWnTs52EEifE= 2023-12-15T23:17:36.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yzxna3aZUFkhAOtcWnTs52EEifE=', 'Content-Length': '0'} 2023-12-15T23:17:36.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000188255fe47ae71db-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.669 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.669 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.669 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.669 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.669 DEBUG:boto:Method: GET 2023-12-15T23:17:36.669 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.669 DEBUG:boto:Data: 2023-12-15T23:17:36.669 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.669 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.670 DEBUG:boto:Params: {} 2023-12-15T23:17:36.670 DEBUG:boto:Token: None 2023-12-15T23:17:36.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.672 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034de14a6ecc426cc-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.673 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.673 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.673 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.673 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.673 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.673 DEBUG:boto:Method: GET 2023-12-15T23:17:36.673 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:17:36.674 DEBUG:boto:Data: 2023-12-15T23:17:36.674 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.674 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.674 DEBUG:boto:Params: {} 2023-12-15T23:17:36.674 DEBUG:boto:Token: None 2023-12-15T23:17:36.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.677 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007aa0ca893a20ae46-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.677 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.677 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:17:36.677 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.677 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.677 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.678 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.678 DEBUG:boto:Method: GET 2023-12-15T23:17:36.678 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.678 DEBUG:boto:Data: 2023-12-15T23:17:36.678 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.678 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.678 DEBUG:boto:Params: {} 2023-12-15T23:17:36.678 DEBUG:boto:Token: None 2023-12-15T23:17:36.678 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.679 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw= 2023-12-15T23:17:36.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw=', 'Content-Length': '0'} 2023-12-15T23:17:36.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003325b0ab124f576-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.681 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.681 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.681 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.681 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.682 DEBUG:boto:Method: GET 2023-12-15T23:17:36.682 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.682 DEBUG:boto:Data: 2023-12-15T23:17:36.682 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.682 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.682 DEBUG:boto:Params: {} 2023-12-15T23:17:36.682 DEBUG:boto:Token: None 2023-12-15T23:17:36.682 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw= 2023-12-15T23:17:36.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw=', 'Content-Length': '0'} 2023-12-15T23:17:36.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001015d3e851bf8cdb-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.685 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.685 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.685 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.685 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.685 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.685 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.685 DEBUG:boto:Data: 2023-12-15T23:17:36.685 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.685 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.685 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.685 DEBUG:boto:Params: {} 2023-12-15T23:17:36.686 DEBUG:boto:Token: None 2023-12-15T23:17:36.686 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9vVvsYtpyNosGDSYZT+zSva+KPk= 2023-12-15T23:17:36.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9vVvsYtpyNosGDSYZT+zSva+KPk=', 'Content-Length': '0'} 2023-12-15T23:17:36.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f24d780e2ed7a8b8-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.688 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.688 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.689 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.689 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.689 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.689 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.689 DEBUG:boto:Data: 2023-12-15T23:17:36.689 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.689 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.689 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.689 DEBUG:boto:Params: {} 2023-12-15T23:17:36.689 DEBUG:boto:Token: None 2023-12-15T23:17:36.690 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9vVvsYtpyNosGDSYZT+zSva+KPk= 2023-12-15T23:17:36.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9vVvsYtpyNosGDSYZT+zSva+KPk=', 'Content-Length': '0'} 2023-12-15T23:17:36.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fee0d424b9901945-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:17:36.692 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.692 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.692 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.692 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.692 DEBUG:boto:Method: GET 2023-12-15T23:17:36.693 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.693 DEBUG:boto:Data: 2023-12-15T23:17:36.693 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.693 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.693 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.693 DEBUG:boto:Params: {} 2023-12-15T23:17:36.693 DEBUG:boto:Token: None 2023-12-15T23:17:36.693 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.693 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw= 2023-12-15T23:17:36.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw=', 'Content-Length': '0'} 2023-12-15T23:17:36.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004e7a5db74d58aa1-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.737 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.737 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.738 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.738 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.738 DEBUG:boto:Method: GET 2023-12-15T23:17:36.738 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.738 DEBUG:boto:Data: 2023-12-15T23:17:36.738 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.738 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.738 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.738 DEBUG:boto:Params: {} 2023-12-15T23:17:36.738 DEBUG:boto:Token: None 2023-12-15T23:17:36.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:17:36.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw= 2023-12-15T23:17:36.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NAxo/Y8oxAoMVnbgd8Pmk3eViVw=', 'Content-Length': '0'} 2023-12-15T23:17:36.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000734a1bb43f9b1e2d-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.741 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.741 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.741 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.741 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.741 DEBUG:boto:Method: GET 2023-12-15T23:17:36.741 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.742 DEBUG:boto:Data: 2023-12-15T23:17:36.742 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.742 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.742 DEBUG:boto:Params: {} 2023-12-15T23:17:36.742 DEBUG:boto:Token: None 2023-12-15T23:17:36.742 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000550284025c48ce04-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.785 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.786 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.786 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.786 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.786 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.786 DEBUG:boto:Method: GET 2023-12-15T23:17:36.786 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.786 DEBUG:boto:Data: 2023-12-15T23:17:36.786 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.786 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.787 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.787 DEBUG:boto:Params: {} 2023-12-15T23:17:36.787 DEBUG:boto:Token: None 2023-12-15T23:17:36.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.789 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088b9667c650bad46-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.789 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.790 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.790 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.790 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.790 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:17:36.790 DEBUG:boto:Data: 2023-12-15T23:17:36.790 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.790 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.791 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.791 DEBUG:boto:Params: {} 2023-12-15T23:17:36.791 DEBUG:boto:Token: None 2023-12-15T23:17:36.791 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55 2023-12-15T23:17:36.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a9Kf4FgTeMZTB0rYn4pFxTtU4MM= 2023-12-15T23:17:36.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a9Kf4FgTeMZTB0rYn4pFxTtU4MM=', 'Content-Length': '0'} 2023-12-15T23:17:36.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082569792fc9a5aba-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.793 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.794 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.794 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.794 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:17:36.794 DEBUG:boto:Data: 2023-12-15T23:17:36.794 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.794 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.794 DEBUG:boto:Params: {} 2023-12-15T23:17:36.794 DEBUG:boto:Token: None 2023-12-15T23:17:36.794 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55 2023-12-15T23:17:36.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a9Kf4FgTeMZTB0rYn4pFxTtU4MM= 2023-12-15T23:17:36.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a9Kf4FgTeMZTB0rYn4pFxTtU4MM=', 'Content-Length': '0'} 2023-12-15T23:17:36.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea97ecb18e0d0293-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:17:36.797 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.797 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.797 DEBUG:boto:Method: GET 2023-12-15T23:17:36.797 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:17:36.797 DEBUG:boto:Data: 2023-12-15T23:17:36.797 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.798 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.798 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.798 DEBUG:boto:Params: {} 2023-12-15T23:17:36.798 DEBUG:boto:Token: None 2023-12-15T23:17:36.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55 2023-12-15T23:17:36.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2Frq/bF52VcVHBfx3tklNfCTAFg= 2023-12-15T23:17:36.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2Frq/bF52VcVHBfx3tklNfCTAFg=', 'Content-Length': '0'} 2023-12-15T23:17:36.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac88994345ec5487-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.841 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:17:36.842 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:17:36.842 DEBUG:boto:Method: GET 2023-12-15T23:17:36.842 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:17:36.842 DEBUG:boto:Data: 2023-12-15T23:17:36.842 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.842 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.842 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.842 DEBUG:boto:Params: {} 2023-12-15T23:17:36.842 DEBUG:boto:Token: None 2023-12-15T23:17:36.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj55 2023-12-15T23:17:36.843 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2Frq/bF52VcVHBfx3tklNfCTAFg= 2023-12-15T23:17:36.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2Frq/bF52VcVHBfx3tklNfCTAFg=', 'Content-Length': '0'} 2023-12-15T23:17:36.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004febf36057c013f8-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.845 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.845 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.845 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.845 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.845 DEBUG:boto:Method: GET 2023-12-15T23:17:36.846 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.846 DEBUG:boto:Data: 2023-12-15T23:17:36.846 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.846 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.846 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.846 DEBUG:boto:Params: {} 2023-12-15T23:17:36.846 DEBUG:boto:Token: None 2023-12-15T23:17:36.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026b3325fe2941918-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.849 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.849 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.849 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.849 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.849 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.850 DEBUG:boto:Method: GET 2023-12-15T23:17:36.850 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:17:36.850 DEBUG:boto:Data: 2023-12-15T23:17:36.850 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.850 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.850 DEBUG:boto:Params: {} 2023-12-15T23:17:36.850 DEBUG:boto:Token: None 2023-12-15T23:17:36.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dca4c9781ad00ae-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.853 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.854 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:17:36.854 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.854 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.854 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.854 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.854 DEBUG:boto:Method: GET 2023-12-15T23:17:36.854 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.854 DEBUG:boto:Data: 2023-12-15T23:17:36.854 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.855 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.855 DEBUG:boto:Params: {} 2023-12-15T23:17:36.855 DEBUG:boto:Token: None 2023-12-15T23:17:36.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8= 2023-12-15T23:17:36.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8=', 'Content-Length': '0'} 2023-12-15T23:17:36.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4ca8a5f675da4bd-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.858 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.858 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.858 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.858 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.858 DEBUG:boto:Method: GET 2023-12-15T23:17:36.858 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.859 DEBUG:boto:Data: 2023-12-15T23:17:36.859 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.859 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.859 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.859 DEBUG:boto:Params: {} 2023-12-15T23:17:36.859 DEBUG:boto:Token: None 2023-12-15T23:17:36.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8= 2023-12-15T23:17:36.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8=', 'Content-Length': '0'} 2023-12-15T23:17:36.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009605486b1198155a-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.862 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.862 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.862 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.862 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.862 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.862 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.862 DEBUG:boto:Data: 2023-12-15T23:17:36.862 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.863 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.863 DEBUG:boto:Params: {} 2023-12-15T23:17:36.863 DEBUG:boto:Token: None 2023-12-15T23:17:36.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9WO4jeihqbTcXJ68s8+9E7qYaUI= 2023-12-15T23:17:36.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9WO4jeihqbTcXJ68s8+9E7qYaUI=', 'Content-Length': '0'} 2023-12-15T23:17:36.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2a786d41e6eddd8-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.865 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.865 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.866 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.866 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.866 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.866 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.866 DEBUG:boto:Data: 2023-12-15T23:17:36.866 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.866 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.866 DEBUG:boto:Params: {} 2023-12-15T23:17:36.866 DEBUG:boto:Token: None 2023-12-15T23:17:36.866 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9WO4jeihqbTcXJ68s8+9E7qYaUI= 2023-12-15T23:17:36.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9WO4jeihqbTcXJ68s8+9E7qYaUI=', 'Content-Length': '0'} 2023-12-15T23:17:36.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3a0bdcdad9ad1ef-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:17:36.869 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.869 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.869 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.870 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.870 DEBUG:boto:Method: GET 2023-12-15T23:17:36.870 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.870 DEBUG:boto:Data: 2023-12-15T23:17:36.870 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.870 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.870 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.870 DEBUG:boto:Params: {} 2023-12-15T23:17:36.870 DEBUG:boto:Token: None 2023-12-15T23:17:36.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8= 2023-12-15T23:17:36.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8=', 'Content-Length': '0'} 2023-12-15T23:17:36.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059a973d3a14259d9-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.913 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.914 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.914 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.914 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.914 DEBUG:boto:Method: GET 2023-12-15T23:17:36.914 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.914 DEBUG:boto:Data: 2023-12-15T23:17:36.914 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.914 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.914 DEBUG:boto:Params: {} 2023-12-15T23:17:36.914 DEBUG:boto:Token: None 2023-12-15T23:17:36.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:17:36.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8= 2023-12-15T23:17:36.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VAY8K/wVVrIVJ/5SkawgGCBheg8=', 'Content-Length': '0'} 2023-12-15T23:17:36.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4bc538e7d35cf73-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.917 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.917 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.917 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.917 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.918 DEBUG:boto:Method: GET 2023-12-15T23:17:36.918 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.918 DEBUG:boto:Data: 2023-12-15T23:17:36.918 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.918 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.918 DEBUG:boto:Params: {} 2023-12-15T23:17:36.918 DEBUG:boto:Token: None 2023-12-15T23:17:36.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa3e32e88a0a6c85-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.921 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.921 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.921 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.922 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.922 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.922 DEBUG:boto:Method: GET 2023-12-15T23:17:36.922 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.922 DEBUG:boto:Data: 2023-12-15T23:17:36.922 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.922 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.922 DEBUG:boto:Params: {} 2023-12-15T23:17:36.922 DEBUG:boto:Token: None 2023-12-15T23:17:36.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa98b4ab749ab840-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.925 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.925 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.925 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.926 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.926 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:17:36.926 DEBUG:boto:Data: 2023-12-15T23:17:36.926 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.926 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.926 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.926 DEBUG:boto:Params: {} 2023-12-15T23:17:36.926 DEBUG:boto:Token: None 2023-12-15T23:17:36.926 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68 2023-12-15T23:17:36.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VgDYUEW2FHQ+h19G+n6sVFD42vg= 2023-12-15T23:17:36.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VgDYUEW2FHQ+h19G+n6sVFD42vg=', 'Content-Length': '0'} 2023-12-15T23:17:36.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff4cc30e1404a5b3-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.929 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.929 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.929 DEBUG:boto:Method: HEAD 2023-12-15T23:17:36.929 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:17:36.929 DEBUG:boto:Data: 2023-12-15T23:17:36.929 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.929 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.929 DEBUG:boto:Params: {} 2023-12-15T23:17:36.930 DEBUG:boto:Token: None 2023-12-15T23:17:36.930 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68 2023-12-15T23:17:36.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VgDYUEW2FHQ+h19G+n6sVFD42vg= 2023-12-15T23:17:36.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VgDYUEW2FHQ+h19G+n6sVFD42vg=', 'Content-Length': '0'} 2023-12-15T23:17:36.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8b4dbddf0ccf2d2-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:17:36.932 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.932 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.932 DEBUG:boto:Method: GET 2023-12-15T23:17:36.933 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:17:36.933 DEBUG:boto:Data: 2023-12-15T23:17:36.933 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.933 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.933 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.933 DEBUG:boto:Params: {} 2023-12-15T23:17:36.933 DEBUG:boto:Token: None 2023-12-15T23:17:36.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68 2023-12-15T23:17:36.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9QYvxHaYPM0/REkcW4Z6PjCbnCs= 2023-12-15T23:17:36.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9QYvxHaYPM0/REkcW4Z6PjCbnCs=', 'Content-Length': '0'} 2023-12-15T23:17:36.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052c0d3fe9839de8b-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.977 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:17:36.978 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:17:36.978 DEBUG:boto:Method: GET 2023-12-15T23:17:36.978 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:17:36.978 DEBUG:boto:Data: 2023-12-15T23:17:36.978 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.978 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.978 DEBUG:boto:Params: {} 2023-12-15T23:17:36.978 DEBUG:boto:Token: None 2023-12-15T23:17:36.978 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj68 2023-12-15T23:17:36.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9QYvxHaYPM0/REkcW4Z6PjCbnCs= 2023-12-15T23:17:36.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9QYvxHaYPM0/REkcW4Z6PjCbnCs=', 'Content-Length': '0'} 2023-12-15T23:17:36.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e945ce24a6ae0576-00657cde90-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.981 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.982 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.982 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.982 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.982 DEBUG:boto:Method: GET 2023-12-15T23:17:36.982 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.982 DEBUG:boto:Data: 2023-12-15T23:17:36.982 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.982 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.982 DEBUG:boto:Params: {} 2023-12-15T23:17:36.983 DEBUG:boto:Token: None 2023-12-15T23:17:36.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000792a5293ae7f5f4f-00657cde90-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.985 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.986 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:36.986 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:36.986 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.986 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.986 DEBUG:boto:Method: GET 2023-12-15T23:17:36.986 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:17:36.986 DEBUG:boto:Data: 2023-12-15T23:17:36.986 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.987 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:36.987 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.987 DEBUG:boto:Params: {} 2023-12-15T23:17:36.987 DEBUG:boto:Token: None 2023-12-15T23:17:36.987 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/ 2023-12-15T23:17:36.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s= 2023-12-15T23:17:36.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wVaGDb7t4GLSF19v03LhzvCKr9s=', 'Content-Length': '0'} 2023-12-15T23:17:36.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000001f7784a3419b93-00657cde90-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:36.990 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:36.990 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:17:36.990 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:36.990 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:36.990 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:36.990 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:36.991 DEBUG:boto:Method: GET 2023-12-15T23:17:36.991 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:36.991 DEBUG:boto:Data: 2023-12-15T23:17:36.991 DEBUG:boto:Headers: {} 2023-12-15T23:17:36.991 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:36.991 DEBUG:boto:Port: 8000 2023-12-15T23:17:36.991 DEBUG:boto:Params: {} 2023-12-15T23:17:36.991 DEBUG:boto:Token: None 2023-12-15T23:17:36.991 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:36 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:36.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yAZ2FLvfpMFKODdW4vVVlJxQ4jE= 2023-12-15T23:17:36.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yAZ2FLvfpMFKODdW4vVVlJxQ4jE=', 'Content-Length': '0'} 2023-12-15T23:17:36.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004916139b6c6b8f03-00657cde90-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.037 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.038 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.038 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.038 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.038 DEBUG:boto:Method: GET 2023-12-15T23:17:37.038 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.038 DEBUG:boto:Data: 2023-12-15T23:17:37.038 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.038 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.038 DEBUG:boto:Params: {} 2023-12-15T23:17:37.039 DEBUG:boto:Token: None 2023-12-15T23:17:37.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc= 2023-12-15T23:17:37.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc=', 'Content-Length': '0'} 2023-12-15T23:17:37.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e77b79ad190272d-00657cde91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.041 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.041 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.042 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.042 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.042 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.042 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.042 DEBUG:boto:Data: 2023-12-15T23:17:37.042 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.042 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.042 DEBUG:boto:Params: {} 2023-12-15T23:17:37.042 DEBUG:boto:Token: None 2023-12-15T23:17:37.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SnquKTTXWXGIH5sX4NKtNmHG6Gs= 2023-12-15T23:17:37.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SnquKTTXWXGIH5sX4NKtNmHG6Gs=', 'Content-Length': '0'} 2023-12-15T23:17:37.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014819892be89aa2d-00657cde91-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.045 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.045 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.045 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.045 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.045 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.045 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.046 DEBUG:boto:Data: 2023-12-15T23:17:37.046 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.046 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.046 DEBUG:boto:Params: {} 2023-12-15T23:17:37.046 DEBUG:boto:Token: None 2023-12-15T23:17:37.046 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SnquKTTXWXGIH5sX4NKtNmHG6Gs= 2023-12-15T23:17:37.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SnquKTTXWXGIH5sX4NKtNmHG6Gs=', 'Content-Length': '0'} 2023-12-15T23:17:37.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7f85eb046438102-00657cde91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.049 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:17:37.049 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.049 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.049 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.049 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.049 DEBUG:boto:Method: GET 2023-12-15T23:17:37.050 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.050 DEBUG:boto:Data: 2023-12-15T23:17:37.050 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.050 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.050 DEBUG:boto:Params: {} 2023-12-15T23:17:37.050 DEBUG:boto:Token: None 2023-12-15T23:17:37.050 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc= 2023-12-15T23:17:37.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc=', 'Content-Length': '0'} 2023-12-15T23:17:37.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081eb648e02820bda-00657cde91-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.093 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.094 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.094 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.094 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.094 DEBUG:boto:Method: GET 2023-12-15T23:17:37.094 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.094 DEBUG:boto:Data: 2023-12-15T23:17:37.094 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.094 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.094 DEBUG:boto:Params: {} 2023-12-15T23:17:37.094 DEBUG:boto:Token: None 2023-12-15T23:17:37.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:17:37.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc= 2023-12-15T23:17:37.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Nd3QcU+PgU27r7GuDggBGs9gvkc=', 'Content-Length': '0'} 2023-12-15T23:17:37.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091687ca980012630-00657cde91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.097 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.097 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.098 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.098 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.098 DEBUG:boto:Method: GET 2023-12-15T23:17:37.098 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.098 DEBUG:boto:Data: 2023-12-15T23:17:37.098 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.098 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.098 DEBUG:boto:Params: {} 2023-12-15T23:17:37.098 DEBUG:boto:Token: None 2023-12-15T23:17:37.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM= 2023-12-15T23:17:37.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM=', 'Content-Length': '0'} 2023-12-15T23:17:37.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084f7988822a2033e-00657cde91-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.101 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:37.102 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.102 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.102 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.102 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.102 DEBUG:boto:Method: GET 2023-12-15T23:17:37.102 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.102 DEBUG:boto:Data: 2023-12-15T23:17:37.102 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.102 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.102 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.103 DEBUG:boto:Params: {} 2023-12-15T23:17:37.103 DEBUG:boto:Token: None 2023-12-15T23:17:37.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM= 2023-12-15T23:17:37.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM=', 'Content-Length': '0'} 2023-12-15T23:17:37.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008358e48bf4a806bd-00657cde91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.106 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:37.106 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.106 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.106 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.106 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:17:37.107 DEBUG:boto:Data: 2023-12-15T23:17:37.107 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.107 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.107 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.107 DEBUG:boto:Params: {} 2023-12-15T23:17:37.107 DEBUG:boto:Token: None 2023-12-15T23:17:37.107 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85 2023-12-15T23:17:37.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:anUn1Qrz4PoVLQH6Bupadq+aNtk= 2023-12-15T23:17:37.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:anUn1Qrz4PoVLQH6Bupadq+aNtk=', 'Content-Length': '0'} 2023-12-15T23:17:37.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eae63f2b38e50682-00657cde91-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.110 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.110 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.110 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.110 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:17:37.110 DEBUG:boto:Data: 2023-12-15T23:17:37.110 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.110 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.111 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.111 DEBUG:boto:Params: {} 2023-12-15T23:17:37.111 DEBUG:boto:Token: None 2023-12-15T23:17:37.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85 2023-12-15T23:17:37.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:anUn1Qrz4PoVLQH6Bupadq+aNtk= 2023-12-15T23:17:37.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:anUn1Qrz4PoVLQH6Bupadq+aNtk=', 'Content-Length': '0'} 2023-12-15T23:17:37.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045a3705e43bfe332-00657cde91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:17:37.113 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.113 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.114 DEBUG:boto:Method: GET 2023-12-15T23:17:37.114 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:17:37.114 DEBUG:boto:Data: 2023-12-15T23:17:37.114 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.114 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.114 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.114 DEBUG:boto:Params: {} 2023-12-15T23:17:37.114 DEBUG:boto:Token: None 2023-12-15T23:17:37.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85 2023-12-15T23:17:37.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qvNwiiD3JlhQfomYpMDo8RZ5ECk= 2023-12-15T23:17:37.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qvNwiiD3JlhQfomYpMDo8RZ5ECk=', 'Content-Length': '0'} 2023-12-15T23:17:37.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e7ff2e3aa47f760-00657cde91-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.157 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:17:37.158 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:17:37.158 DEBUG:boto:Method: GET 2023-12-15T23:17:37.158 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:17:37.158 DEBUG:boto:Data: 2023-12-15T23:17:37.158 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.158 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.158 DEBUG:boto:Params: {} 2023-12-15T23:17:37.158 DEBUG:boto:Token: None 2023-12-15T23:17:37.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj85 2023-12-15T23:17:37.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qvNwiiD3JlhQfomYpMDo8RZ5ECk= 2023-12-15T23:17:37.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qvNwiiD3JlhQfomYpMDo8RZ5ECk=', 'Content-Length': '0'} 2023-12-15T23:17:37.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8dabb35fd4412a-00657cde91-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.161 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.161 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.161 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.161 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.161 DEBUG:boto:Method: GET 2023-12-15T23:17:37.161 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.162 DEBUG:boto:Data: 2023-12-15T23:17:37.162 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:17:37.162 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.162 DEBUG:boto:Params: {} 2023-12-15T23:17:37.162 DEBUG:boto:Token: None 2023-12-15T23:17:37.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM= 2023-12-15T23:17:37.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM=', 'Content-Length': '0'} 2023-12-15T23:17:37.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052b08a693ddd5a69-00657cde91-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.165 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:37.165 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.166 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.166 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.166 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.166 DEBUG:boto:Method: GET 2023-12-15T23:17:37.166 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:17:37.166 DEBUG:boto:Data: 2023-12-15T23:17:37.166 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.166 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.166 DEBUG:boto:Params: {} 2023-12-15T23:17:37.166 DEBUG:boto:Token: None 2023-12-15T23:17:37.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM= 2023-12-15T23:17:37.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ourTAcXzLytHvfJx/LYzj4jr9DM=', 'Content-Length': '0'} 2023-12-15T23:17:37.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007daf6a1217fdea03-00657cde91-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.170 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:17:37.170 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:17:37.170 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:17:37.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:17:37.171 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:17:37.227 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:17:37.227 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:17:37.274 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:17:37.274 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:17:37.281 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 10 2023-12-15T23:17:37.332 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.332 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.332 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.333 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:37.333 DEBUG:boto:Data: 2023-12-15T23:17:37.333 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.333 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.333 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.333 DEBUG:boto:Params: {} 2023-12-15T23:17:37.333 DEBUG:boto:Token: None 2023-12-15T23:17:37.333 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.333 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU= 2023-12-15T23:17:37.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU=', 'Content-Length': '0'} 2023-12-15T23:17:37.336 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8bcadf2538fd838-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.336 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:17:37.336 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:17:37.336 DEBUG:boto:Method: PUT 2023-12-15T23:17:37.336 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:17:37.337 DEBUG:boto:Data: 2023-12-15T23:17:37.337 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:17:37.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.337 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.337 DEBUG:boto:Params: {} 2023-12-15T23:17:37.337 DEBUG:boto:Token: None 2023-12-15T23:17:37.337 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj19 2023-12-15T23:17:37.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lAVI8dtlYCCh0mnNaWb/nH+b+Rs= 2023-12-15T23:17:37.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lAVI8dtlYCCh0mnNaWb/nH+b+Rs='} 2023-12-15T23:17:37.343 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000030893dedc25d65e1-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.343 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.343 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.343 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.343 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:37.343 DEBUG:boto:Data: 2023-12-15T23:17:37.343 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.343 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.343 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.343 DEBUG:boto:Params: {} 2023-12-15T23:17:37.344 DEBUG:boto:Token: None 2023-12-15T23:17:37.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU= 2023-12-15T23:17:37.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU=', 'Content-Length': '0'} 2023-12-15T23:17:37.346 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a16d6acc2749f5bd-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.346 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:17:37.347 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:17:37.347 DEBUG:boto:Method: PUT 2023-12-15T23:17:37.347 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:17:37.347 DEBUG:boto:Data: 2023-12-15T23:17:37.347 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:17:37.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.347 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.347 DEBUG:boto:Params: {} 2023-12-15T23:17:37.347 DEBUG:boto:Token: None 2023-12-15T23:17:37.348 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj38 2023-12-15T23:17:37.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7h1mKkdfjsul838lv04WCtfPctI= 2023-12-15T23:17:37.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7h1mKkdfjsul838lv04WCtfPctI='} 2023-12-15T23:17:37.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000007bdedd0ed98fb01-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.390 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.390 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.390 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.390 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:37.390 DEBUG:boto:Data: 2023-12-15T23:17:37.390 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.391 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.391 DEBUG:boto:Params: {} 2023-12-15T23:17:37.391 DEBUG:boto:Token: None 2023-12-15T23:17:37.391 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU= 2023-12-15T23:17:37.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU=', 'Content-Length': '0'} 2023-12-15T23:17:37.393 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cba23bc2617d2f16-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.394 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:17:37.394 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:17:37.394 DEBUG:boto:Method: PUT 2023-12-15T23:17:37.394 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:17:37.394 DEBUG:boto:Data: 2023-12-15T23:17:37.394 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:17:37.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.394 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.394 DEBUG:boto:Params: {} 2023-12-15T23:17:37.395 DEBUG:boto:Token: None 2023-12-15T23:17:37.395 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj57 2023-12-15T23:17:37.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gFK0Y+ePufwgyjElsPCZWN0AhCs= 2023-12-15T23:17:37.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gFK0Y+ePufwgyjElsPCZWN0AhCs='} 2023-12-15T23:17:37.399 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000beae01f629508588-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.399 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.399 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.399 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.400 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:37.400 DEBUG:boto:Data: 2023-12-15T23:17:37.400 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.400 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.400 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.400 DEBUG:boto:Params: {} 2023-12-15T23:17:37.400 DEBUG:boto:Token: None 2023-12-15T23:17:37.400 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.400 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU= 2023-12-15T23:17:37.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU=', 'Content-Length': '0'} 2023-12-15T23:17:37.402 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da1fc62f4f9d0875-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.403 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:17:37.403 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:17:37.403 DEBUG:boto:Method: PUT 2023-12-15T23:17:37.403 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:17:37.403 DEBUG:boto:Data: 2023-12-15T23:17:37.403 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:17:37.403 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.403 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.403 DEBUG:boto:Params: {} 2023-12-15T23:17:37.404 DEBUG:boto:Token: None 2023-12-15T23:17:37.404 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj76 2023-12-15T23:17:37.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6z3b/mC50gvOwIZuzRdzOe0xKqU= 2023-12-15T23:17:37.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6z3b/mC50gvOwIZuzRdzOe0xKqU='} 2023-12-15T23:17:37.445 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfebbf95dd329988-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.446 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:17:37.446 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:17:37.446 DEBUG:boto:Method: HEAD 2023-12-15T23:17:37.446 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:17:37.446 DEBUG:boto:Data: 2023-12-15T23:17:37.446 DEBUG:boto:Headers: {} 2023-12-15T23:17:37.446 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.446 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.446 DEBUG:boto:Params: {} 2023-12-15T23:17:37.447 DEBUG:boto:Token: None 2023-12-15T23:17:37.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/ 2023-12-15T23:17:37.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU= 2023-12-15T23:17:37.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hq/fyz/IrkzH9gKSLuzMJcML8nU=', 'Content-Length': '0'} 2023-12-15T23:17:37.449 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d43db61c6e0aa3ee-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.449 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:17:37.450 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:17:37.450 DEBUG:boto:Method: PUT 2023-12-15T23:17:37.450 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:17:37.450 DEBUG:boto:Data: 2023-12-15T23:17:37.450 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:17:37.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:17:37.450 DEBUG:boto:Port: 8000 2023-12-15T23:17:37.450 DEBUG:boto:Params: {} 2023-12-15T23:17:37.450 DEBUG:boto:Token: None 2023-12-15T23:17:37.450 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:17:37 GMT /kskgfn-49/obj95 2023-12-15T23:17:37.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NHO2dOaP+I3b0S8EmEIib9wWTv8= 2023-12-15T23:17:37.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:17:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NHO2dOaP+I3b0S8EmEIib9wWTv8='} 2023-12-15T23:17:37.454 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7744294c5b0eb8f-00657cde91-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:17:37.455 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:17:37.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:17:37.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:17:37.455 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:17:37.515 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:17:37.515 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:17:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:37.552+0000 7fab9dd25800 1 waiting to reach latest gen 2, on 1.. 2023-12-15T23:17:42.555 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:42.554+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:42.556 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2023-12-15T23:17:42.556 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:17:47.557 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:47.555+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:47.557 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2023-12-15T23:17:47.557 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:17:52.558 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:52.557+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:52.558 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2023-12-15T23:17:52.559 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:17:57.560 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:17:57.558+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:17:57.560 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2023-12-15T23:17:57.560 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:02.561 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:02.560+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:02.561 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:02.561 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:07.563 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:07.561+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:07.563 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:07.563 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:12.564 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:12.563+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:12.565 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:12.565 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:17.566 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:17.563+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:17.566 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:17.566 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:22.567 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:22.565+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:22.567 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:22.567 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:27.568 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:27.567+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:27.569 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:27.569 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:32.570 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:32.568+0000 7fab9dd25800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:32.570 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:32.571 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:37.570+0000 7fab9dd25800 1 bucket sync caught up with source: 2023-12-15T23:18:37.572 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:37.572 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.55.6, 00000000004.81.6, , , , , , , , , , , ] 2023-12-15T23:18:37.572 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:37.570+0000 7fab9dd25800 0 bucket checkpoint complete 2023-12-15T23:18:37.590 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:18:37.590 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:18:37.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:18:37.591 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:18:37.651 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:18:37.651 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:18:37.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:18:37.688+0000 7f83b8725800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:37.689 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000001.126.6, 00000000001.83.6, , 00000000001.150.6, , , 00000000002.91.6, 00000000004.105.6, 00000000003.99.6] 2023-12-15T23:18:37.690 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000001.126.6, 00000000001.83.6, 00000000001.132.6, 00000000001.150.6, , , 00000000002.91.6, 00000000004.105.6, 00000000003.99.6] 2023-12-15T23:18:42.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:18:42.689+0000 7f83b8725800 1 bucket sync caught up with source: 2023-12-15T23:18:42.691 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000001.126.6, 00000000001.83.6, 00000000001.132.6, 00000000001.150.6, , , 00000000002.91.6, 00000000004.105.6, 00000000003.99.6] 2023-12-15T23:18:42.691 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000001.126.6, 00000000001.83.6, 00000000001.132.6, 00000000001.150.6, , , 00000000002.91.6, 00000000004.105.6, 00000000003.99.6] 2023-12-15T23:18:42.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:18:42.690+0000 7f83b8725800 0 bucket checkpoint complete 2023-12-15T23:18:42.711 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:18:42.711 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.711 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.711 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.711 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:42.712 DEBUG:boto:Data: 2023-12-15T23:18:42.712 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.712 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.712 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.712 DEBUG:boto:Params: {} 2023-12-15T23:18:42.712 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:18:42.712 DEBUG:boto:Token: None 2023-12-15T23:18:42.712 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4E6hQbzAaZO898DD6xFJBEEZhTA= 2023-12-15T23:18:42.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4E6hQbzAaZO898DD6xFJBEEZhTA=', 'Content-Length': '0'} 2023-12-15T23:18:42.717 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001333446e48d6a8c9-00657cded2-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.717 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.717 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.717 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.717 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:42.718 DEBUG:boto:Data: 2023-12-15T23:18:42.718 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.718 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.718 DEBUG:boto:Params: {} 2023-12-15T23:18:42.718 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:18:42.718 DEBUG:boto:Token: None 2023-12-15T23:18:42.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4E6hQbzAaZO898DD6xFJBEEZhTA= 2023-12-15T23:18:42.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4E6hQbzAaZO898DD6xFJBEEZhTA=', 'Content-Length': '0'} 2023-12-15T23:18:42.722 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bfdf025694ac0426-00657cded2-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.722 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:18:42.723 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.723 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.723 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.723 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.723 DEBUG:boto:Method: GET 2023-12-15T23:18:42.723 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.723 DEBUG:boto:Data: 2023-12-15T23:18:42.723 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.723 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.723 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.724 DEBUG:boto:Params: {} 2023-12-15T23:18:42.724 DEBUG:boto:Token: None 2023-12-15T23:18:42.724 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/?versions 2023-12-15T23:18:42.724 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o= 2023-12-15T23:18:42.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o=', 'Content-Length': '0'} 2023-12-15T23:18:42.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000919de70664df7c49-00657cded2-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.726 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:18:42.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:18:42.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:18:42.729 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:18:42.729 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.729 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.729 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.729 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.729 DEBUG:boto:Method: GET 2023-12-15T23:18:42.729 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.729 DEBUG:boto:Data: 2023-12-15T23:18:42.729 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.730 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.730 DEBUG:boto:Params: {} 2023-12-15T23:18:42.730 DEBUG:boto:Token: None 2023-12-15T23:18:42.730 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/?versions 2023-12-15T23:18:42.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o= 2023-12-15T23:18:42.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o=', 'Content-Length': '0'} 2023-12-15T23:18:42.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000638826af712869eb-00657cded2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.733 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:18:42.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:18:42.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:18:42.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:18:42.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:18:42.738 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.738 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.738 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.738 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.738 DEBUG:boto:Method: GET 2023-12-15T23:18:42.738 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.738 DEBUG:boto:Data: 2023-12-15T23:18:42.738 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.739 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.739 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.739 DEBUG:boto:Params: {} 2023-12-15T23:18:42.739 DEBUG:boto:Token: None 2023-12-15T23:18:42.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/?versions 2023-12-15T23:18:42.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o= 2023-12-15T23:18:42.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o=', 'Content-Length': '0'} 2023-12-15T23:18:42.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000890fb038a5b831f6-00657cded2-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.742 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.743 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.743 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.743 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.743 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.743 DEBUG:boto:Method: GET 2023-12-15T23:18:42.743 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:18:42.743 DEBUG:boto:Data: 2023-12-15T23:18:42.743 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.743 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.743 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.743 DEBUG:boto:Params: {} 2023-12-15T23:18:42.744 DEBUG:boto:Token: None 2023-12-15T23:18:42.744 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/?versions 2023-12-15T23:18:42.744 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o= 2023-12-15T23:18:42.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hhsDCzBs7sZhVLhjsHJ+Y37I63o=', 'Content-Length': '0'} 2023-12-15T23:18:42.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc235600f73c2d75-00657cded2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.747 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:18:42.748 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.748 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.748 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.748 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.748 DEBUG:boto:Method: GET 2023-12-15T23:18:42.748 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.748 DEBUG:boto:Data: 2023-12-15T23:18:42.748 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.748 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.749 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.749 DEBUG:boto:Params: {} 2023-12-15T23:18:42.749 DEBUG:boto:Token: None 2023-12-15T23:18:42.749 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.749 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk= 2023-12-15T23:18:42.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk=', 'Content-Length': '0'} 2023-12-15T23:18:42.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fa732e0356005b3-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.752 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.752 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.752 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.752 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.752 DEBUG:boto:Method: GET 2023-12-15T23:18:42.752 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.752 DEBUG:boto:Data: 2023-12-15T23:18:42.752 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.752 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.753 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.753 DEBUG:boto:Params: {} 2023-12-15T23:18:42.753 DEBUG:boto:Token: None 2023-12-15T23:18:42.753 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.753 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk= 2023-12-15T23:18:42.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk=', 'Content-Length': '0'} 2023-12-15T23:18:42.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000252813b1bfaa2f37-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.755 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.756 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.756 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.756 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.756 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.756 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.756 DEBUG:boto:Data: 2023-12-15T23:18:42.756 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.756 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.756 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.756 DEBUG:boto:Params: {} 2023-12-15T23:18:42.756 DEBUG:boto:Token: None 2023-12-15T23:18:42.757 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.757 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a6Z9tOhfa3cEiZ2f+zw3hMqxzsg= 2023-12-15T23:18:42.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a6Z9tOhfa3cEiZ2f+zw3hMqxzsg=', 'Content-Length': '0'} 2023-12-15T23:18:42.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2a78c7f0156f1dd-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.759 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.759 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.759 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.759 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.759 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.759 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.759 DEBUG:boto:Data: 2023-12-15T23:18:42.759 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.760 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.760 DEBUG:boto:Params: {} 2023-12-15T23:18:42.760 DEBUG:boto:Token: None 2023-12-15T23:18:42.760 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a6Z9tOhfa3cEiZ2f+zw3hMqxzsg= 2023-12-15T23:18:42.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a6Z9tOhfa3cEiZ2f+zw3hMqxzsg=', 'Content-Length': '0'} 2023-12-15T23:18:42.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c094d0d351e3ac04-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:18:42.763 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.763 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.763 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.763 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.763 DEBUG:boto:Method: GET 2023-12-15T23:18:42.763 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.763 DEBUG:boto:Data: 2023-12-15T23:18:42.763 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.763 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.763 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.764 DEBUG:boto:Params: {} 2023-12-15T23:18:42.764 DEBUG:boto:Token: None 2023-12-15T23:18:42.764 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk= 2023-12-15T23:18:42.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk=', 'Content-Length': '0'} 2023-12-15T23:18:42.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b86d46553a9a350-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.809 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.810 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.810 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.810 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.810 DEBUG:boto:Method: GET 2023-12-15T23:18:42.810 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.810 DEBUG:boto:Data: 2023-12-15T23:18:42.810 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.810 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.810 DEBUG:boto:Params: {} 2023-12-15T23:18:42.810 DEBUG:boto:Token: None 2023-12-15T23:18:42.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:18:42.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk= 2023-12-15T23:18:42.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpPzD+IUILFseeUIgNEGanCybUk=', 'Content-Length': '0'} 2023-12-15T23:18:42.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001287c8f15713fef7-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.813 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.813 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.813 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.814 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.814 DEBUG:boto:Method: GET 2023-12-15T23:18:42.814 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.814 DEBUG:boto:Data: 2023-12-15T23:18:42.814 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.814 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.814 DEBUG:boto:Params: {} 2023-12-15T23:18:42.814 DEBUG:boto:Token: None 2023-12-15T23:18:42.814 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:42.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000403bda39b1f9c99a-00657cded2-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.817 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.818 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.818 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.818 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.818 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.818 DEBUG:boto:Method: GET 2023-12-15T23:18:42.818 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.818 DEBUG:boto:Data: 2023-12-15T23:18:42.818 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.818 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.818 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.818 DEBUG:boto:Params: {} 2023-12-15T23:18:42.819 DEBUG:boto:Token: None 2023-12-15T23:18:42.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:42.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000dbd5f85e09f7e7a-00657cded2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.821 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.822 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.822 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.822 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.822 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:18:42.822 DEBUG:boto:Data: 2023-12-15T23:18:42.822 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.822 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.822 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.822 DEBUG:boto:Params: {} 2023-12-15T23:18:42.823 DEBUG:boto:Token: None 2023-12-15T23:18:42.823 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11 2023-12-15T23:18:42.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V6UayjDKi/wsRPznV7q1b/4SF88= 2023-12-15T23:18:42.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V6UayjDKi/wsRPznV7q1b/4SF88=', 'Content-Length': '0'} 2023-12-15T23:18:42.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b3ffdd93f661b62-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.825 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.825 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.825 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.825 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:18:42.825 DEBUG:boto:Data: 2023-12-15T23:18:42.826 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.826 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.826 DEBUG:boto:Params: {} 2023-12-15T23:18:42.826 DEBUG:boto:Token: None 2023-12-15T23:18:42.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11 2023-12-15T23:18:42.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V6UayjDKi/wsRPznV7q1b/4SF88= 2023-12-15T23:18:42.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V6UayjDKi/wsRPznV7q1b/4SF88=', 'Content-Length': '0'} 2023-12-15T23:18:42.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ead57f3e21d744ef-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:18:42.829 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.829 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.829 DEBUG:boto:Method: GET 2023-12-15T23:18:42.829 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:18:42.829 DEBUG:boto:Data: 2023-12-15T23:18:42.829 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.829 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.830 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.830 DEBUG:boto:Params: {} 2023-12-15T23:18:42.830 DEBUG:boto:Token: None 2023-12-15T23:18:42.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11 2023-12-15T23:18:42.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAl+wRpoYBjFo7RHT0RXbPDcdbs= 2023-12-15T23:18:42.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAl+wRpoYBjFo7RHT0RXbPDcdbs=', 'Content-Length': '0'} 2023-12-15T23:18:42.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a266fd6fa5780480-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.873 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:18:42.874 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:18:42.874 DEBUG:boto:Method: GET 2023-12-15T23:18:42.874 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:18:42.874 DEBUG:boto:Data: 2023-12-15T23:18:42.874 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.874 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.874 DEBUG:boto:Params: {} 2023-12-15T23:18:42.874 DEBUG:boto:Token: None 2023-12-15T23:18:42.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj11 2023-12-15T23:18:42.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CAl+wRpoYBjFo7RHT0RXbPDcdbs= 2023-12-15T23:18:42.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CAl+wRpoYBjFo7RHT0RXbPDcdbs=', 'Content-Length': '0'} 2023-12-15T23:18:42.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4048bbebcd69c96-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.877 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.877 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.877 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.877 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.877 DEBUG:boto:Method: GET 2023-12-15T23:18:42.877 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.877 DEBUG:boto:Data: 2023-12-15T23:18:42.878 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.878 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.878 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.878 DEBUG:boto:Params: {} 2023-12-15T23:18:42.878 DEBUG:boto:Token: None 2023-12-15T23:18:42.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:42.880 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000246f69940b3be973-00657cded2-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.881 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.881 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.881 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.881 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.881 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.881 DEBUG:boto:Method: GET 2023-12-15T23:18:42.881 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:18:42.882 DEBUG:boto:Data: 2023-12-15T23:18:42.882 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.882 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.882 DEBUG:boto:Params: {} 2023-12-15T23:18:42.882 DEBUG:boto:Token: None 2023-12-15T23:18:42.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:42.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e90eef3002bcc3e-00657cded2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.885 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.885 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:18:42.886 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.886 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.886 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.886 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.886 DEBUG:boto:Method: GET 2023-12-15T23:18:42.886 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.886 DEBUG:boto:Data: 2023-12-15T23:18:42.886 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.886 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.886 DEBUG:boto:Params: {} 2023-12-15T23:18:42.887 DEBUG:boto:Token: None 2023-12-15T23:18:42.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc= 2023-12-15T23:18:42.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc=', 'Content-Length': '0'} 2023-12-15T23:18:42.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd4eb93e81905d87-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.889 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.889 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.889 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.889 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.889 DEBUG:boto:Method: GET 2023-12-15T23:18:42.890 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.890 DEBUG:boto:Data: 2023-12-15T23:18:42.890 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.890 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.890 DEBUG:boto:Params: {} 2023-12-15T23:18:42.890 DEBUG:boto:Token: None 2023-12-15T23:18:42.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc= 2023-12-15T23:18:42.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc=', 'Content-Length': '0'} 2023-12-15T23:18:42.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0d62e5497a25aaf-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.892 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.893 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.893 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.893 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.893 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.893 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.893 DEBUG:boto:Data: 2023-12-15T23:18:42.893 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.893 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.893 DEBUG:boto:Params: {} 2023-12-15T23:18:42.893 DEBUG:boto:Token: None 2023-12-15T23:18:42.894 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bDkASp0fvive1GxIoilaSB1dhVc= 2023-12-15T23:18:42.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bDkASp0fvive1GxIoilaSB1dhVc=', 'Content-Length': '0'} 2023-12-15T23:18:42.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071d9dcc464f41b53-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.896 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.896 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.896 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.896 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.896 DEBUG:boto:Method: HEAD 2023-12-15T23:18:42.896 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.896 DEBUG:boto:Data: 2023-12-15T23:18:42.896 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.896 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.896 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.897 DEBUG:boto:Params: {} 2023-12-15T23:18:42.897 DEBUG:boto:Token: None 2023-12-15T23:18:42.897 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bDkASp0fvive1GxIoilaSB1dhVc= 2023-12-15T23:18:42.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bDkASp0fvive1GxIoilaSB1dhVc=', 'Content-Length': '0'} 2023-12-15T23:18:42.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0461865d2c2017c-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:18:42.899 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.899 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.899 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.899 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.899 DEBUG:boto:Method: GET 2023-12-15T23:18:42.900 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.900 DEBUG:boto:Data: 2023-12-15T23:18:42.900 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.900 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.900 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.900 DEBUG:boto:Params: {} 2023-12-15T23:18:42.900 DEBUG:boto:Token: None 2023-12-15T23:18:42.900 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc= 2023-12-15T23:18:42.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc=', 'Content-Length': '0'} 2023-12-15T23:18:42.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020c0173b436a8cf1-00657cded2-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.949 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:42.950 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:42.950 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.950 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.950 DEBUG:boto:Method: GET 2023-12-15T23:18:42.950 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.950 DEBUG:boto:Data: 2023-12-15T23:18:42.950 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.950 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.950 DEBUG:boto:Params: {} 2023-12-15T23:18:42.951 DEBUG:boto:Token: None 2023-12-15T23:18:42.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:18:42.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc= 2023-12-15T23:18:42.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XEhquNdfqwWVc802X7bVNpW8sSc=', 'Content-Length': '0'} 2023-12-15T23:18:42.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e283700ebc598a2b-00657cded2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.953 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.954 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.954 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.954 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.954 DEBUG:boto:Method: GET 2023-12-15T23:18:42.954 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.954 DEBUG:boto:Data: 2023-12-15T23:18:42.954 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.954 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:42.954 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.954 DEBUG:boto:Params: {} 2023-12-15T23:18:42.954 DEBUG:boto:Token: None 2023-12-15T23:18:42.954 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:42.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a82a51e1c424c95d-00657cded2-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:42 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:42.997 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:42.998 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:42.998 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:42.998 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.998 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.998 DEBUG:boto:Method: GET 2023-12-15T23:18:42.998 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:18:42.998 DEBUG:boto:Data: 2023-12-15T23:18:42.998 DEBUG:boto:Headers: {} 2023-12-15T23:18:42.999 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:42.999 DEBUG:boto:Port: 8000 2023-12-15T23:18:42.999 DEBUG:boto:Params: {} 2023-12-15T23:18:42.999 DEBUG:boto:Token: None 2023-12-15T23:18:42.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:42 GMT /kskgfn-49/ 2023-12-15T23:18:42.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo= 2023-12-15T23:18:42.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:42 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Djj+NpS9iN/Do2rR+Al6vhM8eTo=', 'Content-Length': '0'} 2023-12-15T23:18:43.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003eeb57f49e0b964-00657cded2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.002 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.002 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:43.002 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:43.002 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.003 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:18:43.003 DEBUG:boto:Data: 2023-12-15T23:18:43.003 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.003 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.003 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.003 DEBUG:boto:Params: {} 2023-12-15T23:18:43.003 DEBUG:boto:Token: None 2023-12-15T23:18:43.003 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj17 2023-12-15T23:18:43.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A+xwNXvfmF1voDwMRxxdPp5TeqE= 2023-12-15T23:18:43.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A+xwNXvfmF1voDwMRxxdPp5TeqE=', 'Content-Length': '0'} 2023-12-15T23:18:43.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008189dff8ff797964-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.006 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:43.006 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:43.006 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.006 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:18:43.006 DEBUG:boto:Data: 2023-12-15T23:18:43.006 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.006 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.006 DEBUG:boto:Params: {} 2023-12-15T23:18:43.006 DEBUG:boto:Token: None 2023-12-15T23:18:43.006 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj17 2023-12-15T23:18:43.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A+xwNXvfmF1voDwMRxxdPp5TeqE= 2023-12-15T23:18:43.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A+xwNXvfmF1voDwMRxxdPp5TeqE=', 'Content-Length': '0'} 2023-12-15T23:18:43.008 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e126efb80212478-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.009 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:18:43.009 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:43.009 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:43.009 DEBUG:boto:Method: GET 2023-12-15T23:18:43.009 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:18:43.009 DEBUG:boto:Data: 2023-12-15T23:18:43.009 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.009 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.009 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.010 DEBUG:boto:Params: {} 2023-12-15T23:18:43.010 DEBUG:boto:Token: None 2023-12-15T23:18:43.010 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj17 2023-12-15T23:18:43.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3btvHwfUhlkBOsPXA0Pb0oMP4NY= 2023-12-15T23:18:43.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3btvHwfUhlkBOsPXA0Pb0oMP4NY=', 'Content-Length': '0'} 2023-12-15T23:18:43.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081ba3608c97c4890-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.054 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:18:43.054 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:18:43.054 DEBUG:boto:Method: GET 2023-12-15T23:18:43.054 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:18:43.054 DEBUG:boto:Data: 2023-12-15T23:18:43.054 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.054 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.054 DEBUG:boto:Params: {} 2023-12-15T23:18:43.055 DEBUG:boto:Token: None 2023-12-15T23:18:43.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj17 2023-12-15T23:18:43.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3btvHwfUhlkBOsPXA0Pb0oMP4NY= 2023-12-15T23:18:43.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3btvHwfUhlkBOsPXA0Pb0oMP4NY=', 'Content-Length': '0'} 2023-12-15T23:18:43.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000764fd0190a90b3d3-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.057 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.057 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.057 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.057 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.057 DEBUG:boto:Method: GET 2023-12-15T23:18:43.057 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.057 DEBUG:boto:Data: 2023-12-15T23:18:43.058 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.058 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.058 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.058 DEBUG:boto:Params: {} 2023-12-15T23:18:43.058 DEBUG:boto:Token: None 2023-12-15T23:18:43.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.060 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005cf5f312ba7c6271-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.061 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.061 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.061 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.061 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.061 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.061 DEBUG:boto:Method: GET 2023-12-15T23:18:43.061 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:18:43.062 DEBUG:boto:Data: 2023-12-15T23:18:43.062 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.062 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.062 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.062 DEBUG:boto:Params: {} 2023-12-15T23:18:43.062 DEBUG:boto:Token: None 2023-12-15T23:18:43.062 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e510dda0584cad58-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.065 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:18:43.065 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.065 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.066 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.066 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.066 DEBUG:boto:Method: GET 2023-12-15T23:18:43.066 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.066 DEBUG:boto:Data: 2023-12-15T23:18:43.066 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.066 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.066 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.066 DEBUG:boto:Params: {} 2023-12-15T23:18:43.066 DEBUG:boto:Token: None 2023-12-15T23:18:43.066 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY= 2023-12-15T23:18:43.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY=', 'Content-Length': '0'} 2023-12-15T23:18:43.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cba620c8e0cfb67b-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.069 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.069 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.069 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.069 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.070 DEBUG:boto:Method: GET 2023-12-15T23:18:43.070 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.070 DEBUG:boto:Data: 2023-12-15T23:18:43.070 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.070 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.070 DEBUG:boto:Params: {} 2023-12-15T23:18:43.070 DEBUG:boto:Token: None 2023-12-15T23:18:43.070 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY= 2023-12-15T23:18:43.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY=', 'Content-Length': '0'} 2023-12-15T23:18:43.072 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000253cbd345860f685-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.073 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.073 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.073 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.073 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.073 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.073 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.073 DEBUG:boto:Data: 2023-12-15T23:18:43.073 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.073 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.073 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.073 DEBUG:boto:Params: {} 2023-12-15T23:18:43.074 DEBUG:boto:Token: None 2023-12-15T23:18:43.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.074 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BNE4vwI0Y3VW3hwENk0AoNRh6Uk= 2023-12-15T23:18:43.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BNE4vwI0Y3VW3hwENk0AoNRh6Uk=', 'Content-Length': '0'} 2023-12-15T23:18:43.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbb04ee6795a966e-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.076 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.076 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.076 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.077 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.077 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.077 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.077 DEBUG:boto:Data: 2023-12-15T23:18:43.077 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.077 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.077 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.077 DEBUG:boto:Params: {} 2023-12-15T23:18:43.077 DEBUG:boto:Token: None 2023-12-15T23:18:43.077 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BNE4vwI0Y3VW3hwENk0AoNRh6Uk= 2023-12-15T23:18:43.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BNE4vwI0Y3VW3hwENk0AoNRh6Uk=', 'Content-Length': '0'} 2023-12-15T23:18:43.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fcb6e6e2a5087a5-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:18:43.080 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.080 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.080 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.081 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.081 DEBUG:boto:Method: GET 2023-12-15T23:18:43.081 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.081 DEBUG:boto:Data: 2023-12-15T23:18:43.081 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.081 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.081 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.081 DEBUG:boto:Params: {} 2023-12-15T23:18:43.081 DEBUG:boto:Token: None 2023-12-15T23:18:43.081 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY= 2023-12-15T23:18:43.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY=', 'Content-Length': '0'} 2023-12-15T23:18:43.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c124bb4ba08423c-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.125 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.125 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.126 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.126 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.126 DEBUG:boto:Method: GET 2023-12-15T23:18:43.126 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.126 DEBUG:boto:Data: 2023-12-15T23:18:43.126 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.126 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.126 DEBUG:boto:Params: {} 2023-12-15T23:18:43.126 DEBUG:boto:Token: None 2023-12-15T23:18:43.126 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:18:43.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY= 2023-12-15T23:18:43.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ectsE+0/vJOBnsj3LXqyQzX/qNY=', 'Content-Length': '0'} 2023-12-15T23:18:43.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0ff56cad33bba6c-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.129 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.129 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.129 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.129 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.129 DEBUG:boto:Method: GET 2023-12-15T23:18:43.129 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.130 DEBUG:boto:Data: 2023-12-15T23:18:43.130 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.130 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.130 DEBUG:boto:Params: {} 2023-12-15T23:18:43.130 DEBUG:boto:Token: None 2023-12-15T23:18:43.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045afac4609f0ec4f-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.177 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.178 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.178 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.178 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.178 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.178 DEBUG:boto:Method: GET 2023-12-15T23:18:43.178 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.178 DEBUG:boto:Data: 2023-12-15T23:18:43.178 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.179 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.179 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.179 DEBUG:boto:Params: {} 2023-12-15T23:18:43.179 DEBUG:boto:Token: None 2023-12-15T23:18:43.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bd1b1b75890b0ea-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.182 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.182 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.182 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.182 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.183 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:18:43.183 DEBUG:boto:Data: 2023-12-15T23:18:43.183 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.183 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.183 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.183 DEBUG:boto:Params: {} 2023-12-15T23:18:43.183 DEBUG:boto:Token: None 2023-12-15T23:18:43.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19 2023-12-15T23:18:43.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4yROvdrJ0cy46I34S/FdfMDick= 2023-12-15T23:18:43.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4yROvdrJ0cy46I34S/FdfMDick=', 'Content-Length': '0'} 2023-12-15T23:18:43.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060a103a4d369e668-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.186 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.186 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.186 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.186 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:18:43.186 DEBUG:boto:Data: 2023-12-15T23:18:43.186 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.186 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.186 DEBUG:boto:Params: {} 2023-12-15T23:18:43.186 DEBUG:boto:Token: None 2023-12-15T23:18:43.187 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19 2023-12-15T23:18:43.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V4yROvdrJ0cy46I34S/FdfMDick= 2023-12-15T23:18:43.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V4yROvdrJ0cy46I34S/FdfMDick=', 'Content-Length': '0'} 2023-12-15T23:18:43.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfedaa1fd8c5036e-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.189 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:18:43.189 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.189 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.189 DEBUG:boto:Method: GET 2023-12-15T23:18:43.190 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:18:43.190 DEBUG:boto:Data: 2023-12-15T23:18:43.190 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.190 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.190 DEBUG:boto:Params: {} 2023-12-15T23:18:43.190 DEBUG:boto:Token: None 2023-12-15T23:18:43.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19 2023-12-15T23:18:43.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J9oLpXJUhPFl7J0iuvo7xpN16RU= 2023-12-15T23:18:43.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J9oLpXJUhPFl7J0iuvo7xpN16RU=', 'Content-Length': '0'} 2023-12-15T23:18:43.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7c2de30d60a16d8-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.233 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:18:43.234 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:18:43.234 DEBUG:boto:Method: GET 2023-12-15T23:18:43.234 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:18:43.234 DEBUG:boto:Data: 2023-12-15T23:18:43.234 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.234 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.234 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.234 DEBUG:boto:Params: {} 2023-12-15T23:18:43.234 DEBUG:boto:Token: None 2023-12-15T23:18:43.234 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj19 2023-12-15T23:18:43.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J9oLpXJUhPFl7J0iuvo7xpN16RU= 2023-12-15T23:18:43.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J9oLpXJUhPFl7J0iuvo7xpN16RU=', 'Content-Length': '0'} 2023-12-15T23:18:43.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063941a01121fb5ac-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.237 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.237 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.237 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.237 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.238 DEBUG:boto:Method: GET 2023-12-15T23:18:43.238 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.238 DEBUG:boto:Data: 2023-12-15T23:18:43.238 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.238 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.238 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.238 DEBUG:boto:Params: {} 2023-12-15T23:18:43.238 DEBUG:boto:Token: None 2023-12-15T23:18:43.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088e075736cfe65d4-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.241 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.241 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.241 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.241 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.241 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.241 DEBUG:boto:Method: GET 2023-12-15T23:18:43.242 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:18:43.242 DEBUG:boto:Data: 2023-12-15T23:18:43.242 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.242 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.242 DEBUG:boto:Params: {} 2023-12-15T23:18:43.242 DEBUG:boto:Token: None 2023-12-15T23:18:43.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c2b351668a805354-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.245 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:18:43.246 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.246 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.246 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.246 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.246 DEBUG:boto:Method: GET 2023-12-15T23:18:43.246 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.246 DEBUG:boto:Data: 2023-12-15T23:18:43.246 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.246 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.247 DEBUG:boto:Params: {} 2023-12-15T23:18:43.247 DEBUG:boto:Token: None 2023-12-15T23:18:43.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ= 2023-12-15T23:18:43.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dbe2e4b6aaa647b-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.249 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.249 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.249 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.250 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.250 DEBUG:boto:Method: GET 2023-12-15T23:18:43.250 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.250 DEBUG:boto:Data: 2023-12-15T23:18:43.250 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.250 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.250 DEBUG:boto:Params: {} 2023-12-15T23:18:43.250 DEBUG:boto:Token: None 2023-12-15T23:18:43.250 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ= 2023-12-15T23:18:43.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003efd0fd1b43fcc9c-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.253 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.253 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.253 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.253 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.253 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.254 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.254 DEBUG:boto:Data: 2023-12-15T23:18:43.254 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.254 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.254 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.254 DEBUG:boto:Params: {} 2023-12-15T23:18:43.254 DEBUG:boto:Token: None 2023-12-15T23:18:43.254 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eQ123OLLBxOlv6WT70BzgAHzMTY= 2023-12-15T23:18:43.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eQ123OLLBxOlv6WT70BzgAHzMTY=', 'Content-Length': '0'} 2023-12-15T23:18:43.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000818c0fd69e99a7ed-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.256 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.256 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.257 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.257 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.257 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.257 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.257 DEBUG:boto:Data: 2023-12-15T23:18:43.257 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.257 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.257 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.257 DEBUG:boto:Params: {} 2023-12-15T23:18:43.258 DEBUG:boto:Token: None 2023-12-15T23:18:43.258 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eQ123OLLBxOlv6WT70BzgAHzMTY= 2023-12-15T23:18:43.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eQ123OLLBxOlv6WT70BzgAHzMTY=', 'Content-Length': '0'} 2023-12-15T23:18:43.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007377d9a93508662e-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:18:43.260 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.260 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.260 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.260 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.261 DEBUG:boto:Method: GET 2023-12-15T23:18:43.261 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.261 DEBUG:boto:Data: 2023-12-15T23:18:43.261 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.261 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.261 DEBUG:boto:Params: {} 2023-12-15T23:18:43.261 DEBUG:boto:Token: None 2023-12-15T23:18:43.261 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.261 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ= 2023-12-15T23:18:43.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001242079190f5f8ef-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.305 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.306 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.306 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.306 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.306 DEBUG:boto:Method: GET 2023-12-15T23:18:43.306 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.306 DEBUG:boto:Data: 2023-12-15T23:18:43.306 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.306 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.306 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.306 DEBUG:boto:Params: {} 2023-12-15T23:18:43.306 DEBUG:boto:Token: None 2023-12-15T23:18:43.306 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:18:43.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ= 2023-12-15T23:18:43.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mYbCU1ax3HTqTMpo4BDj7xztEpQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009d2e78d4374617b-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.309 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.309 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.309 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.309 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.309 DEBUG:boto:Method: GET 2023-12-15T23:18:43.309 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.310 DEBUG:boto:Data: 2023-12-15T23:18:43.310 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.310 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.310 DEBUG:boto:Params: {} 2023-12-15T23:18:43.310 DEBUG:boto:Token: None 2023-12-15T23:18:43.310 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048e27402f2d46339-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.357 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.358 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.358 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.358 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.358 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.358 DEBUG:boto:Method: GET 2023-12-15T23:18:43.358 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.358 DEBUG:boto:Data: 2023-12-15T23:18:43.359 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.359 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.359 DEBUG:boto:Params: {} 2023-12-15T23:18:43.359 DEBUG:boto:Token: None 2023-12-15T23:18:43.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003fac543d96ecd888-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.362 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.362 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.363 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.363 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.363 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:18:43.363 DEBUG:boto:Data: 2023-12-15T23:18:43.363 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.363 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.363 DEBUG:boto:Params: {} 2023-12-15T23:18:43.363 DEBUG:boto:Token: None 2023-12-15T23:18:43.363 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22 2023-12-15T23:18:43.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0bI+REajEbu4xDRxPQzoOc3y85M= 2023-12-15T23:18:43.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0bI+REajEbu4xDRxPQzoOc3y85M=', 'Content-Length': '0'} 2023-12-15T23:18:43.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff5ae442d3181c6e-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.366 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.366 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.366 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.366 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:18:43.366 DEBUG:boto:Data: 2023-12-15T23:18:43.366 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.366 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.366 DEBUG:boto:Params: {} 2023-12-15T23:18:43.366 DEBUG:boto:Token: None 2023-12-15T23:18:43.367 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22 2023-12-15T23:18:43.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0bI+REajEbu4xDRxPQzoOc3y85M= 2023-12-15T23:18:43.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0bI+REajEbu4xDRxPQzoOc3y85M=', 'Content-Length': '0'} 2023-12-15T23:18:43.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e93806ff15e2a0a-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:18:43.369 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.369 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.369 DEBUG:boto:Method: GET 2023-12-15T23:18:43.369 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:18:43.369 DEBUG:boto:Data: 2023-12-15T23:18:43.369 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.369 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.369 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.369 DEBUG:boto:Params: {} 2023-12-15T23:18:43.369 DEBUG:boto:Token: None 2023-12-15T23:18:43.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22 2023-12-15T23:18:43.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VJYTXAynQqaqMaak77ZNr743CEY= 2023-12-15T23:18:43.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VJYTXAynQqaqMaak77ZNr743CEY=', 'Content-Length': '0'} 2023-12-15T23:18:43.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004be6a36af64c5261-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.414 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:18:43.414 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:18:43.414 DEBUG:boto:Method: GET 2023-12-15T23:18:43.414 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:18:43.414 DEBUG:boto:Data: 2023-12-15T23:18:43.414 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.414 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.414 DEBUG:boto:Params: {} 2023-12-15T23:18:43.414 DEBUG:boto:Token: None 2023-12-15T23:18:43.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj22 2023-12-15T23:18:43.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VJYTXAynQqaqMaak77ZNr743CEY= 2023-12-15T23:18:43.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VJYTXAynQqaqMaak77ZNr743CEY=', 'Content-Length': '0'} 2023-12-15T23:18:43.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e26f77887e78917-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.417 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.417 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.417 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.418 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.418 DEBUG:boto:Method: GET 2023-12-15T23:18:43.418 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.418 DEBUG:boto:Data: 2023-12-15T23:18:43.418 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.418 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.418 DEBUG:boto:Params: {} 2023-12-15T23:18:43.418 DEBUG:boto:Token: None 2023-12-15T23:18:43.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084fbedbbdb7bfea5-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.421 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.421 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.421 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.422 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.422 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.422 DEBUG:boto:Method: GET 2023-12-15T23:18:43.422 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:18:43.422 DEBUG:boto:Data: 2023-12-15T23:18:43.422 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.422 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.422 DEBUG:boto:Params: {} 2023-12-15T23:18:43.422 DEBUG:boto:Token: None 2023-12-15T23:18:43.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9530ab3507e61cb-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.426 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.426 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:18:43.426 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.426 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.426 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.426 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.426 DEBUG:boto:Method: GET 2023-12-15T23:18:43.426 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.427 DEBUG:boto:Data: 2023-12-15T23:18:43.427 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.427 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.427 DEBUG:boto:Params: {} 2023-12-15T23:18:43.427 DEBUG:boto:Token: None 2023-12-15T23:18:43.427 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4= 2023-12-15T23:18:43.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4=', 'Content-Length': '0'} 2023-12-15T23:18:43.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000511ebbba2cf3cb91-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.430 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.430 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.430 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.430 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.430 DEBUG:boto:Method: GET 2023-12-15T23:18:43.430 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.430 DEBUG:boto:Data: 2023-12-15T23:18:43.430 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.430 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.430 DEBUG:boto:Params: {} 2023-12-15T23:18:43.430 DEBUG:boto:Token: None 2023-12-15T23:18:43.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4= 2023-12-15T23:18:43.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4=', 'Content-Length': '0'} 2023-12-15T23:18:43.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061f53bdb4e860b06-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.433 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.433 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.434 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.434 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.434 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.434 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.434 DEBUG:boto:Data: 2023-12-15T23:18:43.434 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.434 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.434 DEBUG:boto:Params: {} 2023-12-15T23:18:43.434 DEBUG:boto:Token: None 2023-12-15T23:18:43.434 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ePTaFc9/bwvLBC7m/Uy78mWiywQ= 2023-12-15T23:18:43.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ePTaFc9/bwvLBC7m/Uy78mWiywQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cac7ce14dc39b18f-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.437 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.437 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.437 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.437 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.437 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.437 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.437 DEBUG:boto:Data: 2023-12-15T23:18:43.437 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.437 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.438 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.438 DEBUG:boto:Params: {} 2023-12-15T23:18:43.438 DEBUG:boto:Token: None 2023-12-15T23:18:43.438 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ePTaFc9/bwvLBC7m/Uy78mWiywQ= 2023-12-15T23:18:43.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ePTaFc9/bwvLBC7m/Uy78mWiywQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b35f06a179df545c-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:18:43.441 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.441 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.441 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.441 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.441 DEBUG:boto:Method: GET 2023-12-15T23:18:43.441 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.441 DEBUG:boto:Data: 2023-12-15T23:18:43.441 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.442 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.442 DEBUG:boto:Params: {} 2023-12-15T23:18:43.442 DEBUG:boto:Token: None 2023-12-15T23:18:43.442 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4= 2023-12-15T23:18:43.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4=', 'Content-Length': '0'} 2023-12-15T23:18:43.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd6a5baf4dacb26c-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.485 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.486 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.486 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.486 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.486 DEBUG:boto:Method: GET 2023-12-15T23:18:43.486 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.486 DEBUG:boto:Data: 2023-12-15T23:18:43.486 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.486 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.486 DEBUG:boto:Params: {} 2023-12-15T23:18:43.487 DEBUG:boto:Token: None 2023-12-15T23:18:43.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:18:43.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4= 2023-12-15T23:18:43.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JexlpirWTn0KZuXYszV6t7DAAn4=', 'Content-Length': '0'} 2023-12-15T23:18:43.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009359d4bc0fd61507-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.489 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.490 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.490 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.490 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.490 DEBUG:boto:Method: GET 2023-12-15T23:18:43.490 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.490 DEBUG:boto:Data: 2023-12-15T23:18:43.490 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.490 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.490 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.490 DEBUG:boto:Params: {} 2023-12-15T23:18:43.490 DEBUG:boto:Token: None 2023-12-15T23:18:43.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7fd0e8b0d9a0eae-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.493 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.493 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.494 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.494 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.494 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.494 DEBUG:boto:Method: GET 2023-12-15T23:18:43.494 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.494 DEBUG:boto:Data: 2023-12-15T23:18:43.494 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.494 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.494 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.494 DEBUG:boto:Params: {} 2023-12-15T23:18:43.494 DEBUG:boto:Token: None 2023-12-15T23:18:43.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000302a8e91b3425f42-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.498 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.498 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.498 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.498 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.499 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:18:43.499 DEBUG:boto:Data: 2023-12-15T23:18:43.499 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.499 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.499 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.499 DEBUG:boto:Params: {} 2023-12-15T23:18:43.499 DEBUG:boto:Token: None 2023-12-15T23:18:43.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33 2023-12-15T23:18:43.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GNpk9uCwQgrUQMkmj2BrECN94KU= 2023-12-15T23:18:43.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GNpk9uCwQgrUQMkmj2BrECN94KU=', 'Content-Length': '0'} 2023-12-15T23:18:43.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085958480a0086335-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.502 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.502 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.502 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.502 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:18:43.502 DEBUG:boto:Data: 2023-12-15T23:18:43.502 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.502 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.502 DEBUG:boto:Params: {} 2023-12-15T23:18:43.503 DEBUG:boto:Token: None 2023-12-15T23:18:43.503 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33 2023-12-15T23:18:43.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GNpk9uCwQgrUQMkmj2BrECN94KU= 2023-12-15T23:18:43.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GNpk9uCwQgrUQMkmj2BrECN94KU=', 'Content-Length': '0'} 2023-12-15T23:18:43.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e5f70bf7e4af36f-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:18:43.506 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.506 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.506 DEBUG:boto:Method: GET 2023-12-15T23:18:43.506 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:18:43.506 DEBUG:boto:Data: 2023-12-15T23:18:43.506 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.506 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.506 DEBUG:boto:Params: {} 2023-12-15T23:18:43.506 DEBUG:boto:Token: None 2023-12-15T23:18:43.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33 2023-12-15T23:18:43.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KXzbeiXeQITd+dhpPFEJtrlWAS4= 2023-12-15T23:18:43.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KXzbeiXeQITd+dhpPFEJtrlWAS4=', 'Content-Length': '0'} 2023-12-15T23:18:43.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1db04f57cdbd316-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.549 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:18:43.552 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:18:43.552 DEBUG:boto:Method: GET 2023-12-15T23:18:43.552 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:18:43.552 DEBUG:boto:Data: 2023-12-15T23:18:43.552 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.552 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.552 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.552 DEBUG:boto:Params: {} 2023-12-15T23:18:43.553 DEBUG:boto:Token: None 2023-12-15T23:18:43.553 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj33 2023-12-15T23:18:43.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KXzbeiXeQITd+dhpPFEJtrlWAS4= 2023-12-15T23:18:43.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KXzbeiXeQITd+dhpPFEJtrlWAS4=', 'Content-Length': '0'} 2023-12-15T23:18:43.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd8e686baa9d4970-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.556 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.556 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.556 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.556 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.556 DEBUG:boto:Method: GET 2023-12-15T23:18:43.556 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.556 DEBUG:boto:Data: 2023-12-15T23:18:43.556 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.557 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.557 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.557 DEBUG:boto:Params: {} 2023-12-15T23:18:43.557 DEBUG:boto:Token: None 2023-12-15T23:18:43.557 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.557 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b22448c48fbc5a37-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.601 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.602 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.602 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.602 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.602 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.602 DEBUG:boto:Method: GET 2023-12-15T23:18:43.602 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:18:43.602 DEBUG:boto:Data: 2023-12-15T23:18:43.602 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.602 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.603 DEBUG:boto:Params: {} 2023-12-15T23:18:43.603 DEBUG:boto:Token: None 2023-12-15T23:18:43.603 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.605 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e8ca300ac11b6cf-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.606 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:18:43.606 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.606 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.606 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.606 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.606 DEBUG:boto:Method: GET 2023-12-15T23:18:43.607 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.607 DEBUG:boto:Data: 2023-12-15T23:18:43.607 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.607 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.607 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.607 DEBUG:boto:Params: {} 2023-12-15T23:18:43.607 DEBUG:boto:Token: None 2023-12-15T23:18:43.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A= 2023-12-15T23:18:43.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A=', 'Content-Length': '0'} 2023-12-15T23:18:43.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001af054b8c4d385c2-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.610 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.610 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.610 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.610 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.610 DEBUG:boto:Method: GET 2023-12-15T23:18:43.610 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.610 DEBUG:boto:Data: 2023-12-15T23:18:43.610 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.611 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.611 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.611 DEBUG:boto:Params: {} 2023-12-15T23:18:43.611 DEBUG:boto:Token: None 2023-12-15T23:18:43.611 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A= 2023-12-15T23:18:43.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A=', 'Content-Length': '0'} 2023-12-15T23:18:43.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000432aca7fcfff12d8-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.653 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.654 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.654 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.654 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.654 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.654 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.654 DEBUG:boto:Data: 2023-12-15T23:18:43.654 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.654 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.654 DEBUG:boto:Params: {} 2023-12-15T23:18:43.654 DEBUG:boto:Token: None 2023-12-15T23:18:43.654 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gWVcs24Gou4IIBuGQCkFw2WBzOI= 2023-12-15T23:18:43.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gWVcs24Gou4IIBuGQCkFw2WBzOI=', 'Content-Length': '0'} 2023-12-15T23:18:43.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a52724a2c523a38-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.657 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.657 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.657 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.657 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.658 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.658 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.658 DEBUG:boto:Data: 2023-12-15T23:18:43.658 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.658 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.658 DEBUG:boto:Params: {} 2023-12-15T23:18:43.658 DEBUG:boto:Token: None 2023-12-15T23:18:43.658 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gWVcs24Gou4IIBuGQCkFw2WBzOI= 2023-12-15T23:18:43.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gWVcs24Gou4IIBuGQCkFw2WBzOI=', 'Content-Length': '0'} 2023-12-15T23:18:43.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3f4869a05926be1-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:18:43.661 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.661 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.661 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.661 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.661 DEBUG:boto:Method: GET 2023-12-15T23:18:43.661 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.661 DEBUG:boto:Data: 2023-12-15T23:18:43.662 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.662 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.662 DEBUG:boto:Params: {} 2023-12-15T23:18:43.662 DEBUG:boto:Token: None 2023-12-15T23:18:43.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A= 2023-12-15T23:18:43.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A=', 'Content-Length': '0'} 2023-12-15T23:18:43.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e754e704d0c5d438-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.709 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.710 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.710 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.710 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.710 DEBUG:boto:Method: GET 2023-12-15T23:18:43.710 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.710 DEBUG:boto:Data: 2023-12-15T23:18:43.710 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.710 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.710 DEBUG:boto:Params: {} 2023-12-15T23:18:43.710 DEBUG:boto:Token: None 2023-12-15T23:18:43.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:18:43.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A= 2023-12-15T23:18:43.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jUR1yTrtRuttVXOK0vn63hhV5/A=', 'Content-Length': '0'} 2023-12-15T23:18:43.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a83770a8feb7770-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.713 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.713 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.714 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.714 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.714 DEBUG:boto:Method: GET 2023-12-15T23:18:43.714 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.714 DEBUG:boto:Data: 2023-12-15T23:18:43.714 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.714 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.714 DEBUG:boto:Params: {} 2023-12-15T23:18:43.714 DEBUG:boto:Token: None 2023-12-15T23:18:43.714 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.714 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cbdc8c2cc97de70-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.717 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.717 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.717 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.717 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.718 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.718 DEBUG:boto:Method: GET 2023-12-15T23:18:43.718 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.718 DEBUG:boto:Data: 2023-12-15T23:18:43.718 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.718 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.718 DEBUG:boto:Params: {} 2023-12-15T23:18:43.718 DEBUG:boto:Token: None 2023-12-15T23:18:43.718 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9fc766b5396be12-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.721 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.722 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.722 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.722 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.722 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:18:43.722 DEBUG:boto:Data: 2023-12-15T23:18:43.722 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.722 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.723 DEBUG:boto:Params: {} 2023-12-15T23:18:43.723 DEBUG:boto:Token: None 2023-12-15T23:18:43.723 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34 2023-12-15T23:18:43.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J1/LqbGszamWBRvRRnsWyXZ/22U= 2023-12-15T23:18:43.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J1/LqbGszamWBRvRRnsWyXZ/22U=', 'Content-Length': '0'} 2023-12-15T23:18:43.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c573f49369af4683-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.725 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.725 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.726 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.726 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:18:43.726 DEBUG:boto:Data: 2023-12-15T23:18:43.726 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.726 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.726 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.726 DEBUG:boto:Params: {} 2023-12-15T23:18:43.726 DEBUG:boto:Token: None 2023-12-15T23:18:43.726 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34 2023-12-15T23:18:43.726 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J1/LqbGszamWBRvRRnsWyXZ/22U= 2023-12-15T23:18:43.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J1/LqbGszamWBRvRRnsWyXZ/22U=', 'Content-Length': '0'} 2023-12-15T23:18:43.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed5d3606cf9af8a2-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.728 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:18:43.728 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.729 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.729 DEBUG:boto:Method: GET 2023-12-15T23:18:43.729 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:18:43.729 DEBUG:boto:Data: 2023-12-15T23:18:43.729 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.729 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.729 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.729 DEBUG:boto:Params: {} 2023-12-15T23:18:43.729 DEBUG:boto:Token: None 2023-12-15T23:18:43.729 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34 2023-12-15T23:18:43.729 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aGtGU7Qg/frCFQk0yAC54redKfQ= 2023-12-15T23:18:43.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aGtGU7Qg/frCFQk0yAC54redKfQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f96f3564027aa7f-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.773 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:18:43.774 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:18:43.774 DEBUG:boto:Method: GET 2023-12-15T23:18:43.774 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:18:43.774 DEBUG:boto:Data: 2023-12-15T23:18:43.774 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.774 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.774 DEBUG:boto:Params: {} 2023-12-15T23:18:43.774 DEBUG:boto:Token: None 2023-12-15T23:18:43.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj34 2023-12-15T23:18:43.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aGtGU7Qg/frCFQk0yAC54redKfQ= 2023-12-15T23:18:43.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aGtGU7Qg/frCFQk0yAC54redKfQ=', 'Content-Length': '0'} 2023-12-15T23:18:43.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035b185c75cc67c8a-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.777 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.777 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.777 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.778 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.778 DEBUG:boto:Method: GET 2023-12-15T23:18:43.778 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.778 DEBUG:boto:Data: 2023-12-15T23:18:43.778 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.778 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.778 DEBUG:boto:Params: {} 2023-12-15T23:18:43.778 DEBUG:boto:Token: None 2023-12-15T23:18:43.778 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022b59fdc794eb223-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.821 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.822 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.822 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.822 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.822 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.822 DEBUG:boto:Method: GET 2023-12-15T23:18:43.822 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:18:43.822 DEBUG:boto:Data: 2023-12-15T23:18:43.822 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.822 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.823 DEBUG:boto:Params: {} 2023-12-15T23:18:43.823 DEBUG:boto:Token: None 2023-12-15T23:18:43.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079307da6d8528bd3-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.826 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:18:43.826 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.826 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.826 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.826 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.827 DEBUG:boto:Method: GET 2023-12-15T23:18:43.827 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.827 DEBUG:boto:Data: 2023-12-15T23:18:43.827 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.827 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.827 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.827 DEBUG:boto:Params: {} 2023-12-15T23:18:43.827 DEBUG:boto:Token: None 2023-12-15T23:18:43.827 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.827 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw= 2023-12-15T23:18:43.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw=', 'Content-Length': '0'} 2023-12-15T23:18:43.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017dfc7ad69dddaca-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.830 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.830 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.830 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.830 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.830 DEBUG:boto:Method: GET 2023-12-15T23:18:43.830 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.830 DEBUG:boto:Data: 2023-12-15T23:18:43.830 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.831 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.831 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.831 DEBUG:boto:Params: {} 2023-12-15T23:18:43.831 DEBUG:boto:Token: None 2023-12-15T23:18:43.831 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw= 2023-12-15T23:18:43.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw=', 'Content-Length': '0'} 2023-12-15T23:18:43.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a3fc9361a6924f5-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.873 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.874 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.874 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.874 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.874 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.874 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.874 DEBUG:boto:Data: 2023-12-15T23:18:43.874 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.874 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.874 DEBUG:boto:Params: {} 2023-12-15T23:18:43.874 DEBUG:boto:Token: None 2023-12-15T23:18:43.874 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lB61XqyJnTjSlVF+ePO1Mr8aqqI= 2023-12-15T23:18:43.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lB61XqyJnTjSlVF+ePO1Mr8aqqI=', 'Content-Length': '0'} 2023-12-15T23:18:43.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009582400b5e6ecab9-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.877 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.877 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.877 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.877 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.877 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.877 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.878 DEBUG:boto:Data: 2023-12-15T23:18:43.878 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.878 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.878 DEBUG:boto:Params: {} 2023-12-15T23:18:43.878 DEBUG:boto:Token: None 2023-12-15T23:18:43.878 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lB61XqyJnTjSlVF+ePO1Mr8aqqI= 2023-12-15T23:18:43.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lB61XqyJnTjSlVF+ePO1Mr8aqqI=', 'Content-Length': '0'} 2023-12-15T23:18:43.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036232602229cbd67-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:18:43.881 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.881 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.881 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.881 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.881 DEBUG:boto:Method: GET 2023-12-15T23:18:43.881 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.881 DEBUG:boto:Data: 2023-12-15T23:18:43.881 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.881 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.881 DEBUG:boto:Params: {} 2023-12-15T23:18:43.882 DEBUG:boto:Token: None 2023-12-15T23:18:43.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw= 2023-12-15T23:18:43.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw=', 'Content-Length': '0'} 2023-12-15T23:18:43.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012d71947841d3a24-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.929 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.930 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.930 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.930 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.930 DEBUG:boto:Method: GET 2023-12-15T23:18:43.930 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.930 DEBUG:boto:Data: 2023-12-15T23:18:43.930 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.930 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.930 DEBUG:boto:Params: {} 2023-12-15T23:18:43.931 DEBUG:boto:Token: None 2023-12-15T23:18:43.931 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:18:43.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw= 2023-12-15T23:18:43.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dXs6+LMUqMJsHZJDGC5z13Vywtw=', 'Content-Length': '0'} 2023-12-15T23:18:43.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cee8ed8b80e6718c-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.933 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.933 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.933 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.933 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.934 DEBUG:boto:Method: GET 2023-12-15T23:18:43.934 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.934 DEBUG:boto:Data: 2023-12-15T23:18:43.934 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.934 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.934 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.934 DEBUG:boto:Params: {} 2023-12-15T23:18:43.934 DEBUG:boto:Token: None 2023-12-15T23:18:43.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3e0c3b7e323356b-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.937 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.937 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.938 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.938 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.938 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.938 DEBUG:boto:Method: GET 2023-12-15T23:18:43.938 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.938 DEBUG:boto:Data: 2023-12-15T23:18:43.938 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.938 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.938 DEBUG:boto:Params: {} 2023-12-15T23:18:43.938 DEBUG:boto:Token: None 2023-12-15T23:18:43.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:43.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c73adfd537920f6a-00657cded3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.941 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:43.942 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.942 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.942 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.942 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:18:43.942 DEBUG:boto:Data: 2023-12-15T23:18:43.942 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.942 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.942 DEBUG:boto:Params: {} 2023-12-15T23:18:43.943 DEBUG:boto:Token: None 2023-12-15T23:18:43.943 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38 2023-12-15T23:18:43.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZnCkItnlg5V2KdZHYs7qWP+uj+o= 2023-12-15T23:18:43.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZnCkItnlg5V2KdZHYs7qWP+uj+o=', 'Content-Length': '0'} 2023-12-15T23:18:43.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a525759be82b7da-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.945 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.945 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.945 DEBUG:boto:Method: HEAD 2023-12-15T23:18:43.945 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:18:43.945 DEBUG:boto:Data: 2023-12-15T23:18:43.945 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.946 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.946 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.946 DEBUG:boto:Params: {} 2023-12-15T23:18:43.946 DEBUG:boto:Token: None 2023-12-15T23:18:43.946 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38 2023-12-15T23:18:43.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZnCkItnlg5V2KdZHYs7qWP+uj+o= 2023-12-15T23:18:43.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZnCkItnlg5V2KdZHYs7qWP+uj+o=', 'Content-Length': '0'} 2023-12-15T23:18:43.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052fb275681bbfe37-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:18:43.948 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.949 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.949 DEBUG:boto:Method: GET 2023-12-15T23:18:43.949 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:18:43.949 DEBUG:boto:Data: 2023-12-15T23:18:43.949 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.949 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.949 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.949 DEBUG:boto:Params: {} 2023-12-15T23:18:43.949 DEBUG:boto:Token: None 2023-12-15T23:18:43.949 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38 2023-12-15T23:18:43.950 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+tVOfLS2km09A1TJpUT/7gp3hC8= 2023-12-15T23:18:43.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+tVOfLS2km09A1TJpUT/7gp3hC8=', 'Content-Length': '0'} 2023-12-15T23:18:43.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dec56a536a82d18-00657cded3-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.993 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:18:43.994 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:18:43.994 DEBUG:boto:Method: GET 2023-12-15T23:18:43.994 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:18:43.994 DEBUG:boto:Data: 2023-12-15T23:18:43.994 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:43.994 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.994 DEBUG:boto:Params: {} 2023-12-15T23:18:43.994 DEBUG:boto:Token: None 2023-12-15T23:18:43.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/obj38 2023-12-15T23:18:43.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+tVOfLS2km09A1TJpUT/7gp3hC8= 2023-12-15T23:18:43.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+tVOfLS2km09A1TJpUT/7gp3hC8=', 'Content-Length': '0'} 2023-12-15T23:18:43.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002924b6162dca91db-00657cded3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:43.997 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:43.997 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:43.997 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.997 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.997 DEBUG:boto:Method: GET 2023-12-15T23:18:43.997 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:18:43.997 DEBUG:boto:Data: 2023-12-15T23:18:43.997 DEBUG:boto:Headers: {} 2023-12-15T23:18:43.997 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:43.997 DEBUG:boto:Port: 8000 2023-12-15T23:18:43.998 DEBUG:boto:Params: {} 2023-12-15T23:18:43.998 DEBUG:boto:Token: None 2023-12-15T23:18:43.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:43 GMT /kskgfn-49/ 2023-12-15T23:18:43.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0= 2023-12-15T23:18:43.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:43 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CU4pOqOf8cH/2jk2ovVvcjPZDQ0=', 'Content-Length': '0'} 2023-12-15T23:18:44.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018562b48210ef712-00657cded3-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:43 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.041 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.042 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.042 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.042 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:44.042 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:18:44.042 DEBUG:boto:Method: GET 2023-12-15T23:18:44.042 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:18:44.042 DEBUG:boto:Data: 2023-12-15T23:18:44.042 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.043 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.043 DEBUG:boto:Params: {} 2023-12-15T23:18:44.043 DEBUG:boto:Token: None 2023-12-15T23:18:44.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b88b6cfeb11a604-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.046 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.046 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:18:44.046 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.046 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.047 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.047 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.047 DEBUG:boto:Method: GET 2023-12-15T23:18:44.047 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.047 DEBUG:boto:Data: 2023-12-15T23:18:44.047 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.047 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.047 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.047 DEBUG:boto:Params: {} 2023-12-15T23:18:44.047 DEBUG:boto:Token: None 2023-12-15T23:18:44.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc= 2023-12-15T23:18:44.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc=', 'Content-Length': '0'} 2023-12-15T23:18:44.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000356977476886cb40-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.050 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.050 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.050 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.050 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.050 DEBUG:boto:Method: GET 2023-12-15T23:18:44.050 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.050 DEBUG:boto:Data: 2023-12-15T23:18:44.051 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.051 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.051 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.051 DEBUG:boto:Params: {} 2023-12-15T23:18:44.051 DEBUG:boto:Token: None 2023-12-15T23:18:44.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc= 2023-12-15T23:18:44.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc=', 'Content-Length': '0'} 2023-12-15T23:18:44.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d73ebe4ad386cff4-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.053 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.054 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.054 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.054 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.054 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.054 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.054 DEBUG:boto:Data: 2023-12-15T23:18:44.054 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.054 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.054 DEBUG:boto:Params: {} 2023-12-15T23:18:44.054 DEBUG:boto:Token: None 2023-12-15T23:18:44.055 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U++pvr4M+hg2R36wP9pNZWh7Ujg= 2023-12-15T23:18:44.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U++pvr4M+hg2R36wP9pNZWh7Ujg=', 'Content-Length': '0'} 2023-12-15T23:18:44.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa26d3938d805edb-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.057 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.057 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.057 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.057 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.057 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.057 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.057 DEBUG:boto:Data: 2023-12-15T23:18:44.057 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.058 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.058 DEBUG:boto:Params: {} 2023-12-15T23:18:44.058 DEBUG:boto:Token: None 2023-12-15T23:18:44.058 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U++pvr4M+hg2R36wP9pNZWh7Ujg= 2023-12-15T23:18:44.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U++pvr4M+hg2R36wP9pNZWh7Ujg=', 'Content-Length': '0'} 2023-12-15T23:18:44.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c81db6ff0d58654-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:18:44.060 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.060 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.061 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.061 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.061 DEBUG:boto:Method: GET 2023-12-15T23:18:44.061 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.061 DEBUG:boto:Data: 2023-12-15T23:18:44.061 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.061 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.061 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.061 DEBUG:boto:Params: {} 2023-12-15T23:18:44.061 DEBUG:boto:Token: None 2023-12-15T23:18:44.062 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc= 2023-12-15T23:18:44.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc=', 'Content-Length': '0'} 2023-12-15T23:18:44.063 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe337c5d5389a268-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.105 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.106 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.106 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.106 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.106 DEBUG:boto:Method: GET 2023-12-15T23:18:44.106 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.106 DEBUG:boto:Data: 2023-12-15T23:18:44.106 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.106 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.106 DEBUG:boto:Params: {} 2023-12-15T23:18:44.106 DEBUG:boto:Token: None 2023-12-15T23:18:44.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:18:44.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc= 2023-12-15T23:18:44.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEgl1+OqjCYy6jOx5mvuEObzDUc=', 'Content-Length': '0'} 2023-12-15T23:18:44.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000258924580741ca5-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.109 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.109 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.109 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.109 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.110 DEBUG:boto:Method: GET 2023-12-15T23:18:44.110 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.110 DEBUG:boto:Data: 2023-12-15T23:18:44.110 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.110 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.110 DEBUG:boto:Params: {} 2023-12-15T23:18:44.110 DEBUG:boto:Token: None 2023-12-15T23:18:44.110 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8014c453a6b1b0e-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.153 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.154 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.154 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.154 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.154 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.154 DEBUG:boto:Method: GET 2023-12-15T23:18:44.154 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.154 DEBUG:boto:Data: 2023-12-15T23:18:44.154 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.155 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.155 DEBUG:boto:Params: {} 2023-12-15T23:18:44.155 DEBUG:boto:Token: None 2023-12-15T23:18:44.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000d0b12186f79aab-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.158 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.158 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.158 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.158 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.158 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:18:44.158 DEBUG:boto:Data: 2023-12-15T23:18:44.158 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.159 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.159 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.159 DEBUG:boto:Params: {} 2023-12-15T23:18:44.159 DEBUG:boto:Token: None 2023-12-15T23:18:44.159 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44 2023-12-15T23:18:44.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xwAxTCzmNWSpbtdvVObsltTFK3c= 2023-12-15T23:18:44.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xwAxTCzmNWSpbtdvVObsltTFK3c=', 'Content-Length': '0'} 2023-12-15T23:18:44.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5b0709deea4c2f0-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.161 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.164 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.164 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.165 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:18:44.165 DEBUG:boto:Data: 2023-12-15T23:18:44.165 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.165 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.165 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.165 DEBUG:boto:Params: {} 2023-12-15T23:18:44.165 DEBUG:boto:Token: None 2023-12-15T23:18:44.165 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44 2023-12-15T23:18:44.165 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xwAxTCzmNWSpbtdvVObsltTFK3c= 2023-12-15T23:18:44.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xwAxTCzmNWSpbtdvVObsltTFK3c=', 'Content-Length': '0'} 2023-12-15T23:18:44.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de76a86c867feb30-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:18:44.168 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.168 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.168 DEBUG:boto:Method: GET 2023-12-15T23:18:44.168 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:18:44.168 DEBUG:boto:Data: 2023-12-15T23:18:44.168 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.168 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.168 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.168 DEBUG:boto:Params: {} 2023-12-15T23:18:44.168 DEBUG:boto:Token: None 2023-12-15T23:18:44.169 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44 2023-12-15T23:18:44.169 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hg1ujHCfRqc2GeeiiApnwOXQJiU= 2023-12-15T23:18:44.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hg1ujHCfRqc2GeeiiApnwOXQJiU=', 'Content-Length': '0'} 2023-12-15T23:18:44.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084b8a9a0dc307d92-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.214 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:18:44.214 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:18:44.214 DEBUG:boto:Method: GET 2023-12-15T23:18:44.214 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:18:44.214 DEBUG:boto:Data: 2023-12-15T23:18:44.214 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.214 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.215 DEBUG:boto:Params: {} 2023-12-15T23:18:44.215 DEBUG:boto:Token: None 2023-12-15T23:18:44.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj44 2023-12-15T23:18:44.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hg1ujHCfRqc2GeeiiApnwOXQJiU= 2023-12-15T23:18:44.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hg1ujHCfRqc2GeeiiApnwOXQJiU=', 'Content-Length': '0'} 2023-12-15T23:18:44.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009df8d6687fa7e149-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.217 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.217 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.217 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.217 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.218 DEBUG:boto:Method: GET 2023-12-15T23:18:44.218 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.218 DEBUG:boto:Data: 2023-12-15T23:18:44.218 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.218 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.218 DEBUG:boto:Params: {} 2023-12-15T23:18:44.218 DEBUG:boto:Token: None 2023-12-15T23:18:44.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089e34ec72d06f380-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.221 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.222 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.222 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.222 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.222 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.222 DEBUG:boto:Method: GET 2023-12-15T23:18:44.222 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:18:44.222 DEBUG:boto:Data: 2023-12-15T23:18:44.222 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.222 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.222 DEBUG:boto:Params: {} 2023-12-15T23:18:44.223 DEBUG:boto:Token: None 2023-12-15T23:18:44.223 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.225 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d9acb1f24afe390-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.226 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.226 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:18:44.226 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.226 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.226 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.226 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.226 DEBUG:boto:Method: GET 2023-12-15T23:18:44.227 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.227 DEBUG:boto:Data: 2023-12-15T23:18:44.227 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.227 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.227 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.227 DEBUG:boto:Params: {} 2023-12-15T23:18:44.227 DEBUG:boto:Token: None 2023-12-15T23:18:44.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q= 2023-12-15T23:18:44.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q=', 'Content-Length': '0'} 2023-12-15T23:18:44.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a41193576b7cd1a0-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.230 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.230 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.230 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.230 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.230 DEBUG:boto:Method: GET 2023-12-15T23:18:44.230 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.230 DEBUG:boto:Data: 2023-12-15T23:18:44.230 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.230 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.231 DEBUG:boto:Params: {} 2023-12-15T23:18:44.231 DEBUG:boto:Token: None 2023-12-15T23:18:44.231 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q= 2023-12-15T23:18:44.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q=', 'Content-Length': '0'} 2023-12-15T23:18:44.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000127a9f911719a784-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.233 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.233 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.233 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.233 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.233 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.233 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.234 DEBUG:boto:Data: 2023-12-15T23:18:44.234 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.234 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.234 DEBUG:boto:Params: {} 2023-12-15T23:18:44.234 DEBUG:boto:Token: None 2023-12-15T23:18:44.234 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:seQzvprxt/uMRc799V/eLaEWir8= 2023-12-15T23:18:44.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:seQzvprxt/uMRc799V/eLaEWir8=', 'Content-Length': '0'} 2023-12-15T23:18:44.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000634b13741ea9a99f-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.236 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.236 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.236 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.236 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.236 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.237 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.237 DEBUG:boto:Data: 2023-12-15T23:18:44.237 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.237 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.237 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.237 DEBUG:boto:Params: {} 2023-12-15T23:18:44.237 DEBUG:boto:Token: None 2023-12-15T23:18:44.237 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.237 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:seQzvprxt/uMRc799V/eLaEWir8= 2023-12-15T23:18:44.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:seQzvprxt/uMRc799V/eLaEWir8=', 'Content-Length': '0'} 2023-12-15T23:18:44.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000966e5dd3f5ed0120-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:18:44.239 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.240 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.240 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.240 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.240 DEBUG:boto:Method: GET 2023-12-15T23:18:44.240 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.240 DEBUG:boto:Data: 2023-12-15T23:18:44.240 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.240 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.240 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.240 DEBUG:boto:Params: {} 2023-12-15T23:18:44.240 DEBUG:boto:Token: None 2023-12-15T23:18:44.241 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.241 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q= 2023-12-15T23:18:44.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q=', 'Content-Length': '0'} 2023-12-15T23:18:44.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c01b3fe9f9984b88-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.286 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.286 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.286 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.286 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.286 DEBUG:boto:Method: GET 2023-12-15T23:18:44.286 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.286 DEBUG:boto:Data: 2023-12-15T23:18:44.286 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.286 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.286 DEBUG:boto:Params: {} 2023-12-15T23:18:44.287 DEBUG:boto:Token: None 2023-12-15T23:18:44.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:18:44.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q= 2023-12-15T23:18:44.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ErRfF5XYO9OYVo/QwpeOVretf7Q=', 'Content-Length': '0'} 2023-12-15T23:18:44.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e4986a22127dc41-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.289 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.289 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.290 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.290 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.290 DEBUG:boto:Method: GET 2023-12-15T23:18:44.290 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.290 DEBUG:boto:Data: 2023-12-15T23:18:44.290 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.290 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.290 DEBUG:boto:Params: {} 2023-12-15T23:18:44.290 DEBUG:boto:Token: None 2023-12-15T23:18:44.290 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015685b2916d0ac75-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.293 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.293 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.293 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.293 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.293 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.294 DEBUG:boto:Method: GET 2023-12-15T23:18:44.294 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.294 DEBUG:boto:Data: 2023-12-15T23:18:44.294 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.294 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.294 DEBUG:boto:Params: {} 2023-12-15T23:18:44.294 DEBUG:boto:Token: None 2023-12-15T23:18:44.294 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.294 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.297 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094ca98c72ec0a455-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.297 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.298 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.298 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.298 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.298 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:18:44.298 DEBUG:boto:Data: 2023-12-15T23:18:44.298 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.298 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.298 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.298 DEBUG:boto:Params: {} 2023-12-15T23:18:44.299 DEBUG:boto:Token: None 2023-12-15T23:18:44.299 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51 2023-12-15T23:18:44.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i66g1+arRUBP6L2vco3A1vXnDMY= 2023-12-15T23:18:44.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i66g1+arRUBP6L2vco3A1vXnDMY=', 'Content-Length': '0'} 2023-12-15T23:18:44.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005a543d7337ce896-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.301 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.301 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.301 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.301 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:18:44.301 DEBUG:boto:Data: 2023-12-15T23:18:44.301 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.302 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.302 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.302 DEBUG:boto:Params: {} 2023-12-15T23:18:44.302 DEBUG:boto:Token: None 2023-12-15T23:18:44.302 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51 2023-12-15T23:18:44.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i66g1+arRUBP6L2vco3A1vXnDMY= 2023-12-15T23:18:44.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i66g1+arRUBP6L2vco3A1vXnDMY=', 'Content-Length': '0'} 2023-12-15T23:18:44.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1227816d76e4520-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:18:44.304 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.304 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.304 DEBUG:boto:Method: GET 2023-12-15T23:18:44.304 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:18:44.305 DEBUG:boto:Data: 2023-12-15T23:18:44.305 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.305 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.305 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.305 DEBUG:boto:Params: {} 2023-12-15T23:18:44.305 DEBUG:boto:Token: None 2023-12-15T23:18:44.305 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51 2023-12-15T23:18:44.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vo7WyEkERa8z8yuTzIHHUqUbETU= 2023-12-15T23:18:44.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vo7WyEkERa8z8yuTzIHHUqUbETU=', 'Content-Length': '0'} 2023-12-15T23:18:44.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc80c1670032ff07-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.349 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:18:44.350 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:18:44.350 DEBUG:boto:Method: GET 2023-12-15T23:18:44.350 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:18:44.350 DEBUG:boto:Data: 2023-12-15T23:18:44.350 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.350 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.350 DEBUG:boto:Params: {} 2023-12-15T23:18:44.350 DEBUG:boto:Token: None 2023-12-15T23:18:44.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj51 2023-12-15T23:18:44.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vo7WyEkERa8z8yuTzIHHUqUbETU= 2023-12-15T23:18:44.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vo7WyEkERa8z8yuTzIHHUqUbETU=', 'Content-Length': '0'} 2023-12-15T23:18:44.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000980aa74ee6b43155-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.353 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.353 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.353 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.353 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.353 DEBUG:boto:Method: GET 2023-12-15T23:18:44.353 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.353 DEBUG:boto:Data: 2023-12-15T23:18:44.353 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.354 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.354 DEBUG:boto:Params: {} 2023-12-15T23:18:44.354 DEBUG:boto:Token: None 2023-12-15T23:18:44.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c43b67c91f5783f-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.357 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.357 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.357 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.357 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.357 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.357 DEBUG:boto:Method: GET 2023-12-15T23:18:44.358 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:18:44.358 DEBUG:boto:Data: 2023-12-15T23:18:44.358 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.358 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.358 DEBUG:boto:Params: {} 2023-12-15T23:18:44.358 DEBUG:boto:Token: None 2023-12-15T23:18:44.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e116661186ce3c5-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.361 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:18:44.362 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.362 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.362 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.362 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.362 DEBUG:boto:Method: GET 2023-12-15T23:18:44.362 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.362 DEBUG:boto:Data: 2023-12-15T23:18:44.362 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.363 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.363 DEBUG:boto:Params: {} 2023-12-15T23:18:44.363 DEBUG:boto:Token: None 2023-12-15T23:18:44.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ= 2023-12-15T23:18:44.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ=', 'Content-Length': '0'} 2023-12-15T23:18:44.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000151fc1495b16d310-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.365 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.366 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.366 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.366 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.366 DEBUG:boto:Method: GET 2023-12-15T23:18:44.366 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.366 DEBUG:boto:Data: 2023-12-15T23:18:44.366 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.366 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.366 DEBUG:boto:Params: {} 2023-12-15T23:18:44.366 DEBUG:boto:Token: None 2023-12-15T23:18:44.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ= 2023-12-15T23:18:44.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ=', 'Content-Length': '0'} 2023-12-15T23:18:44.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba4d5da3714a880c-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.369 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.369 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.369 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.370 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.370 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.370 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.370 DEBUG:boto:Data: 2023-12-15T23:18:44.370 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.370 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.370 DEBUG:boto:Params: {} 2023-12-15T23:18:44.370 DEBUG:boto:Token: None 2023-12-15T23:18:44.370 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xz7QEkCBInm99jR6GUQvALFnXwk= 2023-12-15T23:18:44.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xz7QEkCBInm99jR6GUQvALFnXwk=', 'Content-Length': '0'} 2023-12-15T23:18:44.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2f4a85d8ce3dbfd-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.373 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.373 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.373 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.373 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.373 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.373 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.374 DEBUG:boto:Data: 2023-12-15T23:18:44.374 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.374 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.374 DEBUG:boto:Params: {} 2023-12-15T23:18:44.374 DEBUG:boto:Token: None 2023-12-15T23:18:44.374 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xz7QEkCBInm99jR6GUQvALFnXwk= 2023-12-15T23:18:44.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xz7QEkCBInm99jR6GUQvALFnXwk=', 'Content-Length': '0'} 2023-12-15T23:18:44.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d224c1038d67fd8d-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:18:44.377 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.377 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.377 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.377 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.377 DEBUG:boto:Method: GET 2023-12-15T23:18:44.377 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.377 DEBUG:boto:Data: 2023-12-15T23:18:44.377 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.377 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.378 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.378 DEBUG:boto:Params: {} 2023-12-15T23:18:44.378 DEBUG:boto:Token: None 2023-12-15T23:18:44.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ= 2023-12-15T23:18:44.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ=', 'Content-Length': '0'} 2023-12-15T23:18:44.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e119c8bfc331bee2-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.421 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.422 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.422 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.422 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.422 DEBUG:boto:Method: GET 2023-12-15T23:18:44.422 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.422 DEBUG:boto:Data: 2023-12-15T23:18:44.422 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.422 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.422 DEBUG:boto:Params: {} 2023-12-15T23:18:44.423 DEBUG:boto:Token: None 2023-12-15T23:18:44.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:18:44.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ= 2023-12-15T23:18:44.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ipPUISCd5pWb9ldZR2f47HLn9VQ=', 'Content-Length': '0'} 2023-12-15T23:18:44.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d2330d2ee2a82b7-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.425 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.425 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.426 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.426 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.426 DEBUG:boto:Method: GET 2023-12-15T23:18:44.426 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.426 DEBUG:boto:Data: 2023-12-15T23:18:44.426 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.426 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.426 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.426 DEBUG:boto:Params: {} 2023-12-15T23:18:44.426 DEBUG:boto:Token: None 2023-12-15T23:18:44.426 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.427 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075f91efc94dfebbd-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.469 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.470 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.470 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.470 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.470 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.470 DEBUG:boto:Method: GET 2023-12-15T23:18:44.470 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.470 DEBUG:boto:Data: 2023-12-15T23:18:44.470 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.471 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.471 DEBUG:boto:Params: {} 2023-12-15T23:18:44.471 DEBUG:boto:Token: None 2023-12-15T23:18:44.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003df10eb8c237af4f-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.474 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.474 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.475 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.475 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.475 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:18:44.475 DEBUG:boto:Data: 2023-12-15T23:18:44.475 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.475 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.475 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.475 DEBUG:boto:Params: {} 2023-12-15T23:18:44.475 DEBUG:boto:Token: None 2023-12-15T23:18:44.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55 2023-12-15T23:18:44.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y7PamIaDMKguOq2jAvg32VFHAts= 2023-12-15T23:18:44.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y7PamIaDMKguOq2jAvg32VFHAts=', 'Content-Length': '0'} 2023-12-15T23:18:44.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a9a681773e6dcb3-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.478 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.478 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.478 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.478 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:18:44.478 DEBUG:boto:Data: 2023-12-15T23:18:44.478 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.478 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.478 DEBUG:boto:Params: {} 2023-12-15T23:18:44.478 DEBUG:boto:Token: None 2023-12-15T23:18:44.479 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55 2023-12-15T23:18:44.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y7PamIaDMKguOq2jAvg32VFHAts= 2023-12-15T23:18:44.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y7PamIaDMKguOq2jAvg32VFHAts=', 'Content-Length': '0'} 2023-12-15T23:18:44.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a3da609c1ca9076-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.481 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:18:44.481 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.481 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.482 DEBUG:boto:Method: GET 2023-12-15T23:18:44.482 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:18:44.482 DEBUG:boto:Data: 2023-12-15T23:18:44.482 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.482 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.482 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.482 DEBUG:boto:Params: {} 2023-12-15T23:18:44.482 DEBUG:boto:Token: None 2023-12-15T23:18:44.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55 2023-12-15T23:18:44.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7mpmdyqL6J3sj4QPvGoHP6okllg= 2023-12-15T23:18:44.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7mpmdyqL6J3sj4QPvGoHP6okllg=', 'Content-Length': '0'} 2023-12-15T23:18:44.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b0c42d8f7c1b14d-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.525 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:18:44.526 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:18:44.526 DEBUG:boto:Method: GET 2023-12-15T23:18:44.526 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:18:44.526 DEBUG:boto:Data: 2023-12-15T23:18:44.526 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.526 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.526 DEBUG:boto:Params: {} 2023-12-15T23:18:44.526 DEBUG:boto:Token: None 2023-12-15T23:18:44.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj55 2023-12-15T23:18:44.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7mpmdyqL6J3sj4QPvGoHP6okllg= 2023-12-15T23:18:44.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7mpmdyqL6J3sj4QPvGoHP6okllg=', 'Content-Length': '0'} 2023-12-15T23:18:44.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006301897867cbd27b-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.529 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.529 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.529 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.529 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.529 DEBUG:boto:Method: GET 2023-12-15T23:18:44.529 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.529 DEBUG:boto:Data: 2023-12-15T23:18:44.530 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.530 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.530 DEBUG:boto:Params: {} 2023-12-15T23:18:44.530 DEBUG:boto:Token: None 2023-12-15T23:18:44.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.532 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d730a90a1a94681b-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.573 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.574 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.574 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.574 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.574 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.574 DEBUG:boto:Method: GET 2023-12-15T23:18:44.574 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:18:44.574 DEBUG:boto:Data: 2023-12-15T23:18:44.574 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.574 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.575 DEBUG:boto:Params: {} 2023-12-15T23:18:44.575 DEBUG:boto:Token: None 2023-12-15T23:18:44.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000268bde3db728611c-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.578 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:18:44.578 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.578 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.578 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.579 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.579 DEBUG:boto:Method: GET 2023-12-15T23:18:44.579 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.579 DEBUG:boto:Data: 2023-12-15T23:18:44.579 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.579 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.579 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.579 DEBUG:boto:Params: {} 2023-12-15T23:18:44.579 DEBUG:boto:Token: None 2023-12-15T23:18:44.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4= 2023-12-15T23:18:44.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4=', 'Content-Length': '0'} 2023-12-15T23:18:44.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c68159459215bab1-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.582 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.582 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.582 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.582 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.582 DEBUG:boto:Method: GET 2023-12-15T23:18:44.582 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.583 DEBUG:boto:Data: 2023-12-15T23:18:44.583 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.583 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.583 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.583 DEBUG:boto:Params: {} 2023-12-15T23:18:44.583 DEBUG:boto:Token: None 2023-12-15T23:18:44.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4= 2023-12-15T23:18:44.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4=', 'Content-Length': '0'} 2023-12-15T23:18:44.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed132cdd578415d7-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.586 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.586 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.586 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.586 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.586 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.587 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.587 DEBUG:boto:Data: 2023-12-15T23:18:44.587 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.587 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.587 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.587 DEBUG:boto:Params: {} 2023-12-15T23:18:44.587 DEBUG:boto:Token: None 2023-12-15T23:18:44.587 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DUGOU8fKrOf0qTMFHe4wpRkbTVk= 2023-12-15T23:18:44.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DUGOU8fKrOf0qTMFHe4wpRkbTVk=', 'Content-Length': '0'} 2023-12-15T23:18:44.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e030a39db1d5542-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.590 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.590 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.590 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.590 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.590 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.590 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.590 DEBUG:boto:Data: 2023-12-15T23:18:44.590 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.590 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.591 DEBUG:boto:Params: {} 2023-12-15T23:18:44.591 DEBUG:boto:Token: None 2023-12-15T23:18:44.591 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DUGOU8fKrOf0qTMFHe4wpRkbTVk= 2023-12-15T23:18:44.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DUGOU8fKrOf0qTMFHe4wpRkbTVk=', 'Content-Length': '0'} 2023-12-15T23:18:44.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085f546ddbc2c2979-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:18:44.594 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.594 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.594 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.594 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.594 DEBUG:boto:Method: GET 2023-12-15T23:18:44.594 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.594 DEBUG:boto:Data: 2023-12-15T23:18:44.594 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.594 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.594 DEBUG:boto:Params: {} 2023-12-15T23:18:44.595 DEBUG:boto:Token: None 2023-12-15T23:18:44.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4= 2023-12-15T23:18:44.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4=', 'Content-Length': '0'} 2023-12-15T23:18:44.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b902a043d2c7ea9e-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.637 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.638 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.638 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.638 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.638 DEBUG:boto:Method: GET 2023-12-15T23:18:44.638 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.638 DEBUG:boto:Data: 2023-12-15T23:18:44.638 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.638 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.638 DEBUG:boto:Params: {} 2023-12-15T23:18:44.639 DEBUG:boto:Token: None 2023-12-15T23:18:44.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:18:44.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4= 2023-12-15T23:18:44.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2C2lflFQL2w4NR5pPrXwZQdxoa4=', 'Content-Length': '0'} 2023-12-15T23:18:44.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df7f24c3aa946265-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.642 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.642 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.642 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.642 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.642 DEBUG:boto:Method: GET 2023-12-15T23:18:44.642 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.642 DEBUG:boto:Data: 2023-12-15T23:18:44.642 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.642 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.642 DEBUG:boto:Params: {} 2023-12-15T23:18:44.643 DEBUG:boto:Token: None 2023-12-15T23:18:44.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040c969eacb6ce655-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.645 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.646 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.646 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.646 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.646 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.646 DEBUG:boto:Method: GET 2023-12-15T23:18:44.646 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.646 DEBUG:boto:Data: 2023-12-15T23:18:44.646 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.647 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.647 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.647 DEBUG:boto:Params: {} 2023-12-15T23:18:44.647 DEBUG:boto:Token: None 2023-12-15T23:18:44.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9120a91daa2e14a-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.693 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.694 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.694 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.694 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.694 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:18:44.694 DEBUG:boto:Data: 2023-12-15T23:18:44.694 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.695 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.695 DEBUG:boto:Params: {} 2023-12-15T23:18:44.695 DEBUG:boto:Token: None 2023-12-15T23:18:44.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57 2023-12-15T23:18:44.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rb6a/90liQG81erl/8dvGV8aKp4= 2023-12-15T23:18:44.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rb6a/90liQG81erl/8dvGV8aKp4=', 'Content-Length': '0'} 2023-12-15T23:18:44.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005558243fc60898a3-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.698 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.698 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.698 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.698 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:18:44.698 DEBUG:boto:Data: 2023-12-15T23:18:44.698 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.698 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.698 DEBUG:boto:Params: {} 2023-12-15T23:18:44.698 DEBUG:boto:Token: None 2023-12-15T23:18:44.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57 2023-12-15T23:18:44.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rb6a/90liQG81erl/8dvGV8aKp4= 2023-12-15T23:18:44.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rb6a/90liQG81erl/8dvGV8aKp4=', 'Content-Length': '0'} 2023-12-15T23:18:44.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7da861ad7cd0c85-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.701 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:18:44.701 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.701 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.701 DEBUG:boto:Method: GET 2023-12-15T23:18:44.701 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:18:44.702 DEBUG:boto:Data: 2023-12-15T23:18:44.702 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.702 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.702 DEBUG:boto:Params: {} 2023-12-15T23:18:44.702 DEBUG:boto:Token: None 2023-12-15T23:18:44.702 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57 2023-12-15T23:18:44.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zaoUe+Anwp1y/J9rbEpJZ98tJ/8= 2023-12-15T23:18:44.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zaoUe+Anwp1y/J9rbEpJZ98tJ/8=', 'Content-Length': '0'} 2023-12-15T23:18:44.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dcd3b27c29a08c9-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.746 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:18:44.746 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:18:44.746 DEBUG:boto:Method: GET 2023-12-15T23:18:44.746 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:18:44.746 DEBUG:boto:Data: 2023-12-15T23:18:44.746 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.746 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.746 DEBUG:boto:Params: {} 2023-12-15T23:18:44.747 DEBUG:boto:Token: None 2023-12-15T23:18:44.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj57 2023-12-15T23:18:44.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zaoUe+Anwp1y/J9rbEpJZ98tJ/8= 2023-12-15T23:18:44.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zaoUe+Anwp1y/J9rbEpJZ98tJ/8=', 'Content-Length': '0'} 2023-12-15T23:18:44.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be1779f0f63262d6-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.749 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.749 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.750 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.750 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.750 DEBUG:boto:Method: GET 2023-12-15T23:18:44.750 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.750 DEBUG:boto:Data: 2023-12-15T23:18:44.750 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.750 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.750 DEBUG:boto:Params: {} 2023-12-15T23:18:44.750 DEBUG:boto:Token: None 2023-12-15T23:18:44.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e69afc03f7d6486-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.793 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.794 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.794 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.794 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.794 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.794 DEBUG:boto:Method: GET 2023-12-15T23:18:44.794 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:18:44.795 DEBUG:boto:Data: 2023-12-15T23:18:44.795 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.795 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.795 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.795 DEBUG:boto:Params: {} 2023-12-15T23:18:44.795 DEBUG:boto:Token: None 2023-12-15T23:18:44.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.797 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f6e0a8c65365a98-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.798 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:18:44.798 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.798 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.798 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.798 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.799 DEBUG:boto:Method: GET 2023-12-15T23:18:44.799 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.799 DEBUG:boto:Data: 2023-12-15T23:18:44.799 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.799 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.799 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.799 DEBUG:boto:Params: {} 2023-12-15T23:18:44.799 DEBUG:boto:Token: None 2023-12-15T23:18:44.799 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow= 2023-12-15T23:18:44.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow=', 'Content-Length': '0'} 2023-12-15T23:18:44.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b8956493cdcf8d4-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.802 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.802 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.802 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.802 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.803 DEBUG:boto:Method: GET 2023-12-15T23:18:44.803 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.803 DEBUG:boto:Data: 2023-12-15T23:18:44.803 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.803 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.803 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.803 DEBUG:boto:Params: {} 2023-12-15T23:18:44.803 DEBUG:boto:Token: None 2023-12-15T23:18:44.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow= 2023-12-15T23:18:44.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow=', 'Content-Length': '0'} 2023-12-15T23:18:44.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3c7244abf255237-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.806 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.806 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.806 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.806 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.806 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.806 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.806 DEBUG:boto:Data: 2023-12-15T23:18:44.806 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.807 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.807 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.807 DEBUG:boto:Params: {} 2023-12-15T23:18:44.807 DEBUG:boto:Token: None 2023-12-15T23:18:44.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u3mTniMTvOKGamH0cm/2dOhRDg8= 2023-12-15T23:18:44.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u3mTniMTvOKGamH0cm/2dOhRDg8=', 'Content-Length': '0'} 2023-12-15T23:18:44.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083dfd8c5aaa40c66-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.810 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.810 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.810 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.810 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.810 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.810 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.810 DEBUG:boto:Data: 2023-12-15T23:18:44.810 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.810 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.811 DEBUG:boto:Params: {} 2023-12-15T23:18:44.811 DEBUG:boto:Token: None 2023-12-15T23:18:44.811 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u3mTniMTvOKGamH0cm/2dOhRDg8= 2023-12-15T23:18:44.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u3mTniMTvOKGamH0cm/2dOhRDg8=', 'Content-Length': '0'} 2023-12-15T23:18:44.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f46a432f0735a89-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:18:44.813 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.814 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.814 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.814 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.814 DEBUG:boto:Method: GET 2023-12-15T23:18:44.814 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.814 DEBUG:boto:Data: 2023-12-15T23:18:44.814 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.814 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.814 DEBUG:boto:Params: {} 2023-12-15T23:18:44.814 DEBUG:boto:Token: None 2023-12-15T23:18:44.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow= 2023-12-15T23:18:44.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow=', 'Content-Length': '0'} 2023-12-15T23:18:44.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000620660da196939ce-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.857 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.858 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.858 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.858 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.858 DEBUG:boto:Method: GET 2023-12-15T23:18:44.858 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.858 DEBUG:boto:Data: 2023-12-15T23:18:44.858 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.858 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.858 DEBUG:boto:Params: {} 2023-12-15T23:18:44.858 DEBUG:boto:Token: None 2023-12-15T23:18:44.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:18:44.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow= 2023-12-15T23:18:44.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5p69cJKZD+oPNwL4yUxVByWUAow=', 'Content-Length': '0'} 2023-12-15T23:18:44.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cd70b1a80d97d0b-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.861 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.861 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.861 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.861 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.862 DEBUG:boto:Method: GET 2023-12-15T23:18:44.862 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.862 DEBUG:boto:Data: 2023-12-15T23:18:44.862 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.862 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.862 DEBUG:boto:Params: {} 2023-12-15T23:18:44.862 DEBUG:boto:Token: None 2023-12-15T23:18:44.862 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.862 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.865 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002acffdd4cf03cc22-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.905 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.906 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.906 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.906 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.906 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.906 DEBUG:boto:Method: GET 2023-12-15T23:18:44.906 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.906 DEBUG:boto:Data: 2023-12-15T23:18:44.906 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.907 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.907 DEBUG:boto:Params: {} 2023-12-15T23:18:44.907 DEBUG:boto:Token: None 2023-12-15T23:18:44.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.909 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b29f822f41c52b0-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.910 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.910 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.910 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.910 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.910 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:18:44.910 DEBUG:boto:Data: 2023-12-15T23:18:44.910 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.911 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.911 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.911 DEBUG:boto:Params: {} 2023-12-15T23:18:44.911 DEBUG:boto:Token: None 2023-12-15T23:18:44.911 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68 2023-12-15T23:18:44.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4FeJz3TIQZojb/vmtABjeNHHkuU= 2023-12-15T23:18:44.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4FeJz3TIQZojb/vmtABjeNHHkuU=', 'Content-Length': '0'} 2023-12-15T23:18:44.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7c8ef0d926c5fd1-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.913 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.913 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.913 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.914 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:18:44.914 DEBUG:boto:Data: 2023-12-15T23:18:44.914 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.914 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.914 DEBUG:boto:Params: {} 2023-12-15T23:18:44.914 DEBUG:boto:Token: None 2023-12-15T23:18:44.914 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68 2023-12-15T23:18:44.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4FeJz3TIQZojb/vmtABjeNHHkuU= 2023-12-15T23:18:44.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4FeJz3TIQZojb/vmtABjeNHHkuU=', 'Content-Length': '0'} 2023-12-15T23:18:44.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4a3519f09fd5f8f-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.917 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:18:44.917 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.917 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.917 DEBUG:boto:Method: GET 2023-12-15T23:18:44.917 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:18:44.917 DEBUG:boto:Data: 2023-12-15T23:18:44.917 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.917 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.917 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.917 DEBUG:boto:Params: {} 2023-12-15T23:18:44.918 DEBUG:boto:Token: None 2023-12-15T23:18:44.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68 2023-12-15T23:18:44.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vK2Q1ek1ePWnTGhhRdnaSFM2oq8= 2023-12-15T23:18:44.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vK2Q1ek1ePWnTGhhRdnaSFM2oq8=', 'Content-Length': '0'} 2023-12-15T23:18:44.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f8bcbe187beabdf-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.961 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:18:44.961 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:18:44.962 DEBUG:boto:Method: GET 2023-12-15T23:18:44.962 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:18:44.962 DEBUG:boto:Data: 2023-12-15T23:18:44.962 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.962 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.962 DEBUG:boto:Params: {} 2023-12-15T23:18:44.962 DEBUG:boto:Token: None 2023-12-15T23:18:44.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj68 2023-12-15T23:18:44.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vK2Q1ek1ePWnTGhhRdnaSFM2oq8= 2023-12-15T23:18:44.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vK2Q1ek1ePWnTGhhRdnaSFM2oq8=', 'Content-Length': '0'} 2023-12-15T23:18:44.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8010c6d19ad1e9e-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.965 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.965 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.965 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.965 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.965 DEBUG:boto:Method: GET 2023-12-15T23:18:44.965 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.965 DEBUG:boto:Data: 2023-12-15T23:18:44.965 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.966 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.966 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.966 DEBUG:boto:Params: {} 2023-12-15T23:18:44.966 DEBUG:boto:Token: None 2023-12-15T23:18:44.966 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.969 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004f5655101c80326-00657cded4-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.969 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.969 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:44.969 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:44.969 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.969 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.970 DEBUG:boto:Method: GET 2023-12-15T23:18:44.970 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:18:44.970 DEBUG:boto:Data: 2023-12-15T23:18:44.970 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.970 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.970 DEBUG:boto:Params: {} 2023-12-15T23:18:44.970 DEBUG:boto:Token: None 2023-12-15T23:18:44.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/ 2023-12-15T23:18:44.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4= 2023-12-15T23:18:44.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VPo0+7EKXFXt+3fWN/rlePdE4=', 'Content-Length': '0'} 2023-12-15T23:18:44.973 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aa56111f47af43e-00657cded4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.973 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:44.974 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:18:44.974 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:44.974 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:44.974 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.974 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.974 DEBUG:boto:Method: GET 2023-12-15T23:18:44.974 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.974 DEBUG:boto:Data: 2023-12-15T23:18:44.974 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.975 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.975 DEBUG:boto:Params: {} 2023-12-15T23:18:44.975 DEBUG:boto:Token: None 2023-12-15T23:18:44.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU= 2023-12-15T23:18:44.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU=', 'Content-Length': '0'} 2023-12-15T23:18:44.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b9797902c62363a-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.978 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:44.978 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:44.978 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.978 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.978 DEBUG:boto:Method: GET 2023-12-15T23:18:44.978 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.978 DEBUG:boto:Data: 2023-12-15T23:18:44.978 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.978 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.978 DEBUG:boto:Params: {} 2023-12-15T23:18:44.978 DEBUG:boto:Token: None 2023-12-15T23:18:44.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU= 2023-12-15T23:18:44.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU=', 'Content-Length': '0'} 2023-12-15T23:18:44.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0a2aa00cc0669a9-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.982 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:44.982 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:44.982 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.982 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.982 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.982 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.982 DEBUG:boto:Data: 2023-12-15T23:18:44.982 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.982 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.983 DEBUG:boto:Params: {} 2023-12-15T23:18:44.983 DEBUG:boto:Token: None 2023-12-15T23:18:44.983 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Waah96heBR7bbN3hVFxx0xbSot0= 2023-12-15T23:18:44.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Waah96heBR7bbN3hVFxx0xbSot0=', 'Content-Length': '0'} 2023-12-15T23:18:44.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c4e07e4fc98c577-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.985 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:44.985 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:44.985 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.985 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.985 DEBUG:boto:Method: HEAD 2023-12-15T23:18:44.985 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.986 DEBUG:boto:Data: 2023-12-15T23:18:44.986 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:44.986 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.986 DEBUG:boto:Params: {} 2023-12-15T23:18:44.986 DEBUG:boto:Token: None 2023-12-15T23:18:44.986 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Waah96heBR7bbN3hVFxx0xbSot0= 2023-12-15T23:18:44.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Waah96heBR7bbN3hVFxx0xbSot0=', 'Content-Length': '0'} 2023-12-15T23:18:44.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007fcf715c18fb68e-00657cded4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:44.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:18:44.988 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:44.989 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:44.989 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.989 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.989 DEBUG:boto:Method: GET 2023-12-15T23:18:44.989 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.989 DEBUG:boto:Data: 2023-12-15T23:18:44.989 DEBUG:boto:Headers: {} 2023-12-15T23:18:44.989 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:44.989 DEBUG:boto:Port: 8000 2023-12-15T23:18:44.989 DEBUG:boto:Params: {} 2023-12-15T23:18:44.990 DEBUG:boto:Token: None 2023-12-15T23:18:44.990 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:44 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:44.990 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU= 2023-12-15T23:18:44.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XbnEb1wPaxck9y5UB0eK3e/J7GU=', 'Content-Length': '0'} 2023-12-15T23:18:44.992 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000711f4f5bb8ab85d-00657cded4-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.033 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:45.034 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:45.034 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:45.034 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:18:45.034 DEBUG:boto:Method: GET 2023-12-15T23:18:45.034 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:45.034 DEBUG:boto:Data: 2023-12-15T23:18:45.034 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.034 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.034 DEBUG:boto:Params: {} 2023-12-15T23:18:45.034 DEBUG:boto:Token: None 2023-12-15T23:18:45.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:18:45.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IwHnJGhkwDKGMutTNbhNesoE2/c= 2023-12-15T23:18:45.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IwHnJGhkwDKGMutTNbhNesoE2/c=', 'Content-Length': '0'} 2023-12-15T23:18:45.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093b7d29e43ec6061-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.037 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.037 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.037 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.038 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.038 DEBUG:boto:Method: GET 2023-12-15T23:18:45.038 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.038 DEBUG:boto:Data: 2023-12-15T23:18:45.038 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.038 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.038 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.038 DEBUG:boto:Params: {} 2023-12-15T23:18:45.038 DEBUG:boto:Token: None 2023-12-15T23:18:45.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a239adc468afc4b-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.041 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.042 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.042 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.042 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.042 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.042 DEBUG:boto:Method: GET 2023-12-15T23:18:45.042 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.042 DEBUG:boto:Data: 2023-12-15T23:18:45.042 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.042 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.042 DEBUG:boto:Params: {} 2023-12-15T23:18:45.042 DEBUG:boto:Token: None 2023-12-15T23:18:45.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000274f613d7bb53fe5-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.046 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.046 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:45.046 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:45.046 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.046 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:18:45.046 DEBUG:boto:Data: 2023-12-15T23:18:45.047 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.047 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.047 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.047 DEBUG:boto:Params: {} 2023-12-15T23:18:45.047 DEBUG:boto:Token: None 2023-12-15T23:18:45.047 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj76 2023-12-15T23:18:45.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2g5NBRUCK3w5//H0v2jsF0UNz6A= 2023-12-15T23:18:45.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2g5NBRUCK3w5//H0v2jsF0UNz6A=', 'Content-Length': '0'} 2023-12-15T23:18:45.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a004b2d8a8e32d68-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.049 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:45.049 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:45.050 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.050 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:18:45.050 DEBUG:boto:Data: 2023-12-15T23:18:45.050 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.050 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.050 DEBUG:boto:Params: {} 2023-12-15T23:18:45.050 DEBUG:boto:Token: None 2023-12-15T23:18:45.050 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj76 2023-12-15T23:18:45.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2g5NBRUCK3w5//H0v2jsF0UNz6A= 2023-12-15T23:18:45.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2g5NBRUCK3w5//H0v2jsF0UNz6A=', 'Content-Length': '0'} 2023-12-15T23:18:45.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9be7461069f08ef-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:18:45.053 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:45.053 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:45.053 DEBUG:boto:Method: GET 2023-12-15T23:18:45.053 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:18:45.053 DEBUG:boto:Data: 2023-12-15T23:18:45.053 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.053 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.053 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.053 DEBUG:boto:Params: {} 2023-12-15T23:18:45.053 DEBUG:boto:Token: None 2023-12-15T23:18:45.054 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj76 2023-12-15T23:18:45.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGZoUZosyHr9lQO0GEhs/9/fHEg= 2023-12-15T23:18:45.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGZoUZosyHr9lQO0GEhs/9/fHEg=', 'Content-Length': '0'} 2023-12-15T23:18:45.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b37423204da0c33-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.097 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:18:45.098 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:18:45.098 DEBUG:boto:Method: GET 2023-12-15T23:18:45.098 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:18:45.098 DEBUG:boto:Data: 2023-12-15T23:18:45.098 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.098 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.098 DEBUG:boto:Params: {} 2023-12-15T23:18:45.098 DEBUG:boto:Token: None 2023-12-15T23:18:45.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj76 2023-12-15T23:18:45.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGZoUZosyHr9lQO0GEhs/9/fHEg= 2023-12-15T23:18:45.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGZoUZosyHr9lQO0GEhs/9/fHEg=', 'Content-Length': '0'} 2023-12-15T23:18:45.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b06211a12b613da6-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.101 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.101 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.101 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.101 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.101 DEBUG:boto:Method: GET 2023-12-15T23:18:45.102 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.102 DEBUG:boto:Data: 2023-12-15T23:18:45.102 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.102 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.102 DEBUG:boto:Params: {} 2023-12-15T23:18:45.102 DEBUG:boto:Token: None 2023-12-15T23:18:45.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1714b2064346e28-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.105 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.105 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.105 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.105 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.105 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.105 DEBUG:boto:Method: GET 2023-12-15T23:18:45.106 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:18:45.106 DEBUG:boto:Data: 2023-12-15T23:18:45.106 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.106 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.106 DEBUG:boto:Params: {} 2023-12-15T23:18:45.106 DEBUG:boto:Token: None 2023-12-15T23:18:45.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cac70bc2f8918fda-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.109 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:18:45.110 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.110 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.110 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.110 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.110 DEBUG:boto:Method: GET 2023-12-15T23:18:45.110 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.110 DEBUG:boto:Data: 2023-12-15T23:18:45.110 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.111 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.111 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.111 DEBUG:boto:Params: {} 2023-12-15T23:18:45.111 DEBUG:boto:Token: None 2023-12-15T23:18:45.111 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU= 2023-12-15T23:18:45.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU=', 'Content-Length': '0'} 2023-12-15T23:18:45.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b7b1b7a90a650ce-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.113 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.113 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.113 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.114 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.114 DEBUG:boto:Method: GET 2023-12-15T23:18:45.114 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.114 DEBUG:boto:Data: 2023-12-15T23:18:45.114 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.114 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.114 DEBUG:boto:Params: {} 2023-12-15T23:18:45.114 DEBUG:boto:Token: None 2023-12-15T23:18:45.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU= 2023-12-15T23:18:45.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU=', 'Content-Length': '0'} 2023-12-15T23:18:45.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055e1c0a3d8d6fa18-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.117 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.117 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.117 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.117 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.117 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.117 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.117 DEBUG:boto:Data: 2023-12-15T23:18:45.117 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.118 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.118 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.118 DEBUG:boto:Params: {} 2023-12-15T23:18:45.118 DEBUG:boto:Token: None 2023-12-15T23:18:45.118 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q4oopc5iHY8G5TScjsa+UFgwr3A= 2023-12-15T23:18:45.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q4oopc5iHY8G5TScjsa+UFgwr3A=', 'Content-Length': '0'} 2023-12-15T23:18:45.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a7ef762014bfb56-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.121 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.121 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.121 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.121 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.121 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.121 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.121 DEBUG:boto:Data: 2023-12-15T23:18:45.121 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.121 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.122 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.122 DEBUG:boto:Params: {} 2023-12-15T23:18:45.122 DEBUG:boto:Token: None 2023-12-15T23:18:45.122 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q4oopc5iHY8G5TScjsa+UFgwr3A= 2023-12-15T23:18:45.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q4oopc5iHY8G5TScjsa+UFgwr3A=', 'Content-Length': '0'} 2023-12-15T23:18:45.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033e55808dc58c621-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:18:45.124 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.124 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.125 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.125 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.125 DEBUG:boto:Method: GET 2023-12-15T23:18:45.125 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.125 DEBUG:boto:Data: 2023-12-15T23:18:45.125 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.125 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.125 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.125 DEBUG:boto:Params: {} 2023-12-15T23:18:45.125 DEBUG:boto:Token: None 2023-12-15T23:18:45.126 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU= 2023-12-15T23:18:45.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU=', 'Content-Length': '0'} 2023-12-15T23:18:45.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ae4a86b08482fa2-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.169 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.170 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.170 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.170 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.170 DEBUG:boto:Method: GET 2023-12-15T23:18:45.170 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.170 DEBUG:boto:Data: 2023-12-15T23:18:45.170 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.170 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.170 DEBUG:boto:Params: {} 2023-12-15T23:18:45.171 DEBUG:boto:Token: None 2023-12-15T23:18:45.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:18:45.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU= 2023-12-15T23:18:45.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:63n0cGTaxb1TJSvkRM9sef1oxbU=', 'Content-Length': '0'} 2023-12-15T23:18:45.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000249de50e61db08e6-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.173 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.173 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.173 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.173 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.173 DEBUG:boto:Method: GET 2023-12-15T23:18:45.174 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.174 DEBUG:boto:Data: 2023-12-15T23:18:45.174 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.174 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.174 DEBUG:boto:Params: {} 2023-12-15T23:18:45.174 DEBUG:boto:Token: None 2023-12-15T23:18:45.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fbd4d108b285c1f-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.217 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.218 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.218 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.218 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.218 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.218 DEBUG:boto:Method: GET 2023-12-15T23:18:45.218 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.218 DEBUG:boto:Data: 2023-12-15T23:18:45.218 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.219 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.219 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.219 DEBUG:boto:Params: {} 2023-12-15T23:18:45.219 DEBUG:boto:Token: None 2023-12-15T23:18:45.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.222 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d68fa16c052259ca-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.222 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.222 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.222 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.223 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.223 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:18:45.223 DEBUG:boto:Data: 2023-12-15T23:18:45.223 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.223 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.223 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.223 DEBUG:boto:Params: {} 2023-12-15T23:18:45.223 DEBUG:boto:Token: None 2023-12-15T23:18:45.223 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85 2023-12-15T23:18:45.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rblOc2vocBqLmlmnJI/JDuZyfQw= 2023-12-15T23:18:45.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rblOc2vocBqLmlmnJI/JDuZyfQw=', 'Content-Length': '0'} 2023-12-15T23:18:45.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000018dbd63fae32e26-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.226 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.226 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.226 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.226 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:18:45.226 DEBUG:boto:Data: 2023-12-15T23:18:45.226 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.226 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.226 DEBUG:boto:Params: {} 2023-12-15T23:18:45.227 DEBUG:boto:Token: None 2023-12-15T23:18:45.227 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85 2023-12-15T23:18:45.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rblOc2vocBqLmlmnJI/JDuZyfQw= 2023-12-15T23:18:45.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rblOc2vocBqLmlmnJI/JDuZyfQw=', 'Content-Length': '0'} 2023-12-15T23:18:45.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa8285be142d9f02-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.229 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:18:45.229 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.229 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.229 DEBUG:boto:Method: GET 2023-12-15T23:18:45.229 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:18:45.229 DEBUG:boto:Data: 2023-12-15T23:18:45.229 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.229 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.230 DEBUG:boto:Params: {} 2023-12-15T23:18:45.230 DEBUG:boto:Token: None 2023-12-15T23:18:45.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85 2023-12-15T23:18:45.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muBxx6DTyu14R6XbUB2GOdgVIus= 2023-12-15T23:18:45.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muBxx6DTyu14R6XbUB2GOdgVIus=', 'Content-Length': '0'} 2023-12-15T23:18:45.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a768288530da7e59-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.277 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:18:45.278 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:18:45.278 DEBUG:boto:Method: GET 2023-12-15T23:18:45.278 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:18:45.278 DEBUG:boto:Data: 2023-12-15T23:18:45.278 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.278 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.278 DEBUG:boto:Params: {} 2023-12-15T23:18:45.278 DEBUG:boto:Token: None 2023-12-15T23:18:45.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj85 2023-12-15T23:18:45.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muBxx6DTyu14R6XbUB2GOdgVIus= 2023-12-15T23:18:45.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muBxx6DTyu14R6XbUB2GOdgVIus=', 'Content-Length': '0'} 2023-12-15T23:18:45.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002b22aec737770a1-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.282 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.282 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.282 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.282 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.282 DEBUG:boto:Method: GET 2023-12-15T23:18:45.282 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.282 DEBUG:boto:Data: 2023-12-15T23:18:45.282 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.282 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.282 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.283 DEBUG:boto:Params: {} 2023-12-15T23:18:45.283 DEBUG:boto:Token: None 2023-12-15T23:18:45.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d440da330a6a95f2-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.329 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.330 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.330 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.330 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.330 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.330 DEBUG:boto:Method: GET 2023-12-15T23:18:45.330 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:18:45.330 DEBUG:boto:Data: 2023-12-15T23:18:45.330 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.331 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.331 DEBUG:boto:Params: {} 2023-12-15T23:18:45.331 DEBUG:boto:Token: None 2023-12-15T23:18:45.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c06875a212673cad-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.334 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:18:45.334 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.335 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.335 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.335 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.335 DEBUG:boto:Method: GET 2023-12-15T23:18:45.335 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.335 DEBUG:boto:Data: 2023-12-15T23:18:45.335 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.335 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.335 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.335 DEBUG:boto:Params: {} 2023-12-15T23:18:45.335 DEBUG:boto:Token: None 2023-12-15T23:18:45.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.336 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc= 2023-12-15T23:18:45.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc=', 'Content-Length': '0'} 2023-12-15T23:18:45.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043bf01ffd33d9e70-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.338 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.338 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.338 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.338 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.338 DEBUG:boto:Method: GET 2023-12-15T23:18:45.338 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.338 DEBUG:boto:Data: 2023-12-15T23:18:45.339 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.339 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.339 DEBUG:boto:Params: {} 2023-12-15T23:18:45.339 DEBUG:boto:Token: None 2023-12-15T23:18:45.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc= 2023-12-15T23:18:45.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc=', 'Content-Length': '0'} 2023-12-15T23:18:45.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc19f2b426b65a67-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.341 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.342 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.342 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.342 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.342 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.342 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.342 DEBUG:boto:Data: 2023-12-15T23:18:45.342 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.342 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.342 DEBUG:boto:Params: {} 2023-12-15T23:18:45.342 DEBUG:boto:Token: None 2023-12-15T23:18:45.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YmaTn/8zo238mozEdUfb93g2HBw= 2023-12-15T23:18:45.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YmaTn/8zo238mozEdUfb93g2HBw=', 'Content-Length': '0'} 2023-12-15T23:18:45.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090ce7fe20723fd67-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.345 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.345 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.345 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.345 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.345 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.345 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.346 DEBUG:boto:Data: 2023-12-15T23:18:45.346 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.346 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.346 DEBUG:boto:Params: {} 2023-12-15T23:18:45.346 DEBUG:boto:Token: None 2023-12-15T23:18:45.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YmaTn/8zo238mozEdUfb93g2HBw= 2023-12-15T23:18:45.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YmaTn/8zo238mozEdUfb93g2HBw=', 'Content-Length': '0'} 2023-12-15T23:18:45.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d6de24adc91832b-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:18:45.348 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.349 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.349 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.349 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.349 DEBUG:boto:Method: GET 2023-12-15T23:18:45.349 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.349 DEBUG:boto:Data: 2023-12-15T23:18:45.349 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.349 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.349 DEBUG:boto:Params: {} 2023-12-15T23:18:45.349 DEBUG:boto:Token: None 2023-12-15T23:18:45.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc= 2023-12-15T23:18:45.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc=', 'Content-Length': '0'} 2023-12-15T23:18:45.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ba3bba4665a1b1c-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.393 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.394 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.394 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.394 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.394 DEBUG:boto:Method: GET 2023-12-15T23:18:45.394 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.394 DEBUG:boto:Data: 2023-12-15T23:18:45.394 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.394 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.394 DEBUG:boto:Params: {} 2023-12-15T23:18:45.395 DEBUG:boto:Token: None 2023-12-15T23:18:45.395 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:18:45.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc= 2023-12-15T23:18:45.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QBvCoZPDjI2jrI2hYgIakQ86zkc=', 'Content-Length': '0'} 2023-12-15T23:18:45.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d7bf64f34e0a3d8-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.397 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.397 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.397 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.397 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.397 DEBUG:boto:Method: GET 2023-12-15T23:18:45.397 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.397 DEBUG:boto:Data: 2023-12-15T23:18:45.397 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.398 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.398 DEBUG:boto:Params: {} 2023-12-15T23:18:45.398 DEBUG:boto:Token: None 2023-12-15T23:18:45.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a5cb50aef734fa5-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.441 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.442 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.442 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.442 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.442 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.442 DEBUG:boto:Method: GET 2023-12-15T23:18:45.442 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.442 DEBUG:boto:Data: 2023-12-15T23:18:45.442 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.443 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.443 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.443 DEBUG:boto:Params: {} 2023-12-15T23:18:45.443 DEBUG:boto:Token: None 2023-12-15T23:18:45.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.446 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000917e5521b41720f6-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.446 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.446 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.447 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.447 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.447 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:18:45.447 DEBUG:boto:Data: 2023-12-15T23:18:45.447 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.447 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.447 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.447 DEBUG:boto:Params: {} 2023-12-15T23:18:45.447 DEBUG:boto:Token: None 2023-12-15T23:18:45.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95 2023-12-15T23:18:45.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3FNuXv4H3oDZaP7wUPhlTgHcnZg= 2023-12-15T23:18:45.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3FNuXv4H3oDZaP7wUPhlTgHcnZg=', 'Content-Length': '0'} 2023-12-15T23:18:45.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000869c862c01e9a256-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.450 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.450 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.450 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.450 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:18:45.450 DEBUG:boto:Data: 2023-12-15T23:18:45.450 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.450 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.450 DEBUG:boto:Params: {} 2023-12-15T23:18:45.450 DEBUG:boto:Token: None 2023-12-15T23:18:45.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95 2023-12-15T23:18:45.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3FNuXv4H3oDZaP7wUPhlTgHcnZg= 2023-12-15T23:18:45.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3FNuXv4H3oDZaP7wUPhlTgHcnZg=', 'Content-Length': '0'} 2023-12-15T23:18:45.452 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c4d54d960c78ab4-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:18:45.453 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.453 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.453 DEBUG:boto:Method: GET 2023-12-15T23:18:45.453 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:18:45.453 DEBUG:boto:Data: 2023-12-15T23:18:45.453 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.453 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.453 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.454 DEBUG:boto:Params: {} 2023-12-15T23:18:45.454 DEBUG:boto:Token: None 2023-12-15T23:18:45.454 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95 2023-12-15T23:18:45.454 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2wUqhOHWSggy1E2y1Sllbf1tWeM= 2023-12-15T23:18:45.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2wUqhOHWSggy1E2y1Sllbf1tWeM=', 'Content-Length': '0'} 2023-12-15T23:18:45.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000546eca4519892425-00657cded5-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.497 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:18:45.498 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:18:45.498 DEBUG:boto:Method: GET 2023-12-15T23:18:45.498 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:18:45.498 DEBUG:boto:Data: 2023-12-15T23:18:45.498 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.498 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.498 DEBUG:boto:Params: {} 2023-12-15T23:18:45.498 DEBUG:boto:Token: None 2023-12-15T23:18:45.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj95 2023-12-15T23:18:45.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2wUqhOHWSggy1E2y1Sllbf1tWeM= 2023-12-15T23:18:45.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2wUqhOHWSggy1E2y1Sllbf1tWeM=', 'Content-Length': '0'} 2023-12-15T23:18:45.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a166c7ae3fe988d-00657cded5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.501 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.501 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.501 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.501 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.501 DEBUG:boto:Method: GET 2023-12-15T23:18:45.501 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.501 DEBUG:boto:Data: 2023-12-15T23:18:45.501 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.501 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:18:45.501 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.502 DEBUG:boto:Params: {} 2023-12-15T23:18:45.502 DEBUG:boto:Token: None 2023-12-15T23:18:45.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d565ebbdd71bca4d-00657cded5-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.505 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.505 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.505 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.505 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.505 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.505 DEBUG:boto:Method: GET 2023-12-15T23:18:45.505 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:18:45.506 DEBUG:boto:Data: 2023-12-15T23:18:45.506 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.506 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.506 DEBUG:boto:Params: {} 2023-12-15T23:18:45.506 DEBUG:boto:Token: None 2023-12-15T23:18:45.506 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.506 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs= 2023-12-15T23:18:45.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XvsWJHhllPRyAOsgSnfHhZT2vOs=', 'Content-Length': '0'} 2023-12-15T23:18:45.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd3dc4c74f90ce10-00657cded5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.509 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:18:45.510 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:18:45.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:18:45.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:18:45.511 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:18:45.568 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:18:45.568 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:18:45.615 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:18:45.615 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:18:45.624 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 15 2023-12-15T23:18:45.680 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.680 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.680 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.680 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:45.680 DEBUG:boto:Data: 2023-12-15T23:18:45.680 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.680 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.680 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.680 DEBUG:boto:Params: {} 2023-12-15T23:18:45.680 DEBUG:boto:Token: None 2023-12-15T23:18:45.681 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.681 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U= 2023-12-15T23:18:45.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U=', 'Content-Length': '0'} 2023-12-15T23:18:45.683 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be8bff20b808732e-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.684 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:18:45.684 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:18:45.684 DEBUG:boto:Method: PUT 2023-12-15T23:18:45.684 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:18:45.684 DEBUG:boto:Data: 2023-12-15T23:18:45.684 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:18:45.684 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.684 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.684 DEBUG:boto:Params: {} 2023-12-15T23:18:45.684 DEBUG:boto:Token: None 2023-12-15T23:18:45.685 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj23 2023-12-15T23:18:45.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uAGwHAUg4ijLqHzQN5LzEGB8yvA= 2023-12-15T23:18:45.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uAGwHAUg4ijLqHzQN5LzEGB8yvA='} 2023-12-15T23:18:45.690 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000539c8a4fc608477c-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.690 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.690 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.690 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.690 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:45.690 DEBUG:boto:Data: 2023-12-15T23:18:45.690 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.691 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.691 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.691 DEBUG:boto:Params: {} 2023-12-15T23:18:45.691 DEBUG:boto:Token: None 2023-12-15T23:18:45.691 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U= 2023-12-15T23:18:45.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U=', 'Content-Length': '0'} 2023-12-15T23:18:45.693 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d379d678f9fb5362-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.693 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:18:45.694 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:18:45.694 DEBUG:boto:Method: PUT 2023-12-15T23:18:45.694 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:18:45.694 DEBUG:boto:Data: 2023-12-15T23:18:45.694 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:18:45.694 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.694 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.694 DEBUG:boto:Params: {} 2023-12-15T23:18:45.694 DEBUG:boto:Token: None 2023-12-15T23:18:45.694 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj46 2023-12-15T23:18:45.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5++5sOZk1oh74PpGRnobO50CgYY= 2023-12-15T23:18:45.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5++5sOZk1oh74PpGRnobO50CgYY='} 2023-12-15T23:18:45.737 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000066949d9cb39e5633-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.738 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.738 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.738 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.738 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:45.738 DEBUG:boto:Data: 2023-12-15T23:18:45.738 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.738 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.738 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.738 DEBUG:boto:Params: {} 2023-12-15T23:18:45.738 DEBUG:boto:Token: None 2023-12-15T23:18:45.739 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U= 2023-12-15T23:18:45.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U=', 'Content-Length': '0'} 2023-12-15T23:18:45.741 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000004df8c83cd862f28-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.741 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:18:45.741 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:18:45.741 DEBUG:boto:Method: PUT 2023-12-15T23:18:45.741 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:18:45.742 DEBUG:boto:Data: 2023-12-15T23:18:45.742 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:18:45.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.742 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.742 DEBUG:boto:Params: {} 2023-12-15T23:18:45.742 DEBUG:boto:Token: None 2023-12-15T23:18:45.742 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj69 2023-12-15T23:18:45.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PxezxqJH7a5VM5jnoF2n/Kg7DCE= 2023-12-15T23:18:45.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PxezxqJH7a5VM5jnoF2n/Kg7DCE='} 2023-12-15T23:18:45.748 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000077a8d6187c5e2f90-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.748 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.748 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.748 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.749 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:45.749 DEBUG:boto:Data: 2023-12-15T23:18:45.749 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.749 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.749 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.749 DEBUG:boto:Params: {} 2023-12-15T23:18:45.749 DEBUG:boto:Token: None 2023-12-15T23:18:45.749 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U= 2023-12-15T23:18:45.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U=', 'Content-Length': '0'} 2023-12-15T23:18:45.752 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001feeb2d5e0839643-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.752 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:18:45.752 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:18:45.752 DEBUG:boto:Method: PUT 2023-12-15T23:18:45.752 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:18:45.752 DEBUG:boto:Data: 2023-12-15T23:18:45.752 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:18:45.752 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.752 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.753 DEBUG:boto:Params: {} 2023-12-15T23:18:45.753 DEBUG:boto:Token: None 2023-12-15T23:18:45.753 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj92 2023-12-15T23:18:45.753 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jXTvoAtUEflr3FiblcyeWmzK+iQ= 2023-12-15T23:18:45.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jXTvoAtUEflr3FiblcyeWmzK+iQ='} 2023-12-15T23:18:45.759 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd54bb14363cb2e2-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.759 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:18:45.759 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:18:45.759 DEBUG:boto:Method: HEAD 2023-12-15T23:18:45.759 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:18:45.759 DEBUG:boto:Data: 2023-12-15T23:18:45.759 DEBUG:boto:Headers: {} 2023-12-15T23:18:45.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.759 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.759 DEBUG:boto:Params: {} 2023-12-15T23:18:45.760 DEBUG:boto:Token: None 2023-12-15T23:18:45.760 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/ 2023-12-15T23:18:45.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U= 2023-12-15T23:18:45.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJ6Xqz8hGYQsbCxl6dksBTP9S3U=', 'Content-Length': '0'} 2023-12-15T23:18:45.762 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009f9f42fb23527e79-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.762 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:18:45.762 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:18:45.762 DEBUG:boto:Method: PUT 2023-12-15T23:18:45.762 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:18:45.762 DEBUG:boto:Data: 2023-12-15T23:18:45.763 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:18:45.763 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:18:45.763 DEBUG:boto:Port: 8000 2023-12-15T23:18:45.763 DEBUG:boto:Params: {} 2023-12-15T23:18:45.763 DEBUG:boto:Token: None 2023-12-15T23:18:45.763 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:18:45 GMT /kskgfn-49/obj115 2023-12-15T23:18:45.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cAlL6L/RH2dZ3XHOvbsKS4vc738= 2023-12-15T23:18:45.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:18:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cAlL6L/RH2dZ3XHOvbsKS4vc738='} 2023-12-15T23:18:45.805 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000038a4e530c0f31090-00657cded5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:18:45.806 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:18:45.806 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:18:45.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:18:45.806 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:18:45.867 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:18:45.867 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:18:45.906 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:45.905+0000 7f3869ddc800 1 waiting to reach latest gen 3, on 2.. 2023-12-15T23:18:50.909 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:50.908+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:50.909 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , , , , , ] 2023-12-15T23:18:50.910 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:18:53.343 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:18:53.341+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:18:55.911 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:18:55.909+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:18:55.911 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:18:55.911 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:00.912 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:00.911+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:00.913 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:00.913 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:05.914 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:05.913+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:05.914 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:05.914 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:10.916 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:10.914+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:10.916 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:10.916 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:15.918 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:15.915+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:15.918 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:15.918 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:20.920 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:20.918+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:20.920 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:20.920 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:25.921 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:25.920+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:25.921 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:25.922 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:30.923 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:30.922+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:30.923 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:30.923 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:35.925 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:35.923+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:35.925 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:35.925 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:40.926 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:40.925+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:40.927 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:40.927 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:45.928 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:45.927+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:45.928 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:45.928 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:50.928+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:50.930 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , 00000000002.93.6, , , , , , , , 00000000001.87.6, , , , ] 2023-12-15T23:19:50.931 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:55.932 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:19:55.930+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:19:55.932 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:19:55.932 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:00.933 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:00.931+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:00.934 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:00.934 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:05.935 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:05.932+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:05.935 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:05.935 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:10.937 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:10.935+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:10.937 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:10.937 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:15.938 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:15.937+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:15.939 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:15.939 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:20.940 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:20.939+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:20.941 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:20.941 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:25.942 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:25.940+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:25.942 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:25.942 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:30.944 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:30.942+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:30.945 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:30.945 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:35.944+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:35.947 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:35.947 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:40.948 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:40.946+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:40.948 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:40.948 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:45.950 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:45.948+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:45.950 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:45.950 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:50.952 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:50.950+0000 7f3869ddc800 1 waiting for incremental sync to catch up: 2023-12-15T23:20:50.952 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:50.952 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:55.956 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:55.951+0000 7f3869ddc800 1 bucket sync caught up with source: 2023-12-15T23:20:55.956 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:55.956 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.45.6, , , 00000000002.175.6, , 00000000002.93.6, , , , , , 00000000001.61.6, , 00000000001.87.6, , , , ] 2023-12-15T23:20:55.956 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:20:55.951+0000 7f3869ddc800 0 bucket checkpoint complete 2023-12-15T23:20:55.974 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:20:55.974 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:20:55.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:20:55.975 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:20:56.035 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:20:56.036 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:20:56.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:20:56.072+0000 7f5ea9924800 1 bucket sync caught up with source: 2023-12-15T23:20:56.074 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000002.138.6, 00000000002.156.6, , , 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:20:56.074 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000002.138.6, 00000000002.156.6, , , 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:20:56.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:20:56.072+0000 7f5ea9924800 0 bucket checkpoint complete 2023-12-15T23:20:56.089 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:20:56.089 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.090 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.090 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.090 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:20:56.090 DEBUG:boto:Data: 2023-12-15T23:20:56.090 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.091 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.091 DEBUG:boto:Params: {} 2023-12-15T23:20:56.091 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:20:56.091 DEBUG:boto:Token: None 2023-12-15T23:20:56.092 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zAoHjFBLosw+eWC6f082JvBje4g= 2023-12-15T23:20:56.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zAoHjFBLosw+eWC6f082JvBje4g=', 'Content-Length': '0'} 2023-12-15T23:20:56.096 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c155c73ac7c1dd35-00657cdf58-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.097 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.097 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.097 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.097 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:20:56.097 DEBUG:boto:Data: 2023-12-15T23:20:56.097 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.097 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.097 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.098 DEBUG:boto:Params: {} 2023-12-15T23:20:56.098 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:20:56.098 DEBUG:boto:Token: None 2023-12-15T23:20:56.098 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zAoHjFBLosw+eWC6f082JvBje4g= 2023-12-15T23:20:56.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zAoHjFBLosw+eWC6f082JvBje4g=', 'Content-Length': '0'} 2023-12-15T23:20:56.103 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007022e2b5441a243b-00657cdf58-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.104 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:20:56.104 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.104 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.104 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.104 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.104 DEBUG:boto:Method: GET 2023-12-15T23:20:56.104 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.105 DEBUG:boto:Data: 2023-12-15T23:20:56.105 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.105 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.105 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.105 DEBUG:boto:Params: {} 2023-12-15T23:20:56.106 DEBUG:boto:Token: None 2023-12-15T23:20:56.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/?versions 2023-12-15T23:20:56.106 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo= 2023-12-15T23:20:56.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo=', 'Content-Length': '0'} 2023-12-15T23:20:56.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ed8201142e2fd51-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.109 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:20:56.111 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:20:56.112 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:20:56.113 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:20:56.113 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.113 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.113 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.113 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.113 DEBUG:boto:Method: GET 2023-12-15T23:20:56.113 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.113 DEBUG:boto:Data: 2023-12-15T23:20:56.113 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.114 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.114 DEBUG:boto:Params: {} 2023-12-15T23:20:56.114 DEBUG:boto:Token: None 2023-12-15T23:20:56.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/?versions 2023-12-15T23:20:56.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo= 2023-12-15T23:20:56.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo=', 'Content-Length': '0'} 2023-12-15T23:20:56.117 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000debe4aaac33a8b65-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.118 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:20:56.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:20:56.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:20:56.121 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:20:56.121 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:20:56.121 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.121 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.121 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.121 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.121 DEBUG:boto:Method: GET 2023-12-15T23:20:56.121 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.121 DEBUG:boto:Data: 2023-12-15T23:20:56.122 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.122 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.122 DEBUG:boto:Params: {} 2023-12-15T23:20:56.122 DEBUG:boto:Token: None 2023-12-15T23:20:56.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/?versions 2023-12-15T23:20:56.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo= 2023-12-15T23:20:56.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo=', 'Content-Length': '0'} 2023-12-15T23:20:56.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005e0a537277b2e93-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.125 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.126 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.126 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.127 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.127 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.127 DEBUG:boto:Method: GET 2023-12-15T23:20:56.127 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:20:56.127 DEBUG:boto:Data: 2023-12-15T23:20:56.127 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.127 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.127 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.127 DEBUG:boto:Params: {} 2023-12-15T23:20:56.127 DEBUG:boto:Token: None 2023-12-15T23:20:56.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/?versions 2023-12-15T23:20:56.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo= 2023-12-15T23:20:56.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sHMpuJCN591dpVOjA+3q2us/wxo=', 'Content-Length': '0'} 2023-12-15T23:20:56.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4b17271e8dddf6d-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.131 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:20:56.132 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.132 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.132 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.133 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.133 DEBUG:boto:Method: GET 2023-12-15T23:20:56.133 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.133 DEBUG:boto:Data: 2023-12-15T23:20:56.133 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.133 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.133 DEBUG:boto:Params: {} 2023-12-15T23:20:56.133 DEBUG:boto:Token: None 2023-12-15T23:20:56.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE= 2023-12-15T23:20:56.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE=', 'Content-Length': '0'} 2023-12-15T23:20:56.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e677bd0b645d04b6-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.136 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.136 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.137 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.137 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.137 DEBUG:boto:Method: GET 2023-12-15T23:20:56.137 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.137 DEBUG:boto:Data: 2023-12-15T23:20:56.137 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.137 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.137 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.138 DEBUG:boto:Params: {} 2023-12-15T23:20:56.138 DEBUG:boto:Token: None 2023-12-15T23:20:56.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE= 2023-12-15T23:20:56.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE=', 'Content-Length': '0'} 2023-12-15T23:20:56.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cca789ff640f04c4-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.140 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.140 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.141 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.141 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.141 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.141 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.141 DEBUG:boto:Data: 2023-12-15T23:20:56.141 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.141 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.142 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.142 DEBUG:boto:Params: {} 2023-12-15T23:20:56.142 DEBUG:boto:Token: None 2023-12-15T23:20:56.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ctIBNbIKpI/UmBuiRlcvV5pXeCE= 2023-12-15T23:20:56.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ctIBNbIKpI/UmBuiRlcvV5pXeCE=', 'Content-Length': '0'} 2023-12-15T23:20:56.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eee6d3b4ad1256dc-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.144 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.145 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.145 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.145 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.145 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.145 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.145 DEBUG:boto:Data: 2023-12-15T23:20:56.145 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.145 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.146 DEBUG:boto:Params: {} 2023-12-15T23:20:56.146 DEBUG:boto:Token: None 2023-12-15T23:20:56.146 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ctIBNbIKpI/UmBuiRlcvV5pXeCE= 2023-12-15T23:20:56.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ctIBNbIKpI/UmBuiRlcvV5pXeCE=', 'Content-Length': '0'} 2023-12-15T23:20:56.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8348d30e374516c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:20:56.148 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.148 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.148 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.148 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.148 DEBUG:boto:Method: GET 2023-12-15T23:20:56.149 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.149 DEBUG:boto:Data: 2023-12-15T23:20:56.149 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.149 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.149 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.149 DEBUG:boto:Params: {} 2023-12-15T23:20:56.149 DEBUG:boto:Token: None 2023-12-15T23:20:56.149 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE= 2023-12-15T23:20:56.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE=', 'Content-Length': '0'} 2023-12-15T23:20:56.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3d0e91ac1afacf9-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.193 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.193 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.194 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.194 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.194 DEBUG:boto:Method: GET 2023-12-15T23:20:56.194 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.194 DEBUG:boto:Data: 2023-12-15T23:20:56.194 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.194 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.194 DEBUG:boto:Params: {} 2023-12-15T23:20:56.195 DEBUG:boto:Token: None 2023-12-15T23:20:56.195 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:20:56.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE= 2023-12-15T23:20:56.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G4JbiLMiM0y0XPiPV6s0VtiGwVE=', 'Content-Length': '0'} 2023-12-15T23:20:56.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1dd6c67387cce67-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.197 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.197 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.198 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.198 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.198 DEBUG:boto:Method: GET 2023-12-15T23:20:56.198 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.198 DEBUG:boto:Data: 2023-12-15T23:20:56.198 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.198 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.198 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.198 DEBUG:boto:Params: {} 2023-12-15T23:20:56.198 DEBUG:boto:Token: None 2023-12-15T23:20:56.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055174d990573171a-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.201 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.202 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.202 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.202 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.202 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.202 DEBUG:boto:Method: GET 2023-12-15T23:20:56.202 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.202 DEBUG:boto:Data: 2023-12-15T23:20:56.203 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.203 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.203 DEBUG:boto:Params: {} 2023-12-15T23:20:56.203 DEBUG:boto:Token: None 2023-12-15T23:20:56.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e00091ba0ac005ab-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.206 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.206 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.207 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.207 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.207 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:20:56.207 DEBUG:boto:Data: 2023-12-15T23:20:56.207 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.207 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.207 DEBUG:boto:Params: {} 2023-12-15T23:20:56.207 DEBUG:boto:Token: None 2023-12-15T23:20:56.207 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11 2023-12-15T23:20:56.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c1Q534XZe3BZccU7KPmoIpt+xck= 2023-12-15T23:20:56.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c1Q534XZe3BZccU7KPmoIpt+xck=', 'Content-Length': '0'} 2023-12-15T23:20:56.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009c280e3da2e3991-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.210 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.210 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.210 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.210 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:20:56.210 DEBUG:boto:Data: 2023-12-15T23:20:56.210 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.211 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.211 DEBUG:boto:Params: {} 2023-12-15T23:20:56.211 DEBUG:boto:Token: None 2023-12-15T23:20:56.211 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11 2023-12-15T23:20:56.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c1Q534XZe3BZccU7KPmoIpt+xck= 2023-12-15T23:20:56.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c1Q534XZe3BZccU7KPmoIpt+xck=', 'Content-Length': '0'} 2023-12-15T23:20:56.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce901f1ff599c39e-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:20:56.213 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.214 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.214 DEBUG:boto:Method: GET 2023-12-15T23:20:56.214 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:20:56.214 DEBUG:boto:Data: 2023-12-15T23:20:56.214 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.214 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.214 DEBUG:boto:Params: {} 2023-12-15T23:20:56.214 DEBUG:boto:Token: None 2023-12-15T23:20:56.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11 2023-12-15T23:20:56.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uPvXupViqCX7746DwPPDyYU1qjQ= 2023-12-15T23:20:56.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uPvXupViqCX7746DwPPDyYU1qjQ=', 'Content-Length': '0'} 2023-12-15T23:20:56.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e0f8c3a05418d6e-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.257 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:20:56.258 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:20:56.258 DEBUG:boto:Method: GET 2023-12-15T23:20:56.258 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:20:56.258 DEBUG:boto:Data: 2023-12-15T23:20:56.258 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.258 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.258 DEBUG:boto:Params: {} 2023-12-15T23:20:56.258 DEBUG:boto:Token: None 2023-12-15T23:20:56.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj11 2023-12-15T23:20:56.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uPvXupViqCX7746DwPPDyYU1qjQ= 2023-12-15T23:20:56.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uPvXupViqCX7746DwPPDyYU1qjQ=', 'Content-Length': '0'} 2023-12-15T23:20:56.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fc19bcf20b455d5-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.261 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.261 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.261 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.261 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.261 DEBUG:boto:Method: GET 2023-12-15T23:20:56.261 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.262 DEBUG:boto:Data: 2023-12-15T23:20:56.262 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.262 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.262 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.262 DEBUG:boto:Params: {} 2023-12-15T23:20:56.262 DEBUG:boto:Token: None 2023-12-15T23:20:56.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dda6542b2f2a0aeb-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.265 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.265 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.266 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.266 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.266 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.266 DEBUG:boto:Method: GET 2023-12-15T23:20:56.266 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:20:56.266 DEBUG:boto:Data: 2023-12-15T23:20:56.266 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.266 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.266 DEBUG:boto:Params: {} 2023-12-15T23:20:56.266 DEBUG:boto:Token: None 2023-12-15T23:20:56.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb94c7f8bb59bb1c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.269 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:20:56.270 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.270 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.270 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.270 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.270 DEBUG:boto:Method: GET 2023-12-15T23:20:56.270 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.270 DEBUG:boto:Data: 2023-12-15T23:20:56.270 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.271 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.271 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.271 DEBUG:boto:Params: {} 2023-12-15T23:20:56.271 DEBUG:boto:Token: None 2023-12-15T23:20:56.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos= 2023-12-15T23:20:56.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos=', 'Content-Length': '0'} 2023-12-15T23:20:56.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f63200dcc0fd67c-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.274 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.274 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.274 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.274 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.274 DEBUG:boto:Method: GET 2023-12-15T23:20:56.274 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.275 DEBUG:boto:Data: 2023-12-15T23:20:56.275 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.275 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.275 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.275 DEBUG:boto:Params: {} 2023-12-15T23:20:56.275 DEBUG:boto:Token: None 2023-12-15T23:20:56.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos= 2023-12-15T23:20:56.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos=', 'Content-Length': '0'} 2023-12-15T23:20:56.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9f0ee4d0999152c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.278 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.278 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.278 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.278 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.278 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.278 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.278 DEBUG:boto:Data: 2023-12-15T23:20:56.278 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.278 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.278 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.279 DEBUG:boto:Params: {} 2023-12-15T23:20:56.279 DEBUG:boto:Token: None 2023-12-15T23:20:56.279 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xl1YrJhWowihkqsbJcuKNKVsDzU= 2023-12-15T23:20:56.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xl1YrJhWowihkqsbJcuKNKVsDzU=', 'Content-Length': '0'} 2023-12-15T23:20:56.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a8e971204883ade-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.281 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.281 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.282 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.282 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.282 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.282 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.282 DEBUG:boto:Data: 2023-12-15T23:20:56.282 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.282 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.282 DEBUG:boto:Params: {} 2023-12-15T23:20:56.282 DEBUG:boto:Token: None 2023-12-15T23:20:56.283 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Xl1YrJhWowihkqsbJcuKNKVsDzU= 2023-12-15T23:20:56.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Xl1YrJhWowihkqsbJcuKNKVsDzU=', 'Content-Length': '0'} 2023-12-15T23:20:56.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d64ee5d9d2706b54-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:20:56.285 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.285 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.285 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.285 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.286 DEBUG:boto:Method: GET 2023-12-15T23:20:56.286 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.286 DEBUG:boto:Data: 2023-12-15T23:20:56.286 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.286 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.286 DEBUG:boto:Params: {} 2023-12-15T23:20:56.286 DEBUG:boto:Token: None 2023-12-15T23:20:56.286 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos= 2023-12-15T23:20:56.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos=', 'Content-Length': '0'} 2023-12-15T23:20:56.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe11ba810393c308-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.289 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.289 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.289 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.289 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.289 DEBUG:boto:Method: GET 2023-12-15T23:20:56.289 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.289 DEBUG:boto:Data: 2023-12-15T23:20:56.289 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.290 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.290 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.290 DEBUG:boto:Params: {} 2023-12-15T23:20:56.290 DEBUG:boto:Token: None 2023-12-15T23:20:56.290 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:20:56.290 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos= 2023-12-15T23:20:56.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8kBBo6lFZ2mkFvJtGn5BQNSQfos=', 'Content-Length': '0'} 2023-12-15T23:20:56.292 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9f04d2b16f60aee-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.333 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.334 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.334 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.334 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.334 DEBUG:boto:Method: GET 2023-12-15T23:20:56.334 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.334 DEBUG:boto:Data: 2023-12-15T23:20:56.334 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.334 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.334 DEBUG:boto:Params: {} 2023-12-15T23:20:56.334 DEBUG:boto:Token: None 2023-12-15T23:20:56.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8f60c4a5f6c77f2-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.337 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.338 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.338 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.338 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.338 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.338 DEBUG:boto:Method: GET 2023-12-15T23:20:56.338 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.338 DEBUG:boto:Data: 2023-12-15T23:20:56.339 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.339 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.339 DEBUG:boto:Params: {} 2023-12-15T23:20:56.339 DEBUG:boto:Token: None 2023-12-15T23:20:56.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004bfda250c164437-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.342 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.342 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.343 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.343 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.343 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:20:56.343 DEBUG:boto:Data: 2023-12-15T23:20:56.343 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.343 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.343 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.343 DEBUG:boto:Params: {} 2023-12-15T23:20:56.343 DEBUG:boto:Token: None 2023-12-15T23:20:56.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115 2023-12-15T23:20:56.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:itxqQ3PftrLYOZ48oKC4yHs0sWg= 2023-12-15T23:20:56.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:itxqQ3PftrLYOZ48oKC4yHs0sWg=', 'Content-Length': '0'} 2023-12-15T23:20:56.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d77c32ead7f8667-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.346 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.346 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.346 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.346 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:20:56.346 DEBUG:boto:Data: 2023-12-15T23:20:56.347 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.347 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.347 DEBUG:boto:Params: {} 2023-12-15T23:20:56.347 DEBUG:boto:Token: None 2023-12-15T23:20:56.347 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115 2023-12-15T23:20:56.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:itxqQ3PftrLYOZ48oKC4yHs0sWg= 2023-12-15T23:20:56.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:itxqQ3PftrLYOZ48oKC4yHs0sWg=', 'Content-Length': '0'} 2023-12-15T23:20:56.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0ef70830bcc4122-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:20:56.350 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.350 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.350 DEBUG:boto:Method: GET 2023-12-15T23:20:56.350 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:20:56.350 DEBUG:boto:Data: 2023-12-15T23:20:56.350 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.350 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.350 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.350 DEBUG:boto:Params: {} 2023-12-15T23:20:56.350 DEBUG:boto:Token: None 2023-12-15T23:20:56.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115 2023-12-15T23:20:56.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPXSOxE69Ixo0ZAr7s609Cn23zM= 2023-12-15T23:20:56.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPXSOxE69Ixo0ZAr7s609Cn23zM=', 'Content-Length': '0'} 2023-12-15T23:20:56.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6f2d5698569656e-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.397 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:20:56.398 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:20:56.398 DEBUG:boto:Method: GET 2023-12-15T23:20:56.398 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:20:56.398 DEBUG:boto:Data: 2023-12-15T23:20:56.398 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.398 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.398 DEBUG:boto:Params: {} 2023-12-15T23:20:56.399 DEBUG:boto:Token: None 2023-12-15T23:20:56.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj115 2023-12-15T23:20:56.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPXSOxE69Ixo0ZAr7s609Cn23zM= 2023-12-15T23:20:56.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPXSOxE69Ixo0ZAr7s609Cn23zM=', 'Content-Length': '0'} 2023-12-15T23:20:56.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008be89da0f9e94e97-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.402 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.402 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.402 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.402 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.402 DEBUG:boto:Method: GET 2023-12-15T23:20:56.402 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.402 DEBUG:boto:Data: 2023-12-15T23:20:56.402 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.402 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.403 DEBUG:boto:Params: {} 2023-12-15T23:20:56.403 DEBUG:boto:Token: None 2023-12-15T23:20:56.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f5cf926e460c528-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.406 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.406 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.406 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.406 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.406 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.406 DEBUG:boto:Method: GET 2023-12-15T23:20:56.407 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:20:56.407 DEBUG:boto:Data: 2023-12-15T23:20:56.407 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.407 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.407 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.407 DEBUG:boto:Params: {} 2023-12-15T23:20:56.407 DEBUG:boto:Token: None 2023-12-15T23:20:56.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.408 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083afe5f3138623dc-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.410 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:20:56.411 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.411 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.411 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.411 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.411 DEBUG:boto:Method: GET 2023-12-15T23:20:56.411 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.411 DEBUG:boto:Data: 2023-12-15T23:20:56.411 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.411 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.411 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.412 DEBUG:boto:Params: {} 2023-12-15T23:20:56.412 DEBUG:boto:Token: None 2023-12-15T23:20:56.412 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI= 2023-12-15T23:20:56.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI=', 'Content-Length': '0'} 2023-12-15T23:20:56.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ec9bf7ec34fc95a-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.414 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.414 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.414 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.414 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.415 DEBUG:boto:Method: GET 2023-12-15T23:20:56.415 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.415 DEBUG:boto:Data: 2023-12-15T23:20:56.415 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.415 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.415 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.415 DEBUG:boto:Params: {} 2023-12-15T23:20:56.415 DEBUG:boto:Token: None 2023-12-15T23:20:56.416 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.416 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI= 2023-12-15T23:20:56.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI=', 'Content-Length': '0'} 2023-12-15T23:20:56.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058668b4d06ee0c87-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.461 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.462 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.462 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.462 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.462 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.462 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.462 DEBUG:boto:Data: 2023-12-15T23:20:56.462 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.462 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.463 DEBUG:boto:Params: {} 2023-12-15T23:20:56.463 DEBUG:boto:Token: None 2023-12-15T23:20:56.463 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8JkTqL1mbvGAUyPPNlkGikrA4CA= 2023-12-15T23:20:56.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8JkTqL1mbvGAUyPPNlkGikrA4CA=', 'Content-Length': '0'} 2023-12-15T23:20:56.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023ae44d07d973daa-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.465 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.465 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.465 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.466 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.466 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.466 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.466 DEBUG:boto:Data: 2023-12-15T23:20:56.466 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.466 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.466 DEBUG:boto:Params: {} 2023-12-15T23:20:56.466 DEBUG:boto:Token: None 2023-12-15T23:20:56.467 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8JkTqL1mbvGAUyPPNlkGikrA4CA= 2023-12-15T23:20:56.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8JkTqL1mbvGAUyPPNlkGikrA4CA=', 'Content-Length': '0'} 2023-12-15T23:20:56.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a1b9bdf8cbfbfb7-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:20:56.469 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.469 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.469 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.469 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.469 DEBUG:boto:Method: GET 2023-12-15T23:20:56.469 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.469 DEBUG:boto:Data: 2023-12-15T23:20:56.469 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.470 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.470 DEBUG:boto:Params: {} 2023-12-15T23:20:56.470 DEBUG:boto:Token: None 2023-12-15T23:20:56.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI= 2023-12-15T23:20:56.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI=', 'Content-Length': '0'} 2023-12-15T23:20:56.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029363419265487cb-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.472 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.472 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.472 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.472 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.472 DEBUG:boto:Method: GET 2023-12-15T23:20:56.473 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.473 DEBUG:boto:Data: 2023-12-15T23:20:56.473 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.473 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.473 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.473 DEBUG:boto:Params: {} 2023-12-15T23:20:56.473 DEBUG:boto:Token: None 2023-12-15T23:20:56.473 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:20:56.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI= 2023-12-15T23:20:56.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oqQ4dvhqrVq1/AzpFShKVCSvhhI=', 'Content-Length': '0'} 2023-12-15T23:20:56.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f78cf1402e358e34-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.476 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.476 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.476 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.476 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.476 DEBUG:boto:Method: GET 2023-12-15T23:20:56.476 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.476 DEBUG:boto:Data: 2023-12-15T23:20:56.477 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.477 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.477 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.477 DEBUG:boto:Params: {} 2023-12-15T23:20:56.477 DEBUG:boto:Token: None 2023-12-15T23:20:56.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b74ab52a364fe6fc-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.480 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.480 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.480 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.480 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.481 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.481 DEBUG:boto:Method: GET 2023-12-15T23:20:56.481 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.481 DEBUG:boto:Data: 2023-12-15T23:20:56.481 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.481 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.481 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.481 DEBUG:boto:Params: {} 2023-12-15T23:20:56.481 DEBUG:boto:Token: None 2023-12-15T23:20:56.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.484 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c764d3323b3aff77-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.484 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.485 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.485 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.485 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.485 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:20:56.485 DEBUG:boto:Data: 2023-12-15T23:20:56.485 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.485 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.486 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.486 DEBUG:boto:Params: {} 2023-12-15T23:20:56.486 DEBUG:boto:Token: None 2023-12-15T23:20:56.486 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17 2023-12-15T23:20:56.486 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A6ZumotsULuyH6rdmwWnG0FvScI= 2023-12-15T23:20:56.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A6ZumotsULuyH6rdmwWnG0FvScI=', 'Content-Length': '0'} 2023-12-15T23:20:56.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a3b6a2b5c8245d0-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.488 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.488 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.488 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.488 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:20:56.488 DEBUG:boto:Data: 2023-12-15T23:20:56.488 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.488 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.489 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.489 DEBUG:boto:Params: {} 2023-12-15T23:20:56.489 DEBUG:boto:Token: None 2023-12-15T23:20:56.489 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17 2023-12-15T23:20:56.489 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A6ZumotsULuyH6rdmwWnG0FvScI= 2023-12-15T23:20:56.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A6ZumotsULuyH6rdmwWnG0FvScI=', 'Content-Length': '0'} 2023-12-15T23:20:56.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004674951105fc18c7-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:20:56.491 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.491 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.491 DEBUG:boto:Method: GET 2023-12-15T23:20:56.491 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:20:56.492 DEBUG:boto:Data: 2023-12-15T23:20:56.492 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.492 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.492 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.492 DEBUG:boto:Params: {} 2023-12-15T23:20:56.492 DEBUG:boto:Token: None 2023-12-15T23:20:56.492 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17 2023-12-15T23:20:56.492 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYrKJTDHQ9DW1ft9azyDKWkgX6g= 2023-12-15T23:20:56.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYrKJTDHQ9DW1ft9azyDKWkgX6g=', 'Content-Length': '0'} 2023-12-15T23:20:56.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc615e0c6748f73e-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.494 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:20:56.494 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:20:56.495 DEBUG:boto:Method: GET 2023-12-15T23:20:56.495 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:20:56.495 DEBUG:boto:Data: 2023-12-15T23:20:56.495 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.495 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.495 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.495 DEBUG:boto:Params: {} 2023-12-15T23:20:56.495 DEBUG:boto:Token: None 2023-12-15T23:20:56.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj17 2023-12-15T23:20:56.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYrKJTDHQ9DW1ft9azyDKWkgX6g= 2023-12-15T23:20:56.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYrKJTDHQ9DW1ft9azyDKWkgX6g=', 'Content-Length': '0'} 2023-12-15T23:20:56.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000363201e1416baa92-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.497 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.498 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.498 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.498 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.498 DEBUG:boto:Method: GET 2023-12-15T23:20:56.498 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.498 DEBUG:boto:Data: 2023-12-15T23:20:56.498 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.498 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.498 DEBUG:boto:Params: {} 2023-12-15T23:20:56.498 DEBUG:boto:Token: None 2023-12-15T23:20:56.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000607d3b6df99de15d-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.541 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.542 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.542 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.542 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.542 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.542 DEBUG:boto:Method: GET 2023-12-15T23:20:56.542 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:20:56.542 DEBUG:boto:Data: 2023-12-15T23:20:56.543 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.543 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.543 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.543 DEBUG:boto:Params: {} 2023-12-15T23:20:56.543 DEBUG:boto:Token: None 2023-12-15T23:20:56.543 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.546 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000550931c6c9229658-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.546 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:20:56.546 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.546 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.546 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.547 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.547 DEBUG:boto:Method: GET 2023-12-15T23:20:56.547 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.547 DEBUG:boto:Data: 2023-12-15T23:20:56.547 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.547 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.547 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.547 DEBUG:boto:Params: {} 2023-12-15T23:20:56.547 DEBUG:boto:Token: None 2023-12-15T23:20:56.548 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk= 2023-12-15T23:20:56.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk=', 'Content-Length': '0'} 2023-12-15T23:20:56.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3209648745655fa-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.550 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.550 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.551 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.551 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.551 DEBUG:boto:Method: GET 2023-12-15T23:20:56.551 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.551 DEBUG:boto:Data: 2023-12-15T23:20:56.551 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.551 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.551 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.551 DEBUG:boto:Params: {} 2023-12-15T23:20:56.551 DEBUG:boto:Token: None 2023-12-15T23:20:56.552 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.552 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk= 2023-12-15T23:20:56.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk=', 'Content-Length': '0'} 2023-12-15T23:20:56.554 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfb7210da0dc89e3-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.554 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.554 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.554 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.554 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.555 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.555 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.555 DEBUG:boto:Data: 2023-12-15T23:20:56.555 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.555 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.555 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.555 DEBUG:boto:Params: {} 2023-12-15T23:20:56.555 DEBUG:boto:Token: None 2023-12-15T23:20:56.555 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:89aCLJCmWKHJq1z7B7NBB8YtHcA= 2023-12-15T23:20:56.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:89aCLJCmWKHJq1z7B7NBB8YtHcA=', 'Content-Length': '0'} 2023-12-15T23:20:56.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f483e8c8ae43f20c-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.558 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.558 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.558 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.558 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.558 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.558 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.558 DEBUG:boto:Data: 2023-12-15T23:20:56.558 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.559 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.559 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.559 DEBUG:boto:Params: {} 2023-12-15T23:20:56.559 DEBUG:boto:Token: None 2023-12-15T23:20:56.559 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:89aCLJCmWKHJq1z7B7NBB8YtHcA= 2023-12-15T23:20:56.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:89aCLJCmWKHJq1z7B7NBB8YtHcA=', 'Content-Length': '0'} 2023-12-15T23:20:56.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9710e55f506f243-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:20:56.562 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.562 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.562 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.562 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.562 DEBUG:boto:Method: GET 2023-12-15T23:20:56.562 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.562 DEBUG:boto:Data: 2023-12-15T23:20:56.562 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.563 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.563 DEBUG:boto:Params: {} 2023-12-15T23:20:56.563 DEBUG:boto:Token: None 2023-12-15T23:20:56.563 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk= 2023-12-15T23:20:56.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk=', 'Content-Length': '0'} 2023-12-15T23:20:56.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c279337e3c694b7-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.605 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.606 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.606 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.606 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.606 DEBUG:boto:Method: GET 2023-12-15T23:20:56.606 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.606 DEBUG:boto:Data: 2023-12-15T23:20:56.606 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.606 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.606 DEBUG:boto:Params: {} 2023-12-15T23:20:56.607 DEBUG:boto:Token: None 2023-12-15T23:20:56.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:20:56.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk= 2023-12-15T23:20:56.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wu25i9HlYe1JaCEVjhl1HOkQ4dk=', 'Content-Length': '0'} 2023-12-15T23:20:56.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9b7a8362a2e5589-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.609 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.609 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.610 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.610 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.610 DEBUG:boto:Method: GET 2023-12-15T23:20:56.610 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.610 DEBUG:boto:Data: 2023-12-15T23:20:56.610 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.610 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.610 DEBUG:boto:Params: {} 2023-12-15T23:20:56.611 DEBUG:boto:Token: None 2023-12-15T23:20:56.611 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0ed2d4282bbe5fc-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.614 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.614 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.614 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.614 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.614 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.614 DEBUG:boto:Method: GET 2023-12-15T23:20:56.615 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.615 DEBUG:boto:Data: 2023-12-15T23:20:56.615 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.615 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.615 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.615 DEBUG:boto:Params: {} 2023-12-15T23:20:56.615 DEBUG:boto:Token: None 2023-12-15T23:20:56.615 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000800e6f7b673a7972-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.618 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.619 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.619 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.619 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.619 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:20:56.619 DEBUG:boto:Data: 2023-12-15T23:20:56.619 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.619 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.620 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.620 DEBUG:boto:Params: {} 2023-12-15T23:20:56.620 DEBUG:boto:Token: None 2023-12-15T23:20:56.620 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19 2023-12-15T23:20:56.620 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjCB5lhsxLifqaDDS5HV3il7KWk= 2023-12-15T23:20:56.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjCB5lhsxLifqaDDS5HV3il7KWk=', 'Content-Length': '0'} 2023-12-15T23:20:56.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005057e53e33b856ed-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.623 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.623 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.623 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.623 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:20:56.623 DEBUG:boto:Data: 2023-12-15T23:20:56.623 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.623 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.623 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.623 DEBUG:boto:Params: {} 2023-12-15T23:20:56.623 DEBUG:boto:Token: None 2023-12-15T23:20:56.624 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19 2023-12-15T23:20:56.624 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjCB5lhsxLifqaDDS5HV3il7KWk= 2023-12-15T23:20:56.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjCB5lhsxLifqaDDS5HV3il7KWk=', 'Content-Length': '0'} 2023-12-15T23:20:56.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c3f40f5e887fdea-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.626 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:20:56.626 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.626 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.626 DEBUG:boto:Method: GET 2023-12-15T23:20:56.626 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:20:56.627 DEBUG:boto:Data: 2023-12-15T23:20:56.627 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.627 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.627 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.627 DEBUG:boto:Params: {} 2023-12-15T23:20:56.627 DEBUG:boto:Token: None 2023-12-15T23:20:56.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19 2023-12-15T23:20:56.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x34bC+NnvyZP8KtycCQq/JXnPN4= 2023-12-15T23:20:56.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x34bC+NnvyZP8KtycCQq/JXnPN4=', 'Content-Length': '0'} 2023-12-15T23:20:56.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f0631a1433175a9-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.673 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:20:56.673 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:20:56.674 DEBUG:boto:Method: GET 2023-12-15T23:20:56.674 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:20:56.674 DEBUG:boto:Data: 2023-12-15T23:20:56.674 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.674 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.674 DEBUG:boto:Params: {} 2023-12-15T23:20:56.675 DEBUG:boto:Token: None 2023-12-15T23:20:56.675 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj19 2023-12-15T23:20:56.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x34bC+NnvyZP8KtycCQq/JXnPN4= 2023-12-15T23:20:56.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x34bC+NnvyZP8KtycCQq/JXnPN4=', 'Content-Length': '0'} 2023-12-15T23:20:56.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005de8b236b8770fd2-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.677 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.678 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.678 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.678 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.678 DEBUG:boto:Method: GET 2023-12-15T23:20:56.678 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.678 DEBUG:boto:Data: 2023-12-15T23:20:56.678 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.678 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.678 DEBUG:boto:Params: {} 2023-12-15T23:20:56.678 DEBUG:boto:Token: None 2023-12-15T23:20:56.679 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.679 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.681 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8f3a14881f8798a-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.682 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.682 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.682 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.682 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.682 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.682 DEBUG:boto:Method: GET 2023-12-15T23:20:56.683 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:20:56.683 DEBUG:boto:Data: 2023-12-15T23:20:56.683 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.683 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.683 DEBUG:boto:Params: {} 2023-12-15T23:20:56.683 DEBUG:boto:Token: None 2023-12-15T23:20:56.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002708801fa205d2f0-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.686 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:20:56.687 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.687 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.687 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.687 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.687 DEBUG:boto:Method: GET 2023-12-15T23:20:56.687 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.687 DEBUG:boto:Data: 2023-12-15T23:20:56.687 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.687 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.687 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.687 DEBUG:boto:Params: {} 2023-12-15T23:20:56.688 DEBUG:boto:Token: None 2023-12-15T23:20:56.688 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.688 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM= 2023-12-15T23:20:56.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM=', 'Content-Length': '0'} 2023-12-15T23:20:56.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000396be951d19725e6-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.690 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.690 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.690 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.691 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.691 DEBUG:boto:Method: GET 2023-12-15T23:20:56.691 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.691 DEBUG:boto:Data: 2023-12-15T23:20:56.691 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.691 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.691 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.691 DEBUG:boto:Params: {} 2023-12-15T23:20:56.691 DEBUG:boto:Token: None 2023-12-15T23:20:56.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.692 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM= 2023-12-15T23:20:56.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM=', 'Content-Length': '0'} 2023-12-15T23:20:56.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000187a3df6a10ba928-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.694 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.694 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.694 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.694 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.694 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.694 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.694 DEBUG:boto:Data: 2023-12-15T23:20:56.695 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.695 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.695 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.695 DEBUG:boto:Params: {} 2023-12-15T23:20:56.695 DEBUG:boto:Token: None 2023-12-15T23:20:56.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t1GPJ+O6Z38azbuntLhnnGmclYg= 2023-12-15T23:20:56.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t1GPJ+O6Z38azbuntLhnnGmclYg=', 'Content-Length': '0'} 2023-12-15T23:20:56.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000939286e6a36868d-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.697 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.697 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.698 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.698 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.698 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.698 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.698 DEBUG:boto:Data: 2023-12-15T23:20:56.698 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.698 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.698 DEBUG:boto:Params: {} 2023-12-15T23:20:56.698 DEBUG:boto:Token: None 2023-12-15T23:20:56.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t1GPJ+O6Z38azbuntLhnnGmclYg= 2023-12-15T23:20:56.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t1GPJ+O6Z38azbuntLhnnGmclYg=', 'Content-Length': '0'} 2023-12-15T23:20:56.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d2fea4d94c0148c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.701 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:20:56.701 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.701 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.701 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.701 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.701 DEBUG:boto:Method: GET 2023-12-15T23:20:56.701 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.701 DEBUG:boto:Data: 2023-12-15T23:20:56.702 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.702 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.702 DEBUG:boto:Params: {} 2023-12-15T23:20:56.702 DEBUG:boto:Token: None 2023-12-15T23:20:56.702 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.702 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM= 2023-12-15T23:20:56.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM=', 'Content-Length': '0'} 2023-12-15T23:20:56.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000335538f172c6c242-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.745 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.746 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.746 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.746 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.746 DEBUG:boto:Method: GET 2023-12-15T23:20:56.746 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.746 DEBUG:boto:Data: 2023-12-15T23:20:56.746 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.746 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.747 DEBUG:boto:Params: {} 2023-12-15T23:20:56.747 DEBUG:boto:Token: None 2023-12-15T23:20:56.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:20:56.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM= 2023-12-15T23:20:56.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RI6fOmTLWNREvWhD0ZIFHCvuIFM=', 'Content-Length': '0'} 2023-12-15T23:20:56.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000487a9cc731ac7776-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.749 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.749 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.750 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.750 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.750 DEBUG:boto:Method: GET 2023-12-15T23:20:56.750 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.750 DEBUG:boto:Data: 2023-12-15T23:20:56.750 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.750 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.750 DEBUG:boto:Params: {} 2023-12-15T23:20:56.750 DEBUG:boto:Token: None 2023-12-15T23:20:56.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a14018cc6960358-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.753 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.754 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.754 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.754 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.754 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.754 DEBUG:boto:Method: GET 2023-12-15T23:20:56.754 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.754 DEBUG:boto:Data: 2023-12-15T23:20:56.754 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.755 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.755 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.755 DEBUG:boto:Params: {} 2023-12-15T23:20:56.755 DEBUG:boto:Token: None 2023-12-15T23:20:56.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb8fbf0d665483b1-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.758 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.758 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.759 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.759 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.759 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:20:56.759 DEBUG:boto:Data: 2023-12-15T23:20:56.759 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.759 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.759 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.759 DEBUG:boto:Params: {} 2023-12-15T23:20:56.759 DEBUG:boto:Token: None 2023-12-15T23:20:56.759 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22 2023-12-15T23:20:56.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N4GPx65f6mwbh+FD4LvvNaH2lfU= 2023-12-15T23:20:56.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N4GPx65f6mwbh+FD4LvvNaH2lfU=', 'Content-Length': '0'} 2023-12-15T23:20:56.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe71bb50bfbe6f8b-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.762 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.762 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.762 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.762 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:20:56.762 DEBUG:boto:Data: 2023-12-15T23:20:56.762 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.762 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.763 DEBUG:boto:Params: {} 2023-12-15T23:20:56.763 DEBUG:boto:Token: None 2023-12-15T23:20:56.763 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22 2023-12-15T23:20:56.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N4GPx65f6mwbh+FD4LvvNaH2lfU= 2023-12-15T23:20:56.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N4GPx65f6mwbh+FD4LvvNaH2lfU=', 'Content-Length': '0'} 2023-12-15T23:20:56.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064a2265e90832248-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:20:56.766 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.766 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.766 DEBUG:boto:Method: GET 2023-12-15T23:20:56.766 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:20:56.766 DEBUG:boto:Data: 2023-12-15T23:20:56.766 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.766 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.766 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.766 DEBUG:boto:Params: {} 2023-12-15T23:20:56.767 DEBUG:boto:Token: None 2023-12-15T23:20:56.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22 2023-12-15T23:20:56.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u2wLZ1TG0q5ndtDQOzm0mVj0beU= 2023-12-15T23:20:56.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u2wLZ1TG0q5ndtDQOzm0mVj0beU=', 'Content-Length': '0'} 2023-12-15T23:20:56.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4ee8cbbbefb5710-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.809 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:20:56.810 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:20:56.810 DEBUG:boto:Method: GET 2023-12-15T23:20:56.810 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:20:56.810 DEBUG:boto:Data: 2023-12-15T23:20:56.810 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.810 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.810 DEBUG:boto:Params: {} 2023-12-15T23:20:56.810 DEBUG:boto:Token: None 2023-12-15T23:20:56.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj22 2023-12-15T23:20:56.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u2wLZ1TG0q5ndtDQOzm0mVj0beU= 2023-12-15T23:20:56.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u2wLZ1TG0q5ndtDQOzm0mVj0beU=', 'Content-Length': '0'} 2023-12-15T23:20:56.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042ff42177c9c6c9c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.813 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.813 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.813 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.813 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.813 DEBUG:boto:Method: GET 2023-12-15T23:20:56.813 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.813 DEBUG:boto:Data: 2023-12-15T23:20:56.813 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.813 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.814 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.814 DEBUG:boto:Params: {} 2023-12-15T23:20:56.814 DEBUG:boto:Token: None 2023-12-15T23:20:56.814 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.816 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a9172387b804782-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.861 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.862 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.862 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.862 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.862 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.862 DEBUG:boto:Method: GET 2023-12-15T23:20:56.862 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:20:56.863 DEBUG:boto:Data: 2023-12-15T23:20:56.863 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.863 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.863 DEBUG:boto:Params: {} 2023-12-15T23:20:56.863 DEBUG:boto:Token: None 2023-12-15T23:20:56.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ff4d4f6c5c0b94c-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.866 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:20:56.867 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.867 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.867 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.867 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.867 DEBUG:boto:Method: GET 2023-12-15T23:20:56.867 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.867 DEBUG:boto:Data: 2023-12-15T23:20:56.867 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.868 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.868 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.868 DEBUG:boto:Params: {} 2023-12-15T23:20:56.868 DEBUG:boto:Token: None 2023-12-15T23:20:56.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI= 2023-12-15T23:20:56.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI=', 'Content-Length': '0'} 2023-12-15T23:20:56.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000297da7c84b2e85aa-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.870 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.870 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.871 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.871 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.871 DEBUG:boto:Method: GET 2023-12-15T23:20:56.871 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.871 DEBUG:boto:Data: 2023-12-15T23:20:56.871 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.871 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.871 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.871 DEBUG:boto:Params: {} 2023-12-15T23:20:56.871 DEBUG:boto:Token: None 2023-12-15T23:20:56.872 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI= 2023-12-15T23:20:56.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI=', 'Content-Length': '0'} 2023-12-15T23:20:56.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083fa3457af1e3ab5-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.874 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.874 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.874 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.874 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.874 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.874 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.874 DEBUG:boto:Data: 2023-12-15T23:20:56.875 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.875 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.875 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.875 DEBUG:boto:Params: {} 2023-12-15T23:20:56.875 DEBUG:boto:Token: None 2023-12-15T23:20:56.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iPWZzlCOnEjUuEprZXvENuLbH5I= 2023-12-15T23:20:56.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iPWZzlCOnEjUuEprZXvENuLbH5I=', 'Content-Length': '0'} 2023-12-15T23:20:56.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007919f00b47570a49-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.878 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.878 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.878 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.878 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.878 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.878 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.878 DEBUG:boto:Data: 2023-12-15T23:20:56.878 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.879 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.879 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.879 DEBUG:boto:Params: {} 2023-12-15T23:20:56.879 DEBUG:boto:Token: None 2023-12-15T23:20:56.879 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iPWZzlCOnEjUuEprZXvENuLbH5I= 2023-12-15T23:20:56.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iPWZzlCOnEjUuEprZXvENuLbH5I=', 'Content-Length': '0'} 2023-12-15T23:20:56.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a81143ff6acc1ff0-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:20:56.881 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.881 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.881 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.881 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.882 DEBUG:boto:Method: GET 2023-12-15T23:20:56.882 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.882 DEBUG:boto:Data: 2023-12-15T23:20:56.882 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.882 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.882 DEBUG:boto:Params: {} 2023-12-15T23:20:56.882 DEBUG:boto:Token: None 2023-12-15T23:20:56.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI= 2023-12-15T23:20:56.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI=', 'Content-Length': '0'} 2023-12-15T23:20:56.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fcbe58407638811-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.925 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.926 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.926 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.926 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.926 DEBUG:boto:Method: GET 2023-12-15T23:20:56.926 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.926 DEBUG:boto:Data: 2023-12-15T23:20:56.926 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.926 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.926 DEBUG:boto:Params: {} 2023-12-15T23:20:56.927 DEBUG:boto:Token: None 2023-12-15T23:20:56.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:20:56.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI= 2023-12-15T23:20:56.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iED5ori+HidT0opAiiR4AUOzEZI=', 'Content-Length': '0'} 2023-12-15T23:20:56.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076a6365659dbba73-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.929 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.929 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.929 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.930 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.930 DEBUG:boto:Method: GET 2023-12-15T23:20:56.930 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.930 DEBUG:boto:Data: 2023-12-15T23:20:56.930 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.930 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.930 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.930 DEBUG:boto:Params: {} 2023-12-15T23:20:56.930 DEBUG:boto:Token: None 2023-12-15T23:20:56.931 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ef50278931765da-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.933 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.933 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.934 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.934 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.934 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.934 DEBUG:boto:Method: GET 2023-12-15T23:20:56.934 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.934 DEBUG:boto:Data: 2023-12-15T23:20:56.934 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.934 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.935 DEBUG:boto:Params: {} 2023-12-15T23:20:56.935 DEBUG:boto:Token: None 2023-12-15T23:20:56.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.938 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013da3d956a99a3ba-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.938 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:56.938 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.938 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.939 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.939 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:20:56.939 DEBUG:boto:Data: 2023-12-15T23:20:56.939 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.939 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.939 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.939 DEBUG:boto:Params: {} 2023-12-15T23:20:56.939 DEBUG:boto:Token: None 2023-12-15T23:20:56.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23 2023-12-15T23:20:56.940 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lT5KVw4oO7TjZDtO8CkhbnAl0SY= 2023-12-15T23:20:56.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lT5KVw4oO7TjZDtO8CkhbnAl0SY=', 'Content-Length': '0'} 2023-12-15T23:20:56.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063f7145e54d9abf3-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.942 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.942 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.942 DEBUG:boto:Method: HEAD 2023-12-15T23:20:56.942 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:20:56.942 DEBUG:boto:Data: 2023-12-15T23:20:56.942 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.942 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.942 DEBUG:boto:Params: {} 2023-12-15T23:20:56.943 DEBUG:boto:Token: None 2023-12-15T23:20:56.943 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23 2023-12-15T23:20:56.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lT5KVw4oO7TjZDtO8CkhbnAl0SY= 2023-12-15T23:20:56.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lT5KVw4oO7TjZDtO8CkhbnAl0SY=', 'Content-Length': '0'} 2023-12-15T23:20:56.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b13a16ebf488273-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:20:56.945 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.945 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.946 DEBUG:boto:Method: GET 2023-12-15T23:20:56.946 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:20:56.946 DEBUG:boto:Data: 2023-12-15T23:20:56.946 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.946 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.946 DEBUG:boto:Params: {} 2023-12-15T23:20:56.946 DEBUG:boto:Token: None 2023-12-15T23:20:56.946 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23 2023-12-15T23:20:56.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zAZ3m1jEkLOj2fUqFvwyA9mhtv0= 2023-12-15T23:20:56.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zAZ3m1jEkLOj2fUqFvwyA9mhtv0=', 'Content-Length': '0'} 2023-12-15T23:20:56.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050ce3f4265feaa34-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.989 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:20:56.990 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:20:56.990 DEBUG:boto:Method: GET 2023-12-15T23:20:56.990 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:20:56.990 DEBUG:boto:Data: 2023-12-15T23:20:56.990 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:56.990 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.990 DEBUG:boto:Params: {} 2023-12-15T23:20:56.990 DEBUG:boto:Token: None 2023-12-15T23:20:56.991 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/obj23 2023-12-15T23:20:56.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zAZ3m1jEkLOj2fUqFvwyA9mhtv0= 2023-12-15T23:20:56.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zAZ3m1jEkLOj2fUqFvwyA9mhtv0=', 'Content-Length': '0'} 2023-12-15T23:20:56.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5729a0a57f751f7-00657cdf58-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:56.993 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:56.993 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:56.993 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.993 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.994 DEBUG:boto:Method: GET 2023-12-15T23:20:56.994 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:20:56.994 DEBUG:boto:Data: 2023-12-15T23:20:56.994 DEBUG:boto:Headers: {} 2023-12-15T23:20:56.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:56.994 DEBUG:boto:Port: 8000 2023-12-15T23:20:56.994 DEBUG:boto:Params: {} 2023-12-15T23:20:56.994 DEBUG:boto:Token: None 2023-12-15T23:20:56.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:56 GMT /kskgfn-49/ 2023-12-15T23:20:56.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI= 2023-12-15T23:20:56.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mmvYcLn/zWF52CynQAd+kjyT5lI=', 'Content-Length': '0'} 2023-12-15T23:20:56.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076bd733d44bd8a51-00657cdf58-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.037 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.038 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.038 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.038 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:57.038 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:20:57.038 DEBUG:boto:Method: GET 2023-12-15T23:20:57.038 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:20:57.039 DEBUG:boto:Data: 2023-12-15T23:20:57.039 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.039 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.039 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.039 DEBUG:boto:Params: {} 2023-12-15T23:20:57.039 DEBUG:boto:Token: None 2023-12-15T23:20:57.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d4e078ce66bb577-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.042 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:20:57.043 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.043 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.043 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.043 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.043 DEBUG:boto:Method: GET 2023-12-15T23:20:57.043 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.043 DEBUG:boto:Data: 2023-12-15T23:20:57.043 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.043 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.044 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.044 DEBUG:boto:Params: {} 2023-12-15T23:20:57.044 DEBUG:boto:Token: None 2023-12-15T23:20:57.044 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.044 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU= 2023-12-15T23:20:57.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU=', 'Content-Length': '0'} 2023-12-15T23:20:57.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f85db507beceeef-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.046 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.047 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.047 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.047 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.047 DEBUG:boto:Method: GET 2023-12-15T23:20:57.047 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.047 DEBUG:boto:Data: 2023-12-15T23:20:57.047 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.047 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.047 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.048 DEBUG:boto:Params: {} 2023-12-15T23:20:57.048 DEBUG:boto:Token: None 2023-12-15T23:20:57.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU= 2023-12-15T23:20:57.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU=', 'Content-Length': '0'} 2023-12-15T23:20:57.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efb6159af7b457d2-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.051 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.051 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.051 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.051 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.051 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.051 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.051 DEBUG:boto:Data: 2023-12-15T23:20:57.051 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.051 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.051 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.051 DEBUG:boto:Params: {} 2023-12-15T23:20:57.052 DEBUG:boto:Token: None 2023-12-15T23:20:57.052 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H9Tp5VP67wkOmCS9nhrdSvsR/c4= 2023-12-15T23:20:57.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H9Tp5VP67wkOmCS9nhrdSvsR/c4=', 'Content-Length': '0'} 2023-12-15T23:20:57.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8e28af7be9c930e-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.054 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.054 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.054 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.054 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.055 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.055 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.055 DEBUG:boto:Data: 2023-12-15T23:20:57.055 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.055 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.055 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.055 DEBUG:boto:Params: {} 2023-12-15T23:20:57.055 DEBUG:boto:Token: None 2023-12-15T23:20:57.056 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.056 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H9Tp5VP67wkOmCS9nhrdSvsR/c4= 2023-12-15T23:20:57.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H9Tp5VP67wkOmCS9nhrdSvsR/c4=', 'Content-Length': '0'} 2023-12-15T23:20:57.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006767066d9c139675-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:20:57.058 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.059 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.059 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.059 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.059 DEBUG:boto:Method: GET 2023-12-15T23:20:57.059 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.059 DEBUG:boto:Data: 2023-12-15T23:20:57.059 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.060 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.060 DEBUG:boto:Params: {} 2023-12-15T23:20:57.060 DEBUG:boto:Token: None 2023-12-15T23:20:57.060 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU= 2023-12-15T23:20:57.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU=', 'Content-Length': '0'} 2023-12-15T23:20:57.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc494b118e9d0997-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.106 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.106 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.106 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.106 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.106 DEBUG:boto:Method: GET 2023-12-15T23:20:57.106 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.106 DEBUG:boto:Data: 2023-12-15T23:20:57.106 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.106 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.106 DEBUG:boto:Params: {} 2023-12-15T23:20:57.107 DEBUG:boto:Token: None 2023-12-15T23:20:57.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:20:57.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU= 2023-12-15T23:20:57.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKIR0yhbHutCwpiz3DaM83hSFUU=', 'Content-Length': '0'} 2023-12-15T23:20:57.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbd1421edf56ce65-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.109 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.109 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.110 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.110 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.110 DEBUG:boto:Method: GET 2023-12-15T23:20:57.110 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.110 DEBUG:boto:Data: 2023-12-15T23:20:57.110 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.110 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.111 DEBUG:boto:Params: {} 2023-12-15T23:20:57.111 DEBUG:boto:Token: None 2023-12-15T23:20:57.111 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008916c4c0c745b94d-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.114 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.114 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.114 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.114 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.114 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.114 DEBUG:boto:Method: GET 2023-12-15T23:20:57.115 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.115 DEBUG:boto:Data: 2023-12-15T23:20:57.115 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.115 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.115 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.115 DEBUG:boto:Params: {} 2023-12-15T23:20:57.115 DEBUG:boto:Token: None 2023-12-15T23:20:57.115 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000be9911976c44bbd-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.119 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.119 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.119 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.119 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.119 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:20:57.119 DEBUG:boto:Data: 2023-12-15T23:20:57.119 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.120 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.120 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.120 DEBUG:boto:Params: {} 2023-12-15T23:20:57.120 DEBUG:boto:Token: None 2023-12-15T23:20:57.120 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33 2023-12-15T23:20:57.120 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sxm3iuLCA0MkwFAsqM4QiFQZGo4= 2023-12-15T23:20:57.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sxm3iuLCA0MkwFAsqM4QiFQZGo4=', 'Content-Length': '0'} 2023-12-15T23:20:57.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000826d81bb3d0c8261-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.123 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.123 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.123 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.123 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:20:57.123 DEBUG:boto:Data: 2023-12-15T23:20:57.123 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.123 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.123 DEBUG:boto:Params: {} 2023-12-15T23:20:57.123 DEBUG:boto:Token: None 2023-12-15T23:20:57.124 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33 2023-12-15T23:20:57.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sxm3iuLCA0MkwFAsqM4QiFQZGo4= 2023-12-15T23:20:57.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sxm3iuLCA0MkwFAsqM4QiFQZGo4=', 'Content-Length': '0'} 2023-12-15T23:20:57.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb2fc2f7ec970710-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:20:57.126 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.126 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.127 DEBUG:boto:Method: GET 2023-12-15T23:20:57.127 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:20:57.127 DEBUG:boto:Data: 2023-12-15T23:20:57.127 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.127 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.127 DEBUG:boto:Params: {} 2023-12-15T23:20:57.127 DEBUG:boto:Token: None 2023-12-15T23:20:57.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33 2023-12-15T23:20:57.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Eh6vrvk4BBJvruPsaUNSZ/HItI= 2023-12-15T23:20:57.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Eh6vrvk4BBJvruPsaUNSZ/HItI=', 'Content-Length': '0'} 2023-12-15T23:20:57.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b91354c463feb8a-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.169 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:20:57.170 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:20:57.170 DEBUG:boto:Method: GET 2023-12-15T23:20:57.170 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:20:57.170 DEBUG:boto:Data: 2023-12-15T23:20:57.170 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.170 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.170 DEBUG:boto:Params: {} 2023-12-15T23:20:57.171 DEBUG:boto:Token: None 2023-12-15T23:20:57.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj33 2023-12-15T23:20:57.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5Eh6vrvk4BBJvruPsaUNSZ/HItI= 2023-12-15T23:20:57.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5Eh6vrvk4BBJvruPsaUNSZ/HItI=', 'Content-Length': '0'} 2023-12-15T23:20:57.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a992fad73aee3c4-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.173 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.173 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.173 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.174 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.174 DEBUG:boto:Method: GET 2023-12-15T23:20:57.174 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.174 DEBUG:boto:Data: 2023-12-15T23:20:57.174 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.174 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.174 DEBUG:boto:Params: {} 2023-12-15T23:20:57.174 DEBUG:boto:Token: None 2023-12-15T23:20:57.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf39dd0882d8a301-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.177 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.177 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.178 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.178 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.178 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.178 DEBUG:boto:Method: GET 2023-12-15T23:20:57.178 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:20:57.178 DEBUG:boto:Data: 2023-12-15T23:20:57.178 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.178 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.178 DEBUG:boto:Params: {} 2023-12-15T23:20:57.179 DEBUG:boto:Token: None 2023-12-15T23:20:57.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000791cabf1ae484e6d-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.182 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:20:57.183 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.183 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.183 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.183 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.183 DEBUG:boto:Method: GET 2023-12-15T23:20:57.183 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.183 DEBUG:boto:Data: 2023-12-15T23:20:57.183 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.183 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.183 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.183 DEBUG:boto:Params: {} 2023-12-15T23:20:57.184 DEBUG:boto:Token: None 2023-12-15T23:20:57.184 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4= 2023-12-15T23:20:57.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4=', 'Content-Length': '0'} 2023-12-15T23:20:57.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058a9c05a7e814b33-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.187 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.187 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.187 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.187 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.187 DEBUG:boto:Method: GET 2023-12-15T23:20:57.187 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.187 DEBUG:boto:Data: 2023-12-15T23:20:57.187 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.187 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.187 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.187 DEBUG:boto:Params: {} 2023-12-15T23:20:57.188 DEBUG:boto:Token: None 2023-12-15T23:20:57.188 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.188 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4= 2023-12-15T23:20:57.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4=', 'Content-Length': '0'} 2023-12-15T23:20:57.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b32d6c8609d1a31-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.192 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.192 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.192 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.193 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.193 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.193 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.193 DEBUG:boto:Data: 2023-12-15T23:20:57.193 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.193 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.193 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.193 DEBUG:boto:Params: {} 2023-12-15T23:20:57.193 DEBUG:boto:Token: None 2023-12-15T23:20:57.194 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0BS1tfuQuuXC/VkCjUGzZtw46wU= 2023-12-15T23:20:57.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0BS1tfuQuuXC/VkCjUGzZtw46wU=', 'Content-Length': '0'} 2023-12-15T23:20:57.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000269611a7f26abd70-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.196 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.196 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.196 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.196 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.196 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.196 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.196 DEBUG:boto:Data: 2023-12-15T23:20:57.197 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.197 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.197 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.197 DEBUG:boto:Params: {} 2023-12-15T23:20:57.197 DEBUG:boto:Token: None 2023-12-15T23:20:57.197 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0BS1tfuQuuXC/VkCjUGzZtw46wU= 2023-12-15T23:20:57.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0BS1tfuQuuXC/VkCjUGzZtw46wU=', 'Content-Length': '0'} 2023-12-15T23:20:57.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000325ce84419b8308-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:20:57.200 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.200 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.200 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.200 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.200 DEBUG:boto:Method: GET 2023-12-15T23:20:57.201 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.201 DEBUG:boto:Data: 2023-12-15T23:20:57.201 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.201 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.201 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.201 DEBUG:boto:Params: {} 2023-12-15T23:20:57.201 DEBUG:boto:Token: None 2023-12-15T23:20:57.201 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.201 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4= 2023-12-15T23:20:57.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4=', 'Content-Length': '0'} 2023-12-15T23:20:57.204 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6f2354ab34c460f-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.245 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.246 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.246 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.246 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.246 DEBUG:boto:Method: GET 2023-12-15T23:20:57.246 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.246 DEBUG:boto:Data: 2023-12-15T23:20:57.246 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.246 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.246 DEBUG:boto:Params: {} 2023-12-15T23:20:57.247 DEBUG:boto:Token: None 2023-12-15T23:20:57.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:20:57.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4= 2023-12-15T23:20:57.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1pWFsbE/brgXItRiZwBuTyXF2l4=', 'Content-Length': '0'} 2023-12-15T23:20:57.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a16fd5bce4bad01-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.250 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.250 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.250 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.250 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.250 DEBUG:boto:Method: GET 2023-12-15T23:20:57.250 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.250 DEBUG:boto:Data: 2023-12-15T23:20:57.250 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.251 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.251 DEBUG:boto:Params: {} 2023-12-15T23:20:57.251 DEBUG:boto:Token: None 2023-12-15T23:20:57.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.253 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000450f0b63292e410c-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.293 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.294 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.294 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.294 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.294 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.294 DEBUG:boto:Method: GET 2023-12-15T23:20:57.294 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.294 DEBUG:boto:Data: 2023-12-15T23:20:57.294 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.295 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.295 DEBUG:boto:Params: {} 2023-12-15T23:20:57.295 DEBUG:boto:Token: None 2023-12-15T23:20:57.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004241497a8f7a3777-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.298 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.298 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.298 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.298 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.299 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:20:57.299 DEBUG:boto:Data: 2023-12-15T23:20:57.299 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.299 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.299 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.299 DEBUG:boto:Params: {} 2023-12-15T23:20:57.299 DEBUG:boto:Token: None 2023-12-15T23:20:57.299 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34 2023-12-15T23:20:57.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2v8HYTmORj51cwlYRhW0YMKzcHo= 2023-12-15T23:20:57.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2v8HYTmORj51cwlYRhW0YMKzcHo=', 'Content-Length': '0'} 2023-12-15T23:20:57.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b0b2dc2e9a65058-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.302 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.302 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.302 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.302 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:20:57.302 DEBUG:boto:Data: 2023-12-15T23:20:57.302 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.302 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.302 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.302 DEBUG:boto:Params: {} 2023-12-15T23:20:57.303 DEBUG:boto:Token: None 2023-12-15T23:20:57.303 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34 2023-12-15T23:20:57.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2v8HYTmORj51cwlYRhW0YMKzcHo= 2023-12-15T23:20:57.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2v8HYTmORj51cwlYRhW0YMKzcHo=', 'Content-Length': '0'} 2023-12-15T23:20:57.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074b8743120c86921-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:20:57.305 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.306 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.306 DEBUG:boto:Method: GET 2023-12-15T23:20:57.306 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:20:57.306 DEBUG:boto:Data: 2023-12-15T23:20:57.306 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.306 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.306 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.306 DEBUG:boto:Params: {} 2023-12-15T23:20:57.306 DEBUG:boto:Token: None 2023-12-15T23:20:57.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34 2023-12-15T23:20:57.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DOxmZsk/LH30FFcRI/OvdbWDvgk= 2023-12-15T23:20:57.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DOxmZsk/LH30FFcRI/OvdbWDvgk=', 'Content-Length': '0'} 2023-12-15T23:20:57.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081ed1f9ce5ba898c-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.349 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:20:57.350 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:20:57.350 DEBUG:boto:Method: GET 2023-12-15T23:20:57.350 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:20:57.350 DEBUG:boto:Data: 2023-12-15T23:20:57.350 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.350 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.350 DEBUG:boto:Params: {} 2023-12-15T23:20:57.351 DEBUG:boto:Token: None 2023-12-15T23:20:57.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj34 2023-12-15T23:20:57.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DOxmZsk/LH30FFcRI/OvdbWDvgk= 2023-12-15T23:20:57.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DOxmZsk/LH30FFcRI/OvdbWDvgk=', 'Content-Length': '0'} 2023-12-15T23:20:57.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000551efb9f75bc0df-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.353 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.354 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.354 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.354 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.354 DEBUG:boto:Method: GET 2023-12-15T23:20:57.354 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.354 DEBUG:boto:Data: 2023-12-15T23:20:57.354 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.354 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.355 DEBUG:boto:Params: {} 2023-12-15T23:20:57.355 DEBUG:boto:Token: None 2023-12-15T23:20:57.355 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002982af125f5dc0b9-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.397 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.398 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.398 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.398 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.398 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.398 DEBUG:boto:Method: GET 2023-12-15T23:20:57.398 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:20:57.398 DEBUG:boto:Data: 2023-12-15T23:20:57.398 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.398 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.398 DEBUG:boto:Params: {} 2023-12-15T23:20:57.399 DEBUG:boto:Token: None 2023-12-15T23:20:57.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e86634fb7ab167f-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.402 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:20:57.403 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.403 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.403 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.403 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.403 DEBUG:boto:Method: GET 2023-12-15T23:20:57.403 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.403 DEBUG:boto:Data: 2023-12-15T23:20:57.404 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.404 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.404 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.404 DEBUG:boto:Params: {} 2023-12-15T23:20:57.404 DEBUG:boto:Token: None 2023-12-15T23:20:57.404 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA= 2023-12-15T23:20:57.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA=', 'Content-Length': '0'} 2023-12-15T23:20:57.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a65fdd4d260c1e4-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.407 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.407 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.407 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.407 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.407 DEBUG:boto:Method: GET 2023-12-15T23:20:57.407 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.407 DEBUG:boto:Data: 2023-12-15T23:20:57.407 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.408 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.408 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.408 DEBUG:boto:Params: {} 2023-12-15T23:20:57.408 DEBUG:boto:Token: None 2023-12-15T23:20:57.408 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.408 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA= 2023-12-15T23:20:57.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA=', 'Content-Length': '0'} 2023-12-15T23:20:57.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059958c1f6bf00217-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.410 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.410 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.410 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.411 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.411 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.411 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.411 DEBUG:boto:Data: 2023-12-15T23:20:57.411 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.411 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.411 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.411 DEBUG:boto:Params: {} 2023-12-15T23:20:57.411 DEBUG:boto:Token: None 2023-12-15T23:20:57.412 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rS0fWagEv4TyybuHlXz9uf+U4D0= 2023-12-15T23:20:57.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rS0fWagEv4TyybuHlXz9uf+U4D0=', 'Content-Length': '0'} 2023-12-15T23:20:57.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000994d765b73f771bd-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.414 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.414 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.414 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.414 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.414 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.414 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.415 DEBUG:boto:Data: 2023-12-15T23:20:57.415 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.415 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.415 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.415 DEBUG:boto:Params: {} 2023-12-15T23:20:57.415 DEBUG:boto:Token: None 2023-12-15T23:20:57.415 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rS0fWagEv4TyybuHlXz9uf+U4D0= 2023-12-15T23:20:57.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rS0fWagEv4TyybuHlXz9uf+U4D0=', 'Content-Length': '0'} 2023-12-15T23:20:57.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061b85e539791ab1d-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:20:57.418 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.418 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.418 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.418 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.418 DEBUG:boto:Method: GET 2023-12-15T23:20:57.418 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.418 DEBUG:boto:Data: 2023-12-15T23:20:57.418 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.418 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.418 DEBUG:boto:Params: {} 2023-12-15T23:20:57.419 DEBUG:boto:Token: None 2023-12-15T23:20:57.419 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA= 2023-12-15T23:20:57.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA=', 'Content-Length': '0'} 2023-12-15T23:20:57.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000467ce3e5c8b99fbc-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.461 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.462 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.462 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.462 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.462 DEBUG:boto:Method: GET 2023-12-15T23:20:57.462 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.462 DEBUG:boto:Data: 2023-12-15T23:20:57.462 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.462 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.462 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.462 DEBUG:boto:Params: {} 2023-12-15T23:20:57.463 DEBUG:boto:Token: None 2023-12-15T23:20:57.463 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:20:57.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA= 2023-12-15T23:20:57.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XvSb4drSFQ2zTH3XEkY6LJTiA=', 'Content-Length': '0'} 2023-12-15T23:20:57.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002855eab39ff05f0e-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.465 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.465 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.466 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.466 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.466 DEBUG:boto:Method: GET 2023-12-15T23:20:57.466 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.466 DEBUG:boto:Data: 2023-12-15T23:20:57.466 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.466 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.466 DEBUG:boto:Params: {} 2023-12-15T23:20:57.466 DEBUG:boto:Token: None 2023-12-15T23:20:57.467 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bb0aafca891a4a8-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.469 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.470 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.470 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.470 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.470 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.470 DEBUG:boto:Method: GET 2023-12-15T23:20:57.470 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.470 DEBUG:boto:Data: 2023-12-15T23:20:57.471 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.471 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.471 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.471 DEBUG:boto:Params: {} 2023-12-15T23:20:57.471 DEBUG:boto:Token: None 2023-12-15T23:20:57.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ba4f0e744f52bf5-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.474 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.475 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.475 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.475 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.475 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:20:57.475 DEBUG:boto:Data: 2023-12-15T23:20:57.475 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.475 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.475 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.475 DEBUG:boto:Params: {} 2023-12-15T23:20:57.476 DEBUG:boto:Token: None 2023-12-15T23:20:57.476 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38 2023-12-15T23:20:57.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eqP1nn+pG7LGIcy356rVJq8Z+H8= 2023-12-15T23:20:57.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eqP1nn+pG7LGIcy356rVJq8Z+H8=', 'Content-Length': '0'} 2023-12-15T23:20:57.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc7bd0f457bb594b-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.478 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.478 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.478 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.479 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:20:57.479 DEBUG:boto:Data: 2023-12-15T23:20:57.479 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.479 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.479 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.479 DEBUG:boto:Params: {} 2023-12-15T23:20:57.479 DEBUG:boto:Token: None 2023-12-15T23:20:57.479 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38 2023-12-15T23:20:57.480 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eqP1nn+pG7LGIcy356rVJq8Z+H8= 2023-12-15T23:20:57.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eqP1nn+pG7LGIcy356rVJq8Z+H8=', 'Content-Length': '0'} 2023-12-15T23:20:57.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7d9e989e7828dc9-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.482 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:20:57.482 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.482 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.482 DEBUG:boto:Method: GET 2023-12-15T23:20:57.482 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:20:57.482 DEBUG:boto:Data: 2023-12-15T23:20:57.482 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.482 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.482 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.482 DEBUG:boto:Params: {} 2023-12-15T23:20:57.483 DEBUG:boto:Token: None 2023-12-15T23:20:57.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38 2023-12-15T23:20:57.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HIUjNLeCvzzMQ5MaOvlpPG6YL2A= 2023-12-15T23:20:57.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HIUjNLeCvzzMQ5MaOvlpPG6YL2A=', 'Content-Length': '0'} 2023-12-15T23:20:57.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000736edbe99895cca4-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.525 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:20:57.526 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:20:57.526 DEBUG:boto:Method: GET 2023-12-15T23:20:57.526 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:20:57.526 DEBUG:boto:Data: 2023-12-15T23:20:57.526 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.526 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.526 DEBUG:boto:Params: {} 2023-12-15T23:20:57.526 DEBUG:boto:Token: None 2023-12-15T23:20:57.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj38 2023-12-15T23:20:57.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HIUjNLeCvzzMQ5MaOvlpPG6YL2A= 2023-12-15T23:20:57.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HIUjNLeCvzzMQ5MaOvlpPG6YL2A=', 'Content-Length': '0'} 2023-12-15T23:20:57.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033dde4bd0a318e21-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.529 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.529 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.529 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.529 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.529 DEBUG:boto:Method: GET 2023-12-15T23:20:57.529 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.530 DEBUG:boto:Data: 2023-12-15T23:20:57.530 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.530 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.530 DEBUG:boto:Params: {} 2023-12-15T23:20:57.530 DEBUG:boto:Token: None 2023-12-15T23:20:57.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.533 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007436ce51a36d1781-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.533 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.533 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.533 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.534 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.534 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.534 DEBUG:boto:Method: GET 2023-12-15T23:20:57.534 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:20:57.534 DEBUG:boto:Data: 2023-12-15T23:20:57.534 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.534 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.534 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.534 DEBUG:boto:Params: {} 2023-12-15T23:20:57.534 DEBUG:boto:Token: None 2023-12-15T23:20:57.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eed7891cd57b4082-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.538 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:20:57.538 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.538 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.538 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.538 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.538 DEBUG:boto:Method: GET 2023-12-15T23:20:57.539 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.539 DEBUG:boto:Data: 2023-12-15T23:20:57.539 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.539 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.539 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.539 DEBUG:boto:Params: {} 2023-12-15T23:20:57.539 DEBUG:boto:Token: None 2023-12-15T23:20:57.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.540 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38= 2023-12-15T23:20:57.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38=', 'Content-Length': '0'} 2023-12-15T23:20:57.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073736db6f0841a90-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.542 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.542 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.542 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.542 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.542 DEBUG:boto:Method: GET 2023-12-15T23:20:57.542 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.542 DEBUG:boto:Data: 2023-12-15T23:20:57.543 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.543 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.543 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.543 DEBUG:boto:Params: {} 2023-12-15T23:20:57.543 DEBUG:boto:Token: None 2023-12-15T23:20:57.543 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38= 2023-12-15T23:20:57.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38=', 'Content-Length': '0'} 2023-12-15T23:20:57.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000361842c40d2e5370-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.546 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.546 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.546 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.546 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.546 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.546 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.546 DEBUG:boto:Data: 2023-12-15T23:20:57.546 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.546 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.546 DEBUG:boto:Params: {} 2023-12-15T23:20:57.547 DEBUG:boto:Token: None 2023-12-15T23:20:57.547 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZ2fqGWIK0v9GBYhZYIFLg5StTI= 2023-12-15T23:20:57.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZ2fqGWIK0v9GBYhZYIFLg5StTI=', 'Content-Length': '0'} 2023-12-15T23:20:57.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046bd1956b6a1e5a8-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.549 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.549 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.549 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.550 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.550 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.550 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.550 DEBUG:boto:Data: 2023-12-15T23:20:57.550 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.550 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.550 DEBUG:boto:Params: {} 2023-12-15T23:20:57.550 DEBUG:boto:Token: None 2023-12-15T23:20:57.550 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WZ2fqGWIK0v9GBYhZYIFLg5StTI= 2023-12-15T23:20:57.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WZ2fqGWIK0v9GBYhZYIFLg5StTI=', 'Content-Length': '0'} 2023-12-15T23:20:57.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b5e074e06ec6adc-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:20:57.553 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.553 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.553 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.553 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.554 DEBUG:boto:Method: GET 2023-12-15T23:20:57.554 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.554 DEBUG:boto:Data: 2023-12-15T23:20:57.554 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.554 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.554 DEBUG:boto:Params: {} 2023-12-15T23:20:57.554 DEBUG:boto:Token: None 2023-12-15T23:20:57.554 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38= 2023-12-15T23:20:57.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38=', 'Content-Length': '0'} 2023-12-15T23:20:57.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f097b7252e96a89d-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.597 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.600 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.601 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.601 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.601 DEBUG:boto:Method: GET 2023-12-15T23:20:57.601 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.601 DEBUG:boto:Data: 2023-12-15T23:20:57.601 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.601 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.601 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.601 DEBUG:boto:Params: {} 2023-12-15T23:20:57.602 DEBUG:boto:Token: None 2023-12-15T23:20:57.602 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:20:57.602 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38= 2023-12-15T23:20:57.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYIo09PjaHgcPai66ToscqeEL38=', 'Content-Length': '0'} 2023-12-15T23:20:57.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ae13bcc66b7489c-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.604 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.604 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.605 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.605 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.605 DEBUG:boto:Method: GET 2023-12-15T23:20:57.605 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.605 DEBUG:boto:Data: 2023-12-15T23:20:57.605 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.605 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.605 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.605 DEBUG:boto:Params: {} 2023-12-15T23:20:57.606 DEBUG:boto:Token: None 2023-12-15T23:20:57.606 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027fb5c6c2ef4a786-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.649 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.650 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.650 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.650 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.650 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.650 DEBUG:boto:Method: GET 2023-12-15T23:20:57.650 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.650 DEBUG:boto:Data: 2023-12-15T23:20:57.651 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.651 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.651 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.651 DEBUG:boto:Params: {} 2023-12-15T23:20:57.651 DEBUG:boto:Token: None 2023-12-15T23:20:57.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad8c6da006b34f74-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.654 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.655 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.655 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.655 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.655 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:20:57.655 DEBUG:boto:Data: 2023-12-15T23:20:57.655 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.655 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.655 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.655 DEBUG:boto:Params: {} 2023-12-15T23:20:57.656 DEBUG:boto:Token: None 2023-12-15T23:20:57.656 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44 2023-12-15T23:20:57.656 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sELrgcskQMB4ZJiTVdjFXFRSHl0= 2023-12-15T23:20:57.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sELrgcskQMB4ZJiTVdjFXFRSHl0=', 'Content-Length': '0'} 2023-12-15T23:20:57.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000742b8767dae11b77-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.658 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.658 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.658 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.658 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:20:57.658 DEBUG:boto:Data: 2023-12-15T23:20:57.659 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.659 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.659 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.659 DEBUG:boto:Params: {} 2023-12-15T23:20:57.659 DEBUG:boto:Token: None 2023-12-15T23:20:57.659 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44 2023-12-15T23:20:57.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sELrgcskQMB4ZJiTVdjFXFRSHl0= 2023-12-15T23:20:57.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sELrgcskQMB4ZJiTVdjFXFRSHl0=', 'Content-Length': '0'} 2023-12-15T23:20:57.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018ecb8b4d6f25e89-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:20:57.661 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.662 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.662 DEBUG:boto:Method: GET 2023-12-15T23:20:57.662 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:20:57.662 DEBUG:boto:Data: 2023-12-15T23:20:57.662 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.662 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.662 DEBUG:boto:Params: {} 2023-12-15T23:20:57.662 DEBUG:boto:Token: None 2023-12-15T23:20:57.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44 2023-12-15T23:20:57.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kcvJj2jOUjY4Zd22aeugiuFfTmc= 2023-12-15T23:20:57.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kcvJj2jOUjY4Zd22aeugiuFfTmc=', 'Content-Length': '0'} 2023-12-15T23:20:57.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fa429e1a6e5309f-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.709 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:20:57.709 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:20:57.710 DEBUG:boto:Method: GET 2023-12-15T23:20:57.710 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:20:57.710 DEBUG:boto:Data: 2023-12-15T23:20:57.710 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.710 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.710 DEBUG:boto:Params: {} 2023-12-15T23:20:57.710 DEBUG:boto:Token: None 2023-12-15T23:20:57.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj44 2023-12-15T23:20:57.711 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kcvJj2jOUjY4Zd22aeugiuFfTmc= 2023-12-15T23:20:57.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kcvJj2jOUjY4Zd22aeugiuFfTmc=', 'Content-Length': '0'} 2023-12-15T23:20:57.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eba9e06b8cf5a570-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.713 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.713 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.713 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.713 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.714 DEBUG:boto:Method: GET 2023-12-15T23:20:57.714 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.714 DEBUG:boto:Data: 2023-12-15T23:20:57.714 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.714 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.714 DEBUG:boto:Params: {} 2023-12-15T23:20:57.714 DEBUG:boto:Token: None 2023-12-15T23:20:57.714 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d76f78de5129f83-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.761 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.762 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.762 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.762 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.762 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.762 DEBUG:boto:Method: GET 2023-12-15T23:20:57.762 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:20:57.762 DEBUG:boto:Data: 2023-12-15T23:20:57.763 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.763 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.763 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.763 DEBUG:boto:Params: {} 2023-12-15T23:20:57.763 DEBUG:boto:Token: None 2023-12-15T23:20:57.763 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c160ef8280a3e43-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.767 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:20:57.767 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.767 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.768 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.768 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.768 DEBUG:boto:Method: GET 2023-12-15T23:20:57.768 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.768 DEBUG:boto:Data: 2023-12-15T23:20:57.768 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.768 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.768 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.768 DEBUG:boto:Params: {} 2023-12-15T23:20:57.768 DEBUG:boto:Token: None 2023-12-15T23:20:57.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4= 2023-12-15T23:20:57.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4=', 'Content-Length': '0'} 2023-12-15T23:20:57.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046546b49874eee7b-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.771 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.772 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.772 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.772 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.772 DEBUG:boto:Method: GET 2023-12-15T23:20:57.772 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.772 DEBUG:boto:Data: 2023-12-15T23:20:57.772 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.772 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.772 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.772 DEBUG:boto:Params: {} 2023-12-15T23:20:57.773 DEBUG:boto:Token: None 2023-12-15T23:20:57.773 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4= 2023-12-15T23:20:57.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4=', 'Content-Length': '0'} 2023-12-15T23:20:57.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df6b9b2c25861606-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.775 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.775 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.776 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.776 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.776 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.776 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.776 DEBUG:boto:Data: 2023-12-15T23:20:57.776 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.776 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.776 DEBUG:boto:Params: {} 2023-12-15T23:20:57.776 DEBUG:boto:Token: None 2023-12-15T23:20:57.777 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.777 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aA+zkf2w3zmyVaqu/QBcOzAI4PI= 2023-12-15T23:20:57.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aA+zkf2w3zmyVaqu/QBcOzAI4PI=', 'Content-Length': '0'} 2023-12-15T23:20:57.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0bbaa591e6d8b32-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.779 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.779 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.780 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.780 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.780 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.780 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.780 DEBUG:boto:Data: 2023-12-15T23:20:57.780 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.780 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.780 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.780 DEBUG:boto:Params: {} 2023-12-15T23:20:57.780 DEBUG:boto:Token: None 2023-12-15T23:20:57.781 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aA+zkf2w3zmyVaqu/QBcOzAI4PI= 2023-12-15T23:20:57.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aA+zkf2w3zmyVaqu/QBcOzAI4PI=', 'Content-Length': '0'} 2023-12-15T23:20:57.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f28eb7652541224-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.783 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:20:57.783 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.783 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.783 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.784 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.784 DEBUG:boto:Method: GET 2023-12-15T23:20:57.784 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.784 DEBUG:boto:Data: 2023-12-15T23:20:57.784 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.784 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.784 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.784 DEBUG:boto:Params: {} 2023-12-15T23:20:57.784 DEBUG:boto:Token: None 2023-12-15T23:20:57.784 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4= 2023-12-15T23:20:57.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4=', 'Content-Length': '0'} 2023-12-15T23:20:57.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000708bd694973bc01c-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.829 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.829 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.830 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.830 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.830 DEBUG:boto:Method: GET 2023-12-15T23:20:57.830 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.830 DEBUG:boto:Data: 2023-12-15T23:20:57.830 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.830 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.830 DEBUG:boto:Params: {} 2023-12-15T23:20:57.830 DEBUG:boto:Token: None 2023-12-15T23:20:57.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:20:57.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4= 2023-12-15T23:20:57.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HdmRt8c2hRnn5TiVbjoDiGojWP4=', 'Content-Length': '0'} 2023-12-15T23:20:57.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f933295036f1f485-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.833 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.833 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.834 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.834 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.834 DEBUG:boto:Method: GET 2023-12-15T23:20:57.834 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.834 DEBUG:boto:Data: 2023-12-15T23:20:57.834 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.834 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.834 DEBUG:boto:Params: {} 2023-12-15T23:20:57.834 DEBUG:boto:Token: None 2023-12-15T23:20:57.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a7a13817f474184-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.837 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.838 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.838 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.838 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.838 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.838 DEBUG:boto:Method: GET 2023-12-15T23:20:57.838 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.838 DEBUG:boto:Data: 2023-12-15T23:20:57.838 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.838 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.838 DEBUG:boto:Params: {} 2023-12-15T23:20:57.839 DEBUG:boto:Token: None 2023-12-15T23:20:57.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edbb278d7d5a9d63-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.842 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.842 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.843 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.843 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.843 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:20:57.843 DEBUG:boto:Data: 2023-12-15T23:20:57.843 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.843 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.843 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.843 DEBUG:boto:Params: {} 2023-12-15T23:20:57.844 DEBUG:boto:Token: None 2023-12-15T23:20:57.844 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46 2023-12-15T23:20:57.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w+3cCHe3cejCEpmR5xBM403tZ/8= 2023-12-15T23:20:57.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w+3cCHe3cejCEpmR5xBM403tZ/8=', 'Content-Length': '0'} 2023-12-15T23:20:57.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000eba035371790164-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.846 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.846 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.846 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.847 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:20:57.847 DEBUG:boto:Data: 2023-12-15T23:20:57.847 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.847 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.847 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.847 DEBUG:boto:Params: {} 2023-12-15T23:20:57.847 DEBUG:boto:Token: None 2023-12-15T23:20:57.847 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46 2023-12-15T23:20:57.848 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w+3cCHe3cejCEpmR5xBM403tZ/8= 2023-12-15T23:20:57.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w+3cCHe3cejCEpmR5xBM403tZ/8=', 'Content-Length': '0'} 2023-12-15T23:20:57.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3604237bbb8e36f-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:20:57.850 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.850 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.850 DEBUG:boto:Method: GET 2023-12-15T23:20:57.851 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:20:57.851 DEBUG:boto:Data: 2023-12-15T23:20:57.851 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.851 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.851 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.851 DEBUG:boto:Params: {} 2023-12-15T23:20:57.851 DEBUG:boto:Token: None 2023-12-15T23:20:57.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46 2023-12-15T23:20:57.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+nivE6FjX2TmZ08vPXeomCsQJ24= 2023-12-15T23:20:57.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+nivE6FjX2TmZ08vPXeomCsQJ24=', 'Content-Length': '0'} 2023-12-15T23:20:57.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000138e64f184d11804-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.897 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:20:57.898 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:20:57.898 DEBUG:boto:Method: GET 2023-12-15T23:20:57.898 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:20:57.898 DEBUG:boto:Data: 2023-12-15T23:20:57.898 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.898 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.898 DEBUG:boto:Params: {} 2023-12-15T23:20:57.898 DEBUG:boto:Token: None 2023-12-15T23:20:57.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj46 2023-12-15T23:20:57.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+nivE6FjX2TmZ08vPXeomCsQJ24= 2023-12-15T23:20:57.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+nivE6FjX2TmZ08vPXeomCsQJ24=', 'Content-Length': '0'} 2023-12-15T23:20:57.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca1e60edf8652e9b-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.901 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.901 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.901 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.901 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.901 DEBUG:boto:Method: GET 2023-12-15T23:20:57.902 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.902 DEBUG:boto:Data: 2023-12-15T23:20:57.902 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.902 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.902 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.902 DEBUG:boto:Params: {} 2023-12-15T23:20:57.902 DEBUG:boto:Token: None 2023-12-15T23:20:57.902 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.902 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bc3de8ce1812bf2-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.905 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.905 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.906 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.906 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.906 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.906 DEBUG:boto:Method: GET 2023-12-15T23:20:57.906 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:20:57.906 DEBUG:boto:Data: 2023-12-15T23:20:57.906 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.906 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.906 DEBUG:boto:Params: {} 2023-12-15T23:20:57.907 DEBUG:boto:Token: None 2023-12-15T23:20:57.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000dac4f21a04d53db-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.910 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:57.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:20:57.910 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.910 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.910 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.911 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.911 DEBUG:boto:Method: GET 2023-12-15T23:20:57.911 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.911 DEBUG:boto:Data: 2023-12-15T23:20:57.911 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.911 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.911 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.911 DEBUG:boto:Params: {} 2023-12-15T23:20:57.911 DEBUG:boto:Token: None 2023-12-15T23:20:57.912 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0= 2023-12-15T23:20:57.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0=', 'Content-Length': '0'} 2023-12-15T23:20:57.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b3eb572d6fca69d-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.914 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.914 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.914 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.914 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.914 DEBUG:boto:Method: GET 2023-12-15T23:20:57.914 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.915 DEBUG:boto:Data: 2023-12-15T23:20:57.915 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.915 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.915 DEBUG:boto:Params: {} 2023-12-15T23:20:57.915 DEBUG:boto:Token: None 2023-12-15T23:20:57.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0= 2023-12-15T23:20:57.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0=', 'Content-Length': '0'} 2023-12-15T23:20:57.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2e91efaa2407c53-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.917 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.918 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.918 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.918 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.918 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.918 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.918 DEBUG:boto:Data: 2023-12-15T23:20:57.918 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.918 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.918 DEBUG:boto:Params: {} 2023-12-15T23:20:57.918 DEBUG:boto:Token: None 2023-12-15T23:20:57.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Qd6CIiaAbLjLFyEsUmjjx43IlM= 2023-12-15T23:20:57.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Qd6CIiaAbLjLFyEsUmjjx43IlM=', 'Content-Length': '0'} 2023-12-15T23:20:57.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063e538e9ac639eb4-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.921 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.921 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.921 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.921 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.921 DEBUG:boto:Method: HEAD 2023-12-15T23:20:57.921 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.922 DEBUG:boto:Data: 2023-12-15T23:20:57.922 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.922 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.922 DEBUG:boto:Params: {} 2023-12-15T23:20:57.922 DEBUG:boto:Token: None 2023-12-15T23:20:57.922 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Qd6CIiaAbLjLFyEsUmjjx43IlM= 2023-12-15T23:20:57.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Qd6CIiaAbLjLFyEsUmjjx43IlM=', 'Content-Length': '0'} 2023-12-15T23:20:57.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000837f852b4403d1da-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:20:57.925 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.925 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.925 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.925 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.925 DEBUG:boto:Method: GET 2023-12-15T23:20:57.925 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.925 DEBUG:boto:Data: 2023-12-15T23:20:57.925 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.925 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.926 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.926 DEBUG:boto:Params: {} 2023-12-15T23:20:57.926 DEBUG:boto:Token: None 2023-12-15T23:20:57.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0= 2023-12-15T23:20:57.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0=', 'Content-Length': '0'} 2023-12-15T23:20:57.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7aa536affef4ba2-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.969 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:57.970 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:57.970 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.970 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.970 DEBUG:boto:Method: GET 2023-12-15T23:20:57.970 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.970 DEBUG:boto:Data: 2023-12-15T23:20:57.970 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:57.970 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.971 DEBUG:boto:Params: {} 2023-12-15T23:20:57.971 DEBUG:boto:Token: None 2023-12-15T23:20:57.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:20:57.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0= 2023-12-15T23:20:57.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vvGWHfRovlB+Q0bP0anyxOEUmK0=', 'Content-Length': '0'} 2023-12-15T23:20:57.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000184d88c6b367fac-00657cdf59-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:57.973 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:57.973 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:57.974 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:57.974 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:57.974 DEBUG:boto:Method: GET 2023-12-15T23:20:57.974 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:20:57.974 DEBUG:boto:Data: 2023-12-15T23:20:57.974 DEBUG:boto:Headers: {} 2023-12-15T23:20:57.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:57.974 DEBUG:boto:Port: 8000 2023-12-15T23:20:57.975 DEBUG:boto:Params: {} 2023-12-15T23:20:57.975 DEBUG:boto:Token: None 2023-12-15T23:20:57.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:57 GMT /kskgfn-49/ 2023-12-15T23:20:57.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU= 2023-12-15T23:20:57.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4bdFYxZ/AHhssVXtYCLYpXuUbXU=', 'Content-Length': '0'} 2023-12-15T23:20:57.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006dddbff83b59f0c-00657cdf59-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.017 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.018 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.018 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.018 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.018 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.018 DEBUG:boto:Method: GET 2023-12-15T23:20:58.019 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.019 DEBUG:boto:Data: 2023-12-15T23:20:58.019 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.019 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.019 DEBUG:boto:Params: {} 2023-12-15T23:20:58.019 DEBUG:boto:Token: None 2023-12-15T23:20:58.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.023 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027eb28c55fd7442f-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.023 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.023 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:58.023 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:58.024 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.024 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:20:58.024 DEBUG:boto:Data: 2023-12-15T23:20:58.024 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.024 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.024 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.024 DEBUG:boto:Params: {} 2023-12-15T23:20:58.024 DEBUG:boto:Token: None 2023-12-15T23:20:58.024 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj51 2023-12-15T23:20:58.025 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PrXky9toIla/tb7r96akeVuk6l0= 2023-12-15T23:20:58.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PrXky9toIla/tb7r96akeVuk6l0=', 'Content-Length': '0'} 2023-12-15T23:20:58.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac00fe253a592350-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.027 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:58.027 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:58.027 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.027 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:20:58.027 DEBUG:boto:Data: 2023-12-15T23:20:58.027 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.027 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.027 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.027 DEBUG:boto:Params: {} 2023-12-15T23:20:58.027 DEBUG:boto:Token: None 2023-12-15T23:20:58.028 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj51 2023-12-15T23:20:58.028 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PrXky9toIla/tb7r96akeVuk6l0= 2023-12-15T23:20:58.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PrXky9toIla/tb7r96akeVuk6l0=', 'Content-Length': '0'} 2023-12-15T23:20:58.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef6b0ed8fd8f1d71-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:20:58.030 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:58.030 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:58.030 DEBUG:boto:Method: GET 2023-12-15T23:20:58.030 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:20:58.030 DEBUG:boto:Data: 2023-12-15T23:20:58.031 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.031 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.031 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.031 DEBUG:boto:Params: {} 2023-12-15T23:20:58.031 DEBUG:boto:Token: None 2023-12-15T23:20:58.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj51 2023-12-15T23:20:58.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oN1AO0LtoohichJfTmXEf8YDSYk= 2023-12-15T23:20:58.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oN1AO0LtoohichJfTmXEf8YDSYk=', 'Content-Length': '0'} 2023-12-15T23:20:58.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e45ee8f714a978c8-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.073 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:20:58.073 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:20:58.074 DEBUG:boto:Method: GET 2023-12-15T23:20:58.074 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:20:58.074 DEBUG:boto:Data: 2023-12-15T23:20:58.074 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.074 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.074 DEBUG:boto:Params: {} 2023-12-15T23:20:58.074 DEBUG:boto:Token: None 2023-12-15T23:20:58.074 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj51 2023-12-15T23:20:58.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oN1AO0LtoohichJfTmXEf8YDSYk= 2023-12-15T23:20:58.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oN1AO0LtoohichJfTmXEf8YDSYk=', 'Content-Length': '0'} 2023-12-15T23:20:58.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b64ded2d12e75e31-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.077 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.077 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.077 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.077 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.077 DEBUG:boto:Method: GET 2023-12-15T23:20:58.077 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.077 DEBUG:boto:Data: 2023-12-15T23:20:58.077 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.077 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.077 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.078 DEBUG:boto:Params: {} 2023-12-15T23:20:58.078 DEBUG:boto:Token: None 2023-12-15T23:20:58.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008775639339e557fa-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.121 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.122 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.122 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.122 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.122 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.122 DEBUG:boto:Method: GET 2023-12-15T23:20:58.122 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:20:58.122 DEBUG:boto:Data: 2023-12-15T23:20:58.123 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.123 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.123 DEBUG:boto:Params: {} 2023-12-15T23:20:58.123 DEBUG:boto:Token: None 2023-12-15T23:20:58.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000283bdb37427b2f76-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.126 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:20:58.127 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.127 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.127 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.127 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.127 DEBUG:boto:Method: GET 2023-12-15T23:20:58.127 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.127 DEBUG:boto:Data: 2023-12-15T23:20:58.127 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.127 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.127 DEBUG:boto:Params: {} 2023-12-15T23:20:58.128 DEBUG:boto:Token: None 2023-12-15T23:20:58.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8= 2023-12-15T23:20:58.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8=', 'Content-Length': '0'} 2023-12-15T23:20:58.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067c4c6ccb09dcf4b-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.130 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.131 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.131 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.131 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.131 DEBUG:boto:Method: GET 2023-12-15T23:20:58.131 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.131 DEBUG:boto:Data: 2023-12-15T23:20:58.131 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.131 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.131 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.131 DEBUG:boto:Params: {} 2023-12-15T23:20:58.132 DEBUG:boto:Token: None 2023-12-15T23:20:58.132 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.132 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8= 2023-12-15T23:20:58.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8=', 'Content-Length': '0'} 2023-12-15T23:20:58.134 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086d95aad343d12de-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.177 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.178 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.178 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.178 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.178 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.178 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.178 DEBUG:boto:Data: 2023-12-15T23:20:58.178 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.178 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.178 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.178 DEBUG:boto:Params: {} 2023-12-15T23:20:58.179 DEBUG:boto:Token: None 2023-12-15T23:20:58.179 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pw3/enTxZdJXu9YaH06mQ4Lor/w= 2023-12-15T23:20:58.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pw3/enTxZdJXu9YaH06mQ4Lor/w=', 'Content-Length': '0'} 2023-12-15T23:20:58.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac7e2addec6abc4b-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.181 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.182 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.182 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.182 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.182 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.182 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.182 DEBUG:boto:Data: 2023-12-15T23:20:58.182 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.182 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.182 DEBUG:boto:Params: {} 2023-12-15T23:20:58.182 DEBUG:boto:Token: None 2023-12-15T23:20:58.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pw3/enTxZdJXu9YaH06mQ4Lor/w= 2023-12-15T23:20:58.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pw3/enTxZdJXu9YaH06mQ4Lor/w=', 'Content-Length': '0'} 2023-12-15T23:20:58.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be99d732d19a1e70-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:20:58.185 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.185 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.185 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.185 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.185 DEBUG:boto:Method: GET 2023-12-15T23:20:58.186 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.186 DEBUG:boto:Data: 2023-12-15T23:20:58.186 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.186 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.186 DEBUG:boto:Params: {} 2023-12-15T23:20:58.186 DEBUG:boto:Token: None 2023-12-15T23:20:58.186 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8= 2023-12-15T23:20:58.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8=', 'Content-Length': '0'} 2023-12-15T23:20:58.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d79281f248dc1535-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.229 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.230 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.230 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.230 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.230 DEBUG:boto:Method: GET 2023-12-15T23:20:58.230 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.230 DEBUG:boto:Data: 2023-12-15T23:20:58.230 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.230 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.230 DEBUG:boto:Params: {} 2023-12-15T23:20:58.231 DEBUG:boto:Token: None 2023-12-15T23:20:58.231 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:20:58.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8= 2023-12-15T23:20:58.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WGCzZKB6lrg4S4lOLknGPzzJv8=', 'Content-Length': '0'} 2023-12-15T23:20:58.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007cac804c4f8603bd-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.234 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.234 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.234 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.234 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.234 DEBUG:boto:Method: GET 2023-12-15T23:20:58.234 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.234 DEBUG:boto:Data: 2023-12-15T23:20:58.234 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.234 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.234 DEBUG:boto:Params: {} 2023-12-15T23:20:58.235 DEBUG:boto:Token: None 2023-12-15T23:20:58.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fbf1599954a1476f-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.237 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.238 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.238 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.238 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.238 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.238 DEBUG:boto:Method: GET 2023-12-15T23:20:58.238 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.238 DEBUG:boto:Data: 2023-12-15T23:20:58.238 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.239 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.239 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.239 DEBUG:boto:Params: {} 2023-12-15T23:20:58.239 DEBUG:boto:Token: None 2023-12-15T23:20:58.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000157c5cabd95f2568-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.242 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.242 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.243 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.243 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.243 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:20:58.243 DEBUG:boto:Data: 2023-12-15T23:20:58.243 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.243 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.243 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.243 DEBUG:boto:Params: {} 2023-12-15T23:20:58.243 DEBUG:boto:Token: None 2023-12-15T23:20:58.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55 2023-12-15T23:20:58.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mh0azXrwCX6tKdD90ohV4qPa4kU= 2023-12-15T23:20:58.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mh0azXrwCX6tKdD90ohV4qPa4kU=', 'Content-Length': '0'} 2023-12-15T23:20:58.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000545bd1825ec1b459-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.246 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.246 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.246 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.246 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:20:58.246 DEBUG:boto:Data: 2023-12-15T23:20:58.247 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.247 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.247 DEBUG:boto:Params: {} 2023-12-15T23:20:58.247 DEBUG:boto:Token: None 2023-12-15T23:20:58.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55 2023-12-15T23:20:58.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mh0azXrwCX6tKdD90ohV4qPa4kU= 2023-12-15T23:20:58.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mh0azXrwCX6tKdD90ohV4qPa4kU=', 'Content-Length': '0'} 2023-12-15T23:20:58.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084c541c551af25ac-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.249 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:20:58.249 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.250 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.250 DEBUG:boto:Method: GET 2023-12-15T23:20:58.250 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:20:58.250 DEBUG:boto:Data: 2023-12-15T23:20:58.250 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.250 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.250 DEBUG:boto:Params: {} 2023-12-15T23:20:58.250 DEBUG:boto:Token: None 2023-12-15T23:20:58.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55 2023-12-15T23:20:58.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PLTTPZluF+JJFeoMhuAHBiJa0rk= 2023-12-15T23:20:58.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PLTTPZluF+JJFeoMhuAHBiJa0rk=', 'Content-Length': '0'} 2023-12-15T23:20:58.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afff8971a3359106-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.293 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:20:58.294 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:20:58.294 DEBUG:boto:Method: GET 2023-12-15T23:20:58.294 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:20:58.294 DEBUG:boto:Data: 2023-12-15T23:20:58.294 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.294 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.294 DEBUG:boto:Params: {} 2023-12-15T23:20:58.295 DEBUG:boto:Token: None 2023-12-15T23:20:58.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj55 2023-12-15T23:20:58.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PLTTPZluF+JJFeoMhuAHBiJa0rk= 2023-12-15T23:20:58.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PLTTPZluF+JJFeoMhuAHBiJa0rk=', 'Content-Length': '0'} 2023-12-15T23:20:58.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9f63b5dc19215b4-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.297 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.297 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.298 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.298 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.298 DEBUG:boto:Method: GET 2023-12-15T23:20:58.298 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.298 DEBUG:boto:Data: 2023-12-15T23:20:58.298 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.298 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.298 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.298 DEBUG:boto:Params: {} 2023-12-15T23:20:58.299 DEBUG:boto:Token: None 2023-12-15T23:20:58.299 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000844545922ea2256b-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.302 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.302 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.302 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.302 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.302 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.302 DEBUG:boto:Method: GET 2023-12-15T23:20:58.302 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:20:58.303 DEBUG:boto:Data: 2023-12-15T23:20:58.303 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.303 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.303 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.303 DEBUG:boto:Params: {} 2023-12-15T23:20:58.303 DEBUG:boto:Token: None 2023-12-15T23:20:58.303 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d00fd11cbc976da4-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.307 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.307 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:20:58.307 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.307 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.307 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.308 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.308 DEBUG:boto:Method: GET 2023-12-15T23:20:58.308 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.308 DEBUG:boto:Data: 2023-12-15T23:20:58.308 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.308 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.308 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.308 DEBUG:boto:Params: {} 2023-12-15T23:20:58.308 DEBUG:boto:Token: None 2023-12-15T23:20:58.308 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.309 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg= 2023-12-15T23:20:58.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg=', 'Content-Length': '0'} 2023-12-15T23:20:58.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceb2fd71d771fd76-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.311 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.312 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.312 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.312 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.312 DEBUG:boto:Method: GET 2023-12-15T23:20:58.312 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.312 DEBUG:boto:Data: 2023-12-15T23:20:58.312 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.312 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.312 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.312 DEBUG:boto:Params: {} 2023-12-15T23:20:58.313 DEBUG:boto:Token: None 2023-12-15T23:20:58.313 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg= 2023-12-15T23:20:58.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg=', 'Content-Length': '0'} 2023-12-15T23:20:58.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e044a2b7731e6612-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.316 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.316 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.316 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.316 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.316 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.316 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.316 DEBUG:boto:Data: 2023-12-15T23:20:58.316 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.317 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.317 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.317 DEBUG:boto:Params: {} 2023-12-15T23:20:58.317 DEBUG:boto:Token: None 2023-12-15T23:20:58.317 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7cSKl4AJ9laPsUGLMi3rxguGnYw= 2023-12-15T23:20:58.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7cSKl4AJ9laPsUGLMi3rxguGnYw=', 'Content-Length': '0'} 2023-12-15T23:20:58.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b228fbbf78ae87ca-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.320 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.320 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.320 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.320 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.320 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.320 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.320 DEBUG:boto:Data: 2023-12-15T23:20:58.320 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.321 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.321 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.321 DEBUG:boto:Params: {} 2023-12-15T23:20:58.321 DEBUG:boto:Token: None 2023-12-15T23:20:58.321 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7cSKl4AJ9laPsUGLMi3rxguGnYw= 2023-12-15T23:20:58.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7cSKl4AJ9laPsUGLMi3rxguGnYw=', 'Content-Length': '0'} 2023-12-15T23:20:58.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bde6a28c69dbb217-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:20:58.324 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.324 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.324 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.324 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.324 DEBUG:boto:Method: GET 2023-12-15T23:20:58.324 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.324 DEBUG:boto:Data: 2023-12-15T23:20:58.324 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.325 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.325 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.325 DEBUG:boto:Params: {} 2023-12-15T23:20:58.325 DEBUG:boto:Token: None 2023-12-15T23:20:58.325 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg= 2023-12-15T23:20:58.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg=', 'Content-Length': '0'} 2023-12-15T23:20:58.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000129a9c89fecc329f-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.369 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.370 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.370 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.370 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.370 DEBUG:boto:Method: GET 2023-12-15T23:20:58.370 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.370 DEBUG:boto:Data: 2023-12-15T23:20:58.370 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.370 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.370 DEBUG:boto:Params: {} 2023-12-15T23:20:58.371 DEBUG:boto:Token: None 2023-12-15T23:20:58.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:20:58.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg= 2023-12-15T23:20:58.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uC/Ocm2V7N4nsEr2HiNWL+fBFEg=', 'Content-Length': '0'} 2023-12-15T23:20:58.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae1e6651e365d51-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.374 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.374 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.374 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.374 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.374 DEBUG:boto:Method: GET 2023-12-15T23:20:58.374 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.374 DEBUG:boto:Data: 2023-12-15T23:20:58.374 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.375 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.375 DEBUG:boto:Params: {} 2023-12-15T23:20:58.375 DEBUG:boto:Token: None 2023-12-15T23:20:58.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f53f4218432599d-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.378 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.378 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.378 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.378 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.379 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.379 DEBUG:boto:Method: GET 2023-12-15T23:20:58.379 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.379 DEBUG:boto:Data: 2023-12-15T23:20:58.379 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.379 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.379 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.379 DEBUG:boto:Params: {} 2023-12-15T23:20:58.379 DEBUG:boto:Token: None 2023-12-15T23:20:58.379 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.383 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ee3cf5ee0f7df62-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.383 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.383 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.383 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.383 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.384 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:20:58.384 DEBUG:boto:Data: 2023-12-15T23:20:58.384 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.384 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.384 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.384 DEBUG:boto:Params: {} 2023-12-15T23:20:58.384 DEBUG:boto:Token: None 2023-12-15T23:20:58.384 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57 2023-12-15T23:20:58.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MW4nh67vwxdoHDVeMGbEksTi29w= 2023-12-15T23:20:58.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MW4nh67vwxdoHDVeMGbEksTi29w=', 'Content-Length': '0'} 2023-12-15T23:20:58.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf67a6995e398664-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.387 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.387 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.387 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.387 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:20:58.387 DEBUG:boto:Data: 2023-12-15T23:20:58.388 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.388 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.388 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.388 DEBUG:boto:Params: {} 2023-12-15T23:20:58.388 DEBUG:boto:Token: None 2023-12-15T23:20:58.388 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57 2023-12-15T23:20:58.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MW4nh67vwxdoHDVeMGbEksTi29w= 2023-12-15T23:20:58.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MW4nh67vwxdoHDVeMGbEksTi29w=', 'Content-Length': '0'} 2023-12-15T23:20:58.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000214e6bfb41ed4d03-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:20:58.391 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.391 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.391 DEBUG:boto:Method: GET 2023-12-15T23:20:58.391 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:20:58.391 DEBUG:boto:Data: 2023-12-15T23:20:58.391 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.391 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.391 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.391 DEBUG:boto:Params: {} 2023-12-15T23:20:58.392 DEBUG:boto:Token: None 2023-12-15T23:20:58.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57 2023-12-15T23:20:58.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VVBAWjiDLM95LlXZLQpkLFIQRUs= 2023-12-15T23:20:58.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VVBAWjiDLM95LlXZLQpkLFIQRUs=', 'Content-Length': '0'} 2023-12-15T23:20:58.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057c1b01a7b1bd7c5-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.437 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:20:58.438 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:20:58.438 DEBUG:boto:Method: GET 2023-12-15T23:20:58.438 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:20:58.438 DEBUG:boto:Data: 2023-12-15T23:20:58.438 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.438 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.438 DEBUG:boto:Params: {} 2023-12-15T23:20:58.438 DEBUG:boto:Token: None 2023-12-15T23:20:58.439 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj57 2023-12-15T23:20:58.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VVBAWjiDLM95LlXZLQpkLFIQRUs= 2023-12-15T23:20:58.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VVBAWjiDLM95LlXZLQpkLFIQRUs=', 'Content-Length': '0'} 2023-12-15T23:20:58.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ca8ec9e39eae6f5-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.441 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.441 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.441 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.441 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.442 DEBUG:boto:Method: GET 2023-12-15T23:20:58.442 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.442 DEBUG:boto:Data: 2023-12-15T23:20:58.442 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.442 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.442 DEBUG:boto:Params: {} 2023-12-15T23:20:58.442 DEBUG:boto:Token: None 2023-12-15T23:20:58.442 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014284a4d71ab793a-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.445 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.446 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.446 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.446 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.446 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.446 DEBUG:boto:Method: GET 2023-12-15T23:20:58.446 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:20:58.447 DEBUG:boto:Data: 2023-12-15T23:20:58.447 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.447 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.447 DEBUG:boto:Params: {} 2023-12-15T23:20:58.447 DEBUG:boto:Token: None 2023-12-15T23:20:58.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001757a8e61ac4de13-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.451 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.451 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:20:58.451 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.451 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.451 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.451 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.452 DEBUG:boto:Method: GET 2023-12-15T23:20:58.452 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.452 DEBUG:boto:Data: 2023-12-15T23:20:58.452 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.452 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.452 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.452 DEBUG:boto:Params: {} 2023-12-15T23:20:58.452 DEBUG:boto:Token: None 2023-12-15T23:20:58.452 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw= 2023-12-15T23:20:58.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw=', 'Content-Length': '0'} 2023-12-15T23:20:58.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000880cd610e542eb02-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.455 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.455 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.455 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.455 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.456 DEBUG:boto:Method: GET 2023-12-15T23:20:58.456 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.456 DEBUG:boto:Data: 2023-12-15T23:20:58.456 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.456 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.456 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.456 DEBUG:boto:Params: {} 2023-12-15T23:20:58.456 DEBUG:boto:Token: None 2023-12-15T23:20:58.456 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw= 2023-12-15T23:20:58.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw=', 'Content-Length': '0'} 2023-12-15T23:20:58.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004114c8e472d00741-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.459 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.459 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.460 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.460 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.460 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.460 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.460 DEBUG:boto:Data: 2023-12-15T23:20:58.460 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.460 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.460 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.460 DEBUG:boto:Params: {} 2023-12-15T23:20:58.461 DEBUG:boto:Token: None 2023-12-15T23:20:58.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FduM2KpttwmssGnhzNx7ELdrIdY= 2023-12-15T23:20:58.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FduM2KpttwmssGnhzNx7ELdrIdY=', 'Content-Length': '0'} 2023-12-15T23:20:58.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfffd57e6a364432-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.463 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.463 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.463 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.463 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.464 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.464 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.464 DEBUG:boto:Data: 2023-12-15T23:20:58.464 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.464 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.464 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.464 DEBUG:boto:Params: {} 2023-12-15T23:20:58.464 DEBUG:boto:Token: None 2023-12-15T23:20:58.464 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FduM2KpttwmssGnhzNx7ELdrIdY= 2023-12-15T23:20:58.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FduM2KpttwmssGnhzNx7ELdrIdY=', 'Content-Length': '0'} 2023-12-15T23:20:58.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fa74d6c42fc4f93-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:20:58.467 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.468 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.468 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.468 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.468 DEBUG:boto:Method: GET 2023-12-15T23:20:58.468 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.468 DEBUG:boto:Data: 2023-12-15T23:20:58.468 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.468 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.468 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.469 DEBUG:boto:Params: {} 2023-12-15T23:20:58.469 DEBUG:boto:Token: None 2023-12-15T23:20:58.469 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw= 2023-12-15T23:20:58.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw=', 'Content-Length': '0'} 2023-12-15T23:20:58.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093eca951dd104afa-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.513 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.514 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.514 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.514 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.514 DEBUG:boto:Method: GET 2023-12-15T23:20:58.514 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.514 DEBUG:boto:Data: 2023-12-15T23:20:58.514 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.515 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.515 DEBUG:boto:Params: {} 2023-12-15T23:20:58.515 DEBUG:boto:Token: None 2023-12-15T23:20:58.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:20:58.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw= 2023-12-15T23:20:58.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VMhlU9QxfRsDq13gbJJGmNhhDKw=', 'Content-Length': '0'} 2023-12-15T23:20:58.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bacad3dd490e6351-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.517 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.518 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.518 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.518 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.518 DEBUG:boto:Method: GET 2023-12-15T23:20:58.518 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.518 DEBUG:boto:Data: 2023-12-15T23:20:58.518 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.518 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.519 DEBUG:boto:Params: {} 2023-12-15T23:20:58.519 DEBUG:boto:Token: None 2023-12-15T23:20:58.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6455936acb6bda5-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.522 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.522 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.522 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.522 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.522 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.523 DEBUG:boto:Method: GET 2023-12-15T23:20:58.523 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.523 DEBUG:boto:Data: 2023-12-15T23:20:58.523 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.523 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.523 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.523 DEBUG:boto:Params: {} 2023-12-15T23:20:58.523 DEBUG:boto:Token: None 2023-12-15T23:20:58.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f7839f4be6a98c1-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.526 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.527 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.527 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.527 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.527 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:20:58.527 DEBUG:boto:Data: 2023-12-15T23:20:58.527 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.527 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.527 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.528 DEBUG:boto:Params: {} 2023-12-15T23:20:58.528 DEBUG:boto:Token: None 2023-12-15T23:20:58.528 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68 2023-12-15T23:20:58.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q2mtw5+VJujEMK//fC44/bm0R2Y= 2023-12-15T23:20:58.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q2mtw5+VJujEMK//fC44/bm0R2Y=', 'Content-Length': '0'} 2023-12-15T23:20:58.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fbff8e6a9ddf30e-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.530 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.531 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.531 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.531 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:20:58.531 DEBUG:boto:Data: 2023-12-15T23:20:58.531 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.531 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.531 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.531 DEBUG:boto:Params: {} 2023-12-15T23:20:58.532 DEBUG:boto:Token: None 2023-12-15T23:20:58.532 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68 2023-12-15T23:20:58.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q2mtw5+VJujEMK//fC44/bm0R2Y= 2023-12-15T23:20:58.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q2mtw5+VJujEMK//fC44/bm0R2Y=', 'Content-Length': '0'} 2023-12-15T23:20:58.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e452be70576360f-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:20:58.534 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.535 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.535 DEBUG:boto:Method: GET 2023-12-15T23:20:58.535 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:20:58.535 DEBUG:boto:Data: 2023-12-15T23:20:58.535 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.535 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.535 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.535 DEBUG:boto:Params: {} 2023-12-15T23:20:58.535 DEBUG:boto:Token: None 2023-12-15T23:20:58.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68 2023-12-15T23:20:58.536 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zgfayqo4Itnv+Vb+B7ycr560LDI= 2023-12-15T23:20:58.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zgfayqo4Itnv+Vb+B7ycr560LDI=', 'Content-Length': '0'} 2023-12-15T23:20:58.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000420b9f1589c5470e-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.585 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:20:58.586 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:20:58.586 DEBUG:boto:Method: GET 2023-12-15T23:20:58.586 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:20:58.586 DEBUG:boto:Data: 2023-12-15T23:20:58.586 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.586 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.586 DEBUG:boto:Params: {} 2023-12-15T23:20:58.586 DEBUG:boto:Token: None 2023-12-15T23:20:58.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj68 2023-12-15T23:20:58.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zgfayqo4Itnv+Vb+B7ycr560LDI= 2023-12-15T23:20:58.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zgfayqo4Itnv+Vb+B7ycr560LDI=', 'Content-Length': '0'} 2023-12-15T23:20:58.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031ec6c4569bf9318-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.589 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.589 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.590 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.590 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.590 DEBUG:boto:Method: GET 2023-12-15T23:20:58.590 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.590 DEBUG:boto:Data: 2023-12-15T23:20:58.590 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.590 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.590 DEBUG:boto:Params: {} 2023-12-15T23:20:58.590 DEBUG:boto:Token: None 2023-12-15T23:20:58.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aaf13337d6f132b8-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.593 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.594 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.594 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.594 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.594 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.594 DEBUG:boto:Method: GET 2023-12-15T23:20:58.594 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:20:58.595 DEBUG:boto:Data: 2023-12-15T23:20:58.595 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.595 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.595 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.595 DEBUG:boto:Params: {} 2023-12-15T23:20:58.595 DEBUG:boto:Token: None 2023-12-15T23:20:58.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068e6e1c2f845bf36-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.598 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:20:58.599 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.599 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.599 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.599 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.599 DEBUG:boto:Method: GET 2023-12-15T23:20:58.599 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.600 DEBUG:boto:Data: 2023-12-15T23:20:58.600 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.600 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.600 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.600 DEBUG:boto:Params: {} 2023-12-15T23:20:58.600 DEBUG:boto:Token: None 2023-12-15T23:20:58.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4= 2023-12-15T23:20:58.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4=', 'Content-Length': '0'} 2023-12-15T23:20:58.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d38e1661dc8a07d1-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.603 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.603 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.603 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.604 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.604 DEBUG:boto:Method: GET 2023-12-15T23:20:58.604 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.604 DEBUG:boto:Data: 2023-12-15T23:20:58.604 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.604 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.604 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.604 DEBUG:boto:Params: {} 2023-12-15T23:20:58.604 DEBUG:boto:Token: None 2023-12-15T23:20:58.605 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.605 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4= 2023-12-15T23:20:58.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4=', 'Content-Length': '0'} 2023-12-15T23:20:58.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000053017c71c11fb7e-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.607 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.608 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.608 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.608 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.608 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.608 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.608 DEBUG:boto:Data: 2023-12-15T23:20:58.608 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.608 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.608 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.609 DEBUG:boto:Params: {} 2023-12-15T23:20:58.609 DEBUG:boto:Token: None 2023-12-15T23:20:58.609 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cS1JNxHJJ3uowCx1tgq1eQXO3G4= 2023-12-15T23:20:58.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cS1JNxHJJ3uowCx1tgq1eQXO3G4=', 'Content-Length': '0'} 2023-12-15T23:20:58.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c708c6e10651fcaf-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.612 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.612 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.612 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.612 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.612 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.612 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.612 DEBUG:boto:Data: 2023-12-15T23:20:58.612 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.613 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.613 DEBUG:boto:Params: {} 2023-12-15T23:20:58.613 DEBUG:boto:Token: None 2023-12-15T23:20:58.613 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cS1JNxHJJ3uowCx1tgq1eQXO3G4= 2023-12-15T23:20:58.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cS1JNxHJJ3uowCx1tgq1eQXO3G4=', 'Content-Length': '0'} 2023-12-15T23:20:58.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000410ce22765749d97-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:20:58.616 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.616 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.616 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.616 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.616 DEBUG:boto:Method: GET 2023-12-15T23:20:58.616 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.616 DEBUG:boto:Data: 2023-12-15T23:20:58.616 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.617 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.617 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.617 DEBUG:boto:Params: {} 2023-12-15T23:20:58.617 DEBUG:boto:Token: None 2023-12-15T23:20:58.617 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4= 2023-12-15T23:20:58.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4=', 'Content-Length': '0'} 2023-12-15T23:20:58.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cc967e36261d170-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.661 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.662 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.662 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.662 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.662 DEBUG:boto:Method: GET 2023-12-15T23:20:58.662 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.662 DEBUG:boto:Data: 2023-12-15T23:20:58.662 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.662 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.662 DEBUG:boto:Params: {} 2023-12-15T23:20:58.663 DEBUG:boto:Token: None 2023-12-15T23:20:58.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:20:58.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4= 2023-12-15T23:20:58.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TM+1ZZuMzKxs+eIzW6QcjlxwoH4=', 'Content-Length': '0'} 2023-12-15T23:20:58.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000561e3ed1dee4fda2-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.666 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.666 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.666 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.666 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.666 DEBUG:boto:Method: GET 2023-12-15T23:20:58.666 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.666 DEBUG:boto:Data: 2023-12-15T23:20:58.666 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.667 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.667 DEBUG:boto:Params: {} 2023-12-15T23:20:58.667 DEBUG:boto:Token: None 2023-12-15T23:20:58.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d64b790c10c58dc4-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.670 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.670 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.670 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.670 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.670 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.670 DEBUG:boto:Method: GET 2023-12-15T23:20:58.671 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.671 DEBUG:boto:Data: 2023-12-15T23:20:58.671 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.671 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.671 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.671 DEBUG:boto:Params: {} 2023-12-15T23:20:58.671 DEBUG:boto:Token: None 2023-12-15T23:20:58.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.675 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000698da249fd00477-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.675 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.675 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.675 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.676 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.676 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:20:58.676 DEBUG:boto:Data: 2023-12-15T23:20:58.676 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.676 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.676 DEBUG:boto:Params: {} 2023-12-15T23:20:58.676 DEBUG:boto:Token: None 2023-12-15T23:20:58.676 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69 2023-12-15T23:20:58.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5ktqBc/l9qlCtwiz+jXuZpevheM= 2023-12-15T23:20:58.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5ktqBc/l9qlCtwiz+jXuZpevheM=', 'Content-Length': '0'} 2023-12-15T23:20:58.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d00eeb73c6cf4e2-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.679 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.679 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.679 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.679 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:20:58.680 DEBUG:boto:Data: 2023-12-15T23:20:58.680 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.680 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.680 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.680 DEBUG:boto:Params: {} 2023-12-15T23:20:58.680 DEBUG:boto:Token: None 2023-12-15T23:20:58.680 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69 2023-12-15T23:20:58.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5ktqBc/l9qlCtwiz+jXuZpevheM= 2023-12-15T23:20:58.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5ktqBc/l9qlCtwiz+jXuZpevheM=', 'Content-Length': '0'} 2023-12-15T23:20:58.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000995652757f285f4a-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.683 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:20:58.683 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.683 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.683 DEBUG:boto:Method: GET 2023-12-15T23:20:58.684 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:20:58.684 DEBUG:boto:Data: 2023-12-15T23:20:58.684 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.684 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.684 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.684 DEBUG:boto:Params: {} 2023-12-15T23:20:58.684 DEBUG:boto:Token: None 2023-12-15T23:20:58.684 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69 2023-12-15T23:20:58.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G0HodVI/bePb0mKJhJVs2aEr8s4= 2023-12-15T23:20:58.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G0HodVI/bePb0mKJhJVs2aEr8s4=', 'Content-Length': '0'} 2023-12-15T23:20:58.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044870370e5cadce7-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.729 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:20:58.730 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:20:58.730 DEBUG:boto:Method: GET 2023-12-15T23:20:58.730 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:20:58.730 DEBUG:boto:Data: 2023-12-15T23:20:58.730 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.730 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.730 DEBUG:boto:Params: {} 2023-12-15T23:20:58.731 DEBUG:boto:Token: None 2023-12-15T23:20:58.731 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj69 2023-12-15T23:20:58.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G0HodVI/bePb0mKJhJVs2aEr8s4= 2023-12-15T23:20:58.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G0HodVI/bePb0mKJhJVs2aEr8s4=', 'Content-Length': '0'} 2023-12-15T23:20:58.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4090b872b862fe1-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.733 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.734 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.734 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.734 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.734 DEBUG:boto:Method: GET 2023-12-15T23:20:58.734 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.734 DEBUG:boto:Data: 2023-12-15T23:20:58.734 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.734 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.735 DEBUG:boto:Params: {} 2023-12-15T23:20:58.735 DEBUG:boto:Token: None 2023-12-15T23:20:58.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079af9b6a894c3158-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.738 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.738 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.738 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.738 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.738 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.739 DEBUG:boto:Method: GET 2023-12-15T23:20:58.739 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:20:58.739 DEBUG:boto:Data: 2023-12-15T23:20:58.739 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.739 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.739 DEBUG:boto:Params: {} 2023-12-15T23:20:58.739 DEBUG:boto:Token: None 2023-12-15T23:20:58.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.740 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.743 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ce263d9328b95d6-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.743 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.743 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:20:58.743 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.744 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.744 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.744 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.744 DEBUG:boto:Method: GET 2023-12-15T23:20:58.744 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.744 DEBUG:boto:Data: 2023-12-15T23:20:58.744 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.744 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.744 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.745 DEBUG:boto:Params: {} 2023-12-15T23:20:58.745 DEBUG:boto:Token: None 2023-12-15T23:20:58.745 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.745 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8= 2023-12-15T23:20:58.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8=', 'Content-Length': '0'} 2023-12-15T23:20:58.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6bbf101deab2dbd-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.748 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.748 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.748 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.748 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.748 DEBUG:boto:Method: GET 2023-12-15T23:20:58.748 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.748 DEBUG:boto:Data: 2023-12-15T23:20:58.748 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.749 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.749 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.749 DEBUG:boto:Params: {} 2023-12-15T23:20:58.749 DEBUG:boto:Token: None 2023-12-15T23:20:58.749 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.749 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8= 2023-12-15T23:20:58.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8=', 'Content-Length': '0'} 2023-12-15T23:20:58.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a14df4f184f4c6b-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.793 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.794 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.794 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.794 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.794 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.794 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.794 DEBUG:boto:Data: 2023-12-15T23:20:58.794 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.794 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.794 DEBUG:boto:Params: {} 2023-12-15T23:20:58.795 DEBUG:boto:Token: None 2023-12-15T23:20:58.795 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u0PcuWTNa7RzGSOphohX/Z97L+E= 2023-12-15T23:20:58.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u0PcuWTNa7RzGSOphohX/Z97L+E=', 'Content-Length': '0'} 2023-12-15T23:20:58.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042779fb86d509df5-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.797 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.797 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.798 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.798 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.798 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.798 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.798 DEBUG:boto:Data: 2023-12-15T23:20:58.798 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.798 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.798 DEBUG:boto:Params: {} 2023-12-15T23:20:58.799 DEBUG:boto:Token: None 2023-12-15T23:20:58.799 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:u0PcuWTNa7RzGSOphohX/Z97L+E= 2023-12-15T23:20:58.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:u0PcuWTNa7RzGSOphohX/Z97L+E=', 'Content-Length': '0'} 2023-12-15T23:20:58.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000699f1a89f293fe79-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:20:58.801 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.802 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.802 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.802 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.802 DEBUG:boto:Method: GET 2023-12-15T23:20:58.802 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.802 DEBUG:boto:Data: 2023-12-15T23:20:58.802 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.802 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.802 DEBUG:boto:Params: {} 2023-12-15T23:20:58.803 DEBUG:boto:Token: None 2023-12-15T23:20:58.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8= 2023-12-15T23:20:58.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8=', 'Content-Length': '0'} 2023-12-15T23:20:58.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e8592e50cd9e92-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.845 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.846 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.846 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.846 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.846 DEBUG:boto:Method: GET 2023-12-15T23:20:58.846 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.846 DEBUG:boto:Data: 2023-12-15T23:20:58.846 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.847 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.847 DEBUG:boto:Params: {} 2023-12-15T23:20:58.847 DEBUG:boto:Token: None 2023-12-15T23:20:58.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:20:58.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8= 2023-12-15T23:20:58.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XJi9Sv6iWZxpJQ4mkO5s+xtjS+8=', 'Content-Length': '0'} 2023-12-15T23:20:58.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080a2ab3d6ca8061e-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.850 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.850 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.850 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.850 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.850 DEBUG:boto:Method: GET 2023-12-15T23:20:58.850 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.850 DEBUG:boto:Data: 2023-12-15T23:20:58.851 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.851 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.851 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.851 DEBUG:boto:Params: {} 2023-12-15T23:20:58.851 DEBUG:boto:Token: None 2023-12-15T23:20:58.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.854 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b48321c94851a15-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.897 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.898 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.898 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.898 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.898 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.898 DEBUG:boto:Method: GET 2023-12-15T23:20:58.898 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.898 DEBUG:boto:Data: 2023-12-15T23:20:58.898 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.899 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.899 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.899 DEBUG:boto:Params: {} 2023-12-15T23:20:58.899 DEBUG:boto:Token: None 2023-12-15T23:20:58.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.902 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000686ca92349f78078-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.902 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:58.903 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.903 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.903 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.903 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:20:58.903 DEBUG:boto:Data: 2023-12-15T23:20:58.903 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.904 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.904 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.904 DEBUG:boto:Params: {} 2023-12-15T23:20:58.904 DEBUG:boto:Token: None 2023-12-15T23:20:58.904 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76 2023-12-15T23:20:58.904 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CZ96SOpmVYURAKFw3i7v+5xL2Wg= 2023-12-15T23:20:58.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CZ96SOpmVYURAKFw3i7v+5xL2Wg=', 'Content-Length': '0'} 2023-12-15T23:20:58.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dc26921f5ff1997-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.907 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.907 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.907 DEBUG:boto:Method: HEAD 2023-12-15T23:20:58.907 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:20:58.907 DEBUG:boto:Data: 2023-12-15T23:20:58.907 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.907 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.907 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.908 DEBUG:boto:Params: {} 2023-12-15T23:20:58.908 DEBUG:boto:Token: None 2023-12-15T23:20:58.908 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76 2023-12-15T23:20:58.908 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CZ96SOpmVYURAKFw3i7v+5xL2Wg= 2023-12-15T23:20:58.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CZ96SOpmVYURAKFw3i7v+5xL2Wg=', 'Content-Length': '0'} 2023-12-15T23:20:58.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059c07c5af147e5f6-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:20:58.911 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.911 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.911 DEBUG:boto:Method: GET 2023-12-15T23:20:58.911 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:20:58.911 DEBUG:boto:Data: 2023-12-15T23:20:58.911 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.911 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.911 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.911 DEBUG:boto:Params: {} 2023-12-15T23:20:58.912 DEBUG:boto:Token: None 2023-12-15T23:20:58.912 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76 2023-12-15T23:20:58.912 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vAXuEWypL/mHBXBeUeZRGdGEJ80= 2023-12-15T23:20:58.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vAXuEWypL/mHBXBeUeZRGdGEJ80=', 'Content-Length': '0'} 2023-12-15T23:20:58.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008eb284cd9991e9d0-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.957 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:20:58.958 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:20:58.958 DEBUG:boto:Method: GET 2023-12-15T23:20:58.958 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:20:58.958 DEBUG:boto:Data: 2023-12-15T23:20:58.958 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:58.958 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.958 DEBUG:boto:Params: {} 2023-12-15T23:20:58.958 DEBUG:boto:Token: None 2023-12-15T23:20:58.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/obj76 2023-12-15T23:20:58.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vAXuEWypL/mHBXBeUeZRGdGEJ80= 2023-12-15T23:20:58.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vAXuEWypL/mHBXBeUeZRGdGEJ80=', 'Content-Length': '0'} 2023-12-15T23:20:58.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dbe088e17512dea-00657cdf5a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:58.961 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:58.962 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:58.962 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.962 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.962 DEBUG:boto:Method: GET 2023-12-15T23:20:58.962 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:20:58.962 DEBUG:boto:Data: 2023-12-15T23:20:58.962 DEBUG:boto:Headers: {} 2023-12-15T23:20:58.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:58.962 DEBUG:boto:Port: 8000 2023-12-15T23:20:58.962 DEBUG:boto:Params: {} 2023-12-15T23:20:58.963 DEBUG:boto:Token: None 2023-12-15T23:20:58.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:58 GMT /kskgfn-49/ 2023-12-15T23:20:58.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ= 2023-12-15T23:20:58.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XYcBf2nEsWjRwwwpMAXK3skIksQ=', 'Content-Length': '0'} 2023-12-15T23:20:58.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbc883d4236f4adb-00657cdf5a-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.005 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.006 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.006 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.006 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:59.006 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:20:59.006 DEBUG:boto:Method: GET 2023-12-15T23:20:59.006 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:20:59.006 DEBUG:boto:Data: 2023-12-15T23:20:59.007 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.007 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.007 DEBUG:boto:Params: {} 2023-12-15T23:20:59.007 DEBUG:boto:Token: None 2023-12-15T23:20:59.007 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1fa1a752dd8ecb0-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.010 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.011 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:20:59.011 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.011 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.011 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.011 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.011 DEBUG:boto:Method: GET 2023-12-15T23:20:59.011 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.011 DEBUG:boto:Data: 2023-12-15T23:20:59.011 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.012 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.012 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.012 DEBUG:boto:Params: {} 2023-12-15T23:20:59.012 DEBUG:boto:Token: None 2023-12-15T23:20:59.012 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.012 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ= 2023-12-15T23:20:59.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ=', 'Content-Length': '0'} 2023-12-15T23:20:59.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3a18d6e1815f7d5-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.015 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.015 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.015 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.015 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.015 DEBUG:boto:Method: GET 2023-12-15T23:20:59.016 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.016 DEBUG:boto:Data: 2023-12-15T23:20:59.016 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.016 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.016 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.016 DEBUG:boto:Params: {} 2023-12-15T23:20:59.016 DEBUG:boto:Token: None 2023-12-15T23:20:59.016 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.016 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ= 2023-12-15T23:20:59.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ=', 'Content-Length': '0'} 2023-12-15T23:20:59.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000846956f7adf61d67-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.066 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.066 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.066 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.066 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.066 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.066 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.066 DEBUG:boto:Data: 2023-12-15T23:20:59.066 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.067 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.067 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.067 DEBUG:boto:Params: {} 2023-12-15T23:20:59.067 DEBUG:boto:Token: None 2023-12-15T23:20:59.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:isNvRKH+nfyh7/f94BFOHGMksQg= 2023-12-15T23:20:59.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:isNvRKH+nfyh7/f94BFOHGMksQg=', 'Content-Length': '0'} 2023-12-15T23:20:59.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c87bfbd865b9f437-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.070 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.070 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.070 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.070 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.070 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.071 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.071 DEBUG:boto:Data: 2023-12-15T23:20:59.071 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.071 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.071 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.071 DEBUG:boto:Params: {} 2023-12-15T23:20:59.071 DEBUG:boto:Token: None 2023-12-15T23:20:59.071 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:isNvRKH+nfyh7/f94BFOHGMksQg= 2023-12-15T23:20:59.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:isNvRKH+nfyh7/f94BFOHGMksQg=', 'Content-Length': '0'} 2023-12-15T23:20:59.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ca9e73bba72f795-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.074 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:20:59.074 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.074 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.074 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.074 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.074 DEBUG:boto:Method: GET 2023-12-15T23:20:59.074 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.074 DEBUG:boto:Data: 2023-12-15T23:20:59.074 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.075 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.075 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.075 DEBUG:boto:Params: {} 2023-12-15T23:20:59.075 DEBUG:boto:Token: None 2023-12-15T23:20:59.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ= 2023-12-15T23:20:59.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ=', 'Content-Length': '0'} 2023-12-15T23:20:59.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d185c307037a5c6d-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.125 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.126 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.126 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.126 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.126 DEBUG:boto:Method: GET 2023-12-15T23:20:59.126 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.126 DEBUG:boto:Data: 2023-12-15T23:20:59.126 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.126 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.127 DEBUG:boto:Params: {} 2023-12-15T23:20:59.127 DEBUG:boto:Token: None 2023-12-15T23:20:59.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:20:59.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ= 2023-12-15T23:20:59.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L5xYnI6ytkbCR74S4bo2ZQU3TUQ=', 'Content-Length': '0'} 2023-12-15T23:20:59.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001dc19872aafb994-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.130 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.130 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.130 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.130 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.130 DEBUG:boto:Method: GET 2023-12-15T23:20:59.130 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.130 DEBUG:boto:Data: 2023-12-15T23:20:59.131 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.131 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.131 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.131 DEBUG:boto:Params: {} 2023-12-15T23:20:59.131 DEBUG:boto:Token: None 2023-12-15T23:20:59.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002206c12f4acf8ac8-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.177 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.178 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.178 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.178 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.178 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.178 DEBUG:boto:Method: GET 2023-12-15T23:20:59.179 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.179 DEBUG:boto:Data: 2023-12-15T23:20:59.179 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.179 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.179 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.179 DEBUG:boto:Params: {} 2023-12-15T23:20:59.179 DEBUG:boto:Token: None 2023-12-15T23:20:59.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b865edaf7634340-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.182 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.183 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.183 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.183 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.183 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:20:59.183 DEBUG:boto:Data: 2023-12-15T23:20:59.183 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.183 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.183 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.184 DEBUG:boto:Params: {} 2023-12-15T23:20:59.184 DEBUG:boto:Token: None 2023-12-15T23:20:59.184 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85 2023-12-15T23:20:59.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mdPZIYlM2cpg3HYpdbh7K/AYPsc= 2023-12-15T23:20:59.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mdPZIYlM2cpg3HYpdbh7K/AYPsc=', 'Content-Length': '0'} 2023-12-15T23:20:59.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012750e51bc2a6e49-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.186 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.186 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.187 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.187 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:20:59.187 DEBUG:boto:Data: 2023-12-15T23:20:59.187 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.187 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.187 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.187 DEBUG:boto:Params: {} 2023-12-15T23:20:59.187 DEBUG:boto:Token: None 2023-12-15T23:20:59.187 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85 2023-12-15T23:20:59.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mdPZIYlM2cpg3HYpdbh7K/AYPsc= 2023-12-15T23:20:59.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mdPZIYlM2cpg3HYpdbh7K/AYPsc=', 'Content-Length': '0'} 2023-12-15T23:20:59.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058b48c2887ea9eca-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.190 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:20:59.190 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.190 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.190 DEBUG:boto:Method: GET 2023-12-15T23:20:59.190 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:20:59.190 DEBUG:boto:Data: 2023-12-15T23:20:59.191 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.191 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.191 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.191 DEBUG:boto:Params: {} 2023-12-15T23:20:59.191 DEBUG:boto:Token: None 2023-12-15T23:20:59.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85 2023-12-15T23:20:59.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LDw+iHGSascmLEz6d9G1BTLRUcI= 2023-12-15T23:20:59.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LDw+iHGSascmLEz6d9G1BTLRUcI=', 'Content-Length': '0'} 2023-12-15T23:20:59.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012858ea5b29a40fc-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.240 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:20:59.240 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:20:59.241 DEBUG:boto:Method: GET 2023-12-15T23:20:59.241 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:20:59.241 DEBUG:boto:Data: 2023-12-15T23:20:59.241 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.241 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.241 DEBUG:boto:Params: {} 2023-12-15T23:20:59.241 DEBUG:boto:Token: None 2023-12-15T23:20:59.241 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj85 2023-12-15T23:20:59.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LDw+iHGSascmLEz6d9G1BTLRUcI= 2023-12-15T23:20:59.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LDw+iHGSascmLEz6d9G1BTLRUcI=', 'Content-Length': '0'} 2023-12-15T23:20:59.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027858f2ec4e0dac6-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.244 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.244 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.244 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.245 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.245 DEBUG:boto:Method: GET 2023-12-15T23:20:59.245 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.245 DEBUG:boto:Data: 2023-12-15T23:20:59.245 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.245 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.245 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.245 DEBUG:boto:Params: {} 2023-12-15T23:20:59.245 DEBUG:boto:Token: None 2023-12-15T23:20:59.246 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.246 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad9738748f9cae6c-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.289 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.290 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.290 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.290 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.290 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.290 DEBUG:boto:Method: GET 2023-12-15T23:20:59.291 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:20:59.291 DEBUG:boto:Data: 2023-12-15T23:20:59.291 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.291 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.291 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.291 DEBUG:boto:Params: {} 2023-12-15T23:20:59.291 DEBUG:boto:Token: None 2023-12-15T23:20:59.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.295 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000813c7a75ce27d691-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.295 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.295 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:20:59.295 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.295 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.296 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.296 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.296 DEBUG:boto:Method: GET 2023-12-15T23:20:59.296 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.296 DEBUG:boto:Data: 2023-12-15T23:20:59.296 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.296 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.296 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.296 DEBUG:boto:Params: {} 2023-12-15T23:20:59.296 DEBUG:boto:Token: None 2023-12-15T23:20:59.297 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.297 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM= 2023-12-15T23:20:59.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM=', 'Content-Length': '0'} 2023-12-15T23:20:59.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013765d31b1e79a6b-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.299 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.299 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.299 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.299 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.300 DEBUG:boto:Method: GET 2023-12-15T23:20:59.300 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.300 DEBUG:boto:Data: 2023-12-15T23:20:59.300 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.300 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.300 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.300 DEBUG:boto:Params: {} 2023-12-15T23:20:59.300 DEBUG:boto:Token: None 2023-12-15T23:20:59.300 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.301 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM= 2023-12-15T23:20:59.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM=', 'Content-Length': '0'} 2023-12-15T23:20:59.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f316994ad50da40-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.346 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.346 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.346 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.346 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.346 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.346 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.346 DEBUG:boto:Data: 2023-12-15T23:20:59.346 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.347 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.347 DEBUG:boto:Params: {} 2023-12-15T23:20:59.347 DEBUG:boto:Token: None 2023-12-15T23:20:59.347 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEt3vXv6zGslw/hxAlxlAGj2dVM= 2023-12-15T23:20:59.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEt3vXv6zGslw/hxAlxlAGj2dVM=', 'Content-Length': '0'} 2023-12-15T23:20:59.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025a6570a80a03273-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.349 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.349 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.349 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.349 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.349 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.350 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.350 DEBUG:boto:Data: 2023-12-15T23:20:59.350 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.350 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.350 DEBUG:boto:Params: {} 2023-12-15T23:20:59.350 DEBUG:boto:Token: None 2023-12-15T23:20:59.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fEt3vXv6zGslw/hxAlxlAGj2dVM= 2023-12-15T23:20:59.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fEt3vXv6zGslw/hxAlxlAGj2dVM=', 'Content-Length': '0'} 2023-12-15T23:20:59.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fb94f967f4b6731-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:20:59.353 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.353 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.353 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.353 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.353 DEBUG:boto:Method: GET 2023-12-15T23:20:59.353 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.353 DEBUG:boto:Data: 2023-12-15T23:20:59.353 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.354 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.354 DEBUG:boto:Params: {} 2023-12-15T23:20:59.354 DEBUG:boto:Token: None 2023-12-15T23:20:59.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM= 2023-12-15T23:20:59.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM=', 'Content-Length': '0'} 2023-12-15T23:20:59.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000337dfa98d9a77357-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.397 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.398 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.398 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.398 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.398 DEBUG:boto:Method: GET 2023-12-15T23:20:59.398 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.398 DEBUG:boto:Data: 2023-12-15T23:20:59.398 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.398 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.398 DEBUG:boto:Params: {} 2023-12-15T23:20:59.398 DEBUG:boto:Token: None 2023-12-15T23:20:59.399 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:20:59.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM= 2023-12-15T23:20:59.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SDOuZ0rn/ZHzwjWeIgX75VuD1tM=', 'Content-Length': '0'} 2023-12-15T23:20:59.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003977731d3c701d45-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.401 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.401 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.401 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.401 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.401 DEBUG:boto:Method: GET 2023-12-15T23:20:59.401 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.402 DEBUG:boto:Data: 2023-12-15T23:20:59.402 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.402 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.402 DEBUG:boto:Params: {} 2023-12-15T23:20:59.402 DEBUG:boto:Token: None 2023-12-15T23:20:59.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000918f6457f3ce6a49-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.405 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.405 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.406 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.406 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.406 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.406 DEBUG:boto:Method: GET 2023-12-15T23:20:59.406 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.406 DEBUG:boto:Data: 2023-12-15T23:20:59.406 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.406 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.406 DEBUG:boto:Params: {} 2023-12-15T23:20:59.407 DEBUG:boto:Token: None 2023-12-15T23:20:59.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039c9cfa5f998b68e-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.410 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.410 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.410 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.410 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.410 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:20:59.411 DEBUG:boto:Data: 2023-12-15T23:20:59.411 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.411 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.411 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.411 DEBUG:boto:Params: {} 2023-12-15T23:20:59.411 DEBUG:boto:Token: None 2023-12-15T23:20:59.411 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92 2023-12-15T23:20:59.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzQ5dz9A8rTqS+3aFfr4gMSt35I= 2023-12-15T23:20:59.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzQ5dz9A8rTqS+3aFfr4gMSt35I=', 'Content-Length': '0'} 2023-12-15T23:20:59.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6d41f0e65382e6a-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.413 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.413 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.413 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.414 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:20:59.414 DEBUG:boto:Data: 2023-12-15T23:20:59.414 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.414 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.414 DEBUG:boto:Params: {} 2023-12-15T23:20:59.414 DEBUG:boto:Token: None 2023-12-15T23:20:59.414 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92 2023-12-15T23:20:59.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PzQ5dz9A8rTqS+3aFfr4gMSt35I= 2023-12-15T23:20:59.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PzQ5dz9A8rTqS+3aFfr4gMSt35I=', 'Content-Length': '0'} 2023-12-15T23:20:59.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009391d72bc94619a1-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:20:59.417 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.417 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.417 DEBUG:boto:Method: GET 2023-12-15T23:20:59.417 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:20:59.417 DEBUG:boto:Data: 2023-12-15T23:20:59.417 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.417 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.417 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.417 DEBUG:boto:Params: {} 2023-12-15T23:20:59.417 DEBUG:boto:Token: None 2023-12-15T23:20:59.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92 2023-12-15T23:20:59.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FMQ8qsbFu3zjrYF4HTzZAPtZ5GI= 2023-12-15T23:20:59.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FMQ8qsbFu3zjrYF4HTzZAPtZ5GI=', 'Content-Length': '0'} 2023-12-15T23:20:59.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d65515e17eea9af-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.465 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:20:59.466 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:20:59.466 DEBUG:boto:Method: GET 2023-12-15T23:20:59.466 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:20:59.466 DEBUG:boto:Data: 2023-12-15T23:20:59.466 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.466 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.466 DEBUG:boto:Params: {} 2023-12-15T23:20:59.466 DEBUG:boto:Token: None 2023-12-15T23:20:59.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj92 2023-12-15T23:20:59.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FMQ8qsbFu3zjrYF4HTzZAPtZ5GI= 2023-12-15T23:20:59.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FMQ8qsbFu3zjrYF4HTzZAPtZ5GI=', 'Content-Length': '0'} 2023-12-15T23:20:59.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000311a22661128d925-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.469 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.469 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.469 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.469 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.469 DEBUG:boto:Method: GET 2023-12-15T23:20:59.469 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.469 DEBUG:boto:Data: 2023-12-15T23:20:59.470 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.470 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.470 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.470 DEBUG:boto:Params: {} 2023-12-15T23:20:59.470 DEBUG:boto:Token: None 2023-12-15T23:20:59.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b26b72f40ee4dabb-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.517 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.518 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.518 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.518 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.518 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.518 DEBUG:boto:Method: GET 2023-12-15T23:20:59.518 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:20:59.519 DEBUG:boto:Data: 2023-12-15T23:20:59.519 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.519 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.519 DEBUG:boto:Params: {} 2023-12-15T23:20:59.519 DEBUG:boto:Token: None 2023-12-15T23:20:59.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000adc72ceda7934497-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.522 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:20:59.523 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.523 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.523 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.523 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.523 DEBUG:boto:Method: GET 2023-12-15T23:20:59.523 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.523 DEBUG:boto:Data: 2023-12-15T23:20:59.523 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.523 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.523 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.524 DEBUG:boto:Params: {} 2023-12-15T23:20:59.524 DEBUG:boto:Token: None 2023-12-15T23:20:59.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY= 2023-12-15T23:20:59.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY=', 'Content-Length': '0'} 2023-12-15T23:20:59.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0fe66b0381977cb-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.526 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.526 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.526 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.526 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.526 DEBUG:boto:Method: GET 2023-12-15T23:20:59.526 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.526 DEBUG:boto:Data: 2023-12-15T23:20:59.527 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.527 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.527 DEBUG:boto:Params: {} 2023-12-15T23:20:59.527 DEBUG:boto:Token: None 2023-12-15T23:20:59.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY= 2023-12-15T23:20:59.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY=', 'Content-Length': '0'} 2023-12-15T23:20:59.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017f5f974cbc1550c-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.570 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.570 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.570 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.570 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.570 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.570 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.570 DEBUG:boto:Data: 2023-12-15T23:20:59.570 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.570 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.570 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.571 DEBUG:boto:Params: {} 2023-12-15T23:20:59.571 DEBUG:boto:Token: None 2023-12-15T23:20:59.571 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUP9Kx7YooxmHAxoGRGmJ9mJ5+0= 2023-12-15T23:20:59.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUP9Kx7YooxmHAxoGRGmJ9mJ5+0=', 'Content-Length': '0'} 2023-12-15T23:20:59.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037b132e8c646aec6-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.573 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.573 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.573 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.573 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.573 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.573 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.574 DEBUG:boto:Data: 2023-12-15T23:20:59.574 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.574 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.574 DEBUG:boto:Params: {} 2023-12-15T23:20:59.574 DEBUG:boto:Token: None 2023-12-15T23:20:59.574 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pUP9Kx7YooxmHAxoGRGmJ9mJ5+0= 2023-12-15T23:20:59.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pUP9Kx7YooxmHAxoGRGmJ9mJ5+0=', 'Content-Length': '0'} 2023-12-15T23:20:59.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052be23dfb7535a38-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:20:59.576 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.576 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.577 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.577 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.577 DEBUG:boto:Method: GET 2023-12-15T23:20:59.577 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.577 DEBUG:boto:Data: 2023-12-15T23:20:59.577 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.577 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.577 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.577 DEBUG:boto:Params: {} 2023-12-15T23:20:59.577 DEBUG:boto:Token: None 2023-12-15T23:20:59.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY= 2023-12-15T23:20:59.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY=', 'Content-Length': '0'} 2023-12-15T23:20:59.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ec9e5ebb7049b73-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.621 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.622 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.622 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.622 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.622 DEBUG:boto:Method: GET 2023-12-15T23:20:59.622 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.622 DEBUG:boto:Data: 2023-12-15T23:20:59.622 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.622 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.622 DEBUG:boto:Params: {} 2023-12-15T23:20:59.622 DEBUG:boto:Token: None 2023-12-15T23:20:59.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:20:59.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY= 2023-12-15T23:20:59.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ofiJSoFondtddUGpztDVGbmT4lY=', 'Content-Length': '0'} 2023-12-15T23:20:59.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cc9ec69065a6d4e-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.625 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.625 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.625 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.625 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.625 DEBUG:boto:Method: GET 2023-12-15T23:20:59.625 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.626 DEBUG:boto:Data: 2023-12-15T23:20:59.626 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.626 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.626 DEBUG:boto:Params: {} 2023-12-15T23:20:59.626 DEBUG:boto:Token: None 2023-12-15T23:20:59.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027f47f03a9ac2dca-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.629 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.629 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.629 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.629 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.629 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.629 DEBUG:boto:Method: GET 2023-12-15T23:20:59.630 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.630 DEBUG:boto:Data: 2023-12-15T23:20:59.630 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.630 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.630 DEBUG:boto:Params: {} 2023-12-15T23:20:59.630 DEBUG:boto:Token: None 2023-12-15T23:20:59.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ead8c244ce2e9d2-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.634 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.634 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.634 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.634 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.634 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:20:59.634 DEBUG:boto:Data: 2023-12-15T23:20:59.634 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.635 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.635 DEBUG:boto:Params: {} 2023-12-15T23:20:59.635 DEBUG:boto:Token: None 2023-12-15T23:20:59.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95 2023-12-15T23:20:59.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zh6Dvm+gvy+Mxpyp8Px30NT5S+M= 2023-12-15T23:20:59.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zh6Dvm+gvy+Mxpyp8Px30NT5S+M=', 'Content-Length': '0'} 2023-12-15T23:20:59.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045f22ab223dabbcb-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.637 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.637 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.638 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.638 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:20:59.638 DEBUG:boto:Data: 2023-12-15T23:20:59.638 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.638 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.638 DEBUG:boto:Params: {} 2023-12-15T23:20:59.638 DEBUG:boto:Token: None 2023-12-15T23:20:59.638 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95 2023-12-15T23:20:59.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zh6Dvm+gvy+Mxpyp8Px30NT5S+M= 2023-12-15T23:20:59.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zh6Dvm+gvy+Mxpyp8Px30NT5S+M=', 'Content-Length': '0'} 2023-12-15T23:20:59.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026251d9184dcaafb-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.641 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:20:59.641 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.641 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.641 DEBUG:boto:Method: GET 2023-12-15T23:20:59.641 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:20:59.641 DEBUG:boto:Data: 2023-12-15T23:20:59.641 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.641 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.641 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.642 DEBUG:boto:Params: {} 2023-12-15T23:20:59.642 DEBUG:boto:Token: None 2023-12-15T23:20:59.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95 2023-12-15T23:20:59.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wFR7pJTsED+QRkdCUQUyAO+GVpg= 2023-12-15T23:20:59.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wFR7pJTsED+QRkdCUQUyAO+GVpg=', 'Content-Length': '0'} 2023-12-15T23:20:59.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013b595ba1e1bcba1-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.685 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:20:59.686 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:20:59.686 DEBUG:boto:Method: GET 2023-12-15T23:20:59.686 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:20:59.686 DEBUG:boto:Data: 2023-12-15T23:20:59.686 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.686 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.686 DEBUG:boto:Params: {} 2023-12-15T23:20:59.686 DEBUG:boto:Token: None 2023-12-15T23:20:59.686 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj95 2023-12-15T23:20:59.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wFR7pJTsED+QRkdCUQUyAO+GVpg= 2023-12-15T23:20:59.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wFR7pJTsED+QRkdCUQUyAO+GVpg=', 'Content-Length': '0'} 2023-12-15T23:20:59.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb11f6fac496a2a1-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.689 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.689 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.689 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.689 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.689 DEBUG:boto:Method: GET 2023-12-15T23:20:59.689 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.690 DEBUG:boto:Data: 2023-12-15T23:20:59.690 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.690 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:20:59.690 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.690 DEBUG:boto:Params: {} 2023-12-15T23:20:59.690 DEBUG:boto:Token: None 2023-12-15T23:20:59.690 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000360e04454c3d8755-00657cdf5b-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.733 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.734 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.734 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.734 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.734 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.735 DEBUG:boto:Method: GET 2023-12-15T23:20:59.735 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:20:59.735 DEBUG:boto:Data: 2023-12-15T23:20:59.735 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.735 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.735 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.735 DEBUG:boto:Params: {} 2023-12-15T23:20:59.735 DEBUG:boto:Token: None 2023-12-15T23:20:59.736 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.736 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo= 2023-12-15T23:20:59.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LggCRKErcJR3m/9e2eAPHeAMjqo=', 'Content-Length': '0'} 2023-12-15T23:20:59.739 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000a06d6f465fb160-00657cdf5b-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.739 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:20:59.739 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:20:59.739 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:20:59.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:20:59.740 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:20:59.795 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:20:59.795 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:20:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:20:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:20:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 20 2023-12-15T23:20:59.917 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.917 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.918 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.918 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:20:59.918 DEBUG:boto:Data: 2023-12-15T23:20:59.918 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.918 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.918 DEBUG:boto:Params: {} 2023-12-15T23:20:59.918 DEBUG:boto:Token: None 2023-12-15T23:20:59.918 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI= 2023-12-15T23:20:59.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI=', 'Content-Length': '0'} 2023-12-15T23:20:59.921 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000098f53a6533c73a47-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.922 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:20:59.922 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:20:59.922 DEBUG:boto:Method: PUT 2023-12-15T23:20:59.922 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:20:59.922 DEBUG:boto:Data: 2023-12-15T23:20:59.922 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:20:59.922 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.922 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.923 DEBUG:boto:Params: {} 2023-12-15T23:20:59.923 DEBUG:boto:Token: None 2023-12-15T23:20:59.923 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj29 2023-12-15T23:20:59.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tdLeDe+27627I/BdnKHUI2czzhs= 2023-12-15T23:20:59.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tdLeDe+27627I/BdnKHUI2czzhs='} 2023-12-15T23:20:59.966 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000631a5afba22ead18-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.966 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.966 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.966 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.966 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:20:59.966 DEBUG:boto:Data: 2023-12-15T23:20:59.966 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.966 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.966 DEBUG:boto:Params: {} 2023-12-15T23:20:59.967 DEBUG:boto:Token: None 2023-12-15T23:20:59.967 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI= 2023-12-15T23:20:59.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI=', 'Content-Length': '0'} 2023-12-15T23:20:59.969 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001132014e0f1f9dd5-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.970 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:20:59.970 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:20:59.970 DEBUG:boto:Method: PUT 2023-12-15T23:20:59.970 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:20:59.970 DEBUG:boto:Data: 2023-12-15T23:20:59.970 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:20:59.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.970 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.970 DEBUG:boto:Params: {} 2023-12-15T23:20:59.971 DEBUG:boto:Token: None 2023-12-15T23:20:59.971 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj58 2023-12-15T23:20:59.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FXLbCglh184W65P7IJPQZGEd0V0= 2023-12-15T23:20:59.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FXLbCglh184W65P7IJPQZGEd0V0='} 2023-12-15T23:20:59.976 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aeb676b6df80b64c-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.976 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:20:59.976 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:20:59.976 DEBUG:boto:Method: HEAD 2023-12-15T23:20:59.976 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:20:59.976 DEBUG:boto:Data: 2023-12-15T23:20:59.977 DEBUG:boto:Headers: {} 2023-12-15T23:20:59.977 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.977 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.977 DEBUG:boto:Params: {} 2023-12-15T23:20:59.977 DEBUG:boto:Token: None 2023-12-15T23:20:59.977 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/ 2023-12-15T23:20:59.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI= 2023-12-15T23:20:59.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3eseYhcSRGaxaHLmdGWCe5KORcI=', 'Content-Length': '0'} 2023-12-15T23:20:59.980 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ced84376750c8869-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:20:59.980 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:20:59.980 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:20:59.980 DEBUG:boto:Method: PUT 2023-12-15T23:20:59.980 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:20:59.980 DEBUG:boto:Data: 2023-12-15T23:20:59.980 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:20:59.980 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:20:59.981 DEBUG:boto:Port: 8000 2023-12-15T23:20:59.981 DEBUG:boto:Params: {} 2023-12-15T23:20:59.981 DEBUG:boto:Token: None 2023-12-15T23:20:59.981 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:20:59 GMT /kskgfn-49/obj87 2023-12-15T23:20:59.981 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ADVkOBFfp7kxXoQMrJIL10OoCzs= 2023-12-15T23:20:59.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:20:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ADVkOBFfp7kxXoQMrJIL10OoCzs='} 2023-12-15T23:21:00.026 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000805a912f727b53c8-00657cdf5b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:21:00.026 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:21:00.026 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:21:00.026 DEBUG:boto:Method: HEAD 2023-12-15T23:21:00.026 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:21:00.026 DEBUG:boto:Data: 2023-12-15T23:21:00.026 DEBUG:boto:Headers: {} 2023-12-15T23:21:00.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:21:00.026 DEBUG:boto:Port: 8000 2023-12-15T23:21:00.027 DEBUG:boto:Params: {} 2023-12-15T23:21:00.027 DEBUG:boto:Token: None 2023-12-15T23:21:00.027 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:21:00 GMT /kskgfn-49/ 2023-12-15T23:21:00.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sYMtnNiFkge11ztZ7PWTZ2xhgyg= 2023-12-15T23:21:00.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:21:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sYMtnNiFkge11ztZ7PWTZ2xhgyg=', 'Content-Length': '0'} 2023-12-15T23:21:00.030 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a2b0ecc19064fb3-00657cdf5c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:21:00.030 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:21:00.030 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:21:00.030 DEBUG:boto:Method: PUT 2023-12-15T23:21:00.030 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:21:00.030 DEBUG:boto:Data: 2023-12-15T23:21:00.030 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:21:00.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:21:00.031 DEBUG:boto:Port: 8000 2023-12-15T23:21:00.031 DEBUG:boto:Params: {} 2023-12-15T23:21:00.031 DEBUG:boto:Token: None 2023-12-15T23:21:00.031 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:21:00 GMT /kskgfn-49/obj116 2023-12-15T23:21:00.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:czJfC69IfjplfprSjrm4nDelJms= 2023-12-15T23:21:00.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:21:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:czJfC69IfjplfprSjrm4nDelJms='} 2023-12-15T23:21:00.036 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa82584f1ce20893-00657cdf5c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:21:00.037 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:21:00.037 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:21:00.037 DEBUG:boto:Method: HEAD 2023-12-15T23:21:00.037 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:21:00.037 DEBUG:boto:Data: 2023-12-15T23:21:00.037 DEBUG:boto:Headers: {} 2023-12-15T23:21:00.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:21:00.037 DEBUG:boto:Port: 8000 2023-12-15T23:21:00.037 DEBUG:boto:Params: {} 2023-12-15T23:21:00.038 DEBUG:boto:Token: None 2023-12-15T23:21:00.038 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:21:00 GMT /kskgfn-49/ 2023-12-15T23:21:00.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sYMtnNiFkge11ztZ7PWTZ2xhgyg= 2023-12-15T23:21:00.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:21:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sYMtnNiFkge11ztZ7PWTZ2xhgyg=', 'Content-Length': '0'} 2023-12-15T23:21:00.040 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b85e1cf37407c330-00657cdf5c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:21:00.040 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:21:00.040 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:21:00.041 DEBUG:boto:Method: PUT 2023-12-15T23:21:00.041 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:21:00.041 DEBUG:boto:Data: 2023-12-15T23:21:00.041 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:21:00.041 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:21:00.041 DEBUG:boto:Port: 8000 2023-12-15T23:21:00.041 DEBUG:boto:Params: {} 2023-12-15T23:21:00.041 DEBUG:boto:Token: None 2023-12-15T23:21:00.041 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:21:00 GMT /kskgfn-49/obj145 2023-12-15T23:21:00.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5xycUJeO6d3pgahP7dNwGrb01MY= 2023-12-15T23:21:00.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:21:00 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5xycUJeO6d3pgahP7dNwGrb01MY='} 2023-12-15T23:21:00.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003df27b507d32999b-00657cdf5c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:21:00.086 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:21:00.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:21:00.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:21:00.086 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:21:00.146 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:21:00.146 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:21:00.186 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:00.184+0000 7fec7dd30800 1 waiting to reach latest gen 4, on 3.. 2023-12-15T23:21:05.189 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:05.187+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:05.189 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:05.189 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:10.191 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:10.189+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:10.191 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:10.191 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:15.192 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:15.191+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:15.193 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:15.193 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:20.194 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:20.193+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:20.194 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:20.195 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:25.194+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:25.196 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:25.196 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:30.198 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:30.196+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:30.198 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:30.198 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:35.200 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:35.198+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:35.200 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:35.200 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:40.202 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:40.200+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:40.202 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:40.202 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:45.204 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:45.202+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:45.204 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:45.204 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:50.206 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:50.203+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:50.206 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:50.206 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:21:55.207 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:21:55.205+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:21:55.208 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:21:55.208 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:22:00.209 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:00.208+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:00.209 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:00.210 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:22:03.352 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:22:03.351+0000 7fca6d65b640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:22:05.211 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:05.209+0000 7fec7dd30800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:05.211 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000002.43.6, 00000000001.71.6, , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:05.211 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:22:10.213 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:10.211+0000 7fec7dd30800 1 bucket sync caught up with source: 2023-12-15T23:22:10.213 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:22:10.213 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [00000000002.43.6, 00000000001.71.6, , , , , 00000000001.52.6, , , , , , , , , , , 00000000002.36.6, 00000000001.62.6, , , , , , , , , , ] 2023-12-15T23:22:10.213 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:10.211+0000 7fec7dd30800 0 bucket checkpoint complete 2023-12-15T23:22:10.233 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:22:10.233 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:22:10.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:22:10.233 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:22:10.294 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:22:10.294 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:22:10.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:22:10.334+0000 7f052fd2b800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:10.336 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000003.162.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:10.336 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:15.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:22:15.335+0000 7f052fd2b800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:15.337 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000003.162.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:15.337 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:20.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:22:20.336+0000 7f052fd2b800 1 bucket sync caught up with source: 2023-12-15T23:22:20.339 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:20.339 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000002.144.6, 00000000002.140.6, 00000000001.83.6, 00000000003.150.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000002.91.6, 00000000005.109.6, 00000000004.105.6] 2023-12-15T23:22:20.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:22:20.336+0000 7f052fd2b800 0 bucket checkpoint complete 2023-12-15T23:22:20.359 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:22:20.359 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.359 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.360 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.360 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:20.360 DEBUG:boto:Data: 2023-12-15T23:22:20.360 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.360 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.360 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.360 DEBUG:boto:Params: {} 2023-12-15T23:22:20.361 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:22:20.361 DEBUG:boto:Token: None 2023-12-15T23:22:20.361 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.361 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JUwFcVyqaTIMdqYTYSuHd1gdMZM= 2023-12-15T23:22:20.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JUwFcVyqaTIMdqYTYSuHd1gdMZM=', 'Content-Length': '0'} 2023-12-15T23:22:20.366 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007fb4035e87c461b2-00657cdfac-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.366 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.366 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.366 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.366 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:20.366 DEBUG:boto:Data: 2023-12-15T23:22:20.366 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.367 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.367 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.367 DEBUG:boto:Params: {} 2023-12-15T23:22:20.367 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:22:20.367 DEBUG:boto:Token: None 2023-12-15T23:22:20.367 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JUwFcVyqaTIMdqYTYSuHd1gdMZM= 2023-12-15T23:22:20.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JUwFcVyqaTIMdqYTYSuHd1gdMZM=', 'Content-Length': '0'} 2023-12-15T23:22:20.372 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002d1ae68a4dc03519-00657cdfac-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.372 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:22:20.372 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.372 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.372 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.372 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.372 DEBUG:boto:Method: GET 2023-12-15T23:22:20.372 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.372 DEBUG:boto:Data: 2023-12-15T23:22:20.373 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.373 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.373 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.373 DEBUG:boto:Params: {} 2023-12-15T23:22:20.373 DEBUG:boto:Token: None 2023-12-15T23:22:20.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/?versions 2023-12-15T23:22:20.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY= 2023-12-15T23:22:20.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY=', 'Content-Length': '0'} 2023-12-15T23:22:20.376 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071247da1e0d7f320-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.376 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:22:20.378 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:22:20.379 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:22:20.380 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:22:20.380 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.380 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.380 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.380 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.381 DEBUG:boto:Method: GET 2023-12-15T23:22:20.381 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.381 DEBUG:boto:Data: 2023-12-15T23:22:20.381 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.381 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.381 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.381 DEBUG:boto:Params: {} 2023-12-15T23:22:20.381 DEBUG:boto:Token: None 2023-12-15T23:22:20.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/?versions 2023-12-15T23:22:20.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY= 2023-12-15T23:22:20.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY=', 'Content-Length': '0'} 2023-12-15T23:22:20.385 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000718eb4c7d9c45689-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.385 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:22:20.387 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:22:20.388 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:22:20.389 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:22:20.389 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:22:20.389 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:22:20.389 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:22:20.389 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.389 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.389 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.389 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.389 DEBUG:boto:Method: GET 2023-12-15T23:22:20.389 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.390 DEBUG:boto:Data: 2023-12-15T23:22:20.390 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.390 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.390 DEBUG:boto:Params: {} 2023-12-15T23:22:20.390 DEBUG:boto:Token: None 2023-12-15T23:22:20.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/?versions 2023-12-15T23:22:20.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY= 2023-12-15T23:22:20.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY=', 'Content-Length': '0'} 2023-12-15T23:22:20.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c677444e66714641-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.393 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.394 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.395 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.395 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.395 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.395 DEBUG:boto:Method: GET 2023-12-15T23:22:20.395 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:22:20.395 DEBUG:boto:Data: 2023-12-15T23:22:20.395 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.395 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.395 DEBUG:boto:Params: {} 2023-12-15T23:22:20.395 DEBUG:boto:Token: None 2023-12-15T23:22:20.396 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/?versions 2023-12-15T23:22:20.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY= 2023-12-15T23:22:20.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XC8MkKBDj0ylI7miISBEO7bT0hY=', 'Content-Length': '0'} 2023-12-15T23:22:20.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047cf555a5a9d0a44-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.399 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:22:20.400 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.400 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.400 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.401 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.401 DEBUG:boto:Method: GET 2023-12-15T23:22:20.401 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.401 DEBUG:boto:Data: 2023-12-15T23:22:20.401 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.401 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.401 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.401 DEBUG:boto:Params: {} 2023-12-15T23:22:20.401 DEBUG:boto:Token: None 2023-12-15T23:22:20.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM= 2023-12-15T23:22:20.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM=', 'Content-Length': '0'} 2023-12-15T23:22:20.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b11febce08e7566b-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.404 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.404 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.404 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.404 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.405 DEBUG:boto:Method: GET 2023-12-15T23:22:20.405 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.405 DEBUG:boto:Data: 2023-12-15T23:22:20.405 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.405 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.405 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.405 DEBUG:boto:Params: {} 2023-12-15T23:22:20.405 DEBUG:boto:Token: None 2023-12-15T23:22:20.405 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM= 2023-12-15T23:22:20.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM=', 'Content-Length': '0'} 2023-12-15T23:22:20.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030beb2a6ac8b8cec-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.408 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.408 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.408 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.409 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.409 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.409 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.409 DEBUG:boto:Data: 2023-12-15T23:22:20.409 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.409 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.409 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.409 DEBUG:boto:Params: {} 2023-12-15T23:22:20.409 DEBUG:boto:Token: None 2023-12-15T23:22:20.409 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cwf5AcPhlgw4acKMLE8Zdaby5Wc= 2023-12-15T23:22:20.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cwf5AcPhlgw4acKMLE8Zdaby5Wc=', 'Content-Length': '0'} 2023-12-15T23:22:20.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e9a216cd7aa2a33-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.412 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.412 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.412 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.412 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.413 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.413 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.413 DEBUG:boto:Data: 2023-12-15T23:22:20.413 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.413 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.413 DEBUG:boto:Params: {} 2023-12-15T23:22:20.413 DEBUG:boto:Token: None 2023-12-15T23:22:20.413 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.413 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cwf5AcPhlgw4acKMLE8Zdaby5Wc= 2023-12-15T23:22:20.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cwf5AcPhlgw4acKMLE8Zdaby5Wc=', 'Content-Length': '0'} 2023-12-15T23:22:20.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049e9eb1e90efe4ba-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:22:20.416 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.416 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.416 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.416 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.417 DEBUG:boto:Method: GET 2023-12-15T23:22:20.417 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.417 DEBUG:boto:Data: 2023-12-15T23:22:20.417 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.417 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.417 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.417 DEBUG:boto:Params: {} 2023-12-15T23:22:20.417 DEBUG:boto:Token: None 2023-12-15T23:22:20.417 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM= 2023-12-15T23:22:20.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM=', 'Content-Length': '0'} 2023-12-15T23:22:20.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e509a1d5229c83a3-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.462 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.462 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.462 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.462 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.462 DEBUG:boto:Method: GET 2023-12-15T23:22:20.462 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.462 DEBUG:boto:Data: 2023-12-15T23:22:20.462 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.462 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.462 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.462 DEBUG:boto:Params: {} 2023-12-15T23:22:20.463 DEBUG:boto:Token: None 2023-12-15T23:22:20.463 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:22:20.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM= 2023-12-15T23:22:20.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MhlN7VDvat9H5BHUqJLWIKJoDbM=', 'Content-Length': '0'} 2023-12-15T23:22:20.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f7f66fa6c87ae85-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.465 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.466 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.466 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.466 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.466 DEBUG:boto:Method: GET 2023-12-15T23:22:20.466 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.466 DEBUG:boto:Data: 2023-12-15T23:22:20.466 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.466 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.466 DEBUG:boto:Params: {} 2023-12-15T23:22:20.466 DEBUG:boto:Token: None 2023-12-15T23:22:20.467 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000106dd71b74d392f3-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.469 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.470 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.470 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.470 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.470 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.470 DEBUG:boto:Method: GET 2023-12-15T23:22:20.470 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.470 DEBUG:boto:Data: 2023-12-15T23:22:20.470 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.471 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.471 DEBUG:boto:Params: {} 2023-12-15T23:22:20.471 DEBUG:boto:Token: None 2023-12-15T23:22:20.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a76d49495221f47-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.474 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.475 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.475 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.475 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.475 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:22:20.475 DEBUG:boto:Data: 2023-12-15T23:22:20.475 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.475 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.475 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.475 DEBUG:boto:Params: {} 2023-12-15T23:22:20.476 DEBUG:boto:Token: None 2023-12-15T23:22:20.476 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11 2023-12-15T23:22:20.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pVcCLqNxgihV+IZkSlDWznJnEG4= 2023-12-15T23:22:20.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pVcCLqNxgihV+IZkSlDWznJnEG4=', 'Content-Length': '0'} 2023-12-15T23:22:20.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bb215dc82aa74e2-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.478 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.479 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.479 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.479 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:22:20.479 DEBUG:boto:Data: 2023-12-15T23:22:20.479 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.479 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.479 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.479 DEBUG:boto:Params: {} 2023-12-15T23:22:20.479 DEBUG:boto:Token: None 2023-12-15T23:22:20.480 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11 2023-12-15T23:22:20.480 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pVcCLqNxgihV+IZkSlDWznJnEG4= 2023-12-15T23:22:20.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pVcCLqNxgihV+IZkSlDWznJnEG4=', 'Content-Length': '0'} 2023-12-15T23:22:20.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000903c80622731a1d1-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.482 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:22:20.483 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.483 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.483 DEBUG:boto:Method: GET 2023-12-15T23:22:20.483 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:22:20.483 DEBUG:boto:Data: 2023-12-15T23:22:20.483 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.483 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.483 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.483 DEBUG:boto:Params: {} 2023-12-15T23:22:20.483 DEBUG:boto:Token: None 2023-12-15T23:22:20.484 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11 2023-12-15T23:22:20.484 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sJL3SGxtTZDsx3LVO+U8LCJmcr0= 2023-12-15T23:22:20.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sJL3SGxtTZDsx3LVO+U8LCJmcr0=', 'Content-Length': '0'} 2023-12-15T23:22:20.486 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010324563680a4b86-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.529 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:22:20.530 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:22:20.530 DEBUG:boto:Method: GET 2023-12-15T23:22:20.530 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:22:20.530 DEBUG:boto:Data: 2023-12-15T23:22:20.530 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.530 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.530 DEBUG:boto:Params: {} 2023-12-15T23:22:20.530 DEBUG:boto:Token: None 2023-12-15T23:22:20.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj11 2023-12-15T23:22:20.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sJL3SGxtTZDsx3LVO+U8LCJmcr0= 2023-12-15T23:22:20.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sJL3SGxtTZDsx3LVO+U8LCJmcr0=', 'Content-Length': '0'} 2023-12-15T23:22:20.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3f83b434c1815ed-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.533 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.533 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.533 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.533 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.533 DEBUG:boto:Method: GET 2023-12-15T23:22:20.534 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.534 DEBUG:boto:Data: 2023-12-15T23:22:20.534 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.534 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.534 DEBUG:boto:Params: {} 2023-12-15T23:22:20.534 DEBUG:boto:Token: None 2023-12-15T23:22:20.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009bc0035047379f4-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.537 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.537 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.537 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.537 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.537 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.538 DEBUG:boto:Method: GET 2023-12-15T23:22:20.538 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:22:20.538 DEBUG:boto:Data: 2023-12-15T23:22:20.538 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.538 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.538 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.538 DEBUG:boto:Params: {} 2023-12-15T23:22:20.538 DEBUG:boto:Token: None 2023-12-15T23:22:20.538 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ef634360fe473ab-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.542 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:22:20.543 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.543 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.543 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.543 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.543 DEBUG:boto:Method: GET 2023-12-15T23:22:20.543 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.543 DEBUG:boto:Data: 2023-12-15T23:22:20.544 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.544 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.544 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.544 DEBUG:boto:Params: {} 2023-12-15T23:22:20.544 DEBUG:boto:Token: None 2023-12-15T23:22:20.544 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U= 2023-12-15T23:22:20.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U=', 'Content-Length': '0'} 2023-12-15T23:22:20.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b1011352b74ce61-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.546 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.547 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.547 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.547 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.547 DEBUG:boto:Method: GET 2023-12-15T23:22:20.547 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.547 DEBUG:boto:Data: 2023-12-15T23:22:20.547 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.547 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.547 DEBUG:boto:Params: {} 2023-12-15T23:22:20.547 DEBUG:boto:Token: None 2023-12-15T23:22:20.548 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.548 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U= 2023-12-15T23:22:20.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U=', 'Content-Length': '0'} 2023-12-15T23:22:20.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003134ca713cdb4f14-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.550 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.550 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.550 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.550 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.551 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.551 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.551 DEBUG:boto:Data: 2023-12-15T23:22:20.551 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.551 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.551 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.551 DEBUG:boto:Params: {} 2023-12-15T23:22:20.551 DEBUG:boto:Token: None 2023-12-15T23:22:20.551 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3gYy/j88SrVIkFDqNNHTmwfgvL8= 2023-12-15T23:22:20.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3gYy/j88SrVIkFDqNNHTmwfgvL8=', 'Content-Length': '0'} 2023-12-15T23:22:20.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab66c53522a1dd52-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.554 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.554 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.554 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.554 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.554 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.554 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.554 DEBUG:boto:Data: 2023-12-15T23:22:20.554 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.555 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.555 DEBUG:boto:Params: {} 2023-12-15T23:22:20.555 DEBUG:boto:Token: None 2023-12-15T23:22:20.555 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3gYy/j88SrVIkFDqNNHTmwfgvL8= 2023-12-15T23:22:20.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3gYy/j88SrVIkFDqNNHTmwfgvL8=', 'Content-Length': '0'} 2023-12-15T23:22:20.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099064a9b74018bf4-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.557 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:22:20.557 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.558 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.558 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.558 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.558 DEBUG:boto:Method: GET 2023-12-15T23:22:20.558 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.558 DEBUG:boto:Data: 2023-12-15T23:22:20.558 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.558 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.558 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.558 DEBUG:boto:Params: {} 2023-12-15T23:22:20.558 DEBUG:boto:Token: None 2023-12-15T23:22:20.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U= 2023-12-15T23:22:20.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U=', 'Content-Length': '0'} 2023-12-15T23:22:20.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd33e215fdb40fbe-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.601 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.602 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.602 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.602 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.602 DEBUG:boto:Method: GET 2023-12-15T23:22:20.602 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.602 DEBUG:boto:Data: 2023-12-15T23:22:20.602 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.602 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.602 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.602 DEBUG:boto:Params: {} 2023-12-15T23:22:20.602 DEBUG:boto:Token: None 2023-12-15T23:22:20.603 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:22:20.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U= 2023-12-15T23:22:20.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Io0R1K1azGTFwI4T0N7ZZBBHp1U=', 'Content-Length': '0'} 2023-12-15T23:22:20.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7971f6506c31f69-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.605 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.605 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.606 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.606 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.606 DEBUG:boto:Method: GET 2023-12-15T23:22:20.606 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.606 DEBUG:boto:Data: 2023-12-15T23:22:20.606 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.606 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.606 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.606 DEBUG:boto:Params: {} 2023-12-15T23:22:20.606 DEBUG:boto:Token: None 2023-12-15T23:22:20.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.609 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d43a6b713de7736-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.609 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.609 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.609 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.609 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.610 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.610 DEBUG:boto:Method: GET 2023-12-15T23:22:20.610 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.610 DEBUG:boto:Data: 2023-12-15T23:22:20.610 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.610 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.610 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.610 DEBUG:boto:Params: {} 2023-12-15T23:22:20.610 DEBUG:boto:Token: None 2023-12-15T23:22:20.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.614 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d409821428533fc3-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.614 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.614 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.615 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.615 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.615 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:22:20.615 DEBUG:boto:Data: 2023-12-15T23:22:20.615 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.615 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.615 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.615 DEBUG:boto:Params: {} 2023-12-15T23:22:20.615 DEBUG:boto:Token: None 2023-12-15T23:22:20.616 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115 2023-12-15T23:22:20.616 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lavlkPTJbnv+fo6zqePAlZ2izbU= 2023-12-15T23:22:20.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lavlkPTJbnv+fo6zqePAlZ2izbU=', 'Content-Length': '0'} 2023-12-15T23:22:20.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5bb3ac95736e258-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.618 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.618 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.618 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.618 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:22:20.619 DEBUG:boto:Data: 2023-12-15T23:22:20.619 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.619 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.619 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.619 DEBUG:boto:Params: {} 2023-12-15T23:22:20.619 DEBUG:boto:Token: None 2023-12-15T23:22:20.619 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115 2023-12-15T23:22:20.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lavlkPTJbnv+fo6zqePAlZ2izbU= 2023-12-15T23:22:20.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lavlkPTJbnv+fo6zqePAlZ2izbU=', 'Content-Length': '0'} 2023-12-15T23:22:20.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd5ecc2d7fe5c135-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:22:20.622 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.622 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.622 DEBUG:boto:Method: GET 2023-12-15T23:22:20.622 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:22:20.622 DEBUG:boto:Data: 2023-12-15T23:22:20.622 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.622 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.622 DEBUG:boto:Params: {} 2023-12-15T23:22:20.622 DEBUG:boto:Token: None 2023-12-15T23:22:20.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115 2023-12-15T23:22:20.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w/3aqt8QOjEsQscv7Bl+LtMH04o= 2023-12-15T23:22:20.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w/3aqt8QOjEsQscv7Bl+LtMH04o=', 'Content-Length': '0'} 2023-12-15T23:22:20.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002868aad13dae13f-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.625 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:22:20.625 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:22:20.625 DEBUG:boto:Method: GET 2023-12-15T23:22:20.625 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:22:20.625 DEBUG:boto:Data: 2023-12-15T23:22:20.625 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.625 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.626 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.626 DEBUG:boto:Params: {} 2023-12-15T23:22:20.626 DEBUG:boto:Token: None 2023-12-15T23:22:20.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj115 2023-12-15T23:22:20.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w/3aqt8QOjEsQscv7Bl+LtMH04o= 2023-12-15T23:22:20.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w/3aqt8QOjEsQscv7Bl+LtMH04o=', 'Content-Length': '0'} 2023-12-15T23:22:20.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d7180f717cf547d-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.670 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.670 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.670 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.670 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.670 DEBUG:boto:Method: GET 2023-12-15T23:22:20.670 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.670 DEBUG:boto:Data: 2023-12-15T23:22:20.670 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.671 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.671 DEBUG:boto:Params: {} 2023-12-15T23:22:20.671 DEBUG:boto:Token: None 2023-12-15T23:22:20.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003481b3870c5cb32d-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.673 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.674 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.674 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.674 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.674 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.674 DEBUG:boto:Method: GET 2023-12-15T23:22:20.674 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:22:20.674 DEBUG:boto:Data: 2023-12-15T23:22:20.674 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.674 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.674 DEBUG:boto:Params: {} 2023-12-15T23:22:20.674 DEBUG:boto:Token: None 2023-12-15T23:22:20.675 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005061809ea101a25c-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.678 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:22:20.679 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.679 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.679 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.679 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.679 DEBUG:boto:Method: GET 2023-12-15T23:22:20.679 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.679 DEBUG:boto:Data: 2023-12-15T23:22:20.679 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.679 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.680 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.680 DEBUG:boto:Params: {} 2023-12-15T23:22:20.680 DEBUG:boto:Token: None 2023-12-15T23:22:20.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4= 2023-12-15T23:22:20.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4=', 'Content-Length': '0'} 2023-12-15T23:22:20.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ab3165d7c380537-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.682 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.682 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.682 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.682 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.683 DEBUG:boto:Method: GET 2023-12-15T23:22:20.683 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.683 DEBUG:boto:Data: 2023-12-15T23:22:20.683 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.683 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.683 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.683 DEBUG:boto:Params: {} 2023-12-15T23:22:20.683 DEBUG:boto:Token: None 2023-12-15T23:22:20.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4= 2023-12-15T23:22:20.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4=', 'Content-Length': '0'} 2023-12-15T23:22:20.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013d22627c445d58b-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.686 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.686 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.686 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.686 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.686 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.686 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.686 DEBUG:boto:Data: 2023-12-15T23:22:20.686 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.686 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.686 DEBUG:boto:Params: {} 2023-12-15T23:22:20.687 DEBUG:boto:Token: None 2023-12-15T23:22:20.687 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5buRzcoKJhiueXM+GWtRaRGRtQ= 2023-12-15T23:22:20.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5buRzcoKJhiueXM+GWtRaRGRtQ=', 'Content-Length': '0'} 2023-12-15T23:22:20.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee51dfe7c94237a7-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.689 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.689 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.689 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.689 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.689 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.689 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.689 DEBUG:boto:Data: 2023-12-15T23:22:20.689 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.690 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.690 DEBUG:boto:Params: {} 2023-12-15T23:22:20.690 DEBUG:boto:Token: None 2023-12-15T23:22:20.690 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U5buRzcoKJhiueXM+GWtRaRGRtQ= 2023-12-15T23:22:20.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U5buRzcoKJhiueXM+GWtRaRGRtQ=', 'Content-Length': '0'} 2023-12-15T23:22:20.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9ed741da1116484-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:22:20.692 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.692 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.692 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.692 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.693 DEBUG:boto:Method: GET 2023-12-15T23:22:20.693 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.693 DEBUG:boto:Data: 2023-12-15T23:22:20.693 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.693 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.693 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.693 DEBUG:boto:Params: {} 2023-12-15T23:22:20.693 DEBUG:boto:Token: None 2023-12-15T23:22:20.693 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.693 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4= 2023-12-15T23:22:20.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4=', 'Content-Length': '0'} 2023-12-15T23:22:20.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d69d5c288fcae51-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.737 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.738 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.738 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.738 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.738 DEBUG:boto:Method: GET 2023-12-15T23:22:20.738 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.738 DEBUG:boto:Data: 2023-12-15T23:22:20.738 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.738 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.738 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.738 DEBUG:boto:Params: {} 2023-12-15T23:22:20.738 DEBUG:boto:Token: None 2023-12-15T23:22:20.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:22:20.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4= 2023-12-15T23:22:20.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bAh//LJUfIgHzoYWaMiPGYrfjF4=', 'Content-Length': '0'} 2023-12-15T23:22:20.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000249f910f3d5b4432-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.741 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.741 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.741 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.741 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.741 DEBUG:boto:Method: GET 2023-12-15T23:22:20.741 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.742 DEBUG:boto:Data: 2023-12-15T23:22:20.742 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.742 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.742 DEBUG:boto:Params: {} 2023-12-15T23:22:20.742 DEBUG:boto:Token: None 2023-12-15T23:22:20.742 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8f224e11ee17cb4-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.745 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.745 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.745 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.745 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.745 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.746 DEBUG:boto:Method: GET 2023-12-15T23:22:20.746 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.746 DEBUG:boto:Data: 2023-12-15T23:22:20.746 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.746 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.746 DEBUG:boto:Params: {} 2023-12-15T23:22:20.746 DEBUG:boto:Token: None 2023-12-15T23:22:20.746 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049bed263f6d34f25-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.750 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.750 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.750 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.750 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.751 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:22:20.751 DEBUG:boto:Data: 2023-12-15T23:22:20.751 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.751 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.751 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.751 DEBUG:boto:Params: {} 2023-12-15T23:22:20.751 DEBUG:boto:Token: None 2023-12-15T23:22:20.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116 2023-12-15T23:22:20.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iDWdlFf4JOTie7lje1X31f0Uz5o= 2023-12-15T23:22:20.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iDWdlFf4JOTie7lje1X31f0Uz5o=', 'Content-Length': '0'} 2023-12-15T23:22:20.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baca758c18aface7-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.753 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.754 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.754 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.754 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:22:20.754 DEBUG:boto:Data: 2023-12-15T23:22:20.754 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.754 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.754 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.754 DEBUG:boto:Params: {} 2023-12-15T23:22:20.754 DEBUG:boto:Token: None 2023-12-15T23:22:20.754 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116 2023-12-15T23:22:20.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iDWdlFf4JOTie7lje1X31f0Uz5o= 2023-12-15T23:22:20.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iDWdlFf4JOTie7lje1X31f0Uz5o=', 'Content-Length': '0'} 2023-12-15T23:22:20.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c8efff8ee53ce83-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:22:20.757 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.757 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.757 DEBUG:boto:Method: GET 2023-12-15T23:22:20.757 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:22:20.757 DEBUG:boto:Data: 2023-12-15T23:22:20.757 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.757 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.757 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.758 DEBUG:boto:Params: {} 2023-12-15T23:22:20.758 DEBUG:boto:Token: None 2023-12-15T23:22:20.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116 2023-12-15T23:22:20.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v5UGgVTg8sDztWHqpXYOonOmut0= 2023-12-15T23:22:20.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v5UGgVTg8sDztWHqpXYOonOmut0=', 'Content-Length': '0'} 2023-12-15T23:22:20.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c045e9ad5ae0ec9-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.760 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:22:20.760 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:22:20.760 DEBUG:boto:Method: GET 2023-12-15T23:22:20.761 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:22:20.761 DEBUG:boto:Data: 2023-12-15T23:22:20.761 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.761 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.761 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.761 DEBUG:boto:Params: {} 2023-12-15T23:22:20.761 DEBUG:boto:Token: None 2023-12-15T23:22:20.761 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj116 2023-12-15T23:22:20.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v5UGgVTg8sDztWHqpXYOonOmut0= 2023-12-15T23:22:20.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v5UGgVTg8sDztWHqpXYOonOmut0=', 'Content-Length': '0'} 2023-12-15T23:22:20.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a8e1f3bc711ccc4-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.763 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.764 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.764 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.764 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.764 DEBUG:boto:Method: GET 2023-12-15T23:22:20.764 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.764 DEBUG:boto:Data: 2023-12-15T23:22:20.764 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.764 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.764 DEBUG:boto:Params: {} 2023-12-15T23:22:20.765 DEBUG:boto:Token: None 2023-12-15T23:22:20.765 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.765 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059e5a191fe0fcd02-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.768 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.768 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.768 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.768 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.768 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.768 DEBUG:boto:Method: GET 2023-12-15T23:22:20.768 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:22:20.768 DEBUG:boto:Data: 2023-12-15T23:22:20.769 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.769 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.769 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.769 DEBUG:boto:Params: {} 2023-12-15T23:22:20.769 DEBUG:boto:Token: None 2023-12-15T23:22:20.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5c6c09f000876ba-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.773 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:22:20.773 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.773 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.774 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.774 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.774 DEBUG:boto:Method: GET 2023-12-15T23:22:20.774 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.774 DEBUG:boto:Data: 2023-12-15T23:22:20.774 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.774 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.774 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.774 DEBUG:boto:Params: {} 2023-12-15T23:22:20.774 DEBUG:boto:Token: None 2023-12-15T23:22:20.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg= 2023-12-15T23:22:20.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg=', 'Content-Length': '0'} 2023-12-15T23:22:20.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009518c362c5268818-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.777 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.777 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.777 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.778 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.778 DEBUG:boto:Method: GET 2023-12-15T23:22:20.778 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.778 DEBUG:boto:Data: 2023-12-15T23:22:20.778 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.778 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.778 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.778 DEBUG:boto:Params: {} 2023-12-15T23:22:20.778 DEBUG:boto:Token: None 2023-12-15T23:22:20.778 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg= 2023-12-15T23:22:20.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg=', 'Content-Length': '0'} 2023-12-15T23:22:20.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c071799032052982-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.781 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.781 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.781 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.781 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.781 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.781 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.781 DEBUG:boto:Data: 2023-12-15T23:22:20.781 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.782 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.782 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.782 DEBUG:boto:Params: {} 2023-12-15T23:22:20.782 DEBUG:boto:Token: None 2023-12-15T23:22:20.782 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+S135/DoGBdbpGwciaDZ2/5qLv0= 2023-12-15T23:22:20.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+S135/DoGBdbpGwciaDZ2/5qLv0=', 'Content-Length': '0'} 2023-12-15T23:22:20.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f123d0e308527bf-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.784 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.784 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.784 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.785 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.785 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.785 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.785 DEBUG:boto:Data: 2023-12-15T23:22:20.785 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.785 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.785 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.785 DEBUG:boto:Params: {} 2023-12-15T23:22:20.785 DEBUG:boto:Token: None 2023-12-15T23:22:20.786 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+S135/DoGBdbpGwciaDZ2/5qLv0= 2023-12-15T23:22:20.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+S135/DoGBdbpGwciaDZ2/5qLv0=', 'Content-Length': '0'} 2023-12-15T23:22:20.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007faa609d96b292de-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:22:20.788 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.788 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.788 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.788 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.788 DEBUG:boto:Method: GET 2023-12-15T23:22:20.788 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.788 DEBUG:boto:Data: 2023-12-15T23:22:20.789 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.789 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.789 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.789 DEBUG:boto:Params: {} 2023-12-15T23:22:20.789 DEBUG:boto:Token: None 2023-12-15T23:22:20.789 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg= 2023-12-15T23:22:20.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg=', 'Content-Length': '0'} 2023-12-15T23:22:20.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5fbd86cda8fd2e6-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.791 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.791 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.792 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.792 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.792 DEBUG:boto:Method: GET 2023-12-15T23:22:20.792 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.792 DEBUG:boto:Data: 2023-12-15T23:22:20.792 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.792 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.792 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.792 DEBUG:boto:Params: {} 2023-12-15T23:22:20.792 DEBUG:boto:Token: None 2023-12-15T23:22:20.792 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:22:20.793 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg= 2023-12-15T23:22:20.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wjy3+oVcdhxNbtfaKP5SviHj5Fg=', 'Content-Length': '0'} 2023-12-15T23:22:20.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfa080d626562551-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.795 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.795 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.795 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.795 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.795 DEBUG:boto:Method: GET 2023-12-15T23:22:20.795 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.795 DEBUG:boto:Data: 2023-12-15T23:22:20.795 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.795 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.796 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.796 DEBUG:boto:Params: {} 2023-12-15T23:22:20.796 DEBUG:boto:Token: None 2023-12-15T23:22:20.796 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.796 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a680b670fe9347a4-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.799 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.799 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.799 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.799 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.799 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.799 DEBUG:boto:Method: GET 2023-12-15T23:22:20.800 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.800 DEBUG:boto:Data: 2023-12-15T23:22:20.800 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.800 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.800 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.800 DEBUG:boto:Params: {} 2023-12-15T23:22:20.800 DEBUG:boto:Token: None 2023-12-15T23:22:20.800 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.800 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.803 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008aff6cc3627fd521-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.804 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.804 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.804 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.804 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.804 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:22:20.804 DEBUG:boto:Data: 2023-12-15T23:22:20.804 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.804 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.805 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.805 DEBUG:boto:Params: {} 2023-12-15T23:22:20.805 DEBUG:boto:Token: None 2023-12-15T23:22:20.805 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145 2023-12-15T23:22:20.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z3Tj7ZwOiPxLEA82hCp9doWzJoU= 2023-12-15T23:22:20.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z3Tj7ZwOiPxLEA82hCp9doWzJoU=', 'Content-Length': '0'} 2023-12-15T23:22:20.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000798ca71d1c2e2bf3-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.807 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.807 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.807 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.807 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:22:20.807 DEBUG:boto:Data: 2023-12-15T23:22:20.807 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.808 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.808 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.808 DEBUG:boto:Params: {} 2023-12-15T23:22:20.808 DEBUG:boto:Token: None 2023-12-15T23:22:20.808 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145 2023-12-15T23:22:20.808 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z3Tj7ZwOiPxLEA82hCp9doWzJoU= 2023-12-15T23:22:20.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z3Tj7ZwOiPxLEA82hCp9doWzJoU=', 'Content-Length': '0'} 2023-12-15T23:22:20.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c022e1b1e3966760-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:22:20.810 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.810 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.810 DEBUG:boto:Method: GET 2023-12-15T23:22:20.810 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:22:20.811 DEBUG:boto:Data: 2023-12-15T23:22:20.811 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.811 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.811 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.811 DEBUG:boto:Params: {} 2023-12-15T23:22:20.811 DEBUG:boto:Token: None 2023-12-15T23:22:20.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145 2023-12-15T23:22:20.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iNiSPEX0jYD2pNIGakJLoxCRO0g= 2023-12-15T23:22:20.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iNiSPEX0jYD2pNIGakJLoxCRO0g=', 'Content-Length': '0'} 2023-12-15T23:22:20.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a73e888f57faf62-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.814 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:22:20.814 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:22:20.814 DEBUG:boto:Method: GET 2023-12-15T23:22:20.814 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:22:20.814 DEBUG:boto:Data: 2023-12-15T23:22:20.814 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.814 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.814 DEBUG:boto:Params: {} 2023-12-15T23:22:20.814 DEBUG:boto:Token: None 2023-12-15T23:22:20.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj145 2023-12-15T23:22:20.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iNiSPEX0jYD2pNIGakJLoxCRO0g= 2023-12-15T23:22:20.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iNiSPEX0jYD2pNIGakJLoxCRO0g=', 'Content-Length': '0'} 2023-12-15T23:22:20.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000885b990ac9ccf3f1-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.857 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.858 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.858 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.858 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.858 DEBUG:boto:Method: GET 2023-12-15T23:22:20.858 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.858 DEBUG:boto:Data: 2023-12-15T23:22:20.858 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.858 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.858 DEBUG:boto:Params: {} 2023-12-15T23:22:20.859 DEBUG:boto:Token: None 2023-12-15T23:22:20.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cafafef91d1befc-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.861 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.862 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.862 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.862 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.862 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.862 DEBUG:boto:Method: GET 2023-12-15T23:22:20.862 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:22:20.862 DEBUG:boto:Data: 2023-12-15T23:22:20.862 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.862 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.862 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.862 DEBUG:boto:Params: {} 2023-12-15T23:22:20.863 DEBUG:boto:Token: None 2023-12-15T23:22:20.863 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000419c096ecfef8f55-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.867 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:22:20.867 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.867 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.867 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.867 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.868 DEBUG:boto:Method: GET 2023-12-15T23:22:20.868 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.868 DEBUG:boto:Data: 2023-12-15T23:22:20.868 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.868 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.868 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.868 DEBUG:boto:Params: {} 2023-12-15T23:22:20.868 DEBUG:boto:Token: None 2023-12-15T23:22:20.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM= 2023-12-15T23:22:20.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM=', 'Content-Length': '0'} 2023-12-15T23:22:20.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6df2ed1917c8c6b-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.870 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.870 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.871 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.871 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.871 DEBUG:boto:Method: GET 2023-12-15T23:22:20.871 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.871 DEBUG:boto:Data: 2023-12-15T23:22:20.871 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.871 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.871 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.871 DEBUG:boto:Params: {} 2023-12-15T23:22:20.871 DEBUG:boto:Token: None 2023-12-15T23:22:20.872 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM= 2023-12-15T23:22:20.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM=', 'Content-Length': '0'} 2023-12-15T23:22:20.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bb3578d47a51577-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.874 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.874 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.874 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.874 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.874 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.874 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.874 DEBUG:boto:Data: 2023-12-15T23:22:20.875 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.875 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.875 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.875 DEBUG:boto:Params: {} 2023-12-15T23:22:20.875 DEBUG:boto:Token: None 2023-12-15T23:22:20.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cdg/895vrHLPErym5HLnstmpdMQ= 2023-12-15T23:22:20.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cdg/895vrHLPErym5HLnstmpdMQ=', 'Content-Length': '0'} 2023-12-15T23:22:20.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000392cc28b6e7e5cc4-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.877 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.877 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.877 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.877 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.877 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.878 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.878 DEBUG:boto:Data: 2023-12-15T23:22:20.878 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.878 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.878 DEBUG:boto:Params: {} 2023-12-15T23:22:20.878 DEBUG:boto:Token: None 2023-12-15T23:22:20.878 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cdg/895vrHLPErym5HLnstmpdMQ= 2023-12-15T23:22:20.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cdg/895vrHLPErym5HLnstmpdMQ=', 'Content-Length': '0'} 2023-12-15T23:22:20.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006238d2cef84e89d4-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:22:20.880 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.880 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.881 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.881 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.881 DEBUG:boto:Method: GET 2023-12-15T23:22:20.881 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.881 DEBUG:boto:Data: 2023-12-15T23:22:20.881 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.881 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.881 DEBUG:boto:Params: {} 2023-12-15T23:22:20.881 DEBUG:boto:Token: None 2023-12-15T23:22:20.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM= 2023-12-15T23:22:20.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM=', 'Content-Length': '0'} 2023-12-15T23:22:20.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000590d5cdb9463d42-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.925 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.925 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.926 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.926 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.926 DEBUG:boto:Method: GET 2023-12-15T23:22:20.926 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.926 DEBUG:boto:Data: 2023-12-15T23:22:20.926 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.926 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.926 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.926 DEBUG:boto:Params: {} 2023-12-15T23:22:20.926 DEBUG:boto:Token: None 2023-12-15T23:22:20.927 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:22:20.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM= 2023-12-15T23:22:20.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j/WYSMVcRj0NkXBLBRAf7njoclM=', 'Content-Length': '0'} 2023-12-15T23:22:20.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f55abb695a24f6cd-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.929 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.929 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.929 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.929 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.929 DEBUG:boto:Method: GET 2023-12-15T23:22:20.929 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.930 DEBUG:boto:Data: 2023-12-15T23:22:20.930 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.930 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.930 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.930 DEBUG:boto:Params: {} 2023-12-15T23:22:20.930 DEBUG:boto:Token: None 2023-12-15T23:22:20.930 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba61fdd28538e2b7-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.933 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.933 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.933 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.933 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.933 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.934 DEBUG:boto:Method: GET 2023-12-15T23:22:20.934 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.934 DEBUG:boto:Data: 2023-12-15T23:22:20.934 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.934 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.934 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.934 DEBUG:boto:Params: {} 2023-12-15T23:22:20.934 DEBUG:boto:Token: None 2023-12-15T23:22:20.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6621c852cf7fb7b-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.938 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.938 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.938 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.938 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.938 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:22:20.938 DEBUG:boto:Data: 2023-12-15T23:22:20.938 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.938 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.939 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.939 DEBUG:boto:Params: {} 2023-12-15T23:22:20.939 DEBUG:boto:Token: None 2023-12-15T23:22:20.939 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17 2023-12-15T23:22:20.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X6K3TqlxbOqIX9lcBZFgZ78zV+0= 2023-12-15T23:22:20.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X6K3TqlxbOqIX9lcBZFgZ78zV+0=', 'Content-Length': '0'} 2023-12-15T23:22:20.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045e6588093e0a4f0-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.941 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.941 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.941 DEBUG:boto:Method: HEAD 2023-12-15T23:22:20.941 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:22:20.941 DEBUG:boto:Data: 2023-12-15T23:22:20.941 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.941 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.942 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.942 DEBUG:boto:Params: {} 2023-12-15T23:22:20.942 DEBUG:boto:Token: None 2023-12-15T23:22:20.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17 2023-12-15T23:22:20.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X6K3TqlxbOqIX9lcBZFgZ78zV+0= 2023-12-15T23:22:20.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X6K3TqlxbOqIX9lcBZFgZ78zV+0=', 'Content-Length': '0'} 2023-12-15T23:22:20.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e2d4f9908d4ffe3-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.944 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:22:20.944 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.945 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.945 DEBUG:boto:Method: GET 2023-12-15T23:22:20.945 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:22:20.945 DEBUG:boto:Data: 2023-12-15T23:22:20.945 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.945 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.945 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.945 DEBUG:boto:Params: {} 2023-12-15T23:22:20.945 DEBUG:boto:Token: None 2023-12-15T23:22:20.945 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17 2023-12-15T23:22:20.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jdDyETP/kuKO0SawRuy5vO92Gt8= 2023-12-15T23:22:20.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jdDyETP/kuKO0SawRuy5vO92Gt8=', 'Content-Length': '0'} 2023-12-15T23:22:20.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012d6d74ae245f1a7-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.948 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:22:20.948 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:22:20.948 DEBUG:boto:Method: GET 2023-12-15T23:22:20.948 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:22:20.948 DEBUG:boto:Data: 2023-12-15T23:22:20.948 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.948 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.948 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.948 DEBUG:boto:Params: {} 2023-12-15T23:22:20.948 DEBUG:boto:Token: None 2023-12-15T23:22:20.949 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj17 2023-12-15T23:22:20.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jdDyETP/kuKO0SawRuy5vO92Gt8= 2023-12-15T23:22:20.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jdDyETP/kuKO0SawRuy5vO92Gt8=', 'Content-Length': '0'} 2023-12-15T23:22:20.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052561ceb5db239a0-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.951 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.951 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.951 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.951 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.951 DEBUG:boto:Method: GET 2023-12-15T23:22:20.951 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.951 DEBUG:boto:Data: 2023-12-15T23:22:20.951 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.952 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.952 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.952 DEBUG:boto:Params: {} 2023-12-15T23:22:20.952 DEBUG:boto:Token: None 2023-12-15T23:22:20.952 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.952 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c69a97a4846124c-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.955 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.955 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:20.955 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:20.955 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.955 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.955 DEBUG:boto:Method: GET 2023-12-15T23:22:20.956 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:22:20.956 DEBUG:boto:Data: 2023-12-15T23:22:20.956 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.956 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.956 DEBUG:boto:Params: {} 2023-12-15T23:22:20.956 DEBUG:boto:Token: None 2023-12-15T23:22:20.956 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/ 2023-12-15T23:22:20.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk= 2023-12-15T23:22:20.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:770hkVgomkCKT//+0or9d0NDWnk=', 'Content-Length': '0'} 2023-12-15T23:22:20.960 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a10e136ec205dbd4-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.960 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:20.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:22:20.961 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:20.961 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:20.961 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.961 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.961 DEBUG:boto:Method: GET 2023-12-15T23:22:20.961 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.961 DEBUG:boto:Data: 2023-12-15T23:22:20.961 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:20.962 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.962 DEBUG:boto:Params: {} 2023-12-15T23:22:20.962 DEBUG:boto:Token: None 2023-12-15T23:22:20.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X/Hk8xd1a9kSBwhU+zIOD/QcFZo= 2023-12-15T23:22:20.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X/Hk8xd1a9kSBwhU+zIOD/QcFZo=', 'Content-Length': '0'} 2023-12-15T23:22:20.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5a2a14d1990c4f0-00657cdfac-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:20.965 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:20.965 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:20.965 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.965 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.965 DEBUG:boto:Method: GET 2023-12-15T23:22:20.965 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.965 DEBUG:boto:Data: 2023-12-15T23:22:20.966 DEBUG:boto:Headers: {} 2023-12-15T23:22:20.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:20.966 DEBUG:boto:Port: 8000 2023-12-15T23:22:20.966 DEBUG:boto:Params: {} 2023-12-15T23:22:20.966 DEBUG:boto:Token: None 2023-12-15T23:22:20.966 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:20 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:20.966 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X/Hk8xd1a9kSBwhU+zIOD/QcFZo= 2023-12-15T23:22:20.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X/Hk8xd1a9kSBwhU+zIOD/QcFZo=', 'Content-Length': '0'} 2023-12-15T23:22:20.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb3574a5d8286d62-00657cdfac-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.010 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.010 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.010 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.010 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.010 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.010 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.010 DEBUG:boto:Data: 2023-12-15T23:22:21.010 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.010 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.010 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.010 DEBUG:boto:Params: {} 2023-12-15T23:22:21.011 DEBUG:boto:Token: None 2023-12-15T23:22:21.011 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YBStOLTfs8I/FkZ2iSHOxPhfFaM= 2023-12-15T23:22:21.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YBStOLTfs8I/FkZ2iSHOxPhfFaM=', 'Content-Length': '0'} 2023-12-15T23:22:21.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3c8a8ab0653fe36-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.013 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.013 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.013 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.013 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.013 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.013 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.014 DEBUG:boto:Data: 2023-12-15T23:22:21.014 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.014 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.014 DEBUG:boto:Params: {} 2023-12-15T23:22:21.014 DEBUG:boto:Token: None 2023-12-15T23:22:21.014 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YBStOLTfs8I/FkZ2iSHOxPhfFaM= 2023-12-15T23:22:21.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YBStOLTfs8I/FkZ2iSHOxPhfFaM=', 'Content-Length': '0'} 2023-12-15T23:22:21.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000113fe0592c44b811-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:22:21.016 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.017 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.017 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.017 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.017 DEBUG:boto:Method: GET 2023-12-15T23:22:21.017 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.017 DEBUG:boto:Data: 2023-12-15T23:22:21.017 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.017 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.017 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.017 DEBUG:boto:Params: {} 2023-12-15T23:22:21.018 DEBUG:boto:Token: None 2023-12-15T23:22:21.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.018 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ie9AmEfShLKpmxJBSUlINy10TmE= 2023-12-15T23:22:21.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ie9AmEfShLKpmxJBSUlINy10TmE=', 'Content-Length': '0'} 2023-12-15T23:22:21.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078870f5d73e90d66-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.021 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.021 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.021 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.021 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.021 DEBUG:boto:Method: GET 2023-12-15T23:22:21.021 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.021 DEBUG:boto:Data: 2023-12-15T23:22:21.021 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.021 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.021 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.022 DEBUG:boto:Params: {} 2023-12-15T23:22:21.022 DEBUG:boto:Token: None 2023-12-15T23:22:21.022 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:22:21.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ie9AmEfShLKpmxJBSUlINy10TmE= 2023-12-15T23:22:21.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ie9AmEfShLKpmxJBSUlINy10TmE=', 'Content-Length': '0'} 2023-12-15T23:22:21.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f53e6e6bd6abe9f-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.024 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.025 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.025 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.025 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.025 DEBUG:boto:Method: GET 2023-12-15T23:22:21.025 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.025 DEBUG:boto:Data: 2023-12-15T23:22:21.025 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.025 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.025 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.025 DEBUG:boto:Params: {} 2023-12-15T23:22:21.026 DEBUG:boto:Token: None 2023-12-15T23:22:21.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.028 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f111f501df94e3a-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.028 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.028 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.029 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.029 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.029 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.029 DEBUG:boto:Method: GET 2023-12-15T23:22:21.029 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.029 DEBUG:boto:Data: 2023-12-15T23:22:21.029 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.029 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.029 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.029 DEBUG:boto:Params: {} 2023-12-15T23:22:21.030 DEBUG:boto:Token: None 2023-12-15T23:22:21.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.030 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f734edc68afd1e95-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.033 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.034 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.034 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.034 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.034 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:22:21.034 DEBUG:boto:Data: 2023-12-15T23:22:21.034 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.034 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.034 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.034 DEBUG:boto:Params: {} 2023-12-15T23:22:21.034 DEBUG:boto:Token: None 2023-12-15T23:22:21.035 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19 2023-12-15T23:22:21.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VPiR5CewHCOjQ7wr2ZzL8NuX7a8= 2023-12-15T23:22:21.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VPiR5CewHCOjQ7wr2ZzL8NuX7a8=', 'Content-Length': '0'} 2023-12-15T23:22:21.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006039bc56dc125f72-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.037 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.037 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.037 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.037 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:22:21.037 DEBUG:boto:Data: 2023-12-15T23:22:21.037 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.038 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.038 DEBUG:boto:Params: {} 2023-12-15T23:22:21.038 DEBUG:boto:Token: None 2023-12-15T23:22:21.038 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19 2023-12-15T23:22:21.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VPiR5CewHCOjQ7wr2ZzL8NuX7a8= 2023-12-15T23:22:21.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VPiR5CewHCOjQ7wr2ZzL8NuX7a8=', 'Content-Length': '0'} 2023-12-15T23:22:21.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047c966984fb8c02a-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:22:21.040 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.041 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.041 DEBUG:boto:Method: GET 2023-12-15T23:22:21.041 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:22:21.041 DEBUG:boto:Data: 2023-12-15T23:22:21.041 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.041 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.041 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.041 DEBUG:boto:Params: {} 2023-12-15T23:22:21.041 DEBUG:boto:Token: None 2023-12-15T23:22:21.042 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19 2023-12-15T23:22:21.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JsC+Js+GPv2MhhNou7eT+X7Bhj0= 2023-12-15T23:22:21.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JsC+Js+GPv2MhhNou7eT+X7Bhj0=', 'Content-Length': '0'} 2023-12-15T23:22:21.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081dcce3a875ddd28-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.044 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:22:21.044 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:22:21.044 DEBUG:boto:Method: GET 2023-12-15T23:22:21.044 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:22:21.044 DEBUG:boto:Data: 2023-12-15T23:22:21.044 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.044 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.044 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.044 DEBUG:boto:Params: {} 2023-12-15T23:22:21.045 DEBUG:boto:Token: None 2023-12-15T23:22:21.045 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj19 2023-12-15T23:22:21.045 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JsC+Js+GPv2MhhNou7eT+X7Bhj0= 2023-12-15T23:22:21.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JsC+Js+GPv2MhhNou7eT+X7Bhj0=', 'Content-Length': '0'} 2023-12-15T23:22:21.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a819a62f3776d033-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.047 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.047 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.047 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.047 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.047 DEBUG:boto:Method: GET 2023-12-15T23:22:21.047 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.047 DEBUG:boto:Data: 2023-12-15T23:22:21.048 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.048 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.048 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.048 DEBUG:boto:Params: {} 2023-12-15T23:22:21.048 DEBUG:boto:Token: None 2023-12-15T23:22:21.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000524a96a0f4a5488b-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.051 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.051 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.051 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.051 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.051 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.051 DEBUG:boto:Method: GET 2023-12-15T23:22:21.051 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:22:21.051 DEBUG:boto:Data: 2023-12-15T23:22:21.052 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.052 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.052 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.052 DEBUG:boto:Params: {} 2023-12-15T23:22:21.052 DEBUG:boto:Token: None 2023-12-15T23:22:21.052 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000612f0d4eab6ab01e-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.055 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:22:21.056 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.056 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.056 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.056 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.056 DEBUG:boto:Method: GET 2023-12-15T23:22:21.056 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.056 DEBUG:boto:Data: 2023-12-15T23:22:21.057 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.057 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.057 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.057 DEBUG:boto:Params: {} 2023-12-15T23:22:21.057 DEBUG:boto:Token: None 2023-12-15T23:22:21.057 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.057 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M= 2023-12-15T23:22:21.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M=', 'Content-Length': '0'} 2023-12-15T23:22:21.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d99b965d84eebf39-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.105 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.106 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.106 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.106 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.106 DEBUG:boto:Method: GET 2023-12-15T23:22:21.106 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.106 DEBUG:boto:Data: 2023-12-15T23:22:21.106 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.106 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.106 DEBUG:boto:Params: {} 2023-12-15T23:22:21.107 DEBUG:boto:Token: None 2023-12-15T23:22:21.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M= 2023-12-15T23:22:21.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M=', 'Content-Length': '0'} 2023-12-15T23:22:21.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004363774260c88acb-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.109 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.109 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.109 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.109 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.109 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.109 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.109 DEBUG:boto:Data: 2023-12-15T23:22:21.110 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.110 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.110 DEBUG:boto:Params: {} 2023-12-15T23:22:21.110 DEBUG:boto:Token: None 2023-12-15T23:22:21.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5qwowqrhWUCbQkUZXtmpzGN98rQ= 2023-12-15T23:22:21.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5qwowqrhWUCbQkUZXtmpzGN98rQ=', 'Content-Length': '0'} 2023-12-15T23:22:21.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b94711486c65e3b1-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.113 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.113 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.113 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.113 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.113 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.113 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.113 DEBUG:boto:Data: 2023-12-15T23:22:21.113 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.114 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.114 DEBUG:boto:Params: {} 2023-12-15T23:22:21.114 DEBUG:boto:Token: None 2023-12-15T23:22:21.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5qwowqrhWUCbQkUZXtmpzGN98rQ= 2023-12-15T23:22:21.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5qwowqrhWUCbQkUZXtmpzGN98rQ=', 'Content-Length': '0'} 2023-12-15T23:22:21.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d80450d726a112dc-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:22:21.116 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.116 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.116 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.117 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.117 DEBUG:boto:Method: GET 2023-12-15T23:22:21.117 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.117 DEBUG:boto:Data: 2023-12-15T23:22:21.117 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.117 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.117 DEBUG:boto:Params: {} 2023-12-15T23:22:21.117 DEBUG:boto:Token: None 2023-12-15T23:22:21.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M= 2023-12-15T23:22:21.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M=', 'Content-Length': '0'} 2023-12-15T23:22:21.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004305289703444bfd-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.120 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.120 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.120 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.120 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.120 DEBUG:boto:Method: GET 2023-12-15T23:22:21.120 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.120 DEBUG:boto:Data: 2023-12-15T23:22:21.120 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.120 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.120 DEBUG:boto:Params: {} 2023-12-15T23:22:21.120 DEBUG:boto:Token: None 2023-12-15T23:22:21.121 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:22:21.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M= 2023-12-15T23:22:21.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:h1W6G7mtK8kVrj7GsyQ5TdO89+M=', 'Content-Length': '0'} 2023-12-15T23:22:21.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088dd462dcae1e994-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.123 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.123 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.123 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.123 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.124 DEBUG:boto:Method: GET 2023-12-15T23:22:21.124 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.124 DEBUG:boto:Data: 2023-12-15T23:22:21.124 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.124 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.124 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.124 DEBUG:boto:Params: {} 2023-12-15T23:22:21.124 DEBUG:boto:Token: None 2023-12-15T23:22:21.124 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.127 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c116900edc40663c-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.127 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.127 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.127 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.127 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.127 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.127 DEBUG:boto:Method: GET 2023-12-15T23:22:21.127 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.128 DEBUG:boto:Data: 2023-12-15T23:22:21.128 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.128 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.128 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.128 DEBUG:boto:Params: {} 2023-12-15T23:22:21.128 DEBUG:boto:Token: None 2023-12-15T23:22:21.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f24218425988d55a-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.132 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.132 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.132 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.132 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.133 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:22:21.133 DEBUG:boto:Data: 2023-12-15T23:22:21.133 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.133 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.133 DEBUG:boto:Params: {} 2023-12-15T23:22:21.133 DEBUG:boto:Token: None 2023-12-15T23:22:21.133 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22 2023-12-15T23:22:21.133 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:81fxWwqD8ScSrA3sgQ/AmfOb5dI= 2023-12-15T23:22:21.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:81fxWwqD8ScSrA3sgQ/AmfOb5dI=', 'Content-Length': '0'} 2023-12-15T23:22:21.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae2a62a508bdb288-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.135 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.135 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.135 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.135 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:22:21.135 DEBUG:boto:Data: 2023-12-15T23:22:21.136 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.136 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.136 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.136 DEBUG:boto:Params: {} 2023-12-15T23:22:21.136 DEBUG:boto:Token: None 2023-12-15T23:22:21.136 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22 2023-12-15T23:22:21.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:81fxWwqD8ScSrA3sgQ/AmfOb5dI= 2023-12-15T23:22:21.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:81fxWwqD8ScSrA3sgQ/AmfOb5dI=', 'Content-Length': '0'} 2023-12-15T23:22:21.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e5de93d35820034-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.138 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:22:21.138 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.138 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.139 DEBUG:boto:Method: GET 2023-12-15T23:22:21.139 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:22:21.139 DEBUG:boto:Data: 2023-12-15T23:22:21.139 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.139 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.139 DEBUG:boto:Params: {} 2023-12-15T23:22:21.139 DEBUG:boto:Token: None 2023-12-15T23:22:21.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22 2023-12-15T23:22:21.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPsZTUsSRbRlFE98NQ2HIKjvOtg= 2023-12-15T23:22:21.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPsZTUsSRbRlFE98NQ2HIKjvOtg=', 'Content-Length': '0'} 2023-12-15T23:22:21.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2a3745f47d04d20-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.141 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:22:21.142 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:22:21.142 DEBUG:boto:Method: GET 2023-12-15T23:22:21.142 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:22:21.142 DEBUG:boto:Data: 2023-12-15T23:22:21.142 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.142 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.142 DEBUG:boto:Params: {} 2023-12-15T23:22:21.142 DEBUG:boto:Token: None 2023-12-15T23:22:21.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj22 2023-12-15T23:22:21.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pPsZTUsSRbRlFE98NQ2HIKjvOtg= 2023-12-15T23:22:21.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pPsZTUsSRbRlFE98NQ2HIKjvOtg=', 'Content-Length': '0'} 2023-12-15T23:22:21.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000275a6604a2567676-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.185 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.186 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.186 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.186 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.186 DEBUG:boto:Method: GET 2023-12-15T23:22:21.186 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.186 DEBUG:boto:Data: 2023-12-15T23:22:21.186 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.187 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.187 DEBUG:boto:Params: {} 2023-12-15T23:22:21.187 DEBUG:boto:Token: None 2023-12-15T23:22:21.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.190 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088db7f6f61ab3ca7-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.190 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.190 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.190 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.190 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.191 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.191 DEBUG:boto:Method: GET 2023-12-15T23:22:21.191 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:22:21.191 DEBUG:boto:Data: 2023-12-15T23:22:21.191 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.191 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.191 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.191 DEBUG:boto:Params: {} 2023-12-15T23:22:21.191 DEBUG:boto:Token: None 2023-12-15T23:22:21.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.192 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.195 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ecae8997baf932b-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.195 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:22:21.195 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.195 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.195 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.196 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.196 DEBUG:boto:Method: GET 2023-12-15T23:22:21.196 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.196 DEBUG:boto:Data: 2023-12-15T23:22:21.196 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.196 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.196 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.196 DEBUG:boto:Params: {} 2023-12-15T23:22:21.196 DEBUG:boto:Token: None 2023-12-15T23:22:21.196 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.196 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk= 2023-12-15T23:22:21.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk=', 'Content-Length': '0'} 2023-12-15T23:22:21.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f21f5fea0b2a4221-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.241 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.242 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.242 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.242 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.242 DEBUG:boto:Method: GET 2023-12-15T23:22:21.242 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.242 DEBUG:boto:Data: 2023-12-15T23:22:21.242 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.242 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.242 DEBUG:boto:Params: {} 2023-12-15T23:22:21.242 DEBUG:boto:Token: None 2023-12-15T23:22:21.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.243 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk= 2023-12-15T23:22:21.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk=', 'Content-Length': '0'} 2023-12-15T23:22:21.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f8dcf86d030c619-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.245 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.245 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.245 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.245 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.245 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.245 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.245 DEBUG:boto:Data: 2023-12-15T23:22:21.246 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.246 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.246 DEBUG:boto:Params: {} 2023-12-15T23:22:21.246 DEBUG:boto:Token: None 2023-12-15T23:22:21.246 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.246 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37://GLjr3ei4Nlyto3c07RfcUMWtA= 2023-12-15T23:22:21.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37://GLjr3ei4Nlyto3c07RfcUMWtA=', 'Content-Length': '0'} 2023-12-15T23:22:21.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baa243c47b97f0ed-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.248 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.248 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.248 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.248 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.248 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.248 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.249 DEBUG:boto:Data: 2023-12-15T23:22:21.249 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.249 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.249 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.249 DEBUG:boto:Params: {} 2023-12-15T23:22:21.249 DEBUG:boto:Token: None 2023-12-15T23:22:21.249 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.249 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37://GLjr3ei4Nlyto3c07RfcUMWtA= 2023-12-15T23:22:21.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37://GLjr3ei4Nlyto3c07RfcUMWtA=', 'Content-Length': '0'} 2023-12-15T23:22:21.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5d747f13a0f2e9d-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:22:21.252 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.252 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.252 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.252 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.252 DEBUG:boto:Method: GET 2023-12-15T23:22:21.252 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.252 DEBUG:boto:Data: 2023-12-15T23:22:21.252 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.252 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.252 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.252 DEBUG:boto:Params: {} 2023-12-15T23:22:21.253 DEBUG:boto:Token: None 2023-12-15T23:22:21.253 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.253 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk= 2023-12-15T23:22:21.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk=', 'Content-Length': '0'} 2023-12-15T23:22:21.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fc42dae921623d2-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.255 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.255 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.255 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.255 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.255 DEBUG:boto:Method: GET 2023-12-15T23:22:21.255 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.255 DEBUG:boto:Data: 2023-12-15T23:22:21.255 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.256 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.256 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.256 DEBUG:boto:Params: {} 2023-12-15T23:22:21.256 DEBUG:boto:Token: None 2023-12-15T23:22:21.256 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:22:21.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk= 2023-12-15T23:22:21.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8Frcnw7ZLHNYLyso2b5ywMXZMk=', 'Content-Length': '0'} 2023-12-15T23:22:21.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f3c370f77958cba-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.258 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.258 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.258 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.259 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.259 DEBUG:boto:Method: GET 2023-12-15T23:22:21.259 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.259 DEBUG:boto:Data: 2023-12-15T23:22:21.259 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.259 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.259 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.259 DEBUG:boto:Params: {} 2023-12-15T23:22:21.259 DEBUG:boto:Token: None 2023-12-15T23:22:21.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006444a6fb9d4ca64a-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.262 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.262 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.262 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.262 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.262 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.262 DEBUG:boto:Method: GET 2023-12-15T23:22:21.262 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.263 DEBUG:boto:Data: 2023-12-15T23:22:21.263 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.263 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.263 DEBUG:boto:Params: {} 2023-12-15T23:22:21.263 DEBUG:boto:Token: None 2023-12-15T23:22:21.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.267 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006f42bfbf516f3a0-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.267 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.267 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.267 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.267 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.267 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:22:21.267 DEBUG:boto:Data: 2023-12-15T23:22:21.268 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.268 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.268 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.268 DEBUG:boto:Params: {} 2023-12-15T23:22:21.268 DEBUG:boto:Token: None 2023-12-15T23:22:21.268 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23 2023-12-15T23:22:21.268 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2Nph6wFUz/cMYhWbS14dKvLKVyY= 2023-12-15T23:22:21.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2Nph6wFUz/cMYhWbS14dKvLKVyY=', 'Content-Length': '0'} 2023-12-15T23:22:21.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008a56b2aa5a8044d-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.270 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.270 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.270 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.270 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:22:21.270 DEBUG:boto:Data: 2023-12-15T23:22:21.270 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.271 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.271 DEBUG:boto:Params: {} 2023-12-15T23:22:21.271 DEBUG:boto:Token: None 2023-12-15T23:22:21.271 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23 2023-12-15T23:22:21.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2Nph6wFUz/cMYhWbS14dKvLKVyY= 2023-12-15T23:22:21.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2Nph6wFUz/cMYhWbS14dKvLKVyY=', 'Content-Length': '0'} 2023-12-15T23:22:21.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccda09a349f894ba-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:22:21.273 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.273 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.273 DEBUG:boto:Method: GET 2023-12-15T23:22:21.273 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:22:21.273 DEBUG:boto:Data: 2023-12-15T23:22:21.274 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.274 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.274 DEBUG:boto:Params: {} 2023-12-15T23:22:21.274 DEBUG:boto:Token: None 2023-12-15T23:22:21.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23 2023-12-15T23:22:21.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ydCac1wQAOhCe3GRZYt8MwAvMpc= 2023-12-15T23:22:21.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ydCac1wQAOhCe3GRZYt8MwAvMpc=', 'Content-Length': '0'} 2023-12-15T23:22:21.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017491cb2a4d23e47-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.321 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:22:21.322 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:22:21.322 DEBUG:boto:Method: GET 2023-12-15T23:22:21.322 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:22:21.322 DEBUG:boto:Data: 2023-12-15T23:22:21.322 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.322 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.322 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.322 DEBUG:boto:Params: {} 2023-12-15T23:22:21.322 DEBUG:boto:Token: None 2023-12-15T23:22:21.322 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj23 2023-12-15T23:22:21.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ydCac1wQAOhCe3GRZYt8MwAvMpc= 2023-12-15T23:22:21.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ydCac1wQAOhCe3GRZYt8MwAvMpc=', 'Content-Length': '0'} 2023-12-15T23:22:21.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c254400549206843-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.325 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.325 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.325 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.325 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.325 DEBUG:boto:Method: GET 2023-12-15T23:22:21.325 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.325 DEBUG:boto:Data: 2023-12-15T23:22:21.325 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.325 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.325 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.325 DEBUG:boto:Params: {} 2023-12-15T23:22:21.326 DEBUG:boto:Token: None 2023-12-15T23:22:21.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b4be6f71b227c3a-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.329 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.329 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.329 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.329 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.329 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.330 DEBUG:boto:Method: GET 2023-12-15T23:22:21.330 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:22:21.330 DEBUG:boto:Data: 2023-12-15T23:22:21.330 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.330 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.330 DEBUG:boto:Params: {} 2023-12-15T23:22:21.330 DEBUG:boto:Token: None 2023-12-15T23:22:21.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d3e7c27ed98bb35-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.334 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:22:21.334 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.334 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.334 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.334 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.335 DEBUG:boto:Method: GET 2023-12-15T23:22:21.335 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.335 DEBUG:boto:Data: 2023-12-15T23:22:21.335 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.335 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.335 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.335 DEBUG:boto:Params: {} 2023-12-15T23:22:21.335 DEBUG:boto:Token: None 2023-12-15T23:22:21.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA= 2023-12-15T23:22:21.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA=', 'Content-Length': '0'} 2023-12-15T23:22:21.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c301fa8461cbec5-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.338 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.338 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.338 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.338 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.338 DEBUG:boto:Method: GET 2023-12-15T23:22:21.338 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.339 DEBUG:boto:Data: 2023-12-15T23:22:21.339 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.339 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.339 DEBUG:boto:Params: {} 2023-12-15T23:22:21.339 DEBUG:boto:Token: None 2023-12-15T23:22:21.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA= 2023-12-15T23:22:21.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA=', 'Content-Length': '0'} 2023-12-15T23:22:21.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e341c7775a1948a3-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.342 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.342 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.342 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.342 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.342 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.342 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.342 DEBUG:boto:Data: 2023-12-15T23:22:21.342 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.342 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.342 DEBUG:boto:Params: {} 2023-12-15T23:22:21.343 DEBUG:boto:Token: None 2023-12-15T23:22:21.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pdUNf28HH3zSzFfvzIm8QKifmME= 2023-12-15T23:22:21.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pdUNf28HH3zSzFfvzIm8QKifmME=', 'Content-Length': '0'} 2023-12-15T23:22:21.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000951088a68cb71812-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.345 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.345 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.346 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.346 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.346 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.346 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.346 DEBUG:boto:Data: 2023-12-15T23:22:21.346 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.346 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.346 DEBUG:boto:Params: {} 2023-12-15T23:22:21.346 DEBUG:boto:Token: None 2023-12-15T23:22:21.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pdUNf28HH3zSzFfvzIm8QKifmME= 2023-12-15T23:22:21.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pdUNf28HH3zSzFfvzIm8QKifmME=', 'Content-Length': '0'} 2023-12-15T23:22:21.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d5385b897ae122-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:22:21.349 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.349 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.349 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.349 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.349 DEBUG:boto:Method: GET 2023-12-15T23:22:21.349 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.349 DEBUG:boto:Data: 2023-12-15T23:22:21.349 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.350 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.350 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.350 DEBUG:boto:Params: {} 2023-12-15T23:22:21.350 DEBUG:boto:Token: None 2023-12-15T23:22:21.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA= 2023-12-15T23:22:21.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA=', 'Content-Length': '0'} 2023-12-15T23:22:21.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000150698bc7410f334-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.352 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.352 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.353 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.353 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.353 DEBUG:boto:Method: GET 2023-12-15T23:22:21.353 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.353 DEBUG:boto:Data: 2023-12-15T23:22:21.353 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.353 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.353 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.353 DEBUG:boto:Params: {} 2023-12-15T23:22:21.353 DEBUG:boto:Token: None 2023-12-15T23:22:21.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:22:21.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA= 2023-12-15T23:22:21.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lzRTNsN/SHBk8fd5ZTKwbMVsdxA=', 'Content-Length': '0'} 2023-12-15T23:22:21.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c32f61bfaaba988d-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.356 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.356 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.356 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.356 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.356 DEBUG:boto:Method: GET 2023-12-15T23:22:21.357 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.357 DEBUG:boto:Data: 2023-12-15T23:22:21.357 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.357 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.357 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.357 DEBUG:boto:Params: {} 2023-12-15T23:22:21.357 DEBUG:boto:Token: None 2023-12-15T23:22:21.357 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d541f135e381c6d8-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.360 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.360 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.360 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.360 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.360 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.360 DEBUG:boto:Method: GET 2023-12-15T23:22:21.361 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.361 DEBUG:boto:Data: 2023-12-15T23:22:21.361 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.361 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.361 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.361 DEBUG:boto:Params: {} 2023-12-15T23:22:21.361 DEBUG:boto:Token: None 2023-12-15T23:22:21.361 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.361 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1b925eb1deefa6a-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.364 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.365 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.365 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.365 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.365 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:22:21.365 DEBUG:boto:Data: 2023-12-15T23:22:21.365 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.365 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.365 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.365 DEBUG:boto:Params: {} 2023-12-15T23:22:21.366 DEBUG:boto:Token: None 2023-12-15T23:22:21.366 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29 2023-12-15T23:22:21.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7m6VZ8k/G4zYkL0/8jiPzzMuBZk= 2023-12-15T23:22:21.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7m6VZ8k/G4zYkL0/8jiPzzMuBZk=', 'Content-Length': '0'} 2023-12-15T23:22:21.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063fe91fd2c4c58f1-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.368 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.368 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.368 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.368 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:22:21.368 DEBUG:boto:Data: 2023-12-15T23:22:21.368 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.368 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.368 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.368 DEBUG:boto:Params: {} 2023-12-15T23:22:21.369 DEBUG:boto:Token: None 2023-12-15T23:22:21.369 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29 2023-12-15T23:22:21.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7m6VZ8k/G4zYkL0/8jiPzzMuBZk= 2023-12-15T23:22:21.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7m6VZ8k/G4zYkL0/8jiPzzMuBZk=', 'Content-Length': '0'} 2023-12-15T23:22:21.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001499d424ac0656d4-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:22:21.372 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.373 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.373 DEBUG:boto:Method: GET 2023-12-15T23:22:21.373 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:22:21.373 DEBUG:boto:Data: 2023-12-15T23:22:21.373 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.373 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.373 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.373 DEBUG:boto:Params: {} 2023-12-15T23:22:21.373 DEBUG:boto:Token: None 2023-12-15T23:22:21.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29 2023-12-15T23:22:21.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jk4S3+Z1H/d8NoiI/8KBCVb96lo= 2023-12-15T23:22:21.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jk4S3+Z1H/d8NoiI/8KBCVb96lo=', 'Content-Length': '0'} 2023-12-15T23:22:21.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061f354b6d4b18cf7-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.418 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:22:21.418 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:22:21.418 DEBUG:boto:Method: GET 2023-12-15T23:22:21.418 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:22:21.418 DEBUG:boto:Data: 2023-12-15T23:22:21.418 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.418 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.418 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.418 DEBUG:boto:Params: {} 2023-12-15T23:22:21.418 DEBUG:boto:Token: None 2023-12-15T23:22:21.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj29 2023-12-15T23:22:21.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jk4S3+Z1H/d8NoiI/8KBCVb96lo= 2023-12-15T23:22:21.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jk4S3+Z1H/d8NoiI/8KBCVb96lo=', 'Content-Length': '0'} 2023-12-15T23:22:21.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000529f0d7445dddc85-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.421 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.421 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.421 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.421 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.422 DEBUG:boto:Method: GET 2023-12-15T23:22:21.422 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.422 DEBUG:boto:Data: 2023-12-15T23:22:21.422 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.422 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.422 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.422 DEBUG:boto:Params: {} 2023-12-15T23:22:21.422 DEBUG:boto:Token: None 2023-12-15T23:22:21.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4ac8cc3a5ec153c-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.466 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.466 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.466 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.466 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.466 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.467 DEBUG:boto:Method: GET 2023-12-15T23:22:21.467 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:22:21.467 DEBUG:boto:Data: 2023-12-15T23:22:21.467 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.467 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.467 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.467 DEBUG:boto:Params: {} 2023-12-15T23:22:21.467 DEBUG:boto:Token: None 2023-12-15T23:22:21.468 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.468 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.471 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072a61dd22548d28b-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.471 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:22:21.472 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.472 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.472 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.472 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.472 DEBUG:boto:Method: GET 2023-12-15T23:22:21.472 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.472 DEBUG:boto:Data: 2023-12-15T23:22:21.472 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.472 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.472 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.473 DEBUG:boto:Params: {} 2023-12-15T23:22:21.473 DEBUG:boto:Token: None 2023-12-15T23:22:21.473 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.473 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8= 2023-12-15T23:22:21.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8=', 'Content-Length': '0'} 2023-12-15T23:22:21.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f9e8b18050389bb-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.476 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.476 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.476 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.476 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.476 DEBUG:boto:Method: GET 2023-12-15T23:22:21.476 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.477 DEBUG:boto:Data: 2023-12-15T23:22:21.477 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.477 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.477 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.477 DEBUG:boto:Params: {} 2023-12-15T23:22:21.477 DEBUG:boto:Token: None 2023-12-15T23:22:21.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8= 2023-12-15T23:22:21.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8=', 'Content-Length': '0'} 2023-12-15T23:22:21.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6a306f057b02d9c-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.525 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.526 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.526 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.526 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.526 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.526 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.526 DEBUG:boto:Data: 2023-12-15T23:22:21.526 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.526 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.527 DEBUG:boto:Params: {} 2023-12-15T23:22:21.527 DEBUG:boto:Token: None 2023-12-15T23:22:21.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XobaF3TAYxMzFf2HIMH++kC3n+Y= 2023-12-15T23:22:21.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XobaF3TAYxMzFf2HIMH++kC3n+Y=', 'Content-Length': '0'} 2023-12-15T23:22:21.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005218d1fdeea3083a-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.529 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.530 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.530 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.530 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.530 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.530 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.530 DEBUG:boto:Data: 2023-12-15T23:22:21.530 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.531 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.531 DEBUG:boto:Params: {} 2023-12-15T23:22:21.531 DEBUG:boto:Token: None 2023-12-15T23:22:21.531 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XobaF3TAYxMzFf2HIMH++kC3n+Y= 2023-12-15T23:22:21.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XobaF3TAYxMzFf2HIMH++kC3n+Y=', 'Content-Length': '0'} 2023-12-15T23:22:21.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048976f6ff9cdd76e-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:22:21.534 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.534 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.534 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.534 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.534 DEBUG:boto:Method: GET 2023-12-15T23:22:21.534 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.534 DEBUG:boto:Data: 2023-12-15T23:22:21.534 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.535 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.535 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.535 DEBUG:boto:Params: {} 2023-12-15T23:22:21.535 DEBUG:boto:Token: None 2023-12-15T23:22:21.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8= 2023-12-15T23:22:21.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8=', 'Content-Length': '0'} 2023-12-15T23:22:21.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034a067bbcb73e99f-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.581 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.582 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.582 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.582 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.582 DEBUG:boto:Method: GET 2023-12-15T23:22:21.582 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.582 DEBUG:boto:Data: 2023-12-15T23:22:21.582 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.582 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.582 DEBUG:boto:Params: {} 2023-12-15T23:22:21.583 DEBUG:boto:Token: None 2023-12-15T23:22:21.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:22:21.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8= 2023-12-15T23:22:21.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V0qhkR2Nfmbn76acAJfmD9wfaA8=', 'Content-Length': '0'} 2023-12-15T23:22:21.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000045aa344a3bf856a-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.585 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.586 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.586 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.586 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.586 DEBUG:boto:Method: GET 2023-12-15T23:22:21.586 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.586 DEBUG:boto:Data: 2023-12-15T23:22:21.586 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.586 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.586 DEBUG:boto:Params: {} 2023-12-15T23:22:21.587 DEBUG:boto:Token: None 2023-12-15T23:22:21.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012ad4c951448b6e0-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.589 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.590 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.590 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.590 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.590 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.590 DEBUG:boto:Method: GET 2023-12-15T23:22:21.590 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.590 DEBUG:boto:Data: 2023-12-15T23:22:21.591 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.591 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.591 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.591 DEBUG:boto:Params: {} 2023-12-15T23:22:21.591 DEBUG:boto:Token: None 2023-12-15T23:22:21.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.595 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000631227faedb66bc5-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.595 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.595 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.595 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.596 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.596 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:22:21.596 DEBUG:boto:Data: 2023-12-15T23:22:21.596 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.596 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.596 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.596 DEBUG:boto:Params: {} 2023-12-15T23:22:21.596 DEBUG:boto:Token: None 2023-12-15T23:22:21.596 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33 2023-12-15T23:22:21.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI+lIhaCBgmnxYGpSj7mgQw+N1o= 2023-12-15T23:22:21.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI+lIhaCBgmnxYGpSj7mgQw+N1o=', 'Content-Length': '0'} 2023-12-15T23:22:21.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082c7c8b30975ee6e-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.599 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.599 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.599 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.599 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:22:21.599 DEBUG:boto:Data: 2023-12-15T23:22:21.600 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.600 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.600 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.600 DEBUG:boto:Params: {} 2023-12-15T23:22:21.600 DEBUG:boto:Token: None 2023-12-15T23:22:21.600 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33 2023-12-15T23:22:21.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI+lIhaCBgmnxYGpSj7mgQw+N1o= 2023-12-15T23:22:21.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI+lIhaCBgmnxYGpSj7mgQw+N1o=', 'Content-Length': '0'} 2023-12-15T23:22:21.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c995acd25cb70b9c-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:22:21.603 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.603 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.603 DEBUG:boto:Method: GET 2023-12-15T23:22:21.603 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:22:21.603 DEBUG:boto:Data: 2023-12-15T23:22:21.603 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.603 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.604 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.604 DEBUG:boto:Params: {} 2023-12-15T23:22:21.604 DEBUG:boto:Token: None 2023-12-15T23:22:21.604 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33 2023-12-15T23:22:21.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FudE0evtvLnESklNzdB6ALflMEE= 2023-12-15T23:22:21.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FudE0evtvLnESklNzdB6ALflMEE=', 'Content-Length': '0'} 2023-12-15T23:22:21.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041f686ffb8590e9c-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.649 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:22:21.650 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:22:21.650 DEBUG:boto:Method: GET 2023-12-15T23:22:21.650 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:22:21.650 DEBUG:boto:Data: 2023-12-15T23:22:21.650 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.650 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.650 DEBUG:boto:Params: {} 2023-12-15T23:22:21.650 DEBUG:boto:Token: None 2023-12-15T23:22:21.650 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj33 2023-12-15T23:22:21.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FudE0evtvLnESklNzdB6ALflMEE= 2023-12-15T23:22:21.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FudE0evtvLnESklNzdB6ALflMEE=', 'Content-Length': '0'} 2023-12-15T23:22:21.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c94ba3a1e4a85d9-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.653 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.653 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.653 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.653 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.654 DEBUG:boto:Method: GET 2023-12-15T23:22:21.654 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.654 DEBUG:boto:Data: 2023-12-15T23:22:21.654 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.654 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.654 DEBUG:boto:Params: {} 2023-12-15T23:22:21.654 DEBUG:boto:Token: None 2023-12-15T23:22:21.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb6903780924c9d2-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.657 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.657 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.658 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.658 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.658 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.658 DEBUG:boto:Method: GET 2023-12-15T23:22:21.658 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:22:21.658 DEBUG:boto:Data: 2023-12-15T23:22:21.658 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.658 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.658 DEBUG:boto:Params: {} 2023-12-15T23:22:21.659 DEBUG:boto:Token: None 2023-12-15T23:22:21.659 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038b9a57c655948f8-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.663 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.663 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:22:21.663 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.663 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.663 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.663 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.664 DEBUG:boto:Method: GET 2023-12-15T23:22:21.664 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.664 DEBUG:boto:Data: 2023-12-15T23:22:21.664 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.664 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.664 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.664 DEBUG:boto:Params: {} 2023-12-15T23:22:21.664 DEBUG:boto:Token: None 2023-12-15T23:22:21.664 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.665 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA= 2023-12-15T23:22:21.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA=', 'Content-Length': '0'} 2023-12-15T23:22:21.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086046df9019089fc-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.667 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.667 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.667 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.668 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.668 DEBUG:boto:Method: GET 2023-12-15T23:22:21.668 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.668 DEBUG:boto:Data: 2023-12-15T23:22:21.668 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.668 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.668 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.668 DEBUG:boto:Params: {} 2023-12-15T23:22:21.668 DEBUG:boto:Token: None 2023-12-15T23:22:21.669 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.669 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA= 2023-12-15T23:22:21.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA=', 'Content-Length': '0'} 2023-12-15T23:22:21.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001df34617a530eb4f-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.713 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.714 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.714 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.714 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.714 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.714 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.714 DEBUG:boto:Data: 2023-12-15T23:22:21.714 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.714 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.715 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.715 DEBUG:boto:Params: {} 2023-12-15T23:22:21.715 DEBUG:boto:Token: None 2023-12-15T23:22:21.715 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AZ92LT6lYrXPgUgr/zvbT9aufFk= 2023-12-15T23:22:21.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AZ92LT6lYrXPgUgr/zvbT9aufFk=', 'Content-Length': '0'} 2023-12-15T23:22:21.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000284af61081963ee5-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.718 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.718 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.718 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.718 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.718 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.718 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.718 DEBUG:boto:Data: 2023-12-15T23:22:21.718 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.718 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.719 DEBUG:boto:Params: {} 2023-12-15T23:22:21.719 DEBUG:boto:Token: None 2023-12-15T23:22:21.719 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AZ92LT6lYrXPgUgr/zvbT9aufFk= 2023-12-15T23:22:21.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AZ92LT6lYrXPgUgr/zvbT9aufFk=', 'Content-Length': '0'} 2023-12-15T23:22:21.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002548e0d6921f6b0b-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:22:21.722 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.722 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.722 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.722 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.722 DEBUG:boto:Method: GET 2023-12-15T23:22:21.722 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.722 DEBUG:boto:Data: 2023-12-15T23:22:21.722 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.723 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.723 DEBUG:boto:Params: {} 2023-12-15T23:22:21.723 DEBUG:boto:Token: None 2023-12-15T23:22:21.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA= 2023-12-15T23:22:21.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA=', 'Content-Length': '0'} 2023-12-15T23:22:21.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000474c5a7eae6233cb-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.765 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.766 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.766 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.766 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.766 DEBUG:boto:Method: GET 2023-12-15T23:22:21.766 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.766 DEBUG:boto:Data: 2023-12-15T23:22:21.766 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.766 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.766 DEBUG:boto:Params: {} 2023-12-15T23:22:21.767 DEBUG:boto:Token: None 2023-12-15T23:22:21.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:22:21.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA= 2023-12-15T23:22:21.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LE0duViaj77gBhVo68IlHw70GZA=', 'Content-Length': '0'} 2023-12-15T23:22:21.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a66c59c98d587a6-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.770 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.770 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.770 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.770 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.770 DEBUG:boto:Method: GET 2023-12-15T23:22:21.770 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.770 DEBUG:boto:Data: 2023-12-15T23:22:21.770 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.770 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.770 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.771 DEBUG:boto:Params: {} 2023-12-15T23:22:21.771 DEBUG:boto:Token: None 2023-12-15T23:22:21.771 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ddd02967a378c59-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.774 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.774 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.774 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.774 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.774 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.775 DEBUG:boto:Method: GET 2023-12-15T23:22:21.775 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.775 DEBUG:boto:Data: 2023-12-15T23:22:21.775 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.775 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.775 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.775 DEBUG:boto:Params: {} 2023-12-15T23:22:21.775 DEBUG:boto:Token: None 2023-12-15T23:22:21.776 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbc39f8ce134138b-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.780 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.780 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.780 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.781 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.781 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:22:21.781 DEBUG:boto:Data: 2023-12-15T23:22:21.781 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.781 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.781 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.781 DEBUG:boto:Params: {} 2023-12-15T23:22:21.781 DEBUG:boto:Token: None 2023-12-15T23:22:21.781 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34 2023-12-15T23:22:21.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I3BcK6soCY9u3nsJA1dLRR7VGHU= 2023-12-15T23:22:21.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I3BcK6soCY9u3nsJA1dLRR7VGHU=', 'Content-Length': '0'} 2023-12-15T23:22:21.784 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1e24087126f75db-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.784 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.784 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.784 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.784 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:22:21.785 DEBUG:boto:Data: 2023-12-15T23:22:21.785 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.785 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.785 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.785 DEBUG:boto:Params: {} 2023-12-15T23:22:21.785 DEBUG:boto:Token: None 2023-12-15T23:22:21.785 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34 2023-12-15T23:22:21.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I3BcK6soCY9u3nsJA1dLRR7VGHU= 2023-12-15T23:22:21.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I3BcK6soCY9u3nsJA1dLRR7VGHU=', 'Content-Length': '0'} 2023-12-15T23:22:21.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff7f1087e0343785-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:22:21.788 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.788 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.788 DEBUG:boto:Method: GET 2023-12-15T23:22:21.788 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:22:21.788 DEBUG:boto:Data: 2023-12-15T23:22:21.788 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.788 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.789 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.789 DEBUG:boto:Params: {} 2023-12-15T23:22:21.789 DEBUG:boto:Token: None 2023-12-15T23:22:21.789 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34 2023-12-15T23:22:21.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ra9H9jN6zw62vFmiOYcudrJsAOg= 2023-12-15T23:22:21.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ra9H9jN6zw62vFmiOYcudrJsAOg=', 'Content-Length': '0'} 2023-12-15T23:22:21.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cad916bfb98a90f-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.834 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:22:21.834 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:22:21.834 DEBUG:boto:Method: GET 2023-12-15T23:22:21.834 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:22:21.834 DEBUG:boto:Data: 2023-12-15T23:22:21.834 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.834 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.834 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.834 DEBUG:boto:Params: {} 2023-12-15T23:22:21.835 DEBUG:boto:Token: None 2023-12-15T23:22:21.835 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj34 2023-12-15T23:22:21.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ra9H9jN6zw62vFmiOYcudrJsAOg= 2023-12-15T23:22:21.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ra9H9jN6zw62vFmiOYcudrJsAOg=', 'Content-Length': '0'} 2023-12-15T23:22:21.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bc87f7d81326083-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.837 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.838 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.838 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.838 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.838 DEBUG:boto:Method: GET 2023-12-15T23:22:21.838 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.838 DEBUG:boto:Data: 2023-12-15T23:22:21.838 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.838 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.838 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.839 DEBUG:boto:Params: {} 2023-12-15T23:22:21.839 DEBUG:boto:Token: None 2023-12-15T23:22:21.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084c6baf893218911-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.842 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.842 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.842 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.843 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.843 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.843 DEBUG:boto:Method: GET 2023-12-15T23:22:21.843 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:22:21.843 DEBUG:boto:Data: 2023-12-15T23:22:21.843 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.843 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.843 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.843 DEBUG:boto:Params: {} 2023-12-15T23:22:21.844 DEBUG:boto:Token: None 2023-12-15T23:22:21.844 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.847 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ce90207f764fd34-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.847 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:22:21.848 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.848 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.848 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.848 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.848 DEBUG:boto:Method: GET 2023-12-15T23:22:21.849 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.849 DEBUG:boto:Data: 2023-12-15T23:22:21.849 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.849 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.849 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.849 DEBUG:boto:Params: {} 2023-12-15T23:22:21.849 DEBUG:boto:Token: None 2023-12-15T23:22:21.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM= 2023-12-15T23:22:21.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM=', 'Content-Length': '0'} 2023-12-15T23:22:21.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba40fdcb18ab4b90-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.852 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.852 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.852 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.852 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.852 DEBUG:boto:Method: GET 2023-12-15T23:22:21.853 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.853 DEBUG:boto:Data: 2023-12-15T23:22:21.853 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.853 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.853 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.853 DEBUG:boto:Params: {} 2023-12-15T23:22:21.853 DEBUG:boto:Token: None 2023-12-15T23:22:21.853 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM= 2023-12-15T23:22:21.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM=', 'Content-Length': '0'} 2023-12-15T23:22:21.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3053ae56caa4240-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.856 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.856 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.856 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.856 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.856 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.856 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.857 DEBUG:boto:Data: 2023-12-15T23:22:21.857 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.857 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.857 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.857 DEBUG:boto:Params: {} 2023-12-15T23:22:21.857 DEBUG:boto:Token: None 2023-12-15T23:22:21.857 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.857 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LNwaR8GoV0AMXmzdUexYF9v0/2U= 2023-12-15T23:22:21.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LNwaR8GoV0AMXmzdUexYF9v0/2U=', 'Content-Length': '0'} 2023-12-15T23:22:21.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e346f60902735ac-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.860 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.860 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.860 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.860 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.860 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.860 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.860 DEBUG:boto:Data: 2023-12-15T23:22:21.861 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.861 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.861 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.861 DEBUG:boto:Params: {} 2023-12-15T23:22:21.861 DEBUG:boto:Token: None 2023-12-15T23:22:21.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LNwaR8GoV0AMXmzdUexYF9v0/2U= 2023-12-15T23:22:21.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LNwaR8GoV0AMXmzdUexYF9v0/2U=', 'Content-Length': '0'} 2023-12-15T23:22:21.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d308535c4318333-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:22:21.863 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.864 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.864 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.864 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.864 DEBUG:boto:Method: GET 2023-12-15T23:22:21.864 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.864 DEBUG:boto:Data: 2023-12-15T23:22:21.864 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.864 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.864 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.865 DEBUG:boto:Params: {} 2023-12-15T23:22:21.865 DEBUG:boto:Token: None 2023-12-15T23:22:21.865 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM= 2023-12-15T23:22:21.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM=', 'Content-Length': '0'} 2023-12-15T23:22:21.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a7d599ded18708d-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.909 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.910 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.910 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.910 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.910 DEBUG:boto:Method: GET 2023-12-15T23:22:21.910 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.910 DEBUG:boto:Data: 2023-12-15T23:22:21.910 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.910 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.911 DEBUG:boto:Params: {} 2023-12-15T23:22:21.911 DEBUG:boto:Token: None 2023-12-15T23:22:21.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:22:21.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM= 2023-12-15T23:22:21.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TNn9xi7yrPE5iEI7XtTkW0XbuvM=', 'Content-Length': '0'} 2023-12-15T23:22:21.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce77f40f9093df40-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.913 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.914 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.914 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.914 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.914 DEBUG:boto:Method: GET 2023-12-15T23:22:21.914 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.914 DEBUG:boto:Data: 2023-12-15T23:22:21.914 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.914 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.914 DEBUG:boto:Params: {} 2023-12-15T23:22:21.915 DEBUG:boto:Token: None 2023-12-15T23:22:21.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009768cebb66181b8c-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.957 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.958 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:21.958 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:21.958 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.958 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.958 DEBUG:boto:Method: GET 2023-12-15T23:22:21.958 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:22:21.958 DEBUG:boto:Data: 2023-12-15T23:22:21.959 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.959 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.959 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.959 DEBUG:boto:Params: {} 2023-12-15T23:22:21.959 DEBUG:boto:Token: None 2023-12-15T23:22:21.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/ 2023-12-15T23:22:21.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc= 2023-12-15T23:22:21.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6nslp7zN8NHcPmnxXoh7+hy8xOc=', 'Content-Length': '0'} 2023-12-15T23:22:21.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014457449e695d1d5-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.963 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:21.963 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.963 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.964 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.964 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:22:21.964 DEBUG:boto:Data: 2023-12-15T23:22:21.964 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.964 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.964 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.964 DEBUG:boto:Params: {} 2023-12-15T23:22:21.964 DEBUG:boto:Token: None 2023-12-15T23:22:21.964 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38 2023-12-15T23:22:21.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zeqUlWoUovFbdABMBYd2LZs4b4= 2023-12-15T23:22:21.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zeqUlWoUovFbdABMBYd2LZs4b4=', 'Content-Length': '0'} 2023-12-15T23:22:21.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f96bef5c54d8459-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.967 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.967 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.967 DEBUG:boto:Method: HEAD 2023-12-15T23:22:21.967 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:22:21.967 DEBUG:boto:Data: 2023-12-15T23:22:21.967 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:21.967 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.968 DEBUG:boto:Params: {} 2023-12-15T23:22:21.968 DEBUG:boto:Token: None 2023-12-15T23:22:21.968 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38 2023-12-15T23:22:21.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zeqUlWoUovFbdABMBYd2LZs4b4= 2023-12-15T23:22:21.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zeqUlWoUovFbdABMBYd2LZs4b4=', 'Content-Length': '0'} 2023-12-15T23:22:21.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061dbe74850ec5f6e-00657cdfad-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:21.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:22:21.970 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:21.970 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:21.971 DEBUG:boto:Method: GET 2023-12-15T23:22:21.971 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:22:21.971 DEBUG:boto:Data: 2023-12-15T23:22:21.971 DEBUG:boto:Headers: {} 2023-12-15T23:22:21.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:21.971 DEBUG:boto:Port: 8000 2023-12-15T23:22:21.971 DEBUG:boto:Params: {} 2023-12-15T23:22:21.971 DEBUG:boto:Token: None 2023-12-15T23:22:21.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:21 GMT /kskgfn-49/obj38 2023-12-15T23:22:21.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qn9oAnJ1nsGn88yvIskhayZnado= 2023-12-15T23:22:21.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:21 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qn9oAnJ1nsGn88yvIskhayZnado=', 'Content-Length': '0'} 2023-12-15T23:22:21.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3859dbfc45b9ed5-00657cdfad-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:21 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.014 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:22:22.014 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:22:22.014 DEBUG:boto:Method: GET 2023-12-15T23:22:22.014 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:22:22.014 DEBUG:boto:Data: 2023-12-15T23:22:22.014 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.014 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.015 DEBUG:boto:Params: {} 2023-12-15T23:22:22.015 DEBUG:boto:Token: None 2023-12-15T23:22:22.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj38 2023-12-15T23:22:22.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6OBtfNtOnoFg34WXFEt9+B8h3ts= 2023-12-15T23:22:22.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6OBtfNtOnoFg34WXFEt9+B8h3ts=', 'Content-Length': '0'} 2023-12-15T23:22:22.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3787d03c8d0988f-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.017 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.018 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.018 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.018 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.018 DEBUG:boto:Method: GET 2023-12-15T23:22:22.018 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.018 DEBUG:boto:Data: 2023-12-15T23:22:22.018 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.018 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.019 DEBUG:boto:Params: {} 2023-12-15T23:22:22.019 DEBUG:boto:Token: None 2023-12-15T23:22:22.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d20cd24e47565e23-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.065 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.066 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.066 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.066 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.066 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.066 DEBUG:boto:Method: GET 2023-12-15T23:22:22.066 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:22:22.066 DEBUG:boto:Data: 2023-12-15T23:22:22.066 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.067 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.067 DEBUG:boto:Params: {} 2023-12-15T23:22:22.067 DEBUG:boto:Token: None 2023-12-15T23:22:22.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9117b58b12fa1df-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.070 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:22:22.071 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.071 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.071 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.071 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.071 DEBUG:boto:Method: GET 2023-12-15T23:22:22.071 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.071 DEBUG:boto:Data: 2023-12-15T23:22:22.072 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.072 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.072 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.072 DEBUG:boto:Params: {} 2023-12-15T23:22:22.072 DEBUG:boto:Token: None 2023-12-15T23:22:22.072 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw= 2023-12-15T23:22:22.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw=', 'Content-Length': '0'} 2023-12-15T23:22:22.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c817dc0e0c8423c7-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.075 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.075 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.075 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.075 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.075 DEBUG:boto:Method: GET 2023-12-15T23:22:22.075 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.075 DEBUG:boto:Data: 2023-12-15T23:22:22.075 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.075 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.075 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.076 DEBUG:boto:Params: {} 2023-12-15T23:22:22.076 DEBUG:boto:Token: None 2023-12-15T23:22:22.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw= 2023-12-15T23:22:22.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw=', 'Content-Length': '0'} 2023-12-15T23:22:22.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093e13916ff53a8e0-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.125 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.126 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.126 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.126 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.126 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.126 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.126 DEBUG:boto:Data: 2023-12-15T23:22:22.126 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.126 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.127 DEBUG:boto:Params: {} 2023-12-15T23:22:22.127 DEBUG:boto:Token: None 2023-12-15T23:22:22.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ngRfma4NkXU0c9GdkyutUHSHe2E= 2023-12-15T23:22:22.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ngRfma4NkXU0c9GdkyutUHSHe2E=', 'Content-Length': '0'} 2023-12-15T23:22:22.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024c0533b8a302ab1-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.129 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.129 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.129 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.130 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.130 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.130 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.130 DEBUG:boto:Data: 2023-12-15T23:22:22.130 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.130 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.130 DEBUG:boto:Params: {} 2023-12-15T23:22:22.130 DEBUG:boto:Token: None 2023-12-15T23:22:22.130 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ngRfma4NkXU0c9GdkyutUHSHe2E= 2023-12-15T23:22:22.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ngRfma4NkXU0c9GdkyutUHSHe2E=', 'Content-Length': '0'} 2023-12-15T23:22:22.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3d39fbe25ee22bf-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:22:22.133 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.133 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.133 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.133 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.133 DEBUG:boto:Method: GET 2023-12-15T23:22:22.133 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.133 DEBUG:boto:Data: 2023-12-15T23:22:22.134 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.134 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.134 DEBUG:boto:Params: {} 2023-12-15T23:22:22.134 DEBUG:boto:Token: None 2023-12-15T23:22:22.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw= 2023-12-15T23:22:22.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw=', 'Content-Length': '0'} 2023-12-15T23:22:22.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3df90e1a5c6af7f-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.178 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.178 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.178 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.178 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.178 DEBUG:boto:Method: GET 2023-12-15T23:22:22.178 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.178 DEBUG:boto:Data: 2023-12-15T23:22:22.178 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.178 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.178 DEBUG:boto:Params: {} 2023-12-15T23:22:22.179 DEBUG:boto:Token: None 2023-12-15T23:22:22.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:22:22.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw= 2023-12-15T23:22:22.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1a+VugfdSDUwvfIX8+ndVei55Cw=', 'Content-Length': '0'} 2023-12-15T23:22:22.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f8bf1b77b258a05-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.181 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.181 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.181 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.182 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.182 DEBUG:boto:Method: GET 2023-12-15T23:22:22.182 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.182 DEBUG:boto:Data: 2023-12-15T23:22:22.182 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.182 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.182 DEBUG:boto:Params: {} 2023-12-15T23:22:22.182 DEBUG:boto:Token: None 2023-12-15T23:22:22.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004442f32ffdcd287d-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.187 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.187 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.187 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.187 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.187 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.188 DEBUG:boto:Method: GET 2023-12-15T23:22:22.188 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.188 DEBUG:boto:Data: 2023-12-15T23:22:22.188 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.188 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.188 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.188 DEBUG:boto:Params: {} 2023-12-15T23:22:22.188 DEBUG:boto:Token: None 2023-12-15T23:22:22.188 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.188 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001e25af55ff9ed66-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.192 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.192 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.193 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.193 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.193 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:22:22.193 DEBUG:boto:Data: 2023-12-15T23:22:22.193 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.193 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.193 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.193 DEBUG:boto:Params: {} 2023-12-15T23:22:22.193 DEBUG:boto:Token: None 2023-12-15T23:22:22.193 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44 2023-12-15T23:22:22.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VUmqoFrNQwrP/YEkYBDrEoUo8= 2023-12-15T23:22:22.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VUmqoFrNQwrP/YEkYBDrEoUo8=', 'Content-Length': '0'} 2023-12-15T23:22:22.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e664600d762e6adc-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.196 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.196 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.196 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.196 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:22:22.196 DEBUG:boto:Data: 2023-12-15T23:22:22.196 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.196 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.197 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.197 DEBUG:boto:Params: {} 2023-12-15T23:22:22.197 DEBUG:boto:Token: None 2023-12-15T23:22:22.197 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44 2023-12-15T23:22:22.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q7VUmqoFrNQwrP/YEkYBDrEoUo8= 2023-12-15T23:22:22.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q7VUmqoFrNQwrP/YEkYBDrEoUo8=', 'Content-Length': '0'} 2023-12-15T23:22:22.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c41c914cce9f7f42-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:22:22.199 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.199 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.199 DEBUG:boto:Method: GET 2023-12-15T23:22:22.199 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:22:22.200 DEBUG:boto:Data: 2023-12-15T23:22:22.200 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.200 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.200 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.200 DEBUG:boto:Params: {} 2023-12-15T23:22:22.200 DEBUG:boto:Token: None 2023-12-15T23:22:22.200 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44 2023-12-15T23:22:22.200 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+2Kqng5+iM2sYdvgVQt7UKqpjg= 2023-12-15T23:22:22.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+2Kqng5+iM2sYdvgVQt7UKqpjg=', 'Content-Length': '0'} 2023-12-15T23:22:22.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085522cd216b2beff-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.250 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:22:22.250 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:22:22.250 DEBUG:boto:Method: GET 2023-12-15T23:22:22.250 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:22:22.250 DEBUG:boto:Data: 2023-12-15T23:22:22.250 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.250 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.250 DEBUG:boto:Params: {} 2023-12-15T23:22:22.250 DEBUG:boto:Token: None 2023-12-15T23:22:22.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj44 2023-12-15T23:22:22.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+2Kqng5+iM2sYdvgVQt7UKqpjg= 2023-12-15T23:22:22.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+2Kqng5+iM2sYdvgVQt7UKqpjg=', 'Content-Length': '0'} 2023-12-15T23:22:22.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8e6f3e64194910b-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.253 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.253 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.253 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.253 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.253 DEBUG:boto:Method: GET 2023-12-15T23:22:22.253 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.253 DEBUG:boto:Data: 2023-12-15T23:22:22.254 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.254 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.254 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.254 DEBUG:boto:Params: {} 2023-12-15T23:22:22.254 DEBUG:boto:Token: None 2023-12-15T23:22:22.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.256 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb8c96ad27c12438-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.257 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.257 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.257 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.257 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.257 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.258 DEBUG:boto:Method: GET 2023-12-15T23:22:22.258 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:22:22.258 DEBUG:boto:Data: 2023-12-15T23:22:22.258 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.258 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.258 DEBUG:boto:Params: {} 2023-12-15T23:22:22.258 DEBUG:boto:Token: None 2023-12-15T23:22:22.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035a8b718d8777290-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.262 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:22:22.262 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.262 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.263 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.263 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.263 DEBUG:boto:Method: GET 2023-12-15T23:22:22.263 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.263 DEBUG:boto:Data: 2023-12-15T23:22:22.263 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.263 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.263 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.263 DEBUG:boto:Params: {} 2023-12-15T23:22:22.263 DEBUG:boto:Token: None 2023-12-15T23:22:22.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.264 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8= 2023-12-15T23:22:22.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8=', 'Content-Length': '0'} 2023-12-15T23:22:22.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001745dbac799b1ee2-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.266 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.266 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.266 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.266 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.267 DEBUG:boto:Method: GET 2023-12-15T23:22:22.267 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.267 DEBUG:boto:Data: 2023-12-15T23:22:22.267 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.267 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.267 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.267 DEBUG:boto:Params: {} 2023-12-15T23:22:22.267 DEBUG:boto:Token: None 2023-12-15T23:22:22.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8= 2023-12-15T23:22:22.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8=', 'Content-Length': '0'} 2023-12-15T23:22:22.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba343dc18eb6aa9e-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.314 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.314 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.314 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.314 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.314 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.314 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.314 DEBUG:boto:Data: 2023-12-15T23:22:22.314 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.314 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.314 DEBUG:boto:Params: {} 2023-12-15T23:22:22.315 DEBUG:boto:Token: None 2023-12-15T23:22:22.315 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whlTUKDOMtBZT4ZeQXWiRlUsKIA= 2023-12-15T23:22:22.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whlTUKDOMtBZT4ZeQXWiRlUsKIA=', 'Content-Length': '0'} 2023-12-15T23:22:22.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d24fa3d38bddfdd9-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.317 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.317 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.317 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.317 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.318 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.318 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.318 DEBUG:boto:Data: 2023-12-15T23:22:22.318 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.318 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.318 DEBUG:boto:Params: {} 2023-12-15T23:22:22.318 DEBUG:boto:Token: None 2023-12-15T23:22:22.318 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whlTUKDOMtBZT4ZeQXWiRlUsKIA= 2023-12-15T23:22:22.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whlTUKDOMtBZT4ZeQXWiRlUsKIA=', 'Content-Length': '0'} 2023-12-15T23:22:22.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d32714c608f0bc4f-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:22:22.321 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.321 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.321 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.321 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.321 DEBUG:boto:Method: GET 2023-12-15T23:22:22.321 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.322 DEBUG:boto:Data: 2023-12-15T23:22:22.322 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.322 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.322 DEBUG:boto:Params: {} 2023-12-15T23:22:22.322 DEBUG:boto:Token: None 2023-12-15T23:22:22.322 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8= 2023-12-15T23:22:22.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8=', 'Content-Length': '0'} 2023-12-15T23:22:22.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060de716d54593c1c-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.366 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.430 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.431 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.431 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.431 DEBUG:boto:Method: GET 2023-12-15T23:22:22.431 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.431 DEBUG:boto:Data: 2023-12-15T23:22:22.431 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.431 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.431 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.431 DEBUG:boto:Params: {} 2023-12-15T23:22:22.431 DEBUG:boto:Token: None 2023-12-15T23:22:22.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:22:22.432 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8= 2023-12-15T23:22:22.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m21TmTQSyUrBAhpOXRrQcY2rtM8=', 'Content-Length': '0'} 2023-12-15T23:22:22.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ac839cb337641a2-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.434 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.434 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.434 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.434 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.434 DEBUG:boto:Method: GET 2023-12-15T23:22:22.434 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.435 DEBUG:boto:Data: 2023-12-15T23:22:22.435 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.435 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.435 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.435 DEBUG:boto:Params: {} 2023-12-15T23:22:22.435 DEBUG:boto:Token: None 2023-12-15T23:22:22.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a403f1696dc753b-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.437 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.438 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.438 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.438 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.438 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.438 DEBUG:boto:Method: GET 2023-12-15T23:22:22.438 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.438 DEBUG:boto:Data: 2023-12-15T23:22:22.438 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.439 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.439 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.439 DEBUG:boto:Params: {} 2023-12-15T23:22:22.439 DEBUG:boto:Token: None 2023-12-15T23:22:22.439 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f270698b9a9fde5-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.443 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.443 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.443 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.443 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.443 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:22:22.443 DEBUG:boto:Data: 2023-12-15T23:22:22.443 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.444 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.444 DEBUG:boto:Params: {} 2023-12-15T23:22:22.444 DEBUG:boto:Token: None 2023-12-15T23:22:22.444 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46 2023-12-15T23:22:22.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k18CnXnSnXaJ29+UY2ug70A7wig= 2023-12-15T23:22:22.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k18CnXnSnXaJ29+UY2ug70A7wig=', 'Content-Length': '0'} 2023-12-15T23:22:22.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3e18197e4840a3b-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.447 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.447 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.447 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.447 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:22:22.447 DEBUG:boto:Data: 2023-12-15T23:22:22.447 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.447 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.447 DEBUG:boto:Params: {} 2023-12-15T23:22:22.448 DEBUG:boto:Token: None 2023-12-15T23:22:22.448 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46 2023-12-15T23:22:22.448 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k18CnXnSnXaJ29+UY2ug70A7wig= 2023-12-15T23:22:22.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k18CnXnSnXaJ29+UY2ug70A7wig=', 'Content-Length': '0'} 2023-12-15T23:22:22.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e6394953dd2db21-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:22:22.450 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.450 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.451 DEBUG:boto:Method: GET 2023-12-15T23:22:22.451 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:22:22.451 DEBUG:boto:Data: 2023-12-15T23:22:22.451 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.451 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.451 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.451 DEBUG:boto:Params: {} 2023-12-15T23:22:22.451 DEBUG:boto:Token: None 2023-12-15T23:22:22.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46 2023-12-15T23:22:22.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:27bm9NGAVQTUOSuJnTBi1tpMlGI= 2023-12-15T23:22:22.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:27bm9NGAVQTUOSuJnTBi1tpMlGI=', 'Content-Length': '0'} 2023-12-15T23:22:22.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5bf9471125a89df-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.497 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:22:22.498 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:22:22.498 DEBUG:boto:Method: GET 2023-12-15T23:22:22.498 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:22:22.498 DEBUG:boto:Data: 2023-12-15T23:22:22.498 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.498 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.498 DEBUG:boto:Params: {} 2023-12-15T23:22:22.498 DEBUG:boto:Token: None 2023-12-15T23:22:22.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj46 2023-12-15T23:22:22.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:27bm9NGAVQTUOSuJnTBi1tpMlGI= 2023-12-15T23:22:22.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:27bm9NGAVQTUOSuJnTBi1tpMlGI=', 'Content-Length': '0'} 2023-12-15T23:22:22.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8571bfbdc82d51e-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.501 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.501 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.501 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.501 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.502 DEBUG:boto:Method: GET 2023-12-15T23:22:22.502 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.502 DEBUG:boto:Data: 2023-12-15T23:22:22.502 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.502 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.502 DEBUG:boto:Params: {} 2023-12-15T23:22:22.502 DEBUG:boto:Token: None 2023-12-15T23:22:22.502 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.502 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b7b00f1a30adc43-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.505 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.505 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.506 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.506 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.506 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.506 DEBUG:boto:Method: GET 2023-12-15T23:22:22.506 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:22:22.506 DEBUG:boto:Data: 2023-12-15T23:22:22.506 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.506 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.506 DEBUG:boto:Params: {} 2023-12-15T23:22:22.507 DEBUG:boto:Token: None 2023-12-15T23:22:22.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.510 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005f0954853ef468d-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.510 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:22:22.511 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.511 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.511 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.511 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.511 DEBUG:boto:Method: GET 2023-12-15T23:22:22.511 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.511 DEBUG:boto:Data: 2023-12-15T23:22:22.511 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.511 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.512 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.512 DEBUG:boto:Params: {} 2023-12-15T23:22:22.512 DEBUG:boto:Token: None 2023-12-15T23:22:22.512 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.512 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M= 2023-12-15T23:22:22.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M=', 'Content-Length': '0'} 2023-12-15T23:22:22.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f82134fdb7bb1c13-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.514 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.514 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.514 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.514 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.515 DEBUG:boto:Method: GET 2023-12-15T23:22:22.515 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.515 DEBUG:boto:Data: 2023-12-15T23:22:22.515 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.515 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.515 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.515 DEBUG:boto:Params: {} 2023-12-15T23:22:22.515 DEBUG:boto:Token: None 2023-12-15T23:22:22.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M= 2023-12-15T23:22:22.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M=', 'Content-Length': '0'} 2023-12-15T23:22:22.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a0fd6dd8387c07f-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.518 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.518 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.518 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.518 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.518 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.518 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.518 DEBUG:boto:Data: 2023-12-15T23:22:22.518 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.518 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.519 DEBUG:boto:Params: {} 2023-12-15T23:22:22.519 DEBUG:boto:Token: None 2023-12-15T23:22:22.519 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U6fuu2I/BG5qCOBekNxVZLgMhJ4= 2023-12-15T23:22:22.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U6fuu2I/BG5qCOBekNxVZLgMhJ4=', 'Content-Length': '0'} 2023-12-15T23:22:22.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026ea78cbbb97b889-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.521 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.521 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.521 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.521 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.521 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.521 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.522 DEBUG:boto:Data: 2023-12-15T23:22:22.522 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.522 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.522 DEBUG:boto:Params: {} 2023-12-15T23:22:22.522 DEBUG:boto:Token: None 2023-12-15T23:22:22.522 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U6fuu2I/BG5qCOBekNxVZLgMhJ4= 2023-12-15T23:22:22.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U6fuu2I/BG5qCOBekNxVZLgMhJ4=', 'Content-Length': '0'} 2023-12-15T23:22:22.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000b1aea11fb91fe6-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:22:22.524 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.524 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.525 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.525 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.525 DEBUG:boto:Method: GET 2023-12-15T23:22:22.525 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.525 DEBUG:boto:Data: 2023-12-15T23:22:22.525 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.525 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.525 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.525 DEBUG:boto:Params: {} 2023-12-15T23:22:22.525 DEBUG:boto:Token: None 2023-12-15T23:22:22.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M= 2023-12-15T23:22:22.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M=', 'Content-Length': '0'} 2023-12-15T23:22:22.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018fe5d87e363fc99-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.569 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.570 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.570 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.570 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.570 DEBUG:boto:Method: GET 2023-12-15T23:22:22.570 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.570 DEBUG:boto:Data: 2023-12-15T23:22:22.570 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.570 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.570 DEBUG:boto:Params: {} 2023-12-15T23:22:22.571 DEBUG:boto:Token: None 2023-12-15T23:22:22.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:22:22.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M= 2023-12-15T23:22:22.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MowZYWUi/ERjNsth601R5dxGw6M=', 'Content-Length': '0'} 2023-12-15T23:22:22.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcb2eb621a2e40b8-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.573 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.574 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.574 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.574 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.574 DEBUG:boto:Method: GET 2023-12-15T23:22:22.574 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.574 DEBUG:boto:Data: 2023-12-15T23:22:22.574 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.574 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.575 DEBUG:boto:Params: {} 2023-12-15T23:22:22.575 DEBUG:boto:Token: None 2023-12-15T23:22:22.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035bb896f7f8a8324-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.617 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.618 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.618 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.618 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.618 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.618 DEBUG:boto:Method: GET 2023-12-15T23:22:22.618 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.618 DEBUG:boto:Data: 2023-12-15T23:22:22.619 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.619 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.619 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.619 DEBUG:boto:Params: {} 2023-12-15T23:22:22.619 DEBUG:boto:Token: None 2023-12-15T23:22:22.619 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3a14d65b73efb0d-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.623 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.623 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.623 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.623 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.623 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:22:22.623 DEBUG:boto:Data: 2023-12-15T23:22:22.623 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.623 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.624 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.624 DEBUG:boto:Params: {} 2023-12-15T23:22:22.624 DEBUG:boto:Token: None 2023-12-15T23:22:22.624 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51 2023-12-15T23:22:22.624 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KW1v2yjxvSrm1IzSimFwQNlFWTU= 2023-12-15T23:22:22.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KW1v2yjxvSrm1IzSimFwQNlFWTU=', 'Content-Length': '0'} 2023-12-15T23:22:22.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1b830c2e03548f9-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.626 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.626 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.626 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.626 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:22:22.626 DEBUG:boto:Data: 2023-12-15T23:22:22.626 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.626 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.627 DEBUG:boto:Params: {} 2023-12-15T23:22:22.627 DEBUG:boto:Token: None 2023-12-15T23:22:22.627 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51 2023-12-15T23:22:22.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KW1v2yjxvSrm1IzSimFwQNlFWTU= 2023-12-15T23:22:22.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KW1v2yjxvSrm1IzSimFwQNlFWTU=', 'Content-Length': '0'} 2023-12-15T23:22:22.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ebff2001c539d6e-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:22:22.629 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.629 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.630 DEBUG:boto:Method: GET 2023-12-15T23:22:22.630 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:22:22.630 DEBUG:boto:Data: 2023-12-15T23:22:22.630 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.630 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.630 DEBUG:boto:Params: {} 2023-12-15T23:22:22.630 DEBUG:boto:Token: None 2023-12-15T23:22:22.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51 2023-12-15T23:22:22.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GocuyrEdP3x0FQpXxNC8UGch0e4= 2023-12-15T23:22:22.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GocuyrEdP3x0FQpXxNC8UGch0e4=', 'Content-Length': '0'} 2023-12-15T23:22:22.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a40a1f5598f884aa-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.673 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:22:22.674 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:22:22.674 DEBUG:boto:Method: GET 2023-12-15T23:22:22.674 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:22:22.674 DEBUG:boto:Data: 2023-12-15T23:22:22.674 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.674 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.674 DEBUG:boto:Params: {} 2023-12-15T23:22:22.674 DEBUG:boto:Token: None 2023-12-15T23:22:22.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj51 2023-12-15T23:22:22.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GocuyrEdP3x0FQpXxNC8UGch0e4= 2023-12-15T23:22:22.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GocuyrEdP3x0FQpXxNC8UGch0e4=', 'Content-Length': '0'} 2023-12-15T23:22:22.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000340160813cc8e293-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.677 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.677 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.677 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.677 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.677 DEBUG:boto:Method: GET 2023-12-15T23:22:22.677 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.677 DEBUG:boto:Data: 2023-12-15T23:22:22.677 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.678 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.678 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.678 DEBUG:boto:Params: {} 2023-12-15T23:22:22.678 DEBUG:boto:Token: None 2023-12-15T23:22:22.678 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077080089009804f0-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.721 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.722 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.722 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.722 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.722 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.722 DEBUG:boto:Method: GET 2023-12-15T23:22:22.722 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:22:22.722 DEBUG:boto:Data: 2023-12-15T23:22:22.723 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.723 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.723 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.723 DEBUG:boto:Params: {} 2023-12-15T23:22:22.723 DEBUG:boto:Token: None 2023-12-15T23:22:22.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091f2fab106876b69-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.726 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:22:22.727 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.727 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.727 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.727 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.727 DEBUG:boto:Method: GET 2023-12-15T23:22:22.727 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.727 DEBUG:boto:Data: 2023-12-15T23:22:22.728 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.728 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.728 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.728 DEBUG:boto:Params: {} 2023-12-15T23:22:22.728 DEBUG:boto:Token: None 2023-12-15T23:22:22.728 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.728 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw= 2023-12-15T23:22:22.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw=', 'Content-Length': '0'} 2023-12-15T23:22:22.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cc92dd0249a037b-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.731 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.731 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.731 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.731 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.731 DEBUG:boto:Method: GET 2023-12-15T23:22:22.731 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.731 DEBUG:boto:Data: 2023-12-15T23:22:22.731 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.731 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.731 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.731 DEBUG:boto:Params: {} 2023-12-15T23:22:22.732 DEBUG:boto:Token: None 2023-12-15T23:22:22.732 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.732 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw= 2023-12-15T23:22:22.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw=', 'Content-Length': '0'} 2023-12-15T23:22:22.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042eb1456235d2e18-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.734 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.734 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.734 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.735 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.735 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.735 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.735 DEBUG:boto:Data: 2023-12-15T23:22:22.735 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.735 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.735 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.735 DEBUG:boto:Params: {} 2023-12-15T23:22:22.735 DEBUG:boto:Token: None 2023-12-15T23:22:22.735 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.736 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J5EH0v6ZyzlgBY/pc05ISjRGvdQ= 2023-12-15T23:22:22.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J5EH0v6ZyzlgBY/pc05ISjRGvdQ=', 'Content-Length': '0'} 2023-12-15T23:22:22.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4ad47b025c93383-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.738 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.738 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.738 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.738 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.738 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.738 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.738 DEBUG:boto:Data: 2023-12-15T23:22:22.739 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.739 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.739 DEBUG:boto:Params: {} 2023-12-15T23:22:22.739 DEBUG:boto:Token: None 2023-12-15T23:22:22.739 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J5EH0v6ZyzlgBY/pc05ISjRGvdQ= 2023-12-15T23:22:22.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J5EH0v6ZyzlgBY/pc05ISjRGvdQ=', 'Content-Length': '0'} 2023-12-15T23:22:22.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b50cd07be46b9fb-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.741 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:22:22.741 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.741 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.742 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.742 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.742 DEBUG:boto:Method: GET 2023-12-15T23:22:22.742 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.742 DEBUG:boto:Data: 2023-12-15T23:22:22.742 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.742 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.742 DEBUG:boto:Params: {} 2023-12-15T23:22:22.742 DEBUG:boto:Token: None 2023-12-15T23:22:22.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw= 2023-12-15T23:22:22.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw=', 'Content-Length': '0'} 2023-12-15T23:22:22.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c1d9f31e9085198-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.790 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.790 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.790 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.790 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.790 DEBUG:boto:Method: GET 2023-12-15T23:22:22.790 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.790 DEBUG:boto:Data: 2023-12-15T23:22:22.790 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.790 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.790 DEBUG:boto:Params: {} 2023-12-15T23:22:22.791 DEBUG:boto:Token: None 2023-12-15T23:22:22.791 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:22:22.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw= 2023-12-15T23:22:22.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s2l1Qm0toHnYFkPsCN+hZ8EQAjw=', 'Content-Length': '0'} 2023-12-15T23:22:22.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000123beaa06e62483f-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.793 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.793 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.793 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.794 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.794 DEBUG:boto:Method: GET 2023-12-15T23:22:22.794 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.794 DEBUG:boto:Data: 2023-12-15T23:22:22.794 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.794 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.794 DEBUG:boto:Params: {} 2023-12-15T23:22:22.794 DEBUG:boto:Token: None 2023-12-15T23:22:22.794 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.797 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000508f08307a8a88bf-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.797 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.797 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.797 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.797 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.798 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.798 DEBUG:boto:Method: GET 2023-12-15T23:22:22.798 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.798 DEBUG:boto:Data: 2023-12-15T23:22:22.798 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.798 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.798 DEBUG:boto:Params: {} 2023-12-15T23:22:22.798 DEBUG:boto:Token: None 2023-12-15T23:22:22.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd14446106dc362c-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.802 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.802 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.803 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.803 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.803 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:22:22.803 DEBUG:boto:Data: 2023-12-15T23:22:22.803 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.803 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.803 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.803 DEBUG:boto:Params: {} 2023-12-15T23:22:22.803 DEBUG:boto:Token: None 2023-12-15T23:22:22.803 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55 2023-12-15T23:22:22.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BszEQX5hglBRgSFp8PqKJbHXNcc= 2023-12-15T23:22:22.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BszEQX5hglBRgSFp8PqKJbHXNcc=', 'Content-Length': '0'} 2023-12-15T23:22:22.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034d75831f861cdf3-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.806 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.806 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.806 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.806 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:22:22.806 DEBUG:boto:Data: 2023-12-15T23:22:22.806 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.807 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.807 DEBUG:boto:Params: {} 2023-12-15T23:22:22.807 DEBUG:boto:Token: None 2023-12-15T23:22:22.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55 2023-12-15T23:22:22.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BszEQX5hglBRgSFp8PqKJbHXNcc= 2023-12-15T23:22:22.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BszEQX5hglBRgSFp8PqKJbHXNcc=', 'Content-Length': '0'} 2023-12-15T23:22:22.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab49de5d50269ac4-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:22:22.809 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.809 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.810 DEBUG:boto:Method: GET 2023-12-15T23:22:22.810 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:22:22.810 DEBUG:boto:Data: 2023-12-15T23:22:22.810 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.810 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.810 DEBUG:boto:Params: {} 2023-12-15T23:22:22.810 DEBUG:boto:Token: None 2023-12-15T23:22:22.810 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55 2023-12-15T23:22:22.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dz7G3cFT1r77Roex5ivNkeXjIb4= 2023-12-15T23:22:22.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dz7G3cFT1r77Roex5ivNkeXjIb4=', 'Content-Length': '0'} 2023-12-15T23:22:22.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022c15b17fd8243e2-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.854 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:22:22.854 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:22:22.854 DEBUG:boto:Method: GET 2023-12-15T23:22:22.854 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:22:22.854 DEBUG:boto:Data: 2023-12-15T23:22:22.854 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.854 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.854 DEBUG:boto:Params: {} 2023-12-15T23:22:22.854 DEBUG:boto:Token: None 2023-12-15T23:22:22.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj55 2023-12-15T23:22:22.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dz7G3cFT1r77Roex5ivNkeXjIb4= 2023-12-15T23:22:22.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dz7G3cFT1r77Roex5ivNkeXjIb4=', 'Content-Length': '0'} 2023-12-15T23:22:22.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e26c879cfcc844c5-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.857 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.858 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.858 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.858 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.858 DEBUG:boto:Method: GET 2023-12-15T23:22:22.858 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.858 DEBUG:boto:Data: 2023-12-15T23:22:22.858 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.858 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.858 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.858 DEBUG:boto:Params: {} 2023-12-15T23:22:22.859 DEBUG:boto:Token: None 2023-12-15T23:22:22.859 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001d48554c7a90b73-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.901 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.902 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.902 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.902 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.902 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.903 DEBUG:boto:Method: GET 2023-12-15T23:22:22.903 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:22:22.903 DEBUG:boto:Data: 2023-12-15T23:22:22.903 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.903 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.903 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.903 DEBUG:boto:Params: {} 2023-12-15T23:22:22.903 DEBUG:boto:Token: None 2023-12-15T23:22:22.903 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.904 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.907 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d820bb7d396ad8f5-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.907 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.908 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:22:22.908 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.908 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.908 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.908 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.908 DEBUG:boto:Method: GET 2023-12-15T23:22:22.908 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.908 DEBUG:boto:Data: 2023-12-15T23:22:22.909 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.909 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.909 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.909 DEBUG:boto:Params: {} 2023-12-15T23:22:22.909 DEBUG:boto:Token: None 2023-12-15T23:22:22.909 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.909 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU= 2023-12-15T23:22:22.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU=', 'Content-Length': '0'} 2023-12-15T23:22:22.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ead3d0c845272d2-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.912 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.912 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.912 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.912 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.912 DEBUG:boto:Method: GET 2023-12-15T23:22:22.912 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.912 DEBUG:boto:Data: 2023-12-15T23:22:22.912 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.912 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.912 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.913 DEBUG:boto:Params: {} 2023-12-15T23:22:22.913 DEBUG:boto:Token: None 2023-12-15T23:22:22.913 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.913 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU= 2023-12-15T23:22:22.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU=', 'Content-Length': '0'} 2023-12-15T23:22:22.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000318d5ef7aa76d02a-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.916 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.916 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.916 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.916 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.916 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.916 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.916 DEBUG:boto:Data: 2023-12-15T23:22:22.916 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.916 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.916 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.916 DEBUG:boto:Params: {} 2023-12-15T23:22:22.917 DEBUG:boto:Token: None 2023-12-15T23:22:22.917 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.917 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rT8LZ7SbuxJ/p8tcG/6JIKQfytY= 2023-12-15T23:22:22.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rT8LZ7SbuxJ/p8tcG/6JIKQfytY=', 'Content-Length': '0'} 2023-12-15T23:22:22.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9fc6936acd0fefc-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.919 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.920 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.920 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.920 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.920 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.920 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.920 DEBUG:boto:Data: 2023-12-15T23:22:22.920 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.920 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.920 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.920 DEBUG:boto:Params: {} 2023-12-15T23:22:22.920 DEBUG:boto:Token: None 2023-12-15T23:22:22.921 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.921 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rT8LZ7SbuxJ/p8tcG/6JIKQfytY= 2023-12-15T23:22:22.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rT8LZ7SbuxJ/p8tcG/6JIKQfytY=', 'Content-Length': '0'} 2023-12-15T23:22:22.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e89905e18a632eb-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:22:22.923 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.923 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.923 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.923 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.923 DEBUG:boto:Method: GET 2023-12-15T23:22:22.923 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.923 DEBUG:boto:Data: 2023-12-15T23:22:22.923 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.923 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.924 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.924 DEBUG:boto:Params: {} 2023-12-15T23:22:22.924 DEBUG:boto:Token: None 2023-12-15T23:22:22.924 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.924 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU= 2023-12-15T23:22:22.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU=', 'Content-Length': '0'} 2023-12-15T23:22:22.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e78947a02d5ba2b-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.974 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.974 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.974 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.974 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.974 DEBUG:boto:Method: GET 2023-12-15T23:22:22.974 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.974 DEBUG:boto:Data: 2023-12-15T23:22:22.974 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.975 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.975 DEBUG:boto:Params: {} 2023-12-15T23:22:22.975 DEBUG:boto:Token: None 2023-12-15T23:22:22.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:22:22.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU= 2023-12-15T23:22:22.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4ejX4WGJkOIcXNhdK3wRWhTv1bU=', 'Content-Length': '0'} 2023-12-15T23:22:22.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf724b9a53bcbbb9-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.978 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.978 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.978 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.978 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.978 DEBUG:boto:Method: GET 2023-12-15T23:22:22.978 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.978 DEBUG:boto:Data: 2023-12-15T23:22:22.978 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.978 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.979 DEBUG:boto:Params: {} 2023-12-15T23:22:22.979 DEBUG:boto:Token: None 2023-12-15T23:22:22.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fa040992563a826-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.981 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.982 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:22.982 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:22.982 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.982 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.982 DEBUG:boto:Method: GET 2023-12-15T23:22:22.982 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:22:22.982 DEBUG:boto:Data: 2023-12-15T23:22:22.982 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.982 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.983 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.983 DEBUG:boto:Params: {} 2023-12-15T23:22:22.983 DEBUG:boto:Token: None 2023-12-15T23:22:22.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/ 2023-12-15T23:22:22.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8= 2023-12-15T23:22:22.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E6xE1HFJGTovbUgAjU2Dkl2MiD8=', 'Content-Length': '0'} 2023-12-15T23:22:22.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0070a4f1c52bd4b-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.986 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:22.986 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.987 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.987 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.987 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:22:22.987 DEBUG:boto:Data: 2023-12-15T23:22:22.987 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.987 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.987 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.987 DEBUG:boto:Params: {} 2023-12-15T23:22:22.987 DEBUG:boto:Token: None 2023-12-15T23:22:22.987 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57 2023-12-15T23:22:22.988 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9Wes8zCNXw2OmyMf+SYMCHTIWFQ= 2023-12-15T23:22:22.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9Wes8zCNXw2OmyMf+SYMCHTIWFQ=', 'Content-Length': '0'} 2023-12-15T23:22:22.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080de9e51ab5fc7c9-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.990 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.990 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.990 DEBUG:boto:Method: HEAD 2023-12-15T23:22:22.990 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:22:22.990 DEBUG:boto:Data: 2023-12-15T23:22:22.990 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:22.990 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.991 DEBUG:boto:Params: {} 2023-12-15T23:22:22.991 DEBUG:boto:Token: None 2023-12-15T23:22:22.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57 2023-12-15T23:22:22.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9Wes8zCNXw2OmyMf+SYMCHTIWFQ= 2023-12-15T23:22:22.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9Wes8zCNXw2OmyMf+SYMCHTIWFQ=', 'Content-Length': '0'} 2023-12-15T23:22:22.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b174da261784e90-00657cdfae-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:22.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:22:22.993 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:22.994 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:22.994 DEBUG:boto:Method: GET 2023-12-15T23:22:22.994 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:22:22.994 DEBUG:boto:Data: 2023-12-15T23:22:22.994 DEBUG:boto:Headers: {} 2023-12-15T23:22:22.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:22.994 DEBUG:boto:Port: 8000 2023-12-15T23:22:22.994 DEBUG:boto:Params: {} 2023-12-15T23:22:22.994 DEBUG:boto:Token: None 2023-12-15T23:22:22.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:22 GMT /kskgfn-49/obj57 2023-12-15T23:22:22.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dRn0W9Jk9sLkYuu2/QICoVnSM+4= 2023-12-15T23:22:22.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:22 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dRn0W9Jk9sLkYuu2/QICoVnSM+4=', 'Content-Length': '0'} 2023-12-15T23:22:22.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a25d656bb9e8074e-00657cdfae-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:22 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.037 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:22:23.038 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:22:23.038 DEBUG:boto:Method: GET 2023-12-15T23:22:23.038 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:22:23.038 DEBUG:boto:Data: 2023-12-15T23:22:23.038 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.038 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.038 DEBUG:boto:Params: {} 2023-12-15T23:22:23.039 DEBUG:boto:Token: None 2023-12-15T23:22:23.039 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj57 2023-12-15T23:22:23.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j5tXxP4NhfPnYsDTFSzWyVK3wGs= 2023-12-15T23:22:23.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j5tXxP4NhfPnYsDTFSzWyVK3wGs=', 'Content-Length': '0'} 2023-12-15T23:22:23.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7a6363d03cf9dc9-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.041 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.042 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.042 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.042 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.042 DEBUG:boto:Method: GET 2023-12-15T23:22:23.042 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.042 DEBUG:boto:Data: 2023-12-15T23:22:23.042 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.042 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.042 DEBUG:boto:Params: {} 2023-12-15T23:22:23.043 DEBUG:boto:Token: None 2023-12-15T23:22:23.043 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007620c5c8eab0c883-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.045 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.046 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.046 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.046 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.046 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.046 DEBUG:boto:Method: GET 2023-12-15T23:22:23.046 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:22:23.046 DEBUG:boto:Data: 2023-12-15T23:22:23.046 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.047 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.047 DEBUG:boto:Params: {} 2023-12-15T23:22:23.047 DEBUG:boto:Token: None 2023-12-15T23:22:23.047 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070f11fa088e401fc-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.051 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:22:23.051 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.051 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.051 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.051 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.051 DEBUG:boto:Method: GET 2023-12-15T23:22:23.052 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.052 DEBUG:boto:Data: 2023-12-15T23:22:23.052 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.052 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.052 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.052 DEBUG:boto:Params: {} 2023-12-15T23:22:23.052 DEBUG:boto:Token: None 2023-12-15T23:22:23.052 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.052 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4= 2023-12-15T23:22:23.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4=', 'Content-Length': '0'} 2023-12-15T23:22:23.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e5a9c4184290cfe-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.055 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.055 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.055 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.055 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.055 DEBUG:boto:Method: GET 2023-12-15T23:22:23.055 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.055 DEBUG:boto:Data: 2023-12-15T23:22:23.055 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.056 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.056 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.056 DEBUG:boto:Params: {} 2023-12-15T23:22:23.056 DEBUG:boto:Token: None 2023-12-15T23:22:23.056 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.056 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4= 2023-12-15T23:22:23.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4=', 'Content-Length': '0'} 2023-12-15T23:22:23.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d109ee5481e72d6-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.058 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.058 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.059 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.059 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.059 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.059 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.059 DEBUG:boto:Data: 2023-12-15T23:22:23.059 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.059 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.059 DEBUG:boto:Params: {} 2023-12-15T23:22:23.059 DEBUG:boto:Token: None 2023-12-15T23:22:23.060 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wN6kYS2qw1bGPPAreKS/ClxQFxM= 2023-12-15T23:22:23.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wN6kYS2qw1bGPPAreKS/ClxQFxM=', 'Content-Length': '0'} 2023-12-15T23:22:23.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0ad1b78871b4c55-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.062 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.062 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.062 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.062 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.062 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.062 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.062 DEBUG:boto:Data: 2023-12-15T23:22:23.062 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.063 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.063 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.063 DEBUG:boto:Params: {} 2023-12-15T23:22:23.063 DEBUG:boto:Token: None 2023-12-15T23:22:23.063 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wN6kYS2qw1bGPPAreKS/ClxQFxM= 2023-12-15T23:22:23.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wN6kYS2qw1bGPPAreKS/ClxQFxM=', 'Content-Length': '0'} 2023-12-15T23:22:23.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019e054f1c650c025-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:22:23.065 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.065 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.065 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.065 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.066 DEBUG:boto:Method: GET 2023-12-15T23:22:23.066 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.066 DEBUG:boto:Data: 2023-12-15T23:22:23.066 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.066 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.066 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.066 DEBUG:boto:Params: {} 2023-12-15T23:22:23.066 DEBUG:boto:Token: None 2023-12-15T23:22:23.066 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4= 2023-12-15T23:22:23.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4=', 'Content-Length': '0'} 2023-12-15T23:22:23.068 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d76e9197da81fcd-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.113 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.114 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.114 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.114 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.114 DEBUG:boto:Method: GET 2023-12-15T23:22:23.114 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.114 DEBUG:boto:Data: 2023-12-15T23:22:23.114 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.114 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.114 DEBUG:boto:Params: {} 2023-12-15T23:22:23.115 DEBUG:boto:Token: None 2023-12-15T23:22:23.115 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:22:23.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4= 2023-12-15T23:22:23.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASmYnGXqN64eIF/Gfw4rI0K9xD4=', 'Content-Length': '0'} 2023-12-15T23:22:23.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c4d88bedb63a2e4-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.117 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.117 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.117 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.117 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.117 DEBUG:boto:Method: GET 2023-12-15T23:22:23.117 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.118 DEBUG:boto:Data: 2023-12-15T23:22:23.118 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.118 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.118 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.118 DEBUG:boto:Params: {} 2023-12-15T23:22:23.118 DEBUG:boto:Token: None 2023-12-15T23:22:23.118 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.120 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000766d460da6712bc4-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.120 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.121 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.121 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.121 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.121 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.121 DEBUG:boto:Method: GET 2023-12-15T23:22:23.121 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.121 DEBUG:boto:Data: 2023-12-15T23:22:23.121 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.121 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.122 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.122 DEBUG:boto:Params: {} 2023-12-15T23:22:23.122 DEBUG:boto:Token: None 2023-12-15T23:22:23.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.122 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093410fbfdbe03016-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.125 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.126 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.126 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.126 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.126 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:22:23.126 DEBUG:boto:Data: 2023-12-15T23:22:23.126 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.126 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.126 DEBUG:boto:Params: {} 2023-12-15T23:22:23.127 DEBUG:boto:Token: None 2023-12-15T23:22:23.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58 2023-12-15T23:22:23.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fj26nyqhFodtHnvCFkYACCurBPo= 2023-12-15T23:22:23.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fj26nyqhFodtHnvCFkYACCurBPo=', 'Content-Length': '0'} 2023-12-15T23:22:23.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5f916af90a02bab-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.129 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.129 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.129 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.129 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:22:23.129 DEBUG:boto:Data: 2023-12-15T23:22:23.129 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.129 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.129 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.130 DEBUG:boto:Params: {} 2023-12-15T23:22:23.130 DEBUG:boto:Token: None 2023-12-15T23:22:23.130 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58 2023-12-15T23:22:23.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fj26nyqhFodtHnvCFkYACCurBPo= 2023-12-15T23:22:23.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fj26nyqhFodtHnvCFkYACCurBPo=', 'Content-Length': '0'} 2023-12-15T23:22:23.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8a3bf348a2fdcd8-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:22:23.132 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.132 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.132 DEBUG:boto:Method: GET 2023-12-15T23:22:23.132 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:22:23.132 DEBUG:boto:Data: 2023-12-15T23:22:23.133 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.133 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.133 DEBUG:boto:Params: {} 2023-12-15T23:22:23.133 DEBUG:boto:Token: None 2023-12-15T23:22:23.133 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58 2023-12-15T23:22:23.133 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QQDEChbsX6BmPWkLUyJfhbdGodU= 2023-12-15T23:22:23.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QQDEChbsX6BmPWkLUyJfhbdGodU=', 'Content-Length': '0'} 2023-12-15T23:22:23.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000578725caf5692e0e-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.177 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:22:23.178 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:22:23.178 DEBUG:boto:Method: GET 2023-12-15T23:22:23.178 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:22:23.178 DEBUG:boto:Data: 2023-12-15T23:22:23.178 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.178 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.178 DEBUG:boto:Params: {} 2023-12-15T23:22:23.178 DEBUG:boto:Token: None 2023-12-15T23:22:23.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj58 2023-12-15T23:22:23.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QQDEChbsX6BmPWkLUyJfhbdGodU= 2023-12-15T23:22:23.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QQDEChbsX6BmPWkLUyJfhbdGodU=', 'Content-Length': '0'} 2023-12-15T23:22:23.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a8e7e5597d6e3c0-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.181 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.181 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.181 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.181 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.182 DEBUG:boto:Method: GET 2023-12-15T23:22:23.182 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.182 DEBUG:boto:Data: 2023-12-15T23:22:23.182 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.182 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.182 DEBUG:boto:Params: {} 2023-12-15T23:22:23.182 DEBUG:boto:Token: None 2023-12-15T23:22:23.182 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0c3eb343a0151b7-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.185 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.186 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.186 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.186 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.186 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.186 DEBUG:boto:Method: GET 2023-12-15T23:22:23.186 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:22:23.186 DEBUG:boto:Data: 2023-12-15T23:22:23.186 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.187 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.187 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.187 DEBUG:boto:Params: {} 2023-12-15T23:22:23.187 DEBUG:boto:Token: None 2023-12-15T23:22:23.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.190 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f4ad46776531039-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.191 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:22:23.191 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.191 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.191 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.191 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.192 DEBUG:boto:Method: GET 2023-12-15T23:22:23.192 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.192 DEBUG:boto:Data: 2023-12-15T23:22:23.192 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.192 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.192 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.192 DEBUG:boto:Params: {} 2023-12-15T23:22:23.192 DEBUG:boto:Token: None 2023-12-15T23:22:23.192 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y= 2023-12-15T23:22:23.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b223ae77c0a2cf5-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.195 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.196 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.196 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.196 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.196 DEBUG:boto:Method: GET 2023-12-15T23:22:23.196 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.196 DEBUG:boto:Data: 2023-12-15T23:22:23.196 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.196 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.196 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.197 DEBUG:boto:Params: {} 2023-12-15T23:22:23.197 DEBUG:boto:Token: None 2023-12-15T23:22:23.197 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y= 2023-12-15T23:22:23.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008caade7c19401fac-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.200 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.200 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.200 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.200 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.200 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.200 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.200 DEBUG:boto:Data: 2023-12-15T23:22:23.200 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.201 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.201 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.201 DEBUG:boto:Params: {} 2023-12-15T23:22:23.201 DEBUG:boto:Token: None 2023-12-15T23:22:23.201 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.201 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hc2OYHPldzup2seWpIW+CtjmUzc= 2023-12-15T23:22:23.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hc2OYHPldzup2seWpIW+CtjmUzc=', 'Content-Length': '0'} 2023-12-15T23:22:23.204 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052c31a91c2ffbfb1-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.204 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.205 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.205 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.205 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.205 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.205 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.205 DEBUG:boto:Data: 2023-12-15T23:22:23.205 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.205 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.206 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.206 DEBUG:boto:Params: {} 2023-12-15T23:22:23.206 DEBUG:boto:Token: None 2023-12-15T23:22:23.206 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hc2OYHPldzup2seWpIW+CtjmUzc= 2023-12-15T23:22:23.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hc2OYHPldzup2seWpIW+CtjmUzc=', 'Content-Length': '0'} 2023-12-15T23:22:23.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da9cb8b2e3d46d78-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:22:23.209 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.209 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.209 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.209 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.209 DEBUG:boto:Method: GET 2023-12-15T23:22:23.209 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.209 DEBUG:boto:Data: 2023-12-15T23:22:23.209 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.209 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.210 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.210 DEBUG:boto:Params: {} 2023-12-15T23:22:23.210 DEBUG:boto:Token: None 2023-12-15T23:22:23.210 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y= 2023-12-15T23:22:23.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032b9e5cbca54884c-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.253 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.254 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.254 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.254 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.254 DEBUG:boto:Method: GET 2023-12-15T23:22:23.254 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.254 DEBUG:boto:Data: 2023-12-15T23:22:23.254 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.254 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.254 DEBUG:boto:Params: {} 2023-12-15T23:22:23.255 DEBUG:boto:Token: None 2023-12-15T23:22:23.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:22:23.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y= 2023-12-15T23:22:23.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gq55QUulaaMFi67XnrSdFKqLR2Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b996e256db72bdb4-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.257 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.257 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.258 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.258 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.258 DEBUG:boto:Method: GET 2023-12-15T23:22:23.258 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.258 DEBUG:boto:Data: 2023-12-15T23:22:23.258 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.258 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.258 DEBUG:boto:Params: {} 2023-12-15T23:22:23.258 DEBUG:boto:Token: None 2023-12-15T23:22:23.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018eb73a4303cf643-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.261 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.262 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.262 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.262 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.262 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.262 DEBUG:boto:Method: GET 2023-12-15T23:22:23.262 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.262 DEBUG:boto:Data: 2023-12-15T23:22:23.262 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.263 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.263 DEBUG:boto:Params: {} 2023-12-15T23:22:23.263 DEBUG:boto:Token: None 2023-12-15T23:22:23.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005612116820229ef1-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.267 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.267 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.267 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.267 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.267 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:22:23.267 DEBUG:boto:Data: 2023-12-15T23:22:23.267 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.268 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.268 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.268 DEBUG:boto:Params: {} 2023-12-15T23:22:23.268 DEBUG:boto:Token: None 2023-12-15T23:22:23.268 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68 2023-12-15T23:22:23.268 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHRBMrEa7ZgesMDvsYqm1ZPSDNo= 2023-12-15T23:22:23.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHRBMrEa7ZgesMDvsYqm1ZPSDNo=', 'Content-Length': '0'} 2023-12-15T23:22:23.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca4b4a3b00c3060b-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.270 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.271 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.271 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.271 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:22:23.271 DEBUG:boto:Data: 2023-12-15T23:22:23.271 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.271 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.271 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.271 DEBUG:boto:Params: {} 2023-12-15T23:22:23.271 DEBUG:boto:Token: None 2023-12-15T23:22:23.271 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68 2023-12-15T23:22:23.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gHRBMrEa7ZgesMDvsYqm1ZPSDNo= 2023-12-15T23:22:23.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gHRBMrEa7ZgesMDvsYqm1ZPSDNo=', 'Content-Length': '0'} 2023-12-15T23:22:23.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc3c9b542d049652-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:22:23.274 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.274 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.274 DEBUG:boto:Method: GET 2023-12-15T23:22:23.274 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:22:23.275 DEBUG:boto:Data: 2023-12-15T23:22:23.275 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.275 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.275 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.275 DEBUG:boto:Params: {} 2023-12-15T23:22:23.275 DEBUG:boto:Token: None 2023-12-15T23:22:23.275 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68 2023-12-15T23:22:23.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZjhPVEDO2fPHnM2YtRUSIuIFzEc= 2023-12-15T23:22:23.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZjhPVEDO2fPHnM2YtRUSIuIFzEc=', 'Content-Length': '0'} 2023-12-15T23:22:23.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2a98df468a9eaa0-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.325 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:22:23.326 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:22:23.326 DEBUG:boto:Method: GET 2023-12-15T23:22:23.326 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:22:23.326 DEBUG:boto:Data: 2023-12-15T23:22:23.326 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.326 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.326 DEBUG:boto:Params: {} 2023-12-15T23:22:23.326 DEBUG:boto:Token: None 2023-12-15T23:22:23.327 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj68 2023-12-15T23:22:23.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZjhPVEDO2fPHnM2YtRUSIuIFzEc= 2023-12-15T23:22:23.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZjhPVEDO2fPHnM2YtRUSIuIFzEc=', 'Content-Length': '0'} 2023-12-15T23:22:23.329 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bc1625cfb3e7130-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.329 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.329 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.329 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.330 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.330 DEBUG:boto:Method: GET 2023-12-15T23:22:23.330 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.330 DEBUG:boto:Data: 2023-12-15T23:22:23.330 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.330 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.330 DEBUG:boto:Params: {} 2023-12-15T23:22:23.330 DEBUG:boto:Token: None 2023-12-15T23:22:23.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000343f586b8491160-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.333 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.333 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.334 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.334 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.334 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.334 DEBUG:boto:Method: GET 2023-12-15T23:22:23.334 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:22:23.334 DEBUG:boto:Data: 2023-12-15T23:22:23.334 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.334 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.334 DEBUG:boto:Params: {} 2023-12-15T23:22:23.334 DEBUG:boto:Token: None 2023-12-15T23:22:23.335 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.335 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001e77cb501baeeec-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.338 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:22:23.339 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.339 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.339 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.339 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.339 DEBUG:boto:Method: GET 2023-12-15T23:22:23.339 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.339 DEBUG:boto:Data: 2023-12-15T23:22:23.339 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.339 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.339 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.339 DEBUG:boto:Params: {} 2023-12-15T23:22:23.340 DEBUG:boto:Token: None 2023-12-15T23:22:23.340 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.340 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM= 2023-12-15T23:22:23.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM=', 'Content-Length': '0'} 2023-12-15T23:22:23.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d62c456590526c03-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.343 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.343 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.343 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.343 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.343 DEBUG:boto:Method: GET 2023-12-15T23:22:23.343 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.343 DEBUG:boto:Data: 2023-12-15T23:22:23.343 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.343 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.343 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.343 DEBUG:boto:Params: {} 2023-12-15T23:22:23.344 DEBUG:boto:Token: None 2023-12-15T23:22:23.344 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM= 2023-12-15T23:22:23.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM=', 'Content-Length': '0'} 2023-12-15T23:22:23.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ed25bb7adbe1cdd-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.389 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.390 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.390 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.390 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.390 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.390 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.390 DEBUG:boto:Data: 2023-12-15T23:22:23.390 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.390 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.390 DEBUG:boto:Params: {} 2023-12-15T23:22:23.391 DEBUG:boto:Token: None 2023-12-15T23:22:23.391 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B2E1f5sT0tKOvqlmfHCNg1cNe6Y= 2023-12-15T23:22:23.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B2E1f5sT0tKOvqlmfHCNg1cNe6Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0ab6766e778ad3e-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.393 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.393 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.394 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.394 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.394 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.394 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.394 DEBUG:boto:Data: 2023-12-15T23:22:23.394 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.394 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.394 DEBUG:boto:Params: {} 2023-12-15T23:22:23.394 DEBUG:boto:Token: None 2023-12-15T23:22:23.394 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:B2E1f5sT0tKOvqlmfHCNg1cNe6Y= 2023-12-15T23:22:23.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:B2E1f5sT0tKOvqlmfHCNg1cNe6Y=', 'Content-Length': '0'} 2023-12-15T23:22:23.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cab420dd44e5f74a-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:22:23.397 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.397 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.397 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.397 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.397 DEBUG:boto:Method: GET 2023-12-15T23:22:23.397 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.398 DEBUG:boto:Data: 2023-12-15T23:22:23.398 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.398 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.398 DEBUG:boto:Params: {} 2023-12-15T23:22:23.398 DEBUG:boto:Token: None 2023-12-15T23:22:23.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM= 2023-12-15T23:22:23.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM=', 'Content-Length': '0'} 2023-12-15T23:22:23.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000455621581df6f927-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.441 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.442 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.442 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.442 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.442 DEBUG:boto:Method: GET 2023-12-15T23:22:23.442 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.442 DEBUG:boto:Data: 2023-12-15T23:22:23.442 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.442 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.442 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.443 DEBUG:boto:Params: {} 2023-12-15T23:22:23.443 DEBUG:boto:Token: None 2023-12-15T23:22:23.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:22:23.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM= 2023-12-15T23:22:23.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/o13Qvtm8VMisxImh0eSa7BFTdM=', 'Content-Length': '0'} 2023-12-15T23:22:23.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059f0544f7a9e7054-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.446 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.446 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.446 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.446 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.446 DEBUG:boto:Method: GET 2023-12-15T23:22:23.446 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.446 DEBUG:boto:Data: 2023-12-15T23:22:23.446 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.446 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.446 DEBUG:boto:Params: {} 2023-12-15T23:22:23.447 DEBUG:boto:Token: None 2023-12-15T23:22:23.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a3b5cb4959adee2-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.449 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.450 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.450 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.450 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.450 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.450 DEBUG:boto:Method: GET 2023-12-15T23:22:23.450 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.450 DEBUG:boto:Data: 2023-12-15T23:22:23.450 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.450 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.451 DEBUG:boto:Params: {} 2023-12-15T23:22:23.451 DEBUG:boto:Token: None 2023-12-15T23:22:23.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3a1af0f6954f28c-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.454 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.454 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.455 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.455 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.455 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:22:23.455 DEBUG:boto:Data: 2023-12-15T23:22:23.455 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.455 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.455 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.455 DEBUG:boto:Params: {} 2023-12-15T23:22:23.455 DEBUG:boto:Token: None 2023-12-15T23:22:23.455 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69 2023-12-15T23:22:23.456 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rSlq77qorM/P295ymUtr2hlkrgM= 2023-12-15T23:22:23.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rSlq77qorM/P295ymUtr2hlkrgM=', 'Content-Length': '0'} 2023-12-15T23:22:23.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015052a8cb844caf8-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.458 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.458 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.458 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.459 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:22:23.459 DEBUG:boto:Data: 2023-12-15T23:22:23.459 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.459 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.459 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.459 DEBUG:boto:Params: {} 2023-12-15T23:22:23.459 DEBUG:boto:Token: None 2023-12-15T23:22:23.459 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69 2023-12-15T23:22:23.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rSlq77qorM/P295ymUtr2hlkrgM= 2023-12-15T23:22:23.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rSlq77qorM/P295ymUtr2hlkrgM=', 'Content-Length': '0'} 2023-12-15T23:22:23.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b4e56c17b0c8347-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:22:23.462 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.462 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.462 DEBUG:boto:Method: GET 2023-12-15T23:22:23.462 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:22:23.462 DEBUG:boto:Data: 2023-12-15T23:22:23.462 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.462 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.462 DEBUG:boto:Params: {} 2023-12-15T23:22:23.463 DEBUG:boto:Token: None 2023-12-15T23:22:23.463 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69 2023-12-15T23:22:23.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sm5FbzI22RiwLcX38qzQo1Fr1PI= 2023-12-15T23:22:23.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sm5FbzI22RiwLcX38qzQo1Fr1PI=', 'Content-Length': '0'} 2023-12-15T23:22:23.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030cb96cd49057540-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.505 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:22:23.506 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:22:23.506 DEBUG:boto:Method: GET 2023-12-15T23:22:23.506 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:22:23.506 DEBUG:boto:Data: 2023-12-15T23:22:23.506 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.506 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.506 DEBUG:boto:Params: {} 2023-12-15T23:22:23.507 DEBUG:boto:Token: None 2023-12-15T23:22:23.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj69 2023-12-15T23:22:23.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sm5FbzI22RiwLcX38qzQo1Fr1PI= 2023-12-15T23:22:23.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sm5FbzI22RiwLcX38qzQo1Fr1PI=', 'Content-Length': '0'} 2023-12-15T23:22:23.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fde6fa4696dc4fa-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.509 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.509 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.510 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.510 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.510 DEBUG:boto:Method: GET 2023-12-15T23:22:23.510 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.510 DEBUG:boto:Data: 2023-12-15T23:22:23.510 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.510 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.510 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.510 DEBUG:boto:Params: {} 2023-12-15T23:22:23.510 DEBUG:boto:Token: None 2023-12-15T23:22:23.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030eb1d8474120b46-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.513 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.514 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.514 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.514 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.514 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.514 DEBUG:boto:Method: GET 2023-12-15T23:22:23.514 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:22:23.514 DEBUG:boto:Data: 2023-12-15T23:22:23.514 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.514 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.515 DEBUG:boto:Params: {} 2023-12-15T23:22:23.515 DEBUG:boto:Token: None 2023-12-15T23:22:23.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ff09f7add2b738f-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.518 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.519 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:22:23.519 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.519 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.519 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.519 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.519 DEBUG:boto:Method: GET 2023-12-15T23:22:23.519 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.519 DEBUG:boto:Data: 2023-12-15T23:22:23.519 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.520 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.520 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.520 DEBUG:boto:Params: {} 2023-12-15T23:22:23.520 DEBUG:boto:Token: None 2023-12-15T23:22:23.520 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.520 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE= 2023-12-15T23:22:23.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE=', 'Content-Length': '0'} 2023-12-15T23:22:23.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082de61512016e631-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.523 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.523 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.523 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.523 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.523 DEBUG:boto:Method: GET 2023-12-15T23:22:23.523 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.523 DEBUG:boto:Data: 2023-12-15T23:22:23.523 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.523 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.523 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.524 DEBUG:boto:Params: {} 2023-12-15T23:22:23.524 DEBUG:boto:Token: None 2023-12-15T23:22:23.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE= 2023-12-15T23:22:23.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE=', 'Content-Length': '0'} 2023-12-15T23:22:23.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fcd04323a6a875f-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.526 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.527 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.527 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.527 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.527 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.527 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.527 DEBUG:boto:Data: 2023-12-15T23:22:23.527 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.527 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.527 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.527 DEBUG:boto:Params: {} 2023-12-15T23:22:23.528 DEBUG:boto:Token: None 2023-12-15T23:22:23.528 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjwfKiNVMpmcKwpZH64W7psvQE8= 2023-12-15T23:22:23.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjwfKiNVMpmcKwpZH64W7psvQE8=', 'Content-Length': '0'} 2023-12-15T23:22:23.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b484ad52130dd60e-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.530 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.530 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.530 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.530 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.530 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.530 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.530 DEBUG:boto:Data: 2023-12-15T23:22:23.530 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.531 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.531 DEBUG:boto:Params: {} 2023-12-15T23:22:23.531 DEBUG:boto:Token: None 2023-12-15T23:22:23.531 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjwfKiNVMpmcKwpZH64W7psvQE8= 2023-12-15T23:22:23.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjwfKiNVMpmcKwpZH64W7psvQE8=', 'Content-Length': '0'} 2023-12-15T23:22:23.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fed2a68ff423ad24-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:22:23.533 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.533 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.534 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.534 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.534 DEBUG:boto:Method: GET 2023-12-15T23:22:23.534 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.534 DEBUG:boto:Data: 2023-12-15T23:22:23.534 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.534 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.534 DEBUG:boto:Params: {} 2023-12-15T23:22:23.534 DEBUG:boto:Token: None 2023-12-15T23:22:23.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE= 2023-12-15T23:22:23.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE=', 'Content-Length': '0'} 2023-12-15T23:22:23.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017151200744dcef8-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.577 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.578 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.578 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.578 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.578 DEBUG:boto:Method: GET 2023-12-15T23:22:23.578 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.578 DEBUG:boto:Data: 2023-12-15T23:22:23.578 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.578 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.578 DEBUG:boto:Params: {} 2023-12-15T23:22:23.579 DEBUG:boto:Token: None 2023-12-15T23:22:23.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:22:23.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE= 2023-12-15T23:22:23.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m781oYSguc/MiA13vpzzFAL06EE=', 'Content-Length': '0'} 2023-12-15T23:22:23.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006420d3bf3dd9a128-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.582 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.582 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.582 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.582 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.582 DEBUG:boto:Method: GET 2023-12-15T23:22:23.582 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.582 DEBUG:boto:Data: 2023-12-15T23:22:23.582 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.582 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.583 DEBUG:boto:Params: {} 2023-12-15T23:22:23.583 DEBUG:boto:Token: None 2023-12-15T23:22:23.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e771c6351f5429db-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.586 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.586 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.586 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.586 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.586 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.586 DEBUG:boto:Method: GET 2023-12-15T23:22:23.586 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.587 DEBUG:boto:Data: 2023-12-15T23:22:23.587 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.587 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.587 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.587 DEBUG:boto:Params: {} 2023-12-15T23:22:23.587 DEBUG:boto:Token: None 2023-12-15T23:22:23.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000678af7638ac51fb6-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.591 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.591 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.591 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.591 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.592 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:22:23.592 DEBUG:boto:Data: 2023-12-15T23:22:23.592 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.592 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.592 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.592 DEBUG:boto:Params: {} 2023-12-15T23:22:23.592 DEBUG:boto:Token: None 2023-12-15T23:22:23.592 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76 2023-12-15T23:22:23.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:biD/GXxZm8LkwOM95qDlcI7WAy8= 2023-12-15T23:22:23.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:biD/GXxZm8LkwOM95qDlcI7WAy8=', 'Content-Length': '0'} 2023-12-15T23:22:23.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004671a20802c43d2a-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.595 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.595 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.595 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.595 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:22:23.595 DEBUG:boto:Data: 2023-12-15T23:22:23.596 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.596 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.596 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.596 DEBUG:boto:Params: {} 2023-12-15T23:22:23.596 DEBUG:boto:Token: None 2023-12-15T23:22:23.596 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76 2023-12-15T23:22:23.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:biD/GXxZm8LkwOM95qDlcI7WAy8= 2023-12-15T23:22:23.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:biD/GXxZm8LkwOM95qDlcI7WAy8=', 'Content-Length': '0'} 2023-12-15T23:22:23.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080d123a041b17bec-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:22:23.598 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.599 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.599 DEBUG:boto:Method: GET 2023-12-15T23:22:23.599 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:22:23.599 DEBUG:boto:Data: 2023-12-15T23:22:23.599 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.599 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.599 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.599 DEBUG:boto:Params: {} 2023-12-15T23:22:23.600 DEBUG:boto:Token: None 2023-12-15T23:22:23.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76 2023-12-15T23:22:23.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HQ7+IJOoeAden27r3l5xCpQUWB0= 2023-12-15T23:22:23.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HQ7+IJOoeAden27r3l5xCpQUWB0=', 'Content-Length': '0'} 2023-12-15T23:22:23.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c7400ac55e23f43-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.645 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:22:23.646 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:22:23.646 DEBUG:boto:Method: GET 2023-12-15T23:22:23.646 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:22:23.646 DEBUG:boto:Data: 2023-12-15T23:22:23.646 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.646 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.646 DEBUG:boto:Params: {} 2023-12-15T23:22:23.647 DEBUG:boto:Token: None 2023-12-15T23:22:23.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj76 2023-12-15T23:22:23.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HQ7+IJOoeAden27r3l5xCpQUWB0= 2023-12-15T23:22:23.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HQ7+IJOoeAden27r3l5xCpQUWB0=', 'Content-Length': '0'} 2023-12-15T23:22:23.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a9159986ede42aa-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.651 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.651 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.651 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.651 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.651 DEBUG:boto:Method: GET 2023-12-15T23:22:23.651 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.652 DEBUG:boto:Data: 2023-12-15T23:22:23.652 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.652 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.652 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.652 DEBUG:boto:Params: {} 2023-12-15T23:22:23.652 DEBUG:boto:Token: None 2023-12-15T23:22:23.652 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.652 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.655 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001434852cb754dc62-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.655 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.655 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.655 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.656 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.656 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.656 DEBUG:boto:Method: GET 2023-12-15T23:22:23.656 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:22:23.656 DEBUG:boto:Data: 2023-12-15T23:22:23.656 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.656 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.656 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.656 DEBUG:boto:Params: {} 2023-12-15T23:22:23.656 DEBUG:boto:Token: None 2023-12-15T23:22:23.656 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039a4faa115f193f6-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.660 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.660 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:22:23.660 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.661 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.661 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.661 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.661 DEBUG:boto:Method: GET 2023-12-15T23:22:23.661 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.661 DEBUG:boto:Data: 2023-12-15T23:22:23.661 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.661 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.661 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.661 DEBUG:boto:Params: {} 2023-12-15T23:22:23.662 DEBUG:boto:Token: None 2023-12-15T23:22:23.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk= 2023-12-15T23:22:23.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk=', 'Content-Length': '0'} 2023-12-15T23:22:23.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046fd256c0f5464a1-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.664 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.665 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.665 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.665 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.665 DEBUG:boto:Method: GET 2023-12-15T23:22:23.665 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.665 DEBUG:boto:Data: 2023-12-15T23:22:23.665 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.665 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.665 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.665 DEBUG:boto:Params: {} 2023-12-15T23:22:23.665 DEBUG:boto:Token: None 2023-12-15T23:22:23.666 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk= 2023-12-15T23:22:23.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk=', 'Content-Length': '0'} 2023-12-15T23:22:23.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006106e1aa9179268d-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.668 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.668 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.668 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.668 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.668 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.668 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.668 DEBUG:boto:Data: 2023-12-15T23:22:23.668 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.668 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.668 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.669 DEBUG:boto:Params: {} 2023-12-15T23:22:23.669 DEBUG:boto:Token: None 2023-12-15T23:22:23.669 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.669 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LYsj0jqIN5wCQhwWscVLkb8T+3w= 2023-12-15T23:22:23.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LYsj0jqIN5wCQhwWscVLkb8T+3w=', 'Content-Length': '0'} 2023-12-15T23:22:23.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031cd50f575c7bdd8-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.672 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.672 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.672 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.672 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.672 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.672 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.672 DEBUG:boto:Data: 2023-12-15T23:22:23.672 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.672 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.672 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.672 DEBUG:boto:Params: {} 2023-12-15T23:22:23.673 DEBUG:boto:Token: None 2023-12-15T23:22:23.673 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LYsj0jqIN5wCQhwWscVLkb8T+3w= 2023-12-15T23:22:23.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LYsj0jqIN5wCQhwWscVLkb8T+3w=', 'Content-Length': '0'} 2023-12-15T23:22:23.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b342f74b1600b61-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:22:23.675 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.676 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.676 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.676 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.676 DEBUG:boto:Method: GET 2023-12-15T23:22:23.676 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.676 DEBUG:boto:Data: 2023-12-15T23:22:23.676 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.676 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.676 DEBUG:boto:Params: {} 2023-12-15T23:22:23.676 DEBUG:boto:Token: None 2023-12-15T23:22:23.677 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk= 2023-12-15T23:22:23.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk=', 'Content-Length': '0'} 2023-12-15T23:22:23.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5b60ac7ae2743fc-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.721 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.722 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.722 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.722 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.722 DEBUG:boto:Method: GET 2023-12-15T23:22:23.722 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.722 DEBUG:boto:Data: 2023-12-15T23:22:23.722 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.722 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.722 DEBUG:boto:Params: {} 2023-12-15T23:22:23.723 DEBUG:boto:Token: None 2023-12-15T23:22:23.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:22:23.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk= 2023-12-15T23:22:23.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:47mRBYOzJ+VMm9cvoYEZJA4XDVk=', 'Content-Length': '0'} 2023-12-15T23:22:23.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7335b2fbc85bb93-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.725 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.725 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.725 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.726 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.726 DEBUG:boto:Method: GET 2023-12-15T23:22:23.726 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.726 DEBUG:boto:Data: 2023-12-15T23:22:23.726 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.726 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.726 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.726 DEBUG:boto:Params: {} 2023-12-15T23:22:23.726 DEBUG:boto:Token: None 2023-12-15T23:22:23.726 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.729 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d77f1e82d75f4866-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.769 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.770 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.770 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.770 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.770 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.770 DEBUG:boto:Method: GET 2023-12-15T23:22:23.770 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.770 DEBUG:boto:Data: 2023-12-15T23:22:23.770 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.771 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.771 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.771 DEBUG:boto:Params: {} 2023-12-15T23:22:23.771 DEBUG:boto:Token: None 2023-12-15T23:22:23.771 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.774 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d5ba89463c52560-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.775 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.775 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.775 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.775 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.775 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:22:23.775 DEBUG:boto:Data: 2023-12-15T23:22:23.775 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.776 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.776 DEBUG:boto:Params: {} 2023-12-15T23:22:23.776 DEBUG:boto:Token: None 2023-12-15T23:22:23.776 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85 2023-12-15T23:22:23.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1eF7ott7+PVTI3L9MgBgW8CYylk= 2023-12-15T23:22:23.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1eF7ott7+PVTI3L9MgBgW8CYylk=', 'Content-Length': '0'} 2023-12-15T23:22:23.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065ab22f9765f7926-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.778 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.778 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.779 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.779 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:22:23.779 DEBUG:boto:Data: 2023-12-15T23:22:23.779 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.779 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.779 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.779 DEBUG:boto:Params: {} 2023-12-15T23:22:23.779 DEBUG:boto:Token: None 2023-12-15T23:22:23.779 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85 2023-12-15T23:22:23.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1eF7ott7+PVTI3L9MgBgW8CYylk= 2023-12-15T23:22:23.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1eF7ott7+PVTI3L9MgBgW8CYylk=', 'Content-Length': '0'} 2023-12-15T23:22:23.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066c3bd625e7f95fa-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:22:23.781 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.782 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.782 DEBUG:boto:Method: GET 2023-12-15T23:22:23.782 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:22:23.782 DEBUG:boto:Data: 2023-12-15T23:22:23.782 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.782 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.782 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.782 DEBUG:boto:Params: {} 2023-12-15T23:22:23.782 DEBUG:boto:Token: None 2023-12-15T23:22:23.782 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85 2023-12-15T23:22:23.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WCe2aHIt1AEnNymZ+iPstbBtJIE= 2023-12-15T23:22:23.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WCe2aHIt1AEnNymZ+iPstbBtJIE=', 'Content-Length': '0'} 2023-12-15T23:22:23.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003298eb18e082776c-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.829 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:22:23.829 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:22:23.830 DEBUG:boto:Method: GET 2023-12-15T23:22:23.830 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:22:23.830 DEBUG:boto:Data: 2023-12-15T23:22:23.830 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.830 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.830 DEBUG:boto:Params: {} 2023-12-15T23:22:23.830 DEBUG:boto:Token: None 2023-12-15T23:22:23.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj85 2023-12-15T23:22:23.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WCe2aHIt1AEnNymZ+iPstbBtJIE= 2023-12-15T23:22:23.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WCe2aHIt1AEnNymZ+iPstbBtJIE=', 'Content-Length': '0'} 2023-12-15T23:22:23.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2455e40874c0ac9-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.833 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.833 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.833 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.833 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.833 DEBUG:boto:Method: GET 2023-12-15T23:22:23.833 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.834 DEBUG:boto:Data: 2023-12-15T23:22:23.834 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.834 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.834 DEBUG:boto:Params: {} 2023-12-15T23:22:23.834 DEBUG:boto:Token: None 2023-12-15T23:22:23.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000133ee996c1b861b-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.877 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.878 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.878 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.878 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.878 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.878 DEBUG:boto:Method: GET 2023-12-15T23:22:23.878 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:22:23.878 DEBUG:boto:Data: 2023-12-15T23:22:23.879 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.879 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.879 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.879 DEBUG:boto:Params: {} 2023-12-15T23:22:23.879 DEBUG:boto:Token: None 2023-12-15T23:22:23.879 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083d72abc3712e11e-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.882 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.883 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:22:23.883 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.883 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.883 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.883 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.883 DEBUG:boto:Method: GET 2023-12-15T23:22:23.883 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.883 DEBUG:boto:Data: 2023-12-15T23:22:23.883 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.883 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.884 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.884 DEBUG:boto:Params: {} 2023-12-15T23:22:23.884 DEBUG:boto:Token: None 2023-12-15T23:22:23.884 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM= 2023-12-15T23:22:23.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM=', 'Content-Length': '0'} 2023-12-15T23:22:23.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002f4e02b297f121c-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.887 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.887 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.887 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.887 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.887 DEBUG:boto:Method: GET 2023-12-15T23:22:23.887 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.888 DEBUG:boto:Data: 2023-12-15T23:22:23.888 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.888 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.888 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.888 DEBUG:boto:Params: {} 2023-12-15T23:22:23.888 DEBUG:boto:Token: None 2023-12-15T23:22:23.889 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.889 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM= 2023-12-15T23:22:23.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM=', 'Content-Length': '0'} 2023-12-15T23:22:23.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfde3059e8fb7e22-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.891 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.891 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.891 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.891 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.891 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.891 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.891 DEBUG:boto:Data: 2023-12-15T23:22:23.892 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.892 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.892 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.892 DEBUG:boto:Params: {} 2023-12-15T23:22:23.892 DEBUG:boto:Token: None 2023-12-15T23:22:23.892 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.892 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWGsnzOapo5CID3CtDcapJB4AWo= 2023-12-15T23:22:23.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWGsnzOapo5CID3CtDcapJB4AWo=', 'Content-Length': '0'} 2023-12-15T23:22:23.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b447000a719a361-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.894 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.894 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.894 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.894 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.894 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.895 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.895 DEBUG:boto:Data: 2023-12-15T23:22:23.895 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.895 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.895 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.895 DEBUG:boto:Params: {} 2023-12-15T23:22:23.895 DEBUG:boto:Token: None 2023-12-15T23:22:23.895 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWGsnzOapo5CID3CtDcapJB4AWo= 2023-12-15T23:22:23.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWGsnzOapo5CID3CtDcapJB4AWo=', 'Content-Length': '0'} 2023-12-15T23:22:23.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc55342e8a57af4f-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:22:23.897 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.898 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.898 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.898 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.898 DEBUG:boto:Method: GET 2023-12-15T23:22:23.898 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.898 DEBUG:boto:Data: 2023-12-15T23:22:23.898 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.898 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.898 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.898 DEBUG:boto:Params: {} 2023-12-15T23:22:23.898 DEBUG:boto:Token: None 2023-12-15T23:22:23.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM= 2023-12-15T23:22:23.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM=', 'Content-Length': '0'} 2023-12-15T23:22:23.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edd344afdb3bb0f5-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.941 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.942 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.942 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.942 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.942 DEBUG:boto:Method: GET 2023-12-15T23:22:23.942 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.942 DEBUG:boto:Data: 2023-12-15T23:22:23.942 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.942 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.942 DEBUG:boto:Params: {} 2023-12-15T23:22:23.943 DEBUG:boto:Token: None 2023-12-15T23:22:23.943 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:22:23.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM= 2023-12-15T23:22:23.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xHXuwhiP06IjorF7t4Qi7+nTZCM=', 'Content-Length': '0'} 2023-12-15T23:22:23.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000757268437e6e6eb9-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.945 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.945 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.945 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.945 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.945 DEBUG:boto:Method: GET 2023-12-15T23:22:23.946 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.946 DEBUG:boto:Data: 2023-12-15T23:22:23.946 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.946 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.946 DEBUG:boto:Params: {} 2023-12-15T23:22:23.946 DEBUG:boto:Token: None 2023-12-15T23:22:23.946 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000762db0d20ab2542a-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.949 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.950 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:23.950 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:23.950 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.950 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.950 DEBUG:boto:Method: GET 2023-12-15T23:22:23.950 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:22:23.950 DEBUG:boto:Data: 2023-12-15T23:22:23.951 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.951 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.951 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.951 DEBUG:boto:Params: {} 2023-12-15T23:22:23.951 DEBUG:boto:Token: None 2023-12-15T23:22:23.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/ 2023-12-15T23:22:23.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8= 2023-12-15T23:22:23.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N9deBriOdVxsiLMQV+NGJezY3b8=', 'Content-Length': '0'} 2023-12-15T23:22:23.954 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067f2ff3464d7558b-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.954 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:23.955 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.955 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.955 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.955 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:22:23.955 DEBUG:boto:Data: 2023-12-15T23:22:23.955 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.955 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.955 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.956 DEBUG:boto:Params: {} 2023-12-15T23:22:23.956 DEBUG:boto:Token: None 2023-12-15T23:22:23.956 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87 2023-12-15T23:22:23.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HqrNVqEachA72uxv4T2MlC4kXIE= 2023-12-15T23:22:23.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HqrNVqEachA72uxv4T2MlC4kXIE=', 'Content-Length': '0'} 2023-12-15T23:22:23.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099db798748a3e107-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.958 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.958 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.958 DEBUG:boto:Method: HEAD 2023-12-15T23:22:23.958 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:22:23.958 DEBUG:boto:Data: 2023-12-15T23:22:23.958 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:23.959 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.959 DEBUG:boto:Params: {} 2023-12-15T23:22:23.959 DEBUG:boto:Token: None 2023-12-15T23:22:23.959 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87 2023-12-15T23:22:23.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HqrNVqEachA72uxv4T2MlC4kXIE= 2023-12-15T23:22:23.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HqrNVqEachA72uxv4T2MlC4kXIE=', 'Content-Length': '0'} 2023-12-15T23:22:23.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088e64861e99d6a4b-00657cdfaf-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:23.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:22:23.961 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:23.961 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:23.961 DEBUG:boto:Method: GET 2023-12-15T23:22:23.961 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:22:23.961 DEBUG:boto:Data: 2023-12-15T23:22:23.962 DEBUG:boto:Headers: {} 2023-12-15T23:22:23.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:23.962 DEBUG:boto:Port: 8000 2023-12-15T23:22:23.962 DEBUG:boto:Params: {} 2023-12-15T23:22:23.962 DEBUG:boto:Token: None 2023-12-15T23:22:23.962 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:23 GMT /kskgfn-49/obj87 2023-12-15T23:22:23.962 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NkVXms8UhGWl2BJRLhmll0yn6D8= 2023-12-15T23:22:23.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NkVXms8UhGWl2BJRLhmll0yn6D8=', 'Content-Length': '0'} 2023-12-15T23:22:23.964 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058b66e987f55632c-00657cdfaf-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.005 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:22:24.006 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:22:24.006 DEBUG:boto:Method: GET 2023-12-15T23:22:24.006 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:22:24.006 DEBUG:boto:Data: 2023-12-15T23:22:24.006 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.006 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.006 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.006 DEBUG:boto:Params: {} 2023-12-15T23:22:24.007 DEBUG:boto:Token: None 2023-12-15T23:22:24.007 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj87 2023-12-15T23:22:24.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2Gmcie1yOFkA/oRT9mwvKcBp8pc= 2023-12-15T23:22:24.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2Gmcie1yOFkA/oRT9mwvKcBp8pc=', 'Content-Length': '0'} 2023-12-15T23:22:24.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000debaf80c8efdcfb6-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.009 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.009 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.009 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.009 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.010 DEBUG:boto:Method: GET 2023-12-15T23:22:24.010 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.010 DEBUG:boto:Data: 2023-12-15T23:22:24.010 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.010 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.010 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.010 DEBUG:boto:Params: {} 2023-12-15T23:22:24.010 DEBUG:boto:Token: None 2023-12-15T23:22:24.010 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.013 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f229ff637dd787cb-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.013 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.013 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.014 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.014 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.014 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.014 DEBUG:boto:Method: GET 2023-12-15T23:22:24.014 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:22:24.014 DEBUG:boto:Data: 2023-12-15T23:22:24.014 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.014 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.014 DEBUG:boto:Params: {} 2023-12-15T23:22:24.015 DEBUG:boto:Token: None 2023-12-15T23:22:24.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003be0d7f35d80c79a-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.018 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:22:24.019 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.019 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.019 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.019 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.019 DEBUG:boto:Method: GET 2023-12-15T23:22:24.019 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.019 DEBUG:boto:Data: 2023-12-15T23:22:24.020 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.020 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.020 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.020 DEBUG:boto:Params: {} 2023-12-15T23:22:24.020 DEBUG:boto:Token: None 2023-12-15T23:22:24.020 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA= 2023-12-15T23:22:24.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA=', 'Content-Length': '0'} 2023-12-15T23:22:24.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4f8ba28972c569e-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.022 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.023 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.023 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.023 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.023 DEBUG:boto:Method: GET 2023-12-15T23:22:24.023 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.023 DEBUG:boto:Data: 2023-12-15T23:22:24.023 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.023 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.023 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.023 DEBUG:boto:Params: {} 2023-12-15T23:22:24.024 DEBUG:boto:Token: None 2023-12-15T23:22:24.024 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.024 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA= 2023-12-15T23:22:24.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA=', 'Content-Length': '0'} 2023-12-15T23:22:24.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026e1998c2ec9b1a5-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.069 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.070 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.070 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.070 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.070 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.070 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.070 DEBUG:boto:Data: 2023-12-15T23:22:24.070 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.070 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.070 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.071 DEBUG:boto:Params: {} 2023-12-15T23:22:24.071 DEBUG:boto:Token: None 2023-12-15T23:22:24.071 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5I/UB0Bl43BJDpb6vDp6OVVy1IU= 2023-12-15T23:22:24.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5I/UB0Bl43BJDpb6vDp6OVVy1IU=', 'Content-Length': '0'} 2023-12-15T23:22:24.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecfadea7e07819c7-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.073 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.073 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.074 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.074 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.074 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.074 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.074 DEBUG:boto:Data: 2023-12-15T23:22:24.074 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.074 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.074 DEBUG:boto:Params: {} 2023-12-15T23:22:24.074 DEBUG:boto:Token: None 2023-12-15T23:22:24.074 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5I/UB0Bl43BJDpb6vDp6OVVy1IU= 2023-12-15T23:22:24.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5I/UB0Bl43BJDpb6vDp6OVVy1IU=', 'Content-Length': '0'} 2023-12-15T23:22:24.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058175a2269e1166d-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:22:24.077 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.077 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.077 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.077 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.077 DEBUG:boto:Method: GET 2023-12-15T23:22:24.077 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.078 DEBUG:boto:Data: 2023-12-15T23:22:24.078 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.078 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.078 DEBUG:boto:Params: {} 2023-12-15T23:22:24.078 DEBUG:boto:Token: None 2023-12-15T23:22:24.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA= 2023-12-15T23:22:24.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA=', 'Content-Length': '0'} 2023-12-15T23:22:24.080 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000020368b4d390e563-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.121 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.122 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.122 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.122 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.122 DEBUG:boto:Method: GET 2023-12-15T23:22:24.122 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.122 DEBUG:boto:Data: 2023-12-15T23:22:24.122 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.122 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.123 DEBUG:boto:Params: {} 2023-12-15T23:22:24.123 DEBUG:boto:Token: None 2023-12-15T23:22:24.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:22:24.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA= 2023-12-15T23:22:24.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9XRAEGFXT/MNFCbq+u9pvM8X7hA=', 'Content-Length': '0'} 2023-12-15T23:22:24.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2aa81448572c377-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.125 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.125 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.126 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.126 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.126 DEBUG:boto:Method: GET 2023-12-15T23:22:24.126 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.126 DEBUG:boto:Data: 2023-12-15T23:22:24.126 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.126 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.126 DEBUG:boto:Params: {} 2023-12-15T23:22:24.126 DEBUG:boto:Token: None 2023-12-15T23:22:24.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000efe2127206cd7325-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.129 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.129 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.129 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.130 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.130 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.130 DEBUG:boto:Method: GET 2023-12-15T23:22:24.130 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.130 DEBUG:boto:Data: 2023-12-15T23:22:24.130 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.130 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.130 DEBUG:boto:Params: {} 2023-12-15T23:22:24.130 DEBUG:boto:Token: None 2023-12-15T23:22:24.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f72e5bd52c689be5-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.135 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.135 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.135 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.135 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.135 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:22:24.135 DEBUG:boto:Data: 2023-12-15T23:22:24.135 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.135 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.135 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.136 DEBUG:boto:Params: {} 2023-12-15T23:22:24.136 DEBUG:boto:Token: None 2023-12-15T23:22:24.136 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92 2023-12-15T23:22:24.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3Ezng8ba1DsFT5qyA+XxeMB3xSA= 2023-12-15T23:22:24.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3Ezng8ba1DsFT5qyA+XxeMB3xSA=', 'Content-Length': '0'} 2023-12-15T23:22:24.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cc7d0655166ef7b-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.138 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.138 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.138 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.138 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:22:24.138 DEBUG:boto:Data: 2023-12-15T23:22:24.139 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.139 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.139 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.139 DEBUG:boto:Params: {} 2023-12-15T23:22:24.139 DEBUG:boto:Token: None 2023-12-15T23:22:24.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92 2023-12-15T23:22:24.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3Ezng8ba1DsFT5qyA+XxeMB3xSA= 2023-12-15T23:22:24.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3Ezng8ba1DsFT5qyA+XxeMB3xSA=', 'Content-Length': '0'} 2023-12-15T23:22:24.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e9feabcef5a5bc2-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:22:24.141 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.141 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.142 DEBUG:boto:Method: GET 2023-12-15T23:22:24.142 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:22:24.142 DEBUG:boto:Data: 2023-12-15T23:22:24.142 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.142 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.142 DEBUG:boto:Params: {} 2023-12-15T23:22:24.142 DEBUG:boto:Token: None 2023-12-15T23:22:24.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92 2023-12-15T23:22:24.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V2QNHhvKl7WaGPNQAH/cpJJInks= 2023-12-15T23:22:24.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V2QNHhvKl7WaGPNQAH/cpJJInks=', 'Content-Length': '0'} 2023-12-15T23:22:24.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ea94003f8aeee41-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.185 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:22:24.186 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:22:24.186 DEBUG:boto:Method: GET 2023-12-15T23:22:24.186 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:22:24.186 DEBUG:boto:Data: 2023-12-15T23:22:24.186 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.186 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.186 DEBUG:boto:Params: {} 2023-12-15T23:22:24.186 DEBUG:boto:Token: None 2023-12-15T23:22:24.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj92 2023-12-15T23:22:24.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V2QNHhvKl7WaGPNQAH/cpJJInks= 2023-12-15T23:22:24.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V2QNHhvKl7WaGPNQAH/cpJJInks=', 'Content-Length': '0'} 2023-12-15T23:22:24.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1c2c52b4d35a8b9-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.189 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.189 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.189 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.189 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.189 DEBUG:boto:Method: GET 2023-12-15T23:22:24.189 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.189 DEBUG:boto:Data: 2023-12-15T23:22:24.189 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.190 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.190 DEBUG:boto:Params: {} 2023-12-15T23:22:24.190 DEBUG:boto:Token: None 2023-12-15T23:22:24.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062d04976a5ce8d5a-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.192 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.193 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.193 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.193 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.193 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.193 DEBUG:boto:Method: GET 2023-12-15T23:22:24.193 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:22:24.194 DEBUG:boto:Data: 2023-12-15T23:22:24.194 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.194 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.194 DEBUG:boto:Params: {} 2023-12-15T23:22:24.194 DEBUG:boto:Token: None 2023-12-15T23:22:24.194 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a84f0083941c2a57-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.198 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:22:24.198 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.199 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.199 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.199 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.199 DEBUG:boto:Method: GET 2023-12-15T23:22:24.199 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.199 DEBUG:boto:Data: 2023-12-15T23:22:24.199 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.199 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.199 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.199 DEBUG:boto:Params: {} 2023-12-15T23:22:24.199 DEBUG:boto:Token: None 2023-12-15T23:22:24.200 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.200 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8= 2023-12-15T23:22:24.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8=', 'Content-Length': '0'} 2023-12-15T23:22:24.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004399aed82ee65e5f-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.202 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.202 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.202 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.202 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.202 DEBUG:boto:Method: GET 2023-12-15T23:22:24.202 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.203 DEBUG:boto:Data: 2023-12-15T23:22:24.203 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.203 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.203 DEBUG:boto:Params: {} 2023-12-15T23:22:24.203 DEBUG:boto:Token: None 2023-12-15T23:22:24.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8= 2023-12-15T23:22:24.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8=', 'Content-Length': '0'} 2023-12-15T23:22:24.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000093a351cf4017c7f-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.245 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.246 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.246 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.246 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.246 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.246 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.246 DEBUG:boto:Data: 2023-12-15T23:22:24.246 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.246 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.246 DEBUG:boto:Params: {} 2023-12-15T23:22:24.247 DEBUG:boto:Token: None 2023-12-15T23:22:24.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KtPavIOpAcTT8sDOOwRWuVaPyCw= 2023-12-15T23:22:24.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KtPavIOpAcTT8sDOOwRWuVaPyCw=', 'Content-Length': '0'} 2023-12-15T23:22:24.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067983bc55898c872-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.249 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.249 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.249 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.250 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.250 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.250 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.250 DEBUG:boto:Data: 2023-12-15T23:22:24.250 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.250 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.250 DEBUG:boto:Params: {} 2023-12-15T23:22:24.250 DEBUG:boto:Token: None 2023-12-15T23:22:24.250 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KtPavIOpAcTT8sDOOwRWuVaPyCw= 2023-12-15T23:22:24.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KtPavIOpAcTT8sDOOwRWuVaPyCw=', 'Content-Length': '0'} 2023-12-15T23:22:24.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020ec954c94c9f2ae-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:22:24.253 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.253 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.253 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.253 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.253 DEBUG:boto:Method: GET 2023-12-15T23:22:24.253 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.253 DEBUG:boto:Data: 2023-12-15T23:22:24.253 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.253 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.254 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.254 DEBUG:boto:Params: {} 2023-12-15T23:22:24.254 DEBUG:boto:Token: None 2023-12-15T23:22:24.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8= 2023-12-15T23:22:24.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8=', 'Content-Length': '0'} 2023-12-15T23:22:24.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064eddb2e63eb9510-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.297 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.298 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.298 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.298 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.298 DEBUG:boto:Method: GET 2023-12-15T23:22:24.298 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.298 DEBUG:boto:Data: 2023-12-15T23:22:24.298 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.298 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.298 DEBUG:boto:Params: {} 2023-12-15T23:22:24.299 DEBUG:boto:Token: None 2023-12-15T23:22:24.299 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:22:24.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8= 2023-12-15T23:22:24.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I/cqoScEdWKU0oRCAie3yj4V+r8=', 'Content-Length': '0'} 2023-12-15T23:22:24.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c710835afe070d8-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.301 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.301 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.301 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.301 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.302 DEBUG:boto:Method: GET 2023-12-15T23:22:24.302 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.302 DEBUG:boto:Data: 2023-12-15T23:22:24.302 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.302 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.302 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.302 DEBUG:boto:Params: {} 2023-12-15T23:22:24.302 DEBUG:boto:Token: None 2023-12-15T23:22:24.302 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063bfcf4e7c88c6c0-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.305 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.305 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.306 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.306 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.306 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.306 DEBUG:boto:Method: GET 2023-12-15T23:22:24.306 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.306 DEBUG:boto:Data: 2023-12-15T23:22:24.306 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.306 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.306 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.306 DEBUG:boto:Params: {} 2023-12-15T23:22:24.306 DEBUG:boto:Token: None 2023-12-15T23:22:24.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.310 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb2109f65fa9c812-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.310 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.310 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.310 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.310 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.311 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:22:24.311 DEBUG:boto:Data: 2023-12-15T23:22:24.311 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.311 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.311 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.311 DEBUG:boto:Params: {} 2023-12-15T23:22:24.311 DEBUG:boto:Token: None 2023-12-15T23:22:24.311 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95 2023-12-15T23:22:24.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uzbY6APlu3lBw7iRf5ZMht+jzYw= 2023-12-15T23:22:24.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uzbY6APlu3lBw7iRf5ZMht+jzYw=', 'Content-Length': '0'} 2023-12-15T23:22:24.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b48af9014da0ee8-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.313 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.314 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.314 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.314 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:22:24.314 DEBUG:boto:Data: 2023-12-15T23:22:24.314 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.314 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.314 DEBUG:boto:Params: {} 2023-12-15T23:22:24.314 DEBUG:boto:Token: None 2023-12-15T23:22:24.314 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95 2023-12-15T23:22:24.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uzbY6APlu3lBw7iRf5ZMht+jzYw= 2023-12-15T23:22:24.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uzbY6APlu3lBw7iRf5ZMht+jzYw=', 'Content-Length': '0'} 2023-12-15T23:22:24.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a05b40930c6e952a-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:22:24.317 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.317 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.317 DEBUG:boto:Method: GET 2023-12-15T23:22:24.317 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:22:24.317 DEBUG:boto:Data: 2023-12-15T23:22:24.317 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.317 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.317 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.318 DEBUG:boto:Params: {} 2023-12-15T23:22:24.318 DEBUG:boto:Token: None 2023-12-15T23:22:24.318 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95 2023-12-15T23:22:24.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMR6xb2LCdwBfj/HrPbOOGyzVwQ= 2023-12-15T23:22:24.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMR6xb2LCdwBfj/HrPbOOGyzVwQ=', 'Content-Length': '0'} 2023-12-15T23:22:24.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cf92b6c413f202c-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.361 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:22:24.362 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:22:24.362 DEBUG:boto:Method: GET 2023-12-15T23:22:24.362 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:22:24.362 DEBUG:boto:Data: 2023-12-15T23:22:24.362 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.362 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.362 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.362 DEBUG:boto:Params: {} 2023-12-15T23:22:24.363 DEBUG:boto:Token: None 2023-12-15T23:22:24.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj95 2023-12-15T23:22:24.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MMR6xb2LCdwBfj/HrPbOOGyzVwQ= 2023-12-15T23:22:24.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MMR6xb2LCdwBfj/HrPbOOGyzVwQ=', 'Content-Length': '0'} 2023-12-15T23:22:24.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080db94011c379b01-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.365 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.365 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.365 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.365 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.366 DEBUG:boto:Method: GET 2023-12-15T23:22:24.366 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.366 DEBUG:boto:Data: 2023-12-15T23:22:24.366 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:22:24.366 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.366 DEBUG:boto:Params: {} 2023-12-15T23:22:24.366 DEBUG:boto:Token: None 2023-12-15T23:22:24.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a017da717bafa910-00657cdfb0-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.409 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.410 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.410 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.410 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.410 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.410 DEBUG:boto:Method: GET 2023-12-15T23:22:24.411 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:22:24.411 DEBUG:boto:Data: 2023-12-15T23:22:24.411 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.411 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.411 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.411 DEBUG:boto:Params: {} 2023-12-15T23:22:24.411 DEBUG:boto:Token: None 2023-12-15T23:22:24.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc= 2023-12-15T23:22:24.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TutGi87keJUgbNGoA2dfImfIDcc=', 'Content-Length': '0'} 2023-12-15T23:22:24.415 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a90b5b0aace16b1e-00657cdfb0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.415 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:22:24.415 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:22:24.416 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:22:24.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:22:24.416 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:22:24.473 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:22:24.474 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:22:24.529 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:22:24.529 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:22:24.542 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 25 2023-12-15T23:22:24.613 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.613 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.613 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.613 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:24.613 DEBUG:boto:Data: 2023-12-15T23:22:24.613 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.613 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.614 DEBUG:boto:Params: {} 2023-12-15T23:22:24.614 DEBUG:boto:Token: None 2023-12-15T23:22:24.614 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0= 2023-12-15T23:22:24.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0=', 'Content-Length': '0'} 2023-12-15T23:22:24.617 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d0828bb6933e2c9e-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.617 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:22:24.617 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:22:24.617 DEBUG:boto:Method: PUT 2023-12-15T23:22:24.617 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:22:24.618 DEBUG:boto:Data: 2023-12-15T23:22:24.618 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:22:24.618 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.618 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.618 DEBUG:boto:Params: {} 2023-12-15T23:22:24.618 DEBUG:boto:Token: None 2023-12-15T23:22:24.618 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj31 2023-12-15T23:22:24.618 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lsnty5qtwRJjNA4KBVR1cDa/CyA= 2023-12-15T23:22:24.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lsnty5qtwRJjNA4KBVR1cDa/CyA='} 2023-12-15T23:22:24.624 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005f830a742a3c0bbe-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.624 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.624 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.624 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.625 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:24.625 DEBUG:boto:Data: 2023-12-15T23:22:24.625 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.625 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.625 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.625 DEBUG:boto:Params: {} 2023-12-15T23:22:24.625 DEBUG:boto:Token: None 2023-12-15T23:22:24.625 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.625 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0= 2023-12-15T23:22:24.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0=', 'Content-Length': '0'} 2023-12-15T23:22:24.628 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e2bc354559ad6fa6-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.628 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:22:24.628 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:22:24.628 DEBUG:boto:Method: PUT 2023-12-15T23:22:24.628 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:22:24.629 DEBUG:boto:Data: 2023-12-15T23:22:24.629 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:22:24.629 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.629 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.629 DEBUG:boto:Params: {} 2023-12-15T23:22:24.629 DEBUG:boto:Token: None 2023-12-15T23:22:24.629 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj62 2023-12-15T23:22:24.629 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tAfC4C2ETHTSwTHOdw0U0FrnelA= 2023-12-15T23:22:24.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tAfC4C2ETHTSwTHOdw0U0FrnelA='} 2023-12-15T23:22:24.674 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e8321b7cc2937b9-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.674 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.674 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.674 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.674 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:24.674 DEBUG:boto:Data: 2023-12-15T23:22:24.674 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.674 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.674 DEBUG:boto:Params: {} 2023-12-15T23:22:24.674 DEBUG:boto:Token: None 2023-12-15T23:22:24.675 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0= 2023-12-15T23:22:24.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0=', 'Content-Length': '0'} 2023-12-15T23:22:24.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9fcb901b5bc9e9b-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.677 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:22:24.678 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:22:24.678 DEBUG:boto:Method: PUT 2023-12-15T23:22:24.678 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:22:24.678 DEBUG:boto:Data: 2023-12-15T23:22:24.678 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:22:24.678 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.678 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.678 DEBUG:boto:Params: {} 2023-12-15T23:22:24.678 DEBUG:boto:Token: None 2023-12-15T23:22:24.678 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj93 2023-12-15T23:22:24.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wCgtac77ubnYiCMgnvGCIB7tG6o= 2023-12-15T23:22:24.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wCgtac77ubnYiCMgnvGCIB7tG6o='} 2023-12-15T23:22:24.684 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000490fbbdeabb07b5a-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.684 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.684 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.684 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.684 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:24.684 DEBUG:boto:Data: 2023-12-15T23:22:24.684 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.684 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.685 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.685 DEBUG:boto:Params: {} 2023-12-15T23:22:24.685 DEBUG:boto:Token: None 2023-12-15T23:22:24.685 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0= 2023-12-15T23:22:24.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0=', 'Content-Length': '0'} 2023-12-15T23:22:24.687 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000028f85023e8ca43ba-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.688 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:22:24.688 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:22:24.688 DEBUG:boto:Method: PUT 2023-12-15T23:22:24.688 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:22:24.688 DEBUG:boto:Data: 2023-12-15T23:22:24.688 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:22:24.688 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.688 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.688 DEBUG:boto:Params: {} 2023-12-15T23:22:24.688 DEBUG:boto:Token: None 2023-12-15T23:22:24.689 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj124 2023-12-15T23:22:24.689 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ofRAbNzWW0J5sWpfwwXbS9U1aKk= 2023-12-15T23:22:24.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ofRAbNzWW0J5sWpfwwXbS9U1aKk='} 2023-12-15T23:22:24.694 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000072b5f574c53590ba-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.694 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:22:24.694 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:22:24.694 DEBUG:boto:Method: HEAD 2023-12-15T23:22:24.694 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:22:24.694 DEBUG:boto:Data: 2023-12-15T23:22:24.694 DEBUG:boto:Headers: {} 2023-12-15T23:22:24.695 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.695 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.695 DEBUG:boto:Params: {} 2023-12-15T23:22:24.695 DEBUG:boto:Token: None 2023-12-15T23:22:24.695 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/ 2023-12-15T23:22:24.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0= 2023-12-15T23:22:24.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IMsPFiv+s2v/ZAPOC/auDMjfZj0=', 'Content-Length': '0'} 2023-12-15T23:22:24.697 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e6f19e3065ce4a8b-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.698 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:22:24.698 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:22:24.698 DEBUG:boto:Method: PUT 2023-12-15T23:22:24.698 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:22:24.698 DEBUG:boto:Data: 2023-12-15T23:22:24.698 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:22:24.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:22:24.698 DEBUG:boto:Port: 8000 2023-12-15T23:22:24.698 DEBUG:boto:Params: {} 2023-12-15T23:22:24.699 DEBUG:boto:Token: None 2023-12-15T23:22:24.699 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:22:24 GMT /kskgfn-49/obj155 2023-12-15T23:22:24.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mIGbObpYP0r4HOFBiU5q44kgvLQ= 2023-12-15T23:22:24.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:22:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mIGbObpYP0r4HOFBiU5q44kgvLQ='} 2023-12-15T23:22:24.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002907e93868a20137-00657cdfb0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:22:24.742 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:22:24.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:22:24.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:22:24.743 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:22:24.802 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:22:24.802 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:22:24.841 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:24.839+0000 7f526df21800 1 waiting to reach latest gen 5, on 4.. 2023-12-15T23:22:29.844 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:29.842+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:29.844 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:29.844 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:34.848 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:34.846+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:34.848 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:34.848 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:39.849 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:39.847+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:39.850 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:39.850 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:44.851 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:44.849+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:44.852 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:44.852 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:49.853 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:49.852+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:49.854 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:49.854 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:54.856 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:54.854+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:54.856 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:54.856 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:22:59.857 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:22:59.856+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:22:59.858 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:22:59.858 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:04.859 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:04.858+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:04.860 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:04.860 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:09.861 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:09.860+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:09.862 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:09.862 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:14.864 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:14.862+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:14.864 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:14.864 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:19.866 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:19.864+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:19.866 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:19.866 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:24.867 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:24.866+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:24.868 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:24.868 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:29.869 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:29.868+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:29.870 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , 00000000001.76.6, , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:23:29.870 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:34.871 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:34.869+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:34.871 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:34.872 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:39.873 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:39.871+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:39.873 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:39.874 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:44.875 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:44.874+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:44.876 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:44.876 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:49.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:49.876+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:49.879 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:49.879 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:54.880 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:54.878+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:54.880 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:54.880 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:59.882 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:23:59.880+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:23:59.882 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:23:59.882 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:04.884 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:04.882+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:04.884 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:04.885 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:09.887 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:09.886+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:09.896 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:09.896 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:14.891 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:14.888+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:14.891 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:14.891 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:19.892 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:19.890+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:19.892 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:19.892 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:24.894 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:24.892+0000 7f526df21800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:24.894 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , , , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:24.894 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:29.893+0000 7f526df21800 1 bucket sync caught up with source: 2023-12-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , 00000000002.102.6, , 00000000001.76.6, , 00000000001.65.6, , , , , , , , , , 00000000001.94.6, , , , , , , , , , , , , , 00000000001.52.6] 2023-12-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:29.893+0000 7f526df21800 0 bucket checkpoint complete 2023-12-15T23:24:29.916 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:24:29.916 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:24:29.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:24:29.917 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:24:30.022+0000 7f976fb24800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000003.154.6, 00000000002.140.6, 00000000001.83.6, 00000000004.156.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000003.101.6, 00000000006.117.6, 00000000004.105.6] 2023-12-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000004.156.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000003.101.6, 00000000006.117.6, 00000000004.105.6] 2023-12-15T23:24:32.592 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:24:32.590+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:24:35.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:24:35.023+0000 7f976fb24800 1 bucket sync caught up with source: 2023-12-15T23:24:35.025 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000004.156.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000003.101.6, 00000000006.117.6, 00000000004.105.6] 2023-12-15T23:24:35.026 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000004.156.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000003.101.6, 00000000006.117.6, 00000000004.105.6] 2023-12-15T23:24:35.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:24:35.023+0000 7f976fb24800 0 bucket checkpoint complete 2023-12-15T23:24:35.045 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:24:35.046 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.046 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.046 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.046 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:35.046 DEBUG:boto:Data: 2023-12-15T23:24:35.046 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.046 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.047 DEBUG:boto:Params: {} 2023-12-15T23:24:35.047 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:24:35.047 DEBUG:boto:Token: None 2023-12-15T23:24:35.048 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mvZ3IZwQerboquyBm6LIjVi8Ci0= 2023-12-15T23:24:35.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mvZ3IZwQerboquyBm6LIjVi8Ci0=', 'Content-Length': '0'} 2023-12-15T23:24:35.052 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000947e11266f3a0c7c-00657ce033-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.052 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.052 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.053 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.053 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:35.053 DEBUG:boto:Data: 2023-12-15T23:24:35.053 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.053 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.053 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.053 DEBUG:boto:Params: {} 2023-12-15T23:24:35.053 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:24:35.053 DEBUG:boto:Token: None 2023-12-15T23:24:35.054 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mvZ3IZwQerboquyBm6LIjVi8Ci0= 2023-12-15T23:24:35.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mvZ3IZwQerboquyBm6LIjVi8Ci0=', 'Content-Length': '0'} 2023-12-15T23:24:35.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b5ca78e5288c598-00657ce033-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.058 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:24:35.058 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.058 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.059 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.059 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.059 DEBUG:boto:Method: GET 2023-12-15T23:24:35.059 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.059 DEBUG:boto:Data: 2023-12-15T23:24:35.059 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.059 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.059 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.059 DEBUG:boto:Params: {} 2023-12-15T23:24:35.059 DEBUG:boto:Token: None 2023-12-15T23:24:35.060 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/?versions 2023-12-15T23:24:35.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs= 2023-12-15T23:24:35.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs=', 'Content-Length': '0'} 2023-12-15T23:24:35.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048f9d0626dd9f56c-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.062 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:24:35.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:24:35.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:24:35.067 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:24:35.067 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.067 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.068 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.068 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.068 DEBUG:boto:Method: GET 2023-12-15T23:24:35.068 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.068 DEBUG:boto:Data: 2023-12-15T23:24:35.068 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.068 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.068 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.068 DEBUG:boto:Params: {} 2023-12-15T23:24:35.068 DEBUG:boto:Token: None 2023-12-15T23:24:35.068 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/?versions 2023-12-15T23:24:35.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs= 2023-12-15T23:24:35.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs=', 'Content-Length': '0'} 2023-12-15T23:24:35.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000052008f1dfd67136-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.072 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:24:35.074 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:24:35.075 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:24:35.076 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:24:35.076 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.077 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.077 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.077 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.077 DEBUG:boto:Method: GET 2023-12-15T23:24:35.077 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.077 DEBUG:boto:Data: 2023-12-15T23:24:35.077 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.077 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.077 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.077 DEBUG:boto:Params: {} 2023-12-15T23:24:35.077 DEBUG:boto:Token: None 2023-12-15T23:24:35.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/?versions 2023-12-15T23:24:35.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs= 2023-12-15T23:24:35.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs=', 'Content-Length': '0'} 2023-12-15T23:24:35.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094422039319d20bd-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.080 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.082 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.082 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.082 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.082 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.082 DEBUG:boto:Method: GET 2023-12-15T23:24:35.082 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:24:35.082 DEBUG:boto:Data: 2023-12-15T23:24:35.082 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.083 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.083 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.083 DEBUG:boto:Params: {} 2023-12-15T23:24:35.083 DEBUG:boto:Token: None 2023-12-15T23:24:35.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/?versions 2023-12-15T23:24:35.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs= 2023-12-15T23:24:35.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U3zEu0ELOHZvjoFFxuKm752NkEs=', 'Content-Length': '0'} 2023-12-15T23:24:35.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9e0aba412c944d8-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.087 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:24:35.088 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.088 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.089 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.089 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.089 DEBUG:boto:Method: GET 2023-12-15T23:24:35.089 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.089 DEBUG:boto:Data: 2023-12-15T23:24:35.089 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.089 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.089 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.089 DEBUG:boto:Params: {} 2023-12-15T23:24:35.089 DEBUG:boto:Token: None 2023-12-15T23:24:35.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I= 2023-12-15T23:24:35.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I=', 'Content-Length': '0'} 2023-12-15T23:24:35.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094bc10933adaa93e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.092 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.092 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.092 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.093 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.093 DEBUG:boto:Method: GET 2023-12-15T23:24:35.093 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.093 DEBUG:boto:Data: 2023-12-15T23:24:35.093 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.093 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.093 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.093 DEBUG:boto:Params: {} 2023-12-15T23:24:35.093 DEBUG:boto:Token: None 2023-12-15T23:24:35.093 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I= 2023-12-15T23:24:35.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I=', 'Content-Length': '0'} 2023-12-15T23:24:35.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edccc0418394dd7d-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.137 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.138 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.138 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.138 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.138 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.138 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.138 DEBUG:boto:Data: 2023-12-15T23:24:35.138 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.138 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.138 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.138 DEBUG:boto:Params: {} 2023-12-15T23:24:35.139 DEBUG:boto:Token: None 2023-12-15T23:24:35.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6srvYhn32N3HuRSkyUskiEiUVGw= 2023-12-15T23:24:35.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6srvYhn32N3HuRSkyUskiEiUVGw=', 'Content-Length': '0'} 2023-12-15T23:24:35.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086eef492483bbe26-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.141 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.141 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.141 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.142 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.142 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.142 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.142 DEBUG:boto:Data: 2023-12-15T23:24:35.142 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.142 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.142 DEBUG:boto:Params: {} 2023-12-15T23:24:35.142 DEBUG:boto:Token: None 2023-12-15T23:24:35.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6srvYhn32N3HuRSkyUskiEiUVGw= 2023-12-15T23:24:35.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6srvYhn32N3HuRSkyUskiEiUVGw=', 'Content-Length': '0'} 2023-12-15T23:24:35.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce8057bade01715c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:24:35.145 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.145 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.145 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.145 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.145 DEBUG:boto:Method: GET 2023-12-15T23:24:35.145 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.146 DEBUG:boto:Data: 2023-12-15T23:24:35.146 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.146 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.146 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.146 DEBUG:boto:Params: {} 2023-12-15T23:24:35.146 DEBUG:boto:Token: None 2023-12-15T23:24:35.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I= 2023-12-15T23:24:35.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I=', 'Content-Length': '0'} 2023-12-15T23:24:35.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aeb47f8cdd7a6a6-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.189 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.190 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.190 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.190 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.190 DEBUG:boto:Method: GET 2023-12-15T23:24:35.190 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.190 DEBUG:boto:Data: 2023-12-15T23:24:35.190 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.190 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.190 DEBUG:boto:Params: {} 2023-12-15T23:24:35.191 DEBUG:boto:Token: None 2023-12-15T23:24:35.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:24:35.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I= 2023-12-15T23:24:35.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oaDrzd1nexu6qr/24h3iZDazb+I=', 'Content-Length': '0'} 2023-12-15T23:24:35.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4992f8bf7a01f16-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.193 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.193 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.194 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.194 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.194 DEBUG:boto:Method: GET 2023-12-15T23:24:35.194 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.194 DEBUG:boto:Data: 2023-12-15T23:24:35.194 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.194 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.194 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.194 DEBUG:boto:Params: {} 2023-12-15T23:24:35.194 DEBUG:boto:Token: None 2023-12-15T23:24:35.195 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.197 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000767aa991043bf8af-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.197 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.198 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.198 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.198 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.198 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.198 DEBUG:boto:Method: GET 2023-12-15T23:24:35.198 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.198 DEBUG:boto:Data: 2023-12-15T23:24:35.198 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.199 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.199 DEBUG:boto:Params: {} 2023-12-15T23:24:35.199 DEBUG:boto:Token: None 2023-12-15T23:24:35.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000460840e7779a87d9-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.203 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.203 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.203 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.203 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.203 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:24:35.203 DEBUG:boto:Data: 2023-12-15T23:24:35.204 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.204 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.204 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.204 DEBUG:boto:Params: {} 2023-12-15T23:24:35.204 DEBUG:boto:Token: None 2023-12-15T23:24:35.204 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11 2023-12-15T23:24:35.204 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SNjqpf4P9p+ApyrZwJqvPFiz2zE= 2023-12-15T23:24:35.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SNjqpf4P9p+ApyrZwJqvPFiz2zE=', 'Content-Length': '0'} 2023-12-15T23:24:35.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfa60214f910be8d-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.206 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.207 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.207 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.207 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:24:35.207 DEBUG:boto:Data: 2023-12-15T23:24:35.207 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.207 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.207 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.207 DEBUG:boto:Params: {} 2023-12-15T23:24:35.207 DEBUG:boto:Token: None 2023-12-15T23:24:35.207 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11 2023-12-15T23:24:35.208 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SNjqpf4P9p+ApyrZwJqvPFiz2zE= 2023-12-15T23:24:35.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SNjqpf4P9p+ApyrZwJqvPFiz2zE=', 'Content-Length': '0'} 2023-12-15T23:24:35.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046b5c543747ddf23-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:24:35.210 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.210 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.210 DEBUG:boto:Method: GET 2023-12-15T23:24:35.210 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:24:35.210 DEBUG:boto:Data: 2023-12-15T23:24:35.210 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.211 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.211 DEBUG:boto:Params: {} 2023-12-15T23:24:35.211 DEBUG:boto:Token: None 2023-12-15T23:24:35.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11 2023-12-15T23:24:35.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6U+MwrX5s+0164stM1VRG5TporA= 2023-12-15T23:24:35.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6U+MwrX5s+0164stM1VRG5TporA=', 'Content-Length': '0'} 2023-12-15T23:24:35.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f29e29bf11189935-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.253 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:24:35.254 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:24:35.254 DEBUG:boto:Method: GET 2023-12-15T23:24:35.254 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:24:35.254 DEBUG:boto:Data: 2023-12-15T23:24:35.254 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.254 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.254 DEBUG:boto:Params: {} 2023-12-15T23:24:35.254 DEBUG:boto:Token: None 2023-12-15T23:24:35.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj11 2023-12-15T23:24:35.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6U+MwrX5s+0164stM1VRG5TporA= 2023-12-15T23:24:35.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6U+MwrX5s+0164stM1VRG5TporA=', 'Content-Length': '0'} 2023-12-15T23:24:35.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000357c7f4fab237749-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.257 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.257 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.257 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.257 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.258 DEBUG:boto:Method: GET 2023-12-15T23:24:35.258 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.258 DEBUG:boto:Data: 2023-12-15T23:24:35.258 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.258 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.258 DEBUG:boto:Params: {} 2023-12-15T23:24:35.258 DEBUG:boto:Token: None 2023-12-15T23:24:35.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010bd03a88f829b06-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.261 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.262 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.262 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.262 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.262 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.262 DEBUG:boto:Method: GET 2023-12-15T23:24:35.262 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:24:35.262 DEBUG:boto:Data: 2023-12-15T23:24:35.262 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.262 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.263 DEBUG:boto:Params: {} 2023-12-15T23:24:35.263 DEBUG:boto:Token: None 2023-12-15T23:24:35.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006462a9cd816aed1d-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.266 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:24:35.267 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.267 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.267 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.267 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.267 DEBUG:boto:Method: GET 2023-12-15T23:24:35.267 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.268 DEBUG:boto:Data: 2023-12-15T23:24:35.268 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.268 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.268 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.268 DEBUG:boto:Params: {} 2023-12-15T23:24:35.268 DEBUG:boto:Token: None 2023-12-15T23:24:35.268 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.268 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs= 2023-12-15T23:24:35.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs=', 'Content-Length': '0'} 2023-12-15T23:24:35.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7471c4b5e0ca01a-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.271 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.271 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.271 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.271 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.271 DEBUG:boto:Method: GET 2023-12-15T23:24:35.271 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.271 DEBUG:boto:Data: 2023-12-15T23:24:35.271 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.271 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.272 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.272 DEBUG:boto:Params: {} 2023-12-15T23:24:35.272 DEBUG:boto:Token: None 2023-12-15T23:24:35.272 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs= 2023-12-15T23:24:35.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs=', 'Content-Length': '0'} 2023-12-15T23:24:35.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9144df6c3c6675f-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.317 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.318 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.318 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.318 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.318 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.318 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.318 DEBUG:boto:Data: 2023-12-15T23:24:35.318 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.318 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.318 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.318 DEBUG:boto:Params: {} 2023-12-15T23:24:35.319 DEBUG:boto:Token: None 2023-12-15T23:24:35.319 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vE2W6lzFvHjCG03NerOjzuw95xo= 2023-12-15T23:24:35.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vE2W6lzFvHjCG03NerOjzuw95xo=', 'Content-Length': '0'} 2023-12-15T23:24:35.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087ddc246c08692c8-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.321 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.321 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.321 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.321 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.321 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.321 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.322 DEBUG:boto:Data: 2023-12-15T23:24:35.322 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.322 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.322 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.322 DEBUG:boto:Params: {} 2023-12-15T23:24:35.322 DEBUG:boto:Token: None 2023-12-15T23:24:35.322 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vE2W6lzFvHjCG03NerOjzuw95xo= 2023-12-15T23:24:35.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vE2W6lzFvHjCG03NerOjzuw95xo=', 'Content-Length': '0'} 2023-12-15T23:24:35.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006651ebcfff5b4b52-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:24:35.325 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.325 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.325 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.325 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.325 DEBUG:boto:Method: GET 2023-12-15T23:24:35.325 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.325 DEBUG:boto:Data: 2023-12-15T23:24:35.325 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.326 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.326 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.326 DEBUG:boto:Params: {} 2023-12-15T23:24:35.326 DEBUG:boto:Token: None 2023-12-15T23:24:35.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs= 2023-12-15T23:24:35.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs=', 'Content-Length': '0'} 2023-12-15T23:24:35.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f73b1b76b64001b-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.329 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.329 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.329 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.329 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.329 DEBUG:boto:Method: GET 2023-12-15T23:24:35.329 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.329 DEBUG:boto:Data: 2023-12-15T23:24:35.329 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.329 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.330 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.330 DEBUG:boto:Params: {} 2023-12-15T23:24:35.330 DEBUG:boto:Token: None 2023-12-15T23:24:35.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:24:35.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs= 2023-12-15T23:24:35.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kvGbQopUZgmYrlug2D7H0y7oXTs=', 'Content-Length': '0'} 2023-12-15T23:24:35.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093812775ba892cf4-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.332 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.333 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.333 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.333 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.333 DEBUG:boto:Method: GET 2023-12-15T23:24:35.333 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.333 DEBUG:boto:Data: 2023-12-15T23:24:35.333 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.333 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.333 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.333 DEBUG:boto:Params: {} 2023-12-15T23:24:35.334 DEBUG:boto:Token: None 2023-12-15T23:24:35.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b179af939207fe5e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.336 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.337 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.337 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.337 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.337 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.337 DEBUG:boto:Method: GET 2023-12-15T23:24:35.337 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.337 DEBUG:boto:Data: 2023-12-15T23:24:35.337 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.337 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.338 DEBUG:boto:Params: {} 2023-12-15T23:24:35.338 DEBUG:boto:Token: None 2023-12-15T23:24:35.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c692182a28a2812-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.341 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.342 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.342 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.342 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.342 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:24:35.342 DEBUG:boto:Data: 2023-12-15T23:24:35.342 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.342 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.342 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.342 DEBUG:boto:Params: {} 2023-12-15T23:24:35.343 DEBUG:boto:Token: None 2023-12-15T23:24:35.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115 2023-12-15T23:24:35.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QTRUo7pezAse5Vsa3oxvJj7nO5s= 2023-12-15T23:24:35.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QTRUo7pezAse5Vsa3oxvJj7nO5s=', 'Content-Length': '0'} 2023-12-15T23:24:35.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030212a91e25fb8de-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.345 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.345 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.345 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.345 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:24:35.346 DEBUG:boto:Data: 2023-12-15T23:24:35.346 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.346 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.346 DEBUG:boto:Params: {} 2023-12-15T23:24:35.346 DEBUG:boto:Token: None 2023-12-15T23:24:35.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115 2023-12-15T23:24:35.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QTRUo7pezAse5Vsa3oxvJj7nO5s= 2023-12-15T23:24:35.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QTRUo7pezAse5Vsa3oxvJj7nO5s=', 'Content-Length': '0'} 2023-12-15T23:24:35.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce3228d24566a6b1-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:24:35.349 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.349 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.349 DEBUG:boto:Method: GET 2023-12-15T23:24:35.349 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:24:35.349 DEBUG:boto:Data: 2023-12-15T23:24:35.349 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.350 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.350 DEBUG:boto:Params: {} 2023-12-15T23:24:35.350 DEBUG:boto:Token: None 2023-12-15T23:24:35.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115 2023-12-15T23:24:35.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2a1mFy3hKhGCHW0pHek/vErgNw= 2023-12-15T23:24:35.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2a1mFy3hKhGCHW0pHek/vErgNw=', 'Content-Length': '0'} 2023-12-15T23:24:35.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000826e3f9c9e6dca11-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.352 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:24:35.352 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:24:35.353 DEBUG:boto:Method: GET 2023-12-15T23:24:35.353 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:24:35.353 DEBUG:boto:Data: 2023-12-15T23:24:35.353 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.353 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.353 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.353 DEBUG:boto:Params: {} 2023-12-15T23:24:35.353 DEBUG:boto:Token: None 2023-12-15T23:24:35.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj115 2023-12-15T23:24:35.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2a1mFy3hKhGCHW0pHek/vErgNw= 2023-12-15T23:24:35.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2a1mFy3hKhGCHW0pHek/vErgNw=', 'Content-Length': '0'} 2023-12-15T23:24:35.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028bbf800763e9eb9-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.356 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.356 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.356 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.356 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.356 DEBUG:boto:Method: GET 2023-12-15T23:24:35.356 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.356 DEBUG:boto:Data: 2023-12-15T23:24:35.356 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.356 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.357 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.357 DEBUG:boto:Params: {} 2023-12-15T23:24:35.357 DEBUG:boto:Token: None 2023-12-15T23:24:35.357 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.359 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab92480cf32a37ef-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.360 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.360 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.360 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.360 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.360 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.360 DEBUG:boto:Method: GET 2023-12-15T23:24:35.360 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:24:35.360 DEBUG:boto:Data: 2023-12-15T23:24:35.361 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.361 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.361 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.361 DEBUG:boto:Params: {} 2023-12-15T23:24:35.361 DEBUG:boto:Token: None 2023-12-15T23:24:35.361 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.361 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b2d98f69076b50e-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.365 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:24:35.365 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.365 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.365 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.365 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.365 DEBUG:boto:Method: GET 2023-12-15T23:24:35.366 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.366 DEBUG:boto:Data: 2023-12-15T23:24:35.366 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.366 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.366 DEBUG:boto:Params: {} 2023-12-15T23:24:35.366 DEBUG:boto:Token: None 2023-12-15T23:24:35.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE= 2023-12-15T23:24:35.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE=', 'Content-Length': '0'} 2023-12-15T23:24:35.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cf2c5d019694c4d-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.368 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.369 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.369 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.369 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.369 DEBUG:boto:Method: GET 2023-12-15T23:24:35.369 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.369 DEBUG:boto:Data: 2023-12-15T23:24:35.369 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.369 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.369 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.369 DEBUG:boto:Params: {} 2023-12-15T23:24:35.370 DEBUG:boto:Token: None 2023-12-15T23:24:35.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE= 2023-12-15T23:24:35.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE=', 'Content-Length': '0'} 2023-12-15T23:24:35.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076f4d7d52d3a667a-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.372 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.372 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.372 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.373 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.373 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.373 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.373 DEBUG:boto:Data: 2023-12-15T23:24:35.373 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.373 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.373 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.373 DEBUG:boto:Params: {} 2023-12-15T23:24:35.373 DEBUG:boto:Token: None 2023-12-15T23:24:35.373 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kNoMwXk3wyJLPmAAHfVAhndJATY= 2023-12-15T23:24:35.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kNoMwXk3wyJLPmAAHfVAhndJATY=', 'Content-Length': '0'} 2023-12-15T23:24:35.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000abab34923b67ac1-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.376 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.376 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.376 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.376 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.376 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.376 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.376 DEBUG:boto:Data: 2023-12-15T23:24:35.376 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.377 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.377 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.377 DEBUG:boto:Params: {} 2023-12-15T23:24:35.377 DEBUG:boto:Token: None 2023-12-15T23:24:35.377 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.377 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kNoMwXk3wyJLPmAAHfVAhndJATY= 2023-12-15T23:24:35.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kNoMwXk3wyJLPmAAHfVAhndJATY=', 'Content-Length': '0'} 2023-12-15T23:24:35.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb86746b62746d4c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:24:35.379 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.380 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.380 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.380 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.380 DEBUG:boto:Method: GET 2023-12-15T23:24:35.380 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.380 DEBUG:boto:Data: 2023-12-15T23:24:35.380 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.380 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.380 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.380 DEBUG:boto:Params: {} 2023-12-15T23:24:35.380 DEBUG:boto:Token: None 2023-12-15T23:24:35.381 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE= 2023-12-15T23:24:35.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE=', 'Content-Length': '0'} 2023-12-15T23:24:35.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003edcb9331e93a72a-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.383 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.383 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.383 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.383 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.383 DEBUG:boto:Method: GET 2023-12-15T23:24:35.383 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.383 DEBUG:boto:Data: 2023-12-15T23:24:35.384 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.384 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.384 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.384 DEBUG:boto:Params: {} 2023-12-15T23:24:35.384 DEBUG:boto:Token: None 2023-12-15T23:24:35.384 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:24:35.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE= 2023-12-15T23:24:35.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z3+ekfqfDvCtFoIryonHdXcCCkE=', 'Content-Length': '0'} 2023-12-15T23:24:35.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e4c3370c05a1264-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.387 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.387 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.387 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.387 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.387 DEBUG:boto:Method: GET 2023-12-15T23:24:35.387 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.387 DEBUG:boto:Data: 2023-12-15T23:24:35.387 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.387 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.388 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.388 DEBUG:boto:Params: {} 2023-12-15T23:24:35.388 DEBUG:boto:Token: None 2023-12-15T23:24:35.388 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c69fe303bb65c5bc-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.391 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.391 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.391 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.391 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.391 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.391 DEBUG:boto:Method: GET 2023-12-15T23:24:35.391 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.391 DEBUG:boto:Data: 2023-12-15T23:24:35.392 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.392 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.392 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.392 DEBUG:boto:Params: {} 2023-12-15T23:24:35.392 DEBUG:boto:Token: None 2023-12-15T23:24:35.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000195e382c0bfb1c63-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.437 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.438 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.438 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.438 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.438 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:24:35.438 DEBUG:boto:Data: 2023-12-15T23:24:35.438 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.438 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.439 DEBUG:boto:Params: {} 2023-12-15T23:24:35.439 DEBUG:boto:Token: None 2023-12-15T23:24:35.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116 2023-12-15T23:24:35.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:je1bxfHY88xrUidQDOkWSEpjNFk= 2023-12-15T23:24:35.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:je1bxfHY88xrUidQDOkWSEpjNFk=', 'Content-Length': '0'} 2023-12-15T23:24:35.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033b9c278823698af-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.441 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.441 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.441 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.441 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:24:35.442 DEBUG:boto:Data: 2023-12-15T23:24:35.442 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.442 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.442 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.442 DEBUG:boto:Params: {} 2023-12-15T23:24:35.442 DEBUG:boto:Token: None 2023-12-15T23:24:35.442 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116 2023-12-15T23:24:35.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:je1bxfHY88xrUidQDOkWSEpjNFk= 2023-12-15T23:24:35.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:je1bxfHY88xrUidQDOkWSEpjNFk=', 'Content-Length': '0'} 2023-12-15T23:24:35.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a0dfc6150324c10-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:24:35.445 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.445 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.445 DEBUG:boto:Method: GET 2023-12-15T23:24:35.445 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:24:35.445 DEBUG:boto:Data: 2023-12-15T23:24:35.445 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.445 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.445 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.445 DEBUG:boto:Params: {} 2023-12-15T23:24:35.445 DEBUG:boto:Token: None 2023-12-15T23:24:35.446 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116 2023-12-15T23:24:35.446 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yn0G+432avr37MAmuGVHEaEqQtc= 2023-12-15T23:24:35.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yn0G+432avr37MAmuGVHEaEqQtc=', 'Content-Length': '0'} 2023-12-15T23:24:35.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005230ffde551a2cb8-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.448 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:24:35.448 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:24:35.448 DEBUG:boto:Method: GET 2023-12-15T23:24:35.448 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:24:35.448 DEBUG:boto:Data: 2023-12-15T23:24:35.448 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.448 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.449 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.449 DEBUG:boto:Params: {} 2023-12-15T23:24:35.449 DEBUG:boto:Token: None 2023-12-15T23:24:35.449 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj116 2023-12-15T23:24:35.449 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yn0G+432avr37MAmuGVHEaEqQtc= 2023-12-15T23:24:35.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yn0G+432avr37MAmuGVHEaEqQtc=', 'Content-Length': '0'} 2023-12-15T23:24:35.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000412d93c2a9ca872c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.451 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.451 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.451 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.451 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.451 DEBUG:boto:Method: GET 2023-12-15T23:24:35.452 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.452 DEBUG:boto:Data: 2023-12-15T23:24:35.452 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.452 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.452 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.452 DEBUG:boto:Params: {} 2023-12-15T23:24:35.452 DEBUG:boto:Token: None 2023-12-15T23:24:35.452 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acaafd5669133cce-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.455 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.455 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.455 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.455 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.455 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.456 DEBUG:boto:Method: GET 2023-12-15T23:24:35.456 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:24:35.456 DEBUG:boto:Data: 2023-12-15T23:24:35.456 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.456 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.456 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.456 DEBUG:boto:Params: {} 2023-12-15T23:24:35.456 DEBUG:boto:Token: None 2023-12-15T23:24:35.456 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.456 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.459 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5f4d5c8622e2d49-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.460 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:24:35.460 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.460 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.460 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.460 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.461 DEBUG:boto:Method: GET 2023-12-15T23:24:35.461 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.461 DEBUG:boto:Data: 2023-12-15T23:24:35.461 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.461 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.461 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.461 DEBUG:boto:Params: {} 2023-12-15T23:24:35.461 DEBUG:boto:Token: None 2023-12-15T23:24:35.461 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I= 2023-12-15T23:24:35.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I=', 'Content-Length': '0'} 2023-12-15T23:24:35.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f49e45bb3372e7c0-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.464 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.464 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.464 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.464 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.465 DEBUG:boto:Method: GET 2023-12-15T23:24:35.465 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.465 DEBUG:boto:Data: 2023-12-15T23:24:35.465 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.465 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.465 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.465 DEBUG:boto:Params: {} 2023-12-15T23:24:35.465 DEBUG:boto:Token: None 2023-12-15T23:24:35.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I= 2023-12-15T23:24:35.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I=', 'Content-Length': '0'} 2023-12-15T23:24:35.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090813e1fe828b504-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.468 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.468 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.468 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.468 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.468 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.468 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.468 DEBUG:boto:Data: 2023-12-15T23:24:35.468 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.468 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.468 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.468 DEBUG:boto:Params: {} 2023-12-15T23:24:35.469 DEBUG:boto:Token: None 2023-12-15T23:24:35.469 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DtdP23xriJhrgJAT7eOcULzqtLI= 2023-12-15T23:24:35.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DtdP23xriJhrgJAT7eOcULzqtLI=', 'Content-Length': '0'} 2023-12-15T23:24:35.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000600ad3e94d9575f-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.471 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.471 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.471 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.471 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.471 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.472 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.472 DEBUG:boto:Data: 2023-12-15T23:24:35.472 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.472 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.472 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.472 DEBUG:boto:Params: {} 2023-12-15T23:24:35.472 DEBUG:boto:Token: None 2023-12-15T23:24:35.472 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.472 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DtdP23xriJhrgJAT7eOcULzqtLI= 2023-12-15T23:24:35.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DtdP23xriJhrgJAT7eOcULzqtLI=', 'Content-Length': '0'} 2023-12-15T23:24:35.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d7951f45a029087-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.474 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:24:35.474 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.474 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.475 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.475 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.475 DEBUG:boto:Method: GET 2023-12-15T23:24:35.475 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.475 DEBUG:boto:Data: 2023-12-15T23:24:35.475 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.475 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.475 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.475 DEBUG:boto:Params: {} 2023-12-15T23:24:35.475 DEBUG:boto:Token: None 2023-12-15T23:24:35.476 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I= 2023-12-15T23:24:35.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I=', 'Content-Length': '0'} 2023-12-15T23:24:35.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c56323fb4a153282-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.478 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.478 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.478 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.478 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.478 DEBUG:boto:Method: GET 2023-12-15T23:24:35.478 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.478 DEBUG:boto:Data: 2023-12-15T23:24:35.478 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.479 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.479 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.479 DEBUG:boto:Params: {} 2023-12-15T23:24:35.479 DEBUG:boto:Token: None 2023-12-15T23:24:35.479 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:24:35.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I= 2023-12-15T23:24:35.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+xk69NNUVOstZPlFI9maQ0P593I=', 'Content-Length': '0'} 2023-12-15T23:24:35.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007051057ded3ccbdf-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.522 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.522 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.522 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.522 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.522 DEBUG:boto:Method: GET 2023-12-15T23:24:35.522 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.522 DEBUG:boto:Data: 2023-12-15T23:24:35.522 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.522 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.523 DEBUG:boto:Params: {} 2023-12-15T23:24:35.523 DEBUG:boto:Token: None 2023-12-15T23:24:35.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.525 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b52efa8069c6f1ae-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.525 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.526 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.526 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.526 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.526 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.526 DEBUG:boto:Method: GET 2023-12-15T23:24:35.526 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.526 DEBUG:boto:Data: 2023-12-15T23:24:35.527 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.527 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.527 DEBUG:boto:Params: {} 2023-12-15T23:24:35.527 DEBUG:boto:Token: None 2023-12-15T23:24:35.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cb5d306b78ba210-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.530 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.531 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.531 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.531 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.531 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:24:35.531 DEBUG:boto:Data: 2023-12-15T23:24:35.531 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.531 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.532 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.532 DEBUG:boto:Params: {} 2023-12-15T23:24:35.532 DEBUG:boto:Token: None 2023-12-15T23:24:35.532 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124 2023-12-15T23:24:35.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MyfHZ2RUwOnaxl6gNv8ca16W1BM= 2023-12-15T23:24:35.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MyfHZ2RUwOnaxl6gNv8ca16W1BM=', 'Content-Length': '0'} 2023-12-15T23:24:35.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f50bb22e51931a6e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.534 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.534 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.534 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.534 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:24:35.534 DEBUG:boto:Data: 2023-12-15T23:24:35.534 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.535 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.535 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.535 DEBUG:boto:Params: {} 2023-12-15T23:24:35.535 DEBUG:boto:Token: None 2023-12-15T23:24:35.535 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124 2023-12-15T23:24:35.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MyfHZ2RUwOnaxl6gNv8ca16W1BM= 2023-12-15T23:24:35.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MyfHZ2RUwOnaxl6gNv8ca16W1BM=', 'Content-Length': '0'} 2023-12-15T23:24:35.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061c5daeb8239771b-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:24:35.537 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.537 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.537 DEBUG:boto:Method: GET 2023-12-15T23:24:35.538 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:24:35.538 DEBUG:boto:Data: 2023-12-15T23:24:35.538 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.538 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.538 DEBUG:boto:Params: {} 2023-12-15T23:24:35.538 DEBUG:boto:Token: None 2023-12-15T23:24:35.538 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124 2023-12-15T23:24:35.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:faZNY3H2yOGbKvaG2Myz/mls9QU= 2023-12-15T23:24:35.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:faZNY3H2yOGbKvaG2Myz/mls9QU=', 'Content-Length': '0'} 2023-12-15T23:24:35.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009500ad9c6b0ba91e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.581 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:24:35.582 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:24:35.582 DEBUG:boto:Method: GET 2023-12-15T23:24:35.582 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:24:35.582 DEBUG:boto:Data: 2023-12-15T23:24:35.582 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.582 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.582 DEBUG:boto:Params: {} 2023-12-15T23:24:35.582 DEBUG:boto:Token: None 2023-12-15T23:24:35.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj124 2023-12-15T23:24:35.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:faZNY3H2yOGbKvaG2Myz/mls9QU= 2023-12-15T23:24:35.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:faZNY3H2yOGbKvaG2Myz/mls9QU=', 'Content-Length': '0'} 2023-12-15T23:24:35.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000122e8f8494e69e19-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.585 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.585 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.585 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.585 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.585 DEBUG:boto:Method: GET 2023-12-15T23:24:35.585 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.586 DEBUG:boto:Data: 2023-12-15T23:24:35.586 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.586 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.586 DEBUG:boto:Params: {} 2023-12-15T23:24:35.586 DEBUG:boto:Token: None 2023-12-15T23:24:35.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000777ff2fc8455354e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.589 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.589 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.589 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.589 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.589 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.590 DEBUG:boto:Method: GET 2023-12-15T23:24:35.590 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:24:35.590 DEBUG:boto:Data: 2023-12-15T23:24:35.590 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.590 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.590 DEBUG:boto:Params: {} 2023-12-15T23:24:35.590 DEBUG:boto:Token: None 2023-12-15T23:24:35.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000426474de98d8ee83-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.594 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:24:35.594 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.595 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.595 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.595 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.595 DEBUG:boto:Method: GET 2023-12-15T23:24:35.595 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.595 DEBUG:boto:Data: 2023-12-15T23:24:35.595 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.595 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.595 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.595 DEBUG:boto:Params: {} 2023-12-15T23:24:35.595 DEBUG:boto:Token: None 2023-12-15T23:24:35.596 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc= 2023-12-15T23:24:35.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc=', 'Content-Length': '0'} 2023-12-15T23:24:35.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004771c39e5dfdb58c-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.598 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.598 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.598 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.598 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.598 DEBUG:boto:Method: GET 2023-12-15T23:24:35.599 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.599 DEBUG:boto:Data: 2023-12-15T23:24:35.599 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.599 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.599 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.599 DEBUG:boto:Params: {} 2023-12-15T23:24:35.599 DEBUG:boto:Token: None 2023-12-15T23:24:35.599 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.599 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc= 2023-12-15T23:24:35.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc=', 'Content-Length': '0'} 2023-12-15T23:24:35.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eda3a33b6dd86797-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.641 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.642 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.642 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.642 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.642 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.642 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.642 DEBUG:boto:Data: 2023-12-15T23:24:35.642 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.642 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.642 DEBUG:boto:Params: {} 2023-12-15T23:24:35.643 DEBUG:boto:Token: None 2023-12-15T23:24:35.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HcX3GwRZ9FG6or1xT8znqekgaz0= 2023-12-15T23:24:35.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HcX3GwRZ9FG6or1xT8znqekgaz0=', 'Content-Length': '0'} 2023-12-15T23:24:35.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d89c7d2f314eece8-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.645 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.646 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.646 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.646 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.646 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.646 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.646 DEBUG:boto:Data: 2023-12-15T23:24:35.646 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.646 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.646 DEBUG:boto:Params: {} 2023-12-15T23:24:35.647 DEBUG:boto:Token: None 2023-12-15T23:24:35.647 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HcX3GwRZ9FG6or1xT8znqekgaz0= 2023-12-15T23:24:35.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HcX3GwRZ9FG6or1xT8znqekgaz0=', 'Content-Length': '0'} 2023-12-15T23:24:35.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f022845113da33c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:24:35.649 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.649 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.649 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.649 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.649 DEBUG:boto:Method: GET 2023-12-15T23:24:35.649 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.650 DEBUG:boto:Data: 2023-12-15T23:24:35.650 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.650 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.650 DEBUG:boto:Params: {} 2023-12-15T23:24:35.650 DEBUG:boto:Token: None 2023-12-15T23:24:35.650 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc= 2023-12-15T23:24:35.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc=', 'Content-Length': '0'} 2023-12-15T23:24:35.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bffd0797fa0cdfd-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.652 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.653 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.653 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.653 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.653 DEBUG:boto:Method: GET 2023-12-15T23:24:35.653 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.653 DEBUG:boto:Data: 2023-12-15T23:24:35.653 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.653 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.653 DEBUG:boto:Params: {} 2023-12-15T23:24:35.654 DEBUG:boto:Token: None 2023-12-15T23:24:35.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:24:35.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc= 2023-12-15T23:24:35.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYnrZTIpoSicLBBe7dT7YH9+7Wc=', 'Content-Length': '0'} 2023-12-15T23:24:35.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000145152167c83947e-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.656 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.656 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.656 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.656 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.656 DEBUG:boto:Method: GET 2023-12-15T23:24:35.657 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.657 DEBUG:boto:Data: 2023-12-15T23:24:35.657 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.657 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.657 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.657 DEBUG:boto:Params: {} 2023-12-15T23:24:35.657 DEBUG:boto:Token: None 2023-12-15T23:24:35.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc5900b87d1b6d37-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.660 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.660 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.661 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.661 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.661 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.661 DEBUG:boto:Method: GET 2023-12-15T23:24:35.661 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.661 DEBUG:boto:Data: 2023-12-15T23:24:35.661 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.661 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.661 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.661 DEBUG:boto:Params: {} 2023-12-15T23:24:35.662 DEBUG:boto:Token: None 2023-12-15T23:24:35.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035807056b09db853-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.665 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.666 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.666 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.666 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.666 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:24:35.666 DEBUG:boto:Data: 2023-12-15T23:24:35.666 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.666 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.666 DEBUG:boto:Params: {} 2023-12-15T23:24:35.667 DEBUG:boto:Token: None 2023-12-15T23:24:35.667 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145 2023-12-15T23:24:35.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xmhEJZZilVi1g/G6aPiXjPdLN08= 2023-12-15T23:24:35.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xmhEJZZilVi1g/G6aPiXjPdLN08=', 'Content-Length': '0'} 2023-12-15T23:24:35.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009366ac14a5be9e29-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.669 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.669 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.669 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.669 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:24:35.669 DEBUG:boto:Data: 2023-12-15T23:24:35.669 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.669 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.669 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.670 DEBUG:boto:Params: {} 2023-12-15T23:24:35.670 DEBUG:boto:Token: None 2023-12-15T23:24:35.670 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145 2023-12-15T23:24:35.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xmhEJZZilVi1g/G6aPiXjPdLN08= 2023-12-15T23:24:35.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xmhEJZZilVi1g/G6aPiXjPdLN08=', 'Content-Length': '0'} 2023-12-15T23:24:35.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d58534c6e2868207-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:24:35.672 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.672 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.672 DEBUG:boto:Method: GET 2023-12-15T23:24:35.672 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:24:35.672 DEBUG:boto:Data: 2023-12-15T23:24:35.673 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.673 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.673 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.673 DEBUG:boto:Params: {} 2023-12-15T23:24:35.673 DEBUG:boto:Token: None 2023-12-15T23:24:35.673 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145 2023-12-15T23:24:35.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgYPVYyN3CUcQQg7XaFeWE3JsRc= 2023-12-15T23:24:35.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgYPVYyN3CUcQQg7XaFeWE3JsRc=', 'Content-Length': '0'} 2023-12-15T23:24:35.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007188901bb3397725-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.675 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:24:35.676 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:24:35.676 DEBUG:boto:Method: GET 2023-12-15T23:24:35.676 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:24:35.676 DEBUG:boto:Data: 2023-12-15T23:24:35.676 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.676 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.676 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.676 DEBUG:boto:Params: {} 2023-12-15T23:24:35.676 DEBUG:boto:Token: None 2023-12-15T23:24:35.676 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj145 2023-12-15T23:24:35.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mgYPVYyN3CUcQQg7XaFeWE3JsRc= 2023-12-15T23:24:35.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mgYPVYyN3CUcQQg7XaFeWE3JsRc=', 'Content-Length': '0'} 2023-12-15T23:24:35.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009dcb5ad4ac456c5-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.679 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.679 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.679 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.679 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.679 DEBUG:boto:Method: GET 2023-12-15T23:24:35.679 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.679 DEBUG:boto:Data: 2023-12-15T23:24:35.680 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.680 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.680 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.680 DEBUG:boto:Params: {} 2023-12-15T23:24:35.680 DEBUG:boto:Token: None 2023-12-15T23:24:35.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093cf7ed167e24037-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.683 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.683 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.683 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.683 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.683 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.683 DEBUG:boto:Method: GET 2023-12-15T23:24:35.683 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:24:35.683 DEBUG:boto:Data: 2023-12-15T23:24:35.684 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.684 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.684 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.684 DEBUG:boto:Params: {} 2023-12-15T23:24:35.684 DEBUG:boto:Token: None 2023-12-15T23:24:35.684 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.684 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036fd82961f1b3d0f-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.687 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:24:35.688 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.688 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.688 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.688 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.688 DEBUG:boto:Method: GET 2023-12-15T23:24:35.688 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.688 DEBUG:boto:Data: 2023-12-15T23:24:35.689 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.689 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.689 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.689 DEBUG:boto:Params: {} 2023-12-15T23:24:35.689 DEBUG:boto:Token: None 2023-12-15T23:24:35.689 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.689 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4= 2023-12-15T23:24:35.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4=', 'Content-Length': '0'} 2023-12-15T23:24:35.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9916190c8f6d692-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.692 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.692 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.692 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.692 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.692 DEBUG:boto:Method: GET 2023-12-15T23:24:35.692 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.692 DEBUG:boto:Data: 2023-12-15T23:24:35.693 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.693 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.693 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.693 DEBUG:boto:Params: {} 2023-12-15T23:24:35.693 DEBUG:boto:Token: None 2023-12-15T23:24:35.693 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.693 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4= 2023-12-15T23:24:35.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4=', 'Content-Length': '0'} 2023-12-15T23:24:35.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089f5a22a12feb731-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.737 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.738 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.738 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.738 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.738 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.738 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.738 DEBUG:boto:Data: 2023-12-15T23:24:35.738 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.738 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.738 DEBUG:boto:Params: {} 2023-12-15T23:24:35.738 DEBUG:boto:Token: None 2023-12-15T23:24:35.739 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pl5sXNUf7l/odv+nHQpLHbXje5g= 2023-12-15T23:24:35.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pl5sXNUf7l/odv+nHQpLHbXje5g=', 'Content-Length': '0'} 2023-12-15T23:24:35.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032288c223f6ee038-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.741 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.741 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.741 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.741 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.742 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.742 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.742 DEBUG:boto:Data: 2023-12-15T23:24:35.742 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.742 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.742 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.742 DEBUG:boto:Params: {} 2023-12-15T23:24:35.742 DEBUG:boto:Token: None 2023-12-15T23:24:35.742 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.742 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pl5sXNUf7l/odv+nHQpLHbXje5g= 2023-12-15T23:24:35.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pl5sXNUf7l/odv+nHQpLHbXje5g=', 'Content-Length': '0'} 2023-12-15T23:24:35.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000992f72a10f61ee35-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:24:35.745 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.745 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.745 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.745 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.745 DEBUG:boto:Method: GET 2023-12-15T23:24:35.745 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.745 DEBUG:boto:Data: 2023-12-15T23:24:35.745 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.745 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.746 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.746 DEBUG:boto:Params: {} 2023-12-15T23:24:35.746 DEBUG:boto:Token: None 2023-12-15T23:24:35.746 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4= 2023-12-15T23:24:35.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4=', 'Content-Length': '0'} 2023-12-15T23:24:35.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a37ac172127bf5d4-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.748 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.749 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.749 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.749 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.749 DEBUG:boto:Method: GET 2023-12-15T23:24:35.749 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.749 DEBUG:boto:Data: 2023-12-15T23:24:35.749 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.749 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.749 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.749 DEBUG:boto:Params: {} 2023-12-15T23:24:35.750 DEBUG:boto:Token: None 2023-12-15T23:24:35.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:24:35.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4= 2023-12-15T23:24:35.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x+3rNY7uIGajDPjdKSU7GohA7l4=', 'Content-Length': '0'} 2023-12-15T23:24:35.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093b4367ae9fb139a-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.753 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.753 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.753 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.753 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.753 DEBUG:boto:Method: GET 2023-12-15T23:24:35.753 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.753 DEBUG:boto:Data: 2023-12-15T23:24:35.753 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.753 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.753 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.754 DEBUG:boto:Params: {} 2023-12-15T23:24:35.754 DEBUG:boto:Token: None 2023-12-15T23:24:35.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.756 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e383b7962b2bb0b-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.756 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.756 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.756 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.757 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.757 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.757 DEBUG:boto:Method: GET 2023-12-15T23:24:35.757 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.757 DEBUG:boto:Data: 2023-12-15T23:24:35.757 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.757 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.757 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.757 DEBUG:boto:Params: {} 2023-12-15T23:24:35.758 DEBUG:boto:Token: None 2023-12-15T23:24:35.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.761 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050a9c57c3122e32d-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.761 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.762 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.762 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.762 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.762 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:24:35.762 DEBUG:boto:Data: 2023-12-15T23:24:35.762 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.762 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.762 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.762 DEBUG:boto:Params: {} 2023-12-15T23:24:35.762 DEBUG:boto:Token: None 2023-12-15T23:24:35.763 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155 2023-12-15T23:24:35.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXKkneG/uATvf3d6KnzjaetsD4c= 2023-12-15T23:24:35.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXKkneG/uATvf3d6KnzjaetsD4c=', 'Content-Length': '0'} 2023-12-15T23:24:35.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051a4e960fd197361-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.765 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.765 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.766 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.766 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:24:35.766 DEBUG:boto:Data: 2023-12-15T23:24:35.766 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.766 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.766 DEBUG:boto:Params: {} 2023-12-15T23:24:35.766 DEBUG:boto:Token: None 2023-12-15T23:24:35.766 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155 2023-12-15T23:24:35.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXKkneG/uATvf3d6KnzjaetsD4c= 2023-12-15T23:24:35.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXKkneG/uATvf3d6KnzjaetsD4c=', 'Content-Length': '0'} 2023-12-15T23:24:35.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005799ed1516d1a785-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:24:35.769 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.769 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.770 DEBUG:boto:Method: GET 2023-12-15T23:24:35.770 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:24:35.770 DEBUG:boto:Data: 2023-12-15T23:24:35.770 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.770 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.770 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.770 DEBUG:boto:Params: {} 2023-12-15T23:24:35.770 DEBUG:boto:Token: None 2023-12-15T23:24:35.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155 2023-12-15T23:24:35.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKkR9M9li5j1Qnj6RoaChhQiOBU= 2023-12-15T23:24:35.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKkR9M9li5j1Qnj6RoaChhQiOBU=', 'Content-Length': '0'} 2023-12-15T23:24:35.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ab2d961dcf0ab6c-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.773 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:24:35.773 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:24:35.773 DEBUG:boto:Method: GET 2023-12-15T23:24:35.774 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:24:35.774 DEBUG:boto:Data: 2023-12-15T23:24:35.774 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.774 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.774 DEBUG:boto:Params: {} 2023-12-15T23:24:35.774 DEBUG:boto:Token: None 2023-12-15T23:24:35.774 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj155 2023-12-15T23:24:35.774 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PKkR9M9li5j1Qnj6RoaChhQiOBU= 2023-12-15T23:24:35.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PKkR9M9li5j1Qnj6RoaChhQiOBU=', 'Content-Length': '0'} 2023-12-15T23:24:35.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae2cfed2df6a61d7-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.777 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.777 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.777 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.777 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.777 DEBUG:boto:Method: GET 2023-12-15T23:24:35.777 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.778 DEBUG:boto:Data: 2023-12-15T23:24:35.778 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.778 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.778 DEBUG:boto:Params: {} 2023-12-15T23:24:35.778 DEBUG:boto:Token: None 2023-12-15T23:24:35.778 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000937a4467b25b60e1-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.781 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.781 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.781 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.781 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.781 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.781 DEBUG:boto:Method: GET 2023-12-15T23:24:35.781 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:24:35.782 DEBUG:boto:Data: 2023-12-15T23:24:35.782 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.782 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.782 DEBUG:boto:Params: {} 2023-12-15T23:24:35.782 DEBUG:boto:Token: None 2023-12-15T23:24:35.782 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7078e896622ece3-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.786 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:24:35.786 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.787 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.787 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.787 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.787 DEBUG:boto:Method: GET 2023-12-15T23:24:35.787 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.787 DEBUG:boto:Data: 2023-12-15T23:24:35.787 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.787 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.787 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.787 DEBUG:boto:Params: {} 2023-12-15T23:24:35.787 DEBUG:boto:Token: None 2023-12-15T23:24:35.788 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q= 2023-12-15T23:24:35.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q=', 'Content-Length': '0'} 2023-12-15T23:24:35.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082efa73a7bdb9842-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.790 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.790 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.790 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.790 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.791 DEBUG:boto:Method: GET 2023-12-15T23:24:35.791 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.791 DEBUG:boto:Data: 2023-12-15T23:24:35.791 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.791 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.791 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.791 DEBUG:boto:Params: {} 2023-12-15T23:24:35.791 DEBUG:boto:Token: None 2023-12-15T23:24:35.791 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q= 2023-12-15T23:24:35.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q=', 'Content-Length': '0'} 2023-12-15T23:24:35.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d62fd3896315ee6f-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.794 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.794 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.794 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.794 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.794 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.794 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.794 DEBUG:boto:Data: 2023-12-15T23:24:35.794 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.794 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.795 DEBUG:boto:Params: {} 2023-12-15T23:24:35.795 DEBUG:boto:Token: None 2023-12-15T23:24:35.795 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlCUga5La7DX/mkbG4/pB7nh3NE= 2023-12-15T23:24:35.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlCUga5La7DX/mkbG4/pB7nh3NE=', 'Content-Length': '0'} 2023-12-15T23:24:35.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3578ad2235b6271-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.797 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.797 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.797 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.797 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.797 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.798 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.798 DEBUG:boto:Data: 2023-12-15T23:24:35.798 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.798 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.798 DEBUG:boto:Params: {} 2023-12-15T23:24:35.798 DEBUG:boto:Token: None 2023-12-15T23:24:35.798 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tlCUga5La7DX/mkbG4/pB7nh3NE= 2023-12-15T23:24:35.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tlCUga5La7DX/mkbG4/pB7nh3NE=', 'Content-Length': '0'} 2023-12-15T23:24:35.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af16916a28f2076c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:24:35.800 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.801 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.801 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.801 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.801 DEBUG:boto:Method: GET 2023-12-15T23:24:35.801 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.801 DEBUG:boto:Data: 2023-12-15T23:24:35.801 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.801 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.801 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.801 DEBUG:boto:Params: {} 2023-12-15T23:24:35.802 DEBUG:boto:Token: None 2023-12-15T23:24:35.802 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q= 2023-12-15T23:24:35.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q=', 'Content-Length': '0'} 2023-12-15T23:24:35.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039b51c005baf1822-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.845 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.846 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.846 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.846 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.846 DEBUG:boto:Method: GET 2023-12-15T23:24:35.846 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.846 DEBUG:boto:Data: 2023-12-15T23:24:35.846 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.846 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.846 DEBUG:boto:Params: {} 2023-12-15T23:24:35.847 DEBUG:boto:Token: None 2023-12-15T23:24:35.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:24:35.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q= 2023-12-15T23:24:35.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x63FRMQNezCSLqMIZouWyjEtE6Q=', 'Content-Length': '0'} 2023-12-15T23:24:35.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e91bdd1ca45b27c-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.849 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.849 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.849 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.849 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.850 DEBUG:boto:Method: GET 2023-12-15T23:24:35.850 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.850 DEBUG:boto:Data: 2023-12-15T23:24:35.850 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.850 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.850 DEBUG:boto:Params: {} 2023-12-15T23:24:35.850 DEBUG:boto:Token: None 2023-12-15T23:24:35.850 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.850 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b287c3fd1496a7a-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.853 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.854 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.854 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.854 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.854 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.854 DEBUG:boto:Method: GET 2023-12-15T23:24:35.854 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.854 DEBUG:boto:Data: 2023-12-15T23:24:35.854 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.854 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.854 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.855 DEBUG:boto:Params: {} 2023-12-15T23:24:35.855 DEBUG:boto:Token: None 2023-12-15T23:24:35.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d47116f4c7736c38-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.858 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.859 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.859 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.859 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.859 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:24:35.859 DEBUG:boto:Data: 2023-12-15T23:24:35.859 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.859 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.859 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.859 DEBUG:boto:Params: {} 2023-12-15T23:24:35.860 DEBUG:boto:Token: None 2023-12-15T23:24:35.860 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17 2023-12-15T23:24:35.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ej1dWOu26DvBmG1RHrr7fq6EPek= 2023-12-15T23:24:35.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ej1dWOu26DvBmG1RHrr7fq6EPek=', 'Content-Length': '0'} 2023-12-15T23:24:35.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d9e1f0139948407-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.862 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.862 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.862 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.862 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:24:35.863 DEBUG:boto:Data: 2023-12-15T23:24:35.863 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.863 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.863 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.863 DEBUG:boto:Params: {} 2023-12-15T23:24:35.863 DEBUG:boto:Token: None 2023-12-15T23:24:35.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17 2023-12-15T23:24:35.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ej1dWOu26DvBmG1RHrr7fq6EPek= 2023-12-15T23:24:35.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ej1dWOu26DvBmG1RHrr7fq6EPek=', 'Content-Length': '0'} 2023-12-15T23:24:35.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046df62f34c364288-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:24:35.865 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.866 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.866 DEBUG:boto:Method: GET 2023-12-15T23:24:35.866 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:24:35.866 DEBUG:boto:Data: 2023-12-15T23:24:35.866 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.866 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.866 DEBUG:boto:Params: {} 2023-12-15T23:24:35.866 DEBUG:boto:Token: None 2023-12-15T23:24:35.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17 2023-12-15T23:24:35.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fNfa43gpQPDCG3J1/xE5lvHDQFw= 2023-12-15T23:24:35.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fNfa43gpQPDCG3J1/xE5lvHDQFw=', 'Content-Length': '0'} 2023-12-15T23:24:35.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef599c370adb148b-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.869 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:24:35.869 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:24:35.869 DEBUG:boto:Method: GET 2023-12-15T23:24:35.869 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:24:35.869 DEBUG:boto:Data: 2023-12-15T23:24:35.869 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.869 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.869 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.869 DEBUG:boto:Params: {} 2023-12-15T23:24:35.870 DEBUG:boto:Token: None 2023-12-15T23:24:35.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj17 2023-12-15T23:24:35.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fNfa43gpQPDCG3J1/xE5lvHDQFw= 2023-12-15T23:24:35.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fNfa43gpQPDCG3J1/xE5lvHDQFw=', 'Content-Length': '0'} 2023-12-15T23:24:35.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006825a245dcec2ba8-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.872 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.872 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.872 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.872 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.873 DEBUG:boto:Method: GET 2023-12-15T23:24:35.873 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.873 DEBUG:boto:Data: 2023-12-15T23:24:35.873 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.873 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.873 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.873 DEBUG:boto:Params: {} 2023-12-15T23:24:35.873 DEBUG:boto:Token: None 2023-12-15T23:24:35.873 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.873 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.876 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a9db959877215f9-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.876 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.876 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.876 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.876 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.876 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.876 DEBUG:boto:Method: GET 2023-12-15T23:24:35.877 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:24:35.877 DEBUG:boto:Data: 2023-12-15T23:24:35.877 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.877 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.877 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.877 DEBUG:boto:Params: {} 2023-12-15T23:24:35.877 DEBUG:boto:Token: None 2023-12-15T23:24:35.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d38a387a60de6c62-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.881 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:24:35.881 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.881 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.882 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.882 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.882 DEBUG:boto:Method: GET 2023-12-15T23:24:35.882 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.882 DEBUG:boto:Data: 2023-12-15T23:24:35.882 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.882 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.882 DEBUG:boto:Params: {} 2023-12-15T23:24:35.882 DEBUG:boto:Token: None 2023-12-15T23:24:35.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg= 2023-12-15T23:24:35.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg=', 'Content-Length': '0'} 2023-12-15T23:24:35.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ec8fbcc3ef3d66f-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.885 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.885 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.885 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.885 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.886 DEBUG:boto:Method: GET 2023-12-15T23:24:35.886 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.886 DEBUG:boto:Data: 2023-12-15T23:24:35.886 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.886 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.886 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.886 DEBUG:boto:Params: {} 2023-12-15T23:24:35.886 DEBUG:boto:Token: None 2023-12-15T23:24:35.886 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg= 2023-12-15T23:24:35.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg=', 'Content-Length': '0'} 2023-12-15T23:24:35.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4e5737a146e8c30-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.889 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.889 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.889 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.890 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.890 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.890 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.890 DEBUG:boto:Data: 2023-12-15T23:24:35.890 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.890 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.890 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.890 DEBUG:boto:Params: {} 2023-12-15T23:24:35.890 DEBUG:boto:Token: None 2023-12-15T23:24:35.890 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uUQKes2feWvbc7f8iljGSNJ0VKA= 2023-12-15T23:24:35.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uUQKes2feWvbc7f8iljGSNJ0VKA=', 'Content-Length': '0'} 2023-12-15T23:24:35.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034a1c4f47e8cc575-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.893 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.893 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.893 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.893 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.893 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.893 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.893 DEBUG:boto:Data: 2023-12-15T23:24:35.894 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.894 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.894 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.894 DEBUG:boto:Params: {} 2023-12-15T23:24:35.894 DEBUG:boto:Token: None 2023-12-15T23:24:35.894 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uUQKes2feWvbc7f8iljGSNJ0VKA= 2023-12-15T23:24:35.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uUQKes2feWvbc7f8iljGSNJ0VKA=', 'Content-Length': '0'} 2023-12-15T23:24:35.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f26634e2de9f3d64-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:24:35.897 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.897 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.897 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.897 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.897 DEBUG:boto:Method: GET 2023-12-15T23:24:35.897 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.897 DEBUG:boto:Data: 2023-12-15T23:24:35.897 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.897 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.897 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.898 DEBUG:boto:Params: {} 2023-12-15T23:24:35.898 DEBUG:boto:Token: None 2023-12-15T23:24:35.898 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.898 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg= 2023-12-15T23:24:35.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg=', 'Content-Length': '0'} 2023-12-15T23:24:35.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ecebe5193291615-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.900 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.900 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.900 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.900 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.900 DEBUG:boto:Method: GET 2023-12-15T23:24:35.901 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.901 DEBUG:boto:Data: 2023-12-15T23:24:35.901 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.901 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.901 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.901 DEBUG:boto:Params: {} 2023-12-15T23:24:35.901 DEBUG:boto:Token: None 2023-12-15T23:24:35.901 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:24:35.901 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg= 2023-12-15T23:24:35.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QfCM9cSHmkr7IUtCfjT3kr2Sqdg=', 'Content-Length': '0'} 2023-12-15T23:24:35.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55bbcdf9e2e6271-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.903 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.904 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.904 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.904 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.904 DEBUG:boto:Method: GET 2023-12-15T23:24:35.904 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.904 DEBUG:boto:Data: 2023-12-15T23:24:35.904 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.904 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.904 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.904 DEBUG:boto:Params: {} 2023-12-15T23:24:35.905 DEBUG:boto:Token: None 2023-12-15T23:24:35.905 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.905 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.907 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003df79be09e57f4e6-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.907 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.908 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.908 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.908 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.908 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.908 DEBUG:boto:Method: GET 2023-12-15T23:24:35.908 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.908 DEBUG:boto:Data: 2023-12-15T23:24:35.908 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.909 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.909 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.909 DEBUG:boto:Params: {} 2023-12-15T23:24:35.909 DEBUG:boto:Token: None 2023-12-15T23:24:35.909 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.909 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.912 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e37abf4e1163f204-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.913 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.913 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.913 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.913 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.913 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:24:35.913 DEBUG:boto:Data: 2023-12-15T23:24:35.913 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.914 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.914 DEBUG:boto:Params: {} 2023-12-15T23:24:35.914 DEBUG:boto:Token: None 2023-12-15T23:24:35.914 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19 2023-12-15T23:24:35.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eHuqDkvUsH9rfW4msBJ+wCGF5zA= 2023-12-15T23:24:35.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eHuqDkvUsH9rfW4msBJ+wCGF5zA=', 'Content-Length': '0'} 2023-12-15T23:24:35.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000aee4a6f18f89df2-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.916 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.917 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.917 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.917 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:24:35.917 DEBUG:boto:Data: 2023-12-15T23:24:35.917 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.917 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.917 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.917 DEBUG:boto:Params: {} 2023-12-15T23:24:35.917 DEBUG:boto:Token: None 2023-12-15T23:24:35.917 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19 2023-12-15T23:24:35.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eHuqDkvUsH9rfW4msBJ+wCGF5zA= 2023-12-15T23:24:35.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eHuqDkvUsH9rfW4msBJ+wCGF5zA=', 'Content-Length': '0'} 2023-12-15T23:24:35.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf2c49a78c8165e9-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.920 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:24:35.920 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.920 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.920 DEBUG:boto:Method: GET 2023-12-15T23:24:35.920 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:24:35.920 DEBUG:boto:Data: 2023-12-15T23:24:35.921 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.921 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.921 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.921 DEBUG:boto:Params: {} 2023-12-15T23:24:35.921 DEBUG:boto:Token: None 2023-12-15T23:24:35.921 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19 2023-12-15T23:24:35.921 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OjZvQLPsoiphQz1brwN25LSTCLk= 2023-12-15T23:24:35.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OjZvQLPsoiphQz1brwN25LSTCLk=', 'Content-Length': '0'} 2023-12-15T23:24:35.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bf5f9b9b3e51e91-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.924 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:24:35.924 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:24:35.924 DEBUG:boto:Method: GET 2023-12-15T23:24:35.924 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:24:35.924 DEBUG:boto:Data: 2023-12-15T23:24:35.924 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.925 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.925 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.925 DEBUG:boto:Params: {} 2023-12-15T23:24:35.925 DEBUG:boto:Token: None 2023-12-15T23:24:35.925 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj19 2023-12-15T23:24:35.925 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OjZvQLPsoiphQz1brwN25LSTCLk= 2023-12-15T23:24:35.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OjZvQLPsoiphQz1brwN25LSTCLk=', 'Content-Length': '0'} 2023-12-15T23:24:35.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d49abab722490876-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.928 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.928 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.928 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.928 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.928 DEBUG:boto:Method: GET 2023-12-15T23:24:35.928 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.928 DEBUG:boto:Data: 2023-12-15T23:24:35.928 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.929 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.929 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.929 DEBUG:boto:Params: {} 2023-12-15T23:24:35.929 DEBUG:boto:Token: None 2023-12-15T23:24:35.929 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.929 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.931 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000785a740093838d56-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.931 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.932 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.932 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.932 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.932 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.932 DEBUG:boto:Method: GET 2023-12-15T23:24:35.932 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:24:35.932 DEBUG:boto:Data: 2023-12-15T23:24:35.933 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.933 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.933 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.933 DEBUG:boto:Params: {} 2023-12-15T23:24:35.933 DEBUG:boto:Token: None 2023-12-15T23:24:35.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000bd7af18caf27460-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.937 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.937 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:24:35.937 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.937 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.938 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.938 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.938 DEBUG:boto:Method: GET 2023-12-15T23:24:35.938 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.938 DEBUG:boto:Data: 2023-12-15T23:24:35.938 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.938 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.938 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.938 DEBUG:boto:Params: {} 2023-12-15T23:24:35.938 DEBUG:boto:Token: None 2023-12-15T23:24:35.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA= 2023-12-15T23:24:35.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA=', 'Content-Length': '0'} 2023-12-15T23:24:35.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc8c3c8343849db2-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.941 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.941 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.941 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.941 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.941 DEBUG:boto:Method: GET 2023-12-15T23:24:35.941 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.942 DEBUG:boto:Data: 2023-12-15T23:24:35.942 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.942 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.942 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.942 DEBUG:boto:Params: {} 2023-12-15T23:24:35.942 DEBUG:boto:Token: None 2023-12-15T23:24:35.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA= 2023-12-15T23:24:35.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA=', 'Content-Length': '0'} 2023-12-15T23:24:35.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a4588fa6d338d92-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.945 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.945 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.945 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.945 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.945 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.945 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.945 DEBUG:boto:Data: 2023-12-15T23:24:35.945 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.945 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.945 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.946 DEBUG:boto:Params: {} 2023-12-15T23:24:35.946 DEBUG:boto:Token: None 2023-12-15T23:24:35.946 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ymupFFL0SoABSaOpvEHR5w0z4MA= 2023-12-15T23:24:35.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymupFFL0SoABSaOpvEHR5w0z4MA=', 'Content-Length': '0'} 2023-12-15T23:24:35.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c178b40c31098668-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.948 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.948 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.948 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.948 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.948 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.949 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.949 DEBUG:boto:Data: 2023-12-15T23:24:35.949 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.949 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.949 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.949 DEBUG:boto:Params: {} 2023-12-15T23:24:35.949 DEBUG:boto:Token: None 2023-12-15T23:24:35.949 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ymupFFL0SoABSaOpvEHR5w0z4MA= 2023-12-15T23:24:35.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymupFFL0SoABSaOpvEHR5w0z4MA=', 'Content-Length': '0'} 2023-12-15T23:24:35.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000222a13e9685aa2b0-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:24:35.952 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.952 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.952 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.952 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.952 DEBUG:boto:Method: GET 2023-12-15T23:24:35.952 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.952 DEBUG:boto:Data: 2023-12-15T23:24:35.952 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.952 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.953 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.953 DEBUG:boto:Params: {} 2023-12-15T23:24:35.953 DEBUG:boto:Token: None 2023-12-15T23:24:35.953 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA= 2023-12-15T23:24:35.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA=', 'Content-Length': '0'} 2023-12-15T23:24:35.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fe4f0af9f596e4e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.955 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.956 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.956 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.956 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.956 DEBUG:boto:Method: GET 2023-12-15T23:24:35.956 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.956 DEBUG:boto:Data: 2023-12-15T23:24:35.956 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.956 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.956 DEBUG:boto:Params: {} 2023-12-15T23:24:35.956 DEBUG:boto:Token: None 2023-12-15T23:24:35.957 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:24:35.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA= 2023-12-15T23:24:35.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z8ie3DZxn6laVDQt26S13IxkeZA=', 'Content-Length': '0'} 2023-12-15T23:24:35.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098088705cf918139-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.959 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.959 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.959 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.959 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.959 DEBUG:boto:Method: GET 2023-12-15T23:24:35.959 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.959 DEBUG:boto:Data: 2023-12-15T23:24:35.959 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.960 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.960 DEBUG:boto:Params: {} 2023-12-15T23:24:35.960 DEBUG:boto:Token: None 2023-12-15T23:24:35.960 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea88627d95d6737b-00657ce033-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.963 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.963 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:35.963 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:35.963 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.963 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.963 DEBUG:boto:Method: GET 2023-12-15T23:24:35.964 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:24:35.964 DEBUG:boto:Data: 2023-12-15T23:24:35.964 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.964 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.964 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.964 DEBUG:boto:Params: {} 2023-12-15T23:24:35.964 DEBUG:boto:Token: None 2023-12-15T23:24:35.964 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/ 2023-12-15T23:24:35.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc= 2023-12-15T23:24:35.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WEm9Ne4K3K5PtwWLoGFsqJ3X5yc=', 'Content-Length': '0'} 2023-12-15T23:24:35.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f662486183769f8b-00657ce033-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.967 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:35.968 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.968 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.968 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.968 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:24:35.968 DEBUG:boto:Data: 2023-12-15T23:24:35.968 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.968 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.968 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.969 DEBUG:boto:Params: {} 2023-12-15T23:24:35.969 DEBUG:boto:Token: None 2023-12-15T23:24:35.969 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22 2023-12-15T23:24:35.969 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8HdXopEu74JEsAFtG1kXDP5H7DU= 2023-12-15T23:24:35.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8HdXopEu74JEsAFtG1kXDP5H7DU=', 'Content-Length': '0'} 2023-12-15T23:24:35.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000323153964008e3c9-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.971 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.971 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.971 DEBUG:boto:Method: HEAD 2023-12-15T23:24:35.971 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:24:35.971 DEBUG:boto:Data: 2023-12-15T23:24:35.971 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.972 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:35.972 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.972 DEBUG:boto:Params: {} 2023-12-15T23:24:35.972 DEBUG:boto:Token: None 2023-12-15T23:24:35.972 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22 2023-12-15T23:24:35.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8HdXopEu74JEsAFtG1kXDP5H7DU= 2023-12-15T23:24:35.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8HdXopEu74JEsAFtG1kXDP5H7DU=', 'Content-Length': '0'} 2023-12-15T23:24:35.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5c8ba5423618f85-00657ce033-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:35.974 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:24:35.974 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:35.974 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:35.974 DEBUG:boto:Method: GET 2023-12-15T23:24:35.974 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:24:35.975 DEBUG:boto:Data: 2023-12-15T23:24:35.975 DEBUG:boto:Headers: {} 2023-12-15T23:24:35.975 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:35.975 DEBUG:boto:Port: 8000 2023-12-15T23:24:35.975 DEBUG:boto:Params: {} 2023-12-15T23:24:35.975 DEBUG:boto:Token: None 2023-12-15T23:24:35.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:35 GMT /kskgfn-49/obj22 2023-12-15T23:24:35.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DVHwTKKNeNHtsAlf6h94mNgZ2eo= 2023-12-15T23:24:35.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:35 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DVHwTKKNeNHtsAlf6h94mNgZ2eo=', 'Content-Length': '0'} 2023-12-15T23:24:35.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006929e2c55528100e-00657ce033-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:35 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.017 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:24:36.018 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:24:36.018 DEBUG:boto:Method: GET 2023-12-15T23:24:36.018 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:24:36.018 DEBUG:boto:Data: 2023-12-15T23:24:36.018 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.018 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.018 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.018 DEBUG:boto:Params: {} 2023-12-15T23:24:36.018 DEBUG:boto:Token: None 2023-12-15T23:24:36.018 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj22 2023-12-15T23:24:36.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2qZ/vSa6IyFzNN70qJTIc5xEkAQ= 2023-12-15T23:24:36.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2qZ/vSa6IyFzNN70qJTIc5xEkAQ=', 'Content-Length': '0'} 2023-12-15T23:24:36.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4fe51b6b557aedd-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.021 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.021 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.021 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.021 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.021 DEBUG:boto:Method: GET 2023-12-15T23:24:36.021 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.021 DEBUG:boto:Data: 2023-12-15T23:24:36.021 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.022 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.022 DEBUG:boto:Params: {} 2023-12-15T23:24:36.022 DEBUG:boto:Token: None 2023-12-15T23:24:36.022 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c71db655c2eaa41-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.025 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.025 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.025 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.025 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.025 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.026 DEBUG:boto:Method: GET 2023-12-15T23:24:36.026 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:24:36.026 DEBUG:boto:Data: 2023-12-15T23:24:36.026 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.026 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.026 DEBUG:boto:Params: {} 2023-12-15T23:24:36.026 DEBUG:boto:Token: None 2023-12-15T23:24:36.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000539bcd2de50935a7-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.030 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:24:36.030 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.031 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.031 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.031 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.031 DEBUG:boto:Method: GET 2023-12-15T23:24:36.031 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.031 DEBUG:boto:Data: 2023-12-15T23:24:36.031 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.031 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.031 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.031 DEBUG:boto:Params: {} 2023-12-15T23:24:36.031 DEBUG:boto:Token: None 2023-12-15T23:24:36.032 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.032 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM= 2023-12-15T23:24:36.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM=', 'Content-Length': '0'} 2023-12-15T23:24:36.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a7ecc93ab574c05-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.034 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.034 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.034 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.034 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.034 DEBUG:boto:Method: GET 2023-12-15T23:24:36.034 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.035 DEBUG:boto:Data: 2023-12-15T23:24:36.035 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.035 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.035 DEBUG:boto:Params: {} 2023-12-15T23:24:36.035 DEBUG:boto:Token: None 2023-12-15T23:24:36.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM= 2023-12-15T23:24:36.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM=', 'Content-Length': '0'} 2023-12-15T23:24:36.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e808c85f9118142-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.038 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.038 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.038 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.038 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.038 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.038 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.038 DEBUG:boto:Data: 2023-12-15T23:24:36.039 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.039 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.039 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.039 DEBUG:boto:Params: {} 2023-12-15T23:24:36.039 DEBUG:boto:Token: None 2023-12-15T23:24:36.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gfzWJ88D91k90utP+g1AasQJZYA= 2023-12-15T23:24:36.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gfzWJ88D91k90utP+g1AasQJZYA=', 'Content-Length': '0'} 2023-12-15T23:24:36.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036301a1d47455fe8-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.041 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.042 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.042 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.042 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.042 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.042 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.042 DEBUG:boto:Data: 2023-12-15T23:24:36.042 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.042 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.042 DEBUG:boto:Params: {} 2023-12-15T23:24:36.042 DEBUG:boto:Token: None 2023-12-15T23:24:36.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gfzWJ88D91k90utP+g1AasQJZYA= 2023-12-15T23:24:36.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gfzWJ88D91k90utP+g1AasQJZYA=', 'Content-Length': '0'} 2023-12-15T23:24:36.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063a2432bd5485b83-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:24:36.045 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.045 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.045 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.045 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.045 DEBUG:boto:Method: GET 2023-12-15T23:24:36.045 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.046 DEBUG:boto:Data: 2023-12-15T23:24:36.046 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.046 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.046 DEBUG:boto:Params: {} 2023-12-15T23:24:36.046 DEBUG:boto:Token: None 2023-12-15T23:24:36.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM= 2023-12-15T23:24:36.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM=', 'Content-Length': '0'} 2023-12-15T23:24:36.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1cdb28cc7d6d964-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.048 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.048 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.049 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.049 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.049 DEBUG:boto:Method: GET 2023-12-15T23:24:36.049 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.049 DEBUG:boto:Data: 2023-12-15T23:24:36.049 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.049 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.049 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.049 DEBUG:boto:Params: {} 2023-12-15T23:24:36.049 DEBUG:boto:Token: None 2023-12-15T23:24:36.050 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:24:36.050 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM= 2023-12-15T23:24:36.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DEUokR8kfh7ivuv/oBst4PHj/wM=', 'Content-Length': '0'} 2023-12-15T23:24:36.051 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fda6c8b8aaf086cb-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.052 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.052 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.052 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.052 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.052 DEBUG:boto:Method: GET 2023-12-15T23:24:36.052 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.052 DEBUG:boto:Data: 2023-12-15T23:24:36.053 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.053 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.053 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.053 DEBUG:boto:Params: {} 2023-12-15T23:24:36.053 DEBUG:boto:Token: None 2023-12-15T23:24:36.053 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.053 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.056 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ecc64b79e9fb6d7-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.056 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.056 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.057 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.057 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.057 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.057 DEBUG:boto:Method: GET 2023-12-15T23:24:36.057 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.057 DEBUG:boto:Data: 2023-12-15T23:24:36.057 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.057 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.057 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.057 DEBUG:boto:Params: {} 2023-12-15T23:24:36.058 DEBUG:boto:Token: None 2023-12-15T23:24:36.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.058 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f87415853898f12-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.061 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.061 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.061 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.062 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.062 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:24:36.062 DEBUG:boto:Data: 2023-12-15T23:24:36.062 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.062 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.062 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.062 DEBUG:boto:Params: {} 2023-12-15T23:24:36.062 DEBUG:boto:Token: None 2023-12-15T23:24:36.062 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23 2023-12-15T23:24:36.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uYIH24W5C4pQoqgi0kN1kWxe3E= 2023-12-15T23:24:36.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uYIH24W5C4pQoqgi0kN1kWxe3E=', 'Content-Length': '0'} 2023-12-15T23:24:36.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cf49fcbac7d0b53-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.064 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.065 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.065 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.065 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:24:36.065 DEBUG:boto:Data: 2023-12-15T23:24:36.065 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.065 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.065 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.065 DEBUG:boto:Params: {} 2023-12-15T23:24:36.065 DEBUG:boto:Token: None 2023-12-15T23:24:36.066 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23 2023-12-15T23:24:36.066 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/uYIH24W5C4pQoqgi0kN1kWxe3E= 2023-12-15T23:24:36.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/uYIH24W5C4pQoqgi0kN1kWxe3E=', 'Content-Length': '0'} 2023-12-15T23:24:36.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c991e2b2eb307ffd-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:24:36.068 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.068 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.068 DEBUG:boto:Method: GET 2023-12-15T23:24:36.068 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:24:36.068 DEBUG:boto:Data: 2023-12-15T23:24:36.068 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.068 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.069 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.069 DEBUG:boto:Params: {} 2023-12-15T23:24:36.069 DEBUG:boto:Token: None 2023-12-15T23:24:36.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23 2023-12-15T23:24:36.069 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TZbRbiGk97sgb+cDdeZSbYpjAEc= 2023-12-15T23:24:36.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TZbRbiGk97sgb+cDdeZSbYpjAEc=', 'Content-Length': '0'} 2023-12-15T23:24:36.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf0b30ab932738ef-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.071 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:24:36.071 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:24:36.071 DEBUG:boto:Method: GET 2023-12-15T23:24:36.071 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:24:36.072 DEBUG:boto:Data: 2023-12-15T23:24:36.072 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.072 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.072 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.072 DEBUG:boto:Params: {} 2023-12-15T23:24:36.072 DEBUG:boto:Token: None 2023-12-15T23:24:36.072 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj23 2023-12-15T23:24:36.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TZbRbiGk97sgb+cDdeZSbYpjAEc= 2023-12-15T23:24:36.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TZbRbiGk97sgb+cDdeZSbYpjAEc=', 'Content-Length': '0'} 2023-12-15T23:24:36.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001471e042aead72fd-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.074 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.075 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.075 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.075 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.075 DEBUG:boto:Method: GET 2023-12-15T23:24:36.075 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.075 DEBUG:boto:Data: 2023-12-15T23:24:36.075 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.075 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.075 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.075 DEBUG:boto:Params: {} 2023-12-15T23:24:36.076 DEBUG:boto:Token: None 2023-12-15T23:24:36.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010e1ea227c1da870-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.078 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.079 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.079 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.079 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.079 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.079 DEBUG:boto:Method: GET 2023-12-15T23:24:36.079 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:24:36.079 DEBUG:boto:Data: 2023-12-15T23:24:36.079 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.079 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.080 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.080 DEBUG:boto:Params: {} 2023-12-15T23:24:36.080 DEBUG:boto:Token: None 2023-12-15T23:24:36.080 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.080 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.083 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b50865f3a0a242f-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.125 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:24:36.126 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.126 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.126 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.126 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.126 DEBUG:boto:Method: GET 2023-12-15T23:24:36.126 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.126 DEBUG:boto:Data: 2023-12-15T23:24:36.127 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.127 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.127 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.127 DEBUG:boto:Params: {} 2023-12-15T23:24:36.127 DEBUG:boto:Token: None 2023-12-15T23:24:36.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY= 2023-12-15T23:24:36.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY=', 'Content-Length': '0'} 2023-12-15T23:24:36.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e79e1abfdb677991-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.130 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.130 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.130 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.130 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.130 DEBUG:boto:Method: GET 2023-12-15T23:24:36.130 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.131 DEBUG:boto:Data: 2023-12-15T23:24:36.131 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.131 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.131 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.131 DEBUG:boto:Params: {} 2023-12-15T23:24:36.131 DEBUG:boto:Token: None 2023-12-15T23:24:36.131 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY= 2023-12-15T23:24:36.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY=', 'Content-Length': '0'} 2023-12-15T23:24:36.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000172ecbd925d792cd-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.134 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.134 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.134 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.134 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.134 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.134 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.134 DEBUG:boto:Data: 2023-12-15T23:24:36.134 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.135 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.135 DEBUG:boto:Params: {} 2023-12-15T23:24:36.135 DEBUG:boto:Token: None 2023-12-15T23:24:36.135 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jIQ295MeWt7JrBCVrnDKg+/+tFk= 2023-12-15T23:24:36.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jIQ295MeWt7JrBCVrnDKg+/+tFk=', 'Content-Length': '0'} 2023-12-15T23:24:36.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b14cbead85c4a9b4-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.137 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.137 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.138 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.138 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.138 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.138 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.138 DEBUG:boto:Data: 2023-12-15T23:24:36.138 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.138 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.138 DEBUG:boto:Params: {} 2023-12-15T23:24:36.138 DEBUG:boto:Token: None 2023-12-15T23:24:36.138 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jIQ295MeWt7JrBCVrnDKg+/+tFk= 2023-12-15T23:24:36.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jIQ295MeWt7JrBCVrnDKg+/+tFk=', 'Content-Length': '0'} 2023-12-15T23:24:36.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ec04fb5ec62e674-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:24:36.141 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.141 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.141 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.141 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.141 DEBUG:boto:Method: GET 2023-12-15T23:24:36.142 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.142 DEBUG:boto:Data: 2023-12-15T23:24:36.142 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.142 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.142 DEBUG:boto:Params: {} 2023-12-15T23:24:36.142 DEBUG:boto:Token: None 2023-12-15T23:24:36.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY= 2023-12-15T23:24:36.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY=', 'Content-Length': '0'} 2023-12-15T23:24:36.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d44ca15214b701f4-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.185 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.186 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.186 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.186 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.186 DEBUG:boto:Method: GET 2023-12-15T23:24:36.186 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.186 DEBUG:boto:Data: 2023-12-15T23:24:36.186 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.186 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.186 DEBUG:boto:Params: {} 2023-12-15T23:24:36.186 DEBUG:boto:Token: None 2023-12-15T23:24:36.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:24:36.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY= 2023-12-15T23:24:36.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NrDNQl/1EY/m6djEABlE0kiLYxY=', 'Content-Length': '0'} 2023-12-15T23:24:36.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001836d2040d511ba4-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.189 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.189 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.190 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.190 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.190 DEBUG:boto:Method: GET 2023-12-15T23:24:36.190 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.190 DEBUG:boto:Data: 2023-12-15T23:24:36.190 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.190 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.190 DEBUG:boto:Params: {} 2023-12-15T23:24:36.190 DEBUG:boto:Token: None 2023-12-15T23:24:36.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.193 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d1230e9164ab400-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.193 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.194 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.194 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.194 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.194 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.194 DEBUG:boto:Method: GET 2023-12-15T23:24:36.194 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.194 DEBUG:boto:Data: 2023-12-15T23:24:36.194 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.194 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.195 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.195 DEBUG:boto:Params: {} 2023-12-15T23:24:36.195 DEBUG:boto:Token: None 2023-12-15T23:24:36.195 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.195 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d7057475f242732-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.199 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.199 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.199 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.199 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.199 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:24:36.199 DEBUG:boto:Data: 2023-12-15T23:24:36.199 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.200 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.200 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.200 DEBUG:boto:Params: {} 2023-12-15T23:24:36.200 DEBUG:boto:Token: None 2023-12-15T23:24:36.200 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29 2023-12-15T23:24:36.200 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v3R1P2bV9mwuz0KhZbuJg5fs8As= 2023-12-15T23:24:36.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v3R1P2bV9mwuz0KhZbuJg5fs8As=', 'Content-Length': '0'} 2023-12-15T23:24:36.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d336f9c62fc0a66-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.202 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.203 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.203 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.203 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:24:36.203 DEBUG:boto:Data: 2023-12-15T23:24:36.203 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.203 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.203 DEBUG:boto:Params: {} 2023-12-15T23:24:36.203 DEBUG:boto:Token: None 2023-12-15T23:24:36.204 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29 2023-12-15T23:24:36.204 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v3R1P2bV9mwuz0KhZbuJg5fs8As= 2023-12-15T23:24:36.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v3R1P2bV9mwuz0KhZbuJg5fs8As=', 'Content-Length': '0'} 2023-12-15T23:24:36.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7dcc5f41f20e4e8-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:24:36.206 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.206 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.206 DEBUG:boto:Method: GET 2023-12-15T23:24:36.206 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:24:36.206 DEBUG:boto:Data: 2023-12-15T23:24:36.206 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.207 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.207 DEBUG:boto:Params: {} 2023-12-15T23:24:36.207 DEBUG:boto:Token: None 2023-12-15T23:24:36.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29 2023-12-15T23:24:36.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yNl9vO4J02Z4VwVmnG6z7eFBWbk= 2023-12-15T23:24:36.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yNl9vO4J02Z4VwVmnG6z7eFBWbk=', 'Content-Length': '0'} 2023-12-15T23:24:36.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e54c8e67f5041f66-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.209 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:24:36.210 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:24:36.210 DEBUG:boto:Method: GET 2023-12-15T23:24:36.210 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:24:36.210 DEBUG:boto:Data: 2023-12-15T23:24:36.210 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.210 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.210 DEBUG:boto:Params: {} 2023-12-15T23:24:36.210 DEBUG:boto:Token: None 2023-12-15T23:24:36.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj29 2023-12-15T23:24:36.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yNl9vO4J02Z4VwVmnG6z7eFBWbk= 2023-12-15T23:24:36.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yNl9vO4J02Z4VwVmnG6z7eFBWbk=', 'Content-Length': '0'} 2023-12-15T23:24:36.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbb15dd6a44d44ed-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.253 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.253 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.254 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.254 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.254 DEBUG:boto:Method: GET 2023-12-15T23:24:36.254 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.254 DEBUG:boto:Data: 2023-12-15T23:24:36.254 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.254 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.254 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.254 DEBUG:boto:Params: {} 2023-12-15T23:24:36.254 DEBUG:boto:Token: None 2023-12-15T23:24:36.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.257 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f40f03d3bb5063c2-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.257 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.258 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.258 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.258 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.258 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.258 DEBUG:boto:Method: GET 2023-12-15T23:24:36.258 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:24:36.258 DEBUG:boto:Data: 2023-12-15T23:24:36.258 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.259 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.259 DEBUG:boto:Params: {} 2023-12-15T23:24:36.259 DEBUG:boto:Token: None 2023-12-15T23:24:36.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.263 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c3180e57b461800-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.263 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.263 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:24:36.263 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.263 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.263 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.264 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.264 DEBUG:boto:Method: GET 2023-12-15T23:24:36.264 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.264 DEBUG:boto:Data: 2023-12-15T23:24:36.264 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.264 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.264 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.264 DEBUG:boto:Params: {} 2023-12-15T23:24:36.264 DEBUG:boto:Token: None 2023-12-15T23:24:36.264 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.265 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM= 2023-12-15T23:24:36.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM=', 'Content-Length': '0'} 2023-12-15T23:24:36.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fa42d0b888446b4-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.309 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.310 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.310 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.310 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.310 DEBUG:boto:Method: GET 2023-12-15T23:24:36.310 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.310 DEBUG:boto:Data: 2023-12-15T23:24:36.310 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.310 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.310 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.310 DEBUG:boto:Params: {} 2023-12-15T23:24:36.311 DEBUG:boto:Token: None 2023-12-15T23:24:36.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM= 2023-12-15T23:24:36.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM=', 'Content-Length': '0'} 2023-12-15T23:24:36.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ff00fca13799272-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.313 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.313 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.313 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.313 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.314 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.314 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.314 DEBUG:boto:Data: 2023-12-15T23:24:36.314 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.314 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.314 DEBUG:boto:Params: {} 2023-12-15T23:24:36.314 DEBUG:boto:Token: None 2023-12-15T23:24:36.314 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WNKdFZRq3sYCR6DYy6Y7gS4abl8= 2023-12-15T23:24:36.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WNKdFZRq3sYCR6DYy6Y7gS4abl8=', 'Content-Length': '0'} 2023-12-15T23:24:36.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcca57cd1d6e58be-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.317 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.317 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.317 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.317 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.318 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.318 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.318 DEBUG:boto:Data: 2023-12-15T23:24:36.318 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.318 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.318 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.318 DEBUG:boto:Params: {} 2023-12-15T23:24:36.318 DEBUG:boto:Token: None 2023-12-15T23:24:36.318 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.318 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WNKdFZRq3sYCR6DYy6Y7gS4abl8= 2023-12-15T23:24:36.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WNKdFZRq3sYCR6DYy6Y7gS4abl8=', 'Content-Length': '0'} 2023-12-15T23:24:36.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070d3957de2aa6c65-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:24:36.321 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.321 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.321 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.321 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.322 DEBUG:boto:Method: GET 2023-12-15T23:24:36.322 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.322 DEBUG:boto:Data: 2023-12-15T23:24:36.322 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.322 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.322 DEBUG:boto:Params: {} 2023-12-15T23:24:36.322 DEBUG:boto:Token: None 2023-12-15T23:24:36.322 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.322 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM= 2023-12-15T23:24:36.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM=', 'Content-Length': '0'} 2023-12-15T23:24:36.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027e63839d7525957-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.325 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.325 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.325 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.326 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.326 DEBUG:boto:Method: GET 2023-12-15T23:24:36.326 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.326 DEBUG:boto:Data: 2023-12-15T23:24:36.326 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.326 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.326 DEBUG:boto:Params: {} 2023-12-15T23:24:36.326 DEBUG:boto:Token: None 2023-12-15T23:24:36.326 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:24:36.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM= 2023-12-15T23:24:36.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AAs8Z4xHV0A39SIJGUY+Hb/LpTM=', 'Content-Length': '0'} 2023-12-15T23:24:36.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dd587e044423d2e-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.329 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.329 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.329 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.329 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.329 DEBUG:boto:Method: GET 2023-12-15T23:24:36.329 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.329 DEBUG:boto:Data: 2023-12-15T23:24:36.329 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.329 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.330 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.330 DEBUG:boto:Params: {} 2023-12-15T23:24:36.330 DEBUG:boto:Token: None 2023-12-15T23:24:36.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0e151704dd08c95-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.332 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.333 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.333 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.333 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.333 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.333 DEBUG:boto:Method: GET 2023-12-15T23:24:36.333 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.333 DEBUG:boto:Data: 2023-12-15T23:24:36.333 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.334 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.334 DEBUG:boto:Params: {} 2023-12-15T23:24:36.334 DEBUG:boto:Token: None 2023-12-15T23:24:36.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fc42e8392856d94-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.337 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.338 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.338 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.338 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.338 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:24:36.338 DEBUG:boto:Data: 2023-12-15T23:24:36.338 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.338 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.339 DEBUG:boto:Params: {} 2023-12-15T23:24:36.339 DEBUG:boto:Token: None 2023-12-15T23:24:36.339 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31 2023-12-15T23:24:36.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dp1JGQkfxgSIPXNQ6F+LGSEt5gw= 2023-12-15T23:24:36.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dp1JGQkfxgSIPXNQ6F+LGSEt5gw=', 'Content-Length': '0'} 2023-12-15T23:24:36.341 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0977f0851cf7868-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.342 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.342 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.342 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.342 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:24:36.342 DEBUG:boto:Data: 2023-12-15T23:24:36.342 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.342 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.342 DEBUG:boto:Params: {} 2023-12-15T23:24:36.343 DEBUG:boto:Token: None 2023-12-15T23:24:36.343 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31 2023-12-15T23:24:36.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Dp1JGQkfxgSIPXNQ6F+LGSEt5gw= 2023-12-15T23:24:36.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Dp1JGQkfxgSIPXNQ6F+LGSEt5gw=', 'Content-Length': '0'} 2023-12-15T23:24:36.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029f3c373dd7b89dc-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:24:36.345 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.345 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.345 DEBUG:boto:Method: GET 2023-12-15T23:24:36.345 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:24:36.346 DEBUG:boto:Data: 2023-12-15T23:24:36.346 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.346 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.346 DEBUG:boto:Params: {} 2023-12-15T23:24:36.346 DEBUG:boto:Token: None 2023-12-15T23:24:36.346 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31 2023-12-15T23:24:36.346 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UEG7lOIMRYs13JO8rGqKIuH3IA= 2023-12-15T23:24:36.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UEG7lOIMRYs13JO8rGqKIuH3IA=', 'Content-Length': '0'} 2023-12-15T23:24:36.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000987f90acdbeac0f9-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.349 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:24:36.349 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:24:36.349 DEBUG:boto:Method: GET 2023-12-15T23:24:36.349 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:24:36.349 DEBUG:boto:Data: 2023-12-15T23:24:36.349 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.349 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.349 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.349 DEBUG:boto:Params: {} 2023-12-15T23:24:36.350 DEBUG:boto:Token: None 2023-12-15T23:24:36.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj31 2023-12-15T23:24:36.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3UEG7lOIMRYs13JO8rGqKIuH3IA= 2023-12-15T23:24:36.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3UEG7lOIMRYs13JO8rGqKIuH3IA=', 'Content-Length': '0'} 2023-12-15T23:24:36.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000951b3df28a956415-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.352 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.352 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.352 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.352 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.353 DEBUG:boto:Method: GET 2023-12-15T23:24:36.353 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.353 DEBUG:boto:Data: 2023-12-15T23:24:36.353 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.353 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.353 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.353 DEBUG:boto:Params: {} 2023-12-15T23:24:36.353 DEBUG:boto:Token: None 2023-12-15T23:24:36.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c79e6635c21a4935-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.356 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.356 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.357 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.357 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.357 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.357 DEBUG:boto:Method: GET 2023-12-15T23:24:36.357 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:24:36.357 DEBUG:boto:Data: 2023-12-15T23:24:36.357 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.357 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.357 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.357 DEBUG:boto:Params: {} 2023-12-15T23:24:36.358 DEBUG:boto:Token: None 2023-12-15T23:24:36.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ced4f0ebc0d98b37-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.361 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:24:36.362 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.362 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.362 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.362 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.362 DEBUG:boto:Method: GET 2023-12-15T23:24:36.362 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.362 DEBUG:boto:Data: 2023-12-15T23:24:36.362 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.362 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.362 DEBUG:boto:Params: {} 2023-12-15T23:24:36.363 DEBUG:boto:Token: None 2023-12-15T23:24:36.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ= 2023-12-15T23:24:36.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ=', 'Content-Length': '0'} 2023-12-15T23:24:36.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5e4f619be213948-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.365 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.366 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.366 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.366 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.366 DEBUG:boto:Method: GET 2023-12-15T23:24:36.366 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.366 DEBUG:boto:Data: 2023-12-15T23:24:36.366 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.366 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.366 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.366 DEBUG:boto:Params: {} 2023-12-15T23:24:36.366 DEBUG:boto:Token: None 2023-12-15T23:24:36.367 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ= 2023-12-15T23:24:36.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ=', 'Content-Length': '0'} 2023-12-15T23:24:36.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081b6ffff23e7cd4e-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.369 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.369 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.369 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.369 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.370 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.370 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.370 DEBUG:boto:Data: 2023-12-15T23:24:36.370 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.370 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.370 DEBUG:boto:Params: {} 2023-12-15T23:24:36.370 DEBUG:boto:Token: None 2023-12-15T23:24:36.370 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r+lSYAX8UoCN/Vr9Cgof9SZvQao= 2023-12-15T23:24:36.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r+lSYAX8UoCN/Vr9Cgof9SZvQao=', 'Content-Length': '0'} 2023-12-15T23:24:36.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9392fcace008374-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.373 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.373 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.373 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.373 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.373 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.374 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.374 DEBUG:boto:Data: 2023-12-15T23:24:36.374 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.374 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.374 DEBUG:boto:Params: {} 2023-12-15T23:24:36.374 DEBUG:boto:Token: None 2023-12-15T23:24:36.374 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r+lSYAX8UoCN/Vr9Cgof9SZvQao= 2023-12-15T23:24:36.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r+lSYAX8UoCN/Vr9Cgof9SZvQao=', 'Content-Length': '0'} 2023-12-15T23:24:36.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076c17ac355c14911-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:24:36.377 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.377 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.377 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.377 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.377 DEBUG:boto:Method: GET 2023-12-15T23:24:36.377 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.377 DEBUG:boto:Data: 2023-12-15T23:24:36.377 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.377 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.378 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.378 DEBUG:boto:Params: {} 2023-12-15T23:24:36.378 DEBUG:boto:Token: None 2023-12-15T23:24:36.378 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ= 2023-12-15T23:24:36.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ=', 'Content-Length': '0'} 2023-12-15T23:24:36.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e51140560aec57f5-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.381 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.381 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.381 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.381 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.381 DEBUG:boto:Method: GET 2023-12-15T23:24:36.381 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.381 DEBUG:boto:Data: 2023-12-15T23:24:36.381 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.382 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.382 DEBUG:boto:Params: {} 2023-12-15T23:24:36.382 DEBUG:boto:Token: None 2023-12-15T23:24:36.382 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:24:36.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ= 2023-12-15T23:24:36.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XaY+nE7IjLKgpoSKXou+ds7xzGQ=', 'Content-Length': '0'} 2023-12-15T23:24:36.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4490be31e35f271-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.384 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.385 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.385 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.385 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.385 DEBUG:boto:Method: GET 2023-12-15T23:24:36.385 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.385 DEBUG:boto:Data: 2023-12-15T23:24:36.385 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.385 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.385 DEBUG:boto:Params: {} 2023-12-15T23:24:36.386 DEBUG:boto:Token: None 2023-12-15T23:24:36.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a290948879cf7ce5-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.388 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.389 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.389 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.389 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.389 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.389 DEBUG:boto:Method: GET 2023-12-15T23:24:36.389 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.389 DEBUG:boto:Data: 2023-12-15T23:24:36.389 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.389 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.389 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.390 DEBUG:boto:Params: {} 2023-12-15T23:24:36.390 DEBUG:boto:Token: None 2023-12-15T23:24:36.390 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8cc6c9106a96640-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.393 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.394 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.394 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.394 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.394 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:24:36.394 DEBUG:boto:Data: 2023-12-15T23:24:36.394 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.394 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.394 DEBUG:boto:Params: {} 2023-12-15T23:24:36.394 DEBUG:boto:Token: None 2023-12-15T23:24:36.395 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33 2023-12-15T23:24:36.395 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aAkCqWn1Ma+Qr7O5yNVMm61sqw= 2023-12-15T23:24:36.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aAkCqWn1Ma+Qr7O5yNVMm61sqw=', 'Content-Length': '0'} 2023-12-15T23:24:36.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071c9d9472e89e07b-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.397 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.397 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.397 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.397 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:24:36.397 DEBUG:boto:Data: 2023-12-15T23:24:36.398 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.398 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.398 DEBUG:boto:Params: {} 2023-12-15T23:24:36.398 DEBUG:boto:Token: None 2023-12-15T23:24:36.398 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33 2023-12-15T23:24:36.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8aAkCqWn1Ma+Qr7O5yNVMm61sqw= 2023-12-15T23:24:36.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8aAkCqWn1Ma+Qr7O5yNVMm61sqw=', 'Content-Length': '0'} 2023-12-15T23:24:36.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7133f92251bd55c-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:24:36.400 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.400 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.401 DEBUG:boto:Method: GET 2023-12-15T23:24:36.401 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:24:36.401 DEBUG:boto:Data: 2023-12-15T23:24:36.401 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.401 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.401 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.401 DEBUG:boto:Params: {} 2023-12-15T23:24:36.401 DEBUG:boto:Token: None 2023-12-15T23:24:36.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33 2023-12-15T23:24:36.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pCAB7rSM/hCSu5feXo1uKcE9Og= 2023-12-15T23:24:36.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pCAB7rSM/hCSu5feXo1uKcE9Og=', 'Content-Length': '0'} 2023-12-15T23:24:36.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac083fc573073d3d-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.404 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:24:36.404 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:24:36.405 DEBUG:boto:Method: GET 2023-12-15T23:24:36.405 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:24:36.405 DEBUG:boto:Data: 2023-12-15T23:24:36.405 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.405 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.405 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.405 DEBUG:boto:Params: {} 2023-12-15T23:24:36.405 DEBUG:boto:Token: None 2023-12-15T23:24:36.405 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj33 2023-12-15T23:24:36.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pCAB7rSM/hCSu5feXo1uKcE9Og= 2023-12-15T23:24:36.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pCAB7rSM/hCSu5feXo1uKcE9Og=', 'Content-Length': '0'} 2023-12-15T23:24:36.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ee6005960abb0c7-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.408 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.408 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.408 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.408 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.408 DEBUG:boto:Method: GET 2023-12-15T23:24:36.409 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.409 DEBUG:boto:Data: 2023-12-15T23:24:36.409 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.409 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.409 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.409 DEBUG:boto:Params: {} 2023-12-15T23:24:36.409 DEBUG:boto:Token: None 2023-12-15T23:24:36.409 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.409 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f74b04ccdf281a0d-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.412 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.412 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.412 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.412 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.412 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.413 DEBUG:boto:Method: GET 2023-12-15T23:24:36.413 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:24:36.413 DEBUG:boto:Data: 2023-12-15T23:24:36.413 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.413 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.413 DEBUG:boto:Params: {} 2023-12-15T23:24:36.413 DEBUG:boto:Token: None 2023-12-15T23:24:36.413 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.413 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.417 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000415282129a6a5a72-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.417 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:24:36.417 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.417 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.418 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.418 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.418 DEBUG:boto:Method: GET 2023-12-15T23:24:36.418 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.418 DEBUG:boto:Data: 2023-12-15T23:24:36.418 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.418 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.418 DEBUG:boto:Params: {} 2023-12-15T23:24:36.418 DEBUG:boto:Token: None 2023-12-15T23:24:36.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.419 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E= 2023-12-15T23:24:36.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E=', 'Content-Length': '0'} 2023-12-15T23:24:36.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094671bfc29226e9b-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.421 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.421 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.421 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.421 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.421 DEBUG:boto:Method: GET 2023-12-15T23:24:36.422 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.422 DEBUG:boto:Data: 2023-12-15T23:24:36.422 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.422 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.422 DEBUG:boto:Params: {} 2023-12-15T23:24:36.422 DEBUG:boto:Token: None 2023-12-15T23:24:36.422 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.422 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E= 2023-12-15T23:24:36.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E=', 'Content-Length': '0'} 2023-12-15T23:24:36.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9b763a9a705eae4-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.426 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.427 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.427 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.427 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.427 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.427 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.427 DEBUG:boto:Data: 2023-12-15T23:24:36.427 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.427 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.427 DEBUG:boto:Params: {} 2023-12-15T23:24:36.428 DEBUG:boto:Token: None 2023-12-15T23:24:36.428 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muUL3840AQ4ggei73VhnniGpOUE= 2023-12-15T23:24:36.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muUL3840AQ4ggei73VhnniGpOUE=', 'Content-Length': '0'} 2023-12-15T23:24:36.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090d390f5a057e78f-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.430 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.430 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.430 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.430 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.430 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.431 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.431 DEBUG:boto:Data: 2023-12-15T23:24:36.431 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.431 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.431 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.431 DEBUG:boto:Params: {} 2023-12-15T23:24:36.431 DEBUG:boto:Token: None 2023-12-15T23:24:36.431 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:muUL3840AQ4ggei73VhnniGpOUE= 2023-12-15T23:24:36.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:muUL3840AQ4ggei73VhnniGpOUE=', 'Content-Length': '0'} 2023-12-15T23:24:36.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae30d5db578fe3d0-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.434 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:24:36.434 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.434 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.434 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.434 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.434 DEBUG:boto:Method: GET 2023-12-15T23:24:36.434 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.434 DEBUG:boto:Data: 2023-12-15T23:24:36.434 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.435 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.435 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.435 DEBUG:boto:Params: {} 2023-12-15T23:24:36.435 DEBUG:boto:Token: None 2023-12-15T23:24:36.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E= 2023-12-15T23:24:36.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E=', 'Content-Length': '0'} 2023-12-15T23:24:36.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f742b8c49df4717-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.438 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.438 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.438 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.438 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.438 DEBUG:boto:Method: GET 2023-12-15T23:24:36.438 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.438 DEBUG:boto:Data: 2023-12-15T23:24:36.438 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.438 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.438 DEBUG:boto:Params: {} 2023-12-15T23:24:36.439 DEBUG:boto:Token: None 2023-12-15T23:24:36.439 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:24:36.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E= 2023-12-15T23:24:36.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lPhtTcDo+um7jw+RDqOd8O/Uo4E=', 'Content-Length': '0'} 2023-12-15T23:24:36.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a889c2f23696ea04-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.481 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.482 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.482 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.482 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.482 DEBUG:boto:Method: GET 2023-12-15T23:24:36.482 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.482 DEBUG:boto:Data: 2023-12-15T23:24:36.482 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.482 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.482 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.482 DEBUG:boto:Params: {} 2023-12-15T23:24:36.482 DEBUG:boto:Token: None 2023-12-15T23:24:36.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093e8cb04e130a1b4-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.485 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.486 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.486 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.486 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.486 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.486 DEBUG:boto:Method: GET 2023-12-15T23:24:36.486 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.486 DEBUG:boto:Data: 2023-12-15T23:24:36.486 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.486 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.487 DEBUG:boto:Params: {} 2023-12-15T23:24:36.487 DEBUG:boto:Token: None 2023-12-15T23:24:36.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e97393019fa60487-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.490 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.490 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.491 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.491 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.491 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:24:36.491 DEBUG:boto:Data: 2023-12-15T23:24:36.491 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.491 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.491 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.491 DEBUG:boto:Params: {} 2023-12-15T23:24:36.491 DEBUG:boto:Token: None 2023-12-15T23:24:36.491 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34 2023-12-15T23:24:36.492 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zxv6jyxocG425IXrAxPopqnnQBo= 2023-12-15T23:24:36.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zxv6jyxocG425IXrAxPopqnnQBo=', 'Content-Length': '0'} 2023-12-15T23:24:36.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000480cfdc5f99efdbc-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.494 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.494 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.494 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.494 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:24:36.494 DEBUG:boto:Data: 2023-12-15T23:24:36.494 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.494 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.494 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.495 DEBUG:boto:Params: {} 2023-12-15T23:24:36.495 DEBUG:boto:Token: None 2023-12-15T23:24:36.495 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34 2023-12-15T23:24:36.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zxv6jyxocG425IXrAxPopqnnQBo= 2023-12-15T23:24:36.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zxv6jyxocG425IXrAxPopqnnQBo=', 'Content-Length': '0'} 2023-12-15T23:24:36.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0e10eb30b973f7c-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:24:36.497 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.497 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.497 DEBUG:boto:Method: GET 2023-12-15T23:24:36.497 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:24:36.498 DEBUG:boto:Data: 2023-12-15T23:24:36.498 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.498 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.498 DEBUG:boto:Params: {} 2023-12-15T23:24:36.498 DEBUG:boto:Token: None 2023-12-15T23:24:36.498 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34 2023-12-15T23:24:36.498 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pEjdv3vSCq+soMFvQYR35moBxZ4= 2023-12-15T23:24:36.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pEjdv3vSCq+soMFvQYR35moBxZ4=', 'Content-Length': '0'} 2023-12-15T23:24:36.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0f5d81394a5c68d-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.541 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:24:36.542 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:24:36.542 DEBUG:boto:Method: GET 2023-12-15T23:24:36.542 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:24:36.542 DEBUG:boto:Data: 2023-12-15T23:24:36.542 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.542 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.542 DEBUG:boto:Params: {} 2023-12-15T23:24:36.542 DEBUG:boto:Token: None 2023-12-15T23:24:36.542 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj34 2023-12-15T23:24:36.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pEjdv3vSCq+soMFvQYR35moBxZ4= 2023-12-15T23:24:36.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pEjdv3vSCq+soMFvQYR35moBxZ4=', 'Content-Length': '0'} 2023-12-15T23:24:36.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce59c6799686efc5-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.545 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.545 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.545 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.545 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.545 DEBUG:boto:Method: GET 2023-12-15T23:24:36.546 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.546 DEBUG:boto:Data: 2023-12-15T23:24:36.546 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.546 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.546 DEBUG:boto:Params: {} 2023-12-15T23:24:36.546 DEBUG:boto:Token: None 2023-12-15T23:24:36.546 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.546 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001615d4a20e1eb521-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.549 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.549 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.549 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.549 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.549 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.549 DEBUG:boto:Method: GET 2023-12-15T23:24:36.549 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:24:36.550 DEBUG:boto:Data: 2023-12-15T23:24:36.550 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.550 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.550 DEBUG:boto:Params: {} 2023-12-15T23:24:36.550 DEBUG:boto:Token: None 2023-12-15T23:24:36.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000781009d469ac5852-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.553 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.554 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:24:36.554 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.554 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.554 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.554 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.554 DEBUG:boto:Method: GET 2023-12-15T23:24:36.554 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.554 DEBUG:boto:Data: 2023-12-15T23:24:36.554 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.555 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.555 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.555 DEBUG:boto:Params: {} 2023-12-15T23:24:36.555 DEBUG:boto:Token: None 2023-12-15T23:24:36.555 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM= 2023-12-15T23:24:36.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa79125fbb68ea27-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.558 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.558 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.558 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.558 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.558 DEBUG:boto:Method: GET 2023-12-15T23:24:36.558 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.558 DEBUG:boto:Data: 2023-12-15T23:24:36.558 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.558 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.558 DEBUG:boto:Params: {} 2023-12-15T23:24:36.559 DEBUG:boto:Token: None 2023-12-15T23:24:36.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM= 2023-12-15T23:24:36.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f112ee455f6a3a01-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.601 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.602 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.602 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.602 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.602 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.602 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.602 DEBUG:boto:Data: 2023-12-15T23:24:36.602 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.602 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.602 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.602 DEBUG:boto:Params: {} 2023-12-15T23:24:36.603 DEBUG:boto:Token: None 2023-12-15T23:24:36.603 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8dKNK6IsEgi9ZxMiK3P1asfvwjE= 2023-12-15T23:24:36.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8dKNK6IsEgi9ZxMiK3P1asfvwjE=', 'Content-Length': '0'} 2023-12-15T23:24:36.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3654ac1b08c6c3a-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.605 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.605 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.606 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.606 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.606 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.606 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.606 DEBUG:boto:Data: 2023-12-15T23:24:36.606 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.606 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.606 DEBUG:boto:Params: {} 2023-12-15T23:24:36.606 DEBUG:boto:Token: None 2023-12-15T23:24:36.607 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8dKNK6IsEgi9ZxMiK3P1asfvwjE= 2023-12-15T23:24:36.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8dKNK6IsEgi9ZxMiK3P1asfvwjE=', 'Content-Length': '0'} 2023-12-15T23:24:36.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a92fcd40dddc5285-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:24:36.609 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.609 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.609 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.609 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.609 DEBUG:boto:Method: GET 2023-12-15T23:24:36.609 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.609 DEBUG:boto:Data: 2023-12-15T23:24:36.610 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.610 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.610 DEBUG:boto:Params: {} 2023-12-15T23:24:36.610 DEBUG:boto:Token: None 2023-12-15T23:24:36.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM= 2023-12-15T23:24:36.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000121f6878cf8a7237-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.653 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.654 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.654 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.654 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.654 DEBUG:boto:Method: GET 2023-12-15T23:24:36.654 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.654 DEBUG:boto:Data: 2023-12-15T23:24:36.654 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.654 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.654 DEBUG:boto:Params: {} 2023-12-15T23:24:36.654 DEBUG:boto:Token: None 2023-12-15T23:24:36.655 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:24:36.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM= 2023-12-15T23:24:36.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3VjjnpsC5xRAOurAy6Tr7Jyz6hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e181179dbe6a2578-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.657 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.657 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.657 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.657 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.657 DEBUG:boto:Method: GET 2023-12-15T23:24:36.657 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.657 DEBUG:boto:Data: 2023-12-15T23:24:36.658 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.658 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.658 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.658 DEBUG:boto:Params: {} 2023-12-15T23:24:36.658 DEBUG:boto:Token: None 2023-12-15T23:24:36.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000539eb17de0b424ca-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.661 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.661 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.661 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.661 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.661 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.661 DEBUG:boto:Method: GET 2023-12-15T23:24:36.662 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.662 DEBUG:boto:Data: 2023-12-15T23:24:36.662 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.662 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.662 DEBUG:boto:Params: {} 2023-12-15T23:24:36.662 DEBUG:boto:Token: None 2023-12-15T23:24:36.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016b0f6d79d77f9b7-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.666 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.666 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.666 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.666 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.666 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:24:36.666 DEBUG:boto:Data: 2023-12-15T23:24:36.666 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.667 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.667 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.667 DEBUG:boto:Params: {} 2023-12-15T23:24:36.667 DEBUG:boto:Token: None 2023-12-15T23:24:36.667 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38 2023-12-15T23:24:36.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bGEG3mMwkP6L8ZTqDZYrQgRl3hM= 2023-12-15T23:24:36.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bGEG3mMwkP6L8ZTqDZYrQgRl3hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af0db61f9e2b845a-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.669 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.669 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.670 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.670 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:24:36.670 DEBUG:boto:Data: 2023-12-15T23:24:36.670 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.670 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.670 DEBUG:boto:Params: {} 2023-12-15T23:24:36.670 DEBUG:boto:Token: None 2023-12-15T23:24:36.670 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38 2023-12-15T23:24:36.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bGEG3mMwkP6L8ZTqDZYrQgRl3hM= 2023-12-15T23:24:36.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bGEG3mMwkP6L8ZTqDZYrQgRl3hM=', 'Content-Length': '0'} 2023-12-15T23:24:36.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ed1c1b29ec1ac8a-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:24:36.672 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.673 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.673 DEBUG:boto:Method: GET 2023-12-15T23:24:36.673 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:24:36.673 DEBUG:boto:Data: 2023-12-15T23:24:36.673 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.673 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.673 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.673 DEBUG:boto:Params: {} 2023-12-15T23:24:36.673 DEBUG:boto:Token: None 2023-12-15T23:24:36.674 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38 2023-12-15T23:24:36.674 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bB2cbhIAmzL/zbLxCLVk4Y3gb5Y= 2023-12-15T23:24:36.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bB2cbhIAmzL/zbLxCLVk4Y3gb5Y=', 'Content-Length': '0'} 2023-12-15T23:24:36.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c618d81c79c8696c-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.718 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:24:36.718 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:24:36.718 DEBUG:boto:Method: GET 2023-12-15T23:24:36.718 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:24:36.718 DEBUG:boto:Data: 2023-12-15T23:24:36.718 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.718 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.718 DEBUG:boto:Params: {} 2023-12-15T23:24:36.719 DEBUG:boto:Token: None 2023-12-15T23:24:36.719 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj38 2023-12-15T23:24:36.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bB2cbhIAmzL/zbLxCLVk4Y3gb5Y= 2023-12-15T23:24:36.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bB2cbhIAmzL/zbLxCLVk4Y3gb5Y=', 'Content-Length': '0'} 2023-12-15T23:24:36.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000903fcc23d7e9cde9-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.721 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.721 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.721 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.721 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.721 DEBUG:boto:Method: GET 2023-12-15T23:24:36.722 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.722 DEBUG:boto:Data: 2023-12-15T23:24:36.722 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.722 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.722 DEBUG:boto:Params: {} 2023-12-15T23:24:36.722 DEBUG:boto:Token: None 2023-12-15T23:24:36.722 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.722 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044f217144fcb3518-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.765 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.766 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.766 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.766 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.766 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.766 DEBUG:boto:Method: GET 2023-12-15T23:24:36.766 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:24:36.766 DEBUG:boto:Data: 2023-12-15T23:24:36.766 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.767 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.767 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.767 DEBUG:boto:Params: {} 2023-12-15T23:24:36.767 DEBUG:boto:Token: None 2023-12-15T23:24:36.767 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.770 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7df777ec0c1f5a1-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.771 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:24:36.771 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.771 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.771 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.771 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.771 DEBUG:boto:Method: GET 2023-12-15T23:24:36.772 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.772 DEBUG:boto:Data: 2023-12-15T23:24:36.772 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.772 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.772 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.772 DEBUG:boto:Params: {} 2023-12-15T23:24:36.772 DEBUG:boto:Token: None 2023-12-15T23:24:36.772 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.772 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI= 2023-12-15T23:24:36.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI=', 'Content-Length': '0'} 2023-12-15T23:24:36.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008aea219576df8fbf-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.775 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.775 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.775 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.775 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.775 DEBUG:boto:Method: GET 2023-12-15T23:24:36.775 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.775 DEBUG:boto:Data: 2023-12-15T23:24:36.775 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.775 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.776 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.776 DEBUG:boto:Params: {} 2023-12-15T23:24:36.776 DEBUG:boto:Token: None 2023-12-15T23:24:36.776 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.776 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI= 2023-12-15T23:24:36.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI=', 'Content-Length': '0'} 2023-12-15T23:24:36.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044734a70c86c62d3-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.822 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.822 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.822 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.822 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.822 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.822 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.822 DEBUG:boto:Data: 2023-12-15T23:24:36.822 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.822 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.822 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.822 DEBUG:boto:Params: {} 2023-12-15T23:24:36.823 DEBUG:boto:Token: None 2023-12-15T23:24:36.823 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ps0H1WuXptvcU8hSYrbw/n5y6nM= 2023-12-15T23:24:36.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ps0H1WuXptvcU8hSYrbw/n5y6nM=', 'Content-Length': '0'} 2023-12-15T23:24:36.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008401772ee86b91e2-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.825 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.825 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.825 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.826 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.826 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.826 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.826 DEBUG:boto:Data: 2023-12-15T23:24:36.826 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.826 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.826 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.826 DEBUG:boto:Params: {} 2023-12-15T23:24:36.826 DEBUG:boto:Token: None 2023-12-15T23:24:36.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ps0H1WuXptvcU8hSYrbw/n5y6nM= 2023-12-15T23:24:36.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ps0H1WuXptvcU8hSYrbw/n5y6nM=', 'Content-Length': '0'} 2023-12-15T23:24:36.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dea215cb4c20548-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:24:36.829 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.829 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.829 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.829 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.829 DEBUG:boto:Method: GET 2023-12-15T23:24:36.829 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.829 DEBUG:boto:Data: 2023-12-15T23:24:36.829 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.830 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.830 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.830 DEBUG:boto:Params: {} 2023-12-15T23:24:36.830 DEBUG:boto:Token: None 2023-12-15T23:24:36.830 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI= 2023-12-15T23:24:36.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI=', 'Content-Length': '0'} 2023-12-15T23:24:36.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c253b55e0204defd-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.873 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.874 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.874 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.874 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.874 DEBUG:boto:Method: GET 2023-12-15T23:24:36.874 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.874 DEBUG:boto:Data: 2023-12-15T23:24:36.874 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.874 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.874 DEBUG:boto:Params: {} 2023-12-15T23:24:36.874 DEBUG:boto:Token: None 2023-12-15T23:24:36.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:24:36.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI= 2023-12-15T23:24:36.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qkn8CCb4a/ePH5I2Mp0qNmFCZHI=', 'Content-Length': '0'} 2023-12-15T23:24:36.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c116b8fdf13e8852-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.877 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.877 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.877 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.877 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.877 DEBUG:boto:Method: GET 2023-12-15T23:24:36.877 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.877 DEBUG:boto:Data: 2023-12-15T23:24:36.878 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.878 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.878 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.878 DEBUG:boto:Params: {} 2023-12-15T23:24:36.878 DEBUG:boto:Token: None 2023-12-15T23:24:36.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a672a6ccc88152e-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.881 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.881 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.881 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.881 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.882 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.882 DEBUG:boto:Method: GET 2023-12-15T23:24:36.882 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.882 DEBUG:boto:Data: 2023-12-15T23:24:36.882 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.882 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.882 DEBUG:boto:Params: {} 2023-12-15T23:24:36.882 DEBUG:boto:Token: None 2023-12-15T23:24:36.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b66c15560a4fdbf-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.885 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.886 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.886 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.886 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.886 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:24:36.886 DEBUG:boto:Data: 2023-12-15T23:24:36.886 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.886 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.886 DEBUG:boto:Params: {} 2023-12-15T23:24:36.887 DEBUG:boto:Token: None 2023-12-15T23:24:36.887 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44 2023-12-15T23:24:36.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6tflyo6MHPiLaTZLdH4Hts9FAw= 2023-12-15T23:24:36.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6tflyo6MHPiLaTZLdH4Hts9FAw=', 'Content-Length': '0'} 2023-12-15T23:24:36.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000076a0e7d6a12b208-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.889 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.889 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.889 DEBUG:boto:Method: HEAD 2023-12-15T23:24:36.889 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:24:36.889 DEBUG:boto:Data: 2023-12-15T23:24:36.889 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.890 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.890 DEBUG:boto:Params: {} 2023-12-15T23:24:36.890 DEBUG:boto:Token: None 2023-12-15T23:24:36.890 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44 2023-12-15T23:24:36.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C6tflyo6MHPiLaTZLdH4Hts9FAw= 2023-12-15T23:24:36.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C6tflyo6MHPiLaTZLdH4Hts9FAw=', 'Content-Length': '0'} 2023-12-15T23:24:36.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b44df4fa02edabf-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:24:36.892 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.892 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.892 DEBUG:boto:Method: GET 2023-12-15T23:24:36.892 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:24:36.893 DEBUG:boto:Data: 2023-12-15T23:24:36.893 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.893 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.893 DEBUG:boto:Params: {} 2023-12-15T23:24:36.893 DEBUG:boto:Token: None 2023-12-15T23:24:36.893 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44 2023-12-15T23:24:36.893 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TCgHTDsJBHldWMoL1CsBtBglBfg= 2023-12-15T23:24:36.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TCgHTDsJBHldWMoL1CsBtBglBfg=', 'Content-Length': '0'} 2023-12-15T23:24:36.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099a1cdf0352a0226-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.937 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:24:36.938 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:24:36.938 DEBUG:boto:Method: GET 2023-12-15T23:24:36.938 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:24:36.938 DEBUG:boto:Data: 2023-12-15T23:24:36.938 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.938 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.938 DEBUG:boto:Params: {} 2023-12-15T23:24:36.938 DEBUG:boto:Token: None 2023-12-15T23:24:36.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj44 2023-12-15T23:24:36.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TCgHTDsJBHldWMoL1CsBtBglBfg= 2023-12-15T23:24:36.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TCgHTDsJBHldWMoL1CsBtBglBfg=', 'Content-Length': '0'} 2023-12-15T23:24:36.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003454053a9ef72b61-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.941 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.941 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.941 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.941 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.941 DEBUG:boto:Method: GET 2023-12-15T23:24:36.941 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.941 DEBUG:boto:Data: 2023-12-15T23:24:36.941 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.942 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.942 DEBUG:boto:Params: {} 2023-12-15T23:24:36.942 DEBUG:boto:Token: None 2023-12-15T23:24:36.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.944 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d175cde5d47134e-00657ce034-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.985 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.986 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:36.986 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:36.986 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.986 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.986 DEBUG:boto:Method: GET 2023-12-15T23:24:36.986 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:24:36.986 DEBUG:boto:Data: 2023-12-15T23:24:36.986 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.987 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.987 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.987 DEBUG:boto:Params: {} 2023-12-15T23:24:36.987 DEBUG:boto:Token: None 2023-12-15T23:24:36.987 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/ 2023-12-15T23:24:36.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes= 2023-12-15T23:24:36.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fxGN4u1VqXg5u11TVuYKGLLyes=', 'Content-Length': '0'} 2023-12-15T23:24:36.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e86bc95e57370fb5-00657ce034-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.990 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:36.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:24:36.991 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:36.991 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:36.991 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.991 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.991 DEBUG:boto:Method: GET 2023-12-15T23:24:36.991 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.991 DEBUG:boto:Data: 2023-12-15T23:24:36.992 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.992 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:36.992 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.992 DEBUG:boto:Params: {} 2023-12-15T23:24:36.992 DEBUG:boto:Token: None 2023-12-15T23:24:36.992 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.992 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VDfhUf89ndUn+z/fCUIjP0SOe5A= 2023-12-15T23:24:36.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VDfhUf89ndUn+z/fCUIjP0SOe5A=', 'Content-Length': '0'} 2023-12-15T23:24:36.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076326274f2f4164d-00657ce034-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:36.995 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:36.995 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:36.995 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.995 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.995 DEBUG:boto:Method: GET 2023-12-15T23:24:36.995 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.995 DEBUG:boto:Data: 2023-12-15T23:24:36.995 DEBUG:boto:Headers: {} 2023-12-15T23:24:36.996 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:36.996 DEBUG:boto:Port: 8000 2023-12-15T23:24:36.996 DEBUG:boto:Params: {} 2023-12-15T23:24:36.996 DEBUG:boto:Token: None 2023-12-15T23:24:36.996 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:36 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:36.996 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VDfhUf89ndUn+z/fCUIjP0SOe5A= 2023-12-15T23:24:36.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:36 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VDfhUf89ndUn+z/fCUIjP0SOe5A=', 'Content-Length': '0'} 2023-12-15T23:24:36.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036d153eaf6743e74-00657ce034-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:36 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.041 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.042 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.042 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.042 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.042 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.042 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.042 DEBUG:boto:Data: 2023-12-15T23:24:37.042 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.042 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.042 DEBUG:boto:Params: {} 2023-12-15T23:24:37.042 DEBUG:boto:Token: None 2023-12-15T23:24:37.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C/x1SosBtO5RH8pbHzkpCsz2WQI= 2023-12-15T23:24:37.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C/x1SosBtO5RH8pbHzkpCsz2WQI=', 'Content-Length': '0'} 2023-12-15T23:24:37.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000054fae56cf3eef99-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.045 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.045 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.045 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.045 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.045 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.046 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.046 DEBUG:boto:Data: 2023-12-15T23:24:37.046 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.046 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.046 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.046 DEBUG:boto:Params: {} 2023-12-15T23:24:37.046 DEBUG:boto:Token: None 2023-12-15T23:24:37.046 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C/x1SosBtO5RH8pbHzkpCsz2WQI= 2023-12-15T23:24:37.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C/x1SosBtO5RH8pbHzkpCsz2WQI=', 'Content-Length': '0'} 2023-12-15T23:24:37.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa2f2b31d4bf8c8f-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.049 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:24:37.049 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.049 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.049 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.050 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.050 DEBUG:boto:Method: GET 2023-12-15T23:24:37.050 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.050 DEBUG:boto:Data: 2023-12-15T23:24:37.050 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.050 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.050 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.050 DEBUG:boto:Params: {} 2023-12-15T23:24:37.050 DEBUG:boto:Token: None 2023-12-15T23:24:37.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+vKL/XwerVXkJi4Ham2sngyK7s8= 2023-12-15T23:24:37.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+vKL/XwerVXkJi4Ham2sngyK7s8=', 'Content-Length': '0'} 2023-12-15T23:24:37.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d2bf04f4aad3996-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.093 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.094 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.094 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.094 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.094 DEBUG:boto:Method: GET 2023-12-15T23:24:37.094 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.094 DEBUG:boto:Data: 2023-12-15T23:24:37.094 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.094 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.094 DEBUG:boto:Params: {} 2023-12-15T23:24:37.095 DEBUG:boto:Token: None 2023-12-15T23:24:37.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:24:37.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+vKL/XwerVXkJi4Ham2sngyK7s8= 2023-12-15T23:24:37.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+vKL/XwerVXkJi4Ham2sngyK7s8=', 'Content-Length': '0'} 2023-12-15T23:24:37.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002382845a8d753961-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.097 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.098 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.098 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.098 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.098 DEBUG:boto:Method: GET 2023-12-15T23:24:37.098 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.098 DEBUG:boto:Data: 2023-12-15T23:24:37.098 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.098 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.098 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.098 DEBUG:boto:Params: {} 2023-12-15T23:24:37.098 DEBUG:boto:Token: None 2023-12-15T23:24:37.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cf791914f0f50fc-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.101 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.102 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.102 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.102 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.102 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.102 DEBUG:boto:Method: GET 2023-12-15T23:24:37.102 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.102 DEBUG:boto:Data: 2023-12-15T23:24:37.102 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.102 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.102 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.102 DEBUG:boto:Params: {} 2023-12-15T23:24:37.103 DEBUG:boto:Token: None 2023-12-15T23:24:37.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f00471b9a7a50bb-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.106 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.107 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.107 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.107 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.107 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:24:37.107 DEBUG:boto:Data: 2023-12-15T23:24:37.107 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.107 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.107 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.107 DEBUG:boto:Params: {} 2023-12-15T23:24:37.108 DEBUG:boto:Token: None 2023-12-15T23:24:37.108 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46 2023-12-15T23:24:37.108 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVtAh66vhqhK7a1qWl0HjsMUF7Y= 2023-12-15T23:24:37.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVtAh66vhqhK7a1qWl0HjsMUF7Y=', 'Content-Length': '0'} 2023-12-15T23:24:37.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f595738d77589d71-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.110 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.110 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.110 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.111 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:24:37.111 DEBUG:boto:Data: 2023-12-15T23:24:37.111 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.111 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.111 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.111 DEBUG:boto:Params: {} 2023-12-15T23:24:37.111 DEBUG:boto:Token: None 2023-12-15T23:24:37.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46 2023-12-15T23:24:37.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PVtAh66vhqhK7a1qWl0HjsMUF7Y= 2023-12-15T23:24:37.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PVtAh66vhqhK7a1qWl0HjsMUF7Y=', 'Content-Length': '0'} 2023-12-15T23:24:37.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000088c763c591b2bc2-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:24:37.113 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.114 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.114 DEBUG:boto:Method: GET 2023-12-15T23:24:37.114 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:24:37.114 DEBUG:boto:Data: 2023-12-15T23:24:37.114 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.114 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.114 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.114 DEBUG:boto:Params: {} 2023-12-15T23:24:37.114 DEBUG:boto:Token: None 2023-12-15T23:24:37.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46 2023-12-15T23:24:37.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R42k1rM1R19/jWGzs8SWLDCIQpo= 2023-12-15T23:24:37.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R42k1rM1R19/jWGzs8SWLDCIQpo=', 'Content-Length': '0'} 2023-12-15T23:24:37.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b3cc0de16431069-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.158 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:24:37.158 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:24:37.158 DEBUG:boto:Method: GET 2023-12-15T23:24:37.158 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:24:37.158 DEBUG:boto:Data: 2023-12-15T23:24:37.158 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.158 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.158 DEBUG:boto:Params: {} 2023-12-15T23:24:37.158 DEBUG:boto:Token: None 2023-12-15T23:24:37.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj46 2023-12-15T23:24:37.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:R42k1rM1R19/jWGzs8SWLDCIQpo= 2023-12-15T23:24:37.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:R42k1rM1R19/jWGzs8SWLDCIQpo=', 'Content-Length': '0'} 2023-12-15T23:24:37.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000608ace0aef9223b-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.161 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.162 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.162 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.162 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.162 DEBUG:boto:Method: GET 2023-12-15T23:24:37.162 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.162 DEBUG:boto:Data: 2023-12-15T23:24:37.162 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.162 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.162 DEBUG:boto:Params: {} 2023-12-15T23:24:37.162 DEBUG:boto:Token: None 2023-12-15T23:24:37.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000620b5fd4a9551dbc-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.165 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.166 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.166 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.166 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.166 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.166 DEBUG:boto:Method: GET 2023-12-15T23:24:37.166 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:24:37.166 DEBUG:boto:Data: 2023-12-15T23:24:37.166 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.167 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.167 DEBUG:boto:Params: {} 2023-12-15T23:24:37.167 DEBUG:boto:Token: None 2023-12-15T23:24:37.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.170 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df8e78aa06f19696-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.170 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:24:37.171 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.171 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.171 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.171 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.171 DEBUG:boto:Method: GET 2023-12-15T23:24:37.171 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.171 DEBUG:boto:Data: 2023-12-15T23:24:37.171 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.171 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.171 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.171 DEBUG:boto:Params: {} 2023-12-15T23:24:37.171 DEBUG:boto:Token: None 2023-12-15T23:24:37.172 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.172 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ= 2023-12-15T23:24:37.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d3e7cc22de9606f-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.174 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.174 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.174 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.174 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.174 DEBUG:boto:Method: GET 2023-12-15T23:24:37.174 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.174 DEBUG:boto:Data: 2023-12-15T23:24:37.175 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.175 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.175 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.175 DEBUG:boto:Params: {} 2023-12-15T23:24:37.175 DEBUG:boto:Token: None 2023-12-15T23:24:37.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ= 2023-12-15T23:24:37.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043a82b359cba29f5-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.217 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.218 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.218 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.218 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.218 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.218 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.218 DEBUG:boto:Data: 2023-12-15T23:24:37.218 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.218 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.218 DEBUG:boto:Params: {} 2023-12-15T23:24:37.219 DEBUG:boto:Token: None 2023-12-15T23:24:37.219 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whIL5XMussfjL3h9CcysBj8rxWg= 2023-12-15T23:24:37.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whIL5XMussfjL3h9CcysBj8rxWg=', 'Content-Length': '0'} 2023-12-15T23:24:37.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7873cc521341f91-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.221 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.221 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.221 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.221 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.221 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.221 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.221 DEBUG:boto:Data: 2023-12-15T23:24:37.221 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.222 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.222 DEBUG:boto:Params: {} 2023-12-15T23:24:37.222 DEBUG:boto:Token: None 2023-12-15T23:24:37.222 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.222 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:whIL5XMussfjL3h9CcysBj8rxWg= 2023-12-15T23:24:37.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:whIL5XMussfjL3h9CcysBj8rxWg=', 'Content-Length': '0'} 2023-12-15T23:24:37.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d2aa2239f8a6d6-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:24:37.224 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.224 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.225 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.225 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.225 DEBUG:boto:Method: GET 2023-12-15T23:24:37.225 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.225 DEBUG:boto:Data: 2023-12-15T23:24:37.225 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.225 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.225 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.225 DEBUG:boto:Params: {} 2023-12-15T23:24:37.225 DEBUG:boto:Token: None 2023-12-15T23:24:37.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ= 2023-12-15T23:24:37.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039a4b09ceffc22ce-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.270 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.270 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.270 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.270 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.270 DEBUG:boto:Method: GET 2023-12-15T23:24:37.270 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.270 DEBUG:boto:Data: 2023-12-15T23:24:37.270 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.270 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.270 DEBUG:boto:Params: {} 2023-12-15T23:24:37.271 DEBUG:boto:Token: None 2023-12-15T23:24:37.271 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:24:37.271 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ= 2023-12-15T23:24:37.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DAb7LJ/iSfdnH8XWdWYReaghvsQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d5b45b7710fcfc6-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.273 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.273 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.273 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.274 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.274 DEBUG:boto:Method: GET 2023-12-15T23:24:37.274 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.274 DEBUG:boto:Data: 2023-12-15T23:24:37.274 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.274 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.274 DEBUG:boto:Params: {} 2023-12-15T23:24:37.274 DEBUG:boto:Token: None 2023-12-15T23:24:37.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.275 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eac3e25c9978872e-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.277 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.278 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.278 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.278 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.278 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.278 DEBUG:boto:Method: GET 2023-12-15T23:24:37.278 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.278 DEBUG:boto:Data: 2023-12-15T23:24:37.278 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.278 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.278 DEBUG:boto:Params: {} 2023-12-15T23:24:37.278 DEBUG:boto:Token: None 2023-12-15T23:24:37.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008129c77637275a23-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.282 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.283 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.283 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.283 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.283 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:24:37.283 DEBUG:boto:Data: 2023-12-15T23:24:37.283 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.283 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.283 DEBUG:boto:Params: {} 2023-12-15T23:24:37.284 DEBUG:boto:Token: None 2023-12-15T23:24:37.284 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51 2023-12-15T23:24:37.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z6sYOYCafw+WhrWMlYrIrV/IbIc= 2023-12-15T23:24:37.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z6sYOYCafw+WhrWMlYrIrV/IbIc=', 'Content-Length': '0'} 2023-12-15T23:24:37.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e143b87444fa66ba-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.286 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.286 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.286 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.286 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:24:37.286 DEBUG:boto:Data: 2023-12-15T23:24:37.286 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.286 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.286 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.287 DEBUG:boto:Params: {} 2023-12-15T23:24:37.287 DEBUG:boto:Token: None 2023-12-15T23:24:37.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51 2023-12-15T23:24:37.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z6sYOYCafw+WhrWMlYrIrV/IbIc= 2023-12-15T23:24:37.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z6sYOYCafw+WhrWMlYrIrV/IbIc=', 'Content-Length': '0'} 2023-12-15T23:24:37.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bffbe39364529f6-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.289 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:24:37.289 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.289 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.289 DEBUG:boto:Method: GET 2023-12-15T23:24:37.289 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:24:37.289 DEBUG:boto:Data: 2023-12-15T23:24:37.289 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.290 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.290 DEBUG:boto:Params: {} 2023-12-15T23:24:37.290 DEBUG:boto:Token: None 2023-12-15T23:24:37.290 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51 2023-12-15T23:24:37.290 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6lUgN0muCiKvSejASPAQTUMNcvE= 2023-12-15T23:24:37.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6lUgN0muCiKvSejASPAQTUMNcvE=', 'Content-Length': '0'} 2023-12-15T23:24:37.292 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034d49dec124623b4-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.333 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:24:37.334 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:24:37.334 DEBUG:boto:Method: GET 2023-12-15T23:24:37.334 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:24:37.334 DEBUG:boto:Data: 2023-12-15T23:24:37.334 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.334 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.334 DEBUG:boto:Params: {} 2023-12-15T23:24:37.334 DEBUG:boto:Token: None 2023-12-15T23:24:37.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj51 2023-12-15T23:24:37.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6lUgN0muCiKvSejASPAQTUMNcvE= 2023-12-15T23:24:37.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6lUgN0muCiKvSejASPAQTUMNcvE=', 'Content-Length': '0'} 2023-12-15T23:24:37.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a180f5fbad4a94b-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.336 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.336 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.337 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.337 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.337 DEBUG:boto:Method: GET 2023-12-15T23:24:37.337 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.337 DEBUG:boto:Data: 2023-12-15T23:24:37.337 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.337 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.337 DEBUG:boto:Params: {} 2023-12-15T23:24:37.337 DEBUG:boto:Token: None 2023-12-15T23:24:37.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.340 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004694b15a7dbfae3-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.340 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.341 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.341 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.341 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.341 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.341 DEBUG:boto:Method: GET 2023-12-15T23:24:37.341 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:24:37.341 DEBUG:boto:Data: 2023-12-15T23:24:37.341 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.341 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.341 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.342 DEBUG:boto:Params: {} 2023-12-15T23:24:37.342 DEBUG:boto:Token: None 2023-12-15T23:24:37.342 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bccf9fc4d2e91c8-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.345 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:24:37.346 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.346 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.346 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.346 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.346 DEBUG:boto:Method: GET 2023-12-15T23:24:37.346 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.346 DEBUG:boto:Data: 2023-12-15T23:24:37.346 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.347 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.347 DEBUG:boto:Params: {} 2023-12-15T23:24:37.347 DEBUG:boto:Token: None 2023-12-15T23:24:37.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs= 2023-12-15T23:24:37.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs=', 'Content-Length': '0'} 2023-12-15T23:24:37.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b557a69c459b05f0-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.350 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.350 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.350 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.350 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.350 DEBUG:boto:Method: GET 2023-12-15T23:24:37.350 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.350 DEBUG:boto:Data: 2023-12-15T23:24:37.350 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.350 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.350 DEBUG:boto:Params: {} 2023-12-15T23:24:37.350 DEBUG:boto:Token: None 2023-12-15T23:24:37.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs= 2023-12-15T23:24:37.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs=', 'Content-Length': '0'} 2023-12-15T23:24:37.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efe78132500bf850-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.353 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.353 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.353 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.353 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.353 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.353 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.353 DEBUG:boto:Data: 2023-12-15T23:24:37.353 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.353 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.353 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.354 DEBUG:boto:Params: {} 2023-12-15T23:24:37.354 DEBUG:boto:Token: None 2023-12-15T23:24:37.354 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K2UsEaQ+JdZHwDyp1EHkyi6sMP0= 2023-12-15T23:24:37.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K2UsEaQ+JdZHwDyp1EHkyi6sMP0=', 'Content-Length': '0'} 2023-12-15T23:24:37.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000888f5d905654133d-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.356 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.356 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.357 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.357 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.357 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.357 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.357 DEBUG:boto:Data: 2023-12-15T23:24:37.357 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.357 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.357 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.357 DEBUG:boto:Params: {} 2023-12-15T23:24:37.357 DEBUG:boto:Token: None 2023-12-15T23:24:37.358 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:K2UsEaQ+JdZHwDyp1EHkyi6sMP0= 2023-12-15T23:24:37.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:K2UsEaQ+JdZHwDyp1EHkyi6sMP0=', 'Content-Length': '0'} 2023-12-15T23:24:37.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e0d6f98affdfe1d-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:24:37.360 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.360 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.360 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.360 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.361 DEBUG:boto:Method: GET 2023-12-15T23:24:37.361 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.361 DEBUG:boto:Data: 2023-12-15T23:24:37.361 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.361 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.361 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.361 DEBUG:boto:Params: {} 2023-12-15T23:24:37.361 DEBUG:boto:Token: None 2023-12-15T23:24:37.361 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs= 2023-12-15T23:24:37.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs=', 'Content-Length': '0'} 2023-12-15T23:24:37.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008dd7bcb0e5ed7b33-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.405 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.405 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.406 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.406 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.406 DEBUG:boto:Method: GET 2023-12-15T23:24:37.406 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.406 DEBUG:boto:Data: 2023-12-15T23:24:37.406 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.406 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.406 DEBUG:boto:Params: {} 2023-12-15T23:24:37.406 DEBUG:boto:Token: None 2023-12-15T23:24:37.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:24:37.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs= 2023-12-15T23:24:37.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Cor+3hNSB64QSrT2HHS9mmJt+Qs=', 'Content-Length': '0'} 2023-12-15T23:24:37.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045f3097a161b799c-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.409 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.409 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.409 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.409 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.409 DEBUG:boto:Method: GET 2023-12-15T23:24:37.409 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.409 DEBUG:boto:Data: 2023-12-15T23:24:37.409 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.410 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.410 DEBUG:boto:Params: {} 2023-12-15T23:24:37.410 DEBUG:boto:Token: None 2023-12-15T23:24:37.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1fa7c6a8015299f-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.453 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.454 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.454 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.454 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.454 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.454 DEBUG:boto:Method: GET 2023-12-15T23:24:37.454 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.454 DEBUG:boto:Data: 2023-12-15T23:24:37.454 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.455 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.455 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.455 DEBUG:boto:Params: {} 2023-12-15T23:24:37.455 DEBUG:boto:Token: None 2023-12-15T23:24:37.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.458 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d136a10b6e57684-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.459 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.459 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.459 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.459 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.459 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:24:37.459 DEBUG:boto:Data: 2023-12-15T23:24:37.459 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.459 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.459 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.459 DEBUG:boto:Params: {} 2023-12-15T23:24:37.460 DEBUG:boto:Token: None 2023-12-15T23:24:37.460 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55 2023-12-15T23:24:37.460 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jamL5QjSbDbqPWndQ2CMxNni3uA= 2023-12-15T23:24:37.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jamL5QjSbDbqPWndQ2CMxNni3uA=', 'Content-Length': '0'} 2023-12-15T23:24:37.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cde59315fea42a0b-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.462 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.462 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.462 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.462 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:24:37.462 DEBUG:boto:Data: 2023-12-15T23:24:37.462 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.463 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.463 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.463 DEBUG:boto:Params: {} 2023-12-15T23:24:37.463 DEBUG:boto:Token: None 2023-12-15T23:24:37.463 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55 2023-12-15T23:24:37.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jamL5QjSbDbqPWndQ2CMxNni3uA= 2023-12-15T23:24:37.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jamL5QjSbDbqPWndQ2CMxNni3uA=', 'Content-Length': '0'} 2023-12-15T23:24:37.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001b66cca586713cb-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:24:37.466 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.466 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.466 DEBUG:boto:Method: GET 2023-12-15T23:24:37.466 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:24:37.466 DEBUG:boto:Data: 2023-12-15T23:24:37.466 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.466 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.466 DEBUG:boto:Params: {} 2023-12-15T23:24:37.466 DEBUG:boto:Token: None 2023-12-15T23:24:37.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55 2023-12-15T23:24:37.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1i8N+KP3VVweesCbnLdeO6KRDc4= 2023-12-15T23:24:37.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1i8N+KP3VVweesCbnLdeO6KRDc4=', 'Content-Length': '0'} 2023-12-15T23:24:37.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042a5d3571f15e71b-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.509 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:24:37.510 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:24:37.510 DEBUG:boto:Method: GET 2023-12-15T23:24:37.510 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:24:37.510 DEBUG:boto:Data: 2023-12-15T23:24:37.510 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.510 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.510 DEBUG:boto:Params: {} 2023-12-15T23:24:37.510 DEBUG:boto:Token: None 2023-12-15T23:24:37.510 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj55 2023-12-15T23:24:37.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1i8N+KP3VVweesCbnLdeO6KRDc4= 2023-12-15T23:24:37.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1i8N+KP3VVweesCbnLdeO6KRDc4=', 'Content-Length': '0'} 2023-12-15T23:24:37.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d32f6a27cf0a90ac-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.513 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.513 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.513 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.513 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.513 DEBUG:boto:Method: GET 2023-12-15T23:24:37.514 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.514 DEBUG:boto:Data: 2023-12-15T23:24:37.514 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.514 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.514 DEBUG:boto:Params: {} 2023-12-15T23:24:37.514 DEBUG:boto:Token: None 2023-12-15T23:24:37.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cb00d75c1c859b8-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.557 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.558 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.558 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.558 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.558 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.558 DEBUG:boto:Method: GET 2023-12-15T23:24:37.559 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:24:37.559 DEBUG:boto:Data: 2023-12-15T23:24:37.559 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.559 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.559 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.559 DEBUG:boto:Params: {} 2023-12-15T23:24:37.559 DEBUG:boto:Token: None 2023-12-15T23:24:37.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d4cab8953f2aa9a-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.563 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:24:37.563 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.563 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.563 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.563 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.564 DEBUG:boto:Method: GET 2023-12-15T23:24:37.564 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.564 DEBUG:boto:Data: 2023-12-15T23:24:37.564 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.564 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.564 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.564 DEBUG:boto:Params: {} 2023-12-15T23:24:37.564 DEBUG:boto:Token: None 2023-12-15T23:24:37.564 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.564 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4= 2023-12-15T23:24:37.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4=', 'Content-Length': '0'} 2023-12-15T23:24:37.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015fd2e6369ecab77-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.567 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.567 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.567 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.567 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.567 DEBUG:boto:Method: GET 2023-12-15T23:24:37.567 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.567 DEBUG:boto:Data: 2023-12-15T23:24:37.567 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.567 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.568 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.568 DEBUG:boto:Params: {} 2023-12-15T23:24:37.568 DEBUG:boto:Token: None 2023-12-15T23:24:37.568 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.568 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4= 2023-12-15T23:24:37.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4=', 'Content-Length': '0'} 2023-12-15T23:24:37.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc5203cc27aa3118-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.570 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.570 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.570 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.571 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.571 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.571 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.571 DEBUG:boto:Data: 2023-12-15T23:24:37.571 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.571 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.571 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.571 DEBUG:boto:Params: {} 2023-12-15T23:24:37.571 DEBUG:boto:Token: None 2023-12-15T23:24:37.571 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ByH28HpRk7uAYY8Hq00/TMpWM28= 2023-12-15T23:24:37.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ByH28HpRk7uAYY8Hq00/TMpWM28=', 'Content-Length': '0'} 2023-12-15T23:24:37.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088470ce0c022f1b8-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.574 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.574 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.574 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.574 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.574 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.574 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.574 DEBUG:boto:Data: 2023-12-15T23:24:37.574 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.575 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.575 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.575 DEBUG:boto:Params: {} 2023-12-15T23:24:37.575 DEBUG:boto:Token: None 2023-12-15T23:24:37.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ByH28HpRk7uAYY8Hq00/TMpWM28= 2023-12-15T23:24:37.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ByH28HpRk7uAYY8Hq00/TMpWM28=', 'Content-Length': '0'} 2023-12-15T23:24:37.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb0e46083ffa198d-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:24:37.578 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.578 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.578 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.578 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.578 DEBUG:boto:Method: GET 2023-12-15T23:24:37.578 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.578 DEBUG:boto:Data: 2023-12-15T23:24:37.578 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.578 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.578 DEBUG:boto:Params: {} 2023-12-15T23:24:37.578 DEBUG:boto:Token: None 2023-12-15T23:24:37.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4= 2023-12-15T23:24:37.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4=', 'Content-Length': '0'} 2023-12-15T23:24:37.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccaa71d4e18848fe-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.625 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.626 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.626 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.626 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.626 DEBUG:boto:Method: GET 2023-12-15T23:24:37.626 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.626 DEBUG:boto:Data: 2023-12-15T23:24:37.626 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.626 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.626 DEBUG:boto:Params: {} 2023-12-15T23:24:37.627 DEBUG:boto:Token: None 2023-12-15T23:24:37.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:24:37.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4= 2023-12-15T23:24:37.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DP788ttR11/DoOOTXGyC1CWl4O4=', 'Content-Length': '0'} 2023-12-15T23:24:37.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb8bfd4d7919422d-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.630 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.630 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.630 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.630 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.630 DEBUG:boto:Method: GET 2023-12-15T23:24:37.630 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.630 DEBUG:boto:Data: 2023-12-15T23:24:37.630 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.630 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.631 DEBUG:boto:Params: {} 2023-12-15T23:24:37.631 DEBUG:boto:Token: None 2023-12-15T23:24:37.631 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094dd8bb8e68c72b7-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.633 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.634 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.634 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.634 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.634 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.634 DEBUG:boto:Method: GET 2023-12-15T23:24:37.634 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.634 DEBUG:boto:Data: 2023-12-15T23:24:37.635 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.635 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.635 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.635 DEBUG:boto:Params: {} 2023-12-15T23:24:37.635 DEBUG:boto:Token: None 2023-12-15T23:24:37.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.638 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000855adbe08ac9c4b9-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.681 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.682 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.682 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.682 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.682 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:24:37.682 DEBUG:boto:Data: 2023-12-15T23:24:37.682 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.682 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.682 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.683 DEBUG:boto:Params: {} 2023-12-15T23:24:37.683 DEBUG:boto:Token: None 2023-12-15T23:24:37.683 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57 2023-12-15T23:24:37.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MZ7EnLr8XmyCbc5+ayse58DUQlk= 2023-12-15T23:24:37.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MZ7EnLr8XmyCbc5+ayse58DUQlk=', 'Content-Length': '0'} 2023-12-15T23:24:37.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc63366ab98a50f3-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.685 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.685 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.686 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.686 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:24:37.686 DEBUG:boto:Data: 2023-12-15T23:24:37.686 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.686 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.686 DEBUG:boto:Params: {} 2023-12-15T23:24:37.686 DEBUG:boto:Token: None 2023-12-15T23:24:37.686 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57 2023-12-15T23:24:37.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MZ7EnLr8XmyCbc5+ayse58DUQlk= 2023-12-15T23:24:37.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MZ7EnLr8XmyCbc5+ayse58DUQlk=', 'Content-Length': '0'} 2023-12-15T23:24:37.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000671cf8a8219f8a92-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.689 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:24:37.689 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.689 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.689 DEBUG:boto:Method: GET 2023-12-15T23:24:37.689 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:24:37.689 DEBUG:boto:Data: 2023-12-15T23:24:37.689 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.689 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.689 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.690 DEBUG:boto:Params: {} 2023-12-15T23:24:37.690 DEBUG:boto:Token: None 2023-12-15T23:24:37.690 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57 2023-12-15T23:24:37.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uj1NNz2OynWROxkWnblDriywyB0= 2023-12-15T23:24:37.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uj1NNz2OynWROxkWnblDriywyB0=', 'Content-Length': '0'} 2023-12-15T23:24:37.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026382c09cac641be-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.733 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:24:37.734 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:24:37.734 DEBUG:boto:Method: GET 2023-12-15T23:24:37.734 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:24:37.734 DEBUG:boto:Data: 2023-12-15T23:24:37.734 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.734 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.734 DEBUG:boto:Params: {} 2023-12-15T23:24:37.734 DEBUG:boto:Token: None 2023-12-15T23:24:37.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj57 2023-12-15T23:24:37.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uj1NNz2OynWROxkWnblDriywyB0= 2023-12-15T23:24:37.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uj1NNz2OynWROxkWnblDriywyB0=', 'Content-Length': '0'} 2023-12-15T23:24:37.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a2c4597586a5971-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.737 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.738 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.738 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.738 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.738 DEBUG:boto:Method: GET 2023-12-15T23:24:37.738 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.738 DEBUG:boto:Data: 2023-12-15T23:24:37.738 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.738 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.738 DEBUG:boto:Params: {} 2023-12-15T23:24:37.739 DEBUG:boto:Token: None 2023-12-15T23:24:37.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e437fc3a1e4452fe-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.741 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.742 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.742 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.742 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.742 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.742 DEBUG:boto:Method: GET 2023-12-15T23:24:37.742 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:24:37.742 DEBUG:boto:Data: 2023-12-15T23:24:37.742 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.743 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.743 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.743 DEBUG:boto:Params: {} 2023-12-15T23:24:37.743 DEBUG:boto:Token: None 2023-12-15T23:24:37.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fc9f8418a6beb56-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.746 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:24:37.747 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.747 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.747 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.747 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.747 DEBUG:boto:Method: GET 2023-12-15T23:24:37.747 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.747 DEBUG:boto:Data: 2023-12-15T23:24:37.747 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.747 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.748 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.748 DEBUG:boto:Params: {} 2023-12-15T23:24:37.748 DEBUG:boto:Token: None 2023-12-15T23:24:37.748 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.748 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI= 2023-12-15T23:24:37.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI=', 'Content-Length': '0'} 2023-12-15T23:24:37.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063f5ec833d1f15a4-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.793 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.794 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.794 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.794 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.794 DEBUG:boto:Method: GET 2023-12-15T23:24:37.794 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.794 DEBUG:boto:Data: 2023-12-15T23:24:37.794 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.794 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.794 DEBUG:boto:Params: {} 2023-12-15T23:24:37.794 DEBUG:boto:Token: None 2023-12-15T23:24:37.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI= 2023-12-15T23:24:37.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI=', 'Content-Length': '0'} 2023-12-15T23:24:37.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000211e500e15baf350-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.797 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.797 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.797 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.797 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.798 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.798 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.798 DEBUG:boto:Data: 2023-12-15T23:24:37.798 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.798 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.798 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.798 DEBUG:boto:Params: {} 2023-12-15T23:24:37.798 DEBUG:boto:Token: None 2023-12-15T23:24:37.798 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z9I9W518274U5aVKBv7jD/UutTk= 2023-12-15T23:24:37.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z9I9W518274U5aVKBv7jD/UutTk=', 'Content-Length': '0'} 2023-12-15T23:24:37.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4c3b991688bdf2a-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.800 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.800 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.801 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.801 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.801 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.801 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.801 DEBUG:boto:Data: 2023-12-15T23:24:37.801 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.801 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.801 DEBUG:boto:Params: {} 2023-12-15T23:24:37.801 DEBUG:boto:Token: None 2023-12-15T23:24:37.802 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z9I9W518274U5aVKBv7jD/UutTk= 2023-12-15T23:24:37.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z9I9W518274U5aVKBv7jD/UutTk=', 'Content-Length': '0'} 2023-12-15T23:24:37.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4f7cac09c63e3f5-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:24:37.804 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.804 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.804 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.804 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.804 DEBUG:boto:Method: GET 2023-12-15T23:24:37.804 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.804 DEBUG:boto:Data: 2023-12-15T23:24:37.804 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.805 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.805 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.805 DEBUG:boto:Params: {} 2023-12-15T23:24:37.805 DEBUG:boto:Token: None 2023-12-15T23:24:37.805 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI= 2023-12-15T23:24:37.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI=', 'Content-Length': '0'} 2023-12-15T23:24:37.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f30299d8937f141-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.850 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.850 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.850 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.850 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.850 DEBUG:boto:Method: GET 2023-12-15T23:24:37.850 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.850 DEBUG:boto:Data: 2023-12-15T23:24:37.850 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.850 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.850 DEBUG:boto:Params: {} 2023-12-15T23:24:37.851 DEBUG:boto:Token: None 2023-12-15T23:24:37.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:24:37.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI= 2023-12-15T23:24:37.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXS1bsucQRzyNBherPizIWwpvHI=', 'Content-Length': '0'} 2023-12-15T23:24:37.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b2968a7aa86a67c-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.853 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.853 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.853 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.853 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.853 DEBUG:boto:Method: GET 2023-12-15T23:24:37.854 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.854 DEBUG:boto:Data: 2023-12-15T23:24:37.854 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.854 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.854 DEBUG:boto:Params: {} 2023-12-15T23:24:37.854 DEBUG:boto:Token: None 2023-12-15T23:24:37.854 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.857 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e80f099d4647de8c-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.857 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.857 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.857 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.858 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.858 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.858 DEBUG:boto:Method: GET 2023-12-15T23:24:37.858 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.858 DEBUG:boto:Data: 2023-12-15T23:24:37.858 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.858 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.858 DEBUG:boto:Params: {} 2023-12-15T23:24:37.858 DEBUG:boto:Token: None 2023-12-15T23:24:37.858 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.862 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8f46582a69a7dd6-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.862 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.864 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.864 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.865 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.865 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:24:37.865 DEBUG:boto:Data: 2023-12-15T23:24:37.865 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.865 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.865 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.865 DEBUG:boto:Params: {} 2023-12-15T23:24:37.865 DEBUG:boto:Token: None 2023-12-15T23:24:37.865 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58 2023-12-15T23:24:37.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fsqLE7xZkck5u1E0zj9vyt8824U= 2023-12-15T23:24:37.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fsqLE7xZkck5u1E0zj9vyt8824U=', 'Content-Length': '0'} 2023-12-15T23:24:37.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e19976eabe3a18d-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.868 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.868 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.868 DEBUG:boto:Method: HEAD 2023-12-15T23:24:37.868 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:24:37.868 DEBUG:boto:Data: 2023-12-15T23:24:37.868 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.868 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.868 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.868 DEBUG:boto:Params: {} 2023-12-15T23:24:37.868 DEBUG:boto:Token: None 2023-12-15T23:24:37.869 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58 2023-12-15T23:24:37.869 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fsqLE7xZkck5u1E0zj9vyt8824U= 2023-12-15T23:24:37.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fsqLE7xZkck5u1E0zj9vyt8824U=', 'Content-Length': '0'} 2023-12-15T23:24:37.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e33f23f6ffab85a1-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:24:37.871 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.871 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.871 DEBUG:boto:Method: GET 2023-12-15T23:24:37.871 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:24:37.871 DEBUG:boto:Data: 2023-12-15T23:24:37.871 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.872 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.872 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.872 DEBUG:boto:Params: {} 2023-12-15T23:24:37.872 DEBUG:boto:Token: None 2023-12-15T23:24:37.872 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58 2023-12-15T23:24:37.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT442hB9NWhEH9ld4rBtPkPpZuQ= 2023-12-15T23:24:37.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT442hB9NWhEH9ld4rBtPkPpZuQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6445d3e2b7cb7b7-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.917 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:24:37.918 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:24:37.918 DEBUG:boto:Method: GET 2023-12-15T23:24:37.918 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:24:37.918 DEBUG:boto:Data: 2023-12-15T23:24:37.918 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.918 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.918 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.918 DEBUG:boto:Params: {} 2023-12-15T23:24:37.918 DEBUG:boto:Token: None 2023-12-15T23:24:37.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj58 2023-12-15T23:24:37.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WT442hB9NWhEH9ld4rBtPkPpZuQ= 2023-12-15T23:24:37.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WT442hB9NWhEH9ld4rBtPkPpZuQ=', 'Content-Length': '0'} 2023-12-15T23:24:37.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e23bba47f59cb9d-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.921 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.921 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.921 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.921 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.921 DEBUG:boto:Method: GET 2023-12-15T23:24:37.921 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.921 DEBUG:boto:Data: 2023-12-15T23:24:37.922 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.922 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.922 DEBUG:boto:Params: {} 2023-12-15T23:24:37.922 DEBUG:boto:Token: None 2023-12-15T23:24:37.922 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d1a47737c297372-00657ce035-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.965 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.966 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:37.966 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:37.966 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.966 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.966 DEBUG:boto:Method: GET 2023-12-15T23:24:37.966 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:24:37.966 DEBUG:boto:Data: 2023-12-15T23:24:37.966 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.966 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.967 DEBUG:boto:Params: {} 2023-12-15T23:24:37.967 DEBUG:boto:Token: None 2023-12-15T23:24:37.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/ 2023-12-15T23:24:37.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg= 2023-12-15T23:24:37.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H2oJZYhDfERMFQZW0N5waLigzSg=', 'Content-Length': '0'} 2023-12-15T23:24:37.970 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014ab065bfdb14171-00657ce035-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.970 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:37.971 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:24:37.971 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:37.971 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:37.971 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.971 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.971 DEBUG:boto:Method: GET 2023-12-15T23:24:37.971 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.971 DEBUG:boto:Data: 2023-12-15T23:24:37.971 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:37.972 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.972 DEBUG:boto:Params: {} 2023-12-15T23:24:37.972 DEBUG:boto:Token: None 2023-12-15T23:24:37.972 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UNPFqWv5tAhjkrjvtF66P8nAtiA= 2023-12-15T23:24:37.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UNPFqWv5tAhjkrjvtF66P8nAtiA=', 'Content-Length': '0'} 2023-12-15T23:24:37.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0379280200b3f10-00657ce035-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:37.975 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:37.975 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:37.975 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.975 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.976 DEBUG:boto:Method: GET 2023-12-15T23:24:37.976 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.976 DEBUG:boto:Data: 2023-12-15T23:24:37.976 DEBUG:boto:Headers: {} 2023-12-15T23:24:37.976 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:37.976 DEBUG:boto:Port: 8000 2023-12-15T23:24:37.976 DEBUG:boto:Params: {} 2023-12-15T23:24:37.976 DEBUG:boto:Token: None 2023-12-15T23:24:37.976 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:37 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:37.976 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UNPFqWv5tAhjkrjvtF66P8nAtiA= 2023-12-15T23:24:37.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:37 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UNPFqWv5tAhjkrjvtF66P8nAtiA=', 'Content-Length': '0'} 2023-12-15T23:24:37.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000493dd157ce02f0f-00657ce035-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:37 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.021 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.021 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.022 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.022 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.022 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.022 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.022 DEBUG:boto:Data: 2023-12-15T23:24:38.022 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.022 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.022 DEBUG:boto:Params: {} 2023-12-15T23:24:38.023 DEBUG:boto:Token: None 2023-12-15T23:24:38.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n40NmSCUkfcIOeZo7G5PgHMu+Ts= 2023-12-15T23:24:38.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n40NmSCUkfcIOeZo7G5PgHMu+Ts=', 'Content-Length': '0'} 2023-12-15T23:24:38.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9d0271aba31f12f-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.025 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.025 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.025 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.026 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.026 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.026 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.026 DEBUG:boto:Data: 2023-12-15T23:24:38.026 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.026 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.026 DEBUG:boto:Params: {} 2023-12-15T23:24:38.026 DEBUG:boto:Token: None 2023-12-15T23:24:38.026 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:n40NmSCUkfcIOeZo7G5PgHMu+Ts= 2023-12-15T23:24:38.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:n40NmSCUkfcIOeZo7G5PgHMu+Ts=', 'Content-Length': '0'} 2023-12-15T23:24:38.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012efc9212d3c5b9c-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:24:38.029 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.029 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.029 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.030 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.030 DEBUG:boto:Method: GET 2023-12-15T23:24:38.030 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.030 DEBUG:boto:Data: 2023-12-15T23:24:38.030 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.030 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.030 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.030 DEBUG:boto:Params: {} 2023-12-15T23:24:38.030 DEBUG:boto:Token: None 2023-12-15T23:24:38.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.030 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSemSSLiEUsSxypPQdl/1hwA2MY= 2023-12-15T23:24:38.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSemSSLiEUsSxypPQdl/1hwA2MY=', 'Content-Length': '0'} 2023-12-15T23:24:38.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9267f98186e64a1-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.073 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.074 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.074 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.074 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.074 DEBUG:boto:Method: GET 2023-12-15T23:24:38.074 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.074 DEBUG:boto:Data: 2023-12-15T23:24:38.074 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.074 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.074 DEBUG:boto:Params: {} 2023-12-15T23:24:38.074 DEBUG:boto:Token: None 2023-12-15T23:24:38.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:24:38.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSemSSLiEUsSxypPQdl/1hwA2MY= 2023-12-15T23:24:38.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSemSSLiEUsSxypPQdl/1hwA2MY=', 'Content-Length': '0'} 2023-12-15T23:24:38.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b25fd7389af2472-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.077 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.077 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.078 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.078 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.078 DEBUG:boto:Method: GET 2023-12-15T23:24:38.078 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.078 DEBUG:boto:Data: 2023-12-15T23:24:38.078 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.078 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.078 DEBUG:boto:Params: {} 2023-12-15T23:24:38.078 DEBUG:boto:Token: None 2023-12-15T23:24:38.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c0f5615f57c82ca-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.081 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.081 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.081 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.082 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.082 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.082 DEBUG:boto:Method: GET 2023-12-15T23:24:38.082 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.082 DEBUG:boto:Data: 2023-12-15T23:24:38.082 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.082 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.082 DEBUG:boto:Params: {} 2023-12-15T23:24:38.082 DEBUG:boto:Token: None 2023-12-15T23:24:38.082 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb1cde9d3c4673ae-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.086 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.086 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.086 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.087 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.087 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:24:38.087 DEBUG:boto:Data: 2023-12-15T23:24:38.087 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.087 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.087 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.087 DEBUG:boto:Params: {} 2023-12-15T23:24:38.087 DEBUG:boto:Token: None 2023-12-15T23:24:38.087 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62 2023-12-15T23:24:38.088 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JCPrn1WyTXHYT0tg8zwsZE089us= 2023-12-15T23:24:38.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JCPrn1WyTXHYT0tg8zwsZE089us=', 'Content-Length': '0'} 2023-12-15T23:24:38.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000922d49546d9fd168-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.090 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.090 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.090 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.090 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:24:38.090 DEBUG:boto:Data: 2023-12-15T23:24:38.090 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.091 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.091 DEBUG:boto:Params: {} 2023-12-15T23:24:38.091 DEBUG:boto:Token: None 2023-12-15T23:24:38.091 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62 2023-12-15T23:24:38.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JCPrn1WyTXHYT0tg8zwsZE089us= 2023-12-15T23:24:38.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JCPrn1WyTXHYT0tg8zwsZE089us=', 'Content-Length': '0'} 2023-12-15T23:24:38.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033f5ca99cbba171c-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:24:38.093 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.093 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.093 DEBUG:boto:Method: GET 2023-12-15T23:24:38.093 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:24:38.094 DEBUG:boto:Data: 2023-12-15T23:24:38.094 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.094 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.094 DEBUG:boto:Params: {} 2023-12-15T23:24:38.094 DEBUG:boto:Token: None 2023-12-15T23:24:38.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62 2023-12-15T23:24:38.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASkoSEgfmwnV4yngJ9ZmL51Hcls= 2023-12-15T23:24:38.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASkoSEgfmwnV4yngJ9ZmL51Hcls=', 'Content-Length': '0'} 2023-12-15T23:24:38.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5eb223f68812ca5-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.138 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:24:38.138 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:24:38.138 DEBUG:boto:Method: GET 2023-12-15T23:24:38.138 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:24:38.138 DEBUG:boto:Data: 2023-12-15T23:24:38.138 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.138 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.138 DEBUG:boto:Params: {} 2023-12-15T23:24:38.139 DEBUG:boto:Token: None 2023-12-15T23:24:38.139 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj62 2023-12-15T23:24:38.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ASkoSEgfmwnV4yngJ9ZmL51Hcls= 2023-12-15T23:24:38.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ASkoSEgfmwnV4yngJ9ZmL51Hcls=', 'Content-Length': '0'} 2023-12-15T23:24:38.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005847b0d5b4380102-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.141 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.141 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.142 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.142 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.142 DEBUG:boto:Method: GET 2023-12-15T23:24:38.142 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.142 DEBUG:boto:Data: 2023-12-15T23:24:38.142 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.142 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.142 DEBUG:boto:Params: {} 2023-12-15T23:24:38.142 DEBUG:boto:Token: None 2023-12-15T23:24:38.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f1bfda910e5d387-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.145 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.146 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.146 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.146 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.146 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.146 DEBUG:boto:Method: GET 2023-12-15T23:24:38.146 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:24:38.146 DEBUG:boto:Data: 2023-12-15T23:24:38.146 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.146 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.146 DEBUG:boto:Params: {} 2023-12-15T23:24:38.147 DEBUG:boto:Token: None 2023-12-15T23:24:38.147 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.150 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004793beb94b4f1c7d-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.150 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:24:38.151 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.151 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.151 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.151 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.151 DEBUG:boto:Method: GET 2023-12-15T23:24:38.151 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.151 DEBUG:boto:Data: 2023-12-15T23:24:38.151 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.151 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.151 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.151 DEBUG:boto:Params: {} 2023-12-15T23:24:38.152 DEBUG:boto:Token: None 2023-12-15T23:24:38.152 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.152 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk= 2023-12-15T23:24:38.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk=', 'Content-Length': '0'} 2023-12-15T23:24:38.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7093287fd87f26e-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.154 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.154 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.154 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.154 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.154 DEBUG:boto:Method: GET 2023-12-15T23:24:38.154 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.155 DEBUG:boto:Data: 2023-12-15T23:24:38.155 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.155 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.155 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.155 DEBUG:boto:Params: {} 2023-12-15T23:24:38.155 DEBUG:boto:Token: None 2023-12-15T23:24:38.155 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk= 2023-12-15T23:24:38.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk=', 'Content-Length': '0'} 2023-12-15T23:24:38.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcaf74b31373093e-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.201 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.201 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.202 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.202 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.202 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.202 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.202 DEBUG:boto:Data: 2023-12-15T23:24:38.202 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.202 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.202 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.202 DEBUG:boto:Params: {} 2023-12-15T23:24:38.202 DEBUG:boto:Token: None 2023-12-15T23:24:38.203 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eCzVY0Vm5vPgTiwgkpzBIw+80vg= 2023-12-15T23:24:38.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eCzVY0Vm5vPgTiwgkpzBIw+80vg=', 'Content-Length': '0'} 2023-12-15T23:24:38.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bca1a5fcbead40cf-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.205 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.205 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.206 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.206 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.206 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.206 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.206 DEBUG:boto:Data: 2023-12-15T23:24:38.206 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.206 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.206 DEBUG:boto:Params: {} 2023-12-15T23:24:38.206 DEBUG:boto:Token: None 2023-12-15T23:24:38.207 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eCzVY0Vm5vPgTiwgkpzBIw+80vg= 2023-12-15T23:24:38.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eCzVY0Vm5vPgTiwgkpzBIw+80vg=', 'Content-Length': '0'} 2023-12-15T23:24:38.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098060ded0ae2b4fc-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:24:38.209 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.209 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.209 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.209 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.209 DEBUG:boto:Method: GET 2023-12-15T23:24:38.209 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.209 DEBUG:boto:Data: 2023-12-15T23:24:38.210 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.210 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.210 DEBUG:boto:Params: {} 2023-12-15T23:24:38.210 DEBUG:boto:Token: None 2023-12-15T23:24:38.210 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk= 2023-12-15T23:24:38.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk=', 'Content-Length': '0'} 2023-12-15T23:24:38.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4252d0358cb379b-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.253 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.254 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.254 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.254 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.254 DEBUG:boto:Method: GET 2023-12-15T23:24:38.254 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.254 DEBUG:boto:Data: 2023-12-15T23:24:38.254 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.254 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.254 DEBUG:boto:Params: {} 2023-12-15T23:24:38.254 DEBUG:boto:Token: None 2023-12-15T23:24:38.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:24:38.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk= 2023-12-15T23:24:38.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZtVayfa+0yY8UTCYZKKGJY0orIk=', 'Content-Length': '0'} 2023-12-15T23:24:38.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060494359d2a5ef60-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.257 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.257 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.257 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.257 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.257 DEBUG:boto:Method: GET 2023-12-15T23:24:38.257 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.258 DEBUG:boto:Data: 2023-12-15T23:24:38.258 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.258 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.258 DEBUG:boto:Params: {} 2023-12-15T23:24:38.258 DEBUG:boto:Token: None 2023-12-15T23:24:38.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.261 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b17ad63f292a858-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.261 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.261 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.261 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.261 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.262 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.262 DEBUG:boto:Method: GET 2023-12-15T23:24:38.262 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.262 DEBUG:boto:Data: 2023-12-15T23:24:38.262 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.262 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.262 DEBUG:boto:Params: {} 2023-12-15T23:24:38.262 DEBUG:boto:Token: None 2023-12-15T23:24:38.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092cd035c57fdb05c-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.266 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.266 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.266 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.266 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.267 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:24:38.267 DEBUG:boto:Data: 2023-12-15T23:24:38.267 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.267 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.267 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.267 DEBUG:boto:Params: {} 2023-12-15T23:24:38.267 DEBUG:boto:Token: None 2023-12-15T23:24:38.267 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68 2023-12-15T23:24:38.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GA6R25wtaSi/JzLUXvBHlSFJWGA= 2023-12-15T23:24:38.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GA6R25wtaSi/JzLUXvBHlSFJWGA=', 'Content-Length': '0'} 2023-12-15T23:24:38.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006395173513fa82b5-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.270 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.272 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.272 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.272 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:24:38.272 DEBUG:boto:Data: 2023-12-15T23:24:38.272 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.272 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.273 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.273 DEBUG:boto:Params: {} 2023-12-15T23:24:38.273 DEBUG:boto:Token: None 2023-12-15T23:24:38.273 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68 2023-12-15T23:24:38.273 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GA6R25wtaSi/JzLUXvBHlSFJWGA= 2023-12-15T23:24:38.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GA6R25wtaSi/JzLUXvBHlSFJWGA=', 'Content-Length': '0'} 2023-12-15T23:24:38.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4fc191f71bdbc26-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:24:38.276 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.276 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.276 DEBUG:boto:Method: GET 2023-12-15T23:24:38.276 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:24:38.276 DEBUG:boto:Data: 2023-12-15T23:24:38.276 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.276 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.276 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.276 DEBUG:boto:Params: {} 2023-12-15T23:24:38.276 DEBUG:boto:Token: None 2023-12-15T23:24:38.276 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68 2023-12-15T23:24:38.277 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hc/OfgD8R/txJMFnelrfNllTiaI= 2023-12-15T23:24:38.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hc/OfgD8R/txJMFnelrfNllTiaI=', 'Content-Length': '0'} 2023-12-15T23:24:38.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e810fcab46384a9a-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.325 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:24:38.326 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:24:38.326 DEBUG:boto:Method: GET 2023-12-15T23:24:38.326 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:24:38.326 DEBUG:boto:Data: 2023-12-15T23:24:38.326 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.326 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.326 DEBUG:boto:Params: {} 2023-12-15T23:24:38.326 DEBUG:boto:Token: None 2023-12-15T23:24:38.327 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj68 2023-12-15T23:24:38.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hc/OfgD8R/txJMFnelrfNllTiaI= 2023-12-15T23:24:38.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hc/OfgD8R/txJMFnelrfNllTiaI=', 'Content-Length': '0'} 2023-12-15T23:24:38.329 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae30fe566c52885e-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.329 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.329 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.329 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.330 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.330 DEBUG:boto:Method: GET 2023-12-15T23:24:38.330 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.330 DEBUG:boto:Data: 2023-12-15T23:24:38.330 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.330 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.330 DEBUG:boto:Params: {} 2023-12-15T23:24:38.330 DEBUG:boto:Token: None 2023-12-15T23:24:38.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.333 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000637ffa54c019483a-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.373 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.374 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.374 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.374 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.374 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.374 DEBUG:boto:Method: GET 2023-12-15T23:24:38.374 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:24:38.374 DEBUG:boto:Data: 2023-12-15T23:24:38.374 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.375 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.375 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.375 DEBUG:boto:Params: {} 2023-12-15T23:24:38.375 DEBUG:boto:Token: None 2023-12-15T23:24:38.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d01319bfebb6176b-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.378 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:24:38.379 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.379 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.379 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.379 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.379 DEBUG:boto:Method: GET 2023-12-15T23:24:38.379 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.379 DEBUG:boto:Data: 2023-12-15T23:24:38.379 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.380 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.380 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.380 DEBUG:boto:Params: {} 2023-12-15T23:24:38.380 DEBUG:boto:Token: None 2023-12-15T23:24:38.380 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw= 2023-12-15T23:24:38.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw=', 'Content-Length': '0'} 2023-12-15T23:24:38.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093e9ec5d75948eca-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.383 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.383 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.383 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.383 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.383 DEBUG:boto:Method: GET 2023-12-15T23:24:38.383 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.383 DEBUG:boto:Data: 2023-12-15T23:24:38.383 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.383 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.383 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.384 DEBUG:boto:Params: {} 2023-12-15T23:24:38.384 DEBUG:boto:Token: None 2023-12-15T23:24:38.384 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw= 2023-12-15T23:24:38.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw=', 'Content-Length': '0'} 2023-12-15T23:24:38.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ac252abac7b4d69-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.429 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.430 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.430 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.430 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.430 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.430 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.430 DEBUG:boto:Data: 2023-12-15T23:24:38.430 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.430 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.430 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.430 DEBUG:boto:Params: {} 2023-12-15T23:24:38.430 DEBUG:boto:Token: None 2023-12-15T23:24:38.431 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5yoQRlfiyrTjYW1Lp9vY15jIqaE= 2023-12-15T23:24:38.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5yoQRlfiyrTjYW1Lp9vY15jIqaE=', 'Content-Length': '0'} 2023-12-15T23:24:38.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b269965f9a7b1a4c-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.433 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.433 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.433 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.433 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.434 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.434 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.434 DEBUG:boto:Data: 2023-12-15T23:24:38.434 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.434 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.434 DEBUG:boto:Params: {} 2023-12-15T23:24:38.434 DEBUG:boto:Token: None 2023-12-15T23:24:38.434 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5yoQRlfiyrTjYW1Lp9vY15jIqaE= 2023-12-15T23:24:38.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5yoQRlfiyrTjYW1Lp9vY15jIqaE=', 'Content-Length': '0'} 2023-12-15T23:24:38.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f711cc7586c90a07-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:24:38.437 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.437 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.437 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.437 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.437 DEBUG:boto:Method: GET 2023-12-15T23:24:38.437 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.437 DEBUG:boto:Data: 2023-12-15T23:24:38.437 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.438 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.438 DEBUG:boto:Params: {} 2023-12-15T23:24:38.438 DEBUG:boto:Token: None 2023-12-15T23:24:38.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw= 2023-12-15T23:24:38.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw=', 'Content-Length': '0'} 2023-12-15T23:24:38.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d91111de7b1feb5-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.481 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.482 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.482 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.482 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.482 DEBUG:boto:Method: GET 2023-12-15T23:24:38.482 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.482 DEBUG:boto:Data: 2023-12-15T23:24:38.482 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.482 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.482 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.482 DEBUG:boto:Params: {} 2023-12-15T23:24:38.483 DEBUG:boto:Token: None 2023-12-15T23:24:38.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:24:38.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw= 2023-12-15T23:24:38.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:246M+RfubgkmnC6RfdpTA/FTDHw=', 'Content-Length': '0'} 2023-12-15T23:24:38.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c6ec845c881c2fd-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.485 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.485 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.486 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.486 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.486 DEBUG:boto:Method: GET 2023-12-15T23:24:38.486 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.486 DEBUG:boto:Data: 2023-12-15T23:24:38.486 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.486 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.486 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.486 DEBUG:boto:Params: {} 2023-12-15T23:24:38.486 DEBUG:boto:Token: None 2023-12-15T23:24:38.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e763f22e07d54ac7-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.489 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.489 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.490 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.490 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.490 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.490 DEBUG:boto:Method: GET 2023-12-15T23:24:38.490 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.490 DEBUG:boto:Data: 2023-12-15T23:24:38.490 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.490 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.490 DEBUG:boto:Params: {} 2023-12-15T23:24:38.490 DEBUG:boto:Token: None 2023-12-15T23:24:38.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d3d3249e46d1917-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.494 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.495 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.495 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.495 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.495 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:24:38.495 DEBUG:boto:Data: 2023-12-15T23:24:38.495 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.495 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.495 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.495 DEBUG:boto:Params: {} 2023-12-15T23:24:38.495 DEBUG:boto:Token: None 2023-12-15T23:24:38.496 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69 2023-12-15T23:24:38.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b27DLix20JU6bhYbnYMn1wwSuf8= 2023-12-15T23:24:38.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b27DLix20JU6bhYbnYMn1wwSuf8=', 'Content-Length': '0'} 2023-12-15T23:24:38.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082c5c89802d4159e-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.498 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.498 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.499 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.499 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:24:38.499 DEBUG:boto:Data: 2023-12-15T23:24:38.499 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.499 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.499 DEBUG:boto:Params: {} 2023-12-15T23:24:38.499 DEBUG:boto:Token: None 2023-12-15T23:24:38.499 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69 2023-12-15T23:24:38.500 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b27DLix20JU6bhYbnYMn1wwSuf8= 2023-12-15T23:24:38.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b27DLix20JU6bhYbnYMn1wwSuf8=', 'Content-Length': '0'} 2023-12-15T23:24:38.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000953c132ce12ff6a0-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.502 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:24:38.502 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.502 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.502 DEBUG:boto:Method: GET 2023-12-15T23:24:38.502 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:24:38.502 DEBUG:boto:Data: 2023-12-15T23:24:38.502 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.502 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.503 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.503 DEBUG:boto:Params: {} 2023-12-15T23:24:38.503 DEBUG:boto:Token: None 2023-12-15T23:24:38.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69 2023-12-15T23:24:38.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2e7n2DYTqC5NE73Nk0zQfMaid2s= 2023-12-15T23:24:38.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2e7n2DYTqC5NE73Nk0zQfMaid2s=', 'Content-Length': '0'} 2023-12-15T23:24:38.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000775d8efd6138d075-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.545 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:24:38.546 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:24:38.546 DEBUG:boto:Method: GET 2023-12-15T23:24:38.546 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:24:38.546 DEBUG:boto:Data: 2023-12-15T23:24:38.546 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.546 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.546 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.546 DEBUG:boto:Params: {} 2023-12-15T23:24:38.546 DEBUG:boto:Token: None 2023-12-15T23:24:38.546 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj69 2023-12-15T23:24:38.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2e7n2DYTqC5NE73Nk0zQfMaid2s= 2023-12-15T23:24:38.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2e7n2DYTqC5NE73Nk0zQfMaid2s=', 'Content-Length': '0'} 2023-12-15T23:24:38.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa5c0a4c77e3f28d-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.549 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.549 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.550 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.550 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.550 DEBUG:boto:Method: GET 2023-12-15T23:24:38.550 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.550 DEBUG:boto:Data: 2023-12-15T23:24:38.550 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.550 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.550 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.550 DEBUG:boto:Params: {} 2023-12-15T23:24:38.550 DEBUG:boto:Token: None 2023-12-15T23:24:38.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001551f9839c60c207-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.553 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.553 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.554 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.554 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.554 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.554 DEBUG:boto:Method: GET 2023-12-15T23:24:38.554 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:24:38.554 DEBUG:boto:Data: 2023-12-15T23:24:38.554 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.554 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.554 DEBUG:boto:Params: {} 2023-12-15T23:24:38.555 DEBUG:boto:Token: None 2023-12-15T23:24:38.555 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.558 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000af86be0cb035d4b-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.558 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:24:38.559 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.559 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.559 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.559 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.559 DEBUG:boto:Method: GET 2023-12-15T23:24:38.559 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.559 DEBUG:boto:Data: 2023-12-15T23:24:38.559 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.560 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.560 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.560 DEBUG:boto:Params: {} 2023-12-15T23:24:38.560 DEBUG:boto:Token: None 2023-12-15T23:24:38.560 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.560 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ= 2023-12-15T23:24:38.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ=', 'Content-Length': '0'} 2023-12-15T23:24:38.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077f7400ab33fe77a-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.563 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.563 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.563 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.563 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.563 DEBUG:boto:Method: GET 2023-12-15T23:24:38.563 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.563 DEBUG:boto:Data: 2023-12-15T23:24:38.563 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.563 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.563 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.564 DEBUG:boto:Params: {} 2023-12-15T23:24:38.564 DEBUG:boto:Token: None 2023-12-15T23:24:38.564 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.564 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ= 2023-12-15T23:24:38.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ=', 'Content-Length': '0'} 2023-12-15T23:24:38.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033f0284d680c0779-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.613 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.614 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.614 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.614 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.614 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.614 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.614 DEBUG:boto:Data: 2023-12-15T23:24:38.614 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.614 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.614 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.614 DEBUG:boto:Params: {} 2023-12-15T23:24:38.615 DEBUG:boto:Token: None 2023-12-15T23:24:38.615 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nmNFvXHy6dYImZwws5tnkk2QIjE= 2023-12-15T23:24:38.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nmNFvXHy6dYImZwws5tnkk2QIjE=', 'Content-Length': '0'} 2023-12-15T23:24:38.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017af11ad6ea73e98-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.617 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.618 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.618 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.618 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.618 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.618 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.618 DEBUG:boto:Data: 2023-12-15T23:24:38.618 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.618 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.618 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.618 DEBUG:boto:Params: {} 2023-12-15T23:24:38.618 DEBUG:boto:Token: None 2023-12-15T23:24:38.619 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nmNFvXHy6dYImZwws5tnkk2QIjE= 2023-12-15T23:24:38.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nmNFvXHy6dYImZwws5tnkk2QIjE=', 'Content-Length': '0'} 2023-12-15T23:24:38.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009697a52e215eaf4e-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:24:38.621 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.622 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.622 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.622 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.622 DEBUG:boto:Method: GET 2023-12-15T23:24:38.622 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.622 DEBUG:boto:Data: 2023-12-15T23:24:38.622 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.622 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.622 DEBUG:boto:Params: {} 2023-12-15T23:24:38.622 DEBUG:boto:Token: None 2023-12-15T23:24:38.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ= 2023-12-15T23:24:38.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ=', 'Content-Length': '0'} 2023-12-15T23:24:38.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4d160a688fe7e00-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.665 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.666 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.666 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.666 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.666 DEBUG:boto:Method: GET 2023-12-15T23:24:38.666 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.666 DEBUG:boto:Data: 2023-12-15T23:24:38.666 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.666 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.666 DEBUG:boto:Params: {} 2023-12-15T23:24:38.666 DEBUG:boto:Token: None 2023-12-15T23:24:38.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:24:38.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ= 2023-12-15T23:24:38.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8CTL6b8nodqvD2Gm3aiRvJANUEQ=', 'Content-Length': '0'} 2023-12-15T23:24:38.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae0ef1d9f654c25-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.669 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.669 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.670 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.670 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.670 DEBUG:boto:Method: GET 2023-12-15T23:24:38.670 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.670 DEBUG:boto:Data: 2023-12-15T23:24:38.670 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.670 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.670 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.670 DEBUG:boto:Params: {} 2023-12-15T23:24:38.670 DEBUG:boto:Token: None 2023-12-15T23:24:38.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000247b978b4a4697e5-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.673 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.673 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.674 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.674 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.674 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.674 DEBUG:boto:Method: GET 2023-12-15T23:24:38.674 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.674 DEBUG:boto:Data: 2023-12-15T23:24:38.674 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.674 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.674 DEBUG:boto:Params: {} 2023-12-15T23:24:38.674 DEBUG:boto:Token: None 2023-12-15T23:24:38.675 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.680 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dad462f5f0250f9-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.680 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.681 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.681 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.681 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.681 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:24:38.681 DEBUG:boto:Data: 2023-12-15T23:24:38.681 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.681 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.681 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.681 DEBUG:boto:Params: {} 2023-12-15T23:24:38.682 DEBUG:boto:Token: None 2023-12-15T23:24:38.682 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76 2023-12-15T23:24:38.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a3M9bkRoK+uGnYzEWLdaFr3FGA8= 2023-12-15T23:24:38.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a3M9bkRoK+uGnYzEWLdaFr3FGA8=', 'Content-Length': '0'} 2023-12-15T23:24:38.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000048b5d1e20ef8afb-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.684 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.684 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.685 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.685 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:24:38.685 DEBUG:boto:Data: 2023-12-15T23:24:38.685 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.685 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.685 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.685 DEBUG:boto:Params: {} 2023-12-15T23:24:38.685 DEBUG:boto:Token: None 2023-12-15T23:24:38.685 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76 2023-12-15T23:24:38.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a3M9bkRoK+uGnYzEWLdaFr3FGA8= 2023-12-15T23:24:38.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a3M9bkRoK+uGnYzEWLdaFr3FGA8=', 'Content-Length': '0'} 2023-12-15T23:24:38.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd319cd21399db9a-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:24:38.688 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.688 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.688 DEBUG:boto:Method: GET 2023-12-15T23:24:38.688 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:24:38.688 DEBUG:boto:Data: 2023-12-15T23:24:38.688 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.689 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.689 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.689 DEBUG:boto:Params: {} 2023-12-15T23:24:38.689 DEBUG:boto:Token: None 2023-12-15T23:24:38.689 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76 2023-12-15T23:24:38.689 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kQIAHvLdaM2A5oTHSv8izmLuZSY= 2023-12-15T23:24:38.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kQIAHvLdaM2A5oTHSv8izmLuZSY=', 'Content-Length': '0'} 2023-12-15T23:24:38.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2f96528badeb228-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.733 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:24:38.734 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:24:38.734 DEBUG:boto:Method: GET 2023-12-15T23:24:38.734 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:24:38.734 DEBUG:boto:Data: 2023-12-15T23:24:38.734 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.734 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.734 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.734 DEBUG:boto:Params: {} 2023-12-15T23:24:38.734 DEBUG:boto:Token: None 2023-12-15T23:24:38.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj76 2023-12-15T23:24:38.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kQIAHvLdaM2A5oTHSv8izmLuZSY= 2023-12-15T23:24:38.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kQIAHvLdaM2A5oTHSv8izmLuZSY=', 'Content-Length': '0'} 2023-12-15T23:24:38.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b983b0988371e10f-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.737 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.737 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.737 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.737 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.737 DEBUG:boto:Method: GET 2023-12-15T23:24:38.737 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.738 DEBUG:boto:Data: 2023-12-15T23:24:38.738 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.738 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.738 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.738 DEBUG:boto:Params: {} 2023-12-15T23:24:38.738 DEBUG:boto:Token: None 2023-12-15T23:24:38.738 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.738 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf2e6e4305db3b4e-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.781 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.782 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.782 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.782 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.782 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.782 DEBUG:boto:Method: GET 2023-12-15T23:24:38.782 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:24:38.782 DEBUG:boto:Data: 2023-12-15T23:24:38.783 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.783 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.783 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.783 DEBUG:boto:Params: {} 2023-12-15T23:24:38.783 DEBUG:boto:Token: None 2023-12-15T23:24:38.783 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000151ee7cceb8d3f92-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.787 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.787 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:24:38.787 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.787 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.787 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.787 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.787 DEBUG:boto:Method: GET 2023-12-15T23:24:38.787 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.788 DEBUG:boto:Data: 2023-12-15T23:24:38.788 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.788 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.788 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.788 DEBUG:boto:Params: {} 2023-12-15T23:24:38.788 DEBUG:boto:Token: None 2023-12-15T23:24:38.788 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U= 2023-12-15T23:24:38.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U=', 'Content-Length': '0'} 2023-12-15T23:24:38.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0094d16652631e2-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.790 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.790 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.791 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.791 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.791 DEBUG:boto:Method: GET 2023-12-15T23:24:38.791 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.791 DEBUG:boto:Data: 2023-12-15T23:24:38.791 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.791 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.791 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.791 DEBUG:boto:Params: {} 2023-12-15T23:24:38.791 DEBUG:boto:Token: None 2023-12-15T23:24:38.792 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.792 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U= 2023-12-15T23:24:38.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U=', 'Content-Length': '0'} 2023-12-15T23:24:38.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c946e9a3781192b5-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.837 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.838 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.838 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.838 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.838 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.838 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.838 DEBUG:boto:Data: 2023-12-15T23:24:38.838 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.838 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.838 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.838 DEBUG:boto:Params: {} 2023-12-15T23:24:38.838 DEBUG:boto:Token: None 2023-12-15T23:24:38.839 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hR8fUOg9bSHIsSMHLPOIpIFQfKM= 2023-12-15T23:24:38.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hR8fUOg9bSHIsSMHLPOIpIFQfKM=', 'Content-Length': '0'} 2023-12-15T23:24:38.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e78ddd3c873ba8a3-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.841 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.841 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.841 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.842 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.842 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.842 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.842 DEBUG:boto:Data: 2023-12-15T23:24:38.842 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.842 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.842 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.842 DEBUG:boto:Params: {} 2023-12-15T23:24:38.842 DEBUG:boto:Token: None 2023-12-15T23:24:38.842 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hR8fUOg9bSHIsSMHLPOIpIFQfKM= 2023-12-15T23:24:38.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hR8fUOg9bSHIsSMHLPOIpIFQfKM=', 'Content-Length': '0'} 2023-12-15T23:24:38.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933a506266000688-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:24:38.845 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.845 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.845 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.845 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.845 DEBUG:boto:Method: GET 2023-12-15T23:24:38.845 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.846 DEBUG:boto:Data: 2023-12-15T23:24:38.846 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.846 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.846 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.846 DEBUG:boto:Params: {} 2023-12-15T23:24:38.846 DEBUG:boto:Token: None 2023-12-15T23:24:38.846 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.846 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U= 2023-12-15T23:24:38.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U=', 'Content-Length': '0'} 2023-12-15T23:24:38.848 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059429ce4638ba9b4-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.889 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.889 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.890 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.890 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.890 DEBUG:boto:Method: GET 2023-12-15T23:24:38.890 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.890 DEBUG:boto:Data: 2023-12-15T23:24:38.890 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.890 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.890 DEBUG:boto:Params: {} 2023-12-15T23:24:38.890 DEBUG:boto:Token: None 2023-12-15T23:24:38.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:24:38.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U= 2023-12-15T23:24:38.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r0L72qfiP4WD6ZcU8geguhAtj8U=', 'Content-Length': '0'} 2023-12-15T23:24:38.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f9e1bab6bdf20ee-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.893 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.893 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.893 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.893 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.893 DEBUG:boto:Method: GET 2023-12-15T23:24:38.894 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.894 DEBUG:boto:Data: 2023-12-15T23:24:38.894 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.894 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.894 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.894 DEBUG:boto:Params: {} 2023-12-15T23:24:38.894 DEBUG:boto:Token: None 2023-12-15T23:24:38.894 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053f30adaa2d04f5d-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.897 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.897 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.897 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.898 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.898 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.898 DEBUG:boto:Method: GET 2023-12-15T23:24:38.898 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.898 DEBUG:boto:Data: 2023-12-15T23:24:38.898 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.898 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.898 DEBUG:boto:Params: {} 2023-12-15T23:24:38.898 DEBUG:boto:Token: None 2023-12-15T23:24:38.898 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.902 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003458e75b20172a4b-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.902 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.903 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.903 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.903 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.903 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:24:38.903 DEBUG:boto:Data: 2023-12-15T23:24:38.903 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.903 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.903 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.903 DEBUG:boto:Params: {} 2023-12-15T23:24:38.903 DEBUG:boto:Token: None 2023-12-15T23:24:38.904 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85 2023-12-15T23:24:38.904 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XAXgo5GDD6edGC6/40fFYsyus= 2023-12-15T23:24:38.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XAXgo5GDD6edGC6/40fFYsyus=', 'Content-Length': '0'} 2023-12-15T23:24:38.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075b631a3c2130664-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.906 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.906 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.906 DEBUG:boto:Method: HEAD 2023-12-15T23:24:38.906 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:24:38.906 DEBUG:boto:Data: 2023-12-15T23:24:38.906 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.907 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.907 DEBUG:boto:Params: {} 2023-12-15T23:24:38.907 DEBUG:boto:Token: None 2023-12-15T23:24:38.907 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85 2023-12-15T23:24:38.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d7XAXgo5GDD6edGC6/40fFYsyus= 2023-12-15T23:24:38.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d7XAXgo5GDD6edGC6/40fFYsyus=', 'Content-Length': '0'} 2023-12-15T23:24:38.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4ee8713dc161527-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:24:38.909 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.909 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.909 DEBUG:boto:Method: GET 2023-12-15T23:24:38.909 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:24:38.910 DEBUG:boto:Data: 2023-12-15T23:24:38.910 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.910 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.910 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.910 DEBUG:boto:Params: {} 2023-12-15T23:24:38.910 DEBUG:boto:Token: None 2023-12-15T23:24:38.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85 2023-12-15T23:24:38.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c6J5TrtYJTQhWwM8/WIj1p8CwoE= 2023-12-15T23:24:38.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c6J5TrtYJTQhWwM8/WIj1p8CwoE=', 'Content-Length': '0'} 2023-12-15T23:24:38.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7f4f385e56fb6cc-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.953 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:24:38.954 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:24:38.954 DEBUG:boto:Method: GET 2023-12-15T23:24:38.954 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:24:38.954 DEBUG:boto:Data: 2023-12-15T23:24:38.954 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.954 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.954 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.954 DEBUG:boto:Params: {} 2023-12-15T23:24:38.954 DEBUG:boto:Token: None 2023-12-15T23:24:38.954 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj85 2023-12-15T23:24:38.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c6J5TrtYJTQhWwM8/WIj1p8CwoE= 2023-12-15T23:24:38.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c6J5TrtYJTQhWwM8/WIj1p8CwoE=', 'Content-Length': '0'} 2023-12-15T23:24:38.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9fa5513bbe84dad-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.957 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.957 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.958 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.958 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.958 DEBUG:boto:Method: GET 2023-12-15T23:24:38.958 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.958 DEBUG:boto:Data: 2023-12-15T23:24:38.958 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.958 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.958 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.958 DEBUG:boto:Params: {} 2023-12-15T23:24:38.958 DEBUG:boto:Token: None 2023-12-15T23:24:38.958 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.961 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000371ee82a3fbd979f-00657ce036-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.961 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.962 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:38.962 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:38.962 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.962 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.962 DEBUG:boto:Method: GET 2023-12-15T23:24:38.962 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:24:38.962 DEBUG:boto:Data: 2023-12-15T23:24:38.962 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.962 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.962 DEBUG:boto:Params: {} 2023-12-15T23:24:38.963 DEBUG:boto:Token: None 2023-12-15T23:24:38.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/ 2023-12-15T23:24:38.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w= 2023-12-15T23:24:38.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:L2Ml7RfuL27BDYM7O9Qm8583a+w=', 'Content-Length': '0'} 2023-12-15T23:24:38.966 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af35f2cbc0d9123b-00657ce036-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.966 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:38.967 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:24:38.967 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:38.967 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:38.967 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.967 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.967 DEBUG:boto:Method: GET 2023-12-15T23:24:38.967 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.967 DEBUG:boto:Data: 2023-12-15T23:24:38.967 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.967 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:38.968 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.968 DEBUG:boto:Params: {} 2023-12-15T23:24:38.968 DEBUG:boto:Token: None 2023-12-15T23:24:38.968 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ikAoJIKarwNlFTaFDIxyR+e5lzY= 2023-12-15T23:24:38.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ikAoJIKarwNlFTaFDIxyR+e5lzY=', 'Content-Length': '0'} 2023-12-15T23:24:38.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df650c33c87798aa-00657ce036-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:38.970 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:38.970 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:38.970 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.970 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.971 DEBUG:boto:Method: GET 2023-12-15T23:24:38.971 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.971 DEBUG:boto:Data: 2023-12-15T23:24:38.971 DEBUG:boto:Headers: {} 2023-12-15T23:24:38.971 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:38.971 DEBUG:boto:Port: 8000 2023-12-15T23:24:38.971 DEBUG:boto:Params: {} 2023-12-15T23:24:38.971 DEBUG:boto:Token: None 2023-12-15T23:24:38.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:38 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:38.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ikAoJIKarwNlFTaFDIxyR+e5lzY= 2023-12-15T23:24:38.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:38 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ikAoJIKarwNlFTaFDIxyR+e5lzY=', 'Content-Length': '0'} 2023-12-15T23:24:38.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002abe628f47785979-00657ce036-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:38 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.022 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.022 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.022 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.022 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.022 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.022 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.022 DEBUG:boto:Data: 2023-12-15T23:24:39.022 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.022 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.022 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.022 DEBUG:boto:Params: {} 2023-12-15T23:24:39.023 DEBUG:boto:Token: None 2023-12-15T23:24:39.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1r0bwm5r/TnM7O4a6PZ8as3vbzk= 2023-12-15T23:24:39.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1r0bwm5r/TnM7O4a6PZ8as3vbzk=', 'Content-Length': '0'} 2023-12-15T23:24:39.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002692f35458fefd24-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.025 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.025 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.025 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.025 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.025 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.026 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.026 DEBUG:boto:Data: 2023-12-15T23:24:39.026 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.026 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.026 DEBUG:boto:Params: {} 2023-12-15T23:24:39.026 DEBUG:boto:Token: None 2023-12-15T23:24:39.026 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1r0bwm5r/TnM7O4a6PZ8as3vbzk= 2023-12-15T23:24:39.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1r0bwm5r/TnM7O4a6PZ8as3vbzk=', 'Content-Length': '0'} 2023-12-15T23:24:39.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083a351e2201ea3e5-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:24:39.028 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.028 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.029 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.029 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.029 DEBUG:boto:Method: GET 2023-12-15T23:24:39.029 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.029 DEBUG:boto:Data: 2023-12-15T23:24:39.029 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.029 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.029 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.029 DEBUG:boto:Params: {} 2023-12-15T23:24:39.029 DEBUG:boto:Token: None 2023-12-15T23:24:39.030 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.030 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v1RFU16xXYN5TfvpQLJwf0SBz64= 2023-12-15T23:24:39.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v1RFU16xXYN5TfvpQLJwf0SBz64=', 'Content-Length': '0'} 2023-12-15T23:24:39.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1ba1ed05d950162-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.073 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.074 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.074 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.074 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.074 DEBUG:boto:Method: GET 2023-12-15T23:24:39.074 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.074 DEBUG:boto:Data: 2023-12-15T23:24:39.074 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.074 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.074 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.074 DEBUG:boto:Params: {} 2023-12-15T23:24:39.074 DEBUG:boto:Token: None 2023-12-15T23:24:39.075 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:24:39.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:v1RFU16xXYN5TfvpQLJwf0SBz64= 2023-12-15T23:24:39.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:v1RFU16xXYN5TfvpQLJwf0SBz64=', 'Content-Length': '0'} 2023-12-15T23:24:39.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f10110d535efa5e9-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.077 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.077 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.077 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.077 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.077 DEBUG:boto:Method: GET 2023-12-15T23:24:39.077 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.077 DEBUG:boto:Data: 2023-12-15T23:24:39.078 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.078 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.078 DEBUG:boto:Params: {} 2023-12-15T23:24:39.078 DEBUG:boto:Token: None 2023-12-15T23:24:39.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.078 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096b526c54336abb8-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.081 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.081 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.081 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.081 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.081 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.082 DEBUG:boto:Method: GET 2023-12-15T23:24:39.082 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.082 DEBUG:boto:Data: 2023-12-15T23:24:39.082 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.082 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.082 DEBUG:boto:Params: {} 2023-12-15T23:24:39.082 DEBUG:boto:Token: None 2023-12-15T23:24:39.082 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fb56283dbda651b-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.086 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.086 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.086 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.086 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.086 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:24:39.087 DEBUG:boto:Data: 2023-12-15T23:24:39.087 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.087 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.087 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.087 DEBUG:boto:Params: {} 2023-12-15T23:24:39.087 DEBUG:boto:Token: None 2023-12-15T23:24:39.087 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87 2023-12-15T23:24:39.089 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k2acmPOzEXezWvJnRZFS1wzwHOo= 2023-12-15T23:24:39.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k2acmPOzEXezWvJnRZFS1wzwHOo=', 'Content-Length': '0'} 2023-12-15T23:24:39.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007726ca3ecab675ac-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.091 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.091 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.092 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.092 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:24:39.092 DEBUG:boto:Data: 2023-12-15T23:24:39.092 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.092 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.092 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.092 DEBUG:boto:Params: {} 2023-12-15T23:24:39.092 DEBUG:boto:Token: None 2023-12-15T23:24:39.092 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87 2023-12-15T23:24:39.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k2acmPOzEXezWvJnRZFS1wzwHOo= 2023-12-15T23:24:39.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k2acmPOzEXezWvJnRZFS1wzwHOo=', 'Content-Length': '0'} 2023-12-15T23:24:39.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a771c6b79fa8c8d-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:24:39.095 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.095 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.095 DEBUG:boto:Method: GET 2023-12-15T23:24:39.095 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:24:39.095 DEBUG:boto:Data: 2023-12-15T23:24:39.095 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.095 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.095 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.095 DEBUG:boto:Params: {} 2023-12-15T23:24:39.095 DEBUG:boto:Token: None 2023-12-15T23:24:39.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87 2023-12-15T23:24:39.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:77tpa2UdrAmV4sZVbMUbGXV8RVI= 2023-12-15T23:24:39.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:77tpa2UdrAmV4sZVbMUbGXV8RVI=', 'Content-Length': '0'} 2023-12-15T23:24:39.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba7e33f9fd16c0bf-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.141 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:24:39.142 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:24:39.142 DEBUG:boto:Method: GET 2023-12-15T23:24:39.142 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:24:39.142 DEBUG:boto:Data: 2023-12-15T23:24:39.142 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.142 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.142 DEBUG:boto:Params: {} 2023-12-15T23:24:39.142 DEBUG:boto:Token: None 2023-12-15T23:24:39.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj87 2023-12-15T23:24:39.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:77tpa2UdrAmV4sZVbMUbGXV8RVI= 2023-12-15T23:24:39.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:77tpa2UdrAmV4sZVbMUbGXV8RVI=', 'Content-Length': '0'} 2023-12-15T23:24:39.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049bd1c0a16048b1f-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.145 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.145 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.145 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.145 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.145 DEBUG:boto:Method: GET 2023-12-15T23:24:39.146 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.146 DEBUG:boto:Data: 2023-12-15T23:24:39.146 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.146 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.146 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.146 DEBUG:boto:Params: {} 2023-12-15T23:24:39.146 DEBUG:boto:Token: None 2023-12-15T23:24:39.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000536de70adb00c65a-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.189 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.190 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.190 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.190 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.190 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.190 DEBUG:boto:Method: GET 2023-12-15T23:24:39.190 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:24:39.190 DEBUG:boto:Data: 2023-12-15T23:24:39.190 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.191 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.191 DEBUG:boto:Params: {} 2023-12-15T23:24:39.191 DEBUG:boto:Token: None 2023-12-15T23:24:39.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062d5676bc59d9531-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.194 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:24:39.195 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.195 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.195 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.195 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.195 DEBUG:boto:Method: GET 2023-12-15T23:24:39.195 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.195 DEBUG:boto:Data: 2023-12-15T23:24:39.195 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.195 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.196 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.196 DEBUG:boto:Params: {} 2023-12-15T23:24:39.196 DEBUG:boto:Token: None 2023-12-15T23:24:39.196 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.196 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI= 2023-12-15T23:24:39.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI=', 'Content-Length': '0'} 2023-12-15T23:24:39.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cafa32c1b44f111f-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.198 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.198 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.198 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.199 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.199 DEBUG:boto:Method: GET 2023-12-15T23:24:39.199 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.199 DEBUG:boto:Data: 2023-12-15T23:24:39.199 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.199 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.199 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.199 DEBUG:boto:Params: {} 2023-12-15T23:24:39.199 DEBUG:boto:Token: None 2023-12-15T23:24:39.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI= 2023-12-15T23:24:39.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI=', 'Content-Length': '0'} 2023-12-15T23:24:39.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072903822ea6be0df-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.241 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.242 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.242 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.242 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.242 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.242 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.242 DEBUG:boto:Data: 2023-12-15T23:24:39.242 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.242 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.242 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.242 DEBUG:boto:Params: {} 2023-12-15T23:24:39.242 DEBUG:boto:Token: None 2023-12-15T23:24:39.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.243 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mknM53XpdB8kdKMbcBKim4/nwJ8= 2023-12-15T23:24:39.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mknM53XpdB8kdKMbcBKim4/nwJ8=', 'Content-Length': '0'} 2023-12-15T23:24:39.244 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c4f1f4f4be52a94-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.245 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.245 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.245 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.245 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.245 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.245 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.245 DEBUG:boto:Data: 2023-12-15T23:24:39.245 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.245 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.245 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.246 DEBUG:boto:Params: {} 2023-12-15T23:24:39.246 DEBUG:boto:Token: None 2023-12-15T23:24:39.246 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.246 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mknM53XpdB8kdKMbcBKim4/nwJ8= 2023-12-15T23:24:39.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mknM53XpdB8kdKMbcBKim4/nwJ8=', 'Content-Length': '0'} 2023-12-15T23:24:39.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb5be862d07ef50d-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:24:39.248 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.248 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.248 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.248 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.248 DEBUG:boto:Method: GET 2023-12-15T23:24:39.249 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.249 DEBUG:boto:Data: 2023-12-15T23:24:39.249 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.249 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.249 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.249 DEBUG:boto:Params: {} 2023-12-15T23:24:39.249 DEBUG:boto:Token: None 2023-12-15T23:24:39.249 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.249 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI= 2023-12-15T23:24:39.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI=', 'Content-Length': '0'} 2023-12-15T23:24:39.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2bfef3ae2ea2330-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.293 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.294 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.294 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.294 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.294 DEBUG:boto:Method: GET 2023-12-15T23:24:39.294 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.294 DEBUG:boto:Data: 2023-12-15T23:24:39.294 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.294 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.294 DEBUG:boto:Params: {} 2023-12-15T23:24:39.294 DEBUG:boto:Token: None 2023-12-15T23:24:39.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:24:39.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI= 2023-12-15T23:24:39.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SuTyBWOMcJgWf1VDYjfeUSyX7hI=', 'Content-Length': '0'} 2023-12-15T23:24:39.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff035adc6e7af0f3-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.297 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.297 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.297 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.297 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.297 DEBUG:boto:Method: GET 2023-12-15T23:24:39.297 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.297 DEBUG:boto:Data: 2023-12-15T23:24:39.297 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.297 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.297 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.298 DEBUG:boto:Params: {} 2023-12-15T23:24:39.298 DEBUG:boto:Token: None 2023-12-15T23:24:39.298 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.300 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c6dbe075ff7237a-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.300 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.301 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.301 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.301 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.301 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.301 DEBUG:boto:Method: GET 2023-12-15T23:24:39.301 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.301 DEBUG:boto:Data: 2023-12-15T23:24:39.301 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.301 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.302 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.302 DEBUG:boto:Params: {} 2023-12-15T23:24:39.302 DEBUG:boto:Token: None 2023-12-15T23:24:39.302 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3d6f18879be7735-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.306 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.306 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.306 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.306 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.306 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:24:39.306 DEBUG:boto:Data: 2023-12-15T23:24:39.306 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.306 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.307 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.307 DEBUG:boto:Params: {} 2023-12-15T23:24:39.307 DEBUG:boto:Token: None 2023-12-15T23:24:39.307 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92 2023-12-15T23:24:39.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xUZrQWEN3fK4yXJcSMA8hzwhJfU= 2023-12-15T23:24:39.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xUZrQWEN3fK4yXJcSMA8hzwhJfU=', 'Content-Length': '0'} 2023-12-15T23:24:39.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d80fdb6a91e6c39-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.309 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.309 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.309 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.309 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:24:39.309 DEBUG:boto:Data: 2023-12-15T23:24:39.309 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.310 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.310 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.310 DEBUG:boto:Params: {} 2023-12-15T23:24:39.310 DEBUG:boto:Token: None 2023-12-15T23:24:39.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92 2023-12-15T23:24:39.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xUZrQWEN3fK4yXJcSMA8hzwhJfU= 2023-12-15T23:24:39.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xUZrQWEN3fK4yXJcSMA8hzwhJfU=', 'Content-Length': '0'} 2023-12-15T23:24:39.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dcc1213ca3e3877-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:24:39.312 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.312 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.312 DEBUG:boto:Method: GET 2023-12-15T23:24:39.313 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:24:39.313 DEBUG:boto:Data: 2023-12-15T23:24:39.313 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.313 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.313 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.313 DEBUG:boto:Params: {} 2023-12-15T23:24:39.313 DEBUG:boto:Token: None 2023-12-15T23:24:39.313 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92 2023-12-15T23:24:39.313 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Vyc2nd/ooFKa091RXmUyXDWGxvg= 2023-12-15T23:24:39.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Vyc2nd/ooFKa091RXmUyXDWGxvg=', 'Content-Length': '0'} 2023-12-15T23:24:39.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064814809353d1cef-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.357 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:24:39.358 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:24:39.358 DEBUG:boto:Method: GET 2023-12-15T23:24:39.358 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:24:39.358 DEBUG:boto:Data: 2023-12-15T23:24:39.358 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.358 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.358 DEBUG:boto:Params: {} 2023-12-15T23:24:39.358 DEBUG:boto:Token: None 2023-12-15T23:24:39.358 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj92 2023-12-15T23:24:39.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Vyc2nd/ooFKa091RXmUyXDWGxvg= 2023-12-15T23:24:39.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Vyc2nd/ooFKa091RXmUyXDWGxvg=', 'Content-Length': '0'} 2023-12-15T23:24:39.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000613039744558a376-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.361 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.361 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.361 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.361 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.361 DEBUG:boto:Method: GET 2023-12-15T23:24:39.361 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.361 DEBUG:boto:Data: 2023-12-15T23:24:39.361 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.361 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.362 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.362 DEBUG:boto:Params: {} 2023-12-15T23:24:39.362 DEBUG:boto:Token: None 2023-12-15T23:24:39.362 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.365 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e9a84e80aadd629-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.405 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.406 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.406 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.406 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.406 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.406 DEBUG:boto:Method: GET 2023-12-15T23:24:39.406 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:24:39.406 DEBUG:boto:Data: 2023-12-15T23:24:39.406 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.407 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.407 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.407 DEBUG:boto:Params: {} 2023-12-15T23:24:39.407 DEBUG:boto:Token: None 2023-12-15T23:24:39.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044359386a1fbc4f0-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.411 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:24:39.411 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.411 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.411 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.411 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.411 DEBUG:boto:Method: GET 2023-12-15T23:24:39.412 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.412 DEBUG:boto:Data: 2023-12-15T23:24:39.412 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.412 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.412 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.412 DEBUG:boto:Params: {} 2023-12-15T23:24:39.412 DEBUG:boto:Token: None 2023-12-15T23:24:39.412 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0= 2023-12-15T23:24:39.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0=', 'Content-Length': '0'} 2023-12-15T23:24:39.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf24af95a677a6ad-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.415 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.415 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.415 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.415 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.415 DEBUG:boto:Method: GET 2023-12-15T23:24:39.415 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.415 DEBUG:boto:Data: 2023-12-15T23:24:39.415 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.415 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.416 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.416 DEBUG:boto:Params: {} 2023-12-15T23:24:39.416 DEBUG:boto:Token: None 2023-12-15T23:24:39.416 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.416 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0= 2023-12-15T23:24:39.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0=', 'Content-Length': '0'} 2023-12-15T23:24:39.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b201a5274bffb7b2-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.461 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.462 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.462 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.462 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.462 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.462 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.462 DEBUG:boto:Data: 2023-12-15T23:24:39.462 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.462 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.462 DEBUG:boto:Params: {} 2023-12-15T23:24:39.462 DEBUG:boto:Token: None 2023-12-15T23:24:39.462 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8OD6SutmpOw74ESrOT2FDf6XrrY= 2023-12-15T23:24:39.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8OD6SutmpOw74ESrOT2FDf6XrrY=', 'Content-Length': '0'} 2023-12-15T23:24:39.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b555ec6162f63c1-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.465 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.465 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.465 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.465 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.465 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.465 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.466 DEBUG:boto:Data: 2023-12-15T23:24:39.466 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.466 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.466 DEBUG:boto:Params: {} 2023-12-15T23:24:39.466 DEBUG:boto:Token: None 2023-12-15T23:24:39.466 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8OD6SutmpOw74ESrOT2FDf6XrrY= 2023-12-15T23:24:39.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8OD6SutmpOw74ESrOT2FDf6XrrY=', 'Content-Length': '0'} 2023-12-15T23:24:39.468 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da9f5ebb3f8ec570-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:24:39.468 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.469 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.469 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.469 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.469 DEBUG:boto:Method: GET 2023-12-15T23:24:39.469 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.469 DEBUG:boto:Data: 2023-12-15T23:24:39.469 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.469 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.469 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.469 DEBUG:boto:Params: {} 2023-12-15T23:24:39.469 DEBUG:boto:Token: None 2023-12-15T23:24:39.470 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0= 2023-12-15T23:24:39.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0=', 'Content-Length': '0'} 2023-12-15T23:24:39.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029ecbec1c40cd6bb-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.513 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.514 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.514 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.514 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.514 DEBUG:boto:Method: GET 2023-12-15T23:24:39.514 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.514 DEBUG:boto:Data: 2023-12-15T23:24:39.514 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.514 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.514 DEBUG:boto:Params: {} 2023-12-15T23:24:39.514 DEBUG:boto:Token: None 2023-12-15T23:24:39.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:24:39.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0= 2023-12-15T23:24:39.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bNanrCp5n9FbFY006gE++GX20U0=', 'Content-Length': '0'} 2023-12-15T23:24:39.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cea9dcd8a920048d-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.517 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.517 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.517 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.517 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.518 DEBUG:boto:Method: GET 2023-12-15T23:24:39.518 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.518 DEBUG:boto:Data: 2023-12-15T23:24:39.518 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.518 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.518 DEBUG:boto:Params: {} 2023-12-15T23:24:39.518 DEBUG:boto:Token: None 2023-12-15T23:24:39.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040345f495be72e8d-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.521 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.521 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.521 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.521 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.521 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.522 DEBUG:boto:Method: GET 2023-12-15T23:24:39.522 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.522 DEBUG:boto:Data: 2023-12-15T23:24:39.522 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.522 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.522 DEBUG:boto:Params: {} 2023-12-15T23:24:39.522 DEBUG:boto:Token: None 2023-12-15T23:24:39.522 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe61a2387e3fa4e5-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.526 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.526 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.526 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.526 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.526 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:24:39.527 DEBUG:boto:Data: 2023-12-15T23:24:39.527 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.527 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.527 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.527 DEBUG:boto:Params: {} 2023-12-15T23:24:39.527 DEBUG:boto:Token: None 2023-12-15T23:24:39.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93 2023-12-15T23:24:39.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+zng/krBFmO6kDZFDO544sUOt5M= 2023-12-15T23:24:39.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+zng/krBFmO6kDZFDO544sUOt5M=', 'Content-Length': '0'} 2023-12-15T23:24:39.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c80ab9f9506e853-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.530 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.530 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.530 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.530 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:24:39.530 DEBUG:boto:Data: 2023-12-15T23:24:39.530 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.530 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.531 DEBUG:boto:Params: {} 2023-12-15T23:24:39.531 DEBUG:boto:Token: None 2023-12-15T23:24:39.531 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93 2023-12-15T23:24:39.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+zng/krBFmO6kDZFDO544sUOt5M= 2023-12-15T23:24:39.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+zng/krBFmO6kDZFDO544sUOt5M=', 'Content-Length': '0'} 2023-12-15T23:24:39.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9dd5faa81f5b937-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:24:39.533 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.533 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.533 DEBUG:boto:Method: GET 2023-12-15T23:24:39.533 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:24:39.533 DEBUG:boto:Data: 2023-12-15T23:24:39.533 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.534 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.534 DEBUG:boto:Params: {} 2023-12-15T23:24:39.534 DEBUG:boto:Token: None 2023-12-15T23:24:39.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93 2023-12-15T23:24:39.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dGoITajUnOYxpBClbUmqnaNBrH8= 2023-12-15T23:24:39.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dGoITajUnOYxpBClbUmqnaNBrH8=', 'Content-Length': '0'} 2023-12-15T23:24:39.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f30d6ace1f8c14fd-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.577 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:24:39.577 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:24:39.578 DEBUG:boto:Method: GET 2023-12-15T23:24:39.578 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:24:39.578 DEBUG:boto:Data: 2023-12-15T23:24:39.578 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.578 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.578 DEBUG:boto:Params: {} 2023-12-15T23:24:39.578 DEBUG:boto:Token: None 2023-12-15T23:24:39.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj93 2023-12-15T23:24:39.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dGoITajUnOYxpBClbUmqnaNBrH8= 2023-12-15T23:24:39.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dGoITajUnOYxpBClbUmqnaNBrH8=', 'Content-Length': '0'} 2023-12-15T23:24:39.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cc0ea6027b390f3-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.581 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.581 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.581 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.581 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.581 DEBUG:boto:Method: GET 2023-12-15T23:24:39.581 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.581 DEBUG:boto:Data: 2023-12-15T23:24:39.581 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.581 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.581 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.581 DEBUG:boto:Params: {} 2023-12-15T23:24:39.582 DEBUG:boto:Token: None 2023-12-15T23:24:39.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffe462c05690e5c2-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.584 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.584 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.584 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.585 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.585 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.585 DEBUG:boto:Method: GET 2023-12-15T23:24:39.585 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:24:39.585 DEBUG:boto:Data: 2023-12-15T23:24:39.585 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.585 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.585 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.585 DEBUG:boto:Params: {} 2023-12-15T23:24:39.585 DEBUG:boto:Token: None 2023-12-15T23:24:39.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1359f8d8a29408b-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.589 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:24:39.589 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.589 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.589 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.590 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.590 DEBUG:boto:Method: GET 2023-12-15T23:24:39.590 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.590 DEBUG:boto:Data: 2023-12-15T23:24:39.590 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.590 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.590 DEBUG:boto:Params: {} 2023-12-15T23:24:39.590 DEBUG:boto:Token: None 2023-12-15T23:24:39.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI= 2023-12-15T23:24:39.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI=', 'Content-Length': '0'} 2023-12-15T23:24:39.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000170f870c9c98c86a-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.593 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.593 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.593 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.593 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.593 DEBUG:boto:Method: GET 2023-12-15T23:24:39.593 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.593 DEBUG:boto:Data: 2023-12-15T23:24:39.594 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.594 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.594 DEBUG:boto:Params: {} 2023-12-15T23:24:39.594 DEBUG:boto:Token: None 2023-12-15T23:24:39.594 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI= 2023-12-15T23:24:39.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI=', 'Content-Length': '0'} 2023-12-15T23:24:39.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f136351e7701a6a-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.596 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.597 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.597 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.597 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.597 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.597 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.597 DEBUG:boto:Data: 2023-12-15T23:24:39.597 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.597 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.597 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.597 DEBUG:boto:Params: {} 2023-12-15T23:24:39.597 DEBUG:boto:Token: None 2023-12-15T23:24:39.598 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gfyQrgDMb2+Pj3+dPGAgQ4/0ZrE= 2023-12-15T23:24:39.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gfyQrgDMb2+Pj3+dPGAgQ4/0ZrE=', 'Content-Length': '0'} 2023-12-15T23:24:39.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e40c6494435586-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.600 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.600 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.600 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.600 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.600 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.600 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.600 DEBUG:boto:Data: 2023-12-15T23:24:39.600 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.601 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.601 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.601 DEBUG:boto:Params: {} 2023-12-15T23:24:39.601 DEBUG:boto:Token: None 2023-12-15T23:24:39.601 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gfyQrgDMb2+Pj3+dPGAgQ4/0ZrE= 2023-12-15T23:24:39.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gfyQrgDMb2+Pj3+dPGAgQ4/0ZrE=', 'Content-Length': '0'} 2023-12-15T23:24:39.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecbe20e4b9ce3485-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:24:39.603 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.603 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.603 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.604 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.604 DEBUG:boto:Method: GET 2023-12-15T23:24:39.604 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.604 DEBUG:boto:Data: 2023-12-15T23:24:39.604 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.604 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.604 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.604 DEBUG:boto:Params: {} 2023-12-15T23:24:39.604 DEBUG:boto:Token: None 2023-12-15T23:24:39.604 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI= 2023-12-15T23:24:39.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI=', 'Content-Length': '0'} 2023-12-15T23:24:39.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f533d3c6665d9887-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.649 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.650 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.650 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.650 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.650 DEBUG:boto:Method: GET 2023-12-15T23:24:39.650 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.650 DEBUG:boto:Data: 2023-12-15T23:24:39.650 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.650 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.650 DEBUG:boto:Params: {} 2023-12-15T23:24:39.650 DEBUG:boto:Token: None 2023-12-15T23:24:39.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:24:39.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI= 2023-12-15T23:24:39.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Pvtymi1mKRstI9/oxsw29ThXMEI=', 'Content-Length': '0'} 2023-12-15T23:24:39.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004763775b88d5a2c5-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.653 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.653 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.653 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.653 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.653 DEBUG:boto:Method: GET 2023-12-15T23:24:39.653 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.653 DEBUG:boto:Data: 2023-12-15T23:24:39.653 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.653 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.654 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.654 DEBUG:boto:Params: {} 2023-12-15T23:24:39.654 DEBUG:boto:Token: None 2023-12-15T23:24:39.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d12063040610b66-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.657 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.657 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.657 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.657 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.657 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.657 DEBUG:boto:Method: GET 2023-12-15T23:24:39.657 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.657 DEBUG:boto:Data: 2023-12-15T23:24:39.658 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.658 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.658 DEBUG:boto:Params: {} 2023-12-15T23:24:39.658 DEBUG:boto:Token: None 2023-12-15T23:24:39.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002867b44dbf3e73a4-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.662 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.662 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.662 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.662 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.662 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:24:39.662 DEBUG:boto:Data: 2023-12-15T23:24:39.662 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.663 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.663 DEBUG:boto:Params: {} 2023-12-15T23:24:39.663 DEBUG:boto:Token: None 2023-12-15T23:24:39.663 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95 2023-12-15T23:24:39.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wnvf/uwpWA77A0IzFvJXrIqgBCg= 2023-12-15T23:24:39.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wnvf/uwpWA77A0IzFvJXrIqgBCg=', 'Content-Length': '0'} 2023-12-15T23:24:39.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000317c695577dde945-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.665 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.665 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.666 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.666 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:24:39.666 DEBUG:boto:Data: 2023-12-15T23:24:39.666 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.666 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.666 DEBUG:boto:Params: {} 2023-12-15T23:24:39.666 DEBUG:boto:Token: None 2023-12-15T23:24:39.666 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95 2023-12-15T23:24:39.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Wnvf/uwpWA77A0IzFvJXrIqgBCg= 2023-12-15T23:24:39.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Wnvf/uwpWA77A0IzFvJXrIqgBCg=', 'Content-Length': '0'} 2023-12-15T23:24:39.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf11e98b05b30811-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:24:39.668 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.669 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.669 DEBUG:boto:Method: GET 2023-12-15T23:24:39.669 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:24:39.669 DEBUG:boto:Data: 2023-12-15T23:24:39.669 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.669 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.669 DEBUG:boto:Params: {} 2023-12-15T23:24:39.669 DEBUG:boto:Token: None 2023-12-15T23:24:39.669 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95 2023-12-15T23:24:39.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pb/LJ5vIFIqR8SoCgsOFg9q69Kg= 2023-12-15T23:24:39.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pb/LJ5vIFIqR8SoCgsOFg9q69Kg=', 'Content-Length': '0'} 2023-12-15T23:24:39.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007de801f61e137e25-00657ce037-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.713 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:24:39.714 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:24:39.714 DEBUG:boto:Method: GET 2023-12-15T23:24:39.714 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:24:39.714 DEBUG:boto:Data: 2023-12-15T23:24:39.714 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.714 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.714 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.714 DEBUG:boto:Params: {} 2023-12-15T23:24:39.714 DEBUG:boto:Token: None 2023-12-15T23:24:39.715 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj95 2023-12-15T23:24:39.715 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pb/LJ5vIFIqR8SoCgsOFg9q69Kg= 2023-12-15T23:24:39.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pb/LJ5vIFIqR8SoCgsOFg9q69Kg=', 'Content-Length': '0'} 2023-12-15T23:24:39.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d35b2f6541a00d20-00657ce037-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.717 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.717 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.717 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.717 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.717 DEBUG:boto:Method: GET 2023-12-15T23:24:39.717 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.717 DEBUG:boto:Data: 2023-12-15T23:24:39.718 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.718 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:24:39.718 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.718 DEBUG:boto:Params: {} 2023-12-15T23:24:39.718 DEBUG:boto:Token: None 2023-12-15T23:24:39.718 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.720 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aeb56e5a57ecf60e-00657ce037-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.761 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.762 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.762 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.762 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.762 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.762 DEBUG:boto:Method: GET 2023-12-15T23:24:39.762 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:24:39.762 DEBUG:boto:Data: 2023-12-15T23:24:39.762 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.763 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.763 DEBUG:boto:Params: {} 2023-12-15T23:24:39.763 DEBUG:boto:Token: None 2023-12-15T23:24:39.763 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw= 2023-12-15T23:24:39.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dxKrNRqiBcjw2O7l4ssOBtVYDfw=', 'Content-Length': '0'} 2023-12-15T23:24:39.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073fcc978e22ce731-00657ce037-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.766 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:24:39.767 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:24:39.767 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:24:39.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:24:39.767 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:24:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:24:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:24:39.877 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:24:39.877 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-49 2023-12-15T23:24:39.892 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 30 2023-12-15T23:24:39.969 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.969 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.969 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.969 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:39.969 DEBUG:boto:Data: 2023-12-15T23:24:39.969 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.969 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.969 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.969 DEBUG:boto:Params: {} 2023-12-15T23:24:39.969 DEBUG:boto:Token: None 2023-12-15T23:24:39.970 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o= 2023-12-15T23:24:39.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o=', 'Content-Length': '0'} 2023-12-15T23:24:39.973 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001aea132c8f79ad9e-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.973 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:24:39.973 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:24:39.973 DEBUG:boto:Method: PUT 2023-12-15T23:24:39.973 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:24:39.973 DEBUG:boto:Data: 2023-12-15T23:24:39.973 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:24:39.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.974 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.974 DEBUG:boto:Params: {} 2023-12-15T23:24:39.974 DEBUG:boto:Token: None 2023-12-15T23:24:39.974 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj37 2023-12-15T23:24:39.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eXiLmFVzX04EoFZbydlRkojxtOI= 2023-12-15T23:24:39.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eXiLmFVzX04EoFZbydlRkojxtOI='} 2023-12-15T23:24:39.979 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000014085dd6927039b3-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.979 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.979 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.980 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.980 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:39.980 DEBUG:boto:Data: 2023-12-15T23:24:39.980 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.980 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.980 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.980 DEBUG:boto:Params: {} 2023-12-15T23:24:39.980 DEBUG:boto:Token: None 2023-12-15T23:24:39.980 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.980 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o= 2023-12-15T23:24:39.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o=', 'Content-Length': '0'} 2023-12-15T23:24:39.983 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f5bc9c9c8cb76ad-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.984 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:24:39.984 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:24:39.984 DEBUG:boto:Method: PUT 2023-12-15T23:24:39.984 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:24:39.984 DEBUG:boto:Data: 2023-12-15T23:24:39.984 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:24:39.984 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.984 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.984 DEBUG:boto:Params: {} 2023-12-15T23:24:39.985 DEBUG:boto:Token: None 2023-12-15T23:24:39.985 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj74 2023-12-15T23:24:39.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lf4GCl2rMrYpYJYxYZUjP5Hs4eo= 2023-12-15T23:24:39.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lf4GCl2rMrYpYJYxYZUjP5Hs4eo='} 2023-12-15T23:24:39.990 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f52cee34dd096d1-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.990 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:39.990 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:39.990 DEBUG:boto:Method: HEAD 2023-12-15T23:24:39.990 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:39.990 DEBUG:boto:Data: 2023-12-15T23:24:39.991 DEBUG:boto:Headers: {} 2023-12-15T23:24:39.991 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.991 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.991 DEBUG:boto:Params: {} 2023-12-15T23:24:39.991 DEBUG:boto:Token: None 2023-12-15T23:24:39.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/ 2023-12-15T23:24:39.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o= 2023-12-15T23:24:39.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1OggQbWPJJauL14ZZE9oLBel98o=', 'Content-Length': '0'} 2023-12-15T23:24:39.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000011a2c841e587fcd1-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:39.994 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:24:39.994 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:24:39.994 DEBUG:boto:Method: PUT 2023-12-15T23:24:39.994 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:24:39.994 DEBUG:boto:Data: 2023-12-15T23:24:39.994 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:24:39.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:39.995 DEBUG:boto:Port: 8000 2023-12-15T23:24:39.995 DEBUG:boto:Params: {} 2023-12-15T23:24:39.995 DEBUG:boto:Token: None 2023-12-15T23:24:39.995 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:24:39 GMT /kskgfn-49/obj111 2023-12-15T23:24:39.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rBfuzKLkpW5M00JZPszwlIfs27w= 2023-12-15T23:24:39.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:24:39 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rBfuzKLkpW5M00JZPszwlIfs27w='} 2023-12-15T23:24:40.038 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e594a9ff6ffd307-00657ce037-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:40.038 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:40.038 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:40.038 DEBUG:boto:Method: HEAD 2023-12-15T23:24:40.038 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:40.038 DEBUG:boto:Data: 2023-12-15T23:24:40.038 DEBUG:boto:Headers: {} 2023-12-15T23:24:40.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:40.038 DEBUG:boto:Port: 8000 2023-12-15T23:24:40.038 DEBUG:boto:Params: {} 2023-12-15T23:24:40.039 DEBUG:boto:Token: None 2023-12-15T23:24:40.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:40 GMT /kskgfn-49/ 2023-12-15T23:24:40.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jC0KwGK2mtOo9w5VKaOvkCcVY6w= 2023-12-15T23:24:40.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jC0KwGK2mtOo9w5VKaOvkCcVY6w=', 'Content-Length': '0'} 2023-12-15T23:24:40.041 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c9fffaba6154abb-00657ce038-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:40.042 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:24:40.042 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:24:40.042 DEBUG:boto:Method: PUT 2023-12-15T23:24:40.042 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:24:40.042 DEBUG:boto:Data: 2023-12-15T23:24:40.042 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:24:40.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:40.042 DEBUG:boto:Port: 8000 2023-12-15T23:24:40.043 DEBUG:boto:Params: {} 2023-12-15T23:24:40.043 DEBUG:boto:Token: None 2023-12-15T23:24:40.043 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:24:40 GMT /kskgfn-49/obj148 2023-12-15T23:24:40.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:72EArPnO7EAAjR9oRdQhmRBLCkg= 2023-12-15T23:24:40.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:24:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:72EArPnO7EAAjR9oRdQhmRBLCkg='} 2023-12-15T23:24:40.048 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008bba0e1f99048e78-00657ce038-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:40.048 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:24:40.048 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:24:40.048 DEBUG:boto:Method: HEAD 2023-12-15T23:24:40.049 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:24:40.049 DEBUG:boto:Data: 2023-12-15T23:24:40.049 DEBUG:boto:Headers: {} 2023-12-15T23:24:40.049 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:40.049 DEBUG:boto:Port: 8000 2023-12-15T23:24:40.049 DEBUG:boto:Params: {} 2023-12-15T23:24:40.049 DEBUG:boto:Token: None 2023-12-15T23:24:40.049 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:24:40 GMT /kskgfn-49/ 2023-12-15T23:24:40.049 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jC0KwGK2mtOo9w5VKaOvkCcVY6w= 2023-12-15T23:24:40.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:24:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jC0KwGK2mtOo9w5VKaOvkCcVY6w=', 'Content-Length': '0'} 2023-12-15T23:24:40.052 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000949ef606cddb1703-00657ce038-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:40.052 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:24:40.053 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:24:40.053 DEBUG:boto:Method: PUT 2023-12-15T23:24:40.053 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:24:40.053 DEBUG:boto:Data: 2023-12-15T23:24:40.053 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:24:40.053 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:24:40.053 DEBUG:boto:Port: 8000 2023-12-15T23:24:40.053 DEBUG:boto:Params: {} 2023-12-15T23:24:40.053 DEBUG:boto:Token: None 2023-12-15T23:24:40.054 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:24:40 GMT /kskgfn-49/obj185 2023-12-15T23:24:40.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6uFhTVhaMfOqmBxB3EfeqpwG/WU= 2023-12-15T23:24:40.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:24:40 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6uFhTVhaMfOqmBxB3EfeqpwG/WU='} 2023-12-15T23:24:40.097 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b92e2aac27316680-00657ce038-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:24:40.098 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:24:40.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:24:40.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:24:40.098 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:24:40.159 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:24:40.159 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:24:40.197 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:40.196+0000 7f28aad3e800 1 waiting to reach latest gen 6, on 5.. 2023-12-15T23:24:45.200 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:45.199+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:45.201 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2023-12-15T23:24:45.201 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:24:50.203 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:50.201+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:50.203 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:24:50.203 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:24:55.205 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:24:55.203+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:24:55.206 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:24:55.206 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:00.208 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:00.206+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:00.208 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:00.208 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:05.210 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:05.208+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:05.210 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:05.210 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:10.212 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:10.211+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:10.213 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:10.213 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:15.215 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:15.213+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:15.215 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:15.215 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:20.217 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:20.214+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:20.217 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:20.217 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:25.220 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:25.217+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:25.220 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:25.220 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:30.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:30.221+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:30.223 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:30.223 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:35.225 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:35.223+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:35.225 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:35.225 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:40.227 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:40.225+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:40.227 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:40.227 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:45.229 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:45.227+0000 7f28aad3e800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:45.230 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:45.230 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:50.231 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:50.229+0000 7f28aad3e800 1 bucket sync caught up with source: 2023-12-15T23:25:50.231 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:50.232 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:25:50.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:25:50.229+0000 7f28aad3e800 0 bucket checkpoint complete 2023-12-15T23:25:50.251 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:25:50.251 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:25:50.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:25:50.252 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:25:50.313 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:25:50.313 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:25:50.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:25:50.354+0000 7f8499b20800 1 waiting for incremental sync to catch up: 2023-12-15T23:25:50.356 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000005.162.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000004.105.6, 00000000007.121.6, 00000000005.115.6] 2023-12-15T23:25:50.356 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000005.162.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000004.105.6, 00000000007.121.6, 00000000006.117.6] 2023-12-15T23:25:55.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:25:55.355+0000 7f8499b20800 1 bucket sync caught up with source: 2023-12-15T23:25:55.358 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000005.162.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000004.105.6, 00000000007.121.6, 00000000006.117.6] 2023-12-15T23:25:55.358 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000003.154.6, 00000000002.140.6, 00000000002.93.6, 00000000005.162.6, 00000000004.164.6, 00000000001.62.6, 00000000001.144.6, 00000000004.105.6, 00000000007.121.6, 00000000006.117.6] 2023-12-15T23:25:55.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:25:55.355+0000 7f8499b20800 0 bucket checkpoint complete 2023-12-15T23:25:55.376 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:25:55.377 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.377 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.377 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.377 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:25:55.377 DEBUG:boto:Data: 2023-12-15T23:25:55.377 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.377 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.377 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.377 DEBUG:boto:Params: {} 2023-12-15T23:25:55.378 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:25:55.378 DEBUG:boto:Token: None 2023-12-15T23:25:55.378 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vqUFkpdqiiplArL6CRx8ajn9vt4= 2023-12-15T23:25:55.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vqUFkpdqiiplArL6CRx8ajn9vt4=', 'Content-Length': '0'} 2023-12-15T23:25:55.384 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000300fa298e4b9ffd2-00657ce083-5221-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.384 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.384 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.384 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.385 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:25:55.385 DEBUG:boto:Data: 2023-12-15T23:25:55.385 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.385 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.385 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.385 DEBUG:boto:Params: {} 2023-12-15T23:25:55.385 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:25:55.385 DEBUG:boto:Token: None 2023-12-15T23:25:55.385 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vqUFkpdqiiplArL6CRx8ajn9vt4= 2023-12-15T23:25:55.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vqUFkpdqiiplArL6CRx8ajn9vt4=', 'Content-Length': '0'} 2023-12-15T23:25:55.391 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000064607d11e3e5cac2-00657ce083-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.391 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:25:55.391 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.391 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.391 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.391 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.391 DEBUG:boto:Method: GET 2023-12-15T23:25:55.391 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.391 DEBUG:boto:Data: 2023-12-15T23:25:55.392 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.392 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.392 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.392 DEBUG:boto:Params: {} 2023-12-15T23:25:55.392 DEBUG:boto:Token: None 2023-12-15T23:25:55.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/?versions 2023-12-15T23:25:55.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw= 2023-12-15T23:25:55.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw=', 'Content-Length': '0'} 2023-12-15T23:25:55.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026205b739427344a-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.395 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:25:55.398 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:25:55.399 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:25:55.400 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:25:55.401 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:25:55.401 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:25:55.401 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.401 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.401 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.401 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.401 DEBUG:boto:Method: GET 2023-12-15T23:25:55.401 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.401 DEBUG:boto:Data: 2023-12-15T23:25:55.401 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.402 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.402 DEBUG:boto:Params: {} 2023-12-15T23:25:55.402 DEBUG:boto:Token: None 2023-12-15T23:25:55.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/?versions 2023-12-15T23:25:55.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw= 2023-12-15T23:25:55.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw=', 'Content-Length': '0'} 2023-12-15T23:25:55.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d504721459ace26a-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.406 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:25:55.408 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:25:55.409 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:25:55.410 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:25:55.410 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.410 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.411 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.411 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.411 DEBUG:boto:Method: GET 2023-12-15T23:25:55.411 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.411 DEBUG:boto:Data: 2023-12-15T23:25:55.411 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.411 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.411 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.411 DEBUG:boto:Params: {} 2023-12-15T23:25:55.411 DEBUG:boto:Token: None 2023-12-15T23:25:55.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/?versions 2023-12-15T23:25:55.412 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw= 2023-12-15T23:25:55.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw=', 'Content-Length': '0'} 2023-12-15T23:25:55.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef56b6bc0e96cdfa-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.415 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.416 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.416 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.416 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.417 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.417 DEBUG:boto:Method: GET 2023-12-15T23:25:55.417 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:25:55.417 DEBUG:boto:Data: 2023-12-15T23:25:55.417 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.417 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.417 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.417 DEBUG:boto:Params: {} 2023-12-15T23:25:55.417 DEBUG:boto:Token: None 2023-12-15T23:25:55.417 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/?versions 2023-12-15T23:25:55.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw= 2023-12-15T23:25:55.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARbPV3Ag9gzn/wmtTguxcvf+Nw=', 'Content-Length': '0'} 2023-12-15T23:25:55.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4d6d1f8b38eea41-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.421 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:25:55.423 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.423 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.423 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.423 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.424 DEBUG:boto:Method: GET 2023-12-15T23:25:55.424 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.424 DEBUG:boto:Data: 2023-12-15T23:25:55.424 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.424 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.424 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.424 DEBUG:boto:Params: {} 2023-12-15T23:25:55.424 DEBUG:boto:Token: None 2023-12-15T23:25:55.424 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.424 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4= 2023-12-15T23:25:55.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4=', 'Content-Length': '0'} 2023-12-15T23:25:55.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d517bfa8bff44ceb-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.427 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.427 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.427 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.427 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.427 DEBUG:boto:Method: GET 2023-12-15T23:25:55.427 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.428 DEBUG:boto:Data: 2023-12-15T23:25:55.428 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.428 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.428 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.428 DEBUG:boto:Params: {} 2023-12-15T23:25:55.428 DEBUG:boto:Token: None 2023-12-15T23:25:55.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4= 2023-12-15T23:25:55.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4=', 'Content-Length': '0'} 2023-12-15T23:25:55.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b40b27b9c0979dc-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.473 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.474 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.474 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.474 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.474 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.474 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.474 DEBUG:boto:Data: 2023-12-15T23:25:55.474 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.474 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.474 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.474 DEBUG:boto:Params: {} 2023-12-15T23:25:55.474 DEBUG:boto:Token: None 2023-12-15T23:25:55.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wTHCgnNVMLQ5hkl9ldERjOcaj5g= 2023-12-15T23:25:55.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wTHCgnNVMLQ5hkl9ldERjOcaj5g=', 'Content-Length': '0'} 2023-12-15T23:25:55.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c98f93c5bc2226d3-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.477 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.477 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.477 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.477 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.477 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.477 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.478 DEBUG:boto:Data: 2023-12-15T23:25:55.478 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.478 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.478 DEBUG:boto:Params: {} 2023-12-15T23:25:55.478 DEBUG:boto:Token: None 2023-12-15T23:25:55.478 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wTHCgnNVMLQ5hkl9ldERjOcaj5g= 2023-12-15T23:25:55.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wTHCgnNVMLQ5hkl9ldERjOcaj5g=', 'Content-Length': '0'} 2023-12-15T23:25:55.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d671a36a237be717-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:25:55.480 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.481 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.481 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.481 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.481 DEBUG:boto:Method: GET 2023-12-15T23:25:55.481 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.481 DEBUG:boto:Data: 2023-12-15T23:25:55.481 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.481 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.481 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.481 DEBUG:boto:Params: {} 2023-12-15T23:25:55.481 DEBUG:boto:Token: None 2023-12-15T23:25:55.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4= 2023-12-15T23:25:55.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4=', 'Content-Length': '0'} 2023-12-15T23:25:55.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e712a82f5781636-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.525 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.526 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.526 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.526 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.526 DEBUG:boto:Method: GET 2023-12-15T23:25:55.526 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.526 DEBUG:boto:Data: 2023-12-15T23:25:55.526 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.526 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.526 DEBUG:boto:Params: {} 2023-12-15T23:25:55.527 DEBUG:boto:Token: None 2023-12-15T23:25:55.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:25:55.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4= 2023-12-15T23:25:55.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CwA1wvUXHMDrB/sYjMPZ6UK+BL4=', 'Content-Length': '0'} 2023-12-15T23:25:55.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ccaab76a86fd8a-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.529 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.529 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.530 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.530 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.530 DEBUG:boto:Method: GET 2023-12-15T23:25:55.530 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.530 DEBUG:boto:Data: 2023-12-15T23:25:55.530 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.530 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.530 DEBUG:boto:Params: {} 2023-12-15T23:25:55.530 DEBUG:boto:Token: None 2023-12-15T23:25:55.530 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.533 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d01a97bbc358764b-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.533 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.534 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.534 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.534 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.534 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.534 DEBUG:boto:Method: GET 2023-12-15T23:25:55.534 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.534 DEBUG:boto:Data: 2023-12-15T23:25:55.534 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.534 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.535 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.535 DEBUG:boto:Params: {} 2023-12-15T23:25:55.535 DEBUG:boto:Token: None 2023-12-15T23:25:55.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000767503399e7b1cde-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.538 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.539 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.539 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.539 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.539 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:25:55.539 DEBUG:boto:Data: 2023-12-15T23:25:55.539 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.539 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.540 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.540 DEBUG:boto:Params: {} 2023-12-15T23:25:55.540 DEBUG:boto:Token: None 2023-12-15T23:25:55.540 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11 2023-12-15T23:25:55.540 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BthlgyDhh3fWnxtNhb6iqlAtAhs= 2023-12-15T23:25:55.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BthlgyDhh3fWnxtNhb6iqlAtAhs=', 'Content-Length': '0'} 2023-12-15T23:25:55.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000464aba568ef56f33-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.542 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.543 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.543 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.543 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:25:55.543 DEBUG:boto:Data: 2023-12-15T23:25:55.543 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.543 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.543 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.543 DEBUG:boto:Params: {} 2023-12-15T23:25:55.543 DEBUG:boto:Token: None 2023-12-15T23:25:55.543 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11 2023-12-15T23:25:55.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BthlgyDhh3fWnxtNhb6iqlAtAhs= 2023-12-15T23:25:55.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BthlgyDhh3fWnxtNhb6iqlAtAhs=', 'Content-Length': '0'} 2023-12-15T23:25:55.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e65b5d7dd743fd32-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:25:55.546 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.546 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.546 DEBUG:boto:Method: GET 2023-12-15T23:25:55.546 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:25:55.546 DEBUG:boto:Data: 2023-12-15T23:25:55.547 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.547 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.547 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.547 DEBUG:boto:Params: {} 2023-12-15T23:25:55.547 DEBUG:boto:Token: None 2023-12-15T23:25:55.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11 2023-12-15T23:25:55.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kavash/TTfn/jUexRmXy42x1MnY= 2023-12-15T23:25:55.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kavash/TTfn/jUexRmXy42x1MnY=', 'Content-Length': '0'} 2023-12-15T23:25:55.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096755ee00d7c729f-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.589 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:25:55.589 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:25:55.590 DEBUG:boto:Method: GET 2023-12-15T23:25:55.590 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:25:55.590 DEBUG:boto:Data: 2023-12-15T23:25:55.590 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.590 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.590 DEBUG:boto:Params: {} 2023-12-15T23:25:55.590 DEBUG:boto:Token: None 2023-12-15T23:25:55.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj11 2023-12-15T23:25:55.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Kavash/TTfn/jUexRmXy42x1MnY= 2023-12-15T23:25:55.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Kavash/TTfn/jUexRmXy42x1MnY=', 'Content-Length': '0'} 2023-12-15T23:25:55.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008938fc45d392d4e2-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.593 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.593 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.593 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.593 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.593 DEBUG:boto:Method: GET 2023-12-15T23:25:55.593 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.593 DEBUG:boto:Data: 2023-12-15T23:25:55.594 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.594 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.594 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.594 DEBUG:boto:Params: {} 2023-12-15T23:25:55.594 DEBUG:boto:Token: None 2023-12-15T23:25:55.594 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.596 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013ac7c027351760d-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.596 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.597 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.597 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.597 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.597 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.597 DEBUG:boto:Method: GET 2023-12-15T23:25:55.597 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:25:55.598 DEBUG:boto:Data: 2023-12-15T23:25:55.598 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.598 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.598 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.598 DEBUG:boto:Params: {} 2023-12-15T23:25:55.598 DEBUG:boto:Token: None 2023-12-15T23:25:55.598 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b53f233bb34aaa72-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.602 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:25:55.603 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.603 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.603 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.603 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.603 DEBUG:boto:Method: GET 2023-12-15T23:25:55.603 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.603 DEBUG:boto:Data: 2023-12-15T23:25:55.603 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.603 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.603 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.603 DEBUG:boto:Params: {} 2023-12-15T23:25:55.604 DEBUG:boto:Token: None 2023-12-15T23:25:55.604 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps= 2023-12-15T23:25:55.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps=', 'Content-Length': '0'} 2023-12-15T23:25:55.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a76f84faf74b9a7d-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.606 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.606 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.606 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.606 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.606 DEBUG:boto:Method: GET 2023-12-15T23:25:55.607 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.607 DEBUG:boto:Data: 2023-12-15T23:25:55.607 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.607 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.607 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.607 DEBUG:boto:Params: {} 2023-12-15T23:25:55.607 DEBUG:boto:Token: None 2023-12-15T23:25:55.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps= 2023-12-15T23:25:55.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps=', 'Content-Length': '0'} 2023-12-15T23:25:55.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2ccef6f8dc70fea-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.649 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.650 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.650 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.650 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.650 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.650 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.650 DEBUG:boto:Data: 2023-12-15T23:25:55.650 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.650 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.650 DEBUG:boto:Params: {} 2023-12-15T23:25:55.650 DEBUG:boto:Token: None 2023-12-15T23:25:55.651 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7o8u3BV4iXV8x12XTg5HfQ8Fqc= 2023-12-15T23:25:55.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7o8u3BV4iXV8x12XTg5HfQ8Fqc=', 'Content-Length': '0'} 2023-12-15T23:25:55.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003483fee639985b4b-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.653 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.653 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.653 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.653 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.653 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.653 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.653 DEBUG:boto:Data: 2023-12-15T23:25:55.653 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.654 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.654 DEBUG:boto:Params: {} 2023-12-15T23:25:55.654 DEBUG:boto:Token: None 2023-12-15T23:25:55.654 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i7o8u3BV4iXV8x12XTg5HfQ8Fqc= 2023-12-15T23:25:55.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i7o8u3BV4iXV8x12XTg5HfQ8Fqc=', 'Content-Length': '0'} 2023-12-15T23:25:55.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3664ecad5e7bef3-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:25:55.656 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.657 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.657 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.657 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.657 DEBUG:boto:Method: GET 2023-12-15T23:25:55.657 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.657 DEBUG:boto:Data: 2023-12-15T23:25:55.657 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.657 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.657 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.657 DEBUG:boto:Params: {} 2023-12-15T23:25:55.657 DEBUG:boto:Token: None 2023-12-15T23:25:55.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps= 2023-12-15T23:25:55.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps=', 'Content-Length': '0'} 2023-12-15T23:25:55.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfee5ca6345371d0-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.701 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.702 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.702 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.702 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.702 DEBUG:boto:Method: GET 2023-12-15T23:25:55.702 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.702 DEBUG:boto:Data: 2023-12-15T23:25:55.702 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.702 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.702 DEBUG:boto:Params: {} 2023-12-15T23:25:55.702 DEBUG:boto:Token: None 2023-12-15T23:25:55.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:25:55.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps= 2023-12-15T23:25:55.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1mVeapyznWN4VIHnVN2bpahxxps=', 'Content-Length': '0'} 2023-12-15T23:25:55.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b17d15084fee3134-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.705 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.705 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.706 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.706 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.706 DEBUG:boto:Method: GET 2023-12-15T23:25:55.706 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.706 DEBUG:boto:Data: 2023-12-15T23:25:55.706 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.706 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.706 DEBUG:boto:Params: {} 2023-12-15T23:25:55.706 DEBUG:boto:Token: None 2023-12-15T23:25:55.706 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f512bf1f6f3db50-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.709 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.709 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.709 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.709 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.709 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.710 DEBUG:boto:Method: GET 2023-12-15T23:25:55.710 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.710 DEBUG:boto:Data: 2023-12-15T23:25:55.710 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.710 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.710 DEBUG:boto:Params: {} 2023-12-15T23:25:55.710 DEBUG:boto:Token: None 2023-12-15T23:25:55.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a521d0ea09b0d836-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.714 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.714 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.715 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.715 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.715 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:25:55.715 DEBUG:boto:Data: 2023-12-15T23:25:55.715 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.715 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.715 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.715 DEBUG:boto:Params: {} 2023-12-15T23:25:55.715 DEBUG:boto:Token: None 2023-12-15T23:25:55.715 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111 2023-12-15T23:25:55.716 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NWWUkid99PDpQMUZ8J8PWogvMLU= 2023-12-15T23:25:55.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NWWUkid99PDpQMUZ8J8PWogvMLU=', 'Content-Length': '0'} 2023-12-15T23:25:55.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f47cd6c80e023aba-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.717 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.718 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.718 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.718 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:25:55.718 DEBUG:boto:Data: 2023-12-15T23:25:55.718 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.718 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.718 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.718 DEBUG:boto:Params: {} 2023-12-15T23:25:55.718 DEBUG:boto:Token: None 2023-12-15T23:25:55.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111 2023-12-15T23:25:55.719 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NWWUkid99PDpQMUZ8J8PWogvMLU= 2023-12-15T23:25:55.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NWWUkid99PDpQMUZ8J8PWogvMLU=', 'Content-Length': '0'} 2023-12-15T23:25:55.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2664d77cb393ecf-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:25:55.721 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.721 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.721 DEBUG:boto:Method: GET 2023-12-15T23:25:55.721 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:25:55.721 DEBUG:boto:Data: 2023-12-15T23:25:55.721 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.721 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.721 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.721 DEBUG:boto:Params: {} 2023-12-15T23:25:55.722 DEBUG:boto:Token: None 2023-12-15T23:25:55.722 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111 2023-12-15T23:25:55.722 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FlX7x7xVoWDfZgHxNlP6Wykofwg= 2023-12-15T23:25:55.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FlX7x7xVoWDfZgHxNlP6Wykofwg=', 'Content-Length': '0'} 2023-12-15T23:25:55.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e71a659d4fb7b13-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.724 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:25:55.724 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:25:55.724 DEBUG:boto:Method: GET 2023-12-15T23:25:55.724 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:25:55.724 DEBUG:boto:Data: 2023-12-15T23:25:55.724 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.724 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.724 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.724 DEBUG:boto:Params: {} 2023-12-15T23:25:55.724 DEBUG:boto:Token: None 2023-12-15T23:25:55.725 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj111 2023-12-15T23:25:55.725 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FlX7x7xVoWDfZgHxNlP6Wykofwg= 2023-12-15T23:25:55.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FlX7x7xVoWDfZgHxNlP6Wykofwg=', 'Content-Length': '0'} 2023-12-15T23:25:55.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f46e0808f5fac7e-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.727 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.727 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.727 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.727 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.727 DEBUG:boto:Method: GET 2023-12-15T23:25:55.727 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.727 DEBUG:boto:Data: 2023-12-15T23:25:55.727 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.727 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.728 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.728 DEBUG:boto:Params: {} 2023-12-15T23:25:55.728 DEBUG:boto:Token: None 2023-12-15T23:25:55.728 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.728 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6d42d4b8c8616c2-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.731 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.731 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.731 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.731 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.731 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.731 DEBUG:boto:Method: GET 2023-12-15T23:25:55.731 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:25:55.731 DEBUG:boto:Data: 2023-12-15T23:25:55.732 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.732 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.732 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.732 DEBUG:boto:Params: {} 2023-12-15T23:25:55.732 DEBUG:boto:Token: None 2023-12-15T23:25:55.732 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.732 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044ff9af3be2eb241-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.777 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.778 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:25:55.778 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.778 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.778 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.778 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.778 DEBUG:boto:Method: GET 2023-12-15T23:25:55.778 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.778 DEBUG:boto:Data: 2023-12-15T23:25:55.778 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.779 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.779 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.779 DEBUG:boto:Params: {} 2023-12-15T23:25:55.779 DEBUG:boto:Token: None 2023-12-15T23:25:55.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA= 2023-12-15T23:25:55.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA=', 'Content-Length': '0'} 2023-12-15T23:25:55.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f74a6c2e10e29f16-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.782 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.782 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.782 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.782 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.782 DEBUG:boto:Method: GET 2023-12-15T23:25:55.782 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.782 DEBUG:boto:Data: 2023-12-15T23:25:55.782 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.782 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.782 DEBUG:boto:Params: {} 2023-12-15T23:25:55.783 DEBUG:boto:Token: None 2023-12-15T23:25:55.783 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA= 2023-12-15T23:25:55.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA=', 'Content-Length': '0'} 2023-12-15T23:25:55.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000838ba074f97a934b-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.785 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.785 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.786 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.786 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.786 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.786 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.786 DEBUG:boto:Data: 2023-12-15T23:25:55.786 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.786 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.786 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.786 DEBUG:boto:Params: {} 2023-12-15T23:25:55.786 DEBUG:boto:Token: None 2023-12-15T23:25:55.786 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rbsLQAojh8cU5UO8UX0MFgUnLrw= 2023-12-15T23:25:55.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rbsLQAojh8cU5UO8UX0MFgUnLrw=', 'Content-Length': '0'} 2023-12-15T23:25:55.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5f81234eb0a2058-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.789 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.789 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.789 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.789 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.789 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.789 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.789 DEBUG:boto:Data: 2023-12-15T23:25:55.790 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.790 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.790 DEBUG:boto:Params: {} 2023-12-15T23:25:55.790 DEBUG:boto:Token: None 2023-12-15T23:25:55.790 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rbsLQAojh8cU5UO8UX0MFgUnLrw= 2023-12-15T23:25:55.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rbsLQAojh8cU5UO8UX0MFgUnLrw=', 'Content-Length': '0'} 2023-12-15T23:25:55.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4279301d3ad4a8f-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:25:55.793 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.793 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.793 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.793 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.793 DEBUG:boto:Method: GET 2023-12-15T23:25:55.793 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.793 DEBUG:boto:Data: 2023-12-15T23:25:55.793 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.793 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.793 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.793 DEBUG:boto:Params: {} 2023-12-15T23:25:55.794 DEBUG:boto:Token: None 2023-12-15T23:25:55.794 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA= 2023-12-15T23:25:55.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA=', 'Content-Length': '0'} 2023-12-15T23:25:55.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c46516107f862c35-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.796 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.796 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.796 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.796 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.797 DEBUG:boto:Method: GET 2023-12-15T23:25:55.797 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.797 DEBUG:boto:Data: 2023-12-15T23:25:55.797 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.797 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.797 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.797 DEBUG:boto:Params: {} 2023-12-15T23:25:55.797 DEBUG:boto:Token: None 2023-12-15T23:25:55.797 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:25:55.797 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA= 2023-12-15T23:25:55.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DoWmGl1axS5kHYhcnjWZUKzeGLA=', 'Content-Length': '0'} 2023-12-15T23:25:55.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd626b5ddb6796be-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.800 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.800 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.800 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.800 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.800 DEBUG:boto:Method: GET 2023-12-15T23:25:55.800 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.800 DEBUG:boto:Data: 2023-12-15T23:25:55.800 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.800 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.801 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.801 DEBUG:boto:Params: {} 2023-12-15T23:25:55.801 DEBUG:boto:Token: None 2023-12-15T23:25:55.801 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.801 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.803 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e248ef2abb86e48-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.804 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.804 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.804 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.804 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.804 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.804 DEBUG:boto:Method: GET 2023-12-15T23:25:55.804 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.804 DEBUG:boto:Data: 2023-12-15T23:25:55.805 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.805 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.805 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.805 DEBUG:boto:Params: {} 2023-12-15T23:25:55.805 DEBUG:boto:Token: None 2023-12-15T23:25:55.805 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.805 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003afef305040e8e41-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.809 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.809 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.809 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.810 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.810 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:25:55.810 DEBUG:boto:Data: 2023-12-15T23:25:55.810 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.810 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.810 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.810 DEBUG:boto:Params: {} 2023-12-15T23:25:55.810 DEBUG:boto:Token: None 2023-12-15T23:25:55.810 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115 2023-12-15T23:25:55.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vLzDfrS2tt9sRPWsHXlgFiB29U= 2023-12-15T23:25:55.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vLzDfrS2tt9sRPWsHXlgFiB29U=', 'Content-Length': '0'} 2023-12-15T23:25:55.812 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bffd99e845161af-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.812 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.813 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.813 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.813 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:25:55.813 DEBUG:boto:Data: 2023-12-15T23:25:55.813 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.813 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.813 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.813 DEBUG:boto:Params: {} 2023-12-15T23:25:55.813 DEBUG:boto:Token: None 2023-12-15T23:25:55.813 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115 2023-12-15T23:25:55.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vLzDfrS2tt9sRPWsHXlgFiB29U= 2023-12-15T23:25:55.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vLzDfrS2tt9sRPWsHXlgFiB29U=', 'Content-Length': '0'} 2023-12-15T23:25:55.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d4c84e8e0226886-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:25:55.816 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.816 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.816 DEBUG:boto:Method: GET 2023-12-15T23:25:55.816 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:25:55.817 DEBUG:boto:Data: 2023-12-15T23:25:55.817 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.817 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.817 DEBUG:boto:Params: {} 2023-12-15T23:25:55.817 DEBUG:boto:Token: None 2023-12-15T23:25:55.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115 2023-12-15T23:25:55.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NlCpONHlR2aFqCPewv4i03yWyHQ= 2023-12-15T23:25:55.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NlCpONHlR2aFqCPewv4i03yWyHQ=', 'Content-Length': '0'} 2023-12-15T23:25:55.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e48bd0ef9fcd67-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.819 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:25:55.819 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:25:55.820 DEBUG:boto:Method: GET 2023-12-15T23:25:55.820 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:25:55.820 DEBUG:boto:Data: 2023-12-15T23:25:55.820 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.820 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.820 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.820 DEBUG:boto:Params: {} 2023-12-15T23:25:55.820 DEBUG:boto:Token: None 2023-12-15T23:25:55.820 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj115 2023-12-15T23:25:55.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NlCpONHlR2aFqCPewv4i03yWyHQ= 2023-12-15T23:25:55.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NlCpONHlR2aFqCPewv4i03yWyHQ=', 'Content-Length': '0'} 2023-12-15T23:25:55.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052bf70abe1fff131-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.823 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.823 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.823 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.823 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.823 DEBUG:boto:Method: GET 2023-12-15T23:25:55.823 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.823 DEBUG:boto:Data: 2023-12-15T23:25:55.823 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.824 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.824 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.824 DEBUG:boto:Params: {} 2023-12-15T23:25:55.824 DEBUG:boto:Token: None 2023-12-15T23:25:55.824 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.824 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003bbda66550f8ca6a-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.827 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.827 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.827 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.827 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.827 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.827 DEBUG:boto:Method: GET 2023-12-15T23:25:55.827 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:25:55.827 DEBUG:boto:Data: 2023-12-15T23:25:55.827 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.828 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.828 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.828 DEBUG:boto:Params: {} 2023-12-15T23:25:55.828 DEBUG:boto:Token: None 2023-12-15T23:25:55.828 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.828 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba98109b40772c09-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.831 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:25:55.832 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.832 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.832 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.832 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.832 DEBUG:boto:Method: GET 2023-12-15T23:25:55.832 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.832 DEBUG:boto:Data: 2023-12-15T23:25:55.832 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.833 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.833 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.833 DEBUG:boto:Params: {} 2023-12-15T23:25:55.833 DEBUG:boto:Token: None 2023-12-15T23:25:55.833 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.833 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU= 2023-12-15T23:25:55.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU=', 'Content-Length': '0'} 2023-12-15T23:25:55.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a98f37744cc91ea4-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.877 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.878 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.878 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.878 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.878 DEBUG:boto:Method: GET 2023-12-15T23:25:55.878 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.878 DEBUG:boto:Data: 2023-12-15T23:25:55.878 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.878 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.878 DEBUG:boto:Params: {} 2023-12-15T23:25:55.878 DEBUG:boto:Token: None 2023-12-15T23:25:55.879 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU= 2023-12-15T23:25:55.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU=', 'Content-Length': '0'} 2023-12-15T23:25:55.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc67cb2dd2fcb7dd-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.881 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.881 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.881 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.881 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.881 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.881 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.882 DEBUG:boto:Data: 2023-12-15T23:25:55.882 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.882 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.882 DEBUG:boto:Params: {} 2023-12-15T23:25:55.882 DEBUG:boto:Token: None 2023-12-15T23:25:55.882 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fJMhQNLxf4gE7cznHRMiF9lJv7I= 2023-12-15T23:25:55.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fJMhQNLxf4gE7cznHRMiF9lJv7I=', 'Content-Length': '0'} 2023-12-15T23:25:55.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000509bd79a8c61bb70-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.884 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.884 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.884 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.884 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.885 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.885 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.885 DEBUG:boto:Data: 2023-12-15T23:25:55.885 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.885 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.885 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.885 DEBUG:boto:Params: {} 2023-12-15T23:25:55.885 DEBUG:boto:Token: None 2023-12-15T23:25:55.885 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fJMhQNLxf4gE7cznHRMiF9lJv7I= 2023-12-15T23:25:55.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fJMhQNLxf4gE7cznHRMiF9lJv7I=', 'Content-Length': '0'} 2023-12-15T23:25:55.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f58a73ded3780e9-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:25:55.888 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.888 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.888 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.888 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.888 DEBUG:boto:Method: GET 2023-12-15T23:25:55.888 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.888 DEBUG:boto:Data: 2023-12-15T23:25:55.888 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.888 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.889 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.889 DEBUG:boto:Params: {} 2023-12-15T23:25:55.889 DEBUG:boto:Token: None 2023-12-15T23:25:55.889 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.889 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU= 2023-12-15T23:25:55.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU=', 'Content-Length': '0'} 2023-12-15T23:25:55.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000582aadd4d34b9f9a-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.891 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.891 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.891 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.891 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.892 DEBUG:boto:Method: GET 2023-12-15T23:25:55.892 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.892 DEBUG:boto:Data: 2023-12-15T23:25:55.892 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.892 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.892 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.892 DEBUG:boto:Params: {} 2023-12-15T23:25:55.892 DEBUG:boto:Token: None 2023-12-15T23:25:55.892 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:25:55.892 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU= 2023-12-15T23:25:55.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eVn9lqMxRXNVzOgJ0YVsuahPLyU=', 'Content-Length': '0'} 2023-12-15T23:25:55.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9d41b1a6131c4ac-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.895 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.895 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.895 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.895 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.895 DEBUG:boto:Method: GET 2023-12-15T23:25:55.895 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.895 DEBUG:boto:Data: 2023-12-15T23:25:55.895 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.895 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.895 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.895 DEBUG:boto:Params: {} 2023-12-15T23:25:55.896 DEBUG:boto:Token: None 2023-12-15T23:25:55.896 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.896 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.898 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d1a867e5c7ff858-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.898 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.899 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.899 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.899 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.899 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.899 DEBUG:boto:Method: GET 2023-12-15T23:25:55.899 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.899 DEBUG:boto:Data: 2023-12-15T23:25:55.899 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.899 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.899 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.900 DEBUG:boto:Params: {} 2023-12-15T23:25:55.900 DEBUG:boto:Token: None 2023-12-15T23:25:55.900 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.900 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.903 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005f361bfc35f879b-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.945 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.946 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.946 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.946 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.946 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:25:55.946 DEBUG:boto:Data: 2023-12-15T23:25:55.946 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.946 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.946 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.946 DEBUG:boto:Params: {} 2023-12-15T23:25:55.947 DEBUG:boto:Token: None 2023-12-15T23:25:55.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116 2023-12-15T23:25:55.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:La5CKq0fFfqaPsMbkJK14Epy7ZI= 2023-12-15T23:25:55.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:La5CKq0fFfqaPsMbkJK14Epy7ZI=', 'Content-Length': '0'} 2023-12-15T23:25:55.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073b83847b80edbc1-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.949 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.949 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.949 DEBUG:boto:Method: HEAD 2023-12-15T23:25:55.949 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:25:55.949 DEBUG:boto:Data: 2023-12-15T23:25:55.949 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.950 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.950 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.950 DEBUG:boto:Params: {} 2023-12-15T23:25:55.950 DEBUG:boto:Token: None 2023-12-15T23:25:55.950 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116 2023-12-15T23:25:55.950 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:La5CKq0fFfqaPsMbkJK14Epy7ZI= 2023-12-15T23:25:55.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:La5CKq0fFfqaPsMbkJK14Epy7ZI=', 'Content-Length': '0'} 2023-12-15T23:25:55.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fa033299e7daa3b-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:25:55.952 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.952 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.953 DEBUG:boto:Method: GET 2023-12-15T23:25:55.953 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:25:55.953 DEBUG:boto:Data: 2023-12-15T23:25:55.953 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.953 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.953 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.953 DEBUG:boto:Params: {} 2023-12-15T23:25:55.953 DEBUG:boto:Token: None 2023-12-15T23:25:55.953 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116 2023-12-15T23:25:55.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sioU0IWFWhmnR3cD0pW17IycnJY= 2023-12-15T23:25:55.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sioU0IWFWhmnR3cD0pW17IycnJY=', 'Content-Length': '0'} 2023-12-15T23:25:55.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004489d20fd655f3e0-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.956 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:25:55.956 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:25:55.956 DEBUG:boto:Method: GET 2023-12-15T23:25:55.956 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:25:55.956 DEBUG:boto:Data: 2023-12-15T23:25:55.956 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.956 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.956 DEBUG:boto:Params: {} 2023-12-15T23:25:55.956 DEBUG:boto:Token: None 2023-12-15T23:25:55.956 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj116 2023-12-15T23:25:55.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sioU0IWFWhmnR3cD0pW17IycnJY= 2023-12-15T23:25:55.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sioU0IWFWhmnR3cD0pW17IycnJY=', 'Content-Length': '0'} 2023-12-15T23:25:55.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088bef4e5be8692a5-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.959 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.959 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.959 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.959 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.959 DEBUG:boto:Method: GET 2023-12-15T23:25:55.959 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.959 DEBUG:boto:Data: 2023-12-15T23:25:55.959 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.959 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.960 DEBUG:boto:Params: {} 2023-12-15T23:25:55.960 DEBUG:boto:Token: None 2023-12-15T23:25:55.960 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a68bba9a24e37689-00657ce083-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.962 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.963 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:55.963 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:55.963 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.963 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.963 DEBUG:boto:Method: GET 2023-12-15T23:25:55.963 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:25:55.963 DEBUG:boto:Data: 2023-12-15T23:25:55.964 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.964 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.964 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.964 DEBUG:boto:Params: {} 2023-12-15T23:25:55.964 DEBUG:boto:Token: None 2023-12-15T23:25:55.964 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/ 2023-12-15T23:25:55.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk= 2023-12-15T23:25:55.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY7Tp/W56emKk0etvKBoYK/MFAk=', 'Content-Length': '0'} 2023-12-15T23:25:55.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003123150f27eb7908-00657ce083-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.968 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:55.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:25:55.968 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:55.968 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:55.968 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.968 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.969 DEBUG:boto:Method: GET 2023-12-15T23:25:55.969 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.969 DEBUG:boto:Data: 2023-12-15T23:25:55.969 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.969 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:55.969 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.969 DEBUG:boto:Params: {} 2023-12-15T23:25:55.969 DEBUG:boto:Token: None 2023-12-15T23:25:55.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SJB7AMHpy0PQAuH7kCe1/bQJgY8= 2023-12-15T23:25:55.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SJB7AMHpy0PQAuH7kCe1/bQJgY8=', 'Content-Length': '0'} 2023-12-15T23:25:55.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cc545e6a3cc7d78-00657ce083-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:55.972 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:55.972 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:55.972 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.972 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.972 DEBUG:boto:Method: GET 2023-12-15T23:25:55.972 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.972 DEBUG:boto:Data: 2023-12-15T23:25:55.972 DEBUG:boto:Headers: {} 2023-12-15T23:25:55.972 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:55.972 DEBUG:boto:Port: 8000 2023-12-15T23:25:55.973 DEBUG:boto:Params: {} 2023-12-15T23:25:55.973 DEBUG:boto:Token: None 2023-12-15T23:25:55.973 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:55 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:55.973 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SJB7AMHpy0PQAuH7kCe1/bQJgY8= 2023-12-15T23:25:55.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SJB7AMHpy0PQAuH7kCe1/bQJgY8=', 'Content-Length': '0'} 2023-12-15T23:25:55.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d923609adeacad05-00657ce083-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.017 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.017 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.018 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.018 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.018 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.018 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.018 DEBUG:boto:Data: 2023-12-15T23:25:56.018 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.018 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.018 DEBUG:boto:Params: {} 2023-12-15T23:25:56.018 DEBUG:boto:Token: None 2023-12-15T23:25:56.019 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mC+wfo4xyLgIzTasFZ1QyZLh7V0= 2023-12-15T23:25:56.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mC+wfo4xyLgIzTasFZ1QyZLh7V0=', 'Content-Length': '0'} 2023-12-15T23:25:56.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a650263516bae21a-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.021 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.021 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.021 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.021 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.021 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.021 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.021 DEBUG:boto:Data: 2023-12-15T23:25:56.021 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.022 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.022 DEBUG:boto:Params: {} 2023-12-15T23:25:56.022 DEBUG:boto:Token: None 2023-12-15T23:25:56.022 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mC+wfo4xyLgIzTasFZ1QyZLh7V0= 2023-12-15T23:25:56.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mC+wfo4xyLgIzTasFZ1QyZLh7V0=', 'Content-Length': '0'} 2023-12-15T23:25:56.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ff003b7ad49b49a-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:25:56.024 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.025 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.025 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.025 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.025 DEBUG:boto:Method: GET 2023-12-15T23:25:56.025 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.025 DEBUG:boto:Data: 2023-12-15T23:25:56.025 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.025 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.025 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.025 DEBUG:boto:Params: {} 2023-12-15T23:25:56.026 DEBUG:boto:Token: None 2023-12-15T23:25:56.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zvtmk4Q/mNOsBJLzSGmgYXn64XY= 2023-12-15T23:25:56.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zvtmk4Q/mNOsBJLzSGmgYXn64XY=', 'Content-Length': '0'} 2023-12-15T23:25:56.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056f4fb747f7eacf7-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.028 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.028 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.028 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.028 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.029 DEBUG:boto:Method: GET 2023-12-15T23:25:56.029 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.029 DEBUG:boto:Data: 2023-12-15T23:25:56.029 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.029 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.029 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.029 DEBUG:boto:Params: {} 2023-12-15T23:25:56.029 DEBUG:boto:Token: None 2023-12-15T23:25:56.029 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:25:56.029 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zvtmk4Q/mNOsBJLzSGmgYXn64XY= 2023-12-15T23:25:56.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zvtmk4Q/mNOsBJLzSGmgYXn64XY=', 'Content-Length': '0'} 2023-12-15T23:25:56.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052233571c28823cd-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.032 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.032 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.032 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.032 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.032 DEBUG:boto:Method: GET 2023-12-15T23:25:56.032 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.032 DEBUG:boto:Data: 2023-12-15T23:25:56.032 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.032 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.032 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.032 DEBUG:boto:Params: {} 2023-12-15T23:25:56.033 DEBUG:boto:Token: None 2023-12-15T23:25:56.033 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.033 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.035 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006275786a1294b9e0-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.036 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.036 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.036 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.036 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.036 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.036 DEBUG:boto:Method: GET 2023-12-15T23:25:56.036 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.036 DEBUG:boto:Data: 2023-12-15T23:25:56.037 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.037 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.037 DEBUG:boto:Params: {} 2023-12-15T23:25:56.037 DEBUG:boto:Token: None 2023-12-15T23:25:56.037 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.040 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f14a8a5be45cdc3b-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.041 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.041 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.041 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.041 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.041 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:25:56.041 DEBUG:boto:Data: 2023-12-15T23:25:56.041 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.041 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.042 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.042 DEBUG:boto:Params: {} 2023-12-15T23:25:56.042 DEBUG:boto:Token: None 2023-12-15T23:25:56.042 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124 2023-12-15T23:25:56.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZlA6WbRanpYJDUZAXPkjiQtBTGs= 2023-12-15T23:25:56.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZlA6WbRanpYJDUZAXPkjiQtBTGs=', 'Content-Length': '0'} 2023-12-15T23:25:56.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050bc3b71a8d59cb7-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.044 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.044 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.044 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.044 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:25:56.044 DEBUG:boto:Data: 2023-12-15T23:25:56.044 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.044 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.045 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.045 DEBUG:boto:Params: {} 2023-12-15T23:25:56.045 DEBUG:boto:Token: None 2023-12-15T23:25:56.045 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124 2023-12-15T23:25:56.045 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZlA6WbRanpYJDUZAXPkjiQtBTGs= 2023-12-15T23:25:56.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZlA6WbRanpYJDUZAXPkjiQtBTGs=', 'Content-Length': '0'} 2023-12-15T23:25:56.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f701d3a555fc115-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:25:56.047 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.047 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.047 DEBUG:boto:Method: GET 2023-12-15T23:25:56.047 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:25:56.047 DEBUG:boto:Data: 2023-12-15T23:25:56.047 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.048 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.048 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.048 DEBUG:boto:Params: {} 2023-12-15T23:25:56.048 DEBUG:boto:Token: None 2023-12-15T23:25:56.048 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124 2023-12-15T23:25:56.048 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uH03iGNFHecQlfeSF72Khr+Loz4= 2023-12-15T23:25:56.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uH03iGNFHecQlfeSF72Khr+Loz4=', 'Content-Length': '0'} 2023-12-15T23:25:56.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d717451f151e524-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.050 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:25:56.050 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:25:56.050 DEBUG:boto:Method: GET 2023-12-15T23:25:56.051 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:25:56.051 DEBUG:boto:Data: 2023-12-15T23:25:56.051 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.051 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.051 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.051 DEBUG:boto:Params: {} 2023-12-15T23:25:56.051 DEBUG:boto:Token: None 2023-12-15T23:25:56.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj124 2023-12-15T23:25:56.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uH03iGNFHecQlfeSF72Khr+Loz4= 2023-12-15T23:25:56.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uH03iGNFHecQlfeSF72Khr+Loz4=', 'Content-Length': '0'} 2023-12-15T23:25:56.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000068613ee7ef516c8-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.053 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.054 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.054 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.054 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.054 DEBUG:boto:Method: GET 2023-12-15T23:25:56.054 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.054 DEBUG:boto:Data: 2023-12-15T23:25:56.054 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.054 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.054 DEBUG:boto:Params: {} 2023-12-15T23:25:56.054 DEBUG:boto:Token: None 2023-12-15T23:25:56.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012de0d2f14ef3196-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.097 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.098 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.098 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.098 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.098 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.098 DEBUG:boto:Method: GET 2023-12-15T23:25:56.098 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:25:56.098 DEBUG:boto:Data: 2023-12-15T23:25:56.098 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.099 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.099 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.099 DEBUG:boto:Params: {} 2023-12-15T23:25:56.099 DEBUG:boto:Token: None 2023-12-15T23:25:56.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff22b25f0152044c-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.103 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.103 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:25:56.103 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.103 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.103 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.103 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.104 DEBUG:boto:Method: GET 2023-12-15T23:25:56.104 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.104 DEBUG:boto:Data: 2023-12-15T23:25:56.104 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.104 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.104 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.104 DEBUG:boto:Params: {} 2023-12-15T23:25:56.104 DEBUG:boto:Token: None 2023-12-15T23:25:56.104 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.104 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo= 2023-12-15T23:25:56.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo=', 'Content-Length': '0'} 2023-12-15T23:25:56.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e77b270eee99b6e9-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.106 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.107 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.107 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.107 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.107 DEBUG:boto:Method: GET 2023-12-15T23:25:56.107 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.107 DEBUG:boto:Data: 2023-12-15T23:25:56.107 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.107 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.107 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.107 DEBUG:boto:Params: {} 2023-12-15T23:25:56.108 DEBUG:boto:Token: None 2023-12-15T23:25:56.108 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.108 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo= 2023-12-15T23:25:56.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo=', 'Content-Length': '0'} 2023-12-15T23:25:56.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d930ebd4d0d599d7-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.110 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.110 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.110 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.110 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.110 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.111 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.111 DEBUG:boto:Data: 2023-12-15T23:25:56.111 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.111 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.111 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.111 DEBUG:boto:Params: {} 2023-12-15T23:25:56.111 DEBUG:boto:Token: None 2023-12-15T23:25:56.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ntyAsRx3zFpHTfNoeqsqNV5diiU= 2023-12-15T23:25:56.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ntyAsRx3zFpHTfNoeqsqNV5diiU=', 'Content-Length': '0'} 2023-12-15T23:25:56.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000886a94d3f8f9d8c0-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.113 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.113 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.113 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.114 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.114 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.114 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.114 DEBUG:boto:Data: 2023-12-15T23:25:56.114 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.114 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.114 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.114 DEBUG:boto:Params: {} 2023-12-15T23:25:56.114 DEBUG:boto:Token: None 2023-12-15T23:25:56.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ntyAsRx3zFpHTfNoeqsqNV5diiU= 2023-12-15T23:25:56.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ntyAsRx3zFpHTfNoeqsqNV5diiU=', 'Content-Length': '0'} 2023-12-15T23:25:56.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad7a89e159fcfed1-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.117 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:25:56.117 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.117 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.117 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.117 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.117 DEBUG:boto:Method: GET 2023-12-15T23:25:56.117 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.121 DEBUG:boto:Data: 2023-12-15T23:25:56.121 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.121 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.121 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.121 DEBUG:boto:Params: {} 2023-12-15T23:25:56.121 DEBUG:boto:Token: None 2023-12-15T23:25:56.121 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo= 2023-12-15T23:25:56.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo=', 'Content-Length': '0'} 2023-12-15T23:25:56.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000683d9e0da9b24b91-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.123 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.124 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.124 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.124 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.124 DEBUG:boto:Method: GET 2023-12-15T23:25:56.124 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.124 DEBUG:boto:Data: 2023-12-15T23:25:56.124 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.124 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.124 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.124 DEBUG:boto:Params: {} 2023-12-15T23:25:56.124 DEBUG:boto:Token: None 2023-12-15T23:25:56.125 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:25:56.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo= 2023-12-15T23:25:56.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:llTkCxmF5vWwVEccOOEO/hzJDEo=', 'Content-Length': '0'} 2023-12-15T23:25:56.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a95c0b0c8e455205-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.169 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.170 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.170 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.170 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.170 DEBUG:boto:Method: GET 2023-12-15T23:25:56.170 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.170 DEBUG:boto:Data: 2023-12-15T23:25:56.170 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.170 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.170 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.171 DEBUG:boto:Params: {} 2023-12-15T23:25:56.171 DEBUG:boto:Token: None 2023-12-15T23:25:56.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2f0ed5e631f7216-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.174 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.174 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.174 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.174 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.174 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.175 DEBUG:boto:Method: GET 2023-12-15T23:25:56.175 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.175 DEBUG:boto:Data: 2023-12-15T23:25:56.175 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.175 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.175 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.175 DEBUG:boto:Params: {} 2023-12-15T23:25:56.175 DEBUG:boto:Token: None 2023-12-15T23:25:56.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec86b633ce310bc8-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.179 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.179 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.180 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.180 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.180 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:25:56.180 DEBUG:boto:Data: 2023-12-15T23:25:56.180 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.180 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.180 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.180 DEBUG:boto:Params: {} 2023-12-15T23:25:56.180 DEBUG:boto:Token: None 2023-12-15T23:25:56.180 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145 2023-12-15T23:25:56.181 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEl/pB46bAb3DkdgqLXs4Zaq90Y= 2023-12-15T23:25:56.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEl/pB46bAb3DkdgqLXs4Zaq90Y=', 'Content-Length': '0'} 2023-12-15T23:25:56.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b96f66739ba3c4ee-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.182 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.183 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.183 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.183 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:25:56.183 DEBUG:boto:Data: 2023-12-15T23:25:56.183 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.183 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.183 DEBUG:boto:Params: {} 2023-12-15T23:25:56.183 DEBUG:boto:Token: None 2023-12-15T23:25:56.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145 2023-12-15T23:25:56.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEl/pB46bAb3DkdgqLXs4Zaq90Y= 2023-12-15T23:25:56.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEl/pB46bAb3DkdgqLXs4Zaq90Y=', 'Content-Length': '0'} 2023-12-15T23:25:56.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d03f18a17bdb2947-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:25:56.186 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.186 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.186 DEBUG:boto:Method: GET 2023-12-15T23:25:56.186 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:25:56.186 DEBUG:boto:Data: 2023-12-15T23:25:56.186 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.186 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.186 DEBUG:boto:Params: {} 2023-12-15T23:25:56.187 DEBUG:boto:Token: None 2023-12-15T23:25:56.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145 2023-12-15T23:25:56.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A/v4NSNDSFOwDuqyCu0hD3cjiNg= 2023-12-15T23:25:56.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A/v4NSNDSFOwDuqyCu0hD3cjiNg=', 'Content-Length': '0'} 2023-12-15T23:25:56.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be86c07b0775a6d2-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.229 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:25:56.230 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:25:56.230 DEBUG:boto:Method: GET 2023-12-15T23:25:56.230 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:25:56.230 DEBUG:boto:Data: 2023-12-15T23:25:56.230 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.230 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.230 DEBUG:boto:Params: {} 2023-12-15T23:25:56.230 DEBUG:boto:Token: None 2023-12-15T23:25:56.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj145 2023-12-15T23:25:56.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A/v4NSNDSFOwDuqyCu0hD3cjiNg= 2023-12-15T23:25:56.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A/v4NSNDSFOwDuqyCu0hD3cjiNg=', 'Content-Length': '0'} 2023-12-15T23:25:56.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000735b498a0f069e75-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.233 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.233 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.233 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.233 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.233 DEBUG:boto:Method: GET 2023-12-15T23:25:56.233 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.233 DEBUG:boto:Data: 2023-12-15T23:25:56.233 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.233 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.234 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.234 DEBUG:boto:Params: {} 2023-12-15T23:25:56.234 DEBUG:boto:Token: None 2023-12-15T23:25:56.234 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.234 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d876367b901060b8-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.236 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.237 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.237 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.237 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.237 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.237 DEBUG:boto:Method: GET 2023-12-15T23:25:56.237 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:25:56.237 DEBUG:boto:Data: 2023-12-15T23:25:56.238 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.238 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.238 DEBUG:boto:Params: {} 2023-12-15T23:25:56.238 DEBUG:boto:Token: None 2023-12-15T23:25:56.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e2efda1a5615291-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.242 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.242 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:25:56.242 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.242 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.243 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.243 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.243 DEBUG:boto:Method: GET 2023-12-15T23:25:56.243 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.243 DEBUG:boto:Data: 2023-12-15T23:25:56.243 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.243 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.243 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.243 DEBUG:boto:Params: {} 2023-12-15T23:25:56.243 DEBUG:boto:Token: None 2023-12-15T23:25:56.243 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM= 2023-12-15T23:25:56.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM=', 'Content-Length': '0'} 2023-12-15T23:25:56.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017910d9f09e6a6c8-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.246 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.246 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.246 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.246 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.246 DEBUG:boto:Method: GET 2023-12-15T23:25:56.247 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.247 DEBUG:boto:Data: 2023-12-15T23:25:56.247 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.247 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.247 DEBUG:boto:Params: {} 2023-12-15T23:25:56.247 DEBUG:boto:Token: None 2023-12-15T23:25:56.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM= 2023-12-15T23:25:56.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM=', 'Content-Length': '0'} 2023-12-15T23:25:56.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2ce67834ea601b4-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.289 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.289 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.290 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.290 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.290 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.290 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.290 DEBUG:boto:Data: 2023-12-15T23:25:56.290 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.290 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.290 DEBUG:boto:Params: {} 2023-12-15T23:25:56.290 DEBUG:boto:Token: None 2023-12-15T23:25:56.291 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H8iwsBxVJKWH4kv1J1F3SwtXnt4= 2023-12-15T23:25:56.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H8iwsBxVJKWH4kv1J1F3SwtXnt4=', 'Content-Length': '0'} 2023-12-15T23:25:56.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a17cd90f9146464-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.293 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.293 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.293 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.293 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.293 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.293 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.294 DEBUG:boto:Data: 2023-12-15T23:25:56.294 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.294 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.294 DEBUG:boto:Params: {} 2023-12-15T23:25:56.294 DEBUG:boto:Token: None 2023-12-15T23:25:56.294 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.294 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:H8iwsBxVJKWH4kv1J1F3SwtXnt4= 2023-12-15T23:25:56.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:H8iwsBxVJKWH4kv1J1F3SwtXnt4=', 'Content-Length': '0'} 2023-12-15T23:25:56.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068e7b6c3658292dc-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:25:56.297 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.297 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.297 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.297 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.297 DEBUG:boto:Method: GET 2023-12-15T23:25:56.297 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.297 DEBUG:boto:Data: 2023-12-15T23:25:56.297 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.297 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.297 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.297 DEBUG:boto:Params: {} 2023-12-15T23:25:56.298 DEBUG:boto:Token: None 2023-12-15T23:25:56.298 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM= 2023-12-15T23:25:56.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM=', 'Content-Length': '0'} 2023-12-15T23:25:56.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041fecfb377f1ed07-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.300 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.300 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.300 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.300 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.300 DEBUG:boto:Method: GET 2023-12-15T23:25:56.300 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.301 DEBUG:boto:Data: 2023-12-15T23:25:56.301 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.301 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.301 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.301 DEBUG:boto:Params: {} 2023-12-15T23:25:56.301 DEBUG:boto:Token: None 2023-12-15T23:25:56.301 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:25:56.301 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM= 2023-12-15T23:25:56.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/MYdRTYrEabe8e6SkEQB9u2G0sM=', 'Content-Length': '0'} 2023-12-15T23:25:56.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049db996238f8ceae-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.304 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.304 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.304 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.304 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.304 DEBUG:boto:Method: GET 2023-12-15T23:25:56.304 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.304 DEBUG:boto:Data: 2023-12-15T23:25:56.304 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.304 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.304 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.304 DEBUG:boto:Params: {} 2023-12-15T23:25:56.305 DEBUG:boto:Token: None 2023-12-15T23:25:56.305 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.307 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000400ebef10ff9ccf7-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.307 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.308 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.308 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.308 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.308 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.308 DEBUG:boto:Method: GET 2023-12-15T23:25:56.308 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.308 DEBUG:boto:Data: 2023-12-15T23:25:56.308 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.308 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.308 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.309 DEBUG:boto:Params: {} 2023-12-15T23:25:56.309 DEBUG:boto:Token: None 2023-12-15T23:25:56.309 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.309 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004eb3313271fa676b-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.313 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.313 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.313 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.313 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.313 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:25:56.313 DEBUG:boto:Data: 2023-12-15T23:25:56.314 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.314 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.314 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.314 DEBUG:boto:Params: {} 2023-12-15T23:25:56.314 DEBUG:boto:Token: None 2023-12-15T23:25:56.314 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148 2023-12-15T23:25:56.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ht4bC5hlvPwnmAXxBTiPkizOiH4= 2023-12-15T23:25:56.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ht4bC5hlvPwnmAXxBTiPkizOiH4=', 'Content-Length': '0'} 2023-12-15T23:25:56.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000580cf906172f6ea5-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.316 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.316 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.316 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.317 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:25:56.317 DEBUG:boto:Data: 2023-12-15T23:25:56.317 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.317 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.317 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.317 DEBUG:boto:Params: {} 2023-12-15T23:25:56.317 DEBUG:boto:Token: None 2023-12-15T23:25:56.317 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148 2023-12-15T23:25:56.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ht4bC5hlvPwnmAXxBTiPkizOiH4= 2023-12-15T23:25:56.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ht4bC5hlvPwnmAXxBTiPkizOiH4=', 'Content-Length': '0'} 2023-12-15T23:25:56.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1ad4fcc6bf22e96-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:25:56.320 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.320 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.320 DEBUG:boto:Method: GET 2023-12-15T23:25:56.320 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:25:56.320 DEBUG:boto:Data: 2023-12-15T23:25:56.320 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.320 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.320 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.320 DEBUG:boto:Params: {} 2023-12-15T23:25:56.320 DEBUG:boto:Token: None 2023-12-15T23:25:56.321 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148 2023-12-15T23:25:56.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jTDCg9F5mi6eaichim4CrdgBB70= 2023-12-15T23:25:56.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jTDCg9F5mi6eaichim4CrdgBB70=', 'Content-Length': '0'} 2023-12-15T23:25:56.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032da2265d2a8daf1-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.323 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:25:56.323 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:25:56.323 DEBUG:boto:Method: GET 2023-12-15T23:25:56.323 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:25:56.323 DEBUG:boto:Data: 2023-12-15T23:25:56.323 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.323 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.324 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.324 DEBUG:boto:Params: {} 2023-12-15T23:25:56.324 DEBUG:boto:Token: None 2023-12-15T23:25:56.324 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj148 2023-12-15T23:25:56.324 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jTDCg9F5mi6eaichim4CrdgBB70= 2023-12-15T23:25:56.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jTDCg9F5mi6eaichim4CrdgBB70=', 'Content-Length': '0'} 2023-12-15T23:25:56.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b479d1d40198e997-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.326 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.326 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.326 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.327 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.327 DEBUG:boto:Method: GET 2023-12-15T23:25:56.327 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.327 DEBUG:boto:Data: 2023-12-15T23:25:56.327 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.327 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.327 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.327 DEBUG:boto:Params: {} 2023-12-15T23:25:56.327 DEBUG:boto:Token: None 2023-12-15T23:25:56.327 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.328 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b41c02e2e595c48d-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.330 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.331 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.331 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.331 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.331 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.331 DEBUG:boto:Method: GET 2023-12-15T23:25:56.331 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:25:56.331 DEBUG:boto:Data: 2023-12-15T23:25:56.331 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.332 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.332 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.332 DEBUG:boto:Params: {} 2023-12-15T23:25:56.332 DEBUG:boto:Token: None 2023-12-15T23:25:56.332 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.332 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcc2d958c58e2d89-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.336 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:25:56.336 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.336 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.336 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.337 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.337 DEBUG:boto:Method: GET 2023-12-15T23:25:56.337 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.337 DEBUG:boto:Data: 2023-12-15T23:25:56.337 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.337 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.337 DEBUG:boto:Params: {} 2023-12-15T23:25:56.337 DEBUG:boto:Token: None 2023-12-15T23:25:56.337 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4= 2023-12-15T23:25:56.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4=', 'Content-Length': '0'} 2023-12-15T23:25:56.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6ca3825b1332a34-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.340 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.340 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.340 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.340 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.341 DEBUG:boto:Method: GET 2023-12-15T23:25:56.341 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.341 DEBUG:boto:Data: 2023-12-15T23:25:56.341 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.341 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.341 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.341 DEBUG:boto:Params: {} 2023-12-15T23:25:56.341 DEBUG:boto:Token: None 2023-12-15T23:25:56.341 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4= 2023-12-15T23:25:56.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4=', 'Content-Length': '0'} 2023-12-15T23:25:56.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ad884e36e992e39-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.385 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.386 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.386 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.386 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.386 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.386 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.386 DEBUG:boto:Data: 2023-12-15T23:25:56.386 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.386 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.386 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.386 DEBUG:boto:Params: {} 2023-12-15T23:25:56.387 DEBUG:boto:Token: None 2023-12-15T23:25:56.387 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vOloBkKZ7Dzprp0DwE58vemsGlY= 2023-12-15T23:25:56.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vOloBkKZ7Dzprp0DwE58vemsGlY=', 'Content-Length': '0'} 2023-12-15T23:25:56.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c3b12afe3a4dc13-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.389 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.389 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.389 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.389 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.390 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.390 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.390 DEBUG:boto:Data: 2023-12-15T23:25:56.390 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.390 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.390 DEBUG:boto:Params: {} 2023-12-15T23:25:56.390 DEBUG:boto:Token: None 2023-12-15T23:25:56.390 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vOloBkKZ7Dzprp0DwE58vemsGlY= 2023-12-15T23:25:56.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vOloBkKZ7Dzprp0DwE58vemsGlY=', 'Content-Length': '0'} 2023-12-15T23:25:56.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b647bfdae7ed4e77-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:25:56.393 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.393 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.393 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.393 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.393 DEBUG:boto:Method: GET 2023-12-15T23:25:56.394 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.394 DEBUG:boto:Data: 2023-12-15T23:25:56.394 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.394 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.394 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.394 DEBUG:boto:Params: {} 2023-12-15T23:25:56.394 DEBUG:boto:Token: None 2023-12-15T23:25:56.394 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4= 2023-12-15T23:25:56.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4=', 'Content-Length': '0'} 2023-12-15T23:25:56.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c19c00c94b826c2e-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.397 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.397 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.397 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.397 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.397 DEBUG:boto:Method: GET 2023-12-15T23:25:56.397 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.397 DEBUG:boto:Data: 2023-12-15T23:25:56.397 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.398 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.398 DEBUG:boto:Params: {} 2023-12-15T23:25:56.398 DEBUG:boto:Token: None 2023-12-15T23:25:56.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:25:56.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4= 2023-12-15T23:25:56.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZmFbTrbsoM4cs1sDyUQpLwVhig4=', 'Content-Length': '0'} 2023-12-15T23:25:56.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004095c5f7cf9a28e2-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.401 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.401 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.401 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.401 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.401 DEBUG:boto:Method: GET 2023-12-15T23:25:56.401 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.401 DEBUG:boto:Data: 2023-12-15T23:25:56.401 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.401 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.401 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.402 DEBUG:boto:Params: {} 2023-12-15T23:25:56.402 DEBUG:boto:Token: None 2023-12-15T23:25:56.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7213fead355387f-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.404 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.405 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.405 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.405 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.405 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.405 DEBUG:boto:Method: GET 2023-12-15T23:25:56.405 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.405 DEBUG:boto:Data: 2023-12-15T23:25:56.405 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.405 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.406 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.406 DEBUG:boto:Params: {} 2023-12-15T23:25:56.406 DEBUG:boto:Token: None 2023-12-15T23:25:56.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c176ed01c7c1ed4-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.410 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.410 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.410 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.411 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.411 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:25:56.411 DEBUG:boto:Data: 2023-12-15T23:25:56.411 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.411 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.411 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.411 DEBUG:boto:Params: {} 2023-12-15T23:25:56.411 DEBUG:boto:Token: None 2023-12-15T23:25:56.411 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155 2023-12-15T23:25:56.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w4QyUBR6othsDowHh8Wy4yEznOU= 2023-12-15T23:25:56.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w4QyUBR6othsDowHh8Wy4yEznOU=', 'Content-Length': '0'} 2023-12-15T23:25:56.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0700e2657a59364-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.414 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.414 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.414 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.414 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:25:56.414 DEBUG:boto:Data: 2023-12-15T23:25:56.414 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.415 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.415 DEBUG:boto:Params: {} 2023-12-15T23:25:56.415 DEBUG:boto:Token: None 2023-12-15T23:25:56.415 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155 2023-12-15T23:25:56.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w4QyUBR6othsDowHh8Wy4yEznOU= 2023-12-15T23:25:56.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w4QyUBR6othsDowHh8Wy4yEznOU=', 'Content-Length': '0'} 2023-12-15T23:25:56.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096a9ed1601733071-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:25:56.417 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.418 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.418 DEBUG:boto:Method: GET 2023-12-15T23:25:56.418 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:25:56.418 DEBUG:boto:Data: 2023-12-15T23:25:56.418 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.418 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.418 DEBUG:boto:Params: {} 2023-12-15T23:25:56.418 DEBUG:boto:Token: None 2023-12-15T23:25:56.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155 2023-12-15T23:25:56.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UukpNz6Dk9Zzu5f1oPy9I3rGIr4= 2023-12-15T23:25:56.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UukpNz6Dk9Zzu5f1oPy9I3rGIr4=', 'Content-Length': '0'} 2023-12-15T23:25:56.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037f04e8123a3b29c-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.461 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:25:56.462 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:25:56.462 DEBUG:boto:Method: GET 2023-12-15T23:25:56.462 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:25:56.462 DEBUG:boto:Data: 2023-12-15T23:25:56.462 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.462 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.462 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.462 DEBUG:boto:Params: {} 2023-12-15T23:25:56.462 DEBUG:boto:Token: None 2023-12-15T23:25:56.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj155 2023-12-15T23:25:56.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UukpNz6Dk9Zzu5f1oPy9I3rGIr4= 2023-12-15T23:25:56.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UukpNz6Dk9Zzu5f1oPy9I3rGIr4=', 'Content-Length': '0'} 2023-12-15T23:25:56.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092eee0a2360278bb-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.465 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.465 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.465 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.465 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.466 DEBUG:boto:Method: GET 2023-12-15T23:25:56.466 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.466 DEBUG:boto:Data: 2023-12-15T23:25:56.466 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.466 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.466 DEBUG:boto:Params: {} 2023-12-15T23:25:56.466 DEBUG:boto:Token: None 2023-12-15T23:25:56.466 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae2e4064045488c2-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.469 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.470 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.470 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.470 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.470 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.470 DEBUG:boto:Method: GET 2023-12-15T23:25:56.470 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:25:56.470 DEBUG:boto:Data: 2023-12-15T23:25:56.470 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.470 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.471 DEBUG:boto:Params: {} 2023-12-15T23:25:56.471 DEBUG:boto:Token: None 2023-12-15T23:25:56.471 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.475 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7b1a1d2df2b3e23-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.475 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:25:56.475 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.475 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.476 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.476 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.476 DEBUG:boto:Method: GET 2023-12-15T23:25:56.476 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.476 DEBUG:boto:Data: 2023-12-15T23:25:56.476 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.476 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.476 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.476 DEBUG:boto:Params: {} 2023-12-15T23:25:56.476 DEBUG:boto:Token: None 2023-12-15T23:25:56.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs= 2023-12-15T23:25:56.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs=', 'Content-Length': '0'} 2023-12-15T23:25:56.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e2e9cd3f3bb2812-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.479 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.479 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.479 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.479 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.479 DEBUG:boto:Method: GET 2023-12-15T23:25:56.479 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.479 DEBUG:boto:Data: 2023-12-15T23:25:56.479 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.479 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.479 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.480 DEBUG:boto:Params: {} 2023-12-15T23:25:56.480 DEBUG:boto:Token: None 2023-12-15T23:25:56.480 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.480 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs= 2023-12-15T23:25:56.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs=', 'Content-Length': '0'} 2023-12-15T23:25:56.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092cd82c11952f0e9-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.526 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.526 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.526 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.526 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.526 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.526 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.526 DEBUG:boto:Data: 2023-12-15T23:25:56.526 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.526 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.526 DEBUG:boto:Params: {} 2023-12-15T23:25:56.527 DEBUG:boto:Token: None 2023-12-15T23:25:56.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9aS3lf3W1+1eU5hoPdSNsj9w7lE= 2023-12-15T23:25:56.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9aS3lf3W1+1eU5hoPdSNsj9w7lE=', 'Content-Length': '0'} 2023-12-15T23:25:56.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b753a040c938107-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.529 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.529 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.529 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.529 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.529 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.530 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.530 DEBUG:boto:Data: 2023-12-15T23:25:56.530 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.530 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.530 DEBUG:boto:Params: {} 2023-12-15T23:25:56.530 DEBUG:boto:Token: None 2023-12-15T23:25:56.530 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9aS3lf3W1+1eU5hoPdSNsj9w7lE= 2023-12-15T23:25:56.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9aS3lf3W1+1eU5hoPdSNsj9w7lE=', 'Content-Length': '0'} 2023-12-15T23:25:56.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000368f981b405a914-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:25:56.532 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.532 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.533 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.533 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.533 DEBUG:boto:Method: GET 2023-12-15T23:25:56.533 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.533 DEBUG:boto:Data: 2023-12-15T23:25:56.533 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.533 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.533 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.533 DEBUG:boto:Params: {} 2023-12-15T23:25:56.533 DEBUG:boto:Token: None 2023-12-15T23:25:56.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs= 2023-12-15T23:25:56.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs=', 'Content-Length': '0'} 2023-12-15T23:25:56.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f55adf8e6cc1d5c-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.536 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.536 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.536 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.536 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.536 DEBUG:boto:Method: GET 2023-12-15T23:25:56.536 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.537 DEBUG:boto:Data: 2023-12-15T23:25:56.537 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.537 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.537 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.537 DEBUG:boto:Params: {} 2023-12-15T23:25:56.537 DEBUG:boto:Token: None 2023-12-15T23:25:56.537 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:25:56.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs= 2023-12-15T23:25:56.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VqIKkVgvQY84MowirujI6ac6fFs=', 'Content-Length': '0'} 2023-12-15T23:25:56.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000facc3cc90228407d-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.540 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.540 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.540 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.540 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.540 DEBUG:boto:Method: GET 2023-12-15T23:25:56.540 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.540 DEBUG:boto:Data: 2023-12-15T23:25:56.540 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.540 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.540 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.541 DEBUG:boto:Params: {} 2023-12-15T23:25:56.541 DEBUG:boto:Token: None 2023-12-15T23:25:56.541 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.541 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc4e40b0f9d4711-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.543 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.544 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.544 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.544 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.544 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.544 DEBUG:boto:Method: GET 2023-12-15T23:25:56.544 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.544 DEBUG:boto:Data: 2023-12-15T23:25:56.544 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.544 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.544 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.545 DEBUG:boto:Params: {} 2023-12-15T23:25:56.545 DEBUG:boto:Token: None 2023-12-15T23:25:56.545 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004260f083cb1a1b31-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.548 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.549 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.549 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.549 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.549 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:25:56.549 DEBUG:boto:Data: 2023-12-15T23:25:56.549 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.549 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.549 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.549 DEBUG:boto:Params: {} 2023-12-15T23:25:56.550 DEBUG:boto:Token: None 2023-12-15T23:25:56.550 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17 2023-12-15T23:25:56.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wbnCfUNAp420HiqRjDTUg6suSTE= 2023-12-15T23:25:56.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wbnCfUNAp420HiqRjDTUg6suSTE=', 'Content-Length': '0'} 2023-12-15T23:25:56.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b080b70ce2f3393-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.552 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.552 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.552 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.552 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:25:56.552 DEBUG:boto:Data: 2023-12-15T23:25:56.552 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.552 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.552 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.553 DEBUG:boto:Params: {} 2023-12-15T23:25:56.553 DEBUG:boto:Token: None 2023-12-15T23:25:56.553 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17 2023-12-15T23:25:56.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wbnCfUNAp420HiqRjDTUg6suSTE= 2023-12-15T23:25:56.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wbnCfUNAp420HiqRjDTUg6suSTE=', 'Content-Length': '0'} 2023-12-15T23:25:56.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7303f11243af8a7-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:25:56.555 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.555 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.555 DEBUG:boto:Method: GET 2023-12-15T23:25:56.555 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:25:56.555 DEBUG:boto:Data: 2023-12-15T23:25:56.555 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.555 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.556 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.556 DEBUG:boto:Params: {} 2023-12-15T23:25:56.556 DEBUG:boto:Token: None 2023-12-15T23:25:56.556 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17 2023-12-15T23:25:56.556 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jFxOqajv/iIkl/PU0eY34BXdQls= 2023-12-15T23:25:56.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jFxOqajv/iIkl/PU0eY34BXdQls=', 'Content-Length': '0'} 2023-12-15T23:25:56.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe328aafd797fdc0-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.558 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:25:56.558 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:25:56.558 DEBUG:boto:Method: GET 2023-12-15T23:25:56.558 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:25:56.558 DEBUG:boto:Data: 2023-12-15T23:25:56.559 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.559 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.559 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.559 DEBUG:boto:Params: {} 2023-12-15T23:25:56.559 DEBUG:boto:Token: None 2023-12-15T23:25:56.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj17 2023-12-15T23:25:56.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jFxOqajv/iIkl/PU0eY34BXdQls= 2023-12-15T23:25:56.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jFxOqajv/iIkl/PU0eY34BXdQls=', 'Content-Length': '0'} 2023-12-15T23:25:56.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016ae5226c26e0d30-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.562 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.562 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.562 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.562 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.562 DEBUG:boto:Method: GET 2023-12-15T23:25:56.562 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.562 DEBUG:boto:Data: 2023-12-15T23:25:56.562 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.562 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.562 DEBUG:boto:Params: {} 2023-12-15T23:25:56.563 DEBUG:boto:Token: None 2023-12-15T23:25:56.563 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1a9f9a915e70d66-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.565 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.566 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.566 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.566 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.566 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.566 DEBUG:boto:Method: GET 2023-12-15T23:25:56.566 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:25:56.566 DEBUG:boto:Data: 2023-12-15T23:25:56.566 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.566 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.567 DEBUG:boto:Params: {} 2023-12-15T23:25:56.567 DEBUG:boto:Token: None 2023-12-15T23:25:56.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.571 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095d20ad74a45ce03-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.571 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:25:56.571 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.571 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.571 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.571 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.572 DEBUG:boto:Method: GET 2023-12-15T23:25:56.572 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.572 DEBUG:boto:Data: 2023-12-15T23:25:56.572 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.572 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.572 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.572 DEBUG:boto:Params: {} 2023-12-15T23:25:56.572 DEBUG:boto:Token: None 2023-12-15T23:25:56.572 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM= 2023-12-15T23:25:56.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM=', 'Content-Length': '0'} 2023-12-15T23:25:56.575 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae41f5c61fd81d2a-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.575 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.575 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.575 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.575 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.576 DEBUG:boto:Method: GET 2023-12-15T23:25:56.576 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.576 DEBUG:boto:Data: 2023-12-15T23:25:56.576 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.576 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.576 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.576 DEBUG:boto:Params: {} 2023-12-15T23:25:56.576 DEBUG:boto:Token: None 2023-12-15T23:25:56.576 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.577 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM= 2023-12-15T23:25:56.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM=', 'Content-Length': '0'} 2023-12-15T23:25:56.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001363d31a2fe1a90d-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.621 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.622 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.622 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.622 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.622 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.622 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.622 DEBUG:boto:Data: 2023-12-15T23:25:56.622 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.622 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.622 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.622 DEBUG:boto:Params: {} 2023-12-15T23:25:56.622 DEBUG:boto:Token: None 2023-12-15T23:25:56.623 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/HDcxmkael4ghkyKqtkLJdYgvo= 2023-12-15T23:25:56.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/HDcxmkael4ghkyKqtkLJdYgvo=', 'Content-Length': '0'} 2023-12-15T23:25:56.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfbec3064af4295f-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.625 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.625 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.625 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.626 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.626 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.626 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.626 DEBUG:boto:Data: 2023-12-15T23:25:56.626 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.626 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.626 DEBUG:boto:Params: {} 2023-12-15T23:25:56.626 DEBUG:boto:Token: None 2023-12-15T23:25:56.626 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0/HDcxmkael4ghkyKqtkLJdYgvo= 2023-12-15T23:25:56.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0/HDcxmkael4ghkyKqtkLJdYgvo=', 'Content-Length': '0'} 2023-12-15T23:25:56.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000358d654ed5b77010-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:25:56.629 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.629 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.629 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.629 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.630 DEBUG:boto:Method: GET 2023-12-15T23:25:56.630 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.630 DEBUG:boto:Data: 2023-12-15T23:25:56.630 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.630 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.630 DEBUG:boto:Params: {} 2023-12-15T23:25:56.630 DEBUG:boto:Token: None 2023-12-15T23:25:56.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM= 2023-12-15T23:25:56.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM=', 'Content-Length': '0'} 2023-12-15T23:25:56.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000802e96eb64b42ff3-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.632 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.633 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.633 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.633 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.633 DEBUG:boto:Method: GET 2023-12-15T23:25:56.633 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.633 DEBUG:boto:Data: 2023-12-15T23:25:56.633 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.633 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.633 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.633 DEBUG:boto:Params: {} 2023-12-15T23:25:56.634 DEBUG:boto:Token: None 2023-12-15T23:25:56.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:25:56.634 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM= 2023-12-15T23:25:56.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dARfOcIXhzLkc+h392JhXsTDmfM=', 'Content-Length': '0'} 2023-12-15T23:25:56.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000728c977a8e2936a6-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.636 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.636 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.636 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.636 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.636 DEBUG:boto:Method: GET 2023-12-15T23:25:56.637 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.637 DEBUG:boto:Data: 2023-12-15T23:25:56.637 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.637 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.637 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.637 DEBUG:boto:Params: {} 2023-12-15T23:25:56.637 DEBUG:boto:Token: None 2023-12-15T23:25:56.637 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.637 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094a751da17429b09-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.640 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.640 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.640 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.641 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.641 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.641 DEBUG:boto:Method: GET 2023-12-15T23:25:56.641 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.641 DEBUG:boto:Data: 2023-12-15T23:25:56.641 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.641 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.641 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.641 DEBUG:boto:Params: {} 2023-12-15T23:25:56.641 DEBUG:boto:Token: None 2023-12-15T23:25:56.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf494fe66f17713d-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.646 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.646 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.646 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.646 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.646 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:25:56.647 DEBUG:boto:Data: 2023-12-15T23:25:56.647 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.647 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.647 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.647 DEBUG:boto:Params: {} 2023-12-15T23:25:56.647 DEBUG:boto:Token: None 2023-12-15T23:25:56.647 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185 2023-12-15T23:25:56.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T1iT2EwdGnp7ImUQRLPnWt3jh8E= 2023-12-15T23:25:56.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T1iT2EwdGnp7ImUQRLPnWt3jh8E=', 'Content-Length': '0'} 2023-12-15T23:25:56.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008759ec9824128250-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.650 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.650 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.650 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.650 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:25:56.650 DEBUG:boto:Data: 2023-12-15T23:25:56.650 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.650 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.650 DEBUG:boto:Params: {} 2023-12-15T23:25:56.650 DEBUG:boto:Token: None 2023-12-15T23:25:56.651 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185 2023-12-15T23:25:56.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T1iT2EwdGnp7ImUQRLPnWt3jh8E= 2023-12-15T23:25:56.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T1iT2EwdGnp7ImUQRLPnWt3jh8E=', 'Content-Length': '0'} 2023-12-15T23:25:56.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc39f098aee0f78d-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:25:56.653 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.653 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.654 DEBUG:boto:Method: GET 2023-12-15T23:25:56.654 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:25:56.654 DEBUG:boto:Data: 2023-12-15T23:25:56.654 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.654 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.654 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.654 DEBUG:boto:Params: {} 2023-12-15T23:25:56.654 DEBUG:boto:Token: None 2023-12-15T23:25:56.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185 2023-12-15T23:25:56.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dPGrf1yX4Z1VIYaiZPGEi1muONg= 2023-12-15T23:25:56.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dPGrf1yX4Z1VIYaiZPGEi1muONg=', 'Content-Length': '0'} 2023-12-15T23:25:56.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006426577891d9a14d-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.697 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:25:56.698 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:25:56.698 DEBUG:boto:Method: GET 2023-12-15T23:25:56.698 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:25:56.698 DEBUG:boto:Data: 2023-12-15T23:25:56.698 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.698 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.698 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.698 DEBUG:boto:Params: {} 2023-12-15T23:25:56.698 DEBUG:boto:Token: None 2023-12-15T23:25:56.699 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj185 2023-12-15T23:25:56.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dPGrf1yX4Z1VIYaiZPGEi1muONg= 2023-12-15T23:25:56.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dPGrf1yX4Z1VIYaiZPGEi1muONg=', 'Content-Length': '0'} 2023-12-15T23:25:56.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008242cd45d65c37be-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.702 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.702 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.702 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.702 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.702 DEBUG:boto:Method: GET 2023-12-15T23:25:56.702 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.702 DEBUG:boto:Data: 2023-12-15T23:25:56.702 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.702 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.703 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.703 DEBUG:boto:Params: {} 2023-12-15T23:25:56.703 DEBUG:boto:Token: None 2023-12-15T23:25:56.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000246e38e3eef9c692-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.706 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.706 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.706 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.706 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.706 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.706 DEBUG:boto:Method: GET 2023-12-15T23:25:56.707 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:25:56.707 DEBUG:boto:Data: 2023-12-15T23:25:56.707 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.707 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.707 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.707 DEBUG:boto:Params: {} 2023-12-15T23:25:56.707 DEBUG:boto:Token: None 2023-12-15T23:25:56.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.711 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b612fa2e578ee52-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.753 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:25:56.754 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.754 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.754 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.754 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.754 DEBUG:boto:Method: GET 2023-12-15T23:25:56.755 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.755 DEBUG:boto:Data: 2023-12-15T23:25:56.755 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.755 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.755 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.755 DEBUG:boto:Params: {} 2023-12-15T23:25:56.755 DEBUG:boto:Token: None 2023-12-15T23:25:56.755 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8= 2023-12-15T23:25:56.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8=', 'Content-Length': '0'} 2023-12-15T23:25:56.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b049907b1a357691-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.758 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.758 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.758 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.758 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.759 DEBUG:boto:Method: GET 2023-12-15T23:25:56.759 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.759 DEBUG:boto:Data: 2023-12-15T23:25:56.759 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.759 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.759 DEBUG:boto:Params: {} 2023-12-15T23:25:56.759 DEBUG:boto:Token: None 2023-12-15T23:25:56.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8= 2023-12-15T23:25:56.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8=', 'Content-Length': '0'} 2023-12-15T23:25:56.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000637ec3c0a0d1c571-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.762 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.762 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.763 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.763 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.763 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.763 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.763 DEBUG:boto:Data: 2023-12-15T23:25:56.763 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.763 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.763 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.763 DEBUG:boto:Params: {} 2023-12-15T23:25:56.763 DEBUG:boto:Token: None 2023-12-15T23:25:56.764 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:25QDsle6Vq1K+NGTM1k1thW46Rk= 2023-12-15T23:25:56.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:25QDsle6Vq1K+NGTM1k1thW46Rk=', 'Content-Length': '0'} 2023-12-15T23:25:56.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2a33544477289ca-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.766 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.766 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.766 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.767 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.767 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.767 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.767 DEBUG:boto:Data: 2023-12-15T23:25:56.767 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.767 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.767 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.767 DEBUG:boto:Params: {} 2023-12-15T23:25:56.767 DEBUG:boto:Token: None 2023-12-15T23:25:56.767 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:25QDsle6Vq1K+NGTM1k1thW46Rk= 2023-12-15T23:25:56.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:25QDsle6Vq1K+NGTM1k1thW46Rk=', 'Content-Length': '0'} 2023-12-15T23:25:56.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021189b2ea8864c2f-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.770 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:25:56.770 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.770 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.771 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.771 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.771 DEBUG:boto:Method: GET 2023-12-15T23:25:56.771 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.771 DEBUG:boto:Data: 2023-12-15T23:25:56.771 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.771 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.771 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.771 DEBUG:boto:Params: {} 2023-12-15T23:25:56.771 DEBUG:boto:Token: None 2023-12-15T23:25:56.772 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.772 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8= 2023-12-15T23:25:56.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8=', 'Content-Length': '0'} 2023-12-15T23:25:56.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d527441bb5376f39-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.817 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.818 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.818 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.818 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.818 DEBUG:boto:Method: GET 2023-12-15T23:25:56.818 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.818 DEBUG:boto:Data: 2023-12-15T23:25:56.818 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.818 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.818 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.818 DEBUG:boto:Params: {} 2023-12-15T23:25:56.819 DEBUG:boto:Token: None 2023-12-15T23:25:56.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:25:56.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8= 2023-12-15T23:25:56.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Le3SFVhOA5oqjIcdCfsrmteAb8=', 'Content-Length': '0'} 2023-12-15T23:25:56.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb2fac97011bf5d7-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.822 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.822 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.822 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.822 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.822 DEBUG:boto:Method: GET 2023-12-15T23:25:56.822 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.822 DEBUG:boto:Data: 2023-12-15T23:25:56.823 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.823 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.823 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.823 DEBUG:boto:Params: {} 2023-12-15T23:25:56.823 DEBUG:boto:Token: None 2023-12-15T23:25:56.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2c51291657b4ba7-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.826 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.826 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.826 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.826 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.827 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.827 DEBUG:boto:Method: GET 2023-12-15T23:25:56.827 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.827 DEBUG:boto:Data: 2023-12-15T23:25:56.827 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.827 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.827 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.827 DEBUG:boto:Params: {} 2023-12-15T23:25:56.828 DEBUG:boto:Token: None 2023-12-15T23:25:56.828 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.828 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9030e3bab2dee5f-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.877 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.878 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.878 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.878 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.878 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:25:56.878 DEBUG:boto:Data: 2023-12-15T23:25:56.878 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.878 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.879 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.879 DEBUG:boto:Params: {} 2023-12-15T23:25:56.879 DEBUG:boto:Token: None 2023-12-15T23:25:56.879 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19 2023-12-15T23:25:56.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C/wisY6E2WrJse4WokocFLulMDg= 2023-12-15T23:25:56.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C/wisY6E2WrJse4WokocFLulMDg=', 'Content-Length': '0'} 2023-12-15T23:25:56.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094870a4f0951cbba-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.882 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.882 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.882 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.882 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:25:56.882 DEBUG:boto:Data: 2023-12-15T23:25:56.882 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.882 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.882 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.882 DEBUG:boto:Params: {} 2023-12-15T23:25:56.883 DEBUG:boto:Token: None 2023-12-15T23:25:56.883 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19 2023-12-15T23:25:56.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:C/wisY6E2WrJse4WokocFLulMDg= 2023-12-15T23:25:56.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:C/wisY6E2WrJse4WokocFLulMDg=', 'Content-Length': '0'} 2023-12-15T23:25:56.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d8189b3f0e99c01-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.885 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:25:56.885 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.885 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.885 DEBUG:boto:Method: GET 2023-12-15T23:25:56.885 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:25:56.886 DEBUG:boto:Data: 2023-12-15T23:25:56.886 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.886 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.886 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.886 DEBUG:boto:Params: {} 2023-12-15T23:25:56.886 DEBUG:boto:Token: None 2023-12-15T23:25:56.886 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19 2023-12-15T23:25:56.886 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xzTnix8GeqhAM/s90FY1uneNnIg= 2023-12-15T23:25:56.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xzTnix8GeqhAM/s90FY1uneNnIg=', 'Content-Length': '0'} 2023-12-15T23:25:56.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030e84f040396989e-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.889 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:25:56.889 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:25:56.889 DEBUG:boto:Method: GET 2023-12-15T23:25:56.889 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:25:56.889 DEBUG:boto:Data: 2023-12-15T23:25:56.890 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.890 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.890 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.890 DEBUG:boto:Params: {} 2023-12-15T23:25:56.890 DEBUG:boto:Token: None 2023-12-15T23:25:56.890 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj19 2023-12-15T23:25:56.890 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xzTnix8GeqhAM/s90FY1uneNnIg= 2023-12-15T23:25:56.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xzTnix8GeqhAM/s90FY1uneNnIg=', 'Content-Length': '0'} 2023-12-15T23:25:56.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a1a4d2d0118b26e-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.893 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.893 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.893 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.893 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.893 DEBUG:boto:Method: GET 2023-12-15T23:25:56.893 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.893 DEBUG:boto:Data: 2023-12-15T23:25:56.893 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.894 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.894 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.894 DEBUG:boto:Params: {} 2023-12-15T23:25:56.894 DEBUG:boto:Token: None 2023-12-15T23:25:56.894 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.894 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005cf5efb8b8c45c6d-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.897 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.897 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.898 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.898 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.898 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.898 DEBUG:boto:Method: GET 2023-12-15T23:25:56.898 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:25:56.898 DEBUG:boto:Data: 2023-12-15T23:25:56.898 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.898 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.898 DEBUG:boto:Params: {} 2023-12-15T23:25:56.899 DEBUG:boto:Token: None 2023-12-15T23:25:56.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.902 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c66e02a7a733ca0-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.903 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:25:56.903 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.903 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.903 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.903 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.904 DEBUG:boto:Method: GET 2023-12-15T23:25:56.904 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.904 DEBUG:boto:Data: 2023-12-15T23:25:56.904 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.904 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.904 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.904 DEBUG:boto:Params: {} 2023-12-15T23:25:56.904 DEBUG:boto:Token: None 2023-12-15T23:25:56.904 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.905 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds= 2023-12-15T23:25:56.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds=', 'Content-Length': '0'} 2023-12-15T23:25:56.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b0a4245b0e26ea0-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.907 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.907 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.907 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.907 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.908 DEBUG:boto:Method: GET 2023-12-15T23:25:56.908 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.908 DEBUG:boto:Data: 2023-12-15T23:25:56.908 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.908 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.908 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.908 DEBUG:boto:Params: {} 2023-12-15T23:25:56.908 DEBUG:boto:Token: None 2023-12-15T23:25:56.908 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.909 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds= 2023-12-15T23:25:56.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds=', 'Content-Length': '0'} 2023-12-15T23:25:56.911 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7a3bbe95e7f978d-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.911 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.911 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.911 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.911 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.912 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.912 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.912 DEBUG:boto:Data: 2023-12-15T23:25:56.912 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.912 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.912 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.912 DEBUG:boto:Params: {} 2023-12-15T23:25:56.912 DEBUG:boto:Token: None 2023-12-15T23:25:56.913 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.913 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ibljptk+D/XrhYoGiNRlyTIn8D8= 2023-12-15T23:25:56.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ibljptk+D/XrhYoGiNRlyTIn8D8=', 'Content-Length': '0'} 2023-12-15T23:25:56.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c5f3635ec43ac5c-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.915 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.915 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.915 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.915 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.915 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.915 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.915 DEBUG:boto:Data: 2023-12-15T23:25:56.915 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.916 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.916 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.916 DEBUG:boto:Params: {} 2023-12-15T23:25:56.916 DEBUG:boto:Token: None 2023-12-15T23:25:56.916 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ibljptk+D/XrhYoGiNRlyTIn8D8= 2023-12-15T23:25:56.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ibljptk+D/XrhYoGiNRlyTIn8D8=', 'Content-Length': '0'} 2023-12-15T23:25:56.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5e0bde294259950-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.918 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:25:56.919 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.919 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.919 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.919 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.919 DEBUG:boto:Method: GET 2023-12-15T23:25:56.919 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.919 DEBUG:boto:Data: 2023-12-15T23:25:56.919 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.920 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.920 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.920 DEBUG:boto:Params: {} 2023-12-15T23:25:56.920 DEBUG:boto:Token: None 2023-12-15T23:25:56.920 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.920 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds= 2023-12-15T23:25:56.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds=', 'Content-Length': '0'} 2023-12-15T23:25:56.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b71b12cac87418b0-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.965 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.966 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.966 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.966 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.966 DEBUG:boto:Method: GET 2023-12-15T23:25:56.967 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.967 DEBUG:boto:Data: 2023-12-15T23:25:56.967 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.967 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.967 DEBUG:boto:Params: {} 2023-12-15T23:25:56.967 DEBUG:boto:Token: None 2023-12-15T23:25:56.968 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:25:56.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds= 2023-12-15T23:25:56.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:davfW9+bfVhw2I0HtOcza6dhgds=', 'Content-Length': '0'} 2023-12-15T23:25:56.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000705f3331b2b8dc50-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.970 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.970 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.971 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.971 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.971 DEBUG:boto:Method: GET 2023-12-15T23:25:56.971 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.971 DEBUG:boto:Data: 2023-12-15T23:25:56.971 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.971 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.972 DEBUG:boto:Params: {} 2023-12-15T23:25:56.972 DEBUG:boto:Token: None 2023-12-15T23:25:56.972 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f675dbb50d82f042-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.974 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.975 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.975 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.975 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.975 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.976 DEBUG:boto:Method: GET 2023-12-15T23:25:56.976 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.976 DEBUG:boto:Data: 2023-12-15T23:25:56.976 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.976 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.976 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.976 DEBUG:boto:Params: {} 2023-12-15T23:25:56.976 DEBUG:boto:Token: None 2023-12-15T23:25:56.977 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.977 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:56.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:56.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ff6ef49b9d582d5-00657ce084-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.981 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:56.981 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.981 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.981 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.982 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:25:56.982 DEBUG:boto:Data: 2023-12-15T23:25:56.982 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.982 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.982 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.982 DEBUG:boto:Params: {} 2023-12-15T23:25:56.982 DEBUG:boto:Token: None 2023-12-15T23:25:56.983 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22 2023-12-15T23:25:56.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EseAfo8xv9lpJOJdDrXsMzvifEQ= 2023-12-15T23:25:56.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EseAfo8xv9lpJOJdDrXsMzvifEQ=', 'Content-Length': '0'} 2023-12-15T23:25:56.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fcfd9b68e7df62e-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.985 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.985 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.986 DEBUG:boto:Method: HEAD 2023-12-15T23:25:56.986 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:25:56.986 DEBUG:boto:Data: 2023-12-15T23:25:56.986 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.986 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.986 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.986 DEBUG:boto:Params: {} 2023-12-15T23:25:56.987 DEBUG:boto:Token: None 2023-12-15T23:25:56.987 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22 2023-12-15T23:25:56.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EseAfo8xv9lpJOJdDrXsMzvifEQ= 2023-12-15T23:25:56.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EseAfo8xv9lpJOJdDrXsMzvifEQ=', 'Content-Length': '0'} 2023-12-15T23:25:56.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aba7eb658c01b91a-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:25:56.989 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.990 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.990 DEBUG:boto:Method: GET 2023-12-15T23:25:56.990 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:25:56.990 DEBUG:boto:Data: 2023-12-15T23:25:56.990 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.990 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.990 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.990 DEBUG:boto:Params: {} 2023-12-15T23:25:56.991 DEBUG:boto:Token: None 2023-12-15T23:25:56.991 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22 2023-12-15T23:25:56.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eAeM+469fJveQ36kHPZwsRYBw9c= 2023-12-15T23:25:56.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eAeM+469fJveQ36kHPZwsRYBw9c=', 'Content-Length': '0'} 2023-12-15T23:25:56.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c97cb8929083b102-00657ce084-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.994 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:25:56.994 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:25:56.994 DEBUG:boto:Method: GET 2023-12-15T23:25:56.994 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:25:56.994 DEBUG:boto:Data: 2023-12-15T23:25:56.994 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:56.995 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.995 DEBUG:boto:Params: {} 2023-12-15T23:25:56.995 DEBUG:boto:Token: None 2023-12-15T23:25:56.995 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/obj22 2023-12-15T23:25:56.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eAeM+469fJveQ36kHPZwsRYBw9c= 2023-12-15T23:25:56.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eAeM+469fJveQ36kHPZwsRYBw9c=', 'Content-Length': '0'} 2023-12-15T23:25:56.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000639b5b9d4acbc27-00657ce084-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:56 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:56.998 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:56.998 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:56.998 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.998 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.998 DEBUG:boto:Method: GET 2023-12-15T23:25:56.999 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:25:56.999 DEBUG:boto:Data: 2023-12-15T23:25:56.999 DEBUG:boto:Headers: {} 2023-12-15T23:25:56.999 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:56.999 DEBUG:boto:Port: 8000 2023-12-15T23:25:56.999 DEBUG:boto:Params: {} 2023-12-15T23:25:56.999 DEBUG:boto:Token: None 2023-12-15T23:25:56.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:56 GMT /kskgfn-49/ 2023-12-15T23:25:56.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU= 2023-12-15T23:25:57.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:56 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mGfehdc32yOrGVdb/T3kXjiKgZU=', 'Content-Length': '0'} 2023-12-15T23:25:57.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a03f61a6c1605ad-00657ce084-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.002 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.002 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.002 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.003 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:57.003 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:25:57.003 DEBUG:boto:Method: GET 2023-12-15T23:25:57.003 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:25:57.003 DEBUG:boto:Data: 2023-12-15T23:25:57.003 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.003 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.003 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.003 DEBUG:boto:Params: {} 2023-12-15T23:25:57.003 DEBUG:boto:Token: None 2023-12-15T23:25:57.004 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4a22240ae68f6db-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.008 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.008 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:25:57.008 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.008 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.008 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.008 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.008 DEBUG:boto:Method: GET 2023-12-15T23:25:57.008 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.009 DEBUG:boto:Data: 2023-12-15T23:25:57.009 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.009 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.009 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.009 DEBUG:boto:Params: {} 2023-12-15T23:25:57.009 DEBUG:boto:Token: None 2023-12-15T23:25:57.009 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.009 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8= 2023-12-15T23:25:57.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8=', 'Content-Length': '0'} 2023-12-15T23:25:57.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009beb562f7f23a3b4-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.057 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.058 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.058 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.058 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.058 DEBUG:boto:Method: GET 2023-12-15T23:25:57.058 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.058 DEBUG:boto:Data: 2023-12-15T23:25:57.058 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.058 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.058 DEBUG:boto:Params: {} 2023-12-15T23:25:57.058 DEBUG:boto:Token: None 2023-12-15T23:25:57.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8= 2023-12-15T23:25:57.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8=', 'Content-Length': '0'} 2023-12-15T23:25:57.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd55f68cf806df47-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.061 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.061 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.061 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.061 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.061 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.062 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.062 DEBUG:boto:Data: 2023-12-15T23:25:57.062 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.062 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.062 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.062 DEBUG:boto:Params: {} 2023-12-15T23:25:57.062 DEBUG:boto:Token: None 2023-12-15T23:25:57.062 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.062 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W42Og5N1yUxBZU90vTSowzilPGg= 2023-12-15T23:25:57.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W42Og5N1yUxBZU90vTSowzilPGg=', 'Content-Length': '0'} 2023-12-15T23:25:57.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006739a82ad7ba0de8-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.064 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.065 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.065 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.065 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.065 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.065 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.065 DEBUG:boto:Data: 2023-12-15T23:25:57.065 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.065 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.065 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.065 DEBUG:boto:Params: {} 2023-12-15T23:25:57.066 DEBUG:boto:Token: None 2023-12-15T23:25:57.066 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.066 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:W42Og5N1yUxBZU90vTSowzilPGg= 2023-12-15T23:25:57.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:W42Og5N1yUxBZU90vTSowzilPGg=', 'Content-Length': '0'} 2023-12-15T23:25:57.068 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ecb7d1147d2df44-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:25:57.068 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.068 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.068 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.068 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.069 DEBUG:boto:Method: GET 2023-12-15T23:25:57.069 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.069 DEBUG:boto:Data: 2023-12-15T23:25:57.069 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.069 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.069 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.069 DEBUG:boto:Params: {} 2023-12-15T23:25:57.069 DEBUG:boto:Token: None 2023-12-15T23:25:57.069 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.070 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8= 2023-12-15T23:25:57.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8=', 'Content-Length': '0'} 2023-12-15T23:25:57.072 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000891cdba066bcf614-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.072 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.072 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.072 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.072 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.072 DEBUG:boto:Method: GET 2023-12-15T23:25:57.073 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.073 DEBUG:boto:Data: 2023-12-15T23:25:57.073 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.073 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.073 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.073 DEBUG:boto:Params: {} 2023-12-15T23:25:57.073 DEBUG:boto:Token: None 2023-12-15T23:25:57.073 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:25:57.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8= 2023-12-15T23:25:57.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AeQAcF9AH182WEhmmBaC/W/7ZI8=', 'Content-Length': '0'} 2023-12-15T23:25:57.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021a17d905befa16a-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.075 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.075 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.076 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.076 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.076 DEBUG:boto:Method: GET 2023-12-15T23:25:57.076 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.076 DEBUG:boto:Data: 2023-12-15T23:25:57.076 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.076 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.076 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.076 DEBUG:boto:Params: {} 2023-12-15T23:25:57.076 DEBUG:boto:Token: None 2023-12-15T23:25:57.077 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.077 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.079 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea277a4e63034882-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.079 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.080 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.080 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.080 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.080 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.080 DEBUG:boto:Method: GET 2023-12-15T23:25:57.080 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.080 DEBUG:boto:Data: 2023-12-15T23:25:57.080 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.081 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.081 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.081 DEBUG:boto:Params: {} 2023-12-15T23:25:57.081 DEBUG:boto:Token: None 2023-12-15T23:25:57.081 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.081 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000babe38c4d20c04af-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.085 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.085 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.085 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.085 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.086 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:25:57.086 DEBUG:boto:Data: 2023-12-15T23:25:57.086 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.086 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.086 DEBUG:boto:Params: {} 2023-12-15T23:25:57.086 DEBUG:boto:Token: None 2023-12-15T23:25:57.086 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23 2023-12-15T23:25:57.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7FxvGiaYuuoOsUibRvo4G3aF4PM= 2023-12-15T23:25:57.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7FxvGiaYuuoOsUibRvo4G3aF4PM=', 'Content-Length': '0'} 2023-12-15T23:25:57.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001eb0c86cd5aa17a3-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.088 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.088 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.089 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.089 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:25:57.089 DEBUG:boto:Data: 2023-12-15T23:25:57.089 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.089 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.089 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.089 DEBUG:boto:Params: {} 2023-12-15T23:25:57.089 DEBUG:boto:Token: None 2023-12-15T23:25:57.089 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23 2023-12-15T23:25:57.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7FxvGiaYuuoOsUibRvo4G3aF4PM= 2023-12-15T23:25:57.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7FxvGiaYuuoOsUibRvo4G3aF4PM=', 'Content-Length': '0'} 2023-12-15T23:25:57.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000633c8b9a2af1d68c-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:25:57.094 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.094 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.094 DEBUG:boto:Method: GET 2023-12-15T23:25:57.094 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:25:57.095 DEBUG:boto:Data: 2023-12-15T23:25:57.095 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.095 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.095 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.095 DEBUG:boto:Params: {} 2023-12-15T23:25:57.095 DEBUG:boto:Token: None 2023-12-15T23:25:57.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23 2023-12-15T23:25:57.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yDBdic37tHoi1U4VhLS/12SuHxM= 2023-12-15T23:25:57.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yDBdic37tHoi1U4VhLS/12SuHxM=', 'Content-Length': '0'} 2023-12-15T23:25:57.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0d23fd1b371699e-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.098 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:25:57.098 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:25:57.098 DEBUG:boto:Method: GET 2023-12-15T23:25:57.098 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:25:57.098 DEBUG:boto:Data: 2023-12-15T23:25:57.098 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.098 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.098 DEBUG:boto:Params: {} 2023-12-15T23:25:57.098 DEBUG:boto:Token: None 2023-12-15T23:25:57.099 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj23 2023-12-15T23:25:57.099 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yDBdic37tHoi1U4VhLS/12SuHxM= 2023-12-15T23:25:57.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yDBdic37tHoi1U4VhLS/12SuHxM=', 'Content-Length': '0'} 2023-12-15T23:25:57.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da7cb5ccf917e4db-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.141 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.142 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.142 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.142 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.142 DEBUG:boto:Method: GET 2023-12-15T23:25:57.142 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.142 DEBUG:boto:Data: 2023-12-15T23:25:57.142 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.142 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.142 DEBUG:boto:Params: {} 2023-12-15T23:25:57.143 DEBUG:boto:Token: None 2023-12-15T23:25:57.143 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000762589205c070653-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.145 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.146 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.146 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.146 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.146 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.146 DEBUG:boto:Method: GET 2023-12-15T23:25:57.146 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:25:57.146 DEBUG:boto:Data: 2023-12-15T23:25:57.146 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.147 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.147 DEBUG:boto:Params: {} 2023-12-15T23:25:57.147 DEBUG:boto:Token: None 2023-12-15T23:25:57.147 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.150 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c010c8a61b94061-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.151 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:25:57.151 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.151 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.151 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.151 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.151 DEBUG:boto:Method: GET 2023-12-15T23:25:57.152 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.152 DEBUG:boto:Data: 2023-12-15T23:25:57.152 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.152 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.152 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.152 DEBUG:boto:Params: {} 2023-12-15T23:25:57.152 DEBUG:boto:Token: None 2023-12-15T23:25:57.152 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.152 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk= 2023-12-15T23:25:57.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk=', 'Content-Length': '0'} 2023-12-15T23:25:57.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4ebd48259edb086-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.155 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.155 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.155 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.155 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.155 DEBUG:boto:Method: GET 2023-12-15T23:25:57.155 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.155 DEBUG:boto:Data: 2023-12-15T23:25:57.156 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.156 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.156 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.156 DEBUG:boto:Params: {} 2023-12-15T23:25:57.156 DEBUG:boto:Token: None 2023-12-15T23:25:57.156 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.156 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk= 2023-12-15T23:25:57.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk=', 'Content-Length': '0'} 2023-12-15T23:25:57.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002301f7019ff7d223-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.159 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.159 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.159 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.159 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.159 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.159 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.159 DEBUG:boto:Data: 2023-12-15T23:25:57.159 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.159 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.160 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.160 DEBUG:boto:Params: {} 2023-12-15T23:25:57.160 DEBUG:boto:Token: None 2023-12-15T23:25:57.160 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.160 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYGKwOgcyT9Sm9aInE9+MVplL1U= 2023-12-15T23:25:57.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYGKwOgcyT9Sm9aInE9+MVplL1U=', 'Content-Length': '0'} 2023-12-15T23:25:57.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fe1359eb58ba860-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.162 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.163 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.163 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.163 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.163 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.163 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.163 DEBUG:boto:Data: 2023-12-15T23:25:57.163 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.163 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.163 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.163 DEBUG:boto:Params: {} 2023-12-15T23:25:57.163 DEBUG:boto:Token: None 2023-12-15T23:25:57.164 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.164 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lYGKwOgcyT9Sm9aInE9+MVplL1U= 2023-12-15T23:25:57.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lYGKwOgcyT9Sm9aInE9+MVplL1U=', 'Content-Length': '0'} 2023-12-15T23:25:57.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005840bffca4f75741-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:25:57.166 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.166 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.166 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.166 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.166 DEBUG:boto:Method: GET 2023-12-15T23:25:57.167 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.167 DEBUG:boto:Data: 2023-12-15T23:25:57.167 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.167 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.167 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.167 DEBUG:boto:Params: {} 2023-12-15T23:25:57.167 DEBUG:boto:Token: None 2023-12-15T23:25:57.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk= 2023-12-15T23:25:57.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk=', 'Content-Length': '0'} 2023-12-15T23:25:57.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bb84039ec20eee8-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.213 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.213 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.214 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.214 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.214 DEBUG:boto:Method: GET 2023-12-15T23:25:57.214 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.214 DEBUG:boto:Data: 2023-12-15T23:25:57.214 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.214 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.214 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.214 DEBUG:boto:Params: {} 2023-12-15T23:25:57.214 DEBUG:boto:Token: None 2023-12-15T23:25:57.215 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:25:57.215 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk= 2023-12-15T23:25:57.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OINlnnpJkJqZakl9kwtm6lhPJVk=', 'Content-Length': '0'} 2023-12-15T23:25:57.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039a2fa848f4ef637-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.217 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.217 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.217 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.218 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.218 DEBUG:boto:Method: GET 2023-12-15T23:25:57.218 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.218 DEBUG:boto:Data: 2023-12-15T23:25:57.218 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.218 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.218 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.218 DEBUG:boto:Params: {} 2023-12-15T23:25:57.218 DEBUG:boto:Token: None 2023-12-15T23:25:57.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a622196bf8e054d1-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.221 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.221 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.222 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.222 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.222 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.222 DEBUG:boto:Method: GET 2023-12-15T23:25:57.222 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.222 DEBUG:boto:Data: 2023-12-15T23:25:57.222 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.222 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.222 DEBUG:boto:Params: {} 2023-12-15T23:25:57.223 DEBUG:boto:Token: None 2023-12-15T23:25:57.223 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1f090e189b10ffc-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.226 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.227 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.227 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.227 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.227 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:25:57.227 DEBUG:boto:Data: 2023-12-15T23:25:57.227 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.227 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.227 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.227 DEBUG:boto:Params: {} 2023-12-15T23:25:57.228 DEBUG:boto:Token: None 2023-12-15T23:25:57.228 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29 2023-12-15T23:25:57.228 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ch7Zp5fJwh8nmrhAbNUZqquGfwY= 2023-12-15T23:25:57.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ch7Zp5fJwh8nmrhAbNUZqquGfwY=', 'Content-Length': '0'} 2023-12-15T23:25:57.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a19687eabd12fc38-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.230 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.230 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.230 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.230 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:25:57.230 DEBUG:boto:Data: 2023-12-15T23:25:57.230 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.231 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.231 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.231 DEBUG:boto:Params: {} 2023-12-15T23:25:57.231 DEBUG:boto:Token: None 2023-12-15T23:25:57.231 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29 2023-12-15T23:25:57.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ch7Zp5fJwh8nmrhAbNUZqquGfwY= 2023-12-15T23:25:57.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ch7Zp5fJwh8nmrhAbNUZqquGfwY=', 'Content-Length': '0'} 2023-12-15T23:25:57.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c61976564b07baa-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:25:57.234 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.234 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.234 DEBUG:boto:Method: GET 2023-12-15T23:25:57.234 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:25:57.234 DEBUG:boto:Data: 2023-12-15T23:25:57.234 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.234 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.234 DEBUG:boto:Params: {} 2023-12-15T23:25:57.234 DEBUG:boto:Token: None 2023-12-15T23:25:57.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29 2023-12-15T23:25:57.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jsoNoF+A6kv/oiChPX3vftt1eMM= 2023-12-15T23:25:57.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jsoNoF+A6kv/oiChPX3vftt1eMM=', 'Content-Length': '0'} 2023-12-15T23:25:57.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000998d9175545d9583-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.237 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:25:57.237 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:25:57.238 DEBUG:boto:Method: GET 2023-12-15T23:25:57.238 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:25:57.238 DEBUG:boto:Data: 2023-12-15T23:25:57.238 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.238 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.238 DEBUG:boto:Params: {} 2023-12-15T23:25:57.238 DEBUG:boto:Token: None 2023-12-15T23:25:57.238 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj29 2023-12-15T23:25:57.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jsoNoF+A6kv/oiChPX3vftt1eMM= 2023-12-15T23:25:57.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jsoNoF+A6kv/oiChPX3vftt1eMM=', 'Content-Length': '0'} 2023-12-15T23:25:57.240 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088f437d70f2d812b-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.241 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.241 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.241 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.241 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.241 DEBUG:boto:Method: GET 2023-12-15T23:25:57.241 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.241 DEBUG:boto:Data: 2023-12-15T23:25:57.241 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.241 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.241 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.241 DEBUG:boto:Params: {} 2023-12-15T23:25:57.242 DEBUG:boto:Token: None 2023-12-15T23:25:57.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000eab5fa76f7cad9d-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.244 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.245 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.245 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.245 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.245 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.245 DEBUG:boto:Method: GET 2023-12-15T23:25:57.245 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:25:57.245 DEBUG:boto:Data: 2023-12-15T23:25:57.246 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.246 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.246 DEBUG:boto:Params: {} 2023-12-15T23:25:57.246 DEBUG:boto:Token: None 2023-12-15T23:25:57.246 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.246 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e24d5710fdf27e1-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.250 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.250 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:25:57.250 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.251 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.251 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.251 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.251 DEBUG:boto:Method: GET 2023-12-15T23:25:57.251 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.251 DEBUG:boto:Data: 2023-12-15T23:25:57.251 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.251 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.251 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.251 DEBUG:boto:Params: {} 2023-12-15T23:25:57.251 DEBUG:boto:Token: None 2023-12-15T23:25:57.252 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.252 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ= 2023-12-15T23:25:57.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc2ba6dcbb3b01d-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.254 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.254 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.255 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.255 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.255 DEBUG:boto:Method: GET 2023-12-15T23:25:57.255 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.255 DEBUG:boto:Data: 2023-12-15T23:25:57.255 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.255 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.255 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.255 DEBUG:boto:Params: {} 2023-12-15T23:25:57.255 DEBUG:boto:Token: None 2023-12-15T23:25:57.256 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ= 2023-12-15T23:25:57.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb0af9ecaf13528e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.258 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.259 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.259 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.259 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.259 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.259 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.259 DEBUG:boto:Data: 2023-12-15T23:25:57.259 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.259 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.259 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.259 DEBUG:boto:Params: {} 2023-12-15T23:25:57.260 DEBUG:boto:Token: None 2023-12-15T23:25:57.260 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.260 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y+IO/c2sgfPgMA00psNNus83/2s= 2023-12-15T23:25:57.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y+IO/c2sgfPgMA00psNNus83/2s=', 'Content-Length': '0'} 2023-12-15T23:25:57.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e68d28e6e0d3020-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.262 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.262 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.262 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.262 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.262 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.263 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.263 DEBUG:boto:Data: 2023-12-15T23:25:57.263 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.263 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.263 DEBUG:boto:Params: {} 2023-12-15T23:25:57.263 DEBUG:boto:Token: None 2023-12-15T23:25:57.263 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:y+IO/c2sgfPgMA00psNNus83/2s= 2023-12-15T23:25:57.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:y+IO/c2sgfPgMA00psNNus83/2s=', 'Content-Length': '0'} 2023-12-15T23:25:57.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002db14462eb3d1fc8-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.266 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:25:57.266 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.266 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.266 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.266 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.266 DEBUG:boto:Method: GET 2023-12-15T23:25:57.267 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.267 DEBUG:boto:Data: 2023-12-15T23:25:57.267 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.267 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.267 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.267 DEBUG:boto:Params: {} 2023-12-15T23:25:57.267 DEBUG:boto:Token: None 2023-12-15T23:25:57.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ= 2023-12-15T23:25:57.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a02e31d7f10288b-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.314 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.314 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.314 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.314 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.314 DEBUG:boto:Method: GET 2023-12-15T23:25:57.314 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.314 DEBUG:boto:Data: 2023-12-15T23:25:57.314 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.314 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.315 DEBUG:boto:Params: {} 2023-12-15T23:25:57.315 DEBUG:boto:Token: None 2023-12-15T23:25:57.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:25:57.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ= 2023-12-15T23:25:57.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NZYbvVv02Oy5ahgt+FISF0QxrxQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f594926883e199be-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.318 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.318 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.318 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.318 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.318 DEBUG:boto:Method: GET 2023-12-15T23:25:57.318 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.318 DEBUG:boto:Data: 2023-12-15T23:25:57.318 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.318 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.319 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.319 DEBUG:boto:Params: {} 2023-12-15T23:25:57.319 DEBUG:boto:Token: None 2023-12-15T23:25:57.319 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.319 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f35dd4ff5d221c1f-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.322 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.322 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.322 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.322 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.322 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.322 DEBUG:boto:Method: GET 2023-12-15T23:25:57.322 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.322 DEBUG:boto:Data: 2023-12-15T23:25:57.323 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.323 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.323 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.323 DEBUG:boto:Params: {} 2023-12-15T23:25:57.323 DEBUG:boto:Token: None 2023-12-15T23:25:57.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.327 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ee3bd6cd7c5e69e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.327 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.328 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.328 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.328 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.328 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:25:57.328 DEBUG:boto:Data: 2023-12-15T23:25:57.328 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.328 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.328 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.328 DEBUG:boto:Params: {} 2023-12-15T23:25:57.329 DEBUG:boto:Token: None 2023-12-15T23:25:57.329 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31 2023-12-15T23:25:57.329 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i/okyu2eUms2azBMfLZbG1cgoqE= 2023-12-15T23:25:57.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i/okyu2eUms2azBMfLZbG1cgoqE=', 'Content-Length': '0'} 2023-12-15T23:25:57.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa507874e8e96cb5-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.331 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.331 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.331 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.332 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:25:57.332 DEBUG:boto:Data: 2023-12-15T23:25:57.332 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.332 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.332 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.332 DEBUG:boto:Params: {} 2023-12-15T23:25:57.332 DEBUG:boto:Token: None 2023-12-15T23:25:57.332 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31 2023-12-15T23:25:57.332 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i/okyu2eUms2azBMfLZbG1cgoqE= 2023-12-15T23:25:57.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i/okyu2eUms2azBMfLZbG1cgoqE=', 'Content-Length': '0'} 2023-12-15T23:25:57.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000651178e127e9c3f3-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.335 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:25:57.335 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.335 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.335 DEBUG:boto:Method: GET 2023-12-15T23:25:57.335 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:25:57.335 DEBUG:boto:Data: 2023-12-15T23:25:57.336 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.336 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.336 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.336 DEBUG:boto:Params: {} 2023-12-15T23:25:57.336 DEBUG:boto:Token: None 2023-12-15T23:25:57.336 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31 2023-12-15T23:25:57.336 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oAPx1tb0YiMt+s7DCdk/ZGAc0C4= 2023-12-15T23:25:57.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oAPx1tb0YiMt+s7DCdk/ZGAc0C4=', 'Content-Length': '0'} 2023-12-15T23:25:57.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e691025b5a22fdf0-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.339 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:25:57.339 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:25:57.339 DEBUG:boto:Method: GET 2023-12-15T23:25:57.339 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:25:57.339 DEBUG:boto:Data: 2023-12-15T23:25:57.339 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.339 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.339 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.339 DEBUG:boto:Params: {} 2023-12-15T23:25:57.340 DEBUG:boto:Token: None 2023-12-15T23:25:57.340 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj31 2023-12-15T23:25:57.340 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oAPx1tb0YiMt+s7DCdk/ZGAc0C4= 2023-12-15T23:25:57.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oAPx1tb0YiMt+s7DCdk/ZGAc0C4=', 'Content-Length': '0'} 2023-12-15T23:25:57.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f805bef52264a402-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.342 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.342 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.342 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.343 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.343 DEBUG:boto:Method: GET 2023-12-15T23:25:57.343 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.343 DEBUG:boto:Data: 2023-12-15T23:25:57.343 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.343 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.343 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.343 DEBUG:boto:Params: {} 2023-12-15T23:25:57.343 DEBUG:boto:Token: None 2023-12-15T23:25:57.344 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a41dc5262c802483-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.389 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.390 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.390 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.390 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.390 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.390 DEBUG:boto:Method: GET 2023-12-15T23:25:57.390 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:25:57.391 DEBUG:boto:Data: 2023-12-15T23:25:57.391 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.391 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.391 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.391 DEBUG:boto:Params: {} 2023-12-15T23:25:57.391 DEBUG:boto:Token: None 2023-12-15T23:25:57.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a22894bea3db2e16-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.395 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:25:57.396 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.396 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.396 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.396 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.396 DEBUG:boto:Method: GET 2023-12-15T23:25:57.396 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.396 DEBUG:boto:Data: 2023-12-15T23:25:57.397 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.397 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.397 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.397 DEBUG:boto:Params: {} 2023-12-15T23:25:57.397 DEBUG:boto:Token: None 2023-12-15T23:25:57.397 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.397 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY= 2023-12-15T23:25:57.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY=', 'Content-Length': '0'} 2023-12-15T23:25:57.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a915e0b91256eb9-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.400 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.400 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.400 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.400 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.400 DEBUG:boto:Method: GET 2023-12-15T23:25:57.400 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.400 DEBUG:boto:Data: 2023-12-15T23:25:57.401 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.401 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.401 DEBUG:boto:Params: {} 2023-12-15T23:25:57.401 DEBUG:boto:Token: None 2023-12-15T23:25:57.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY= 2023-12-15T23:25:57.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY=', 'Content-Length': '0'} 2023-12-15T23:25:57.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003190071c0746183a-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.445 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.445 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.446 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.446 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.446 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.446 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.446 DEBUG:boto:Data: 2023-12-15T23:25:57.446 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.446 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.446 DEBUG:boto:Params: {} 2023-12-15T23:25:57.447 DEBUG:boto:Token: None 2023-12-15T23:25:57.447 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5xzNcm6hHDYtwn+UYX8fEXx9do= 2023-12-15T23:25:57.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5xzNcm6hHDYtwn+UYX8fEXx9do=', 'Content-Length': '0'} 2023-12-15T23:25:57.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe1e96281bb1f801-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.449 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.450 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.450 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.450 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.450 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.450 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.450 DEBUG:boto:Data: 2023-12-15T23:25:57.450 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.450 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.450 DEBUG:boto:Params: {} 2023-12-15T23:25:57.451 DEBUG:boto:Token: None 2023-12-15T23:25:57.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5xzNcm6hHDYtwn+UYX8fEXx9do= 2023-12-15T23:25:57.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5xzNcm6hHDYtwn+UYX8fEXx9do=', 'Content-Length': '0'} 2023-12-15T23:25:57.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a0e9bf282078e91-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:25:57.453 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.453 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.454 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.454 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.454 DEBUG:boto:Method: GET 2023-12-15T23:25:57.454 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.454 DEBUG:boto:Data: 2023-12-15T23:25:57.454 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.454 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.454 DEBUG:boto:Params: {} 2023-12-15T23:25:57.454 DEBUG:boto:Token: None 2023-12-15T23:25:57.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY= 2023-12-15T23:25:57.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY=', 'Content-Length': '0'} 2023-12-15T23:25:57.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0a4a2b4cedd704b-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.457 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.458 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.458 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.458 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.458 DEBUG:boto:Method: GET 2023-12-15T23:25:57.458 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.458 DEBUG:boto:Data: 2023-12-15T23:25:57.458 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.458 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.459 DEBUG:boto:Params: {} 2023-12-15T23:25:57.459 DEBUG:boto:Token: None 2023-12-15T23:25:57.459 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:25:57.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY= 2023-12-15T23:25:57.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5RV26K69+lj40Rfr04vCqWCkcoY=', 'Content-Length': '0'} 2023-12-15T23:25:57.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f993853c21d64b20-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.462 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.462 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.462 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.462 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.462 DEBUG:boto:Method: GET 2023-12-15T23:25:57.462 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.462 DEBUG:boto:Data: 2023-12-15T23:25:57.462 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.463 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.463 DEBUG:boto:Params: {} 2023-12-15T23:25:57.463 DEBUG:boto:Token: None 2023-12-15T23:25:57.463 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083c8c398d421e64c-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.466 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.466 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.466 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.466 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.466 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.466 DEBUG:boto:Method: GET 2023-12-15T23:25:57.466 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.466 DEBUG:boto:Data: 2023-12-15T23:25:57.467 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.467 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.467 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.467 DEBUG:boto:Params: {} 2023-12-15T23:25:57.467 DEBUG:boto:Token: None 2023-12-15T23:25:57.467 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.471 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e83aa6bb2449a365-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.471 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.471 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.471 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.471 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.471 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:25:57.471 DEBUG:boto:Data: 2023-12-15T23:25:57.472 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.472 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.472 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.472 DEBUG:boto:Params: {} 2023-12-15T23:25:57.472 DEBUG:boto:Token: None 2023-12-15T23:25:57.472 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33 2023-12-15T23:25:57.472 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uAd8h2+74fEoJQ5dxoreOTM28I8= 2023-12-15T23:25:57.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uAd8h2+74fEoJQ5dxoreOTM28I8=', 'Content-Length': '0'} 2023-12-15T23:25:57.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003295ea7fd656002f-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.475 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.475 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.475 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.475 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:25:57.475 DEBUG:boto:Data: 2023-12-15T23:25:57.475 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.475 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.475 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.475 DEBUG:boto:Params: {} 2023-12-15T23:25:57.476 DEBUG:boto:Token: None 2023-12-15T23:25:57.476 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33 2023-12-15T23:25:57.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uAd8h2+74fEoJQ5dxoreOTM28I8= 2023-12-15T23:25:57.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uAd8h2+74fEoJQ5dxoreOTM28I8=', 'Content-Length': '0'} 2023-12-15T23:25:57.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c72f523ecac96d3-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.478 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:25:57.478 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.479 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.479 DEBUG:boto:Method: GET 2023-12-15T23:25:57.479 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:25:57.479 DEBUG:boto:Data: 2023-12-15T23:25:57.479 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.479 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.479 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.479 DEBUG:boto:Params: {} 2023-12-15T23:25:57.479 DEBUG:boto:Token: None 2023-12-15T23:25:57.479 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33 2023-12-15T23:25:57.480 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nasaK37RnrAGWsYgUQtwY69hxWo= 2023-12-15T23:25:57.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nasaK37RnrAGWsYgUQtwY69hxWo=', 'Content-Length': '0'} 2023-12-15T23:25:57.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1ab7cfbfc8ace75-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.529 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:25:57.530 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:25:57.530 DEBUG:boto:Method: GET 2023-12-15T23:25:57.530 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:25:57.530 DEBUG:boto:Data: 2023-12-15T23:25:57.530 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.530 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.530 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.530 DEBUG:boto:Params: {} 2023-12-15T23:25:57.530 DEBUG:boto:Token: None 2023-12-15T23:25:57.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj33 2023-12-15T23:25:57.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nasaK37RnrAGWsYgUQtwY69hxWo= 2023-12-15T23:25:57.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nasaK37RnrAGWsYgUQtwY69hxWo=', 'Content-Length': '0'} 2023-12-15T23:25:57.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d88bb65f16b8c311-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.533 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.533 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.533 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.533 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.534 DEBUG:boto:Method: GET 2023-12-15T23:25:57.534 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.534 DEBUG:boto:Data: 2023-12-15T23:25:57.534 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.534 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.534 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.534 DEBUG:boto:Params: {} 2023-12-15T23:25:57.534 DEBUG:boto:Token: None 2023-12-15T23:25:57.534 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000548be62c873aabae-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.537 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.538 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.538 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.538 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.538 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.538 DEBUG:boto:Method: GET 2023-12-15T23:25:57.538 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:25:57.538 DEBUG:boto:Data: 2023-12-15T23:25:57.538 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.539 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.539 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.539 DEBUG:boto:Params: {} 2023-12-15T23:25:57.539 DEBUG:boto:Token: None 2023-12-15T23:25:57.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0c97592d1694a15-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.543 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:25:57.544 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.544 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.544 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.544 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.544 DEBUG:boto:Method: GET 2023-12-15T23:25:57.544 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.545 DEBUG:boto:Data: 2023-12-15T23:25:57.545 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.545 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.545 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.545 DEBUG:boto:Params: {} 2023-12-15T23:25:57.545 DEBUG:boto:Token: None 2023-12-15T23:25:57.545 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.545 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY= 2023-12-15T23:25:57.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY=', 'Content-Length': '0'} 2023-12-15T23:25:57.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb920e10756d4fdb-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.548 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.548 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.548 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.548 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.548 DEBUG:boto:Method: GET 2023-12-15T23:25:57.548 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.548 DEBUG:boto:Data: 2023-12-15T23:25:57.549 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.549 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.549 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.549 DEBUG:boto:Params: {} 2023-12-15T23:25:57.549 DEBUG:boto:Token: None 2023-12-15T23:25:57.549 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.549 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY= 2023-12-15T23:25:57.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY=', 'Content-Length': '0'} 2023-12-15T23:25:57.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001e3816f76ff7aab-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.552 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.552 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.552 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.552 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.552 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.552 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.553 DEBUG:boto:Data: 2023-12-15T23:25:57.553 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.553 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.553 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.553 DEBUG:boto:Params: {} 2023-12-15T23:25:57.553 DEBUG:boto:Token: None 2023-12-15T23:25:57.553 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2wYZae9cyJFcUpyxwEkT2DL7E8c= 2023-12-15T23:25:57.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2wYZae9cyJFcUpyxwEkT2DL7E8c=', 'Content-Length': '0'} 2023-12-15T23:25:57.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f29d208909154d98-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.556 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.556 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.556 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.556 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.556 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.556 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.556 DEBUG:boto:Data: 2023-12-15T23:25:57.556 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.556 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.557 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.557 DEBUG:boto:Params: {} 2023-12-15T23:25:57.557 DEBUG:boto:Token: None 2023-12-15T23:25:57.557 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.557 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2wYZae9cyJFcUpyxwEkT2DL7E8c= 2023-12-15T23:25:57.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2wYZae9cyJFcUpyxwEkT2DL7E8c=', 'Content-Length': '0'} 2023-12-15T23:25:57.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c881bb2e5860040-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:25:57.560 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.560 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.560 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.560 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.560 DEBUG:boto:Method: GET 2023-12-15T23:25:57.560 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.560 DEBUG:boto:Data: 2023-12-15T23:25:57.560 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.560 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.561 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.561 DEBUG:boto:Params: {} 2023-12-15T23:25:57.561 DEBUG:boto:Token: None 2023-12-15T23:25:57.561 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.561 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY= 2023-12-15T23:25:57.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY=', 'Content-Length': '0'} 2023-12-15T23:25:57.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8d57bd14c151be7-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.564 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.564 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.564 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.564 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.564 DEBUG:boto:Method: GET 2023-12-15T23:25:57.564 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.564 DEBUG:boto:Data: 2023-12-15T23:25:57.565 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.565 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.565 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.565 DEBUG:boto:Params: {} 2023-12-15T23:25:57.565 DEBUG:boto:Token: None 2023-12-15T23:25:57.565 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:25:57.565 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY= 2023-12-15T23:25:57.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U+oUgeJPwa9qtfIXkH8Rc/n4PDY=', 'Content-Length': '0'} 2023-12-15T23:25:57.567 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee15e77f07ceae0f-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.568 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.568 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.568 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.568 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.568 DEBUG:boto:Method: GET 2023-12-15T23:25:57.568 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.568 DEBUG:boto:Data: 2023-12-15T23:25:57.568 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.569 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.569 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.569 DEBUG:boto:Params: {} 2023-12-15T23:25:57.569 DEBUG:boto:Token: None 2023-12-15T23:25:57.569 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.569 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7d2f5d476c98642-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.572 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.572 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.572 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.572 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.573 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.573 DEBUG:boto:Method: GET 2023-12-15T23:25:57.573 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.573 DEBUG:boto:Data: 2023-12-15T23:25:57.573 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.573 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.573 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.573 DEBUG:boto:Params: {} 2023-12-15T23:25:57.573 DEBUG:boto:Token: None 2023-12-15T23:25:57.573 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d625b75133d5952-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.577 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.578 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.578 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.578 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.578 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:25:57.578 DEBUG:boto:Data: 2023-12-15T23:25:57.578 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.578 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.578 DEBUG:boto:Params: {} 2023-12-15T23:25:57.579 DEBUG:boto:Token: None 2023-12-15T23:25:57.579 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34 2023-12-15T23:25:57.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VFiDCeqPqpnnNVIuf+jI0Z2i0c8= 2023-12-15T23:25:57.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VFiDCeqPqpnnNVIuf+jI0Z2i0c8=', 'Content-Length': '0'} 2023-12-15T23:25:57.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4103bad3b3e8313-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.581 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.581 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.581 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.581 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:25:57.582 DEBUG:boto:Data: 2023-12-15T23:25:57.582 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.582 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.582 DEBUG:boto:Params: {} 2023-12-15T23:25:57.582 DEBUG:boto:Token: None 2023-12-15T23:25:57.582 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34 2023-12-15T23:25:57.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VFiDCeqPqpnnNVIuf+jI0Z2i0c8= 2023-12-15T23:25:57.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VFiDCeqPqpnnNVIuf+jI0Z2i0c8=', 'Content-Length': '0'} 2023-12-15T23:25:57.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f88eece0fc8b6d21-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:25:57.584 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.584 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.585 DEBUG:boto:Method: GET 2023-12-15T23:25:57.585 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:25:57.585 DEBUG:boto:Data: 2023-12-15T23:25:57.585 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.585 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.585 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.585 DEBUG:boto:Params: {} 2023-12-15T23:25:57.585 DEBUG:boto:Token: None 2023-12-15T23:25:57.585 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34 2023-12-15T23:25:57.585 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZ2CcfSFN+u9TMddvF3W17mDTRc= 2023-12-15T23:25:57.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZ2CcfSFN+u9TMddvF3W17mDTRc=', 'Content-Length': '0'} 2023-12-15T23:25:57.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027332a69037ea8db-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.588 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:25:57.588 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:25:57.588 DEBUG:boto:Method: GET 2023-12-15T23:25:57.588 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:25:57.588 DEBUG:boto:Data: 2023-12-15T23:25:57.588 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.589 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.589 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.589 DEBUG:boto:Params: {} 2023-12-15T23:25:57.589 DEBUG:boto:Token: None 2023-12-15T23:25:57.589 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj34 2023-12-15T23:25:57.589 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RZ2CcfSFN+u9TMddvF3W17mDTRc= 2023-12-15T23:25:57.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RZ2CcfSFN+u9TMddvF3W17mDTRc=', 'Content-Length': '0'} 2023-12-15T23:25:57.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c92d39af4b9a986d-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.592 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.592 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.592 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.592 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.592 DEBUG:boto:Method: GET 2023-12-15T23:25:57.592 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.592 DEBUG:boto:Data: 2023-12-15T23:25:57.592 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.592 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.593 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.593 DEBUG:boto:Params: {} 2023-12-15T23:25:57.593 DEBUG:boto:Token: None 2023-12-15T23:25:57.593 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.593 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.596 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000229b174e5dc24d56-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.596 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.596 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.596 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.596 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.596 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.597 DEBUG:boto:Method: GET 2023-12-15T23:25:57.597 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:25:57.597 DEBUG:boto:Data: 2023-12-15T23:25:57.597 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.597 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.597 DEBUG:boto:Params: {} 2023-12-15T23:25:57.597 DEBUG:boto:Token: None 2023-12-15T23:25:57.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e18ca56c2b71dcc-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.601 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:25:57.602 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.602 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.602 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.602 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.602 DEBUG:boto:Method: GET 2023-12-15T23:25:57.602 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.602 DEBUG:boto:Data: 2023-12-15T23:25:57.602 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.603 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.603 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.603 DEBUG:boto:Params: {} 2023-12-15T23:25:57.603 DEBUG:boto:Token: None 2023-12-15T23:25:57.603 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0= 2023-12-15T23:25:57.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0=', 'Content-Length': '0'} 2023-12-15T23:25:57.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070cd828fc5392993-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.605 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.605 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.606 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.606 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.606 DEBUG:boto:Method: GET 2023-12-15T23:25:57.606 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.606 DEBUG:boto:Data: 2023-12-15T23:25:57.606 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.606 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.606 DEBUG:boto:Params: {} 2023-12-15T23:25:57.606 DEBUG:boto:Token: None 2023-12-15T23:25:57.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0= 2023-12-15T23:25:57.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0=', 'Content-Length': '0'} 2023-12-15T23:25:57.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6b8bd1dba2f7b3a-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.609 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.609 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.609 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.610 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.610 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.610 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.610 DEBUG:boto:Data: 2023-12-15T23:25:57.610 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.610 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.610 DEBUG:boto:Params: {} 2023-12-15T23:25:57.610 DEBUG:boto:Token: None 2023-12-15T23:25:57.611 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:StLQ+iwSBKl6yAb8KFFd8RqBzLY= 2023-12-15T23:25:57.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:StLQ+iwSBKl6yAb8KFFd8RqBzLY=', 'Content-Length': '0'} 2023-12-15T23:25:57.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000478b4d6676e1231c-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.613 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.613 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.613 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.613 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.614 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.614 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.614 DEBUG:boto:Data: 2023-12-15T23:25:57.614 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.614 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.614 DEBUG:boto:Params: {} 2023-12-15T23:25:57.614 DEBUG:boto:Token: None 2023-12-15T23:25:57.614 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:StLQ+iwSBKl6yAb8KFFd8RqBzLY= 2023-12-15T23:25:57.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:StLQ+iwSBKl6yAb8KFFd8RqBzLY=', 'Content-Length': '0'} 2023-12-15T23:25:57.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013053fab2f193d96-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.617 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:25:57.617 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.617 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.617 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.617 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.617 DEBUG:boto:Method: GET 2023-12-15T23:25:57.617 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.617 DEBUG:boto:Data: 2023-12-15T23:25:57.618 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.618 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.618 DEBUG:boto:Params: {} 2023-12-15T23:25:57.618 DEBUG:boto:Token: None 2023-12-15T23:25:57.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.618 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0= 2023-12-15T23:25:57.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0=', 'Content-Length': '0'} 2023-12-15T23:25:57.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005764fd8ef0f2d893-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.621 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.621 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.621 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.621 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.621 DEBUG:boto:Method: GET 2023-12-15T23:25:57.621 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.621 DEBUG:boto:Data: 2023-12-15T23:25:57.621 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.621 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.622 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.622 DEBUG:boto:Params: {} 2023-12-15T23:25:57.622 DEBUG:boto:Token: None 2023-12-15T23:25:57.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:25:57.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0= 2023-12-15T23:25:57.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/WJ/t/MCLYQJg1R7hF9qSv694j0=', 'Content-Length': '0'} 2023-12-15T23:25:57.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a6a647e142ff05a-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.625 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.625 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.625 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.625 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.625 DEBUG:boto:Method: GET 2023-12-15T23:25:57.625 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.625 DEBUG:boto:Data: 2023-12-15T23:25:57.625 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.625 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.625 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.626 DEBUG:boto:Params: {} 2023-12-15T23:25:57.626 DEBUG:boto:Token: None 2023-12-15T23:25:57.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.629 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008de76644ee3b3c0b-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.629 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.629 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.629 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.629 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.629 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.630 DEBUG:boto:Method: GET 2023-12-15T23:25:57.630 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.630 DEBUG:boto:Data: 2023-12-15T23:25:57.630 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.630 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.630 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.630 DEBUG:boto:Params: {} 2023-12-15T23:25:57.630 DEBUG:boto:Token: None 2023-12-15T23:25:57.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aa33b3d5a80474f-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.634 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.634 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.635 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.635 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.635 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:25:57.635 DEBUG:boto:Data: 2023-12-15T23:25:57.635 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.635 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.635 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.635 DEBUG:boto:Params: {} 2023-12-15T23:25:57.635 DEBUG:boto:Token: None 2023-12-15T23:25:57.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37 2023-12-15T23:25:57.636 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VwhjVUKyez/J+uGXRZwJTbQhxSo= 2023-12-15T23:25:57.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VwhjVUKyez/J+uGXRZwJTbQhxSo=', 'Content-Length': '0'} 2023-12-15T23:25:57.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c6f04ebe79e8bcf-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.638 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.638 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.638 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.638 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:25:57.638 DEBUG:boto:Data: 2023-12-15T23:25:57.638 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.638 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.638 DEBUG:boto:Params: {} 2023-12-15T23:25:57.639 DEBUG:boto:Token: None 2023-12-15T23:25:57.639 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37 2023-12-15T23:25:57.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VwhjVUKyez/J+uGXRZwJTbQhxSo= 2023-12-15T23:25:57.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VwhjVUKyez/J+uGXRZwJTbQhxSo=', 'Content-Length': '0'} 2023-12-15T23:25:57.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3219027f47ae87e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.641 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:25:57.641 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.641 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.641 DEBUG:boto:Method: GET 2023-12-15T23:25:57.641 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:25:57.641 DEBUG:boto:Data: 2023-12-15T23:25:57.642 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.642 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.642 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.642 DEBUG:boto:Params: {} 2023-12-15T23:25:57.642 DEBUG:boto:Token: None 2023-12-15T23:25:57.642 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37 2023-12-15T23:25:57.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KRbz6IyfzDqoswaAwqdwu6d90A8= 2023-12-15T23:25:57.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KRbz6IyfzDqoswaAwqdwu6d90A8=', 'Content-Length': '0'} 2023-12-15T23:25:57.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069918ba67e8a4628-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.644 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:25:57.645 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:25:57.645 DEBUG:boto:Method: GET 2023-12-15T23:25:57.645 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:25:57.645 DEBUG:boto:Data: 2023-12-15T23:25:57.645 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.645 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.645 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.645 DEBUG:boto:Params: {} 2023-12-15T23:25:57.645 DEBUG:boto:Token: None 2023-12-15T23:25:57.646 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj37 2023-12-15T23:25:57.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KRbz6IyfzDqoswaAwqdwu6d90A8= 2023-12-15T23:25:57.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KRbz6IyfzDqoswaAwqdwu6d90A8=', 'Content-Length': '0'} 2023-12-15T23:25:57.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f505c519c78b14fb-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.648 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.648 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.648 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.648 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.648 DEBUG:boto:Method: GET 2023-12-15T23:25:57.648 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.649 DEBUG:boto:Data: 2023-12-15T23:25:57.649 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.649 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.649 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.649 DEBUG:boto:Params: {} 2023-12-15T23:25:57.649 DEBUG:boto:Token: None 2023-12-15T23:25:57.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.649 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.652 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001799a6c9f2c3ee3f-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.652 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.652 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.652 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.652 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.652 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.652 DEBUG:boto:Method: GET 2023-12-15T23:25:57.653 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:25:57.653 DEBUG:boto:Data: 2023-12-15T23:25:57.653 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.653 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.653 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.653 DEBUG:boto:Params: {} 2023-12-15T23:25:57.653 DEBUG:boto:Token: None 2023-12-15T23:25:57.653 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e2151fe42995ccf-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.657 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.657 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:25:57.657 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.657 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.657 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.658 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.658 DEBUG:boto:Method: GET 2023-12-15T23:25:57.658 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.658 DEBUG:boto:Data: 2023-12-15T23:25:57.658 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.658 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.658 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.658 DEBUG:boto:Params: {} 2023-12-15T23:25:57.658 DEBUG:boto:Token: None 2023-12-15T23:25:57.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.659 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU= 2023-12-15T23:25:57.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU=', 'Content-Length': '0'} 2023-12-15T23:25:57.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014ddfc262032ac09-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.661 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.661 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.661 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.661 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.661 DEBUG:boto:Method: GET 2023-12-15T23:25:57.661 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.661 DEBUG:boto:Data: 2023-12-15T23:25:57.661 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.662 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.662 DEBUG:boto:Params: {} 2023-12-15T23:25:57.662 DEBUG:boto:Token: None 2023-12-15T23:25:57.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU= 2023-12-15T23:25:57.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU=', 'Content-Length': '0'} 2023-12-15T23:25:57.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000287848493fc2ece8-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.664 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.664 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.664 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.665 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.665 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.665 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.665 DEBUG:boto:Data: 2023-12-15T23:25:57.665 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.665 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.665 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.665 DEBUG:boto:Params: {} 2023-12-15T23:25:57.665 DEBUG:boto:Token: None 2023-12-15T23:25:57.666 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ymvtgQi+hX8ILqfwicoaoiGYNhU= 2023-12-15T23:25:57.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymvtgQi+hX8ILqfwicoaoiGYNhU=', 'Content-Length': '0'} 2023-12-15T23:25:57.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d22e953097eb397-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.668 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.668 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.668 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.668 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.668 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.668 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.668 DEBUG:boto:Data: 2023-12-15T23:25:57.668 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.668 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.669 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.669 DEBUG:boto:Params: {} 2023-12-15T23:25:57.669 DEBUG:boto:Token: None 2023-12-15T23:25:57.669 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.669 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ymvtgQi+hX8ILqfwicoaoiGYNhU= 2023-12-15T23:25:57.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymvtgQi+hX8ILqfwicoaoiGYNhU=', 'Content-Length': '0'} 2023-12-15T23:25:57.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a120a283c69af6f9-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:25:57.671 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.671 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.672 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.672 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.672 DEBUG:boto:Method: GET 2023-12-15T23:25:57.672 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.672 DEBUG:boto:Data: 2023-12-15T23:25:57.672 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.672 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.672 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.672 DEBUG:boto:Params: {} 2023-12-15T23:25:57.672 DEBUG:boto:Token: None 2023-12-15T23:25:57.672 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU= 2023-12-15T23:25:57.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU=', 'Content-Length': '0'} 2023-12-15T23:25:57.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006dec3287a426be7-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.675 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.675 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.675 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.675 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.676 DEBUG:boto:Method: GET 2023-12-15T23:25:57.676 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.676 DEBUG:boto:Data: 2023-12-15T23:25:57.676 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.676 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.676 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.676 DEBUG:boto:Params: {} 2023-12-15T23:25:57.676 DEBUG:boto:Token: None 2023-12-15T23:25:57.676 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:25:57.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU= 2023-12-15T23:25:57.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sb3bOxaX95H0Z+rfaBa5tBTX/PU=', 'Content-Length': '0'} 2023-12-15T23:25:57.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baad8bd8c4bd4466-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.679 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.679 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.679 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.679 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.679 DEBUG:boto:Method: GET 2023-12-15T23:25:57.679 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.680 DEBUG:boto:Data: 2023-12-15T23:25:57.680 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.680 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.680 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.680 DEBUG:boto:Params: {} 2023-12-15T23:25:57.680 DEBUG:boto:Token: None 2023-12-15T23:25:57.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.683 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070cc7b9cbe5ece54-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.729 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.730 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.730 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.730 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.730 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.730 DEBUG:boto:Method: GET 2023-12-15T23:25:57.730 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.730 DEBUG:boto:Data: 2023-12-15T23:25:57.730 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.731 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.731 DEBUG:boto:Params: {} 2023-12-15T23:25:57.731 DEBUG:boto:Token: None 2023-12-15T23:25:57.731 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d7bed43d03ebe53-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.735 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.735 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.735 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.735 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.735 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:25:57.735 DEBUG:boto:Data: 2023-12-15T23:25:57.735 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.735 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.736 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.736 DEBUG:boto:Params: {} 2023-12-15T23:25:57.736 DEBUG:boto:Token: None 2023-12-15T23:25:57.736 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38 2023-12-15T23:25:57.736 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KiOwgoQDdtsxvudJ/P2dpjgn4rA= 2023-12-15T23:25:57.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KiOwgoQDdtsxvudJ/P2dpjgn4rA=', 'Content-Length': '0'} 2023-12-15T23:25:57.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c5579336dbccf49-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.738 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.738 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.739 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.739 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:25:57.739 DEBUG:boto:Data: 2023-12-15T23:25:57.739 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.739 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.739 DEBUG:boto:Params: {} 2023-12-15T23:25:57.739 DEBUG:boto:Token: None 2023-12-15T23:25:57.739 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38 2023-12-15T23:25:57.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:KiOwgoQDdtsxvudJ/P2dpjgn4rA= 2023-12-15T23:25:57.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:KiOwgoQDdtsxvudJ/P2dpjgn4rA=', 'Content-Length': '0'} 2023-12-15T23:25:57.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d1f8de5f0d8ffd-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:25:57.742 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.742 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.742 DEBUG:boto:Method: GET 2023-12-15T23:25:57.742 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:25:57.742 DEBUG:boto:Data: 2023-12-15T23:25:57.742 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.743 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.743 DEBUG:boto:Params: {} 2023-12-15T23:25:57.743 DEBUG:boto:Token: None 2023-12-15T23:25:57.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38 2023-12-15T23:25:57.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yn+O4lNKmbWZ6i77fddzYYQep3U= 2023-12-15T23:25:57.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yn+O4lNKmbWZ6i77fddzYYQep3U=', 'Content-Length': '0'} 2023-12-15T23:25:57.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ed1fe201dbedaa1-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.745 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:25:57.745 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:25:57.745 DEBUG:boto:Method: GET 2023-12-15T23:25:57.745 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:25:57.746 DEBUG:boto:Data: 2023-12-15T23:25:57.746 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.746 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.746 DEBUG:boto:Params: {} 2023-12-15T23:25:57.746 DEBUG:boto:Token: None 2023-12-15T23:25:57.746 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj38 2023-12-15T23:25:57.746 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Yn+O4lNKmbWZ6i77fddzYYQep3U= 2023-12-15T23:25:57.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Yn+O4lNKmbWZ6i77fddzYYQep3U=', 'Content-Length': '0'} 2023-12-15T23:25:57.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058a5d71efd066d7c-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.789 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.790 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.790 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.790 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.790 DEBUG:boto:Method: GET 2023-12-15T23:25:57.790 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.790 DEBUG:boto:Data: 2023-12-15T23:25:57.790 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.790 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.790 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.790 DEBUG:boto:Params: {} 2023-12-15T23:25:57.790 DEBUG:boto:Token: None 2023-12-15T23:25:57.791 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000439ee5885b643d44-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.793 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.793 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.794 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.794 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.794 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.794 DEBUG:boto:Method: GET 2023-12-15T23:25:57.794 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:25:57.794 DEBUG:boto:Data: 2023-12-15T23:25:57.794 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.794 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.794 DEBUG:boto:Params: {} 2023-12-15T23:25:57.794 DEBUG:boto:Token: None 2023-12-15T23:25:57.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005455c9be470a29ab-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.798 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:25:57.799 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.799 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.799 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.799 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.799 DEBUG:boto:Method: GET 2023-12-15T23:25:57.799 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.800 DEBUG:boto:Data: 2023-12-15T23:25:57.800 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.800 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.800 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.800 DEBUG:boto:Params: {} 2023-12-15T23:25:57.800 DEBUG:boto:Token: None 2023-12-15T23:25:57.800 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.800 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po= 2023-12-15T23:25:57.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po=', 'Content-Length': '0'} 2023-12-15T23:25:57.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8ea1f3ac1ab02eb-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.803 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.803 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.803 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.803 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.803 DEBUG:boto:Method: GET 2023-12-15T23:25:57.803 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.803 DEBUG:boto:Data: 2023-12-15T23:25:57.803 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.803 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.803 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.804 DEBUG:boto:Params: {} 2023-12-15T23:25:57.804 DEBUG:boto:Token: None 2023-12-15T23:25:57.804 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.804 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po= 2023-12-15T23:25:57.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po=', 'Content-Length': '0'} 2023-12-15T23:25:57.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad66be3bb319b8e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.806 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.806 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.806 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.807 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.807 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.807 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.807 DEBUG:boto:Data: 2023-12-15T23:25:57.807 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.807 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.807 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.807 DEBUG:boto:Params: {} 2023-12-15T23:25:57.807 DEBUG:boto:Token: None 2023-12-15T23:25:57.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.808 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+ONCjcv7U+3iYIUE7ox9VwHQNXg= 2023-12-15T23:25:57.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+ONCjcv7U+3iYIUE7ox9VwHQNXg=', 'Content-Length': '0'} 2023-12-15T23:25:57.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021c70011988f9f80-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.810 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.810 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.810 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.810 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.810 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.810 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.810 DEBUG:boto:Data: 2023-12-15T23:25:57.810 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.811 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.811 DEBUG:boto:Params: {} 2023-12-15T23:25:57.811 DEBUG:boto:Token: None 2023-12-15T23:25:57.811 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+ONCjcv7U+3iYIUE7ox9VwHQNXg= 2023-12-15T23:25:57.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+ONCjcv7U+3iYIUE7ox9VwHQNXg=', 'Content-Length': '0'} 2023-12-15T23:25:57.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000565cda397a83e04d-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:25:57.814 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.814 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.814 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.814 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.814 DEBUG:boto:Method: GET 2023-12-15T23:25:57.814 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.814 DEBUG:boto:Data: 2023-12-15T23:25:57.814 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.815 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.815 DEBUG:boto:Params: {} 2023-12-15T23:25:57.815 DEBUG:boto:Token: None 2023-12-15T23:25:57.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po= 2023-12-15T23:25:57.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po=', 'Content-Length': '0'} 2023-12-15T23:25:57.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000458c02a2bfd33867-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.857 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.858 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.858 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.858 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.858 DEBUG:boto:Method: GET 2023-12-15T23:25:57.858 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.858 DEBUG:boto:Data: 2023-12-15T23:25:57.858 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.858 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.858 DEBUG:boto:Params: {} 2023-12-15T23:25:57.858 DEBUG:boto:Token: None 2023-12-15T23:25:57.858 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:25:57.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po= 2023-12-15T23:25:57.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AvqT2s6ZtYlyMaXtXK0wiIOz2Po=', 'Content-Length': '0'} 2023-12-15T23:25:57.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3946a61db59abb8-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.861 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.861 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.861 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.861 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.861 DEBUG:boto:Method: GET 2023-12-15T23:25:57.861 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.861 DEBUG:boto:Data: 2023-12-15T23:25:57.861 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.862 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.862 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.862 DEBUG:boto:Params: {} 2023-12-15T23:25:57.862 DEBUG:boto:Token: None 2023-12-15T23:25:57.862 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.862 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000350e2ffa18a785fb-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.865 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.865 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.865 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.865 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.865 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.866 DEBUG:boto:Method: GET 2023-12-15T23:25:57.866 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.866 DEBUG:boto:Data: 2023-12-15T23:25:57.866 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.866 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.866 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.866 DEBUG:boto:Params: {} 2023-12-15T23:25:57.866 DEBUG:boto:Token: None 2023-12-15T23:25:57.866 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.866 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092c4eb58315c7186-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.870 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.870 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.871 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.871 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.871 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:25:57.871 DEBUG:boto:Data: 2023-12-15T23:25:57.871 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.871 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.871 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.871 DEBUG:boto:Params: {} 2023-12-15T23:25:57.871 DEBUG:boto:Token: None 2023-12-15T23:25:57.871 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44 2023-12-15T23:25:57.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke4ncFqAnJIWipD5IIt4VRHz/KI= 2023-12-15T23:25:57.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke4ncFqAnJIWipD5IIt4VRHz/KI=', 'Content-Length': '0'} 2023-12-15T23:25:57.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0c8708d8b8ba383-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.874 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.874 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.874 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.874 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:25:57.874 DEBUG:boto:Data: 2023-12-15T23:25:57.874 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.874 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.874 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.874 DEBUG:boto:Params: {} 2023-12-15T23:25:57.874 DEBUG:boto:Token: None 2023-12-15T23:25:57.875 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44 2023-12-15T23:25:57.875 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ke4ncFqAnJIWipD5IIt4VRHz/KI= 2023-12-15T23:25:57.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ke4ncFqAnJIWipD5IIt4VRHz/KI=', 'Content-Length': '0'} 2023-12-15T23:25:57.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd510f5d544eac9e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:25:57.877 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.877 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.877 DEBUG:boto:Method: GET 2023-12-15T23:25:57.877 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:25:57.877 DEBUG:boto:Data: 2023-12-15T23:25:57.877 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.877 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.878 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.878 DEBUG:boto:Params: {} 2023-12-15T23:25:57.878 DEBUG:boto:Token: None 2023-12-15T23:25:57.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44 2023-12-15T23:25:57.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z0BEMHcYvpkT7wX9+KOz3RdYSkQ= 2023-12-15T23:25:57.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z0BEMHcYvpkT7wX9+KOz3RdYSkQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004509170e9b6e6319-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.880 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:25:57.880 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:25:57.880 DEBUG:boto:Method: GET 2023-12-15T23:25:57.880 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:25:57.881 DEBUG:boto:Data: 2023-12-15T23:25:57.881 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.881 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.881 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.881 DEBUG:boto:Params: {} 2023-12-15T23:25:57.881 DEBUG:boto:Token: None 2023-12-15T23:25:57.881 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj44 2023-12-15T23:25:57.881 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Z0BEMHcYvpkT7wX9+KOz3RdYSkQ= 2023-12-15T23:25:57.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Z0BEMHcYvpkT7wX9+KOz3RdYSkQ=', 'Content-Length': '0'} 2023-12-15T23:25:57.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005468d7ab0cac359b-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.884 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.884 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.884 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.884 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.884 DEBUG:boto:Method: GET 2023-12-15T23:25:57.884 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.884 DEBUG:boto:Data: 2023-12-15T23:25:57.884 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.884 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.884 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.885 DEBUG:boto:Params: {} 2023-12-15T23:25:57.885 DEBUG:boto:Token: None 2023-12-15T23:25:57.885 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.885 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ae2fe28edacd014-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.888 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.888 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.888 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.888 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.888 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.888 DEBUG:boto:Method: GET 2023-12-15T23:25:57.888 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:25:57.889 DEBUG:boto:Data: 2023-12-15T23:25:57.889 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.889 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.889 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.889 DEBUG:boto:Params: {} 2023-12-15T23:25:57.889 DEBUG:boto:Token: None 2023-12-15T23:25:57.889 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.889 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d11bf51bc0859513-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.893 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.893 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:25:57.894 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.894 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.894 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.894 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.894 DEBUG:boto:Method: GET 2023-12-15T23:25:57.894 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.894 DEBUG:boto:Data: 2023-12-15T23:25:57.894 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.894 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.895 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.895 DEBUG:boto:Params: {} 2023-12-15T23:25:57.895 DEBUG:boto:Token: None 2023-12-15T23:25:57.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8= 2023-12-15T23:25:57.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8=', 'Content-Length': '0'} 2023-12-15T23:25:57.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096e675390c9c73cd-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.898 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.898 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.898 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.898 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.898 DEBUG:boto:Method: GET 2023-12-15T23:25:57.898 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.898 DEBUG:boto:Data: 2023-12-15T23:25:57.899 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.899 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.899 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.899 DEBUG:boto:Params: {} 2023-12-15T23:25:57.899 DEBUG:boto:Token: None 2023-12-15T23:25:57.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8= 2023-12-15T23:25:57.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8=', 'Content-Length': '0'} 2023-12-15T23:25:57.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9bfd8a55d541c0f-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.902 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.902 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.902 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.902 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.902 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.902 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.902 DEBUG:boto:Data: 2023-12-15T23:25:57.903 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.903 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.903 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.903 DEBUG:boto:Params: {} 2023-12-15T23:25:57.903 DEBUG:boto:Token: None 2023-12-15T23:25:57.903 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZIWTpcz8qHwUbNtvEvyLBufmgv4= 2023-12-15T23:25:57.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZIWTpcz8qHwUbNtvEvyLBufmgv4=', 'Content-Length': '0'} 2023-12-15T23:25:57.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003147110d9c46513-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.906 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.906 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.906 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.906 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.906 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.906 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.906 DEBUG:boto:Data: 2023-12-15T23:25:57.907 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.907 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.907 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.907 DEBUG:boto:Params: {} 2023-12-15T23:25:57.907 DEBUG:boto:Token: None 2023-12-15T23:25:57.907 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZIWTpcz8qHwUbNtvEvyLBufmgv4= 2023-12-15T23:25:57.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZIWTpcz8qHwUbNtvEvyLBufmgv4=', 'Content-Length': '0'} 2023-12-15T23:25:57.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000632654e2c6861eea-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:25:57.910 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.910 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.910 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.910 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.910 DEBUG:boto:Method: GET 2023-12-15T23:25:57.911 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.911 DEBUG:boto:Data: 2023-12-15T23:25:57.911 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.911 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.911 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.911 DEBUG:boto:Params: {} 2023-12-15T23:25:57.911 DEBUG:boto:Token: None 2023-12-15T23:25:57.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8= 2023-12-15T23:25:57.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8=', 'Content-Length': '0'} 2023-12-15T23:25:57.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a08d634042ab225f-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.958 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.958 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.958 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.958 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.958 DEBUG:boto:Method: GET 2023-12-15T23:25:57.958 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.958 DEBUG:boto:Data: 2023-12-15T23:25:57.958 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.958 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.959 DEBUG:boto:Params: {} 2023-12-15T23:25:57.959 DEBUG:boto:Token: None 2023-12-15T23:25:57.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:25:57.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8= 2023-12-15T23:25:57.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PEgJZD6ENeXnKTtwQ4y7brZEuT8=', 'Content-Length': '0'} 2023-12-15T23:25:57.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca2076fc8a48fa4e-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.961 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.962 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.962 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.962 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.962 DEBUG:boto:Method: GET 2023-12-15T23:25:57.962 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.962 DEBUG:boto:Data: 2023-12-15T23:25:57.962 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.962 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.962 DEBUG:boto:Params: {} 2023-12-15T23:25:57.962 DEBUG:boto:Token: None 2023-12-15T23:25:57.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.965 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000628073c53460f339-00657ce085-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.965 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.966 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:57.966 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:57.966 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.966 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.966 DEBUG:boto:Method: GET 2023-12-15T23:25:57.966 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:25:57.966 DEBUG:boto:Data: 2023-12-15T23:25:57.966 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.966 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.967 DEBUG:boto:Params: {} 2023-12-15T23:25:57.967 DEBUG:boto:Token: None 2023-12-15T23:25:57.967 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/ 2023-12-15T23:25:57.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw= 2023-12-15T23:25:57.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8vETU5mxyOm/tfcPD/cOeK6jrUw=', 'Content-Length': '0'} 2023-12-15T23:25:57.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ca0c1300953c6e3-00657ce085-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.971 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:57.971 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.971 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.971 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.971 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:25:57.971 DEBUG:boto:Data: 2023-12-15T23:25:57.972 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.972 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.972 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.972 DEBUG:boto:Params: {} 2023-12-15T23:25:57.972 DEBUG:boto:Token: None 2023-12-15T23:25:57.972 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46 2023-12-15T23:25:57.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oTDGxqptQQqyBjpGhc/Vpli9bLo= 2023-12-15T23:25:57.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oTDGxqptQQqyBjpGhc/Vpli9bLo=', 'Content-Length': '0'} 2023-12-15T23:25:57.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d48304a0f9412402-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.974 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.974 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.975 DEBUG:boto:Method: HEAD 2023-12-15T23:25:57.975 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:25:57.975 DEBUG:boto:Data: 2023-12-15T23:25:57.975 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.975 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.975 DEBUG:boto:Params: {} 2023-12-15T23:25:57.975 DEBUG:boto:Token: None 2023-12-15T23:25:57.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46 2023-12-15T23:25:57.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oTDGxqptQQqyBjpGhc/Vpli9bLo= 2023-12-15T23:25:57.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oTDGxqptQQqyBjpGhc/Vpli9bLo=', 'Content-Length': '0'} 2023-12-15T23:25:57.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020f1bbad38ea6c18-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:25:57.978 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.978 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.978 DEBUG:boto:Method: GET 2023-12-15T23:25:57.978 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:25:57.978 DEBUG:boto:Data: 2023-12-15T23:25:57.978 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.979 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:57.979 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.979 DEBUG:boto:Params: {} 2023-12-15T23:25:57.979 DEBUG:boto:Token: None 2023-12-15T23:25:57.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46 2023-12-15T23:25:57.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p+3QsVyLJfrwbFDFbx2DbJn6ItM= 2023-12-15T23:25:57.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p+3QsVyLJfrwbFDFbx2DbJn6ItM=', 'Content-Length': '0'} 2023-12-15T23:25:57.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000903f8980b5bce025-00657ce085-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:57.982 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:25:57.982 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:25:57.982 DEBUG:boto:Method: GET 2023-12-15T23:25:57.982 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:25:57.982 DEBUG:boto:Data: 2023-12-15T23:25:57.982 DEBUG:boto:Headers: {} 2023-12-15T23:25:57.982 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:57.983 DEBUG:boto:Port: 8000 2023-12-15T23:25:57.983 DEBUG:boto:Params: {} 2023-12-15T23:25:57.983 DEBUG:boto:Token: None 2023-12-15T23:25:57.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:57 GMT /kskgfn-49/obj46 2023-12-15T23:25:57.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p+3QsVyLJfrwbFDFbx2DbJn6ItM= 2023-12-15T23:25:57.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:57 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p+3QsVyLJfrwbFDFbx2DbJn6ItM=', 'Content-Length': '0'} 2023-12-15T23:25:57.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000702fe9c07278ce76-00657ce085-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:57 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.025 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.026 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.026 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.026 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.026 DEBUG:boto:Method: GET 2023-12-15T23:25:58.026 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.026 DEBUG:boto:Data: 2023-12-15T23:25:58.026 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.026 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.026 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.026 DEBUG:boto:Params: {} 2023-12-15T23:25:58.026 DEBUG:boto:Token: None 2023-12-15T23:25:58.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006dfa1ff6c8aa5b73-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.029 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.030 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.030 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.030 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.030 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.030 DEBUG:boto:Method: GET 2023-12-15T23:25:58.030 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:25:58.030 DEBUG:boto:Data: 2023-12-15T23:25:58.030 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.030 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.031 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.031 DEBUG:boto:Params: {} 2023-12-15T23:25:58.031 DEBUG:boto:Token: None 2023-12-15T23:25:58.031 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000003bec46bb3b251-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.035 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.035 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:25:58.035 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.035 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.035 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.036 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.036 DEBUG:boto:Method: GET 2023-12-15T23:25:58.036 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.036 DEBUG:boto:Data: 2023-12-15T23:25:58.036 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.036 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.036 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.036 DEBUG:boto:Params: {} 2023-12-15T23:25:58.036 DEBUG:boto:Token: None 2023-12-15T23:25:58.036 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc= 2023-12-15T23:25:58.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc=', 'Content-Length': '0'} 2023-12-15T23:25:58.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b0c977b03287a6b-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.081 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.081 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.082 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.082 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.082 DEBUG:boto:Method: GET 2023-12-15T23:25:58.082 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.082 DEBUG:boto:Data: 2023-12-15T23:25:58.082 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.082 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.082 DEBUG:boto:Params: {} 2023-12-15T23:25:58.082 DEBUG:boto:Token: None 2023-12-15T23:25:58.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc= 2023-12-15T23:25:58.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc=', 'Content-Length': '0'} 2023-12-15T23:25:58.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000244e2b327eb3fca2-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.085 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.085 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.085 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.085 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.085 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.086 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.086 DEBUG:boto:Data: 2023-12-15T23:25:58.086 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.086 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.086 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.086 DEBUG:boto:Params: {} 2023-12-15T23:25:58.086 DEBUG:boto:Token: None 2023-12-15T23:25:58.086 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WAddaXeJePZp/it8kKAYB94hOdM= 2023-12-15T23:25:58.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WAddaXeJePZp/it8kKAYB94hOdM=', 'Content-Length': '0'} 2023-12-15T23:25:58.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056b403bfadf5b508-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.088 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.089 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.089 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.089 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.089 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.089 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.089 DEBUG:boto:Data: 2023-12-15T23:25:58.089 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.089 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.089 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.089 DEBUG:boto:Params: {} 2023-12-15T23:25:58.090 DEBUG:boto:Token: None 2023-12-15T23:25:58.090 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.090 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WAddaXeJePZp/it8kKAYB94hOdM= 2023-12-15T23:25:58.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WAddaXeJePZp/it8kKAYB94hOdM=', 'Content-Length': '0'} 2023-12-15T23:25:58.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000630959d369ac9dd1-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:25:58.092 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.092 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.092 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.093 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.093 DEBUG:boto:Method: GET 2023-12-15T23:25:58.093 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.093 DEBUG:boto:Data: 2023-12-15T23:25:58.093 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.093 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.093 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.093 DEBUG:boto:Params: {} 2023-12-15T23:25:58.093 DEBUG:boto:Token: None 2023-12-15T23:25:58.093 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc= 2023-12-15T23:25:58.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc=', 'Content-Length': '0'} 2023-12-15T23:25:58.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c82dc5894954990-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.096 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.096 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.096 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.096 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.096 DEBUG:boto:Method: GET 2023-12-15T23:25:58.096 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.096 DEBUG:boto:Data: 2023-12-15T23:25:58.096 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.096 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.097 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.097 DEBUG:boto:Params: {} 2023-12-15T23:25:58.097 DEBUG:boto:Token: None 2023-12-15T23:25:58.097 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:25:58.097 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc= 2023-12-15T23:25:58.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ajiUO3PFX6eW77NGmtLuWoDcJrc=', 'Content-Length': '0'} 2023-12-15T23:25:58.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a52f2f55e4df25d6-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.099 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.099 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.100 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.100 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.100 DEBUG:boto:Method: GET 2023-12-15T23:25:58.100 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.100 DEBUG:boto:Data: 2023-12-15T23:25:58.100 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.100 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.100 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.100 DEBUG:boto:Params: {} 2023-12-15T23:25:58.100 DEBUG:boto:Token: None 2023-12-15T23:25:58.100 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.101 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.103 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0ff9b2416499adc-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.103 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.104 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.104 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.104 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.104 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.104 DEBUG:boto:Method: GET 2023-12-15T23:25:58.104 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.104 DEBUG:boto:Data: 2023-12-15T23:25:58.104 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.104 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.104 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.104 DEBUG:boto:Params: {} 2023-12-15T23:25:58.105 DEBUG:boto:Token: None 2023-12-15T23:25:58.105 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.105 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008235ffa745737e8-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.109 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.109 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.109 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.109 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.110 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:25:58.110 DEBUG:boto:Data: 2023-12-15T23:25:58.110 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.110 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.110 DEBUG:boto:Params: {} 2023-12-15T23:25:58.110 DEBUG:boto:Token: None 2023-12-15T23:25:58.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51 2023-12-15T23:25:58.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c1A6+E+2y8PvcIaUQMta18xFcvc= 2023-12-15T23:25:58.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c1A6+E+2y8PvcIaUQMta18xFcvc=', 'Content-Length': '0'} 2023-12-15T23:25:58.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008761d78a3396424c-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.113 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.113 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.113 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.113 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:25:58.113 DEBUG:boto:Data: 2023-12-15T23:25:58.113 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.113 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.113 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.113 DEBUG:boto:Params: {} 2023-12-15T23:25:58.114 DEBUG:boto:Token: None 2023-12-15T23:25:58.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51 2023-12-15T23:25:58.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c1A6+E+2y8PvcIaUQMta18xFcvc= 2023-12-15T23:25:58.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c1A6+E+2y8PvcIaUQMta18xFcvc=', 'Content-Length': '0'} 2023-12-15T23:25:58.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020c3ce4fab2cf662-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:25:58.116 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.116 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.116 DEBUG:boto:Method: GET 2023-12-15T23:25:58.116 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:25:58.116 DEBUG:boto:Data: 2023-12-15T23:25:58.116 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.117 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.117 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.117 DEBUG:boto:Params: {} 2023-12-15T23:25:58.117 DEBUG:boto:Token: None 2023-12-15T23:25:58.117 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51 2023-12-15T23:25:58.117 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DRhfxoabEOAy1wEq8ypn/iK41Cw= 2023-12-15T23:25:58.117 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DRhfxoabEOAy1wEq8ypn/iK41Cw=', 'Content-Length': '0'} 2023-12-15T23:25:58.119 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b381bb67c6692961-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.119 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:25:58.120 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:25:58.120 DEBUG:boto:Method: GET 2023-12-15T23:25:58.120 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:25:58.120 DEBUG:boto:Data: 2023-12-15T23:25:58.120 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.120 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.120 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.120 DEBUG:boto:Params: {} 2023-12-15T23:25:58.120 DEBUG:boto:Token: None 2023-12-15T23:25:58.120 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj51 2023-12-15T23:25:58.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DRhfxoabEOAy1wEq8ypn/iK41Cw= 2023-12-15T23:25:58.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DRhfxoabEOAy1wEq8ypn/iK41Cw=', 'Content-Length': '0'} 2023-12-15T23:25:58.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003499d73ced9d27e2-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.123 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.123 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.123 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.123 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.123 DEBUG:boto:Method: GET 2023-12-15T23:25:58.123 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.123 DEBUG:boto:Data: 2023-12-15T23:25:58.123 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.123 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.123 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.123 DEBUG:boto:Params: {} 2023-12-15T23:25:58.124 DEBUG:boto:Token: None 2023-12-15T23:25:58.124 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.124 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff57ba3e33ada99e-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.126 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.127 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.127 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.127 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.127 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.127 DEBUG:boto:Method: GET 2023-12-15T23:25:58.127 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:25:58.127 DEBUG:boto:Data: 2023-12-15T23:25:58.127 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.127 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.127 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.128 DEBUG:boto:Params: {} 2023-12-15T23:25:58.128 DEBUG:boto:Token: None 2023-12-15T23:25:58.128 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.128 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bfcf633411b95c9d-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.131 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:25:58.132 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.132 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.132 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.132 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.132 DEBUG:boto:Method: GET 2023-12-15T23:25:58.132 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.132 DEBUG:boto:Data: 2023-12-15T23:25:58.133 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.133 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.133 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.133 DEBUG:boto:Params: {} 2023-12-15T23:25:58.133 DEBUG:boto:Token: None 2023-12-15T23:25:58.133 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.133 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw= 2023-12-15T23:25:58.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw=', 'Content-Length': '0'} 2023-12-15T23:25:58.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d8dd246fd9a73ab-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.177 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.178 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.178 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.178 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.178 DEBUG:boto:Method: GET 2023-12-15T23:25:58.178 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.178 DEBUG:boto:Data: 2023-12-15T23:25:58.178 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.178 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.178 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.178 DEBUG:boto:Params: {} 2023-12-15T23:25:58.178 DEBUG:boto:Token: None 2023-12-15T23:25:58.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw= 2023-12-15T23:25:58.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw=', 'Content-Length': '0'} 2023-12-15T23:25:58.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003781f8470d9ed5c1-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.181 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.181 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.181 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.181 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.182 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.182 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.182 DEBUG:boto:Data: 2023-12-15T23:25:58.182 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.182 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.182 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.182 DEBUG:boto:Params: {} 2023-12-15T23:25:58.182 DEBUG:boto:Token: None 2023-12-15T23:25:58.182 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WHQGBujnWID8B62SUd+Q076zAs= 2023-12-15T23:25:58.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WHQGBujnWID8B62SUd+Q076zAs=', 'Content-Length': '0'} 2023-12-15T23:25:58.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee65eafd10b92acd-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.185 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.185 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.185 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.185 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.185 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.185 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.186 DEBUG:boto:Data: 2023-12-15T23:25:58.186 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.186 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.186 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.186 DEBUG:boto:Params: {} 2023-12-15T23:25:58.186 DEBUG:boto:Token: None 2023-12-15T23:25:58.186 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8WHQGBujnWID8B62SUd+Q076zAs= 2023-12-15T23:25:58.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8WHQGBujnWID8B62SUd+Q076zAs=', 'Content-Length': '0'} 2023-12-15T23:25:58.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000800631102ce9fc5-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:25:58.189 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.189 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.189 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.189 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.189 DEBUG:boto:Method: GET 2023-12-15T23:25:58.189 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.189 DEBUG:boto:Data: 2023-12-15T23:25:58.189 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.189 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.189 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.190 DEBUG:boto:Params: {} 2023-12-15T23:25:58.190 DEBUG:boto:Token: None 2023-12-15T23:25:58.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw= 2023-12-15T23:25:58.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw=', 'Content-Length': '0'} 2023-12-15T23:25:58.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d0d70d406a0e1cb-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.192 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.192 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.192 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.193 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.193 DEBUG:boto:Method: GET 2023-12-15T23:25:58.193 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.193 DEBUG:boto:Data: 2023-12-15T23:25:58.193 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.193 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.193 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.193 DEBUG:boto:Params: {} 2023-12-15T23:25:58.193 DEBUG:boto:Token: None 2023-12-15T23:25:58.193 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:25:58.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw= 2023-12-15T23:25:58.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BWOs+Bbb64jpsXp9ylWFqUqYWWw=', 'Content-Length': '0'} 2023-12-15T23:25:58.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1965013c0702521-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.196 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.196 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.196 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.197 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.197 DEBUG:boto:Method: GET 2023-12-15T23:25:58.197 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.197 DEBUG:boto:Data: 2023-12-15T23:25:58.197 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.197 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.197 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.197 DEBUG:boto:Params: {} 2023-12-15T23:25:58.197 DEBUG:boto:Token: None 2023-12-15T23:25:58.197 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.200 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8a6146afc78063b-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.200 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.201 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.201 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.201 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.201 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.201 DEBUG:boto:Method: GET 2023-12-15T23:25:58.201 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.201 DEBUG:boto:Data: 2023-12-15T23:25:58.201 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.202 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.202 DEBUG:boto:Params: {} 2023-12-15T23:25:58.202 DEBUG:boto:Token: None 2023-12-15T23:25:58.202 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.202 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e275bcbcb5a0be69-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.206 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.206 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.206 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.206 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.206 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:25:58.206 DEBUG:boto:Data: 2023-12-15T23:25:58.206 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.207 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.207 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.207 DEBUG:boto:Params: {} 2023-12-15T23:25:58.207 DEBUG:boto:Token: None 2023-12-15T23:25:58.207 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55 2023-12-15T23:25:58.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+SKr4Zb3vp3nqjy95MEf0lYSxPY= 2023-12-15T23:25:58.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+SKr4Zb3vp3nqjy95MEf0lYSxPY=', 'Content-Length': '0'} 2023-12-15T23:25:58.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000899a27c228ea1cc3-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.209 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.210 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.210 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.210 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:25:58.210 DEBUG:boto:Data: 2023-12-15T23:25:58.210 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.210 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.210 DEBUG:boto:Params: {} 2023-12-15T23:25:58.210 DEBUG:boto:Token: None 2023-12-15T23:25:58.211 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55 2023-12-15T23:25:58.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+SKr4Zb3vp3nqjy95MEf0lYSxPY= 2023-12-15T23:25:58.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+SKr4Zb3vp3nqjy95MEf0lYSxPY=', 'Content-Length': '0'} 2023-12-15T23:25:58.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d26505b08554cb-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:25:58.213 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.213 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.214 DEBUG:boto:Method: GET 2023-12-15T23:25:58.214 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:25:58.214 DEBUG:boto:Data: 2023-12-15T23:25:58.214 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.214 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.214 DEBUG:boto:Params: {} 2023-12-15T23:25:58.214 DEBUG:boto:Token: None 2023-12-15T23:25:58.214 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55 2023-12-15T23:25:58.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G6l5Ve+jO9fAc6rvtq5j2JYVbUA= 2023-12-15T23:25:58.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G6l5Ve+jO9fAc6rvtq5j2JYVbUA=', 'Content-Length': '0'} 2023-12-15T23:25:58.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecbecfe1938c40a8-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.217 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:25:58.217 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:25:58.217 DEBUG:boto:Method: GET 2023-12-15T23:25:58.217 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:25:58.217 DEBUG:boto:Data: 2023-12-15T23:25:58.217 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.217 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.217 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.218 DEBUG:boto:Params: {} 2023-12-15T23:25:58.218 DEBUG:boto:Token: None 2023-12-15T23:25:58.218 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj55 2023-12-15T23:25:58.218 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G6l5Ve+jO9fAc6rvtq5j2JYVbUA= 2023-12-15T23:25:58.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G6l5Ve+jO9fAc6rvtq5j2JYVbUA=', 'Content-Length': '0'} 2023-12-15T23:25:58.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3a76ed7fc21477e-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.261 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.262 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.262 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.262 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.262 DEBUG:boto:Method: GET 2023-12-15T23:25:58.262 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.262 DEBUG:boto:Data: 2023-12-15T23:25:58.262 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.262 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.262 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.262 DEBUG:boto:Params: {} 2023-12-15T23:25:58.263 DEBUG:boto:Token: None 2023-12-15T23:25:58.263 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.263 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f927ac8ad2c6d2e2-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.265 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.265 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.266 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.266 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.266 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.266 DEBUG:boto:Method: GET 2023-12-15T23:25:58.266 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:25:58.266 DEBUG:boto:Data: 2023-12-15T23:25:58.266 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.266 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.266 DEBUG:boto:Params: {} 2023-12-15T23:25:58.267 DEBUG:boto:Token: None 2023-12-15T23:25:58.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043d923c93a157f4a-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.271 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.271 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:25:58.271 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.271 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.271 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.271 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.271 DEBUG:boto:Method: GET 2023-12-15T23:25:58.272 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.272 DEBUG:boto:Data: 2023-12-15T23:25:58.272 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.272 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.272 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.272 DEBUG:boto:Params: {} 2023-12-15T23:25:58.272 DEBUG:boto:Token: None 2023-12-15T23:25:58.272 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4= 2023-12-15T23:25:58.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4=', 'Content-Length': '0'} 2023-12-15T23:25:58.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008435ee54d08e7514-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.275 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.275 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.275 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.275 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.275 DEBUG:boto:Method: GET 2023-12-15T23:25:58.275 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.275 DEBUG:boto:Data: 2023-12-15T23:25:58.275 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.275 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.275 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.275 DEBUG:boto:Params: {} 2023-12-15T23:25:58.276 DEBUG:boto:Token: None 2023-12-15T23:25:58.276 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.276 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4= 2023-12-15T23:25:58.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4=', 'Content-Length': '0'} 2023-12-15T23:25:58.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bcaddeaf8341725-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.278 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.278 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.278 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.278 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.278 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.279 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.279 DEBUG:boto:Data: 2023-12-15T23:25:58.279 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.279 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.279 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.279 DEBUG:boto:Params: {} 2023-12-15T23:25:58.279 DEBUG:boto:Token: None 2023-12-15T23:25:58.279 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ndjuCQmTAkBgoFCo2hkkgWde+jA= 2023-12-15T23:25:58.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ndjuCQmTAkBgoFCo2hkkgWde+jA=', 'Content-Length': '0'} 2023-12-15T23:25:58.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b87314a834dac82-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.282 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.282 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.282 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.282 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.282 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.282 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.282 DEBUG:boto:Data: 2023-12-15T23:25:58.282 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.283 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.283 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.283 DEBUG:boto:Params: {} 2023-12-15T23:25:58.283 DEBUG:boto:Token: None 2023-12-15T23:25:58.283 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ndjuCQmTAkBgoFCo2hkkgWde+jA= 2023-12-15T23:25:58.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ndjuCQmTAkBgoFCo2hkkgWde+jA=', 'Content-Length': '0'} 2023-12-15T23:25:58.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072971e7d744ac68f-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:25:58.286 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.286 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.286 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.286 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.286 DEBUG:boto:Method: GET 2023-12-15T23:25:58.286 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.286 DEBUG:boto:Data: 2023-12-15T23:25:58.286 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.286 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.286 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.286 DEBUG:boto:Params: {} 2023-12-15T23:25:58.287 DEBUG:boto:Token: None 2023-12-15T23:25:58.287 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4= 2023-12-15T23:25:58.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4=', 'Content-Length': '0'} 2023-12-15T23:25:58.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2c72e983a6e9837-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.329 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.330 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.330 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.330 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.330 DEBUG:boto:Method: GET 2023-12-15T23:25:58.330 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.330 DEBUG:boto:Data: 2023-12-15T23:25:58.330 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.330 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.330 DEBUG:boto:Params: {} 2023-12-15T23:25:58.330 DEBUG:boto:Token: None 2023-12-15T23:25:58.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:25:58.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4= 2023-12-15T23:25:58.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CIZ2Ys3H3j4XyigwfC69p+HZIl4=', 'Content-Length': '0'} 2023-12-15T23:25:58.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f38694cc430f748b-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.333 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.333 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.333 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.333 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.333 DEBUG:boto:Method: GET 2023-12-15T23:25:58.333 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.334 DEBUG:boto:Data: 2023-12-15T23:25:58.334 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.334 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.334 DEBUG:boto:Params: {} 2023-12-15T23:25:58.334 DEBUG:boto:Token: None 2023-12-15T23:25:58.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008eb23f1cf5d4734b-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.337 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.337 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.337 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.337 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.337 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.338 DEBUG:boto:Method: GET 2023-12-15T23:25:58.338 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.338 DEBUG:boto:Data: 2023-12-15T23:25:58.338 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.338 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.338 DEBUG:boto:Params: {} 2023-12-15T23:25:58.338 DEBUG:boto:Token: None 2023-12-15T23:25:58.338 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076c465245488ac1e-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.342 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.343 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.343 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.343 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.343 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:25:58.343 DEBUG:boto:Data: 2023-12-15T23:25:58.343 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.343 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.343 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.343 DEBUG:boto:Params: {} 2023-12-15T23:25:58.343 DEBUG:boto:Token: None 2023-12-15T23:25:58.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57 2023-12-15T23:25:58.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f+NTTQy7+VEcUVTpOVEljXjriy0= 2023-12-15T23:25:58.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f+NTTQy7+VEcUVTpOVEljXjriy0=', 'Content-Length': '0'} 2023-12-15T23:25:58.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000baeb1699d488236f-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.346 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.346 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.346 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.346 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:25:58.346 DEBUG:boto:Data: 2023-12-15T23:25:58.346 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.346 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.346 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.346 DEBUG:boto:Params: {} 2023-12-15T23:25:58.347 DEBUG:boto:Token: None 2023-12-15T23:25:58.347 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57 2023-12-15T23:25:58.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:f+NTTQy7+VEcUVTpOVEljXjriy0= 2023-12-15T23:25:58.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:f+NTTQy7+VEcUVTpOVEljXjriy0=', 'Content-Length': '0'} 2023-12-15T23:25:58.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a10515822599288-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:25:58.349 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.349 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.349 DEBUG:boto:Method: GET 2023-12-15T23:25:58.349 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:25:58.349 DEBUG:boto:Data: 2023-12-15T23:25:58.349 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.350 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.350 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.350 DEBUG:boto:Params: {} 2023-12-15T23:25:58.350 DEBUG:boto:Token: None 2023-12-15T23:25:58.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57 2023-12-15T23:25:58.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1bsOh8FrAwP5M874kSJ/TSOHu+M= 2023-12-15T23:25:58.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1bsOh8FrAwP5M874kSJ/TSOHu+M=', 'Content-Length': '0'} 2023-12-15T23:25:58.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7f8ed4c6f667db1-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.352 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:25:58.352 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:25:58.353 DEBUG:boto:Method: GET 2023-12-15T23:25:58.353 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:25:58.353 DEBUG:boto:Data: 2023-12-15T23:25:58.353 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.353 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.353 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.353 DEBUG:boto:Params: {} 2023-12-15T23:25:58.353 DEBUG:boto:Token: None 2023-12-15T23:25:58.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj57 2023-12-15T23:25:58.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1bsOh8FrAwP5M874kSJ/TSOHu+M= 2023-12-15T23:25:58.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1bsOh8FrAwP5M874kSJ/TSOHu+M=', 'Content-Length': '0'} 2023-12-15T23:25:58.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c4bff439198faed-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.356 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.356 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.356 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.356 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.356 DEBUG:boto:Method: GET 2023-12-15T23:25:58.356 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.356 DEBUG:boto:Data: 2023-12-15T23:25:58.356 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.356 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.356 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.357 DEBUG:boto:Params: {} 2023-12-15T23:25:58.357 DEBUG:boto:Token: None 2023-12-15T23:25:58.357 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.357 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.359 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000856b38466eccac46-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.360 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.360 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.360 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.360 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.360 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.360 DEBUG:boto:Method: GET 2023-12-15T23:25:58.360 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:25:58.360 DEBUG:boto:Data: 2023-12-15T23:25:58.360 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.361 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.361 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.361 DEBUG:boto:Params: {} 2023-12-15T23:25:58.361 DEBUG:boto:Token: None 2023-12-15T23:25:58.361 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.361 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.365 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a48c33314ed4b6a-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.365 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:25:58.365 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.365 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.365 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.365 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.366 DEBUG:boto:Method: GET 2023-12-15T23:25:58.366 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.366 DEBUG:boto:Data: 2023-12-15T23:25:58.366 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.366 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.366 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.366 DEBUG:boto:Params: {} 2023-12-15T23:25:58.366 DEBUG:boto:Token: None 2023-12-15T23:25:58.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c= 2023-12-15T23:25:58.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c=', 'Content-Length': '0'} 2023-12-15T23:25:58.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9ea1ac2a960a352-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.368 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.369 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.369 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.369 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.369 DEBUG:boto:Method: GET 2023-12-15T23:25:58.369 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.369 DEBUG:boto:Data: 2023-12-15T23:25:58.369 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.369 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.369 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.369 DEBUG:boto:Params: {} 2023-12-15T23:25:58.369 DEBUG:boto:Token: None 2023-12-15T23:25:58.370 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c= 2023-12-15T23:25:58.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c=', 'Content-Length': '0'} 2023-12-15T23:25:58.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006398fc3d134dcf09-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.372 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.372 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.372 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.372 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.373 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.373 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.373 DEBUG:boto:Data: 2023-12-15T23:25:58.373 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.373 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.373 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.373 DEBUG:boto:Params: {} 2023-12-15T23:25:58.373 DEBUG:boto:Token: None 2023-12-15T23:25:58.373 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BOhbi8t5GVAoXoFr4DWjlUXvhQ8= 2023-12-15T23:25:58.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BOhbi8t5GVAoXoFr4DWjlUXvhQ8=', 'Content-Length': '0'} 2023-12-15T23:25:58.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000667bd8fbffd75e35-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.375 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.376 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.376 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.376 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.376 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.376 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.376 DEBUG:boto:Data: 2023-12-15T23:25:58.376 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.376 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.376 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.376 DEBUG:boto:Params: {} 2023-12-15T23:25:58.377 DEBUG:boto:Token: None 2023-12-15T23:25:58.377 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.377 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BOhbi8t5GVAoXoFr4DWjlUXvhQ8= 2023-12-15T23:25:58.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BOhbi8t5GVAoXoFr4DWjlUXvhQ8=', 'Content-Length': '0'} 2023-12-15T23:25:58.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a48171a14a92f177-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:25:58.379 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.379 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.379 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.379 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.379 DEBUG:boto:Method: GET 2023-12-15T23:25:58.380 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.380 DEBUG:boto:Data: 2023-12-15T23:25:58.380 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.380 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.380 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.380 DEBUG:boto:Params: {} 2023-12-15T23:25:58.380 DEBUG:boto:Token: None 2023-12-15T23:25:58.380 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.380 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c= 2023-12-15T23:25:58.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c=', 'Content-Length': '0'} 2023-12-15T23:25:58.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d09946d1bb8f1383-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.382 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.382 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.383 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.383 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.383 DEBUG:boto:Method: GET 2023-12-15T23:25:58.383 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.383 DEBUG:boto:Data: 2023-12-15T23:25:58.383 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.383 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.383 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.383 DEBUG:boto:Params: {} 2023-12-15T23:25:58.383 DEBUG:boto:Token: None 2023-12-15T23:25:58.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:25:58.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c= 2023-12-15T23:25:58.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OGODuax5FKbZ9eYHbEWrCZmv/8c=', 'Content-Length': '0'} 2023-12-15T23:25:58.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e513c5f956156f8-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.386 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.386 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.386 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.386 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.386 DEBUG:boto:Method: GET 2023-12-15T23:25:58.386 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.386 DEBUG:boto:Data: 2023-12-15T23:25:58.386 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.386 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.387 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.387 DEBUG:boto:Params: {} 2023-12-15T23:25:58.387 DEBUG:boto:Token: None 2023-12-15T23:25:58.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4ad17cd4d3ad703-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.433 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.434 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.434 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.434 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.434 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.434 DEBUG:boto:Method: GET 2023-12-15T23:25:58.434 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.434 DEBUG:boto:Data: 2023-12-15T23:25:58.434 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.434 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.435 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.435 DEBUG:boto:Params: {} 2023-12-15T23:25:58.435 DEBUG:boto:Token: None 2023-12-15T23:25:58.435 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.439 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000accb6639081d75e8-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.439 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.439 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.439 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.439 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.439 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:25:58.440 DEBUG:boto:Data: 2023-12-15T23:25:58.440 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.440 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.440 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.440 DEBUG:boto:Params: {} 2023-12-15T23:25:58.440 DEBUG:boto:Token: None 2023-12-15T23:25:58.440 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58 2023-12-15T23:25:58.440 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ARFsuSq8jIYwXlNP8xNeEGRm5zM= 2023-12-15T23:25:58.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ARFsuSq8jIYwXlNP8xNeEGRm5zM=', 'Content-Length': '0'} 2023-12-15T23:25:58.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e0c57eb2090640d-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.443 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.443 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.443 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.443 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:25:58.443 DEBUG:boto:Data: 2023-12-15T23:25:58.443 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.443 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.443 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.443 DEBUG:boto:Params: {} 2023-12-15T23:25:58.443 DEBUG:boto:Token: None 2023-12-15T23:25:58.444 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58 2023-12-15T23:25:58.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ARFsuSq8jIYwXlNP8xNeEGRm5zM= 2023-12-15T23:25:58.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ARFsuSq8jIYwXlNP8xNeEGRm5zM=', 'Content-Length': '0'} 2023-12-15T23:25:58.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca7ca3c74fd98cb5-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.446 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:25:58.446 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.446 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.446 DEBUG:boto:Method: GET 2023-12-15T23:25:58.446 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:25:58.446 DEBUG:boto:Data: 2023-12-15T23:25:58.446 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.446 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.446 DEBUG:boto:Params: {} 2023-12-15T23:25:58.447 DEBUG:boto:Token: None 2023-12-15T23:25:58.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58 2023-12-15T23:25:58.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c7pvE3mkMCYNprHOmX0LxQ1JZVc= 2023-12-15T23:25:58.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c7pvE3mkMCYNprHOmX0LxQ1JZVc=', 'Content-Length': '0'} 2023-12-15T23:25:58.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000029100c8f154aed-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.449 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:25:58.449 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:25:58.449 DEBUG:boto:Method: GET 2023-12-15T23:25:58.449 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:25:58.449 DEBUG:boto:Data: 2023-12-15T23:25:58.450 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.450 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.450 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.450 DEBUG:boto:Params: {} 2023-12-15T23:25:58.450 DEBUG:boto:Token: None 2023-12-15T23:25:58.450 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj58 2023-12-15T23:25:58.450 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:c7pvE3mkMCYNprHOmX0LxQ1JZVc= 2023-12-15T23:25:58.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:c7pvE3mkMCYNprHOmX0LxQ1JZVc=', 'Content-Length': '0'} 2023-12-15T23:25:58.452 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d517f6a2dc261f2f-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.493 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.494 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.494 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.494 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.494 DEBUG:boto:Method: GET 2023-12-15T23:25:58.494 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.494 DEBUG:boto:Data: 2023-12-15T23:25:58.494 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.494 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.494 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.494 DEBUG:boto:Params: {} 2023-12-15T23:25:58.494 DEBUG:boto:Token: None 2023-12-15T23:25:58.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008df7b3f5cab34446-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.497 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.497 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.498 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.498 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.498 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.498 DEBUG:boto:Method: GET 2023-12-15T23:25:58.498 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:25:58.498 DEBUG:boto:Data: 2023-12-15T23:25:58.498 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.498 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.498 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.498 DEBUG:boto:Params: {} 2023-12-15T23:25:58.499 DEBUG:boto:Token: None 2023-12-15T23:25:58.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.502 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6b6dd51041fc8bb-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.502 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:25:58.503 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.503 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.503 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.503 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.503 DEBUG:boto:Method: GET 2023-12-15T23:25:58.503 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.503 DEBUG:boto:Data: 2023-12-15T23:25:58.503 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.504 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.504 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.504 DEBUG:boto:Params: {} 2023-12-15T23:25:58.504 DEBUG:boto:Token: None 2023-12-15T23:25:58.504 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.504 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8= 2023-12-15T23:25:58.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8=', 'Content-Length': '0'} 2023-12-15T23:25:58.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d5b06c9d0cb1d37-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.506 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.507 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.507 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.507 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.507 DEBUG:boto:Method: GET 2023-12-15T23:25:58.507 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.507 DEBUG:boto:Data: 2023-12-15T23:25:58.507 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.507 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.507 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.507 DEBUG:boto:Params: {} 2023-12-15T23:25:58.507 DEBUG:boto:Token: None 2023-12-15T23:25:58.508 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.508 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8= 2023-12-15T23:25:58.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8=', 'Content-Length': '0'} 2023-12-15T23:25:58.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bdd4472c7fe0711-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.510 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.510 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.510 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.511 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.511 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.511 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.511 DEBUG:boto:Data: 2023-12-15T23:25:58.511 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.511 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.511 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.511 DEBUG:boto:Params: {} 2023-12-15T23:25:58.511 DEBUG:boto:Token: None 2023-12-15T23:25:58.511 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.512 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahFeR8eOUO0Fx0AXk9uls0MmGfk= 2023-12-15T23:25:58.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahFeR8eOUO0Fx0AXk9uls0MmGfk=', 'Content-Length': '0'} 2023-12-15T23:25:58.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b698a5a4e4f5ff6-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.514 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.514 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.514 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.514 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.514 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.514 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.514 DEBUG:boto:Data: 2023-12-15T23:25:58.514 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.515 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.515 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.515 DEBUG:boto:Params: {} 2023-12-15T23:25:58.515 DEBUG:boto:Token: None 2023-12-15T23:25:58.515 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahFeR8eOUO0Fx0AXk9uls0MmGfk= 2023-12-15T23:25:58.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahFeR8eOUO0Fx0AXk9uls0MmGfk=', 'Content-Length': '0'} 2023-12-15T23:25:58.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009039a73c31406ad2-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:25:58.518 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.518 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.518 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.518 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.518 DEBUG:boto:Method: GET 2023-12-15T23:25:58.518 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.518 DEBUG:boto:Data: 2023-12-15T23:25:58.518 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.519 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.519 DEBUG:boto:Params: {} 2023-12-15T23:25:58.519 DEBUG:boto:Token: None 2023-12-15T23:25:58.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8= 2023-12-15T23:25:58.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8=', 'Content-Length': '0'} 2023-12-15T23:25:58.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001562465378656638-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.561 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.562 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.562 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.562 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.562 DEBUG:boto:Method: GET 2023-12-15T23:25:58.562 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.562 DEBUG:boto:Data: 2023-12-15T23:25:58.562 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.562 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.562 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.562 DEBUG:boto:Params: {} 2023-12-15T23:25:58.563 DEBUG:boto:Token: None 2023-12-15T23:25:58.563 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:25:58.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8= 2023-12-15T23:25:58.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WbCsnNezbdxS0KU2ahCVq3rSAm8=', 'Content-Length': '0'} 2023-12-15T23:25:58.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040c85dd4c1f025f8-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.565 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.565 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.565 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.566 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.566 DEBUG:boto:Method: GET 2023-12-15T23:25:58.566 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.566 DEBUG:boto:Data: 2023-12-15T23:25:58.566 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.566 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.566 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.566 DEBUG:boto:Params: {} 2023-12-15T23:25:58.566 DEBUG:boto:Token: None 2023-12-15T23:25:58.567 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000abe3c6ff3eb150b-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.569 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.569 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.570 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.570 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.570 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.570 DEBUG:boto:Method: GET 2023-12-15T23:25:58.570 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.570 DEBUG:boto:Data: 2023-12-15T23:25:58.570 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.570 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.570 DEBUG:boto:Params: {} 2023-12-15T23:25:58.571 DEBUG:boto:Token: None 2023-12-15T23:25:58.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029a2a356c2992881-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.574 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.575 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.575 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.575 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.575 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:25:58.575 DEBUG:boto:Data: 2023-12-15T23:25:58.575 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.575 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.575 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.576 DEBUG:boto:Params: {} 2023-12-15T23:25:58.576 DEBUG:boto:Token: None 2023-12-15T23:25:58.576 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62 2023-12-15T23:25:58.576 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GBMRlhiLvJOlXI4yJ+ibSHkIOqY= 2023-12-15T23:25:58.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GBMRlhiLvJOlXI4yJ+ibSHkIOqY=', 'Content-Length': '0'} 2023-12-15T23:25:58.578 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f8d11064e7ea7fc-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.578 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.578 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.578 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.578 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:25:58.578 DEBUG:boto:Data: 2023-12-15T23:25:58.579 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.579 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.579 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.579 DEBUG:boto:Params: {} 2023-12-15T23:25:58.579 DEBUG:boto:Token: None 2023-12-15T23:25:58.579 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62 2023-12-15T23:25:58.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GBMRlhiLvJOlXI4yJ+ibSHkIOqY= 2023-12-15T23:25:58.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GBMRlhiLvJOlXI4yJ+ibSHkIOqY=', 'Content-Length': '0'} 2023-12-15T23:25:58.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009aacc90b20d56a06-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:25:58.582 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.582 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.582 DEBUG:boto:Method: GET 2023-12-15T23:25:58.582 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:25:58.582 DEBUG:boto:Data: 2023-12-15T23:25:58.582 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.582 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.582 DEBUG:boto:Params: {} 2023-12-15T23:25:58.582 DEBUG:boto:Token: None 2023-12-15T23:25:58.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62 2023-12-15T23:25:58.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nOSgN9OV4Mb7lXTmb0Y55S9+8/4= 2023-12-15T23:25:58.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nOSgN9OV4Mb7lXTmb0Y55S9+8/4=', 'Content-Length': '0'} 2023-12-15T23:25:58.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfdc26e8bd8f9e67-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.585 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:25:58.585 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:25:58.585 DEBUG:boto:Method: GET 2023-12-15T23:25:58.586 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:25:58.586 DEBUG:boto:Data: 2023-12-15T23:25:58.586 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.586 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.586 DEBUG:boto:Params: {} 2023-12-15T23:25:58.586 DEBUG:boto:Token: None 2023-12-15T23:25:58.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj62 2023-12-15T23:25:58.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nOSgN9OV4Mb7lXTmb0Y55S9+8/4= 2023-12-15T23:25:58.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nOSgN9OV4Mb7lXTmb0Y55S9+8/4=', 'Content-Length': '0'} 2023-12-15T23:25:58.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014c76c330e03b6b4-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.589 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.589 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.589 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.589 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.589 DEBUG:boto:Method: GET 2023-12-15T23:25:58.589 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.589 DEBUG:boto:Data: 2023-12-15T23:25:58.589 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.589 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.589 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.589 DEBUG:boto:Params: {} 2023-12-15T23:25:58.590 DEBUG:boto:Token: None 2023-12-15T23:25:58.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.592 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b062e772990940b6-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.593 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.593 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.593 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.593 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.593 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.593 DEBUG:boto:Method: GET 2023-12-15T23:25:58.593 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:25:58.593 DEBUG:boto:Data: 2023-12-15T23:25:58.594 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.594 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.594 DEBUG:boto:Params: {} 2023-12-15T23:25:58.594 DEBUG:boto:Token: None 2023-12-15T23:25:58.594 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.594 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.598 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023fdaa9935a04370-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.598 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:25:58.599 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.599 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.599 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.599 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.599 DEBUG:boto:Method: GET 2023-12-15T23:25:58.599 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.599 DEBUG:boto:Data: 2023-12-15T23:25:58.599 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.599 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.599 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.599 DEBUG:boto:Params: {} 2023-12-15T23:25:58.600 DEBUG:boto:Token: None 2023-12-15T23:25:58.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY= 2023-12-15T23:25:58.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY=', 'Content-Length': '0'} 2023-12-15T23:25:58.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b9bbc7d8c7b0f85-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.602 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.602 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.602 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.603 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.603 DEBUG:boto:Method: GET 2023-12-15T23:25:58.603 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.603 DEBUG:boto:Data: 2023-12-15T23:25:58.603 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.603 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.603 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.603 DEBUG:boto:Params: {} 2023-12-15T23:25:58.603 DEBUG:boto:Token: None 2023-12-15T23:25:58.604 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY= 2023-12-15T23:25:58.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY=', 'Content-Length': '0'} 2023-12-15T23:25:58.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3e50988b418a251-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.606 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.607 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.607 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.607 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.607 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.607 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.607 DEBUG:boto:Data: 2023-12-15T23:25:58.607 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.607 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.607 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.607 DEBUG:boto:Params: {} 2023-12-15T23:25:58.608 DEBUG:boto:Token: None 2023-12-15T23:25:58.608 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.608 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jrV3Wih7i08ekSelZMZlZxl0H5o= 2023-12-15T23:25:58.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jrV3Wih7i08ekSelZMZlZxl0H5o=', 'Content-Length': '0'} 2023-12-15T23:25:58.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d24a4c7e4ea24042-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.610 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.610 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.610 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.610 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.611 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.611 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.611 DEBUG:boto:Data: 2023-12-15T23:25:58.611 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.611 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.611 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.611 DEBUG:boto:Params: {} 2023-12-15T23:25:58.611 DEBUG:boto:Token: None 2023-12-15T23:25:58.611 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jrV3Wih7i08ekSelZMZlZxl0H5o= 2023-12-15T23:25:58.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jrV3Wih7i08ekSelZMZlZxl0H5o=', 'Content-Length': '0'} 2023-12-15T23:25:58.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086e10641234167ae-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:25:58.614 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.614 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.614 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.615 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.615 DEBUG:boto:Method: GET 2023-12-15T23:25:58.615 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.615 DEBUG:boto:Data: 2023-12-15T23:25:58.615 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.615 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.615 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.615 DEBUG:boto:Params: {} 2023-12-15T23:25:58.615 DEBUG:boto:Token: None 2023-12-15T23:25:58.615 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY= 2023-12-15T23:25:58.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY=', 'Content-Length': '0'} 2023-12-15T23:25:58.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d6bae779b6a43b4-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.661 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.662 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.662 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.662 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.662 DEBUG:boto:Method: GET 2023-12-15T23:25:58.662 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.662 DEBUG:boto:Data: 2023-12-15T23:25:58.662 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.662 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.662 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.662 DEBUG:boto:Params: {} 2023-12-15T23:25:58.662 DEBUG:boto:Token: None 2023-12-15T23:25:58.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:25:58.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY= 2023-12-15T23:25:58.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:PBdPijYRS2vjElcOLS4/f5ppjAY=', 'Content-Length': '0'} 2023-12-15T23:25:58.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006046c6e10c3c4b09-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.665 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.665 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.665 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.665 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.665 DEBUG:boto:Method: GET 2023-12-15T23:25:58.665 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.665 DEBUG:boto:Data: 2023-12-15T23:25:58.666 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.666 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.666 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.666 DEBUG:boto:Params: {} 2023-12-15T23:25:58.666 DEBUG:boto:Token: None 2023-12-15T23:25:58.666 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.666 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fada16ac9ca8e874-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.669 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.669 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.669 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.669 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.670 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.670 DEBUG:boto:Method: GET 2023-12-15T23:25:58.670 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.670 DEBUG:boto:Data: 2023-12-15T23:25:58.670 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.670 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.670 DEBUG:boto:Params: {} 2023-12-15T23:25:58.670 DEBUG:boto:Token: None 2023-12-15T23:25:58.670 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.674 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5424f5d33cb452d-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.674 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.675 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.675 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.675 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.675 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:25:58.675 DEBUG:boto:Data: 2023-12-15T23:25:58.675 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.675 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.675 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.676 DEBUG:boto:Params: {} 2023-12-15T23:25:58.676 DEBUG:boto:Token: None 2023-12-15T23:25:58.676 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68 2023-12-15T23:25:58.676 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pU/8ok+8yK2nOJSbWZdV7aEpPNo= 2023-12-15T23:25:58.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pU/8ok+8yK2nOJSbWZdV7aEpPNo=', 'Content-Length': '0'} 2023-12-15T23:25:58.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e313b8d93b4e34c8-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.679 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.679 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.679 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.679 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:25:58.679 DEBUG:boto:Data: 2023-12-15T23:25:58.679 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.679 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.679 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.679 DEBUG:boto:Params: {} 2023-12-15T23:25:58.679 DEBUG:boto:Token: None 2023-12-15T23:25:58.679 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68 2023-12-15T23:25:58.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pU/8ok+8yK2nOJSbWZdV7aEpPNo= 2023-12-15T23:25:58.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pU/8ok+8yK2nOJSbWZdV7aEpPNo=', 'Content-Length': '0'} 2023-12-15T23:25:58.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098d61597baf16e40-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.682 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:25:58.682 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.682 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.682 DEBUG:boto:Method: GET 2023-12-15T23:25:58.682 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:25:58.682 DEBUG:boto:Data: 2023-12-15T23:25:58.683 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.683 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.683 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.683 DEBUG:boto:Params: {} 2023-12-15T23:25:58.683 DEBUG:boto:Token: None 2023-12-15T23:25:58.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68 2023-12-15T23:25:58.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9RMsbObE45cMAq7GF3V29fR3jh4= 2023-12-15T23:25:58.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9RMsbObE45cMAq7GF3V29fR3jh4=', 'Content-Length': '0'} 2023-12-15T23:25:58.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075d8e7258efcc276-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.685 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:25:58.685 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:25:58.686 DEBUG:boto:Method: GET 2023-12-15T23:25:58.686 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:25:58.686 DEBUG:boto:Data: 2023-12-15T23:25:58.686 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.686 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.686 DEBUG:boto:Params: {} 2023-12-15T23:25:58.686 DEBUG:boto:Token: None 2023-12-15T23:25:58.686 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj68 2023-12-15T23:25:58.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9RMsbObE45cMAq7GF3V29fR3jh4= 2023-12-15T23:25:58.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9RMsbObE45cMAq7GF3V29fR3jh4=', 'Content-Length': '0'} 2023-12-15T23:25:58.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fcb334e6bffcb84-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.689 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.689 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.689 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.689 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.689 DEBUG:boto:Method: GET 2023-12-15T23:25:58.689 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.689 DEBUG:boto:Data: 2023-12-15T23:25:58.690 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.690 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.690 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.690 DEBUG:boto:Params: {} 2023-12-15T23:25:58.690 DEBUG:boto:Token: None 2023-12-15T23:25:58.690 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9b5e571430032fd-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.693 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.693 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.693 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.693 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.693 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.694 DEBUG:boto:Method: GET 2023-12-15T23:25:58.694 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:25:58.694 DEBUG:boto:Data: 2023-12-15T23:25:58.694 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.694 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.694 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.694 DEBUG:boto:Params: {} 2023-12-15T23:25:58.694 DEBUG:boto:Token: None 2023-12-15T23:25:58.694 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.695 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001638180aa084aaf9-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.698 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.699 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:25:58.699 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.699 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.699 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.699 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.699 DEBUG:boto:Method: GET 2023-12-15T23:25:58.699 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.699 DEBUG:boto:Data: 2023-12-15T23:25:58.699 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.700 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.700 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.700 DEBUG:boto:Params: {} 2023-12-15T23:25:58.700 DEBUG:boto:Token: None 2023-12-15T23:25:58.700 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI= 2023-12-15T23:25:58.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI=', 'Content-Length': '0'} 2023-12-15T23:25:58.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e46ce5b34108bb2e-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.702 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.703 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.703 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.703 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.703 DEBUG:boto:Method: GET 2023-12-15T23:25:58.703 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.703 DEBUG:boto:Data: 2023-12-15T23:25:58.703 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.703 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.703 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.703 DEBUG:boto:Params: {} 2023-12-15T23:25:58.704 DEBUG:boto:Token: None 2023-12-15T23:25:58.704 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.704 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI= 2023-12-15T23:25:58.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI=', 'Content-Length': '0'} 2023-12-15T23:25:58.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e6d0b5fb857db05-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.753 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.754 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.754 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.754 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.754 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.754 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.754 DEBUG:boto:Data: 2023-12-15T23:25:58.754 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.754 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.754 DEBUG:boto:Params: {} 2023-12-15T23:25:58.754 DEBUG:boto:Token: None 2023-12-15T23:25:58.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKSkiIbpD4KKebmQz/jitstD0NQ= 2023-12-15T23:25:58.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKSkiIbpD4KKebmQz/jitstD0NQ=', 'Content-Length': '0'} 2023-12-15T23:25:58.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090b24cea10e8599a-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.757 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.757 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.757 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.757 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.757 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.757 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.758 DEBUG:boto:Data: 2023-12-15T23:25:58.758 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.758 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.758 DEBUG:boto:Params: {} 2023-12-15T23:25:58.758 DEBUG:boto:Token: None 2023-12-15T23:25:58.758 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKSkiIbpD4KKebmQz/jitstD0NQ= 2023-12-15T23:25:58.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKSkiIbpD4KKebmQz/jitstD0NQ=', 'Content-Length': '0'} 2023-12-15T23:25:58.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c79bb4f3609e0479-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:25:58.761 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.761 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.761 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.761 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.761 DEBUG:boto:Method: GET 2023-12-15T23:25:58.761 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.761 DEBUG:boto:Data: 2023-12-15T23:25:58.761 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.761 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.761 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.761 DEBUG:boto:Params: {} 2023-12-15T23:25:58.762 DEBUG:boto:Token: None 2023-12-15T23:25:58.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.762 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI= 2023-12-15T23:25:58.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI=', 'Content-Length': '0'} 2023-12-15T23:25:58.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000875d0fa23fe8c137-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.765 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.765 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.765 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.765 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.765 DEBUG:boto:Method: GET 2023-12-15T23:25:58.765 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.765 DEBUG:boto:Data: 2023-12-15T23:25:58.765 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.766 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.766 DEBUG:boto:Params: {} 2023-12-15T23:25:58.766 DEBUG:boto:Token: None 2023-12-15T23:25:58.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:25:58.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI= 2023-12-15T23:25:58.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:d5WEmab/tzXcN2RRqCo0WAcIQxI=', 'Content-Length': '0'} 2023-12-15T23:25:58.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a2e7c3d7b0410d7-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.769 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.769 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.769 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.769 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.769 DEBUG:boto:Method: GET 2023-12-15T23:25:58.769 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.769 DEBUG:boto:Data: 2023-12-15T23:25:58.770 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.770 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.770 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.770 DEBUG:boto:Params: {} 2023-12-15T23:25:58.770 DEBUG:boto:Token: None 2023-12-15T23:25:58.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aab08f363054c3e1-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.772 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.773 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.773 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.773 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.773 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.773 DEBUG:boto:Method: GET 2023-12-15T23:25:58.773 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.774 DEBUG:boto:Data: 2023-12-15T23:25:58.774 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.774 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.774 DEBUG:boto:Params: {} 2023-12-15T23:25:58.774 DEBUG:boto:Token: None 2023-12-15T23:25:58.774 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.774 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.778 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003770594684299e0a-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.778 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.779 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.779 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.779 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.779 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:25:58.779 DEBUG:boto:Data: 2023-12-15T23:25:58.779 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.779 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.779 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.779 DEBUG:boto:Params: {} 2023-12-15T23:25:58.780 DEBUG:boto:Token: None 2023-12-15T23:25:58.780 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69 2023-12-15T23:25:58.780 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPXiDCAlIhjk6W/Z9l0OzDI+dzI= 2023-12-15T23:25:58.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPXiDCAlIhjk6W/Z9l0OzDI+dzI=', 'Content-Length': '0'} 2023-12-15T23:25:58.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8c9f6ed43c0ba7b-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.782 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.782 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.783 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.783 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:25:58.783 DEBUG:boto:Data: 2023-12-15T23:25:58.783 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.783 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.783 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.783 DEBUG:boto:Params: {} 2023-12-15T23:25:58.783 DEBUG:boto:Token: None 2023-12-15T23:25:58.783 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69 2023-12-15T23:25:58.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPXiDCAlIhjk6W/Z9l0OzDI+dzI= 2023-12-15T23:25:58.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPXiDCAlIhjk6W/Z9l0OzDI+dzI=', 'Content-Length': '0'} 2023-12-15T23:25:58.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc045abc13b37e09-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:25:58.786 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.786 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.786 DEBUG:boto:Method: GET 2023-12-15T23:25:58.786 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:25:58.786 DEBUG:boto:Data: 2023-12-15T23:25:58.786 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.786 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.787 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.787 DEBUG:boto:Params: {} 2023-12-15T23:25:58.787 DEBUG:boto:Token: None 2023-12-15T23:25:58.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69 2023-12-15T23:25:58.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FPRaWthSLJo8sGHmwO411KY70LU= 2023-12-15T23:25:58.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FPRaWthSLJo8sGHmwO411KY70LU=', 'Content-Length': '0'} 2023-12-15T23:25:58.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a0ec790f8663579-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.830 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:25:58.830 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:25:58.830 DEBUG:boto:Method: GET 2023-12-15T23:25:58.830 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:25:58.830 DEBUG:boto:Data: 2023-12-15T23:25:58.830 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.830 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.830 DEBUG:boto:Params: {} 2023-12-15T23:25:58.831 DEBUG:boto:Token: None 2023-12-15T23:25:58.831 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj69 2023-12-15T23:25:58.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FPRaWthSLJo8sGHmwO411KY70LU= 2023-12-15T23:25:58.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FPRaWthSLJo8sGHmwO411KY70LU=', 'Content-Length': '0'} 2023-12-15T23:25:58.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036beb3f86938eac8-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.833 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.834 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.834 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.834 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.834 DEBUG:boto:Method: GET 2023-12-15T23:25:58.834 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.834 DEBUG:boto:Data: 2023-12-15T23:25:58.834 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.834 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.834 DEBUG:boto:Params: {} 2023-12-15T23:25:58.835 DEBUG:boto:Token: None 2023-12-15T23:25:58.835 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000206c9b78f2f7945-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.837 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.838 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.838 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.838 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.838 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.838 DEBUG:boto:Method: GET 2023-12-15T23:25:58.838 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:25:58.838 DEBUG:boto:Data: 2023-12-15T23:25:58.838 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.839 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.839 DEBUG:boto:Params: {} 2023-12-15T23:25:58.839 DEBUG:boto:Token: None 2023-12-15T23:25:58.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5e0c81b9963b8ca-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.843 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:25:58.843 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.843 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.843 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.843 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.843 DEBUG:boto:Method: GET 2023-12-15T23:25:58.844 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.844 DEBUG:boto:Data: 2023-12-15T23:25:58.844 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.844 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.844 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.844 DEBUG:boto:Params: {} 2023-12-15T23:25:58.844 DEBUG:boto:Token: None 2023-12-15T23:25:58.844 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s= 2023-12-15T23:25:58.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s=', 'Content-Length': '0'} 2023-12-15T23:25:58.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9f85fd2fad80ba6-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.847 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.847 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.847 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.847 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.847 DEBUG:boto:Method: GET 2023-12-15T23:25:58.848 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.848 DEBUG:boto:Data: 2023-12-15T23:25:58.848 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.848 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.848 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.848 DEBUG:boto:Params: {} 2023-12-15T23:25:58.848 DEBUG:boto:Token: None 2023-12-15T23:25:58.848 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.848 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s= 2023-12-15T23:25:58.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s=', 'Content-Length': '0'} 2023-12-15T23:25:58.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d8dccb39abda7ff-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.893 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.893 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.894 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.894 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.894 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.894 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.894 DEBUG:boto:Data: 2023-12-15T23:25:58.894 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.894 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.894 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.894 DEBUG:boto:Params: {} 2023-12-15T23:25:58.894 DEBUG:boto:Token: None 2023-12-15T23:25:58.895 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t9lWtGClhzg0jZ4Xynpd9vF2Htg= 2023-12-15T23:25:58.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t9lWtGClhzg0jZ4Xynpd9vF2Htg=', 'Content-Length': '0'} 2023-12-15T23:25:58.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0bf57c4c13c948e-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.897 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.897 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.897 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.898 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.898 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.898 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.898 DEBUG:boto:Data: 2023-12-15T23:25:58.898 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.898 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.898 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.898 DEBUG:boto:Params: {} 2023-12-15T23:25:58.898 DEBUG:boto:Token: None 2023-12-15T23:25:58.898 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t9lWtGClhzg0jZ4Xynpd9vF2Htg= 2023-12-15T23:25:58.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t9lWtGClhzg0jZ4Xynpd9vF2Htg=', 'Content-Length': '0'} 2023-12-15T23:25:58.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccdf048cd7ceda64-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:25:58.901 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.901 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.901 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.902 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.902 DEBUG:boto:Method: GET 2023-12-15T23:25:58.902 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.902 DEBUG:boto:Data: 2023-12-15T23:25:58.902 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.902 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.902 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.902 DEBUG:boto:Params: {} 2023-12-15T23:25:58.902 DEBUG:boto:Token: None 2023-12-15T23:25:58.903 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s= 2023-12-15T23:25:58.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s=', 'Content-Length': '0'} 2023-12-15T23:25:58.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9ccb4c475b0a0aa-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.905 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.905 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.906 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.906 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.906 DEBUG:boto:Method: GET 2023-12-15T23:25:58.906 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.906 DEBUG:boto:Data: 2023-12-15T23:25:58.906 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.906 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.906 DEBUG:boto:Params: {} 2023-12-15T23:25:58.906 DEBUG:boto:Token: None 2023-12-15T23:25:58.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:25:58.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s= 2023-12-15T23:25:58.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7pWW2sjOH4NS+fIk5uH5+k3E96s=', 'Content-Length': '0'} 2023-12-15T23:25:58.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b9dea354a7f71f1-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.909 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.909 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.909 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.910 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.910 DEBUG:boto:Method: GET 2023-12-15T23:25:58.910 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.910 DEBUG:boto:Data: 2023-12-15T23:25:58.910 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.910 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.910 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.910 DEBUG:boto:Params: {} 2023-12-15T23:25:58.910 DEBUG:boto:Token: None 2023-12-15T23:25:58.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bc2107d948b059c-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.913 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.913 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.914 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.914 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.914 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.914 DEBUG:boto:Method: GET 2023-12-15T23:25:58.914 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.914 DEBUG:boto:Data: 2023-12-15T23:25:58.914 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.914 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.915 DEBUG:boto:Params: {} 2023-12-15T23:25:58.915 DEBUG:boto:Token: None 2023-12-15T23:25:58.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b114a049bdfef638-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.918 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.919 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.919 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.919 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.919 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:25:58.919 DEBUG:boto:Data: 2023-12-15T23:25:58.919 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.919 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.919 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.919 DEBUG:boto:Params: {} 2023-12-15T23:25:58.920 DEBUG:boto:Token: None 2023-12-15T23:25:58.920 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74 2023-12-15T23:25:58.920 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4xAeaJlMXvSWafPoDc1xzda8NN8= 2023-12-15T23:25:58.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4xAeaJlMXvSWafPoDc1xzda8NN8=', 'Content-Length': '0'} 2023-12-15T23:25:58.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fba3d67d9435070-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.922 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.922 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.922 DEBUG:boto:Method: HEAD 2023-12-15T23:25:58.922 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:25:58.923 DEBUG:boto:Data: 2023-12-15T23:25:58.923 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.923 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.923 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.923 DEBUG:boto:Params: {} 2023-12-15T23:25:58.923 DEBUG:boto:Token: None 2023-12-15T23:25:58.923 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74 2023-12-15T23:25:58.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4xAeaJlMXvSWafPoDc1xzda8NN8= 2023-12-15T23:25:58.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4xAeaJlMXvSWafPoDc1xzda8NN8=', 'Content-Length': '0'} 2023-12-15T23:25:58.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014c354dcf4e3f5d4-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:25:58.929 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.929 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.929 DEBUG:boto:Method: GET 2023-12-15T23:25:58.929 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:25:58.929 DEBUG:boto:Data: 2023-12-15T23:25:58.929 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.929 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.929 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.929 DEBUG:boto:Params: {} 2023-12-15T23:25:58.930 DEBUG:boto:Token: None 2023-12-15T23:25:58.930 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74 2023-12-15T23:25:58.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gutB5TwG1eMwWDXpCRgoDBDm2hs= 2023-12-15T23:25:58.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gutB5TwG1eMwWDXpCRgoDBDm2hs=', 'Content-Length': '0'} 2023-12-15T23:25:58.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7320b98f0695dea-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.933 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:25:58.933 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:25:58.933 DEBUG:boto:Method: GET 2023-12-15T23:25:58.933 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:25:58.933 DEBUG:boto:Data: 2023-12-15T23:25:58.933 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.933 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.933 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.933 DEBUG:boto:Params: {} 2023-12-15T23:25:58.934 DEBUG:boto:Token: None 2023-12-15T23:25:58.934 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj74 2023-12-15T23:25:58.934 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gutB5TwG1eMwWDXpCRgoDBDm2hs= 2023-12-15T23:25:58.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gutB5TwG1eMwWDXpCRgoDBDm2hs=', 'Content-Length': '0'} 2023-12-15T23:25:58.936 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f66c59902d2aa42c-00657ce086-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.977 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.978 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.978 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.978 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.978 DEBUG:boto:Method: GET 2023-12-15T23:25:58.978 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.978 DEBUG:boto:Data: 2023-12-15T23:25:58.978 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.978 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.979 DEBUG:boto:Params: {} 2023-12-15T23:25:58.979 DEBUG:boto:Token: None 2023-12-15T23:25:58.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f60bf1783c0844d9-00657ce086-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.982 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.982 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:58.982 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:58.982 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.983 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.983 DEBUG:boto:Method: GET 2023-12-15T23:25:58.983 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:25:58.983 DEBUG:boto:Data: 2023-12-15T23:25:58.983 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.983 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:58.983 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.983 DEBUG:boto:Params: {} 2023-12-15T23:25:58.983 DEBUG:boto:Token: None 2023-12-15T23:25:58.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/ 2023-12-15T23:25:58.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w= 2023-12-15T23:25:58.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mqSoUcAls/EWzcLUYbuEk4+TG7w=', 'Content-Length': '0'} 2023-12-15T23:25:58.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b94b77172dc68d6-00657ce086-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:58.987 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:58.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:25:58.988 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:58.988 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:58.988 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:58.988 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:58.988 DEBUG:boto:Method: GET 2023-12-15T23:25:58.988 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:58.988 DEBUG:boto:Data: 2023-12-15T23:25:58.989 DEBUG:boto:Headers: {} 2023-12-15T23:25:58.989 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:58.989 DEBUG:boto:Port: 8000 2023-12-15T23:25:58.989 DEBUG:boto:Params: {} 2023-12-15T23:25:58.989 DEBUG:boto:Token: None 2023-12-15T23:25:58.989 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:58 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:58.989 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uYQKTKGq7uAGH7nIv40PgX9f5AY= 2023-12-15T23:25:58.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:58 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uYQKTKGq7uAGH7nIv40PgX9f5AY=', 'Content-Length': '0'} 2023-12-15T23:25:58.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0953157436652c-00657ce086-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:58 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.033 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.033 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.034 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.034 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.034 DEBUG:boto:Method: GET 2023-12-15T23:25:59.034 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.034 DEBUG:boto:Data: 2023-12-15T23:25:59.034 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.034 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.034 DEBUG:boto:Params: {} 2023-12-15T23:25:59.034 DEBUG:boto:Token: None 2023-12-15T23:25:59.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50= 2023-12-15T23:25:59.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50=', 'Content-Length': '0'} 2023-12-15T23:25:59.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000831ed4feaded32e-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.037 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.037 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.037 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.038 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.038 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.038 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.038 DEBUG:boto:Data: 2023-12-15T23:25:59.038 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.038 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.038 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.038 DEBUG:boto:Params: {} 2023-12-15T23:25:59.038 DEBUG:boto:Token: None 2023-12-15T23:25:59.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6tmmaNA2iJUAULEHb4laa8K1uPw= 2023-12-15T23:25:59.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6tmmaNA2iJUAULEHb4laa8K1uPw=', 'Content-Length': '0'} 2023-12-15T23:25:59.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eef9655532f590d4-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.041 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.041 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.041 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.041 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.041 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.042 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.042 DEBUG:boto:Data: 2023-12-15T23:25:59.042 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.042 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.042 DEBUG:boto:Params: {} 2023-12-15T23:25:59.042 DEBUG:boto:Token: None 2023-12-15T23:25:59.042 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6tmmaNA2iJUAULEHb4laa8K1uPw= 2023-12-15T23:25:59.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6tmmaNA2iJUAULEHb4laa8K1uPw=', 'Content-Length': '0'} 2023-12-15T23:25:59.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a73554311f8221dd-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:25:59.045 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.045 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.045 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.045 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.045 DEBUG:boto:Method: GET 2023-12-15T23:25:59.045 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.046 DEBUG:boto:Data: 2023-12-15T23:25:59.046 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.046 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.046 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.046 DEBUG:boto:Params: {} 2023-12-15T23:25:59.046 DEBUG:boto:Token: None 2023-12-15T23:25:59.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.047 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50= 2023-12-15T23:25:59.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50=', 'Content-Length': '0'} 2023-12-15T23:25:59.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c549982b30275848-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.049 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.049 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.049 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.050 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.050 DEBUG:boto:Method: GET 2023-12-15T23:25:59.050 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.050 DEBUG:boto:Data: 2023-12-15T23:25:59.050 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.050 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.050 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.050 DEBUG:boto:Params: {} 2023-12-15T23:25:59.050 DEBUG:boto:Token: None 2023-12-15T23:25:59.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:25:59.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50= 2023-12-15T23:25:59.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b2dw0Yvp0Qg/PvCtfHv+gvtUG50=', 'Content-Length': '0'} 2023-12-15T23:25:59.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030c1cb88c32ca5e9-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.053 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.053 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.053 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.053 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.054 DEBUG:boto:Method: GET 2023-12-15T23:25:59.054 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.054 DEBUG:boto:Data: 2023-12-15T23:25:59.054 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.054 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.054 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.054 DEBUG:boto:Params: {} 2023-12-15T23:25:59.054 DEBUG:boto:Token: None 2023-12-15T23:25:59.054 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.054 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c3a2a75cc8bbb3f-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.057 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.058 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.058 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.058 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.058 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.058 DEBUG:boto:Method: GET 2023-12-15T23:25:59.058 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.058 DEBUG:boto:Data: 2023-12-15T23:25:59.058 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.058 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.059 DEBUG:boto:Params: {} 2023-12-15T23:25:59.059 DEBUG:boto:Token: None 2023-12-15T23:25:59.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.063 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cbf50887584e928-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.063 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.063 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.063 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.063 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.063 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:25:59.064 DEBUG:boto:Data: 2023-12-15T23:25:59.064 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.064 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.064 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.064 DEBUG:boto:Params: {} 2023-12-15T23:25:59.064 DEBUG:boto:Token: None 2023-12-15T23:25:59.064 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76 2023-12-15T23:25:59.064 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6ywYn2W18ilIehl0DT7LxjClxIM= 2023-12-15T23:25:59.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6ywYn2W18ilIehl0DT7LxjClxIM=', 'Content-Length': '0'} 2023-12-15T23:25:59.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f9199f08212fe7-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.067 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.067 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.067 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.067 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:25:59.067 DEBUG:boto:Data: 2023-12-15T23:25:59.067 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.068 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.068 DEBUG:boto:Params: {} 2023-12-15T23:25:59.068 DEBUG:boto:Token: None 2023-12-15T23:25:59.068 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76 2023-12-15T23:25:59.068 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6ywYn2W18ilIehl0DT7LxjClxIM= 2023-12-15T23:25:59.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6ywYn2W18ilIehl0DT7LxjClxIM=', 'Content-Length': '0'} 2023-12-15T23:25:59.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018aecee79668a062-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:25:59.071 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.071 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.071 DEBUG:boto:Method: GET 2023-12-15T23:25:59.071 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:25:59.071 DEBUG:boto:Data: 2023-12-15T23:25:59.071 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.072 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.072 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.072 DEBUG:boto:Params: {} 2023-12-15T23:25:59.072 DEBUG:boto:Token: None 2023-12-15T23:25:59.072 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76 2023-12-15T23:25:59.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CJ64YfTBRJqEosofWAy4oWgPK7I= 2023-12-15T23:25:59.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CJ64YfTBRJqEosofWAy4oWgPK7I=', 'Content-Length': '0'} 2023-12-15T23:25:59.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053ebd1eaee974b9b-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.075 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:25:59.075 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:25:59.075 DEBUG:boto:Method: GET 2023-12-15T23:25:59.075 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:25:59.076 DEBUG:boto:Data: 2023-12-15T23:25:59.076 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.076 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.076 DEBUG:boto:Params: {} 2023-12-15T23:25:59.076 DEBUG:boto:Token: None 2023-12-15T23:25:59.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj76 2023-12-15T23:25:59.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CJ64YfTBRJqEosofWAy4oWgPK7I= 2023-12-15T23:25:59.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CJ64YfTBRJqEosofWAy4oWgPK7I=', 'Content-Length': '0'} 2023-12-15T23:25:59.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dc0d6d387ae1cde-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.121 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.122 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.122 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.122 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.122 DEBUG:boto:Method: GET 2023-12-15T23:25:59.122 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.122 DEBUG:boto:Data: 2023-12-15T23:25:59.122 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.122 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.122 DEBUG:boto:Params: {} 2023-12-15T23:25:59.122 DEBUG:boto:Token: None 2023-12-15T23:25:59.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086f653fa902fcbe3-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.125 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.126 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.126 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.126 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.126 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.126 DEBUG:boto:Method: GET 2023-12-15T23:25:59.126 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:25:59.126 DEBUG:boto:Data: 2023-12-15T23:25:59.126 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.127 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.127 DEBUG:boto:Params: {} 2023-12-15T23:25:59.127 DEBUG:boto:Token: None 2023-12-15T23:25:59.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084b2b29f4d11529d-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.131 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:25:59.131 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.131 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.132 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.132 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.132 DEBUG:boto:Method: GET 2023-12-15T23:25:59.132 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.132 DEBUG:boto:Data: 2023-12-15T23:25:59.132 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.132 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.132 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.132 DEBUG:boto:Params: {} 2023-12-15T23:25:59.132 DEBUG:boto:Token: None 2023-12-15T23:25:59.133 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.133 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8= 2023-12-15T23:25:59.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8=', 'Content-Length': '0'} 2023-12-15T23:25:59.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2cd57d82352a736-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.137 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.137 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.137 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.137 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.137 DEBUG:boto:Method: GET 2023-12-15T23:25:59.137 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.137 DEBUG:boto:Data: 2023-12-15T23:25:59.137 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.138 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.138 DEBUG:boto:Params: {} 2023-12-15T23:25:59.138 DEBUG:boto:Token: None 2023-12-15T23:25:59.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8= 2023-12-15T23:25:59.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8=', 'Content-Length': '0'} 2023-12-15T23:25:59.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e976e7d2d5037bf4-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.141 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.141 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.141 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.141 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.141 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.141 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.141 DEBUG:boto:Data: 2023-12-15T23:25:59.141 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.142 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.142 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.142 DEBUG:boto:Params: {} 2023-12-15T23:25:59.142 DEBUG:boto:Token: None 2023-12-15T23:25:59.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RT9tcFCtQ//4B1FjBoLI58dIPqo= 2023-12-15T23:25:59.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RT9tcFCtQ//4B1FjBoLI58dIPqo=', 'Content-Length': '0'} 2023-12-15T23:25:59.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d8ca4a2e2e95cda-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.145 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.145 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.145 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.146 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.146 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.146 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.146 DEBUG:boto:Data: 2023-12-15T23:25:59.146 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.146 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.146 DEBUG:boto:Params: {} 2023-12-15T23:25:59.146 DEBUG:boto:Token: None 2023-12-15T23:25:59.146 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RT9tcFCtQ//4B1FjBoLI58dIPqo= 2023-12-15T23:25:59.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RT9tcFCtQ//4B1FjBoLI58dIPqo=', 'Content-Length': '0'} 2023-12-15T23:25:59.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e065759ec88ae76-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:25:59.149 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.149 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.149 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.149 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.149 DEBUG:boto:Method: GET 2023-12-15T23:25:59.149 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.150 DEBUG:boto:Data: 2023-12-15T23:25:59.150 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.150 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.150 DEBUG:boto:Params: {} 2023-12-15T23:25:59.150 DEBUG:boto:Token: None 2023-12-15T23:25:59.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8= 2023-12-15T23:25:59.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8=', 'Content-Length': '0'} 2023-12-15T23:25:59.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2a1be90474779a1-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.153 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.153 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.153 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.153 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.153 DEBUG:boto:Method: GET 2023-12-15T23:25:59.153 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.154 DEBUG:boto:Data: 2023-12-15T23:25:59.154 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.154 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.154 DEBUG:boto:Params: {} 2023-12-15T23:25:59.154 DEBUG:boto:Token: None 2023-12-15T23:25:59.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:25:59.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8= 2023-12-15T23:25:59.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+Y4iJ0RHLogT6yM7KMYWKfdjK+8=', 'Content-Length': '0'} 2023-12-15T23:25:59.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f2f4d1838224168-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.157 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.157 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.157 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.157 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.157 DEBUG:boto:Method: GET 2023-12-15T23:25:59.157 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.157 DEBUG:boto:Data: 2023-12-15T23:25:59.158 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.158 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.158 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.158 DEBUG:boto:Params: {} 2023-12-15T23:25:59.158 DEBUG:boto:Token: None 2023-12-15T23:25:59.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.160 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dca77e977e35911d-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.160 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.161 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.161 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.161 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.161 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.161 DEBUG:boto:Method: GET 2023-12-15T23:25:59.161 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.162 DEBUG:boto:Data: 2023-12-15T23:25:59.162 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.162 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.162 DEBUG:boto:Params: {} 2023-12-15T23:25:59.162 DEBUG:boto:Token: None 2023-12-15T23:25:59.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d67900a7ea56258-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.166 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.166 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.166 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.166 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.167 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:25:59.167 DEBUG:boto:Data: 2023-12-15T23:25:59.167 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.167 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.167 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.167 DEBUG:boto:Params: {} 2023-12-15T23:25:59.167 DEBUG:boto:Token: None 2023-12-15T23:25:59.167 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85 2023-12-15T23:25:59.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mXXcraiVwglrOw4TrtjsI7ZKuEY= 2023-12-15T23:25:59.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mXXcraiVwglrOw4TrtjsI7ZKuEY=', 'Content-Length': '0'} 2023-12-15T23:25:59.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071bcf6fa930350d1-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.170 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.170 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.170 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.170 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:25:59.170 DEBUG:boto:Data: 2023-12-15T23:25:59.170 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.170 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.170 DEBUG:boto:Params: {} 2023-12-15T23:25:59.170 DEBUG:boto:Token: None 2023-12-15T23:25:59.171 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85 2023-12-15T23:25:59.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mXXcraiVwglrOw4TrtjsI7ZKuEY= 2023-12-15T23:25:59.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mXXcraiVwglrOw4TrtjsI7ZKuEY=', 'Content-Length': '0'} 2023-12-15T23:25:59.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b03a8e0ee7ab3de-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:25:59.173 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.173 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.173 DEBUG:boto:Method: GET 2023-12-15T23:25:59.173 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:25:59.174 DEBUG:boto:Data: 2023-12-15T23:25:59.174 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.174 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.174 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.174 DEBUG:boto:Params: {} 2023-12-15T23:25:59.174 DEBUG:boto:Token: None 2023-12-15T23:25:59.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85 2023-12-15T23:25:59.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pyvwxqn8n4aP49LdgX1pQBNaCOY= 2023-12-15T23:25:59.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pyvwxqn8n4aP49LdgX1pQBNaCOY=', 'Content-Length': '0'} 2023-12-15T23:25:59.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052429cfe5d98f80a-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.177 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:25:59.177 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:25:59.177 DEBUG:boto:Method: GET 2023-12-15T23:25:59.177 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:25:59.177 DEBUG:boto:Data: 2023-12-15T23:25:59.177 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.177 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.178 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.178 DEBUG:boto:Params: {} 2023-12-15T23:25:59.178 DEBUG:boto:Token: None 2023-12-15T23:25:59.178 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj85 2023-12-15T23:25:59.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pyvwxqn8n4aP49LdgX1pQBNaCOY= 2023-12-15T23:25:59.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pyvwxqn8n4aP49LdgX1pQBNaCOY=', 'Content-Length': '0'} 2023-12-15T23:25:59.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe5c2647ae3dbfdb-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.222 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.222 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.222 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.222 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.222 DEBUG:boto:Method: GET 2023-12-15T23:25:59.222 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.222 DEBUG:boto:Data: 2023-12-15T23:25:59.222 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.222 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.222 DEBUG:boto:Params: {} 2023-12-15T23:25:59.223 DEBUG:boto:Token: None 2023-12-15T23:25:59.223 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.225 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af1c6208a46170c3-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.225 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.226 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.226 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.226 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.226 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.226 DEBUG:boto:Method: GET 2023-12-15T23:25:59.226 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:25:59.226 DEBUG:boto:Data: 2023-12-15T23:25:59.226 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.226 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.227 DEBUG:boto:Params: {} 2023-12-15T23:25:59.227 DEBUG:boto:Token: None 2023-12-15T23:25:59.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a7a86769a3b8946-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.231 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:25:59.231 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.231 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.232 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.232 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.232 DEBUG:boto:Method: GET 2023-12-15T23:25:59.232 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.232 DEBUG:boto:Data: 2023-12-15T23:25:59.232 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.232 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.232 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.232 DEBUG:boto:Params: {} 2023-12-15T23:25:59.232 DEBUG:boto:Token: None 2023-12-15T23:25:59.233 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac= 2023-12-15T23:25:59.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac=', 'Content-Length': '0'} 2023-12-15T23:25:59.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087df2557769ee8b4-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.235 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.235 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.235 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.235 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.236 DEBUG:boto:Method: GET 2023-12-15T23:25:59.236 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.236 DEBUG:boto:Data: 2023-12-15T23:25:59.236 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.236 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.236 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.236 DEBUG:boto:Params: {} 2023-12-15T23:25:59.236 DEBUG:boto:Token: None 2023-12-15T23:25:59.236 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.236 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac= 2023-12-15T23:25:59.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac=', 'Content-Length': '0'} 2023-12-15T23:25:59.238 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bc365f783ab8b5b-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.239 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.239 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.239 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.239 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.239 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.239 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.239 DEBUG:boto:Data: 2023-12-15T23:25:59.240 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.240 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.240 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.240 DEBUG:boto:Params: {} 2023-12-15T23:25:59.240 DEBUG:boto:Token: None 2023-12-15T23:25:59.240 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.240 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SB9vTMD5a1qxKT9wKpIVCMRnTOQ= 2023-12-15T23:25:59.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SB9vTMD5a1qxKT9wKpIVCMRnTOQ=', 'Content-Length': '0'} 2023-12-15T23:25:59.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007183bc85b98e8bc4-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.242 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.242 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.242 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.242 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.242 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.242 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.242 DEBUG:boto:Data: 2023-12-15T23:25:59.243 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.243 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.243 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.243 DEBUG:boto:Params: {} 2023-12-15T23:25:59.243 DEBUG:boto:Token: None 2023-12-15T23:25:59.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.243 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SB9vTMD5a1qxKT9wKpIVCMRnTOQ= 2023-12-15T23:25:59.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SB9vTMD5a1qxKT9wKpIVCMRnTOQ=', 'Content-Length': '0'} 2023-12-15T23:25:59.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b88e54b52e802776-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:25:59.245 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.246 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.246 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.246 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.246 DEBUG:boto:Method: GET 2023-12-15T23:25:59.246 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.246 DEBUG:boto:Data: 2023-12-15T23:25:59.246 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.246 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.246 DEBUG:boto:Params: {} 2023-12-15T23:25:59.246 DEBUG:boto:Token: None 2023-12-15T23:25:59.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac= 2023-12-15T23:25:59.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac=', 'Content-Length': '0'} 2023-12-15T23:25:59.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075990ff8516c8833-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.293 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.294 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.294 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.294 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.294 DEBUG:boto:Method: GET 2023-12-15T23:25:59.294 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.294 DEBUG:boto:Data: 2023-12-15T23:25:59.294 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.294 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.294 DEBUG:boto:Params: {} 2023-12-15T23:25:59.294 DEBUG:boto:Token: None 2023-12-15T23:25:59.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:25:59.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac= 2023-12-15T23:25:59.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hl+6daCsrTvSLbmpoDauAkLiFac=', 'Content-Length': '0'} 2023-12-15T23:25:59.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f137562c0b1b3647-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.297 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.297 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.297 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.297 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.297 DEBUG:boto:Method: GET 2023-12-15T23:25:59.297 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.297 DEBUG:boto:Data: 2023-12-15T23:25:59.298 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.298 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.298 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.298 DEBUG:boto:Params: {} 2023-12-15T23:25:59.298 DEBUG:boto:Token: None 2023-12-15T23:25:59.298 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.300 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d534f9c0bd215ff9-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.301 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.301 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.301 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.301 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.301 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.301 DEBUG:boto:Method: GET 2023-12-15T23:25:59.302 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.302 DEBUG:boto:Data: 2023-12-15T23:25:59.302 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.302 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.302 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.302 DEBUG:boto:Params: {} 2023-12-15T23:25:59.302 DEBUG:boto:Token: None 2023-12-15T23:25:59.302 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.302 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c03f451772a81354-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.306 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.306 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.307 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.307 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.307 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:25:59.307 DEBUG:boto:Data: 2023-12-15T23:25:59.307 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.307 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.307 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.307 DEBUG:boto:Params: {} 2023-12-15T23:25:59.307 DEBUG:boto:Token: None 2023-12-15T23:25:59.307 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87 2023-12-15T23:25:59.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XnRqPMmeybd/ijHcyqWl847zAgQ= 2023-12-15T23:25:59.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XnRqPMmeybd/ijHcyqWl847zAgQ=', 'Content-Length': '0'} 2023-12-15T23:25:59.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000028fd2bc5669629e-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.309 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.310 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.310 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.310 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:25:59.310 DEBUG:boto:Data: 2023-12-15T23:25:59.310 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.310 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.310 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.310 DEBUG:boto:Params: {} 2023-12-15T23:25:59.310 DEBUG:boto:Token: None 2023-12-15T23:25:59.310 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87 2023-12-15T23:25:59.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XnRqPMmeybd/ijHcyqWl847zAgQ= 2023-12-15T23:25:59.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XnRqPMmeybd/ijHcyqWl847zAgQ=', 'Content-Length': '0'} 2023-12-15T23:25:59.312 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ec9024f4249bab5-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:25:59.313 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.313 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.313 DEBUG:boto:Method: GET 2023-12-15T23:25:59.313 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:25:59.313 DEBUG:boto:Data: 2023-12-15T23:25:59.313 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.313 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.313 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.313 DEBUG:boto:Params: {} 2023-12-15T23:25:59.314 DEBUG:boto:Token: None 2023-12-15T23:25:59.314 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87 2023-12-15T23:25:59.314 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zxmMDWMH/5cdwtI2YwMXfzTrIeU= 2023-12-15T23:25:59.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zxmMDWMH/5cdwtI2YwMXfzTrIeU=', 'Content-Length': '0'} 2023-12-15T23:25:59.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2ce96d306e8ea4d-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.316 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:25:59.316 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:25:59.316 DEBUG:boto:Method: GET 2023-12-15T23:25:59.316 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:25:59.316 DEBUG:boto:Data: 2023-12-15T23:25:59.317 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.317 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.317 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.317 DEBUG:boto:Params: {} 2023-12-15T23:25:59.317 DEBUG:boto:Token: None 2023-12-15T23:25:59.317 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj87 2023-12-15T23:25:59.317 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zxmMDWMH/5cdwtI2YwMXfzTrIeU= 2023-12-15T23:25:59.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zxmMDWMH/5cdwtI2YwMXfzTrIeU=', 'Content-Length': '0'} 2023-12-15T23:25:59.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002383db1a3d3c4b3d-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.320 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.320 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.320 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.320 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.320 DEBUG:boto:Method: GET 2023-12-15T23:25:59.320 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.320 DEBUG:boto:Data: 2023-12-15T23:25:59.320 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.320 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.320 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.320 DEBUG:boto:Params: {} 2023-12-15T23:25:59.321 DEBUG:boto:Token: None 2023-12-15T23:25:59.321 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.321 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.323 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000deb8af876338889c-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.323 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.324 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.324 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.324 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.324 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.324 DEBUG:boto:Method: GET 2023-12-15T23:25:59.324 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:25:59.324 DEBUG:boto:Data: 2023-12-15T23:25:59.324 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.324 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.324 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.324 DEBUG:boto:Params: {} 2023-12-15T23:25:59.325 DEBUG:boto:Token: None 2023-12-15T23:25:59.325 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015d6269de5aa5bb8-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.329 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:25:59.329 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.329 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.330 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.330 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.330 DEBUG:boto:Method: GET 2023-12-15T23:25:59.330 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.330 DEBUG:boto:Data: 2023-12-15T23:25:59.330 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.330 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.330 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.330 DEBUG:boto:Params: {} 2023-12-15T23:25:59.330 DEBUG:boto:Token: None 2023-12-15T23:25:59.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4= 2023-12-15T23:25:59.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4=', 'Content-Length': '0'} 2023-12-15T23:25:59.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f47d88ebe95e2523-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.333 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.333 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.333 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.333 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.333 DEBUG:boto:Method: GET 2023-12-15T23:25:59.334 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.334 DEBUG:boto:Data: 2023-12-15T23:25:59.334 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.334 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.334 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.334 DEBUG:boto:Params: {} 2023-12-15T23:25:59.334 DEBUG:boto:Token: None 2023-12-15T23:25:59.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4= 2023-12-15T23:25:59.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4=', 'Content-Length': '0'} 2023-12-15T23:25:59.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2adc807d39b52e7-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.337 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.337 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.337 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.337 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.337 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.337 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.337 DEBUG:boto:Data: 2023-12-15T23:25:59.337 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.340 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.341 DEBUG:boto:Params: {} 2023-12-15T23:25:59.341 DEBUG:boto:Token: None 2023-12-15T23:25:59.341 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5/dtMonnISKxDBymxdlMUJZOQY= 2023-12-15T23:25:59.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5/dtMonnISKxDBymxdlMUJZOQY=', 'Content-Length': '0'} 2023-12-15T23:25:59.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee5729ee7faaf10d-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.343 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.343 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.343 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.343 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.343 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.343 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.344 DEBUG:boto:Data: 2023-12-15T23:25:59.344 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.344 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.344 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.344 DEBUG:boto:Params: {} 2023-12-15T23:25:59.344 DEBUG:boto:Token: None 2023-12-15T23:25:59.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A5/dtMonnISKxDBymxdlMUJZOQY= 2023-12-15T23:25:59.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A5/dtMonnISKxDBymxdlMUJZOQY=', 'Content-Length': '0'} 2023-12-15T23:25:59.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b563dca388c83902-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:25:59.346 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.346 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.347 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.347 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.347 DEBUG:boto:Method: GET 2023-12-15T23:25:59.347 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.347 DEBUG:boto:Data: 2023-12-15T23:25:59.347 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.347 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.347 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.347 DEBUG:boto:Params: {} 2023-12-15T23:25:59.347 DEBUG:boto:Token: None 2023-12-15T23:25:59.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4= 2023-12-15T23:25:59.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4=', 'Content-Length': '0'} 2023-12-15T23:25:59.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005782522f7bbb7096-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.350 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.350 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.350 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.350 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.350 DEBUG:boto:Method: GET 2023-12-15T23:25:59.351 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.351 DEBUG:boto:Data: 2023-12-15T23:25:59.351 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.351 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.351 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.351 DEBUG:boto:Params: {} 2023-12-15T23:25:59.351 DEBUG:boto:Token: None 2023-12-15T23:25:59.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:25:59.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4= 2023-12-15T23:25:59.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0rS909cTnaGrxjt15LwLjXG9Du4=', 'Content-Length': '0'} 2023-12-15T23:25:59.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d880a0a1676481bf-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.353 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.354 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.354 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.354 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.354 DEBUG:boto:Method: GET 2023-12-15T23:25:59.354 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.354 DEBUG:boto:Data: 2023-12-15T23:25:59.354 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.354 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.354 DEBUG:boto:Params: {} 2023-12-15T23:25:59.355 DEBUG:boto:Token: None 2023-12-15T23:25:59.355 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bca38d6fb8aa010f-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.357 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.358 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.358 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.358 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.358 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.358 DEBUG:boto:Method: GET 2023-12-15T23:25:59.358 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.358 DEBUG:boto:Data: 2023-12-15T23:25:59.358 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.358 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.358 DEBUG:boto:Params: {} 2023-12-15T23:25:59.359 DEBUG:boto:Token: None 2023-12-15T23:25:59.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000892fb33710814b28-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.363 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.363 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.363 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.363 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.363 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:25:59.363 DEBUG:boto:Data: 2023-12-15T23:25:59.363 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.364 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.364 DEBUG:boto:Params: {} 2023-12-15T23:25:59.364 DEBUG:boto:Token: None 2023-12-15T23:25:59.364 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92 2023-12-15T23:25:59.364 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gb7AXkRNAhbQk4LUtOoqJMHNPUY= 2023-12-15T23:25:59.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gb7AXkRNAhbQk4LUtOoqJMHNPUY=', 'Content-Length': '0'} 2023-12-15T23:25:59.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000086d2e884e5f559a-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.366 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.366 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.367 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.367 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:25:59.367 DEBUG:boto:Data: 2023-12-15T23:25:59.367 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.367 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.367 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.367 DEBUG:boto:Params: {} 2023-12-15T23:25:59.367 DEBUG:boto:Token: None 2023-12-15T23:25:59.367 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92 2023-12-15T23:25:59.367 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gb7AXkRNAhbQk4LUtOoqJMHNPUY= 2023-12-15T23:25:59.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gb7AXkRNAhbQk4LUtOoqJMHNPUY=', 'Content-Length': '0'} 2023-12-15T23:25:59.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008707ae15f64fea68-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.370 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:25:59.370 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.370 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.370 DEBUG:boto:Method: GET 2023-12-15T23:25:59.370 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:25:59.370 DEBUG:boto:Data: 2023-12-15T23:25:59.370 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.370 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.370 DEBUG:boto:Params: {} 2023-12-15T23:25:59.371 DEBUG:boto:Token: None 2023-12-15T23:25:59.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92 2023-12-15T23:25:59.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3dh0aXcPMhBUu/jMaKTvJ3BK2eE= 2023-12-15T23:25:59.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3dh0aXcPMhBUu/jMaKTvJ3BK2eE=', 'Content-Length': '0'} 2023-12-15T23:25:59.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076cd7a08fcd9a3b4-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.413 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:25:59.414 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:25:59.414 DEBUG:boto:Method: GET 2023-12-15T23:25:59.414 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:25:59.414 DEBUG:boto:Data: 2023-12-15T23:25:59.414 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.414 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.414 DEBUG:boto:Params: {} 2023-12-15T23:25:59.414 DEBUG:boto:Token: None 2023-12-15T23:25:59.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj92 2023-12-15T23:25:59.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3dh0aXcPMhBUu/jMaKTvJ3BK2eE= 2023-12-15T23:25:59.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3dh0aXcPMhBUu/jMaKTvJ3BK2eE=', 'Content-Length': '0'} 2023-12-15T23:25:59.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016fe27b6b3ca7922-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.417 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.417 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.417 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.417 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.417 DEBUG:boto:Method: GET 2023-12-15T23:25:59.417 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.418 DEBUG:boto:Data: 2023-12-15T23:25:59.418 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.418 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.418 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.418 DEBUG:boto:Params: {} 2023-12-15T23:25:59.418 DEBUG:boto:Token: None 2023-12-15T23:25:59.418 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.418 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000385bca7f43288476-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.421 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.421 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.421 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.421 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.422 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.422 DEBUG:boto:Method: GET 2023-12-15T23:25:59.422 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:25:59.422 DEBUG:boto:Data: 2023-12-15T23:25:59.422 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.422 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.422 DEBUG:boto:Params: {} 2023-12-15T23:25:59.422 DEBUG:boto:Token: None 2023-12-15T23:25:59.422 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a5712d1cbcd53c8-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.426 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.427 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:25:59.427 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.427 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.427 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.427 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.427 DEBUG:boto:Method: GET 2023-12-15T23:25:59.427 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.427 DEBUG:boto:Data: 2023-12-15T23:25:59.427 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.428 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.428 DEBUG:boto:Params: {} 2023-12-15T23:25:59.428 DEBUG:boto:Token: None 2023-12-15T23:25:59.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4= 2023-12-15T23:25:59.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4=', 'Content-Length': '0'} 2023-12-15T23:25:59.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e23a3d17323fccf-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.430 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.430 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.430 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.430 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.431 DEBUG:boto:Method: GET 2023-12-15T23:25:59.431 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.431 DEBUG:boto:Data: 2023-12-15T23:25:59.431 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.431 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.431 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.431 DEBUG:boto:Params: {} 2023-12-15T23:25:59.431 DEBUG:boto:Token: None 2023-12-15T23:25:59.431 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.432 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4= 2023-12-15T23:25:59.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4=', 'Content-Length': '0'} 2023-12-15T23:25:59.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001b26cd44b4434ab-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.434 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.434 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.434 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.434 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.434 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.434 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.434 DEBUG:boto:Data: 2023-12-15T23:25:59.434 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.435 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.435 DEBUG:boto:Params: {} 2023-12-15T23:25:59.435 DEBUG:boto:Token: None 2023-12-15T23:25:59.435 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.435 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZYORRTjSciYUpTNl91hEEJYk6TI= 2023-12-15T23:25:59.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZYORRTjSciYUpTNl91hEEJYk6TI=', 'Content-Length': '0'} 2023-12-15T23:25:59.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d356b4647577c15-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.438 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.438 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.438 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.438 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.438 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.438 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.438 DEBUG:boto:Data: 2023-12-15T23:25:59.438 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.438 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.438 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.438 DEBUG:boto:Params: {} 2023-12-15T23:25:59.439 DEBUG:boto:Token: None 2023-12-15T23:25:59.439 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.439 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZYORRTjSciYUpTNl91hEEJYk6TI= 2023-12-15T23:25:59.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZYORRTjSciYUpTNl91hEEJYk6TI=', 'Content-Length': '0'} 2023-12-15T23:25:59.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000243bfc1e2b5ae322-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:25:59.441 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.441 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.441 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.442 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.442 DEBUG:boto:Method: GET 2023-12-15T23:25:59.442 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.442 DEBUG:boto:Data: 2023-12-15T23:25:59.442 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.442 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.442 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.442 DEBUG:boto:Params: {} 2023-12-15T23:25:59.442 DEBUG:boto:Token: None 2023-12-15T23:25:59.443 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.443 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4= 2023-12-15T23:25:59.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4=', 'Content-Length': '0'} 2023-12-15T23:25:59.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b73c0646aead16c-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.485 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.486 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.486 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.486 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.486 DEBUG:boto:Method: GET 2023-12-15T23:25:59.486 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.486 DEBUG:boto:Data: 2023-12-15T23:25:59.486 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.486 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.486 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.486 DEBUG:boto:Params: {} 2023-12-15T23:25:59.486 DEBUG:boto:Token: None 2023-12-15T23:25:59.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:25:59.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4= 2023-12-15T23:25:59.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abBrTt1gTJSbKjl+IvF3B47ZSz4=', 'Content-Length': '0'} 2023-12-15T23:25:59.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc7c3c0fcea8ff46-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.489 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.489 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.489 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.489 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.489 DEBUG:boto:Method: GET 2023-12-15T23:25:59.489 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.490 DEBUG:boto:Data: 2023-12-15T23:25:59.490 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.490 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.490 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.490 DEBUG:boto:Params: {} 2023-12-15T23:25:59.490 DEBUG:boto:Token: None 2023-12-15T23:25:59.490 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.490 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a477e7a86636a473-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.533 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.534 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.534 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.534 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.534 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.534 DEBUG:boto:Method: GET 2023-12-15T23:25:59.534 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.534 DEBUG:boto:Data: 2023-12-15T23:25:59.534 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.535 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.535 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.535 DEBUG:boto:Params: {} 2023-12-15T23:25:59.535 DEBUG:boto:Token: None 2023-12-15T23:25:59.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.539 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c83eb5db793341d6-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.539 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.539 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.539 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.539 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.540 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:25:59.540 DEBUG:boto:Data: 2023-12-15T23:25:59.540 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.540 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.540 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.540 DEBUG:boto:Params: {} 2023-12-15T23:25:59.540 DEBUG:boto:Token: None 2023-12-15T23:25:59.540 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93 2023-12-15T23:25:59.540 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sJOdDqh5V1h/gjl9Al/vusEUCIA= 2023-12-15T23:25:59.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sJOdDqh5V1h/gjl9Al/vusEUCIA=', 'Content-Length': '0'} 2023-12-15T23:25:59.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6c8cb0cd5f5c58f-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.542 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.543 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.543 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.543 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:25:59.543 DEBUG:boto:Data: 2023-12-15T23:25:59.543 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.543 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.543 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.543 DEBUG:boto:Params: {} 2023-12-15T23:25:59.543 DEBUG:boto:Token: None 2023-12-15T23:25:59.543 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93 2023-12-15T23:25:59.544 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sJOdDqh5V1h/gjl9Al/vusEUCIA= 2023-12-15T23:25:59.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sJOdDqh5V1h/gjl9Al/vusEUCIA=', 'Content-Length': '0'} 2023-12-15T23:25:59.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081f136a87eb45709-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:25:59.549 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.549 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.549 DEBUG:boto:Method: GET 2023-12-15T23:25:59.549 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:25:59.549 DEBUG:boto:Data: 2023-12-15T23:25:59.549 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.550 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.550 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.550 DEBUG:boto:Params: {} 2023-12-15T23:25:59.550 DEBUG:boto:Token: None 2023-12-15T23:25:59.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93 2023-12-15T23:25:59.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pTYEpfV5ObjN+UpDKOSCOQXs4dU= 2023-12-15T23:25:59.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pTYEpfV5ObjN+UpDKOSCOQXs4dU=', 'Content-Length': '0'} 2023-12-15T23:25:59.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff8fe8be03b69ad8-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.593 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:25:59.594 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:25:59.594 DEBUG:boto:Method: GET 2023-12-15T23:25:59.594 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:25:59.594 DEBUG:boto:Data: 2023-12-15T23:25:59.594 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.594 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.594 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.594 DEBUG:boto:Params: {} 2023-12-15T23:25:59.594 DEBUG:boto:Token: None 2023-12-15T23:25:59.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj93 2023-12-15T23:25:59.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pTYEpfV5ObjN+UpDKOSCOQXs4dU= 2023-12-15T23:25:59.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pTYEpfV5ObjN+UpDKOSCOQXs4dU=', 'Content-Length': '0'} 2023-12-15T23:25:59.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c6787ad705bc1e8-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.597 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.597 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.597 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.597 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.597 DEBUG:boto:Method: GET 2023-12-15T23:25:59.597 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.597 DEBUG:boto:Data: 2023-12-15T23:25:59.597 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.598 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.598 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.598 DEBUG:boto:Params: {} 2023-12-15T23:25:59.598 DEBUG:boto:Token: None 2023-12-15T23:25:59.598 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.598 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.600 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003348f313a779f609-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.641 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.642 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.642 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.642 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.642 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.642 DEBUG:boto:Method: GET 2023-12-15T23:25:59.642 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:25:59.642 DEBUG:boto:Data: 2023-12-15T23:25:59.642 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.642 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.643 DEBUG:boto:Params: {} 2023-12-15T23:25:59.643 DEBUG:boto:Token: None 2023-12-15T23:25:59.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003272017cebb81c2c-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.646 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:25:59.647 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.647 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.647 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.647 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.647 DEBUG:boto:Method: GET 2023-12-15T23:25:59.647 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.647 DEBUG:boto:Data: 2023-12-15T23:25:59.648 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.648 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.648 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.648 DEBUG:boto:Params: {} 2023-12-15T23:25:59.648 DEBUG:boto:Token: None 2023-12-15T23:25:59.648 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.648 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As= 2023-12-15T23:25:59.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As=', 'Content-Length': '0'} 2023-12-15T23:25:59.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c91157d27ef77914-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.651 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.651 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.651 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.651 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.651 DEBUG:boto:Method: GET 2023-12-15T23:25:59.651 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.651 DEBUG:boto:Data: 2023-12-15T23:25:59.651 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.651 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.651 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.651 DEBUG:boto:Params: {} 2023-12-15T23:25:59.651 DEBUG:boto:Token: None 2023-12-15T23:25:59.652 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.652 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As= 2023-12-15T23:25:59.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As=', 'Content-Length': '0'} 2023-12-15T23:25:59.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bc8c56c450ff503-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.654 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.654 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.654 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.654 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.654 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.654 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.654 DEBUG:boto:Data: 2023-12-15T23:25:59.654 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.655 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.655 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.655 DEBUG:boto:Params: {} 2023-12-15T23:25:59.655 DEBUG:boto:Token: None 2023-12-15T23:25:59.655 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.655 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:quztnlqWxpu3LCWSZCH7FoqHsII= 2023-12-15T23:25:59.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:quztnlqWxpu3LCWSZCH7FoqHsII=', 'Content-Length': '0'} 2023-12-15T23:25:59.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003135eb0350d96f49-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.657 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.657 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.657 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.657 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.657 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.657 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.658 DEBUG:boto:Data: 2023-12-15T23:25:59.658 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.658 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.658 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.658 DEBUG:boto:Params: {} 2023-12-15T23:25:59.658 DEBUG:boto:Token: None 2023-12-15T23:25:59.658 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:quztnlqWxpu3LCWSZCH7FoqHsII= 2023-12-15T23:25:59.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:quztnlqWxpu3LCWSZCH7FoqHsII=', 'Content-Length': '0'} 2023-12-15T23:25:59.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adefbb9cf45051fc-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.660 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:25:59.660 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.661 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.661 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.661 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.661 DEBUG:boto:Method: GET 2023-12-15T23:25:59.661 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.661 DEBUG:boto:Data: 2023-12-15T23:25:59.661 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.661 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.661 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.661 DEBUG:boto:Params: {} 2023-12-15T23:25:59.661 DEBUG:boto:Token: None 2023-12-15T23:25:59.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As= 2023-12-15T23:25:59.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As=', 'Content-Length': '0'} 2023-12-15T23:25:59.664 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b3cc19716a0ea4b-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.705 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.705 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.706 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.706 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.706 DEBUG:boto:Method: GET 2023-12-15T23:25:59.706 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.706 DEBUG:boto:Data: 2023-12-15T23:25:59.706 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.706 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.706 DEBUG:boto:Params: {} 2023-12-15T23:25:59.706 DEBUG:boto:Token: None 2023-12-15T23:25:59.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:25:59.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As= 2023-12-15T23:25:59.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G1UNLfwpmmFgtEo9PWuJZ5tm5As=', 'Content-Length': '0'} 2023-12-15T23:25:59.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f6dd378c8f87b0d-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.709 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.709 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.709 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.709 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.709 DEBUG:boto:Method: GET 2023-12-15T23:25:59.709 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.709 DEBUG:boto:Data: 2023-12-15T23:25:59.709 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.709 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.710 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.710 DEBUG:boto:Params: {} 2023-12-15T23:25:59.710 DEBUG:boto:Token: None 2023-12-15T23:25:59.710 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.712 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d42a64150595c29-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.756 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.757 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.757 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.757 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.757 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.757 DEBUG:boto:Method: GET 2023-12-15T23:25:59.757 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.757 DEBUG:boto:Data: 2023-12-15T23:25:59.757 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.758 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.758 DEBUG:boto:Params: {} 2023-12-15T23:25:59.758 DEBUG:boto:Token: None 2023-12-15T23:25:59.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e9d5b2fbf28080e-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.762 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.762 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.763 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.763 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.763 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:25:59.763 DEBUG:boto:Data: 2023-12-15T23:25:59.763 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.763 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.763 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.763 DEBUG:boto:Params: {} 2023-12-15T23:25:59.763 DEBUG:boto:Token: None 2023-12-15T23:25:59.763 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95 2023-12-15T23:25:59.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3cUr+sZy6GkYNuKY4c5/BY4MXus= 2023-12-15T23:25:59.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3cUr+sZy6GkYNuKY4c5/BY4MXus=', 'Content-Length': '0'} 2023-12-15T23:25:59.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a4b3414d56592c1-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.765 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.766 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.766 DEBUG:boto:Method: HEAD 2023-12-15T23:25:59.766 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:25:59.766 DEBUG:boto:Data: 2023-12-15T23:25:59.766 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.766 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.766 DEBUG:boto:Params: {} 2023-12-15T23:25:59.766 DEBUG:boto:Token: None 2023-12-15T23:25:59.767 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95 2023-12-15T23:25:59.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3cUr+sZy6GkYNuKY4c5/BY4MXus= 2023-12-15T23:25:59.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3cUr+sZy6GkYNuKY4c5/BY4MXus=', 'Content-Length': '0'} 2023-12-15T23:25:59.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dfa20c8a916c2b0-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:25:59.769 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.769 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.769 DEBUG:boto:Method: GET 2023-12-15T23:25:59.769 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:25:59.769 DEBUG:boto:Data: 2023-12-15T23:25:59.769 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.769 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.769 DEBUG:boto:Params: {} 2023-12-15T23:25:59.770 DEBUG:boto:Token: None 2023-12-15T23:25:59.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95 2023-12-15T23:25:59.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYPO26XeBUtHj2MnG4gYycmfelc= 2023-12-15T23:25:59.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYPO26XeBUtHj2MnG4gYycmfelc=', 'Content-Length': '0'} 2023-12-15T23:25:59.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005293d9f207453140-00657ce087-5221-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.813 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:25:59.814 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:25:59.814 DEBUG:boto:Method: GET 2023-12-15T23:25:59.814 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:25:59.814 DEBUG:boto:Data: 2023-12-15T23:25:59.814 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.814 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.814 DEBUG:boto:Params: {} 2023-12-15T23:25:59.814 DEBUG:boto:Token: None 2023-12-15T23:25:59.814 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/obj95 2023-12-15T23:25:59.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cYPO26XeBUtHj2MnG4gYycmfelc= 2023-12-15T23:25:59.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cYPO26XeBUtHj2MnG4gYycmfelc=', 'Content-Length': '0'} 2023-12-15T23:25:59.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b786d8340d9fe478-00657ce087-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.817 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.817 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.817 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.817 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.817 DEBUG:boto:Method: GET 2023-12-15T23:25:59.817 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.818 DEBUG:boto:Data: 2023-12-15T23:25:59.818 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.818 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:25:59.818 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.818 DEBUG:boto:Params: {} 2023-12-15T23:25:59.818 DEBUG:boto:Token: None 2023-12-15T23:25:59.818 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000543f471cbbb045b-00657ce087-5221-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.821 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.821 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:25:59.821 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:25:59.822 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.822 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.822 DEBUG:boto:Method: GET 2023-12-15T23:25:59.822 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:25:59.822 DEBUG:boto:Data: 2023-12-15T23:25:59.822 DEBUG:boto:Headers: {} 2023-12-15T23:25:59.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:25:59.822 DEBUG:boto:Port: 8000 2023-12-15T23:25:59.822 DEBUG:boto:Params: {} 2023-12-15T23:25:59.822 DEBUG:boto:Token: None 2023-12-15T23:25:59.822 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:25:59 GMT /kskgfn-49/ 2023-12-15T23:25:59.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8= 2023-12-15T23:25:59.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:25:59 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aJ32hBKHXrl93Y9faFv/DBE32w8=', 'Content-Length': '0'} 2023-12-15T23:25:59.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070d1f1540b2f7a3f-00657ce087-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:25:59 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:25:59.826 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:25:59.827 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:25:59.827 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:25:59.827 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:25:59.828 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:25:59.827+0000 7fca8b697640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 104838) UID: 0 2023-12-15T23:25:59.828 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:25:59.827+0000 7fca8eef6880 -1 shutting down 2023-12-15T23:26:05.927 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:26:05.928 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:05.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:05.928 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:05.984 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:05.985 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.034 INFO:teuthology.orchestra.run.smithi188.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:16:03.560639Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_spFQUwDStEzyRRnZQ91AllciTNiC_63","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:24:39.996097Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_dvSCxWgSzKoXqNpyXee4TjN8SN0lLh2","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.764463Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_xymLpCUdWQ5SJY92xL2da58rGolw3mN","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:21:00.032328Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1WKaF--0kxkPCUFktzBFiDWLazfuOme","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":35},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:22:24.690024Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_SQlkuvOI2Yk_d8yXKCUZqUEQh7l2YVz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:21:00.042719Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Ryz5rPgdL1pbGP5Vv8-AUHcpM04M_c6","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:24:40.044037Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bf0iodMdpIdi-hesfCf1ACPxP4pkbC5","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.700121Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9gryw59QkTwIWxRNpSf0FJ1ovRsOhxG","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:19.969562Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__4Ekna4XMs1-BVkopNh8a8Z_W1mBJs0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:24:40.054877Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_XRwFtYnIsNHt7NHSNMqc8YILnaQl5Bp","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:17:37.338797Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_11AS5SmqExb7-nT4kNdwhc4b8sRXSVv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:03.573062Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pf2q9hQM6Dcgthw1jpR1zFT-cjHni_u","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:18:45.686301Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_wMc47NmrsFVhUPdmGkq3BBW4BhD3CAt","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:20:59.924361Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aDPL0LDqaAGWCWDCimzuVUYpDbOtWcz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:22:24.619967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_BhWeVm_TnksQpOsDK27mvJFr1TZuPZc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:03.582053Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_41TScoyDJBCdVx3VEq8RoeXPk70LHCR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:19.980332Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_nNZEVlZZp_6VGCuh6aNSmX2MGF5jsA2","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:24:39.975302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_i8mVTyOBMmGqAlbAHrQQgbhi5xqamLJ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.349190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_APMOqH59xbpmaAYsoEOGqavVeRHwEpU","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:03.631864Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_O0TksFYDSpPpaaauRo-GcbjFyufJ_bZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:18:45.695986Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9ofqICQ6IKnoqw-Rjc3ZnPhcv05gQ6Z","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:20.028007Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_7OxRHE078t5MCqrN2QHdc8CkUbQrTva","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:03.643498Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_abl254PQX1fs_zTa3Kmg7FfJrgK5UnC","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:17:37.396541Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_JvwFDEEaDk1EX3GWTIPLJO8H3MQjXi9","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:20:59.972103Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_gdFO2hIa9lusgdOugB5dxxLtHt_NqpG","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:22:24.630786Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ABw-c9qw6Yu-nFRRMn2flK88rwXIHHz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:20.038564Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Pv2kPcPRytTDt91b_y6F9qgjgrOzZxn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:18:45.743628Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1OLvy1MKrISjEe9ZcwaUccaPOHCSdzo","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:24:39.986074Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_qLXet7Aruhs6JEgWhgA-YHfy2EVTXLW","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:17:37.405293Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_NVBs5SP_c5G20_RY8ED5bpWlmBH3Cvf","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:16:20.048930Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_OzpB6C3jCdKK0u9APcvbb1UWTSlJHid","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:20:59.982277Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_u45XNl7L1BtVQ6WmHjikmy46IQ9mZMQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.754807Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_7fxRAdjdy-BvcXB5X9l5Dp4y_Jrcjf3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:22:24.679756Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CWMxq0_F5eiCQlFtU3KHJoLQnYDLa44","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.452056Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ieLrR9Rmibh8xVx6PgLye3TNq4Yxw8E","flags":0,"pending_map":[],"versioned_epoch":0}] 2023-12-15T23:26:06.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.036 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj11 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.085 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.085 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.174 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.175 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj111 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.222 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.223 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.314 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj115 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.362 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.362 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.453 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj116 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.500 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.500 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.588 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.588 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj124 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.636 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.636 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.724 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.724 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj145 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.772 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.772 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.863 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.864 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj148 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:06.912 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:06.912 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:06.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:06.999 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj155 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.048 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.048 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.136 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.136 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj17 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.184 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.184 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.273 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj185 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.321 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.321 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.408 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj19 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.455 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.455 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.541 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj22 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.588 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.588 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.678 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj23 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.726 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.726 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.815 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj29 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.863 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.863 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:07.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:07.952 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj31 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:07.999 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:07.999 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.087 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj33 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.134 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.135 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.221 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj34 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.269 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.269 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.357 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj37 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.405 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.405 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.497 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.498 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj38 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.545 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.546 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.634 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj44 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.681 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.681 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.767 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj46 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.814 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.814 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:08.902 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:08.903 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj51 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:08.950 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:08.950 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.037 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.037 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj55 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.085 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.085 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.173 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj57 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.220 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.220 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.312 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.313 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj58 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.360 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.360 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.448 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.448 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj62 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.496 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.496 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.584 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj68 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.631 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.632 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.721 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj69 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.767 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.768 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.859 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj74 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:09.907 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:09.908 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:09.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:09.996 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj76 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.043 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.043 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.134 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj85 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.181 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.181 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.270 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj87 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.317 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.317 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.408 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj92 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.456 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.456 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.545 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.545 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj93 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.593 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.593 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.681 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.681 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --object obj95 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.729 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.729 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.819 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog trim --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.865 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.865 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:10.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:10.914 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:10.963 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:10.963 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:11.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:11.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:26:11.010 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:26:11.058 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:11.058 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:11.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.126+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: init. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.126+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.135 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.132+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: init 2023-12-15T23:26:11.148 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.146+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.158 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: : injecting data sync error on key=obj111 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.159 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj116[0] 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj124[0] 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.160 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj145[0] 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj148[0] 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: : injecting data sync error on key=obj155 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.161 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj17[0] 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.151+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.162 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: : injecting data sync error on key=obj22 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.163 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: : injecting data sync error on key=obj29 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.164 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: : injecting data sync error on key=obj34 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.152+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.166 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.153+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj55[0] 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj57[0] 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.167 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.154+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj62[0] 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj68[0] 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.176 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: success 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: success 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.177 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj76[0] 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj85[0] 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj87[0] 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.172+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.179 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.173+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.179 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.173+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.179 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.173+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.179 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.173+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj93[0] 2023-12-15T23:26:11.180 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.180 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.174+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: success 2023-12-15T23:26:11.181 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: success 2023-12-15T23:26:11.182 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.182 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.182 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.175+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: success 2023-12-15T23:26:11.182 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.176+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.183 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.180+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: success 2023-12-15T23:26:11.183 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.180+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: success 2023-12-15T23:26:11.185 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.182+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.185 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.182+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: success 2023-12-15T23:26:11.185 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.182+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.185+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: success 2023-12-15T23:26:11.187 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.185+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.188 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.185+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.219+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: success 2023-12-15T23:26:11.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.219+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj11 2023-12-15T23:26:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.220+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: backing out with sync_status=-5 2023-12-15T23:26:11.223 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.220+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: ERROR: full sync failed. error: -5 2023-12-15T23:26:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.222+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.224 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.222+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.228 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.226+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: full 2023-12-15T23:26:11.236 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.234+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.251 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj111[0] 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj116[0] 2023-12-15T23:26:11.252 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj124[0] 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj145[0] 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj148[0] 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.253 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj155[0] 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj17[0] 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.254 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj22[0] 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.255 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj29[0] 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.239+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj34[0] 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.240+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: success 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.258 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.242+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj55[0] 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: success 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj57[0] 2023-12-15T23:26:11.259 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: success 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.243+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj62[0] 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.260 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: : injecting data sync error on key=obj68 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.261 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: success 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: : injecting data sync error on key=obj76 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.244+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.262 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj85[0] 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: : injecting data sync error on key=obj87 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.263 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.264 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj93[0] 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: success 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.245+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: success 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj148 2023-12-15T23:26:11.265 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.246+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.247+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.247+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.247+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: success 2023-12-15T23:26:11.266 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.248+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.249+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: success 2023-12-15T23:26:11.267 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.249+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj19 2023-12-15T23:26:11.268 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.249+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: success 2023-12-15T23:26:11.268 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.252+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: success 2023-12-15T23:26:11.268 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.252+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj62 2023-12-15T23:26:11.269 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.256+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: backing out with sync_status=-5 2023-12-15T23:26:11.269 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.256+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: ERROR: full sync failed. error: -5 2023-12-15T23:26:11.269 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.257+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.269 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.257+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.305 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.302+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: full 2023-12-15T23:26:11.315 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.312+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj111[0] 2023-12-15T23:26:11.331 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: : injecting data sync error on key=obj116 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.332 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj124[0] 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj145[0] 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj148[0] 2023-12-15T23:26:11.333 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: : injecting data sync error on key=obj155 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj17[0] 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.334 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.318+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj22[0] 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.335 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj29[0] 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj34[0] 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.319+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.320+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.320+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.338 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.320+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.320+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: success 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj55[0] 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: success 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj57[0] 2023-12-15T23:26:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: success 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: : injecting data sync error on key=obj62 2023-12-15T23:26:11.340 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.322+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj68[0] 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.341 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: success 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: success 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj76[0] 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.342 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: : injecting data sync error on key=obj85 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: success 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: : injecting data sync error on key=obj87 2023-12-15T23:26:11.343 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.344 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: : injecting data sync error on key=obj93 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.323+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.345 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.324+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: success 2023-12-15T23:26:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.325+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.326+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj115 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.328+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: backing out with sync_status=-5 2023-12-15T23:26:11.347 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.328+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: ERROR: full sync failed. error: -5 2023-12-15T23:26:11.348 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.329+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.348 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.329+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.377 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.374+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: full 2023-12-15T23:26:11.387 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.384+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.401 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.401 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: : injecting data sync error on key=obj111 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.402 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj116[0] 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: : injecting data sync error on key=obj124 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.403 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj145[0] 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: : injecting data sync error on key=obj148 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.404 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj155[0] 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: : injecting data sync error on key=obj17 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.405 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj22[0] 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.406 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj29[0] 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj34[0] 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.390+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: : injecting data sync error on key=obj55 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: : injecting data sync error on key=obj57 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.392+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: success 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj62[0] 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj68[0] 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: success 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj76[0] 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.393+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj85[0] 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj87[0] 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.414 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj93[0] 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: success 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.394+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.395+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.396+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: success 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: success 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: success 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.397+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj11 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.398+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: backing out with sync_status=-5 2023-12-15T23:26:11.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.398+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: ERROR: full sync failed. error: -5 2023-12-15T23:26:11.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.400+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.400+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.449 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.446+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: full 2023-12-15T23:26:11.457 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.454+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj111[0] 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.507 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.500+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj116[0] 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj124[0] 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: : injecting data sync error on key=obj145 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj148[0] 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj155[0] 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj17[0] 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.509 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj22[0] 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.510 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: : injecting data sync error on key=obj29 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.511 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.512 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj34[0] 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.513 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.501+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.502+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.502+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.502+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.502+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.503+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.503+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.503+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.503+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj55[0] 2023-12-15T23:26:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.504+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.504+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.504+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.504+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj57[0] 2023-12-15T23:26:11.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: success 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj62[0] 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: success 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.522 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj68[0] 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj76[0] 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: : injecting data sync error on key=obj85 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 0 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: ERROR: failed to sync object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj87[0] 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: success 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj93[0] 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: success 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.505+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: success 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: success 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: success 2023-12-15T23:26:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj124 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.506+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.507+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.507+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: a sync operation returned error 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.507+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: success 2023-12-15T23:26:11.527 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.508+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: backing out with sync_status=-5 2023-12-15T23:26:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.509+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: ERROR: full sync failed. error: -5 2023-12-15T23:26:11.529 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.511+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.529 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.511+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: waiting on bucket lease 2023-12-15T23:26:11.558 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.555+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: status after acquiring the lock is: full 2023-12-15T23:26:11.571 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.568+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bucket for full sync 2023-12-15T23:26:11.587 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj11 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj11 op=0 op_state=1 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj11[0] 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj111 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj111 op=0 op_state=1 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj111[0] 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj115 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj115 op=0 op_state=1 2023-12-15T23:26:11.588 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj115[0] 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj116 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj116 op=0 op_state=1 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj116[0] 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj124 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj124 op=0 op_state=1 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj124[0] 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj145 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj145 op=0 op_state=1 2023-12-15T23:26:11.589 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj145[0] 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj148 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj148 op=0 op_state=1 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj148[0] 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj155 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj155 op=0 op_state=1 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj155[0] 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj17 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj17 op=0 op_state=1 2023-12-15T23:26:11.590 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj17[0] 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj185 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj185 op=0 op_state=1 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj185[0] 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj19 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj19 op=0 op_state=1 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj19[0] 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj22 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj22 op=0 op_state=1 2023-12-15T23:26:11.591 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj22[0] 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj23 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj23 op=0 op_state=1 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj23[0] 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj29 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj29 op=0 op_state=1 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.574+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj29[0] 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj31 2023-12-15T23:26:11.592 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj31 op=0 op_state=1 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj31[0] 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj33 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj33 op=0 op_state=1 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj33[0] 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj34 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj34 op=0 op_state=1 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj34[0] 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj37 2023-12-15T23:26:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj37 op=0 op_state=1 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj37[0] 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj38 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj38 op=0 op_state=1 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj38[0] 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj44 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj44 op=0 op_state=1 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj44[0] 2023-12-15T23:26:11.594 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj46 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj46 op=0 op_state=1 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.575+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj46[0] 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.577+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj111]: success 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.577+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj51 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.577+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj51 op=0 op_state=1 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.577+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj51[0] 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj124]: success 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj55 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj55 op=0 op_state=1 2023-12-15T23:26:11.595 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj55[0] 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj155]: success 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj57 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj57 op=0 op_state=1 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj57[0] 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj33]: success 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj58 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj58 op=0 op_state=1 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.578+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj58[0] 2023-12-15T23:26:11.596 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj145]: success 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj62 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj62 op=0 op_state=1 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj62[0] 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj11]: success 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj115]: success 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj68 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj68 op=0 op_state=1 2023-12-15T23:26:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj68[0] 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj69 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj69 op=0 op_state=1 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj116]: success 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj69[0] 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj74 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj74 op=0 op_state=1 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj74[0] 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj148]: success 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj76 2023-12-15T23:26:11.598 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj76 op=0 op_state=1 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj76[0] 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj17]: success 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj17 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj22]: success 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj85 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj85 op=0 op_state=1 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj85[0] 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj31]: success 2023-12-15T23:26:11.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj87 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj87 op=0 op_state=1 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj87[0] 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj44]: success 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj92 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj92 op=0 op_state=1 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.579+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj92[0] 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj19]: success 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj93 2023-12-15T23:26:11.600 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj93 op=0 op_state=1 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj93[0] 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj37]: success 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: [full sync] syncing object: kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0/obj95 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b=bucket sync single entry (source_zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c) b= log_entry=obj95 op=0 op_state=1 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: bucket sync: sync obj: 85829102-5436-4ffc-bbf4-ae2b811bdc9c/:kskgfn-49[85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20])/obj95[0] 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.580+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj46]: success 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.581+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj38]: success 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.581+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj51]: success 2023-12-15T23:26:11.601 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.581+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj34]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.581+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj57]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.581+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj58]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.582+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj29]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.582+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj23]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.582+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj55]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.582+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj185]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.582+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj58 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj76]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj74]: success 2023-12-15T23:26:11.602 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj85]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj69]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj92]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj95]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj87]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.583+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj93]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.584+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj68]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.584+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:entry[obj62]: success 2023-12-15T23:26:11.603 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.584+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: updating marker oid=bucket.full-sync-status.85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20 marker=obj95 2023-12-15T23:26:11.612 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.586+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: set bucket state=incremental 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.589+0000 7f33d6811800 5 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:full_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: bucket status objv={r=_YlKoRk4A48Glr_7HBRYMeWz:151,w=:0} 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.592+0000 7f33d6811800 10 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: WARNING: requested sync of past generation 0 < 6, returning success 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.613 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.594+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.616 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: sync status for source bucket shard: 2 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:0]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:2]: sync status for source bucket shard: 2 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:1]: sync status for source bucket shard: 2 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:2]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:2]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:1]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:1]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:3]: sync status for source bucket shard: 2 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:3]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:3]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:4]: sync status for source bucket shard: 2 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.595+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:6]: sync status for source bucket shard: 2 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:4]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:4]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:6]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:6]: listing bilog for incremental sync; position=00000000002.83.6 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:7]: sync status for source bucket shard: 2 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:7]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:7]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.618 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:8]: sync status for source bucket shard: 2 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:8]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:8]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.596+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.619 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:9]: sync status for source bucket shard: 2 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:9]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:9]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:11]: sync status for source bucket shard: 2 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:10]: sync status for source bucket shard: 2 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:11]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:11]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:10]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:10]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:12]: sync status for source bucket shard: 2 2023-12-15T23:26:11.620 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:13]: sync status for source bucket shard: 2 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:12]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:12]: listing bilog for incremental sync; position=00000000002.70.6 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.597+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:13]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:13]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:17]: sync status for source bucket shard: 2 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:14]: sync status for source bucket shard: 2 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:16]: sync status for source bucket shard: 2 2023-12-15T23:26:11.621 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:15]: sync status for source bucket shard: 2 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:18]: sync status for source bucket shard: 2 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:17]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:17]: listing bilog for incremental sync; position=00000000002.74.6 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:14]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:14]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:16]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:16]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:15]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:15]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:19]: sync status for source bucket shard: 2 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:18]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:18]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.622 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:19]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:19]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.598+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:20]: sync status for source bucket shard: 2 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:20]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:20]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.623 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:21]: sync status for source bucket shard: 2 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:23]: sync status for source bucket shard: 2 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:21]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:21]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:23]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:23]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:22]: sync status for source bucket shard: 2 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:22]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:22]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.624 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:24]: sync status for source bucket shard: 2 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:27]: sync status for source bucket shard: 2 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:24]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:24]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.599+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:27]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:27]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:29]: sync status for source bucket shard: 2 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:26]: sync status for source bucket shard: 2 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:28]: sync status for source bucket shard: 2 2023-12-15T23:26:11.625 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:30]: sync status for source bucket shard: 2 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:29]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:29]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:26]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:26]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:28]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:28]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:30]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:30]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:31]: sync status for source bucket shard: 2 2023-12-15T23:26:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:33]: sync status for source bucket shard: 2 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:32]: sync status for source bucket shard: 2 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:31]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:31]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:33]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:33]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:32]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:32]: listing bilog for incremental sync; position=00000000001.78.6 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:5]: sync status for source bucket shard: 2 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:35]: sync status for source bucket shard: 2 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:5]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:5]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.600+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:35]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:35]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.627 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:25]: sync status for source bucket shard: 2 2023-12-15T23:26:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:25]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:25]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:34]: sync status for source bucket shard: 2 2023-12-15T23:26:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:36]: sync status for source bucket shard: 2 2023-12-15T23:26:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:34]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:34]: listing bilog for incremental sync; position= 2023-12-15T23:26:11.628 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:11.601+0000 7f33d6811800 20 RGW-SYNC:bucket[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20<-kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:36]:inc_sync[kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20:36]: listing bilog for incremental sync; position=00000000001.81.6 2023-12-15T23:26:11.670 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:11.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:11.671 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:11.722 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:11.722 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:11.770 INFO:teuthology.orchestra.run.smithi093.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:03.560639Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2911146243366478707","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:24:39.996097Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2186861144969302791","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.764463Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4081639159862857872","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:21:00.032328Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.18051087353264605331","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.690024Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8265782572982046906","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:21:00.042719Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4463765766305651099","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:24:40.044037Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10068375445814152824","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.700121Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2956588108874907959","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:19.969562Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.249719989936972232","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:24:40.054877Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13343649664825648768","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.338797Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.3497394677007345121","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:03.573062Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6747645791238865120","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.686301Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6024842476744361852","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:20:59.924361Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7141120195953601816","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:22:24.619967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.6882356149593312190","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:16:03.582053Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.2144170193181344157","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:19.980332Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.938754708068662297","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:24:39.975302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1443506856733456819","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:17:37.349190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.557863410459015937","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:03.631864Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16481569525072313242","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.695986Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7391706184775783987","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:20.028007Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15336820294247961873","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:03.643498Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4768950367145901510","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:17:37.396541Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.13739921669920687496","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:20:59.972103Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.12589380336166680140","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:22:24.630786Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.1045716611768072121","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:20.038564Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.7995616102380790850","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:18:45.743628Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.8622376887254921104","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:24:39.986074Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.10327544371172382417","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:17:37.405293Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.16135200740367047048","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:20.048930Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.811240529242635251","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:20:59.982277Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.9248864417728910280","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:18:45.754807Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.14795656371302609634","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.679756Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.5264633054457002842","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:17:37.452056Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.15525107022192241551","flags":0,"pending_map":[],"versioned_epoch":0}] 2023-12-15T23:26:11.770 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:11.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-49', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:11.771 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-49 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:11.820 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:11.820 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:11.864 INFO:teuthology.orchestra.run.smithi188.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:16:03.560639Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_VXdGRqgGkLOeGgCUkJSZlLMMaRrZbzK","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:24:39.996097Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Y8KfJNhCaOXNDUHKfQ-NuGtOV6ocu7M","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.764463Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_y-KSUzqw84UQMUtYSRgqWpWTXYmYGet","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":15},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:21:00.032328Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_uILe0r8GcLdE6PbLuEPAETs-U5HABrz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":37},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.690024Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_j0TJnTNM91E6RNap98Qd_7Ycn4K2ZL6","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:21:00.042719Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pRtGiemPz73fPayRIQmmTISDbVN3v6o","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:24:40.044037Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Ofe_-dY9WAnVQxsDBqc1p8M9fo2aR6I","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.700121Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_blRjoH0cruvT3RZnqaZfqvYj8AcIPkX","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:19.969562Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_n8Ij6V4FD1YUdN2HFhzrcd91x86wmmV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":15},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:24:40.054877Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3jV6GW0mrXpEVrsiEodrBJYeNd_kj3W","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.338797Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_5dXwnNGZMbcrVU79EjL9HLG5ORbBGV3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:16:03.573062Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_mESRjuAHQ1NeYyZx6nwLsRrL29s9vOH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.686301Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CQ2cV3BvT6I0pTEa_u0h0hV1w8TaKE0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:20:59.924361Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_N8-_JX8P7_pKZyskfNyDLLyrG13e15N","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:22:24.619967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_oFPBiIlqnKW_ZRaJxgG4PMRpi3MMUyD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:03.582053Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_OKPX_o-U6Bgnp8Qk8njKEVhqb2yvlBL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:19.980332Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Zi0aB8Eie45ggv3LRt8tQo4dP9qcsBH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:24:39.975302Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_l0NgTJ4mImBulON088nYebbX76tlQX5","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:17:37.349190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_5qZ32C2tLJAoPjJE7sJ0OywA564Wa_o","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:16:03.631864Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_lWBF5V5Rq7b79NohqCvr0_Pzx0mXjNv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.695986Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2z2sdVZosmf7WLhN5z4ZuBuD72tsW_8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:20.028007Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ARtYFr4MIHjxm-6s5qq2lfIQFCwKcJw","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:03.643498Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ni_Q5_rXHNsaPrzncvvamllP-iTcPC-","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.396541Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_HoMDt3MpXkrhokIzhGy3rklh97P3EZJ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:20:59.972103Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2HjAZBJqCPWZIcQjhbmKSdzDC_WNZVu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2023-12-15T23:22:24.630786Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_FlnrbcHBgnX6v_yRFZdV1-ueinzxUvE","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:16:20.038564Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aVPcjbBJNv6sGtjqjMcAPLQOXry1zLj","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:18:45.743628Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jhX9DA9VuXmP89GrL3weKjplI9g41Ec","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:24:39.986074Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_p4jy-XBc9a6GTPb_ebiXBTl6APbdJ77","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.405293Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ldUhieEkL9m6BR3-672AjM8c5UmfPfQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:16:20.048930Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_VUNlRquiVcRLS7MVVR1P0_atsPw8G94","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:20:59.982277Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_i_5qSFr-ZCLpkJjha7UBeLuVRc4kxjy","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":14},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2023-12-15T23:18:45.754807Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_6YZFItBPx7RJVStWBN-chELaoPrkqsZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2023-12-15T23:22:24.679756Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_o2Ig-rsZarNcYfTziY4iF-rFS_isnlV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2023-12-15T23:17:37.452056Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"rgw-multisite-test-user","owner_display_name":"Multisite Test User","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_HbIc_JKmRx7h97dDJu5ZiCMUfyJrLOY","flags":0,"pending_map":[],"versioned_epoch":0}] 2023-12-15T23:26:11.865 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:26:11.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:26:11.867 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:26:11.868 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:11.886 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:26:11.886 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:26:11.886 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:26:11.886 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:26:11.886 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:26:12.888 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:12.907 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:26:12.907 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:26:12.907 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:26:12.908 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:26:12.909 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-49 2023-12-15T23:26:12.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:26:12.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:26:12.909 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:26:13.002 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:13.002 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:13.038 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:13.035+0000 7fd963324800 1 bucket sync caught up with source: 2023-12-15T23:26:13.038 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:26:13.038 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.83.6, , , , , , 00000000002.70.6, , , , , 00000000002.74.6, , , , , , , , , , , , , , , 00000000001.78.6, , , , 00000000001.81.6] 2023-12-15T23:26:13.038 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:13.035+0000 7fd963324800 0 bucket checkpoint complete 2023-12-15T23:26:13.052 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-49 2023-12-15T23:26:13.052 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:26:13.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-49', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:26:13.053 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-49 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:26:13.109 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:13.109 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:13.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:26:13.145+0000 7f48829a9800 1 bucket sync caught up with source: 2023-12-15T23:26:13.147 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000009.170.6, 00000000006.192.6, 00000000006.105.6, 00000000015.194.6, 00000000012.186.6, 00000000003.72.6, 00000000003.158.6, 00000000012.123.6, 00000000021.151.6, 00000000018.143.6] 2023-12-15T23:26:13.147 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000009.170.6, 00000000006.192.6, 00000000006.105.6, 00000000015.194.6, 00000000012.186.6, 00000000003.72.6, 00000000003.158.6, 00000000012.123.6, 00000000021.151.6, 00000000018.143.6] 2023-12-15T23:26:13.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:26:13.145+0000 7f48829a9800 0 bucket checkpoint complete 2023-12-15T23:26:13.161 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:26:13.161 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.162 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.162 DEBUG:boto:Method: HEAD 2023-12-15T23:26:13.162 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:26:13.162 DEBUG:boto:Data: 2023-12-15T23:26:13.162 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:13.162 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.162 DEBUG:boto:Params: {} 2023-12-15T23:26:13.162 DEBUG:boto:Token: None 2023-12-15T23:26:13.163 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/ 2023-12-15T23:26:13.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U= 2023-12-15T23:26:13.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U=', 'Content-Length': '0'} 2023-12-15T23:26:13.164 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2023-12-15T23:26:13.164 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:26:13.946 DEBUG:boto:Token: None 2023-12-15T23:26:13.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/ 2023-12-15T23:26:13.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U= 2023-12-15T23:26:13.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U=', 'Content-Length': '0'} 2023-12-15T23:26:13.953 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c7550684a0ed0cc0-00657ce095-5642-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.953 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.954 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.954 DEBUG:boto:Method: HEAD 2023-12-15T23:26:13.954 DEBUG:boto:Path: /kskgfn-49/ 2023-12-15T23:26:13.954 DEBUG:boto:Data: 2023-12-15T23:26:13.954 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.954 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:13.954 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.954 DEBUG:boto:Params: {} 2023-12-15T23:26:13.954 DEBUG:boto:Token: None 2023-12-15T23:26:13.954 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/ 2023-12-15T23:26:13.955 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U= 2023-12-15T23:26:13.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OW4svYLjnwNWg7LC37L+QvLJC3U=', 'Content-Length': '0'} 2023-12-15T23:26:13.958 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a8d66ea088ae11e-00657ce095-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.958 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:26:13.958 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.958 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.959 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.959 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.959 DEBUG:boto:Method: GET 2023-12-15T23:26:13.959 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.959 DEBUG:boto:Data: 2023-12-15T23:26:13.959 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:13.959 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.959 DEBUG:boto:Params: {} 2023-12-15T23:26:13.959 DEBUG:boto:Token: None 2023-12-15T23:26:13.960 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/?versions 2023-12-15T23:26:13.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU= 2023-12-15T23:26:13.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU=', 'Content-Length': '0'} 2023-12-15T23:26:13.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000293d030ca432f4b5-00657ce095-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.963 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:13.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:26:13.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:26:13.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:26:13.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:26:13.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:26:13.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:26:13.968 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:26:13.968 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.968 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.968 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.969 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.969 DEBUG:boto:Method: GET 2023-12-15T23:26:13.969 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.969 DEBUG:boto:Data: 2023-12-15T23:26:13.969 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.969 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:13.969 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.969 DEBUG:boto:Params: {} 2023-12-15T23:26:13.969 DEBUG:boto:Token: None 2023-12-15T23:26:13.969 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/?versions 2023-12-15T23:26:13.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU= 2023-12-15T23:26:13.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU=', 'Content-Length': '0'} 2023-12-15T23:26:13.973 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c46ba423dc1ef6b9-00657ce095-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.973 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:26:13.975 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:26:13.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:26:13.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:26:13.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:26:13.978 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.978 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.978 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.978 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.978 DEBUG:boto:Method: GET 2023-12-15T23:26:13.978 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.978 DEBUG:boto:Data: 2023-12-15T23:26:13.978 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:13.979 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.979 DEBUG:boto:Params: {} 2023-12-15T23:26:13.979 DEBUG:boto:Token: None 2023-12-15T23:26:13.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/?versions 2023-12-15T23:26:13.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU= 2023-12-15T23:26:13.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU=', 'Content-Length': '0'} 2023-12-15T23:26:13.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2c85249f0071016-00657ce095-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.982 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:13.984 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:13.984 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:13.984 DEBUG:boto:path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.984 DEBUG:boto:auth_path=/kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.984 DEBUG:boto:Method: GET 2023-12-15T23:26:13.985 DEBUG:boto:Path: /kskgfn-49/?versions&max-keys=999 2023-12-15T23:26:13.985 DEBUG:boto:Data: 2023-12-15T23:26:13.985 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.985 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:13.985 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.985 DEBUG:boto:Params: {} 2023-12-15T23:26:13.985 DEBUG:boto:Token: None 2023-12-15T23:26:13.985 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/?versions 2023-12-15T23:26:13.985 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU= 2023-12-15T23:26:13.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:krjeuNM5Hjz+dAKnabiRIThN2pU=', 'Content-Length': '0'} 2023-12-15T23:26:13.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5c39edfc4dba672-00657ce095-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.989 DEBUG:boto:b'kskgfn-49999falseobj11nulltrue2023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:13.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:26:13.991 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:13.991 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:13.991 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.991 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.992 DEBUG:boto:Method: GET 2023-12-15T23:26:13.992 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.992 DEBUG:boto:Data: 2023-12-15T23:26:13.992 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.992 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:13.992 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.992 DEBUG:boto:Params: {} 2023-12-15T23:26:13.992 DEBUG:boto:Token: None 2023-12-15T23:26:13.992 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.992 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m5B1XR6xcEeJE6PJmzWyUc/CI8Q= 2023-12-15T23:26:13.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m5B1XR6xcEeJE6PJmzWyUc/CI8Q=', 'Content-Length': '0'} 2023-12-15T23:26:13.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c64a56b85be09511-00657ce095-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:13.996 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:13.996 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:13.996 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.996 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.996 DEBUG:boto:Method: GET 2023-12-15T23:26:13.997 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.997 DEBUG:boto:Data: 2023-12-15T23:26:13.997 DEBUG:boto:Headers: {} 2023-12-15T23:26:13.997 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:13.997 DEBUG:boto:Port: 8000 2023-12-15T23:26:13.997 DEBUG:boto:Params: {} 2023-12-15T23:26:13.997 DEBUG:boto:Token: None 2023-12-15T23:26:13.997 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:13 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:13.997 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:m5B1XR6xcEeJE6PJmzWyUc/CI8Q= 2023-12-15T23:26:13.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:m5B1XR6xcEeJE6PJmzWyUc/CI8Q=', 'Content-Length': '0'} 2023-12-15T23:26:13.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f01ce541b1ae91dc-00657ce095-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.000 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.000 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.000 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.000 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.000 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.000 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.000 DEBUG:boto:Data: 2023-12-15T23:26:14.000 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.000 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.000 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.000 DEBUG:boto:Params: {} 2023-12-15T23:26:14.001 DEBUG:boto:Token: None 2023-12-15T23:26:14.001 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.001 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2GKtjRM/mnSpJrc9NrN0ac8H0AM= 2023-12-15T23:26:14.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2GKtjRM/mnSpJrc9NrN0ac8H0AM=', 'Content-Length': '0'} 2023-12-15T23:26:14.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072d9e5843370a234-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.003 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.004 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.004 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.004 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.004 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.004 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.004 DEBUG:boto:Data: 2023-12-15T23:26:14.004 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.004 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.004 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.004 DEBUG:boto:Params: {} 2023-12-15T23:26:14.005 DEBUG:boto:Token: None 2023-12-15T23:26:14.005 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.005 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2GKtjRM/mnSpJrc9NrN0ac8H0AM= 2023-12-15T23:26:14.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2GKtjRM/mnSpJrc9NrN0ac8H0AM=', 'Content-Length': '0'} 2023-12-15T23:26:14.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2271fdc049f8d85-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:26:14.007 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.007 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.007 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.007 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.008 DEBUG:boto:Method: GET 2023-12-15T23:26:14.008 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.008 DEBUG:boto:Data: 2023-12-15T23:26:14.008 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.008 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.008 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.008 DEBUG:boto:Params: {} 2023-12-15T23:26:14.008 DEBUG:boto:Token: None 2023-12-15T23:26:14.008 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.009 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7CimSXGgwA/oAasmPkaZnBam0KE= 2023-12-15T23:26:14.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7CimSXGgwA/oAasmPkaZnBam0KE=', 'Content-Length': '0'} 2023-12-15T23:26:14.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000793a16304427001c-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.053 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.053 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.054 DEBUG:boto:path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.054 DEBUG:boto:auth_path=/kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.054 DEBUG:boto:Method: GET 2023-12-15T23:26:14.054 DEBUG:boto:Path: /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.054 DEBUG:boto:Data: 2023-12-15T23:26:14.054 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.054 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.054 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.054 DEBUG:boto:Params: {} 2023-12-15T23:26:14.054 DEBUG:boto:Token: None 2023-12-15T23:26:14.055 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11?versionId=null 2023-12-15T23:26:14.055 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7CimSXGgwA/oAasmPkaZnBam0KE= 2023-12-15T23:26:14.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7CimSXGgwA/oAasmPkaZnBam0KE=', 'Content-Length': '0'} 2023-12-15T23:26:14.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff1c22af23e5ad0b-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.057 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.057 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.058 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.058 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.058 DEBUG:boto:Method: GET 2023-12-15T23:26:14.058 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.058 DEBUG:boto:Data: 2023-12-15T23:26:14.058 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.058 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.058 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.058 DEBUG:boto:Params: {} 2023-12-15T23:26:14.058 DEBUG:boto:Token: None 2023-12-15T23:26:14.058 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a27c7148a5fb7f6-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.061 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.066 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.066 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.066 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.066 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.066 DEBUG:boto:Method: GET 2023-12-15T23:26:14.066 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.066 DEBUG:boto:Data: 2023-12-15T23:26:14.066 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.066 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.066 DEBUG:boto:Params: {} 2023-12-15T23:26:14.067 DEBUG:boto:Token: None 2023-12-15T23:26:14.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d96af55a94810dc-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.070 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.071 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.071 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.071 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.071 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:26:14.071 DEBUG:boto:Data: 2023-12-15T23:26:14.071 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.071 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.072 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.072 DEBUG:boto:Params: {} 2023-12-15T23:26:14.072 DEBUG:boto:Token: None 2023-12-15T23:26:14.072 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11 2023-12-15T23:26:14.072 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J2iWT5AG32xJQU47GPGr4uZBtnc= 2023-12-15T23:26:14.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J2iWT5AG32xJQU47GPGr4uZBtnc=', 'Content-Length': '0'} 2023-12-15T23:26:14.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087f1af14f876b20e-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.074 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.074 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.074 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.075 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:26:14.075 DEBUG:boto:Data: 2023-12-15T23:26:14.075 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.075 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.075 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.075 DEBUG:boto:Params: {} 2023-12-15T23:26:14.075 DEBUG:boto:Token: None 2023-12-15T23:26:14.075 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11 2023-12-15T23:26:14.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J2iWT5AG32xJQU47GPGr4uZBtnc= 2023-12-15T23:26:14.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J2iWT5AG32xJQU47GPGr4uZBtnc=', 'Content-Length': '0'} 2023-12-15T23:26:14.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5a307686dee6bcd-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:26:14.077 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.078 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.078 DEBUG:boto:Method: GET 2023-12-15T23:26:14.078 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:26:14.078 DEBUG:boto:Data: 2023-12-15T23:26:14.078 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.078 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.078 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.078 DEBUG:boto:Params: {} 2023-12-15T23:26:14.078 DEBUG:boto:Token: None 2023-12-15T23:26:14.078 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11 2023-12-15T23:26:14.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CikkjWLRts9v2/GU0GeaJspfCOA= 2023-12-15T23:26:14.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CikkjWLRts9v2/GU0GeaJspfCOA=', 'Content-Length': '0'} 2023-12-15T23:26:14.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053ed221c9b01ce6b-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.121 DEBUG:boto:path=/kskgfn-49/obj11 2023-12-15T23:26:14.122 DEBUG:boto:auth_path=/kskgfn-49/obj11 2023-12-15T23:26:14.122 DEBUG:boto:Method: GET 2023-12-15T23:26:14.122 DEBUG:boto:Path: /kskgfn-49/obj11 2023-12-15T23:26:14.122 DEBUG:boto:Data: 2023-12-15T23:26:14.122 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.122 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.122 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.122 DEBUG:boto:Params: {} 2023-12-15T23:26:14.122 DEBUG:boto:Token: None 2023-12-15T23:26:14.122 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj11 2023-12-15T23:26:14.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CikkjWLRts9v2/GU0GeaJspfCOA= 2023-12-15T23:26:14.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CikkjWLRts9v2/GU0GeaJspfCOA=', 'Content-Length': '0'} 2023-12-15T23:26:14.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008971084911ec189f-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.125 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.125 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.125 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.125 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.125 DEBUG:boto:Method: GET 2023-12-15T23:26:14.125 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.125 DEBUG:boto:Data: 2023-12-15T23:26:14.125 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.126 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.126 DEBUG:boto:Params: {} 2023-12-15T23:26:14.126 DEBUG:boto:Token: None 2023-12-15T23:26:14.126 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.126 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.128 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085dc499c6b5ab196-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.129 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.129 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.129 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.129 DEBUG:boto:path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.129 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.130 DEBUG:boto:Method: GET 2023-12-15T23:26:14.130 DEBUG:boto:Path: /kskgfn-49/?prefix=obj11 2023-12-15T23:26:14.130 DEBUG:boto:Data: 2023-12-15T23:26:14.130 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.130 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.130 DEBUG:boto:Params: {} 2023-12-15T23:26:14.130 DEBUG:boto:Token: None 2023-12-15T23:26:14.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.133 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd1765b561d2ba3c-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.133 DEBUG:boto:b'kskgfn-49obj111000falseobj112023-12-15T23:16:03.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.134 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:26:14.134 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.134 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.134 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.134 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.134 DEBUG:boto:Method: GET 2023-12-15T23:26:14.134 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.135 DEBUG:boto:Data: 2023-12-15T23:26:14.135 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.135 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.135 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.135 DEBUG:boto:Params: {} 2023-12-15T23:26:14.135 DEBUG:boto:Token: None 2023-12-15T23:26:14.135 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc= 2023-12-15T23:26:14.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc=', 'Content-Length': '0'} 2023-12-15T23:26:14.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070ddd176a24febc4-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.181 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.181 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.182 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.182 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.182 DEBUG:boto:Method: GET 2023-12-15T23:26:14.182 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.182 DEBUG:boto:Data: 2023-12-15T23:26:14.182 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.182 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.182 DEBUG:boto:Params: {} 2023-12-15T23:26:14.182 DEBUG:boto:Token: None 2023-12-15T23:26:14.183 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc= 2023-12-15T23:26:14.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc=', 'Content-Length': '0'} 2023-12-15T23:26:14.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f331a0dc31acdf2e-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.185 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.185 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.185 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.185 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.185 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.185 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.185 DEBUG:boto:Data: 2023-12-15T23:26:14.185 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.185 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.186 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.186 DEBUG:boto:Params: {} 2023-12-15T23:26:14.186 DEBUG:boto:Token: None 2023-12-15T23:26:14.186 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dv9fm8s74BOOYyoDxchnEAYOGdo= 2023-12-15T23:26:14.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dv9fm8s74BOOYyoDxchnEAYOGdo=', 'Content-Length': '0'} 2023-12-15T23:26:14.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053ff74250047de73-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.188 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.188 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.188 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.188 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.188 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.188 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.188 DEBUG:boto:Data: 2023-12-15T23:26:14.189 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.189 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.189 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.189 DEBUG:boto:Params: {} 2023-12-15T23:26:14.189 DEBUG:boto:Token: None 2023-12-15T23:26:14.189 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.189 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dv9fm8s74BOOYyoDxchnEAYOGdo= 2023-12-15T23:26:14.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dv9fm8s74BOOYyoDxchnEAYOGdo=', 'Content-Length': '0'} 2023-12-15T23:26:14.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb7a71d5d9a8375a-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:26:14.191 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.191 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.191 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.192 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.192 DEBUG:boto:Method: GET 2023-12-15T23:26:14.192 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.192 DEBUG:boto:Data: 2023-12-15T23:26:14.192 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.192 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.192 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.192 DEBUG:boto:Params: {} 2023-12-15T23:26:14.192 DEBUG:boto:Token: None 2023-12-15T23:26:14.192 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc= 2023-12-15T23:26:14.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc=', 'Content-Length': '0'} 2023-12-15T23:26:14.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086dbd2c7f8699baf-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.238 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.238 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.238 DEBUG:boto:path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.238 DEBUG:boto:auth_path=/kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.238 DEBUG:boto:Method: GET 2023-12-15T23:26:14.238 DEBUG:boto:Path: /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.238 DEBUG:boto:Data: 2023-12-15T23:26:14.238 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.238 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.239 DEBUG:boto:Params: {} 2023-12-15T23:26:14.239 DEBUG:boto:Token: None 2023-12-15T23:26:14.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111?versionId=null 2023-12-15T23:26:14.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc= 2023-12-15T23:26:14.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EsgPRoe0n9BeJ9LgKGFQSUPtAQc=', 'Content-Length': '0'} 2023-12-15T23:26:14.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d880f3a491f7099d-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.241 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.241 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.241 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.241 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.241 DEBUG:boto:Method: GET 2023-12-15T23:26:14.242 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.242 DEBUG:boto:Data: 2023-12-15T23:26:14.242 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.242 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.242 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.242 DEBUG:boto:Params: {} 2023-12-15T23:26:14.242 DEBUG:boto:Token: None 2023-12-15T23:26:14.242 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ba2a2bc164a9285-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.245 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.245 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.245 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.245 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.246 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.246 DEBUG:boto:Method: GET 2023-12-15T23:26:14.246 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.246 DEBUG:boto:Data: 2023-12-15T23:26:14.246 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.246 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.246 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.246 DEBUG:boto:Params: {} 2023-12-15T23:26:14.246 DEBUG:boto:Token: None 2023-12-15T23:26:14.246 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f3f09a4ca2aa795-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.250 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.250 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.250 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.250 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.250 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:26:14.250 DEBUG:boto:Data: 2023-12-15T23:26:14.251 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.251 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.251 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.251 DEBUG:boto:Params: {} 2023-12-15T23:26:14.251 DEBUG:boto:Token: None 2023-12-15T23:26:14.251 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111 2023-12-15T23:26:14.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jlym0MVP3y5FS/Hv0d6b+pmQmvE= 2023-12-15T23:26:14.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jlym0MVP3y5FS/Hv0d6b+pmQmvE=', 'Content-Length': '0'} 2023-12-15T23:26:14.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e462826c6d3ab39d-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.253 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.253 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.253 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.253 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:26:14.254 DEBUG:boto:Data: 2023-12-15T23:26:14.254 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.254 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.254 DEBUG:boto:Params: {} 2023-12-15T23:26:14.254 DEBUG:boto:Token: None 2023-12-15T23:26:14.254 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111 2023-12-15T23:26:14.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jlym0MVP3y5FS/Hv0d6b+pmQmvE= 2023-12-15T23:26:14.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jlym0MVP3y5FS/Hv0d6b+pmQmvE=', 'Content-Length': '0'} 2023-12-15T23:26:14.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000927c7f568d28744d-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.256 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:26:14.256 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.256 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.257 DEBUG:boto:Method: GET 2023-12-15T23:26:14.257 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:26:14.257 DEBUG:boto:Data: 2023-12-15T23:26:14.257 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.257 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.257 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.257 DEBUG:boto:Params: {} 2023-12-15T23:26:14.257 DEBUG:boto:Token: None 2023-12-15T23:26:14.257 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111 2023-12-15T23:26:14.257 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FT6z+datrl5MWvHHng7rC9mglUc= 2023-12-15T23:26:14.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FT6z+datrl5MWvHHng7rC9mglUc=', 'Content-Length': '0'} 2023-12-15T23:26:14.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ae28d3e13c4e154-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.263 DEBUG:boto:path=/kskgfn-49/obj111 2023-12-15T23:26:14.263 DEBUG:boto:auth_path=/kskgfn-49/obj111 2023-12-15T23:26:14.263 DEBUG:boto:Method: GET 2023-12-15T23:26:14.263 DEBUG:boto:Path: /kskgfn-49/obj111 2023-12-15T23:26:14.263 DEBUG:boto:Data: 2023-12-15T23:26:14.263 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.263 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.263 DEBUG:boto:Params: {} 2023-12-15T23:26:14.263 DEBUG:boto:Token: None 2023-12-15T23:26:14.264 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj111 2023-12-15T23:26:14.264 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FT6z+datrl5MWvHHng7rC9mglUc= 2023-12-15T23:26:14.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FT6z+datrl5MWvHHng7rC9mglUc=', 'Content-Length': '0'} 2023-12-15T23:26:14.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000772577151cc5ed86-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.309 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.310 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.310 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.310 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.310 DEBUG:boto:Method: GET 2023-12-15T23:26:14.310 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.310 DEBUG:boto:Data: 2023-12-15T23:26:14.310 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.310 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.310 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.310 DEBUG:boto:Params: {} 2023-12-15T23:26:14.310 DEBUG:boto:Token: None 2023-12-15T23:26:14.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fee4766096c34a9-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.313 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.314 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.314 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.314 DEBUG:boto:path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.314 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.314 DEBUG:boto:Method: GET 2023-12-15T23:26:14.314 DEBUG:boto:Path: /kskgfn-49/?prefix=obj111 2023-12-15T23:26:14.314 DEBUG:boto:Data: 2023-12-15T23:26:14.314 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.314 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.315 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.315 DEBUG:boto:Params: {} 2023-12-15T23:26:14.315 DEBUG:boto:Token: None 2023-12-15T23:26:14.315 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.315 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005af8b30f8f8614e3-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.318 DEBUG:boto:b'kskgfn-49obj1111000falseobj1112023-12-15T23:24:39.996Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:26:14.319 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.319 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.319 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.319 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.319 DEBUG:boto:Method: GET 2023-12-15T23:26:14.319 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.319 DEBUG:boto:Data: 2023-12-15T23:26:14.320 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.320 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.320 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.320 DEBUG:boto:Params: {} 2023-12-15T23:26:14.320 DEBUG:boto:Token: None 2023-12-15T23:26:14.320 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw= 2023-12-15T23:26:14.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw=', 'Content-Length': '0'} 2023-12-15T23:26:14.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045662de659074443-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.323 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.323 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.323 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.324 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.324 DEBUG:boto:Method: GET 2023-12-15T23:26:14.324 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.324 DEBUG:boto:Data: 2023-12-15T23:26:14.324 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.324 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.324 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.324 DEBUG:boto:Params: {} 2023-12-15T23:26:14.324 DEBUG:boto:Token: None 2023-12-15T23:26:14.324 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.325 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw= 2023-12-15T23:26:14.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw=', 'Content-Length': '0'} 2023-12-15T23:26:14.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eac6b07189bcd843-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.327 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.327 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.327 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.327 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.327 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.328 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.328 DEBUG:boto:Data: 2023-12-15T23:26:14.328 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.328 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.328 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.328 DEBUG:boto:Params: {} 2023-12-15T23:26:14.328 DEBUG:boto:Token: None 2023-12-15T23:26:14.328 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.328 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TikXlcIDspLlTCoLkZvDA2wmxho= 2023-12-15T23:26:14.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TikXlcIDspLlTCoLkZvDA2wmxho=', 'Content-Length': '0'} 2023-12-15T23:26:14.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be4806665c1b1d7f-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.331 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.331 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.331 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.331 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.331 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.331 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.332 DEBUG:boto:Data: 2023-12-15T23:26:14.332 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.332 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.332 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.332 DEBUG:boto:Params: {} 2023-12-15T23:26:14.332 DEBUG:boto:Token: None 2023-12-15T23:26:14.332 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.332 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TikXlcIDspLlTCoLkZvDA2wmxho= 2023-12-15T23:26:14.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TikXlcIDspLlTCoLkZvDA2wmxho=', 'Content-Length': '0'} 2023-12-15T23:26:14.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000489a36036638b894-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.335 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:26:14.335 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.335 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.335 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.335 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.335 DEBUG:boto:Method: GET 2023-12-15T23:26:14.336 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.336 DEBUG:boto:Data: 2023-12-15T23:26:14.336 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.336 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.336 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.336 DEBUG:boto:Params: {} 2023-12-15T23:26:14.336 DEBUG:boto:Token: None 2023-12-15T23:26:14.336 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.336 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw= 2023-12-15T23:26:14.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw=', 'Content-Length': '0'} 2023-12-15T23:26:14.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dadd43b87da2bca-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.381 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.382 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.382 DEBUG:boto:path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.382 DEBUG:boto:auth_path=/kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.382 DEBUG:boto:Method: GET 2023-12-15T23:26:14.382 DEBUG:boto:Path: /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.382 DEBUG:boto:Data: 2023-12-15T23:26:14.382 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.382 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.382 DEBUG:boto:Params: {} 2023-12-15T23:26:14.382 DEBUG:boto:Token: None 2023-12-15T23:26:14.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115?versionId=null 2023-12-15T23:26:14.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw= 2023-12-15T23:26:14.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hdprbfoTOmF7tr95LzmAZdAyJsw=', 'Content-Length': '0'} 2023-12-15T23:26:14.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3325d82126b5293-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.385 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.385 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.385 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.386 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.386 DEBUG:boto:Method: GET 2023-12-15T23:26:14.386 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.386 DEBUG:boto:Data: 2023-12-15T23:26:14.386 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.386 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.386 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.386 DEBUG:boto:Params: {} 2023-12-15T23:26:14.386 DEBUG:boto:Token: None 2023-12-15T23:26:14.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.389 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d50d4d3d6466100-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.389 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.389 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.390 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.390 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.390 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.390 DEBUG:boto:Method: GET 2023-12-15T23:26:14.390 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.390 DEBUG:boto:Data: 2023-12-15T23:26:14.390 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.390 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.390 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.390 DEBUG:boto:Params: {} 2023-12-15T23:26:14.391 DEBUG:boto:Token: None 2023-12-15T23:26:14.391 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000707a10bef9dfa54-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.394 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.395 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.395 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.395 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.395 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:26:14.395 DEBUG:boto:Data: 2023-12-15T23:26:14.395 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.395 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.395 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.396 DEBUG:boto:Params: {} 2023-12-15T23:26:14.396 DEBUG:boto:Token: None 2023-12-15T23:26:14.396 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115 2023-12-15T23:26:14.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s5fhLQLuHnIIq6wxNi/Ke5cGAgM= 2023-12-15T23:26:14.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s5fhLQLuHnIIq6wxNi/Ke5cGAgM=', 'Content-Length': '0'} 2023-12-15T23:26:14.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bf8671872911dfc-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.398 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.398 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.399 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.399 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:26:14.399 DEBUG:boto:Data: 2023-12-15T23:26:14.399 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.399 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.399 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.399 DEBUG:boto:Params: {} 2023-12-15T23:26:14.399 DEBUG:boto:Token: None 2023-12-15T23:26:14.399 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115 2023-12-15T23:26:14.400 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s5fhLQLuHnIIq6wxNi/Ke5cGAgM= 2023-12-15T23:26:14.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s5fhLQLuHnIIq6wxNi/Ke5cGAgM=', 'Content-Length': '0'} 2023-12-15T23:26:14.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000837b208b83411d3b-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:26:14.402 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.402 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.402 DEBUG:boto:Method: GET 2023-12-15T23:26:14.402 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:26:14.402 DEBUG:boto:Data: 2023-12-15T23:26:14.402 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.402 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.402 DEBUG:boto:Params: {} 2023-12-15T23:26:14.403 DEBUG:boto:Token: None 2023-12-15T23:26:14.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115 2023-12-15T23:26:14.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LBmyMtYUbvpfy3wNtNynYDGOKu4= 2023-12-15T23:26:14.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LBmyMtYUbvpfy3wNtNynYDGOKu4=', 'Content-Length': '0'} 2023-12-15T23:26:14.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059cca2f2ac8ad5f3-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.405 DEBUG:boto:path=/kskgfn-49/obj115 2023-12-15T23:26:14.406 DEBUG:boto:auth_path=/kskgfn-49/obj115 2023-12-15T23:26:14.406 DEBUG:boto:Method: GET 2023-12-15T23:26:14.406 DEBUG:boto:Path: /kskgfn-49/obj115 2023-12-15T23:26:14.406 DEBUG:boto:Data: 2023-12-15T23:26:14.406 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.406 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.406 DEBUG:boto:Params: {} 2023-12-15T23:26:14.406 DEBUG:boto:Token: None 2023-12-15T23:26:14.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj115 2023-12-15T23:26:14.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LBmyMtYUbvpfy3wNtNynYDGOKu4= 2023-12-15T23:26:14.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LBmyMtYUbvpfy3wNtNynYDGOKu4=', 'Content-Length': '0'} 2023-12-15T23:26:14.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000005bcab093412a89-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.409 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.409 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.409 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.409 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.409 DEBUG:boto:Method: GET 2023-12-15T23:26:14.409 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.410 DEBUG:boto:Data: 2023-12-15T23:26:14.410 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.410 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.410 DEBUG:boto:Params: {} 2023-12-15T23:26:14.410 DEBUG:boto:Token: None 2023-12-15T23:26:14.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000275f717e38aaf41a-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.413 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.413 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.414 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.414 DEBUG:boto:path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.414 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.414 DEBUG:boto:Method: GET 2023-12-15T23:26:14.414 DEBUG:boto:Path: /kskgfn-49/?prefix=obj115 2023-12-15T23:26:14.414 DEBUG:boto:Data: 2023-12-15T23:26:14.414 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.414 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.414 DEBUG:boto:Params: {} 2023-12-15T23:26:14.414 DEBUG:boto:Token: None 2023-12-15T23:26:14.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.418 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036840fb5d63767d3-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.418 DEBUG:boto:b'kskgfn-49obj1151000falseobj1152023-12-15T23:18:45.764Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:26:14.419 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.419 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.419 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.419 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.419 DEBUG:boto:Method: GET 2023-12-15T23:26:14.419 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.419 DEBUG:boto:Data: 2023-12-15T23:26:14.419 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.419 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.419 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.419 DEBUG:boto:Params: {} 2023-12-15T23:26:14.420 DEBUG:boto:Token: None 2023-12-15T23:26:14.420 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k= 2023-12-15T23:26:14.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k=', 'Content-Length': '0'} 2023-12-15T23:26:14.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000182a1eeb89ffcd02-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.423 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.423 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.423 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.423 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.423 DEBUG:boto:Method: GET 2023-12-15T23:26:14.423 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.423 DEBUG:boto:Data: 2023-12-15T23:26:14.423 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.423 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.424 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.424 DEBUG:boto:Params: {} 2023-12-15T23:26:14.424 DEBUG:boto:Token: None 2023-12-15T23:26:14.424 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.424 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k= 2023-12-15T23:26:14.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k=', 'Content-Length': '0'} 2023-12-15T23:26:14.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a99232ded4501d1-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.426 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.426 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.427 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.427 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.427 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.427 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.427 DEBUG:boto:Data: 2023-12-15T23:26:14.427 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.427 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.427 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.427 DEBUG:boto:Params: {} 2023-12-15T23:26:14.427 DEBUG:boto:Token: None 2023-12-15T23:26:14.428 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w/9ND0OWTEaK15Ku1J7bR+E/cYo= 2023-12-15T23:26:14.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w/9ND0OWTEaK15Ku1J7bR+E/cYo=', 'Content-Length': '0'} 2023-12-15T23:26:14.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df358aa4eb6ff823-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.430 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.430 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.430 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.430 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.430 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.430 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.430 DEBUG:boto:Data: 2023-12-15T23:26:14.430 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.430 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.431 DEBUG:boto:Params: {} 2023-12-15T23:26:14.431 DEBUG:boto:Token: None 2023-12-15T23:26:14.431 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.431 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:w/9ND0OWTEaK15Ku1J7bR+E/cYo= 2023-12-15T23:26:14.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:w/9ND0OWTEaK15Ku1J7bR+E/cYo=', 'Content-Length': '0'} 2023-12-15T23:26:14.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f91edd96ce542451-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.433 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:26:14.433 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.433 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.433 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.433 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.433 DEBUG:boto:Method: GET 2023-12-15T23:26:14.434 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.434 DEBUG:boto:Data: 2023-12-15T23:26:14.434 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.434 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.434 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.434 DEBUG:boto:Params: {} 2023-12-15T23:26:14.434 DEBUG:boto:Token: None 2023-12-15T23:26:14.434 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k= 2023-12-15T23:26:14.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k=', 'Content-Length': '0'} 2023-12-15T23:26:14.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fb585ea6e02143c-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.477 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.478 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.478 DEBUG:boto:path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.478 DEBUG:boto:auth_path=/kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.478 DEBUG:boto:Method: GET 2023-12-15T23:26:14.478 DEBUG:boto:Path: /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.478 DEBUG:boto:Data: 2023-12-15T23:26:14.478 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.478 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.478 DEBUG:boto:Params: {} 2023-12-15T23:26:14.479 DEBUG:boto:Token: None 2023-12-15T23:26:14.479 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116?versionId=null 2023-12-15T23:26:14.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k= 2023-12-15T23:26:14.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:b04RozHsTo2SMhWVIuhsQO85M8k=', 'Content-Length': '0'} 2023-12-15T23:26:14.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e68229113cad366-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.482 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.482 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.482 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.482 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.482 DEBUG:boto:Method: GET 2023-12-15T23:26:14.482 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.482 DEBUG:boto:Data: 2023-12-15T23:26:14.482 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.483 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.483 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.483 DEBUG:boto:Params: {} 2023-12-15T23:26:14.483 DEBUG:boto:Token: None 2023-12-15T23:26:14.483 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.483 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062ee0b95e8be876e-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.486 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.486 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.486 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.486 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.486 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.486 DEBUG:boto:Method: GET 2023-12-15T23:26:14.486 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.487 DEBUG:boto:Data: 2023-12-15T23:26:14.487 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.487 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.487 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.487 DEBUG:boto:Params: {} 2023-12-15T23:26:14.487 DEBUG:boto:Token: None 2023-12-15T23:26:14.487 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.487 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050c13c3439ab5c75-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.491 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.491 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.491 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.491 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.491 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:26:14.492 DEBUG:boto:Data: 2023-12-15T23:26:14.492 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.492 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.492 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.492 DEBUG:boto:Params: {} 2023-12-15T23:26:14.492 DEBUG:boto:Token: None 2023-12-15T23:26:14.492 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116 2023-12-15T23:26:14.492 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TYfnaFXSRbt2U4z84v/9JV9jqlI= 2023-12-15T23:26:14.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TYfnaFXSRbt2U4z84v/9JV9jqlI=', 'Content-Length': '0'} 2023-12-15T23:26:14.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009494753eeaeb8528-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.495 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.495 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.495 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.495 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:26:14.495 DEBUG:boto:Data: 2023-12-15T23:26:14.495 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.495 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.495 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.495 DEBUG:boto:Params: {} 2023-12-15T23:26:14.495 DEBUG:boto:Token: None 2023-12-15T23:26:14.496 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116 2023-12-15T23:26:14.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TYfnaFXSRbt2U4z84v/9JV9jqlI= 2023-12-15T23:26:14.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TYfnaFXSRbt2U4z84v/9JV9jqlI=', 'Content-Length': '0'} 2023-12-15T23:26:14.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec046fbdfe7a4b26-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.498 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:26:14.498 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.498 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.498 DEBUG:boto:Method: GET 2023-12-15T23:26:14.498 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:26:14.499 DEBUG:boto:Data: 2023-12-15T23:26:14.499 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.499 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.499 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.499 DEBUG:boto:Params: {} 2023-12-15T23:26:14.499 DEBUG:boto:Token: None 2023-12-15T23:26:14.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116 2023-12-15T23:26:14.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9Z1zM7+1feR2gQWRbz2ksC04yY= 2023-12-15T23:26:14.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9Z1zM7+1feR2gQWRbz2ksC04yY=', 'Content-Length': '0'} 2023-12-15T23:26:14.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005890f0b44513531e-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.541 DEBUG:boto:path=/kskgfn-49/obj116 2023-12-15T23:26:14.542 DEBUG:boto:auth_path=/kskgfn-49/obj116 2023-12-15T23:26:14.542 DEBUG:boto:Method: GET 2023-12-15T23:26:14.542 DEBUG:boto:Path: /kskgfn-49/obj116 2023-12-15T23:26:14.542 DEBUG:boto:Data: 2023-12-15T23:26:14.542 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.542 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.542 DEBUG:boto:Params: {} 2023-12-15T23:26:14.542 DEBUG:boto:Token: None 2023-12-15T23:26:14.542 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj116 2023-12-15T23:26:14.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:i9Z1zM7+1feR2gQWRbz2ksC04yY= 2023-12-15T23:26:14.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:i9Z1zM7+1feR2gQWRbz2ksC04yY=', 'Content-Length': '0'} 2023-12-15T23:26:14.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc12973800c4c000-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.545 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.545 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.545 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.545 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.545 DEBUG:boto:Method: GET 2023-12-15T23:26:14.545 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.545 DEBUG:boto:Data: 2023-12-15T23:26:14.546 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.546 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.546 DEBUG:boto:Params: {} 2023-12-15T23:26:14.546 DEBUG:boto:Token: None 2023-12-15T23:26:14.546 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.546 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e882796379d8c1e4-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.549 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.549 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.549 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.549 DEBUG:boto:path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.549 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.549 DEBUG:boto:Method: GET 2023-12-15T23:26:14.550 DEBUG:boto:Path: /kskgfn-49/?prefix=obj116 2023-12-15T23:26:14.550 DEBUG:boto:Data: 2023-12-15T23:26:14.550 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.550 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.550 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.550 DEBUG:boto:Params: {} 2023-12-15T23:26:14.550 DEBUG:boto:Token: None 2023-12-15T23:26:14.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.554 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bfeef96cc4b9b292-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.554 DEBUG:boto:b'kskgfn-49obj1161000falseobj1162023-12-15T23:21:00.032Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.554 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:26:14.554 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.555 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.555 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.555 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.555 DEBUG:boto:Method: GET 2023-12-15T23:26:14.555 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.555 DEBUG:boto:Data: 2023-12-15T23:26:14.555 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.555 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.555 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.555 DEBUG:boto:Params: {} 2023-12-15T23:26:14.555 DEBUG:boto:Token: None 2023-12-15T23:26:14.556 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.556 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ= 2023-12-15T23:26:14.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ=', 'Content-Length': '0'} 2023-12-15T23:26:14.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f32b40416c6c8dd-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.558 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.558 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.558 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.559 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.559 DEBUG:boto:Method: GET 2023-12-15T23:26:14.559 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.559 DEBUG:boto:Data: 2023-12-15T23:26:14.559 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.559 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.559 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.559 DEBUG:boto:Params: {} 2023-12-15T23:26:14.559 DEBUG:boto:Token: None 2023-12-15T23:26:14.559 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.560 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ= 2023-12-15T23:26:14.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ=', 'Content-Length': '0'} 2023-12-15T23:26:14.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012e5ac387d8506dd-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.562 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.562 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.562 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.562 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.562 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.562 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.563 DEBUG:boto:Data: 2023-12-15T23:26:14.563 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.563 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.563 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.563 DEBUG:boto:Params: {} 2023-12-15T23:26:14.563 DEBUG:boto:Token: None 2023-12-15T23:26:14.563 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.563 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZYE885Vr6BoEM6Zmy2TxrpSlXM= 2023-12-15T23:26:14.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZYE885Vr6BoEM6Zmy2TxrpSlXM=', 'Content-Length': '0'} 2023-12-15T23:26:14.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbe3477abd49ba88-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.565 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.566 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.566 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.566 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.566 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.566 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.566 DEBUG:boto:Data: 2023-12-15T23:26:14.566 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.566 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.566 DEBUG:boto:Params: {} 2023-12-15T23:26:14.567 DEBUG:boto:Token: None 2023-12-15T23:26:14.567 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DZYE885Vr6BoEM6Zmy2TxrpSlXM= 2023-12-15T23:26:14.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DZYE885Vr6BoEM6Zmy2TxrpSlXM=', 'Content-Length': '0'} 2023-12-15T23:26:14.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e65864a9d134ea3-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.569 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:26:14.569 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.569 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.570 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.570 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.570 DEBUG:boto:Method: GET 2023-12-15T23:26:14.570 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.570 DEBUG:boto:Data: 2023-12-15T23:26:14.570 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.570 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.570 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.570 DEBUG:boto:Params: {} 2023-12-15T23:26:14.570 DEBUG:boto:Token: None 2023-12-15T23:26:14.571 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ= 2023-12-15T23:26:14.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ=', 'Content-Length': '0'} 2023-12-15T23:26:14.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003394cdb68e489275-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.573 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.573 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.573 DEBUG:boto:path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.573 DEBUG:boto:auth_path=/kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.574 DEBUG:boto:Method: GET 2023-12-15T23:26:14.574 DEBUG:boto:Path: /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.574 DEBUG:boto:Data: 2023-12-15T23:26:14.574 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.574 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.574 DEBUG:boto:Params: {} 2023-12-15T23:26:14.574 DEBUG:boto:Token: None 2023-12-15T23:26:14.574 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124?versionId=null 2023-12-15T23:26:14.574 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ= 2023-12-15T23:26:14.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WaklPjWqu6OXcLLeRdMTtfNsVuQ=', 'Content-Length': '0'} 2023-12-15T23:26:14.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f50d16e18881cf2d-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.617 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.618 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.618 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.618 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.618 DEBUG:boto:Method: GET 2023-12-15T23:26:14.618 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.618 DEBUG:boto:Data: 2023-12-15T23:26:14.618 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.618 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.619 DEBUG:boto:Params: {} 2023-12-15T23:26:14.619 DEBUG:boto:Token: None 2023-12-15T23:26:14.619 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f75bb033ebaf5ae4-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.622 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.622 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.622 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.622 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.622 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.623 DEBUG:boto:Method: GET 2023-12-15T23:26:14.623 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.623 DEBUG:boto:Data: 2023-12-15T23:26:14.623 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.623 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.623 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.623 DEBUG:boto:Params: {} 2023-12-15T23:26:14.623 DEBUG:boto:Token: None 2023-12-15T23:26:14.623 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.627 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e58ee3faf9fb1528-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.627 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.628 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.628 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.628 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.628 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:26:14.628 DEBUG:boto:Data: 2023-12-15T23:26:14.628 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.628 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.628 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.628 DEBUG:boto:Params: {} 2023-12-15T23:26:14.629 DEBUG:boto:Token: None 2023-12-15T23:26:14.629 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124 2023-12-15T23:26:14.629 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AjXfOUgWvwyBF5zUDvjKS4uCzdw= 2023-12-15T23:26:14.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AjXfOUgWvwyBF5zUDvjKS4uCzdw=', 'Content-Length': '0'} 2023-12-15T23:26:14.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4097616422d2066-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.631 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.631 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.631 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.631 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:26:14.631 DEBUG:boto:Data: 2023-12-15T23:26:14.632 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.632 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.632 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.632 DEBUG:boto:Params: {} 2023-12-15T23:26:14.632 DEBUG:boto:Token: None 2023-12-15T23:26:14.632 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124 2023-12-15T23:26:14.632 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AjXfOUgWvwyBF5zUDvjKS4uCzdw= 2023-12-15T23:26:14.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AjXfOUgWvwyBF5zUDvjKS4uCzdw=', 'Content-Length': '0'} 2023-12-15T23:26:14.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c59ae3c36155fa8b-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:26:14.634 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.634 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.634 DEBUG:boto:Method: GET 2023-12-15T23:26:14.635 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:26:14.635 DEBUG:boto:Data: 2023-12-15T23:26:14.635 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.635 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.635 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.635 DEBUG:boto:Params: {} 2023-12-15T23:26:14.635 DEBUG:boto:Token: None 2023-12-15T23:26:14.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124 2023-12-15T23:26:14.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MXi8F90S8bL6KowA/NN3X3TcPaM= 2023-12-15T23:26:14.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MXi8F90S8bL6KowA/NN3X3TcPaM=', 'Content-Length': '0'} 2023-12-15T23:26:14.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d97ddfd647f0e715-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.681 DEBUG:boto:path=/kskgfn-49/obj124 2023-12-15T23:26:14.682 DEBUG:boto:auth_path=/kskgfn-49/obj124 2023-12-15T23:26:14.682 DEBUG:boto:Method: GET 2023-12-15T23:26:14.682 DEBUG:boto:Path: /kskgfn-49/obj124 2023-12-15T23:26:14.682 DEBUG:boto:Data: 2023-12-15T23:26:14.682 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.682 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.682 DEBUG:boto:Params: {} 2023-12-15T23:26:14.682 DEBUG:boto:Token: None 2023-12-15T23:26:14.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj124 2023-12-15T23:26:14.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MXi8F90S8bL6KowA/NN3X3TcPaM= 2023-12-15T23:26:14.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MXi8F90S8bL6KowA/NN3X3TcPaM=', 'Content-Length': '0'} 2023-12-15T23:26:14.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e65ab987832db616-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.685 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.685 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.685 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.685 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.685 DEBUG:boto:Method: GET 2023-12-15T23:26:14.686 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.686 DEBUG:boto:Data: 2023-12-15T23:26:14.686 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.686 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.686 DEBUG:boto:Params: {} 2023-12-15T23:26:14.686 DEBUG:boto:Token: None 2023-12-15T23:26:14.686 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058fd5f3660f7cb21-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.689 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.690 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.690 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.690 DEBUG:boto:path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.690 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.690 DEBUG:boto:Method: GET 2023-12-15T23:26:14.690 DEBUG:boto:Path: /kskgfn-49/?prefix=obj124 2023-12-15T23:26:14.690 DEBUG:boto:Data: 2023-12-15T23:26:14.690 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.691 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.691 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.691 DEBUG:boto:Params: {} 2023-12-15T23:26:14.691 DEBUG:boto:Token: None 2023-12-15T23:26:14.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.695 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5ab10b82d04586e-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.695 DEBUG:boto:b'kskgfn-49obj1241000falseobj1242023-12-15T23:22:24.690Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.696 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:26:14.696 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.696 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.696 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.696 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.696 DEBUG:boto:Method: GET 2023-12-15T23:26:14.696 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.696 DEBUG:boto:Data: 2023-12-15T23:26:14.696 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.697 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.697 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.697 DEBUG:boto:Params: {} 2023-12-15T23:26:14.697 DEBUG:boto:Token: None 2023-12-15T23:26:14.697 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.697 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk= 2023-12-15T23:26:14.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk=', 'Content-Length': '0'} 2023-12-15T23:26:14.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003267baf926aa2df9-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.700 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.700 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.700 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.700 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.700 DEBUG:boto:Method: GET 2023-12-15T23:26:14.700 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.700 DEBUG:boto:Data: 2023-12-15T23:26:14.701 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.701 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.701 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.701 DEBUG:boto:Params: {} 2023-12-15T23:26:14.701 DEBUG:boto:Token: None 2023-12-15T23:26:14.701 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk= 2023-12-15T23:26:14.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk=', 'Content-Length': '0'} 2023-12-15T23:26:14.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5cfbb069ac3cf2e-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.745 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.746 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.746 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.746 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.746 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.746 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.746 DEBUG:boto:Data: 2023-12-15T23:26:14.746 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.746 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.746 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.746 DEBUG:boto:Params: {} 2023-12-15T23:26:14.747 DEBUG:boto:Token: None 2023-12-15T23:26:14.747 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q0gTNr7dDzD9rAtVPjxo2dF/CwY= 2023-12-15T23:26:14.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q0gTNr7dDzD9rAtVPjxo2dF/CwY=', 'Content-Length': '0'} 2023-12-15T23:26:14.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000308944bcc5db4ab7-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.749 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.749 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.749 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.749 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.750 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.750 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.750 DEBUG:boto:Data: 2023-12-15T23:26:14.750 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.750 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.750 DEBUG:boto:Params: {} 2023-12-15T23:26:14.750 DEBUG:boto:Token: None 2023-12-15T23:26:14.750 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q0gTNr7dDzD9rAtVPjxo2dF/CwY= 2023-12-15T23:26:14.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q0gTNr7dDzD9rAtVPjxo2dF/CwY=', 'Content-Length': '0'} 2023-12-15T23:26:14.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000abdcb0b39c39ed8-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:26:14.753 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.753 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.753 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.753 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.754 DEBUG:boto:Method: GET 2023-12-15T23:26:14.754 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.754 DEBUG:boto:Data: 2023-12-15T23:26:14.754 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.754 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.754 DEBUG:boto:Params: {} 2023-12-15T23:26:14.754 DEBUG:boto:Token: None 2023-12-15T23:26:14.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk= 2023-12-15T23:26:14.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk=', 'Content-Length': '0'} 2023-12-15T23:26:14.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e9da4f804ff05ed-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.757 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.757 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.757 DEBUG:boto:path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.757 DEBUG:boto:auth_path=/kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.757 DEBUG:boto:Method: GET 2023-12-15T23:26:14.757 DEBUG:boto:Path: /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.757 DEBUG:boto:Data: 2023-12-15T23:26:14.757 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.757 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.758 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.758 DEBUG:boto:Params: {} 2023-12-15T23:26:14.758 DEBUG:boto:Token: None 2023-12-15T23:26:14.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145?versionId=null 2023-12-15T23:26:14.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk= 2023-12-15T23:26:14.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wA/IU1j3vgyZPDTdp1nDkW2BVfk=', 'Content-Length': '0'} 2023-12-15T23:26:14.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069ade76a89b218ed-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.760 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.760 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.760 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.760 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.761 DEBUG:boto:Method: GET 2023-12-15T23:26:14.761 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.761 DEBUG:boto:Data: 2023-12-15T23:26:14.761 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.761 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.761 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.761 DEBUG:boto:Params: {} 2023-12-15T23:26:14.761 DEBUG:boto:Token: None 2023-12-15T23:26:14.761 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.761 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5b51352af3dd691-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.764 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.764 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.765 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.765 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.765 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.765 DEBUG:boto:Method: GET 2023-12-15T23:26:14.765 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.765 DEBUG:boto:Data: 2023-12-15T23:26:14.765 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.765 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.765 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.765 DEBUG:boto:Params: {} 2023-12-15T23:26:14.766 DEBUG:boto:Token: None 2023-12-15T23:26:14.766 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.766 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d35b2908be5ce0e3-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.770 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.770 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.770 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.770 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.770 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:26:14.770 DEBUG:boto:Data: 2023-12-15T23:26:14.770 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.771 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.771 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.771 DEBUG:boto:Params: {} 2023-12-15T23:26:14.771 DEBUG:boto:Token: None 2023-12-15T23:26:14.771 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145 2023-12-15T23:26:14.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SloGNQEEITMdVKNw+lsF+ptkMfU= 2023-12-15T23:26:14.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SloGNQEEITMdVKNw+lsF+ptkMfU=', 'Content-Length': '0'} 2023-12-15T23:26:14.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060957ac8e90bc2c4-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.773 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.774 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.774 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.774 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:26:14.774 DEBUG:boto:Data: 2023-12-15T23:26:14.774 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.774 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.774 DEBUG:boto:Params: {} 2023-12-15T23:26:14.775 DEBUG:boto:Token: None 2023-12-15T23:26:14.775 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145 2023-12-15T23:26:14.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SloGNQEEITMdVKNw+lsF+ptkMfU= 2023-12-15T23:26:14.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SloGNQEEITMdVKNw+lsF+ptkMfU=', 'Content-Length': '0'} 2023-12-15T23:26:14.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb690b40ed5b3f2-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:26:14.777 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.777 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.777 DEBUG:boto:Method: GET 2023-12-15T23:26:14.777 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:26:14.777 DEBUG:boto:Data: 2023-12-15T23:26:14.777 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.777 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.777 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.777 DEBUG:boto:Params: {} 2023-12-15T23:26:14.778 DEBUG:boto:Token: None 2023-12-15T23:26:14.778 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145 2023-12-15T23:26:14.778 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uPT9CeHxzIlhDkqpTliSnBKokug= 2023-12-15T23:26:14.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uPT9CeHxzIlhDkqpTliSnBKokug=', 'Content-Length': '0'} 2023-12-15T23:26:14.780 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000464e0a0941b2d04f-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.780 DEBUG:boto:path=/kskgfn-49/obj145 2023-12-15T23:26:14.780 DEBUG:boto:auth_path=/kskgfn-49/obj145 2023-12-15T23:26:14.780 DEBUG:boto:Method: GET 2023-12-15T23:26:14.780 DEBUG:boto:Path: /kskgfn-49/obj145 2023-12-15T23:26:14.781 DEBUG:boto:Data: 2023-12-15T23:26:14.781 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.781 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.781 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.781 DEBUG:boto:Params: {} 2023-12-15T23:26:14.781 DEBUG:boto:Token: None 2023-12-15T23:26:14.781 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj145 2023-12-15T23:26:14.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uPT9CeHxzIlhDkqpTliSnBKokug= 2023-12-15T23:26:14.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uPT9CeHxzIlhDkqpTliSnBKokug=', 'Content-Length': '0'} 2023-12-15T23:26:14.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:21:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae180d2621b0febf-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.783 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.784 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.784 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.784 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.784 DEBUG:boto:Method: GET 2023-12-15T23:26:14.784 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.784 DEBUG:boto:Data: 2023-12-15T23:26:14.784 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.784 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.784 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.784 DEBUG:boto:Params: {} 2023-12-15T23:26:14.785 DEBUG:boto:Token: None 2023-12-15T23:26:14.785 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.788 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f95f23d5c4daafc9-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.788 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.788 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.788 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.788 DEBUG:boto:path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.788 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.789 DEBUG:boto:Method: GET 2023-12-15T23:26:14.789 DEBUG:boto:Path: /kskgfn-49/?prefix=obj145 2023-12-15T23:26:14.789 DEBUG:boto:Data: 2023-12-15T23:26:14.789 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.789 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.789 DEBUG:boto:Params: {} 2023-12-15T23:26:14.789 DEBUG:boto:Token: None 2023-12-15T23:26:14.789 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4d4b814dfb35fde-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.793 DEBUG:boto:b'kskgfn-49obj1451000falseobj1452023-12-15T23:21:00.042Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:26:14.794 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.794 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.794 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.794 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.794 DEBUG:boto:Method: GET 2023-12-15T23:26:14.794 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.794 DEBUG:boto:Data: 2023-12-15T23:26:14.794 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.794 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.794 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.794 DEBUG:boto:Params: {} 2023-12-15T23:26:14.795 DEBUG:boto:Token: None 2023-12-15T23:26:14.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI= 2023-12-15T23:26:14.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI=', 'Content-Length': '0'} 2023-12-15T23:26:14.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6ba7086b97d6b3d-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.797 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.797 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.797 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.798 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.798 DEBUG:boto:Method: GET 2023-12-15T23:26:14.798 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.798 DEBUG:boto:Data: 2023-12-15T23:26:14.798 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.798 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.798 DEBUG:boto:Params: {} 2023-12-15T23:26:14.798 DEBUG:boto:Token: None 2023-12-15T23:26:14.799 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.799 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI= 2023-12-15T23:26:14.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI=', 'Content-Length': '0'} 2023-12-15T23:26:14.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048f91cec91d0b34f-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.801 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.801 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.801 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.801 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.801 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.801 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.801 DEBUG:boto:Data: 2023-12-15T23:26:14.802 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.802 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.802 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.802 DEBUG:boto:Params: {} 2023-12-15T23:26:14.802 DEBUG:boto:Token: None 2023-12-15T23:26:14.802 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UlgUbfkf8h7PLLlLHuT/lFMqRRc= 2023-12-15T23:26:14.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UlgUbfkf8h7PLLlLHuT/lFMqRRc=', 'Content-Length': '0'} 2023-12-15T23:26:14.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000992f72558f3b35e2-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.804 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.805 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.805 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.805 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.805 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.805 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.805 DEBUG:boto:Data: 2023-12-15T23:26:14.805 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.805 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.805 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.805 DEBUG:boto:Params: {} 2023-12-15T23:26:14.806 DEBUG:boto:Token: None 2023-12-15T23:26:14.806 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.806 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UlgUbfkf8h7PLLlLHuT/lFMqRRc= 2023-12-15T23:26:14.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UlgUbfkf8h7PLLlLHuT/lFMqRRc=', 'Content-Length': '0'} 2023-12-15T23:26:14.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004905445a4d812182-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:26:14.808 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.808 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.808 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.808 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.809 DEBUG:boto:Method: GET 2023-12-15T23:26:14.809 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.809 DEBUG:boto:Data: 2023-12-15T23:26:14.809 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.809 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.809 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.809 DEBUG:boto:Params: {} 2023-12-15T23:26:14.809 DEBUG:boto:Token: None 2023-12-15T23:26:14.809 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI= 2023-12-15T23:26:14.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI=', 'Content-Length': '0'} 2023-12-15T23:26:14.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d28eb2bbe2b946cf-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.812 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.812 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.812 DEBUG:boto:path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.812 DEBUG:boto:auth_path=/kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.812 DEBUG:boto:Method: GET 2023-12-15T23:26:14.812 DEBUG:boto:Path: /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.812 DEBUG:boto:Data: 2023-12-15T23:26:14.812 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.812 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.813 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.813 DEBUG:boto:Params: {} 2023-12-15T23:26:14.813 DEBUG:boto:Token: None 2023-12-15T23:26:14.813 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148?versionId=null 2023-12-15T23:26:14.813 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI= 2023-12-15T23:26:14.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DjG8zyw1pN03gIM+vKqu6KJAtwI=', 'Content-Length': '0'} 2023-12-15T23:26:14.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000609e8cb18fd52b28-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.815 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.815 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.816 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.816 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.816 DEBUG:boto:Method: GET 2023-12-15T23:26:14.816 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.816 DEBUG:boto:Data: 2023-12-15T23:26:14.816 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.816 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.816 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.816 DEBUG:boto:Params: {} 2023-12-15T23:26:14.816 DEBUG:boto:Token: None 2023-12-15T23:26:14.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.819 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8d36e7c9eaab1e8-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.819 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.820 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.820 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.820 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.820 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.820 DEBUG:boto:Method: GET 2023-12-15T23:26:14.820 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.820 DEBUG:boto:Data: 2023-12-15T23:26:14.821 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.821 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.821 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.821 DEBUG:boto:Params: {} 2023-12-15T23:26:14.821 DEBUG:boto:Token: None 2023-12-15T23:26:14.821 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.821 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020fbec9d72e76182-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.825 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.825 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.825 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.826 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.826 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:26:14.826 DEBUG:boto:Data: 2023-12-15T23:26:14.826 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.826 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.826 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.826 DEBUG:boto:Params: {} 2023-12-15T23:26:14.826 DEBUG:boto:Token: None 2023-12-15T23:26:14.826 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148 2023-12-15T23:26:14.826 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iA76Vpp8dPNIiYqxq7FfdwCMzjY= 2023-12-15T23:26:14.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iA76Vpp8dPNIiYqxq7FfdwCMzjY=', 'Content-Length': '0'} 2023-12-15T23:26:14.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccd3a43782394121-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.829 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.829 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.829 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.829 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:26:14.829 DEBUG:boto:Data: 2023-12-15T23:26:14.829 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.829 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.829 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.829 DEBUG:boto:Params: {} 2023-12-15T23:26:14.829 DEBUG:boto:Token: None 2023-12-15T23:26:14.830 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148 2023-12-15T23:26:14.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iA76Vpp8dPNIiYqxq7FfdwCMzjY= 2023-12-15T23:26:14.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iA76Vpp8dPNIiYqxq7FfdwCMzjY=', 'Content-Length': '0'} 2023-12-15T23:26:14.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9a80bd688a5f14f-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:26:14.832 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.832 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.832 DEBUG:boto:Method: GET 2023-12-15T23:26:14.832 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:26:14.832 DEBUG:boto:Data: 2023-12-15T23:26:14.832 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.832 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.832 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.833 DEBUG:boto:Params: {} 2023-12-15T23:26:14.833 DEBUG:boto:Token: None 2023-12-15T23:26:14.833 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148 2023-12-15T23:26:14.833 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X1natcDIgV6igkV1M7kzVOV/R/8= 2023-12-15T23:26:14.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X1natcDIgV6igkV1M7kzVOV/R/8=', 'Content-Length': '0'} 2023-12-15T23:26:14.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fada21182227e89-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.835 DEBUG:boto:path=/kskgfn-49/obj148 2023-12-15T23:26:14.835 DEBUG:boto:auth_path=/kskgfn-49/obj148 2023-12-15T23:26:14.835 DEBUG:boto:Method: GET 2023-12-15T23:26:14.835 DEBUG:boto:Path: /kskgfn-49/obj148 2023-12-15T23:26:14.835 DEBUG:boto:Data: 2023-12-15T23:26:14.836 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.836 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.836 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.836 DEBUG:boto:Params: {} 2023-12-15T23:26:14.836 DEBUG:boto:Token: None 2023-12-15T23:26:14.836 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj148 2023-12-15T23:26:14.836 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:X1natcDIgV6igkV1M7kzVOV/R/8= 2023-12-15T23:26:14.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:X1natcDIgV6igkV1M7kzVOV/R/8=', 'Content-Length': '0'} 2023-12-15T23:26:14.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a90eab115fca2228-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.838 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.838 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.838 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.838 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.839 DEBUG:boto:Method: GET 2023-12-15T23:26:14.839 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.839 DEBUG:boto:Data: 2023-12-15T23:26:14.839 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.839 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.839 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.839 DEBUG:boto:Params: {} 2023-12-15T23:26:14.839 DEBUG:boto:Token: None 2023-12-15T23:26:14.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014120d6a8a15b685-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.842 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.842 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.842 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.843 DEBUG:boto:path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.843 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.843 DEBUG:boto:Method: GET 2023-12-15T23:26:14.843 DEBUG:boto:Path: /kskgfn-49/?prefix=obj148 2023-12-15T23:26:14.843 DEBUG:boto:Data: 2023-12-15T23:26:14.843 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.843 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.843 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.843 DEBUG:boto:Params: {} 2023-12-15T23:26:14.843 DEBUG:boto:Token: None 2023-12-15T23:26:14.844 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.847 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f65574a9ef6a85f3-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.889 DEBUG:boto:b'kskgfn-49obj1481000falseobj1482023-12-15T23:24:40.044Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:26:14.890 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.890 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.890 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.890 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.890 DEBUG:boto:Method: GET 2023-12-15T23:26:14.890 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.890 DEBUG:boto:Data: 2023-12-15T23:26:14.891 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.891 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.891 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.891 DEBUG:boto:Params: {} 2023-12-15T23:26:14.891 DEBUG:boto:Token: None 2023-12-15T23:26:14.891 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU= 2023-12-15T23:26:14.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU=', 'Content-Length': '0'} 2023-12-15T23:26:14.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d4b3bce775b5b7b-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.894 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.894 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.894 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.894 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.894 DEBUG:boto:Method: GET 2023-12-15T23:26:14.895 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.895 DEBUG:boto:Data: 2023-12-15T23:26:14.895 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.895 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.895 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.895 DEBUG:boto:Params: {} 2023-12-15T23:26:14.895 DEBUG:boto:Token: None 2023-12-15T23:26:14.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU= 2023-12-15T23:26:14.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU=', 'Content-Length': '0'} 2023-12-15T23:26:14.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aca974479f7ef176-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.898 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.898 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.898 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.898 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.898 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.898 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.899 DEBUG:boto:Data: 2023-12-15T23:26:14.899 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.899 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.899 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.899 DEBUG:boto:Params: {} 2023-12-15T23:26:14.899 DEBUG:boto:Token: None 2023-12-15T23:26:14.899 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9qhvFt+PxMwBjsq0paVCJ6GpmdY= 2023-12-15T23:26:14.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9qhvFt+PxMwBjsq0paVCJ6GpmdY=', 'Content-Length': '0'} 2023-12-15T23:26:14.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf7297509a91540b-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.902 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.902 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.902 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.902 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.902 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.902 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.902 DEBUG:boto:Data: 2023-12-15T23:26:14.902 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.902 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.903 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.903 DEBUG:boto:Params: {} 2023-12-15T23:26:14.903 DEBUG:boto:Token: None 2023-12-15T23:26:14.903 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9qhvFt+PxMwBjsq0paVCJ6GpmdY= 2023-12-15T23:26:14.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9qhvFt+PxMwBjsq0paVCJ6GpmdY=', 'Content-Length': '0'} 2023-12-15T23:26:14.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf68771f492a5f21-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:26:14.906 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.906 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.906 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.906 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.906 DEBUG:boto:Method: GET 2023-12-15T23:26:14.906 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.906 DEBUG:boto:Data: 2023-12-15T23:26:14.906 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.906 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.907 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.907 DEBUG:boto:Params: {} 2023-12-15T23:26:14.907 DEBUG:boto:Token: None 2023-12-15T23:26:14.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU= 2023-12-15T23:26:14.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU=', 'Content-Length': '0'} 2023-12-15T23:26:14.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f24af4fe652575f-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.910 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.910 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.910 DEBUG:boto:path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.910 DEBUG:boto:auth_path=/kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.910 DEBUG:boto:Method: GET 2023-12-15T23:26:14.910 DEBUG:boto:Path: /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.910 DEBUG:boto:Data: 2023-12-15T23:26:14.910 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.910 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.911 DEBUG:boto:Params: {} 2023-12-15T23:26:14.911 DEBUG:boto:Token: None 2023-12-15T23:26:14.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155?versionId=null 2023-12-15T23:26:14.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU= 2023-12-15T23:26:14.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qRc2usWDE+M8EHe/m+zZfYXCPQU=', 'Content-Length': '0'} 2023-12-15T23:26:14.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e770f0b6b1d6b7c9-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.913 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.913 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.913 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.913 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.914 DEBUG:boto:Method: GET 2023-12-15T23:26:14.914 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.914 DEBUG:boto:Data: 2023-12-15T23:26:14.914 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.914 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.914 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.914 DEBUG:boto:Params: {} 2023-12-15T23:26:14.914 DEBUG:boto:Token: None 2023-12-15T23:26:14.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d9c8d578b95f7ff-00657ce096-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.957 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.958 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:14.958 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:14.958 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.958 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.958 DEBUG:boto:Method: GET 2023-12-15T23:26:14.958 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:26:14.958 DEBUG:boto:Data: 2023-12-15T23:26:14.958 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.958 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.959 DEBUG:boto:Params: {} 2023-12-15T23:26:14.959 DEBUG:boto:Token: None 2023-12-15T23:26:14.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/ 2023-12-15T23:26:14.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4= 2023-12-15T23:26:14.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lG88BXSZeS7+E5sCeNEss/E5Hf4=', 'Content-Length': '0'} 2023-12-15T23:26:14.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024af9246729b04ce-00657ce096-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.963 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:14.963 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.963 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.963 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.963 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:26:14.964 DEBUG:boto:Data: 2023-12-15T23:26:14.964 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.964 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.964 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.964 DEBUG:boto:Params: {} 2023-12-15T23:26:14.964 DEBUG:boto:Token: None 2023-12-15T23:26:14.964 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155 2023-12-15T23:26:14.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I1nIWwcSnF5qsJotc0iy+LBM6X8= 2023-12-15T23:26:14.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I1nIWwcSnF5qsJotc0iy+LBM6X8=', 'Content-Length': '0'} 2023-12-15T23:26:14.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afa0217ab56e1e3e-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.967 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.967 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.967 DEBUG:boto:Method: HEAD 2023-12-15T23:26:14.967 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:26:14.967 DEBUG:boto:Data: 2023-12-15T23:26:14.967 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.967 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.967 DEBUG:boto:Params: {} 2023-12-15T23:26:14.968 DEBUG:boto:Token: None 2023-12-15T23:26:14.968 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155 2023-12-15T23:26:14.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I1nIWwcSnF5qsJotc0iy+LBM6X8= 2023-12-15T23:26:14.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I1nIWwcSnF5qsJotc0iy+LBM6X8=', 'Content-Length': '0'} 2023-12-15T23:26:14.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fadb3656302fcbf4-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:26:14.970 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.970 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.970 DEBUG:boto:Method: GET 2023-12-15T23:26:14.970 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:26:14.971 DEBUG:boto:Data: 2023-12-15T23:26:14.971 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:14.971 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.971 DEBUG:boto:Params: {} 2023-12-15T23:26:14.971 DEBUG:boto:Token: None 2023-12-15T23:26:14.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155 2023-12-15T23:26:14.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k/7ntsOhCZNz8F9OvcnUyXKva3c= 2023-12-15T23:26:14.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k/7ntsOhCZNz8F9OvcnUyXKva3c=', 'Content-Length': '0'} 2023-12-15T23:26:14.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db6ff7fc3a475610-00657ce096-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:14.974 DEBUG:boto:path=/kskgfn-49/obj155 2023-12-15T23:26:14.974 DEBUG:boto:auth_path=/kskgfn-49/obj155 2023-12-15T23:26:14.974 DEBUG:boto:Method: GET 2023-12-15T23:26:14.974 DEBUG:boto:Path: /kskgfn-49/obj155 2023-12-15T23:26:14.974 DEBUG:boto:Data: 2023-12-15T23:26:14.974 DEBUG:boto:Headers: {} 2023-12-15T23:26:14.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:14.975 DEBUG:boto:Port: 8000 2023-12-15T23:26:14.975 DEBUG:boto:Params: {} 2023-12-15T23:26:14.975 DEBUG:boto:Token: None 2023-12-15T23:26:14.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:14 GMT /kskgfn-49/obj155 2023-12-15T23:26:14.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k/7ntsOhCZNz8F9OvcnUyXKva3c= 2023-12-15T23:26:14.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k/7ntsOhCZNz8F9OvcnUyXKva3c=', 'Content-Length': '0'} 2023-12-15T23:26:14.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2f2ced97a0bdc1d-00657ce096-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.017 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.018 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.018 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.018 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.018 DEBUG:boto:Method: GET 2023-12-15T23:26:15.018 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.018 DEBUG:boto:Data: 2023-12-15T23:26:15.018 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.018 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.018 DEBUG:boto:Params: {} 2023-12-15T23:26:15.019 DEBUG:boto:Token: None 2023-12-15T23:26:15.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.021 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007da0646d63c2d94-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.021 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.022 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.022 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.022 DEBUG:boto:path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.022 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.022 DEBUG:boto:Method: GET 2023-12-15T23:26:15.022 DEBUG:boto:Path: /kskgfn-49/?prefix=obj155 2023-12-15T23:26:15.022 DEBUG:boto:Data: 2023-12-15T23:26:15.022 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.023 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.023 DEBUG:boto:Params: {} 2023-12-15T23:26:15.023 DEBUG:boto:Token: None 2023-12-15T23:26:15.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c9f78b260dea74b-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.026 DEBUG:boto:b'kskgfn-49obj1551000falseobj1552023-12-15T23:22:24.700Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.027 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:26:15.027 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.027 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.027 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.027 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.027 DEBUG:boto:Method: GET 2023-12-15T23:26:15.027 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.027 DEBUG:boto:Data: 2023-12-15T23:26:15.027 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.028 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.028 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.028 DEBUG:boto:Params: {} 2023-12-15T23:26:15.028 DEBUG:boto:Token: None 2023-12-15T23:26:15.028 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.028 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk= 2023-12-15T23:26:15.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk=', 'Content-Length': '0'} 2023-12-15T23:26:15.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dc8f3b050cb18e7-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.031 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.031 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.031 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.031 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.031 DEBUG:boto:Method: GET 2023-12-15T23:26:15.031 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.031 DEBUG:boto:Data: 2023-12-15T23:26:15.031 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.031 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.031 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.031 DEBUG:boto:Params: {} 2023-12-15T23:26:15.032 DEBUG:boto:Token: None 2023-12-15T23:26:15.032 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.032 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk= 2023-12-15T23:26:15.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk=', 'Content-Length': '0'} 2023-12-15T23:26:15.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000607e57268b1f8fd9-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.034 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.034 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.034 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.035 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.035 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.035 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.035 DEBUG:boto:Data: 2023-12-15T23:26:15.035 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.035 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.035 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.035 DEBUG:boto:Params: {} 2023-12-15T23:26:15.035 DEBUG:boto:Token: None 2023-12-15T23:26:15.035 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.036 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XLbOVD7ynbgaswAEcox0Z+sIngc= 2023-12-15T23:26:15.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XLbOVD7ynbgaswAEcox0Z+sIngc=', 'Content-Length': '0'} 2023-12-15T23:26:15.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce732f001e5bfa40-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.038 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.038 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.038 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.038 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.038 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.038 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.038 DEBUG:boto:Data: 2023-12-15T23:26:15.038 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.038 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.038 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.039 DEBUG:boto:Params: {} 2023-12-15T23:26:15.039 DEBUG:boto:Token: None 2023-12-15T23:26:15.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XLbOVD7ynbgaswAEcox0Z+sIngc= 2023-12-15T23:26:15.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XLbOVD7ynbgaswAEcox0Z+sIngc=', 'Content-Length': '0'} 2023-12-15T23:26:15.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059bce8699b8acf49-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:26:15.041 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.041 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.041 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.041 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.041 DEBUG:boto:Method: GET 2023-12-15T23:26:15.041 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.042 DEBUG:boto:Data: 2023-12-15T23:26:15.042 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.042 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.042 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.042 DEBUG:boto:Params: {} 2023-12-15T23:26:15.042 DEBUG:boto:Token: None 2023-12-15T23:26:15.042 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.042 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk= 2023-12-15T23:26:15.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk=', 'Content-Length': '0'} 2023-12-15T23:26:15.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004be8f5a8270d4f05-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.086 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.086 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.086 DEBUG:boto:path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.086 DEBUG:boto:auth_path=/kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.086 DEBUG:boto:Method: GET 2023-12-15T23:26:15.086 DEBUG:boto:Path: /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.087 DEBUG:boto:Data: 2023-12-15T23:26:15.087 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.087 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.087 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.087 DEBUG:boto:Params: {} 2023-12-15T23:26:15.087 DEBUG:boto:Token: None 2023-12-15T23:26:15.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17?versionId=null 2023-12-15T23:26:15.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk= 2023-12-15T23:26:15.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7h1JBajCRVlzJbL/HWNspgyGRsk=', 'Content-Length': '0'} 2023-12-15T23:26:15.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086eaaefb97639d21-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.089 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.090 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.090 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.090 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.090 DEBUG:boto:Method: GET 2023-12-15T23:26:15.090 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.090 DEBUG:boto:Data: 2023-12-15T23:26:15.090 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.090 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.090 DEBUG:boto:Params: {} 2023-12-15T23:26:15.091 DEBUG:boto:Token: None 2023-12-15T23:26:15.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.093 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2ba4e8b800edb57-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.094 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.094 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.094 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.094 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.094 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.094 DEBUG:boto:Method: GET 2023-12-15T23:26:15.094 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.094 DEBUG:boto:Data: 2023-12-15T23:26:15.095 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.095 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.095 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.095 DEBUG:boto:Params: {} 2023-12-15T23:26:15.095 DEBUG:boto:Token: None 2023-12-15T23:26:15.095 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.099 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001eb838b7a646ee59-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.099 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.099 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.099 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.100 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.100 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:26:15.100 DEBUG:boto:Data: 2023-12-15T23:26:15.100 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.100 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.100 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.100 DEBUG:boto:Params: {} 2023-12-15T23:26:15.100 DEBUG:boto:Token: None 2023-12-15T23:26:15.100 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17 2023-12-15T23:26:15.100 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fQ4uvyviRV9beeAMQGZO1rK3tw4= 2023-12-15T23:26:15.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fQ4uvyviRV9beeAMQGZO1rK3tw4=', 'Content-Length': '0'} 2023-12-15T23:26:15.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000410751ba8af158b5-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.102 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.103 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.103 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.103 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:26:15.103 DEBUG:boto:Data: 2023-12-15T23:26:15.103 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.103 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.103 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.103 DEBUG:boto:Params: {} 2023-12-15T23:26:15.103 DEBUG:boto:Token: None 2023-12-15T23:26:15.103 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17 2023-12-15T23:26:15.104 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fQ4uvyviRV9beeAMQGZO1rK3tw4= 2023-12-15T23:26:15.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fQ4uvyviRV9beeAMQGZO1rK3tw4=', 'Content-Length': '0'} 2023-12-15T23:26:15.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f0be53c8fbfe2b9-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:26:15.106 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.106 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.106 DEBUG:boto:Method: GET 2023-12-15T23:26:15.106 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:26:15.106 DEBUG:boto:Data: 2023-12-15T23:26:15.106 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.106 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.106 DEBUG:boto:Params: {} 2023-12-15T23:26:15.106 DEBUG:boto:Token: None 2023-12-15T23:26:15.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17 2023-12-15T23:26:15.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1puDfknfIuBUt1f7yk4AmBFjFOs= 2023-12-15T23:26:15.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1puDfknfIuBUt1f7yk4AmBFjFOs=', 'Content-Length': '0'} 2023-12-15T23:26:15.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efc31c77a5fb291c-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.149 DEBUG:boto:path=/kskgfn-49/obj17 2023-12-15T23:26:15.150 DEBUG:boto:auth_path=/kskgfn-49/obj17 2023-12-15T23:26:15.150 DEBUG:boto:Method: GET 2023-12-15T23:26:15.150 DEBUG:boto:Path: /kskgfn-49/obj17 2023-12-15T23:26:15.150 DEBUG:boto:Data: 2023-12-15T23:26:15.150 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.150 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.150 DEBUG:boto:Params: {} 2023-12-15T23:26:15.150 DEBUG:boto:Token: None 2023-12-15T23:26:15.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj17 2023-12-15T23:26:15.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1puDfknfIuBUt1f7yk4AmBFjFOs= 2023-12-15T23:26:15.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1puDfknfIuBUt1f7yk4AmBFjFOs=', 'Content-Length': '0'} 2023-12-15T23:26:15.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edbdda2edf8ae495-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.153 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.153 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.153 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.153 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.153 DEBUG:boto:Method: GET 2023-12-15T23:26:15.153 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.153 DEBUG:boto:Data: 2023-12-15T23:26:15.153 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.154 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.154 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.154 DEBUG:boto:Params: {} 2023-12-15T23:26:15.154 DEBUG:boto:Token: None 2023-12-15T23:26:15.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007946a5b535398b9b-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.157 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.157 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.157 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.157 DEBUG:boto:path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.157 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.158 DEBUG:boto:Method: GET 2023-12-15T23:26:15.158 DEBUG:boto:Path: /kskgfn-49/?prefix=obj17 2023-12-15T23:26:15.158 DEBUG:boto:Data: 2023-12-15T23:26:15.158 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.158 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.158 DEBUG:boto:Params: {} 2023-12-15T23:26:15.158 DEBUG:boto:Token: None 2023-12-15T23:26:15.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073dffb081c356769-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.162 DEBUG:boto:b'kskgfn-49obj171000falseobj172023-12-15T23:16:19.969Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.162 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:26:15.163 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.163 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.163 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.163 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.163 DEBUG:boto:Method: GET 2023-12-15T23:26:15.163 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.163 DEBUG:boto:Data: 2023-12-15T23:26:15.163 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.163 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.163 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.164 DEBUG:boto:Params: {} 2023-12-15T23:26:15.164 DEBUG:boto:Token: None 2023-12-15T23:26:15.164 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.164 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0= 2023-12-15T23:26:15.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0=', 'Content-Length': '0'} 2023-12-15T23:26:15.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002914bb40fbd11139-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.166 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.166 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.167 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.167 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.167 DEBUG:boto:Method: GET 2023-12-15T23:26:15.167 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.167 DEBUG:boto:Data: 2023-12-15T23:26:15.167 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.167 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.167 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.167 DEBUG:boto:Params: {} 2023-12-15T23:26:15.167 DEBUG:boto:Token: None 2023-12-15T23:26:15.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.168 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0= 2023-12-15T23:26:15.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0=', 'Content-Length': '0'} 2023-12-15T23:26:15.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e620f50462eb9d57-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.170 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.171 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.171 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.171 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.171 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.171 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.171 DEBUG:boto:Data: 2023-12-15T23:26:15.171 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.171 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.171 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.171 DEBUG:boto:Params: {} 2023-12-15T23:26:15.171 DEBUG:boto:Token: None 2023-12-15T23:26:15.172 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.172 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6FMQWBXYq+pyJ+bcpCTLkkyU9Ek= 2023-12-15T23:26:15.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6FMQWBXYq+pyJ+bcpCTLkkyU9Ek=', 'Content-Length': '0'} 2023-12-15T23:26:15.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001436fae7fa499572-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.174 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.174 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.175 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.175 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.175 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.175 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.175 DEBUG:boto:Data: 2023-12-15T23:26:15.175 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.175 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.175 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.175 DEBUG:boto:Params: {} 2023-12-15T23:26:15.175 DEBUG:boto:Token: None 2023-12-15T23:26:15.176 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.176 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6FMQWBXYq+pyJ+bcpCTLkkyU9Ek= 2023-12-15T23:26:15.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6FMQWBXYq+pyJ+bcpCTLkkyU9Ek=', 'Content-Length': '0'} 2023-12-15T23:26:15.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007576139b602bfe2d-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:26:15.178 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.178 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.178 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.179 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.179 DEBUG:boto:Method: GET 2023-12-15T23:26:15.179 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.179 DEBUG:boto:Data: 2023-12-15T23:26:15.179 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.179 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.179 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.179 DEBUG:boto:Params: {} 2023-12-15T23:26:15.179 DEBUG:boto:Token: None 2023-12-15T23:26:15.179 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0= 2023-12-15T23:26:15.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0=', 'Content-Length': '0'} 2023-12-15T23:26:15.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039baf9f45df51cb0-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.226 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.226 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.226 DEBUG:boto:path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.226 DEBUG:boto:auth_path=/kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.226 DEBUG:boto:Method: GET 2023-12-15T23:26:15.226 DEBUG:boto:Path: /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.226 DEBUG:boto:Data: 2023-12-15T23:26:15.226 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.227 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.227 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.227 DEBUG:boto:Params: {} 2023-12-15T23:26:15.227 DEBUG:boto:Token: None 2023-12-15T23:26:15.227 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185?versionId=null 2023-12-15T23:26:15.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0= 2023-12-15T23:26:15.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T/vGCnvF+9m3YSM6ij5q3sMGaT0=', 'Content-Length': '0'} 2023-12-15T23:26:15.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff2b2060540c9544-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.230 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.230 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.230 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.230 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.230 DEBUG:boto:Method: GET 2023-12-15T23:26:15.230 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.230 DEBUG:boto:Data: 2023-12-15T23:26:15.230 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.230 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.230 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.231 DEBUG:boto:Params: {} 2023-12-15T23:26:15.231 DEBUG:boto:Token: None 2023-12-15T23:26:15.231 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cabb82b18e17fc3f-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.233 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.234 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.234 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.234 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.234 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.234 DEBUG:boto:Method: GET 2023-12-15T23:26:15.234 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.234 DEBUG:boto:Data: 2023-12-15T23:26:15.234 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.234 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.235 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.235 DEBUG:boto:Params: {} 2023-12-15T23:26:15.235 DEBUG:boto:Token: None 2023-12-15T23:26:15.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000079ef131895e5646-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.239 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.239 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.239 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.240 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.240 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:26:15.240 DEBUG:boto:Data: 2023-12-15T23:26:15.240 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.240 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.240 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.240 DEBUG:boto:Params: {} 2023-12-15T23:26:15.240 DEBUG:boto:Token: None 2023-12-15T23:26:15.240 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185 2023-12-15T23:26:15.240 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9mNUvO4B1roNR+XPGXl0ECZmWAI= 2023-12-15T23:26:15.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9mNUvO4B1roNR+XPGXl0ECZmWAI=', 'Content-Length': '0'} 2023-12-15T23:26:15.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab9de18f66125f34-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.242 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.243 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.243 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.243 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:26:15.243 DEBUG:boto:Data: 2023-12-15T23:26:15.243 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.243 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.243 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.243 DEBUG:boto:Params: {} 2023-12-15T23:26:15.243 DEBUG:boto:Token: None 2023-12-15T23:26:15.243 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185 2023-12-15T23:26:15.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9mNUvO4B1roNR+XPGXl0ECZmWAI= 2023-12-15T23:26:15.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9mNUvO4B1roNR+XPGXl0ECZmWAI=', 'Content-Length': '0'} 2023-12-15T23:26:15.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c001e07c7683bb0-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:26:15.246 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.247 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.247 DEBUG:boto:Method: GET 2023-12-15T23:26:15.247 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:26:15.247 DEBUG:boto:Data: 2023-12-15T23:26:15.247 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.247 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.247 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.247 DEBUG:boto:Params: {} 2023-12-15T23:26:15.247 DEBUG:boto:Token: None 2023-12-15T23:26:15.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185 2023-12-15T23:26:15.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SS4GCJ6IEwVVwX3bkcu2m+YPjc0= 2023-12-15T23:26:15.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SS4GCJ6IEwVVwX3bkcu2m+YPjc0=', 'Content-Length': '0'} 2023-12-15T23:26:15.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039acc0609261bbd9-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.250 DEBUG:boto:path=/kskgfn-49/obj185 2023-12-15T23:26:15.250 DEBUG:boto:auth_path=/kskgfn-49/obj185 2023-12-15T23:26:15.250 DEBUG:boto:Method: GET 2023-12-15T23:26:15.250 DEBUG:boto:Path: /kskgfn-49/obj185 2023-12-15T23:26:15.250 DEBUG:boto:Data: 2023-12-15T23:26:15.250 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.251 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.251 DEBUG:boto:Params: {} 2023-12-15T23:26:15.251 DEBUG:boto:Token: None 2023-12-15T23:26:15.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj185 2023-12-15T23:26:15.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SS4GCJ6IEwVVwX3bkcu2m+YPjc0= 2023-12-15T23:26:15.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SS4GCJ6IEwVVwX3bkcu2m+YPjc0=', 'Content-Length': '0'} 2023-12-15T23:26:15.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000975c07c3d895f174-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.294 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.294 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.294 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.294 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.294 DEBUG:boto:Method: GET 2023-12-15T23:26:15.294 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.294 DEBUG:boto:Data: 2023-12-15T23:26:15.294 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.294 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.294 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.294 DEBUG:boto:Params: {} 2023-12-15T23:26:15.295 DEBUG:boto:Token: None 2023-12-15T23:26:15.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e142575e0ff8ccb-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.298 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.298 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.298 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.299 DEBUG:boto:path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.299 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.299 DEBUG:boto:Method: GET 2023-12-15T23:26:15.299 DEBUG:boto:Path: /kskgfn-49/?prefix=obj185 2023-12-15T23:26:15.299 DEBUG:boto:Data: 2023-12-15T23:26:15.299 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.299 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.299 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.299 DEBUG:boto:Params: {} 2023-12-15T23:26:15.299 DEBUG:boto:Token: None 2023-12-15T23:26:15.299 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.300 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.303 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091c0ba3741029b97-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.303 DEBUG:boto:b'kskgfn-49obj1851000falseobj1852023-12-15T23:24:40.054Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:26:15.304 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.304 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.304 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.304 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.304 DEBUG:boto:Method: GET 2023-12-15T23:26:15.304 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.304 DEBUG:boto:Data: 2023-12-15T23:26:15.304 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.305 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.305 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.305 DEBUG:boto:Params: {} 2023-12-15T23:26:15.305 DEBUG:boto:Token: None 2023-12-15T23:26:15.305 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI= 2023-12-15T23:26:15.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI=', 'Content-Length': '0'} 2023-12-15T23:26:15.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bf4275544b4e002-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.349 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.350 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.350 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.350 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.350 DEBUG:boto:Method: GET 2023-12-15T23:26:15.350 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.350 DEBUG:boto:Data: 2023-12-15T23:26:15.350 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.350 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.350 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.350 DEBUG:boto:Params: {} 2023-12-15T23:26:15.351 DEBUG:boto:Token: None 2023-12-15T23:26:15.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI= 2023-12-15T23:26:15.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI=', 'Content-Length': '0'} 2023-12-15T23:26:15.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000992732ecd4666825-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.353 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.354 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.354 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.354 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.354 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.354 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.354 DEBUG:boto:Data: 2023-12-15T23:26:15.354 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.354 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.354 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.354 DEBUG:boto:Params: {} 2023-12-15T23:26:15.354 DEBUG:boto:Token: None 2023-12-15T23:26:15.355 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YYkYowYp/GUwoHLshhdA99SeJTA= 2023-12-15T23:26:15.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YYkYowYp/GUwoHLshhdA99SeJTA=', 'Content-Length': '0'} 2023-12-15T23:26:15.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be1e068c520a9a50-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.357 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.357 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.357 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.358 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.358 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.358 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.358 DEBUG:boto:Data: 2023-12-15T23:26:15.358 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.358 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.358 DEBUG:boto:Params: {} 2023-12-15T23:26:15.358 DEBUG:boto:Token: None 2023-12-15T23:26:15.358 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YYkYowYp/GUwoHLshhdA99SeJTA= 2023-12-15T23:26:15.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YYkYowYp/GUwoHLshhdA99SeJTA=', 'Content-Length': '0'} 2023-12-15T23:26:15.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f89c7b97707e1170-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:26:15.361 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.361 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.361 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.361 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.361 DEBUG:boto:Method: GET 2023-12-15T23:26:15.361 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.361 DEBUG:boto:Data: 2023-12-15T23:26:15.361 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.362 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.362 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.362 DEBUG:boto:Params: {} 2023-12-15T23:26:15.362 DEBUG:boto:Token: None 2023-12-15T23:26:15.362 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI= 2023-12-15T23:26:15.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI=', 'Content-Length': '0'} 2023-12-15T23:26:15.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc31a6c90eb68373-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.365 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.365 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.365 DEBUG:boto:path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.365 DEBUG:boto:auth_path=/kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.365 DEBUG:boto:Method: GET 2023-12-15T23:26:15.365 DEBUG:boto:Path: /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.365 DEBUG:boto:Data: 2023-12-15T23:26:15.365 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.365 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.365 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.366 DEBUG:boto:Params: {} 2023-12-15T23:26:15.366 DEBUG:boto:Token: None 2023-12-15T23:26:15.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19?versionId=null 2023-12-15T23:26:15.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI= 2023-12-15T23:26:15.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ILWZLccR+thCW1w9ChWN1fzfeGI=', 'Content-Length': '0'} 2023-12-15T23:26:15.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5e7502c52e76eac-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.368 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.368 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.368 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.368 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.369 DEBUG:boto:Method: GET 2023-12-15T23:26:15.369 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.369 DEBUG:boto:Data: 2023-12-15T23:26:15.369 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.369 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.369 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.369 DEBUG:boto:Params: {} 2023-12-15T23:26:15.369 DEBUG:boto:Token: None 2023-12-15T23:26:15.369 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.370 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bede7a0c84c6bfbb-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.372 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.372 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.373 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.373 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.373 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.373 DEBUG:boto:Method: GET 2023-12-15T23:26:15.373 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.373 DEBUG:boto:Data: 2023-12-15T23:26:15.373 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.373 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.373 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.373 DEBUG:boto:Params: {} 2023-12-15T23:26:15.374 DEBUG:boto:Token: None 2023-12-15T23:26:15.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3f68de34fe3861c-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.377 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.378 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.378 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.378 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.378 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:26:15.378 DEBUG:boto:Data: 2023-12-15T23:26:15.378 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.378 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.379 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.379 DEBUG:boto:Params: {} 2023-12-15T23:26:15.379 DEBUG:boto:Token: None 2023-12-15T23:26:15.379 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19 2023-12-15T23:26:15.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UtfJdx5ycD/tRvLwgTy1NottCnQ= 2023-12-15T23:26:15.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UtfJdx5ycD/tRvLwgTy1NottCnQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d27066ff5935ecb3-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.381 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.381 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.381 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.381 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:26:15.382 DEBUG:boto:Data: 2023-12-15T23:26:15.382 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.382 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.382 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.382 DEBUG:boto:Params: {} 2023-12-15T23:26:15.382 DEBUG:boto:Token: None 2023-12-15T23:26:15.382 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19 2023-12-15T23:26:15.382 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UtfJdx5ycD/tRvLwgTy1NottCnQ= 2023-12-15T23:26:15.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UtfJdx5ycD/tRvLwgTy1NottCnQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049e564343e96e56c-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:26:15.385 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.385 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.385 DEBUG:boto:Method: GET 2023-12-15T23:26:15.385 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:26:15.385 DEBUG:boto:Data: 2023-12-15T23:26:15.385 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.385 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.385 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.385 DEBUG:boto:Params: {} 2023-12-15T23:26:15.386 DEBUG:boto:Token: None 2023-12-15T23:26:15.386 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19 2023-12-15T23:26:15.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j9HxUimYu71QTvxi1k5oiHwhygM= 2023-12-15T23:26:15.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j9HxUimYu71QTvxi1k5oiHwhygM=', 'Content-Length': '0'} 2023-12-15T23:26:15.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a344903947bab1a-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.388 DEBUG:boto:path=/kskgfn-49/obj19 2023-12-15T23:26:15.388 DEBUG:boto:auth_path=/kskgfn-49/obj19 2023-12-15T23:26:15.389 DEBUG:boto:Method: GET 2023-12-15T23:26:15.389 DEBUG:boto:Path: /kskgfn-49/obj19 2023-12-15T23:26:15.389 DEBUG:boto:Data: 2023-12-15T23:26:15.389 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.389 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.389 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.389 DEBUG:boto:Params: {} 2023-12-15T23:26:15.389 DEBUG:boto:Token: None 2023-12-15T23:26:15.389 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj19 2023-12-15T23:26:15.390 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j9HxUimYu71QTvxi1k5oiHwhygM= 2023-12-15T23:26:15.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j9HxUimYu71QTvxi1k5oiHwhygM=', 'Content-Length': '0'} 2023-12-15T23:26:15.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea6866a3aeb71856-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.392 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.392 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.392 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.392 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.393 DEBUG:boto:Method: GET 2023-12-15T23:26:15.393 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.393 DEBUG:boto:Data: 2023-12-15T23:26:15.393 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.393 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.393 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.393 DEBUG:boto:Params: {} 2023-12-15T23:26:15.393 DEBUG:boto:Token: None 2023-12-15T23:26:15.393 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.393 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.396 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0f72211fde1c180-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.396 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.396 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.396 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.397 DEBUG:boto:path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.397 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.397 DEBUG:boto:Method: GET 2023-12-15T23:26:15.397 DEBUG:boto:Path: /kskgfn-49/?prefix=obj19 2023-12-15T23:26:15.397 DEBUG:boto:Data: 2023-12-15T23:26:15.397 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.397 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.397 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.397 DEBUG:boto:Params: {} 2023-12-15T23:26:15.397 DEBUG:boto:Token: None 2023-12-15T23:26:15.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e8cc721be9804c1-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.401 DEBUG:boto:b'kskgfn-49obj191000falseobj192023-12-15T23:17:37.338Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:26:15.402 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.402 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.402 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.402 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.402 DEBUG:boto:Method: GET 2023-12-15T23:26:15.402 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.402 DEBUG:boto:Data: 2023-12-15T23:26:15.402 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.403 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.403 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.403 DEBUG:boto:Params: {} 2023-12-15T23:26:15.403 DEBUG:boto:Token: None 2023-12-15T23:26:15.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE= 2023-12-15T23:26:15.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE=', 'Content-Length': '0'} 2023-12-15T23:26:15.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047e58a42be1b4f10-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.405 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.406 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.406 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.406 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.406 DEBUG:boto:Method: GET 2023-12-15T23:26:15.406 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.406 DEBUG:boto:Data: 2023-12-15T23:26:15.406 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.406 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.406 DEBUG:boto:Params: {} 2023-12-15T23:26:15.407 DEBUG:boto:Token: None 2023-12-15T23:26:15.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE= 2023-12-15T23:26:15.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE=', 'Content-Length': '0'} 2023-12-15T23:26:15.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000491964209f94e478-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.409 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.409 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.409 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.409 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.409 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.409 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.409 DEBUG:boto:Data: 2023-12-15T23:26:15.410 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.410 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.410 DEBUG:boto:Params: {} 2023-12-15T23:26:15.410 DEBUG:boto:Token: None 2023-12-15T23:26:15.410 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzMDdkNHm+rKuGGYW6IH9hi26vE= 2023-12-15T23:26:15.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzMDdkNHm+rKuGGYW6IH9hi26vE=', 'Content-Length': '0'} 2023-12-15T23:26:15.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c46b081f0c1b8fec-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.412 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.412 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.412 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.412 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.413 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.413 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.413 DEBUG:boto:Data: 2023-12-15T23:26:15.413 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.413 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.413 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.413 DEBUG:boto:Params: {} 2023-12-15T23:26:15.413 DEBUG:boto:Token: None 2023-12-15T23:26:15.413 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzMDdkNHm+rKuGGYW6IH9hi26vE= 2023-12-15T23:26:15.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzMDdkNHm+rKuGGYW6IH9hi26vE=', 'Content-Length': '0'} 2023-12-15T23:26:15.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc1988a870538eee-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:26:15.415 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.416 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.416 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.416 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.416 DEBUG:boto:Method: GET 2023-12-15T23:26:15.416 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.416 DEBUG:boto:Data: 2023-12-15T23:26:15.416 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.416 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.416 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.416 DEBUG:boto:Params: {} 2023-12-15T23:26:15.416 DEBUG:boto:Token: None 2023-12-15T23:26:15.417 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE= 2023-12-15T23:26:15.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE=', 'Content-Length': '0'} 2023-12-15T23:26:15.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b525588c7939b57-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.419 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.419 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.419 DEBUG:boto:path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.419 DEBUG:boto:auth_path=/kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.419 DEBUG:boto:Method: GET 2023-12-15T23:26:15.419 DEBUG:boto:Path: /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.420 DEBUG:boto:Data: 2023-12-15T23:26:15.420 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.420 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.420 DEBUG:boto:Params: {} 2023-12-15T23:26:15.420 DEBUG:boto:Token: None 2023-12-15T23:26:15.420 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22?versionId=null 2023-12-15T23:26:15.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE= 2023-12-15T23:26:15.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YDgAVP+nR5c8mXiwzC/mJ0sPyxE=', 'Content-Length': '0'} 2023-12-15T23:26:15.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000838d114a36a22fde-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.422 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.422 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.422 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.422 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.423 DEBUG:boto:Method: GET 2023-12-15T23:26:15.423 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.423 DEBUG:boto:Data: 2023-12-15T23:26:15.423 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.423 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.423 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.423 DEBUG:boto:Params: {} 2023-12-15T23:26:15.423 DEBUG:boto:Token: None 2023-12-15T23:26:15.423 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8069c4293e30344-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.426 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.426 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.427 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.427 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.427 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.427 DEBUG:boto:Method: GET 2023-12-15T23:26:15.427 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.427 DEBUG:boto:Data: 2023-12-15T23:26:15.427 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.427 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.427 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.427 DEBUG:boto:Params: {} 2023-12-15T23:26:15.427 DEBUG:boto:Token: None 2023-12-15T23:26:15.428 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.428 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.431 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000504957433cdbdb50-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.473 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.474 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.474 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.474 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.474 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:26:15.474 DEBUG:boto:Data: 2023-12-15T23:26:15.474 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.474 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.474 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.474 DEBUG:boto:Params: {} 2023-12-15T23:26:15.475 DEBUG:boto:Token: None 2023-12-15T23:26:15.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22 2023-12-15T23:26:15.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xZs+v+5wcBIDPQ1rpFqvsmEPJ/c= 2023-12-15T23:26:15.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xZs+v+5wcBIDPQ1rpFqvsmEPJ/c=', 'Content-Length': '0'} 2023-12-15T23:26:15.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a70f4c971ea02132-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.477 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.477 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.477 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.477 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:26:15.477 DEBUG:boto:Data: 2023-12-15T23:26:15.477 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.477 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.477 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.478 DEBUG:boto:Params: {} 2023-12-15T23:26:15.478 DEBUG:boto:Token: None 2023-12-15T23:26:15.478 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22 2023-12-15T23:26:15.478 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xZs+v+5wcBIDPQ1rpFqvsmEPJ/c= 2023-12-15T23:26:15.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xZs+v+5wcBIDPQ1rpFqvsmEPJ/c=', 'Content-Length': '0'} 2023-12-15T23:26:15.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005813a196015dd84c-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:26:15.480 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.481 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.481 DEBUG:boto:Method: GET 2023-12-15T23:26:15.481 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:26:15.481 DEBUG:boto:Data: 2023-12-15T23:26:15.481 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.481 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.481 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.481 DEBUG:boto:Params: {} 2023-12-15T23:26:15.481 DEBUG:boto:Token: None 2023-12-15T23:26:15.482 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22 2023-12-15T23:26:15.482 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ApRiqwgk3Bg+JTXR5/MrvqDk4Ok= 2023-12-15T23:26:15.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ApRiqwgk3Bg+JTXR5/MrvqDk4Ok=', 'Content-Length': '0'} 2023-12-15T23:26:15.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052ea928300c8be83-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.484 DEBUG:boto:path=/kskgfn-49/obj22 2023-12-15T23:26:15.484 DEBUG:boto:auth_path=/kskgfn-49/obj22 2023-12-15T23:26:15.484 DEBUG:boto:Method: GET 2023-12-15T23:26:15.484 DEBUG:boto:Path: /kskgfn-49/obj22 2023-12-15T23:26:15.484 DEBUG:boto:Data: 2023-12-15T23:26:15.484 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.484 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.484 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.485 DEBUG:boto:Params: {} 2023-12-15T23:26:15.485 DEBUG:boto:Token: None 2023-12-15T23:26:15.485 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj22 2023-12-15T23:26:15.485 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ApRiqwgk3Bg+JTXR5/MrvqDk4Ok= 2023-12-15T23:26:15.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ApRiqwgk3Bg+JTXR5/MrvqDk4Ok=', 'Content-Length': '0'} 2023-12-15T23:26:15.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000485e48932a658451-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.487 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.487 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.487 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.488 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.488 DEBUG:boto:Method: GET 2023-12-15T23:26:15.488 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.488 DEBUG:boto:Data: 2023-12-15T23:26:15.488 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.488 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.488 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.488 DEBUG:boto:Params: {} 2023-12-15T23:26:15.488 DEBUG:boto:Token: None 2023-12-15T23:26:15.488 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.489 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.491 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b8ae59b89a655f1-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.491 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.491 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.492 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.492 DEBUG:boto:path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.492 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.492 DEBUG:boto:Method: GET 2023-12-15T23:26:15.492 DEBUG:boto:Path: /kskgfn-49/?prefix=obj22 2023-12-15T23:26:15.492 DEBUG:boto:Data: 2023-12-15T23:26:15.492 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.492 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.492 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.492 DEBUG:boto:Params: {} 2023-12-15T23:26:15.492 DEBUG:boto:Token: None 2023-12-15T23:26:15.493 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000011b45b946901542-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.497 DEBUG:boto:b'kskgfn-49obj221000falseobj222023-12-15T23:16:03.573Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:26:15.497 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.498 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.498 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.498 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.498 DEBUG:boto:Method: GET 2023-12-15T23:26:15.498 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.498 DEBUG:boto:Data: 2023-12-15T23:26:15.498 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.498 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.498 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.498 DEBUG:boto:Params: {} 2023-12-15T23:26:15.498 DEBUG:boto:Token: None 2023-12-15T23:26:15.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM= 2023-12-15T23:26:15.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM=', 'Content-Length': '0'} 2023-12-15T23:26:15.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acfece31e52def17-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.501 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.502 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.502 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.502 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.502 DEBUG:boto:Method: GET 2023-12-15T23:26:15.502 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.502 DEBUG:boto:Data: 2023-12-15T23:26:15.502 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.502 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.502 DEBUG:boto:Params: {} 2023-12-15T23:26:15.502 DEBUG:boto:Token: None 2023-12-15T23:26:15.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM= 2023-12-15T23:26:15.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM=', 'Content-Length': '0'} 2023-12-15T23:26:15.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f59d93f0a25b342-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.505 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.505 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.505 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.505 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.506 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.506 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.506 DEBUG:boto:Data: 2023-12-15T23:26:15.506 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.506 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.506 DEBUG:boto:Params: {} 2023-12-15T23:26:15.506 DEBUG:boto:Token: None 2023-12-15T23:26:15.506 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MUdLUQtQv0VNq0s/Ak9ZTwBHE/w= 2023-12-15T23:26:15.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MUdLUQtQv0VNq0s/Ak9ZTwBHE/w=', 'Content-Length': '0'} 2023-12-15T23:26:15.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fda6e9a4bbd2cf03-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.509 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.509 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.509 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.509 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.509 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.509 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.509 DEBUG:boto:Data: 2023-12-15T23:26:15.509 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.509 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.510 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.510 DEBUG:boto:Params: {} 2023-12-15T23:26:15.510 DEBUG:boto:Token: None 2023-12-15T23:26:15.510 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.510 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MUdLUQtQv0VNq0s/Ak9ZTwBHE/w= 2023-12-15T23:26:15.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MUdLUQtQv0VNq0s/Ak9ZTwBHE/w=', 'Content-Length': '0'} 2023-12-15T23:26:15.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8b70f6d71d23866-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:26:15.512 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.513 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.513 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.513 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.513 DEBUG:boto:Method: GET 2023-12-15T23:26:15.513 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.513 DEBUG:boto:Data: 2023-12-15T23:26:15.513 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.513 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.513 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.513 DEBUG:boto:Params: {} 2023-12-15T23:26:15.514 DEBUG:boto:Token: None 2023-12-15T23:26:15.514 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.514 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM= 2023-12-15T23:26:15.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM=', 'Content-Length': '0'} 2023-12-15T23:26:15.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000b8699993585542-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.516 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.516 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.516 DEBUG:boto:path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.516 DEBUG:boto:auth_path=/kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.516 DEBUG:boto:Method: GET 2023-12-15T23:26:15.516 DEBUG:boto:Path: /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.517 DEBUG:boto:Data: 2023-12-15T23:26:15.517 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.517 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.517 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.517 DEBUG:boto:Params: {} 2023-12-15T23:26:15.517 DEBUG:boto:Token: None 2023-12-15T23:26:15.517 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23?versionId=null 2023-12-15T23:26:15.517 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM= 2023-12-15T23:26:15.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQN/VzqEIm8nic6EXQjQyYlIIQM=', 'Content-Length': '0'} 2023-12-15T23:26:15.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084a68f70938e5ba0-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.519 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.520 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.520 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.520 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.520 DEBUG:boto:Method: GET 2023-12-15T23:26:15.520 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.520 DEBUG:boto:Data: 2023-12-15T23:26:15.520 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.520 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.520 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.520 DEBUG:boto:Params: {} 2023-12-15T23:26:15.520 DEBUG:boto:Token: None 2023-12-15T23:26:15.521 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.521 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.523 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002079b1c52925d68d-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.523 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.524 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.524 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.524 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.524 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.524 DEBUG:boto:Method: GET 2023-12-15T23:26:15.524 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.524 DEBUG:boto:Data: 2023-12-15T23:26:15.524 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.524 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.525 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.525 DEBUG:boto:Params: {} 2023-12-15T23:26:15.525 DEBUG:boto:Token: None 2023-12-15T23:26:15.525 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.525 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084557d5f7fe06f63-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.529 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.529 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.529 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.529 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.529 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:26:15.530 DEBUG:boto:Data: 2023-12-15T23:26:15.530 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.530 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.530 DEBUG:boto:Params: {} 2023-12-15T23:26:15.530 DEBUG:boto:Token: None 2023-12-15T23:26:15.530 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23 2023-12-15T23:26:15.530 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tKVDM2QX06WGwzQGXECrsoGFktk= 2023-12-15T23:26:15.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tKVDM2QX06WGwzQGXECrsoGFktk=', 'Content-Length': '0'} 2023-12-15T23:26:15.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc1290b3dd6cbe22-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.532 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.532 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.532 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.532 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:26:15.533 DEBUG:boto:Data: 2023-12-15T23:26:15.533 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.533 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.533 DEBUG:boto:Params: {} 2023-12-15T23:26:15.533 DEBUG:boto:Token: None 2023-12-15T23:26:15.533 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23 2023-12-15T23:26:15.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tKVDM2QX06WGwzQGXECrsoGFktk= 2023-12-15T23:26:15.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tKVDM2QX06WGwzQGXECrsoGFktk=', 'Content-Length': '0'} 2023-12-15T23:26:15.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000373a3d8f4456f5ed-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.535 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:26:15.535 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.535 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.536 DEBUG:boto:Method: GET 2023-12-15T23:26:15.536 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:26:15.536 DEBUG:boto:Data: 2023-12-15T23:26:15.536 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.536 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.536 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.536 DEBUG:boto:Params: {} 2023-12-15T23:26:15.536 DEBUG:boto:Token: None 2023-12-15T23:26:15.536 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23 2023-12-15T23:26:15.536 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fFsBKaZKUFFuYW3pSyadyQXQjAM= 2023-12-15T23:26:15.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fFsBKaZKUFFuYW3pSyadyQXQjAM=', 'Content-Length': '0'} 2023-12-15T23:26:15.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea1e1cdb157c2a95-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.581 DEBUG:boto:path=/kskgfn-49/obj23 2023-12-15T23:26:15.582 DEBUG:boto:auth_path=/kskgfn-49/obj23 2023-12-15T23:26:15.582 DEBUG:boto:Method: GET 2023-12-15T23:26:15.582 DEBUG:boto:Path: /kskgfn-49/obj23 2023-12-15T23:26:15.582 DEBUG:boto:Data: 2023-12-15T23:26:15.582 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.582 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.582 DEBUG:boto:Params: {} 2023-12-15T23:26:15.583 DEBUG:boto:Token: None 2023-12-15T23:26:15.583 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj23 2023-12-15T23:26:15.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fFsBKaZKUFFuYW3pSyadyQXQjAM= 2023-12-15T23:26:15.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fFsBKaZKUFFuYW3pSyadyQXQjAM=', 'Content-Length': '0'} 2023-12-15T23:26:15.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8653d869bc266b5-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.585 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.585 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.586 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.586 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.586 DEBUG:boto:Method: GET 2023-12-15T23:26:15.586 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.586 DEBUG:boto:Data: 2023-12-15T23:26:15.586 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.586 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.586 DEBUG:boto:Params: {} 2023-12-15T23:26:15.587 DEBUG:boto:Token: None 2023-12-15T23:26:15.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fe3c12923af2964-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.590 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.590 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.590 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.590 DEBUG:boto:path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.590 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.590 DEBUG:boto:Method: GET 2023-12-15T23:26:15.591 DEBUG:boto:Path: /kskgfn-49/?prefix=obj23 2023-12-15T23:26:15.591 DEBUG:boto:Data: 2023-12-15T23:26:15.591 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.591 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.591 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.591 DEBUG:boto:Params: {} 2023-12-15T23:26:15.591 DEBUG:boto:Token: None 2023-12-15T23:26:15.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.592 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.595 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000623b30262ec109fc-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.595 DEBUG:boto:b'kskgfn-49obj231000falseobj232023-12-15T23:18:45.686Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.595 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:26:15.596 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.596 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.596 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.596 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.596 DEBUG:boto:Method: GET 2023-12-15T23:26:15.596 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.596 DEBUG:boto:Data: 2023-12-15T23:26:15.596 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.596 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.597 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.597 DEBUG:boto:Params: {} 2023-12-15T23:26:15.597 DEBUG:boto:Token: None 2023-12-15T23:26:15.597 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw= 2023-12-15T23:26:15.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw=', 'Content-Length': '0'} 2023-12-15T23:26:15.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f7a45a80aff7946-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.600 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.600 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.600 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.600 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.600 DEBUG:boto:Method: GET 2023-12-15T23:26:15.600 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.600 DEBUG:boto:Data: 2023-12-15T23:26:15.600 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.600 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.601 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.601 DEBUG:boto:Params: {} 2023-12-15T23:26:15.601 DEBUG:boto:Token: None 2023-12-15T23:26:15.601 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw= 2023-12-15T23:26:15.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw=', 'Content-Length': '0'} 2023-12-15T23:26:15.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f9a066653cda560-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.604 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.604 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.604 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.604 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.604 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.604 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.604 DEBUG:boto:Data: 2023-12-15T23:26:15.604 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.605 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.605 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.605 DEBUG:boto:Params: {} 2023-12-15T23:26:15.605 DEBUG:boto:Token: None 2023-12-15T23:26:15.605 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.605 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:++7RwKm4zrWonMCBJhja+ugt1gg= 2023-12-15T23:26:15.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:++7RwKm4zrWonMCBJhja+ugt1gg=', 'Content-Length': '0'} 2023-12-15T23:26:15.607 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000691ab1a50aa07cbf-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.608 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.608 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.608 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.608 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.608 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.608 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.608 DEBUG:boto:Data: 2023-12-15T23:26:15.608 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.609 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.609 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.609 DEBUG:boto:Params: {} 2023-12-15T23:26:15.609 DEBUG:boto:Token: None 2023-12-15T23:26:15.609 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.609 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:++7RwKm4zrWonMCBJhja+ugt1gg= 2023-12-15T23:26:15.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:++7RwKm4zrWonMCBJhja+ugt1gg=', 'Content-Length': '0'} 2023-12-15T23:26:15.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb5db0e3bacde83-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:26:15.612 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.612 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.612 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.612 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.612 DEBUG:boto:Method: GET 2023-12-15T23:26:15.612 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.612 DEBUG:boto:Data: 2023-12-15T23:26:15.613 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.613 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.613 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.613 DEBUG:boto:Params: {} 2023-12-15T23:26:15.613 DEBUG:boto:Token: None 2023-12-15T23:26:15.613 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.613 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw= 2023-12-15T23:26:15.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw=', 'Content-Length': '0'} 2023-12-15T23:26:15.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000883dc10bfba548c2-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.616 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.616 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.616 DEBUG:boto:path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.616 DEBUG:boto:auth_path=/kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.616 DEBUG:boto:Method: GET 2023-12-15T23:26:15.616 DEBUG:boto:Path: /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.616 DEBUG:boto:Data: 2023-12-15T23:26:15.616 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.617 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.617 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.617 DEBUG:boto:Params: {} 2023-12-15T23:26:15.617 DEBUG:boto:Token: None 2023-12-15T23:26:15.617 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29?versionId=null 2023-12-15T23:26:15.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw= 2023-12-15T23:26:15.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qy3i99ZTd6LTtW2gwujCBB+f4uw=', 'Content-Length': '0'} 2023-12-15T23:26:15.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adbedfe965c3f567-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.620 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.620 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.620 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.620 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.620 DEBUG:boto:Method: GET 2023-12-15T23:26:15.620 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.620 DEBUG:boto:Data: 2023-12-15T23:26:15.621 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.621 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.621 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.621 DEBUG:boto:Params: {} 2023-12-15T23:26:15.621 DEBUG:boto:Token: None 2023-12-15T23:26:15.621 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.621 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001789f16c646aa8a8-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.624 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.624 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.624 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.624 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.624 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.625 DEBUG:boto:Method: GET 2023-12-15T23:26:15.625 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.625 DEBUG:boto:Data: 2023-12-15T23:26:15.625 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.625 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.625 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.625 DEBUG:boto:Params: {} 2023-12-15T23:26:15.625 DEBUG:boto:Token: None 2023-12-15T23:26:15.625 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.629 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ada030d7a94f2413-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.629 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.630 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.630 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.630 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.630 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:26:15.630 DEBUG:boto:Data: 2023-12-15T23:26:15.630 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.631 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.631 DEBUG:boto:Params: {} 2023-12-15T23:26:15.631 DEBUG:boto:Token: None 2023-12-15T23:26:15.631 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29 2023-12-15T23:26:15.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XcZKXqChWz6uYHIH1cdu9srMN+g= 2023-12-15T23:26:15.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XcZKXqChWz6uYHIH1cdu9srMN+g=', 'Content-Length': '0'} 2023-12-15T23:26:15.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7eb0f0112a336d7-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.634 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.634 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.634 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.634 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:26:15.634 DEBUG:boto:Data: 2023-12-15T23:26:15.634 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.634 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.635 DEBUG:boto:Params: {} 2023-12-15T23:26:15.635 DEBUG:boto:Token: None 2023-12-15T23:26:15.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29 2023-12-15T23:26:15.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XcZKXqChWz6uYHIH1cdu9srMN+g= 2023-12-15T23:26:15.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XcZKXqChWz6uYHIH1cdu9srMN+g=', 'Content-Length': '0'} 2023-12-15T23:26:15.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012ea07c9b9a2f371-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:26:15.638 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.638 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.638 DEBUG:boto:Method: GET 2023-12-15T23:26:15.638 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:26:15.638 DEBUG:boto:Data: 2023-12-15T23:26:15.638 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.638 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.638 DEBUG:boto:Params: {} 2023-12-15T23:26:15.639 DEBUG:boto:Token: None 2023-12-15T23:26:15.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29 2023-12-15T23:26:15.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kkMEpidXc2DyvyX9NnL39mmbA38= 2023-12-15T23:26:15.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kkMEpidXc2DyvyX9NnL39mmbA38=', 'Content-Length': '0'} 2023-12-15T23:26:15.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000759ea081abfeac78-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.642 DEBUG:boto:path=/kskgfn-49/obj29 2023-12-15T23:26:15.642 DEBUG:boto:auth_path=/kskgfn-49/obj29 2023-12-15T23:26:15.642 DEBUG:boto:Method: GET 2023-12-15T23:26:15.642 DEBUG:boto:Path: /kskgfn-49/obj29 2023-12-15T23:26:15.642 DEBUG:boto:Data: 2023-12-15T23:26:15.642 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.642 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.642 DEBUG:boto:Params: {} 2023-12-15T23:26:15.643 DEBUG:boto:Token: None 2023-12-15T23:26:15.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj29 2023-12-15T23:26:15.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kkMEpidXc2DyvyX9NnL39mmbA38= 2023-12-15T23:26:15.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kkMEpidXc2DyvyX9NnL39mmbA38=', 'Content-Length': '0'} 2023-12-15T23:26:15.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002990119abca7d416-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.686 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.686 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.686 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.686 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.686 DEBUG:boto:Method: GET 2023-12-15T23:26:15.686 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.686 DEBUG:boto:Data: 2023-12-15T23:26:15.686 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.687 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.687 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.687 DEBUG:boto:Params: {} 2023-12-15T23:26:15.687 DEBUG:boto:Token: None 2023-12-15T23:26:15.687 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005df629e8a09bbf54-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.690 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.690 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.690 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.690 DEBUG:boto:path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.690 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.690 DEBUG:boto:Method: GET 2023-12-15T23:26:15.691 DEBUG:boto:Path: /kskgfn-49/?prefix=obj29 2023-12-15T23:26:15.691 DEBUG:boto:Data: 2023-12-15T23:26:15.691 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.691 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.691 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.691 DEBUG:boto:Params: {} 2023-12-15T23:26:15.691 DEBUG:boto:Token: None 2023-12-15T23:26:15.691 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.691 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085a744e5ba9daf79-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.697 DEBUG:boto:b'kskgfn-49obj291000falseobj292023-12-15T23:20:59.924Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.698 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:26:15.698 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.698 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.698 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.698 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.698 DEBUG:boto:Method: GET 2023-12-15T23:26:15.699 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.699 DEBUG:boto:Data: 2023-12-15T23:26:15.699 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.699 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.699 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.699 DEBUG:boto:Params: {} 2023-12-15T23:26:15.699 DEBUG:boto:Token: None 2023-12-15T23:26:15.699 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ= 2023-12-15T23:26:15.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000321e0f9adead8a82-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.745 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.746 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.746 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.746 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.746 DEBUG:boto:Method: GET 2023-12-15T23:26:15.746 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.746 DEBUG:boto:Data: 2023-12-15T23:26:15.746 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.746 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.747 DEBUG:boto:Params: {} 2023-12-15T23:26:15.747 DEBUG:boto:Token: None 2023-12-15T23:26:15.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ= 2023-12-15T23:26:15.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2efb0caa0c422e3-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.750 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.750 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.750 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.750 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.750 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.750 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.751 DEBUG:boto:Data: 2023-12-15T23:26:15.751 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.751 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.751 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.751 DEBUG:boto:Params: {} 2023-12-15T23:26:15.751 DEBUG:boto:Token: None 2023-12-15T23:26:15.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TBZ/SyyzEJA2GCQEYi8MazhBzBU= 2023-12-15T23:26:15.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TBZ/SyyzEJA2GCQEYi8MazhBzBU=', 'Content-Length': '0'} 2023-12-15T23:26:15.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff38a1ee413fb25e-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.754 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.754 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.754 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.754 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.754 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.754 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.754 DEBUG:boto:Data: 2023-12-15T23:26:15.754 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.755 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.755 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.755 DEBUG:boto:Params: {} 2023-12-15T23:26:15.755 DEBUG:boto:Token: None 2023-12-15T23:26:15.755 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.755 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:TBZ/SyyzEJA2GCQEYi8MazhBzBU= 2023-12-15T23:26:15.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:TBZ/SyyzEJA2GCQEYi8MazhBzBU=', 'Content-Length': '0'} 2023-12-15T23:26:15.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d170bda33ba4e315-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:26:15.758 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.758 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.758 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.758 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.759 DEBUG:boto:Method: GET 2023-12-15T23:26:15.759 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.759 DEBUG:boto:Data: 2023-12-15T23:26:15.759 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.759 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.759 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.759 DEBUG:boto:Params: {} 2023-12-15T23:26:15.759 DEBUG:boto:Token: None 2023-12-15T23:26:15.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ= 2023-12-15T23:26:15.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058ce63e848ca3c65-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.762 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.762 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.763 DEBUG:boto:path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.763 DEBUG:boto:auth_path=/kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.763 DEBUG:boto:Method: GET 2023-12-15T23:26:15.763 DEBUG:boto:Path: /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.763 DEBUG:boto:Data: 2023-12-15T23:26:15.763 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.763 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.763 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.763 DEBUG:boto:Params: {} 2023-12-15T23:26:15.764 DEBUG:boto:Token: None 2023-12-15T23:26:15.764 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31?versionId=null 2023-12-15T23:26:15.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ= 2023-12-15T23:26:15.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2iHZbjXBzNS8s/5ZQsN9HHJHJlQ=', 'Content-Length': '0'} 2023-12-15T23:26:15.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a39cf4309c78bb1-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.813 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.814 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.814 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.814 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.814 DEBUG:boto:Method: GET 2023-12-15T23:26:15.814 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.814 DEBUG:boto:Data: 2023-12-15T23:26:15.814 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.814 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.814 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.815 DEBUG:boto:Params: {} 2023-12-15T23:26:15.815 DEBUG:boto:Token: None 2023-12-15T23:26:15.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c61a5b034034338e-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.818 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.818 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.818 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.818 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.818 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.818 DEBUG:boto:Method: GET 2023-12-15T23:26:15.818 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.819 DEBUG:boto:Data: 2023-12-15T23:26:15.819 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.819 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.819 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.819 DEBUG:boto:Params: {} 2023-12-15T23:26:15.819 DEBUG:boto:Token: None 2023-12-15T23:26:15.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.823 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4dfa6071a9f4fec-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.823 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.823 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.824 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.824 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.824 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:26:15.824 DEBUG:boto:Data: 2023-12-15T23:26:15.824 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.824 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.824 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.824 DEBUG:boto:Params: {} 2023-12-15T23:26:15.824 DEBUG:boto:Token: None 2023-12-15T23:26:15.825 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31 2023-12-15T23:26:15.825 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JNF12+bK85cTN9Fv6VxOt5e5JBY= 2023-12-15T23:26:15.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JNF12+bK85cTN9Fv6VxOt5e5JBY=', 'Content-Length': '0'} 2023-12-15T23:26:15.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042d8ef47d5280c54-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.827 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.827 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.827 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.828 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:26:15.828 DEBUG:boto:Data: 2023-12-15T23:26:15.828 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.828 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.828 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.828 DEBUG:boto:Params: {} 2023-12-15T23:26:15.828 DEBUG:boto:Token: None 2023-12-15T23:26:15.828 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31 2023-12-15T23:26:15.828 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JNF12+bK85cTN9Fv6VxOt5e5JBY= 2023-12-15T23:26:15.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JNF12+bK85cTN9Fv6VxOt5e5JBY=', 'Content-Length': '0'} 2023-12-15T23:26:15.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002786f15bfa84846f-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:26:15.831 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.831 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.831 DEBUG:boto:Method: GET 2023-12-15T23:26:15.831 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:26:15.831 DEBUG:boto:Data: 2023-12-15T23:26:15.832 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.832 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.832 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.832 DEBUG:boto:Params: {} 2023-12-15T23:26:15.832 DEBUG:boto:Token: None 2023-12-15T23:26:15.832 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31 2023-12-15T23:26:15.832 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:moJlxpFT1NmD60UosTEZ5EJlW/M= 2023-12-15T23:26:15.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:moJlxpFT1NmD60UosTEZ5EJlW/M=', 'Content-Length': '0'} 2023-12-15T23:26:15.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4e3be689447ee90-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.878 DEBUG:boto:path=/kskgfn-49/obj31 2023-12-15T23:26:15.878 DEBUG:boto:auth_path=/kskgfn-49/obj31 2023-12-15T23:26:15.878 DEBUG:boto:Method: GET 2023-12-15T23:26:15.878 DEBUG:boto:Path: /kskgfn-49/obj31 2023-12-15T23:26:15.878 DEBUG:boto:Data: 2023-12-15T23:26:15.878 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.878 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.878 DEBUG:boto:Params: {} 2023-12-15T23:26:15.879 DEBUG:boto:Token: None 2023-12-15T23:26:15.879 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj31 2023-12-15T23:26:15.879 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:moJlxpFT1NmD60UosTEZ5EJlW/M= 2023-12-15T23:26:15.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:moJlxpFT1NmD60UosTEZ5EJlW/M=', 'Content-Length': '0'} 2023-12-15T23:26:15.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095b1cdf8c1ce5a11-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.881 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.881 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.882 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.882 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.882 DEBUG:boto:Method: GET 2023-12-15T23:26:15.882 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.882 DEBUG:boto:Data: 2023-12-15T23:26:15.882 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.882 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.882 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.882 DEBUG:boto:Params: {} 2023-12-15T23:26:15.882 DEBUG:boto:Token: None 2023-12-15T23:26:15.883 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.883 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000835e7d2b535f81b8-00657ce097-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.886 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.886 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:15.886 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:15.886 DEBUG:boto:path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.886 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.886 DEBUG:boto:Method: GET 2023-12-15T23:26:15.887 DEBUG:boto:Path: /kskgfn-49/?prefix=obj31 2023-12-15T23:26:15.887 DEBUG:boto:Data: 2023-12-15T23:26:15.887 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.887 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.887 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.887 DEBUG:boto:Params: {} 2023-12-15T23:26:15.887 DEBUG:boto:Token: None 2023-12-15T23:26:15.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/ 2023-12-15T23:26:15.888 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8= 2023-12-15T23:26:15.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UcrPobAu8pdkr4yGWtZmHp0Gqa8=', 'Content-Length': '0'} 2023-12-15T23:26:15.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002aeb38c7460cedd7-00657ce097-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.891 DEBUG:boto:b'kskgfn-49obj311000falseobj312023-12-15T23:22:24.619Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:15.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:26:15.892 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.892 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.892 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.892 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.892 DEBUG:boto:Method: GET 2023-12-15T23:26:15.892 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.893 DEBUG:boto:Data: 2023-12-15T23:26:15.893 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.893 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.893 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.893 DEBUG:boto:Params: {} 2023-12-15T23:26:15.893 DEBUG:boto:Token: None 2023-12-15T23:26:15.893 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.893 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas= 2023-12-15T23:26:15.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas=', 'Content-Length': '0'} 2023-12-15T23:26:15.896 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e3691b7e85910e4-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.896 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.896 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.896 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.896 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.896 DEBUG:boto:Method: GET 2023-12-15T23:26:15.897 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.897 DEBUG:boto:Data: 2023-12-15T23:26:15.897 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.897 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.897 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.897 DEBUG:boto:Params: {} 2023-12-15T23:26:15.897 DEBUG:boto:Token: None 2023-12-15T23:26:15.897 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas= 2023-12-15T23:26:15.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas=', 'Content-Length': '0'} 2023-12-15T23:26:15.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffed91078be6dcf7-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.941 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.942 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.942 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.942 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.942 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.942 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.942 DEBUG:boto:Data: 2023-12-15T23:26:15.942 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.942 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.943 DEBUG:boto:Params: {} 2023-12-15T23:26:15.943 DEBUG:boto:Token: None 2023-12-15T23:26:15.943 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D0wAOlzZy8nW/81iHSZSPPEqDY4= 2023-12-15T23:26:15.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D0wAOlzZy8nW/81iHSZSPPEqDY4=', 'Content-Length': '0'} 2023-12-15T23:26:15.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c60c840527301414-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.946 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.946 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.946 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.946 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.946 DEBUG:boto:Method: HEAD 2023-12-15T23:26:15.946 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.946 DEBUG:boto:Data: 2023-12-15T23:26:15.947 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.947 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.947 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.947 DEBUG:boto:Params: {} 2023-12-15T23:26:15.947 DEBUG:boto:Token: None 2023-12-15T23:26:15.947 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D0wAOlzZy8nW/81iHSZSPPEqDY4= 2023-12-15T23:26:15.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D0wAOlzZy8nW/81iHSZSPPEqDY4=', 'Content-Length': '0'} 2023-12-15T23:26:15.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006510c34acac942f1-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.950 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:26:15.950 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.950 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.950 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.950 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.950 DEBUG:boto:Method: GET 2023-12-15T23:26:15.950 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.950 DEBUG:boto:Data: 2023-12-15T23:26:15.951 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.951 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:15.951 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.951 DEBUG:boto:Params: {} 2023-12-15T23:26:15.951 DEBUG:boto:Token: None 2023-12-15T23:26:15.951 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas= 2023-12-15T23:26:15.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas=', 'Content-Length': '0'} 2023-12-15T23:26:15.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4794c983d44f3e4-00657ce097-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:15.997 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:15.998 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:15.998 DEBUG:boto:path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.998 DEBUG:boto:auth_path=/kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.998 DEBUG:boto:Method: GET 2023-12-15T23:26:15.998 DEBUG:boto:Path: /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.998 DEBUG:boto:Data: 2023-12-15T23:26:15.998 DEBUG:boto:Headers: {} 2023-12-15T23:26:15.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:15.998 DEBUG:boto:Port: 8000 2023-12-15T23:26:15.998 DEBUG:boto:Params: {} 2023-12-15T23:26:15.999 DEBUG:boto:Token: None 2023-12-15T23:26:15.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:15 GMT /kskgfn-49/obj33?versionId=null 2023-12-15T23:26:15.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas= 2023-12-15T23:26:15.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wgrCZp8MnE1q88pIhjioo2lWuas=', 'Content-Length': '0'} 2023-12-15T23:26:16.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acd2caba52aec7df-00657ce097-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.002 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.002 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.002 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.002 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.002 DEBUG:boto:Method: GET 2023-12-15T23:26:16.002 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.002 DEBUG:boto:Data: 2023-12-15T23:26:16.002 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.002 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.003 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.003 DEBUG:boto:Params: {} 2023-12-15T23:26:16.003 DEBUG:boto:Token: None 2023-12-15T23:26:16.003 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.003 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b031305399f5748d-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.006 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.006 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.006 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.006 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.006 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.007 DEBUG:boto:Method: GET 2023-12-15T23:26:16.007 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.007 DEBUG:boto:Data: 2023-12-15T23:26:16.007 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.007 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.007 DEBUG:boto:Params: {} 2023-12-15T23:26:16.007 DEBUG:boto:Token: None 2023-12-15T23:26:16.008 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.008 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c89c216c623f8d20-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.011 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.012 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:16.012 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:16.012 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.012 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:26:16.012 DEBUG:boto:Data: 2023-12-15T23:26:16.012 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.012 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.013 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.013 DEBUG:boto:Params: {} 2023-12-15T23:26:16.013 DEBUG:boto:Token: None 2023-12-15T23:26:16.013 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj33 2023-12-15T23:26:16.013 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OVlAKzqGzeG1yx8iUF3tdl8diTE= 2023-12-15T23:26:16.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OVlAKzqGzeG1yx8iUF3tdl8diTE=', 'Content-Length': '0'} 2023-12-15T23:26:16.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4d14073f87b57e7-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.015 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:16.016 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:16.016 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.016 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:26:16.016 DEBUG:boto:Data: 2023-12-15T23:26:16.016 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.016 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.016 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.016 DEBUG:boto:Params: {} 2023-12-15T23:26:16.016 DEBUG:boto:Token: None 2023-12-15T23:26:16.017 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj33 2023-12-15T23:26:16.017 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OVlAKzqGzeG1yx8iUF3tdl8diTE= 2023-12-15T23:26:16.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OVlAKzqGzeG1yx8iUF3tdl8diTE=', 'Content-Length': '0'} 2023-12-15T23:26:16.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000da23e9976eef481-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:26:16.019 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:16.020 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:16.020 DEBUG:boto:Method: GET 2023-12-15T23:26:16.020 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:26:16.020 DEBUG:boto:Data: 2023-12-15T23:26:16.020 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.020 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.020 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.020 DEBUG:boto:Params: {} 2023-12-15T23:26:16.020 DEBUG:boto:Token: None 2023-12-15T23:26:16.021 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj33 2023-12-15T23:26:16.021 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dmYC0NVgLwoNzAr+fwF6w2lMdlw= 2023-12-15T23:26:16.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dmYC0NVgLwoNzAr+fwF6w2lMdlw=', 'Content-Length': '0'} 2023-12-15T23:26:16.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000398c65d6fab33379-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.024 DEBUG:boto:path=/kskgfn-49/obj33 2023-12-15T23:26:16.024 DEBUG:boto:auth_path=/kskgfn-49/obj33 2023-12-15T23:26:16.024 DEBUG:boto:Method: GET 2023-12-15T23:26:16.024 DEBUG:boto:Path: /kskgfn-49/obj33 2023-12-15T23:26:16.024 DEBUG:boto:Data: 2023-12-15T23:26:16.024 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.024 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.024 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.025 DEBUG:boto:Params: {} 2023-12-15T23:26:16.025 DEBUG:boto:Token: None 2023-12-15T23:26:16.025 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj33 2023-12-15T23:26:16.025 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dmYC0NVgLwoNzAr+fwF6w2lMdlw= 2023-12-15T23:26:16.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dmYC0NVgLwoNzAr+fwF6w2lMdlw=', 'Content-Length': '0'} 2023-12-15T23:26:16.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b76bad831eecfa32-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.070 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.070 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.070 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.070 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.070 DEBUG:boto:Method: GET 2023-12-15T23:26:16.070 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.070 DEBUG:boto:Data: 2023-12-15T23:26:16.070 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.071 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.071 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.071 DEBUG:boto:Params: {} 2023-12-15T23:26:16.071 DEBUG:boto:Token: None 2023-12-15T23:26:16.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5710a0f4ad6a4e0-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.074 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.074 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.074 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.074 DEBUG:boto:path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.075 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.075 DEBUG:boto:Method: GET 2023-12-15T23:26:16.075 DEBUG:boto:Path: /kskgfn-49/?prefix=obj33 2023-12-15T23:26:16.075 DEBUG:boto:Data: 2023-12-15T23:26:16.075 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.075 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.075 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.075 DEBUG:boto:Params: {} 2023-12-15T23:26:16.075 DEBUG:boto:Token: None 2023-12-15T23:26:16.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c914326375a2da01-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.080 DEBUG:boto:b'kskgfn-49obj331000falseobj332023-12-15T23:16:03.582Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:26:16.080 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.080 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.081 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.081 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.081 DEBUG:boto:Method: GET 2023-12-15T23:26:16.081 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.081 DEBUG:boto:Data: 2023-12-15T23:26:16.081 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.081 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.081 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.081 DEBUG:boto:Params: {} 2023-12-15T23:26:16.082 DEBUG:boto:Token: None 2023-12-15T23:26:16.082 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0= 2023-12-15T23:26:16.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0=', 'Content-Length': '0'} 2023-12-15T23:26:16.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000949be167b969c40a-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.125 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.126 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.126 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.126 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.126 DEBUG:boto:Method: GET 2023-12-15T23:26:16.126 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.126 DEBUG:boto:Data: 2023-12-15T23:26:16.126 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.127 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.127 DEBUG:boto:Params: {} 2023-12-15T23:26:16.127 DEBUG:boto:Token: None 2023-12-15T23:26:16.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0= 2023-12-15T23:26:16.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0=', 'Content-Length': '0'} 2023-12-15T23:26:16.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b341e67f8a02a46a-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.130 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.130 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.130 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.130 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.130 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.130 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.130 DEBUG:boto:Data: 2023-12-15T23:26:16.131 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.131 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.131 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.131 DEBUG:boto:Params: {} 2023-12-15T23:26:16.131 DEBUG:boto:Token: None 2023-12-15T23:26:16.131 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MUxvvjLAgRYrnAD+yvENpljM5g= 2023-12-15T23:26:16.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MUxvvjLAgRYrnAD+yvENpljM5g=', 'Content-Length': '0'} 2023-12-15T23:26:16.134 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bdb0ce6a4ed5497-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.134 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.134 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.134 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.135 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.135 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.135 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.135 DEBUG:boto:Data: 2023-12-15T23:26:16.135 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.135 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.135 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.135 DEBUG:boto:Params: {} 2023-12-15T23:26:16.135 DEBUG:boto:Token: None 2023-12-15T23:26:16.136 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.136 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0MUxvvjLAgRYrnAD+yvENpljM5g= 2023-12-15T23:26:16.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0MUxvvjLAgRYrnAD+yvENpljM5g=', 'Content-Length': '0'} 2023-12-15T23:26:16.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007abf6de070916a8b-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.138 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:26:16.138 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.139 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.139 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.139 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.139 DEBUG:boto:Method: GET 2023-12-15T23:26:16.139 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.139 DEBUG:boto:Data: 2023-12-15T23:26:16.139 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.139 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.139 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.140 DEBUG:boto:Params: {} 2023-12-15T23:26:16.140 DEBUG:boto:Token: None 2023-12-15T23:26:16.140 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.140 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0= 2023-12-15T23:26:16.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0=', 'Content-Length': '0'} 2023-12-15T23:26:16.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040adf4a03677df30-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.142 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.142 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.143 DEBUG:boto:path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.143 DEBUG:boto:auth_path=/kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.143 DEBUG:boto:Method: GET 2023-12-15T23:26:16.143 DEBUG:boto:Path: /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.143 DEBUG:boto:Data: 2023-12-15T23:26:16.143 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.143 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.143 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.143 DEBUG:boto:Params: {} 2023-12-15T23:26:16.144 DEBUG:boto:Token: None 2023-12-15T23:26:16.144 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34?versionId=null 2023-12-15T23:26:16.144 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0= 2023-12-15T23:26:16.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BN6f2fLqNr/jHpbSgDLOwtMq3A0=', 'Content-Length': '0'} 2023-12-15T23:26:16.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005abfaa68cf9c6108-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.189 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.190 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.190 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.190 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.190 DEBUG:boto:Method: GET 2023-12-15T23:26:16.190 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.190 DEBUG:boto:Data: 2023-12-15T23:26:16.190 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.191 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.191 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.191 DEBUG:boto:Params: {} 2023-12-15T23:26:16.191 DEBUG:boto:Token: None 2023-12-15T23:26:16.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d926cbe81f9259f0-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.194 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.194 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.194 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.194 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.195 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.195 DEBUG:boto:Method: GET 2023-12-15T23:26:16.195 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.195 DEBUG:boto:Data: 2023-12-15T23:26:16.195 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.195 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.195 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.195 DEBUG:boto:Params: {} 2023-12-15T23:26:16.195 DEBUG:boto:Token: None 2023-12-15T23:26:16.196 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.196 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.199 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbc61297a2c7f5bc-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.199 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.200 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.200 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.200 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.200 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:26:16.200 DEBUG:boto:Data: 2023-12-15T23:26:16.200 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.201 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.201 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.201 DEBUG:boto:Params: {} 2023-12-15T23:26:16.201 DEBUG:boto:Token: None 2023-12-15T23:26:16.201 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34 2023-12-15T23:26:16.201 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pyXKf2BX8RGg/yOZLYzOsAk6U4E= 2023-12-15T23:26:16.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pyXKf2BX8RGg/yOZLYzOsAk6U4E=', 'Content-Length': '0'} 2023-12-15T23:26:16.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067c82dc66f4b8193-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.204 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.204 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.204 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.204 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:26:16.204 DEBUG:boto:Data: 2023-12-15T23:26:16.204 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.204 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.204 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.205 DEBUG:boto:Params: {} 2023-12-15T23:26:16.205 DEBUG:boto:Token: None 2023-12-15T23:26:16.205 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34 2023-12-15T23:26:16.205 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pyXKf2BX8RGg/yOZLYzOsAk6U4E= 2023-12-15T23:26:16.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pyXKf2BX8RGg/yOZLYzOsAk6U4E=', 'Content-Length': '0'} 2023-12-15T23:26:16.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a5a85e2d0aeedd5-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:26:16.207 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.208 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.208 DEBUG:boto:Method: GET 2023-12-15T23:26:16.208 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:26:16.208 DEBUG:boto:Data: 2023-12-15T23:26:16.208 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.208 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.208 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.208 DEBUG:boto:Params: {} 2023-12-15T23:26:16.208 DEBUG:boto:Token: None 2023-12-15T23:26:16.209 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34 2023-12-15T23:26:16.209 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eUAnHC/9RQ1MYuUx74OZErk6Iy0= 2023-12-15T23:26:16.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eUAnHC/9RQ1MYuUx74OZErk6Iy0=', 'Content-Length': '0'} 2023-12-15T23:26:16.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000236e203318500f61-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.253 DEBUG:boto:path=/kskgfn-49/obj34 2023-12-15T23:26:16.254 DEBUG:boto:auth_path=/kskgfn-49/obj34 2023-12-15T23:26:16.254 DEBUG:boto:Method: GET 2023-12-15T23:26:16.254 DEBUG:boto:Path: /kskgfn-49/obj34 2023-12-15T23:26:16.254 DEBUG:boto:Data: 2023-12-15T23:26:16.254 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.254 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.254 DEBUG:boto:Params: {} 2023-12-15T23:26:16.254 DEBUG:boto:Token: None 2023-12-15T23:26:16.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj34 2023-12-15T23:26:16.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eUAnHC/9RQ1MYuUx74OZErk6Iy0= 2023-12-15T23:26:16.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eUAnHC/9RQ1MYuUx74OZErk6Iy0=', 'Content-Length': '0'} 2023-12-15T23:26:16.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000694a4607f1500a8e-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.258 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.258 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.258 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.258 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.258 DEBUG:boto:Method: GET 2023-12-15T23:26:16.258 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.258 DEBUG:boto:Data: 2023-12-15T23:26:16.259 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.259 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.259 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.259 DEBUG:boto:Params: {} 2023-12-15T23:26:16.259 DEBUG:boto:Token: None 2023-12-15T23:26:16.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005680616a32f7079c-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.262 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.262 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.262 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.262 DEBUG:boto:path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.263 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.263 DEBUG:boto:Method: GET 2023-12-15T23:26:16.263 DEBUG:boto:Path: /kskgfn-49/?prefix=obj34 2023-12-15T23:26:16.263 DEBUG:boto:Data: 2023-12-15T23:26:16.263 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.263 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.263 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.263 DEBUG:boto:Params: {} 2023-12-15T23:26:16.264 DEBUG:boto:Token: None 2023-12-15T23:26:16.264 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.264 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aca7710b97424e1c-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.309 DEBUG:boto:b'kskgfn-49obj341000falseobj342023-12-15T23:16:19.980Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.310 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:26:16.310 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.310 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.310 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.310 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.311 DEBUG:boto:Method: GET 2023-12-15T23:26:16.311 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.311 DEBUG:boto:Data: 2023-12-15T23:26:16.311 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.311 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.311 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.311 DEBUG:boto:Params: {} 2023-12-15T23:26:16.311 DEBUG:boto:Token: None 2023-12-15T23:26:16.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.312 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ= 2023-12-15T23:26:16.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8a2617976d42432-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.314 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.315 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.315 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.315 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.315 DEBUG:boto:Method: GET 2023-12-15T23:26:16.315 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.315 DEBUG:boto:Data: 2023-12-15T23:26:16.315 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.315 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.315 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.315 DEBUG:boto:Params: {} 2023-12-15T23:26:16.316 DEBUG:boto:Token: None 2023-12-15T23:26:16.316 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.316 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ= 2023-12-15T23:26:16.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000471b0e9c664d9e45-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.319 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.319 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.319 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.319 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.319 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.319 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.319 DEBUG:boto:Data: 2023-12-15T23:26:16.319 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.319 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.320 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.320 DEBUG:boto:Params: {} 2023-12-15T23:26:16.320 DEBUG:boto:Token: None 2023-12-15T23:26:16.320 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z81gps966na5wo7K2BTUVdLUNxw= 2023-12-15T23:26:16.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z81gps966na5wo7K2BTUVdLUNxw=', 'Content-Length': '0'} 2023-12-15T23:26:16.322 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ccb0f12fb69d625-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.323 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.323 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.323 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.323 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.323 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.323 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.323 DEBUG:boto:Data: 2023-12-15T23:26:16.323 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.323 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.323 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.323 DEBUG:boto:Params: {} 2023-12-15T23:26:16.324 DEBUG:boto:Token: None 2023-12-15T23:26:16.324 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.324 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z81gps966na5wo7K2BTUVdLUNxw= 2023-12-15T23:26:16.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z81gps966na5wo7K2BTUVdLUNxw=', 'Content-Length': '0'} 2023-12-15T23:26:16.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2edef0efa1e8c0f-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:26:16.327 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.327 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.327 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.327 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.327 DEBUG:boto:Method: GET 2023-12-15T23:26:16.327 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.327 DEBUG:boto:Data: 2023-12-15T23:26:16.327 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.327 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.327 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.328 DEBUG:boto:Params: {} 2023-12-15T23:26:16.328 DEBUG:boto:Token: None 2023-12-15T23:26:16.328 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.328 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ= 2023-12-15T23:26:16.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049f789a38cfdc63a-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.373 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.374 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.374 DEBUG:boto:path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.374 DEBUG:boto:auth_path=/kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.374 DEBUG:boto:Method: GET 2023-12-15T23:26:16.374 DEBUG:boto:Path: /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.374 DEBUG:boto:Data: 2023-12-15T23:26:16.374 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.374 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.374 DEBUG:boto:Params: {} 2023-12-15T23:26:16.375 DEBUG:boto:Token: None 2023-12-15T23:26:16.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37?versionId=null 2023-12-15T23:26:16.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ= 2023-12-15T23:26:16.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lvpUUUh0X+RQnhEZ8P43EJ8fUoQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002544211d22a412e7-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.377 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.377 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.378 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.378 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.378 DEBUG:boto:Method: GET 2023-12-15T23:26:16.378 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.378 DEBUG:boto:Data: 2023-12-15T23:26:16.378 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.378 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.378 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.378 DEBUG:boto:Params: {} 2023-12-15T23:26:16.378 DEBUG:boto:Token: None 2023-12-15T23:26:16.379 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.381 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022e57a5283ee3a70-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.381 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.382 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.382 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.382 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.382 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.382 DEBUG:boto:Method: GET 2023-12-15T23:26:16.382 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.382 DEBUG:boto:Data: 2023-12-15T23:26:16.382 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.383 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.383 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.383 DEBUG:boto:Params: {} 2023-12-15T23:26:16.383 DEBUG:boto:Token: None 2023-12-15T23:26:16.383 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.387 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc00cef90228b121-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.387 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.388 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.388 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.388 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.388 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:26:16.388 DEBUG:boto:Data: 2023-12-15T23:26:16.388 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.388 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.388 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.389 DEBUG:boto:Params: {} 2023-12-15T23:26:16.389 DEBUG:boto:Token: None 2023-12-15T23:26:16.389 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37 2023-12-15T23:26:16.389 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rYHacPJNtOfEIgBe3smbxMqB8Yk= 2023-12-15T23:26:16.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rYHacPJNtOfEIgBe3smbxMqB8Yk=', 'Content-Length': '0'} 2023-12-15T23:26:16.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ce3e24496aa2d3c-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.391 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.391 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.391 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.392 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:26:16.392 DEBUG:boto:Data: 2023-12-15T23:26:16.392 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.392 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.392 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.392 DEBUG:boto:Params: {} 2023-12-15T23:26:16.392 DEBUG:boto:Token: None 2023-12-15T23:26:16.392 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37 2023-12-15T23:26:16.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rYHacPJNtOfEIgBe3smbxMqB8Yk= 2023-12-15T23:26:16.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rYHacPJNtOfEIgBe3smbxMqB8Yk=', 'Content-Length': '0'} 2023-12-15T23:26:16.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049d0ff3e4907d43b-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.395 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:26:16.395 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.395 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.395 DEBUG:boto:Method: GET 2023-12-15T23:26:16.395 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:26:16.395 DEBUG:boto:Data: 2023-12-15T23:26:16.395 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.395 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.396 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.396 DEBUG:boto:Params: {} 2023-12-15T23:26:16.396 DEBUG:boto:Token: None 2023-12-15T23:26:16.396 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37 2023-12-15T23:26:16.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SSkNDnwUYRHPAxghoSgxXiXF7uk= 2023-12-15T23:26:16.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SSkNDnwUYRHPAxghoSgxXiXF7uk=', 'Content-Length': '0'} 2023-12-15T23:26:16.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a90f1cdf1a27300f-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.398 DEBUG:boto:path=/kskgfn-49/obj37 2023-12-15T23:26:16.399 DEBUG:boto:auth_path=/kskgfn-49/obj37 2023-12-15T23:26:16.399 DEBUG:boto:Method: GET 2023-12-15T23:26:16.399 DEBUG:boto:Path: /kskgfn-49/obj37 2023-12-15T23:26:16.399 DEBUG:boto:Data: 2023-12-15T23:26:16.399 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.399 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.399 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.399 DEBUG:boto:Params: {} 2023-12-15T23:26:16.399 DEBUG:boto:Token: None 2023-12-15T23:26:16.400 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj37 2023-12-15T23:26:16.400 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SSkNDnwUYRHPAxghoSgxXiXF7uk= 2023-12-15T23:26:16.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SSkNDnwUYRHPAxghoSgxXiXF7uk=', 'Content-Length': '0'} 2023-12-15T23:26:16.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029e13141574d2e0a-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.446 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.446 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.446 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.446 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.446 DEBUG:boto:Method: GET 2023-12-15T23:26:16.446 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.446 DEBUG:boto:Data: 2023-12-15T23:26:16.446 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.446 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.447 DEBUG:boto:Params: {} 2023-12-15T23:26:16.447 DEBUG:boto:Token: None 2023-12-15T23:26:16.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000389f835bfe54c9f8-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.450 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.450 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.450 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.450 DEBUG:boto:path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.450 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.450 DEBUG:boto:Method: GET 2023-12-15T23:26:16.451 DEBUG:boto:Path: /kskgfn-49/?prefix=obj37 2023-12-15T23:26:16.451 DEBUG:boto:Data: 2023-12-15T23:26:16.451 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.451 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.451 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.451 DEBUG:boto:Params: {} 2023-12-15T23:26:16.451 DEBUG:boto:Token: None 2023-12-15T23:26:16.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a22cba95c490524-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.456 DEBUG:boto:b'kskgfn-49obj371000falseobj372023-12-15T23:24:39.975Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:26:16.456 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.456 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.456 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.456 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.457 DEBUG:boto:Method: GET 2023-12-15T23:26:16.457 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.457 DEBUG:boto:Data: 2023-12-15T23:26:16.457 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.457 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.457 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.457 DEBUG:boto:Params: {} 2023-12-15T23:26:16.457 DEBUG:boto:Token: None 2023-12-15T23:26:16.457 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM= 2023-12-15T23:26:16.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM=', 'Content-Length': '0'} 2023-12-15T23:26:16.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000478464f56bf0611-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.460 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.460 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.460 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.460 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.460 DEBUG:boto:Method: GET 2023-12-15T23:26:16.460 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.461 DEBUG:boto:Data: 2023-12-15T23:26:16.461 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.461 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.461 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.461 DEBUG:boto:Params: {} 2023-12-15T23:26:16.461 DEBUG:boto:Token: None 2023-12-15T23:26:16.461 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM= 2023-12-15T23:26:16.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM=', 'Content-Length': '0'} 2023-12-15T23:26:16.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab6746ff6532015c-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.464 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.464 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.464 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.464 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.464 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.464 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.464 DEBUG:boto:Data: 2023-12-15T23:26:16.464 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.464 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.464 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.465 DEBUG:boto:Params: {} 2023-12-15T23:26:16.465 DEBUG:boto:Token: None 2023-12-15T23:26:16.465 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kgVSWppSdX+6w0F0TnZtyEtABk4= 2023-12-15T23:26:16.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kgVSWppSdX+6w0F0TnZtyEtABk4=', 'Content-Length': '0'} 2023-12-15T23:26:16.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca9b10e4ea7b7181-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.467 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.467 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.467 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.468 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.468 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.468 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.468 DEBUG:boto:Data: 2023-12-15T23:26:16.468 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.468 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.468 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.468 DEBUG:boto:Params: {} 2023-12-15T23:26:16.468 DEBUG:boto:Token: None 2023-12-15T23:26:16.468 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.469 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kgVSWppSdX+6w0F0TnZtyEtABk4= 2023-12-15T23:26:16.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kgVSWppSdX+6w0F0TnZtyEtABk4=', 'Content-Length': '0'} 2023-12-15T23:26:16.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096ffe0a995f013ec-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:26:16.471 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.471 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.471 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.471 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.471 DEBUG:boto:Method: GET 2023-12-15T23:26:16.471 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.471 DEBUG:boto:Data: 2023-12-15T23:26:16.471 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.472 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.472 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.472 DEBUG:boto:Params: {} 2023-12-15T23:26:16.472 DEBUG:boto:Token: None 2023-12-15T23:26:16.472 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.472 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM= 2023-12-15T23:26:16.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM=', 'Content-Length': '0'} 2023-12-15T23:26:16.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d070ab406836e870-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.474 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.475 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.475 DEBUG:boto:path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.475 DEBUG:boto:auth_path=/kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.475 DEBUG:boto:Method: GET 2023-12-15T23:26:16.475 DEBUG:boto:Path: /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.475 DEBUG:boto:Data: 2023-12-15T23:26:16.475 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.475 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.475 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.475 DEBUG:boto:Params: {} 2023-12-15T23:26:16.475 DEBUG:boto:Token: None 2023-12-15T23:26:16.476 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38?versionId=null 2023-12-15T23:26:16.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM= 2023-12-15T23:26:16.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZH2PEYU7JSoMtclfOB/UuWXxsvM=', 'Content-Length': '0'} 2023-12-15T23:26:16.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b2a3e52f81ce7b1-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.522 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.522 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.522 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.522 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.522 DEBUG:boto:Method: GET 2023-12-15T23:26:16.522 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.522 DEBUG:boto:Data: 2023-12-15T23:26:16.522 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.522 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.522 DEBUG:boto:Params: {} 2023-12-15T23:26:16.523 DEBUG:boto:Token: None 2023-12-15T23:26:16.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.525 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000899858f73b927513-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.525 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.526 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.526 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.526 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.526 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.526 DEBUG:boto:Method: GET 2023-12-15T23:26:16.526 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.526 DEBUG:boto:Data: 2023-12-15T23:26:16.527 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.527 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.527 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.527 DEBUG:boto:Params: {} 2023-12-15T23:26:16.527 DEBUG:boto:Token: None 2023-12-15T23:26:16.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031c2a86f7e767511-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.531 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.531 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.531 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.531 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.532 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:26:16.532 DEBUG:boto:Data: 2023-12-15T23:26:16.532 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.532 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.532 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.532 DEBUG:boto:Params: {} 2023-12-15T23:26:16.532 DEBUG:boto:Token: None 2023-12-15T23:26:16.532 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38 2023-12-15T23:26:16.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2xERWdYFCTq+Lu33eU4xF7wgNqA= 2023-12-15T23:26:16.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2xERWdYFCTq+Lu33eU4xF7wgNqA=', 'Content-Length': '0'} 2023-12-15T23:26:16.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb26c1ca4e6225ba-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.535 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.535 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.535 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.535 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:26:16.535 DEBUG:boto:Data: 2023-12-15T23:26:16.535 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.535 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.535 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.535 DEBUG:boto:Params: {} 2023-12-15T23:26:16.535 DEBUG:boto:Token: None 2023-12-15T23:26:16.536 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38 2023-12-15T23:26:16.536 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2xERWdYFCTq+Lu33eU4xF7wgNqA= 2023-12-15T23:26:16.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2xERWdYFCTq+Lu33eU4xF7wgNqA=', 'Content-Length': '0'} 2023-12-15T23:26:16.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076640017e4f6109e-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:26:16.538 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.538 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.538 DEBUG:boto:Method: GET 2023-12-15T23:26:16.538 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:26:16.538 DEBUG:boto:Data: 2023-12-15T23:26:16.538 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.538 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.538 DEBUG:boto:Params: {} 2023-12-15T23:26:16.539 DEBUG:boto:Token: None 2023-12-15T23:26:16.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38 2023-12-15T23:26:16.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D75oOUH8BBTK2A9SwdykDc43jn8= 2023-12-15T23:26:16.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D75oOUH8BBTK2A9SwdykDc43jn8=', 'Content-Length': '0'} 2023-12-15T23:26:16.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ba7ef53ce03363d-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.581 DEBUG:boto:path=/kskgfn-49/obj38 2023-12-15T23:26:16.582 DEBUG:boto:auth_path=/kskgfn-49/obj38 2023-12-15T23:26:16.582 DEBUG:boto:Method: GET 2023-12-15T23:26:16.582 DEBUG:boto:Path: /kskgfn-49/obj38 2023-12-15T23:26:16.582 DEBUG:boto:Data: 2023-12-15T23:26:16.582 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.582 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.582 DEBUG:boto:Params: {} 2023-12-15T23:26:16.582 DEBUG:boto:Token: None 2023-12-15T23:26:16.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj38 2023-12-15T23:26:16.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D75oOUH8BBTK2A9SwdykDc43jn8= 2023-12-15T23:26:16.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D75oOUH8BBTK2A9SwdykDc43jn8=', 'Content-Length': '0'} 2023-12-15T23:26:16.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c167d6b60b00b19-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.585 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.585 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.585 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.585 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.585 DEBUG:boto:Method: GET 2023-12-15T23:26:16.585 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.586 DEBUG:boto:Data: 2023-12-15T23:26:16.586 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.586 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.586 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.586 DEBUG:boto:Params: {} 2023-12-15T23:26:16.586 DEBUG:boto:Token: None 2023-12-15T23:26:16.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003da2f634351a137-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.589 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.589 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.589 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.589 DEBUG:boto:path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.589 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.589 DEBUG:boto:Method: GET 2023-12-15T23:26:16.590 DEBUG:boto:Path: /kskgfn-49/?prefix=obj38 2023-12-15T23:26:16.590 DEBUG:boto:Data: 2023-12-15T23:26:16.590 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.590 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.590 DEBUG:boto:Params: {} 2023-12-15T23:26:16.590 DEBUG:boto:Token: None 2023-12-15T23:26:16.590 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.590 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c47d8ec70c5e748f-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.594 DEBUG:boto:b'kskgfn-49obj381000falseobj382023-12-15T23:17:37.349Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.595 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:26:16.595 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.595 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.595 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.595 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.595 DEBUG:boto:Method: GET 2023-12-15T23:26:16.595 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.595 DEBUG:boto:Data: 2023-12-15T23:26:16.595 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.595 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.596 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.596 DEBUG:boto:Params: {} 2023-12-15T23:26:16.596 DEBUG:boto:Token: None 2023-12-15T23:26:16.596 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.596 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg= 2023-12-15T23:26:16.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg=', 'Content-Length': '0'} 2023-12-15T23:26:16.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8ddc8070d7ac58c-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.598 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.599 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.599 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.599 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.599 DEBUG:boto:Method: GET 2023-12-15T23:26:16.599 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.599 DEBUG:boto:Data: 2023-12-15T23:26:16.599 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.599 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.599 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.599 DEBUG:boto:Params: {} 2023-12-15T23:26:16.599 DEBUG:boto:Token: None 2023-12-15T23:26:16.600 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg= 2023-12-15T23:26:16.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg=', 'Content-Length': '0'} 2023-12-15T23:26:16.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063bc3f42a8caff44-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.645 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.646 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.646 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.646 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.646 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.646 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.646 DEBUG:boto:Data: 2023-12-15T23:26:16.646 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.646 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.646 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.646 DEBUG:boto:Params: {} 2023-12-15T23:26:16.646 DEBUG:boto:Token: None 2023-12-15T23:26:16.647 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yO2pO5BxT/372cbLPtxzZMmJdtY= 2023-12-15T23:26:16.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yO2pO5BxT/372cbLPtxzZMmJdtY=', 'Content-Length': '0'} 2023-12-15T23:26:16.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ad7a7c29d30ab25-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.649 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.649 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.649 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.649 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.649 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.650 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.650 DEBUG:boto:Data: 2023-12-15T23:26:16.650 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.650 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.650 DEBUG:boto:Params: {} 2023-12-15T23:26:16.650 DEBUG:boto:Token: None 2023-12-15T23:26:16.650 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yO2pO5BxT/372cbLPtxzZMmJdtY= 2023-12-15T23:26:16.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yO2pO5BxT/372cbLPtxzZMmJdtY=', 'Content-Length': '0'} 2023-12-15T23:26:16.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a9a9bd6ae71229f-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:26:16.653 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.653 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.653 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.653 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.653 DEBUG:boto:Method: GET 2023-12-15T23:26:16.653 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.653 DEBUG:boto:Data: 2023-12-15T23:26:16.653 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.653 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.654 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.654 DEBUG:boto:Params: {} 2023-12-15T23:26:16.654 DEBUG:boto:Token: None 2023-12-15T23:26:16.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg= 2023-12-15T23:26:16.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg=', 'Content-Length': '0'} 2023-12-15T23:26:16.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063359a9e1b9f39ad-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.656 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.656 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.656 DEBUG:boto:path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.656 DEBUG:boto:auth_path=/kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.657 DEBUG:boto:Method: GET 2023-12-15T23:26:16.657 DEBUG:boto:Path: /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.657 DEBUG:boto:Data: 2023-12-15T23:26:16.657 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.657 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.657 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.657 DEBUG:boto:Params: {} 2023-12-15T23:26:16.657 DEBUG:boto:Token: None 2023-12-15T23:26:16.657 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44?versionId=null 2023-12-15T23:26:16.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg= 2023-12-15T23:26:16.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8Z95PO0DeqnKsCWLqSkJPmUHldg=', 'Content-Length': '0'} 2023-12-15T23:26:16.659 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009accf805a22d2e10-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.659 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.660 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.660 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.660 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.660 DEBUG:boto:Method: GET 2023-12-15T23:26:16.660 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.660 DEBUG:boto:Data: 2023-12-15T23:26:16.660 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.660 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.660 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.660 DEBUG:boto:Params: {} 2023-12-15T23:26:16.660 DEBUG:boto:Token: None 2023-12-15T23:26:16.661 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.661 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.663 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009f89324952681ed-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.663 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.663 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.663 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.664 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.664 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.664 DEBUG:boto:Method: GET 2023-12-15T23:26:16.664 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.664 DEBUG:boto:Data: 2023-12-15T23:26:16.664 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.664 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.664 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.664 DEBUG:boto:Params: {} 2023-12-15T23:26:16.664 DEBUG:boto:Token: None 2023-12-15T23:26:16.665 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.665 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.668 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb4e5bc09d9dcaa4-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.668 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.669 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.669 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.669 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.669 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:26:16.669 DEBUG:boto:Data: 2023-12-15T23:26:16.669 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.669 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.669 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.669 DEBUG:boto:Params: {} 2023-12-15T23:26:16.670 DEBUG:boto:Token: None 2023-12-15T23:26:16.670 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44 2023-12-15T23:26:16.670 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ivu4CQBLjRRFtTG4sAtqnIfXVXY= 2023-12-15T23:26:16.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ivu4CQBLjRRFtTG4sAtqnIfXVXY=', 'Content-Length': '0'} 2023-12-15T23:26:16.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000612d02011f0ac335-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.672 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.672 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.672 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.672 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:26:16.672 DEBUG:boto:Data: 2023-12-15T23:26:16.673 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.673 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.673 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.673 DEBUG:boto:Params: {} 2023-12-15T23:26:16.673 DEBUG:boto:Token: None 2023-12-15T23:26:16.673 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44 2023-12-15T23:26:16.673 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ivu4CQBLjRRFtTG4sAtqnIfXVXY= 2023-12-15T23:26:16.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ivu4CQBLjRRFtTG4sAtqnIfXVXY=', 'Content-Length': '0'} 2023-12-15T23:26:16.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684e22a62252a937-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:26:16.676 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.676 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.676 DEBUG:boto:Method: GET 2023-12-15T23:26:16.676 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:26:16.676 DEBUG:boto:Data: 2023-12-15T23:26:16.676 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.676 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.676 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.676 DEBUG:boto:Params: {} 2023-12-15T23:26:16.677 DEBUG:boto:Token: None 2023-12-15T23:26:16.677 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44 2023-12-15T23:26:16.677 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wAzSjqK87hWhT/o6Rkn+wYvuAWk= 2023-12-15T23:26:16.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wAzSjqK87hWhT/o6Rkn+wYvuAWk=', 'Content-Length': '0'} 2023-12-15T23:26:16.679 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000400426fc2127811a-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.679 DEBUG:boto:path=/kskgfn-49/obj44 2023-12-15T23:26:16.679 DEBUG:boto:auth_path=/kskgfn-49/obj44 2023-12-15T23:26:16.679 DEBUG:boto:Method: GET 2023-12-15T23:26:16.679 DEBUG:boto:Path: /kskgfn-49/obj44 2023-12-15T23:26:16.679 DEBUG:boto:Data: 2023-12-15T23:26:16.680 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.680 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.680 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.680 DEBUG:boto:Params: {} 2023-12-15T23:26:16.680 DEBUG:boto:Token: None 2023-12-15T23:26:16.680 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj44 2023-12-15T23:26:16.680 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wAzSjqK87hWhT/o6Rkn+wYvuAWk= 2023-12-15T23:26:16.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wAzSjqK87hWhT/o6Rkn+wYvuAWk=', 'Content-Length': '0'} 2023-12-15T23:26:16.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015a8d29fa694d878-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.683 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.683 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.683 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.683 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.683 DEBUG:boto:Method: GET 2023-12-15T23:26:16.683 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.683 DEBUG:boto:Data: 2023-12-15T23:26:16.683 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.684 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.684 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.684 DEBUG:boto:Params: {} 2023-12-15T23:26:16.684 DEBUG:boto:Token: None 2023-12-15T23:26:16.684 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.684 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d11a5d5f6f6a4314-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.686 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.687 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.687 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.687 DEBUG:boto:path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.687 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.687 DEBUG:boto:Method: GET 2023-12-15T23:26:16.687 DEBUG:boto:Path: /kskgfn-49/?prefix=obj44 2023-12-15T23:26:16.687 DEBUG:boto:Data: 2023-12-15T23:26:16.687 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.688 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.688 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.688 DEBUG:boto:Params: {} 2023-12-15T23:26:16.688 DEBUG:boto:Token: None 2023-12-15T23:26:16.688 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.688 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d015392f026b07b-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.733 DEBUG:boto:b'kskgfn-49obj441000falseobj442023-12-15T23:16:03.631Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.734 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:26:16.734 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.734 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.734 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.734 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.734 DEBUG:boto:Method: GET 2023-12-15T23:26:16.734 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.734 DEBUG:boto:Data: 2023-12-15T23:26:16.735 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.735 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.735 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.735 DEBUG:boto:Params: {} 2023-12-15T23:26:16.735 DEBUG:boto:Token: None 2023-12-15T23:26:16.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc= 2023-12-15T23:26:16.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc=', 'Content-Length': '0'} 2023-12-15T23:26:16.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e737acbe5380e839-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.738 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.738 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.738 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.738 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.738 DEBUG:boto:Method: GET 2023-12-15T23:26:16.739 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.739 DEBUG:boto:Data: 2023-12-15T23:26:16.739 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.739 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.739 DEBUG:boto:Params: {} 2023-12-15T23:26:16.739 DEBUG:boto:Token: None 2023-12-15T23:26:16.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc= 2023-12-15T23:26:16.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc=', 'Content-Length': '0'} 2023-12-15T23:26:16.742 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6d1bcf54c555a3e-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.742 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.742 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.742 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.742 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.742 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.743 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.743 DEBUG:boto:Data: 2023-12-15T23:26:16.743 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.743 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.743 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.743 DEBUG:boto:Params: {} 2023-12-15T23:26:16.743 DEBUG:boto:Token: None 2023-12-15T23:26:16.743 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjFPrAkitt3KMzsd4eZWNiddcsQ= 2023-12-15T23:26:16.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjFPrAkitt3KMzsd4eZWNiddcsQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c40a5554f4aa8325-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.746 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.746 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.746 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.746 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.746 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.746 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.746 DEBUG:boto:Data: 2023-12-15T23:26:16.746 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.747 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.747 DEBUG:boto:Params: {} 2023-12-15T23:26:16.747 DEBUG:boto:Token: None 2023-12-15T23:26:16.747 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjFPrAkitt3KMzsd4eZWNiddcsQ= 2023-12-15T23:26:16.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjFPrAkitt3KMzsd4eZWNiddcsQ=', 'Content-Length': '0'} 2023-12-15T23:26:16.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b772724d97957c42-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.749 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:26:16.749 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.750 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.750 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.750 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.750 DEBUG:boto:Method: GET 2023-12-15T23:26:16.750 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.750 DEBUG:boto:Data: 2023-12-15T23:26:16.750 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.750 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.750 DEBUG:boto:Params: {} 2023-12-15T23:26:16.750 DEBUG:boto:Token: None 2023-12-15T23:26:16.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc= 2023-12-15T23:26:16.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc=', 'Content-Length': '0'} 2023-12-15T23:26:16.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059580fbae3829f4b-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.793 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.794 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.794 DEBUG:boto:path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.794 DEBUG:boto:auth_path=/kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.794 DEBUG:boto:Method: GET 2023-12-15T23:26:16.794 DEBUG:boto:Path: /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.794 DEBUG:boto:Data: 2023-12-15T23:26:16.794 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.794 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.794 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.794 DEBUG:boto:Params: {} 2023-12-15T23:26:16.794 DEBUG:boto:Token: None 2023-12-15T23:26:16.795 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46?versionId=null 2023-12-15T23:26:16.795 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc= 2023-12-15T23:26:16.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jglv3vFGsIZhPYOIMI8XxEHZthc=', 'Content-Length': '0'} 2023-12-15T23:26:16.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aed17193b5b278d-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.797 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.797 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.797 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.797 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.798 DEBUG:boto:Method: GET 2023-12-15T23:26:16.798 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.798 DEBUG:boto:Data: 2023-12-15T23:26:16.798 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.798 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.798 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.798 DEBUG:boto:Params: {} 2023-12-15T23:26:16.798 DEBUG:boto:Token: None 2023-12-15T23:26:16.798 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.801 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021122c3a5be31bfb-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.801 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.802 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.802 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.802 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.802 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.802 DEBUG:boto:Method: GET 2023-12-15T23:26:16.802 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.802 DEBUG:boto:Data: 2023-12-15T23:26:16.802 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.802 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.802 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.803 DEBUG:boto:Params: {} 2023-12-15T23:26:16.803 DEBUG:boto:Token: None 2023-12-15T23:26:16.803 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.803 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.807 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2ddbb000accc8d7-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.807 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.807 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.807 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.807 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.808 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:26:16.808 DEBUG:boto:Data: 2023-12-15T23:26:16.808 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.808 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.808 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.808 DEBUG:boto:Params: {} 2023-12-15T23:26:16.808 DEBUG:boto:Token: None 2023-12-15T23:26:16.808 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46 2023-12-15T23:26:16.808 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UNdYtz+XK1N0+lj0oqq806Hnci0= 2023-12-15T23:26:16.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UNdYtz+XK1N0+lj0oqq806Hnci0=', 'Content-Length': '0'} 2023-12-15T23:26:16.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff1253a59c1df7c2-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.811 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.811 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.811 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.811 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:26:16.811 DEBUG:boto:Data: 2023-12-15T23:26:16.811 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.811 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.811 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.811 DEBUG:boto:Params: {} 2023-12-15T23:26:16.811 DEBUG:boto:Token: None 2023-12-15T23:26:16.812 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46 2023-12-15T23:26:16.812 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UNdYtz+XK1N0+lj0oqq806Hnci0= 2023-12-15T23:26:16.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UNdYtz+XK1N0+lj0oqq806Hnci0=', 'Content-Length': '0'} 2023-12-15T23:26:16.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4f475c706f23b09-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:26:16.814 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.814 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.814 DEBUG:boto:Method: GET 2023-12-15T23:26:16.814 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:26:16.815 DEBUG:boto:Data: 2023-12-15T23:26:16.815 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.815 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.815 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.815 DEBUG:boto:Params: {} 2023-12-15T23:26:16.815 DEBUG:boto:Token: None 2023-12-15T23:26:16.815 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46 2023-12-15T23:26:16.815 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:doSIH04iDZo6fgRI4nLJUqdU5DU= 2023-12-15T23:26:16.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:doSIH04iDZo6fgRI4nLJUqdU5DU=', 'Content-Length': '0'} 2023-12-15T23:26:16.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ea073b415974127-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.818 DEBUG:boto:path=/kskgfn-49/obj46 2023-12-15T23:26:16.818 DEBUG:boto:auth_path=/kskgfn-49/obj46 2023-12-15T23:26:16.818 DEBUG:boto:Method: GET 2023-12-15T23:26:16.818 DEBUG:boto:Path: /kskgfn-49/obj46 2023-12-15T23:26:16.818 DEBUG:boto:Data: 2023-12-15T23:26:16.818 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.818 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.818 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.818 DEBUG:boto:Params: {} 2023-12-15T23:26:16.819 DEBUG:boto:Token: None 2023-12-15T23:26:16.819 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj46 2023-12-15T23:26:16.819 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:doSIH04iDZo6fgRI4nLJUqdU5DU= 2023-12-15T23:26:16.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:doSIH04iDZo6fgRI4nLJUqdU5DU=', 'Content-Length': '0'} 2023-12-15T23:26:16.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beca17bf9094ee64-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.865 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.866 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.866 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.866 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.866 DEBUG:boto:Method: GET 2023-12-15T23:26:16.866 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.866 DEBUG:boto:Data: 2023-12-15T23:26:16.866 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.866 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.866 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.867 DEBUG:boto:Params: {} 2023-12-15T23:26:16.867 DEBUG:boto:Token: None 2023-12-15T23:26:16.867 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.867 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.869 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9e89339e0949c5c-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.870 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.870 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.870 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.870 DEBUG:boto:path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.870 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.870 DEBUG:boto:Method: GET 2023-12-15T23:26:16.871 DEBUG:boto:Path: /kskgfn-49/?prefix=obj46 2023-12-15T23:26:16.871 DEBUG:boto:Data: 2023-12-15T23:26:16.871 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.871 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.871 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.871 DEBUG:boto:Params: {} 2023-12-15T23:26:16.871 DEBUG:boto:Token: None 2023-12-15T23:26:16.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.872 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3b4469bb241029d-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.875 DEBUG:boto:b'kskgfn-49obj461000falseobj462023-12-15T23:18:45.695Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:26:16.876 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.876 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.876 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.876 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.876 DEBUG:boto:Method: GET 2023-12-15T23:26:16.876 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.876 DEBUG:boto:Data: 2023-12-15T23:26:16.877 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.877 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.877 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.877 DEBUG:boto:Params: {} 2023-12-15T23:26:16.877 DEBUG:boto:Token: None 2023-12-15T23:26:16.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M= 2023-12-15T23:26:16.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M=', 'Content-Length': '0'} 2023-12-15T23:26:16.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a57b4845eba480f-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.921 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.922 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.922 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.922 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.922 DEBUG:boto:Method: GET 2023-12-15T23:26:16.922 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.922 DEBUG:boto:Data: 2023-12-15T23:26:16.922 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.923 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.923 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.923 DEBUG:boto:Params: {} 2023-12-15T23:26:16.923 DEBUG:boto:Token: None 2023-12-15T23:26:16.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M= 2023-12-15T23:26:16.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M=', 'Content-Length': '0'} 2023-12-15T23:26:16.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa5bc95bb694c2e1-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.926 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.926 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.926 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.926 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.926 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.926 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.926 DEBUG:boto:Data: 2023-12-15T23:26:16.926 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.926 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.927 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.927 DEBUG:boto:Params: {} 2023-12-15T23:26:16.927 DEBUG:boto:Token: None 2023-12-15T23:26:16.927 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.927 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vcBQPx9SCUswZ1R8o9yTQ3hsVoc= 2023-12-15T23:26:16.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vcBQPx9SCUswZ1R8o9yTQ3hsVoc=', 'Content-Length': '0'} 2023-12-15T23:26:16.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045458f019e4a6895-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.929 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.930 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.930 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.930 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.930 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.930 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.930 DEBUG:boto:Data: 2023-12-15T23:26:16.930 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.930 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.930 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.931 DEBUG:boto:Params: {} 2023-12-15T23:26:16.931 DEBUG:boto:Token: None 2023-12-15T23:26:16.931 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.931 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vcBQPx9SCUswZ1R8o9yTQ3hsVoc= 2023-12-15T23:26:16.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vcBQPx9SCUswZ1R8o9yTQ3hsVoc=', 'Content-Length': '0'} 2023-12-15T23:26:16.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4f7e50cc9e0f5a3-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:26:16.933 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.933 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.934 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.934 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.934 DEBUG:boto:Method: GET 2023-12-15T23:26:16.934 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.934 DEBUG:boto:Data: 2023-12-15T23:26:16.934 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.934 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.934 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.934 DEBUG:boto:Params: {} 2023-12-15T23:26:16.935 DEBUG:boto:Token: None 2023-12-15T23:26:16.935 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.935 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M= 2023-12-15T23:26:16.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M=', 'Content-Length': '0'} 2023-12-15T23:26:16.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000434e2d3375bbb705-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.937 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.937 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.937 DEBUG:boto:path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.937 DEBUG:boto:auth_path=/kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.938 DEBUG:boto:Method: GET 2023-12-15T23:26:16.938 DEBUG:boto:Path: /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.938 DEBUG:boto:Data: 2023-12-15T23:26:16.938 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.938 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.938 DEBUG:boto:Params: {} 2023-12-15T23:26:16.938 DEBUG:boto:Token: None 2023-12-15T23:26:16.938 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51?versionId=null 2023-12-15T23:26:16.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M= 2023-12-15T23:26:16.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1C4Ije+c4HDSyIKnUOP1/sdrI3M=', 'Content-Length': '0'} 2023-12-15T23:26:16.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffa970409b6f8e2b-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.941 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.941 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.941 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.941 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.941 DEBUG:boto:Method: GET 2023-12-15T23:26:16.942 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.942 DEBUG:boto:Data: 2023-12-15T23:26:16.942 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.942 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.942 DEBUG:boto:Params: {} 2023-12-15T23:26:16.942 DEBUG:boto:Token: None 2023-12-15T23:26:16.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.943 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc4a9d5e9c1cef62-00657ce098-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.945 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.945 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:16.946 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:16.946 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.946 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.946 DEBUG:boto:Method: GET 2023-12-15T23:26:16.946 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:26:16.946 DEBUG:boto:Data: 2023-12-15T23:26:16.946 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.946 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.946 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.946 DEBUG:boto:Params: {} 2023-12-15T23:26:16.947 DEBUG:boto:Token: None 2023-12-15T23:26:16.947 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/ 2023-12-15T23:26:16.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc= 2023-12-15T23:26:16.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bs7D6TSNTjjGDhCT8c5qJLJYbKc=', 'Content-Length': '0'} 2023-12-15T23:26:16.951 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b66bee277613d639-00657ce098-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.951 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:16.951 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.951 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.952 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.952 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:26:16.952 DEBUG:boto:Data: 2023-12-15T23:26:16.952 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.952 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.952 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.952 DEBUG:boto:Params: {} 2023-12-15T23:26:16.952 DEBUG:boto:Token: None 2023-12-15T23:26:16.952 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51 2023-12-15T23:26:16.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GgVbJcFJGTpY4wKr61nE3wy4Ik0= 2023-12-15T23:26:16.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GgVbJcFJGTpY4wKr61nE3wy4Ik0=', 'Content-Length': '0'} 2023-12-15T23:26:16.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087f759a460616e0f-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.955 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.955 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.955 DEBUG:boto:Method: HEAD 2023-12-15T23:26:16.955 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:26:16.955 DEBUG:boto:Data: 2023-12-15T23:26:16.955 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.955 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.955 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.955 DEBUG:boto:Params: {} 2023-12-15T23:26:16.955 DEBUG:boto:Token: None 2023-12-15T23:26:16.956 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51 2023-12-15T23:26:16.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GgVbJcFJGTpY4wKr61nE3wy4Ik0= 2023-12-15T23:26:16.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GgVbJcFJGTpY4wKr61nE3wy4Ik0=', 'Content-Length': '0'} 2023-12-15T23:26:16.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000850667dbbb01abf0-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.958 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:26:16.958 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.958 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.958 DEBUG:boto:Method: GET 2023-12-15T23:26:16.958 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:26:16.958 DEBUG:boto:Data: 2023-12-15T23:26:16.958 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.959 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:16.959 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.959 DEBUG:boto:Params: {} 2023-12-15T23:26:16.959 DEBUG:boto:Token: None 2023-12-15T23:26:16.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51 2023-12-15T23:26:16.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3TMn8tcvv9BFc0AzWtcmqlyA0FY= 2023-12-15T23:26:16.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3TMn8tcvv9BFc0AzWtcmqlyA0FY=', 'Content-Length': '0'} 2023-12-15T23:26:16.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f272a0a4bd64a9c-00657ce098-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:16.961 DEBUG:boto:path=/kskgfn-49/obj51 2023-12-15T23:26:16.962 DEBUG:boto:auth_path=/kskgfn-49/obj51 2023-12-15T23:26:16.962 DEBUG:boto:Method: GET 2023-12-15T23:26:16.962 DEBUG:boto:Path: /kskgfn-49/obj51 2023-12-15T23:26:16.962 DEBUG:boto:Data: 2023-12-15T23:26:16.962 DEBUG:boto:Headers: {} 2023-12-15T23:26:16.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:16.962 DEBUG:boto:Port: 8000 2023-12-15T23:26:16.962 DEBUG:boto:Params: {} 2023-12-15T23:26:16.962 DEBUG:boto:Token: None 2023-12-15T23:26:16.963 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:16 GMT /kskgfn-49/obj51 2023-12-15T23:26:16.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3TMn8tcvv9BFc0AzWtcmqlyA0FY= 2023-12-15T23:26:16.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:16 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3TMn8tcvv9BFc0AzWtcmqlyA0FY=', 'Content-Length': '0'} 2023-12-15T23:26:16.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b94afe18efb999f-00657ce098-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:16 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.005 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.006 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.006 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.006 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.006 DEBUG:boto:Method: GET 2023-12-15T23:26:17.006 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.006 DEBUG:boto:Data: 2023-12-15T23:26:17.006 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.006 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.006 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.006 DEBUG:boto:Params: {} 2023-12-15T23:26:17.007 DEBUG:boto:Token: None 2023-12-15T23:26:17.007 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.007 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff8826df8943b4ff-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.009 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.010 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.010 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.010 DEBUG:boto:path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.010 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.010 DEBUG:boto:Method: GET 2023-12-15T23:26:17.010 DEBUG:boto:Path: /kskgfn-49/?prefix=obj51 2023-12-15T23:26:17.010 DEBUG:boto:Data: 2023-12-15T23:26:17.010 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.010 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.011 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.011 DEBUG:boto:Params: {} 2023-12-15T23:26:17.011 DEBUG:boto:Token: None 2023-12-15T23:26:17.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.015 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000024337960ce01754-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.015 DEBUG:boto:b'kskgfn-49obj511000falseobj512023-12-15T23:16:20.028Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:26:17.015 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.015 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.015 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.016 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.016 DEBUG:boto:Method: GET 2023-12-15T23:26:17.016 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.016 DEBUG:boto:Data: 2023-12-15T23:26:17.016 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.016 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.016 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.016 DEBUG:boto:Params: {} 2023-12-15T23:26:17.016 DEBUG:boto:Token: None 2023-12-15T23:26:17.016 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.017 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4= 2023-12-15T23:26:17.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4=', 'Content-Length': '0'} 2023-12-15T23:26:17.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e66f7e99aa0d8e3-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.020 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.020 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.020 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.020 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.020 DEBUG:boto:Method: GET 2023-12-15T23:26:17.020 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.020 DEBUG:boto:Data: 2023-12-15T23:26:17.020 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.020 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.020 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.020 DEBUG:boto:Params: {} 2023-12-15T23:26:17.020 DEBUG:boto:Token: None 2023-12-15T23:26:17.021 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.021 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4= 2023-12-15T23:26:17.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4=', 'Content-Length': '0'} 2023-12-15T23:26:17.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa1f12c71399fe36-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.023 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.023 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.024 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.024 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.024 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.024 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.024 DEBUG:boto:Data: 2023-12-15T23:26:17.024 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.024 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.024 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.024 DEBUG:boto:Params: {} 2023-12-15T23:26:17.024 DEBUG:boto:Token: None 2023-12-15T23:26:17.025 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.025 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY++odOmTa62cHVqKCKi9EQsi8M= 2023-12-15T23:26:17.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY++odOmTa62cHVqKCKi9EQsi8M=', 'Content-Length': '0'} 2023-12-15T23:26:17.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3074cfb7c83b806-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.027 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.027 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.027 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.028 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.028 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.028 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.028 DEBUG:boto:Data: 2023-12-15T23:26:17.028 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.028 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.028 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.028 DEBUG:boto:Params: {} 2023-12-15T23:26:17.028 DEBUG:boto:Token: None 2023-12-15T23:26:17.028 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.029 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IY++odOmTa62cHVqKCKi9EQsi8M= 2023-12-15T23:26:17.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IY++odOmTa62cHVqKCKi9EQsi8M=', 'Content-Length': '0'} 2023-12-15T23:26:17.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bdb3d8f1de25355-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:26:17.031 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.032 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.032 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.032 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.032 DEBUG:boto:Method: GET 2023-12-15T23:26:17.032 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.032 DEBUG:boto:Data: 2023-12-15T23:26:17.032 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.032 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.032 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.032 DEBUG:boto:Params: {} 2023-12-15T23:26:17.032 DEBUG:boto:Token: None 2023-12-15T23:26:17.032 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.033 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4= 2023-12-15T23:26:17.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4=', 'Content-Length': '0'} 2023-12-15T23:26:17.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000959041e78d6ee85f-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.077 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.078 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.078 DEBUG:boto:path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.078 DEBUG:boto:auth_path=/kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.078 DEBUG:boto:Method: GET 2023-12-15T23:26:17.078 DEBUG:boto:Path: /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.078 DEBUG:boto:Data: 2023-12-15T23:26:17.078 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.078 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.079 DEBUG:boto:Params: {} 2023-12-15T23:26:17.079 DEBUG:boto:Token: None 2023-12-15T23:26:17.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55?versionId=null 2023-12-15T23:26:17.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4= 2023-12-15T23:26:17.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2sctTp2mUchA5f8X3QBWXC55y4=', 'Content-Length': '0'} 2023-12-15T23:26:17.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003da0877d75bd2549-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.082 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.082 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.082 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.082 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.082 DEBUG:boto:Method: GET 2023-12-15T23:26:17.082 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.082 DEBUG:boto:Data: 2023-12-15T23:26:17.082 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.083 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.083 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.083 DEBUG:boto:Params: {} 2023-12-15T23:26:17.083 DEBUG:boto:Token: None 2023-12-15T23:26:17.083 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067cb347bfc9a528d-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.086 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.086 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.086 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.087 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.087 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.087 DEBUG:boto:Method: GET 2023-12-15T23:26:17.087 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.087 DEBUG:boto:Data: 2023-12-15T23:26:17.087 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.087 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.087 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.087 DEBUG:boto:Params: {} 2023-12-15T23:26:17.087 DEBUG:boto:Token: None 2023-12-15T23:26:17.088 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.088 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.091 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a04bd2232281248-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.133 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.134 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.134 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.134 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.134 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:26:17.134 DEBUG:boto:Data: 2023-12-15T23:26:17.134 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.134 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.134 DEBUG:boto:Params: {} 2023-12-15T23:26:17.135 DEBUG:boto:Token: None 2023-12-15T23:26:17.135 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55 2023-12-15T23:26:17.135 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rFWIgMw0xer2RdRyHcpms8wj8q0= 2023-12-15T23:26:17.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rFWIgMw0xer2RdRyHcpms8wj8q0=', 'Content-Length': '0'} 2023-12-15T23:26:17.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005cb4da4657fa9191-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.138 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.138 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.138 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.138 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:26:17.138 DEBUG:boto:Data: 2023-12-15T23:26:17.138 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.138 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.138 DEBUG:boto:Params: {} 2023-12-15T23:26:17.138 DEBUG:boto:Token: None 2023-12-15T23:26:17.138 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55 2023-12-15T23:26:17.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rFWIgMw0xer2RdRyHcpms8wj8q0= 2023-12-15T23:26:17.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rFWIgMw0xer2RdRyHcpms8wj8q0=', 'Content-Length': '0'} 2023-12-15T23:26:17.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef433ec2129131a2-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:26:17.141 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.141 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.141 DEBUG:boto:Method: GET 2023-12-15T23:26:17.141 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:26:17.141 DEBUG:boto:Data: 2023-12-15T23:26:17.141 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.141 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.142 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.142 DEBUG:boto:Params: {} 2023-12-15T23:26:17.142 DEBUG:boto:Token: None 2023-12-15T23:26:17.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55 2023-12-15T23:26:17.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:203whGYswFnibS4qC17EcshrWks= 2023-12-15T23:26:17.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:203whGYswFnibS4qC17EcshrWks=', 'Content-Length': '0'} 2023-12-15T23:26:17.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084cf7b0d8ff3ce2c-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.145 DEBUG:boto:path=/kskgfn-49/obj55 2023-12-15T23:26:17.145 DEBUG:boto:auth_path=/kskgfn-49/obj55 2023-12-15T23:26:17.145 DEBUG:boto:Method: GET 2023-12-15T23:26:17.145 DEBUG:boto:Path: /kskgfn-49/obj55 2023-12-15T23:26:17.145 DEBUG:boto:Data: 2023-12-15T23:26:17.145 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.145 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.145 DEBUG:boto:Params: {} 2023-12-15T23:26:17.145 DEBUG:boto:Token: None 2023-12-15T23:26:17.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj55 2023-12-15T23:26:17.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:203whGYswFnibS4qC17EcshrWks= 2023-12-15T23:26:17.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:203whGYswFnibS4qC17EcshrWks=', 'Content-Length': '0'} 2023-12-15T23:26:17.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:03 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa24e1c08e317edb-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.149 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.149 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.149 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.149 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.149 DEBUG:boto:Method: GET 2023-12-15T23:26:17.149 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.149 DEBUG:boto:Data: 2023-12-15T23:26:17.149 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.149 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.149 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.149 DEBUG:boto:Params: {} 2023-12-15T23:26:17.150 DEBUG:boto:Token: None 2023-12-15T23:26:17.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064b280a4736f0c95-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.152 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.153 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.153 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.153 DEBUG:boto:path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.153 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.153 DEBUG:boto:Method: GET 2023-12-15T23:26:17.153 DEBUG:boto:Path: /kskgfn-49/?prefix=obj55 2023-12-15T23:26:17.153 DEBUG:boto:Data: 2023-12-15T23:26:17.153 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.153 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.153 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.154 DEBUG:boto:Params: {} 2023-12-15T23:26:17.154 DEBUG:boto:Token: None 2023-12-15T23:26:17.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2076836c07c0f4b-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.157 DEBUG:boto:b'kskgfn-49obj551000falseobj552023-12-15T23:16:03.643Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:26:17.158 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.158 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.158 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.158 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.158 DEBUG:boto:Method: GET 2023-12-15T23:26:17.158 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.158 DEBUG:boto:Data: 2023-12-15T23:26:17.158 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.159 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.159 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.159 DEBUG:boto:Params: {} 2023-12-15T23:26:17.159 DEBUG:boto:Token: None 2023-12-15T23:26:17.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ= 2023-12-15T23:26:17.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ=', 'Content-Length': '0'} 2023-12-15T23:26:17.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1be5140249af630-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.162 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.162 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.162 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.162 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.162 DEBUG:boto:Method: GET 2023-12-15T23:26:17.162 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.162 DEBUG:boto:Data: 2023-12-15T23:26:17.162 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.162 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.163 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.163 DEBUG:boto:Params: {} 2023-12-15T23:26:17.163 DEBUG:boto:Token: None 2023-12-15T23:26:17.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.163 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ= 2023-12-15T23:26:17.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ=', 'Content-Length': '0'} 2023-12-15T23:26:17.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000514d9ca437988d65-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.165 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.165 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.165 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.165 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.166 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.166 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.166 DEBUG:boto:Data: 2023-12-15T23:26:17.166 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.166 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.166 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.166 DEBUG:boto:Params: {} 2023-12-15T23:26:17.166 DEBUG:boto:Token: None 2023-12-15T23:26:17.166 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HSl031962Ua+6duMRdw4ueG7P10= 2023-12-15T23:26:17.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HSl031962Ua+6duMRdw4ueG7P10=', 'Content-Length': '0'} 2023-12-15T23:26:17.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a3364637f3a9dd8-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.169 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.169 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.169 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.169 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.169 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.169 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.169 DEBUG:boto:Data: 2023-12-15T23:26:17.169 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.169 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.169 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.170 DEBUG:boto:Params: {} 2023-12-15T23:26:17.170 DEBUG:boto:Token: None 2023-12-15T23:26:17.170 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.170 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HSl031962Ua+6duMRdw4ueG7P10= 2023-12-15T23:26:17.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HSl031962Ua+6duMRdw4ueG7P10=', 'Content-Length': '0'} 2023-12-15T23:26:17.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc9b1e2de58589c-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:26:17.173 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.173 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.173 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.173 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.173 DEBUG:boto:Method: GET 2023-12-15T23:26:17.173 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.173 DEBUG:boto:Data: 2023-12-15T23:26:17.173 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.173 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.173 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.173 DEBUG:boto:Params: {} 2023-12-15T23:26:17.174 DEBUG:boto:Token: None 2023-12-15T23:26:17.174 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ= 2023-12-15T23:26:17.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ=', 'Content-Length': '0'} 2023-12-15T23:26:17.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a3939e03d29ad7a-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.176 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.176 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.176 DEBUG:boto:path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.177 DEBUG:boto:auth_path=/kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.177 DEBUG:boto:Method: GET 2023-12-15T23:26:17.177 DEBUG:boto:Path: /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.177 DEBUG:boto:Data: 2023-12-15T23:26:17.177 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.177 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.177 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.177 DEBUG:boto:Params: {} 2023-12-15T23:26:17.177 DEBUG:boto:Token: None 2023-12-15T23:26:17.177 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57?versionId=null 2023-12-15T23:26:17.177 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ= 2023-12-15T23:26:17.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6qbRDZt4UZxuC2a7HZcUQRVxabQ=', 'Content-Length': '0'} 2023-12-15T23:26:17.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0b0e33d776d9f3d-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.180 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.180 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.180 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.180 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.180 DEBUG:boto:Method: GET 2023-12-15T23:26:17.180 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.180 DEBUG:boto:Data: 2023-12-15T23:26:17.180 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.180 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.180 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.180 DEBUG:boto:Params: {} 2023-12-15T23:26:17.181 DEBUG:boto:Token: None 2023-12-15T23:26:17.181 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.181 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.183 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030309ab2cd370578-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.183 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.184 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.184 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.184 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.184 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.184 DEBUG:boto:Method: GET 2023-12-15T23:26:17.184 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.184 DEBUG:boto:Data: 2023-12-15T23:26:17.184 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.184 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.185 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.185 DEBUG:boto:Params: {} 2023-12-15T23:26:17.185 DEBUG:boto:Token: None 2023-12-15T23:26:17.185 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.185 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.188 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088d9af287390b31f-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.189 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.189 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.189 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.189 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.189 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:26:17.189 DEBUG:boto:Data: 2023-12-15T23:26:17.189 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.190 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.190 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.190 DEBUG:boto:Params: {} 2023-12-15T23:26:17.190 DEBUG:boto:Token: None 2023-12-15T23:26:17.190 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57 2023-12-15T23:26:17.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zWzDRgCfgfKZdWaPLRnrRvqncC0= 2023-12-15T23:26:17.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zWzDRgCfgfKZdWaPLRnrRvqncC0=', 'Content-Length': '0'} 2023-12-15T23:26:17.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc184a588d143954-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.192 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.192 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.192 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.193 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:26:17.193 DEBUG:boto:Data: 2023-12-15T23:26:17.193 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.193 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.193 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.193 DEBUG:boto:Params: {} 2023-12-15T23:26:17.193 DEBUG:boto:Token: None 2023-12-15T23:26:17.193 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57 2023-12-15T23:26:17.193 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zWzDRgCfgfKZdWaPLRnrRvqncC0= 2023-12-15T23:26:17.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zWzDRgCfgfKZdWaPLRnrRvqncC0=', 'Content-Length': '0'} 2023-12-15T23:26:17.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb66dbf2ee4c4e5e-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:26:17.196 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.196 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.196 DEBUG:boto:Method: GET 2023-12-15T23:26:17.196 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:26:17.196 DEBUG:boto:Data: 2023-12-15T23:26:17.196 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.196 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.196 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.197 DEBUG:boto:Params: {} 2023-12-15T23:26:17.197 DEBUG:boto:Token: None 2023-12-15T23:26:17.197 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57 2023-12-15T23:26:17.197 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fVudtbxDFzZk0KA2pMPVqu/SWc= 2023-12-15T23:26:17.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fVudtbxDFzZk0KA2pMPVqu/SWc=', 'Content-Length': '0'} 2023-12-15T23:26:17.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e2b73a594bdd0fe-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.199 DEBUG:boto:path=/kskgfn-49/obj57 2023-12-15T23:26:17.200 DEBUG:boto:auth_path=/kskgfn-49/obj57 2023-12-15T23:26:17.200 DEBUG:boto:Method: GET 2023-12-15T23:26:17.200 DEBUG:boto:Path: /kskgfn-49/obj57 2023-12-15T23:26:17.200 DEBUG:boto:Data: 2023-12-15T23:26:17.200 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.200 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.200 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.200 DEBUG:boto:Params: {} 2023-12-15T23:26:17.200 DEBUG:boto:Token: None 2023-12-15T23:26:17.200 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj57 2023-12-15T23:26:17.201 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2fVudtbxDFzZk0KA2pMPVqu/SWc= 2023-12-15T23:26:17.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2fVudtbxDFzZk0KA2pMPVqu/SWc=', 'Content-Length': '0'} 2023-12-15T23:26:17.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a95a39121f4b701a-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.203 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.203 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.203 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.204 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.204 DEBUG:boto:Method: GET 2023-12-15T23:26:17.204 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.204 DEBUG:boto:Data: 2023-12-15T23:26:17.204 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.204 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.204 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.204 DEBUG:boto:Params: {} 2023-12-15T23:26:17.204 DEBUG:boto:Token: None 2023-12-15T23:26:17.204 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.204 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8d9571f266b1867-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.207 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.208 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.208 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.208 DEBUG:boto:path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.208 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.208 DEBUG:boto:Method: GET 2023-12-15T23:26:17.208 DEBUG:boto:Path: /kskgfn-49/?prefix=obj57 2023-12-15T23:26:17.208 DEBUG:boto:Data: 2023-12-15T23:26:17.208 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.208 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.208 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.208 DEBUG:boto:Params: {} 2023-12-15T23:26:17.209 DEBUG:boto:Token: None 2023-12-15T23:26:17.209 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.209 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000541f30a046e78cc7-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.212 DEBUG:boto:b'kskgfn-49obj571000falseobj572023-12-15T23:17:37.396Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:26:17.213 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.213 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.213 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.213 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.213 DEBUG:boto:Method: GET 2023-12-15T23:26:17.213 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.213 DEBUG:boto:Data: 2023-12-15T23:26:17.214 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.214 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.214 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.214 DEBUG:boto:Params: {} 2023-12-15T23:26:17.214 DEBUG:boto:Token: None 2023-12-15T23:26:17.214 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.214 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs= 2023-12-15T23:26:17.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs=', 'Content-Length': '0'} 2023-12-15T23:26:17.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094d7a1c2de1def95-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.257 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.258 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.258 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.258 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.258 DEBUG:boto:Method: GET 2023-12-15T23:26:17.258 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.258 DEBUG:boto:Data: 2023-12-15T23:26:17.258 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.258 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.258 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.258 DEBUG:boto:Params: {} 2023-12-15T23:26:17.258 DEBUG:boto:Token: None 2023-12-15T23:26:17.259 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs= 2023-12-15T23:26:17.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs=', 'Content-Length': '0'} 2023-12-15T23:26:17.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf68779de96bd2e8-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.261 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.261 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.261 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.261 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.261 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.261 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.262 DEBUG:boto:Data: 2023-12-15T23:26:17.262 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.262 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.262 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.262 DEBUG:boto:Params: {} 2023-12-15T23:26:17.262 DEBUG:boto:Token: None 2023-12-15T23:26:17.262 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D03WNXPwfZL/SBlzA3FGiUPk1YE= 2023-12-15T23:26:17.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D03WNXPwfZL/SBlzA3FGiUPk1YE=', 'Content-Length': '0'} 2023-12-15T23:26:17.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005dbcb8dc2b27abfc-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.264 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.264 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.264 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.265 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.265 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.265 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.265 DEBUG:boto:Data: 2023-12-15T23:26:17.265 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.265 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.265 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.265 DEBUG:boto:Params: {} 2023-12-15T23:26:17.265 DEBUG:boto:Token: None 2023-12-15T23:26:17.265 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D03WNXPwfZL/SBlzA3FGiUPk1YE= 2023-12-15T23:26:17.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D03WNXPwfZL/SBlzA3FGiUPk1YE=', 'Content-Length': '0'} 2023-12-15T23:26:17.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000904c96d66755bd0f-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:26:17.268 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.268 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.268 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.268 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.268 DEBUG:boto:Method: GET 2023-12-15T23:26:17.268 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.268 DEBUG:boto:Data: 2023-12-15T23:26:17.268 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.268 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.269 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.269 DEBUG:boto:Params: {} 2023-12-15T23:26:17.269 DEBUG:boto:Token: None 2023-12-15T23:26:17.269 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.269 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs= 2023-12-15T23:26:17.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs=', 'Content-Length': '0'} 2023-12-15T23:26:17.271 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bf96580d5090ab1-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.271 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.271 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.271 DEBUG:boto:path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.271 DEBUG:boto:auth_path=/kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.272 DEBUG:boto:Method: GET 2023-12-15T23:26:17.272 DEBUG:boto:Path: /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.272 DEBUG:boto:Data: 2023-12-15T23:26:17.272 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.272 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.272 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.272 DEBUG:boto:Params: {} 2023-12-15T23:26:17.272 DEBUG:boto:Token: None 2023-12-15T23:26:17.272 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58?versionId=null 2023-12-15T23:26:17.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs= 2023-12-15T23:26:17.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0RqYxuXR2SWw39/c4TNhrbI6ngs=', 'Content-Length': '0'} 2023-12-15T23:26:17.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a9bc34145f10051-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.275 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.275 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.275 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.275 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.275 DEBUG:boto:Method: GET 2023-12-15T23:26:17.275 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.275 DEBUG:boto:Data: 2023-12-15T23:26:17.276 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.276 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.276 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.276 DEBUG:boto:Params: {} 2023-12-15T23:26:17.276 DEBUG:boto:Token: None 2023-12-15T23:26:17.276 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.276 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.279 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe76898836a8721b-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.279 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.279 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.279 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.279 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.280 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.280 DEBUG:boto:Method: GET 2023-12-15T23:26:17.280 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.280 DEBUG:boto:Data: 2023-12-15T23:26:17.280 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.280 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.280 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.280 DEBUG:boto:Params: {} 2023-12-15T23:26:17.280 DEBUG:boto:Token: None 2023-12-15T23:26:17.280 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.280 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe942772e7071782-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.325 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.326 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.326 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.326 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.326 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:26:17.326 DEBUG:boto:Data: 2023-12-15T23:26:17.326 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.326 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.327 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.327 DEBUG:boto:Params: {} 2023-12-15T23:26:17.327 DEBUG:boto:Token: None 2023-12-15T23:26:17.327 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58 2023-12-15T23:26:17.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r7+1Nz9HND0boCyNiYiR0HSiffY= 2023-12-15T23:26:17.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r7+1Nz9HND0boCyNiYiR0HSiffY=', 'Content-Length': '0'} 2023-12-15T23:26:17.329 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0ba01356465ce7e-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.329 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.329 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.329 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.329 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:26:17.330 DEBUG:boto:Data: 2023-12-15T23:26:17.330 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.330 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.330 DEBUG:boto:Params: {} 2023-12-15T23:26:17.330 DEBUG:boto:Token: None 2023-12-15T23:26:17.330 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58 2023-12-15T23:26:17.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:r7+1Nz9HND0boCyNiYiR0HSiffY= 2023-12-15T23:26:17.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:r7+1Nz9HND0boCyNiYiR0HSiffY=', 'Content-Length': '0'} 2023-12-15T23:26:17.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beec259907833be6-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:26:17.332 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.332 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.333 DEBUG:boto:Method: GET 2023-12-15T23:26:17.333 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:26:17.333 DEBUG:boto:Data: 2023-12-15T23:26:17.333 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.333 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.333 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.333 DEBUG:boto:Params: {} 2023-12-15T23:26:17.333 DEBUG:boto:Token: None 2023-12-15T23:26:17.333 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58 2023-12-15T23:26:17.333 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lgJjSq0lvxApR6xonPG2CpPJoJU= 2023-12-15T23:26:17.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lgJjSq0lvxApR6xonPG2CpPJoJU=', 'Content-Length': '0'} 2023-12-15T23:26:17.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b235b6df0021548-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.336 DEBUG:boto:path=/kskgfn-49/obj58 2023-12-15T23:26:17.336 DEBUG:boto:auth_path=/kskgfn-49/obj58 2023-12-15T23:26:17.336 DEBUG:boto:Method: GET 2023-12-15T23:26:17.336 DEBUG:boto:Path: /kskgfn-49/obj58 2023-12-15T23:26:17.336 DEBUG:boto:Data: 2023-12-15T23:26:17.336 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.336 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.336 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.337 DEBUG:boto:Params: {} 2023-12-15T23:26:17.337 DEBUG:boto:Token: None 2023-12-15T23:26:17.337 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj58 2023-12-15T23:26:17.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lgJjSq0lvxApR6xonPG2CpPJoJU= 2023-12-15T23:26:17.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lgJjSq0lvxApR6xonPG2CpPJoJU=', 'Content-Length': '0'} 2023-12-15T23:26:17.339 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025f914f86fbbe394-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.339 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.339 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.339 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.339 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.340 DEBUG:boto:Method: GET 2023-12-15T23:26:17.340 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.340 DEBUG:boto:Data: 2023-12-15T23:26:17.340 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.340 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.340 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.340 DEBUG:boto:Params: {} 2023-12-15T23:26:17.340 DEBUG:boto:Token: None 2023-12-15T23:26:17.340 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.340 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006e6656a647f1903-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.343 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.343 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.343 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.343 DEBUG:boto:path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.343 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.343 DEBUG:boto:Method: GET 2023-12-15T23:26:17.344 DEBUG:boto:Path: /kskgfn-49/?prefix=obj58 2023-12-15T23:26:17.344 DEBUG:boto:Data: 2023-12-15T23:26:17.344 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.344 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.344 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.344 DEBUG:boto:Params: {} 2023-12-15T23:26:17.344 DEBUG:boto:Token: None 2023-12-15T23:26:17.344 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038f00078c59ecbad-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.348 DEBUG:boto:b'kskgfn-49obj581000falseobj582023-12-15T23:20:59.972Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:26:17.349 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.349 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.349 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.349 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.349 DEBUG:boto:Method: GET 2023-12-15T23:26:17.349 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.349 DEBUG:boto:Data: 2023-12-15T23:26:17.349 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.349 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.349 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.349 DEBUG:boto:Params: {} 2023-12-15T23:26:17.350 DEBUG:boto:Token: None 2023-12-15T23:26:17.350 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y= 2023-12-15T23:26:17.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y=', 'Content-Length': '0'} 2023-12-15T23:26:17.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000064ce03628f4b9b8-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.352 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.352 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.352 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.353 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.353 DEBUG:boto:Method: GET 2023-12-15T23:26:17.353 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.353 DEBUG:boto:Data: 2023-12-15T23:26:17.353 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.353 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.353 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.353 DEBUG:boto:Params: {} 2023-12-15T23:26:17.353 DEBUG:boto:Token: None 2023-12-15T23:26:17.353 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y= 2023-12-15T23:26:17.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y=', 'Content-Length': '0'} 2023-12-15T23:26:17.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b52b1161e85af359-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.356 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.357 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.357 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.357 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.357 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.357 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.357 DEBUG:boto:Data: 2023-12-15T23:26:17.357 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.357 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.357 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.357 DEBUG:boto:Params: {} 2023-12-15T23:26:17.358 DEBUG:boto:Token: None 2023-12-15T23:26:17.358 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IclxiyGg2LdE3/3Dff+LRIRgbHw= 2023-12-15T23:26:17.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IclxiyGg2LdE3/3Dff+LRIRgbHw=', 'Content-Length': '0'} 2023-12-15T23:26:17.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ed2b00118f9c154-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.360 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.360 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.360 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.360 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.360 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.360 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.361 DEBUG:boto:Data: 2023-12-15T23:26:17.361 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.361 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.361 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.361 DEBUG:boto:Params: {} 2023-12-15T23:26:17.361 DEBUG:boto:Token: None 2023-12-15T23:26:17.361 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.361 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IclxiyGg2LdE3/3Dff+LRIRgbHw= 2023-12-15T23:26:17.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IclxiyGg2LdE3/3Dff+LRIRgbHw=', 'Content-Length': '0'} 2023-12-15T23:26:17.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000861d9326e6db91bc-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.364 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:26:17.364 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.364 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.364 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.364 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.364 DEBUG:boto:Method: GET 2023-12-15T23:26:17.364 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.364 DEBUG:boto:Data: 2023-12-15T23:26:17.365 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.365 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.365 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.365 DEBUG:boto:Params: {} 2023-12-15T23:26:17.365 DEBUG:boto:Token: None 2023-12-15T23:26:17.365 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.365 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y= 2023-12-15T23:26:17.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y=', 'Content-Length': '0'} 2023-12-15T23:26:17.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046222bb1423d82b2-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.368 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.368 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.368 DEBUG:boto:path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.368 DEBUG:boto:auth_path=/kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.368 DEBUG:boto:Method: GET 2023-12-15T23:26:17.368 DEBUG:boto:Path: /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.368 DEBUG:boto:Data: 2023-12-15T23:26:17.368 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.368 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.368 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.369 DEBUG:boto:Params: {} 2023-12-15T23:26:17.369 DEBUG:boto:Token: None 2023-12-15T23:26:17.369 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62?versionId=null 2023-12-15T23:26:17.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y= 2023-12-15T23:26:17.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pQbwFKlsN6++c+BxdI35+GnnH4Y=', 'Content-Length': '0'} 2023-12-15T23:26:17.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a51fb846f67a5016-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.371 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.372 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.372 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.372 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.372 DEBUG:boto:Method: GET 2023-12-15T23:26:17.372 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.372 DEBUG:boto:Data: 2023-12-15T23:26:17.372 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.372 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.372 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.372 DEBUG:boto:Params: {} 2023-12-15T23:26:17.372 DEBUG:boto:Token: None 2023-12-15T23:26:17.373 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.373 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.375 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008420d54d7ea6a3f9-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.375 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.376 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.376 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.376 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.376 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.376 DEBUG:boto:Method: GET 2023-12-15T23:26:17.376 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.376 DEBUG:boto:Data: 2023-12-15T23:26:17.376 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.376 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.376 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.377 DEBUG:boto:Params: {} 2023-12-15T23:26:17.377 DEBUG:boto:Token: None 2023-12-15T23:26:17.377 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.377 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.381 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad838f847a7b08f8-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.381 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.381 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.381 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.382 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.382 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:26:17.382 DEBUG:boto:Data: 2023-12-15T23:26:17.382 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.382 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.382 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.382 DEBUG:boto:Params: {} 2023-12-15T23:26:17.382 DEBUG:boto:Token: None 2023-12-15T23:26:17.382 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62 2023-12-15T23:26:17.383 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpAJ6Y0L5V+idOaUry4wbABXp54= 2023-12-15T23:26:17.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpAJ6Y0L5V+idOaUry4wbABXp54=', 'Content-Length': '0'} 2023-12-15T23:26:17.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005eb9f9e48ca4564-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.385 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.385 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.385 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.385 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:26:17.385 DEBUG:boto:Data: 2023-12-15T23:26:17.385 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.385 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.385 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.385 DEBUG:boto:Params: {} 2023-12-15T23:26:17.386 DEBUG:boto:Token: None 2023-12-15T23:26:17.386 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62 2023-12-15T23:26:17.386 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DpAJ6Y0L5V+idOaUry4wbABXp54= 2023-12-15T23:26:17.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DpAJ6Y0L5V+idOaUry4wbABXp54=', 'Content-Length': '0'} 2023-12-15T23:26:17.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab524def23ae9101-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:26:17.388 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.388 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.388 DEBUG:boto:Method: GET 2023-12-15T23:26:17.388 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:26:17.388 DEBUG:boto:Data: 2023-12-15T23:26:17.388 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.389 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.389 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.389 DEBUG:boto:Params: {} 2023-12-15T23:26:17.389 DEBUG:boto:Token: None 2023-12-15T23:26:17.389 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62 2023-12-15T23:26:17.389 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gGv4SSH92NcJk/XDUBHFSqsRe2M= 2023-12-15T23:26:17.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gGv4SSH92NcJk/XDUBHFSqsRe2M=', 'Content-Length': '0'} 2023-12-15T23:26:17.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a30e07c8d00c8de5-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.392 DEBUG:boto:path=/kskgfn-49/obj62 2023-12-15T23:26:17.392 DEBUG:boto:auth_path=/kskgfn-49/obj62 2023-12-15T23:26:17.392 DEBUG:boto:Method: GET 2023-12-15T23:26:17.392 DEBUG:boto:Path: /kskgfn-49/obj62 2023-12-15T23:26:17.392 DEBUG:boto:Data: 2023-12-15T23:26:17.392 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.392 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.392 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.392 DEBUG:boto:Params: {} 2023-12-15T23:26:17.392 DEBUG:boto:Token: None 2023-12-15T23:26:17.393 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj62 2023-12-15T23:26:17.393 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gGv4SSH92NcJk/XDUBHFSqsRe2M= 2023-12-15T23:26:17.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gGv4SSH92NcJk/XDUBHFSqsRe2M=', 'Content-Length': '0'} 2023-12-15T23:26:17.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005dd9976a7962ab25-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.395 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.395 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.396 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.396 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.396 DEBUG:boto:Method: GET 2023-12-15T23:26:17.396 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.396 DEBUG:boto:Data: 2023-12-15T23:26:17.396 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.396 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.396 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.396 DEBUG:boto:Params: {} 2023-12-15T23:26:17.396 DEBUG:boto:Token: None 2023-12-15T23:26:17.397 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.397 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096da5593d4e9df0f-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.399 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.400 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.400 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.400 DEBUG:boto:path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.400 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.400 DEBUG:boto:Method: GET 2023-12-15T23:26:17.400 DEBUG:boto:Path: /kskgfn-49/?prefix=obj62 2023-12-15T23:26:17.400 DEBUG:boto:Data: 2023-12-15T23:26:17.400 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.401 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.401 DEBUG:boto:Params: {} 2023-12-15T23:26:17.401 DEBUG:boto:Token: None 2023-12-15T23:26:17.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6b3b0392320d3a8-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.445 DEBUG:boto:b'kskgfn-49obj621000falseobj622023-12-15T23:22:24.630Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.446 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:26:17.446 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.446 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.446 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.446 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.446 DEBUG:boto:Method: GET 2023-12-15T23:26:17.446 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.446 DEBUG:boto:Data: 2023-12-15T23:26:17.446 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.447 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.447 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.447 DEBUG:boto:Params: {} 2023-12-15T23:26:17.447 DEBUG:boto:Token: None 2023-12-15T23:26:17.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk= 2023-12-15T23:26:17.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk=', 'Content-Length': '0'} 2023-12-15T23:26:17.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efc3719951a42af1-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.450 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.450 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.450 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.450 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.450 DEBUG:boto:Method: GET 2023-12-15T23:26:17.450 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.450 DEBUG:boto:Data: 2023-12-15T23:26:17.450 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.451 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.451 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.451 DEBUG:boto:Params: {} 2023-12-15T23:26:17.451 DEBUG:boto:Token: None 2023-12-15T23:26:17.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk= 2023-12-15T23:26:17.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk=', 'Content-Length': '0'} 2023-12-15T23:26:17.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7f9cb1fe128d0bd-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.453 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.454 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.454 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.454 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.454 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.454 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.454 DEBUG:boto:Data: 2023-12-15T23:26:17.454 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.454 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.454 DEBUG:boto:Params: {} 2023-12-15T23:26:17.455 DEBUG:boto:Token: None 2023-12-15T23:26:17.455 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J6XcrXiU9mS7vOwyUaonFgs9Q7U= 2023-12-15T23:26:17.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J6XcrXiU9mS7vOwyUaonFgs9Q7U=', 'Content-Length': '0'} 2023-12-15T23:26:17.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e61f7ddfa2877f49-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.457 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.457 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.457 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.457 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.457 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.458 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.458 DEBUG:boto:Data: 2023-12-15T23:26:17.458 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.458 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.458 DEBUG:boto:Params: {} 2023-12-15T23:26:17.458 DEBUG:boto:Token: None 2023-12-15T23:26:17.458 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J6XcrXiU9mS7vOwyUaonFgs9Q7U= 2023-12-15T23:26:17.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J6XcrXiU9mS7vOwyUaonFgs9Q7U=', 'Content-Length': '0'} 2023-12-15T23:26:17.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed3e3536e93a4c62-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:26:17.461 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.461 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.461 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.461 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.461 DEBUG:boto:Method: GET 2023-12-15T23:26:17.462 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.462 DEBUG:boto:Data: 2023-12-15T23:26:17.462 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.462 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.462 DEBUG:boto:Params: {} 2023-12-15T23:26:17.462 DEBUG:boto:Token: None 2023-12-15T23:26:17.462 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.462 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk= 2023-12-15T23:26:17.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk=', 'Content-Length': '0'} 2023-12-15T23:26:17.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003854773e817030a4-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.505 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.506 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.506 DEBUG:boto:path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.506 DEBUG:boto:auth_path=/kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.506 DEBUG:boto:Method: GET 2023-12-15T23:26:17.506 DEBUG:boto:Path: /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.506 DEBUG:boto:Data: 2023-12-15T23:26:17.506 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.506 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.506 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.506 DEBUG:boto:Params: {} 2023-12-15T23:26:17.506 DEBUG:boto:Token: None 2023-12-15T23:26:17.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68?versionId=null 2023-12-15T23:26:17.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk= 2023-12-15T23:26:17.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OTyXOBc5r95HZhWUSAKS7idcWnk=', 'Content-Length': '0'} 2023-12-15T23:26:17.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bcdd3af3cd311ef-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.509 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.509 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.510 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.510 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.510 DEBUG:boto:Method: GET 2023-12-15T23:26:17.510 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.510 DEBUG:boto:Data: 2023-12-15T23:26:17.510 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.510 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.510 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.510 DEBUG:boto:Params: {} 2023-12-15T23:26:17.510 DEBUG:boto:Token: None 2023-12-15T23:26:17.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.513 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002af9d11ac237b089-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.513 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.513 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.514 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.514 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.514 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.514 DEBUG:boto:Method: GET 2023-12-15T23:26:17.514 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.514 DEBUG:boto:Data: 2023-12-15T23:26:17.514 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.514 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.514 DEBUG:boto:Params: {} 2023-12-15T23:26:17.515 DEBUG:boto:Token: None 2023-12-15T23:26:17.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059c6e4303a442a34-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.519 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.519 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.519 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.519 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.519 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:26:17.519 DEBUG:boto:Data: 2023-12-15T23:26:17.519 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.520 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.520 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.520 DEBUG:boto:Params: {} 2023-12-15T23:26:17.520 DEBUG:boto:Token: None 2023-12-15T23:26:17.520 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68 2023-12-15T23:26:17.520 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UVLOVaR7OTw5jBQZ2g8xbxvJEos= 2023-12-15T23:26:17.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UVLOVaR7OTw5jBQZ2g8xbxvJEos=', 'Content-Length': '0'} 2023-12-15T23:26:17.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027554afb0406c932-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.522 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.522 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.523 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.523 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:26:17.523 DEBUG:boto:Data: 2023-12-15T23:26:17.523 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.523 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.523 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.523 DEBUG:boto:Params: {} 2023-12-15T23:26:17.523 DEBUG:boto:Token: None 2023-12-15T23:26:17.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68 2023-12-15T23:26:17.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UVLOVaR7OTw5jBQZ2g8xbxvJEos= 2023-12-15T23:26:17.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UVLOVaR7OTw5jBQZ2g8xbxvJEos=', 'Content-Length': '0'} 2023-12-15T23:26:17.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da331ebf3b865229-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.526 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:26:17.526 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.526 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.526 DEBUG:boto:Method: GET 2023-12-15T23:26:17.526 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:26:17.526 DEBUG:boto:Data: 2023-12-15T23:26:17.526 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.526 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.526 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.526 DEBUG:boto:Params: {} 2023-12-15T23:26:17.527 DEBUG:boto:Token: None 2023-12-15T23:26:17.527 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68 2023-12-15T23:26:17.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VaPNd2fYOwmlr+IR8zWsejAQYuk= 2023-12-15T23:26:17.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VaPNd2fYOwmlr+IR8zWsejAQYuk=', 'Content-Length': '0'} 2023-12-15T23:26:17.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd716c2ced27af3a-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.529 DEBUG:boto:path=/kskgfn-49/obj68 2023-12-15T23:26:17.532 DEBUG:boto:auth_path=/kskgfn-49/obj68 2023-12-15T23:26:17.532 DEBUG:boto:Method: GET 2023-12-15T23:26:17.533 DEBUG:boto:Path: /kskgfn-49/obj68 2023-12-15T23:26:17.533 DEBUG:boto:Data: 2023-12-15T23:26:17.533 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.533 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.533 DEBUG:boto:Params: {} 2023-12-15T23:26:17.533 DEBUG:boto:Token: None 2023-12-15T23:26:17.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj68 2023-12-15T23:26:17.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VaPNd2fYOwmlr+IR8zWsejAQYuk= 2023-12-15T23:26:17.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VaPNd2fYOwmlr+IR8zWsejAQYuk=', 'Content-Length': '0'} 2023-12-15T23:26:17.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aee90345cc0a84d6-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.536 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.536 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.536 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.536 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.536 DEBUG:boto:Method: GET 2023-12-15T23:26:17.536 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.536 DEBUG:boto:Data: 2023-12-15T23:26:17.537 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.537 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.537 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.537 DEBUG:boto:Params: {} 2023-12-15T23:26:17.537 DEBUG:boto:Token: None 2023-12-15T23:26:17.537 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.537 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007be5c3d063a01319-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.540 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.540 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.540 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.540 DEBUG:boto:path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.540 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.541 DEBUG:boto:Method: GET 2023-12-15T23:26:17.541 DEBUG:boto:Path: /kskgfn-49/?prefix=obj68 2023-12-15T23:26:17.541 DEBUG:boto:Data: 2023-12-15T23:26:17.541 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.541 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.541 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.541 DEBUG:boto:Params: {} 2023-12-15T23:26:17.541 DEBUG:boto:Token: None 2023-12-15T23:26:17.541 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.542 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b38ad2ddf03040e-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.545 DEBUG:boto:b'kskgfn-49obj681000falseobj682023-12-15T23:16:20.038Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.545 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:26:17.546 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.546 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.546 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.546 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.546 DEBUG:boto:Method: GET 2023-12-15T23:26:17.546 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.546 DEBUG:boto:Data: 2023-12-15T23:26:17.546 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.546 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.547 DEBUG:boto:Params: {} 2023-12-15T23:26:17.547 DEBUG:boto:Token: None 2023-12-15T23:26:17.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8= 2023-12-15T23:26:17.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8=', 'Content-Length': '0'} 2023-12-15T23:26:17.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3ac4df97bb8f24a-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.550 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.550 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.550 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.550 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.550 DEBUG:boto:Method: GET 2023-12-15T23:26:17.550 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.550 DEBUG:boto:Data: 2023-12-15T23:26:17.550 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.551 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.551 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.551 DEBUG:boto:Params: {} 2023-12-15T23:26:17.551 DEBUG:boto:Token: None 2023-12-15T23:26:17.551 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.551 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8= 2023-12-15T23:26:17.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8=', 'Content-Length': '0'} 2023-12-15T23:26:17.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e2c6523309729d5-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.554 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.554 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.554 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.554 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.554 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.554 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.554 DEBUG:boto:Data: 2023-12-15T23:26:17.554 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.554 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.554 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.554 DEBUG:boto:Params: {} 2023-12-15T23:26:17.555 DEBUG:boto:Token: None 2023-12-15T23:26:17.555 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8qqF5oH8201QqapRswtMrrnFFDo= 2023-12-15T23:26:17.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8qqF5oH8201QqapRswtMrrnFFDo=', 'Content-Length': '0'} 2023-12-15T23:26:17.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4b21527bc5110a2-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.557 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.557 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.558 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.558 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.558 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.558 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.558 DEBUG:boto:Data: 2023-12-15T23:26:17.558 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.558 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.558 DEBUG:boto:Params: {} 2023-12-15T23:26:17.558 DEBUG:boto:Token: None 2023-12-15T23:26:17.559 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:8qqF5oH8201QqapRswtMrrnFFDo= 2023-12-15T23:26:17.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:8qqF5oH8201QqapRswtMrrnFFDo=', 'Content-Length': '0'} 2023-12-15T23:26:17.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd0e3fc870c4d891-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:26:17.561 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.561 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.561 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.561 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.561 DEBUG:boto:Method: GET 2023-12-15T23:26:17.561 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.561 DEBUG:boto:Data: 2023-12-15T23:26:17.562 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.562 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.562 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.562 DEBUG:boto:Params: {} 2023-12-15T23:26:17.562 DEBUG:boto:Token: None 2023-12-15T23:26:17.562 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.562 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8= 2023-12-15T23:26:17.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8=', 'Content-Length': '0'} 2023-12-15T23:26:17.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bd2d5764e2d63e2-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.605 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.605 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.606 DEBUG:boto:path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.606 DEBUG:boto:auth_path=/kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.606 DEBUG:boto:Method: GET 2023-12-15T23:26:17.606 DEBUG:boto:Path: /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.606 DEBUG:boto:Data: 2023-12-15T23:26:17.606 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.606 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.606 DEBUG:boto:Params: {} 2023-12-15T23:26:17.606 DEBUG:boto:Token: None 2023-12-15T23:26:17.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69?versionId=null 2023-12-15T23:26:17.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8= 2023-12-15T23:26:17.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mrvlmBsvMkeYGZ0Altk9/EP9TW8=', 'Content-Length': '0'} 2023-12-15T23:26:17.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041a621ddfd5bae1b-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.609 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.609 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.609 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.610 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.610 DEBUG:boto:Method: GET 2023-12-15T23:26:17.610 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.610 DEBUG:boto:Data: 2023-12-15T23:26:17.610 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.610 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.610 DEBUG:boto:Params: {} 2023-12-15T23:26:17.610 DEBUG:boto:Token: None 2023-12-15T23:26:17.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056d62addb1d95dd7-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.613 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.613 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.613 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.614 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.614 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.614 DEBUG:boto:Method: GET 2023-12-15T23:26:17.614 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.614 DEBUG:boto:Data: 2023-12-15T23:26:17.614 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.614 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.614 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.614 DEBUG:boto:Params: {} 2023-12-15T23:26:17.614 DEBUG:boto:Token: None 2023-12-15T23:26:17.614 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000285ffe074abdafbb-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.618 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.618 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.619 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.619 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.619 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:26:17.619 DEBUG:boto:Data: 2023-12-15T23:26:17.619 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.619 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.619 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.619 DEBUG:boto:Params: {} 2023-12-15T23:26:17.619 DEBUG:boto:Token: None 2023-12-15T23:26:17.620 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69 2023-12-15T23:26:17.620 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LI4H5rgLv5oSvIHX398te3npcnE= 2023-12-15T23:26:17.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LI4H5rgLv5oSvIHX398te3npcnE=', 'Content-Length': '0'} 2023-12-15T23:26:17.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009adcf8765706e025-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.622 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.622 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.622 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.622 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:26:17.622 DEBUG:boto:Data: 2023-12-15T23:26:17.622 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.622 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.623 DEBUG:boto:Params: {} 2023-12-15T23:26:17.623 DEBUG:boto:Token: None 2023-12-15T23:26:17.623 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69 2023-12-15T23:26:17.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LI4H5rgLv5oSvIHX398te3npcnE= 2023-12-15T23:26:17.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LI4H5rgLv5oSvIHX398te3npcnE=', 'Content-Length': '0'} 2023-12-15T23:26:17.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f5ca52b194d734e-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:26:17.625 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.625 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.626 DEBUG:boto:Method: GET 2023-12-15T23:26:17.626 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:26:17.626 DEBUG:boto:Data: 2023-12-15T23:26:17.626 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.626 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.626 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.626 DEBUG:boto:Params: {} 2023-12-15T23:26:17.626 DEBUG:boto:Token: None 2023-12-15T23:26:17.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69 2023-12-15T23:26:17.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zYtxZgZxWYCaCrSBhvj/AaPiuOo= 2023-12-15T23:26:17.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zYtxZgZxWYCaCrSBhvj/AaPiuOo=', 'Content-Length': '0'} 2023-12-15T23:26:17.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f59ffcf9decca87-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.629 DEBUG:boto:path=/kskgfn-49/obj69 2023-12-15T23:26:17.629 DEBUG:boto:auth_path=/kskgfn-49/obj69 2023-12-15T23:26:17.629 DEBUG:boto:Method: GET 2023-12-15T23:26:17.629 DEBUG:boto:Path: /kskgfn-49/obj69 2023-12-15T23:26:17.629 DEBUG:boto:Data: 2023-12-15T23:26:17.629 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.629 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.630 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.630 DEBUG:boto:Params: {} 2023-12-15T23:26:17.630 DEBUG:boto:Token: None 2023-12-15T23:26:17.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj69 2023-12-15T23:26:17.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zYtxZgZxWYCaCrSBhvj/AaPiuOo= 2023-12-15T23:26:17.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zYtxZgZxWYCaCrSBhvj/AaPiuOo=', 'Content-Length': '0'} 2023-12-15T23:26:17.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000686a7fbf2e295d8e-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.633 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.633 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.633 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.633 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.633 DEBUG:boto:Method: GET 2023-12-15T23:26:17.634 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.634 DEBUG:boto:Data: 2023-12-15T23:26:17.634 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.634 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.634 DEBUG:boto:Params: {} 2023-12-15T23:26:17.634 DEBUG:boto:Token: None 2023-12-15T23:26:17.634 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.634 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fb19d648ce2905b-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.637 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.637 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.637 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.637 DEBUG:boto:path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.637 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.637 DEBUG:boto:Method: GET 2023-12-15T23:26:17.637 DEBUG:boto:Path: /kskgfn-49/?prefix=obj69 2023-12-15T23:26:17.638 DEBUG:boto:Data: 2023-12-15T23:26:17.638 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.638 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.638 DEBUG:boto:Params: {} 2023-12-15T23:26:17.638 DEBUG:boto:Token: None 2023-12-15T23:26:17.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d02cf644af07a352-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.642 DEBUG:boto:b'kskgfn-49obj691000falseobj692023-12-15T23:18:45.743Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:26:17.642 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.642 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.642 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.643 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.643 DEBUG:boto:Method: GET 2023-12-15T23:26:17.643 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.643 DEBUG:boto:Data: 2023-12-15T23:26:17.643 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.643 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.643 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.643 DEBUG:boto:Params: {} 2023-12-15T23:26:17.643 DEBUG:boto:Token: None 2023-12-15T23:26:17.643 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20= 2023-12-15T23:26:17.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20=', 'Content-Length': '0'} 2023-12-15T23:26:17.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000391705b6c89509c1-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.646 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.646 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.646 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.646 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.646 DEBUG:boto:Method: GET 2023-12-15T23:26:17.646 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.647 DEBUG:boto:Data: 2023-12-15T23:26:17.647 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.647 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.647 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.647 DEBUG:boto:Params: {} 2023-12-15T23:26:17.647 DEBUG:boto:Token: None 2023-12-15T23:26:17.647 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.647 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20= 2023-12-15T23:26:17.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20=', 'Content-Length': '0'} 2023-12-15T23:26:17.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c3b718574487c79-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.650 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.650 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.650 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.650 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.650 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.650 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.650 DEBUG:boto:Data: 2023-12-15T23:26:17.650 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.650 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.650 DEBUG:boto:Params: {} 2023-12-15T23:26:17.651 DEBUG:boto:Token: None 2023-12-15T23:26:17.651 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YnLF8ra9FLbSrtCJKW7F0MCLwAU= 2023-12-15T23:26:17.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YnLF8ra9FLbSrtCJKW7F0MCLwAU=', 'Content-Length': '0'} 2023-12-15T23:26:17.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b3bdf9e62be1315-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.653 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.653 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.653 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.653 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.653 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.653 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.654 DEBUG:boto:Data: 2023-12-15T23:26:17.654 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.654 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.654 DEBUG:boto:Params: {} 2023-12-15T23:26:17.654 DEBUG:boto:Token: None 2023-12-15T23:26:17.654 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YnLF8ra9FLbSrtCJKW7F0MCLwAU= 2023-12-15T23:26:17.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YnLF8ra9FLbSrtCJKW7F0MCLwAU=', 'Content-Length': '0'} 2023-12-15T23:26:17.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007edcbd4720ac178a-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:26:17.656 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.657 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.657 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.657 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.657 DEBUG:boto:Method: GET 2023-12-15T23:26:17.657 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.657 DEBUG:boto:Data: 2023-12-15T23:26:17.657 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.657 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.657 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.657 DEBUG:boto:Params: {} 2023-12-15T23:26:17.657 DEBUG:boto:Token: None 2023-12-15T23:26:17.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20= 2023-12-15T23:26:17.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20=', 'Content-Length': '0'} 2023-12-15T23:26:17.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ad6ce810dc60e3e-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.701 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.702 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.702 DEBUG:boto:path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.702 DEBUG:boto:auth_path=/kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.702 DEBUG:boto:Method: GET 2023-12-15T23:26:17.702 DEBUG:boto:Path: /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.702 DEBUG:boto:Data: 2023-12-15T23:26:17.702 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.702 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.702 DEBUG:boto:Params: {} 2023-12-15T23:26:17.703 DEBUG:boto:Token: None 2023-12-15T23:26:17.703 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74?versionId=null 2023-12-15T23:26:17.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20= 2023-12-15T23:26:17.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ISd9/8O1uwMMkUnGdlDEeTsTs20=', 'Content-Length': '0'} 2023-12-15T23:26:17.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000356e37dd587338a1-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.705 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.706 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.706 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.706 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.706 DEBUG:boto:Method: GET 2023-12-15T23:26:17.706 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.706 DEBUG:boto:Data: 2023-12-15T23:26:17.706 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.706 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.706 DEBUG:boto:Params: {} 2023-12-15T23:26:17.707 DEBUG:boto:Token: None 2023-12-15T23:26:17.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f898301cbca09083-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.710 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.710 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.710 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.710 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.711 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.711 DEBUG:boto:Method: GET 2023-12-15T23:26:17.711 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.711 DEBUG:boto:Data: 2023-12-15T23:26:17.711 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.711 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.711 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.711 DEBUG:boto:Params: {} 2023-12-15T23:26:17.711 DEBUG:boto:Token: None 2023-12-15T23:26:17.711 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.712 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.715 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd1db8a980198061-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.715 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.715 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.715 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.716 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.716 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:26:17.716 DEBUG:boto:Data: 2023-12-15T23:26:17.716 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.716 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.716 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.716 DEBUG:boto:Params: {} 2023-12-15T23:26:17.716 DEBUG:boto:Token: None 2023-12-15T23:26:17.716 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74 2023-12-15T23:26:17.716 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cQBl/j6C8ep4nFxnuvq0jxNLrV0= 2023-12-15T23:26:17.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cQBl/j6C8ep4nFxnuvq0jxNLrV0=', 'Content-Length': '0'} 2023-12-15T23:26:17.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043c5ca754dc7b0ee-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.719 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.719 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.719 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.719 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:26:17.719 DEBUG:boto:Data: 2023-12-15T23:26:17.719 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.719 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.719 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.719 DEBUG:boto:Params: {} 2023-12-15T23:26:17.720 DEBUG:boto:Token: None 2023-12-15T23:26:17.720 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74 2023-12-15T23:26:17.720 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cQBl/j6C8ep4nFxnuvq0jxNLrV0= 2023-12-15T23:26:17.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cQBl/j6C8ep4nFxnuvq0jxNLrV0=', 'Content-Length': '0'} 2023-12-15T23:26:17.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7451d7df8155d4f-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:26:17.722 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.722 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.722 DEBUG:boto:Method: GET 2023-12-15T23:26:17.723 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:26:17.723 DEBUG:boto:Data: 2023-12-15T23:26:17.723 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.723 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.723 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.723 DEBUG:boto:Params: {} 2023-12-15T23:26:17.723 DEBUG:boto:Token: None 2023-12-15T23:26:17.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74 2023-12-15T23:26:17.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZPSC8y87+N9EK1naYfVNvHB1aE= 2023-12-15T23:26:17.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZPSC8y87+N9EK1naYfVNvHB1aE=', 'Content-Length': '0'} 2023-12-15T23:26:17.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2cfb22098337735-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.769 DEBUG:boto:path=/kskgfn-49/obj74 2023-12-15T23:26:17.770 DEBUG:boto:auth_path=/kskgfn-49/obj74 2023-12-15T23:26:17.770 DEBUG:boto:Method: GET 2023-12-15T23:26:17.770 DEBUG:boto:Path: /kskgfn-49/obj74 2023-12-15T23:26:17.770 DEBUG:boto:Data: 2023-12-15T23:26:17.770 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.770 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.770 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.770 DEBUG:boto:Params: {} 2023-12-15T23:26:17.770 DEBUG:boto:Token: None 2023-12-15T23:26:17.771 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj74 2023-12-15T23:26:17.771 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OZPSC8y87+N9EK1naYfVNvHB1aE= 2023-12-15T23:26:17.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OZPSC8y87+N9EK1naYfVNvHB1aE=', 'Content-Length': '0'} 2023-12-15T23:26:17.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:24:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ed40e670cac98b2-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.773 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.773 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.773 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.774 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.774 DEBUG:boto:Method: GET 2023-12-15T23:26:17.774 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.774 DEBUG:boto:Data: 2023-12-15T23:26:17.774 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.774 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.774 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.774 DEBUG:boto:Params: {} 2023-12-15T23:26:17.774 DEBUG:boto:Token: None 2023-12-15T23:26:17.774 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2be1a0d524ae2e0-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.777 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.777 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.777 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.778 DEBUG:boto:path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.778 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.778 DEBUG:boto:Method: GET 2023-12-15T23:26:17.778 DEBUG:boto:Path: /kskgfn-49/?prefix=obj74 2023-12-15T23:26:17.778 DEBUG:boto:Data: 2023-12-15T23:26:17.778 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.778 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.778 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.778 DEBUG:boto:Params: {} 2023-12-15T23:26:17.779 DEBUG:boto:Token: None 2023-12-15T23:26:17.779 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.783 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad0c354ac4cf45b9-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.783 DEBUG:boto:b'kskgfn-49obj741000falseobj742023-12-15T23:24:39.986Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.783 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:26:17.783 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.784 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.784 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.784 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.784 DEBUG:boto:Method: GET 2023-12-15T23:26:17.784 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.784 DEBUG:boto:Data: 2023-12-15T23:26:17.784 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.784 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.784 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.785 DEBUG:boto:Params: {} 2023-12-15T23:26:17.785 DEBUG:boto:Token: None 2023-12-15T23:26:17.785 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.785 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig= 2023-12-15T23:26:17.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig=', 'Content-Length': '0'} 2023-12-15T23:26:17.787 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0c2516e67d985e1-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.788 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.788 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.788 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.788 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.788 DEBUG:boto:Method: GET 2023-12-15T23:26:17.788 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.788 DEBUG:boto:Data: 2023-12-15T23:26:17.788 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.788 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.788 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.789 DEBUG:boto:Params: {} 2023-12-15T23:26:17.789 DEBUG:boto:Token: None 2023-12-15T23:26:17.789 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.789 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig= 2023-12-15T23:26:17.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig=', 'Content-Length': '0'} 2023-12-15T23:26:17.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2cc4e273b0f9282-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.833 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.834 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.834 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.834 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.834 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.834 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.834 DEBUG:boto:Data: 2023-12-15T23:26:17.834 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.834 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.834 DEBUG:boto:Params: {} 2023-12-15T23:26:17.835 DEBUG:boto:Token: None 2023-12-15T23:26:17.835 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9ndSTX4aQuVTTaRYPkfhog2iu70= 2023-12-15T23:26:17.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9ndSTX4aQuVTTaRYPkfhog2iu70=', 'Content-Length': '0'} 2023-12-15T23:26:17.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091566956bae458c5-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.837 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.838 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.838 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.838 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.838 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.838 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.838 DEBUG:boto:Data: 2023-12-15T23:26:17.838 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.838 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.838 DEBUG:boto:Params: {} 2023-12-15T23:26:17.838 DEBUG:boto:Token: None 2023-12-15T23:26:17.839 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9ndSTX4aQuVTTaRYPkfhog2iu70= 2023-12-15T23:26:17.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9ndSTX4aQuVTTaRYPkfhog2iu70=', 'Content-Length': '0'} 2023-12-15T23:26:17.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099853c690e6f9a5d-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:26:17.841 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.842 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.842 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.842 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.842 DEBUG:boto:Method: GET 2023-12-15T23:26:17.842 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.842 DEBUG:boto:Data: 2023-12-15T23:26:17.842 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.842 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.842 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.843 DEBUG:boto:Params: {} 2023-12-15T23:26:17.843 DEBUG:boto:Token: None 2023-12-15T23:26:17.843 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.843 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig= 2023-12-15T23:26:17.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig=', 'Content-Length': '0'} 2023-12-15T23:26:17.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e5836dfc995d3b5-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.845 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.846 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.846 DEBUG:boto:path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.846 DEBUG:boto:auth_path=/kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.846 DEBUG:boto:Method: GET 2023-12-15T23:26:17.846 DEBUG:boto:Path: /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.846 DEBUG:boto:Data: 2023-12-15T23:26:17.846 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.846 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.846 DEBUG:boto:Params: {} 2023-12-15T23:26:17.847 DEBUG:boto:Token: None 2023-12-15T23:26:17.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76?versionId=null 2023-12-15T23:26:17.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig= 2023-12-15T23:26:17.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:upKqSo+hvJckxg1OACTbAe5Jiig=', 'Content-Length': '0'} 2023-12-15T23:26:17.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c58aaec711ac95d-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.849 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.850 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.850 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.850 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.850 DEBUG:boto:Method: GET 2023-12-15T23:26:17.850 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.850 DEBUG:boto:Data: 2023-12-15T23:26:17.850 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.850 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.851 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.851 DEBUG:boto:Params: {} 2023-12-15T23:26:17.851 DEBUG:boto:Token: None 2023-12-15T23:26:17.851 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc236ce882fb42e0-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.853 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.854 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.854 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.854 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.854 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.854 DEBUG:boto:Method: GET 2023-12-15T23:26:17.854 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.854 DEBUG:boto:Data: 2023-12-15T23:26:17.855 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.855 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.855 DEBUG:boto:Params: {} 2023-12-15T23:26:17.855 DEBUG:boto:Token: None 2023-12-15T23:26:17.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.859 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045c0bcf1ca678073-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.859 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.859 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.860 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.860 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.860 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:26:17.860 DEBUG:boto:Data: 2023-12-15T23:26:17.860 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.860 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.860 DEBUG:boto:Params: {} 2023-12-15T23:26:17.860 DEBUG:boto:Token: None 2023-12-15T23:26:17.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76 2023-12-15T23:26:17.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CGxXCnJC4yNQq6rL4nm1g4t3xS8= 2023-12-15T23:26:17.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CGxXCnJC4yNQq6rL4nm1g4t3xS8=', 'Content-Length': '0'} 2023-12-15T23:26:17.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000570d15b2dbe43ea1-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.863 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.863 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.863 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.863 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:26:17.864 DEBUG:boto:Data: 2023-12-15T23:26:17.864 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.864 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.864 DEBUG:boto:Params: {} 2023-12-15T23:26:17.864 DEBUG:boto:Token: None 2023-12-15T23:26:17.864 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76 2023-12-15T23:26:17.864 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CGxXCnJC4yNQq6rL4nm1g4t3xS8= 2023-12-15T23:26:17.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CGxXCnJC4yNQq6rL4nm1g4t3xS8=', 'Content-Length': '0'} 2023-12-15T23:26:17.867 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2604e91b80dde4d-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:26:17.867 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.867 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.867 DEBUG:boto:Method: GET 2023-12-15T23:26:17.867 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:26:17.868 DEBUG:boto:Data: 2023-12-15T23:26:17.868 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.868 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.868 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.868 DEBUG:boto:Params: {} 2023-12-15T23:26:17.868 DEBUG:boto:Token: None 2023-12-15T23:26:17.868 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76 2023-12-15T23:26:17.868 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ShFPlgxmdpeqszXzfvqGs5/P3EU= 2023-12-15T23:26:17.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ShFPlgxmdpeqszXzfvqGs5/P3EU=', 'Content-Length': '0'} 2023-12-15T23:26:17.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7098660a887f883-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.913 DEBUG:boto:path=/kskgfn-49/obj76 2023-12-15T23:26:17.914 DEBUG:boto:auth_path=/kskgfn-49/obj76 2023-12-15T23:26:17.914 DEBUG:boto:Method: GET 2023-12-15T23:26:17.914 DEBUG:boto:Path: /kskgfn-49/obj76 2023-12-15T23:26:17.914 DEBUG:boto:Data: 2023-12-15T23:26:17.914 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.914 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.914 DEBUG:boto:Params: {} 2023-12-15T23:26:17.914 DEBUG:boto:Token: None 2023-12-15T23:26:17.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj76 2023-12-15T23:26:17.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ShFPlgxmdpeqszXzfvqGs5/P3EU= 2023-12-15T23:26:17.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ShFPlgxmdpeqszXzfvqGs5/P3EU=', 'Content-Length': '0'} 2023-12-15T23:26:17.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065906ac8c26527e0-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.917 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.917 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.917 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.917 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.918 DEBUG:boto:Method: GET 2023-12-15T23:26:17.918 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.918 DEBUG:boto:Data: 2023-12-15T23:26:17.918 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.918 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.918 DEBUG:boto:Params: {} 2023-12-15T23:26:17.918 DEBUG:boto:Token: None 2023-12-15T23:26:17.918 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a885ee63bfb68d4f-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.922 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.922 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.922 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.922 DEBUG:boto:path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.922 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.922 DEBUG:boto:Method: GET 2023-12-15T23:26:17.923 DEBUG:boto:Path: /kskgfn-49/?prefix=obj76 2023-12-15T23:26:17.923 DEBUG:boto:Data: 2023-12-15T23:26:17.923 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.923 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.923 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.923 DEBUG:boto:Params: {} 2023-12-15T23:26:17.923 DEBUG:boto:Token: None 2023-12-15T23:26:17.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9f7ac52deca0b1e-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.927 DEBUG:boto:b'kskgfn-49obj761000falseobj762023-12-15T23:17:37.405Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:26:17.928 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.928 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.928 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.928 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.928 DEBUG:boto:Method: GET 2023-12-15T23:26:17.928 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.928 DEBUG:boto:Data: 2023-12-15T23:26:17.928 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.928 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.928 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.929 DEBUG:boto:Params: {} 2023-12-15T23:26:17.929 DEBUG:boto:Token: None 2023-12-15T23:26:17.929 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.929 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY= 2023-12-15T23:26:17.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY=', 'Content-Length': '0'} 2023-12-15T23:26:17.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042511385286dfe10-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.931 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.932 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.932 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.932 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.932 DEBUG:boto:Method: GET 2023-12-15T23:26:17.932 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.932 DEBUG:boto:Data: 2023-12-15T23:26:17.932 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.932 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.932 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.932 DEBUG:boto:Params: {} 2023-12-15T23:26:17.933 DEBUG:boto:Token: None 2023-12-15T23:26:17.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY= 2023-12-15T23:26:17.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY=', 'Content-Length': '0'} 2023-12-15T23:26:17.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097499a33e53195c1-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.977 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.977 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.978 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.978 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.978 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.978 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.978 DEBUG:boto:Data: 2023-12-15T23:26:17.978 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.978 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.978 DEBUG:boto:Params: {} 2023-12-15T23:26:17.978 DEBUG:boto:Token: None 2023-12-15T23:26:17.979 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5WF27C39N2P8RICKjWoSx3torhc= 2023-12-15T23:26:17.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5WF27C39N2P8RICKjWoSx3torhc=', 'Content-Length': '0'} 2023-12-15T23:26:17.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a5f3a2dfa4e10a6-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.981 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.981 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.981 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.981 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.982 DEBUG:boto:Method: HEAD 2023-12-15T23:26:17.982 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.982 DEBUG:boto:Data: 2023-12-15T23:26:17.982 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.982 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.982 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.982 DEBUG:boto:Params: {} 2023-12-15T23:26:17.982 DEBUG:boto:Token: None 2023-12-15T23:26:17.982 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.982 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5WF27C39N2P8RICKjWoSx3torhc= 2023-12-15T23:26:17.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5WF27C39N2P8RICKjWoSx3torhc=', 'Content-Length': '0'} 2023-12-15T23:26:17.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004306854a3618b0bc-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:26:17.985 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.985 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.985 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.985 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.986 DEBUG:boto:Method: GET 2023-12-15T23:26:17.986 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.986 DEBUG:boto:Data: 2023-12-15T23:26:17.986 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.986 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.986 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.986 DEBUG:boto:Params: {} 2023-12-15T23:26:17.986 DEBUG:boto:Token: None 2023-12-15T23:26:17.986 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.987 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY= 2023-12-15T23:26:17.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY=', 'Content-Length': '0'} 2023-12-15T23:26:17.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b884b8fb412f2b4-00657ce099-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.989 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:17.989 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:17.989 DEBUG:boto:path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.989 DEBUG:boto:auth_path=/kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.989 DEBUG:boto:Method: GET 2023-12-15T23:26:17.990 DEBUG:boto:Path: /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.990 DEBUG:boto:Data: 2023-12-15T23:26:17.990 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.990 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.990 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.990 DEBUG:boto:Params: {} 2023-12-15T23:26:17.990 DEBUG:boto:Token: None 2023-12-15T23:26:17.990 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/obj85?versionId=null 2023-12-15T23:26:17.990 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY= 2023-12-15T23:26:17.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:supbuWio+cEbPYKC/GrQKEdJ7wY=', 'Content-Length': '0'} 2023-12-15T23:26:17.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e881c4e59e5d93-00657ce099-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.993 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.993 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.993 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.993 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.994 DEBUG:boto:Method: GET 2023-12-15T23:26:17.994 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.994 DEBUG:boto:Data: 2023-12-15T23:26:17.994 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.994 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:17.994 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.994 DEBUG:boto:Params: {} 2023-12-15T23:26:17.994 DEBUG:boto:Token: None 2023-12-15T23:26:17.994 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:17.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019d103a3eb485589-00657ce099-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:17 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:17.997 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:17.998 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:17.998 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:17.998 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.998 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.998 DEBUG:boto:Method: GET 2023-12-15T23:26:17.998 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:26:17.998 DEBUG:boto:Data: 2023-12-15T23:26:17.998 DEBUG:boto:Headers: {} 2023-12-15T23:26:17.998 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:17.998 DEBUG:boto:Port: 8000 2023-12-15T23:26:17.999 DEBUG:boto:Params: {} 2023-12-15T23:26:17.999 DEBUG:boto:Token: None 2023-12-15T23:26:17.999 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:17 GMT /kskgfn-49/ 2023-12-15T23:26:17.999 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU= 2023-12-15T23:26:17.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:17 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OcFvWwnSRaxgSeenCYe6tuneGjU=', 'Content-Length': '0'} 2023-12-15T23:26:18.003 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000103ad08ec9b9c8a2-00657ce099-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.003 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.003 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:18.003 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:18.003 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.004 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:26:18.004 DEBUG:boto:Data: 2023-12-15T23:26:18.004 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.004 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.004 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.004 DEBUG:boto:Params: {} 2023-12-15T23:26:18.004 DEBUG:boto:Token: None 2023-12-15T23:26:18.004 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj85 2023-12-15T23:26:18.004 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oVDaGMzEEwMi3yGRfW6be+1qAy0= 2023-12-15T23:26:18.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oVDaGMzEEwMi3yGRfW6be+1qAy0=', 'Content-Length': '0'} 2023-12-15T23:26:18.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7ac97fbe9acac6f-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.006 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:18.007 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:18.007 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.007 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:26:18.007 DEBUG:boto:Data: 2023-12-15T23:26:18.007 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.007 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.007 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.007 DEBUG:boto:Params: {} 2023-12-15T23:26:18.007 DEBUG:boto:Token: None 2023-12-15T23:26:18.008 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj85 2023-12-15T23:26:18.008 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oVDaGMzEEwMi3yGRfW6be+1qAy0= 2023-12-15T23:26:18.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oVDaGMzEEwMi3yGRfW6be+1qAy0=', 'Content-Length': '0'} 2023-12-15T23:26:18.010 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000278cfe2094d0183-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:26:18.010 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:18.010 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:18.010 DEBUG:boto:Method: GET 2023-12-15T23:26:18.010 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:26:18.010 DEBUG:boto:Data: 2023-12-15T23:26:18.011 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.011 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.011 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.011 DEBUG:boto:Params: {} 2023-12-15T23:26:18.011 DEBUG:boto:Token: None 2023-12-15T23:26:18.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj85 2023-12-15T23:26:18.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDdr5L2/CJomTaEJIoSkFlTvC8Q= 2023-12-15T23:26:18.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDdr5L2/CJomTaEJIoSkFlTvC8Q=', 'Content-Length': '0'} 2023-12-15T23:26:18.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e35622114a58473c-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.057 DEBUG:boto:path=/kskgfn-49/obj85 2023-12-15T23:26:18.058 DEBUG:boto:auth_path=/kskgfn-49/obj85 2023-12-15T23:26:18.058 DEBUG:boto:Method: GET 2023-12-15T23:26:18.058 DEBUG:boto:Path: /kskgfn-49/obj85 2023-12-15T23:26:18.058 DEBUG:boto:Data: 2023-12-15T23:26:18.058 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.058 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.058 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.058 DEBUG:boto:Params: {} 2023-12-15T23:26:18.058 DEBUG:boto:Token: None 2023-12-15T23:26:18.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj85 2023-12-15T23:26:18.059 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tDdr5L2/CJomTaEJIoSkFlTvC8Q= 2023-12-15T23:26:18.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tDdr5L2/CJomTaEJIoSkFlTvC8Q=', 'Content-Length': '0'} 2023-12-15T23:26:18.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:16:20 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5aa73073c25e4cb-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.061 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.061 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.062 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.062 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.062 DEBUG:boto:Method: GET 2023-12-15T23:26:18.062 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.062 DEBUG:boto:Data: 2023-12-15T23:26:18.062 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.062 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.062 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.062 DEBUG:boto:Params: {} 2023-12-15T23:26:18.062 DEBUG:boto:Token: None 2023-12-15T23:26:18.063 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.063 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5758752983c2342-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.065 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.066 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.066 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.066 DEBUG:boto:path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.066 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.066 DEBUG:boto:Method: GET 2023-12-15T23:26:18.066 DEBUG:boto:Path: /kskgfn-49/?prefix=obj85 2023-12-15T23:26:18.066 DEBUG:boto:Data: 2023-12-15T23:26:18.066 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.067 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.067 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.067 DEBUG:boto:Params: {} 2023-12-15T23:26:18.067 DEBUG:boto:Token: None 2023-12-15T23:26:18.067 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052c80d504ca56647-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.071 DEBUG:boto:b'kskgfn-49obj851000falseobj852023-12-15T23:16:20.048Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.071 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:26:18.071 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.072 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.072 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.072 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.072 DEBUG:boto:Method: GET 2023-12-15T23:26:18.072 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.072 DEBUG:boto:Data: 2023-12-15T23:26:18.072 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.072 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.072 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.072 DEBUG:boto:Params: {} 2023-12-15T23:26:18.073 DEBUG:boto:Token: None 2023-12-15T23:26:18.073 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.073 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI= 2023-12-15T23:26:18.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI=', 'Content-Length': '0'} 2023-12-15T23:26:18.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c1ea2418de432fd-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.075 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.076 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.076 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.076 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.076 DEBUG:boto:Method: GET 2023-12-15T23:26:18.076 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.076 DEBUG:boto:Data: 2023-12-15T23:26:18.076 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.076 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.076 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.076 DEBUG:boto:Params: {} 2023-12-15T23:26:18.077 DEBUG:boto:Token: None 2023-12-15T23:26:18.077 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.077 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI= 2023-12-15T23:26:18.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI=', 'Content-Length': '0'} 2023-12-15T23:26:18.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000497b6acce555183a-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.121 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.121 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.122 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.122 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.122 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.122 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.122 DEBUG:boto:Data: 2023-12-15T23:26:18.122 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.122 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.122 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.122 DEBUG:boto:Params: {} 2023-12-15T23:26:18.122 DEBUG:boto:Token: None 2023-12-15T23:26:18.123 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qfvUhT23i0WtZzRFCEqpSuetqJU= 2023-12-15T23:26:18.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qfvUhT23i0WtZzRFCEqpSuetqJU=', 'Content-Length': '0'} 2023-12-15T23:26:18.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f60425a63c7ae41d-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.125 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.125 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.125 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.125 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.126 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.126 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.126 DEBUG:boto:Data: 2023-12-15T23:26:18.126 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.126 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.126 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.126 DEBUG:boto:Params: {} 2023-12-15T23:26:18.126 DEBUG:boto:Token: None 2023-12-15T23:26:18.126 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qfvUhT23i0WtZzRFCEqpSuetqJU= 2023-12-15T23:26:18.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qfvUhT23i0WtZzRFCEqpSuetqJU=', 'Content-Length': '0'} 2023-12-15T23:26:18.128 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f816c8265f055f3d-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:26:18.129 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.129 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.129 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.129 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.129 DEBUG:boto:Method: GET 2023-12-15T23:26:18.129 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.130 DEBUG:boto:Data: 2023-12-15T23:26:18.130 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.130 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.130 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.130 DEBUG:boto:Params: {} 2023-12-15T23:26:18.130 DEBUG:boto:Token: None 2023-12-15T23:26:18.130 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.130 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI= 2023-12-15T23:26:18.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI=', 'Content-Length': '0'} 2023-12-15T23:26:18.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ceb1403a7333b10-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.132 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.133 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.133 DEBUG:boto:path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.133 DEBUG:boto:auth_path=/kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.133 DEBUG:boto:Method: GET 2023-12-15T23:26:18.133 DEBUG:boto:Path: /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.133 DEBUG:boto:Data: 2023-12-15T23:26:18.133 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.133 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.133 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.133 DEBUG:boto:Params: {} 2023-12-15T23:26:18.134 DEBUG:boto:Token: None 2023-12-15T23:26:18.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87?versionId=null 2023-12-15T23:26:18.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI= 2023-12-15T23:26:18.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ogJsZVNjE4V58m4SFVZiVfY//GI=', 'Content-Length': '0'} 2023-12-15T23:26:18.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe261ee6f8d8fa99-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.136 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.136 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.136 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.136 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.137 DEBUG:boto:Method: GET 2023-12-15T23:26:18.137 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.137 DEBUG:boto:Data: 2023-12-15T23:26:18.137 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.137 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.137 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.137 DEBUG:boto:Params: {} 2023-12-15T23:26:18.137 DEBUG:boto:Token: None 2023-12-15T23:26:18.137 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.137 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.140 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcd4558d3d2bf8e0-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.140 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.140 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.140 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.140 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.141 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.141 DEBUG:boto:Method: GET 2023-12-15T23:26:18.141 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.141 DEBUG:boto:Data: 2023-12-15T23:26:18.141 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.141 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.141 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.141 DEBUG:boto:Params: {} 2023-12-15T23:26:18.141 DEBUG:boto:Token: None 2023-12-15T23:26:18.142 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.142 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081cc97173676c254-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.146 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.146 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.146 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.146 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.147 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:26:18.147 DEBUG:boto:Data: 2023-12-15T23:26:18.147 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.147 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.147 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.147 DEBUG:boto:Params: {} 2023-12-15T23:26:18.147 DEBUG:boto:Token: None 2023-12-15T23:26:18.147 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87 2023-12-15T23:26:18.148 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DgdNwRnrWdLXLcWf6k6iXwIclRc= 2023-12-15T23:26:18.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DgdNwRnrWdLXLcWf6k6iXwIclRc=', 'Content-Length': '0'} 2023-12-15T23:26:18.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002748777770155aa2-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.149 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.150 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.150 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.150 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:26:18.150 DEBUG:boto:Data: 2023-12-15T23:26:18.150 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.150 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.150 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.150 DEBUG:boto:Params: {} 2023-12-15T23:26:18.150 DEBUG:boto:Token: None 2023-12-15T23:26:18.151 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87 2023-12-15T23:26:18.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DgdNwRnrWdLXLcWf6k6iXwIclRc= 2023-12-15T23:26:18.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DgdNwRnrWdLXLcWf6k6iXwIclRc=', 'Content-Length': '0'} 2023-12-15T23:26:18.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008db6ae2bf1f1399f-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.153 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:26:18.153 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.153 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.153 DEBUG:boto:Method: GET 2023-12-15T23:26:18.153 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:26:18.153 DEBUG:boto:Data: 2023-12-15T23:26:18.153 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.154 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.154 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.154 DEBUG:boto:Params: {} 2023-12-15T23:26:18.154 DEBUG:boto:Token: None 2023-12-15T23:26:18.154 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87 2023-12-15T23:26:18.154 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rXUi0PTJU9PJvaVllIQ066QYuj4= 2023-12-15T23:26:18.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rXUi0PTJU9PJvaVllIQ066QYuj4=', 'Content-Length': '0'} 2023-12-15T23:26:18.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd857ebf58761591-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.156 DEBUG:boto:path=/kskgfn-49/obj87 2023-12-15T23:26:18.156 DEBUG:boto:auth_path=/kskgfn-49/obj87 2023-12-15T23:26:18.157 DEBUG:boto:Method: GET 2023-12-15T23:26:18.157 DEBUG:boto:Path: /kskgfn-49/obj87 2023-12-15T23:26:18.157 DEBUG:boto:Data: 2023-12-15T23:26:18.157 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.157 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.157 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.157 DEBUG:boto:Params: {} 2023-12-15T23:26:18.157 DEBUG:boto:Token: None 2023-12-15T23:26:18.157 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj87 2023-12-15T23:26:18.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rXUi0PTJU9PJvaVllIQ066QYuj4= 2023-12-15T23:26:18.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rXUi0PTJU9PJvaVllIQ066QYuj4=', 'Content-Length': '0'} 2023-12-15T23:26:18.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:20:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcc1b4d6af8c208c-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.160 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.160 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.160 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.160 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.160 DEBUG:boto:Method: GET 2023-12-15T23:26:18.160 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.160 DEBUG:boto:Data: 2023-12-15T23:26:18.161 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.161 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.161 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.161 DEBUG:boto:Params: {} 2023-12-15T23:26:18.161 DEBUG:boto:Token: None 2023-12-15T23:26:18.161 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.161 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.163 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024bad71e3a1731a4-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.164 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.164 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.164 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.164 DEBUG:boto:path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.164 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.165 DEBUG:boto:Method: GET 2023-12-15T23:26:18.165 DEBUG:boto:Path: /kskgfn-49/?prefix=obj87 2023-12-15T23:26:18.165 DEBUG:boto:Data: 2023-12-15T23:26:18.165 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.165 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.165 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.165 DEBUG:boto:Params: {} 2023-12-15T23:26:18.165 DEBUG:boto:Token: None 2023-12-15T23:26:18.165 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.166 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000687a1feb31a42e56-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.169 DEBUG:boto:b'kskgfn-49obj871000falseobj872023-12-15T23:20:59.982Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:26:18.170 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.170 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.170 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.170 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.170 DEBUG:boto:Method: GET 2023-12-15T23:26:18.170 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.170 DEBUG:boto:Data: 2023-12-15T23:26:18.170 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.171 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.171 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.171 DEBUG:boto:Params: {} 2023-12-15T23:26:18.171 DEBUG:boto:Token: None 2023-12-15T23:26:18.171 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4= 2023-12-15T23:26:18.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4=', 'Content-Length': '0'} 2023-12-15T23:26:18.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c01753d176a582ef-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.174 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.174 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.174 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.174 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.174 DEBUG:boto:Method: GET 2023-12-15T23:26:18.174 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.174 DEBUG:boto:Data: 2023-12-15T23:26:18.174 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.175 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.175 DEBUG:boto:Params: {} 2023-12-15T23:26:18.175 DEBUG:boto:Token: None 2023-12-15T23:26:18.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4= 2023-12-15T23:26:18.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4=', 'Content-Length': '0'} 2023-12-15T23:26:18.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bfab355403eb0b1-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.177 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.177 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.178 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.178 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.178 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.178 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.178 DEBUG:boto:Data: 2023-12-15T23:26:18.178 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.178 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.178 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.178 DEBUG:boto:Params: {} 2023-12-15T23:26:18.178 DEBUG:boto:Token: None 2023-12-15T23:26:18.179 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oLkYg4pxjc93e2iyonA5tUqpYVY= 2023-12-15T23:26:18.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oLkYg4pxjc93e2iyonA5tUqpYVY=', 'Content-Length': '0'} 2023-12-15T23:26:18.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d272556456c284e7-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.181 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.181 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.181 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.181 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.181 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.181 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.182 DEBUG:boto:Data: 2023-12-15T23:26:18.182 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.182 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.182 DEBUG:boto:Params: {} 2023-12-15T23:26:18.182 DEBUG:boto:Token: None 2023-12-15T23:26:18.182 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.182 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oLkYg4pxjc93e2iyonA5tUqpYVY= 2023-12-15T23:26:18.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oLkYg4pxjc93e2iyonA5tUqpYVY=', 'Content-Length': '0'} 2023-12-15T23:26:18.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c42ffcff4458f86f-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.184 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:26:18.185 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.185 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.185 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.185 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.185 DEBUG:boto:Method: GET 2023-12-15T23:26:18.185 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.185 DEBUG:boto:Data: 2023-12-15T23:26:18.185 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.185 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.186 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.186 DEBUG:boto:Params: {} 2023-12-15T23:26:18.186 DEBUG:boto:Token: None 2023-12-15T23:26:18.186 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.186 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4= 2023-12-15T23:26:18.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4=', 'Content-Length': '0'} 2023-12-15T23:26:18.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051cff9b312e62141-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.188 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.188 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.189 DEBUG:boto:path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.189 DEBUG:boto:auth_path=/kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.189 DEBUG:boto:Method: GET 2023-12-15T23:26:18.189 DEBUG:boto:Path: /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.189 DEBUG:boto:Data: 2023-12-15T23:26:18.189 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.189 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.189 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.189 DEBUG:boto:Params: {} 2023-12-15T23:26:18.190 DEBUG:boto:Token: None 2023-12-15T23:26:18.190 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92?versionId=null 2023-12-15T23:26:18.190 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4= 2023-12-15T23:26:18.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gMM+AGgP41z6W4z9z2kybSx8nl4=', 'Content-Length': '0'} 2023-12-15T23:26:18.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c57b1ad9145c505-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.192 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.192 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.193 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.193 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.193 DEBUG:boto:Method: GET 2023-12-15T23:26:18.193 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.193 DEBUG:boto:Data: 2023-12-15T23:26:18.193 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.193 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.193 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.193 DEBUG:boto:Params: {} 2023-12-15T23:26:18.193 DEBUG:boto:Token: None 2023-12-15T23:26:18.194 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.194 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d54937cc9ebb31e0-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.196 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.197 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.197 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.197 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.197 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.197 DEBUG:boto:Method: GET 2023-12-15T23:26:18.197 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.197 DEBUG:boto:Data: 2023-12-15T23:26:18.198 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.198 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.198 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.198 DEBUG:boto:Params: {} 2023-12-15T23:26:18.198 DEBUG:boto:Token: None 2023-12-15T23:26:18.198 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.198 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7b13c264b05e03d-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.202 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.202 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.202 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.202 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.202 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:26:18.203 DEBUG:boto:Data: 2023-12-15T23:26:18.203 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.203 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.203 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.203 DEBUG:boto:Params: {} 2023-12-15T23:26:18.203 DEBUG:boto:Token: None 2023-12-15T23:26:18.203 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92 2023-12-15T23:26:18.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WlNawj4SJm7QrDTaCcZExRLtc9U= 2023-12-15T23:26:18.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WlNawj4SJm7QrDTaCcZExRLtc9U=', 'Content-Length': '0'} 2023-12-15T23:26:18.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd6d07bb0c7bfe31-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.206 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.206 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.206 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.206 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:26:18.206 DEBUG:boto:Data: 2023-12-15T23:26:18.206 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.206 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.206 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.206 DEBUG:boto:Params: {} 2023-12-15T23:26:18.207 DEBUG:boto:Token: None 2023-12-15T23:26:18.207 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92 2023-12-15T23:26:18.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WlNawj4SJm7QrDTaCcZExRLtc9U= 2023-12-15T23:26:18.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WlNawj4SJm7QrDTaCcZExRLtc9U=', 'Content-Length': '0'} 2023-12-15T23:26:18.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005503cff086838ad1-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:26:18.209 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.209 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.209 DEBUG:boto:Method: GET 2023-12-15T23:26:18.210 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:26:18.210 DEBUG:boto:Data: 2023-12-15T23:26:18.210 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.210 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.210 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.210 DEBUG:boto:Params: {} 2023-12-15T23:26:18.210 DEBUG:boto:Token: None 2023-12-15T23:26:18.210 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92 2023-12-15T23:26:18.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NewZRwlqT2mJEbN15AkydlcEJqg= 2023-12-15T23:26:18.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NewZRwlqT2mJEbN15AkydlcEJqg=', 'Content-Length': '0'} 2023-12-15T23:26:18.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019013c5c5c3f2389-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.253 DEBUG:boto:path=/kskgfn-49/obj92 2023-12-15T23:26:18.254 DEBUG:boto:auth_path=/kskgfn-49/obj92 2023-12-15T23:26:18.254 DEBUG:boto:Method: GET 2023-12-15T23:26:18.254 DEBUG:boto:Path: /kskgfn-49/obj92 2023-12-15T23:26:18.254 DEBUG:boto:Data: 2023-12-15T23:26:18.254 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.254 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.254 DEBUG:boto:Params: {} 2023-12-15T23:26:18.254 DEBUG:boto:Token: None 2023-12-15T23:26:18.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj92 2023-12-15T23:26:18.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NewZRwlqT2mJEbN15AkydlcEJqg= 2023-12-15T23:26:18.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NewZRwlqT2mJEbN15AkydlcEJqg=', 'Content-Length': '0'} 2023-12-15T23:26:18.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:18:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c71b87e5a483158f-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.257 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.257 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.257 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.257 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.257 DEBUG:boto:Method: GET 2023-12-15T23:26:18.257 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.257 DEBUG:boto:Data: 2023-12-15T23:26:18.257 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.257 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.258 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.258 DEBUG:boto:Params: {} 2023-12-15T23:26:18.258 DEBUG:boto:Token: None 2023-12-15T23:26:18.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.260 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006484ff791d2e7353-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.261 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.261 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.261 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.261 DEBUG:boto:path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.261 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.261 DEBUG:boto:Method: GET 2023-12-15T23:26:18.261 DEBUG:boto:Path: /kskgfn-49/?prefix=obj92 2023-12-15T23:26:18.262 DEBUG:boto:Data: 2023-12-15T23:26:18.262 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.262 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.262 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.262 DEBUG:boto:Params: {} 2023-12-15T23:26:18.262 DEBUG:boto:Token: None 2023-12-15T23:26:18.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d10130990639be19-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.266 DEBUG:boto:b'kskgfn-49obj921000falseobj922023-12-15T23:18:45.754Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.266 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:26:18.266 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.267 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.267 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.267 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.267 DEBUG:boto:Method: GET 2023-12-15T23:26:18.267 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.267 DEBUG:boto:Data: 2023-12-15T23:26:18.267 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.267 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.267 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.267 DEBUG:boto:Params: {} 2023-12-15T23:26:18.268 DEBUG:boto:Token: None 2023-12-15T23:26:18.268 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.268 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac= 2023-12-15T23:26:18.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac=', 'Content-Length': '0'} 2023-12-15T23:26:18.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004834d9fbead44781-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.271 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.271 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.271 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.271 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.271 DEBUG:boto:Method: GET 2023-12-15T23:26:18.271 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.271 DEBUG:boto:Data: 2023-12-15T23:26:18.271 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.271 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.271 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.272 DEBUG:boto:Params: {} 2023-12-15T23:26:18.272 DEBUG:boto:Token: None 2023-12-15T23:26:18.272 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac= 2023-12-15T23:26:18.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac=', 'Content-Length': '0'} 2023-12-15T23:26:18.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e8b2d846c88538e-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.275 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.275 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.275 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.275 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.275 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.275 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.275 DEBUG:boto:Data: 2023-12-15T23:26:18.275 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.275 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.275 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.276 DEBUG:boto:Params: {} 2023-12-15T23:26:18.276 DEBUG:boto:Token: None 2023-12-15T23:26:18.276 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.276 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nyLbT0J04End0+2iW50Lszehozw= 2023-12-15T23:26:18.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nyLbT0J04End0+2iW50Lszehozw=', 'Content-Length': '0'} 2023-12-15T23:26:18.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016651c073692494a-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.279 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.279 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.279 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.279 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.279 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.279 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.279 DEBUG:boto:Data: 2023-12-15T23:26:18.279 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.279 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.279 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.280 DEBUG:boto:Params: {} 2023-12-15T23:26:18.280 DEBUG:boto:Token: None 2023-12-15T23:26:18.280 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.280 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nyLbT0J04End0+2iW50Lszehozw= 2023-12-15T23:26:18.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nyLbT0J04End0+2iW50Lszehozw=', 'Content-Length': '0'} 2023-12-15T23:26:18.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000291f077ac3cc8662-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:26:18.282 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.282 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.283 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.283 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.283 DEBUG:boto:Method: GET 2023-12-15T23:26:18.283 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.283 DEBUG:boto:Data: 2023-12-15T23:26:18.283 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.283 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.283 DEBUG:boto:Params: {} 2023-12-15T23:26:18.283 DEBUG:boto:Token: None 2023-12-15T23:26:18.284 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac= 2023-12-15T23:26:18.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac=', 'Content-Length': '0'} 2023-12-15T23:26:18.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e476a3523fe1e82e-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.329 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.329 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.330 DEBUG:boto:path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.330 DEBUG:boto:auth_path=/kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.330 DEBUG:boto:Method: GET 2023-12-15T23:26:18.330 DEBUG:boto:Path: /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.330 DEBUG:boto:Data: 2023-12-15T23:26:18.330 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.330 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.330 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.330 DEBUG:boto:Params: {} 2023-12-15T23:26:18.330 DEBUG:boto:Token: None 2023-12-15T23:26:18.331 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93?versionId=null 2023-12-15T23:26:18.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac= 2023-12-15T23:26:18.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wqW3UfRcG/Ncq9LNMc1ImD+OGac=', 'Content-Length': '0'} 2023-12-15T23:26:18.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc6c96bb2888a53a-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.333 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.333 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.333 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.333 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.333 DEBUG:boto:Method: GET 2023-12-15T23:26:18.334 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.334 DEBUG:boto:Data: 2023-12-15T23:26:18.334 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.334 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.334 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.334 DEBUG:boto:Params: {} 2023-12-15T23:26:18.334 DEBUG:boto:Token: None 2023-12-15T23:26:18.334 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8161375625a80a9-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.337 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.337 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.337 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.338 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.338 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.338 DEBUG:boto:Method: GET 2023-12-15T23:26:18.338 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.338 DEBUG:boto:Data: 2023-12-15T23:26:18.338 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.338 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.338 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.338 DEBUG:boto:Params: {} 2023-12-15T23:26:18.339 DEBUG:boto:Token: None 2023-12-15T23:26:18.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f006f4f0f15de901-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.343 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.343 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.343 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.343 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.344 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:26:18.344 DEBUG:boto:Data: 2023-12-15T23:26:18.344 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.344 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.344 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.344 DEBUG:boto:Params: {} 2023-12-15T23:26:18.344 DEBUG:boto:Token: None 2023-12-15T23:26:18.344 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93 2023-12-15T23:26:18.344 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SsjWyi6MQ+etwVIj0CPxzosbVKA= 2023-12-15T23:26:18.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SsjWyi6MQ+etwVIj0CPxzosbVKA=', 'Content-Length': '0'} 2023-12-15T23:26:18.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bbf2923574f6cdf-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.347 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.347 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.347 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.347 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:26:18.347 DEBUG:boto:Data: 2023-12-15T23:26:18.347 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.347 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.348 DEBUG:boto:Params: {} 2023-12-15T23:26:18.348 DEBUG:boto:Token: None 2023-12-15T23:26:18.348 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93 2023-12-15T23:26:18.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SsjWyi6MQ+etwVIj0CPxzosbVKA= 2023-12-15T23:26:18.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SsjWyi6MQ+etwVIj0CPxzosbVKA=', 'Content-Length': '0'} 2023-12-15T23:26:18.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000026882edad35a545-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.350 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:26:18.350 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.350 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.350 DEBUG:boto:Method: GET 2023-12-15T23:26:18.350 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:26:18.350 DEBUG:boto:Data: 2023-12-15T23:26:18.350 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.351 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.351 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.351 DEBUG:boto:Params: {} 2023-12-15T23:26:18.351 DEBUG:boto:Token: None 2023-12-15T23:26:18.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93 2023-12-15T23:26:18.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MR1X31s/pIwaM+jhq/9MQiKqWPQ= 2023-12-15T23:26:18.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MR1X31s/pIwaM+jhq/9MQiKqWPQ=', 'Content-Length': '0'} 2023-12-15T23:26:18.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026f4e3db1363998f-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.397 DEBUG:boto:path=/kskgfn-49/obj93 2023-12-15T23:26:18.398 DEBUG:boto:auth_path=/kskgfn-49/obj93 2023-12-15T23:26:18.398 DEBUG:boto:Method: GET 2023-12-15T23:26:18.398 DEBUG:boto:Path: /kskgfn-49/obj93 2023-12-15T23:26:18.398 DEBUG:boto:Data: 2023-12-15T23:26:18.398 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.398 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.398 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.398 DEBUG:boto:Params: {} 2023-12-15T23:26:18.398 DEBUG:boto:Token: None 2023-12-15T23:26:18.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj93 2023-12-15T23:26:18.399 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MR1X31s/pIwaM+jhq/9MQiKqWPQ= 2023-12-15T23:26:18.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MR1X31s/pIwaM+jhq/9MQiKqWPQ=', 'Content-Length': '0'} 2023-12-15T23:26:18.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:22:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d64f0931e490aac4-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.401 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.401 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.401 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.401 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.401 DEBUG:boto:Method: GET 2023-12-15T23:26:18.401 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.401 DEBUG:boto:Data: 2023-12-15T23:26:18.402 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.402 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.402 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.402 DEBUG:boto:Params: {} 2023-12-15T23:26:18.402 DEBUG:boto:Token: None 2023-12-15T23:26:18.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e4831e63268c76f-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.445 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.446 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.446 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.446 DEBUG:boto:path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.446 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.446 DEBUG:boto:Method: GET 2023-12-15T23:26:18.446 DEBUG:boto:Path: /kskgfn-49/?prefix=obj93 2023-12-15T23:26:18.446 DEBUG:boto:Data: 2023-12-15T23:26:18.446 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.447 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.447 DEBUG:boto:Params: {} 2023-12-15T23:26:18.447 DEBUG:boto:Token: None 2023-12-15T23:26:18.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4173a9ed1b9c969-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.451 DEBUG:boto:b'kskgfn-49obj931000falseobj932023-12-15T23:22:24.679Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:26:18.452 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.452 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.452 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.452 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.452 DEBUG:boto:Method: GET 2023-12-15T23:26:18.452 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.453 DEBUG:boto:Data: 2023-12-15T23:26:18.453 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.453 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.453 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.453 DEBUG:boto:Params: {} 2023-12-15T23:26:18.453 DEBUG:boto:Token: None 2023-12-15T23:26:18.453 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.453 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM= 2023-12-15T23:26:18.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM=', 'Content-Length': '0'} 2023-12-15T23:26:18.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cfbdb99022d8713-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.456 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.456 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.456 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.456 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.456 DEBUG:boto:Method: GET 2023-12-15T23:26:18.456 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.456 DEBUG:boto:Data: 2023-12-15T23:26:18.456 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.456 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.457 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.457 DEBUG:boto:Params: {} 2023-12-15T23:26:18.457 DEBUG:boto:Token: None 2023-12-15T23:26:18.457 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM= 2023-12-15T23:26:18.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM=', 'Content-Length': '0'} 2023-12-15T23:26:18.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2cba6fee555874c-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.459 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.459 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.460 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.460 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.460 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.460 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.460 DEBUG:boto:Data: 2023-12-15T23:26:18.460 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.460 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.460 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.460 DEBUG:boto:Params: {} 2023-12-15T23:26:18.460 DEBUG:boto:Token: None 2023-12-15T23:26:18.461 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.461 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oBzf1HXEE6BY8wO8gTaMIYsiOZY= 2023-12-15T23:26:18.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oBzf1HXEE6BY8wO8gTaMIYsiOZY=', 'Content-Length': '0'} 2023-12-15T23:26:18.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb2e3efbe59c89be-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.463 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.463 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.463 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.463 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.463 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.463 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.463 DEBUG:boto:Data: 2023-12-15T23:26:18.463 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.464 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.464 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.464 DEBUG:boto:Params: {} 2023-12-15T23:26:18.464 DEBUG:boto:Token: None 2023-12-15T23:26:18.464 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.464 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oBzf1HXEE6BY8wO8gTaMIYsiOZY= 2023-12-15T23:26:18.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oBzf1HXEE6BY8wO8gTaMIYsiOZY=', 'Content-Length': '0'} 2023-12-15T23:26:18.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008efc5ee87986c6ea-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.466 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:26:18.466 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.467 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.467 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.467 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.467 DEBUG:boto:Method: GET 2023-12-15T23:26:18.467 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.467 DEBUG:boto:Data: 2023-12-15T23:26:18.467 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.467 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.467 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.467 DEBUG:boto:Params: {} 2023-12-15T23:26:18.467 DEBUG:boto:Token: None 2023-12-15T23:26:18.468 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.468 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM= 2023-12-15T23:26:18.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM=', 'Content-Length': '0'} 2023-12-15T23:26:18.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022392ab92563aae0-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.513 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.513 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.514 DEBUG:boto:path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.514 DEBUG:boto:auth_path=/kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.514 DEBUG:boto:Method: GET 2023-12-15T23:26:18.514 DEBUG:boto:Path: /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.514 DEBUG:boto:Data: 2023-12-15T23:26:18.514 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.514 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.514 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.514 DEBUG:boto:Params: {} 2023-12-15T23:26:18.514 DEBUG:boto:Token: None 2023-12-15T23:26:18.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95?versionId=null 2023-12-15T23:26:18.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM= 2023-12-15T23:26:18.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pHfE+JrHzYCg8Xp0L/TcS6vBYSM=', 'Content-Length': '0'} 2023-12-15T23:26:18.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000880bc4945900e5de-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.517 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.517 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.517 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.517 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.518 DEBUG:boto:Method: GET 2023-12-15T23:26:18.518 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.518 DEBUG:boto:Data: 2023-12-15T23:26:18.518 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.518 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.518 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.518 DEBUG:boto:Params: {} 2023-12-15T23:26:18.518 DEBUG:boto:Token: None 2023-12-15T23:26:18.518 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.521 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e08bea0781373521-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.521 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.521 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.522 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.522 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.522 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.522 DEBUG:boto:Method: GET 2023-12-15T23:26:18.522 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.522 DEBUG:boto:Data: 2023-12-15T23:26:18.522 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.522 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.522 DEBUG:boto:Params: {} 2023-12-15T23:26:18.523 DEBUG:boto:Token: None 2023-12-15T23:26:18.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abe5b8b1bdecf551-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.527 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.527 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.527 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.527 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.527 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:26:18.528 DEBUG:boto:Data: 2023-12-15T23:26:18.528 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.528 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.528 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.528 DEBUG:boto:Params: {} 2023-12-15T23:26:18.528 DEBUG:boto:Token: None 2023-12-15T23:26:18.528 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95 2023-12-15T23:26:18.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wtozvwbwEl7rhQCIIMuGoKKuRdo= 2023-12-15T23:26:18.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wtozvwbwEl7rhQCIIMuGoKKuRdo=', 'Content-Length': '0'} 2023-12-15T23:26:18.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059b81ef1270fe8ef-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.531 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.531 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.531 DEBUG:boto:Method: HEAD 2023-12-15T23:26:18.531 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:26:18.531 DEBUG:boto:Data: 2023-12-15T23:26:18.531 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.531 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.531 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.531 DEBUG:boto:Params: {} 2023-12-15T23:26:18.532 DEBUG:boto:Token: None 2023-12-15T23:26:18.532 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95 2023-12-15T23:26:18.532 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wtozvwbwEl7rhQCIIMuGoKKuRdo= 2023-12-15T23:26:18.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wtozvwbwEl7rhQCIIMuGoKKuRdo=', 'Content-Length': '0'} 2023-12-15T23:26:18.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000024d291826556cf2-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:26:18.534 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.534 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.534 DEBUG:boto:Method: GET 2023-12-15T23:26:18.534 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:26:18.534 DEBUG:boto:Data: 2023-12-15T23:26:18.535 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.535 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.535 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.535 DEBUG:boto:Params: {} 2023-12-15T23:26:18.535 DEBUG:boto:Token: None 2023-12-15T23:26:18.535 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95 2023-12-15T23:26:18.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OCeVszrTjxyLsi3vgDrYDMlPSo= 2023-12-15T23:26:18.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OCeVszrTjxyLsi3vgDrYDMlPSo=', 'Content-Length': '0'} 2023-12-15T23:26:18.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-49:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.20'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3701ab47c157f0b-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.577 DEBUG:boto:path=/kskgfn-49/obj95 2023-12-15T23:26:18.578 DEBUG:boto:auth_path=/kskgfn-49/obj95 2023-12-15T23:26:18.578 DEBUG:boto:Method: GET 2023-12-15T23:26:18.578 DEBUG:boto:Path: /kskgfn-49/obj95 2023-12-15T23:26:18.578 DEBUG:boto:Data: 2023-12-15T23:26:18.578 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.578 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.578 DEBUG:boto:Params: {} 2023-12-15T23:26:18.578 DEBUG:boto:Token: None 2023-12-15T23:26:18.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/obj95 2023-12-15T23:26:18.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4OCeVszrTjxyLsi3vgDrYDMlPSo= 2023-12-15T23:26:18.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4OCeVszrTjxyLsi3vgDrYDMlPSo=', 'Content-Length': '0'} 2023-12-15T23:26:18.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:17:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d4f7c110576df37-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.581 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.581 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.581 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.581 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.581 DEBUG:boto:Method: GET 2023-12-15T23:26:18.581 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.581 DEBUG:boto:Data: 2023-12-15T23:26:18.581 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:26:18.582 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.582 DEBUG:boto:Params: {} 2023-12-15T23:26:18.582 DEBUG:boto:Token: None 2023-12-15T23:26:18.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a38b8221a9ed7720-00657ce09a-5642-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.585 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.585 DEBUG:boto:path=/kskgfn-49/ 2023-12-15T23:26:18.585 DEBUG:boto:auth_path=/kskgfn-49/ 2023-12-15T23:26:18.585 DEBUG:boto:path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.585 DEBUG:boto:auth_path=/kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.585 DEBUG:boto:Method: GET 2023-12-15T23:26:18.586 DEBUG:boto:Path: /kskgfn-49/?prefix=obj95 2023-12-15T23:26:18.586 DEBUG:boto:Data: 2023-12-15T23:26:18.586 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.586 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.586 DEBUG:boto:Params: {} 2023-12-15T23:26:18.586 DEBUG:boto:Token: None 2023-12-15T23:26:18.586 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-49/ 2023-12-15T23:26:18.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og= 2023-12-15T23:26:18.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bQHHIr+VNJKTsM/9pxkocFYy4Og=', 'Content-Length': '0'} 2023-12-15T23:26:18.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076bab1c55af1359e-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.590 DEBUG:boto:b'kskgfn-49obj951000falseobj952023-12-15T23:17:37.452Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:26:18.590 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-49 zones={test-zone2, test-zone1} 2023-12-15T23:26:18.591 INFO:tasks.rgw_multisite_tests:Create several generations of objects, trash them, then run bucket sync init ... ok 2023-12-15T23:26:18.596 INFO:rgw_multi.tests:create role zone=test-zone1 name=roles-kskgfn-1 2023-12-15T23:26:18.596 DEBUG:boto:Method: POST 2023-12-15T23:26:18.597 DEBUG:boto:Path: / 2023-12-15T23:26:18.597 DEBUG:boto:Data: 2023-12-15T23:26:18.597 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com 2023-12-15T23:26:18.597 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.597 DEBUG:boto:Params: {'RoleName': 'roles-kskgfn-1', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2023-12-15T23:26:18.597 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:26:18.597 DEBUG:boto:Token: None 2023-12-15T23:26:18.598 DEBUG:boto:CanonicalRequest: POST / host:smithi093.front.sepia.ceph.com:8000 x-amz-date:20231215T232618Z host;x-amz-date 5101ddfa0fa136f561fb828a95a08a23f90379eb6d4c02ee494136d72d346522 2023-12-15T23:26:18.598 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20231215T232618Z 20231215/front/smithi093/aws4_request a6a9b5dbab23488b6973deb120e8cbd53a7322bb17431ea97500853488783d6f 2023-12-15T23:26:18.598 DEBUG:boto:Signature: 8a891933098d3d0a4eb19eb1a39524c4dc5fe9fda613182ba440fc4152513bf1 2023-12-15T23:26:18.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20231215T232618Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=RQ4G229IF2X1XV5EJM37/20231215/front/smithi093/aws4_request,SignedHeaders=host;x-amz-date,Signature=8a891933098d3d0a4eb19eb1a39524c4dc5fe9fda613182ba440fc4152513bf1', 'Host': 'smithi093.front.sepia.ceph.com:8000'} 2023-12-15T23:26:18.612 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000630ba7bf983729b1-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '731'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.612 DEBUG:boto:b'02e4b550-76a0-4196-9f48-bb59dc87e6a2roles-kskgfn-1/arn:aws:iam:::role/roles-kskgfn-12023-12-15T23:26:18.602Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx00000630ba7bf983729b1-00657ce09a-4716-test-zone1' 2023-12-15T23:26:18.613 INFO:rgw_multi.tests:create role zone=test-zone2 name=roles-kskgfn-2 2023-12-15T23:26:18.613 DEBUG:boto:Method: POST 2023-12-15T23:26:18.613 DEBUG:boto:Path: / 2023-12-15T23:26:18.613 DEBUG:boto:Data: 2023-12-15T23:26:18.613 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.614 DEBUG:boto:Host: smithi188.front.sepia.ceph.com 2023-12-15T23:26:18.614 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.614 DEBUG:boto:Params: {'RoleName': 'roles-kskgfn-2', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2023-12-15T23:26:18.614 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:26:18.614 DEBUG:boto:Token: None 2023-12-15T23:26:18.614 DEBUG:boto:CanonicalRequest: POST / host:smithi188.front.sepia.ceph.com:8000 x-amz-date:20231215T232618Z host;x-amz-date 5ef263925bdaab12358c97e19f3d0637fba86f6f57c20e0bc0092a96b766a819 2023-12-15T23:26:18.614 DEBUG:boto:StringToSign: AWS4-HMAC-SHA256 20231215T232618Z 20231215/front/smithi188/aws4_request 017f0513275bbcf79ab465b284ce7c4c0b2f9811366f320b986e174caf306280 2023-12-15T23:26:18.614 DEBUG:boto:Signature: 6743950e043b0492b464cbc88a339fbe74e132836d834447bc122ae41a82ae19 2023-12-15T23:26:18.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20231215T232618Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=RQ4G229IF2X1XV5EJM37/20231215/front/smithi188/aws4_request,SignedHeaders=host;x-amz-date,Signature=6743950e043b0492b464cbc88a339fbe74e132836d834447bc122ae41a82ae19', 'Host': 'smithi188.front.sepia.ceph.com:8000'} 2023-12-15T23:26:18.618 DEBUG:boto:Response headers: [('Content-Length', '217'), ('x-amz-request-id', 'tx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.618 DEBUG:boto:b'AccessDeniedtx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone25642-test-zone2-test-zonegroup' 2023-12-15T23:26:18.618 ERROR:boto:403 Forbidden 2023-12-15T23:26:18.618 ERROR:boto:b'AccessDeniedtx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone25642-test-zone2-test-zonegroup' 2023-12-15T23:26:18.662 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_sync ... ERROR 2023-12-15T23:26:18.663 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:26:18.663 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:26:18.663 DEBUG:boto:Method: PUT 2023-12-15T23:26:18.663 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:26:18.663 DEBUG:boto:Data: 2023-12-15T23:26:18.663 DEBUG:boto:Headers: {} 2023-12-15T23:26:18.663 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:26:18.663 DEBUG:boto:Port: 8000 2023-12-15T23:26:18.663 DEBUG:boto:Params: {} 2023-12-15T23:26:18.664 DEBUG:boto:Token: None 2023-12-15T23:26:18.664 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:26:18 GMT /kskgfn-50/ 2023-12-15T23:26:18.664 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:56q6tagozQYKNVx8Cz145UKKG/w= 2023-12-15T23:26:18.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:26:18 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:56q6tagozQYKNVx8Cz145UKKG/w=', 'Content-Length': '0'} 2023-12-15T23:26:18.684 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005ca318debce0b314-00657ce09a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:26:18.684 DEBUG:rgw_multi.tests:created bucket=kskgfn-50 2023-12-15T23:26:18.684 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:18.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:18.685 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:18.736 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:18.736 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:18.770 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:26:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702682778.680481_453.1","last_update":"2023-12-15T23:26:18.680481Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:26:18.787 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:18.787 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:26:18.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:18.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:18.788 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:18.843 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:18.843 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:18.877 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:18.874+0000 7f6e096e4800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:18.878 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:18.875+0000 7f6e096e4800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:18.895 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:18Z"} 2023-12-15T23:26:18.895 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:18Z"} 2023-12-15T23:26:18.895 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:18.895 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:18.896 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:18.896 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:23.897 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:23.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:23.898 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:23.951 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:23.951 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:23.985 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:23.983+0000 7fe046ae4800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:23.986 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:23.985+0000 7fe046ae4800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:24.003 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:23Z"} 2023-12-15T23:26:24.004 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:23Z"} 2023-12-15T23:26:24.004 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:24.004 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:24.004 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:24.004 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:29.006 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:29.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:29.006 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:29.059 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:29.059 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:29.093 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:29.092+0000 7f2984b24800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:29.094 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:29.093+0000 7f2984b24800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:29.111 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:29Z"} 2023-12-15T23:26:29.112 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:29Z"} 2023-12-15T23:26:29.112 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:29.112 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:29.112 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:29.112 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:34.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:34.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:34.114 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:34.167 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:34.167 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:34.200 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:34.198+0000 7fa8f1122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:34.201 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:34.199+0000 7fa8f1122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:34.217 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:34Z"} 2023-12-15T23:26:34.218 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:34Z"} 2023-12-15T23:26:34.218 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:34.218 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:34.218 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:34.218 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:39.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:39.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:39.220 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:39.273 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:39.273 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:39.306 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:39.304+0000 7f5d9d737800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:39.307 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:39.306+0000 7f5d9d737800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:39.325 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:39Z"} 2023-12-15T23:26:39.325 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:39Z"} 2023-12-15T23:26:39.325 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:39.325 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:39.325 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:39.326 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:44.326 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:44.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:44.327 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:44.382 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:44.382 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:44.416 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:44.415+0000 7fa3a473a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:44.417 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:44.416+0000 7fa3a473a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:44.435 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:44Z"} 2023-12-15T23:26:44.435 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:44Z"} 2023-12-15T23:26:44.435 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:44.435 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:44.435 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:44.436 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:49.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:49.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:49.437 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:49.490 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:49.491 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:49.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:49.522+0000 7fa5b612e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:49.525 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:49.524+0000 7fa5b612e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:49.542 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:49Z"} 2023-12-15T23:26:49.543 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:49Z"} 2023-12-15T23:26:49.543 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:49.543 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:49.543 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:49.543 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:54.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:54.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:54.544 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:54.598 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:54.598 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:54.630 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:54.629+0000 7f8e4052c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:54.632 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:54.630+0000 7f8e4052c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:54.650 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:54Z"} 2023-12-15T23:26:54.650 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:54Z"} 2023-12-15T23:26:54.650 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:54.650 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:54.650 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:54.650 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:26:59.651 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:59.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:26:59.652 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:26:59.705 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:26:59.705 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:26:59.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:59.738+0000 7f90e9532800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:59.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:26:59.739+0000 7f90e9532800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:26:59.757 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:59Z"} 2023-12-15T23:26:59.758 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:26:59Z"} 2023-12-15T23:26:59.758 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:26:59.758 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:26:59.758 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:26:59.758 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:04.759 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:04.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:04.760 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:04.813 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:04.814 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:04.846 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:04.844+0000 7fefa8926800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:04.847 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:04.845+0000 7fefa8926800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:04.864 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:04Z"} 2023-12-15T23:27:04.865 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:04Z"} 2023-12-15T23:27:04.865 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:04.865 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:04.865 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:04.865 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:09.866 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:09.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:09.867 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:09.923 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:09.923 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:09.955 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:09.953+0000 7f0b34540800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:09.956 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:09.954+0000 7f0b34540800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:09.973 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:09Z"} 2023-12-15T23:27:09.973 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:09Z"} 2023-12-15T23:27:09.974 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:09.974 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:09.974 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:09.974 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:14.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:14.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:14.976 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:15.028 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:15.029 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:15.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:15.060+0000 7ff40e32f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:15.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:15.061+0000 7ff40e32f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:15.079 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:15Z"} 2023-12-15T23:27:15.079 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:15Z"} 2023-12-15T23:27:15.080 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:15.080 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:15.080 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:15.080 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:20.080 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:20.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:20.081 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:20.134 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:20.134 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:20.168 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:20.166+0000 7f22b9520800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:20.170 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:20.168+0000 7f22b9520800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:20Z"} 2023-12-15T23:27:20.187 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:20Z"} 2023-12-15T23:27:20.188 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:20.188 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:20.188 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:20.188 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:25.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:25.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:25.189 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:25.244 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:25.244 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:25.277 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:25.276+0000 7f91f2233800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:25.278 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:25.277+0000 7f91f2233800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:25.295 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:25Z"} 2023-12-15T23:27:25.295 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682679.903327_445.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:24:39.903327Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:25Z"} 2023-12-15T23:27:25.296 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682679.903327_445.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.903327Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:25.296 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:25.296 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682679.903327_445.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:25.296 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682679.903327_445.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:30.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:30.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:30.298 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:30.351 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:30.351 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:30.386 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:30.384+0000 7fd369f35800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:30.387 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:30.386+0000 7fd369f35800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:30.403 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.670949_450.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.670949Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:30Z"} 2023-12-15T23:27:30.404 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.670949_450.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.670949Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:30Z"} 2023-12-15T23:27:30.404 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.670949_450.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.670949Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:30.404 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:30.404 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.670949_450.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:30.404 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702682778.680481_453.1 target=1_1702682778.670949_450.1, shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:35.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:35.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:35.406 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:35.459 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:35.459 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:35.492 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:35.490+0000 7f1ec0726800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:35.493 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:35.491+0000 7f1ec0726800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:35.509 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:35Z"} 2023-12-15T23:27:35.509 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:35Z"} 2023-12-15T23:27:35.510 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:35.510 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:35.510 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:35.510 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:40.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:40.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:40.512 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:40.564 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:40.564 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:40.597 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:40.596+0000 7f20d3d44800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:40.599 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:40.597+0000 7f20d3d44800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:40.616 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:40Z"} 2023-12-15T23:27:40.616 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:40Z"} 2023-12-15T23:27:40.616 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:40.617 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:40.617 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:40.617 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:45.618 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:45.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:45.620 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:45.673 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:45.673 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:45.706 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:45.705+0000 7f3d69b26800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:45.708 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:45.706+0000 7f3d69b26800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:45.726 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:45Z"} 2023-12-15T23:27:45.726 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:45Z"} 2023-12-15T23:27:45.726 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:45.726 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:45.727 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:45.727 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:50.728 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:50.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:50.730 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:50.783 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:50.783 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:50.816 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:50.814+0000 7f0dee53a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:50.817 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:50.815+0000 7f0dee53a800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:50Z"} 2023-12-15T23:27:50.834 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:50Z"} 2023-12-15T23:27:50.835 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:50.835 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:50.835 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:50.835 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:27:55.836 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:55.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:27:55.837 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:27:55.889 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:27:55.889 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:27:55.922 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:55.921+0000 7ff19cf2e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:55.924 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:27:55.922+0000 7ff19cf2e800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:27:55.941 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:55Z"} 2023-12-15T23:27:55.941 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702680871.620243_86.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T22:54:31.620243Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:27:55Z"} 2023-12-15T23:27:55.941 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702680871.620243_86.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T22:54:31.620243Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:27:55.941 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:27:55.941 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702680871.620243_86.1', 2: '', 3: ''} 2023-12-15T23:27:55.942 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1702682778.606100_223.1 target=1_1702680871.620243_86.1 2023-12-15T23:28:00.942 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:28:00.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:28:00.943 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:28:00.996 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:28:00.996 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:28:01.029 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:01.027+0000 7fd377d30800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:28:01.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:01.028+0000 7fd377d30800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:28:01.048 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:28:01Z"} 2023-12-15T23:28:01.048 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702682778.680481_453.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:26:18.680481Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:28:01Z"} 2023-12-15T23:28:01.048 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702682778.680481_453.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.680481Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:28:01.048 DEBUG:rgw_multi.tests:log_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:28:01.048 DEBUG:rgw_multi.tests:sync_status={0: '1_1702682778.680481_453.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:28:01.048 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:28:01.049 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:28:01.049 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:28:01.049 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:28:01.047+0000 7f1525bfc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 111678) UID: 0 2023-12-15T23:28:01.050 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:28:01.047+0000 7f152945b880 -1 shutting down 2023-12-15T23:28:06.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:28:07.150 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:28:07.151 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:28:07.151 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:28:07.151 DEBUG:boto:Method: HEAD 2023-12-15T23:28:07.151 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:28:07.151 DEBUG:boto:Data: 2023-12-15T23:28:07.151 DEBUG:boto:Headers: {} 2023-12-15T23:28:07.151 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.152 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.152 DEBUG:boto:Params: {} 2023-12-15T23:28:07.152 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:28:07.152 DEBUG:boto:Token: None 2023-12-15T23:28:07.153 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/ 2023-12-15T23:28:07.153 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8= 2023-12-15T23:28:07.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8=', 'Content-Length': '0'} 2023-12-15T23:28:07.160 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d716b2a0ca019a3-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.160 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:28:07.161 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:28:07.161 DEBUG:boto:Method: PUT 2023-12-15T23:28:07.161 DEBUG:boto:Path: /kskgfn-50/obj11 2023-12-15T23:28:07.161 DEBUG:boto:Data: 2023-12-15T23:28:07.161 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:28:07.161 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.161 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.161 DEBUG:boto:Params: {} 2023-12-15T23:28:07.161 DEBUG:boto:Token: None 2023-12-15T23:28:07.161 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/obj11 2023-12-15T23:28:07.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7ZoYsYQA88dbPdiFOw5Lo9v7vaA= 2023-12-15T23:28:07.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7ZoYsYQA88dbPdiFOw5Lo9v7vaA='} 2023-12-15T23:28:07.169 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003cfd3c2e36fff2cc-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.170 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:28:07.170 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:28:07.170 DEBUG:boto:Method: HEAD 2023-12-15T23:28:07.170 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:28:07.170 DEBUG:boto:Data: 2023-12-15T23:28:07.170 DEBUG:boto:Headers: {} 2023-12-15T23:28:07.170 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.170 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.170 DEBUG:boto:Params: {} 2023-12-15T23:28:07.170 DEBUG:boto:Token: None 2023-12-15T23:28:07.170 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/ 2023-12-15T23:28:07.170 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8= 2023-12-15T23:28:07.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8=', 'Content-Length': '0'} 2023-12-15T23:28:07.173 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007c18d712953eac07-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.173 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:28:07.173 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:28:07.173 DEBUG:boto:Method: PUT 2023-12-15T23:28:07.173 DEBUG:boto:Path: /kskgfn-50/obj22 2023-12-15T23:28:07.173 DEBUG:boto:Data: 2023-12-15T23:28:07.173 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:28:07.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.174 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.174 DEBUG:boto:Params: {} 2023-12-15T23:28:07.174 DEBUG:boto:Token: None 2023-12-15T23:28:07.174 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/obj22 2023-12-15T23:28:07.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9nAV+qxVqk/QrovzDqSy9Nx5544= 2023-12-15T23:28:07.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9nAV+qxVqk/QrovzDqSy9Nx5544='} 2023-12-15T23:28:07.178 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e090dd600b2bd63b-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.179 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:28:07.179 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:28:07.179 DEBUG:boto:Method: HEAD 2023-12-15T23:28:07.179 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:28:07.179 DEBUG:boto:Data: 2023-12-15T23:28:07.179 DEBUG:boto:Headers: {} 2023-12-15T23:28:07.179 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.179 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.179 DEBUG:boto:Params: {} 2023-12-15T23:28:07.179 DEBUG:boto:Token: None 2023-12-15T23:28:07.179 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/ 2023-12-15T23:28:07.179 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8= 2023-12-15T23:28:07.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8=', 'Content-Length': '0'} 2023-12-15T23:28:07.181 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f527c1aa35bcdb6-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.182 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:28:07.182 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:28:07.182 DEBUG:boto:Method: PUT 2023-12-15T23:28:07.182 DEBUG:boto:Path: /kskgfn-50/obj33 2023-12-15T23:28:07.182 DEBUG:boto:Data: 2023-12-15T23:28:07.182 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:28:07.182 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.182 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.182 DEBUG:boto:Params: {} 2023-12-15T23:28:07.183 DEBUG:boto:Token: None 2023-12-15T23:28:07.183 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/obj33 2023-12-15T23:28:07.183 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oNKnQY+B+JFmFp5ATUj54ykkd9M= 2023-12-15T23:28:07.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oNKnQY+B+JFmFp5ATUj54ykkd9M='} 2023-12-15T23:28:07.226 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000067cd3bf187019b06-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.226 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:28:07.226 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:28:07.226 DEBUG:boto:Method: HEAD 2023-12-15T23:28:07.226 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:28:07.226 DEBUG:boto:Data: 2023-12-15T23:28:07.226 DEBUG:boto:Headers: {} 2023-12-15T23:28:07.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.226 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.226 DEBUG:boto:Params: {} 2023-12-15T23:28:07.226 DEBUG:boto:Token: None 2023-12-15T23:28:07.227 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/ 2023-12-15T23:28:07.227 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8= 2023-12-15T23:28:07.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8=', 'Content-Length': '0'} 2023-12-15T23:28:07.229 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054da8509d93ff086-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.230 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:28:07.230 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:28:07.230 DEBUG:boto:Method: PUT 2023-12-15T23:28:07.230 DEBUG:boto:Path: /kskgfn-50/obj44 2023-12-15T23:28:07.230 DEBUG:boto:Data: 2023-12-15T23:28:07.230 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:28:07.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.230 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.230 DEBUG:boto:Params: {} 2023-12-15T23:28:07.230 DEBUG:boto:Token: None 2023-12-15T23:28:07.231 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/obj44 2023-12-15T23:28:07.231 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6GrG0u/ba1X711zCux+pEMwPSGg= 2023-12-15T23:28:07.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6GrG0u/ba1X711zCux+pEMwPSGg='} 2023-12-15T23:28:07.238 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ca2d8b27bf62cfc9-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.238 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:28:07.238 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:28:07.238 DEBUG:boto:Method: HEAD 2023-12-15T23:28:07.238 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:28:07.238 DEBUG:boto:Data: 2023-12-15T23:28:07.238 DEBUG:boto:Headers: {} 2023-12-15T23:28:07.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.238 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.238 DEBUG:boto:Params: {} 2023-12-15T23:28:07.238 DEBUG:boto:Token: None 2023-12-15T23:28:07.239 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/ 2023-12-15T23:28:07.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8= 2023-12-15T23:28:07.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RhmN1cTEEFj8bQS6oJSkOxZ4Ua8=', 'Content-Length': '0'} 2023-12-15T23:28:07.241 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000fd7cd528272e33f-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.241 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:28:07.241 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:28:07.241 DEBUG:boto:Method: PUT 2023-12-15T23:28:07.242 DEBUG:boto:Path: /kskgfn-50/obj55 2023-12-15T23:28:07.242 DEBUG:boto:Data: 2023-12-15T23:28:07.242 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:28:07.242 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:28:07.242 DEBUG:boto:Port: 8000 2023-12-15T23:28:07.242 DEBUG:boto:Params: {} 2023-12-15T23:28:07.242 DEBUG:boto:Token: None 2023-12-15T23:28:07.242 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:28:07 GMT /kskgfn-50/obj55 2023-12-15T23:28:07.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kdc9CIMm9NXdmFQW1GtG3Ykd/+M= 2023-12-15T23:28:07.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:28:07 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kdc9CIMm9NXdmFQW1GtG3Ykd/+M='} 2023-12-15T23:28:07.247 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000089d029005b29748c-00657ce107-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:28:07.247 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:28:07.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:28:07.247 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:28:07.302 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:28:07.302 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:28:07.336 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:07.335+0000 7ff71168a800 5 RGW-SYNC:data: waiting on data sync status lease 2023-12-15T23:28:07.337 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:07.336+0000 7ff71168a800 5 RGW-SYNC:data: acquired data sync status lease 2023-12-15T23:28:07.363 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:28:07.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:28:07.365 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:28:07.365 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:28:07.382 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:28:07.382 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:28:07.382 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:28:07.383 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:28:07.383 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:28:08.384 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:28:08.403 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:28:08.403 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:28:08.404 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:28:08.404 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:28:08.404 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-50 2023-12-15T23:28:08.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:28:08.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:28:08.405 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:28:08.498 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:28:08.498 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:28:08.533 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:08.532+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:09.697 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:28:09.695+0000 7f720497d640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:28:12.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T23:28:13.534 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:13.532+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:18.535 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:18.533+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:23.535 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:23.534+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:28.536 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:28.534+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:33.537 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:33.535+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:38.536+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:43.538 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:43.536+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:48.539 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:48.537+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:53.539 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:53.537+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:28:58.540 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:28:58.538+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:03.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:03.539+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:08.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:08.540+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:13.542 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:13.540+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:18.541+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:23.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:23.541+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:28.544 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:28.542+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:33.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:33.543+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:38.545 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:38.544+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:41.535 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:29:41.533+0000 7f7210995640 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2023-12-15T23:29:43.546 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:43.543+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:48.546 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:48.544+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:53.547 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:53.545+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:29:58.547 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:29:58.546+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:03.548 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:03.546+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:08.549 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:08.547+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:13.547+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:18.548+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:23.551 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:23.549+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:28.551 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:28.550+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:33.552 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:33.550+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:38.553 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:38.550+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:43.554 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:43.551+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:48.554 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:48.552+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:53.555 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:53.553+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:30:58.555 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:30:58.554+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:31:03.556 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:03.554+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:31:08.557 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:08.555+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:31:13.557 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:13.556+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:31:18.558 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:18.556+0000 7f3361cc0800 1 waiting to reach incremental sync.. 2023-12-15T23:31:23.560 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:23.558+0000 7f3361cc0800 1 bucket sync caught up with source: 2023-12-15T23:31:23.560 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , , , 00000000001.78.6, 00000000002.87.6, 00000000002.45.6] 2023-12-15T23:31:23.560 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , , , 00000000001.78.6, 00000000002.87.6, 00000000002.45.6] 2023-12-15T23:31:23.560 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:23.558+0000 7f3361cc0800 0 bucket checkpoint complete 2023-12-15T23:31:23.580 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-50 2023-12-15T23:31:23.580 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:31:23.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:31:23.582 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:31:23.645 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:23.645 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:23.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:31:23.688+0000 7fcabf8c0800 1 bucket sync caught up with source: 2023-12-15T23:31:23.690 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , , , , 00000000001.51.6, 00000000002.135.6, 00000000002.49.6] 2023-12-15T23:31:23.690 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , , , , 00000000001.51.6, 00000000002.135.6, 00000000002.49.6] 2023-12-15T23:31:23.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:31:23.688+0000 7fcabf8c0800 0 bucket checkpoint complete 2023-12-15T23:31:23.707 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-50 zones={test-zone2, test-zone1} 2023-12-15T23:31:23.707 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.708 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.708 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.708 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:31:23.708 DEBUG:boto:Data: 2023-12-15T23:31:23.708 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.708 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.708 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.708 DEBUG:boto:Params: {} 2023-12-15T23:31:23.709 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:31:23.709 DEBUG:boto:Token: None 2023-12-15T23:31:23.710 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:73zcNk9lyt2wh1TVz2QaKwMaLgU= 2023-12-15T23:31:23.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:73zcNk9lyt2wh1TVz2QaKwMaLgU=', 'Content-Length': '0'} 2023-12-15T23:31:23.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058deeabc428fb1be-00657ce1cb-5788-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.716 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.717 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.717 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.717 DEBUG:boto:Path: /kskgfn-50/ 2023-12-15T23:31:23.717 DEBUG:boto:Data: 2023-12-15T23:31:23.717 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.717 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.717 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.717 DEBUG:boto:Params: {} 2023-12-15T23:31:23.717 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:31:23.718 DEBUG:boto:Token: None 2023-12-15T23:31:23.718 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.718 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:73zcNk9lyt2wh1TVz2QaKwMaLgU= 2023-12-15T23:31:23.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:73zcNk9lyt2wh1TVz2QaKwMaLgU=', 'Content-Length': '0'} 2023-12-15T23:31:23.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000127568a3ea7c7ffd-00657ce1cb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.721 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:31:23.722 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.722 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.722 DEBUG:boto:path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.722 DEBUG:boto:auth_path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.722 DEBUG:boto:Method: GET 2023-12-15T23:31:23.722 DEBUG:boto:Path: /kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.722 DEBUG:boto:Data: 2023-12-15T23:31:23.722 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.722 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.722 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.723 DEBUG:boto:Params: {} 2023-12-15T23:31:23.723 DEBUG:boto:Token: None 2023-12-15T23:31:23.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/?versions 2023-12-15T23:31:23.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg= 2023-12-15T23:31:23.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg=', 'Content-Length': '0'} 2023-12-15T23:31:23.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032e345640234f266-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.725 DEBUG:boto:b'kskgfn-50999falseobj11nulltrue2023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:31:23.727 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:31:23.727 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.728 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.728 DEBUG:boto:path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.728 DEBUG:boto:auth_path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.728 DEBUG:boto:Method: GET 2023-12-15T23:31:23.728 DEBUG:boto:Path: /kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.728 DEBUG:boto:Data: 2023-12-15T23:31:23.728 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.728 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.728 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.728 DEBUG:boto:Params: {} 2023-12-15T23:31:23.728 DEBUG:boto:Token: None 2023-12-15T23:31:23.729 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/?versions 2023-12-15T23:31:23.729 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg= 2023-12-15T23:31:23.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg=', 'Content-Length': '0'} 2023-12-15T23:31:23.731 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060a393ada3dc2405-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.732 DEBUG:boto:b'kskgfn-50999falseobj11nulltrue2023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.732 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:31:23.733 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:31:23.733 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:31:23.733 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:31:23.733 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:31:23.733 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.733 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.733 DEBUG:boto:path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.733 DEBUG:boto:auth_path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.733 DEBUG:boto:Method: GET 2023-12-15T23:31:23.733 DEBUG:boto:Path: /kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.734 DEBUG:boto:Data: 2023-12-15T23:31:23.734 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.734 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.734 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.734 DEBUG:boto:Params: {} 2023-12-15T23:31:23.734 DEBUG:boto:Token: None 2023-12-15T23:31:23.734 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/?versions 2023-12-15T23:31:23.734 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg= 2023-12-15T23:31:23.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg=', 'Content-Length': '0'} 2023-12-15T23:31:23.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b85a94dea45fefc0-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.737 DEBUG:boto:b'kskgfn-50999falseobj11nulltrue2023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.738 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.738 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.738 DEBUG:boto:path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.738 DEBUG:boto:auth_path=/kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.738 DEBUG:boto:Method: GET 2023-12-15T23:31:23.738 DEBUG:boto:Path: /kskgfn-50/?versions&max-keys=999 2023-12-15T23:31:23.739 DEBUG:boto:Data: 2023-12-15T23:31:23.739 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.739 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.739 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.739 DEBUG:boto:Params: {} 2023-12-15T23:31:23.739 DEBUG:boto:Token: None 2023-12-15T23:31:23.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/?versions 2023-12-15T23:31:23.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg= 2023-12-15T23:31:23.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VleCvTNHgQ1eifynWFe5QH9pKHg=', 'Content-Length': '0'} 2023-12-15T23:31:23.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d9b12130913a491-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.742 DEBUG:boto:b'kskgfn-50999falseobj11nulltrue2023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:31:23.743 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.743 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.743 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.743 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.743 DEBUG:boto:Method: GET 2023-12-15T23:31:23.743 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.743 DEBUG:boto:Data: 2023-12-15T23:31:23.743 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.743 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.743 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.743 DEBUG:boto:Params: {} 2023-12-15T23:31:23.744 DEBUG:boto:Token: None 2023-12-15T23:31:23.744 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.744 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs= 2023-12-15T23:31:23.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs=', 'Content-Length': '0'} 2023-12-15T23:31:23.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b166b5efd6cd2a88-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.746 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.747 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.747 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.747 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.747 DEBUG:boto:Method: GET 2023-12-15T23:31:23.747 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.747 DEBUG:boto:Data: 2023-12-15T23:31:23.747 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.747 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.747 DEBUG:boto:Params: {} 2023-12-15T23:31:23.747 DEBUG:boto:Token: None 2023-12-15T23:31:23.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.748 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs= 2023-12-15T23:31:23.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs=', 'Content-Length': '0'} 2023-12-15T23:31:23.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058569569577d8e34-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.750 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.750 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.750 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.750 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.750 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.750 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.750 DEBUG:boto:Data: 2023-12-15T23:31:23.750 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.750 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.750 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.750 DEBUG:boto:Params: {} 2023-12-15T23:31:23.751 DEBUG:boto:Token: None 2023-12-15T23:31:23.751 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wBVHgGKLgCWj6g49wtJUXmR+dvI= 2023-12-15T23:31:23.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wBVHgGKLgCWj6g49wtJUXmR+dvI=', 'Content-Length': '0'} 2023-12-15T23:31:23.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2006885a99d4adc-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.753 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.753 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.753 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.753 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.753 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.753 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.753 DEBUG:boto:Data: 2023-12-15T23:31:23.753 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.753 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.754 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.754 DEBUG:boto:Params: {} 2023-12-15T23:31:23.754 DEBUG:boto:Token: None 2023-12-15T23:31:23.754 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wBVHgGKLgCWj6g49wtJUXmR+dvI= 2023-12-15T23:31:23.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wBVHgGKLgCWj6g49wtJUXmR+dvI=', 'Content-Length': '0'} 2023-12-15T23:31:23.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007089794a60cfeab6-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:31:23.756 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.757 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.757 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.757 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.757 DEBUG:boto:Method: GET 2023-12-15T23:31:23.757 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.757 DEBUG:boto:Data: 2023-12-15T23:31:23.757 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.757 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.757 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.757 DEBUG:boto:Params: {} 2023-12-15T23:31:23.758 DEBUG:boto:Token: None 2023-12-15T23:31:23.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs= 2023-12-15T23:31:23.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs=', 'Content-Length': '0'} 2023-12-15T23:31:23.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bf95c1e703a03b9-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.805 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.806 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.806 DEBUG:boto:path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.806 DEBUG:boto:auth_path=/kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.806 DEBUG:boto:Method: GET 2023-12-15T23:31:23.806 DEBUG:boto:Path: /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.806 DEBUG:boto:Data: 2023-12-15T23:31:23.806 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.806 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.806 DEBUG:boto:Params: {} 2023-12-15T23:31:23.806 DEBUG:boto:Token: None 2023-12-15T23:31:23.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11?versionId=null 2023-12-15T23:31:23.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs= 2023-12-15T23:31:23.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1vZYRHVT3IQET984En2UdjmG6qs=', 'Content-Length': '0'} 2023-12-15T23:31:23.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e36ff31c07c6909-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.809 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.809 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.809 DEBUG:boto:path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.809 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.809 DEBUG:boto:Method: GET 2023-12-15T23:31:23.809 DEBUG:boto:Path: /kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.809 DEBUG:boto:Data: 2023-12-15T23:31:23.809 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.809 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.810 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.810 DEBUG:boto:Params: {} 2023-12-15T23:31:23.810 DEBUG:boto:Token: None 2023-12-15T23:31:23.810 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.810 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6d64c1242e2e1b4-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.812 DEBUG:boto:b'kskgfn-50obj111000falseobj112023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.813 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.813 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.813 DEBUG:boto:path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.813 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.813 DEBUG:boto:Method: GET 2023-12-15T23:31:23.813 DEBUG:boto:Path: /kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.814 DEBUG:boto:Data: 2023-12-15T23:31:23.814 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.814 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.814 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.814 DEBUG:boto:Params: {} 2023-12-15T23:31:23.814 DEBUG:boto:Token: None 2023-12-15T23:31:23.814 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.814 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.816 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000700a9a25cff37a8-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.817 DEBUG:boto:b'kskgfn-50obj111000falseobj112023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.817 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.817 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.817 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.817 DEBUG:boto:Path: /kskgfn-50/obj11 2023-12-15T23:31:23.817 DEBUG:boto:Data: 2023-12-15T23:31:23.817 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.817 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.818 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.818 DEBUG:boto:Params: {} 2023-12-15T23:31:23.818 DEBUG:boto:Token: None 2023-12-15T23:31:23.818 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11 2023-12-15T23:31:23.818 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7zejemakcJoj71iM69OIQ3hA2Ck= 2023-12-15T23:31:23.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7zejemakcJoj71iM69OIQ3hA2Ck=', 'Content-Length': '0'} 2023-12-15T23:31:23.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ba89a4e85b386ae-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.820 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.820 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.821 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.821 DEBUG:boto:Path: /kskgfn-50/obj11 2023-12-15T23:31:23.821 DEBUG:boto:Data: 2023-12-15T23:31:23.821 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.821 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.821 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.822 DEBUG:boto:Params: {} 2023-12-15T23:31:23.822 DEBUG:boto:Token: None 2023-12-15T23:31:23.822 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11 2023-12-15T23:31:23.822 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7zejemakcJoj71iM69OIQ3hA2Ck= 2023-12-15T23:31:23.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7zejemakcJoj71iM69OIQ3hA2Ck=', 'Content-Length': '0'} 2023-12-15T23:31:23.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000460c9aa732c977b8-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:31:23.824 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.824 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.824 DEBUG:boto:Method: GET 2023-12-15T23:31:23.825 DEBUG:boto:Path: /kskgfn-50/obj11 2023-12-15T23:31:23.825 DEBUG:boto:Data: 2023-12-15T23:31:23.825 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.825 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.825 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.825 DEBUG:boto:Params: {} 2023-12-15T23:31:23.825 DEBUG:boto:Token: None 2023-12-15T23:31:23.825 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11 2023-12-15T23:31:23.825 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DD1jxd1Bd6GCfCQMFF8TLBZJr54= 2023-12-15T23:31:23.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DD1jxd1Bd6GCfCQMFF8TLBZJr54=', 'Content-Length': '0'} 2023-12-15T23:31:23.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009fab7fd6ea006878-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.869 DEBUG:boto:path=/kskgfn-50/obj11 2023-12-15T23:31:23.870 DEBUG:boto:auth_path=/kskgfn-50/obj11 2023-12-15T23:31:23.870 DEBUG:boto:Method: GET 2023-12-15T23:31:23.870 DEBUG:boto:Path: /kskgfn-50/obj11 2023-12-15T23:31:23.870 DEBUG:boto:Data: 2023-12-15T23:31:23.870 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.870 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.870 DEBUG:boto:Params: {} 2023-12-15T23:31:23.870 DEBUG:boto:Token: None 2023-12-15T23:31:23.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj11 2023-12-15T23:31:23.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DD1jxd1Bd6GCfCQMFF8TLBZJr54= 2023-12-15T23:31:23.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DD1jxd1Bd6GCfCQMFF8TLBZJr54=', 'Content-Length': '0'} 2023-12-15T23:31:23.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e3fe648b151b5d8-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.872 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.873 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.873 DEBUG:boto:path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.873 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.873 DEBUG:boto:Method: GET 2023-12-15T23:31:23.873 DEBUG:boto:Path: /kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.873 DEBUG:boto:Data: 2023-12-15T23:31:23.873 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.873 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.873 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.873 DEBUG:boto:Params: {} 2023-12-15T23:31:23.874 DEBUG:boto:Token: None 2023-12-15T23:31:23.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.876 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fce1d17b277c95ba-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.876 DEBUG:boto:b'kskgfn-50obj111000falseobj112023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.877 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.877 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.877 DEBUG:boto:path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.877 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.877 DEBUG:boto:Method: GET 2023-12-15T23:31:23.877 DEBUG:boto:Path: /kskgfn-50/?prefix=obj11 2023-12-15T23:31:23.877 DEBUG:boto:Data: 2023-12-15T23:31:23.877 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.878 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.878 DEBUG:boto:Params: {} 2023-12-15T23:31:23.878 DEBUG:boto:Token: None 2023-12-15T23:31:23.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.880 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000879918a289dfa3b-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.880 DEBUG:boto:b'kskgfn-50obj111000falseobj112023-12-15T23:28:07.163Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:31:23.881 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.881 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.881 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.881 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.881 DEBUG:boto:Method: GET 2023-12-15T23:31:23.881 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.881 DEBUG:boto:Data: 2023-12-15T23:31:23.881 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.881 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.882 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.882 DEBUG:boto:Params: {} 2023-12-15T23:31:23.882 DEBUG:boto:Token: None 2023-12-15T23:31:23.882 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.882 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q= 2023-12-15T23:31:23.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q=', 'Content-Length': '0'} 2023-12-15T23:31:23.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dec54899d9313f82-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.884 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.884 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.884 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.885 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.885 DEBUG:boto:Method: GET 2023-12-15T23:31:23.885 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.885 DEBUG:boto:Data: 2023-12-15T23:31:23.885 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.885 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.885 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.885 DEBUG:boto:Params: {} 2023-12-15T23:31:23.885 DEBUG:boto:Token: None 2023-12-15T23:31:23.885 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.885 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q= 2023-12-15T23:31:23.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q=', 'Content-Length': '0'} 2023-12-15T23:31:23.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000179934583812c4f0-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.887 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.888 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.888 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.888 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.888 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.888 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.888 DEBUG:boto:Data: 2023-12-15T23:31:23.888 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.888 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.888 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.888 DEBUG:boto:Params: {} 2023-12-15T23:31:23.888 DEBUG:boto:Token: None 2023-12-15T23:31:23.889 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.889 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zk707N29in+4d7bUDK11+vEw294= 2023-12-15T23:31:23.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zk707N29in+4d7bUDK11+vEw294=', 'Content-Length': '0'} 2023-12-15T23:31:23.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fac612d258e6fbb6-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.891 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.891 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.891 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.891 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.891 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.891 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.891 DEBUG:boto:Data: 2023-12-15T23:31:23.891 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.891 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.891 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.891 DEBUG:boto:Params: {} 2023-12-15T23:31:23.892 DEBUG:boto:Token: None 2023-12-15T23:31:23.892 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.892 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Zk707N29in+4d7bUDK11+vEw294= 2023-12-15T23:31:23.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Zk707N29in+4d7bUDK11+vEw294=', 'Content-Length': '0'} 2023-12-15T23:31:23.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000956aec69e7e4f972-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:31:23.894 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.894 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.894 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.894 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.894 DEBUG:boto:Method: GET 2023-12-15T23:31:23.894 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.894 DEBUG:boto:Data: 2023-12-15T23:31:23.895 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.895 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.895 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.895 DEBUG:boto:Params: {} 2023-12-15T23:31:23.895 DEBUG:boto:Token: None 2023-12-15T23:31:23.895 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q= 2023-12-15T23:31:23.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q=', 'Content-Length': '0'} 2023-12-15T23:31:23.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009409ee385fc82939-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.937 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.938 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.938 DEBUG:boto:path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.938 DEBUG:boto:auth_path=/kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.938 DEBUG:boto:Method: GET 2023-12-15T23:31:23.938 DEBUG:boto:Path: /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.938 DEBUG:boto:Data: 2023-12-15T23:31:23.938 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.938 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.938 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.938 DEBUG:boto:Params: {} 2023-12-15T23:31:23.938 DEBUG:boto:Token: None 2023-12-15T23:31:23.939 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22?versionId=null 2023-12-15T23:31:23.939 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q= 2023-12-15T23:31:23.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zBfxoA4A5kvXrpjyZ+NhtK475Q=', 'Content-Length': '0'} 2023-12-15T23:31:23.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001a1934e2715c1de-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.941 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.941 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.941 DEBUG:boto:path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.941 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.942 DEBUG:boto:Method: GET 2023-12-15T23:31:23.942 DEBUG:boto:Path: /kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.942 DEBUG:boto:Data: 2023-12-15T23:31:23.942 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.942 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.942 DEBUG:boto:Params: {} 2023-12-15T23:31:23.942 DEBUG:boto:Token: None 2023-12-15T23:31:23.942 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0511a40d7e4505e-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.945 DEBUG:boto:b'kskgfn-50obj221000falseobj222023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.946 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:23.946 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:23.946 DEBUG:boto:path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.946 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.946 DEBUG:boto:Method: GET 2023-12-15T23:31:23.946 DEBUG:boto:Path: /kskgfn-50/?prefix=obj22 2023-12-15T23:31:23.946 DEBUG:boto:Data: 2023-12-15T23:31:23.946 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.946 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.946 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.947 DEBUG:boto:Params: {} 2023-12-15T23:31:23.947 DEBUG:boto:Token: None 2023-12-15T23:31:23.947 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/ 2023-12-15T23:31:23.947 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c= 2023-12-15T23:31:23.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6irRKnFRz+YS58cibBTvNuQ6/0c=', 'Content-Length': '0'} 2023-12-15T23:31:23.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d224b99389b2f78-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.949 DEBUG:boto:b'kskgfn-50obj221000falseobj222023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:23.950 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.950 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.950 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.950 DEBUG:boto:Path: /kskgfn-50/obj22 2023-12-15T23:31:23.950 DEBUG:boto:Data: 2023-12-15T23:31:23.950 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.950 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.950 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.950 DEBUG:boto:Params: {} 2023-12-15T23:31:23.950 DEBUG:boto:Token: None 2023-12-15T23:31:23.951 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22 2023-12-15T23:31:23.951 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKItd/gGWfWGC1AfH7/xxjZ7u00= 2023-12-15T23:31:23.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKItd/gGWfWGC1AfH7/xxjZ7u00=', 'Content-Length': '0'} 2023-12-15T23:31:23.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd5c684c86181b09-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.953 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.953 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.953 DEBUG:boto:Method: HEAD 2023-12-15T23:31:23.953 DEBUG:boto:Path: /kskgfn-50/obj22 2023-12-15T23:31:23.953 DEBUG:boto:Data: 2023-12-15T23:31:23.953 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.953 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:23.953 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.953 DEBUG:boto:Params: {} 2023-12-15T23:31:23.954 DEBUG:boto:Token: None 2023-12-15T23:31:23.954 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22 2023-12-15T23:31:23.954 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JKItd/gGWfWGC1AfH7/xxjZ7u00= 2023-12-15T23:31:23.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JKItd/gGWfWGC1AfH7/xxjZ7u00=', 'Content-Length': '0'} 2023-12-15T23:31:23.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed9f0df49421ec0c-00657ce1cb-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:23.956 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:31:23.956 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:23.956 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:23.956 DEBUG:boto:Method: GET 2023-12-15T23:31:23.956 DEBUG:boto:Path: /kskgfn-50/obj22 2023-12-15T23:31:23.956 DEBUG:boto:Data: 2023-12-15T23:31:23.956 DEBUG:boto:Headers: {} 2023-12-15T23:31:23.956 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:23.957 DEBUG:boto:Port: 8000 2023-12-15T23:31:23.957 DEBUG:boto:Params: {} 2023-12-15T23:31:23.957 DEBUG:boto:Token: None 2023-12-15T23:31:23.957 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:23 GMT /kskgfn-50/obj22 2023-12-15T23:31:23.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4fxY6+EiAWTSo0l9UCdVqD00f58= 2023-12-15T23:31:23.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:23 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4fxY6+EiAWTSo0l9UCdVqD00f58=', 'Content-Length': '0'} 2023-12-15T23:31:23.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbfd5b873d163dcf-00657ce1cb-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:23 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.001 DEBUG:boto:path=/kskgfn-50/obj22 2023-12-15T23:31:24.001 DEBUG:boto:auth_path=/kskgfn-50/obj22 2023-12-15T23:31:24.002 DEBUG:boto:Method: GET 2023-12-15T23:31:24.002 DEBUG:boto:Path: /kskgfn-50/obj22 2023-12-15T23:31:24.002 DEBUG:boto:Data: 2023-12-15T23:31:24.002 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.002 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.002 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.002 DEBUG:boto:Params: {} 2023-12-15T23:31:24.002 DEBUG:boto:Token: None 2023-12-15T23:31:24.002 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj22 2023-12-15T23:31:24.002 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IBp2AWBSCQ0/Gx9CUNekYwHf7hw= 2023-12-15T23:31:24.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IBp2AWBSCQ0/Gx9CUNekYwHf7hw=', 'Content-Length': '0'} 2023-12-15T23:31:24.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043697a9cf63d1420-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.005 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.005 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.005 DEBUG:boto:path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.005 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.005 DEBUG:boto:Method: GET 2023-12-15T23:31:24.005 DEBUG:boto:Path: /kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.005 DEBUG:boto:Data: 2023-12-15T23:31:24.005 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.005 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.005 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.005 DEBUG:boto:Params: {} 2023-12-15T23:31:24.006 DEBUG:boto:Token: None 2023-12-15T23:31:24.006 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.006 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.008 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8e88efab4673489-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.049 DEBUG:boto:b'kskgfn-50obj221000falseobj222023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.050 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.050 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.050 DEBUG:boto:path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.050 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.051 DEBUG:boto:Method: GET 2023-12-15T23:31:24.051 DEBUG:boto:Path: /kskgfn-50/?prefix=obj22 2023-12-15T23:31:24.051 DEBUG:boto:Data: 2023-12-15T23:31:24.051 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.051 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.051 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.051 DEBUG:boto:Params: {} 2023-12-15T23:31:24.051 DEBUG:boto:Token: None 2023-12-15T23:31:24.051 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.051 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.054 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014087cdfa25acd4d-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.054 DEBUG:boto:b'kskgfn-50obj221000falseobj222023-12-15T23:28:07.175Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:31:24.055 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.055 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.055 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.055 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.055 DEBUG:boto:Method: GET 2023-12-15T23:31:24.055 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.055 DEBUG:boto:Data: 2023-12-15T23:31:24.055 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.055 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.055 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.056 DEBUG:boto:Params: {} 2023-12-15T23:31:24.056 DEBUG:boto:Token: None 2023-12-15T23:31:24.056 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.056 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo= 2023-12-15T23:31:24.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo=', 'Content-Length': '0'} 2023-12-15T23:31:24.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027ed6c9489320cad-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.058 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.058 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.058 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.059 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.059 DEBUG:boto:Method: GET 2023-12-15T23:31:24.059 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.059 DEBUG:boto:Data: 2023-12-15T23:31:24.059 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.059 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.059 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.059 DEBUG:boto:Params: {} 2023-12-15T23:31:24.059 DEBUG:boto:Token: None 2023-12-15T23:31:24.059 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.060 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo= 2023-12-15T23:31:24.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo=', 'Content-Length': '0'} 2023-12-15T23:31:24.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097e98fd06e1dab22-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.105 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.106 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.106 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.106 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.106 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.106 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.106 DEBUG:boto:Data: 2023-12-15T23:31:24.106 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.106 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.106 DEBUG:boto:Params: {} 2023-12-15T23:31:24.107 DEBUG:boto:Token: None 2023-12-15T23:31:24.107 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZbHvT0vQm9Z3UBmF13bnq1I0Yk8= 2023-12-15T23:31:24.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZbHvT0vQm9Z3UBmF13bnq1I0Yk8=', 'Content-Length': '0'} 2023-12-15T23:31:24.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4370a27a21ddb8c-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.109 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.109 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.109 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.109 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.110 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.110 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.110 DEBUG:boto:Data: 2023-12-15T23:31:24.110 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.110 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.110 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.110 DEBUG:boto:Params: {} 2023-12-15T23:31:24.110 DEBUG:boto:Token: None 2023-12-15T23:31:24.110 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.110 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZbHvT0vQm9Z3UBmF13bnq1I0Yk8= 2023-12-15T23:31:24.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZbHvT0vQm9Z3UBmF13bnq1I0Yk8=', 'Content-Length': '0'} 2023-12-15T23:31:24.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6c03f1633de8f3e-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:31:24.113 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.113 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.113 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.113 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.113 DEBUG:boto:Method: GET 2023-12-15T23:31:24.113 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.113 DEBUG:boto:Data: 2023-12-15T23:31:24.113 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.113 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.114 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.114 DEBUG:boto:Params: {} 2023-12-15T23:31:24.114 DEBUG:boto:Token: None 2023-12-15T23:31:24.114 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo= 2023-12-15T23:31:24.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo=', 'Content-Length': '0'} 2023-12-15T23:31:24.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000315f8994290536b8-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.157 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.158 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.158 DEBUG:boto:path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.158 DEBUG:boto:auth_path=/kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.158 DEBUG:boto:Method: GET 2023-12-15T23:31:24.158 DEBUG:boto:Path: /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.158 DEBUG:boto:Data: 2023-12-15T23:31:24.158 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.158 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.158 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.158 DEBUG:boto:Params: {} 2023-12-15T23:31:24.158 DEBUG:boto:Token: None 2023-12-15T23:31:24.159 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33?versionId=null 2023-12-15T23:31:24.159 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo= 2023-12-15T23:31:24.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hZdaytsBvrr44b+C3g2QLkJUsUo=', 'Content-Length': '0'} 2023-12-15T23:31:24.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e19f11919dfc421f-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.161 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.161 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.161 DEBUG:boto:path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.161 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.161 DEBUG:boto:Method: GET 2023-12-15T23:31:24.161 DEBUG:boto:Path: /kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.162 DEBUG:boto:Data: 2023-12-15T23:31:24.162 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.162 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.162 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.162 DEBUG:boto:Params: {} 2023-12-15T23:31:24.162 DEBUG:boto:Token: None 2023-12-15T23:31:24.162 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.162 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe71c17342e3dd04-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.165 DEBUG:boto:b'kskgfn-50obj331000falseobj332023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.165 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.165 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.165 DEBUG:boto:path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.166 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.166 DEBUG:boto:Method: GET 2023-12-15T23:31:24.166 DEBUG:boto:Path: /kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.166 DEBUG:boto:Data: 2023-12-15T23:31:24.166 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.166 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.166 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.166 DEBUG:boto:Params: {} 2023-12-15T23:31:24.166 DEBUG:boto:Token: None 2023-12-15T23:31:24.166 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006205e28ad8a20852-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.169 DEBUG:boto:b'kskgfn-50obj331000falseobj332023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.170 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.170 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.170 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.170 DEBUG:boto:Path: /kskgfn-50/obj33 2023-12-15T23:31:24.171 DEBUG:boto:Data: 2023-12-15T23:31:24.171 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.171 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.171 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.171 DEBUG:boto:Params: {} 2023-12-15T23:31:24.171 DEBUG:boto:Token: None 2023-12-15T23:31:24.171 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33 2023-12-15T23:31:24.171 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BvlgSn7JkDtgLyP0wpQgDzD28Tg= 2023-12-15T23:31:24.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BvlgSn7JkDtgLyP0wpQgDzD28Tg=', 'Content-Length': '0'} 2023-12-15T23:31:24.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e2d1a2c8d6f5b15-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.174 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.174 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.174 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.174 DEBUG:boto:Path: /kskgfn-50/obj33 2023-12-15T23:31:24.174 DEBUG:boto:Data: 2023-12-15T23:31:24.174 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.174 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.174 DEBUG:boto:Params: {} 2023-12-15T23:31:24.174 DEBUG:boto:Token: None 2023-12-15T23:31:24.175 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33 2023-12-15T23:31:24.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BvlgSn7JkDtgLyP0wpQgDzD28Tg= 2023-12-15T23:31:24.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BvlgSn7JkDtgLyP0wpQgDzD28Tg=', 'Content-Length': '0'} 2023-12-15T23:31:24.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6df9f3aab21aec4-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.177 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:31:24.177 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.177 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.177 DEBUG:boto:Method: GET 2023-12-15T23:31:24.177 DEBUG:boto:Path: /kskgfn-50/obj33 2023-12-15T23:31:24.177 DEBUG:boto:Data: 2023-12-15T23:31:24.177 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.178 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.178 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.178 DEBUG:boto:Params: {} 2023-12-15T23:31:24.178 DEBUG:boto:Token: None 2023-12-15T23:31:24.178 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33 2023-12-15T23:31:24.178 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ/zaeUkfjgD3b0tBYkI/AbrKMQ= 2023-12-15T23:31:24.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ/zaeUkfjgD3b0tBYkI/AbrKMQ=', 'Content-Length': '0'} 2023-12-15T23:31:24.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc41ce94d7bf687c-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.221 DEBUG:boto:path=/kskgfn-50/obj33 2023-12-15T23:31:24.222 DEBUG:boto:auth_path=/kskgfn-50/obj33 2023-12-15T23:31:24.222 DEBUG:boto:Method: GET 2023-12-15T23:31:24.222 DEBUG:boto:Path: /kskgfn-50/obj33 2023-12-15T23:31:24.222 DEBUG:boto:Data: 2023-12-15T23:31:24.222 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.222 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.222 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.222 DEBUG:boto:Params: {} 2023-12-15T23:31:24.222 DEBUG:boto:Token: None 2023-12-15T23:31:24.222 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj33 2023-12-15T23:31:24.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qJ/zaeUkfjgD3b0tBYkI/AbrKMQ= 2023-12-15T23:31:24.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qJ/zaeUkfjgD3b0tBYkI/AbrKMQ=', 'Content-Length': '0'} 2023-12-15T23:31:24.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044f7e2f9c8ce95f5-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.225 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.225 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.225 DEBUG:boto:path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.225 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.225 DEBUG:boto:Method: GET 2023-12-15T23:31:24.225 DEBUG:boto:Path: /kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.226 DEBUG:boto:Data: 2023-12-15T23:31:24.226 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.226 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.226 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.226 DEBUG:boto:Params: {} 2023-12-15T23:31:24.226 DEBUG:boto:Token: None 2023-12-15T23:31:24.226 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.229 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c72eb8067bb2310-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.269 DEBUG:boto:b'kskgfn-50obj331000falseobj332023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.270 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.270 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.270 DEBUG:boto:path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.271 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.271 DEBUG:boto:Method: GET 2023-12-15T23:31:24.271 DEBUG:boto:Path: /kskgfn-50/?prefix=obj33 2023-12-15T23:31:24.271 DEBUG:boto:Data: 2023-12-15T23:31:24.272 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.272 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.272 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.272 DEBUG:boto:Params: {} 2023-12-15T23:31:24.272 DEBUG:boto:Token: None 2023-12-15T23:31:24.273 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.273 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.276 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7a1d2e7a3b71cbc-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.276 DEBUG:boto:b'kskgfn-50obj331000falseobj332023-12-15T23:28:07.184Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.277 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:31:24.277 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.277 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.277 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.278 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.278 DEBUG:boto:Method: GET 2023-12-15T23:31:24.278 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.278 DEBUG:boto:Data: 2023-12-15T23:31:24.278 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.279 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.279 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.279 DEBUG:boto:Params: {} 2023-12-15T23:31:24.279 DEBUG:boto:Token: None 2023-12-15T23:31:24.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.280 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4= 2023-12-15T23:31:24.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4=', 'Content-Length': '0'} 2023-12-15T23:31:24.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aef1a8393af28c1c-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.283 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.283 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.283 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.283 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.284 DEBUG:boto:Method: GET 2023-12-15T23:31:24.284 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.284 DEBUG:boto:Data: 2023-12-15T23:31:24.284 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.284 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.285 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.285 DEBUG:boto:Params: {} 2023-12-15T23:31:24.285 DEBUG:boto:Token: None 2023-12-15T23:31:24.285 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.286 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4= 2023-12-15T23:31:24.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4=', 'Content-Length': '0'} 2023-12-15T23:31:24.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095a61ccf42c4e786-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.289 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.289 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.289 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.289 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.290 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.290 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.290 DEBUG:boto:Data: 2023-12-15T23:31:24.290 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.291 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.291 DEBUG:boto:Params: {} 2023-12-15T23:31:24.291 DEBUG:boto:Token: None 2023-12-15T23:31:24.291 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.292 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aUXCdgm2ZJtjOLeFy+lbaEoTn5I= 2023-12-15T23:31:24.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aUXCdgm2ZJtjOLeFy+lbaEoTn5I=', 'Content-Length': '0'} 2023-12-15T23:31:24.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092b3c82f676a8e40-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.295 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.295 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.295 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.295 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.295 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.296 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.296 DEBUG:boto:Data: 2023-12-15T23:31:24.296 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.296 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.296 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.297 DEBUG:boto:Params: {} 2023-12-15T23:31:24.297 DEBUG:boto:Token: None 2023-12-15T23:31:24.297 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.297 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:aUXCdgm2ZJtjOLeFy+lbaEoTn5I= 2023-12-15T23:31:24.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:aUXCdgm2ZJtjOLeFy+lbaEoTn5I=', 'Content-Length': '0'} 2023-12-15T23:31:24.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000e3306f03750fa5-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.300 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:31:24.301 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.301 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.301 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.301 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.301 DEBUG:boto:Method: GET 2023-12-15T23:31:24.302 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.302 DEBUG:boto:Data: 2023-12-15T23:31:24.302 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.302 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.302 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.303 DEBUG:boto:Params: {} 2023-12-15T23:31:24.303 DEBUG:boto:Token: None 2023-12-15T23:31:24.303 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4= 2023-12-15T23:31:24.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4=', 'Content-Length': '0'} 2023-12-15T23:31:24.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eab523dc89b9f61f-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.349 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.350 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.350 DEBUG:boto:path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.350 DEBUG:boto:auth_path=/kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.350 DEBUG:boto:Method: GET 2023-12-15T23:31:24.350 DEBUG:boto:Path: /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.350 DEBUG:boto:Data: 2023-12-15T23:31:24.351 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.351 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.351 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.351 DEBUG:boto:Params: {} 2023-12-15T23:31:24.351 DEBUG:boto:Token: None 2023-12-15T23:31:24.351 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44?versionId=null 2023-12-15T23:31:24.351 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4= 2023-12-15T23:31:24.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:UwGQGfO16RuSoLqrkHpE5AAw+e4=', 'Content-Length': '0'} 2023-12-15T23:31:24.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086f6ee335f4749b8-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.354 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.355 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.355 DEBUG:boto:path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.355 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.355 DEBUG:boto:Method: GET 2023-12-15T23:31:24.355 DEBUG:boto:Path: /kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.355 DEBUG:boto:Data: 2023-12-15T23:31:24.355 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.355 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.355 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.355 DEBUG:boto:Params: {} 2023-12-15T23:31:24.355 DEBUG:boto:Token: None 2023-12-15T23:31:24.356 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.358 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068c77f0adfaf0de6-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.358 DEBUG:boto:b'kskgfn-50obj441000falseobj442023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.359 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.359 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.359 DEBUG:boto:path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.359 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.359 DEBUG:boto:Method: GET 2023-12-15T23:31:24.359 DEBUG:boto:Path: /kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.359 DEBUG:boto:Data: 2023-12-15T23:31:24.359 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.359 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.359 DEBUG:boto:Params: {} 2023-12-15T23:31:24.360 DEBUG:boto:Token: None 2023-12-15T23:31:24.360 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eef301f56c42f8b3-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.405 DEBUG:boto:b'kskgfn-50obj441000falseobj442023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.406 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.406 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.406 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.406 DEBUG:boto:Path: /kskgfn-50/obj44 2023-12-15T23:31:24.406 DEBUG:boto:Data: 2023-12-15T23:31:24.406 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.406 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.406 DEBUG:boto:Params: {} 2023-12-15T23:31:24.407 DEBUG:boto:Token: None 2023-12-15T23:31:24.407 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44 2023-12-15T23:31:24.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nvlH7a0ho5LlS5YQ1/EdMMWb18Q= 2023-12-15T23:31:24.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nvlH7a0ho5LlS5YQ1/EdMMWb18Q=', 'Content-Length': '0'} 2023-12-15T23:31:24.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000219a8397c801360e-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.409 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.409 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.409 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.410 DEBUG:boto:Path: /kskgfn-50/obj44 2023-12-15T23:31:24.410 DEBUG:boto:Data: 2023-12-15T23:31:24.410 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.410 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.410 DEBUG:boto:Params: {} 2023-12-15T23:31:24.410 DEBUG:boto:Token: None 2023-12-15T23:31:24.410 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44 2023-12-15T23:31:24.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:nvlH7a0ho5LlS5YQ1/EdMMWb18Q= 2023-12-15T23:31:24.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:nvlH7a0ho5LlS5YQ1/EdMMWb18Q=', 'Content-Length': '0'} 2023-12-15T23:31:24.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093019ed9d2c3db59-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:31:24.413 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.413 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.413 DEBUG:boto:Method: GET 2023-12-15T23:31:24.413 DEBUG:boto:Path: /kskgfn-50/obj44 2023-12-15T23:31:24.413 DEBUG:boto:Data: 2023-12-15T23:31:24.413 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.414 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.414 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.414 DEBUG:boto:Params: {} 2023-12-15T23:31:24.414 DEBUG:boto:Token: None 2023-12-15T23:31:24.414 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44 2023-12-15T23:31:24.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eGPMtuzkpUkeUhpe7rMtFs2LnCc= 2023-12-15T23:31:24.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eGPMtuzkpUkeUhpe7rMtFs2LnCc=', 'Content-Length': '0'} 2023-12-15T23:31:24.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7b57686d61ed62f-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.457 DEBUG:boto:path=/kskgfn-50/obj44 2023-12-15T23:31:24.458 DEBUG:boto:auth_path=/kskgfn-50/obj44 2023-12-15T23:31:24.458 DEBUG:boto:Method: GET 2023-12-15T23:31:24.458 DEBUG:boto:Path: /kskgfn-50/obj44 2023-12-15T23:31:24.458 DEBUG:boto:Data: 2023-12-15T23:31:24.458 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.458 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.458 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.458 DEBUG:boto:Params: {} 2023-12-15T23:31:24.458 DEBUG:boto:Token: None 2023-12-15T23:31:24.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj44 2023-12-15T23:31:24.459 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eGPMtuzkpUkeUhpe7rMtFs2LnCc= 2023-12-15T23:31:24.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eGPMtuzkpUkeUhpe7rMtFs2LnCc=', 'Content-Length': '0'} 2023-12-15T23:31:24.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000713631ef753ccde-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.461 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.462 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.462 DEBUG:boto:path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.462 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.462 DEBUG:boto:Method: GET 2023-12-15T23:31:24.462 DEBUG:boto:Path: /kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.462 DEBUG:boto:Data: 2023-12-15T23:31:24.462 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.462 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.462 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.462 DEBUG:boto:Params: {} 2023-12-15T23:31:24.462 DEBUG:boto:Token: None 2023-12-15T23:31:24.463 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.463 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033c1b71696b02863-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.509 DEBUG:boto:b'kskgfn-50obj441000falseobj442023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.510 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.510 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.510 DEBUG:boto:path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.510 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.510 DEBUG:boto:Method: GET 2023-12-15T23:31:24.510 DEBUG:boto:Path: /kskgfn-50/?prefix=obj44 2023-12-15T23:31:24.510 DEBUG:boto:Data: 2023-12-15T23:31:24.511 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.511 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.511 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.511 DEBUG:boto:Params: {} 2023-12-15T23:31:24.511 DEBUG:boto:Token: None 2023-12-15T23:31:24.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.514 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005413c681ec4d446a-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.514 DEBUG:boto:b'kskgfn-50obj441000falseobj442023-12-15T23:28:07.231Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:31:24.514 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.514 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.515 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.515 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.515 DEBUG:boto:Method: GET 2023-12-15T23:31:24.515 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.515 DEBUG:boto:Data: 2023-12-15T23:31:24.515 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.515 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.515 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.515 DEBUG:boto:Params: {} 2023-12-15T23:31:24.515 DEBUG:boto:Token: None 2023-12-15T23:31:24.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.516 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314= 2023-12-15T23:31:24.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314=', 'Content-Length': '0'} 2023-12-15T23:31:24.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c817687bd13ec3ed-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.518 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.518 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.518 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.518 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.518 DEBUG:boto:Method: GET 2023-12-15T23:31:24.519 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.519 DEBUG:boto:Data: 2023-12-15T23:31:24.519 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.519 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.519 DEBUG:boto:Params: {} 2023-12-15T23:31:24.519 DEBUG:boto:Token: None 2023-12-15T23:31:24.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314= 2023-12-15T23:31:24.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314=', 'Content-Length': '0'} 2023-12-15T23:31:24.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012e8fd91b11b159a-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.522 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.522 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.522 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.522 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.522 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.522 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.522 DEBUG:boto:Data: 2023-12-15T23:31:24.523 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.523 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.523 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.523 DEBUG:boto:Params: {} 2023-12-15T23:31:24.523 DEBUG:boto:Token: None 2023-12-15T23:31:24.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLB68580mRAEciv+TKXAmgfdO/s= 2023-12-15T23:31:24.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLB68580mRAEciv+TKXAmgfdO/s=', 'Content-Length': '0'} 2023-12-15T23:31:24.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cc9a105dfb0f9b0-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.526 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.526 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.526 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.526 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.526 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.526 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.526 DEBUG:boto:Data: 2023-12-15T23:31:24.526 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.526 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.526 DEBUG:boto:Params: {} 2023-12-15T23:31:24.527 DEBUG:boto:Token: None 2023-12-15T23:31:24.527 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:uLB68580mRAEciv+TKXAmgfdO/s= 2023-12-15T23:31:24.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:uLB68580mRAEciv+TKXAmgfdO/s=', 'Content-Length': '0'} 2023-12-15T23:31:24.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d919d58cf9c250ef-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:31:24.530 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.530 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.530 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.530 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.530 DEBUG:boto:Method: GET 2023-12-15T23:31:24.530 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.530 DEBUG:boto:Data: 2023-12-15T23:31:24.530 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.530 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.530 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.530 DEBUG:boto:Params: {} 2023-12-15T23:31:24.531 DEBUG:boto:Token: None 2023-12-15T23:31:24.531 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.531 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314= 2023-12-15T23:31:24.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314=', 'Content-Length': '0'} 2023-12-15T23:31:24.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008714747d83883ae0-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.573 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.574 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.574 DEBUG:boto:path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.574 DEBUG:boto:auth_path=/kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.574 DEBUG:boto:Method: GET 2023-12-15T23:31:24.574 DEBUG:boto:Path: /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.574 DEBUG:boto:Data: 2023-12-15T23:31:24.574 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.574 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.574 DEBUG:boto:Params: {} 2023-12-15T23:31:24.575 DEBUG:boto:Token: None 2023-12-15T23:31:24.575 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55?versionId=null 2023-12-15T23:31:24.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314= 2023-12-15T23:31:24.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rnEbjS+vVcJLPigokZYVL+M4314=', 'Content-Length': '0'} 2023-12-15T23:31:24.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f414c98d312c086-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.578 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.578 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.578 DEBUG:boto:path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.578 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.578 DEBUG:boto:Method: GET 2023-12-15T23:31:24.578 DEBUG:boto:Path: /kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.578 DEBUG:boto:Data: 2023-12-15T23:31:24.578 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.579 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.579 DEBUG:boto:Params: {} 2023-12-15T23:31:24.579 DEBUG:boto:Token: None 2023-12-15T23:31:24.579 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c67dfdcbd95e034-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.625 DEBUG:boto:b'kskgfn-50obj551000falseobj552023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.626 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.626 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.626 DEBUG:boto:path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.626 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.626 DEBUG:boto:Method: GET 2023-12-15T23:31:24.626 DEBUG:boto:Path: /kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.626 DEBUG:boto:Data: 2023-12-15T23:31:24.626 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.627 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.627 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.627 DEBUG:boto:Params: {} 2023-12-15T23:31:24.627 DEBUG:boto:Token: None 2023-12-15T23:31:24.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.630 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c12a39e171d634a9-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.630 DEBUG:boto:b'kskgfn-50obj551000falseobj552023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.630 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.630 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.631 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.631 DEBUG:boto:Path: /kskgfn-50/obj55 2023-12-15T23:31:24.631 DEBUG:boto:Data: 2023-12-15T23:31:24.631 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.631 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.631 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.631 DEBUG:boto:Params: {} 2023-12-15T23:31:24.631 DEBUG:boto:Token: None 2023-12-15T23:31:24.631 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55 2023-12-15T23:31:24.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:exWDMyM06P3YdMMVkKgQmBvH/Lg= 2023-12-15T23:31:24.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:exWDMyM06P3YdMMVkKgQmBvH/Lg=', 'Content-Length': '0'} 2023-12-15T23:31:24.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceccb87c09982c74-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.634 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.634 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.634 DEBUG:boto:Method: HEAD 2023-12-15T23:31:24.634 DEBUG:boto:Path: /kskgfn-50/obj55 2023-12-15T23:31:24.634 DEBUG:boto:Data: 2023-12-15T23:31:24.634 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.634 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.635 DEBUG:boto:Params: {} 2023-12-15T23:31:24.635 DEBUG:boto:Token: None 2023-12-15T23:31:24.635 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55 2023-12-15T23:31:24.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:exWDMyM06P3YdMMVkKgQmBvH/Lg= 2023-12-15T23:31:24.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:exWDMyM06P3YdMMVkKgQmBvH/Lg=', 'Content-Length': '0'} 2023-12-15T23:31:24.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fe0a8c62d4fc5d2-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:31:24.637 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.638 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.638 DEBUG:boto:Method: GET 2023-12-15T23:31:24.638 DEBUG:boto:Path: /kskgfn-50/obj55 2023-12-15T23:31:24.638 DEBUG:boto:Data: 2023-12-15T23:31:24.638 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.638 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.638 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.638 DEBUG:boto:Params: {} 2023-12-15T23:31:24.638 DEBUG:boto:Token: None 2023-12-15T23:31:24.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55 2023-12-15T23:31:24.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ms8r2nM/vCMUpIIWQBE8/qLZfo8= 2023-12-15T23:31:24.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ms8r2nM/vCMUpIIWQBE8/qLZfo8=', 'Content-Length': '0'} 2023-12-15T23:31:24.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-50:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.21'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c46887694385394d-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.681 DEBUG:boto:path=/kskgfn-50/obj55 2023-12-15T23:31:24.682 DEBUG:boto:auth_path=/kskgfn-50/obj55 2023-12-15T23:31:24.682 DEBUG:boto:Method: GET 2023-12-15T23:31:24.682 DEBUG:boto:Path: /kskgfn-50/obj55 2023-12-15T23:31:24.682 DEBUG:boto:Data: 2023-12-15T23:31:24.682 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.682 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.682 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.682 DEBUG:boto:Params: {} 2023-12-15T23:31:24.682 DEBUG:boto:Token: None 2023-12-15T23:31:24.682 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/obj55 2023-12-15T23:31:24.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ms8r2nM/vCMUpIIWQBE8/qLZfo8= 2023-12-15T23:31:24.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ms8r2nM/vCMUpIIWQBE8/qLZfo8=', 'Content-Length': '0'} 2023-12-15T23:31:24.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:28:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006477612421392fb3-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.685 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.685 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.685 DEBUG:boto:path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.685 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.686 DEBUG:boto:Method: GET 2023-12-15T23:31:24.686 DEBUG:boto:Path: /kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.686 DEBUG:boto:Data: 2023-12-15T23:31:24.686 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.686 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:24.686 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.686 DEBUG:boto:Params: {} 2023-12-15T23:31:24.686 DEBUG:boto:Token: None 2023-12-15T23:31:24.686 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.686 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068ec082d9c6b5984-00657ce1cc-5788-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.729 DEBUG:boto:b'kskgfn-50obj551000falseobj552023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.730 DEBUG:boto:path=/kskgfn-50/ 2023-12-15T23:31:24.730 DEBUG:boto:auth_path=/kskgfn-50/ 2023-12-15T23:31:24.730 DEBUG:boto:path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.730 DEBUG:boto:auth_path=/kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.730 DEBUG:boto:Method: GET 2023-12-15T23:31:24.730 DEBUG:boto:Path: /kskgfn-50/?prefix=obj55 2023-12-15T23:31:24.730 DEBUG:boto:Data: 2023-12-15T23:31:24.730 DEBUG:boto:Headers: {} 2023-12-15T23:31:24.730 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:24.731 DEBUG:boto:Port: 8000 2023-12-15T23:31:24.731 DEBUG:boto:Params: {} 2023-12-15T23:31:24.731 DEBUG:boto:Token: None 2023-12-15T23:31:24.731 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:31:24 GMT /kskgfn-50/ 2023-12-15T23:31:24.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk= 2023-12-15T23:31:24.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:24 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:JSYUYfgk7yla0FkFfnRucKSiKhk=', 'Content-Length': '0'} 2023-12-15T23:31:24.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be656a546ebcca69-00657ce1cc-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:24 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:24.734 DEBUG:boto:b'kskgfn-50obj551000falseobj552023-12-15T23:28:07.243Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:31:24.734 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-50 zones={test-zone2, test-zone1} 2023-12-15T23:31:24.734 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T23:31:24.734 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.735 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:24.787 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:24.848 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000026763","last_update":"2023-12-15T23:28:13.413753Z"},{"marker":"00000000000000000000:00000000000000026236","last_update":"2023-12-15T23:28:13.415624Z"},{"marker":"00000000000000000000:00000000000000019438","last_update":"2023-12-15T23:24:39.946085Z"},{"marker":"00000000000000000000:00000000000000030144","last_update":"2023-12-15T23:28:07.236040Z"}] 2023-12-15T23:31:24.848 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000026763', 1: '00000000000000000000:00000000000000026236', 2: '00000000000000000000:00000000000000019438', 3: '00000000000000000000:00000000000000030144'} 2023-12-15T23:31:24.848 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:31:24.848 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.849 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:24.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:24.905 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:24.958 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1238840998950607430},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000026763","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:13.413753Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000026236","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:13.415624Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000019438","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2023-12-15T23:24:39.946085Z"}},{"key":3,"val":{"status":"full-sync","marker":"kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0","next_step_marker":"00000000000000000000:00000000000000030144","total_entries":41,"pos":24,"timestamp":"2023-12-15T23:28:07.236040Z"}}]},"full_sync":{"total":50,"complete":33},"current_time":"2023-12-15T23:31:24Z"} 2023-12-15T23:31:24.959 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":1238840998950607430},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000026763","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:13.413753Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000026236","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:13.415624Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000019438","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2023-12-15T23:24:39.946085Z"}},{"key":3,"val":{"status":"full-sync","marker":"kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0","next_step_marker":"00000000000000000000:00000000000000030144","total_entries":41,"pos":24,"timestamp":"2023-12-15T23:28:07.236040Z"}}]},"full_sync":{"total":50,"complete":33},"current_time":"2023-12-15T23:31:24Z"} 2023-12-15T23:31:24.959 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000026763', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:28:13.413753Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000026236', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:28:13.415624Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000019438', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2023-12-15T23:24:39.946085Z'}}, {'key': 3, 'val': {'status': 'full-sync', 'marker': 'kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0', 'next_step_marker': '00000000000000000000:00000000000000030144', 'total_entries': 41, 'pos': 24, 'timestamp': '2023-12-15T23:28:07.236040Z'}}] 2023-12-15T23:31:24.959 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000026763', 1: '00000000000000000000:00000000000000026236', 2: '00000000000000000000:00000000000000019438', 3: '00000000000000000000:00000000000000030144'} 2023-12-15T23:31:24.959 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000026763', 1: '00000000000000000000:00000000000000026236', 2: '00000000000000000000:00000000000000019438', 3: 'kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0'} 2023-12-15T23:31:24.959 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:31:24.959 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T23:31:24.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:24.960 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:25.006 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:25.006 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:25.058 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000014029","last_update":"2023-12-15T23:28:29.480999Z"},{"marker":"00000000000000000000:00000000000000011661","last_update":"2023-12-15T23:29:14.763240Z"},{"marker":"00000000000000000000:00000000000000006699","last_update":"2023-12-15T23:26:11.650215Z"},{"marker":"00000000000000000000:00000000000000014161","last_update":"2023-12-15T23:28:14.776333Z"}] 2023-12-15T23:31:25.058 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000014029', 1: '00000000000000000000:00000000000000011661', 2: '00000000000000000000:00000000000000006699', 3: '00000000000000000000:00000000000000014161'} 2023-12-15T23:31:25.058 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:31:25.058 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.058 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:25.170 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014029","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:29.480999Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000011661","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:29:14.763240Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006699","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:26:11.650215Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014161","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:14.776333Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:31:25Z"} 2023-12-15T23:31:25.170 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014029","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:29.480999Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000011661","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:29:14.763240Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006699","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:26:11.650215Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014161","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:28:14.776333Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:31:25Z"} 2023-12-15T23:31:25.170 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014029', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:28:29.480999Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000011661', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:29:14.763240Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006699', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T23:26:11.650215Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014161', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:28:14.776333Z'}}] 2023-12-15T23:31:25.170 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000014029', 1: '00000000000000000000:00000000000000011661', 2: '00000000000000000000:00000000000000006699', 3: '00000000000000000000:00000000000000014161'} 2023-12-15T23:31:25.171 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000014029', 1: '00000000000000000000:00000000000000011661', 2: '00000000000000000000:00000000000000006699', 3: '00000000000000000000:00000000000000014161'} 2023-12-15T23:31:25.171 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:31:25.171 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_full_sync_after_data_sync_init ... ok 2023-12-15T23:31:25.173 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:25.173 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:25.173 DEBUG:boto:Method: PUT 2023-12-15T23:31:25.173 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:25.173 DEBUG:boto:Data: 2023-12-15T23:31:25.173 DEBUG:boto:Headers: {} 2023-12-15T23:31:25.173 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:25.173 DEBUG:boto:Port: 8000 2023-12-15T23:31:25.174 DEBUG:boto:Params: {} 2023-12-15T23:31:25.174 DEBUG:boto:Token: None 2023-12-15T23:31:25.174 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:31:25 GMT /kskgfn-51/ 2023-12-15T23:31:25.174 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tWzX9Dr88/cUDHZGcnZ/zvGnMLQ= 2023-12-15T23:31:25.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:25 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tWzX9Dr88/cUDHZGcnZ/zvGnMLQ=', 'Content-Length': '0'} 2023-12-15T23:31:25.194 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c7d3ea9cb4534432-00657ce1cd-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:25 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:25.194 DEBUG:rgw_multi.tests:created bucket=kskgfn-51 2023-12-15T23:31:25.195 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.195 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:25.243 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:25.243 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:31:25.293 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702683085.191329_457.1","last_update":"2023-12-15T23:31:25.191329Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:31:25.293 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702683085.191329_457.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:31:25.293 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:31:25.293 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:31:25.294 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:31:25.340 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:25.340 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:25.370 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:25.368+0000 7fa0252c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:31:25.371 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:25.369+0000 7fa0252c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:31:25.387 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683085.191329_457.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:31:25.191329Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:31:25Z"} 2023-12-15T23:31:25.387 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683085.191329_457.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:31:25.191329Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:31:25Z"} 2023-12-15T23:31:25.387 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683085.191329_457.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:31:25.191329Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:31:25.388 DEBUG:rgw_multi.tests:log_status={0: '1_1702683085.191329_457.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:31:25.388 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683085.191329_457.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:31:25.388 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:31:25.388 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:31:25.388 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:31:25.389 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:31:25.387+0000 7f72229b9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 114472) UID: 0 2023-12-15T23:31:25.389 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:31:25.387+0000 7f7228613880 -1 shutting down 2023-12-15T23:31:30.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:31:31.490 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:31:31.490 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.490 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.490 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.490 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.491 DEBUG:boto:Data: 2023-12-15T23:31:31.491 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.491 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.491 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.491 DEBUG:boto:Params: {} 2023-12-15T23:31:31.491 DEBUG:boto:Token: None 2023-12-15T23:31:31.491 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.492 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.494 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d073e1658dd97e25-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.495 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:31:31.495 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:31:31.495 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.495 DEBUG:boto:Path: /kskgfn-51/obj11 2023-12-15T23:31:31.495 DEBUG:boto:Data: 2023-12-15T23:31:31.495 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.495 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.495 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.495 DEBUG:boto:Params: {} 2023-12-15T23:31:31.495 DEBUG:boto:Token: None 2023-12-15T23:31:31.496 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj11 2023-12-15T23:31:31.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dpkuJBo6PNFumwa+C/cOZIzEw2I= 2023-12-15T23:31:31.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dpkuJBo6PNFumwa+C/cOZIzEw2I='} 2023-12-15T23:31:31.504 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004e10803902639225-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.504 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.504 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.504 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.504 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.504 DEBUG:boto:Data: 2023-12-15T23:31:31.505 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.505 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.505 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.505 DEBUG:boto:Params: {} 2023-12-15T23:31:31.505 DEBUG:boto:Token: None 2023-12-15T23:31:31.505 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.505 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.507 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005e2caae5945e7fae-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.508 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:31:31.508 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:31:31.508 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.508 DEBUG:boto:Path: /kskgfn-51/obj22 2023-12-15T23:31:31.508 DEBUG:boto:Data: 2023-12-15T23:31:31.508 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.508 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.508 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.508 DEBUG:boto:Params: {} 2023-12-15T23:31:31.509 DEBUG:boto:Token: None 2023-12-15T23:31:31.509 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj22 2023-12-15T23:31:31.509 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:St46B+uG4m+f7cX6RrUdeNNGuhU= 2023-12-15T23:31:31.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:St46B+uG4m+f7cX6RrUdeNNGuhU='} 2023-12-15T23:31:31.554 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a91e3ab2dac909c1-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.554 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.554 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.554 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.554 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.554 DEBUG:boto:Data: 2023-12-15T23:31:31.554 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.554 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.554 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.554 DEBUG:boto:Params: {} 2023-12-15T23:31:31.555 DEBUG:boto:Token: None 2023-12-15T23:31:31.555 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.555 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.557 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000059c405b441966659-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.557 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:31:31.558 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:31:31.558 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.558 DEBUG:boto:Path: /kskgfn-51/obj33 2023-12-15T23:31:31.558 DEBUG:boto:Data: 2023-12-15T23:31:31.558 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.558 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.558 DEBUG:boto:Params: {} 2023-12-15T23:31:31.558 DEBUG:boto:Token: None 2023-12-15T23:31:31.559 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj33 2023-12-15T23:31:31.559 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:yeBYOo7PqgcJw919khI4KlKx6KU= 2023-12-15T23:31:31.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:yeBYOo7PqgcJw919khI4KlKx6KU='} 2023-12-15T23:31:31.565 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000062e93a8bf061fc85-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.566 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.566 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.566 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.566 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.566 DEBUG:boto:Data: 2023-12-15T23:31:31.566 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.566 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.566 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.566 DEBUG:boto:Params: {} 2023-12-15T23:31:31.566 DEBUG:boto:Token: None 2023-12-15T23:31:31.567 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.567 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.569 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000baa60848ea3e8cbe-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.569 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:31:31.570 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:31:31.570 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.570 DEBUG:boto:Path: /kskgfn-51/obj44 2023-12-15T23:31:31.570 DEBUG:boto:Data: 2023-12-15T23:31:31.570 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.570 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.570 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.570 DEBUG:boto:Params: {} 2023-12-15T23:31:31.570 DEBUG:boto:Token: None 2023-12-15T23:31:31.571 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj44 2023-12-15T23:31:31.571 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SEmJ6bkldrHG67McnOI83wlbOIY= 2023-12-15T23:31:31.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SEmJ6bkldrHG67McnOI83wlbOIY='} 2023-12-15T23:31:31.578 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000061f3c8e190452266-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.578 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.578 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.579 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.579 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.579 DEBUG:boto:Data: 2023-12-15T23:31:31.579 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.579 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.579 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.579 DEBUG:boto:Params: {} 2023-12-15T23:31:31.579 DEBUG:boto:Token: None 2023-12-15T23:31:31.579 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.581 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2a0db5652bf1cdc-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.582 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:31:31.582 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:31:31.582 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.582 DEBUG:boto:Path: /kskgfn-51/obj55 2023-12-15T23:31:31.582 DEBUG:boto:Data: 2023-12-15T23:31:31.582 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.582 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.582 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.583 DEBUG:boto:Params: {} 2023-12-15T23:31:31.583 DEBUG:boto:Token: None 2023-12-15T23:31:31.583 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj55 2023-12-15T23:31:31.583 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Clamc08a4w4rW2d07SmqsZHfcYo= 2023-12-15T23:31:31.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Clamc08a4w4rW2d07SmqsZHfcYo='} 2023-12-15T23:31:31.625 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ef7f609c6945ca89-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.626 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:31.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:31.626 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:31.681 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:31.682 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:31.726 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:31.727 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:31.732 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 5 2023-12-15T23:31:31.776 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.776 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.776 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.776 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.776 DEBUG:boto:Data: 2023-12-15T23:31:31.776 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.776 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.776 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.777 DEBUG:boto:Params: {} 2023-12-15T23:31:31.777 DEBUG:boto:Token: None 2023-12-15T23:31:31.777 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.777 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.780 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b650a671f87f3b26-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.780 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:31:31.780 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:31:31.780 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.780 DEBUG:boto:Path: /kskgfn-51/obj17 2023-12-15T23:31:31.780 DEBUG:boto:Data: 2023-12-15T23:31:31.780 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.781 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.781 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.781 DEBUG:boto:Params: {} 2023-12-15T23:31:31.781 DEBUG:boto:Token: None 2023-12-15T23:31:31.781 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj17 2023-12-15T23:31:31.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S/XyL66ONM4cOmjdfjQodMy9k4k= 2023-12-15T23:31:31.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S/XyL66ONM4cOmjdfjQodMy9k4k='} 2023-12-15T23:31:31.786 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005cefa76bfff40f24-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.787 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.787 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.787 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.787 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.787 DEBUG:boto:Data: 2023-12-15T23:31:31.787 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.787 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.787 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.787 DEBUG:boto:Params: {} 2023-12-15T23:31:31.787 DEBUG:boto:Token: None 2023-12-15T23:31:31.788 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.788 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.790 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038da30d3960f153f-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.790 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:31:31.790 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:31:31.790 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.791 DEBUG:boto:Path: /kskgfn-51/obj34 2023-12-15T23:31:31.791 DEBUG:boto:Data: 2023-12-15T23:31:31.791 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.791 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.791 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.791 DEBUG:boto:Params: {} 2023-12-15T23:31:31.791 DEBUG:boto:Token: None 2023-12-15T23:31:31.791 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj34 2023-12-15T23:31:31.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2zEYTLrRgmDp/Tb8ad5IjWHphJc= 2023-12-15T23:31:31.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2zEYTLrRgmDp/Tb8ad5IjWHphJc='} 2023-12-15T23:31:31.797 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000615a5382dcd99752-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.797 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.797 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.797 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.797 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.797 DEBUG:boto:Data: 2023-12-15T23:31:31.798 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.798 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.798 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.798 DEBUG:boto:Params: {} 2023-12-15T23:31:31.798 DEBUG:boto:Token: None 2023-12-15T23:31:31.798 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.798 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.800 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5b3076f0291b0d5-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.801 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:31:31.801 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:31:31.801 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.801 DEBUG:boto:Path: /kskgfn-51/obj51 2023-12-15T23:31:31.801 DEBUG:boto:Data: 2023-12-15T23:31:31.801 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.801 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.801 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.801 DEBUG:boto:Params: {} 2023-12-15T23:31:31.802 DEBUG:boto:Token: None 2023-12-15T23:31:31.802 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj51 2023-12-15T23:31:31.802 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CgCA3PI+dWebuI4ry3gH4q9Lkc4= 2023-12-15T23:31:31.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CgCA3PI+dWebuI4ry3gH4q9Lkc4='} 2023-12-15T23:31:31.845 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009b551b31f386dd53-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.846 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.846 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.846 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.846 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.846 DEBUG:boto:Data: 2023-12-15T23:31:31.846 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.846 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.846 DEBUG:boto:Params: {} 2023-12-15T23:31:31.846 DEBUG:boto:Token: None 2023-12-15T23:31:31.847 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.849 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc3cd19c28dacd13-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.849 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:31:31.849 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:31:31.849 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.850 DEBUG:boto:Path: /kskgfn-51/obj68 2023-12-15T23:31:31.850 DEBUG:boto:Data: 2023-12-15T23:31:31.850 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.850 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.853 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.853 DEBUG:boto:Params: {} 2023-12-15T23:31:31.854 DEBUG:boto:Token: None 2023-12-15T23:31:31.854 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj68 2023-12-15T23:31:31.854 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1LXDGoHXGn9cSRGfeXh0mqPHTkw= 2023-12-15T23:31:31.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1LXDGoHXGn9cSRGfeXh0mqPHTkw='} 2023-12-15T23:31:31.859 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000afa8945b0aa834ac-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.860 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:31.860 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:31.860 DEBUG:boto:Method: HEAD 2023-12-15T23:31:31.860 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:31.860 DEBUG:boto:Data: 2023-12-15T23:31:31.860 DEBUG:boto:Headers: {} 2023-12-15T23:31:31.860 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.860 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.860 DEBUG:boto:Params: {} 2023-12-15T23:31:31.861 DEBUG:boto:Token: None 2023-12-15T23:31:31.861 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/ 2023-12-15T23:31:31.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI= 2023-12-15T23:31:31.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7eCo/UwHw4qcOhhpjZr3zIUgUSI=', 'Content-Length': '0'} 2023-12-15T23:31:31.863 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000081751a7ad868a73d-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.864 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:31:31.864 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:31:31.864 DEBUG:boto:Method: PUT 2023-12-15T23:31:31.864 DEBUG:boto:Path: /kskgfn-51/obj85 2023-12-15T23:31:31.864 DEBUG:boto:Data: 2023-12-15T23:31:31.864 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:31.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:31.864 DEBUG:boto:Port: 8000 2023-12-15T23:31:31.864 DEBUG:boto:Params: {} 2023-12-15T23:31:31.865 DEBUG:boto:Token: None 2023-12-15T23:31:31.865 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:31 GMT /kskgfn-51/obj85 2023-12-15T23:31:31.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V7BrJM3r3qx/RwdfYFyWQzu8aDs= 2023-12-15T23:31:31.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:31 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V7BrJM3r3qx/RwdfYFyWQzu8aDs='} 2023-12-15T23:31:31.870 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008ba146dbe3e36a5c-00657ce1d3-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:31.870 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:31.870 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:31.871 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:31.920 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:31.920 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:31.970 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:31.970 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:31.977 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 10 2023-12-15T23:31:32.035 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.035 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.035 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.035 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.035 DEBUG:boto:Data: 2023-12-15T23:31:32.035 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.035 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.035 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.035 DEBUG:boto:Params: {} 2023-12-15T23:31:32.035 DEBUG:boto:Token: None 2023-12-15T23:31:32.036 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.036 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.038 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001e75965cf9ef6ec6-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.038 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:31:32.039 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:31:32.039 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.039 DEBUG:boto:Path: /kskgfn-51/obj19 2023-12-15T23:31:32.039 DEBUG:boto:Data: 2023-12-15T23:31:32.039 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.039 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.039 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.039 DEBUG:boto:Params: {} 2023-12-15T23:31:32.039 DEBUG:boto:Token: None 2023-12-15T23:31:32.040 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj19 2023-12-15T23:31:32.040 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WBotYxGGl8yiVOaHnNrVtNbXUv8= 2023-12-15T23:31:32.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WBotYxGGl8yiVOaHnNrVtNbXUv8='} 2023-12-15T23:31:32.081 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d9bc87d9ea0742d8-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.082 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.082 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.082 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.082 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.082 DEBUG:boto:Data: 2023-12-15T23:31:32.082 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.082 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.082 DEBUG:boto:Params: {} 2023-12-15T23:31:32.083 DEBUG:boto:Token: None 2023-12-15T23:31:32.083 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.083 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.085 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000546d55b4da77c284-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.085 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:31:32.085 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:31:32.085 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.086 DEBUG:boto:Path: /kskgfn-51/obj38 2023-12-15T23:31:32.086 DEBUG:boto:Data: 2023-12-15T23:31:32.086 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.086 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.086 DEBUG:boto:Params: {} 2023-12-15T23:31:32.086 DEBUG:boto:Token: None 2023-12-15T23:31:32.086 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj38 2023-12-15T23:31:32.086 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LEWLJ08uifj3g7lB+l8uUAnSq2Y= 2023-12-15T23:31:32.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LEWLJ08uifj3g7lB+l8uUAnSq2Y='} 2023-12-15T23:31:32.090 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009a990b74011c15a6-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.090 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.090 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.090 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.090 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.090 DEBUG:boto:Data: 2023-12-15T23:31:32.091 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.091 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.091 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.091 DEBUG:boto:Params: {} 2023-12-15T23:31:32.091 DEBUG:boto:Token: None 2023-12-15T23:31:32.091 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.093 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e1b8f66be593f73d-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.094 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:31:32.094 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:31:32.094 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.094 DEBUG:boto:Path: /kskgfn-51/obj57 2023-12-15T23:31:32.094 DEBUG:boto:Data: 2023-12-15T23:31:32.094 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.094 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.094 DEBUG:boto:Params: {} 2023-12-15T23:31:32.095 DEBUG:boto:Token: None 2023-12-15T23:31:32.095 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj57 2023-12-15T23:31:32.095 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G9S4vMfBV8oNt9FNz8fWp29021s= 2023-12-15T23:31:32.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G9S4vMfBV8oNt9FNz8fWp29021s='} 2023-12-15T23:31:32.137 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000394835d5826c8e44-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.138 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.138 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.138 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.138 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.138 DEBUG:boto:Data: 2023-12-15T23:31:32.138 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.138 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.138 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.138 DEBUG:boto:Params: {} 2023-12-15T23:31:32.139 DEBUG:boto:Token: None 2023-12-15T23:31:32.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.141 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8d52a02e2216ed4-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.142 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:31:32.142 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:31:32.142 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.142 DEBUG:boto:Path: /kskgfn-51/obj76 2023-12-15T23:31:32.142 DEBUG:boto:Data: 2023-12-15T23:31:32.142 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.142 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.143 DEBUG:boto:Params: {} 2023-12-15T23:31:32.143 DEBUG:boto:Token: None 2023-12-15T23:31:32.143 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj76 2023-12-15T23:31:32.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fqHWZY/H64Cqn05pbiyISxqsLic= 2023-12-15T23:31:32.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fqHWZY/H64Cqn05pbiyISxqsLic='} 2023-12-15T23:31:32.148 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000abd44ce74ebdbdb-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.148 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.148 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.148 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.148 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.148 DEBUG:boto:Data: 2023-12-15T23:31:32.149 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.149 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.149 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.149 DEBUG:boto:Params: {} 2023-12-15T23:31:32.149 DEBUG:boto:Token: None 2023-12-15T23:31:32.149 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.149 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.152 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001af04cb5c0b7abe4-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.152 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:31:32.152 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:31:32.152 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.152 DEBUG:boto:Path: /kskgfn-51/obj95 2023-12-15T23:31:32.152 DEBUG:boto:Data: 2023-12-15T23:31:32.153 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.153 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.153 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.153 DEBUG:boto:Params: {} 2023-12-15T23:31:32.153 DEBUG:boto:Token: None 2023-12-15T23:31:32.153 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj95 2023-12-15T23:31:32.153 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LDv9pAQVw1H7QtsRcMesaWVGZk4= 2023-12-15T23:31:32.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LDv9pAQVw1H7QtsRcMesaWVGZk4='} 2023-12-15T23:31:32.197 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000909106e880775889-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.198 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.198 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:32.247 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:32.248 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:32.290 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:32.290 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:32.298 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 15 2023-12-15T23:31:32.354 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.354 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.354 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.354 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.354 DEBUG:boto:Data: 2023-12-15T23:31:32.354 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.354 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.354 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.354 DEBUG:boto:Params: {} 2023-12-15T23:31:32.355 DEBUG:boto:Token: None 2023-12-15T23:31:32.355 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.357 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005d8734fc3933ed05-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.358 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:31:32.358 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:31:32.358 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.358 DEBUG:boto:Path: /kskgfn-51/obj23 2023-12-15T23:31:32.358 DEBUG:boto:Data: 2023-12-15T23:31:32.358 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.358 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.358 DEBUG:boto:Params: {} 2023-12-15T23:31:32.359 DEBUG:boto:Token: None 2023-12-15T23:31:32.359 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj23 2023-12-15T23:31:32.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qL7xHgf+VYJNBvTiOVLglam0kBQ= 2023-12-15T23:31:32.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qL7xHgf+VYJNBvTiOVLglam0kBQ='} 2023-12-15T23:31:32.363 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad861e2cca387f30-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.364 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.364 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.364 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.364 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.364 DEBUG:boto:Data: 2023-12-15T23:31:32.364 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.364 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.364 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.364 DEBUG:boto:Params: {} 2023-12-15T23:31:32.364 DEBUG:boto:Token: None 2023-12-15T23:31:32.365 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.365 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.367 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ee0e03d8fc08ee0b-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.367 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:31:32.367 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:31:32.367 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.367 DEBUG:boto:Path: /kskgfn-51/obj46 2023-12-15T23:31:32.368 DEBUG:boto:Data: 2023-12-15T23:31:32.368 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.368 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.368 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.368 DEBUG:boto:Params: {} 2023-12-15T23:31:32.368 DEBUG:boto:Token: None 2023-12-15T23:31:32.368 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj46 2023-12-15T23:31:32.368 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MP96b6vXpES+bpTkq6htCUbWVeM= 2023-12-15T23:31:32.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MP96b6vXpES+bpTkq6htCUbWVeM='} 2023-12-15T23:31:32.409 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a6634bace8701ede-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.410 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.410 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.410 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.410 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.410 DEBUG:boto:Data: 2023-12-15T23:31:32.410 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.410 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.410 DEBUG:boto:Params: {} 2023-12-15T23:31:32.410 DEBUG:boto:Token: None 2023-12-15T23:31:32.411 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.413 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000050bec606767beacc-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.413 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:31:32.414 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:31:32.414 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.414 DEBUG:boto:Path: /kskgfn-51/obj69 2023-12-15T23:31:32.414 DEBUG:boto:Data: 2023-12-15T23:31:32.414 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.414 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.414 DEBUG:boto:Params: {} 2023-12-15T23:31:32.414 DEBUG:boto:Token: None 2023-12-15T23:31:32.414 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj69 2023-12-15T23:31:32.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ih8bcGS8C63mMfPTw/XBT8+RD+8= 2023-12-15T23:31:32.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ih8bcGS8C63mMfPTw/XBT8+RD+8='} 2023-12-15T23:31:32.419 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9fc306d2fb0820e-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.420 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.420 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.420 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.420 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.420 DEBUG:boto:Data: 2023-12-15T23:31:32.420 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.420 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.420 DEBUG:boto:Params: {} 2023-12-15T23:31:32.420 DEBUG:boto:Token: None 2023-12-15T23:31:32.421 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.421 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.423 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000070e598b69f85444c-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.423 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:31:32.423 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:31:32.424 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.424 DEBUG:boto:Path: /kskgfn-51/obj92 2023-12-15T23:31:32.424 DEBUG:boto:Data: 2023-12-15T23:31:32.424 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.424 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.424 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.424 DEBUG:boto:Params: {} 2023-12-15T23:31:32.424 DEBUG:boto:Token: None 2023-12-15T23:31:32.424 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj92 2023-12-15T23:31:32.424 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1wK+r/E5qxp6iHooz/8iqnRxOYI= 2023-12-15T23:31:32.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1wK+r/E5qxp6iHooz/8iqnRxOYI='} 2023-12-15T23:31:32.469 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009a06c9c77f39d3b3-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.470 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.470 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.470 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.470 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.470 DEBUG:boto:Data: 2023-12-15T23:31:32.470 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.470 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.470 DEBUG:boto:Params: {} 2023-12-15T23:31:32.471 DEBUG:boto:Token: None 2023-12-15T23:31:32.471 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.471 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.473 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b1b58f3946e590d-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.474 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:31:32.474 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:31:32.474 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.474 DEBUG:boto:Path: /kskgfn-51/obj115 2023-12-15T23:31:32.474 DEBUG:boto:Data: 2023-12-15T23:31:32.474 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.474 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.474 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.475 DEBUG:boto:Params: {} 2023-12-15T23:31:32.475 DEBUG:boto:Token: None 2023-12-15T23:31:32.475 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj115 2023-12-15T23:31:32.475 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AlslULuwHhGIC1XGwqFgciQV2Ds= 2023-12-15T23:31:32.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AlslULuwHhGIC1XGwqFgciQV2Ds='} 2023-12-15T23:31:32.481 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000096fb3f863627aa9-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.481 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.482 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:32.531 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:32.531 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:32.579 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:32.579 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:32.588 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 20 2023-12-15T23:31:32.645 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.645 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.645 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.645 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.645 DEBUG:boto:Data: 2023-12-15T23:31:32.645 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.646 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.646 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.646 DEBUG:boto:Params: {} 2023-12-15T23:31:32.646 DEBUG:boto:Token: None 2023-12-15T23:31:32.646 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.646 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.649 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f1a2097243b01c96-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.649 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:31:32.649 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:31:32.649 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.649 DEBUG:boto:Path: /kskgfn-51/obj29 2023-12-15T23:31:32.649 DEBUG:boto:Data: 2023-12-15T23:31:32.649 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.650 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.650 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.650 DEBUG:boto:Params: {} 2023-12-15T23:31:32.650 DEBUG:boto:Token: None 2023-12-15T23:31:32.650 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj29 2023-12-15T23:31:32.650 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mcXFPYcDM33FtOzezpdW5HMq7cw= 2023-12-15T23:31:32.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mcXFPYcDM33FtOzezpdW5HMq7cw='} 2023-12-15T23:31:32.655 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c6fa241784c9d1e1-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.655 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.656 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.656 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.656 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.656 DEBUG:boto:Data: 2023-12-15T23:31:32.656 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.656 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.656 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.656 DEBUG:boto:Params: {} 2023-12-15T23:31:32.656 DEBUG:boto:Token: None 2023-12-15T23:31:32.656 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.657 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.659 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9c38b39e2c84c36-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.659 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:31:32.659 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:31:32.659 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.659 DEBUG:boto:Path: /kskgfn-51/obj58 2023-12-15T23:31:32.660 DEBUG:boto:Data: 2023-12-15T23:31:32.660 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.660 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.660 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.660 DEBUG:boto:Params: {} 2023-12-15T23:31:32.660 DEBUG:boto:Token: None 2023-12-15T23:31:32.660 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj58 2023-12-15T23:31:32.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xYuyghDweydAA0Odl6mmVxEi1QI= 2023-12-15T23:31:32.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xYuyghDweydAA0Odl6mmVxEi1QI='} 2023-12-15T23:31:32.701 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000572b58a560e5b059-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.702 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.702 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.702 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.702 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.702 DEBUG:boto:Data: 2023-12-15T23:31:32.702 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.702 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.702 DEBUG:boto:Params: {} 2023-12-15T23:31:32.702 DEBUG:boto:Token: None 2023-12-15T23:31:32.703 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.705 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007255db8e7c2d2036-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.705 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:31:32.706 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:31:32.706 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.706 DEBUG:boto:Path: /kskgfn-51/obj87 2023-12-15T23:31:32.706 DEBUG:boto:Data: 2023-12-15T23:31:32.706 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.706 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.706 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.706 DEBUG:boto:Params: {} 2023-12-15T23:31:32.706 DEBUG:boto:Token: None 2023-12-15T23:31:32.706 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj87 2023-12-15T23:31:32.706 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Mh4Vl32qbeaWGw+uPYmabIiN+9I= 2023-12-15T23:31:32.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Mh4Vl32qbeaWGw+uPYmabIiN+9I='} 2023-12-15T23:31:32.712 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000662a91ea50fa9cad-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.712 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.712 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.712 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.712 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.713 DEBUG:boto:Data: 2023-12-15T23:31:32.713 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.713 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.713 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.713 DEBUG:boto:Params: {} 2023-12-15T23:31:32.713 DEBUG:boto:Token: None 2023-12-15T23:31:32.713 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000066e3ac88bf1b6abc-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.716 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:31:32.716 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:31:32.716 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.716 DEBUG:boto:Path: /kskgfn-51/obj116 2023-12-15T23:31:32.716 DEBUG:boto:Data: 2023-12-15T23:31:32.716 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.716 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.717 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.717 DEBUG:boto:Params: {} 2023-12-15T23:31:32.717 DEBUG:boto:Token: None 2023-12-15T23:31:32.717 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj116 2023-12-15T23:31:32.717 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pGaUCsccHnu6373b+TdTlnfZv3k= 2023-12-15T23:31:32.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pGaUCsccHnu6373b+TdTlnfZv3k='} 2023-12-15T23:31:32.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e3228321511785a7-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.723 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.723 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.723 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.723 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.723 DEBUG:boto:Data: 2023-12-15T23:31:32.723 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.723 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.723 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.723 DEBUG:boto:Params: {} 2023-12-15T23:31:32.723 DEBUG:boto:Token: None 2023-12-15T23:31:32.724 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.724 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.726 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014f85334a25c41d5-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.726 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:31:32.726 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:31:32.727 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.727 DEBUG:boto:Path: /kskgfn-51/obj145 2023-12-15T23:31:32.727 DEBUG:boto:Data: 2023-12-15T23:31:32.727 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.727 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.727 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.727 DEBUG:boto:Params: {} 2023-12-15T23:31:32.727 DEBUG:boto:Token: None 2023-12-15T23:31:32.727 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj145 2023-12-15T23:31:32.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VREwdtBJ/rfoJsjCNfWPDc5LIMI= 2023-12-15T23:31:32.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VREwdtBJ/rfoJsjCNfWPDc5LIMI='} 2023-12-15T23:31:32.769 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007453af60f2f1149a-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.770 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:32.770 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:32.819 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:32.819 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:32.870 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:32.870 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:32.883 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 25 2023-12-15T23:31:32.951 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.952 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.952 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.952 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.952 DEBUG:boto:Data: 2023-12-15T23:31:32.952 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.952 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.952 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.952 DEBUG:boto:Params: {} 2023-12-15T23:31:32.952 DEBUG:boto:Token: None 2023-12-15T23:31:32.953 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.955 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007302b64aa2128f3f-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.956 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:31:32.956 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:31:32.956 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.956 DEBUG:boto:Path: /kskgfn-51/obj31 2023-12-15T23:31:32.956 DEBUG:boto:Data: 2023-12-15T23:31:32.956 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.956 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.956 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.956 DEBUG:boto:Params: {} 2023-12-15T23:31:32.957 DEBUG:boto:Token: None 2023-12-15T23:31:32.957 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj31 2023-12-15T23:31:32.957 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:bU9TpClnjAebskC0K0vB5040040= 2023-12-15T23:31:32.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:bU9TpClnjAebskC0K0vB5040040='} 2023-12-15T23:31:32.963 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068ebea840d350a05-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.963 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:32.963 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:32.963 DEBUG:boto:Method: HEAD 2023-12-15T23:31:32.963 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:32.963 DEBUG:boto:Data: 2023-12-15T23:31:32.963 DEBUG:boto:Headers: {} 2023-12-15T23:31:32.963 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.963 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.963 DEBUG:boto:Params: {} 2023-12-15T23:31:32.964 DEBUG:boto:Token: None 2023-12-15T23:31:32.964 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/ 2023-12-15T23:31:32.964 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA= 2023-12-15T23:31:32.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+l6YAguxbeMpo6T7+oh/0YfuttA=', 'Content-Length': '0'} 2023-12-15T23:31:32.966 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000925571190594ddde-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:32.966 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:31:32.966 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:31:32.966 DEBUG:boto:Method: PUT 2023-12-15T23:31:32.967 DEBUG:boto:Path: /kskgfn-51/obj62 2023-12-15T23:31:32.967 DEBUG:boto:Data: 2023-12-15T23:31:32.967 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:32.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:32.967 DEBUG:boto:Port: 8000 2023-12-15T23:31:32.967 DEBUG:boto:Params: {} 2023-12-15T23:31:32.967 DEBUG:boto:Token: None 2023-12-15T23:31:32.967 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:32 GMT /kskgfn-51/obj62 2023-12-15T23:31:32.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IQ7F8jBZnQdg/+FDuRyfIl+vDB8= 2023-12-15T23:31:32.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:32 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IQ7F8jBZnQdg/+FDuRyfIl+vDB8='} 2023-12-15T23:31:33.009 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000316ed9e4038b5de8-00657ce1d4-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.010 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.010 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.010 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.010 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.010 DEBUG:boto:Data: 2023-12-15T23:31:33.010 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.010 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.010 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.010 DEBUG:boto:Params: {} 2023-12-15T23:31:33.010 DEBUG:boto:Token: None 2023-12-15T23:31:33.010 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.013 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f37c385472bf51d0-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.013 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:31:33.013 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:31:33.013 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.013 DEBUG:boto:Path: /kskgfn-51/obj93 2023-12-15T23:31:33.014 DEBUG:boto:Data: 2023-12-15T23:31:33.014 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.014 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.014 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.014 DEBUG:boto:Params: {} 2023-12-15T23:31:33.014 DEBUG:boto:Token: None 2023-12-15T23:31:33.014 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj93 2023-12-15T23:31:33.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S/O/y2WU5Hq7RHNsQ8y/Q/aOciQ= 2023-12-15T23:31:33.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S/O/y2WU5Hq7RHNsQ8y/Q/aOciQ='} 2023-12-15T23:31:33.019 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e6158a0f87e51f0-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.019 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.019 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.019 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.019 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.019 DEBUG:boto:Data: 2023-12-15T23:31:33.019 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.020 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.020 DEBUG:boto:Params: {} 2023-12-15T23:31:33.020 DEBUG:boto:Token: None 2023-12-15T23:31:33.020 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.023 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001655276a87c93cd7-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.023 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:31:33.023 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:31:33.023 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.023 DEBUG:boto:Path: /kskgfn-51/obj124 2023-12-15T23:31:33.023 DEBUG:boto:Data: 2023-12-15T23:31:33.023 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.023 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.024 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.024 DEBUG:boto:Params: {} 2023-12-15T23:31:33.024 DEBUG:boto:Token: None 2023-12-15T23:31:33.024 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj124 2023-12-15T23:31:33.024 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Sf2CYbzDgBWDlOVUF8+K7R6Sdmo= 2023-12-15T23:31:33.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Sf2CYbzDgBWDlOVUF8+K7R6Sdmo='} 2023-12-15T23:31:33.065 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008c5705c9191fe298-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.066 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.066 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.066 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.066 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.066 DEBUG:boto:Data: 2023-12-15T23:31:33.066 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.066 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.066 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.066 DEBUG:boto:Params: {} 2023-12-15T23:31:33.066 DEBUG:boto:Token: None 2023-12-15T23:31:33.067 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.067 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.069 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006630131aa3adc638-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.070 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:31:33.070 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:31:33.070 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.070 DEBUG:boto:Path: /kskgfn-51/obj155 2023-12-15T23:31:33.070 DEBUG:boto:Data: 2023-12-15T23:31:33.070 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.070 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.070 DEBUG:boto:Params: {} 2023-12-15T23:31:33.070 DEBUG:boto:Token: None 2023-12-15T23:31:33.070 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj155 2023-12-15T23:31:33.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V0dVw+DmymOihGjdlf5G9vwk/YU= 2023-12-15T23:31:33.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V0dVw+DmymOihGjdlf5G9vwk/YU='} 2023-12-15T23:31:33.076 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007c0022c1e9d51983-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.076 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:33.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:33.076 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-51 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:33.170 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:31:33.170 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-51 2023-12-15T23:31:33.185 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 30 2023-12-15T23:31:33.249 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.249 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.249 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.249 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.249 DEBUG:boto:Data: 2023-12-15T23:31:33.249 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.250 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.250 DEBUG:boto:Params: {} 2023-12-15T23:31:33.250 DEBUG:boto:Token: None 2023-12-15T23:31:33.250 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.250 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.253 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002f6be8a36d3d9db3-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.253 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:31:33.253 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:31:33.254 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.254 DEBUG:boto:Path: /kskgfn-51/obj37 2023-12-15T23:31:33.254 DEBUG:boto:Data: 2023-12-15T23:31:33.254 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.254 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.254 DEBUG:boto:Params: {} 2023-12-15T23:31:33.254 DEBUG:boto:Token: None 2023-12-15T23:31:33.254 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj37 2023-12-15T23:31:33.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kgWf9EXYMWHts1UMaDeWu/IcUBQ= 2023-12-15T23:31:33.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kgWf9EXYMWHts1UMaDeWu/IcUBQ='} 2023-12-15T23:31:33.260 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9c39941a9f98cc1-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.260 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.260 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.260 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.260 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.261 DEBUG:boto:Data: 2023-12-15T23:31:33.261 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.261 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.261 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.261 DEBUG:boto:Params: {} 2023-12-15T23:31:33.261 DEBUG:boto:Token: None 2023-12-15T23:31:33.261 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.261 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.264 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049e8032c16b1c11f-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.265 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:31:33.265 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:31:33.265 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.265 DEBUG:boto:Path: /kskgfn-51/obj74 2023-12-15T23:31:33.265 DEBUG:boto:Data: 2023-12-15T23:31:33.265 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.265 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.265 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.265 DEBUG:boto:Params: {} 2023-12-15T23:31:33.266 DEBUG:boto:Token: None 2023-12-15T23:31:33.266 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj74 2023-12-15T23:31:33.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:QXiIJdTYUH+fbz2fiIeZzdwtc9w= 2023-12-15T23:31:33.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:QXiIJdTYUH+fbz2fiIeZzdwtc9w='} 2023-12-15T23:31:33.271 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d6e2baee23353fb3-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.271 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.272 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.272 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.272 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.272 DEBUG:boto:Data: 2023-12-15T23:31:33.272 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.272 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.272 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.272 DEBUG:boto:Params: {} 2023-12-15T23:31:33.272 DEBUG:boto:Token: None 2023-12-15T23:31:33.272 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.273 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.275 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000623c01859a216e18-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.276 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:31:33.276 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:31:33.276 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.276 DEBUG:boto:Path: /kskgfn-51/obj111 2023-12-15T23:31:33.276 DEBUG:boto:Data: 2023-12-15T23:31:33.276 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.276 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.276 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.276 DEBUG:boto:Params: {} 2023-12-15T23:31:33.277 DEBUG:boto:Token: None 2023-12-15T23:31:33.277 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj111 2023-12-15T23:31:33.277 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4dHw+20MjN9CcC/7Gi7axTfSp3U= 2023-12-15T23:31:33.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4dHw+20MjN9CcC/7Gi7axTfSp3U='} 2023-12-15T23:31:33.325 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c350a5fcba47e55-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.326 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.326 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.326 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.326 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.326 DEBUG:boto:Data: 2023-12-15T23:31:33.326 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.327 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.327 DEBUG:boto:Params: {} 2023-12-15T23:31:33.327 DEBUG:boto:Token: None 2023-12-15T23:31:33.327 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.327 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.330 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e26fade99a4a7c65-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.330 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:31:33.330 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:31:33.330 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.330 DEBUG:boto:Path: /kskgfn-51/obj148 2023-12-15T23:31:33.331 DEBUG:boto:Data: 2023-12-15T23:31:33.331 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.331 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.331 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.331 DEBUG:boto:Params: {} 2023-12-15T23:31:33.331 DEBUG:boto:Token: None 2023-12-15T23:31:33.331 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj148 2023-12-15T23:31:33.331 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iR055zl5ahS34NeCAQntlrulFoY= 2023-12-15T23:31:33.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iR055zl5ahS34NeCAQntlrulFoY='} 2023-12-15T23:31:33.337 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c6e04ec0453959f-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.337 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:31:33.337 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:31:33.337 DEBUG:boto:Method: HEAD 2023-12-15T23:31:33.337 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:31:33.337 DEBUG:boto:Data: 2023-12-15T23:31:33.337 DEBUG:boto:Headers: {} 2023-12-15T23:31:33.337 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.337 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.338 DEBUG:boto:Params: {} 2023-12-15T23:31:33.338 DEBUG:boto:Token: None 2023-12-15T23:31:33.338 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/ 2023-12-15T23:31:33.338 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA= 2023-12-15T23:31:33.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EtTDqsJ2jfQhmkSv5tWmqfPJDAA=', 'Content-Length': '0'} 2023-12-15T23:31:33.341 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a114860710870570-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.341 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:31:33.341 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:31:33.341 DEBUG:boto:Method: PUT 2023-12-15T23:31:33.341 DEBUG:boto:Path: /kskgfn-51/obj185 2023-12-15T23:31:33.341 DEBUG:boto:Data: 2023-12-15T23:31:33.342 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:31:33.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:31:33.342 DEBUG:boto:Port: 8000 2023-12-15T23:31:33.342 DEBUG:boto:Params: {} 2023-12-15T23:31:33.342 DEBUG:boto:Token: None 2023-12-15T23:31:33.342 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:31:33 GMT /kskgfn-51/obj185 2023-12-15T23:31:33.342 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:P7utV6pPSTso7hiyg6hJDKc5htQ= 2023-12-15T23:31:33.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:31:33 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:P7utV6pPSTso7hiyg6hJDKc5htQ='} 2023-12-15T23:31:33.385 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ef64895e255e96dc-00657ce1d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:31:33.386 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:33.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:31:33.386 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:31:33.440 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:33.440 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:33.473 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:33.471+0000 7fcce5b27800 5 RGW-SYNC:data: waiting on data sync status lease 2023-12-15T23:31:33.475 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:33.472+0000 7fcce5b27800 5 RGW-SYNC:data: acquired data sync status lease 2023-12-15T23:31:33.499 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:31:33.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:31:33.502 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:31:33.502 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:33.520 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:31:33.520 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:31:33.520 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:31:33.521 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:31:33.521 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:31:34.522 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:31:34.542 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:31:34.542 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:31:34.542 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:31:34.543 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:31:34.543 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-51 2023-12-15T23:31:34.543 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:31:34.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:31:34.544 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:31:34.637 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:31:34.637 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:31:34.674 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:34.671+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:31:35.847 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:31:35.844+0000 7f73bf5a3640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:31:36.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T23:31:39.674 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:39.673+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:31:44.675 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:44.673+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:31:49.676 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:49.675+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:31:54.677 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:54.675+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:31:59.678 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:31:59.676+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:04.679 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:04.677+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:09.682 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:09.678+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:14.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:14.679+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:19.682 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:19.680+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:24.683 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:24.680+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:29.684 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:29.682+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:34.685 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:34.683+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:39.686 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:39.684+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:44.684+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:49.685+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:54.688 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:54.686+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:32:59.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:32:59.687+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:04.690 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:04.688+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:09.691 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:09.689+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:14.691 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:14.689+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:19.689+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:24.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:24.690+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:29.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:29.691+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:34.544 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:33:34.542+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:33:34.693 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:34.691+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:39.695 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:39.693+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:44.696 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:44.694+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:49.697 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:49.694+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:54.697 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:54.695+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:33:59.698 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:33:59.696+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:04.699 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:04.698+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:09.700 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:09.698+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:14.701 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:14.698+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:19.702 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:19.700+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:24.703 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:24.701+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:29.704 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:29.702+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:34.705 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:34.703+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:39.706 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:39.704+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:44.706 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:44.704+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:49.707 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:49.706+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:54.709 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:54.707+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:34:59.710 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:34:59.708+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:04.711 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:04.708+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:09.709+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:14.712 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:14.710+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:19.713 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:19.711+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:24.714 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:24.712+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:29.716 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:29.713+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:34.717 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:34.714+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:39.717 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:39.715+0000 7f6c07540800 1 waiting to reach incremental sync.. 2023-12-15T23:35:44.720 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:44.718+0000 7f6c07540800 1 bucket sync caught up with source: 2023-12-15T23:35:44.720 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.92.6, , , , , 00000000002.95.6, , , , , , , , , , , , , , , 00000000001.60.6, , , , 00000000001.127.6] 2023-12-15T23:35:44.721 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.92.6, , , , , 00000000002.95.6, , , , , , , , , , , , , , , 00000000001.60.6, , , , 00000000001.127.6] 2023-12-15T23:35:44.721 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:44.718+0000 7f6c07540800 0 bucket checkpoint complete 2023-12-15T23:35:44.741 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-51 2023-12-15T23:35:44.741 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:35:44.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:35:44.742 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:35:44.803 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:44.804 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:44.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:35:44.842+0000 7fcec4a11800 1 bucket sync caught up with source: 2023-12-15T23:35:44.844 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, 00000000003.170.6, 00000000002.57.6, 00000000002.153.6, 00000000005.130.6, 00000000004.170.6, 00000000001.199.6, 00000000001.155.6, 00000000004.165.6, 00000000007.205.6, 00000000006.82.6] 2023-12-15T23:35:44.844 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, 00000000003.170.6, 00000000002.57.6, 00000000002.153.6, 00000000005.130.6, 00000000004.170.6, 00000000001.199.6, 00000000001.155.6, 00000000004.165.6, 00000000007.205.6, 00000000006.82.6] 2023-12-15T23:35:44.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:35:44.842+0000 7fcec4a11800 0 bucket checkpoint complete 2023-12-15T23:35:44.860 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-51 zones={test-zone2, test-zone1} 2023-12-15T23:35:44.860 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.860 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.861 DEBUG:boto:Method: HEAD 2023-12-15T23:35:44.861 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:35:44.861 DEBUG:boto:Data: 2023-12-15T23:35:44.861 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.861 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.861 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.861 DEBUG:boto:Params: {} 2023-12-15T23:35:44.862 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:35:44.862 DEBUG:boto:Token: None 2023-12-15T23:35:44.863 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/ 2023-12-15T23:35:44.863 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U0ibNNnY0oU/cBGqb3u4q2QLSWw= 2023-12-15T23:35:44.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U0ibNNnY0oU/cBGqb3u4q2QLSWw=', 'Content-Length': '0'} 2023-12-15T23:35:44.869 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007dde11c9854d0a18-00657ce2d0-5826-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.869 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.869 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.869 DEBUG:boto:Method: HEAD 2023-12-15T23:35:44.869 DEBUG:boto:Path: /kskgfn-51/ 2023-12-15T23:35:44.869 DEBUG:boto:Data: 2023-12-15T23:35:44.869 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.869 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:44.870 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.870 DEBUG:boto:Params: {} 2023-12-15T23:35:44.870 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:35:44.870 DEBUG:boto:Token: None 2023-12-15T23:35:44.870 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/ 2023-12-15T23:35:44.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U0ibNNnY0oU/cBGqb3u4q2QLSWw= 2023-12-15T23:35:44.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U0ibNNnY0oU/cBGqb3u4q2QLSWw=', 'Content-Length': '0'} 2023-12-15T23:35:44.875 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c7373604d6a1a3a-00657ce2d0-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.875 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:35:44.876 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.876 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.876 DEBUG:boto:path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.876 DEBUG:boto:auth_path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.876 DEBUG:boto:Method: GET 2023-12-15T23:35:44.876 DEBUG:boto:Path: /kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.876 DEBUG:boto:Data: 2023-12-15T23:35:44.876 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.876 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.876 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.877 DEBUG:boto:Params: {} 2023-12-15T23:35:44.877 DEBUG:boto:Token: None 2023-12-15T23:35:44.877 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/?versions 2023-12-15T23:35:44.877 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8= 2023-12-15T23:35:44.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8=', 'Content-Length': '0'} 2023-12-15T23:35:44.880 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a591e3b283b2e01e-00657ce2d0-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.880 DEBUG:boto:b'kskgfn-51999falseobj11nulltrue2023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:35:44.883 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:35:44.884 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:35:44.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:35:44.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:35:44.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:35:44.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:35:44.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:35:44.886 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:35:44.886 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.886 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.886 DEBUG:boto:path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.886 DEBUG:boto:auth_path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.886 DEBUG:boto:Method: GET 2023-12-15T23:35:44.886 DEBUG:boto:Path: /kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.887 DEBUG:boto:Data: 2023-12-15T23:35:44.887 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.887 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:44.887 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.887 DEBUG:boto:Params: {} 2023-12-15T23:35:44.887 DEBUG:boto:Token: None 2023-12-15T23:35:44.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/?versions 2023-12-15T23:35:44.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8= 2023-12-15T23:35:44.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8=', 'Content-Length': '0'} 2023-12-15T23:35:44.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0e25c4d16ad6b98-00657ce2d0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.891 DEBUG:boto:b'kskgfn-51999falseobj11nulltrue2023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2023-12-15T23:35:44.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2023-12-15T23:35:44.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2023-12-15T23:35:44.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2023-12-15T23:35:44.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2023-12-15T23:35:44.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2023-12-15T23:35:44.896 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.896 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.896 DEBUG:boto:path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.896 DEBUG:boto:auth_path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.896 DEBUG:boto:Method: GET 2023-12-15T23:35:44.896 DEBUG:boto:Path: /kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.896 DEBUG:boto:Data: 2023-12-15T23:35:44.896 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.897 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.897 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.897 DEBUG:boto:Params: {} 2023-12-15T23:35:44.897 DEBUG:boto:Token: None 2023-12-15T23:35:44.897 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/?versions 2023-12-15T23:35:44.897 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8= 2023-12-15T23:35:44.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8=', 'Content-Length': '0'} 2023-12-15T23:35:44.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9af7d1659c06dd7-00657ce2d0-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.900 DEBUG:boto:b'kskgfn-51999falseobj11nulltrue2023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:44.902 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:44.902 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:44.902 DEBUG:boto:path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.902 DEBUG:boto:auth_path=/kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.902 DEBUG:boto:Method: GET 2023-12-15T23:35:44.903 DEBUG:boto:Path: /kskgfn-51/?versions&max-keys=999 2023-12-15T23:35:44.903 DEBUG:boto:Data: 2023-12-15T23:35:44.903 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.903 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:44.903 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.903 DEBUG:boto:Params: {} 2023-12-15T23:35:44.903 DEBUG:boto:Token: None 2023-12-15T23:35:44.903 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/?versions 2023-12-15T23:35:44.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8= 2023-12-15T23:35:44.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hqw2z4j7StxHisroUy6sv4vxez8=', 'Content-Length': '0'} 2023-12-15T23:35:44.907 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000296e7687809a203-00657ce2d0-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.907 DEBUG:boto:b'kskgfn-51999falseobj11nulltrue2023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj111nulltrue2023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj115nulltrue2023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj116nulltrue2023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj124nulltrue2023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj145nulltrue2023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj148nulltrue2023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj155nulltrue2023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj17nulltrue2023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj185nulltrue2023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj19nulltrue2023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj22nulltrue2023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj23nulltrue2023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj29nulltrue2023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj31nulltrue2023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj33nulltrue2023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj34nulltrue2023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj37nulltrue2023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj38nulltrue2023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj44nulltrue2023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj46nulltrue2023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj51nulltrue2023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj55nulltrue2023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj57nulltrue2023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj58nulltrue2023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj62nulltrue2023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj68nulltrue2023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj69nulltrue2023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj74nulltrue2023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj76nulltrue2023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj85nulltrue2023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj87nulltrue2023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj92nulltrue2023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj93nulltrue2023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj95nulltrue2023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:44.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:35:44.910 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:44.910 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:44.910 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.910 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.910 DEBUG:boto:Method: GET 2023-12-15T23:35:44.910 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.910 DEBUG:boto:Data: 2023-12-15T23:35:44.910 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.910 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.911 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.911 DEBUG:boto:Params: {} 2023-12-15T23:35:44.911 DEBUG:boto:Token: None 2023-12-15T23:35:44.911 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.911 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY= 2023-12-15T23:35:44.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY=', 'Content-Length': '0'} 2023-12-15T23:35:44.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c7584e39cfaddd0-00657ce2d0-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.914 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:44.914 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:44.915 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.915 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.915 DEBUG:boto:Method: GET 2023-12-15T23:35:44.915 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.915 DEBUG:boto:Data: 2023-12-15T23:35:44.915 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.915 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:44.915 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.915 DEBUG:boto:Params: {} 2023-12-15T23:35:44.915 DEBUG:boto:Token: None 2023-12-15T23:35:44.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.916 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY= 2023-12-15T23:35:44.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY=', 'Content-Length': '0'} 2023-12-15T23:35:44.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097d0412cf38f4545-00657ce2d0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.961 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:44.962 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:44.962 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.962 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.962 DEBUG:boto:Method: HEAD 2023-12-15T23:35:44.962 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.962 DEBUG:boto:Data: 2023-12-15T23:35:44.962 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.962 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.963 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.963 DEBUG:boto:Params: {} 2023-12-15T23:35:44.963 DEBUG:boto:Token: None 2023-12-15T23:35:44.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:25MvCwFyK9u+fqPTlMLfTsDj6W8= 2023-12-15T23:35:44.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:25MvCwFyK9u+fqPTlMLfTsDj6W8=', 'Content-Length': '0'} 2023-12-15T23:35:44.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c970db0e7abb1cce-00657ce2d0-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.966 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:44.966 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:44.966 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.966 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.966 DEBUG:boto:Method: HEAD 2023-12-15T23:35:44.966 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.967 DEBUG:boto:Data: 2023-12-15T23:35:44.967 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:44.967 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.967 DEBUG:boto:Params: {} 2023-12-15T23:35:44.967 DEBUG:boto:Token: None 2023-12-15T23:35:44.967 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.968 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:25MvCwFyK9u+fqPTlMLfTsDj6W8= 2023-12-15T23:35:44.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:25MvCwFyK9u+fqPTlMLfTsDj6W8=', 'Content-Length': '0'} 2023-12-15T23:35:44.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001039f7c95a8e0f0a-00657ce2d0-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:44.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:35:44.970 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:44.970 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:44.970 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.970 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.971 DEBUG:boto:Method: GET 2023-12-15T23:35:44.971 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.971 DEBUG:boto:Data: 2023-12-15T23:35:44.971 DEBUG:boto:Headers: {} 2023-12-15T23:35:44.971 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:44.971 DEBUG:boto:Port: 8000 2023-12-15T23:35:44.971 DEBUG:boto:Params: {} 2023-12-15T23:35:44.971 DEBUG:boto:Token: None 2023-12-15T23:35:44.972 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:44 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:44.972 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY= 2023-12-15T23:35:44.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:44 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VKu2LT+es0a5VDQZ8W/JYvbgcQY=', 'Content-Length': '0'} 2023-12-15T23:35:44.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b48dec9fd11f0ca4-00657ce2d0-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:44 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.017 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:45.018 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:45.018 DEBUG:boto:path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:45.018 DEBUG:boto:auth_path=/kskgfn-51/obj11?versionId=null 2023-12-15T23:35:45.018 DEBUG:boto:Method: GET 2023-12-15T23:35:45.018 DEBUG:boto:Path: /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:45.018 DEBUG:boto:Data: 2023-12-15T23:35:45.019 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.019 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.019 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.019 DEBUG:boto:Params: {} 2023-12-15T23:35:45.019 DEBUG:boto:Token: None 2023-12-15T23:35:45.019 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj11?versionId=null 2023-12-15T23:35:45.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Oxk1qM3C9S/7YDRgY3G0lSfSlco= 2023-12-15T23:35:45.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oxk1qM3C9S/7YDRgY3G0lSfSlco=', 'Content-Length': '0'} 2023-12-15T23:35:45.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbd7dc73c238e9fe-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.022 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.022 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.022 DEBUG:boto:path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.022 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.022 DEBUG:boto:Method: GET 2023-12-15T23:35:45.022 DEBUG:boto:Path: /kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.022 DEBUG:boto:Data: 2023-12-15T23:35:45.022 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.023 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.023 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.023 DEBUG:boto:Params: {} 2023-12-15T23:35:45.023 DEBUG:boto:Token: None 2023-12-15T23:35:45.023 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdffc078cb6f64a6-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.026 DEBUG:boto:b'kskgfn-51obj111000falseobj112023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.027 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.027 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.027 DEBUG:boto:path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.027 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.027 DEBUG:boto:Method: GET 2023-12-15T23:35:45.027 DEBUG:boto:Path: /kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.027 DEBUG:boto:Data: 2023-12-15T23:35:45.027 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.027 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.028 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.028 DEBUG:boto:Params: {} 2023-12-15T23:35:45.028 DEBUG:boto:Token: None 2023-12-15T23:35:45.028 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.028 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.031 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f765bb18924b481-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.032 DEBUG:boto:b'kskgfn-51obj111000falseobj112023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.032 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:45.032 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:45.032 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.032 DEBUG:boto:Path: /kskgfn-51/obj11 2023-12-15T23:35:45.033 DEBUG:boto:Data: 2023-12-15T23:35:45.033 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.033 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.033 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.033 DEBUG:boto:Params: {} 2023-12-15T23:35:45.033 DEBUG:boto:Token: None 2023-12-15T23:35:45.033 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj11 2023-12-15T23:35:45.033 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9LTOPACk9qHgzx99MGtyQu1X2ns= 2023-12-15T23:35:45.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9LTOPACk9qHgzx99MGtyQu1X2ns=', 'Content-Length': '0'} 2023-12-15T23:35:45.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a81000f4c52603a-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.036 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:45.036 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:45.036 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.036 DEBUG:boto:Path: /kskgfn-51/obj11 2023-12-15T23:35:45.036 DEBUG:boto:Data: 2023-12-15T23:35:45.037 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.037 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.037 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.037 DEBUG:boto:Params: {} 2023-12-15T23:35:45.037 DEBUG:boto:Token: None 2023-12-15T23:35:45.037 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj11 2023-12-15T23:35:45.037 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9LTOPACk9qHgzx99MGtyQu1X2ns= 2023-12-15T23:35:45.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9LTOPACk9qHgzx99MGtyQu1X2ns=', 'Content-Length': '0'} 2023-12-15T23:35:45.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a08ab54762f26df-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2023-12-15T23:35:45.040 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:45.040 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:45.040 DEBUG:boto:Method: GET 2023-12-15T23:35:45.040 DEBUG:boto:Path: /kskgfn-51/obj11 2023-12-15T23:35:45.040 DEBUG:boto:Data: 2023-12-15T23:35:45.040 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.041 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.041 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.041 DEBUG:boto:Params: {} 2023-12-15T23:35:45.041 DEBUG:boto:Token: None 2023-12-15T23:35:45.041 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj11 2023-12-15T23:35:45.041 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9nHJVXJUhEt9p+Py//jefIGo84= 2023-12-15T23:35:45.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9nHJVXJUhEt9p+Py//jefIGo84=', 'Content-Length': '0'} 2023-12-15T23:35:45.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047d20aca3e3dcca7-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.085 DEBUG:boto:path=/kskgfn-51/obj11 2023-12-15T23:35:45.086 DEBUG:boto:auth_path=/kskgfn-51/obj11 2023-12-15T23:35:45.086 DEBUG:boto:Method: GET 2023-12-15T23:35:45.086 DEBUG:boto:Path: /kskgfn-51/obj11 2023-12-15T23:35:45.086 DEBUG:boto:Data: 2023-12-15T23:35:45.086 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.086 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.087 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.087 DEBUG:boto:Params: {} 2023-12-15T23:35:45.087 DEBUG:boto:Token: None 2023-12-15T23:35:45.087 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj11 2023-12-15T23:35:45.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:s9nHJVXJUhEt9p+Py//jefIGo84= 2023-12-15T23:35:45.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:s9nHJVXJUhEt9p+Py//jefIGo84=', 'Content-Length': '0'} 2023-12-15T23:35:45.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba18e555888fd74a-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.090 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.090 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.090 DEBUG:boto:path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.090 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.090 DEBUG:boto:Method: GET 2023-12-15T23:35:45.090 DEBUG:boto:Path: /kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.090 DEBUG:boto:Data: 2023-12-15T23:35:45.091 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.091 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.091 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.091 DEBUG:boto:Params: {} 2023-12-15T23:35:45.091 DEBUG:boto:Token: None 2023-12-15T23:35:45.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076346e3aff91cf8b-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.094 DEBUG:boto:b'kskgfn-51obj111000falseobj112023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.094 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.095 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.095 DEBUG:boto:path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.095 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.095 DEBUG:boto:Method: GET 2023-12-15T23:35:45.095 DEBUG:boto:Path: /kskgfn-51/?prefix=obj11 2023-12-15T23:35:45.095 DEBUG:boto:Data: 2023-12-15T23:35:45.095 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.095 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.095 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.096 DEBUG:boto:Params: {} 2023-12-15T23:35:45.096 DEBUG:boto:Token: None 2023-12-15T23:35:45.096 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038e65e88d4f82c43-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.100 DEBUG:boto:b'kskgfn-51obj111000falseobj112023-12-15T23:31:31.497Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormalobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:35:45.101 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.101 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.101 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.101 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.101 DEBUG:boto:Method: GET 2023-12-15T23:35:45.101 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.101 DEBUG:boto:Data: 2023-12-15T23:35:45.102 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.102 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.102 DEBUG:boto:Params: {} 2023-12-15T23:35:45.102 DEBUG:boto:Token: None 2023-12-15T23:35:45.102 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA= 2023-12-15T23:35:45.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA=', 'Content-Length': '0'} 2023-12-15T23:35:45.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7b9f27422d42ac3-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.145 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.146 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.146 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.146 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.146 DEBUG:boto:Method: GET 2023-12-15T23:35:45.146 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.146 DEBUG:boto:Data: 2023-12-15T23:35:45.146 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.146 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.146 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.146 DEBUG:boto:Params: {} 2023-12-15T23:35:45.147 DEBUG:boto:Token: None 2023-12-15T23:35:45.147 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.147 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA= 2023-12-15T23:35:45.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA=', 'Content-Length': '0'} 2023-12-15T23:35:45.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076da94d7355b0ef3-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.149 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.150 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.150 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.150 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.150 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.150 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.150 DEBUG:boto:Data: 2023-12-15T23:35:45.150 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.150 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.151 DEBUG:boto:Params: {} 2023-12-15T23:35:45.151 DEBUG:boto:Token: None 2023-12-15T23:35:45.151 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZAvTb1oq7PtTPKYDFzG8szyewTo= 2023-12-15T23:35:45.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZAvTb1oq7PtTPKYDFzG8szyewTo=', 'Content-Length': '0'} 2023-12-15T23:35:45.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077bf26deee271c88-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.153 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.154 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.154 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.154 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.154 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.154 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.154 DEBUG:boto:Data: 2023-12-15T23:35:45.154 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.154 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.154 DEBUG:boto:Params: {} 2023-12-15T23:35:45.155 DEBUG:boto:Token: None 2023-12-15T23:35:45.155 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZAvTb1oq7PtTPKYDFzG8szyewTo= 2023-12-15T23:35:45.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZAvTb1oq7PtTPKYDFzG8szyewTo=', 'Content-Length': '0'} 2023-12-15T23:35:45.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038af36ed8bc22697-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:35:45.157 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.157 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.157 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.157 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.157 DEBUG:boto:Method: GET 2023-12-15T23:35:45.158 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.158 DEBUG:boto:Data: 2023-12-15T23:35:45.158 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.158 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.158 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.158 DEBUG:boto:Params: {} 2023-12-15T23:35:45.158 DEBUG:boto:Token: None 2023-12-15T23:35:45.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA= 2023-12-15T23:35:45.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA=', 'Content-Length': '0'} 2023-12-15T23:35:45.160 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc5128e8f767dcb4-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.201 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.202 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.202 DEBUG:boto:path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.202 DEBUG:boto:auth_path=/kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.202 DEBUG:boto:Method: GET 2023-12-15T23:35:45.202 DEBUG:boto:Path: /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.202 DEBUG:boto:Data: 2023-12-15T23:35:45.202 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.202 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.203 DEBUG:boto:Params: {} 2023-12-15T23:35:45.203 DEBUG:boto:Token: None 2023-12-15T23:35:45.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111?versionId=null 2023-12-15T23:35:45.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA= 2023-12-15T23:35:45.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mQNjpCtXAGHuXeI/7LHGfPcYyeA=', 'Content-Length': '0'} 2023-12-15T23:35:45.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000385217e2c9f4cdaf-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.205 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.205 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.205 DEBUG:boto:path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.205 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.206 DEBUG:boto:Method: GET 2023-12-15T23:35:45.206 DEBUG:boto:Path: /kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.206 DEBUG:boto:Data: 2023-12-15T23:35:45.206 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.206 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.206 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.206 DEBUG:boto:Params: {} 2023-12-15T23:35:45.206 DEBUG:boto:Token: None 2023-12-15T23:35:45.207 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.207 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000143ba81a60447d90-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.209 DEBUG:boto:b'kskgfn-51obj1111000falseobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.209 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.210 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.210 DEBUG:boto:path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.210 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.210 DEBUG:boto:Method: GET 2023-12-15T23:35:45.210 DEBUG:boto:Path: /kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.210 DEBUG:boto:Data: 2023-12-15T23:35:45.210 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.210 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.210 DEBUG:boto:Params: {} 2023-12-15T23:35:45.211 DEBUG:boto:Token: None 2023-12-15T23:35:45.211 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.211 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.214 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0f1343ed378be05-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.215 DEBUG:boto:b'kskgfn-51obj1111000falseobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.215 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.215 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.215 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.215 DEBUG:boto:Path: /kskgfn-51/obj111 2023-12-15T23:35:45.215 DEBUG:boto:Data: 2023-12-15T23:35:45.216 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.216 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.216 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.216 DEBUG:boto:Params: {} 2023-12-15T23:35:45.216 DEBUG:boto:Token: None 2023-12-15T23:35:45.216 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111 2023-12-15T23:35:45.216 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91dLcj00aauSzga0sX3gbQ0g2tk= 2023-12-15T23:35:45.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91dLcj00aauSzga0sX3gbQ0g2tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078915bd6bc055510-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.219 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.219 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.219 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.219 DEBUG:boto:Path: /kskgfn-51/obj111 2023-12-15T23:35:45.219 DEBUG:boto:Data: 2023-12-15T23:35:45.219 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.219 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.219 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.219 DEBUG:boto:Params: {} 2023-12-15T23:35:45.219 DEBUG:boto:Token: None 2023-12-15T23:35:45.220 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111 2023-12-15T23:35:45.220 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:91dLcj00aauSzga0sX3gbQ0g2tk= 2023-12-15T23:35:45.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:91dLcj00aauSzga0sX3gbQ0g2tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f565d22209f9f1ad-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2023-12-15T23:35:45.222 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.222 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.222 DEBUG:boto:Method: GET 2023-12-15T23:35:45.222 DEBUG:boto:Path: /kskgfn-51/obj111 2023-12-15T23:35:45.222 DEBUG:boto:Data: 2023-12-15T23:35:45.222 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.223 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.223 DEBUG:boto:Params: {} 2023-12-15T23:35:45.223 DEBUG:boto:Token: None 2023-12-15T23:35:45.223 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111 2023-12-15T23:35:45.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kF321/wbTepoBprZn4x4DOpzAGs= 2023-12-15T23:35:45.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kF321/wbTepoBprZn4x4DOpzAGs=', 'Content-Length': '0'} 2023-12-15T23:35:45.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060f8f0f26b4327a9-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.265 DEBUG:boto:path=/kskgfn-51/obj111 2023-12-15T23:35:45.266 DEBUG:boto:auth_path=/kskgfn-51/obj111 2023-12-15T23:35:45.266 DEBUG:boto:Method: GET 2023-12-15T23:35:45.266 DEBUG:boto:Path: /kskgfn-51/obj111 2023-12-15T23:35:45.266 DEBUG:boto:Data: 2023-12-15T23:35:45.266 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.266 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.266 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.266 DEBUG:boto:Params: {} 2023-12-15T23:35:45.266 DEBUG:boto:Token: None 2023-12-15T23:35:45.267 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj111 2023-12-15T23:35:45.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kF321/wbTepoBprZn4x4DOpzAGs= 2023-12-15T23:35:45.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kF321/wbTepoBprZn4x4DOpzAGs=', 'Content-Length': '0'} 2023-12-15T23:35:45.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d70bb2fb25fbdc45-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.269 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.269 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.269 DEBUG:boto:path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.269 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.269 DEBUG:boto:Method: GET 2023-12-15T23:35:45.269 DEBUG:boto:Path: /kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.269 DEBUG:boto:Data: 2023-12-15T23:35:45.270 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.270 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.270 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.270 DEBUG:boto:Params: {} 2023-12-15T23:35:45.270 DEBUG:boto:Token: None 2023-12-15T23:35:45.270 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.272 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c54059ebf2a11d09-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.273 DEBUG:boto:b'kskgfn-51obj1111000falseobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.273 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.273 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.273 DEBUG:boto:path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.273 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.274 DEBUG:boto:Method: GET 2023-12-15T23:35:45.274 DEBUG:boto:Path: /kskgfn-51/?prefix=obj111 2023-12-15T23:35:45.274 DEBUG:boto:Data: 2023-12-15T23:35:45.274 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.274 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.274 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.274 DEBUG:boto:Params: {} 2023-12-15T23:35:45.274 DEBUG:boto:Token: None 2023-12-15T23:35:45.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b14d3eb2c76c7bcc-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.278 DEBUG:boto:b'kskgfn-51obj1111000falseobj1112023-12-15T23:31:33.277Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.278 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:35:45.278 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.278 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.278 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.278 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.279 DEBUG:boto:Method: GET 2023-12-15T23:35:45.279 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.279 DEBUG:boto:Data: 2023-12-15T23:35:45.279 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.279 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.279 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.279 DEBUG:boto:Params: {} 2023-12-15T23:35:45.279 DEBUG:boto:Token: None 2023-12-15T23:35:45.279 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA= 2023-12-15T23:35:45.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA=', 'Content-Length': '0'} 2023-12-15T23:35:45.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a95a86c8472f440-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.282 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.282 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.282 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.282 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.282 DEBUG:boto:Method: GET 2023-12-15T23:35:45.283 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.283 DEBUG:boto:Data: 2023-12-15T23:35:45.283 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.283 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.283 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.283 DEBUG:boto:Params: {} 2023-12-15T23:35:45.283 DEBUG:boto:Token: None 2023-12-15T23:35:45.283 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA= 2023-12-15T23:35:45.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA=', 'Content-Length': '0'} 2023-12-15T23:35:45.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008481b70eae2da926-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.286 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.286 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.286 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.286 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.286 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.286 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.286 DEBUG:boto:Data: 2023-12-15T23:35:45.286 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.287 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.287 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.287 DEBUG:boto:Params: {} 2023-12-15T23:35:45.287 DEBUG:boto:Token: None 2023-12-15T23:35:45.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2SEvsaqpBvTOttbCAwtetVcDLao= 2023-12-15T23:35:45.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2SEvsaqpBvTOttbCAwtetVcDLao=', 'Content-Length': '0'} 2023-12-15T23:35:45.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f477b86eedffe9fb-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.289 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.289 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.290 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.290 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.290 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.290 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.290 DEBUG:boto:Data: 2023-12-15T23:35:45.290 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.290 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.290 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.290 DEBUG:boto:Params: {} 2023-12-15T23:35:45.291 DEBUG:boto:Token: None 2023-12-15T23:35:45.291 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2SEvsaqpBvTOttbCAwtetVcDLao= 2023-12-15T23:35:45.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2SEvsaqpBvTOttbCAwtetVcDLao=', 'Content-Length': '0'} 2023-12-15T23:35:45.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000224722c7cf5cca9f-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.293 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:35:45.293 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.293 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.293 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.293 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.294 DEBUG:boto:Method: GET 2023-12-15T23:35:45.294 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.294 DEBUG:boto:Data: 2023-12-15T23:35:45.294 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.294 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.294 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.294 DEBUG:boto:Params: {} 2023-12-15T23:35:45.294 DEBUG:boto:Token: None 2023-12-15T23:35:45.294 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA= 2023-12-15T23:35:45.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA=', 'Content-Length': '0'} 2023-12-15T23:35:45.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000103e171977c50c2e-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.297 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.297 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.297 DEBUG:boto:path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.297 DEBUG:boto:auth_path=/kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.297 DEBUG:boto:Method: GET 2023-12-15T23:35:45.297 DEBUG:boto:Path: /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.298 DEBUG:boto:Data: 2023-12-15T23:35:45.298 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.298 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.298 DEBUG:boto:Params: {} 2023-12-15T23:35:45.298 DEBUG:boto:Token: None 2023-12-15T23:35:45.298 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115?versionId=null 2023-12-15T23:35:45.298 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA= 2023-12-15T23:35:45.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ax+G9g8Vp8S1DVAthPFdgjeMSZA=', 'Content-Length': '0'} 2023-12-15T23:35:45.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c87279da85915a6-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.342 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.342 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.342 DEBUG:boto:path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.342 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.342 DEBUG:boto:Method: GET 2023-12-15T23:35:45.342 DEBUG:boto:Path: /kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.342 DEBUG:boto:Data: 2023-12-15T23:35:45.342 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.343 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.343 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.343 DEBUG:boto:Params: {} 2023-12-15T23:35:45.343 DEBUG:boto:Token: None 2023-12-15T23:35:45.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2328d9fc118422a-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.345 DEBUG:boto:b'kskgfn-51obj1151000falseobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.346 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.346 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.346 DEBUG:boto:path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.346 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.347 DEBUG:boto:Method: GET 2023-12-15T23:35:45.347 DEBUG:boto:Path: /kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.347 DEBUG:boto:Data: 2023-12-15T23:35:45.347 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.347 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.347 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.347 DEBUG:boto:Params: {} 2023-12-15T23:35:45.347 DEBUG:boto:Token: None 2023-12-15T23:35:45.347 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.348 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f91ee985d472e467-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.351 DEBUG:boto:b'kskgfn-51obj1151000falseobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.351 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.352 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.352 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.352 DEBUG:boto:Path: /kskgfn-51/obj115 2023-12-15T23:35:45.352 DEBUG:boto:Data: 2023-12-15T23:35:45.352 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.352 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.352 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.352 DEBUG:boto:Params: {} 2023-12-15T23:35:45.352 DEBUG:boto:Token: None 2023-12-15T23:35:45.353 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115 2023-12-15T23:35:45.353 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gy5rHv/ILX2FZhd6WaAnqkJxQcs= 2023-12-15T23:35:45.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gy5rHv/ILX2FZhd6WaAnqkJxQcs=', 'Content-Length': '0'} 2023-12-15T23:35:45.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c34c3ec9f82edd34-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.355 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.355 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.355 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.355 DEBUG:boto:Path: /kskgfn-51/obj115 2023-12-15T23:35:45.355 DEBUG:boto:Data: 2023-12-15T23:35:45.355 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.355 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.355 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.355 DEBUG:boto:Params: {} 2023-12-15T23:35:45.356 DEBUG:boto:Token: None 2023-12-15T23:35:45.356 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115 2023-12-15T23:35:45.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gy5rHv/ILX2FZhd6WaAnqkJxQcs= 2023-12-15T23:35:45.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gy5rHv/ILX2FZhd6WaAnqkJxQcs=', 'Content-Length': '0'} 2023-12-15T23:35:45.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f8e54fad4a15329-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.358 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2023-12-15T23:35:45.358 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.358 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.358 DEBUG:boto:Method: GET 2023-12-15T23:35:45.358 DEBUG:boto:Path: /kskgfn-51/obj115 2023-12-15T23:35:45.358 DEBUG:boto:Data: 2023-12-15T23:35:45.359 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.359 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.359 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.359 DEBUG:boto:Params: {} 2023-12-15T23:35:45.359 DEBUG:boto:Token: None 2023-12-15T23:35:45.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115 2023-12-15T23:35:45.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPyGH+oA5TeIWpbVaI2yDy1epgo= 2023-12-15T23:35:45.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPyGH+oA5TeIWpbVaI2yDy1epgo=', 'Content-Length': '0'} 2023-12-15T23:35:45.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d16b15bb5516a1ff-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.401 DEBUG:boto:path=/kskgfn-51/obj115 2023-12-15T23:35:45.402 DEBUG:boto:auth_path=/kskgfn-51/obj115 2023-12-15T23:35:45.402 DEBUG:boto:Method: GET 2023-12-15T23:35:45.402 DEBUG:boto:Path: /kskgfn-51/obj115 2023-12-15T23:35:45.402 DEBUG:boto:Data: 2023-12-15T23:35:45.402 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.402 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.402 DEBUG:boto:Params: {} 2023-12-15T23:35:45.402 DEBUG:boto:Token: None 2023-12-15T23:35:45.403 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj115 2023-12-15T23:35:45.403 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YPyGH+oA5TeIWpbVaI2yDy1epgo= 2023-12-15T23:35:45.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YPyGH+oA5TeIWpbVaI2yDy1epgo=', 'Content-Length': '0'} 2023-12-15T23:35:45.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000240c86c5d496addc-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.405 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.405 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.405 DEBUG:boto:path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.405 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.405 DEBUG:boto:Method: GET 2023-12-15T23:35:45.406 DEBUG:boto:Path: /kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.406 DEBUG:boto:Data: 2023-12-15T23:35:45.406 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.406 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.406 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.406 DEBUG:boto:Params: {} 2023-12-15T23:35:45.406 DEBUG:boto:Token: None 2023-12-15T23:35:45.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000366c46cda3885b05-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.409 DEBUG:boto:b'kskgfn-51obj1151000falseobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.410 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.410 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.410 DEBUG:boto:path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.410 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.410 DEBUG:boto:Method: GET 2023-12-15T23:35:45.410 DEBUG:boto:Path: /kskgfn-51/?prefix=obj115 2023-12-15T23:35:45.410 DEBUG:boto:Data: 2023-12-15T23:35:45.410 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.410 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.411 DEBUG:boto:Params: {} 2023-12-15T23:35:45.411 DEBUG:boto:Token: None 2023-12-15T23:35:45.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.415 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af84298a5d78a2c2-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.415 DEBUG:boto:b'kskgfn-51obj1151000falseobj1152023-12-15T23:31:32.476Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:35:45.415 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.415 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.415 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.416 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.416 DEBUG:boto:Method: GET 2023-12-15T23:35:45.416 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.416 DEBUG:boto:Data: 2023-12-15T23:35:45.416 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.416 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.416 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.416 DEBUG:boto:Params: {} 2023-12-15T23:35:45.416 DEBUG:boto:Token: None 2023-12-15T23:35:45.416 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ= 2023-12-15T23:35:45.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d846a6c5abc6f591-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.419 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.419 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.419 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.419 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.419 DEBUG:boto:Method: GET 2023-12-15T23:35:45.419 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.420 DEBUG:boto:Data: 2023-12-15T23:35:45.420 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.420 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.420 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.420 DEBUG:boto:Params: {} 2023-12-15T23:35:45.420 DEBUG:boto:Token: None 2023-12-15T23:35:45.420 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ= 2023-12-15T23:35:45.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f5fdf18e0e2131f-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.465 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.466 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.466 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.466 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.466 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.466 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.466 DEBUG:boto:Data: 2023-12-15T23:35:45.466 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.466 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.466 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.466 DEBUG:boto:Params: {} 2023-12-15T23:35:45.466 DEBUG:boto:Token: None 2023-12-15T23:35:45.467 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.467 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ju0TCaQTQgIzwTSy3g3wYnweHIA= 2023-12-15T23:35:45.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ju0TCaQTQgIzwTSy3g3wYnweHIA=', 'Content-Length': '0'} 2023-12-15T23:35:45.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fc2ca901bf743f8-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.469 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.469 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.469 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.469 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.469 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.469 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.470 DEBUG:boto:Data: 2023-12-15T23:35:45.470 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.470 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.470 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.470 DEBUG:boto:Params: {} 2023-12-15T23:35:45.470 DEBUG:boto:Token: None 2023-12-15T23:35:45.470 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ju0TCaQTQgIzwTSy3g3wYnweHIA= 2023-12-15T23:35:45.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ju0TCaQTQgIzwTSy3g3wYnweHIA=', 'Content-Length': '0'} 2023-12-15T23:35:45.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000666bb4deb8b56c3-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.472 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:35:45.472 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.472 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.473 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.473 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.473 DEBUG:boto:Method: GET 2023-12-15T23:35:45.473 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.473 DEBUG:boto:Data: 2023-12-15T23:35:45.473 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.473 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.473 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.473 DEBUG:boto:Params: {} 2023-12-15T23:35:45.473 DEBUG:boto:Token: None 2023-12-15T23:35:45.474 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.474 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ= 2023-12-15T23:35:45.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c439340bfe2e893b-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.476 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.476 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.476 DEBUG:boto:path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.476 DEBUG:boto:auth_path=/kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.476 DEBUG:boto:Method: GET 2023-12-15T23:35:45.476 DEBUG:boto:Path: /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.476 DEBUG:boto:Data: 2023-12-15T23:35:45.476 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.476 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.476 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.476 DEBUG:boto:Params: {} 2023-12-15T23:35:45.477 DEBUG:boto:Token: None 2023-12-15T23:35:45.477 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116?versionId=null 2023-12-15T23:35:45.477 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ= 2023-12-15T23:35:45.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5nosSA9F8FuWreJ+61/qMgIdVcQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000416f55d2631a8e6a-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.479 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.479 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.479 DEBUG:boto:path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.479 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.479 DEBUG:boto:Method: GET 2023-12-15T23:35:45.479 DEBUG:boto:Path: /kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.479 DEBUG:boto:Data: 2023-12-15T23:35:45.479 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.480 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.480 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.480 DEBUG:boto:Params: {} 2023-12-15T23:35:45.480 DEBUG:boto:Token: None 2023-12-15T23:35:45.480 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.480 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000982a84ef3e53635b-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.483 DEBUG:boto:b'kskgfn-51obj1161000falseobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.483 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.483 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.483 DEBUG:boto:path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.484 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.484 DEBUG:boto:Method: GET 2023-12-15T23:35:45.484 DEBUG:boto:Path: /kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.484 DEBUG:boto:Data: 2023-12-15T23:35:45.484 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.484 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.484 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.484 DEBUG:boto:Params: {} 2023-12-15T23:35:45.484 DEBUG:boto:Token: None 2023-12-15T23:35:45.484 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.484 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa9b97a4ef9600e2-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.488 DEBUG:boto:b'kskgfn-51obj1161000falseobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.488 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.488 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.488 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.489 DEBUG:boto:Path: /kskgfn-51/obj116 2023-12-15T23:35:45.489 DEBUG:boto:Data: 2023-12-15T23:35:45.489 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.489 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.489 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.489 DEBUG:boto:Params: {} 2023-12-15T23:35:45.489 DEBUG:boto:Token: None 2023-12-15T23:35:45.489 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116 2023-12-15T23:35:45.489 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xUVDM9wiai8pn6EJeoFaIJtOMQ4= 2023-12-15T23:35:45.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xUVDM9wiai8pn6EJeoFaIJtOMQ4=', 'Content-Length': '0'} 2023-12-15T23:35:45.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1fe40d66eaef335-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.492 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.492 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.492 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.492 DEBUG:boto:Path: /kskgfn-51/obj116 2023-12-15T23:35:45.492 DEBUG:boto:Data: 2023-12-15T23:35:45.492 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.492 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.492 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.492 DEBUG:boto:Params: {} 2023-12-15T23:35:45.493 DEBUG:boto:Token: None 2023-12-15T23:35:45.493 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116 2023-12-15T23:35:45.493 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xUVDM9wiai8pn6EJeoFaIJtOMQ4= 2023-12-15T23:35:45.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xUVDM9wiai8pn6EJeoFaIJtOMQ4=', 'Content-Length': '0'} 2023-12-15T23:35:45.495 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b32e4f457df63f92-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2023-12-15T23:35:45.495 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.495 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.495 DEBUG:boto:Method: GET 2023-12-15T23:35:45.495 DEBUG:boto:Path: /kskgfn-51/obj116 2023-12-15T23:35:45.496 DEBUG:boto:Data: 2023-12-15T23:35:45.496 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.496 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.496 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.496 DEBUG:boto:Params: {} 2023-12-15T23:35:45.496 DEBUG:boto:Token: None 2023-12-15T23:35:45.496 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116 2023-12-15T23:35:45.496 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/cY7Ik+LQT0VvxytoryJOqAguvM= 2023-12-15T23:35:45.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/cY7Ik+LQT0VvxytoryJOqAguvM=', 'Content-Length': '0'} 2023-12-15T23:35:45.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000129b4f235a645f7f-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.499 DEBUG:boto:path=/kskgfn-51/obj116 2023-12-15T23:35:45.499 DEBUG:boto:auth_path=/kskgfn-51/obj116 2023-12-15T23:35:45.499 DEBUG:boto:Method: GET 2023-12-15T23:35:45.499 DEBUG:boto:Path: /kskgfn-51/obj116 2023-12-15T23:35:45.499 DEBUG:boto:Data: 2023-12-15T23:35:45.499 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.499 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.499 DEBUG:boto:Params: {} 2023-12-15T23:35:45.499 DEBUG:boto:Token: None 2023-12-15T23:35:45.500 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj116 2023-12-15T23:35:45.500 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/cY7Ik+LQT0VvxytoryJOqAguvM= 2023-12-15T23:35:45.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/cY7Ik+LQT0VvxytoryJOqAguvM=', 'Content-Length': '0'} 2023-12-15T23:35:45.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb164d38fdfa5129-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.502 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.502 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.502 DEBUG:boto:path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.502 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.502 DEBUG:boto:Method: GET 2023-12-15T23:35:45.502 DEBUG:boto:Path: /kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.502 DEBUG:boto:Data: 2023-12-15T23:35:45.502 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.503 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.503 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.503 DEBUG:boto:Params: {} 2023-12-15T23:35:45.503 DEBUG:boto:Token: None 2023-12-15T23:35:45.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000514d6c4c1ecd8bf5-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.545 DEBUG:boto:b'kskgfn-51obj1161000falseobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.546 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.546 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.546 DEBUG:boto:path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.546 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.546 DEBUG:boto:Method: GET 2023-12-15T23:35:45.546 DEBUG:boto:Path: /kskgfn-51/?prefix=obj116 2023-12-15T23:35:45.546 DEBUG:boto:Data: 2023-12-15T23:35:45.547 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.547 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.547 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.547 DEBUG:boto:Params: {} 2023-12-15T23:35:45.547 DEBUG:boto:Token: None 2023-12-15T23:35:45.547 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.547 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.551 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b4222ee98ff783b-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.551 DEBUG:boto:b'kskgfn-51obj1161000falseobj1162023-12-15T23:31:32.718Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.552 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:35:45.552 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.552 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.552 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.552 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.552 DEBUG:boto:Method: GET 2023-12-15T23:35:45.552 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.552 DEBUG:boto:Data: 2023-12-15T23:35:45.552 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.552 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.553 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.553 DEBUG:boto:Params: {} 2023-12-15T23:35:45.553 DEBUG:boto:Token: None 2023-12-15T23:35:45.553 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI= 2023-12-15T23:35:45.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI=', 'Content-Length': '0'} 2023-12-15T23:35:45.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d996ce1911285ef-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.555 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.556 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.556 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.556 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.556 DEBUG:boto:Method: GET 2023-12-15T23:35:45.556 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.556 DEBUG:boto:Data: 2023-12-15T23:35:45.556 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.556 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.556 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.556 DEBUG:boto:Params: {} 2023-12-15T23:35:45.556 DEBUG:boto:Token: None 2023-12-15T23:35:45.557 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.557 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI= 2023-12-15T23:35:45.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI=', 'Content-Length': '0'} 2023-12-15T23:35:45.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f3a20f4e5ab998f-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.601 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.602 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.602 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.602 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.602 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.602 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.602 DEBUG:boto:Data: 2023-12-15T23:35:45.602 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.602 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.602 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.602 DEBUG:boto:Params: {} 2023-12-15T23:35:45.603 DEBUG:boto:Token: None 2023-12-15T23:35:45.603 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.603 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:axkeGEIei8zUWNFsJwRrfmbWo64= 2023-12-15T23:35:45.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:axkeGEIei8zUWNFsJwRrfmbWo64=', 'Content-Length': '0'} 2023-12-15T23:35:45.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000793319252ea539e7-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.605 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.605 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.605 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.605 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.606 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.606 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.606 DEBUG:boto:Data: 2023-12-15T23:35:45.606 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.606 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.606 DEBUG:boto:Params: {} 2023-12-15T23:35:45.606 DEBUG:boto:Token: None 2023-12-15T23:35:45.606 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:axkeGEIei8zUWNFsJwRrfmbWo64= 2023-12-15T23:35:45.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:axkeGEIei8zUWNFsJwRrfmbWo64=', 'Content-Length': '0'} 2023-12-15T23:35:45.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f4074aec4580bc3-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:35:45.609 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.609 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.609 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.609 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.609 DEBUG:boto:Method: GET 2023-12-15T23:35:45.609 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.609 DEBUG:boto:Data: 2023-12-15T23:35:45.609 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.610 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.610 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.610 DEBUG:boto:Params: {} 2023-12-15T23:35:45.610 DEBUG:boto:Token: None 2023-12-15T23:35:45.610 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI= 2023-12-15T23:35:45.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI=', 'Content-Length': '0'} 2023-12-15T23:35:45.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fc9a164bde06cfc-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.613 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.613 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.613 DEBUG:boto:path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.613 DEBUG:boto:auth_path=/kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.613 DEBUG:boto:Method: GET 2023-12-15T23:35:45.613 DEBUG:boto:Path: /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.613 DEBUG:boto:Data: 2023-12-15T23:35:45.613 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.613 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.614 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.614 DEBUG:boto:Params: {} 2023-12-15T23:35:45.614 DEBUG:boto:Token: None 2023-12-15T23:35:45.614 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124?versionId=null 2023-12-15T23:35:45.614 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI= 2023-12-15T23:35:45.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VhIErkb8Tg6tQZZxAl/IjU8vQdI=', 'Content-Length': '0'} 2023-12-15T23:35:45.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8ba599701b99971-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.617 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.617 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.617 DEBUG:boto:path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.617 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.617 DEBUG:boto:Method: GET 2023-12-15T23:35:45.617 DEBUG:boto:Path: /kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.617 DEBUG:boto:Data: 2023-12-15T23:35:45.617 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.618 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.618 DEBUG:boto:Params: {} 2023-12-15T23:35:45.618 DEBUG:boto:Token: None 2023-12-15T23:35:45.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.618 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078b85255b76b92ee-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.621 DEBUG:boto:b'kskgfn-51obj1241000falseobj1242023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.621 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.621 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.622 DEBUG:boto:path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.622 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.622 DEBUG:boto:Method: GET 2023-12-15T23:35:45.622 DEBUG:boto:Path: /kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.622 DEBUG:boto:Data: 2023-12-15T23:35:45.622 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.622 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.622 DEBUG:boto:Params: {} 2023-12-15T23:35:45.622 DEBUG:boto:Token: None 2023-12-15T23:35:45.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.623 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba23e831ae358093-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.626 DEBUG:boto:b'kskgfn-51obj1241000falseobj1242023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.627 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.627 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.627 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.627 DEBUG:boto:Path: /kskgfn-51/obj124 2023-12-15T23:35:45.627 DEBUG:boto:Data: 2023-12-15T23:35:45.627 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.627 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.627 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.628 DEBUG:boto:Params: {} 2023-12-15T23:35:45.628 DEBUG:boto:Token: None 2023-12-15T23:35:45.628 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124 2023-12-15T23:35:45.628 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WGraXyNS/9e8MR8s2rOW5arMiWc= 2023-12-15T23:35:45.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WGraXyNS/9e8MR8s2rOW5arMiWc=', 'Content-Length': '0'} 2023-12-15T23:35:45.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006313b2a7b8221c9-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.630 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.630 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.630 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.631 DEBUG:boto:Path: /kskgfn-51/obj124 2023-12-15T23:35:45.631 DEBUG:boto:Data: 2023-12-15T23:35:45.631 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.631 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.631 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.631 DEBUG:boto:Params: {} 2023-12-15T23:35:45.631 DEBUG:boto:Token: None 2023-12-15T23:35:45.631 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124 2023-12-15T23:35:45.631 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WGraXyNS/9e8MR8s2rOW5arMiWc= 2023-12-15T23:35:45.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WGraXyNS/9e8MR8s2rOW5arMiWc=', 'Content-Length': '0'} 2023-12-15T23:35:45.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000502106210fb00153-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2023-12-15T23:35:45.634 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.634 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.634 DEBUG:boto:Method: GET 2023-12-15T23:35:45.634 DEBUG:boto:Path: /kskgfn-51/obj124 2023-12-15T23:35:45.635 DEBUG:boto:Data: 2023-12-15T23:35:45.635 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.635 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.635 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.635 DEBUG:boto:Params: {} 2023-12-15T23:35:45.635 DEBUG:boto:Token: None 2023-12-15T23:35:45.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124 2023-12-15T23:35:45.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DS4YnMzoTUde9kn2ss+HvBS/19Y= 2023-12-15T23:35:45.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DS4YnMzoTUde9kn2ss+HvBS/19Y=', 'Content-Length': '0'} 2023-12-15T23:35:45.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053519046d2696595-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.638 DEBUG:boto:path=/kskgfn-51/obj124 2023-12-15T23:35:45.638 DEBUG:boto:auth_path=/kskgfn-51/obj124 2023-12-15T23:35:45.638 DEBUG:boto:Method: GET 2023-12-15T23:35:45.638 DEBUG:boto:Path: /kskgfn-51/obj124 2023-12-15T23:35:45.638 DEBUG:boto:Data: 2023-12-15T23:35:45.638 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.638 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.638 DEBUG:boto:Params: {} 2023-12-15T23:35:45.639 DEBUG:boto:Token: None 2023-12-15T23:35:45.639 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj124 2023-12-15T23:35:45.639 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DS4YnMzoTUde9kn2ss+HvBS/19Y= 2023-12-15T23:35:45.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DS4YnMzoTUde9kn2ss+HvBS/19Y=', 'Content-Length': '0'} 2023-12-15T23:35:45.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008268308f82f9c949-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.681 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.682 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.682 DEBUG:boto:path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.682 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.682 DEBUG:boto:Method: GET 2023-12-15T23:35:45.682 DEBUG:boto:Path: /kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.682 DEBUG:boto:Data: 2023-12-15T23:35:45.682 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.682 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.682 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.682 DEBUG:boto:Params: {} 2023-12-15T23:35:45.682 DEBUG:boto:Token: None 2023-12-15T23:35:45.683 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.683 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.685 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a52c87be08582d89-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.685 DEBUG:boto:b'kskgfn-51obj1241000falseobj1242023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.686 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.686 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.686 DEBUG:boto:path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.686 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.686 DEBUG:boto:Method: GET 2023-12-15T23:35:45.686 DEBUG:boto:Path: /kskgfn-51/?prefix=obj124 2023-12-15T23:35:45.686 DEBUG:boto:Data: 2023-12-15T23:35:45.686 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.686 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.686 DEBUG:boto:Params: {} 2023-12-15T23:35:45.687 DEBUG:boto:Token: None 2023-12-15T23:35:45.687 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.691 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8078dccefc2a465-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.691 DEBUG:boto:b'kskgfn-51obj1241000falseobj1242023-12-15T23:31:33.025Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:35:45.691 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.692 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.692 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.692 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.692 DEBUG:boto:Method: GET 2023-12-15T23:35:45.692 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.692 DEBUG:boto:Data: 2023-12-15T23:35:45.692 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.692 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.692 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.692 DEBUG:boto:Params: {} 2023-12-15T23:35:45.693 DEBUG:boto:Token: None 2023-12-15T23:35:45.693 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.693 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0= 2023-12-15T23:35:45.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0=', 'Content-Length': '0'} 2023-12-15T23:35:45.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008db64be63f8aff62-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.695 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.695 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.695 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.695 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.695 DEBUG:boto:Method: GET 2023-12-15T23:35:45.695 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.696 DEBUG:boto:Data: 2023-12-15T23:35:45.696 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.696 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.696 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.696 DEBUG:boto:Params: {} 2023-12-15T23:35:45.696 DEBUG:boto:Token: None 2023-12-15T23:35:45.696 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.696 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0= 2023-12-15T23:35:45.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0=', 'Content-Length': '0'} 2023-12-15T23:35:45.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013ba51418b705751-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.698 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.698 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.699 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.699 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.699 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.699 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.699 DEBUG:boto:Data: 2023-12-15T23:35:45.699 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.699 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.699 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.699 DEBUG:boto:Params: {} 2023-12-15T23:35:45.699 DEBUG:boto:Token: None 2023-12-15T23:35:45.700 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.700 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7TvtYIU6aA3M2xIvQIWtwvuI+mA= 2023-12-15T23:35:45.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7TvtYIU6aA3M2xIvQIWtwvuI+mA=', 'Content-Length': '0'} 2023-12-15T23:35:45.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008dbda06101e6278-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.702 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.702 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.702 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.702 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.702 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.702 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.702 DEBUG:boto:Data: 2023-12-15T23:35:45.702 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.702 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.703 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.703 DEBUG:boto:Params: {} 2023-12-15T23:35:45.703 DEBUG:boto:Token: None 2023-12-15T23:35:45.703 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7TvtYIU6aA3M2xIvQIWtwvuI+mA= 2023-12-15T23:35:45.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7TvtYIU6aA3M2xIvQIWtwvuI+mA=', 'Content-Length': '0'} 2023-12-15T23:35:45.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6ffde5574bf61d3-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:35:45.705 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.706 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.706 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.706 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.706 DEBUG:boto:Method: GET 2023-12-15T23:35:45.706 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.706 DEBUG:boto:Data: 2023-12-15T23:35:45.706 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.706 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.706 DEBUG:boto:Params: {} 2023-12-15T23:35:45.706 DEBUG:boto:Token: None 2023-12-15T23:35:45.707 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0= 2023-12-15T23:35:45.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0=', 'Content-Length': '0'} 2023-12-15T23:35:45.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d58aabc5afff64c3-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.749 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.750 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.750 DEBUG:boto:path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.750 DEBUG:boto:auth_path=/kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.750 DEBUG:boto:Method: GET 2023-12-15T23:35:45.750 DEBUG:boto:Path: /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.750 DEBUG:boto:Data: 2023-12-15T23:35:45.750 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.750 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.750 DEBUG:boto:Params: {} 2023-12-15T23:35:45.751 DEBUG:boto:Token: None 2023-12-15T23:35:45.751 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145?versionId=null 2023-12-15T23:35:45.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0= 2023-12-15T23:35:45.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IyGLsaLPNh0x6+rWbqD77MJLTu0=', 'Content-Length': '0'} 2023-12-15T23:35:45.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000923b77e4b38cf716-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.753 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.753 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.753 DEBUG:boto:path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.754 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.754 DEBUG:boto:Method: GET 2023-12-15T23:35:45.754 DEBUG:boto:Path: /kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.754 DEBUG:boto:Data: 2023-12-15T23:35:45.754 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.754 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.754 DEBUG:boto:Params: {} 2023-12-15T23:35:45.754 DEBUG:boto:Token: None 2023-12-15T23:35:45.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000232de74b28a0e40f-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.757 DEBUG:boto:b'kskgfn-51obj1451000falseobj1452023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.757 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.757 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.757 DEBUG:boto:path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.757 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.757 DEBUG:boto:Method: GET 2023-12-15T23:35:45.758 DEBUG:boto:Path: /kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.758 DEBUG:boto:Data: 2023-12-15T23:35:45.758 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.758 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.758 DEBUG:boto:Params: {} 2023-12-15T23:35:45.758 DEBUG:boto:Token: None 2023-12-15T23:35:45.758 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.758 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001dd14535b4e903d8-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.762 DEBUG:boto:b'kskgfn-51obj1451000falseobj1452023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.762 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.762 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.762 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.762 DEBUG:boto:Path: /kskgfn-51/obj145 2023-12-15T23:35:45.763 DEBUG:boto:Data: 2023-12-15T23:35:45.763 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.763 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.763 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.763 DEBUG:boto:Params: {} 2023-12-15T23:35:45.763 DEBUG:boto:Token: None 2023-12-15T23:35:45.763 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145 2023-12-15T23:35:45.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NvLnONAYxUZKAtj5yiuJyp9NVUU= 2023-12-15T23:35:45.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NvLnONAYxUZKAtj5yiuJyp9NVUU=', 'Content-Length': '0'} 2023-12-15T23:35:45.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d25dfe05682ba65c-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.766 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.766 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.766 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.766 DEBUG:boto:Path: /kskgfn-51/obj145 2023-12-15T23:35:45.766 DEBUG:boto:Data: 2023-12-15T23:35:45.766 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.766 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.766 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.766 DEBUG:boto:Params: {} 2023-12-15T23:35:45.766 DEBUG:boto:Token: None 2023-12-15T23:35:45.767 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145 2023-12-15T23:35:45.767 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NvLnONAYxUZKAtj5yiuJyp9NVUU= 2023-12-15T23:35:45.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NvLnONAYxUZKAtj5yiuJyp9NVUU=', 'Content-Length': '0'} 2023-12-15T23:35:45.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000047be28bb0bd2512-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2023-12-15T23:35:45.769 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.769 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.769 DEBUG:boto:Method: GET 2023-12-15T23:35:45.769 DEBUG:boto:Path: /kskgfn-51/obj145 2023-12-15T23:35:45.769 DEBUG:boto:Data: 2023-12-15T23:35:45.769 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.769 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.770 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.770 DEBUG:boto:Params: {} 2023-12-15T23:35:45.770 DEBUG:boto:Token: None 2023-12-15T23:35:45.770 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145 2023-12-15T23:35:45.770 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eJXMMOlVCs/ZvR6zzi/FQpbdwjY= 2023-12-15T23:35:45.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eJXMMOlVCs/ZvR6zzi/FQpbdwjY=', 'Content-Length': '0'} 2023-12-15T23:35:45.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684914158a6881ed-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.772 DEBUG:boto:path=/kskgfn-51/obj145 2023-12-15T23:35:45.772 DEBUG:boto:auth_path=/kskgfn-51/obj145 2023-12-15T23:35:45.772 DEBUG:boto:Method: GET 2023-12-15T23:35:45.772 DEBUG:boto:Path: /kskgfn-51/obj145 2023-12-15T23:35:45.772 DEBUG:boto:Data: 2023-12-15T23:35:45.773 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.773 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.773 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.773 DEBUG:boto:Params: {} 2023-12-15T23:35:45.773 DEBUG:boto:Token: None 2023-12-15T23:35:45.773 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj145 2023-12-15T23:35:45.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eJXMMOlVCs/ZvR6zzi/FQpbdwjY= 2023-12-15T23:35:45.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eJXMMOlVCs/ZvR6zzi/FQpbdwjY=', 'Content-Length': '0'} 2023-12-15T23:35:45.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e14784d437a89a7e-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.776 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.776 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.776 DEBUG:boto:path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.776 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.776 DEBUG:boto:Method: GET 2023-12-15T23:35:45.776 DEBUG:boto:Path: /kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.776 DEBUG:boto:Data: 2023-12-15T23:35:45.776 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.776 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.776 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.776 DEBUG:boto:Params: {} 2023-12-15T23:35:45.777 DEBUG:boto:Token: None 2023-12-15T23:35:45.777 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.777 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.779 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edf91c03c35ba9be-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.779 DEBUG:boto:b'kskgfn-51obj1451000falseobj1452023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.780 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.780 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.780 DEBUG:boto:path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.780 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.780 DEBUG:boto:Method: GET 2023-12-15T23:35:45.780 DEBUG:boto:Path: /kskgfn-51/?prefix=obj145 2023-12-15T23:35:45.780 DEBUG:boto:Data: 2023-12-15T23:35:45.780 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.780 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.780 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.781 DEBUG:boto:Params: {} 2023-12-15T23:35:45.781 DEBUG:boto:Token: None 2023-12-15T23:35:45.781 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.784 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007879bc9e1eb76523-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.784 DEBUG:boto:b'kskgfn-51obj1451000falseobj1452023-12-15T23:31:32.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:35:45.785 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.785 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.785 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.785 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.785 DEBUG:boto:Method: GET 2023-12-15T23:35:45.785 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.785 DEBUG:boto:Data: 2023-12-15T23:35:45.785 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.785 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.786 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.786 DEBUG:boto:Params: {} 2023-12-15T23:35:45.786 DEBUG:boto:Token: None 2023-12-15T23:35:45.786 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.786 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE= 2023-12-15T23:35:45.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE=', 'Content-Length': '0'} 2023-12-15T23:35:45.788 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006191b816c5546653-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.788 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.788 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.789 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.789 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.789 DEBUG:boto:Method: GET 2023-12-15T23:35:45.789 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.789 DEBUG:boto:Data: 2023-12-15T23:35:45.789 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.789 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.789 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.789 DEBUG:boto:Params: {} 2023-12-15T23:35:45.789 DEBUG:boto:Token: None 2023-12-15T23:35:45.790 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.790 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE= 2023-12-15T23:35:45.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE=', 'Content-Length': '0'} 2023-12-15T23:35:45.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e48df08bb322a765-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.792 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.792 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.792 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.792 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.793 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.793 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.793 DEBUG:boto:Data: 2023-12-15T23:35:45.793 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.793 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.793 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.793 DEBUG:boto:Params: {} 2023-12-15T23:35:45.793 DEBUG:boto:Token: None 2023-12-15T23:35:45.794 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.794 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:plLeJQYqs+H1D8rgTY680Snak90= 2023-12-15T23:35:45.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:plLeJQYqs+H1D8rgTY680Snak90=', 'Content-Length': '0'} 2023-12-15T23:35:45.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005258a1d5287021a1-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.796 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.796 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.796 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.796 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.796 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.796 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.796 DEBUG:boto:Data: 2023-12-15T23:35:45.796 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.797 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.797 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.797 DEBUG:boto:Params: {} 2023-12-15T23:35:45.797 DEBUG:boto:Token: None 2023-12-15T23:35:45.797 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.797 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:plLeJQYqs+H1D8rgTY680Snak90= 2023-12-15T23:35:45.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:plLeJQYqs+H1D8rgTY680Snak90=', 'Content-Length': '0'} 2023-12-15T23:35:45.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c69ecaf0abdaf08-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:35:45.799 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.799 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.799 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.800 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.800 DEBUG:boto:Method: GET 2023-12-15T23:35:45.800 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.800 DEBUG:boto:Data: 2023-12-15T23:35:45.800 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.800 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.800 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.800 DEBUG:boto:Params: {} 2023-12-15T23:35:45.800 DEBUG:boto:Token: None 2023-12-15T23:35:45.800 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.801 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE= 2023-12-15T23:35:45.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE=', 'Content-Length': '0'} 2023-12-15T23:35:45.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083b8c1209e3dc78c-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.803 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.803 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.803 DEBUG:boto:path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.803 DEBUG:boto:auth_path=/kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.803 DEBUG:boto:Method: GET 2023-12-15T23:35:45.803 DEBUG:boto:Path: /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.803 DEBUG:boto:Data: 2023-12-15T23:35:45.804 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.804 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.804 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.804 DEBUG:boto:Params: {} 2023-12-15T23:35:45.804 DEBUG:boto:Token: None 2023-12-15T23:35:45.804 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148?versionId=null 2023-12-15T23:35:45.804 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE= 2023-12-15T23:35:45.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3JpkU6VqY9nQ7bIIK5dp4yYxLE=', 'Content-Length': '0'} 2023-12-15T23:35:45.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056a6f1ddfa07e3a6-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.806 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.806 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.807 DEBUG:boto:path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.807 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.807 DEBUG:boto:Method: GET 2023-12-15T23:35:45.807 DEBUG:boto:Path: /kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.807 DEBUG:boto:Data: 2023-12-15T23:35:45.807 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.807 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.807 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.807 DEBUG:boto:Params: {} 2023-12-15T23:35:45.807 DEBUG:boto:Token: None 2023-12-15T23:35:45.808 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.808 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d701012ea9e8d19d-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.810 DEBUG:boto:b'kskgfn-51obj1481000falseobj1482023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.811 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.811 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.811 DEBUG:boto:path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.811 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.811 DEBUG:boto:Method: GET 2023-12-15T23:35:45.811 DEBUG:boto:Path: /kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.811 DEBUG:boto:Data: 2023-12-15T23:35:45.811 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.811 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.812 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.812 DEBUG:boto:Params: {} 2023-12-15T23:35:45.812 DEBUG:boto:Token: None 2023-12-15T23:35:45.812 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.812 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b27664c72bcdbac4-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.816 DEBUG:boto:b'kskgfn-51obj1481000falseobj1482023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.816 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.816 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.816 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.816 DEBUG:boto:Path: /kskgfn-51/obj148 2023-12-15T23:35:45.816 DEBUG:boto:Data: 2023-12-15T23:35:45.816 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.816 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.817 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.817 DEBUG:boto:Params: {} 2023-12-15T23:35:45.817 DEBUG:boto:Token: None 2023-12-15T23:35:45.817 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148 2023-12-15T23:35:45.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atRCKwJcO8lHzDxKUAbdDaon6H4= 2023-12-15T23:35:45.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atRCKwJcO8lHzDxKUAbdDaon6H4=', 'Content-Length': '0'} 2023-12-15T23:35:45.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5a174f09f86ad1b-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.819 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.819 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.819 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.819 DEBUG:boto:Path: /kskgfn-51/obj148 2023-12-15T23:35:45.819 DEBUG:boto:Data: 2023-12-15T23:35:45.819 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.820 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.820 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.820 DEBUG:boto:Params: {} 2023-12-15T23:35:45.820 DEBUG:boto:Token: None 2023-12-15T23:35:45.820 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148 2023-12-15T23:35:45.820 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:atRCKwJcO8lHzDxKUAbdDaon6H4= 2023-12-15T23:35:45.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:atRCKwJcO8lHzDxKUAbdDaon6H4=', 'Content-Length': '0'} 2023-12-15T23:35:45.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f937b34e0ade9050-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2023-12-15T23:35:45.822 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.822 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.822 DEBUG:boto:Method: GET 2023-12-15T23:35:45.823 DEBUG:boto:Path: /kskgfn-51/obj148 2023-12-15T23:35:45.823 DEBUG:boto:Data: 2023-12-15T23:35:45.823 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.823 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.823 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.823 DEBUG:boto:Params: {} 2023-12-15T23:35:45.823 DEBUG:boto:Token: None 2023-12-15T23:35:45.823 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148 2023-12-15T23:35:45.823 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HhZnIp6QOgVjCe/FlKrlBLqlGKc= 2023-12-15T23:35:45.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HhZnIp6QOgVjCe/FlKrlBLqlGKc=', 'Content-Length': '0'} 2023-12-15T23:35:45.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003375bb109ec23c59-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.870 DEBUG:boto:path=/kskgfn-51/obj148 2023-12-15T23:35:45.870 DEBUG:boto:auth_path=/kskgfn-51/obj148 2023-12-15T23:35:45.870 DEBUG:boto:Method: GET 2023-12-15T23:35:45.870 DEBUG:boto:Path: /kskgfn-51/obj148 2023-12-15T23:35:45.870 DEBUG:boto:Data: 2023-12-15T23:35:45.870 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.870 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.870 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.870 DEBUG:boto:Params: {} 2023-12-15T23:35:45.870 DEBUG:boto:Token: None 2023-12-15T23:35:45.871 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj148 2023-12-15T23:35:45.871 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HhZnIp6QOgVjCe/FlKrlBLqlGKc= 2023-12-15T23:35:45.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HhZnIp6QOgVjCe/FlKrlBLqlGKc=', 'Content-Length': '0'} 2023-12-15T23:35:45.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aaa94c01f6d7bad2-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.873 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.873 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.873 DEBUG:boto:path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.873 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.874 DEBUG:boto:Method: GET 2023-12-15T23:35:45.874 DEBUG:boto:Path: /kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.874 DEBUG:boto:Data: 2023-12-15T23:35:45.874 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.874 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.874 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.874 DEBUG:boto:Params: {} 2023-12-15T23:35:45.874 DEBUG:boto:Token: None 2023-12-15T23:35:45.874 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.874 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.877 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acac78d42bb22796-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.877 DEBUG:boto:b'kskgfn-51obj1481000falseobj1482023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.877 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.877 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.877 DEBUG:boto:path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.878 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.878 DEBUG:boto:Method: GET 2023-12-15T23:35:45.878 DEBUG:boto:Path: /kskgfn-51/?prefix=obj148 2023-12-15T23:35:45.878 DEBUG:boto:Data: 2023-12-15T23:35:45.878 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.878 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.878 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.878 DEBUG:boto:Params: {} 2023-12-15T23:35:45.878 DEBUG:boto:Token: None 2023-12-15T23:35:45.878 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.878 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9f37dd1d9c7a0a1-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.882 DEBUG:boto:b'kskgfn-51obj1481000falseobj1482023-12-15T23:31:33.332Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.882 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:35:45.882 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.882 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.883 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.883 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.883 DEBUG:boto:Method: GET 2023-12-15T23:35:45.883 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.883 DEBUG:boto:Data: 2023-12-15T23:35:45.883 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.883 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.883 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.883 DEBUG:boto:Params: {} 2023-12-15T23:35:45.883 DEBUG:boto:Token: None 2023-12-15T23:35:45.884 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.884 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk= 2023-12-15T23:35:45.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b28718a1bcaac924-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.886 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.886 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.886 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.886 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.886 DEBUG:boto:Method: GET 2023-12-15T23:35:45.887 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.887 DEBUG:boto:Data: 2023-12-15T23:35:45.887 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.887 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.887 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.887 DEBUG:boto:Params: {} 2023-12-15T23:35:45.887 DEBUG:boto:Token: None 2023-12-15T23:35:45.887 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.887 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk= 2023-12-15T23:35:45.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003213a5868762a4b-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.890 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.890 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.890 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.890 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.890 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.890 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.890 DEBUG:boto:Data: 2023-12-15T23:35:45.890 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.890 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.890 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.890 DEBUG:boto:Params: {} 2023-12-15T23:35:45.891 DEBUG:boto:Token: None 2023-12-15T23:35:45.891 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.891 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FUSEbN0vvWs/PyBdun8KzJyfftA= 2023-12-15T23:35:45.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FUSEbN0vvWs/PyBdun8KzJyfftA=', 'Content-Length': '0'} 2023-12-15T23:35:45.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000994b15c03bd833ed-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.894 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.894 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.894 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.894 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.894 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.894 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.894 DEBUG:boto:Data: 2023-12-15T23:35:45.894 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.894 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.894 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.894 DEBUG:boto:Params: {} 2023-12-15T23:35:45.895 DEBUG:boto:Token: None 2023-12-15T23:35:45.895 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.895 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FUSEbN0vvWs/PyBdun8KzJyfftA= 2023-12-15T23:35:45.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FUSEbN0vvWs/PyBdun8KzJyfftA=', 'Content-Length': '0'} 2023-12-15T23:35:45.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e56c2d1eac689f1-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:35:45.897 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.898 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.898 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.898 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.898 DEBUG:boto:Method: GET 2023-12-15T23:35:45.898 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.898 DEBUG:boto:Data: 2023-12-15T23:35:45.898 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.898 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.898 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.898 DEBUG:boto:Params: {} 2023-12-15T23:35:45.898 DEBUG:boto:Token: None 2023-12-15T23:35:45.899 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.899 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk= 2023-12-15T23:35:45.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8ec46c9dc889f43-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.901 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.901 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.901 DEBUG:boto:path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.901 DEBUG:boto:auth_path=/kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.901 DEBUG:boto:Method: GET 2023-12-15T23:35:45.901 DEBUG:boto:Path: /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.901 DEBUG:boto:Data: 2023-12-15T23:35:45.902 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.902 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.902 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.902 DEBUG:boto:Params: {} 2023-12-15T23:35:45.902 DEBUG:boto:Token: None 2023-12-15T23:35:45.902 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155?versionId=null 2023-12-15T23:35:45.902 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk= 2023-12-15T23:35:45.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZqKZVRP8dmPep+Jfnb95TljD7Tk=', 'Content-Length': '0'} 2023-12-15T23:35:45.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a46651a5e16883b-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.905 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.905 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.905 DEBUG:boto:path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.905 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.905 DEBUG:boto:Method: GET 2023-12-15T23:35:45.905 DEBUG:boto:Path: /kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.905 DEBUG:boto:Data: 2023-12-15T23:35:45.905 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.905 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.905 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.906 DEBUG:boto:Params: {} 2023-12-15T23:35:45.906 DEBUG:boto:Token: None 2023-12-15T23:35:45.906 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.908 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000869202b71d9ac379-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.909 DEBUG:boto:b'kskgfn-51obj1551000falseobj1552023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.909 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.909 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.909 DEBUG:boto:path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.909 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.909 DEBUG:boto:Method: GET 2023-12-15T23:35:45.909 DEBUG:boto:Path: /kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.910 DEBUG:boto:Data: 2023-12-15T23:35:45.910 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.910 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.910 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.910 DEBUG:boto:Params: {} 2023-12-15T23:35:45.910 DEBUG:boto:Token: None 2023-12-15T23:35:45.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c3143aa5bdf33f2-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.914 DEBUG:boto:b'kskgfn-51obj1551000falseobj1552023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.914 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.914 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.914 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.915 DEBUG:boto:Path: /kskgfn-51/obj155 2023-12-15T23:35:45.915 DEBUG:boto:Data: 2023-12-15T23:35:45.915 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.915 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.915 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.915 DEBUG:boto:Params: {} 2023-12-15T23:35:45.915 DEBUG:boto:Token: None 2023-12-15T23:35:45.915 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155 2023-12-15T23:35:45.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I16okwcdCYpUMbhKjP1/J+vATII= 2023-12-15T23:35:45.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I16okwcdCYpUMbhKjP1/J+vATII=', 'Content-Length': '0'} 2023-12-15T23:35:45.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4b5b51d7837ddb3-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.918 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.918 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.918 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.918 DEBUG:boto:Path: /kskgfn-51/obj155 2023-12-15T23:35:45.918 DEBUG:boto:Data: 2023-12-15T23:35:45.919 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.919 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.919 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.919 DEBUG:boto:Params: {} 2023-12-15T23:35:45.919 DEBUG:boto:Token: None 2023-12-15T23:35:45.919 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155 2023-12-15T23:35:45.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:I16okwcdCYpUMbhKjP1/J+vATII= 2023-12-15T23:35:45.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:I16okwcdCYpUMbhKjP1/J+vATII=', 'Content-Length': '0'} 2023-12-15T23:35:45.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001709dda535461b9f-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2023-12-15T23:35:45.922 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.922 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.922 DEBUG:boto:Method: GET 2023-12-15T23:35:45.922 DEBUG:boto:Path: /kskgfn-51/obj155 2023-12-15T23:35:45.922 DEBUG:boto:Data: 2023-12-15T23:35:45.922 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.922 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.922 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.922 DEBUG:boto:Params: {} 2023-12-15T23:35:45.922 DEBUG:boto:Token: None 2023-12-15T23:35:45.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155 2023-12-15T23:35:45.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0QBreOpMS0JR6WHmUX7F6Dh4Bp4= 2023-12-15T23:35:45.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0QBreOpMS0JR6WHmUX7F6Dh4Bp4=', 'Content-Length': '0'} 2023-12-15T23:35:45.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a0006a5076ac433-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.969 DEBUG:boto:path=/kskgfn-51/obj155 2023-12-15T23:35:45.970 DEBUG:boto:auth_path=/kskgfn-51/obj155 2023-12-15T23:35:45.970 DEBUG:boto:Method: GET 2023-12-15T23:35:45.970 DEBUG:boto:Path: /kskgfn-51/obj155 2023-12-15T23:35:45.970 DEBUG:boto:Data: 2023-12-15T23:35:45.970 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.970 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.970 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.970 DEBUG:boto:Params: {} 2023-12-15T23:35:45.970 DEBUG:boto:Token: None 2023-12-15T23:35:45.970 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj155 2023-12-15T23:35:45.970 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0QBreOpMS0JR6WHmUX7F6Dh4Bp4= 2023-12-15T23:35:45.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0QBreOpMS0JR6WHmUX7F6Dh4Bp4=', 'Content-Length': '0'} 2023-12-15T23:35:45.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000335761590e1366af-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.973 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.973 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.973 DEBUG:boto:path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.974 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.974 DEBUG:boto:Method: GET 2023-12-15T23:35:45.974 DEBUG:boto:Path: /kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.974 DEBUG:boto:Data: 2023-12-15T23:35:45.974 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.974 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.974 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.974 DEBUG:boto:Params: {} 2023-12-15T23:35:45.974 DEBUG:boto:Token: None 2023-12-15T23:35:45.974 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b17eb735267f064-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.977 DEBUG:boto:b'kskgfn-51obj1551000falseobj1552023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.978 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:45.978 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:45.978 DEBUG:boto:path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.978 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.978 DEBUG:boto:Method: GET 2023-12-15T23:35:45.978 DEBUG:boto:Path: /kskgfn-51/?prefix=obj155 2023-12-15T23:35:45.978 DEBUG:boto:Data: 2023-12-15T23:35:45.978 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.979 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.979 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.979 DEBUG:boto:Params: {} 2023-12-15T23:35:45.979 DEBUG:boto:Token: None 2023-12-15T23:35:45.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/ 2023-12-15T23:35:45.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog= 2023-12-15T23:35:45.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lOg7DPq75uwdnqYVgWcNOK5llog=', 'Content-Length': '0'} 2023-12-15T23:35:45.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c81454123cf4acb-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.983 DEBUG:boto:b'kskgfn-51obj1551000falseobj1552023-12-15T23:31:33.071Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:45.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:35:45.983 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:45.983 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:45.983 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.983 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.983 DEBUG:boto:Method: GET 2023-12-15T23:35:45.983 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.984 DEBUG:boto:Data: 2023-12-15T23:35:45.984 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.984 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.984 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.984 DEBUG:boto:Params: {} 2023-12-15T23:35:45.984 DEBUG:boto:Token: None 2023-12-15T23:35:45.984 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.984 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ= 2023-12-15T23:35:45.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b04c7917181487ac-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.986 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:45.986 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:45.987 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.987 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.987 DEBUG:boto:Method: GET 2023-12-15T23:35:45.987 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.987 DEBUG:boto:Data: 2023-12-15T23:35:45.987 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.987 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.987 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.987 DEBUG:boto:Params: {} 2023-12-15T23:35:45.987 DEBUG:boto:Token: None 2023-12-15T23:35:45.988 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.988 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ= 2023-12-15T23:35:45.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ=', 'Content-Length': '0'} 2023-12-15T23:35:45.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3b57d6351a3f561-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.990 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:45.990 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:45.990 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.990 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.990 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.990 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.990 DEBUG:boto:Data: 2023-12-15T23:35:45.991 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.991 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.991 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.991 DEBUG:boto:Params: {} 2023-12-15T23:35:45.991 DEBUG:boto:Token: None 2023-12-15T23:35:45.991 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.991 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AYCvOzuS3EMbVz24e0jZJrYsjfw= 2023-12-15T23:35:45.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AYCvOzuS3EMbVz24e0jZJrYsjfw=', 'Content-Length': '0'} 2023-12-15T23:35:45.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f607d8cf225e0c7-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.993 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:45.993 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:45.994 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.994 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.994 DEBUG:boto:Method: HEAD 2023-12-15T23:35:45.994 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.994 DEBUG:boto:Data: 2023-12-15T23:35:45.994 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.994 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:45.994 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.994 DEBUG:boto:Params: {} 2023-12-15T23:35:45.994 DEBUG:boto:Token: None 2023-12-15T23:35:45.994 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.995 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:AYCvOzuS3EMbVz24e0jZJrYsjfw= 2023-12-15T23:35:45.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:AYCvOzuS3EMbVz24e0jZJrYsjfw=', 'Content-Length': '0'} 2023-12-15T23:35:45.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0ffcad3aebe3217-00657ce2d1-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:45.997 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:35:45.997 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:45.997 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:45.997 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.997 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.997 DEBUG:boto:Method: GET 2023-12-15T23:35:45.997 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.997 DEBUG:boto:Data: 2023-12-15T23:35:45.997 DEBUG:boto:Headers: {} 2023-12-15T23:35:45.998 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:45.998 DEBUG:boto:Port: 8000 2023-12-15T23:35:45.998 DEBUG:boto:Params: {} 2023-12-15T23:35:45.998 DEBUG:boto:Token: None 2023-12-15T23:35:45.998 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:45 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:45.998 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ= 2023-12-15T23:35:45.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:45 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6NG2zPSGHTbBYSv3hrYkcAJICAQ=', 'Content-Length': '0'} 2023-12-15T23:35:46.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca49ad14ace0e568-00657ce2d1-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:45 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.000 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:46.000 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:46.000 DEBUG:boto:path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:46.000 DEBUG:boto:auth_path=/kskgfn-51/obj17?versionId=null 2023-12-15T23:35:46.000 DEBUG:boto:Method: GET 2023-12-15T23:35:46.000 DEBUG:boto:Path: /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:46.001 DEBUG:boto:Data: 2023-12-15T23:35:46.001 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.001 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.001 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.001 DEBUG:boto:Params: {} 2023-12-15T23:35:46.001 DEBUG:boto:Token: None 2023-12-15T23:35:46.001 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj17?versionId=null 2023-12-15T23:35:46.001 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Hf0KQll6UONWFAxJTM+uGqrAZiQ= 2023-12-15T23:35:46.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Hf0KQll6UONWFAxJTM+uGqrAZiQ=', 'Content-Length': '0'} 2023-12-15T23:35:46.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2dad31c6d4c0482-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.004 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.004 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.004 DEBUG:boto:path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.004 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.004 DEBUG:boto:Method: GET 2023-12-15T23:35:46.004 DEBUG:boto:Path: /kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.004 DEBUG:boto:Data: 2023-12-15T23:35:46.004 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.005 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.005 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.005 DEBUG:boto:Params: {} 2023-12-15T23:35:46.005 DEBUG:boto:Token: None 2023-12-15T23:35:46.005 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.005 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.008 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053d6c1782115b147-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.008 DEBUG:boto:b'kskgfn-51obj171000falseobj172023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.008 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.008 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.008 DEBUG:boto:path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.009 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.009 DEBUG:boto:Method: GET 2023-12-15T23:35:46.009 DEBUG:boto:Path: /kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.009 DEBUG:boto:Data: 2023-12-15T23:35:46.009 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.009 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.009 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.009 DEBUG:boto:Params: {} 2023-12-15T23:35:46.009 DEBUG:boto:Token: None 2023-12-15T23:35:46.009 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.010 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.013 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047111426c840d61e-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.013 DEBUG:boto:b'kskgfn-51obj171000falseobj172023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.013 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:46.013 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:46.013 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.014 DEBUG:boto:Path: /kskgfn-51/obj17 2023-12-15T23:35:46.014 DEBUG:boto:Data: 2023-12-15T23:35:46.014 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.014 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.014 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.014 DEBUG:boto:Params: {} 2023-12-15T23:35:46.014 DEBUG:boto:Token: None 2023-12-15T23:35:46.014 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj17 2023-12-15T23:35:46.014 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XsWViB1EEmBrLdEo+IgYFPU1sMo= 2023-12-15T23:35:46.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XsWViB1EEmBrLdEo+IgYFPU1sMo=', 'Content-Length': '0'} 2023-12-15T23:35:46.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c162ffef8f9bb2b-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.016 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:46.016 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:46.017 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.017 DEBUG:boto:Path: /kskgfn-51/obj17 2023-12-15T23:35:46.017 DEBUG:boto:Data: 2023-12-15T23:35:46.017 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.017 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.017 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.017 DEBUG:boto:Params: {} 2023-12-15T23:35:46.017 DEBUG:boto:Token: None 2023-12-15T23:35:46.017 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj17 2023-12-15T23:35:46.017 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:XsWViB1EEmBrLdEo+IgYFPU1sMo= 2023-12-15T23:35:46.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:XsWViB1EEmBrLdEo+IgYFPU1sMo=', 'Content-Length': '0'} 2023-12-15T23:35:46.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4bc9210bd43b27e-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2023-12-15T23:35:46.019 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:46.019 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:46.020 DEBUG:boto:Method: GET 2023-12-15T23:35:46.020 DEBUG:boto:Path: /kskgfn-51/obj17 2023-12-15T23:35:46.020 DEBUG:boto:Data: 2023-12-15T23:35:46.020 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.020 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.020 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.020 DEBUG:boto:Params: {} 2023-12-15T23:35:46.020 DEBUG:boto:Token: None 2023-12-15T23:35:46.020 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj17 2023-12-15T23:35:46.020 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:88SmjIw5FLShwL3kdAzS7u8OSO0= 2023-12-15T23:35:46.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:88SmjIw5FLShwL3kdAzS7u8OSO0=', 'Content-Length': '0'} 2023-12-15T23:35:46.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aebc2b51cc923c20-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.023 DEBUG:boto:path=/kskgfn-51/obj17 2023-12-15T23:35:46.023 DEBUG:boto:auth_path=/kskgfn-51/obj17 2023-12-15T23:35:46.023 DEBUG:boto:Method: GET 2023-12-15T23:35:46.023 DEBUG:boto:Path: /kskgfn-51/obj17 2023-12-15T23:35:46.023 DEBUG:boto:Data: 2023-12-15T23:35:46.023 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.023 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.023 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.023 DEBUG:boto:Params: {} 2023-12-15T23:35:46.023 DEBUG:boto:Token: None 2023-12-15T23:35:46.024 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj17 2023-12-15T23:35:46.024 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:88SmjIw5FLShwL3kdAzS7u8OSO0= 2023-12-15T23:35:46.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:88SmjIw5FLShwL3kdAzS7u8OSO0=', 'Content-Length': '0'} 2023-12-15T23:35:46.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008967aaa044498abb-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.026 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.026 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.026 DEBUG:boto:path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.026 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.026 DEBUG:boto:Method: GET 2023-12-15T23:35:46.026 DEBUG:boto:Path: /kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.026 DEBUG:boto:Data: 2023-12-15T23:35:46.026 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.026 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.026 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.027 DEBUG:boto:Params: {} 2023-12-15T23:35:46.027 DEBUG:boto:Token: None 2023-12-15T23:35:46.027 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.027 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cea944b2db18d936-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.069 DEBUG:boto:b'kskgfn-51obj171000falseobj172023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.070 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.070 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.070 DEBUG:boto:path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.070 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.070 DEBUG:boto:Method: GET 2023-12-15T23:35:46.070 DEBUG:boto:Path: /kskgfn-51/?prefix=obj17 2023-12-15T23:35:46.070 DEBUG:boto:Data: 2023-12-15T23:35:46.070 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.071 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.071 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.071 DEBUG:boto:Params: {} 2023-12-15T23:35:46.071 DEBUG:boto:Token: None 2023-12-15T23:35:46.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ede3d85e5b98acf7-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.075 DEBUG:boto:b'kskgfn-51obj171000falseobj172023-12-15T23:31:31.782Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:35:46.075 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.075 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.075 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.076 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.076 DEBUG:boto:Method: GET 2023-12-15T23:35:46.076 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.076 DEBUG:boto:Data: 2023-12-15T23:35:46.076 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.076 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.076 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.076 DEBUG:boto:Params: {} 2023-12-15T23:35:46.076 DEBUG:boto:Token: None 2023-12-15T23:35:46.076 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.076 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk= 2023-12-15T23:35:46.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk=', 'Content-Length': '0'} 2023-12-15T23:35:46.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000195cde02da741188-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.079 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.079 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.079 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.079 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.079 DEBUG:boto:Method: GET 2023-12-15T23:35:46.079 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.079 DEBUG:boto:Data: 2023-12-15T23:35:46.079 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.079 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.080 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.080 DEBUG:boto:Params: {} 2023-12-15T23:35:46.080 DEBUG:boto:Token: None 2023-12-15T23:35:46.080 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.080 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk= 2023-12-15T23:35:46.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk=', 'Content-Length': '0'} 2023-12-15T23:35:46.082 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032bddc5852a3b26d-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.126 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.126 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.126 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.126 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.126 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.126 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.126 DEBUG:boto:Data: 2023-12-15T23:35:46.126 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.126 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.127 DEBUG:boto:Params: {} 2023-12-15T23:35:46.127 DEBUG:boto:Token: None 2023-12-15T23:35:46.127 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YMmORPbyORsdCFKi0J8sDISDzsk= 2023-12-15T23:35:46.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YMmORPbyORsdCFKi0J8sDISDzsk=', 'Content-Length': '0'} 2023-12-15T23:35:46.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001256e327c35b7606-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.129 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.129 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.129 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.130 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.130 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.130 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.130 DEBUG:boto:Data: 2023-12-15T23:35:46.130 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.130 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.130 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.130 DEBUG:boto:Params: {} 2023-12-15T23:35:46.130 DEBUG:boto:Token: None 2023-12-15T23:35:46.130 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.131 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YMmORPbyORsdCFKi0J8sDISDzsk= 2023-12-15T23:35:46.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YMmORPbyORsdCFKi0J8sDISDzsk=', 'Content-Length': '0'} 2023-12-15T23:35:46.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000792c895d512c5210-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:35:46.133 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.133 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.133 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.133 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.133 DEBUG:boto:Method: GET 2023-12-15T23:35:46.133 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.133 DEBUG:boto:Data: 2023-12-15T23:35:46.134 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.134 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.134 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.134 DEBUG:boto:Params: {} 2023-12-15T23:35:46.134 DEBUG:boto:Token: None 2023-12-15T23:35:46.134 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk= 2023-12-15T23:35:46.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk=', 'Content-Length': '0'} 2023-12-15T23:35:46.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a19da0c7e0d94321-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.136 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.136 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.136 DEBUG:boto:path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.137 DEBUG:boto:auth_path=/kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.137 DEBUG:boto:Method: GET 2023-12-15T23:35:46.137 DEBUG:boto:Path: /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.137 DEBUG:boto:Data: 2023-12-15T23:35:46.137 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.137 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.137 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.137 DEBUG:boto:Params: {} 2023-12-15T23:35:46.137 DEBUG:boto:Token: None 2023-12-15T23:35:46.138 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185?versionId=null 2023-12-15T23:35:46.138 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk= 2023-12-15T23:35:46.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N8zp3J948xvVu7kWvmYp1XSvdyk=', 'Content-Length': '0'} 2023-12-15T23:35:46.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1992e90d91ebe56-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.140 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.140 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.140 DEBUG:boto:path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.140 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.140 DEBUG:boto:Method: GET 2023-12-15T23:35:46.140 DEBUG:boto:Path: /kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.140 DEBUG:boto:Data: 2023-12-15T23:35:46.140 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.140 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.141 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.141 DEBUG:boto:Params: {} 2023-12-15T23:35:46.141 DEBUG:boto:Token: None 2023-12-15T23:35:46.141 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.141 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.143 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089d159ed778ae00f-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.144 DEBUG:boto:b'kskgfn-51obj1851000falseobj1852023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.144 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.144 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.144 DEBUG:boto:path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.144 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.144 DEBUG:boto:Method: GET 2023-12-15T23:35:46.144 DEBUG:boto:Path: /kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.144 DEBUG:boto:Data: 2023-12-15T23:35:46.144 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.145 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.145 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.145 DEBUG:boto:Params: {} 2023-12-15T23:35:46.145 DEBUG:boto:Token: None 2023-12-15T23:35:46.145 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.145 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.148 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af41c2e24fbefdee-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.149 DEBUG:boto:b'kskgfn-51obj1851000falseobj1852023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.149 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.149 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.149 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.149 DEBUG:boto:Path: /kskgfn-51/obj185 2023-12-15T23:35:46.149 DEBUG:boto:Data: 2023-12-15T23:35:46.149 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.149 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.150 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.150 DEBUG:boto:Params: {} 2023-12-15T23:35:46.150 DEBUG:boto:Token: None 2023-12-15T23:35:46.150 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185 2023-12-15T23:35:46.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vQ4Hnhtz2PQTD1NS0afXF4klLLs= 2023-12-15T23:35:46.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vQ4Hnhtz2PQTD1NS0afXF4klLLs=', 'Content-Length': '0'} 2023-12-15T23:35:46.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfd9bd9220f639f3-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.152 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.152 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.152 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.152 DEBUG:boto:Path: /kskgfn-51/obj185 2023-12-15T23:35:46.153 DEBUG:boto:Data: 2023-12-15T23:35:46.153 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.153 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.153 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.153 DEBUG:boto:Params: {} 2023-12-15T23:35:46.153 DEBUG:boto:Token: None 2023-12-15T23:35:46.153 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185 2023-12-15T23:35:46.153 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vQ4Hnhtz2PQTD1NS0afXF4klLLs= 2023-12-15T23:35:46.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vQ4Hnhtz2PQTD1NS0afXF4klLLs=', 'Content-Length': '0'} 2023-12-15T23:35:46.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000751124a99cbb230-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2023-12-15T23:35:46.156 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.156 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.156 DEBUG:boto:Method: GET 2023-12-15T23:35:46.156 DEBUG:boto:Path: /kskgfn-51/obj185 2023-12-15T23:35:46.156 DEBUG:boto:Data: 2023-12-15T23:35:46.156 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.156 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.156 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.156 DEBUG:boto:Params: {} 2023-12-15T23:35:46.156 DEBUG:boto:Token: None 2023-12-15T23:35:46.157 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185 2023-12-15T23:35:46.157 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U8aQS4LVH6ZUV8UtwUUb1vL+RM0= 2023-12-15T23:35:46.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U8aQS4LVH6ZUV8UtwUUb1vL+RM0=', 'Content-Length': '0'} 2023-12-15T23:35:46.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad8ef91754cdc682-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.159 DEBUG:boto:path=/kskgfn-51/obj185 2023-12-15T23:35:46.159 DEBUG:boto:auth_path=/kskgfn-51/obj185 2023-12-15T23:35:46.159 DEBUG:boto:Method: GET 2023-12-15T23:35:46.159 DEBUG:boto:Path: /kskgfn-51/obj185 2023-12-15T23:35:46.159 DEBUG:boto:Data: 2023-12-15T23:35:46.159 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.159 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.159 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.159 DEBUG:boto:Params: {} 2023-12-15T23:35:46.160 DEBUG:boto:Token: None 2023-12-15T23:35:46.160 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj185 2023-12-15T23:35:46.160 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:U8aQS4LVH6ZUV8UtwUUb1vL+RM0= 2023-12-15T23:35:46.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:U8aQS4LVH6ZUV8UtwUUb1vL+RM0=', 'Content-Length': '0'} 2023-12-15T23:35:46.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000066c4fb14816e466-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.162 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.162 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.162 DEBUG:boto:path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.162 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.163 DEBUG:boto:Method: GET 2023-12-15T23:35:46.163 DEBUG:boto:Path: /kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.163 DEBUG:boto:Data: 2023-12-15T23:35:46.163 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.163 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.163 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.163 DEBUG:boto:Params: {} 2023-12-15T23:35:46.163 DEBUG:boto:Token: None 2023-12-15T23:35:46.163 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.164 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d447dffc24834bc-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.166 DEBUG:boto:b'kskgfn-51obj1851000falseobj1852023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.166 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.166 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.166 DEBUG:boto:path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.167 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.167 DEBUG:boto:Method: GET 2023-12-15T23:35:46.167 DEBUG:boto:Path: /kskgfn-51/?prefix=obj185 2023-12-15T23:35:46.167 DEBUG:boto:Data: 2023-12-15T23:35:46.167 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.167 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.167 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.167 DEBUG:boto:Params: {} 2023-12-15T23:35:46.167 DEBUG:boto:Token: None 2023-12-15T23:35:46.167 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.167 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.171 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000406370457f334d3b-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.171 DEBUG:boto:b'kskgfn-51obj1851000falseobj1852023-12-15T23:31:33.343Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:35:46.172 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.172 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.172 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.172 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.172 DEBUG:boto:Method: GET 2023-12-15T23:35:46.172 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.172 DEBUG:boto:Data: 2023-12-15T23:35:46.172 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.173 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.173 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.173 DEBUG:boto:Params: {} 2023-12-15T23:35:46.173 DEBUG:boto:Token: None 2023-12-15T23:35:46.173 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.173 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE= 2023-12-15T23:35:46.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE=', 'Content-Length': '0'} 2023-12-15T23:35:46.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063498697d3221c60-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.217 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.218 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.218 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.218 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.218 DEBUG:boto:Method: GET 2023-12-15T23:35:46.218 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.218 DEBUG:boto:Data: 2023-12-15T23:35:46.218 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.218 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.218 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.218 DEBUG:boto:Params: {} 2023-12-15T23:35:46.219 DEBUG:boto:Token: None 2023-12-15T23:35:46.219 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.219 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE= 2023-12-15T23:35:46.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE=', 'Content-Length': '0'} 2023-12-15T23:35:46.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f41edc1ddb92c736-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.221 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.222 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.222 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.222 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.222 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.222 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.222 DEBUG:boto:Data: 2023-12-15T23:35:46.222 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.222 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.222 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.222 DEBUG:boto:Params: {} 2023-12-15T23:35:46.222 DEBUG:boto:Token: None 2023-12-15T23:35:46.223 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.223 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7160fykh9zujvAHirdmW217SscI= 2023-12-15T23:35:46.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7160fykh9zujvAHirdmW217SscI=', 'Content-Length': '0'} 2023-12-15T23:35:46.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b58b4ea04383a34d-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.225 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.225 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.225 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.225 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.225 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.225 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.225 DEBUG:boto:Data: 2023-12-15T23:35:46.225 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.226 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.226 DEBUG:boto:Params: {} 2023-12-15T23:35:46.226 DEBUG:boto:Token: None 2023-12-15T23:35:46.226 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7160fykh9zujvAHirdmW217SscI= 2023-12-15T23:35:46.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7160fykh9zujvAHirdmW217SscI=', 'Content-Length': '0'} 2023-12-15T23:35:46.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faacf0b8f53013bd-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:35:46.228 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.228 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.229 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.229 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.229 DEBUG:boto:Method: GET 2023-12-15T23:35:46.229 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.229 DEBUG:boto:Data: 2023-12-15T23:35:46.229 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.229 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.229 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.229 DEBUG:boto:Params: {} 2023-12-15T23:35:46.229 DEBUG:boto:Token: None 2023-12-15T23:35:46.230 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE= 2023-12-15T23:35:46.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE=', 'Content-Length': '0'} 2023-12-15T23:35:46.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e41da34b1b3fc12-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.232 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.232 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.232 DEBUG:boto:path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.232 DEBUG:boto:auth_path=/kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.232 DEBUG:boto:Method: GET 2023-12-15T23:35:46.232 DEBUG:boto:Path: /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.232 DEBUG:boto:Data: 2023-12-15T23:35:46.233 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.233 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.233 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.233 DEBUG:boto:Params: {} 2023-12-15T23:35:46.233 DEBUG:boto:Token: None 2023-12-15T23:35:46.233 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19?versionId=null 2023-12-15T23:35:46.233 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE= 2023-12-15T23:35:46.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ZGOrACHGIvCGQIY46T9S8bnEknE=', 'Content-Length': '0'} 2023-12-15T23:35:46.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002508722286d94ec1-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.236 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.236 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.236 DEBUG:boto:path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.236 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.237 DEBUG:boto:Method: GET 2023-12-15T23:35:46.237 DEBUG:boto:Path: /kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.237 DEBUG:boto:Data: 2023-12-15T23:35:46.237 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.237 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.237 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.237 DEBUG:boto:Params: {} 2023-12-15T23:35:46.237 DEBUG:boto:Token: None 2023-12-15T23:35:46.237 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.238 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.240 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000540c3b4f0de3eea4-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.240 DEBUG:boto:b'kskgfn-51obj191000falseobj192023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.240 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.240 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.240 DEBUG:boto:path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.241 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.241 DEBUG:boto:Method: GET 2023-12-15T23:35:46.241 DEBUG:boto:Path: /kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.241 DEBUG:boto:Data: 2023-12-15T23:35:46.241 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.241 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.241 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.241 DEBUG:boto:Params: {} 2023-12-15T23:35:46.241 DEBUG:boto:Token: None 2023-12-15T23:35:46.241 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.242 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba8d380a30825f14-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.246 DEBUG:boto:b'kskgfn-51obj191000falseobj192023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.246 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.246 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.246 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.246 DEBUG:boto:Path: /kskgfn-51/obj19 2023-12-15T23:35:46.246 DEBUG:boto:Data: 2023-12-15T23:35:46.246 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.246 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.246 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.247 DEBUG:boto:Params: {} 2023-12-15T23:35:46.247 DEBUG:boto:Token: None 2023-12-15T23:35:46.247 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19 2023-12-15T23:35:46.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kq25Peygyarn3OlAbr964kJr4og= 2023-12-15T23:35:46.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kq25Peygyarn3OlAbr964kJr4og=', 'Content-Length': '0'} 2023-12-15T23:35:46.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000748d63760ac5a04-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.250 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.250 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.250 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.250 DEBUG:boto:Path: /kskgfn-51/obj19 2023-12-15T23:35:46.250 DEBUG:boto:Data: 2023-12-15T23:35:46.250 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.250 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.250 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.250 DEBUG:boto:Params: {} 2023-12-15T23:35:46.250 DEBUG:boto:Token: None 2023-12-15T23:35:46.251 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19 2023-12-15T23:35:46.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:kq25Peygyarn3OlAbr964kJr4og= 2023-12-15T23:35:46.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:kq25Peygyarn3OlAbr964kJr4og=', 'Content-Length': '0'} 2023-12-15T23:35:46.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059da7195c145fa1f-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2023-12-15T23:35:46.253 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.253 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.253 DEBUG:boto:Method: GET 2023-12-15T23:35:46.253 DEBUG:boto:Path: /kskgfn-51/obj19 2023-12-15T23:35:46.254 DEBUG:boto:Data: 2023-12-15T23:35:46.254 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.254 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.254 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.254 DEBUG:boto:Params: {} 2023-12-15T23:35:46.254 DEBUG:boto:Token: None 2023-12-15T23:35:46.254 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19 2023-12-15T23:35:46.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LlZkSN7qOFU9xsc7GaRqmalE5L4= 2023-12-15T23:35:46.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LlZkSN7qOFU9xsc7GaRqmalE5L4=', 'Content-Length': '0'} 2023-12-15T23:35:46.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d99c3e55db2c981-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.257 DEBUG:boto:path=/kskgfn-51/obj19 2023-12-15T23:35:46.257 DEBUG:boto:auth_path=/kskgfn-51/obj19 2023-12-15T23:35:46.257 DEBUG:boto:Method: GET 2023-12-15T23:35:46.257 DEBUG:boto:Path: /kskgfn-51/obj19 2023-12-15T23:35:46.257 DEBUG:boto:Data: 2023-12-15T23:35:46.257 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.257 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.257 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.257 DEBUG:boto:Params: {} 2023-12-15T23:35:46.257 DEBUG:boto:Token: None 2023-12-15T23:35:46.257 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj19 2023-12-15T23:35:46.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LlZkSN7qOFU9xsc7GaRqmalE5L4= 2023-12-15T23:35:46.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LlZkSN7qOFU9xsc7GaRqmalE5L4=', 'Content-Length': '0'} 2023-12-15T23:35:46.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001834f5fc192f6952-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.260 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.260 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.260 DEBUG:boto:path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.260 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.261 DEBUG:boto:Method: GET 2023-12-15T23:35:46.261 DEBUG:boto:Path: /kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.261 DEBUG:boto:Data: 2023-12-15T23:35:46.261 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.261 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.261 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.261 DEBUG:boto:Params: {} 2023-12-15T23:35:46.261 DEBUG:boto:Token: None 2023-12-15T23:35:46.261 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.264 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f30a758e9b5598e-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.264 DEBUG:boto:b'kskgfn-51obj191000falseobj192023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.264 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.265 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.265 DEBUG:boto:path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.265 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.265 DEBUG:boto:Method: GET 2023-12-15T23:35:46.265 DEBUG:boto:Path: /kskgfn-51/?prefix=obj19 2023-12-15T23:35:46.265 DEBUG:boto:Data: 2023-12-15T23:35:46.265 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.265 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.265 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.265 DEBUG:boto:Params: {} 2023-12-15T23:35:46.266 DEBUG:boto:Token: None 2023-12-15T23:35:46.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.266 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040c934b43022a114-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.270 DEBUG:boto:b'kskgfn-51obj191000falseobj192023-12-15T23:31:32.040Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:35:46.270 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.270 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.271 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.271 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.271 DEBUG:boto:Method: GET 2023-12-15T23:35:46.271 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.271 DEBUG:boto:Data: 2023-12-15T23:35:46.271 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.271 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.271 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.271 DEBUG:boto:Params: {} 2023-12-15T23:35:46.271 DEBUG:boto:Token: None 2023-12-15T23:35:46.272 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.272 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs= 2023-12-15T23:35:46.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs=', 'Content-Length': '0'} 2023-12-15T23:35:46.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7e53db1d6d969ce-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.274 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.274 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.275 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.275 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.275 DEBUG:boto:Method: GET 2023-12-15T23:35:46.275 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.275 DEBUG:boto:Data: 2023-12-15T23:35:46.275 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.275 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.275 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.275 DEBUG:boto:Params: {} 2023-12-15T23:35:46.275 DEBUG:boto:Token: None 2023-12-15T23:35:46.276 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.276 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs= 2023-12-15T23:35:46.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs=', 'Content-Length': '0'} 2023-12-15T23:35:46.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e54b1fcfb9247ab-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.321 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.321 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.322 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.322 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.322 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.322 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.322 DEBUG:boto:Data: 2023-12-15T23:35:46.322 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.322 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.322 DEBUG:boto:Params: {} 2023-12-15T23:35:46.322 DEBUG:boto:Token: None 2023-12-15T23:35:46.323 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J7vt6wXMOdNgVI0Y6LPGgFYs3Dc= 2023-12-15T23:35:46.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J7vt6wXMOdNgVI0Y6LPGgFYs3Dc=', 'Content-Length': '0'} 2023-12-15T23:35:46.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f97837bfa14b2f87-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.325 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.325 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.325 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.325 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.325 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.325 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.326 DEBUG:boto:Data: 2023-12-15T23:35:46.326 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.326 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.326 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.326 DEBUG:boto:Params: {} 2023-12-15T23:35:46.326 DEBUG:boto:Token: None 2023-12-15T23:35:46.326 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.326 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:J7vt6wXMOdNgVI0Y6LPGgFYs3Dc= 2023-12-15T23:35:46.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:J7vt6wXMOdNgVI0Y6LPGgFYs3Dc=', 'Content-Length': '0'} 2023-12-15T23:35:46.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024e17814099f9ae8-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:35:46.328 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.329 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.329 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.329 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.329 DEBUG:boto:Method: GET 2023-12-15T23:35:46.329 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.329 DEBUG:boto:Data: 2023-12-15T23:35:46.329 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.329 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.329 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.329 DEBUG:boto:Params: {} 2023-12-15T23:35:46.330 DEBUG:boto:Token: None 2023-12-15T23:35:46.330 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.330 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs= 2023-12-15T23:35:46.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs=', 'Content-Length': '0'} 2023-12-15T23:35:46.332 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e20e8f88cbd30b8-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.332 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.332 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.332 DEBUG:boto:path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.332 DEBUG:boto:auth_path=/kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.333 DEBUG:boto:Method: GET 2023-12-15T23:35:46.333 DEBUG:boto:Path: /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.333 DEBUG:boto:Data: 2023-12-15T23:35:46.333 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.333 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.333 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.333 DEBUG:boto:Params: {} 2023-12-15T23:35:46.333 DEBUG:boto:Token: None 2023-12-15T23:35:46.333 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22?versionId=null 2023-12-15T23:35:46.334 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs= 2023-12-15T23:35:46.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SK//gwzwDyTjx2NtPmKORF3+sWs=', 'Content-Length': '0'} 2023-12-15T23:35:46.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa03acd406832cdc-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.336 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.336 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.336 DEBUG:boto:path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.336 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.336 DEBUG:boto:Method: GET 2023-12-15T23:35:46.336 DEBUG:boto:Path: /kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.336 DEBUG:boto:Data: 2023-12-15T23:35:46.337 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.337 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.337 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.337 DEBUG:boto:Params: {} 2023-12-15T23:35:46.337 DEBUG:boto:Token: None 2023-12-15T23:35:46.337 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.337 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.339 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b3997b257468eac-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.340 DEBUG:boto:b'kskgfn-51obj221000falseobj222023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.340 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.340 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.340 DEBUG:boto:path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.340 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.340 DEBUG:boto:Method: GET 2023-12-15T23:35:46.340 DEBUG:boto:Path: /kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.340 DEBUG:boto:Data: 2023-12-15T23:35:46.340 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.341 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.341 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.341 DEBUG:boto:Params: {} 2023-12-15T23:35:46.341 DEBUG:boto:Token: None 2023-12-15T23:35:46.341 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.341 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000df1965ba7c698e6-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.345 DEBUG:boto:b'kskgfn-51obj221000falseobj222023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.345 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.346 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.346 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.346 DEBUG:boto:Path: /kskgfn-51/obj22 2023-12-15T23:35:46.346 DEBUG:boto:Data: 2023-12-15T23:35:46.346 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.346 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.346 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.346 DEBUG:boto:Params: {} 2023-12-15T23:35:46.346 DEBUG:boto:Token: None 2023-12-15T23:35:46.346 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22 2023-12-15T23:35:46.347 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+N3fmx+HxDZojCk6cll0ZJ+jlR0= 2023-12-15T23:35:46.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+N3fmx+HxDZojCk6cll0ZJ+jlR0=', 'Content-Length': '0'} 2023-12-15T23:35:46.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7ebac45c34a6814-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.349 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.349 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.349 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.349 DEBUG:boto:Path: /kskgfn-51/obj22 2023-12-15T23:35:46.349 DEBUG:boto:Data: 2023-12-15T23:35:46.349 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.349 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.350 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.350 DEBUG:boto:Params: {} 2023-12-15T23:35:46.350 DEBUG:boto:Token: None 2023-12-15T23:35:46.350 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22 2023-12-15T23:35:46.350 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+N3fmx+HxDZojCk6cll0ZJ+jlR0= 2023-12-15T23:35:46.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+N3fmx+HxDZojCk6cll0ZJ+jlR0=', 'Content-Length': '0'} 2023-12-15T23:35:46.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a36898c8c26d7842-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2023-12-15T23:35:46.353 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.353 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.353 DEBUG:boto:Method: GET 2023-12-15T23:35:46.353 DEBUG:boto:Path: /kskgfn-51/obj22 2023-12-15T23:35:46.353 DEBUG:boto:Data: 2023-12-15T23:35:46.353 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.353 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.354 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.354 DEBUG:boto:Params: {} 2023-12-15T23:35:46.354 DEBUG:boto:Token: None 2023-12-15T23:35:46.354 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22 2023-12-15T23:35:46.354 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SBgT8nU8yHjfgi505+En4I0Qtxc= 2023-12-15T23:35:46.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SBgT8nU8yHjfgi505+En4I0Qtxc=', 'Content-Length': '0'} 2023-12-15T23:35:46.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df2c06f68a4dddce-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.356 DEBUG:boto:path=/kskgfn-51/obj22 2023-12-15T23:35:46.357 DEBUG:boto:auth_path=/kskgfn-51/obj22 2023-12-15T23:35:46.357 DEBUG:boto:Method: GET 2023-12-15T23:35:46.357 DEBUG:boto:Path: /kskgfn-51/obj22 2023-12-15T23:35:46.357 DEBUG:boto:Data: 2023-12-15T23:35:46.357 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.357 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.357 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.357 DEBUG:boto:Params: {} 2023-12-15T23:35:46.357 DEBUG:boto:Token: None 2023-12-15T23:35:46.357 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj22 2023-12-15T23:35:46.358 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:SBgT8nU8yHjfgi505+En4I0Qtxc= 2023-12-15T23:35:46.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:SBgT8nU8yHjfgi505+En4I0Qtxc=', 'Content-Length': '0'} 2023-12-15T23:35:46.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1d474a27f1c9840-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.360 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.360 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.361 DEBUG:boto:path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.361 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.361 DEBUG:boto:Method: GET 2023-12-15T23:35:46.361 DEBUG:boto:Path: /kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.361 DEBUG:boto:Data: 2023-12-15T23:35:46.361 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.361 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.361 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.361 DEBUG:boto:Params: {} 2023-12-15T23:35:46.361 DEBUG:boto:Token: None 2023-12-15T23:35:46.362 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.362 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009deab0e4be5e7d1-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.364 DEBUG:boto:b'kskgfn-51obj221000falseobj222023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.364 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.365 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.365 DEBUG:boto:path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.365 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.365 DEBUG:boto:Method: GET 2023-12-15T23:35:46.365 DEBUG:boto:Path: /kskgfn-51/?prefix=obj22 2023-12-15T23:35:46.365 DEBUG:boto:Data: 2023-12-15T23:35:46.365 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.365 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.365 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.365 DEBUG:boto:Params: {} 2023-12-15T23:35:46.365 DEBUG:boto:Token: None 2023-12-15T23:35:46.366 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.366 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086b78430d9b35d3e-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.369 DEBUG:boto:b'kskgfn-51obj221000falseobj222023-12-15T23:31:31.510Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:35:46.370 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.370 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.370 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.370 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.370 DEBUG:boto:Method: GET 2023-12-15T23:35:46.370 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.370 DEBUG:boto:Data: 2023-12-15T23:35:46.370 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.370 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.370 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.370 DEBUG:boto:Params: {} 2023-12-15T23:35:46.371 DEBUG:boto:Token: None 2023-12-15T23:35:46.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E= 2023-12-15T23:35:46.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E=', 'Content-Length': '0'} 2023-12-15T23:35:46.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000732d67f3075323a0-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.373 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.373 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.373 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.373 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.373 DEBUG:boto:Method: GET 2023-12-15T23:35:46.374 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.374 DEBUG:boto:Data: 2023-12-15T23:35:46.374 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.374 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.374 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.374 DEBUG:boto:Params: {} 2023-12-15T23:35:46.374 DEBUG:boto:Token: None 2023-12-15T23:35:46.374 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.374 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E= 2023-12-15T23:35:46.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E=', 'Content-Length': '0'} 2023-12-15T23:35:46.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6e23da782f54149-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.376 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.376 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.377 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.377 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.377 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.377 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.377 DEBUG:boto:Data: 2023-12-15T23:35:46.377 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.377 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.377 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.377 DEBUG:boto:Params: {} 2023-12-15T23:35:46.377 DEBUG:boto:Token: None 2023-12-15T23:35:46.378 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.378 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gjq4TfSrVaPbjAAJyVldFvXhXT4= 2023-12-15T23:35:46.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gjq4TfSrVaPbjAAJyVldFvXhXT4=', 'Content-Length': '0'} 2023-12-15T23:35:46.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000189a0bea70a0cc2b-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.380 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.380 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.380 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.380 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.380 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.380 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.380 DEBUG:boto:Data: 2023-12-15T23:35:46.380 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.380 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.381 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.381 DEBUG:boto:Params: {} 2023-12-15T23:35:46.381 DEBUG:boto:Token: None 2023-12-15T23:35:46.381 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gjq4TfSrVaPbjAAJyVldFvXhXT4= 2023-12-15T23:35:46.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gjq4TfSrVaPbjAAJyVldFvXhXT4=', 'Content-Length': '0'} 2023-12-15T23:35:46.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a12ca7d870d0cc2-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:35:46.384 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.384 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.384 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.384 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.384 DEBUG:boto:Method: GET 2023-12-15T23:35:46.384 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.384 DEBUG:boto:Data: 2023-12-15T23:35:46.384 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.384 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.384 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.385 DEBUG:boto:Params: {} 2023-12-15T23:35:46.385 DEBUG:boto:Token: None 2023-12-15T23:35:46.385 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.385 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E= 2023-12-15T23:35:46.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E=', 'Content-Length': '0'} 2023-12-15T23:35:46.387 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdbc64073fa89712-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.387 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.387 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.387 DEBUG:boto:path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.388 DEBUG:boto:auth_path=/kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.388 DEBUG:boto:Method: GET 2023-12-15T23:35:46.388 DEBUG:boto:Path: /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.388 DEBUG:boto:Data: 2023-12-15T23:35:46.388 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.388 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.388 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.388 DEBUG:boto:Params: {} 2023-12-15T23:35:46.388 DEBUG:boto:Token: None 2023-12-15T23:35:46.388 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23?versionId=null 2023-12-15T23:35:46.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E= 2023-12-15T23:35:46.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ah+2fzil7kMTEIYrBpKjVujyV8E=', 'Content-Length': '0'} 2023-12-15T23:35:46.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033fe11530a4f339e-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.391 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.391 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.391 DEBUG:boto:path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.391 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.391 DEBUG:boto:Method: GET 2023-12-15T23:35:46.391 DEBUG:boto:Path: /kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.391 DEBUG:boto:Data: 2023-12-15T23:35:46.391 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.391 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.391 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.391 DEBUG:boto:Params: {} 2023-12-15T23:35:46.392 DEBUG:boto:Token: None 2023-12-15T23:35:46.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.394 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8c74685c2b36d66-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.394 DEBUG:boto:b'kskgfn-51obj231000falseobj232023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.395 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.395 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.395 DEBUG:boto:path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.395 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.395 DEBUG:boto:Method: GET 2023-12-15T23:35:46.395 DEBUG:boto:Path: /kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.395 DEBUG:boto:Data: 2023-12-15T23:35:46.395 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.395 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.396 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.396 DEBUG:boto:Params: {} 2023-12-15T23:35:46.396 DEBUG:boto:Token: None 2023-12-15T23:35:46.396 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.396 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e39f01a529d1a44f-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.399 DEBUG:boto:b'kskgfn-51obj231000falseobj232023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.400 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.400 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.400 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.400 DEBUG:boto:Path: /kskgfn-51/obj23 2023-12-15T23:35:46.400 DEBUG:boto:Data: 2023-12-15T23:35:46.400 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.400 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.400 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.400 DEBUG:boto:Params: {} 2023-12-15T23:35:46.401 DEBUG:boto:Token: None 2023-12-15T23:35:46.401 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23 2023-12-15T23:35:46.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iKs6mHE/NXNl9HUs21LRG5BiFPY= 2023-12-15T23:35:46.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iKs6mHE/NXNl9HUs21LRG5BiFPY=', 'Content-Length': '0'} 2023-12-15T23:35:46.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d978f580429b2834-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.403 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.403 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.403 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.403 DEBUG:boto:Path: /kskgfn-51/obj23 2023-12-15T23:35:46.403 DEBUG:boto:Data: 2023-12-15T23:35:46.403 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.403 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.403 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.404 DEBUG:boto:Params: {} 2023-12-15T23:35:46.404 DEBUG:boto:Token: None 2023-12-15T23:35:46.404 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23 2023-12-15T23:35:46.404 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iKs6mHE/NXNl9HUs21LRG5BiFPY= 2023-12-15T23:35:46.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iKs6mHE/NXNl9HUs21LRG5BiFPY=', 'Content-Length': '0'} 2023-12-15T23:35:46.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f0a7f7098406da0-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.406 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2023-12-15T23:35:46.406 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.406 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.406 DEBUG:boto:Method: GET 2023-12-15T23:35:46.406 DEBUG:boto:Path: /kskgfn-51/obj23 2023-12-15T23:35:46.406 DEBUG:boto:Data: 2023-12-15T23:35:46.406 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.407 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.407 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.407 DEBUG:boto:Params: {} 2023-12-15T23:35:46.407 DEBUG:boto:Token: None 2023-12-15T23:35:46.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23 2023-12-15T23:35:46.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oeOU3s0NA55HlCrGn0yB1IhBb8g= 2023-12-15T23:35:46.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oeOU3s0NA55HlCrGn0yB1IhBb8g=', 'Content-Length': '0'} 2023-12-15T23:35:46.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061dfae4540d75b94-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.409 DEBUG:boto:path=/kskgfn-51/obj23 2023-12-15T23:35:46.410 DEBUG:boto:auth_path=/kskgfn-51/obj23 2023-12-15T23:35:46.410 DEBUG:boto:Method: GET 2023-12-15T23:35:46.410 DEBUG:boto:Path: /kskgfn-51/obj23 2023-12-15T23:35:46.410 DEBUG:boto:Data: 2023-12-15T23:35:46.410 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.410 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.410 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.410 DEBUG:boto:Params: {} 2023-12-15T23:35:46.410 DEBUG:boto:Token: None 2023-12-15T23:35:46.410 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj23 2023-12-15T23:35:46.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oeOU3s0NA55HlCrGn0yB1IhBb8g= 2023-12-15T23:35:46.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oeOU3s0NA55HlCrGn0yB1IhBb8g=', 'Content-Length': '0'} 2023-12-15T23:35:46.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf18f57822d6c19a-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.453 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.454 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.454 DEBUG:boto:path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.454 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.454 DEBUG:boto:Method: GET 2023-12-15T23:35:46.454 DEBUG:boto:Path: /kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.454 DEBUG:boto:Data: 2023-12-15T23:35:46.454 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.454 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.454 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.454 DEBUG:boto:Params: {} 2023-12-15T23:35:46.455 DEBUG:boto:Token: None 2023-12-15T23:35:46.455 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.458 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7800541edb60aac-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.458 DEBUG:boto:b'kskgfn-51obj231000falseobj232023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.458 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.458 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.459 DEBUG:boto:path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.459 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.459 DEBUG:boto:Method: GET 2023-12-15T23:35:46.459 DEBUG:boto:Path: /kskgfn-51/?prefix=obj23 2023-12-15T23:35:46.459 DEBUG:boto:Data: 2023-12-15T23:35:46.459 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.459 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.459 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.459 DEBUG:boto:Params: {} 2023-12-15T23:35:46.459 DEBUG:boto:Token: None 2023-12-15T23:35:46.459 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.460 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.463 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4be50db02672d12-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.463 DEBUG:boto:b'kskgfn-51obj231000falseobj232023-12-15T23:31:32.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:35:46.464 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.464 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.464 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.464 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.464 DEBUG:boto:Method: GET 2023-12-15T23:35:46.464 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.464 DEBUG:boto:Data: 2023-12-15T23:35:46.464 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.464 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.464 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.464 DEBUG:boto:Params: {} 2023-12-15T23:35:46.465 DEBUG:boto:Token: None 2023-12-15T23:35:46.465 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.465 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is= 2023-12-15T23:35:46.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is=', 'Content-Length': '0'} 2023-12-15T23:35:46.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006317a7b93fabd45c-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.510 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.510 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.510 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.510 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.510 DEBUG:boto:Method: GET 2023-12-15T23:35:46.510 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.510 DEBUG:boto:Data: 2023-12-15T23:35:46.510 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.510 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.511 DEBUG:boto:Params: {} 2023-12-15T23:35:46.511 DEBUG:boto:Token: None 2023-12-15T23:35:46.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is= 2023-12-15T23:35:46.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is=', 'Content-Length': '0'} 2023-12-15T23:35:46.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cac561a59e0c1cf-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.513 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.514 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.514 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.514 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.514 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.514 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.514 DEBUG:boto:Data: 2023-12-15T23:35:46.514 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.514 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.514 DEBUG:boto:Params: {} 2023-12-15T23:35:46.515 DEBUG:boto:Token: None 2023-12-15T23:35:46.515 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:isU6fqCJKv//fOK+970J6+slSDo= 2023-12-15T23:35:46.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:isU6fqCJKv//fOK+970J6+slSDo=', 'Content-Length': '0'} 2023-12-15T23:35:46.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5391b7cdb965455-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.517 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.517 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.517 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.517 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.518 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.518 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.518 DEBUG:boto:Data: 2023-12-15T23:35:46.518 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.518 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.518 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.518 DEBUG:boto:Params: {} 2023-12-15T23:35:46.518 DEBUG:boto:Token: None 2023-12-15T23:35:46.518 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.518 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:isU6fqCJKv//fOK+970J6+slSDo= 2023-12-15T23:35:46.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:isU6fqCJKv//fOK+970J6+slSDo=', 'Content-Length': '0'} 2023-12-15T23:35:46.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008a87b5f37d590fd-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.520 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:35:46.521 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.521 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.521 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.521 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.521 DEBUG:boto:Method: GET 2023-12-15T23:35:46.521 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.521 DEBUG:boto:Data: 2023-12-15T23:35:46.521 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.521 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.521 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.521 DEBUG:boto:Params: {} 2023-12-15T23:35:46.522 DEBUG:boto:Token: None 2023-12-15T23:35:46.522 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.522 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is= 2023-12-15T23:35:46.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is=', 'Content-Length': '0'} 2023-12-15T23:35:46.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6fce46e6e01f00a-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.524 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.524 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.524 DEBUG:boto:path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.525 DEBUG:boto:auth_path=/kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.525 DEBUG:boto:Method: GET 2023-12-15T23:35:46.525 DEBUG:boto:Path: /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.525 DEBUG:boto:Data: 2023-12-15T23:35:46.525 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.525 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.525 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.525 DEBUG:boto:Params: {} 2023-12-15T23:35:46.525 DEBUG:boto:Token: None 2023-12-15T23:35:46.525 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29?versionId=null 2023-12-15T23:35:46.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is= 2023-12-15T23:35:46.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:jGwBB7NRdzy2Y+mxRKeYJoUP+is=', 'Content-Length': '0'} 2023-12-15T23:35:46.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6606f2b10c6f248-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.528 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.528 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.528 DEBUG:boto:path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.528 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.528 DEBUG:boto:Method: GET 2023-12-15T23:35:46.528 DEBUG:boto:Path: /kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.528 DEBUG:boto:Data: 2023-12-15T23:35:46.528 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.528 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.528 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.529 DEBUG:boto:Params: {} 2023-12-15T23:35:46.529 DEBUG:boto:Token: None 2023-12-15T23:35:46.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066356bcee19d8645-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.532 DEBUG:boto:b'kskgfn-51obj291000falseobj292023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.532 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.532 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.532 DEBUG:boto:path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.532 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.532 DEBUG:boto:Method: GET 2023-12-15T23:35:46.532 DEBUG:boto:Path: /kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.533 DEBUG:boto:Data: 2023-12-15T23:35:46.533 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.533 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.533 DEBUG:boto:Params: {} 2023-12-15T23:35:46.533 DEBUG:boto:Token: None 2023-12-15T23:35:46.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.533 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfae5728df02a2c7-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.537 DEBUG:boto:b'kskgfn-51obj291000falseobj292023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.537 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.537 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.537 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.538 DEBUG:boto:Path: /kskgfn-51/obj29 2023-12-15T23:35:46.538 DEBUG:boto:Data: 2023-12-15T23:35:46.538 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.538 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.538 DEBUG:boto:Params: {} 2023-12-15T23:35:46.538 DEBUG:boto:Token: None 2023-12-15T23:35:46.538 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29 2023-12-15T23:35:46.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LGbJDRjdm5IsypRapKLQ2aaffW0= 2023-12-15T23:35:46.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LGbJDRjdm5IsypRapKLQ2aaffW0=', 'Content-Length': '0'} 2023-12-15T23:35:46.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ccce9feaefa867f-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.541 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.541 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.541 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.541 DEBUG:boto:Path: /kskgfn-51/obj29 2023-12-15T23:35:46.541 DEBUG:boto:Data: 2023-12-15T23:35:46.541 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.542 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.542 DEBUG:boto:Params: {} 2023-12-15T23:35:46.542 DEBUG:boto:Token: None 2023-12-15T23:35:46.542 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29 2023-12-15T23:35:46.542 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LGbJDRjdm5IsypRapKLQ2aaffW0= 2023-12-15T23:35:46.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LGbJDRjdm5IsypRapKLQ2aaffW0=', 'Content-Length': '0'} 2023-12-15T23:35:46.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005773ecb119a25e76-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.545 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2023-12-15T23:35:46.545 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.545 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.545 DEBUG:boto:Method: GET 2023-12-15T23:35:46.545 DEBUG:boto:Path: /kskgfn-51/obj29 2023-12-15T23:35:46.545 DEBUG:boto:Data: 2023-12-15T23:35:46.545 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.545 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.545 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.546 DEBUG:boto:Params: {} 2023-12-15T23:35:46.546 DEBUG:boto:Token: None 2023-12-15T23:35:46.546 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29 2023-12-15T23:35:46.546 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8dfvZIfvaw/rd0wBZcHh7xuxt0= 2023-12-15T23:35:46.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8dfvZIfvaw/rd0wBZcHh7xuxt0=', 'Content-Length': '0'} 2023-12-15T23:35:46.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e909f515f54edb88-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.549 DEBUG:boto:path=/kskgfn-51/obj29 2023-12-15T23:35:46.549 DEBUG:boto:auth_path=/kskgfn-51/obj29 2023-12-15T23:35:46.549 DEBUG:boto:Method: GET 2023-12-15T23:35:46.549 DEBUG:boto:Path: /kskgfn-51/obj29 2023-12-15T23:35:46.549 DEBUG:boto:Data: 2023-12-15T23:35:46.549 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.549 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.549 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.550 DEBUG:boto:Params: {} 2023-12-15T23:35:46.550 DEBUG:boto:Token: None 2023-12-15T23:35:46.550 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj29 2023-12-15T23:35:46.550 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:A8dfvZIfvaw/rd0wBZcHh7xuxt0= 2023-12-15T23:35:46.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:A8dfvZIfvaw/rd0wBZcHh7xuxt0=', 'Content-Length': '0'} 2023-12-15T23:35:46.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008363f0e79f2c6bbb-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.552 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.552 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.553 DEBUG:boto:path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.553 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.553 DEBUG:boto:Method: GET 2023-12-15T23:35:46.553 DEBUG:boto:Path: /kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.553 DEBUG:boto:Data: 2023-12-15T23:35:46.553 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.553 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.553 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.553 DEBUG:boto:Params: {} 2023-12-15T23:35:46.554 DEBUG:boto:Token: None 2023-12-15T23:35:46.554 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.554 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b8822881f0632d9-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.556 DEBUG:boto:b'kskgfn-51obj291000falseobj292023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.557 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.557 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.557 DEBUG:boto:path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.557 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.557 DEBUG:boto:Method: GET 2023-12-15T23:35:46.557 DEBUG:boto:Path: /kskgfn-51/?prefix=obj29 2023-12-15T23:35:46.557 DEBUG:boto:Data: 2023-12-15T23:35:46.557 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.558 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.558 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.558 DEBUG:boto:Params: {} 2023-12-15T23:35:46.558 DEBUG:boto:Token: None 2023-12-15T23:35:46.558 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.558 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045e1b75634114f22-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.562 DEBUG:boto:b'kskgfn-51obj291000falseobj292023-12-15T23:31:32.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:35:46.563 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.563 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.563 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.563 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.563 DEBUG:boto:Method: GET 2023-12-15T23:35:46.563 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.563 DEBUG:boto:Data: 2023-12-15T23:35:46.563 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.563 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.563 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.564 DEBUG:boto:Params: {} 2023-12-15T23:35:46.564 DEBUG:boto:Token: None 2023-12-15T23:35:46.564 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.564 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M= 2023-12-15T23:35:46.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M=', 'Content-Length': '0'} 2023-12-15T23:35:46.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063f15c1265e381f5-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.566 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.566 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.566 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.567 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.567 DEBUG:boto:Method: GET 2023-12-15T23:35:46.567 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.567 DEBUG:boto:Data: 2023-12-15T23:35:46.567 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.567 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.567 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.567 DEBUG:boto:Params: {} 2023-12-15T23:35:46.567 DEBUG:boto:Token: None 2023-12-15T23:35:46.568 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.568 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M= 2023-12-15T23:35:46.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M=', 'Content-Length': '0'} 2023-12-15T23:35:46.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee41b2437d39d889-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.570 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.570 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.570 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.570 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.571 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.571 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.571 DEBUG:boto:Data: 2023-12-15T23:35:46.571 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.571 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.571 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.571 DEBUG:boto:Params: {} 2023-12-15T23:35:46.571 DEBUG:boto:Token: None 2023-12-15T23:35:46.571 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.572 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+IZlFyyiTRbJfsekc6aEJFgEBk= 2023-12-15T23:35:46.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+IZlFyyiTRbJfsekc6aEJFgEBk=', 'Content-Length': '0'} 2023-12-15T23:35:46.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee2833c06a1e3d91-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.574 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.574 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.574 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.574 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.574 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.574 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.574 DEBUG:boto:Data: 2023-12-15T23:35:46.574 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.574 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.575 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.575 DEBUG:boto:Params: {} 2023-12-15T23:35:46.575 DEBUG:boto:Token: None 2023-12-15T23:35:46.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:F+IZlFyyiTRbJfsekc6aEJFgEBk= 2023-12-15T23:35:46.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:F+IZlFyyiTRbJfsekc6aEJFgEBk=', 'Content-Length': '0'} 2023-12-15T23:35:46.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bea99efbe965b99a-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:35:46.577 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.577 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.577 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.577 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.577 DEBUG:boto:Method: GET 2023-12-15T23:35:46.578 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.578 DEBUG:boto:Data: 2023-12-15T23:35:46.578 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.578 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.578 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.578 DEBUG:boto:Params: {} 2023-12-15T23:35:46.578 DEBUG:boto:Token: None 2023-12-15T23:35:46.578 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.578 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M= 2023-12-15T23:35:46.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M=', 'Content-Length': '0'} 2023-12-15T23:35:46.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad69b85d39e9a0f2-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.625 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.625 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.626 DEBUG:boto:path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.626 DEBUG:boto:auth_path=/kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.626 DEBUG:boto:Method: GET 2023-12-15T23:35:46.626 DEBUG:boto:Path: /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.626 DEBUG:boto:Data: 2023-12-15T23:35:46.626 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.626 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.626 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.626 DEBUG:boto:Params: {} 2023-12-15T23:35:46.626 DEBUG:boto:Token: None 2023-12-15T23:35:46.627 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31?versionId=null 2023-12-15T23:35:46.627 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M= 2023-12-15T23:35:46.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GzJW9N/ayy1yrgc8RTVMJBHEV1M=', 'Content-Length': '0'} 2023-12-15T23:35:46.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040c16caeb287fef5-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.629 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.629 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.629 DEBUG:boto:path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.629 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.629 DEBUG:boto:Method: GET 2023-12-15T23:35:46.630 DEBUG:boto:Path: /kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.630 DEBUG:boto:Data: 2023-12-15T23:35:46.630 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.630 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.630 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.630 DEBUG:boto:Params: {} 2023-12-15T23:35:46.630 DEBUG:boto:Token: None 2023-12-15T23:35:46.630 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d620a6ca9ae30e4-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.633 DEBUG:boto:b'kskgfn-51obj311000falseobj312023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.633 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.633 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.634 DEBUG:boto:path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.634 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.634 DEBUG:boto:Method: GET 2023-12-15T23:35:46.634 DEBUG:boto:Path: /kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.634 DEBUG:boto:Data: 2023-12-15T23:35:46.634 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.634 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.634 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.634 DEBUG:boto:Params: {} 2023-12-15T23:35:46.634 DEBUG:boto:Token: None 2023-12-15T23:35:46.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.638 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f06c341ede1a5bd-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.638 DEBUG:boto:b'kskgfn-51obj311000falseobj312023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.639 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.639 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.639 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.639 DEBUG:boto:Path: /kskgfn-51/obj31 2023-12-15T23:35:46.639 DEBUG:boto:Data: 2023-12-15T23:35:46.639 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.639 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.639 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.639 DEBUG:boto:Params: {} 2023-12-15T23:35:46.640 DEBUG:boto:Token: None 2023-12-15T23:35:46.640 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31 2023-12-15T23:35:46.640 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5+xqXfhwO3ZsfJnJgsD7tpYf32g= 2023-12-15T23:35:46.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5+xqXfhwO3ZsfJnJgsD7tpYf32g=', 'Content-Length': '0'} 2023-12-15T23:35:46.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd374271f8fd60d2-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.642 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.642 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.642 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.643 DEBUG:boto:Path: /kskgfn-51/obj31 2023-12-15T23:35:46.643 DEBUG:boto:Data: 2023-12-15T23:35:46.643 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.643 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.643 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.643 DEBUG:boto:Params: {} 2023-12-15T23:35:46.643 DEBUG:boto:Token: None 2023-12-15T23:35:46.643 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31 2023-12-15T23:35:46.643 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5+xqXfhwO3ZsfJnJgsD7tpYf32g= 2023-12-15T23:35:46.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5+xqXfhwO3ZsfJnJgsD7tpYf32g=', 'Content-Length': '0'} 2023-12-15T23:35:46.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046bbb038fd6f6aa0-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2023-12-15T23:35:46.649 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.650 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.650 DEBUG:boto:Method: GET 2023-12-15T23:35:46.650 DEBUG:boto:Path: /kskgfn-51/obj31 2023-12-15T23:35:46.650 DEBUG:boto:Data: 2023-12-15T23:35:46.650 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.650 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.650 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.650 DEBUG:boto:Params: {} 2023-12-15T23:35:46.650 DEBUG:boto:Token: None 2023-12-15T23:35:46.651 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31 2023-12-15T23:35:46.651 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yl4EzlLnS5jafVJfDUePRCfOSw= 2023-12-15T23:35:46.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yl4EzlLnS5jafVJfDUePRCfOSw=', 'Content-Length': '0'} 2023-12-15T23:35:46.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fe3310bb9c6164c-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.653 DEBUG:boto:path=/kskgfn-51/obj31 2023-12-15T23:35:46.653 DEBUG:boto:auth_path=/kskgfn-51/obj31 2023-12-15T23:35:46.653 DEBUG:boto:Method: GET 2023-12-15T23:35:46.653 DEBUG:boto:Path: /kskgfn-51/obj31 2023-12-15T23:35:46.653 DEBUG:boto:Data: 2023-12-15T23:35:46.653 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.654 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.654 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.654 DEBUG:boto:Params: {} 2023-12-15T23:35:46.654 DEBUG:boto:Token: None 2023-12-15T23:35:46.654 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj31 2023-12-15T23:35:46.654 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4yl4EzlLnS5jafVJfDUePRCfOSw= 2023-12-15T23:35:46.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4yl4EzlLnS5jafVJfDUePRCfOSw=', 'Content-Length': '0'} 2023-12-15T23:35:46.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf11c6aff3d2e3c3-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.656 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.657 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.657 DEBUG:boto:path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.657 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.657 DEBUG:boto:Method: GET 2023-12-15T23:35:46.657 DEBUG:boto:Path: /kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.657 DEBUG:boto:Data: 2023-12-15T23:35:46.657 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.657 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.657 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.657 DEBUG:boto:Params: {} 2023-12-15T23:35:46.658 DEBUG:boto:Token: None 2023-12-15T23:35:46.658 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.658 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005572a3af5ce77d79-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.660 DEBUG:boto:b'kskgfn-51obj311000falseobj312023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.661 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.661 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.661 DEBUG:boto:path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.661 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.661 DEBUG:boto:Method: GET 2023-12-15T23:35:46.661 DEBUG:boto:Path: /kskgfn-51/?prefix=obj31 2023-12-15T23:35:46.661 DEBUG:boto:Data: 2023-12-15T23:35:46.661 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.661 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.661 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.662 DEBUG:boto:Params: {} 2023-12-15T23:35:46.662 DEBUG:boto:Token: None 2023-12-15T23:35:46.662 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.662 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000055ed569149eb282-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.665 DEBUG:boto:b'kskgfn-51obj311000falseobj312023-12-15T23:31:32.957Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:35:46.666 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.666 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.666 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.666 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.666 DEBUG:boto:Method: GET 2023-12-15T23:35:46.666 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.666 DEBUG:boto:Data: 2023-12-15T23:35:46.666 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.667 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.667 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.667 DEBUG:boto:Params: {} 2023-12-15T23:35:46.667 DEBUG:boto:Token: None 2023-12-15T23:35:46.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI= 2023-12-15T23:35:46.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI=', 'Content-Length': '0'} 2023-12-15T23:35:46.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c1b0bfad6f542cf-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.670 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.670 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.670 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.670 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.670 DEBUG:boto:Method: GET 2023-12-15T23:35:46.670 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.670 DEBUG:boto:Data: 2023-12-15T23:35:46.670 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.670 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.671 DEBUG:boto:Params: {} 2023-12-15T23:35:46.671 DEBUG:boto:Token: None 2023-12-15T23:35:46.671 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI= 2023-12-15T23:35:46.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI=', 'Content-Length': '0'} 2023-12-15T23:35:46.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcd58fe55e61de51-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.673 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.673 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.673 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.673 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.674 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.674 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.674 DEBUG:boto:Data: 2023-12-15T23:35:46.674 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.674 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.674 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.674 DEBUG:boto:Params: {} 2023-12-15T23:35:46.674 DEBUG:boto:Token: None 2023-12-15T23:35:46.674 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJoqDLB0izPEZ+UQHjyUxQYhzts= 2023-12-15T23:35:46.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJoqDLB0izPEZ+UQHjyUxQYhzts=', 'Content-Length': '0'} 2023-12-15T23:35:46.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008344a96d948e5457-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.677 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.677 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.677 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.677 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.677 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.677 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.677 DEBUG:boto:Data: 2023-12-15T23:35:46.677 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.677 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.677 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.678 DEBUG:boto:Params: {} 2023-12-15T23:35:46.678 DEBUG:boto:Token: None 2023-12-15T23:35:46.678 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.678 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:GJoqDLB0izPEZ+UQHjyUxQYhzts= 2023-12-15T23:35:46.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:GJoqDLB0izPEZ+UQHjyUxQYhzts=', 'Content-Length': '0'} 2023-12-15T23:35:46.680 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000789c7a486fd0366a-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:35:46.680 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.680 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.680 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.681 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.681 DEBUG:boto:Method: GET 2023-12-15T23:35:46.681 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.681 DEBUG:boto:Data: 2023-12-15T23:35:46.681 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.681 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.681 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.681 DEBUG:boto:Params: {} 2023-12-15T23:35:46.681 DEBUG:boto:Token: None 2023-12-15T23:35:46.681 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.682 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI= 2023-12-15T23:35:46.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI=', 'Content-Length': '0'} 2023-12-15T23:35:46.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001f44d8e144e58b3-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.684 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.684 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.684 DEBUG:boto:path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.684 DEBUG:boto:auth_path=/kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.684 DEBUG:boto:Method: GET 2023-12-15T23:35:46.684 DEBUG:boto:Path: /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.684 DEBUG:boto:Data: 2023-12-15T23:35:46.684 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.684 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.685 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.685 DEBUG:boto:Params: {} 2023-12-15T23:35:46.685 DEBUG:boto:Token: None 2023-12-15T23:35:46.685 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33?versionId=null 2023-12-15T23:35:46.685 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI= 2023-12-15T23:35:46.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:COZT+nroi3VKEXfgvIidCIXMAsI=', 'Content-Length': '0'} 2023-12-15T23:35:46.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003733fedb9072b9de-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.687 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.687 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.687 DEBUG:boto:path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.688 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.688 DEBUG:boto:Method: GET 2023-12-15T23:35:46.688 DEBUG:boto:Path: /kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.688 DEBUG:boto:Data: 2023-12-15T23:35:46.688 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.688 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.688 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.688 DEBUG:boto:Params: {} 2023-12-15T23:35:46.688 DEBUG:boto:Token: None 2023-12-15T23:35:46.688 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.689 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.690 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031f6bb3c332289e3-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.691 DEBUG:boto:b'kskgfn-51obj331000falseobj332023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.691 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.691 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.691 DEBUG:boto:path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.691 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.691 DEBUG:boto:Method: GET 2023-12-15T23:35:46.692 DEBUG:boto:Path: /kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.692 DEBUG:boto:Data: 2023-12-15T23:35:46.692 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.692 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.692 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.692 DEBUG:boto:Params: {} 2023-12-15T23:35:46.692 DEBUG:boto:Token: None 2023-12-15T23:35:46.692 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.692 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f9690fa8db77024-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.696 DEBUG:boto:b'kskgfn-51obj331000falseobj332023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.696 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.696 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.696 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.696 DEBUG:boto:Path: /kskgfn-51/obj33 2023-12-15T23:35:46.697 DEBUG:boto:Data: 2023-12-15T23:35:46.697 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.697 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.697 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.697 DEBUG:boto:Params: {} 2023-12-15T23:35:46.697 DEBUG:boto:Token: None 2023-12-15T23:35:46.697 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33 2023-12-15T23:35:46.697 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tLoNE0X4M3jsytjJxCvQTlIPi4k= 2023-12-15T23:35:46.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tLoNE0X4M3jsytjJxCvQTlIPi4k=', 'Content-Length': '0'} 2023-12-15T23:35:46.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000178d723f3059deaa-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.699 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.700 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.700 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.700 DEBUG:boto:Path: /kskgfn-51/obj33 2023-12-15T23:35:46.700 DEBUG:boto:Data: 2023-12-15T23:35:46.700 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.700 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.700 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.700 DEBUG:boto:Params: {} 2023-12-15T23:35:46.700 DEBUG:boto:Token: None 2023-12-15T23:35:46.701 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33 2023-12-15T23:35:46.701 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tLoNE0X4M3jsytjJxCvQTlIPi4k= 2023-12-15T23:35:46.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tLoNE0X4M3jsytjJxCvQTlIPi4k=', 'Content-Length': '0'} 2023-12-15T23:35:46.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002e1830f3b40d3f0-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.703 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2023-12-15T23:35:46.703 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.703 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.703 DEBUG:boto:Method: GET 2023-12-15T23:35:46.703 DEBUG:boto:Path: /kskgfn-51/obj33 2023-12-15T23:35:46.703 DEBUG:boto:Data: 2023-12-15T23:35:46.703 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.703 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.703 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.703 DEBUG:boto:Params: {} 2023-12-15T23:35:46.704 DEBUG:boto:Token: None 2023-12-15T23:35:46.704 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33 2023-12-15T23:35:46.704 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5BKpCxIPTfrWR7lNJeSc+FSx7zk= 2023-12-15T23:35:46.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5BKpCxIPTfrWR7lNJeSc+FSx7zk=', 'Content-Length': '0'} 2023-12-15T23:35:46.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc5b7ae7c2590d75-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.749 DEBUG:boto:path=/kskgfn-51/obj33 2023-12-15T23:35:46.750 DEBUG:boto:auth_path=/kskgfn-51/obj33 2023-12-15T23:35:46.750 DEBUG:boto:Method: GET 2023-12-15T23:35:46.750 DEBUG:boto:Path: /kskgfn-51/obj33 2023-12-15T23:35:46.750 DEBUG:boto:Data: 2023-12-15T23:35:46.750 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.750 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.750 DEBUG:boto:Params: {} 2023-12-15T23:35:46.750 DEBUG:boto:Token: None 2023-12-15T23:35:46.750 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj33 2023-12-15T23:35:46.751 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:5BKpCxIPTfrWR7lNJeSc+FSx7zk= 2023-12-15T23:35:46.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:5BKpCxIPTfrWR7lNJeSc+FSx7zk=', 'Content-Length': '0'} 2023-12-15T23:35:46.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000700e76cacaf9f2dd-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.753 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.753 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.753 DEBUG:boto:path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.753 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.753 DEBUG:boto:Method: GET 2023-12-15T23:35:46.753 DEBUG:boto:Path: /kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.753 DEBUG:boto:Data: 2023-12-15T23:35:46.754 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.754 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.754 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.754 DEBUG:boto:Params: {} 2023-12-15T23:35:46.754 DEBUG:boto:Token: None 2023-12-15T23:35:46.754 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.754 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea21f3b98d8c226a-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.757 DEBUG:boto:b'kskgfn-51obj331000falseobj332023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.757 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.758 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.758 DEBUG:boto:path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.758 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.758 DEBUG:boto:Method: GET 2023-12-15T23:35:46.758 DEBUG:boto:Path: /kskgfn-51/?prefix=obj33 2023-12-15T23:35:46.758 DEBUG:boto:Data: 2023-12-15T23:35:46.758 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.758 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.758 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.758 DEBUG:boto:Params: {} 2023-12-15T23:35:46.759 DEBUG:boto:Token: None 2023-12-15T23:35:46.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ed40e646caafe6a-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.763 DEBUG:boto:b'kskgfn-51obj331000falseobj332023-12-15T23:31:31.559Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.763 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:35:46.763 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.763 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.763 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.763 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.763 DEBUG:boto:Method: GET 2023-12-15T23:35:46.764 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.764 DEBUG:boto:Data: 2023-12-15T23:35:46.764 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.764 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.764 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.764 DEBUG:boto:Params: {} 2023-12-15T23:35:46.764 DEBUG:boto:Token: None 2023-12-15T23:35:46.764 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw= 2023-12-15T23:35:46.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw=', 'Content-Length': '0'} 2023-12-15T23:35:46.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e19359419b5e18b-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.767 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.767 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.768 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.768 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.768 DEBUG:boto:Method: GET 2023-12-15T23:35:46.768 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.768 DEBUG:boto:Data: 2023-12-15T23:35:46.768 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.768 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.768 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.768 DEBUG:boto:Params: {} 2023-12-15T23:35:46.768 DEBUG:boto:Token: None 2023-12-15T23:35:46.769 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.769 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw= 2023-12-15T23:35:46.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw=', 'Content-Length': '0'} 2023-12-15T23:35:46.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047b568748ee51f53-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.771 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.771 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.771 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.771 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.772 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.772 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.772 DEBUG:boto:Data: 2023-12-15T23:35:46.772 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.772 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.772 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.772 DEBUG:boto:Params: {} 2023-12-15T23:35:46.772 DEBUG:boto:Token: None 2023-12-15T23:35:46.772 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.773 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ila7Brpiw1PH83Nrk3sOLcPnxMU= 2023-12-15T23:35:46.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ila7Brpiw1PH83Nrk3sOLcPnxMU=', 'Content-Length': '0'} 2023-12-15T23:35:46.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000306f1f2e5d1483eb-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.775 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.776 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.776 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.776 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.776 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.776 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.776 DEBUG:boto:Data: 2023-12-15T23:35:46.776 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.776 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.776 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.777 DEBUG:boto:Params: {} 2023-12-15T23:35:46.777 DEBUG:boto:Token: None 2023-12-15T23:35:46.777 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.777 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ila7Brpiw1PH83Nrk3sOLcPnxMU= 2023-12-15T23:35:46.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ila7Brpiw1PH83Nrk3sOLcPnxMU=', 'Content-Length': '0'} 2023-12-15T23:35:46.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000738bafc3615397c6-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.779 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:35:46.779 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.780 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.780 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.780 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.780 DEBUG:boto:Method: GET 2023-12-15T23:35:46.780 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.780 DEBUG:boto:Data: 2023-12-15T23:35:46.780 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.780 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.780 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.780 DEBUG:boto:Params: {} 2023-12-15T23:35:46.780 DEBUG:boto:Token: None 2023-12-15T23:35:46.781 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.781 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw= 2023-12-15T23:35:46.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw=', 'Content-Length': '0'} 2023-12-15T23:35:46.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cb0acbad37756c9-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.829 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.829 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.830 DEBUG:boto:path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.830 DEBUG:boto:auth_path=/kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.830 DEBUG:boto:Method: GET 2023-12-15T23:35:46.830 DEBUG:boto:Path: /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.830 DEBUG:boto:Data: 2023-12-15T23:35:46.830 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.830 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.830 DEBUG:boto:Params: {} 2023-12-15T23:35:46.830 DEBUG:boto:Token: None 2023-12-15T23:35:46.831 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34?versionId=null 2023-12-15T23:35:46.831 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw= 2023-12-15T23:35:46.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:+iNFW/412xfFwmgIC4Hlh0Q7dRw=', 'Content-Length': '0'} 2023-12-15T23:35:46.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062975f2df5777905-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.833 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.833 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.833 DEBUG:boto:path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.833 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.833 DEBUG:boto:Method: GET 2023-12-15T23:35:46.834 DEBUG:boto:Path: /kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.834 DEBUG:boto:Data: 2023-12-15T23:35:46.834 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.834 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.834 DEBUG:boto:Params: {} 2023-12-15T23:35:46.834 DEBUG:boto:Token: None 2023-12-15T23:35:46.834 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.834 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.836 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee596e8da9702405-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.837 DEBUG:boto:b'kskgfn-51obj341000falseobj342023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.837 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.837 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.837 DEBUG:boto:path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.837 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.837 DEBUG:boto:Method: GET 2023-12-15T23:35:46.838 DEBUG:boto:Path: /kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.838 DEBUG:boto:Data: 2023-12-15T23:35:46.838 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.838 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.838 DEBUG:boto:Params: {} 2023-12-15T23:35:46.838 DEBUG:boto:Token: None 2023-12-15T23:35:46.838 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009af6735ce8485a60-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.842 DEBUG:boto:b'kskgfn-51obj341000falseobj342023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.842 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.842 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.843 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.843 DEBUG:boto:Path: /kskgfn-51/obj34 2023-12-15T23:35:46.843 DEBUG:boto:Data: 2023-12-15T23:35:46.843 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.843 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.843 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.843 DEBUG:boto:Params: {} 2023-12-15T23:35:46.843 DEBUG:boto:Token: None 2023-12-15T23:35:46.843 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34 2023-12-15T23:35:46.844 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hRJUis4ohxZyOJLVNQZTnH52u0k= 2023-12-15T23:35:46.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hRJUis4ohxZyOJLVNQZTnH52u0k=', 'Content-Length': '0'} 2023-12-15T23:35:46.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ba0ec9ef59b799a-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.846 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.846 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.846 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.846 DEBUG:boto:Path: /kskgfn-51/obj34 2023-12-15T23:35:46.846 DEBUG:boto:Data: 2023-12-15T23:35:46.847 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.847 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.847 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.847 DEBUG:boto:Params: {} 2023-12-15T23:35:46.847 DEBUG:boto:Token: None 2023-12-15T23:35:46.847 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34 2023-12-15T23:35:46.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hRJUis4ohxZyOJLVNQZTnH52u0k= 2023-12-15T23:35:46.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hRJUis4ohxZyOJLVNQZTnH52u0k=', 'Content-Length': '0'} 2023-12-15T23:35:46.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cfbb0c30c3636ed-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2023-12-15T23:35:46.852 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.852 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.852 DEBUG:boto:Method: GET 2023-12-15T23:35:46.852 DEBUG:boto:Path: /kskgfn-51/obj34 2023-12-15T23:35:46.853 DEBUG:boto:Data: 2023-12-15T23:35:46.853 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.853 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.853 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.853 DEBUG:boto:Params: {} 2023-12-15T23:35:46.853 DEBUG:boto:Token: None 2023-12-15T23:35:46.853 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34 2023-12-15T23:35:46.853 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HOk04fybUJMG2Yfbq/EqH4mia1Q= 2023-12-15T23:35:46.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HOk04fybUJMG2Yfbq/EqH4mia1Q=', 'Content-Length': '0'} 2023-12-15T23:35:46.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000549f886a98ed4bae-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.856 DEBUG:boto:path=/kskgfn-51/obj34 2023-12-15T23:35:46.856 DEBUG:boto:auth_path=/kskgfn-51/obj34 2023-12-15T23:35:46.856 DEBUG:boto:Method: GET 2023-12-15T23:35:46.856 DEBUG:boto:Path: /kskgfn-51/obj34 2023-12-15T23:35:46.856 DEBUG:boto:Data: 2023-12-15T23:35:46.856 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.856 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.856 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.856 DEBUG:boto:Params: {} 2023-12-15T23:35:46.857 DEBUG:boto:Token: None 2023-12-15T23:35:46.857 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj34 2023-12-15T23:35:46.857 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HOk04fybUJMG2Yfbq/EqH4mia1Q= 2023-12-15T23:35:46.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HOk04fybUJMG2Yfbq/EqH4mia1Q=', 'Content-Length': '0'} 2023-12-15T23:35:46.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000674a7b33f894eb39-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.859 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.859 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.859 DEBUG:boto:path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.860 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.860 DEBUG:boto:Method: GET 2023-12-15T23:35:46.860 DEBUG:boto:Path: /kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.860 DEBUG:boto:Data: 2023-12-15T23:35:46.860 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.860 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.860 DEBUG:boto:Params: {} 2023-12-15T23:35:46.860 DEBUG:boto:Token: None 2023-12-15T23:35:46.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.861 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a74674ed683f8ae-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.863 DEBUG:boto:b'kskgfn-51obj341000falseobj342023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.863 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.864 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.864 DEBUG:boto:path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.864 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.864 DEBUG:boto:Method: GET 2023-12-15T23:35:46.864 DEBUG:boto:Path: /kskgfn-51/?prefix=obj34 2023-12-15T23:35:46.864 DEBUG:boto:Data: 2023-12-15T23:35:46.864 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.864 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.864 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.864 DEBUG:boto:Params: {} 2023-12-15T23:35:46.865 DEBUG:boto:Token: None 2023-12-15T23:35:46.865 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.865 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3a916cd958f1916-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.868 DEBUG:boto:b'kskgfn-51obj341000falseobj342023-12-15T23:31:31.792Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:35:46.869 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.869 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.869 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.869 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.869 DEBUG:boto:Method: GET 2023-12-15T23:35:46.869 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.870 DEBUG:boto:Data: 2023-12-15T23:35:46.870 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.870 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.870 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.870 DEBUG:boto:Params: {} 2023-12-15T23:35:46.870 DEBUG:boto:Token: None 2023-12-15T23:35:46.870 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.870 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU= 2023-12-15T23:35:46.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU=', 'Content-Length': '0'} 2023-12-15T23:35:46.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4c6f5601116daf6-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.913 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.913 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.914 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.914 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.914 DEBUG:boto:Method: GET 2023-12-15T23:35:46.914 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.914 DEBUG:boto:Data: 2023-12-15T23:35:46.914 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.914 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.914 DEBUG:boto:Params: {} 2023-12-15T23:35:46.915 DEBUG:boto:Token: None 2023-12-15T23:35:46.915 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU= 2023-12-15T23:35:46.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU=', 'Content-Length': '0'} 2023-12-15T23:35:46.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f53c9e4e688bbbe0-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.917 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.917 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.917 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.917 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.917 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.917 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.918 DEBUG:boto:Data: 2023-12-15T23:35:46.918 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.918 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.918 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.918 DEBUG:boto:Params: {} 2023-12-15T23:35:46.918 DEBUG:boto:Token: None 2023-12-15T23:35:46.918 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.918 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1hkpEZ0R8D28r7Qw1Nxw9qd7sUc= 2023-12-15T23:35:46.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1hkpEZ0R8D28r7Qw1Nxw9qd7sUc=', 'Content-Length': '0'} 2023-12-15T23:35:46.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd6f7084c8cd64f2-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.920 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.921 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.921 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.921 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.921 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.921 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.921 DEBUG:boto:Data: 2023-12-15T23:35:46.921 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.921 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.921 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.921 DEBUG:boto:Params: {} 2023-12-15T23:35:46.922 DEBUG:boto:Token: None 2023-12-15T23:35:46.922 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.922 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1hkpEZ0R8D28r7Qw1Nxw9qd7sUc= 2023-12-15T23:35:46.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1hkpEZ0R8D28r7Qw1Nxw9qd7sUc=', 'Content-Length': '0'} 2023-12-15T23:35:46.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b32548f9dd27f2c-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:35:46.924 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.924 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.925 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.925 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.925 DEBUG:boto:Method: GET 2023-12-15T23:35:46.925 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.925 DEBUG:boto:Data: 2023-12-15T23:35:46.925 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.925 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.925 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.925 DEBUG:boto:Params: {} 2023-12-15T23:35:46.925 DEBUG:boto:Token: None 2023-12-15T23:35:46.926 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU= 2023-12-15T23:35:46.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU=', 'Content-Length': '0'} 2023-12-15T23:35:46.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047aec842a9013ad8-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.928 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.928 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.928 DEBUG:boto:path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.928 DEBUG:boto:auth_path=/kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.928 DEBUG:boto:Method: GET 2023-12-15T23:35:46.928 DEBUG:boto:Path: /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.928 DEBUG:boto:Data: 2023-12-15T23:35:46.928 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.929 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.929 DEBUG:boto:Params: {} 2023-12-15T23:35:46.929 DEBUG:boto:Token: None 2023-12-15T23:35:46.929 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37?versionId=null 2023-12-15T23:35:46.929 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU= 2023-12-15T23:35:46.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Y+d6oX/HajsUoKg8F5fbHgqM6TU=', 'Content-Length': '0'} 2023-12-15T23:35:46.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aacc73adfe4e36ae-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.931 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.931 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.932 DEBUG:boto:path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.932 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.932 DEBUG:boto:Method: GET 2023-12-15T23:35:46.932 DEBUG:boto:Path: /kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.932 DEBUG:boto:Data: 2023-12-15T23:35:46.932 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.932 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.932 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.932 DEBUG:boto:Params: {} 2023-12-15T23:35:46.932 DEBUG:boto:Token: None 2023-12-15T23:35:46.932 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6889ebcccbbb41e-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.936 DEBUG:boto:b'kskgfn-51obj371000falseobj372023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.936 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.936 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.936 DEBUG:boto:path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.936 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.936 DEBUG:boto:Method: GET 2023-12-15T23:35:46.936 DEBUG:boto:Path: /kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.937 DEBUG:boto:Data: 2023-12-15T23:35:46.937 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.937 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.937 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.937 DEBUG:boto:Params: {} 2023-12-15T23:35:46.937 DEBUG:boto:Token: None 2023-12-15T23:35:46.937 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.937 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.940 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038a740bbf679a7c0-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.941 DEBUG:boto:b'kskgfn-51obj371000falseobj372023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.941 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.941 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.941 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.941 DEBUG:boto:Path: /kskgfn-51/obj37 2023-12-15T23:35:46.941 DEBUG:boto:Data: 2023-12-15T23:35:46.941 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.942 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.942 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.942 DEBUG:boto:Params: {} 2023-12-15T23:35:46.942 DEBUG:boto:Token: None 2023-12-15T23:35:46.942 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37 2023-12-15T23:35:46.942 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hg6/iCotxGJ3MQrkB9DQ0Mh3WqA= 2023-12-15T23:35:46.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hg6/iCotxGJ3MQrkB9DQ0Mh3WqA=', 'Content-Length': '0'} 2023-12-15T23:35:46.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c767d657c6be0be-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.944 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.944 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.945 DEBUG:boto:Method: HEAD 2023-12-15T23:35:46.945 DEBUG:boto:Path: /kskgfn-51/obj37 2023-12-15T23:35:46.945 DEBUG:boto:Data: 2023-12-15T23:35:46.945 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.945 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.945 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.945 DEBUG:boto:Params: {} 2023-12-15T23:35:46.945 DEBUG:boto:Token: None 2023-12-15T23:35:46.945 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37 2023-12-15T23:35:46.946 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:hg6/iCotxGJ3MQrkB9DQ0Mh3WqA= 2023-12-15T23:35:46.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:hg6/iCotxGJ3MQrkB9DQ0Mh3WqA=', 'Content-Length': '0'} 2023-12-15T23:35:46.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e4bc2e486a2aade-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2023-12-15T23:35:46.948 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.948 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.948 DEBUG:boto:Method: GET 2023-12-15T23:35:46.948 DEBUG:boto:Path: /kskgfn-51/obj37 2023-12-15T23:35:46.948 DEBUG:boto:Data: 2023-12-15T23:35:46.948 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.948 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.948 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.949 DEBUG:boto:Params: {} 2023-12-15T23:35:46.949 DEBUG:boto:Token: None 2023-12-15T23:35:46.949 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37 2023-12-15T23:35:46.949 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MQN3FVAaH2Apiq090A3omUmojRo= 2023-12-15T23:35:46.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MQN3FVAaH2Apiq090A3omUmojRo=', 'Content-Length': '0'} 2023-12-15T23:35:46.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e453303311b9c414-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.951 DEBUG:boto:path=/kskgfn-51/obj37 2023-12-15T23:35:46.951 DEBUG:boto:auth_path=/kskgfn-51/obj37 2023-12-15T23:35:46.952 DEBUG:boto:Method: GET 2023-12-15T23:35:46.952 DEBUG:boto:Path: /kskgfn-51/obj37 2023-12-15T23:35:46.952 DEBUG:boto:Data: 2023-12-15T23:35:46.952 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.952 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.952 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.952 DEBUG:boto:Params: {} 2023-12-15T23:35:46.952 DEBUG:boto:Token: None 2023-12-15T23:35:46.952 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/obj37 2023-12-15T23:35:46.953 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MQN3FVAaH2Apiq090A3omUmojRo= 2023-12-15T23:35:46.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MQN3FVAaH2Apiq090A3omUmojRo=', 'Content-Length': '0'} 2023-12-15T23:35:46.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bace29657ec9b4a4-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.955 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.955 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.955 DEBUG:boto:path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.955 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.955 DEBUG:boto:Method: GET 2023-12-15T23:35:46.955 DEBUG:boto:Path: /kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.955 DEBUG:boto:Data: 2023-12-15T23:35:46.955 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.956 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:46.956 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.956 DEBUG:boto:Params: {} 2023-12-15T23:35:46.956 DEBUG:boto:Token: None 2023-12-15T23:35:46.956 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.956 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.958 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ddd15f18424b5a7-00657ce2d2-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:46.959 DEBUG:boto:b'kskgfn-51obj371000falseobj372023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:46.959 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:46.959 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:46.959 DEBUG:boto:path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.959 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.959 DEBUG:boto:Method: GET 2023-12-15T23:35:46.960 DEBUG:boto:Path: /kskgfn-51/?prefix=obj37 2023-12-15T23:35:46.960 DEBUG:boto:Data: 2023-12-15T23:35:46.960 DEBUG:boto:Headers: {} 2023-12-15T23:35:46.960 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:46.960 DEBUG:boto:Port: 8000 2023-12-15T23:35:46.960 DEBUG:boto:Params: {} 2023-12-15T23:35:46.960 DEBUG:boto:Token: None 2023-12-15T23:35:46.960 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:46 GMT /kskgfn-51/ 2023-12-15T23:35:46.960 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE= 2023-12-15T23:35:46.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:46 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:E+X/8TMl9aaOd8viIwoMrj1xlFE=', 'Content-Length': '0'} 2023-12-15T23:35:46.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c26f480ca60c910a-00657ce2d2-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:46 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.009 DEBUG:boto:b'kskgfn-51obj371000falseobj372023-12-15T23:31:33.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:35:47.010 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.010 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.010 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.010 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.010 DEBUG:boto:Method: GET 2023-12-15T23:35:47.010 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.010 DEBUG:boto:Data: 2023-12-15T23:35:47.010 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.011 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.011 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.011 DEBUG:boto:Params: {} 2023-12-15T23:35:47.011 DEBUG:boto:Token: None 2023-12-15T23:35:47.011 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.011 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw= 2023-12-15T23:35:47.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw=', 'Content-Length': '0'} 2023-12-15T23:35:47.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d950856a058f3e09-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.014 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.014 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.014 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.014 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.014 DEBUG:boto:Method: GET 2023-12-15T23:35:47.014 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.014 DEBUG:boto:Data: 2023-12-15T23:35:47.014 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.015 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.015 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.015 DEBUG:boto:Params: {} 2023-12-15T23:35:47.015 DEBUG:boto:Token: None 2023-12-15T23:35:47.015 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.015 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw= 2023-12-15T23:35:47.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw=', 'Content-Length': '0'} 2023-12-15T23:35:47.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e3c12031a96772e-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.017 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.017 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.018 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.018 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.018 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.018 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.018 DEBUG:boto:Data: 2023-12-15T23:35:47.018 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.018 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.018 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.018 DEBUG:boto:Params: {} 2023-12-15T23:35:47.019 DEBUG:boto:Token: None 2023-12-15T23:35:47.019 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.019 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M9PMfiafmsqjdF2RL8Qf2y2vaTo= 2023-12-15T23:35:47.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M9PMfiafmsqjdF2RL8Qf2y2vaTo=', 'Content-Length': '0'} 2023-12-15T23:35:47.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ce26106511710b7-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.021 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.021 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.021 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.021 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.021 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.021 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.021 DEBUG:boto:Data: 2023-12-15T23:35:47.021 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.021 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.022 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.022 DEBUG:boto:Params: {} 2023-12-15T23:35:47.022 DEBUG:boto:Token: None 2023-12-15T23:35:47.022 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.022 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:M9PMfiafmsqjdF2RL8Qf2y2vaTo= 2023-12-15T23:35:47.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:M9PMfiafmsqjdF2RL8Qf2y2vaTo=', 'Content-Length': '0'} 2023-12-15T23:35:47.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d67211c85c1ea04-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:35:47.024 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.024 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.025 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.025 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.025 DEBUG:boto:Method: GET 2023-12-15T23:35:47.025 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.025 DEBUG:boto:Data: 2023-12-15T23:35:47.025 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.025 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.025 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.025 DEBUG:boto:Params: {} 2023-12-15T23:35:47.026 DEBUG:boto:Token: None 2023-12-15T23:35:47.026 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw= 2023-12-15T23:35:47.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw=', 'Content-Length': '0'} 2023-12-15T23:35:47.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4373cabbc0601b4-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.069 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.070 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.070 DEBUG:boto:path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.070 DEBUG:boto:auth_path=/kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.070 DEBUG:boto:Method: GET 2023-12-15T23:35:47.070 DEBUG:boto:Path: /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.070 DEBUG:boto:Data: 2023-12-15T23:35:47.070 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.070 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.070 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.070 DEBUG:boto:Params: {} 2023-12-15T23:35:47.070 DEBUG:boto:Token: None 2023-12-15T23:35:47.071 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38?versionId=null 2023-12-15T23:35:47.071 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw= 2023-12-15T23:35:47.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CI8RPqLgbNCBL5jhVursGU1zCpw=', 'Content-Length': '0'} 2023-12-15T23:35:47.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016454b556594dfb5-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.073 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.073 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.073 DEBUG:boto:path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.074 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.074 DEBUG:boto:Method: GET 2023-12-15T23:35:47.074 DEBUG:boto:Path: /kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.074 DEBUG:boto:Data: 2023-12-15T23:35:47.074 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.074 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.074 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.074 DEBUG:boto:Params: {} 2023-12-15T23:35:47.074 DEBUG:boto:Token: None 2023-12-15T23:35:47.074 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.075 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.077 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099f159a280a479eb-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.077 DEBUG:boto:b'kskgfn-51obj381000falseobj382023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.077 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.078 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.078 DEBUG:boto:path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.078 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.078 DEBUG:boto:Method: GET 2023-12-15T23:35:47.078 DEBUG:boto:Path: /kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.078 DEBUG:boto:Data: 2023-12-15T23:35:47.078 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.078 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.078 DEBUG:boto:Params: {} 2023-12-15T23:35:47.079 DEBUG:boto:Token: None 2023-12-15T23:35:47.079 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001032650e7848774-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.083 DEBUG:boto:b'kskgfn-51obj381000falseobj382023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.083 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.083 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.083 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.083 DEBUG:boto:Path: /kskgfn-51/obj38 2023-12-15T23:35:47.083 DEBUG:boto:Data: 2023-12-15T23:35:47.083 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.083 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.084 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.084 DEBUG:boto:Params: {} 2023-12-15T23:35:47.084 DEBUG:boto:Token: None 2023-12-15T23:35:47.084 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38 2023-12-15T23:35:47.084 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FtkofK4f597OCynM5Th86SpIw2g= 2023-12-15T23:35:47.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FtkofK4f597OCynM5Th86SpIw2g=', 'Content-Length': '0'} 2023-12-15T23:35:47.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000236734088b760b91-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.086 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.086 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.086 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.086 DEBUG:boto:Path: /kskgfn-51/obj38 2023-12-15T23:35:47.086 DEBUG:boto:Data: 2023-12-15T23:35:47.087 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.087 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.087 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.087 DEBUG:boto:Params: {} 2023-12-15T23:35:47.087 DEBUG:boto:Token: None 2023-12-15T23:35:47.087 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38 2023-12-15T23:35:47.087 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FtkofK4f597OCynM5Th86SpIw2g= 2023-12-15T23:35:47.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FtkofK4f597OCynM5Th86SpIw2g=', 'Content-Length': '0'} 2023-12-15T23:35:47.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a278fe22e108964-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2023-12-15T23:35:47.089 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.089 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.090 DEBUG:boto:Method: GET 2023-12-15T23:35:47.090 DEBUG:boto:Path: /kskgfn-51/obj38 2023-12-15T23:35:47.090 DEBUG:boto:Data: 2023-12-15T23:35:47.090 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.090 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.090 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.090 DEBUG:boto:Params: {} 2023-12-15T23:35:47.090 DEBUG:boto:Token: None 2023-12-15T23:35:47.090 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38 2023-12-15T23:35:47.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/Lnuu4ZKdzuEs5Q3DxnCm2BF9/o= 2023-12-15T23:35:47.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/Lnuu4ZKdzuEs5Q3DxnCm2BF9/o=', 'Content-Length': '0'} 2023-12-15T23:35:47.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e3cb697cefefdca-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.093 DEBUG:boto:path=/kskgfn-51/obj38 2023-12-15T23:35:47.093 DEBUG:boto:auth_path=/kskgfn-51/obj38 2023-12-15T23:35:47.093 DEBUG:boto:Method: GET 2023-12-15T23:35:47.093 DEBUG:boto:Path: /kskgfn-51/obj38 2023-12-15T23:35:47.093 DEBUG:boto:Data: 2023-12-15T23:35:47.093 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.094 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.094 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.094 DEBUG:boto:Params: {} 2023-12-15T23:35:47.094 DEBUG:boto:Token: None 2023-12-15T23:35:47.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj38 2023-12-15T23:35:47.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/Lnuu4ZKdzuEs5Q3DxnCm2BF9/o= 2023-12-15T23:35:47.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/Lnuu4ZKdzuEs5Q3DxnCm2BF9/o=', 'Content-Length': '0'} 2023-12-15T23:35:47.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b83bf32deec79f76-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.096 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.096 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.096 DEBUG:boto:path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.096 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.097 DEBUG:boto:Method: GET 2023-12-15T23:35:47.097 DEBUG:boto:Path: /kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.097 DEBUG:boto:Data: 2023-12-15T23:35:47.097 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.097 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.097 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.097 DEBUG:boto:Params: {} 2023-12-15T23:35:47.097 DEBUG:boto:Token: None 2023-12-15T23:35:47.097 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.097 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004082feb3ae34c327-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.100 DEBUG:boto:b'kskgfn-51obj381000falseobj382023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.100 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.100 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.100 DEBUG:boto:path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.100 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.101 DEBUG:boto:Method: GET 2023-12-15T23:35:47.101 DEBUG:boto:Path: /kskgfn-51/?prefix=obj38 2023-12-15T23:35:47.101 DEBUG:boto:Data: 2023-12-15T23:35:47.101 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.101 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.101 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.101 DEBUG:boto:Params: {} 2023-12-15T23:35:47.101 DEBUG:boto:Token: None 2023-12-15T23:35:47.101 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.102 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.105 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029fa065713850880-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.105 DEBUG:boto:b'kskgfn-51obj381000falseobj382023-12-15T23:31:32.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:35:47.106 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.106 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.106 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.106 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.106 DEBUG:boto:Method: GET 2023-12-15T23:35:47.106 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.106 DEBUG:boto:Data: 2023-12-15T23:35:47.106 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.106 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.106 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.107 DEBUG:boto:Params: {} 2023-12-15T23:35:47.107 DEBUG:boto:Token: None 2023-12-15T23:35:47.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY= 2023-12-15T23:35:47.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY=', 'Content-Length': '0'} 2023-12-15T23:35:47.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eee95571762f8e81-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.109 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.109 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.110 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.110 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.110 DEBUG:boto:Method: GET 2023-12-15T23:35:47.110 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.110 DEBUG:boto:Data: 2023-12-15T23:35:47.110 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.110 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.110 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.110 DEBUG:boto:Params: {} 2023-12-15T23:35:47.110 DEBUG:boto:Token: None 2023-12-15T23:35:47.110 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY= 2023-12-15T23:35:47.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY=', 'Content-Length': '0'} 2023-12-15T23:35:47.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030f2d7fb6ab8d6b4-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.113 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.113 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.113 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.113 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.113 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.113 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.113 DEBUG:boto:Data: 2023-12-15T23:35:47.113 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.113 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.113 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.114 DEBUG:boto:Params: {} 2023-12-15T23:35:47.114 DEBUG:boto:Token: None 2023-12-15T23:35:47.114 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.114 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pA8F2RzOL4FOTbu4TThRVY/mZw8= 2023-12-15T23:35:47.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pA8F2RzOL4FOTbu4TThRVY/mZw8=', 'Content-Length': '0'} 2023-12-15T23:35:47.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c023297b886c651-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.116 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.116 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.116 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.117 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.117 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.117 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.117 DEBUG:boto:Data: 2023-12-15T23:35:47.117 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.117 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.117 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.117 DEBUG:boto:Params: {} 2023-12-15T23:35:47.117 DEBUG:boto:Token: None 2023-12-15T23:35:47.118 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.118 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pA8F2RzOL4FOTbu4TThRVY/mZw8= 2023-12-15T23:35:47.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pA8F2RzOL4FOTbu4TThRVY/mZw8=', 'Content-Length': '0'} 2023-12-15T23:35:47.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005575d93502384693-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:35:47.120 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.120 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.120 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.120 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.120 DEBUG:boto:Method: GET 2023-12-15T23:35:47.121 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.121 DEBUG:boto:Data: 2023-12-15T23:35:47.121 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.121 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.121 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.121 DEBUG:boto:Params: {} 2023-12-15T23:35:47.121 DEBUG:boto:Token: None 2023-12-15T23:35:47.121 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.121 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY= 2023-12-15T23:35:47.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY=', 'Content-Length': '0'} 2023-12-15T23:35:47.123 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009251bb511e7cfa0a-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.124 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.124 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.124 DEBUG:boto:path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.124 DEBUG:boto:auth_path=/kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.124 DEBUG:boto:Method: GET 2023-12-15T23:35:47.124 DEBUG:boto:Path: /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.124 DEBUG:boto:Data: 2023-12-15T23:35:47.124 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.124 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.125 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.125 DEBUG:boto:Params: {} 2023-12-15T23:35:47.125 DEBUG:boto:Token: None 2023-12-15T23:35:47.125 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44?versionId=null 2023-12-15T23:35:47.125 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY= 2023-12-15T23:35:47.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WKYymMnPFSb019W4r9i9dWTThQY=', 'Content-Length': '0'} 2023-12-15T23:35:47.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d05c41d4705e2b23-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.128 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.128 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.128 DEBUG:boto:path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.128 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.128 DEBUG:boto:Method: GET 2023-12-15T23:35:47.128 DEBUG:boto:Path: /kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.129 DEBUG:boto:Data: 2023-12-15T23:35:47.129 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.129 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.129 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.129 DEBUG:boto:Params: {} 2023-12-15T23:35:47.129 DEBUG:boto:Token: None 2023-12-15T23:35:47.129 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.129 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3290b53caac073e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.132 DEBUG:boto:b'kskgfn-51obj441000falseobj442023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.132 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.132 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.132 DEBUG:boto:path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.132 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.133 DEBUG:boto:Method: GET 2023-12-15T23:35:47.133 DEBUG:boto:Path: /kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.133 DEBUG:boto:Data: 2023-12-15T23:35:47.133 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.133 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.133 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.133 DEBUG:boto:Params: {} 2023-12-15T23:35:47.133 DEBUG:boto:Token: None 2023-12-15T23:35:47.133 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.134 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000807cbcb578a17aa7-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.138 DEBUG:boto:b'kskgfn-51obj441000falseobj442023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.138 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.138 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.138 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.138 DEBUG:boto:Path: /kskgfn-51/obj44 2023-12-15T23:35:47.138 DEBUG:boto:Data: 2023-12-15T23:35:47.138 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.138 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.139 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.139 DEBUG:boto:Params: {} 2023-12-15T23:35:47.139 DEBUG:boto:Token: None 2023-12-15T23:35:47.139 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44 2023-12-15T23:35:47.139 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:plCGY1lLQffKB3LPseO3UsjhyJ4= 2023-12-15T23:35:47.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:plCGY1lLQffKB3LPseO3UsjhyJ4=', 'Content-Length': '0'} 2023-12-15T23:35:47.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019c4f3993b9652f4-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.141 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.141 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.142 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.142 DEBUG:boto:Path: /kskgfn-51/obj44 2023-12-15T23:35:47.142 DEBUG:boto:Data: 2023-12-15T23:35:47.142 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.142 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.142 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.142 DEBUG:boto:Params: {} 2023-12-15T23:35:47.142 DEBUG:boto:Token: None 2023-12-15T23:35:47.142 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44 2023-12-15T23:35:47.143 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:plCGY1lLQffKB3LPseO3UsjhyJ4= 2023-12-15T23:35:47.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:plCGY1lLQffKB3LPseO3UsjhyJ4=', 'Content-Length': '0'} 2023-12-15T23:35:47.144 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000434eaea1381c292c-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2023-12-15T23:35:47.145 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.145 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.145 DEBUG:boto:Method: GET 2023-12-15T23:35:47.145 DEBUG:boto:Path: /kskgfn-51/obj44 2023-12-15T23:35:47.145 DEBUG:boto:Data: 2023-12-15T23:35:47.145 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.145 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.145 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.146 DEBUG:boto:Params: {} 2023-12-15T23:35:47.146 DEBUG:boto:Token: None 2023-12-15T23:35:47.146 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44 2023-12-15T23:35:47.146 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3f3Nlqp88dr9NPZjM1jZol2f7QU= 2023-12-15T23:35:47.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3f3Nlqp88dr9NPZjM1jZol2f7QU=', 'Content-Length': '0'} 2023-12-15T23:35:47.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a7fdcb916ea1d8c-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.149 DEBUG:boto:path=/kskgfn-51/obj44 2023-12-15T23:35:47.149 DEBUG:boto:auth_path=/kskgfn-51/obj44 2023-12-15T23:35:47.149 DEBUG:boto:Method: GET 2023-12-15T23:35:47.149 DEBUG:boto:Path: /kskgfn-51/obj44 2023-12-15T23:35:47.149 DEBUG:boto:Data: 2023-12-15T23:35:47.149 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.149 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.149 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.149 DEBUG:boto:Params: {} 2023-12-15T23:35:47.150 DEBUG:boto:Token: None 2023-12-15T23:35:47.150 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj44 2023-12-15T23:35:47.150 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3f3Nlqp88dr9NPZjM1jZol2f7QU= 2023-12-15T23:35:47.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3f3Nlqp88dr9NPZjM1jZol2f7QU=', 'Content-Length': '0'} 2023-12-15T23:35:47.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045225f6892c35b37-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.197 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.198 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.198 DEBUG:boto:path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.198 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.198 DEBUG:boto:Method: GET 2023-12-15T23:35:47.198 DEBUG:boto:Path: /kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.198 DEBUG:boto:Data: 2023-12-15T23:35:47.198 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.198 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.198 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.198 DEBUG:boto:Params: {} 2023-12-15T23:35:47.199 DEBUG:boto:Token: None 2023-12-15T23:35:47.199 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.199 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ad62865d8954341-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.201 DEBUG:boto:b'kskgfn-51obj441000falseobj442023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.202 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.202 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.202 DEBUG:boto:path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.202 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.202 DEBUG:boto:Method: GET 2023-12-15T23:35:47.202 DEBUG:boto:Path: /kskgfn-51/?prefix=obj44 2023-12-15T23:35:47.202 DEBUG:boto:Data: 2023-12-15T23:35:47.203 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.203 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.203 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.203 DEBUG:boto:Params: {} 2023-12-15T23:35:47.203 DEBUG:boto:Token: None 2023-12-15T23:35:47.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6c5fcc0a595a20d-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.207 DEBUG:boto:b'kskgfn-51obj441000falseobj442023-12-15T23:31:31.571Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:35:47.208 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.208 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.208 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.208 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.208 DEBUG:boto:Method: GET 2023-12-15T23:35:47.208 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.208 DEBUG:boto:Data: 2023-12-15T23:35:47.208 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.208 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.209 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.209 DEBUG:boto:Params: {} 2023-12-15T23:35:47.209 DEBUG:boto:Token: None 2023-12-15T23:35:47.209 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.209 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to= 2023-12-15T23:35:47.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to=', 'Content-Length': '0'} 2023-12-15T23:35:47.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfe80c365756d100-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.253 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.253 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.254 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.254 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.254 DEBUG:boto:Method: GET 2023-12-15T23:35:47.254 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.254 DEBUG:boto:Data: 2023-12-15T23:35:47.254 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.254 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.254 DEBUG:boto:Params: {} 2023-12-15T23:35:47.254 DEBUG:boto:Token: None 2023-12-15T23:35:47.255 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.255 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to= 2023-12-15T23:35:47.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to=', 'Content-Length': '0'} 2023-12-15T23:35:47.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017dfa25dd6bb634f-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.257 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.257 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.257 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.257 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.258 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.258 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.258 DEBUG:boto:Data: 2023-12-15T23:35:47.258 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.258 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.258 DEBUG:boto:Params: {} 2023-12-15T23:35:47.258 DEBUG:boto:Token: None 2023-12-15T23:35:47.258 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p2GSlQ2F1HN/nR+RtrF7o1VG8d8= 2023-12-15T23:35:47.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p2GSlQ2F1HN/nR+RtrF7o1VG8d8=', 'Content-Length': '0'} 2023-12-15T23:35:47.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009353a107e19606f9-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.261 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.261 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.261 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.261 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.261 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.261 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.261 DEBUG:boto:Data: 2023-12-15T23:35:47.261 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.261 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.262 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.262 DEBUG:boto:Params: {} 2023-12-15T23:35:47.262 DEBUG:boto:Token: None 2023-12-15T23:35:47.262 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:p2GSlQ2F1HN/nR+RtrF7o1VG8d8= 2023-12-15T23:35:47.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:p2GSlQ2F1HN/nR+RtrF7o1VG8d8=', 'Content-Length': '0'} 2023-12-15T23:35:47.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091079697ce43b03e-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:35:47.265 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.265 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.265 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.266 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.266 DEBUG:boto:Method: GET 2023-12-15T23:35:47.266 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.266 DEBUG:boto:Data: 2023-12-15T23:35:47.266 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.266 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.266 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.266 DEBUG:boto:Params: {} 2023-12-15T23:35:47.266 DEBUG:boto:Token: None 2023-12-15T23:35:47.266 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.267 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to= 2023-12-15T23:35:47.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to=', 'Content-Length': '0'} 2023-12-15T23:35:47.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c70917fcafea8122-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.269 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.269 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.269 DEBUG:boto:path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.270 DEBUG:boto:auth_path=/kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.270 DEBUG:boto:Method: GET 2023-12-15T23:35:47.270 DEBUG:boto:Path: /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.270 DEBUG:boto:Data: 2023-12-15T23:35:47.270 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.270 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.270 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.270 DEBUG:boto:Params: {} 2023-12-15T23:35:47.270 DEBUG:boto:Token: None 2023-12-15T23:35:47.270 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46?versionId=null 2023-12-15T23:35:47.270 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to= 2023-12-15T23:35:47.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:pbG5wDk4OfWFfyaath2uwwLM1to=', 'Content-Length': '0'} 2023-12-15T23:35:47.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000273f1d51243f97f7-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.273 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.273 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.273 DEBUG:boto:path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.273 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.273 DEBUG:boto:Method: GET 2023-12-15T23:35:47.274 DEBUG:boto:Path: /kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.274 DEBUG:boto:Data: 2023-12-15T23:35:47.274 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.274 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.274 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.274 DEBUG:boto:Params: {} 2023-12-15T23:35:47.274 DEBUG:boto:Token: None 2023-12-15T23:35:47.274 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.274 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.276 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000143334de8adb7a2f-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.277 DEBUG:boto:b'kskgfn-51obj461000falseobj462023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.277 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.277 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.277 DEBUG:boto:path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.277 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.277 DEBUG:boto:Method: GET 2023-12-15T23:35:47.278 DEBUG:boto:Path: /kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.278 DEBUG:boto:Data: 2023-12-15T23:35:47.278 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.278 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.278 DEBUG:boto:Params: {} 2023-12-15T23:35:47.278 DEBUG:boto:Token: None 2023-12-15T23:35:47.278 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c408001cc261f74d-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.282 DEBUG:boto:b'kskgfn-51obj461000falseobj462023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.283 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.283 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.283 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.283 DEBUG:boto:Path: /kskgfn-51/obj46 2023-12-15T23:35:47.283 DEBUG:boto:Data: 2023-12-15T23:35:47.283 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.283 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.283 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.283 DEBUG:boto:Params: {} 2023-12-15T23:35:47.284 DEBUG:boto:Token: None 2023-12-15T23:35:47.284 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46 2023-12-15T23:35:47.284 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VHSsqt/yzk6q5raTX/OYVzwO3CA= 2023-12-15T23:35:47.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VHSsqt/yzk6q5raTX/OYVzwO3CA=', 'Content-Length': '0'} 2023-12-15T23:35:47.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebc82b77161e3962-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.286 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.286 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.287 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.287 DEBUG:boto:Path: /kskgfn-51/obj46 2023-12-15T23:35:47.287 DEBUG:boto:Data: 2023-12-15T23:35:47.287 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.287 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.287 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.287 DEBUG:boto:Params: {} 2023-12-15T23:35:47.287 DEBUG:boto:Token: None 2023-12-15T23:35:47.287 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46 2023-12-15T23:35:47.287 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:VHSsqt/yzk6q5raTX/OYVzwO3CA= 2023-12-15T23:35:47.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:VHSsqt/yzk6q5raTX/OYVzwO3CA=', 'Content-Length': '0'} 2023-12-15T23:35:47.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e13bb7e5aa615201-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2023-12-15T23:35:47.290 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.290 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.290 DEBUG:boto:Method: GET 2023-12-15T23:35:47.290 DEBUG:boto:Path: /kskgfn-51/obj46 2023-12-15T23:35:47.290 DEBUG:boto:Data: 2023-12-15T23:35:47.290 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.290 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.291 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.291 DEBUG:boto:Params: {} 2023-12-15T23:35:47.291 DEBUG:boto:Token: None 2023-12-15T23:35:47.291 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46 2023-12-15T23:35:47.291 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k+fdF/ovtpn9uMZejUSL2k0TFr4= 2023-12-15T23:35:47.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k+fdF/ovtpn9uMZejUSL2k0TFr4=', 'Content-Length': '0'} 2023-12-15T23:35:47.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b141c6e665ce3523-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.293 DEBUG:boto:path=/kskgfn-51/obj46 2023-12-15T23:35:47.294 DEBUG:boto:auth_path=/kskgfn-51/obj46 2023-12-15T23:35:47.294 DEBUG:boto:Method: GET 2023-12-15T23:35:47.294 DEBUG:boto:Path: /kskgfn-51/obj46 2023-12-15T23:35:47.294 DEBUG:boto:Data: 2023-12-15T23:35:47.294 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.294 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.294 DEBUG:boto:Params: {} 2023-12-15T23:35:47.294 DEBUG:boto:Token: None 2023-12-15T23:35:47.295 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj46 2023-12-15T23:35:47.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:k+fdF/ovtpn9uMZejUSL2k0TFr4= 2023-12-15T23:35:47.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:k+fdF/ovtpn9uMZejUSL2k0TFr4=', 'Content-Length': '0'} 2023-12-15T23:35:47.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0391c8a8a1fd112-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.337 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.337 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.338 DEBUG:boto:path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.338 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.338 DEBUG:boto:Method: GET 2023-12-15T23:35:47.338 DEBUG:boto:Path: /kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.338 DEBUG:boto:Data: 2023-12-15T23:35:47.338 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.338 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.338 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.338 DEBUG:boto:Params: {} 2023-12-15T23:35:47.338 DEBUG:boto:Token: None 2023-12-15T23:35:47.339 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.339 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005740ee14729aaf85-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.341 DEBUG:boto:b'kskgfn-51obj461000falseobj462023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.342 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.342 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.342 DEBUG:boto:path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.342 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.342 DEBUG:boto:Method: GET 2023-12-15T23:35:47.342 DEBUG:boto:Path: /kskgfn-51/?prefix=obj46 2023-12-15T23:35:47.342 DEBUG:boto:Data: 2023-12-15T23:35:47.342 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.342 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.343 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.343 DEBUG:boto:Params: {} 2023-12-15T23:35:47.343 DEBUG:boto:Token: None 2023-12-15T23:35:47.343 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.343 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.347 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cdf7f6c76d01c99-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.347 DEBUG:boto:b'kskgfn-51obj461000falseobj462023-12-15T23:31:32.369Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:35:47.347 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.347 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.347 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.347 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.348 DEBUG:boto:Method: GET 2023-12-15T23:35:47.348 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.348 DEBUG:boto:Data: 2023-12-15T23:35:47.348 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.348 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.348 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.348 DEBUG:boto:Params: {} 2023-12-15T23:35:47.348 DEBUG:boto:Token: None 2023-12-15T23:35:47.349 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.349 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y= 2023-12-15T23:35:47.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y=', 'Content-Length': '0'} 2023-12-15T23:35:47.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000198fbf3ff26b645e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.351 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.351 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.351 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.351 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.351 DEBUG:boto:Method: GET 2023-12-15T23:35:47.351 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.351 DEBUG:boto:Data: 2023-12-15T23:35:47.352 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.352 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.352 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.352 DEBUG:boto:Params: {} 2023-12-15T23:35:47.352 DEBUG:boto:Token: None 2023-12-15T23:35:47.352 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.352 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y= 2023-12-15T23:35:47.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y=', 'Content-Length': '0'} 2023-12-15T23:35:47.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a987e0b389458978-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.355 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.355 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.355 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.355 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.355 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.355 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.355 DEBUG:boto:Data: 2023-12-15T23:35:47.355 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.355 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.355 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.355 DEBUG:boto:Params: {} 2023-12-15T23:35:47.356 DEBUG:boto:Token: None 2023-12-15T23:35:47.356 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.356 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FjzclOPdqX2gxjK/3DUeFMgUnbM= 2023-12-15T23:35:47.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FjzclOPdqX2gxjK/3DUeFMgUnbM=', 'Content-Length': '0'} 2023-12-15T23:35:47.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000089319f4c0cde89e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.358 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.358 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.358 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.359 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.359 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.359 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.359 DEBUG:boto:Data: 2023-12-15T23:35:47.359 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.359 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.359 DEBUG:boto:Params: {} 2023-12-15T23:35:47.359 DEBUG:boto:Token: None 2023-12-15T23:35:47.359 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.360 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FjzclOPdqX2gxjK/3DUeFMgUnbM= 2023-12-15T23:35:47.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FjzclOPdqX2gxjK/3DUeFMgUnbM=', 'Content-Length': '0'} 2023-12-15T23:35:47.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000994f98a80c24d03-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:35:47.362 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.362 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.362 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.362 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.362 DEBUG:boto:Method: GET 2023-12-15T23:35:47.362 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.362 DEBUG:boto:Data: 2023-12-15T23:35:47.363 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.363 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.363 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.363 DEBUG:boto:Params: {} 2023-12-15T23:35:47.363 DEBUG:boto:Token: None 2023-12-15T23:35:47.363 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.363 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y= 2023-12-15T23:35:47.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y=', 'Content-Length': '0'} 2023-12-15T23:35:47.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e29a1a9c5c37c33-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.406 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.406 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.406 DEBUG:boto:path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.406 DEBUG:boto:auth_path=/kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.406 DEBUG:boto:Method: GET 2023-12-15T23:35:47.406 DEBUG:boto:Path: /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.406 DEBUG:boto:Data: 2023-12-15T23:35:47.406 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.406 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.407 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.407 DEBUG:boto:Params: {} 2023-12-15T23:35:47.407 DEBUG:boto:Token: None 2023-12-15T23:35:47.407 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51?versionId=null 2023-12-15T23:35:47.407 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y= 2023-12-15T23:35:47.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tkhxvCfIxt8hi3yyCNfy/6wpv1Y=', 'Content-Length': '0'} 2023-12-15T23:35:47.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e4bcb9e2b1c6f0c-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.409 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.410 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.410 DEBUG:boto:path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.410 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.410 DEBUG:boto:Method: GET 2023-12-15T23:35:47.410 DEBUG:boto:Path: /kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.410 DEBUG:boto:Data: 2023-12-15T23:35:47.410 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.410 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.410 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.410 DEBUG:boto:Params: {} 2023-12-15T23:35:47.410 DEBUG:boto:Token: None 2023-12-15T23:35:47.411 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.411 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dcb615fa79e4fcca-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.413 DEBUG:boto:b'kskgfn-51obj511000falseobj512023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.414 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.414 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.414 DEBUG:boto:path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.414 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.414 DEBUG:boto:Method: GET 2023-12-15T23:35:47.414 DEBUG:boto:Path: /kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.414 DEBUG:boto:Data: 2023-12-15T23:35:47.414 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.414 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.414 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.414 DEBUG:boto:Params: {} 2023-12-15T23:35:47.415 DEBUG:boto:Token: None 2023-12-15T23:35:47.415 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.415 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.418 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6573edbba663c5a-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.418 DEBUG:boto:b'kskgfn-51obj511000falseobj512023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.419 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.419 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.419 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.419 DEBUG:boto:Path: /kskgfn-51/obj51 2023-12-15T23:35:47.419 DEBUG:boto:Data: 2023-12-15T23:35:47.419 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.419 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.419 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.419 DEBUG:boto:Params: {} 2023-12-15T23:35:47.420 DEBUG:boto:Token: None 2023-12-15T23:35:47.420 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51 2023-12-15T23:35:47.420 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xX1t4u1Sr3veehc0x9gVRRACclc= 2023-12-15T23:35:47.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xX1t4u1Sr3veehc0x9gVRRACclc=', 'Content-Length': '0'} 2023-12-15T23:35:47.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000641a18c54a39a6dd-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.422 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.422 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.422 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.422 DEBUG:boto:Path: /kskgfn-51/obj51 2023-12-15T23:35:47.422 DEBUG:boto:Data: 2023-12-15T23:35:47.422 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.422 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.423 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.423 DEBUG:boto:Params: {} 2023-12-15T23:35:47.423 DEBUG:boto:Token: None 2023-12-15T23:35:47.423 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51 2023-12-15T23:35:47.423 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xX1t4u1Sr3veehc0x9gVRRACclc= 2023-12-15T23:35:47.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xX1t4u1Sr3veehc0x9gVRRACclc=', 'Content-Length': '0'} 2023-12-15T23:35:47.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f2ea8cb63df5c25-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.425 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2023-12-15T23:35:47.425 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.425 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.425 DEBUG:boto:Method: GET 2023-12-15T23:35:47.426 DEBUG:boto:Path: /kskgfn-51/obj51 2023-12-15T23:35:47.426 DEBUG:boto:Data: 2023-12-15T23:35:47.426 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.426 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.426 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.426 DEBUG:boto:Params: {} 2023-12-15T23:35:47.426 DEBUG:boto:Token: None 2023-12-15T23:35:47.426 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51 2023-12-15T23:35:47.426 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D7LSXEa0YzSqWk2XMby866JpxAU= 2023-12-15T23:35:47.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D7LSXEa0YzSqWk2XMby866JpxAU=', 'Content-Length': '0'} 2023-12-15T23:35:47.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed4bf99a78b3fbb-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.429 DEBUG:boto:path=/kskgfn-51/obj51 2023-12-15T23:35:47.429 DEBUG:boto:auth_path=/kskgfn-51/obj51 2023-12-15T23:35:47.429 DEBUG:boto:Method: GET 2023-12-15T23:35:47.429 DEBUG:boto:Path: /kskgfn-51/obj51 2023-12-15T23:35:47.429 DEBUG:boto:Data: 2023-12-15T23:35:47.429 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.430 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.430 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.430 DEBUG:boto:Params: {} 2023-12-15T23:35:47.430 DEBUG:boto:Token: None 2023-12-15T23:35:47.430 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj51 2023-12-15T23:35:47.430 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:D7LSXEa0YzSqWk2XMby866JpxAU= 2023-12-15T23:35:47.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:D7LSXEa0YzSqWk2XMby866JpxAU=', 'Content-Length': '0'} 2023-12-15T23:35:47.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d13ec046188acd5a-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.432 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.432 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.433 DEBUG:boto:path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.433 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.433 DEBUG:boto:Method: GET 2023-12-15T23:35:47.433 DEBUG:boto:Path: /kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.433 DEBUG:boto:Data: 2023-12-15T23:35:47.433 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.433 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.433 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.433 DEBUG:boto:Params: {} 2023-12-15T23:35:47.433 DEBUG:boto:Token: None 2023-12-15T23:35:47.434 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.436 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e7512e156810121f-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.436 DEBUG:boto:b'kskgfn-51obj511000falseobj512023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.437 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.437 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.437 DEBUG:boto:path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.437 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.437 DEBUG:boto:Method: GET 2023-12-15T23:35:47.437 DEBUG:boto:Path: /kskgfn-51/?prefix=obj51 2023-12-15T23:35:47.437 DEBUG:boto:Data: 2023-12-15T23:35:47.437 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.437 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.438 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.438 DEBUG:boto:Params: {} 2023-12-15T23:35:47.438 DEBUG:boto:Token: None 2023-12-15T23:35:47.438 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011edb8e45454b397-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.442 DEBUG:boto:b'kskgfn-51obj511000falseobj512023-12-15T23:31:31.802Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:35:47.443 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.443 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.443 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.443 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.443 DEBUG:boto:Method: GET 2023-12-15T23:35:47.443 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.443 DEBUG:boto:Data: 2023-12-15T23:35:47.443 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.443 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.443 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.443 DEBUG:boto:Params: {} 2023-12-15T23:35:47.444 DEBUG:boto:Token: None 2023-12-15T23:35:47.444 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.444 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g= 2023-12-15T23:35:47.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g=', 'Content-Length': '0'} 2023-12-15T23:35:47.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9ebdea791217286-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.446 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.446 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.447 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.447 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.447 DEBUG:boto:Method: GET 2023-12-15T23:35:47.447 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.447 DEBUG:boto:Data: 2023-12-15T23:35:47.447 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.447 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.447 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.447 DEBUG:boto:Params: {} 2023-12-15T23:35:47.447 DEBUG:boto:Token: None 2023-12-15T23:35:47.448 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.448 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g= 2023-12-15T23:35:47.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g=', 'Content-Length': '0'} 2023-12-15T23:35:47.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008eb535a9fad9df10-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.450 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.450 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.450 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.450 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.450 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.450 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.450 DEBUG:boto:Data: 2023-12-15T23:35:47.450 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.450 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.451 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.451 DEBUG:boto:Params: {} 2023-12-15T23:35:47.451 DEBUG:boto:Token: None 2023-12-15T23:35:47.451 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.451 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S8jJHe8FWhYdzvovFiOliFBBtvY= 2023-12-15T23:35:47.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S8jJHe8FWhYdzvovFiOliFBBtvY=', 'Content-Length': '0'} 2023-12-15T23:35:47.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009408f43c5f93f260-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.453 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.453 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.453 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.453 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.454 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.454 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.454 DEBUG:boto:Data: 2023-12-15T23:35:47.454 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.454 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.454 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.454 DEBUG:boto:Params: {} 2023-12-15T23:35:47.454 DEBUG:boto:Token: None 2023-12-15T23:35:47.454 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.455 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:S8jJHe8FWhYdzvovFiOliFBBtvY= 2023-12-15T23:35:47.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:S8jJHe8FWhYdzvovFiOliFBBtvY=', 'Content-Length': '0'} 2023-12-15T23:35:47.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ec2fdbc8c351ec7-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:35:47.457 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.457 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.457 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.457 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.457 DEBUG:boto:Method: GET 2023-12-15T23:35:47.457 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.457 DEBUG:boto:Data: 2023-12-15T23:35:47.457 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.458 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.458 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.458 DEBUG:boto:Params: {} 2023-12-15T23:35:47.458 DEBUG:boto:Token: None 2023-12-15T23:35:47.458 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.458 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g= 2023-12-15T23:35:47.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g=', 'Content-Length': '0'} 2023-12-15T23:35:47.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054448e5670a8c589-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.501 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.501 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.502 DEBUG:boto:path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.502 DEBUG:boto:auth_path=/kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.502 DEBUG:boto:Method: GET 2023-12-15T23:35:47.502 DEBUG:boto:Path: /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.502 DEBUG:boto:Data: 2023-12-15T23:35:47.502 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.502 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.502 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.502 DEBUG:boto:Params: {} 2023-12-15T23:35:47.502 DEBUG:boto:Token: None 2023-12-15T23:35:47.503 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55?versionId=null 2023-12-15T23:35:47.503 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g= 2023-12-15T23:35:47.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YC4P9dasOdDGMP4pFDvHNG/yR+g=', 'Content-Length': '0'} 2023-12-15T23:35:47.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4599a635beb05fa-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.505 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.505 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.506 DEBUG:boto:path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.506 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.506 DEBUG:boto:Method: GET 2023-12-15T23:35:47.506 DEBUG:boto:Path: /kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.506 DEBUG:boto:Data: 2023-12-15T23:35:47.506 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.506 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.506 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.506 DEBUG:boto:Params: {} 2023-12-15T23:35:47.507 DEBUG:boto:Token: None 2023-12-15T23:35:47.507 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.507 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000539d86e9c796273-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.509 DEBUG:boto:b'kskgfn-51obj551000falseobj552023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.510 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.510 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.510 DEBUG:boto:path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.510 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.510 DEBUG:boto:Method: GET 2023-12-15T23:35:47.510 DEBUG:boto:Path: /kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.510 DEBUG:boto:Data: 2023-12-15T23:35:47.510 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.511 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.511 DEBUG:boto:Params: {} 2023-12-15T23:35:47.511 DEBUG:boto:Token: None 2023-12-15T23:35:47.511 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.515 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a5341149660a6da-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.515 DEBUG:boto:b'kskgfn-51obj551000falseobj552023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.515 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.515 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.515 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.515 DEBUG:boto:Path: /kskgfn-51/obj55 2023-12-15T23:35:47.516 DEBUG:boto:Data: 2023-12-15T23:35:47.516 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.516 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.516 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.516 DEBUG:boto:Params: {} 2023-12-15T23:35:47.516 DEBUG:boto:Token: None 2023-12-15T23:35:47.516 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55 2023-12-15T23:35:47.516 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2GL+f3vA451kFQt22zC0q2UtX8= 2023-12-15T23:35:47.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2GL+f3vA451kFQt22zC0q2UtX8=', 'Content-Length': '0'} 2023-12-15T23:35:47.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d86e9d68aa89a9d8-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.518 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.518 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.518 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.519 DEBUG:boto:Path: /kskgfn-51/obj55 2023-12-15T23:35:47.519 DEBUG:boto:Data: 2023-12-15T23:35:47.519 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.519 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.519 DEBUG:boto:Params: {} 2023-12-15T23:35:47.519 DEBUG:boto:Token: None 2023-12-15T23:35:47.519 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55 2023-12-15T23:35:47.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G2GL+f3vA451kFQt22zC0q2UtX8= 2023-12-15T23:35:47.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G2GL+f3vA451kFQt22zC0q2UtX8=', 'Content-Length': '0'} 2023-12-15T23:35:47.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069e216024c9f176d-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2023-12-15T23:35:47.522 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.522 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.522 DEBUG:boto:Method: GET 2023-12-15T23:35:47.522 DEBUG:boto:Path: /kskgfn-51/obj55 2023-12-15T23:35:47.522 DEBUG:boto:Data: 2023-12-15T23:35:47.522 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.522 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.522 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.522 DEBUG:boto:Params: {} 2023-12-15T23:35:47.522 DEBUG:boto:Token: None 2023-12-15T23:35:47.523 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55 2023-12-15T23:35:47.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abKPWzZ6wPgTu1K58cR5mT6TEtU= 2023-12-15T23:35:47.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abKPWzZ6wPgTu1K58cR5mT6TEtU=', 'Content-Length': '0'} 2023-12-15T23:35:47.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000759bc941b706b3f5-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.525 DEBUG:boto:path=/kskgfn-51/obj55 2023-12-15T23:35:47.525 DEBUG:boto:auth_path=/kskgfn-51/obj55 2023-12-15T23:35:47.525 DEBUG:boto:Method: GET 2023-12-15T23:35:47.525 DEBUG:boto:Path: /kskgfn-51/obj55 2023-12-15T23:35:47.525 DEBUG:boto:Data: 2023-12-15T23:35:47.525 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.525 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.525 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.525 DEBUG:boto:Params: {} 2023-12-15T23:35:47.526 DEBUG:boto:Token: None 2023-12-15T23:35:47.526 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj55 2023-12-15T23:35:47.526 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:abKPWzZ6wPgTu1K58cR5mT6TEtU= 2023-12-15T23:35:47.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:abKPWzZ6wPgTu1K58cR5mT6TEtU=', 'Content-Length': '0'} 2023-12-15T23:35:47.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b67ea946913eca42-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.528 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.528 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.528 DEBUG:boto:path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.528 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.528 DEBUG:boto:Method: GET 2023-12-15T23:35:47.528 DEBUG:boto:Path: /kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.528 DEBUG:boto:Data: 2023-12-15T23:35:47.528 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.529 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.529 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.529 DEBUG:boto:Params: {} 2023-12-15T23:35:47.529 DEBUG:boto:Token: None 2023-12-15T23:35:47.529 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.529 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003671d5f8fd67001e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.532 DEBUG:boto:b'kskgfn-51obj551000falseobj552023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.532 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.532 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.532 DEBUG:boto:path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.532 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.532 DEBUG:boto:Method: GET 2023-12-15T23:35:47.533 DEBUG:boto:Path: /kskgfn-51/?prefix=obj55 2023-12-15T23:35:47.533 DEBUG:boto:Data: 2023-12-15T23:35:47.533 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.533 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.533 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.533 DEBUG:boto:Params: {} 2023-12-15T23:35:47.533 DEBUG:boto:Token: None 2023-12-15T23:35:47.533 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.534 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000573230c0e3763ad3-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.537 DEBUG:boto:b'kskgfn-51obj551000falseobj552023-12-15T23:31:31.584Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:35:47.537 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.538 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.538 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.538 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.538 DEBUG:boto:Method: GET 2023-12-15T23:35:47.538 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.538 DEBUG:boto:Data: 2023-12-15T23:35:47.538 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.538 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.538 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.538 DEBUG:boto:Params: {} 2023-12-15T23:35:47.538 DEBUG:boto:Token: None 2023-12-15T23:35:47.539 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.539 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k= 2023-12-15T23:35:47.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k=', 'Content-Length': '0'} 2023-12-15T23:35:47.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e207babd4af3175-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.541 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.541 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.541 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.541 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.541 DEBUG:boto:Method: GET 2023-12-15T23:35:47.542 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.542 DEBUG:boto:Data: 2023-12-15T23:35:47.542 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.542 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.542 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.542 DEBUG:boto:Params: {} 2023-12-15T23:35:47.542 DEBUG:boto:Token: None 2023-12-15T23:35:47.542 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.543 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k= 2023-12-15T23:35:47.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k=', 'Content-Length': '0'} 2023-12-15T23:35:47.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000691b76f6efd27c74-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.545 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.545 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.545 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.545 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.545 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.545 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.545 DEBUG:boto:Data: 2023-12-15T23:35:47.545 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.546 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.546 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.546 DEBUG:boto:Params: {} 2023-12-15T23:35:47.546 DEBUG:boto:Token: None 2023-12-15T23:35:47.546 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.546 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oT9OE2ckK2V3gear5blnmD2k6Zk= 2023-12-15T23:35:47.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oT9OE2ckK2V3gear5blnmD2k6Zk=', 'Content-Length': '0'} 2023-12-15T23:35:47.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099b3c4d86bb41948-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.548 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.548 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.548 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.548 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.548 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.548 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.548 DEBUG:boto:Data: 2023-12-15T23:35:47.549 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.549 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.549 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.549 DEBUG:boto:Params: {} 2023-12-15T23:35:47.549 DEBUG:boto:Token: None 2023-12-15T23:35:47.549 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.549 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oT9OE2ckK2V3gear5blnmD2k6Zk= 2023-12-15T23:35:47.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oT9OE2ckK2V3gear5blnmD2k6Zk=', 'Content-Length': '0'} 2023-12-15T23:35:47.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000099762f83d67cf2c-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:35:47.551 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.551 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.552 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.552 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.552 DEBUG:boto:Method: GET 2023-12-15T23:35:47.552 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.552 DEBUG:boto:Data: 2023-12-15T23:35:47.552 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.552 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.552 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.552 DEBUG:boto:Params: {} 2023-12-15T23:35:47.552 DEBUG:boto:Token: None 2023-12-15T23:35:47.553 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.553 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k= 2023-12-15T23:35:47.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k=', 'Content-Length': '0'} 2023-12-15T23:35:47.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e092c0f603518a0-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.555 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.555 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.555 DEBUG:boto:path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.555 DEBUG:boto:auth_path=/kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.555 DEBUG:boto:Method: GET 2023-12-15T23:35:47.555 DEBUG:boto:Path: /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.555 DEBUG:boto:Data: 2023-12-15T23:35:47.555 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.556 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.556 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.556 DEBUG:boto:Params: {} 2023-12-15T23:35:47.556 DEBUG:boto:Token: None 2023-12-15T23:35:47.556 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57?versionId=null 2023-12-15T23:35:47.556 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k= 2023-12-15T23:35:47.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dHTxXJftDpkzEqYBd+1YPfgyB8k=', 'Content-Length': '0'} 2023-12-15T23:35:47.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e78f287b348b35-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.559 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.559 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.559 DEBUG:boto:path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.559 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.559 DEBUG:boto:Method: GET 2023-12-15T23:35:47.559 DEBUG:boto:Path: /kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.559 DEBUG:boto:Data: 2023-12-15T23:35:47.559 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.559 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.560 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.560 DEBUG:boto:Params: {} 2023-12-15T23:35:47.560 DEBUG:boto:Token: None 2023-12-15T23:35:47.560 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.560 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc2d6160bdf5e950-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.605 DEBUG:boto:b'kskgfn-51obj571000falseobj572023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.606 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.606 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.606 DEBUG:boto:path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.606 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.606 DEBUG:boto:Method: GET 2023-12-15T23:35:47.606 DEBUG:boto:Path: /kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.606 DEBUG:boto:Data: 2023-12-15T23:35:47.606 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.607 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.607 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.607 DEBUG:boto:Params: {} 2023-12-15T23:35:47.607 DEBUG:boto:Token: None 2023-12-15T23:35:47.607 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.610 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000167d10d1ffc2ab6b-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.611 DEBUG:boto:b'kskgfn-51obj571000falseobj572023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.611 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.611 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.611 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.611 DEBUG:boto:Path: /kskgfn-51/obj57 2023-12-15T23:35:47.611 DEBUG:boto:Data: 2023-12-15T23:35:47.611 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.611 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.612 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.612 DEBUG:boto:Params: {} 2023-12-15T23:35:47.612 DEBUG:boto:Token: None 2023-12-15T23:35:47.612 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57 2023-12-15T23:35:47.612 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q3xniyHaWi7s8v8Q2shfzuIxH6M= 2023-12-15T23:35:47.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q3xniyHaWi7s8v8Q2shfzuIxH6M=', 'Content-Length': '0'} 2023-12-15T23:35:47.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040d73af0e161641f-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.614 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.614 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.614 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.615 DEBUG:boto:Path: /kskgfn-51/obj57 2023-12-15T23:35:47.615 DEBUG:boto:Data: 2023-12-15T23:35:47.615 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.615 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.615 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.615 DEBUG:boto:Params: {} 2023-12-15T23:35:47.615 DEBUG:boto:Token: None 2023-12-15T23:35:47.615 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57 2023-12-15T23:35:47.615 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:q3xniyHaWi7s8v8Q2shfzuIxH6M= 2023-12-15T23:35:47.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:q3xniyHaWi7s8v8Q2shfzuIxH6M=', 'Content-Length': '0'} 2023-12-15T23:35:47.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000467b6848060a4bb4-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.617 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2023-12-15T23:35:47.617 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.618 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.618 DEBUG:boto:Method: GET 2023-12-15T23:35:47.618 DEBUG:boto:Path: /kskgfn-51/obj57 2023-12-15T23:35:47.618 DEBUG:boto:Data: 2023-12-15T23:35:47.618 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.618 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.618 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.618 DEBUG:boto:Params: {} 2023-12-15T23:35:47.618 DEBUG:boto:Token: None 2023-12-15T23:35:47.618 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57 2023-12-15T23:35:47.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tk7IbpIRQjGvTAJNGdpKBAxaqBk= 2023-12-15T23:35:47.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tk7IbpIRQjGvTAJNGdpKBAxaqBk=', 'Content-Length': '0'} 2023-12-15T23:35:47.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ac795fe7f8f39e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.621 DEBUG:boto:path=/kskgfn-51/obj57 2023-12-15T23:35:47.621 DEBUG:boto:auth_path=/kskgfn-51/obj57 2023-12-15T23:35:47.621 DEBUG:boto:Method: GET 2023-12-15T23:35:47.621 DEBUG:boto:Path: /kskgfn-51/obj57 2023-12-15T23:35:47.621 DEBUG:boto:Data: 2023-12-15T23:35:47.622 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.622 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.622 DEBUG:boto:Params: {} 2023-12-15T23:35:47.622 DEBUG:boto:Token: None 2023-12-15T23:35:47.622 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj57 2023-12-15T23:35:47.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tk7IbpIRQjGvTAJNGdpKBAxaqBk= 2023-12-15T23:35:47.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tk7IbpIRQjGvTAJNGdpKBAxaqBk=', 'Content-Length': '0'} 2023-12-15T23:35:47.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f30b53370cf239f-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.624 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.624 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.624 DEBUG:boto:path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.625 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.625 DEBUG:boto:Method: GET 2023-12-15T23:35:47.625 DEBUG:boto:Path: /kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.625 DEBUG:boto:Data: 2023-12-15T23:35:47.625 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.625 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.625 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.625 DEBUG:boto:Params: {} 2023-12-15T23:35:47.625 DEBUG:boto:Token: None 2023-12-15T23:35:47.626 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.626 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.628 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002b2f3625a45c4be-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.628 DEBUG:boto:b'kskgfn-51obj571000falseobj572023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.628 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.628 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.629 DEBUG:boto:path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.629 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.629 DEBUG:boto:Method: GET 2023-12-15T23:35:47.629 DEBUG:boto:Path: /kskgfn-51/?prefix=obj57 2023-12-15T23:35:47.629 DEBUG:boto:Data: 2023-12-15T23:35:47.629 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.629 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.629 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.629 DEBUG:boto:Params: {} 2023-12-15T23:35:47.629 DEBUG:boto:Token: None 2023-12-15T23:35:47.629 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.630 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.633 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f50d2db49449de7-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.633 DEBUG:boto:b'kskgfn-51obj571000falseobj572023-12-15T23:31:32.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:35:47.633 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.634 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.634 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.634 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.634 DEBUG:boto:Method: GET 2023-12-15T23:35:47.634 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.634 DEBUG:boto:Data: 2023-12-15T23:35:47.634 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.634 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.634 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.634 DEBUG:boto:Params: {} 2023-12-15T23:35:47.635 DEBUG:boto:Token: None 2023-12-15T23:35:47.635 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.635 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o= 2023-12-15T23:35:47.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o=', 'Content-Length': '0'} 2023-12-15T23:35:47.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003d35d51c3d9f3a1-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.637 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.637 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.637 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.637 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.637 DEBUG:boto:Method: GET 2023-12-15T23:35:47.638 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.638 DEBUG:boto:Data: 2023-12-15T23:35:47.638 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.638 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.638 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.638 DEBUG:boto:Params: {} 2023-12-15T23:35:47.638 DEBUG:boto:Token: None 2023-12-15T23:35:47.638 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.638 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o= 2023-12-15T23:35:47.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o=', 'Content-Length': '0'} 2023-12-15T23:35:47.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b669bfabd7a93404-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.641 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.641 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.641 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.641 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.641 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.641 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.641 DEBUG:boto:Data: 2023-12-15T23:35:47.641 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.641 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.642 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.642 DEBUG:boto:Params: {} 2023-12-15T23:35:47.642 DEBUG:boto:Token: None 2023-12-15T23:35:47.642 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.642 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:byFZtsjssVmsYY3rXSqmpCbfYOI= 2023-12-15T23:35:47.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:byFZtsjssVmsYY3rXSqmpCbfYOI=', 'Content-Length': '0'} 2023-12-15T23:35:47.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bb8e8a4e2806f40-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.644 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.644 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.644 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.644 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.644 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.644 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.644 DEBUG:boto:Data: 2023-12-15T23:35:47.645 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.645 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.645 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.645 DEBUG:boto:Params: {} 2023-12-15T23:35:47.645 DEBUG:boto:Token: None 2023-12-15T23:35:47.645 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.645 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:byFZtsjssVmsYY3rXSqmpCbfYOI= 2023-12-15T23:35:47.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:byFZtsjssVmsYY3rXSqmpCbfYOI=', 'Content-Length': '0'} 2023-12-15T23:35:47.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000520ef109ddab25a8-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:35:47.648 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.648 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.648 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.648 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.648 DEBUG:boto:Method: GET 2023-12-15T23:35:47.648 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.648 DEBUG:boto:Data: 2023-12-15T23:35:47.648 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.648 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.648 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.649 DEBUG:boto:Params: {} 2023-12-15T23:35:47.649 DEBUG:boto:Token: None 2023-12-15T23:35:47.649 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.649 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o= 2023-12-15T23:35:47.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o=', 'Content-Length': '0'} 2023-12-15T23:35:47.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6a2796d4f1c989e-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.651 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.651 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.651 DEBUG:boto:path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.651 DEBUG:boto:auth_path=/kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.651 DEBUG:boto:Method: GET 2023-12-15T23:35:47.652 DEBUG:boto:Path: /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.652 DEBUG:boto:Data: 2023-12-15T23:35:47.652 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.652 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.652 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.652 DEBUG:boto:Params: {} 2023-12-15T23:35:47.652 DEBUG:boto:Token: None 2023-12-15T23:35:47.652 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58?versionId=null 2023-12-15T23:35:47.653 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o= 2023-12-15T23:35:47.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xPatucvebZAZGSd1hYQI2yzW68o=', 'Content-Length': '0'} 2023-12-15T23:35:47.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4670a8fe03383dc-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.655 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.655 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.655 DEBUG:boto:path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.655 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.655 DEBUG:boto:Method: GET 2023-12-15T23:35:47.655 DEBUG:boto:Path: /kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.655 DEBUG:boto:Data: 2023-12-15T23:35:47.656 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.656 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.656 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.656 DEBUG:boto:Params: {} 2023-12-15T23:35:47.656 DEBUG:boto:Token: None 2023-12-15T23:35:47.656 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.656 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c92d21583f37253-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.659 DEBUG:boto:b'kskgfn-51obj581000falseobj582023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.659 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.659 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.659 DEBUG:boto:path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.659 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.659 DEBUG:boto:Method: GET 2023-12-15T23:35:47.659 DEBUG:boto:Path: /kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.659 DEBUG:boto:Data: 2023-12-15T23:35:47.660 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.660 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.660 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.660 DEBUG:boto:Params: {} 2023-12-15T23:35:47.660 DEBUG:boto:Token: None 2023-12-15T23:35:47.660 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.660 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a60fb7d20b9e503a-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.705 DEBUG:boto:b'kskgfn-51obj581000falseobj582023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.706 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.706 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.706 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.706 DEBUG:boto:Path: /kskgfn-51/obj58 2023-12-15T23:35:47.706 DEBUG:boto:Data: 2023-12-15T23:35:47.706 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.706 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.706 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.706 DEBUG:boto:Params: {} 2023-12-15T23:35:47.707 DEBUG:boto:Token: None 2023-12-15T23:35:47.707 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58 2023-12-15T23:35:47.707 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vHluI6B1Av6MiOBd5n6fSLCf7e4= 2023-12-15T23:35:47.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vHluI6B1Av6MiOBd5n6fSLCf7e4=', 'Content-Length': '0'} 2023-12-15T23:35:47.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063ded3a9e4ba9a2d-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.709 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.709 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.709 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.709 DEBUG:boto:Path: /kskgfn-51/obj58 2023-12-15T23:35:47.709 DEBUG:boto:Data: 2023-12-15T23:35:47.709 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.710 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.710 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.710 DEBUG:boto:Params: {} 2023-12-15T23:35:47.710 DEBUG:boto:Token: None 2023-12-15T23:35:47.710 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58 2023-12-15T23:35:47.710 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vHluI6B1Av6MiOBd5n6fSLCf7e4= 2023-12-15T23:35:47.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vHluI6B1Av6MiOBd5n6fSLCf7e4=', 'Content-Length': '0'} 2023-12-15T23:35:47.712 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000182032e07357f0ca-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2023-12-15T23:35:47.712 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.712 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.712 DEBUG:boto:Method: GET 2023-12-15T23:35:47.712 DEBUG:boto:Path: /kskgfn-51/obj58 2023-12-15T23:35:47.712 DEBUG:boto:Data: 2023-12-15T23:35:47.713 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.713 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.713 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.713 DEBUG:boto:Params: {} 2023-12-15T23:35:47.713 DEBUG:boto:Token: None 2023-12-15T23:35:47.713 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58 2023-12-15T23:35:47.713 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3+seZgw1jAqUPWYkGkUgDxDn0XY= 2023-12-15T23:35:47.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3+seZgw1jAqUPWYkGkUgDxDn0XY=', 'Content-Length': '0'} 2023-12-15T23:35:47.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000656a5c753e104916-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.715 DEBUG:boto:path=/kskgfn-51/obj58 2023-12-15T23:35:47.716 DEBUG:boto:auth_path=/kskgfn-51/obj58 2023-12-15T23:35:47.716 DEBUG:boto:Method: GET 2023-12-15T23:35:47.716 DEBUG:boto:Path: /kskgfn-51/obj58 2023-12-15T23:35:47.716 DEBUG:boto:Data: 2023-12-15T23:35:47.716 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.716 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.716 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.716 DEBUG:boto:Params: {} 2023-12-15T23:35:47.716 DEBUG:boto:Token: None 2023-12-15T23:35:47.716 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj58 2023-12-15T23:35:47.717 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3+seZgw1jAqUPWYkGkUgDxDn0XY= 2023-12-15T23:35:47.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3+seZgw1jAqUPWYkGkUgDxDn0XY=', 'Content-Length': '0'} 2023-12-15T23:35:47.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004611ff3ef6d253ae-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.719 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.719 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.719 DEBUG:boto:path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.719 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.719 DEBUG:boto:Method: GET 2023-12-15T23:35:47.719 DEBUG:boto:Path: /kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.719 DEBUG:boto:Data: 2023-12-15T23:35:47.719 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.720 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.720 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.720 DEBUG:boto:Params: {} 2023-12-15T23:35:47.720 DEBUG:boto:Token: None 2023-12-15T23:35:47.720 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.720 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.722 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c11cea231e2eedb0-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.723 DEBUG:boto:b'kskgfn-51obj581000falseobj582023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.723 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.723 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.723 DEBUG:boto:path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.723 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.723 DEBUG:boto:Method: GET 2023-12-15T23:35:47.723 DEBUG:boto:Path: /kskgfn-51/?prefix=obj58 2023-12-15T23:35:47.724 DEBUG:boto:Data: 2023-12-15T23:35:47.724 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.724 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.724 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.724 DEBUG:boto:Params: {} 2023-12-15T23:35:47.724 DEBUG:boto:Token: None 2023-12-15T23:35:47.724 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.724 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088483410578593f4-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.728 DEBUG:boto:b'kskgfn-51obj581000falseobj582023-12-15T23:31:32.661Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.728 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:35:47.728 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.729 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.729 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.729 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.729 DEBUG:boto:Method: GET 2023-12-15T23:35:47.729 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.729 DEBUG:boto:Data: 2023-12-15T23:35:47.729 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.729 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.729 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.729 DEBUG:boto:Params: {} 2023-12-15T23:35:47.729 DEBUG:boto:Token: None 2023-12-15T23:35:47.730 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.730 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo= 2023-12-15T23:35:47.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo=', 'Content-Length': '0'} 2023-12-15T23:35:47.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ec379460b90937f-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.774 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.774 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.774 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.774 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.774 DEBUG:boto:Method: GET 2023-12-15T23:35:47.774 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.774 DEBUG:boto:Data: 2023-12-15T23:35:47.774 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.774 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.774 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.774 DEBUG:boto:Params: {} 2023-12-15T23:35:47.775 DEBUG:boto:Token: None 2023-12-15T23:35:47.775 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.775 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo= 2023-12-15T23:35:47.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo=', 'Content-Length': '0'} 2023-12-15T23:35:47.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000364ef3d09996e6c5-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.778 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.778 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.778 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.778 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.778 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.778 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.778 DEBUG:boto:Data: 2023-12-15T23:35:47.778 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.778 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.779 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.779 DEBUG:boto:Params: {} 2023-12-15T23:35:47.779 DEBUG:boto:Token: None 2023-12-15T23:35:47.779 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.779 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:co9FLfnyEkv8GfkgBI+GorHMn6o= 2023-12-15T23:35:47.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:co9FLfnyEkv8GfkgBI+GorHMn6o=', 'Content-Length': '0'} 2023-12-15T23:35:47.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fb53c9c28685f62-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.781 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.781 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.782 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.782 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.782 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.782 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.782 DEBUG:boto:Data: 2023-12-15T23:35:47.782 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.782 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.782 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.782 DEBUG:boto:Params: {} 2023-12-15T23:35:47.782 DEBUG:boto:Token: None 2023-12-15T23:35:47.783 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.783 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:co9FLfnyEkv8GfkgBI+GorHMn6o= 2023-12-15T23:35:47.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:co9FLfnyEkv8GfkgBI+GorHMn6o=', 'Content-Length': '0'} 2023-12-15T23:35:47.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ae39dbd7f855792-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:35:47.786 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.786 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.786 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.786 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.786 DEBUG:boto:Method: GET 2023-12-15T23:35:47.786 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.786 DEBUG:boto:Data: 2023-12-15T23:35:47.786 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.786 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.786 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.786 DEBUG:boto:Params: {} 2023-12-15T23:35:47.786 DEBUG:boto:Token: None 2023-12-15T23:35:47.787 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.787 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo= 2023-12-15T23:35:47.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo=', 'Content-Length': '0'} 2023-12-15T23:35:47.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f94cf5b271fd2ef3-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.789 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.789 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.789 DEBUG:boto:path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.789 DEBUG:boto:auth_path=/kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.790 DEBUG:boto:Method: GET 2023-12-15T23:35:47.790 DEBUG:boto:Path: /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.790 DEBUG:boto:Data: 2023-12-15T23:35:47.790 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.790 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.790 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.790 DEBUG:boto:Params: {} 2023-12-15T23:35:47.790 DEBUG:boto:Token: None 2023-12-15T23:35:47.790 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62?versionId=null 2023-12-15T23:35:47.791 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo= 2023-12-15T23:35:47.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4LnChMQPGHGdM6RjPyMbBs84UEo=', 'Content-Length': '0'} 2023-12-15T23:35:47.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025bddda2914ce27b-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.837 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.838 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.838 DEBUG:boto:path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.838 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.838 DEBUG:boto:Method: GET 2023-12-15T23:35:47.838 DEBUG:boto:Path: /kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.838 DEBUG:boto:Data: 2023-12-15T23:35:47.838 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.838 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.838 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.838 DEBUG:boto:Params: {} 2023-12-15T23:35:47.838 DEBUG:boto:Token: None 2023-12-15T23:35:47.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090a10985366e2f56-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.841 DEBUG:boto:b'kskgfn-51obj621000falseobj622023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.841 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.842 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.842 DEBUG:boto:path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.842 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.842 DEBUG:boto:Method: GET 2023-12-15T23:35:47.842 DEBUG:boto:Path: /kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.842 DEBUG:boto:Data: 2023-12-15T23:35:47.842 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.842 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.842 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.843 DEBUG:boto:Params: {} 2023-12-15T23:35:47.843 DEBUG:boto:Token: None 2023-12-15T23:35:47.843 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.843 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087db5fd10773fc4f-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.846 DEBUG:boto:b'kskgfn-51obj621000falseobj622023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.847 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.847 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.847 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.847 DEBUG:boto:Path: /kskgfn-51/obj62 2023-12-15T23:35:47.847 DEBUG:boto:Data: 2023-12-15T23:35:47.847 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.847 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.847 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.847 DEBUG:boto:Params: {} 2023-12-15T23:35:47.848 DEBUG:boto:Token: None 2023-12-15T23:35:47.848 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62 2023-12-15T23:35:47.848 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sfmca27HUUZUHx20x3M25PIE/nM= 2023-12-15T23:35:47.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sfmca27HUUZUHx20x3M25PIE/nM=', 'Content-Length': '0'} 2023-12-15T23:35:47.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028d6fd3cd1bbd62c-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.850 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.850 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.850 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.850 DEBUG:boto:Path: /kskgfn-51/obj62 2023-12-15T23:35:47.851 DEBUG:boto:Data: 2023-12-15T23:35:47.851 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.851 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.851 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.851 DEBUG:boto:Params: {} 2023-12-15T23:35:47.851 DEBUG:boto:Token: None 2023-12-15T23:35:47.851 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62 2023-12-15T23:35:47.851 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:sfmca27HUUZUHx20x3M25PIE/nM= 2023-12-15T23:35:47.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:sfmca27HUUZUHx20x3M25PIE/nM=', 'Content-Length': '0'} 2023-12-15T23:35:47.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acd3f8d36d9ce61a-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.854 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2023-12-15T23:35:47.854 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.854 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.854 DEBUG:boto:Method: GET 2023-12-15T23:35:47.854 DEBUG:boto:Path: /kskgfn-51/obj62 2023-12-15T23:35:47.854 DEBUG:boto:Data: 2023-12-15T23:35:47.854 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.854 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.854 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.855 DEBUG:boto:Params: {} 2023-12-15T23:35:47.855 DEBUG:boto:Token: None 2023-12-15T23:35:47.855 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62 2023-12-15T23:35:47.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4cibJzqZ9ANdodPVCdfGLooK+JM= 2023-12-15T23:35:47.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4cibJzqZ9ANdodPVCdfGLooK+JM=', 'Content-Length': '0'} 2023-12-15T23:35:47.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed4bab3a508233f-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.857 DEBUG:boto:path=/kskgfn-51/obj62 2023-12-15T23:35:47.858 DEBUG:boto:auth_path=/kskgfn-51/obj62 2023-12-15T23:35:47.858 DEBUG:boto:Method: GET 2023-12-15T23:35:47.858 DEBUG:boto:Path: /kskgfn-51/obj62 2023-12-15T23:35:47.858 DEBUG:boto:Data: 2023-12-15T23:35:47.858 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.858 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.858 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.858 DEBUG:boto:Params: {} 2023-12-15T23:35:47.858 DEBUG:boto:Token: None 2023-12-15T23:35:47.858 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj62 2023-12-15T23:35:47.859 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4cibJzqZ9ANdodPVCdfGLooK+JM= 2023-12-15T23:35:47.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4cibJzqZ9ANdodPVCdfGLooK+JM=', 'Content-Length': '0'} 2023-12-15T23:35:47.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3614df68509681f-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.901 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.902 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.902 DEBUG:boto:path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.902 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.902 DEBUG:boto:Method: GET 2023-12-15T23:35:47.902 DEBUG:boto:Path: /kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.902 DEBUG:boto:Data: 2023-12-15T23:35:47.902 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.902 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.902 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.903 DEBUG:boto:Params: {} 2023-12-15T23:35:47.903 DEBUG:boto:Token: None 2023-12-15T23:35:47.903 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.903 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ad8c236ce0bbd17-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.906 DEBUG:boto:b'kskgfn-51obj621000falseobj622023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.906 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.906 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.906 DEBUG:boto:path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.906 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.906 DEBUG:boto:Method: GET 2023-12-15T23:35:47.907 DEBUG:boto:Path: /kskgfn-51/?prefix=obj62 2023-12-15T23:35:47.907 DEBUG:boto:Data: 2023-12-15T23:35:47.907 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.907 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.907 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.907 DEBUG:boto:Params: {} 2023-12-15T23:35:47.907 DEBUG:boto:Token: None 2023-12-15T23:35:47.907 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.907 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e55e89dbadf7f08-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.911 DEBUG:boto:b'kskgfn-51obj621000falseobj622023-12-15T23:31:32.968Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.911 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:35:47.911 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.911 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.911 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.912 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.912 DEBUG:boto:Method: GET 2023-12-15T23:35:47.912 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.912 DEBUG:boto:Data: 2023-12-15T23:35:47.912 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.912 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.912 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.912 DEBUG:boto:Params: {} 2023-12-15T23:35:47.912 DEBUG:boto:Token: None 2023-12-15T23:35:47.912 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.913 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4= 2023-12-15T23:35:47.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4=', 'Content-Length': '0'} 2023-12-15T23:35:47.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0dd9d0d076fcf5d-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.957 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.958 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.958 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.958 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.958 DEBUG:boto:Method: GET 2023-12-15T23:35:47.958 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.958 DEBUG:boto:Data: 2023-12-15T23:35:47.958 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.958 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.959 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.959 DEBUG:boto:Params: {} 2023-12-15T23:35:47.959 DEBUG:boto:Token: None 2023-12-15T23:35:47.959 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.959 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4= 2023-12-15T23:35:47.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4=', 'Content-Length': '0'} 2023-12-15T23:35:47.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f76f9f3424bfb29e-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.962 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.962 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.962 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.962 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.962 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.963 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.963 DEBUG:boto:Data: 2023-12-15T23:35:47.963 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.963 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.963 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.963 DEBUG:boto:Params: {} 2023-12-15T23:35:47.963 DEBUG:boto:Token: None 2023-12-15T23:35:47.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gaoBZMu9T1W3gwcBQEW0dlDcFTg= 2023-12-15T23:35:47.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gaoBZMu9T1W3gwcBQEW0dlDcFTg=', 'Content-Length': '0'} 2023-12-15T23:35:47.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001658fcd3ff19e9da-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.966 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.966 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.966 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.966 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.966 DEBUG:boto:Method: HEAD 2023-12-15T23:35:47.966 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.966 DEBUG:boto:Data: 2023-12-15T23:35:47.966 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.966 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.966 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.966 DEBUG:boto:Params: {} 2023-12-15T23:35:47.967 DEBUG:boto:Token: None 2023-12-15T23:35:47.967 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gaoBZMu9T1W3gwcBQEW0dlDcFTg= 2023-12-15T23:35:47.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gaoBZMu9T1W3gwcBQEW0dlDcFTg=', 'Content-Length': '0'} 2023-12-15T23:35:47.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6f06aa088125071-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:35:47.969 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.970 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.970 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.970 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.970 DEBUG:boto:Method: GET 2023-12-15T23:35:47.970 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.970 DEBUG:boto:Data: 2023-12-15T23:35:47.970 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.970 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.970 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.971 DEBUG:boto:Params: {} 2023-12-15T23:35:47.971 DEBUG:boto:Token: None 2023-12-15T23:35:47.971 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.971 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4= 2023-12-15T23:35:47.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4=', 'Content-Length': '0'} 2023-12-15T23:35:47.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6e8211128084c5d-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.974 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:47.974 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:47.974 DEBUG:boto:path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.974 DEBUG:boto:auth_path=/kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.974 DEBUG:boto:Method: GET 2023-12-15T23:35:47.974 DEBUG:boto:Path: /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.975 DEBUG:boto:Data: 2023-12-15T23:35:47.975 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.975 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.975 DEBUG:boto:Params: {} 2023-12-15T23:35:47.975 DEBUG:boto:Token: None 2023-12-15T23:35:47.975 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/obj68?versionId=null 2023-12-15T23:35:47.975 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4= 2023-12-15T23:35:47.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RwHp7ZH1NojQFdbVztoNRcRqQs4=', 'Content-Length': '0'} 2023-12-15T23:35:47.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008287323569c7f3bf-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.978 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.978 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.978 DEBUG:boto:path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.978 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.978 DEBUG:boto:Method: GET 2023-12-15T23:35:47.978 DEBUG:boto:Path: /kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.978 DEBUG:boto:Data: 2023-12-15T23:35:47.978 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.978 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:47.979 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.979 DEBUG:boto:Params: {} 2023-12-15T23:35:47.979 DEBUG:boto:Token: None 2023-12-15T23:35:47.979 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000849288024df6aa1a-00657ce2d3-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:47.981 DEBUG:boto:b'kskgfn-51obj681000falseobj682023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:47.982 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:47.982 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:47.982 DEBUG:boto:path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.982 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.982 DEBUG:boto:Method: GET 2023-12-15T23:35:47.982 DEBUG:boto:Path: /kskgfn-51/?prefix=obj68 2023-12-15T23:35:47.982 DEBUG:boto:Data: 2023-12-15T23:35:47.983 DEBUG:boto:Headers: {} 2023-12-15T23:35:47.983 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:47.983 DEBUG:boto:Port: 8000 2023-12-15T23:35:47.983 DEBUG:boto:Params: {} 2023-12-15T23:35:47.983 DEBUG:boto:Token: None 2023-12-15T23:35:47.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:47 GMT /kskgfn-51/ 2023-12-15T23:35:47.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA= 2023-12-15T23:35:47.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:47 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Gx3kyACT7yxt+BKs15FLj1NxvcA=', 'Content-Length': '0'} 2023-12-15T23:35:47.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068b6f3f363b9d28a-00657ce2d3-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:47 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.029 DEBUG:boto:b'kskgfn-51obj681000falseobj682023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.030 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:48.030 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:48.030 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.030 DEBUG:boto:Path: /kskgfn-51/obj68 2023-12-15T23:35:48.030 DEBUG:boto:Data: 2023-12-15T23:35:48.031 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.031 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.031 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.031 DEBUG:boto:Params: {} 2023-12-15T23:35:48.031 DEBUG:boto:Token: None 2023-12-15T23:35:48.031 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj68 2023-12-15T23:35:48.031 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9jVPhrAPf9hOtvIdvpXc8R9KXGE= 2023-12-15T23:35:48.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9jVPhrAPf9hOtvIdvpXc8R9KXGE=', 'Content-Length': '0'} 2023-12-15T23:35:48.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f6362cdae4abddd-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.034 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:48.034 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:48.034 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.034 DEBUG:boto:Path: /kskgfn-51/obj68 2023-12-15T23:35:48.034 DEBUG:boto:Data: 2023-12-15T23:35:48.034 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.035 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.035 DEBUG:boto:Params: {} 2023-12-15T23:35:48.035 DEBUG:boto:Token: None 2023-12-15T23:35:48.035 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj68 2023-12-15T23:35:48.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9jVPhrAPf9hOtvIdvpXc8R9KXGE= 2023-12-15T23:35:48.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9jVPhrAPf9hOtvIdvpXc8R9KXGE=', 'Content-Length': '0'} 2023-12-15T23:35:48.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058560f1d129d9696-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2023-12-15T23:35:48.037 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:48.037 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:48.038 DEBUG:boto:Method: GET 2023-12-15T23:35:48.038 DEBUG:boto:Path: /kskgfn-51/obj68 2023-12-15T23:35:48.038 DEBUG:boto:Data: 2023-12-15T23:35:48.038 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.038 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.038 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.038 DEBUG:boto:Params: {} 2023-12-15T23:35:48.038 DEBUG:boto:Token: None 2023-12-15T23:35:48.038 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj68 2023-12-15T23:35:48.038 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a+7VD/rOjTOcvPw/446I2JZYtSY= 2023-12-15T23:35:48.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a+7VD/rOjTOcvPw/446I2JZYtSY=', 'Content-Length': '0'} 2023-12-15T23:35:48.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c052d4dcfae1b2ff-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.085 DEBUG:boto:path=/kskgfn-51/obj68 2023-12-15T23:35:48.086 DEBUG:boto:auth_path=/kskgfn-51/obj68 2023-12-15T23:35:48.086 DEBUG:boto:Method: GET 2023-12-15T23:35:48.088 DEBUG:boto:Path: /kskgfn-51/obj68 2023-12-15T23:35:48.088 DEBUG:boto:Data: 2023-12-15T23:35:48.088 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.088 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.088 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.088 DEBUG:boto:Params: {} 2023-12-15T23:35:48.089 DEBUG:boto:Token: None 2023-12-15T23:35:48.089 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj68 2023-12-15T23:35:48.089 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:a+7VD/rOjTOcvPw/446I2JZYtSY= 2023-12-15T23:35:48.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:a+7VD/rOjTOcvPw/446I2JZYtSY=', 'Content-Length': '0'} 2023-12-15T23:35:48.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000408b65e67d716f48-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.092 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.092 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.092 DEBUG:boto:path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.092 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.092 DEBUG:boto:Method: GET 2023-12-15T23:35:48.092 DEBUG:boto:Path: /kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.092 DEBUG:boto:Data: 2023-12-15T23:35:48.092 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.092 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.092 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.093 DEBUG:boto:Params: {} 2023-12-15T23:35:48.093 DEBUG:boto:Token: None 2023-12-15T23:35:48.093 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.093 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.095 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df5ebf478d48986c-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.096 DEBUG:boto:b'kskgfn-51obj681000falseobj682023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.096 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.096 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.096 DEBUG:boto:path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.097 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.097 DEBUG:boto:Method: GET 2023-12-15T23:35:48.097 DEBUG:boto:Path: /kskgfn-51/?prefix=obj68 2023-12-15T23:35:48.097 DEBUG:boto:Data: 2023-12-15T23:35:48.097 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.097 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.097 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.097 DEBUG:boto:Params: {} 2023-12-15T23:35:48.097 DEBUG:boto:Token: None 2023-12-15T23:35:48.097 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.101 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000026aad56318940293-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.101 DEBUG:boto:b'kskgfn-51obj681000falseobj682023-12-15T23:31:31.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:35:48.102 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.102 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.102 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.102 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.102 DEBUG:boto:Method: GET 2023-12-15T23:35:48.102 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.102 DEBUG:boto:Data: 2023-12-15T23:35:48.102 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.102 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.103 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.103 DEBUG:boto:Params: {} 2023-12-15T23:35:48.103 DEBUG:boto:Token: None 2023-12-15T23:35:48.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU= 2023-12-15T23:35:48.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU=', 'Content-Length': '0'} 2023-12-15T23:35:48.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bebcb35db27168d-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.106 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.106 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.106 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.106 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.106 DEBUG:boto:Method: GET 2023-12-15T23:35:48.106 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.106 DEBUG:boto:Data: 2023-12-15T23:35:48.106 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.107 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.107 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.107 DEBUG:boto:Params: {} 2023-12-15T23:35:48.107 DEBUG:boto:Token: None 2023-12-15T23:35:48.107 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU= 2023-12-15T23:35:48.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU=', 'Content-Length': '0'} 2023-12-15T23:35:48.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000664ba23545dfb37d-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.110 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.110 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.110 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.110 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.110 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.110 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.110 DEBUG:boto:Data: 2023-12-15T23:35:48.110 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.110 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.110 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.111 DEBUG:boto:Params: {} 2023-12-15T23:35:48.111 DEBUG:boto:Token: None 2023-12-15T23:35:48.111 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o5kV/ZP0ai7nQr03eladiA959ms= 2023-12-15T23:35:48.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o5kV/ZP0ai7nQr03eladiA959ms=', 'Content-Length': '0'} 2023-12-15T23:35:48.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009817906c05b96ac4-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.114 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.114 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.114 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.114 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.114 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.114 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.114 DEBUG:boto:Data: 2023-12-15T23:35:48.114 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.115 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.115 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.115 DEBUG:boto:Params: {} 2023-12-15T23:35:48.115 DEBUG:boto:Token: None 2023-12-15T23:35:48.115 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.115 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o5kV/ZP0ai7nQr03eladiA959ms= 2023-12-15T23:35:48.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o5kV/ZP0ai7nQr03eladiA959ms=', 'Content-Length': '0'} 2023-12-15T23:35:48.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6773d3ca2d16785-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:35:48.118 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.118 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.118 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.118 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.118 DEBUG:boto:Method: GET 2023-12-15T23:35:48.119 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.119 DEBUG:boto:Data: 2023-12-15T23:35:48.119 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.119 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.119 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.119 DEBUG:boto:Params: {} 2023-12-15T23:35:48.119 DEBUG:boto:Token: None 2023-12-15T23:35:48.119 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.119 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU= 2023-12-15T23:35:48.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU=', 'Content-Length': '0'} 2023-12-15T23:35:48.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba678dd4df85caf6-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.122 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.122 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.122 DEBUG:boto:path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.122 DEBUG:boto:auth_path=/kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.122 DEBUG:boto:Method: GET 2023-12-15T23:35:48.122 DEBUG:boto:Path: /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.122 DEBUG:boto:Data: 2023-12-15T23:35:48.122 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.123 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.123 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.123 DEBUG:boto:Params: {} 2023-12-15T23:35:48.123 DEBUG:boto:Token: None 2023-12-15T23:35:48.123 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69?versionId=null 2023-12-15T23:35:48.123 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU= 2023-12-15T23:35:48.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DSYFtBjiuoKw8d4e2z2up1umLiU=', 'Content-Length': '0'} 2023-12-15T23:35:48.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdd99ef6bd432853-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.125 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.126 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.126 DEBUG:boto:path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.126 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.126 DEBUG:boto:Method: GET 2023-12-15T23:35:48.126 DEBUG:boto:Path: /kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.126 DEBUG:boto:Data: 2023-12-15T23:35:48.126 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.126 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.126 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.126 DEBUG:boto:Params: {} 2023-12-15T23:35:48.126 DEBUG:boto:Token: None 2023-12-15T23:35:48.127 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.127 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.129 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c07df1ad9716fa96-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.173 DEBUG:boto:b'kskgfn-51obj691000falseobj692023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.174 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.174 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.174 DEBUG:boto:path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.174 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.174 DEBUG:boto:Method: GET 2023-12-15T23:35:48.174 DEBUG:boto:Path: /kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.174 DEBUG:boto:Data: 2023-12-15T23:35:48.174 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.174 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.174 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.175 DEBUG:boto:Params: {} 2023-12-15T23:35:48.175 DEBUG:boto:Token: None 2023-12-15T23:35:48.175 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.175 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c0dfc36c41b6b53-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.179 DEBUG:boto:b'kskgfn-51obj691000falseobj692023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.179 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.179 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.179 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.179 DEBUG:boto:Path: /kskgfn-51/obj69 2023-12-15T23:35:48.179 DEBUG:boto:Data: 2023-12-15T23:35:48.179 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.179 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.180 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.180 DEBUG:boto:Params: {} 2023-12-15T23:35:48.180 DEBUG:boto:Token: None 2023-12-15T23:35:48.180 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69 2023-12-15T23:35:48.180 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MIbJvW+qmT6uRkpXBRXnuCGAm1U= 2023-12-15T23:35:48.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MIbJvW+qmT6uRkpXBRXnuCGAm1U=', 'Content-Length': '0'} 2023-12-15T23:35:48.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca02694520941ca4-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.182 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.182 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.183 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.183 DEBUG:boto:Path: /kskgfn-51/obj69 2023-12-15T23:35:48.183 DEBUG:boto:Data: 2023-12-15T23:35:48.183 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.183 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.183 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.183 DEBUG:boto:Params: {} 2023-12-15T23:35:48.183 DEBUG:boto:Token: None 2023-12-15T23:35:48.183 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69 2023-12-15T23:35:48.184 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MIbJvW+qmT6uRkpXBRXnuCGAm1U= 2023-12-15T23:35:48.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MIbJvW+qmT6uRkpXBRXnuCGAm1U=', 'Content-Length': '0'} 2023-12-15T23:35:48.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010715acf423cc0ff-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2023-12-15T23:35:48.186 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.186 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.186 DEBUG:boto:Method: GET 2023-12-15T23:35:48.186 DEBUG:boto:Path: /kskgfn-51/obj69 2023-12-15T23:35:48.186 DEBUG:boto:Data: 2023-12-15T23:35:48.186 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.186 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.186 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.186 DEBUG:boto:Params: {} 2023-12-15T23:35:48.187 DEBUG:boto:Token: None 2023-12-15T23:35:48.187 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69 2023-12-15T23:35:48.187 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fyfA36AdoiyderHTFAXFfcwWtVQ= 2023-12-15T23:35:48.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fyfA36AdoiyderHTFAXFfcwWtVQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d220735a586c0faf-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.189 DEBUG:boto:path=/kskgfn-51/obj69 2023-12-15T23:35:48.190 DEBUG:boto:auth_path=/kskgfn-51/obj69 2023-12-15T23:35:48.190 DEBUG:boto:Method: GET 2023-12-15T23:35:48.190 DEBUG:boto:Path: /kskgfn-51/obj69 2023-12-15T23:35:48.190 DEBUG:boto:Data: 2023-12-15T23:35:48.190 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.190 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.190 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.190 DEBUG:boto:Params: {} 2023-12-15T23:35:48.190 DEBUG:boto:Token: None 2023-12-15T23:35:48.191 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj69 2023-12-15T23:35:48.191 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:fyfA36AdoiyderHTFAXFfcwWtVQ= 2023-12-15T23:35:48.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:fyfA36AdoiyderHTFAXFfcwWtVQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2a05c37b18dd2f4-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.233 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.234 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.234 DEBUG:boto:path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.234 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.234 DEBUG:boto:Method: GET 2023-12-15T23:35:48.234 DEBUG:boto:Path: /kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.234 DEBUG:boto:Data: 2023-12-15T23:35:48.234 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.234 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.234 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.234 DEBUG:boto:Params: {} 2023-12-15T23:35:48.235 DEBUG:boto:Token: None 2023-12-15T23:35:48.235 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.235 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000092fa9c68ba7f1f3-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.237 DEBUG:boto:b'kskgfn-51obj691000falseobj692023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.238 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.238 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.238 DEBUG:boto:path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.238 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.238 DEBUG:boto:Method: GET 2023-12-15T23:35:48.238 DEBUG:boto:Path: /kskgfn-51/?prefix=obj69 2023-12-15T23:35:48.238 DEBUG:boto:Data: 2023-12-15T23:35:48.238 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.238 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.238 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.238 DEBUG:boto:Params: {} 2023-12-15T23:35:48.239 DEBUG:boto:Token: None 2023-12-15T23:35:48.239 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.239 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea5e4d4500d0677b-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.242 DEBUG:boto:b'kskgfn-51obj691000falseobj692023-12-15T23:31:32.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:35:48.243 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.243 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.243 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.243 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.243 DEBUG:boto:Method: GET 2023-12-15T23:35:48.244 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.244 DEBUG:boto:Data: 2023-12-15T23:35:48.244 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.244 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.244 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.244 DEBUG:boto:Params: {} 2023-12-15T23:35:48.244 DEBUG:boto:Token: None 2023-12-15T23:35:48.244 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.244 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0= 2023-12-15T23:35:48.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0=', 'Content-Length': '0'} 2023-12-15T23:35:48.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009de3cd0cb5c95a41-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.246 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.246 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.247 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.247 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.247 DEBUG:boto:Method: GET 2023-12-15T23:35:48.247 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.247 DEBUG:boto:Data: 2023-12-15T23:35:48.247 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.247 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.247 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.247 DEBUG:boto:Params: {} 2023-12-15T23:35:48.247 DEBUG:boto:Token: None 2023-12-15T23:35:48.247 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.247 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0= 2023-12-15T23:35:48.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0=', 'Content-Length': '0'} 2023-12-15T23:35:48.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f59fc5b3c25e101d-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.250 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.250 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.250 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.250 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.250 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.250 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.250 DEBUG:boto:Data: 2023-12-15T23:35:48.250 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.250 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.250 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.251 DEBUG:boto:Params: {} 2023-12-15T23:35:48.251 DEBUG:boto:Token: None 2023-12-15T23:35:48.251 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5bIiMvLkFo7o2O891IUJvqVnOI= 2023-12-15T23:35:48.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5bIiMvLkFo7o2O891IUJvqVnOI=', 'Content-Length': '0'} 2023-12-15T23:35:48.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7a540e005fa19e6-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.253 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.253 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.253 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.253 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.254 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.254 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.254 DEBUG:boto:Data: 2023-12-15T23:35:48.254 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.254 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.254 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.254 DEBUG:boto:Params: {} 2023-12-15T23:35:48.254 DEBUG:boto:Token: None 2023-12-15T23:35:48.254 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.254 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:N5bIiMvLkFo7o2O891IUJvqVnOI= 2023-12-15T23:35:48.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:N5bIiMvLkFo7o2O891IUJvqVnOI=', 'Content-Length': '0'} 2023-12-15T23:35:48.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001603d05b50b9652e-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:35:48.257 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.257 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.257 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.257 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.258 DEBUG:boto:Method: GET 2023-12-15T23:35:48.258 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.258 DEBUG:boto:Data: 2023-12-15T23:35:48.258 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.258 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.258 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.258 DEBUG:boto:Params: {} 2023-12-15T23:35:48.258 DEBUG:boto:Token: None 2023-12-15T23:35:48.258 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.258 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0= 2023-12-15T23:35:48.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0=', 'Content-Length': '0'} 2023-12-15T23:35:48.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d06dca7b6e5d207b-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.301 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.302 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.302 DEBUG:boto:path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.302 DEBUG:boto:auth_path=/kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.302 DEBUG:boto:Method: GET 2023-12-15T23:35:48.302 DEBUG:boto:Path: /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.302 DEBUG:boto:Data: 2023-12-15T23:35:48.302 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.302 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.302 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.303 DEBUG:boto:Params: {} 2023-12-15T23:35:48.303 DEBUG:boto:Token: None 2023-12-15T23:35:48.303 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74?versionId=null 2023-12-15T23:35:48.303 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0= 2023-12-15T23:35:48.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ptO+Q/jXTZItgMBM8HWKsN4wFG0=', 'Content-Length': '0'} 2023-12-15T23:35:48.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fad210d6ff5ab68f-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.306 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.306 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.306 DEBUG:boto:path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.306 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.306 DEBUG:boto:Method: GET 2023-12-15T23:35:48.306 DEBUG:boto:Path: /kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.306 DEBUG:boto:Data: 2023-12-15T23:35:48.306 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.307 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.307 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.307 DEBUG:boto:Params: {} 2023-12-15T23:35:48.307 DEBUG:boto:Token: None 2023-12-15T23:35:48.307 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.309 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f95b604256afaca2-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.309 DEBUG:boto:b'kskgfn-51obj741000falseobj742023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.310 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.310 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.310 DEBUG:boto:path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.310 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.310 DEBUG:boto:Method: GET 2023-12-15T23:35:48.310 DEBUG:boto:Path: /kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.311 DEBUG:boto:Data: 2023-12-15T23:35:48.311 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.311 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.311 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.311 DEBUG:boto:Params: {} 2023-12-15T23:35:48.311 DEBUG:boto:Token: None 2023-12-15T23:35:48.311 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.311 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c3a3583b237cbd3-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.315 DEBUG:boto:b'kskgfn-51obj741000falseobj742023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.315 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.315 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.315 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.316 DEBUG:boto:Path: /kskgfn-51/obj74 2023-12-15T23:35:48.316 DEBUG:boto:Data: 2023-12-15T23:35:48.316 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.316 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.316 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.316 DEBUG:boto:Params: {} 2023-12-15T23:35:48.316 DEBUG:boto:Token: None 2023-12-15T23:35:48.316 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74 2023-12-15T23:35:48.316 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qOnWCC5at/1zCnsgGUEVO45TBdY= 2023-12-15T23:35:48.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qOnWCC5at/1zCnsgGUEVO45TBdY=', 'Content-Length': '0'} 2023-12-15T23:35:48.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f870311d39941bff-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.319 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.319 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.319 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.319 DEBUG:boto:Path: /kskgfn-51/obj74 2023-12-15T23:35:48.319 DEBUG:boto:Data: 2023-12-15T23:35:48.319 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.319 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.319 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.319 DEBUG:boto:Params: {} 2023-12-15T23:35:48.320 DEBUG:boto:Token: None 2023-12-15T23:35:48.320 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74 2023-12-15T23:35:48.320 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qOnWCC5at/1zCnsgGUEVO45TBdY= 2023-12-15T23:35:48.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qOnWCC5at/1zCnsgGUEVO45TBdY=', 'Content-Length': '0'} 2023-12-15T23:35:48.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d45e6395b05b173-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2023-12-15T23:35:48.322 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.322 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.322 DEBUG:boto:Method: GET 2023-12-15T23:35:48.322 DEBUG:boto:Path: /kskgfn-51/obj74 2023-12-15T23:35:48.322 DEBUG:boto:Data: 2023-12-15T23:35:48.322 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.322 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.323 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.323 DEBUG:boto:Params: {} 2023-12-15T23:35:48.323 DEBUG:boto:Token: None 2023-12-15T23:35:48.323 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74 2023-12-15T23:35:48.323 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oU7eI7EjoyAF3QtKWV9KYzna7cg= 2023-12-15T23:35:48.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oU7eI7EjoyAF3QtKWV9KYzna7cg=', 'Content-Length': '0'} 2023-12-15T23:35:48.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6beec26e60af080-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.369 DEBUG:boto:path=/kskgfn-51/obj74 2023-12-15T23:35:48.370 DEBUG:boto:auth_path=/kskgfn-51/obj74 2023-12-15T23:35:48.370 DEBUG:boto:Method: GET 2023-12-15T23:35:48.370 DEBUG:boto:Path: /kskgfn-51/obj74 2023-12-15T23:35:48.370 DEBUG:boto:Data: 2023-12-15T23:35:48.370 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.370 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.370 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.370 DEBUG:boto:Params: {} 2023-12-15T23:35:48.371 DEBUG:boto:Token: None 2023-12-15T23:35:48.371 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj74 2023-12-15T23:35:48.371 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:oU7eI7EjoyAF3QtKWV9KYzna7cg= 2023-12-15T23:35:48.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:oU7eI7EjoyAF3QtKWV9KYzna7cg=', 'Content-Length': '0'} 2023-12-15T23:35:48.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008769b2edbb1f9797-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.373 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.373 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.373 DEBUG:boto:path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.374 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.374 DEBUG:boto:Method: GET 2023-12-15T23:35:48.374 DEBUG:boto:Path: /kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.374 DEBUG:boto:Data: 2023-12-15T23:35:48.374 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.374 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.374 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.374 DEBUG:boto:Params: {} 2023-12-15T23:35:48.374 DEBUG:boto:Token: None 2023-12-15T23:35:48.375 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004291e84ee80e9d11-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.377 DEBUG:boto:b'kskgfn-51obj741000falseobj742023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.377 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.378 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.378 DEBUG:boto:path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.378 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.378 DEBUG:boto:Method: GET 2023-12-15T23:35:48.378 DEBUG:boto:Path: /kskgfn-51/?prefix=obj74 2023-12-15T23:35:48.378 DEBUG:boto:Data: 2023-12-15T23:35:48.378 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.378 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.378 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.378 DEBUG:boto:Params: {} 2023-12-15T23:35:48.378 DEBUG:boto:Token: None 2023-12-15T23:35:48.379 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f9613c58d807bb2-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.382 DEBUG:boto:b'kskgfn-51obj741000falseobj742023-12-15T23:31:33.267Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:35:48.383 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.383 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.383 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.383 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.383 DEBUG:boto:Method: GET 2023-12-15T23:35:48.383 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.384 DEBUG:boto:Data: 2023-12-15T23:35:48.384 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.384 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.384 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.384 DEBUG:boto:Params: {} 2023-12-15T23:35:48.384 DEBUG:boto:Token: None 2023-12-15T23:35:48.384 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.384 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40= 2023-12-15T23:35:48.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40=', 'Content-Length': '0'} 2023-12-15T23:35:48.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000851cbb8aae48699d-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.386 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.387 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.387 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.387 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.387 DEBUG:boto:Method: GET 2023-12-15T23:35:48.387 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.387 DEBUG:boto:Data: 2023-12-15T23:35:48.387 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.387 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.387 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.387 DEBUG:boto:Params: {} 2023-12-15T23:35:48.387 DEBUG:boto:Token: None 2023-12-15T23:35:48.388 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.388 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40= 2023-12-15T23:35:48.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40=', 'Content-Length': '0'} 2023-12-15T23:35:48.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1a8d91ec1ec6362-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.390 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.390 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.390 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.390 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.390 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.390 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.390 DEBUG:boto:Data: 2023-12-15T23:35:48.390 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.390 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.390 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.391 DEBUG:boto:Params: {} 2023-12-15T23:35:48.391 DEBUG:boto:Token: None 2023-12-15T23:35:48.391 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.391 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0U6mGUYwrkJbDXUiTrT245UBPnI= 2023-12-15T23:35:48.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0U6mGUYwrkJbDXUiTrT245UBPnI=', 'Content-Length': '0'} 2023-12-15T23:35:48.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005985cdd85904ac81-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.393 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.393 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.393 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.393 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.393 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.394 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.394 DEBUG:boto:Data: 2023-12-15T23:35:48.394 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.394 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.394 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.394 DEBUG:boto:Params: {} 2023-12-15T23:35:48.394 DEBUG:boto:Token: None 2023-12-15T23:35:48.394 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.394 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:0U6mGUYwrkJbDXUiTrT245UBPnI= 2023-12-15T23:35:48.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:0U6mGUYwrkJbDXUiTrT245UBPnI=', 'Content-Length': '0'} 2023-12-15T23:35:48.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094252a79d77d18c4-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:35:48.397 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.397 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.397 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.397 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.397 DEBUG:boto:Method: GET 2023-12-15T23:35:48.397 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.397 DEBUG:boto:Data: 2023-12-15T23:35:48.398 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.398 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.398 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.398 DEBUG:boto:Params: {} 2023-12-15T23:35:48.398 DEBUG:boto:Token: None 2023-12-15T23:35:48.398 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.398 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40= 2023-12-15T23:35:48.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40=', 'Content-Length': '0'} 2023-12-15T23:35:48.400 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9cf3cd02208bf7e-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.401 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.401 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.401 DEBUG:boto:path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.401 DEBUG:boto:auth_path=/kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.401 DEBUG:boto:Method: GET 2023-12-15T23:35:48.401 DEBUG:boto:Path: /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.402 DEBUG:boto:Data: 2023-12-15T23:35:48.402 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.402 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.402 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.402 DEBUG:boto:Params: {} 2023-12-15T23:35:48.402 DEBUG:boto:Token: None 2023-12-15T23:35:48.402 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76?versionId=null 2023-12-15T23:35:48.402 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40= 2023-12-15T23:35:48.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CdWSDQQPi0y/NsLgrJQzbaqLT40=', 'Content-Length': '0'} 2023-12-15T23:35:48.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062c9dac9594fc6ac-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.445 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.446 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.446 DEBUG:boto:path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.446 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.446 DEBUG:boto:Method: GET 2023-12-15T23:35:48.446 DEBUG:boto:Path: /kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.446 DEBUG:boto:Data: 2023-12-15T23:35:48.446 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.446 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.446 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.446 DEBUG:boto:Params: {} 2023-12-15T23:35:48.447 DEBUG:boto:Token: None 2023-12-15T23:35:48.447 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.447 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.449 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083d1f5488b375336-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.450 DEBUG:boto:b'kskgfn-51obj761000falseobj762023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.450 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.450 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.451 DEBUG:boto:path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.451 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.451 DEBUG:boto:Method: GET 2023-12-15T23:35:48.451 DEBUG:boto:Path: /kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.451 DEBUG:boto:Data: 2023-12-15T23:35:48.451 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.451 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.451 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.451 DEBUG:boto:Params: {} 2023-12-15T23:35:48.451 DEBUG:boto:Token: None 2023-12-15T23:35:48.451 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.452 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4c1e34cb75f85fb-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.455 DEBUG:boto:b'kskgfn-51obj761000falseobj762023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.456 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.456 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.456 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.456 DEBUG:boto:Path: /kskgfn-51/obj76 2023-12-15T23:35:48.456 DEBUG:boto:Data: 2023-12-15T23:35:48.456 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.457 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.457 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.457 DEBUG:boto:Params: {} 2023-12-15T23:35:48.457 DEBUG:boto:Token: None 2023-12-15T23:35:48.457 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76 2023-12-15T23:35:48.457 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V/Bo6tb/q4N3kfRzqMPbjrEWdvQ= 2023-12-15T23:35:48.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V/Bo6tb/q4N3kfRzqMPbjrEWdvQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b7ee0ca7fb6508a-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.459 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.459 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.460 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.460 DEBUG:boto:Path: /kskgfn-51/obj76 2023-12-15T23:35:48.460 DEBUG:boto:Data: 2023-12-15T23:35:48.460 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.460 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.460 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.460 DEBUG:boto:Params: {} 2023-12-15T23:35:48.460 DEBUG:boto:Token: None 2023-12-15T23:35:48.460 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76 2023-12-15T23:35:48.460 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:V/Bo6tb/q4N3kfRzqMPbjrEWdvQ= 2023-12-15T23:35:48.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:V/Bo6tb/q4N3kfRzqMPbjrEWdvQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aa8918a77344e87-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2023-12-15T23:35:48.463 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.463 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.463 DEBUG:boto:Method: GET 2023-12-15T23:35:48.463 DEBUG:boto:Path: /kskgfn-51/obj76 2023-12-15T23:35:48.463 DEBUG:boto:Data: 2023-12-15T23:35:48.463 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.463 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.463 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.463 DEBUG:boto:Params: {} 2023-12-15T23:35:48.464 DEBUG:boto:Token: None 2023-12-15T23:35:48.464 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76 2023-12-15T23:35:48.464 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OV6dH0q2XJKp66J2R6KH4UDrAzA= 2023-12-15T23:35:48.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OV6dH0q2XJKp66J2R6KH4UDrAzA=', 'Content-Length': '0'} 2023-12-15T23:35:48.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e6aa75dde79dc05-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.509 DEBUG:boto:path=/kskgfn-51/obj76 2023-12-15T23:35:48.510 DEBUG:boto:auth_path=/kskgfn-51/obj76 2023-12-15T23:35:48.510 DEBUG:boto:Method: GET 2023-12-15T23:35:48.510 DEBUG:boto:Path: /kskgfn-51/obj76 2023-12-15T23:35:48.510 DEBUG:boto:Data: 2023-12-15T23:35:48.510 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.510 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.510 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.510 DEBUG:boto:Params: {} 2023-12-15T23:35:48.510 DEBUG:boto:Token: None 2023-12-15T23:35:48.510 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj76 2023-12-15T23:35:48.511 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OV6dH0q2XJKp66J2R6KH4UDrAzA= 2023-12-15T23:35:48.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OV6dH0q2XJKp66J2R6KH4UDrAzA=', 'Content-Length': '0'} 2023-12-15T23:35:48.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc4208de35a440b4-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.513 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.513 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.513 DEBUG:boto:path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.513 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.513 DEBUG:boto:Method: GET 2023-12-15T23:35:48.514 DEBUG:boto:Path: /kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.514 DEBUG:boto:Data: 2023-12-15T23:35:48.514 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.514 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.514 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.514 DEBUG:boto:Params: {} 2023-12-15T23:35:48.514 DEBUG:boto:Token: None 2023-12-15T23:35:48.515 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.515 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdfe518b0f41cb7e-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.517 DEBUG:boto:b'kskgfn-51obj761000falseobj762023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.518 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.518 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.518 DEBUG:boto:path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.518 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.518 DEBUG:boto:Method: GET 2023-12-15T23:35:48.518 DEBUG:boto:Path: /kskgfn-51/?prefix=obj76 2023-12-15T23:35:48.518 DEBUG:boto:Data: 2023-12-15T23:35:48.518 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.519 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.519 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.519 DEBUG:boto:Params: {} 2023-12-15T23:35:48.519 DEBUG:boto:Token: None 2023-12-15T23:35:48.519 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.519 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001075f1531c958d86-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.522 DEBUG:boto:b'kskgfn-51obj761000falseobj762023-12-15T23:31:32.143Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:35:48.523 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.523 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.523 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.523 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.523 DEBUG:boto:Method: GET 2023-12-15T23:35:48.523 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.523 DEBUG:boto:Data: 2023-12-15T23:35:48.524 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.524 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.524 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.524 DEBUG:boto:Params: {} 2023-12-15T23:35:48.524 DEBUG:boto:Token: None 2023-12-15T23:35:48.524 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.524 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI= 2023-12-15T23:35:48.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI=', 'Content-Length': '0'} 2023-12-15T23:35:48.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008488203677d786bd-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.527 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.527 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.527 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.527 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.527 DEBUG:boto:Method: GET 2023-12-15T23:35:48.527 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.527 DEBUG:boto:Data: 2023-12-15T23:35:48.528 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.528 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.528 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.528 DEBUG:boto:Params: {} 2023-12-15T23:35:48.528 DEBUG:boto:Token: None 2023-12-15T23:35:48.528 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.528 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI= 2023-12-15T23:35:48.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI=', 'Content-Length': '0'} 2023-12-15T23:35:48.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066291cab918fbd1b-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.573 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.574 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.574 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.574 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.574 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.574 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.574 DEBUG:boto:Data: 2023-12-15T23:35:48.574 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.574 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.574 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.574 DEBUG:boto:Params: {} 2023-12-15T23:35:48.575 DEBUG:boto:Token: None 2023-12-15T23:35:48.575 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.575 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2NJelnri0t6wyd80qiFr8PBlWus= 2023-12-15T23:35:48.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2NJelnri0t6wyd80qiFr8PBlWus=', 'Content-Length': '0'} 2023-12-15T23:35:48.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001adbe5844a038300-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.577 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.577 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.578 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.578 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.578 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.578 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.578 DEBUG:boto:Data: 2023-12-15T23:35:48.578 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.578 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.578 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.578 DEBUG:boto:Params: {} 2023-12-15T23:35:48.578 DEBUG:boto:Token: None 2023-12-15T23:35:48.578 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.579 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2NJelnri0t6wyd80qiFr8PBlWus= 2023-12-15T23:35:48.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2NJelnri0t6wyd80qiFr8PBlWus=', 'Content-Length': '0'} 2023-12-15T23:35:48.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b02ae115dd961440-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:35:48.581 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.581 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.581 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.581 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.581 DEBUG:boto:Method: GET 2023-12-15T23:35:48.581 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.581 DEBUG:boto:Data: 2023-12-15T23:35:48.581 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.582 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.582 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.582 DEBUG:boto:Params: {} 2023-12-15T23:35:48.582 DEBUG:boto:Token: None 2023-12-15T23:35:48.582 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.582 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI= 2023-12-15T23:35:48.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI=', 'Content-Length': '0'} 2023-12-15T23:35:48.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac19d5eaf7f1d4a6-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.585 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.585 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.585 DEBUG:boto:path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.586 DEBUG:boto:auth_path=/kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.586 DEBUG:boto:Method: GET 2023-12-15T23:35:48.586 DEBUG:boto:Path: /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.586 DEBUG:boto:Data: 2023-12-15T23:35:48.586 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.586 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.586 DEBUG:boto:Params: {} 2023-12-15T23:35:48.587 DEBUG:boto:Token: None 2023-12-15T23:35:48.587 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85?versionId=null 2023-12-15T23:35:48.587 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI= 2023-12-15T23:35:48.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q0O2rzVTfzCFolUKN+rz5wO93cI=', 'Content-Length': '0'} 2023-12-15T23:35:48.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f84088a848998afc-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.589 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.590 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.590 DEBUG:boto:path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.590 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.590 DEBUG:boto:Method: GET 2023-12-15T23:35:48.590 DEBUG:boto:Path: /kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.590 DEBUG:boto:Data: 2023-12-15T23:35:48.590 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.590 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.590 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.590 DEBUG:boto:Params: {} 2023-12-15T23:35:48.590 DEBUG:boto:Token: None 2023-12-15T23:35:48.591 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ad764575a9e21c0-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.593 DEBUG:boto:b'kskgfn-51obj851000falseobj852023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.594 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.594 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.594 DEBUG:boto:path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.594 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.594 DEBUG:boto:Method: GET 2023-12-15T23:35:48.594 DEBUG:boto:Path: /kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.594 DEBUG:boto:Data: 2023-12-15T23:35:48.594 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.595 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.595 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.595 DEBUG:boto:Params: {} 2023-12-15T23:35:48.595 DEBUG:boto:Token: None 2023-12-15T23:35:48.595 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.595 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.599 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0937cce03834673-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.599 DEBUG:boto:b'kskgfn-51obj851000falseobj852023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.599 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.599 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.599 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.599 DEBUG:boto:Path: /kskgfn-51/obj85 2023-12-15T23:35:48.600 DEBUG:boto:Data: 2023-12-15T23:35:48.600 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.600 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.600 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.600 DEBUG:boto:Params: {} 2023-12-15T23:35:48.600 DEBUG:boto:Token: None 2023-12-15T23:35:48.600 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85 2023-12-15T23:35:48.600 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YNTcX5GiDOLRbRz8VRFnl+1W4As= 2023-12-15T23:35:48.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YNTcX5GiDOLRbRz8VRFnl+1W4As=', 'Content-Length': '0'} 2023-12-15T23:35:48.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd21ecfc08164408-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.603 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.603 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.603 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.603 DEBUG:boto:Path: /kskgfn-51/obj85 2023-12-15T23:35:48.604 DEBUG:boto:Data: 2023-12-15T23:35:48.604 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.604 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.604 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.604 DEBUG:boto:Params: {} 2023-12-15T23:35:48.604 DEBUG:boto:Token: None 2023-12-15T23:35:48.604 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85 2023-12-15T23:35:48.604 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:YNTcX5GiDOLRbRz8VRFnl+1W4As= 2023-12-15T23:35:48.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:YNTcX5GiDOLRbRz8VRFnl+1W4As=', 'Content-Length': '0'} 2023-12-15T23:35:48.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f89b3287c7bc0474-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2023-12-15T23:35:48.607 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.607 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.607 DEBUG:boto:Method: GET 2023-12-15T23:35:48.607 DEBUG:boto:Path: /kskgfn-51/obj85 2023-12-15T23:35:48.607 DEBUG:boto:Data: 2023-12-15T23:35:48.607 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.607 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.608 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.608 DEBUG:boto:Params: {} 2023-12-15T23:35:48.608 DEBUG:boto:Token: None 2023-12-15T23:35:48.608 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85 2023-12-15T23:35:48.608 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ENP67gHMA4vanOOWvuFPH3tJuro= 2023-12-15T23:35:48.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ENP67gHMA4vanOOWvuFPH3tJuro=', 'Content-Length': '0'} 2023-12-15T23:35:48.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eece2069022ee070-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.610 DEBUG:boto:path=/kskgfn-51/obj85 2023-12-15T23:35:48.611 DEBUG:boto:auth_path=/kskgfn-51/obj85 2023-12-15T23:35:48.611 DEBUG:boto:Method: GET 2023-12-15T23:35:48.611 DEBUG:boto:Path: /kskgfn-51/obj85 2023-12-15T23:35:48.611 DEBUG:boto:Data: 2023-12-15T23:35:48.611 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.611 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.611 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.611 DEBUG:boto:Params: {} 2023-12-15T23:35:48.611 DEBUG:boto:Token: None 2023-12-15T23:35:48.611 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj85 2023-12-15T23:35:48.612 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ENP67gHMA4vanOOWvuFPH3tJuro= 2023-12-15T23:35:48.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ENP67gHMA4vanOOWvuFPH3tJuro=', 'Content-Length': '0'} 2023-12-15T23:35:48.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004604048dcb7f07d0-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.661 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.662 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.662 DEBUG:boto:path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.662 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.662 DEBUG:boto:Method: GET 2023-12-15T23:35:48.662 DEBUG:boto:Path: /kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.662 DEBUG:boto:Data: 2023-12-15T23:35:48.662 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.662 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.662 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.662 DEBUG:boto:Params: {} 2023-12-15T23:35:48.663 DEBUG:boto:Token: None 2023-12-15T23:35:48.663 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.663 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9beaca16377ea9c-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.665 DEBUG:boto:b'kskgfn-51obj851000falseobj852023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.666 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.666 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.666 DEBUG:boto:path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.666 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.666 DEBUG:boto:Method: GET 2023-12-15T23:35:48.666 DEBUG:boto:Path: /kskgfn-51/?prefix=obj85 2023-12-15T23:35:48.666 DEBUG:boto:Data: 2023-12-15T23:35:48.666 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.667 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.667 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.667 DEBUG:boto:Params: {} 2023-12-15T23:35:48.667 DEBUG:boto:Token: None 2023-12-15T23:35:48.667 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d161741264946c1b-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.671 DEBUG:boto:b'kskgfn-51obj851000falseobj852023-12-15T23:31:31.866Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:35:48.671 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.671 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.671 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.671 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.672 DEBUG:boto:Method: GET 2023-12-15T23:35:48.672 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.672 DEBUG:boto:Data: 2023-12-15T23:35:48.672 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.672 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.672 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.672 DEBUG:boto:Params: {} 2023-12-15T23:35:48.672 DEBUG:boto:Token: None 2023-12-15T23:35:48.672 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.672 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc= 2023-12-15T23:35:48.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc=', 'Content-Length': '0'} 2023-12-15T23:35:48.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a4ea8113abd9422-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.721 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.722 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.722 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.722 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.722 DEBUG:boto:Method: GET 2023-12-15T23:35:48.722 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.722 DEBUG:boto:Data: 2023-12-15T23:35:48.722 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.722 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.722 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.722 DEBUG:boto:Params: {} 2023-12-15T23:35:48.723 DEBUG:boto:Token: None 2023-12-15T23:35:48.723 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.723 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc= 2023-12-15T23:35:48.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc=', 'Content-Length': '0'} 2023-12-15T23:35:48.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017fcd144ce2b2733-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.726 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.726 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.726 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.726 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.726 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.726 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.726 DEBUG:boto:Data: 2023-12-15T23:35:48.726 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.726 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.727 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.727 DEBUG:boto:Params: {} 2023-12-15T23:35:48.727 DEBUG:boto:Token: None 2023-12-15T23:35:48.727 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.727 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qjUE/s4SFn1rPY2CxnGt7ZMONa0= 2023-12-15T23:35:48.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qjUE/s4SFn1rPY2CxnGt7ZMONa0=', 'Content-Length': '0'} 2023-12-15T23:35:48.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5a7975924e701d5-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.730 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.730 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.730 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.730 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.730 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.730 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.730 DEBUG:boto:Data: 2023-12-15T23:35:48.730 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.731 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.731 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.731 DEBUG:boto:Params: {} 2023-12-15T23:35:48.731 DEBUG:boto:Token: None 2023-12-15T23:35:48.731 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.731 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qjUE/s4SFn1rPY2CxnGt7ZMONa0= 2023-12-15T23:35:48.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qjUE/s4SFn1rPY2CxnGt7ZMONa0=', 'Content-Length': '0'} 2023-12-15T23:35:48.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dec9880206de0d3c-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.734 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:35:48.734 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.734 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.734 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.734 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.734 DEBUG:boto:Method: GET 2023-12-15T23:35:48.734 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.734 DEBUG:boto:Data: 2023-12-15T23:35:48.734 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.735 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.735 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.735 DEBUG:boto:Params: {} 2023-12-15T23:35:48.735 DEBUG:boto:Token: None 2023-12-15T23:35:48.735 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.735 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc= 2023-12-15T23:35:48.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc=', 'Content-Length': '0'} 2023-12-15T23:35:48.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e0b4be6971c9d3f-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.737 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.737 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.738 DEBUG:boto:path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.738 DEBUG:boto:auth_path=/kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.738 DEBUG:boto:Method: GET 2023-12-15T23:35:48.738 DEBUG:boto:Path: /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.738 DEBUG:boto:Data: 2023-12-15T23:35:48.738 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.738 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.738 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.738 DEBUG:boto:Params: {} 2023-12-15T23:35:48.738 DEBUG:boto:Token: None 2023-12-15T23:35:48.739 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87?versionId=null 2023-12-15T23:35:48.739 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc= 2023-12-15T23:35:48.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xOpNZM0318xHUu+aUFuupzfwrfc=', 'Content-Length': '0'} 2023-12-15T23:35:48.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000982ca121d35d6176-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.741 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.741 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.741 DEBUG:boto:path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.741 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.742 DEBUG:boto:Method: GET 2023-12-15T23:35:48.742 DEBUG:boto:Path: /kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.742 DEBUG:boto:Data: 2023-12-15T23:35:48.742 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.742 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.742 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.742 DEBUG:boto:Params: {} 2023-12-15T23:35:48.742 DEBUG:boto:Token: None 2023-12-15T23:35:48.743 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.743 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035cc3a2f0ecf9910-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.745 DEBUG:boto:b'kskgfn-51obj871000falseobj872023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.746 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.746 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.746 DEBUG:boto:path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.746 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.746 DEBUG:boto:Method: GET 2023-12-15T23:35:48.746 DEBUG:boto:Path: /kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.747 DEBUG:boto:Data: 2023-12-15T23:35:48.747 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.747 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.747 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.747 DEBUG:boto:Params: {} 2023-12-15T23:35:48.747 DEBUG:boto:Token: None 2023-12-15T23:35:48.747 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.751 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c54dcaa957346ab8-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.751 DEBUG:boto:b'kskgfn-51obj871000falseobj872023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.751 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.751 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.752 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.752 DEBUG:boto:Path: /kskgfn-51/obj87 2023-12-15T23:35:48.752 DEBUG:boto:Data: 2023-12-15T23:35:48.752 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.752 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.752 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.752 DEBUG:boto:Params: {} 2023-12-15T23:35:48.752 DEBUG:boto:Token: None 2023-12-15T23:35:48.752 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87 2023-12-15T23:35:48.752 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gbyy6qLThw41mQeXo1bhrnIJ5GE= 2023-12-15T23:35:48.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gbyy6qLThw41mQeXo1bhrnIJ5GE=', 'Content-Length': '0'} 2023-12-15T23:35:48.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cc29adba5801937-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.755 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.755 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.755 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.755 DEBUG:boto:Path: /kskgfn-51/obj87 2023-12-15T23:35:48.755 DEBUG:boto:Data: 2023-12-15T23:35:48.755 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.755 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.755 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.756 DEBUG:boto:Params: {} 2023-12-15T23:35:48.756 DEBUG:boto:Token: None 2023-12-15T23:35:48.756 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87 2023-12-15T23:35:48.756 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:gbyy6qLThw41mQeXo1bhrnIJ5GE= 2023-12-15T23:35:48.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:gbyy6qLThw41mQeXo1bhrnIJ5GE=', 'Content-Length': '0'} 2023-12-15T23:35:48.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002507dad73941f06d-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2023-12-15T23:35:48.758 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.758 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.758 DEBUG:boto:Method: GET 2023-12-15T23:35:48.759 DEBUG:boto:Path: /kskgfn-51/obj87 2023-12-15T23:35:48.759 DEBUG:boto:Data: 2023-12-15T23:35:48.759 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.759 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.759 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.759 DEBUG:boto:Params: {} 2023-12-15T23:35:48.759 DEBUG:boto:Token: None 2023-12-15T23:35:48.759 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87 2023-12-15T23:35:48.759 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OIyJjNBaEMu4Zi0JszHQpY+2hoc= 2023-12-15T23:35:48.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OIyJjNBaEMu4Zi0JszHQpY+2hoc=', 'Content-Length': '0'} 2023-12-15T23:35:48.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f793344ee4555beb-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.762 DEBUG:boto:path=/kskgfn-51/obj87 2023-12-15T23:35:48.762 DEBUG:boto:auth_path=/kskgfn-51/obj87 2023-12-15T23:35:48.762 DEBUG:boto:Method: GET 2023-12-15T23:35:48.762 DEBUG:boto:Path: /kskgfn-51/obj87 2023-12-15T23:35:48.762 DEBUG:boto:Data: 2023-12-15T23:35:48.762 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.762 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.762 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.762 DEBUG:boto:Params: {} 2023-12-15T23:35:48.762 DEBUG:boto:Token: None 2023-12-15T23:35:48.762 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj87 2023-12-15T23:35:48.763 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OIyJjNBaEMu4Zi0JszHQpY+2hoc= 2023-12-15T23:35:48.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OIyJjNBaEMu4Zi0JszHQpY+2hoc=', 'Content-Length': '0'} 2023-12-15T23:35:48.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055561a773a702b2c-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.805 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.806 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.806 DEBUG:boto:path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.806 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.806 DEBUG:boto:Method: GET 2023-12-15T23:35:48.806 DEBUG:boto:Path: /kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.806 DEBUG:boto:Data: 2023-12-15T23:35:48.806 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.806 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.806 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.806 DEBUG:boto:Params: {} 2023-12-15T23:35:48.806 DEBUG:boto:Token: None 2023-12-15T23:35:48.807 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008372b54bb1f05cb2-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.809 DEBUG:boto:b'kskgfn-51obj871000falseobj872023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.810 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.810 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.810 DEBUG:boto:path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.810 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.810 DEBUG:boto:Method: GET 2023-12-15T23:35:48.810 DEBUG:boto:Path: /kskgfn-51/?prefix=obj87 2023-12-15T23:35:48.810 DEBUG:boto:Data: 2023-12-15T23:35:48.810 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.811 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.811 DEBUG:boto:Params: {} 2023-12-15T23:35:48.811 DEBUG:boto:Token: None 2023-12-15T23:35:48.811 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018caa4835cc33397-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.815 DEBUG:boto:b'kskgfn-51obj871000falseobj872023-12-15T23:31:32.707Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:35:48.815 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.816 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.816 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.816 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.816 DEBUG:boto:Method: GET 2023-12-15T23:35:48.816 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.816 DEBUG:boto:Data: 2023-12-15T23:35:48.816 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.816 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.816 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.816 DEBUG:boto:Params: {} 2023-12-15T23:35:48.817 DEBUG:boto:Token: None 2023-12-15T23:35:48.817 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM= 2023-12-15T23:35:48.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM=', 'Content-Length': '0'} 2023-12-15T23:35:48.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beaa4c26c234c909-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.821 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.821 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.821 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.821 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.821 DEBUG:boto:Method: GET 2023-12-15T23:35:48.821 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.821 DEBUG:boto:Data: 2023-12-15T23:35:48.821 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.822 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.822 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.822 DEBUG:boto:Params: {} 2023-12-15T23:35:48.822 DEBUG:boto:Token: None 2023-12-15T23:35:48.822 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.822 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM= 2023-12-15T23:35:48.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM=', 'Content-Length': '0'} 2023-12-15T23:35:48.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df875828df3fec9f-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.825 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.825 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.826 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.826 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.826 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.826 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.826 DEBUG:boto:Data: 2023-12-15T23:35:48.826 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.826 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.826 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.826 DEBUG:boto:Params: {} 2023-12-15T23:35:48.826 DEBUG:boto:Token: None 2023-12-15T23:35:48.827 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.827 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ozRXVtDeuvZPYrBs1o6Q9ycCM2k= 2023-12-15T23:35:48.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ozRXVtDeuvZPYrBs1o6Q9ycCM2k=', 'Content-Length': '0'} 2023-12-15T23:35:48.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbcba1a97c994550-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.829 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.829 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.829 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.830 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.830 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.830 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.830 DEBUG:boto:Data: 2023-12-15T23:35:48.830 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.830 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.830 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.830 DEBUG:boto:Params: {} 2023-12-15T23:35:48.830 DEBUG:boto:Token: None 2023-12-15T23:35:48.830 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.830 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ozRXVtDeuvZPYrBs1o6Q9ycCM2k= 2023-12-15T23:35:48.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ozRXVtDeuvZPYrBs1o6Q9ycCM2k=', 'Content-Length': '0'} 2023-12-15T23:35:48.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a63e110dd0c7749-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.833 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:35:48.833 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.833 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.833 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.833 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.834 DEBUG:boto:Method: GET 2023-12-15T23:35:48.834 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.834 DEBUG:boto:Data: 2023-12-15T23:35:48.834 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.834 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.834 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.834 DEBUG:boto:Params: {} 2023-12-15T23:35:48.834 DEBUG:boto:Token: None 2023-12-15T23:35:48.835 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.835 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM= 2023-12-15T23:35:48.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM=', 'Content-Length': '0'} 2023-12-15T23:35:48.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019fa28f2854449e4-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.837 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.837 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.837 DEBUG:boto:path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.838 DEBUG:boto:auth_path=/kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.838 DEBUG:boto:Method: GET 2023-12-15T23:35:48.838 DEBUG:boto:Path: /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.838 DEBUG:boto:Data: 2023-12-15T23:35:48.838 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.838 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.838 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.838 DEBUG:boto:Params: {} 2023-12-15T23:35:48.838 DEBUG:boto:Token: None 2023-12-15T23:35:48.839 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92?versionId=null 2023-12-15T23:35:48.839 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM= 2023-12-15T23:35:48.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RfDFVmW0OL7pzmFuwBfRmrwlhiM=', 'Content-Length': '0'} 2023-12-15T23:35:48.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e09cbb90a14ce1cc-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.841 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.841 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.841 DEBUG:boto:path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.842 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.842 DEBUG:boto:Method: GET 2023-12-15T23:35:48.842 DEBUG:boto:Path: /kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.842 DEBUG:boto:Data: 2023-12-15T23:35:48.842 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.842 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.842 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.842 DEBUG:boto:Params: {} 2023-12-15T23:35:48.842 DEBUG:boto:Token: None 2023-12-15T23:35:48.842 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.842 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.845 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000976e9a6c5f008fbc-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.845 DEBUG:boto:b'kskgfn-51obj921000falseobj922023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.845 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.845 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.845 DEBUG:boto:path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.846 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.846 DEBUG:boto:Method: GET 2023-12-15T23:35:48.846 DEBUG:boto:Path: /kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.846 DEBUG:boto:Data: 2023-12-15T23:35:48.846 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.846 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.846 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.846 DEBUG:boto:Params: {} 2023-12-15T23:35:48.847 DEBUG:boto:Token: None 2023-12-15T23:35:48.847 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.847 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.851 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000418c1bd3a4be8f77-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.851 DEBUG:boto:b'kskgfn-51obj921000falseobj922023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.851 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.851 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.851 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.852 DEBUG:boto:Path: /kskgfn-51/obj92 2023-12-15T23:35:48.852 DEBUG:boto:Data: 2023-12-15T23:35:48.852 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.852 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.852 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.852 DEBUG:boto:Params: {} 2023-12-15T23:35:48.852 DEBUG:boto:Token: None 2023-12-15T23:35:48.852 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92 2023-12-15T23:35:48.852 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tpicZte2znoVYD/j762C4z2/k/I= 2023-12-15T23:35:48.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tpicZte2znoVYD/j762C4z2/k/I=', 'Content-Length': '0'} 2023-12-15T23:35:48.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008166eb8a924a45cf-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.855 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.855 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.855 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.855 DEBUG:boto:Path: /kskgfn-51/obj92 2023-12-15T23:35:48.855 DEBUG:boto:Data: 2023-12-15T23:35:48.855 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.856 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.856 DEBUG:boto:Params: {} 2023-12-15T23:35:48.856 DEBUG:boto:Token: None 2023-12-15T23:35:48.856 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92 2023-12-15T23:35:48.856 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tpicZte2znoVYD/j762C4z2/k/I= 2023-12-15T23:35:48.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tpicZte2znoVYD/j762C4z2/k/I=', 'Content-Length': '0'} 2023-12-15T23:35:48.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ee9a592df446670-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2023-12-15T23:35:48.859 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.859 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.859 DEBUG:boto:Method: GET 2023-12-15T23:35:48.859 DEBUG:boto:Path: /kskgfn-51/obj92 2023-12-15T23:35:48.859 DEBUG:boto:Data: 2023-12-15T23:35:48.860 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.860 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.860 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.860 DEBUG:boto:Params: {} 2023-12-15T23:35:48.860 DEBUG:boto:Token: None 2023-12-15T23:35:48.860 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92 2023-12-15T23:35:48.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x5JyVhJ9wJbX/wNM1l8r6PYISVQ= 2023-12-15T23:35:48.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x5JyVhJ9wJbX/wNM1l8r6PYISVQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037ef1370020eab0b-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.905 DEBUG:boto:path=/kskgfn-51/obj92 2023-12-15T23:35:48.906 DEBUG:boto:auth_path=/kskgfn-51/obj92 2023-12-15T23:35:48.906 DEBUG:boto:Method: GET 2023-12-15T23:35:48.906 DEBUG:boto:Path: /kskgfn-51/obj92 2023-12-15T23:35:48.906 DEBUG:boto:Data: 2023-12-15T23:35:48.906 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.906 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.906 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.906 DEBUG:boto:Params: {} 2023-12-15T23:35:48.906 DEBUG:boto:Token: None 2023-12-15T23:35:48.906 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj92 2023-12-15T23:35:48.906 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x5JyVhJ9wJbX/wNM1l8r6PYISVQ= 2023-12-15T23:35:48.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x5JyVhJ9wJbX/wNM1l8r6PYISVQ=', 'Content-Length': '0'} 2023-12-15T23:35:48.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2f78d7248f2ed4d-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.909 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.909 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.909 DEBUG:boto:path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.909 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.910 DEBUG:boto:Method: GET 2023-12-15T23:35:48.910 DEBUG:boto:Path: /kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.910 DEBUG:boto:Data: 2023-12-15T23:35:48.910 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.910 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.910 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.910 DEBUG:boto:Params: {} 2023-12-15T23:35:48.910 DEBUG:boto:Token: None 2023-12-15T23:35:48.910 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.910 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e219a73e7c168ae-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.913 DEBUG:boto:b'kskgfn-51obj921000falseobj922023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.913 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.913 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.913 DEBUG:boto:path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.914 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.914 DEBUG:boto:Method: GET 2023-12-15T23:35:48.914 DEBUG:boto:Path: /kskgfn-51/?prefix=obj92 2023-12-15T23:35:48.914 DEBUG:boto:Data: 2023-12-15T23:35:48.914 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.914 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.914 DEBUG:boto:Params: {} 2023-12-15T23:35:48.914 DEBUG:boto:Token: None 2023-12-15T23:35:48.914 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.914 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067a00ca5dabe0adf-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.918 DEBUG:boto:b'kskgfn-51obj921000falseobj922023-12-15T23:31:32.425Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:48.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:35:48.919 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.919 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.919 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.919 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.919 DEBUG:boto:Method: GET 2023-12-15T23:35:48.919 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.919 DEBUG:boto:Data: 2023-12-15T23:35:48.919 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.919 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.919 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.919 DEBUG:boto:Params: {} 2023-12-15T23:35:48.920 DEBUG:boto:Token: None 2023-12-15T23:35:48.920 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.920 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA= 2023-12-15T23:35:48.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA=', 'Content-Length': '0'} 2023-12-15T23:35:48.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a447b870301f5612-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.922 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.922 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.922 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.922 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.922 DEBUG:boto:Method: GET 2023-12-15T23:35:48.922 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.922 DEBUG:boto:Data: 2023-12-15T23:35:48.923 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.923 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.923 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.923 DEBUG:boto:Params: {} 2023-12-15T23:35:48.923 DEBUG:boto:Token: None 2023-12-15T23:35:48.923 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.923 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA= 2023-12-15T23:35:48.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA=', 'Content-Length': '0'} 2023-12-15T23:35:48.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035e1ae420f68dfa4-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.925 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.925 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.925 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.925 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.926 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.926 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.926 DEBUG:boto:Data: 2023-12-15T23:35:48.926 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.926 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.926 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.926 DEBUG:boto:Params: {} 2023-12-15T23:35:48.926 DEBUG:boto:Token: None 2023-12-15T23:35:48.926 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.926 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2sYUuljzkqMD+HZ2MPsGDOyZMHs= 2023-12-15T23:35:48.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2sYUuljzkqMD+HZ2MPsGDOyZMHs=', 'Content-Length': '0'} 2023-12-15T23:35:48.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048aa7ad53e23d1b3-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.928 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.928 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.928 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.929 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.929 DEBUG:boto:Method: HEAD 2023-12-15T23:35:48.929 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.929 DEBUG:boto:Data: 2023-12-15T23:35:48.929 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.929 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.929 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.929 DEBUG:boto:Params: {} 2023-12-15T23:35:48.929 DEBUG:boto:Token: None 2023-12-15T23:35:48.929 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.930 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2sYUuljzkqMD+HZ2MPsGDOyZMHs= 2023-12-15T23:35:48.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2sYUuljzkqMD+HZ2MPsGDOyZMHs=', 'Content-Length': '0'} 2023-12-15T23:35:48.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c3895ba7cfb0c30-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.931 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:35:48.931 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.932 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.932 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.932 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.932 DEBUG:boto:Method: GET 2023-12-15T23:35:48.932 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.932 DEBUG:boto:Data: 2023-12-15T23:35:48.932 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.932 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.932 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.932 DEBUG:boto:Params: {} 2023-12-15T23:35:48.932 DEBUG:boto:Token: None 2023-12-15T23:35:48.933 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.933 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA= 2023-12-15T23:35:48.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA=', 'Content-Length': '0'} 2023-12-15T23:35:48.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000889b1b7fdbea8904-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.981 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:48.982 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:48.982 DEBUG:boto:path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.982 DEBUG:boto:auth_path=/kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.982 DEBUG:boto:Method: GET 2023-12-15T23:35:48.982 DEBUG:boto:Path: /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.982 DEBUG:boto:Data: 2023-12-15T23:35:48.982 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.982 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:48.982 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.982 DEBUG:boto:Params: {} 2023-12-15T23:35:48.982 DEBUG:boto:Token: None 2023-12-15T23:35:48.983 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/obj93?versionId=null 2023-12-15T23:35:48.983 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA= 2023-12-15T23:35:48.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:G3s3yS5jwrBoBtNeIAeALu9T8gA=', 'Content-Length': '0'} 2023-12-15T23:35:48.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2d45082b695c806-00657ce2d4-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:48.985 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:48.985 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:48.985 DEBUG:boto:path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:48.985 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:48.985 DEBUG:boto:Method: GET 2023-12-15T23:35:48.985 DEBUG:boto:Path: /kskgfn-51/?prefix=obj93 2023-12-15T23:35:48.985 DEBUG:boto:Data: 2023-12-15T23:35:48.985 DEBUG:boto:Headers: {} 2023-12-15T23:35:48.986 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:48.986 DEBUG:boto:Port: 8000 2023-12-15T23:35:48.986 DEBUG:boto:Params: {} 2023-12-15T23:35:48.986 DEBUG:boto:Token: None 2023-12-15T23:35:48.986 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:48 GMT /kskgfn-51/ 2023-12-15T23:35:48.986 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI= 2023-12-15T23:35:48.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:48 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:vMn5fukpMEPPk7bjajeHQjjLemI=', 'Content-Length': '0'} 2023-12-15T23:35:48.988 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dae2a91942218d5-00657ce2d4-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:48 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.033 DEBUG:boto:b'kskgfn-51obj931000falseobj932023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.034 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.034 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.034 DEBUG:boto:path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.034 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.034 DEBUG:boto:Method: GET 2023-12-15T23:35:49.034 DEBUG:boto:Path: /kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.034 DEBUG:boto:Data: 2023-12-15T23:35:49.034 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.034 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.034 DEBUG:boto:Params: {} 2023-12-15T23:35:49.035 DEBUG:boto:Token: None 2023-12-15T23:35:49.035 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.038 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079244980961bc525-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.038 DEBUG:boto:b'kskgfn-51obj931000falseobj932023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.038 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:49.038 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:49.039 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.039 DEBUG:boto:Path: /kskgfn-51/obj93 2023-12-15T23:35:49.039 DEBUG:boto:Data: 2023-12-15T23:35:49.039 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.039 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.039 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.039 DEBUG:boto:Params: {} 2023-12-15T23:35:49.039 DEBUG:boto:Token: None 2023-12-15T23:35:49.039 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj93 2023-12-15T23:35:49.039 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQVtgwqVaM+FT1HE21KVCuBb9EE= 2023-12-15T23:35:49.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQVtgwqVaM+FT1HE21KVCuBb9EE=', 'Content-Length': '0'} 2023-12-15T23:35:49.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081a4012a660324a8-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.042 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:49.042 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:49.042 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.042 DEBUG:boto:Path: /kskgfn-51/obj93 2023-12-15T23:35:49.042 DEBUG:boto:Data: 2023-12-15T23:35:49.042 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.042 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.042 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.042 DEBUG:boto:Params: {} 2023-12-15T23:35:49.042 DEBUG:boto:Token: None 2023-12-15T23:35:49.043 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj93 2023-12-15T23:35:49.043 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iQVtgwqVaM+FT1HE21KVCuBb9EE= 2023-12-15T23:35:49.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iQVtgwqVaM+FT1HE21KVCuBb9EE=', 'Content-Length': '0'} 2023-12-15T23:35:49.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007074c226c11bcfde-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2023-12-15T23:35:49.045 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:49.045 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:49.045 DEBUG:boto:Method: GET 2023-12-15T23:35:49.045 DEBUG:boto:Path: /kskgfn-51/obj93 2023-12-15T23:35:49.045 DEBUG:boto:Data: 2023-12-15T23:35:49.045 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.045 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.046 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.046 DEBUG:boto:Params: {} 2023-12-15T23:35:49.046 DEBUG:boto:Token: None 2023-12-15T23:35:49.046 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj93 2023-12-15T23:35:49.046 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e6q8IB8rlec/wsgHsnrFnK/exlY= 2023-12-15T23:35:49.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e6q8IB8rlec/wsgHsnrFnK/exlY=', 'Content-Length': '0'} 2023-12-15T23:35:49.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e36a85ed3f5fb29-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.090 DEBUG:boto:path=/kskgfn-51/obj93 2023-12-15T23:35:49.090 DEBUG:boto:auth_path=/kskgfn-51/obj93 2023-12-15T23:35:49.090 DEBUG:boto:Method: GET 2023-12-15T23:35:49.090 DEBUG:boto:Path: /kskgfn-51/obj93 2023-12-15T23:35:49.090 DEBUG:boto:Data: 2023-12-15T23:35:49.090 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.090 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.090 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.090 DEBUG:boto:Params: {} 2023-12-15T23:35:49.090 DEBUG:boto:Token: None 2023-12-15T23:35:49.091 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj93 2023-12-15T23:35:49.091 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:e6q8IB8rlec/wsgHsnrFnK/exlY= 2023-12-15T23:35:49.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:e6q8IB8rlec/wsgHsnrFnK/exlY=', 'Content-Length': '0'} 2023-12-15T23:35:49.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:33 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002384e021431a5444-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.093 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.093 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.093 DEBUG:boto:path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.093 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.093 DEBUG:boto:Method: GET 2023-12-15T23:35:49.094 DEBUG:boto:Path: /kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.094 DEBUG:boto:Data: 2023-12-15T23:35:49.094 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.094 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.094 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.094 DEBUG:boto:Params: {} 2023-12-15T23:35:49.094 DEBUG:boto:Token: None 2023-12-15T23:35:49.094 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.094 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.097 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf788c0a0884ac20-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.097 DEBUG:boto:b'kskgfn-51obj931000falseobj932023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.097 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.097 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.097 DEBUG:boto:path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.097 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.097 DEBUG:boto:Method: GET 2023-12-15T23:35:49.097 DEBUG:boto:Path: /kskgfn-51/?prefix=obj93 2023-12-15T23:35:49.098 DEBUG:boto:Data: 2023-12-15T23:35:49.098 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.098 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.098 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.098 DEBUG:boto:Params: {} 2023-12-15T23:35:49.098 DEBUG:boto:Token: None 2023-12-15T23:35:49.098 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.098 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001a55fcb19d2d504-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.102 DEBUG:boto:b'kskgfn-51obj931000falseobj932023-12-15T23:31:33.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.102 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:35:49.102 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.102 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.102 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.102 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.103 DEBUG:boto:Method: GET 2023-12-15T23:35:49.103 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.103 DEBUG:boto:Data: 2023-12-15T23:35:49.103 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.103 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.103 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.103 DEBUG:boto:Params: {} 2023-12-15T23:35:49.103 DEBUG:boto:Token: None 2023-12-15T23:35:49.103 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.103 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM= 2023-12-15T23:35:49.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM=', 'Content-Length': '0'} 2023-12-15T23:35:49.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4184d9dfec2162f-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.105 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.106 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.106 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.106 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.106 DEBUG:boto:Method: GET 2023-12-15T23:35:49.106 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.106 DEBUG:boto:Data: 2023-12-15T23:35:49.106 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.106 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.106 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.106 DEBUG:boto:Params: {} 2023-12-15T23:35:49.106 DEBUG:boto:Token: None 2023-12-15T23:35:49.106 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.107 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM= 2023-12-15T23:35:49.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM=', 'Content-Length': '0'} 2023-12-15T23:35:49.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003495267685cc7afc-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.149 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.150 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.150 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.150 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.150 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.150 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.150 DEBUG:boto:Data: 2023-12-15T23:35:49.150 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.150 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.150 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.151 DEBUG:boto:Params: {} 2023-12-15T23:35:49.151 DEBUG:boto:Token: None 2023-12-15T23:35:49.151 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.151 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mn0I1eoVBgzbcambwCok2DRZLJA= 2023-12-15T23:35:49.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mn0I1eoVBgzbcambwCok2DRZLJA=', 'Content-Length': '0'} 2023-12-15T23:35:49.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000917340e305874b5a-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.153 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.153 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.153 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.154 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.154 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.154 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.154 DEBUG:boto:Data: 2023-12-15T23:35:49.154 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.154 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.154 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.154 DEBUG:boto:Params: {} 2023-12-15T23:35:49.154 DEBUG:boto:Token: None 2023-12-15T23:35:49.154 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.155 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mn0I1eoVBgzbcambwCok2DRZLJA= 2023-12-15T23:35:49.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mn0I1eoVBgzbcambwCok2DRZLJA=', 'Content-Length': '0'} 2023-12-15T23:35:49.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee6490fc5f46e527-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:35:49.157 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.157 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.157 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.157 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.157 DEBUG:boto:Method: GET 2023-12-15T23:35:49.157 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.157 DEBUG:boto:Data: 2023-12-15T23:35:49.157 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.157 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.157 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.158 DEBUG:boto:Params: {} 2023-12-15T23:35:49.158 DEBUG:boto:Token: None 2023-12-15T23:35:49.158 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.158 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM= 2023-12-15T23:35:49.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM=', 'Content-Length': '0'} 2023-12-15T23:35:49.160 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a646c5d047d53ca-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.201 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.202 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.202 DEBUG:boto:path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.202 DEBUG:boto:auth_path=/kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.202 DEBUG:boto:Method: GET 2023-12-15T23:35:49.202 DEBUG:boto:Path: /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.202 DEBUG:boto:Data: 2023-12-15T23:35:49.202 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.202 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.202 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.202 DEBUG:boto:Params: {} 2023-12-15T23:35:49.202 DEBUG:boto:Token: None 2023-12-15T23:35:49.203 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95?versionId=null 2023-12-15T23:35:49.203 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM= 2023-12-15T23:35:49.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:dEge9qOPKq7K7w8ptjNJv0+POOM=', 'Content-Length': '0'} 2023-12-15T23:35:49.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd6b30721ac96815-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.205 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.205 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.205 DEBUG:boto:path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.205 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.205 DEBUG:boto:Method: GET 2023-12-15T23:35:49.205 DEBUG:boto:Path: /kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.205 DEBUG:boto:Data: 2023-12-15T23:35:49.206 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.206 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.206 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.206 DEBUG:boto:Params: {} 2023-12-15T23:35:49.206 DEBUG:boto:Token: None 2023-12-15T23:35:49.206 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000586dcd1bbfb3ff65-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.249 DEBUG:boto:b'kskgfn-51obj951000falseobj952023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.250 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.250 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.250 DEBUG:boto:path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.250 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.250 DEBUG:boto:Method: GET 2023-12-15T23:35:49.250 DEBUG:boto:Path: /kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.250 DEBUG:boto:Data: 2023-12-15T23:35:49.250 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.251 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.251 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.251 DEBUG:boto:Params: {} 2023-12-15T23:35:49.251 DEBUG:boto:Token: None 2023-12-15T23:35:49.251 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.251 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006351b31f04485214-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.255 DEBUG:boto:b'kskgfn-51obj951000falseobj952023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.255 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.255 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.255 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.255 DEBUG:boto:Path: /kskgfn-51/obj95 2023-12-15T23:35:49.255 DEBUG:boto:Data: 2023-12-15T23:35:49.256 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.256 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.256 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.256 DEBUG:boto:Params: {} 2023-12-15T23:35:49.256 DEBUG:boto:Token: None 2023-12-15T23:35:49.256 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95 2023-12-15T23:35:49.256 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/dl3ivEGrDNyPHrRRM49VyZ4tKA= 2023-12-15T23:35:49.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/dl3ivEGrDNyPHrRRM49VyZ4tKA=', 'Content-Length': '0'} 2023-12-15T23:35:49.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076b2b0e9c030a3a3-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.258 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.258 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.258 DEBUG:boto:Method: HEAD 2023-12-15T23:35:49.259 DEBUG:boto:Path: /kskgfn-51/obj95 2023-12-15T23:35:49.259 DEBUG:boto:Data: 2023-12-15T23:35:49.259 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.259 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.259 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.259 DEBUG:boto:Params: {} 2023-12-15T23:35:49.259 DEBUG:boto:Token: None 2023-12-15T23:35:49.259 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95 2023-12-15T23:35:49.259 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/dl3ivEGrDNyPHrRRM49VyZ4tKA= 2023-12-15T23:35:49.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/dl3ivEGrDNyPHrRRM49VyZ4tKA=', 'Content-Length': '0'} 2023-12-15T23:35:49.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e7a3b9b3bff675-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2023-12-15T23:35:49.261 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.261 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.262 DEBUG:boto:Method: GET 2023-12-15T23:35:49.262 DEBUG:boto:Path: /kskgfn-51/obj95 2023-12-15T23:35:49.262 DEBUG:boto:Data: 2023-12-15T23:35:49.262 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.262 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.262 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.262 DEBUG:boto:Params: {} 2023-12-15T23:35:49.262 DEBUG:boto:Token: None 2023-12-15T23:35:49.262 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95 2023-12-15T23:35:49.262 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3L9J8D1dxvMwAYU9ECBvSvA4wT4= 2023-12-15T23:35:49.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3L9J8D1dxvMwAYU9ECBvSvA4wT4=', 'Content-Length': '0'} 2023-12-15T23:35:49.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-51:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.22'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c446644bc1aefa23-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.305 DEBUG:boto:path=/kskgfn-51/obj95 2023-12-15T23:35:49.305 DEBUG:boto:auth_path=/kskgfn-51/obj95 2023-12-15T23:35:49.306 DEBUG:boto:Method: GET 2023-12-15T23:35:49.306 DEBUG:boto:Path: /kskgfn-51/obj95 2023-12-15T23:35:49.306 DEBUG:boto:Data: 2023-12-15T23:35:49.306 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.306 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.306 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.306 DEBUG:boto:Params: {} 2023-12-15T23:35:49.306 DEBUG:boto:Token: None 2023-12-15T23:35:49.306 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/obj95 2023-12-15T23:35:49.307 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:3L9J8D1dxvMwAYU9ECBvSvA4wT4= 2023-12-15T23:35:49.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:3L9J8D1dxvMwAYU9ECBvSvA4wT4=', 'Content-Length': '0'} 2023-12-15T23:35:49.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:31:32 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000189433d7715e9da7-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.309 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.309 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.309 DEBUG:boto:path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.309 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.309 DEBUG:boto:Method: GET 2023-12-15T23:35:49.309 DEBUG:boto:Path: /kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.309 DEBUG:boto:Data: 2023-12-15T23:35:49.309 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.309 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:35:49.309 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.310 DEBUG:boto:Params: {} 2023-12-15T23:35:49.310 DEBUG:boto:Token: None 2023-12-15T23:35:49.310 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.310 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.310 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022afd31a7fda3c09-00657ce2d5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.357 DEBUG:boto:b'kskgfn-51obj951000falseobj952023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.358 DEBUG:boto:path=/kskgfn-51/ 2023-12-15T23:35:49.358 DEBUG:boto:auth_path=/kskgfn-51/ 2023-12-15T23:35:49.358 DEBUG:boto:path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.358 DEBUG:boto:auth_path=/kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.358 DEBUG:boto:Method: GET 2023-12-15T23:35:49.358 DEBUG:boto:Path: /kskgfn-51/?prefix=obj95 2023-12-15T23:35:49.358 DEBUG:boto:Data: 2023-12-15T23:35:49.358 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.359 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.359 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.359 DEBUG:boto:Params: {} 2023-12-15T23:35:49.359 DEBUG:boto:Token: None 2023-12-15T23:35:49.359 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-51/ 2023-12-15T23:35:49.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0= 2023-12-15T23:35:49.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zDkCbn71NykzeLgtPSV/nABixf0=', 'Content-Length': '0'} 2023-12-15T23:35:49.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4c00e62e6e44cbe-00657ce2d5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.362 DEBUG:boto:b'kskgfn-51obj951000falseobj952023-12-15T23:31:32.154Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:35:49.363 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-51 zones={test-zone2, test-zone1} 2023-12-15T23:35:49.363 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2023-12-15T23:35:49.363 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.364 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.415 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.415 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.470 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"00000000000000000000:00000000000000032421","last_update":"2023-12-15T23:31:53.418912Z"},{"marker":"00000000000000000000:00000000000000032608","last_update":"2023-12-15T23:31:53.420912Z"},{"marker":"00000000000000000000:00000000000000023827","last_update":"2023-12-15T23:31:53.422646Z"},{"marker":"00000000000000000000:00000000000000036793","last_update":"2023-12-15T23:31:33.346353Z"}] 2023-12-15T23:35:49.471 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000032421', 1: '00000000000000000000:00000000000000032608', 2: '00000000000000000000:00000000000000023827', 3: '00000000000000000000:00000000000000036793'} 2023-12-15T23:35:49.471 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:35:49.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.471 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.526 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.527 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.579 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12882364200947481870},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000032421","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:31:53.418912Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000032608","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:31:53.420912Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023827","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2023-12-15T23:31:53.422646Z"}},{"key":3,"val":{"status":"full-sync","marker":"kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0","next_step_marker":"00000000000000000000:00000000000000036793","total_entries":42,"pos":24,"timestamp":"2023-12-15T23:31:33.346353Z"}}]},"full_sync":{"total":51,"complete":33},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.580 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12882364200947481870},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000032421","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:31:53.418912Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000032608","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:31:53.420912Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000023827","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2023-12-15T23:31:53.422646Z"}},{"key":3,"val":{"status":"full-sync","marker":"kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0","next_step_marker":"00000000000000000000:00000000000000036793","total_entries":42,"pos":24,"timestamp":"2023-12-15T23:31:33.346353Z"}}]},"full_sync":{"total":51,"complete":33},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.580 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000032421', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:31:53.418912Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000032608', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:31:53.420912Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000023827', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2023-12-15T23:31:53.422646Z'}}, {'key': 3, 'val': {'status': 'full-sync', 'marker': 'kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0', 'next_step_marker': '00000000000000000000:00000000000000036793', 'total_entries': 42, 'pos': 24, 'timestamp': '2023-12-15T23:31:33.346353Z'}}] 2023-12-15T23:35:49.580 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000032421', 1: '00000000000000000000:00000000000000032608', 2: '00000000000000000000:00000000000000023827', 3: '00000000000000000000:00000000000000036793'} 2023-12-15T23:35:49.580 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000032421', 1: '00000000000000000000:00000000000000032608', 2: '00000000000000000000:00000000000000023827', 3: 'kskgfn-33:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.4:0'} 2023-12-15T23:35:49.580 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2023-12-15T23:35:49.580 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2023-12-15T23:35:49.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.581 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.626 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.626 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:[{"marker":"00000000000000000000:00000000000000014875","last_update":"2023-12-15T23:33:45.619264Z"},{"marker":"00000000000000000000:00000000000000012368","last_update":"2023-12-15T23:33:45.621352Z"},{"marker":"00000000000000000000:00000000000000007122","last_update":"2023-12-15T23:33:45.623183Z"},{"marker":"00000000000000000000:00000000000000014725","last_update":"2023-12-15T23:33:45.625503Z"}] 2023-12-15T23:35:49.679 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000014875', 1: '00000000000000000000:00000000000000012368', 2: '00000000000000000000:00000000000000007122', 3: '00000000000000000000:00000000000000014725'} 2023-12-15T23:35:49.679 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:35:49.680 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.680 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.730 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.730 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.777 INFO:teuthology.orchestra.run.smithi093.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014875","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.619264Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012368","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.621352Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:33:45.623183Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014725","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.625503Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.777 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16527947896200842135},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014875","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.619264Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012368","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.621352Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007122","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2023-12-15T23:33:45.623183Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000014725","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:33:45.625503Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.777 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014875', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:33:45.619264Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012368', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:33:45.621352Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007122', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2023-12-15T23:33:45.623183Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000014725', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:33:45.625503Z'}}] 2023-12-15T23:35:49.778 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000014875', 1: '00000000000000000000:00000000000000012368', 2: '00000000000000000000:00000000000000007122', 3: '00000000000000000000:00000000000000014725'} 2023-12-15T23:35:49.778 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000014875', 1: '00000000000000000000:00000000000000012368', 2: '00000000000000000000:00000000000000007122', 3: '00000000000000000000:00000000000000014725'} 2023-12-15T23:35:49.778 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2023-12-15T23:35:49.778 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_full_sync_after_data_sync_init ... ok 2023-12-15T23:35:49.780 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:35:49.780 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:35:49.780 DEBUG:boto:Method: PUT 2023-12-15T23:35:49.780 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:35:49.781 DEBUG:boto:Data: 2023-12-15T23:35:49.781 DEBUG:boto:Headers: {} 2023-12-15T23:35:49.781 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:49.781 DEBUG:boto:Port: 8000 2023-12-15T23:35:49.781 DEBUG:boto:Params: {} 2023-12-15T23:35:49.781 DEBUG:boto:Token: None 2023-12-15T23:35:49.781 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:35:49 GMT /kskgfn-52/ 2023-12-15T23:35:49.782 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:IW6HKOkNj6zw1yZbgfJcVOZUszk= 2023-12-15T23:35:49.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IW6HKOkNj6zw1yZbgfJcVOZUszk=', 'Content-Length': '0'} 2023-12-15T23:35:49.796 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008102a58ca57d0ffc-00657ce2d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:49.797 DEBUG:rgw_multi.tests:created bucket=kskgfn-52 2023-12-15T23:35:49.797 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.797 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.842 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.842 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.872 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:35:49.887 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702683349.794097_490.1","last_update":"2023-12-15T23:35:49.794097Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:35:49.887 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:35:49.888 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:35:49.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:49.888 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:49.934 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:49.934 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:49.964 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:49.962+0000 7f71e8322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:35:49.966 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:49.964+0000 7f71e8322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:35:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.786786_487.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.786786Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.982 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.786786_487.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.786786Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:35:49.982 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683349.786786_487.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:35:49.786786Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:35:49.982 DEBUG:rgw_multi.tests:log_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:35:49.982 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683349.786786_487.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:35:49.982 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683349.794097_490.1 target=1_1702683349.786786_487.1 2023-12-15T23:35:54.983 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:54.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:35:54.983 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:35:55.037 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:55.037 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:55.070 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:55.067+0000 7f9e96332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:35:55.071 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:55.069+0000 7f9e96332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:35:55.089 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.794097_490.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.794097Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:55Z"} 2023-12-15T23:35:55.089 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.794097_490.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.794097Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:55Z"} 2023-12-15T23:35:55.090 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683349.794097_490.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:35:49.794097Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:35:55.090 DEBUG:rgw_multi.tests:log_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:35:55.090 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:35:55.090 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:35:55.090 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:35:55.090 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:35:55.090 DEBUG:boto:Method: HEAD 2023-12-15T23:35:55.091 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:35:55.091 DEBUG:boto:Data: 2023-12-15T23:35:55.091 DEBUG:boto:Headers: {} 2023-12-15T23:35:55.091 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:55.091 DEBUG:boto:Port: 8000 2023-12-15T23:35:55.091 DEBUG:boto:Params: {} 2023-12-15T23:35:55.091 DEBUG:boto:Token: None 2023-12-15T23:35:55.092 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:35:55 GMT /kskgfn-52/ 2023-12-15T23:35:55.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HqTusPuy/ZVRbbccld1LaqeOyas= 2023-12-15T23:35:55.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HqTusPuy/ZVRbbccld1LaqeOyas=', 'Content-Length': '0'} 2023-12-15T23:35:55.094 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f26b1dbce3321a6d-00657ce2db-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:55.095 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:35:55.095 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:35:55.095 DEBUG:boto:Method: PUT 2023-12-15T23:35:55.095 DEBUG:boto:Path: /kskgfn-52/dummy 2023-12-15T23:35:55.095 DEBUG:boto:Data: 2023-12-15T23:35:55.095 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:35:55.096 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:35:55.096 DEBUG:boto:Port: 8000 2023-12-15T23:35:55.096 DEBUG:boto:Params: {} 2023-12-15T23:35:55.096 DEBUG:boto:Token: None 2023-12-15T23:35:55.096 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:35:55 GMT /kskgfn-52/dummy 2023-12-15T23:35:55.096 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ymoOWKD2FHCZX4wLdra9dWSOiQc= 2023-12-15T23:35:55.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:35:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymoOWKD2FHCZX4wLdra9dWSOiQc='} 2023-12-15T23:35:55.138 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ff5af59d5c01009-00657ce2db-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:35:55.138 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-52 2023-12-15T23:35:55.138 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:35:55.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:35:55.138 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:35:55.192 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:35:55.192 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:35:55.229 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:35:55.227+0000 7f2c14816800 1 waiting to reach incremental sync.. 2023-12-15T23:36:00.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:00.229+0000 7f2c14816800 1 bucket sync caught up with source: 2023-12-15T23:36:00.232 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:00.232 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:00.232 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:00.229+0000 7f2c14816800 0 bucket checkpoint complete 2023-12-15T23:36:00.251 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-52 2023-12-15T23:36:00.252 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:36:00.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:36:00.252 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:36:00.314 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:36:00.314 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:36:00.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:36:00.351+0000 7f0fbef24800 1 waiting to reach incremental sync.. 2023-12-15T23:36:05.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:36:05.353+0000 7f0fbef24800 1 bucket sync caught up with source: 2023-12-15T23:36:05.356 INFO:teuthology.orchestra.run.smithi093.stderr: local status: [, , , , , 00000000001.126.6, , , , , ] 2023-12-15T23:36:05.356 INFO:teuthology.orchestra.run.smithi093.stderr: remote markers: [, , , , , 00000000001.126.6, , , , , ] 2023-12-15T23:36:05.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:36:05.353+0000 7f0fbef24800 0 bucket checkpoint complete 2023-12-15T23:36:05.375 INFO:tasks.rgw_multi.zone_rados:comparing bucket=kskgfn-52 zones={test-zone2, test-zone1} 2023-12-15T23:36:05.376 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.376 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.376 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.376 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:05.376 DEBUG:boto:Data: 2023-12-15T23:36:05.376 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.376 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.376 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.377 DEBUG:boto:Params: {} 2023-12-15T23:36:05.377 DEBUG:boto:Token: None 2023-12-15T23:36:05.377 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.377 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI= 2023-12-15T23:36:05.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI=', 'Content-Length': '0'} 2023-12-15T23:36:05.380 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8ec59614611337f-00657ce2e5-5826-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.380 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.380 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.380 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.380 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:05.380 DEBUG:boto:Data: 2023-12-15T23:36:05.381 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.381 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.381 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.381 DEBUG:boto:Params: {} 2023-12-15T23:36:05.381 DEBUG:boto:Token: None 2023-12-15T23:36:05.381 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.381 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI= 2023-12-15T23:36:05.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI=', 'Content-Length': '0'} 2023-12-15T23:36:05.385 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e7092a1f79380ab9-00657ce2e5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.386 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2023-12-15T23:36:05.386 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.386 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.386 DEBUG:boto:path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.386 DEBUG:boto:auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.386 DEBUG:boto:Method: GET 2023-12-15T23:36:05.386 DEBUG:boto:Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.387 DEBUG:boto:Data: 2023-12-15T23:36:05.387 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.387 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.387 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.387 DEBUG:boto:Params: {} 2023-12-15T23:36:05.387 DEBUG:boto:Token: None 2023-12-15T23:36:05.387 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/?versions 2023-12-15T23:36:05.387 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:36:05.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:36:05.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b6540ce9b6fbb1f-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.390 DEBUG:boto:b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.391 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T23:36:05.391 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2023-12-15T23:36:05.391 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.391 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.391 DEBUG:boto:path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.391 DEBUG:boto:auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.391 DEBUG:boto:Method: GET 2023-12-15T23:36:05.392 DEBUG:boto:Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.392 DEBUG:boto:Data: 2023-12-15T23:36:05.392 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.392 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.392 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.392 DEBUG:boto:Params: {} 2023-12-15T23:36:05.392 DEBUG:boto:Token: None 2023-12-15T23:36:05.392 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/?versions 2023-12-15T23:36:05.392 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:36:05.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:36:05.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048a4e3eae04c740a-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.395 DEBUG:boto:b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.395 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2023-12-15T23:36:05.395 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.396 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.396 DEBUG:boto:path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.396 DEBUG:boto:auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.396 DEBUG:boto:Method: GET 2023-12-15T23:36:05.396 DEBUG:boto:Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.396 DEBUG:boto:Data: 2023-12-15T23:36:05.396 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.396 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.396 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.396 DEBUG:boto:Params: {} 2023-12-15T23:36:05.397 DEBUG:boto:Token: None 2023-12-15T23:36:05.397 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/?versions 2023-12-15T23:36:05.397 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:36:05.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:36:05.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000161a699367a95775-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.399 DEBUG:boto:b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.400 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.400 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.400 DEBUG:boto:path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.400 DEBUG:boto:auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.400 DEBUG:boto:Method: GET 2023-12-15T23:36:05.400 DEBUG:boto:Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:36:05.400 DEBUG:boto:Data: 2023-12-15T23:36:05.401 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.401 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.401 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.401 DEBUG:boto:Params: {} 2023-12-15T23:36:05.401 DEBUG:boto:Token: None 2023-12-15T23:36:05.401 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/?versions 2023-12-15T23:36:05.401 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:36:05.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:36:05.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000026fe0e7746d7beb-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.404 DEBUG:boto:b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T23:36:05.404 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.404 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.405 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.405 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.405 DEBUG:boto:Method: GET 2023-12-15T23:36:05.405 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.405 DEBUG:boto:Data: 2023-12-15T23:36:05.405 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.405 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.405 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.405 DEBUG:boto:Params: {} 2023-12-15T23:36:05.405 DEBUG:boto:Token: None 2023-12-15T23:36:05.406 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.406 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:36:05.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:36:05.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089cff8d2c273fd3f-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.408 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.408 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.408 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.408 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.409 DEBUG:boto:Method: GET 2023-12-15T23:36:05.409 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.409 DEBUG:boto:Data: 2023-12-15T23:36:05.409 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.409 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.409 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.409 DEBUG:boto:Params: {} 2023-12-15T23:36:05.409 DEBUG:boto:Token: None 2023-12-15T23:36:05.409 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.410 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:36:05.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:36:05.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096ba8b430731f084-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.412 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.412 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.412 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.413 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.413 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.413 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.413 DEBUG:boto:Data: 2023-12-15T23:36:05.413 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.413 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.413 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.413 DEBUG:boto:Params: {} 2023-12-15T23:36:05.413 DEBUG:boto:Token: None 2023-12-15T23:36:05.414 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.414 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w= 2023-12-15T23:36:05.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w=', 'Content-Length': '0'} 2023-12-15T23:36:05.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fa58388b82730a7-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.416 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.416 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.416 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.416 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.416 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.417 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.417 DEBUG:boto:Data: 2023-12-15T23:36:05.417 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.417 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.417 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.417 DEBUG:boto:Params: {} 2023-12-15T23:36:05.417 DEBUG:boto:Token: None 2023-12-15T23:36:05.417 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.417 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w= 2023-12-15T23:36:05.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w=', 'Content-Length': '0'} 2023-12-15T23:36:05.419 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049f4961d8985cf7b-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T23:36:05.420 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.420 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.420 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.420 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.420 DEBUG:boto:Method: GET 2023-12-15T23:36:05.420 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.420 DEBUG:boto:Data: 2023-12-15T23:36:05.421 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.421 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.421 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.421 DEBUG:boto:Params: {} 2023-12-15T23:36:05.421 DEBUG:boto:Token: None 2023-12-15T23:36:05.421 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.421 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:36:05.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:36:05.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecf5e0cc511f65cf-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.424 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.424 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.424 DEBUG:boto:path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.424 DEBUG:boto:auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.425 DEBUG:boto:Method: GET 2023-12-15T23:36:05.425 DEBUG:boto:Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.425 DEBUG:boto:Data: 2023-12-15T23:36:05.425 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.425 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.425 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.425 DEBUG:boto:Params: {} 2023-12-15T23:36:05.425 DEBUG:boto:Token: None 2023-12-15T23:36:05.425 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy?versionId=null 2023-12-15T23:36:05.426 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:36:05.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:36:05.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c4ec2e6bc814cee-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.428 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.428 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.428 DEBUG:boto:path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.428 DEBUG:boto:auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.428 DEBUG:boto:Method: GET 2023-12-15T23:36:05.429 DEBUG:boto:Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.429 DEBUG:boto:Data: 2023-12-15T23:36:05.429 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.429 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.429 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.429 DEBUG:boto:Params: {} 2023-12-15T23:36:05.429 DEBUG:boto:Token: None 2023-12-15T23:36:05.429 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.429 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:36:05.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:36:05.432 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c55c68435619eed-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.432 DEBUG:boto:b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.432 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.433 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.433 DEBUG:boto:path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.433 DEBUG:boto:auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.433 DEBUG:boto:Method: GET 2023-12-15T23:36:05.433 DEBUG:boto:Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.433 DEBUG:boto:Data: 2023-12-15T23:36:05.433 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.433 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.434 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.434 DEBUG:boto:Params: {} 2023-12-15T23:36:05.434 DEBUG:boto:Token: None 2023-12-15T23:36:05.434 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.434 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:36:05.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:36:05.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8b3a6f4b2601a68-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.437 DEBUG:boto:b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.437 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.437 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.437 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.437 DEBUG:boto:Path: /kskgfn-52/dummy 2023-12-15T23:36:05.438 DEBUG:boto:Data: 2023-12-15T23:36:05.438 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.438 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.438 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.438 DEBUG:boto:Params: {} 2023-12-15T23:36:05.438 DEBUG:boto:Token: None 2023-12-15T23:36:05.438 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy 2023-12-15T23:36:05.438 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0= 2023-12-15T23:36:05.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0=', 'Content-Length': '0'} 2023-12-15T23:36:05.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d80323758c10ce86-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.441 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.441 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.441 DEBUG:boto:Method: HEAD 2023-12-15T23:36:05.441 DEBUG:boto:Path: /kskgfn-52/dummy 2023-12-15T23:36:05.441 DEBUG:boto:Data: 2023-12-15T23:36:05.441 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.441 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.441 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.441 DEBUG:boto:Params: {} 2023-12-15T23:36:05.442 DEBUG:boto:Token: None 2023-12-15T23:36:05.442 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy 2023-12-15T23:36:05.442 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0= 2023-12-15T23:36:05.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0=', 'Content-Length': '0'} 2023-12-15T23:36:05.444 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041bc89ce7b05cb37-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2023-12-15T23:36:05.444 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.444 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.444 DEBUG:boto:Method: GET 2023-12-15T23:36:05.444 DEBUG:boto:Path: /kskgfn-52/dummy 2023-12-15T23:36:05.445 DEBUG:boto:Data: 2023-12-15T23:36:05.445 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.445 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.445 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.445 DEBUG:boto:Params: {} 2023-12-15T23:36:05.445 DEBUG:boto:Token: None 2023-12-15T23:36:05.445 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy 2023-12-15T23:36:05.445 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME= 2023-12-15T23:36:05.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME=', 'Content-Length': '0'} 2023-12-15T23:36:05.447 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057d6720820586f01-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.489 DEBUG:boto:path=/kskgfn-52/dummy 2023-12-15T23:36:05.490 DEBUG:boto:auth_path=/kskgfn-52/dummy 2023-12-15T23:36:05.490 DEBUG:boto:Method: GET 2023-12-15T23:36:05.490 DEBUG:boto:Path: /kskgfn-52/dummy 2023-12-15T23:36:05.490 DEBUG:boto:Data: 2023-12-15T23:36:05.490 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.490 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.490 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.490 DEBUG:boto:Params: {} 2023-12-15T23:36:05.491 DEBUG:boto:Token: None 2023-12-15T23:36:05.491 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/dummy 2023-12-15T23:36:05.491 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME= 2023-12-15T23:36:05.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME=', 'Content-Length': '0'} 2023-12-15T23:36:05.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a855fb92a89969b4-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.494 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.494 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.494 DEBUG:boto:path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.494 DEBUG:boto:auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.494 DEBUG:boto:Method: GET 2023-12-15T23:36:05.494 DEBUG:boto:Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.494 DEBUG:boto:Data: 2023-12-15T23:36:05.494 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.494 DEBUG:boto:Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:05.495 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.495 DEBUG:boto:Params: {} 2023-12-15T23:36:05.495 DEBUG:boto:Token: None 2023-12-15T23:36:05.495 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.495 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:36:05.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:36:05.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf094991f957cb58-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.497 DEBUG:boto:b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.498 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:05.498 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:05.498 DEBUG:boto:path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.498 DEBUG:boto:auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.498 DEBUG:boto:Method: GET 2023-12-15T23:36:05.498 DEBUG:boto:Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:36:05.499 DEBUG:boto:Data: 2023-12-15T23:36:05.499 DEBUG:boto:Headers: {} 2023-12-15T23:36:05.499 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:05.499 DEBUG:boto:Port: 8000 2023-12-15T23:36:05.499 DEBUG:boto:Params: {} 2023-12-15T23:36:05.499 DEBUG:boto:Token: None 2023-12-15T23:36:05.499 DEBUG:boto:StringToSign: GET Fri, 15 Dec 2023 23:36:05 GMT /kskgfn-52/ 2023-12-15T23:36:05.499 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:36:05.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:36:05.502 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b551afc0368f1652-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:05.502 DEBUG:boto:b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:36:05.502 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=kskgfn-52 zones={test-zone2, test-zone1} 2023-12-15T23:36:05.503 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:36:05.503 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:36:05.504 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:36:05.502+0000 7f73dd5df640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 115630) UID: 0 2023-12-15T23:36:05.504 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:36:05.502+0000 7f73e0e3e880 -1 shutting down 2023-12-15T23:36:06.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:36:11.604 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:36:11.604 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:11.604 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:11.604 DEBUG:boto:Method: HEAD 2023-12-15T23:36:11.604 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:11.605 DEBUG:boto:Data: 2023-12-15T23:36:11.605 DEBUG:boto:Headers: {} 2023-12-15T23:36:11.605 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.605 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.605 DEBUG:boto:Params: {} 2023-12-15T23:36:11.605 DEBUG:boto:Token: None 2023-12-15T23:36:11.605 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/ 2023-12-15T23:36:11.606 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:36:11.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:36:11.608 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007843e841037c2964-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.609 DEBUG:boto:path=/kskgfn-52/obj11 2023-12-15T23:36:11.609 DEBUG:boto:auth_path=/kskgfn-52/obj11 2023-12-15T23:36:11.609 DEBUG:boto:Method: PUT 2023-12-15T23:36:11.609 DEBUG:boto:Path: /kskgfn-52/obj11 2023-12-15T23:36:11.609 DEBUG:boto:Data: 2023-12-15T23:36:11.609 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:36:11.610 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.610 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.610 DEBUG:boto:Params: {} 2023-12-15T23:36:11.610 DEBUG:boto:Token: None 2023-12-15T23:36:11.610 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/obj11 2023-12-15T23:36:11.610 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:/rHZGVQ6b1tmQl/FpH5K1sJHUUU= 2023-12-15T23:36:11.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/rHZGVQ6b1tmQl/FpH5K1sJHUUU='} 2023-12-15T23:36:11.617 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eaa0f9fbb277b800-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.617 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:11.617 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:11.618 DEBUG:boto:Method: HEAD 2023-12-15T23:36:11.618 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:11.618 DEBUG:boto:Data: 2023-12-15T23:36:11.618 DEBUG:boto:Headers: {} 2023-12-15T23:36:11.618 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.618 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.618 DEBUG:boto:Params: {} 2023-12-15T23:36:11.618 DEBUG:boto:Token: None 2023-12-15T23:36:11.618 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/ 2023-12-15T23:36:11.619 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:36:11.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:36:11.621 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000042c47a62576cd168-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.621 DEBUG:boto:path=/kskgfn-52/obj22 2023-12-15T23:36:11.621 DEBUG:boto:auth_path=/kskgfn-52/obj22 2023-12-15T23:36:11.621 DEBUG:boto:Method: PUT 2023-12-15T23:36:11.621 DEBUG:boto:Path: /kskgfn-52/obj22 2023-12-15T23:36:11.621 DEBUG:boto:Data: 2023-12-15T23:36:11.622 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:36:11.622 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.622 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.622 DEBUG:boto:Params: {} 2023-12-15T23:36:11.622 DEBUG:boto:Token: None 2023-12-15T23:36:11.622 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/obj22 2023-12-15T23:36:11.622 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:7IJqId/0bpfV6eK/b4QiIpF7Jlc= 2023-12-15T23:36:11.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7IJqId/0bpfV6eK/b4QiIpF7Jlc='} 2023-12-15T23:36:11.627 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c21bf57aeab5fc80-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.627 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:11.627 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:11.627 DEBUG:boto:Method: HEAD 2023-12-15T23:36:11.627 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:11.628 DEBUG:boto:Data: 2023-12-15T23:36:11.628 DEBUG:boto:Headers: {} 2023-12-15T23:36:11.628 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.628 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.628 DEBUG:boto:Params: {} 2023-12-15T23:36:11.628 DEBUG:boto:Token: None 2023-12-15T23:36:11.628 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/ 2023-12-15T23:36:11.628 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:36:11.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:36:11.630 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f03ae70d955a7b8-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.631 DEBUG:boto:path=/kskgfn-52/obj33 2023-12-15T23:36:11.631 DEBUG:boto:auth_path=/kskgfn-52/obj33 2023-12-15T23:36:11.631 DEBUG:boto:Method: PUT 2023-12-15T23:36:11.631 DEBUG:boto:Path: /kskgfn-52/obj33 2023-12-15T23:36:11.631 DEBUG:boto:Data: 2023-12-15T23:36:11.631 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:36:11.631 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.631 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.632 DEBUG:boto:Params: {} 2023-12-15T23:36:11.632 DEBUG:boto:Token: None 2023-12-15T23:36:11.632 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/obj33 2023-12-15T23:36:11.632 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Q4/lfflRHH65Iy4+nmAbBSED6pM= 2023-12-15T23:36:11.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q4/lfflRHH65Iy4+nmAbBSED6pM='} 2023-12-15T23:36:11.673 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c9d44e51fb86e60-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.674 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:11.674 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:11.674 DEBUG:boto:Method: HEAD 2023-12-15T23:36:11.674 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:11.674 DEBUG:boto:Data: 2023-12-15T23:36:11.674 DEBUG:boto:Headers: {} 2023-12-15T23:36:11.674 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.674 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.674 DEBUG:boto:Params: {} 2023-12-15T23:36:11.675 DEBUG:boto:Token: None 2023-12-15T23:36:11.675 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/ 2023-12-15T23:36:11.675 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:36:11.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:36:11.677 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000060fb3bf918516cb2-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.678 DEBUG:boto:path=/kskgfn-52/obj44 2023-12-15T23:36:11.678 DEBUG:boto:auth_path=/kskgfn-52/obj44 2023-12-15T23:36:11.678 DEBUG:boto:Method: PUT 2023-12-15T23:36:11.678 DEBUG:boto:Path: /kskgfn-52/obj44 2023-12-15T23:36:11.678 DEBUG:boto:Data: 2023-12-15T23:36:11.678 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:36:11.678 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.678 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.678 DEBUG:boto:Params: {} 2023-12-15T23:36:11.679 DEBUG:boto:Token: None 2023-12-15T23:36:11.679 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/obj44 2023-12-15T23:36:11.679 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:zZi7kCb2pdOL9s98AzwkGSsmrIg= 2023-12-15T23:36:11.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zZi7kCb2pdOL9s98AzwkGSsmrIg='} 2023-12-15T23:36:11.685 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cad3a43cee3c112b-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.686 DEBUG:boto:path=/kskgfn-52/ 2023-12-15T23:36:11.686 DEBUG:boto:auth_path=/kskgfn-52/ 2023-12-15T23:36:11.686 DEBUG:boto:Method: HEAD 2023-12-15T23:36:11.686 DEBUG:boto:Path: /kskgfn-52/ 2023-12-15T23:36:11.686 DEBUG:boto:Data: 2023-12-15T23:36:11.686 DEBUG:boto:Headers: {} 2023-12-15T23:36:11.686 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.686 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.686 DEBUG:boto:Params: {} 2023-12-15T23:36:11.687 DEBUG:boto:Token: None 2023-12-15T23:36:11.687 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/ 2023-12-15T23:36:11.687 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:36:11.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:36:11.689 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002161868f0e0cb7df-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.689 DEBUG:boto:path=/kskgfn-52/obj55 2023-12-15T23:36:11.689 DEBUG:boto:auth_path=/kskgfn-52/obj55 2023-12-15T23:36:11.690 DEBUG:boto:Method: PUT 2023-12-15T23:36:11.690 DEBUG:boto:Path: /kskgfn-52/obj55 2023-12-15T23:36:11.690 DEBUG:boto:Data: 2023-12-15T23:36:11.690 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:36:11.690 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:36:11.690 DEBUG:boto:Port: 8000 2023-12-15T23:36:11.690 DEBUG:boto:Params: {} 2023-12-15T23:36:11.690 DEBUG:boto:Token: None 2023-12-15T23:36:11.690 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:36:11 GMT /kskgfn-52/obj55 2023-12-15T23:36:11.690 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MicGUi/IlgORLnoziy0oBq22EBo= 2023-12-15T23:36:11.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MicGUi/IlgORLnoziy0oBq22EBo='} 2023-12-15T23:36:11.695 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000029632341b1b3632e-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:36:11.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:36:11.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:36:11.696 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:36:11.750 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:36:11.750 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:36:11.784 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:11.782+0000 7f6f9ce8c800 5 RGW-SYNC:data: waiting on data sync status lease 2023-12-15T23:36:11.785 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:11.783+0000 7f6f9ce8c800 5 RGW-SYNC:data: acquired data sync status lease 2023-12-15T23:36:11.814 INFO:tasks.rgw.c2.client.0:Restarting daemon 2023-12-15T23:36:11.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:36:11.835 INFO:tasks.rgw.c2.client.0:Started 2023-12-15T23:36:11.835 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:11.853 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:36:11.853 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:36:11.853 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:36:11.854 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-15T23:36:11.855 INFO:teuthology.orchestra.run.smithi188.stderr:curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:36:12.856 DEBUG:teuthology.orchestra.run.smithi188:> curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:36:12.876 INFO:teuthology.orchestra.run.smithi188.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:36:12.876 INFO:teuthology.orchestra.run.smithi188.stderr: Dload Upload Total Spent Left Speed 2023-12-15T23:36:12.876 INFO:teuthology.orchestra.run.smithi188.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:36:12.877 INFO:teuthology.orchestra.run.smithi188.stdout:anonymous 2023-12-15T23:36:12.877 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-52 2023-12-15T23:36:12.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:36:12.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:36:12.878 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:36:12.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2023-12-15T23:36:12.971 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:36:12.971 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:36:13.008 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:13.006+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:13.008 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:13.008 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:14.221 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:36:14.219+0000 7f7d70c7a640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:36:18.009 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:18.007+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:18.010 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:18.010 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:23.012 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:23.009+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:23.012 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:23.013 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:28.012 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:28.010+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:28.012 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:28.012 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:33.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:33.012+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:33.020 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:33.021 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:38.015 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:38.013+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:38.015 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:38.015 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:43.016 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:43.014+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:43.016 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:43.017 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:48.018 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:48.015+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:48.018 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:48.018 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:53.019 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:53.016+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:53.019 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:53.020 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:36:58.020 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:36:58.018+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:36:58.021 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:36:58.021 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:03.022 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:03.020+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:03.025 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:03.025 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:08.023 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:08.021+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:08.023 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:08.023 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:13.024 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:13.022+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:13.024 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:13.025 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:18.026 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:18.024+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:18.026 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:18.026 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:23.027 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:23.025+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:23.027 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:23.027 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:28.028 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:28.026+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:28.029 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:28.029 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:33.030 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:33.028+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:33.030 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:33.030 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:38.031 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:38.029+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:38.031 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:38.031 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:43.033 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:43.030+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:43.033 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:37:43.033 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:48.034 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:48.031+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:48.035 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:37:48.035 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:53.036 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:53.034+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:53.036 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:37:53.036 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:37:58.037 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:37:58.035+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:37:58.037 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:37:58.037 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:03.038 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:03.036+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:03.038 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:38:03.038 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:08.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:08.038+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:08.040 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:38:08.040 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:13.041 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:13.039+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:13.041 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:13.041 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:18.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:18.040+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:18.042 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:18.042 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:23.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:23.041+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:23.044 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:23.044 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:28.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:28.042+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:28.044 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:28.044 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:33.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:33.043+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:33.045 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:33.045 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:38.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:38.044+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:38.047 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:38.047 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:43.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:43.045+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:43.048 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:38:43.048 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:47.939 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:38:47.936+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:38:48.048 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:48.047+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:48.048 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:48.049 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:53.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:53.048+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:53.051 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:53.051 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:58.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:38:58.049+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:38:58.051 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:38:58.051 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:03.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:03.050+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:03.053 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:03.053 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:08.054 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:08.052+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:08.055 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:08.055 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:13.055 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:13.053+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:13.055 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:13.055 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:18.056 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:18.055+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:18.057 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:18.057 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:23.057 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:23.056+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:23.058 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:23.058 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:28.059 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:28.056+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:28.059 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:28.059 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:33.060 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:33.057+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:33.060 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:33.060 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:38.061 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:38.060+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:38.062 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:38.062 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:43.062 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:43.061+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:43.063 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:43.063 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:48.064 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:48.062+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:48.064 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:48.064 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:53.065 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:53.063+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:53.065 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:53.065 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:58.066 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:39:58.065+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:39:58.066 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:39:58.066 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:03.068 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:03.066+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:03.068 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:03.068 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:08.069 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:08.068+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:08.070 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:08.070 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:13.071 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:13.069+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:13.071 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:13.071 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:18.072 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:18.071+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:18.072 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:18.072 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:23.073 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:23.071+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:23.074 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:23.074 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:28.075 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:28.072+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:28.075 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:28.075 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:33.076 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:33.074+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:33.076 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:33.076 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:38.076+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:38.078 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:38.078 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:43.080 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:43.077+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:43.080 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:43.080 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:48.080 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:48.079+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:48.080 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:48.080 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:53.082 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:53.080+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:53.082 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:53.082 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:58.083 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:40:58.081+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:40:58.083 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:40:58.083 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:41:03.084 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:03.083+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:41:03.084 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:41:03.084 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:41:08.086 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:08.084+0000 7fa2c7612800 0 bucket checkpoint timed out waiting for incremental sync to catch up 2023-12-15T23:41:08.086 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:08.084+0000 7fa2c7612800 0 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:41:08.086 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:08.084+0000 7fa2c7612800 -1 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:41:08.106 DEBUG:teuthology.orchestra.run:got remote process result: 110 2023-12-15T23:41:08.108 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_incremental_sync_after_data_sync_init ... FAIL 2023-12-15T23:41:08.109 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:08.109 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:08.110 DEBUG:boto:Method: PUT 2023-12-15T23:41:08.110 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:08.110 DEBUG:boto:Data: 2023-12-15T23:41:08.110 DEBUG:boto:Headers: {} 2023-12-15T23:41:08.110 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:08.110 DEBUG:boto:Port: 8000 2023-12-15T23:41:08.110 DEBUG:boto:Params: {} 2023-12-15T23:41:08.110 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:41:08.111 DEBUG:boto:Token: None 2023-12-15T23:41:08.111 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:41:08 GMT /kskgfn-53/ 2023-12-15T23:41:08.111 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:T0n5Beig4KPsrz7TRt8s23Re6dU= 2023-12-15T23:41:08.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T0n5Beig4KPsrz7TRt8s23Re6dU=', 'Content-Length': '0'} 2023-12-15T23:41:08.134 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008020672d1e2c28f9-00657ce414-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:08.135 DEBUG:rgw_multi.tests:created bucket=kskgfn-53 2023-12-15T23:41:08.135 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:08.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:08.135 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:41:08.187 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:08.187 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:08.222 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:41:08.239 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702683668.131542_497.1","last_update":"2023-12-15T23:41:08.131542Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:41:08.240 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:41:08.240 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:41:08.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:08.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:08.240 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:41:08.294 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:08.295 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:08.326 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:08.325+0000 7f99c1137800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:41:08.327 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:08.326+0000 7f99c1137800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:41:08.344 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.122541_494.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.122541Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:08Z"} 2023-12-15T23:41:08.344 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.122541_494.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.122541Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:08Z"} 2023-12-15T23:41:08.345 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683668.122541_494.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:08.122541Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:41:08.345 DEBUG:rgw_multi.tests:log_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:41:08.345 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683668.122541_494.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:41:08.345 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683668.131542_497.1 target=1_1702683668.122541_494.1 2023-12-15T23:41:13.346 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:13.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:41:13.346 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:41:13.399 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:13.399 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:13.432 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:13.431+0000 7fec53b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:41:13.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:13.432+0000 7fec53b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:41:13.450 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.131542_497.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.131542Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:13Z"} 2023-12-15T23:41:13.450 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.131542_497.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.131542Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:13Z"} 2023-12-15T23:41:13.450 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683668.131542_497.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:08.131542Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:41:13.450 DEBUG:rgw_multi.tests:log_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:41:13.451 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:41:13.451 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2023-12-15T23:41:13.451 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.451 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.451 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.451 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.451 DEBUG:boto:Data: 2023-12-15T23:41:13.451 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.451 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.451 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.451 DEBUG:boto:Params: {} 2023-12-15T23:41:13.452 DEBUG:boto:Token: None 2023-12-15T23:41:13.452 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.452 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.455 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea8bc56b527094a5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.455 DEBUG:boto:path=/kskgfn-53/obj11 2023-12-15T23:41:13.455 DEBUG:boto:auth_path=/kskgfn-53/obj11 2023-12-15T23:41:13.455 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.455 DEBUG:boto:Path: /kskgfn-53/obj11 2023-12-15T23:41:13.455 DEBUG:boto:Data: 2023-12-15T23:41:13.455 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.455 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.455 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.456 DEBUG:boto:Params: {} 2023-12-15T23:41:13.456 DEBUG:boto:Token: None 2023-12-15T23:41:13.456 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj11 2023-12-15T23:41:13.456 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:CISWj0jciDNT74FgPISYiuhaGaY= 2023-12-15T23:41:13.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CISWj0jciDNT74FgPISYiuhaGaY='} 2023-12-15T23:41:13.465 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000260be847174e23d8-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.465 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.465 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.465 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.465 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.465 DEBUG:boto:Data: 2023-12-15T23:41:13.466 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.466 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.466 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.466 DEBUG:boto:Params: {} 2023-12-15T23:41:13.466 DEBUG:boto:Token: None 2023-12-15T23:41:13.466 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.466 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.468 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ebc5e4b66b4978f-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.469 DEBUG:boto:path=/kskgfn-53/obj22 2023-12-15T23:41:13.469 DEBUG:boto:auth_path=/kskgfn-53/obj22 2023-12-15T23:41:13.469 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.469 DEBUG:boto:Path: /kskgfn-53/obj22 2023-12-15T23:41:13.469 DEBUG:boto:Data: 2023-12-15T23:41:13.469 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.469 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.469 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.469 DEBUG:boto:Params: {} 2023-12-15T23:41:13.469 DEBUG:boto:Token: None 2023-12-15T23:41:13.470 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj22 2023-12-15T23:41:13.470 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:RiW7miNMZTnF8r8q7PR7l1G5fig= 2023-12-15T23:41:13.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RiW7miNMZTnF8r8q7PR7l1G5fig='} 2023-12-15T23:41:13.474 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c22e132a35235fce-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.475 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.475 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.475 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.475 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.475 DEBUG:boto:Data: 2023-12-15T23:41:13.475 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.475 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.475 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.475 DEBUG:boto:Params: {} 2023-12-15T23:41:13.475 DEBUG:boto:Token: None 2023-12-15T23:41:13.475 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.476 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.478 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c48eb9efda6aa7d5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.478 DEBUG:boto:path=/kskgfn-53/obj33 2023-12-15T23:41:13.478 DEBUG:boto:auth_path=/kskgfn-53/obj33 2023-12-15T23:41:13.478 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.478 DEBUG:boto:Path: /kskgfn-53/obj33 2023-12-15T23:41:13.478 DEBUG:boto:Data: 2023-12-15T23:41:13.478 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.478 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.479 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.479 DEBUG:boto:Params: {} 2023-12-15T23:41:13.479 DEBUG:boto:Token: None 2023-12-15T23:41:13.479 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj33 2023-12-15T23:41:13.479 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:iCZLKg8c1MccXVG6c2TNtwPizKY= 2023-12-15T23:41:13.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCZLKg8c1MccXVG6c2TNtwPizKY='} 2023-12-15T23:41:13.522 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f53a0ed69863db2d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.522 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.522 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.522 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.522 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.522 DEBUG:boto:Data: 2023-12-15T23:41:13.522 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.522 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.522 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.522 DEBUG:boto:Params: {} 2023-12-15T23:41:13.523 DEBUG:boto:Token: None 2023-12-15T23:41:13.523 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.523 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.525 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9becb92b3558b26-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.526 DEBUG:boto:path=/kskgfn-53/obj44 2023-12-15T23:41:13.526 DEBUG:boto:auth_path=/kskgfn-53/obj44 2023-12-15T23:41:13.526 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.526 DEBUG:boto:Path: /kskgfn-53/obj44 2023-12-15T23:41:13.526 DEBUG:boto:Data: 2023-12-15T23:41:13.526 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.526 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.526 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.526 DEBUG:boto:Params: {} 2023-12-15T23:41:13.526 DEBUG:boto:Token: None 2023-12-15T23:41:13.527 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj44 2023-12-15T23:41:13.527 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:z0ve9lRj6hMP+csd3cKuYv9rLLc= 2023-12-15T23:41:13.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z0ve9lRj6hMP+csd3cKuYv9rLLc='} 2023-12-15T23:41:13.533 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000017dc67a6aec0c566-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.534 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.534 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.534 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.534 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.534 DEBUG:boto:Data: 2023-12-15T23:41:13.534 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.534 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.534 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.534 DEBUG:boto:Params: {} 2023-12-15T23:41:13.534 DEBUG:boto:Token: None 2023-12-15T23:41:13.535 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.535 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.537 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b276865c3d2260d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.537 DEBUG:boto:path=/kskgfn-53/obj55 2023-12-15T23:41:13.537 DEBUG:boto:auth_path=/kskgfn-53/obj55 2023-12-15T23:41:13.538 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.538 DEBUG:boto:Path: /kskgfn-53/obj55 2023-12-15T23:41:13.538 DEBUG:boto:Data: 2023-12-15T23:41:13.538 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.538 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.538 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.538 DEBUG:boto:Params: {} 2023-12-15T23:41:13.538 DEBUG:boto:Token: None 2023-12-15T23:41:13.538 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj55 2023-12-15T23:41:13.538 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:o0K64qV1vIs3PkbNCoH6FcSr4Yo= 2023-12-15T23:41:13.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o0K64qV1vIs3PkbNCoH6FcSr4Yo='} 2023-12-15T23:41:13.544 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009be17e5072d42034-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.544 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:13.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:13.544 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:13.599 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:13.600 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:13.649 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:13.649 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:13.653 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 5 2023-12-15T23:41:13.698 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.698 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.698 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.698 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.698 DEBUG:boto:Data: 2023-12-15T23:41:13.699 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.699 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.699 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.699 DEBUG:boto:Params: {} 2023-12-15T23:41:13.699 DEBUG:boto:Token: None 2023-12-15T23:41:13.699 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.699 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.702 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e086ba89d86a00af-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.702 DEBUG:boto:path=/kskgfn-53/obj17 2023-12-15T23:41:13.702 DEBUG:boto:auth_path=/kskgfn-53/obj17 2023-12-15T23:41:13.702 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.702 DEBUG:boto:Path: /kskgfn-53/obj17 2023-12-15T23:41:13.703 DEBUG:boto:Data: 2023-12-15T23:41:13.703 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.703 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.703 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.703 DEBUG:boto:Params: {} 2023-12-15T23:41:13.703 DEBUG:boto:Token: None 2023-12-15T23:41:13.703 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj17 2023-12-15T23:41:13.703 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:cbKm3rC9bFQLlYFEPLZANwWP0Yg= 2023-12-15T23:41:13.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cbKm3rC9bFQLlYFEPLZANwWP0Yg='} 2023-12-15T23:41:13.746 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000436493abf2a4ff71-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.746 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.746 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.746 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.746 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.746 DEBUG:boto:Data: 2023-12-15T23:41:13.746 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.746 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.746 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.746 DEBUG:boto:Params: {} 2023-12-15T23:41:13.747 DEBUG:boto:Token: None 2023-12-15T23:41:13.747 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.747 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.749 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007f34691216eca192-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.749 DEBUG:boto:path=/kskgfn-53/obj34 2023-12-15T23:41:13.750 DEBUG:boto:auth_path=/kskgfn-53/obj34 2023-12-15T23:41:13.750 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.750 DEBUG:boto:Path: /kskgfn-53/obj34 2023-12-15T23:41:13.750 DEBUG:boto:Data: 2023-12-15T23:41:13.750 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.750 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.750 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.750 DEBUG:boto:Params: {} 2023-12-15T23:41:13.750 DEBUG:boto:Token: None 2023-12-15T23:41:13.750 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj34 2023-12-15T23:41:13.750 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:1S44Dz1X3DJFBMj5RxWnFmcNHaY= 2023-12-15T23:41:13.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1S44Dz1X3DJFBMj5RxWnFmcNHaY='} 2023-12-15T23:41:13.759 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007690bd74d6cb64ae-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.759 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.759 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.759 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.759 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.759 DEBUG:boto:Data: 2023-12-15T23:41:13.759 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.759 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.759 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.759 DEBUG:boto:Params: {} 2023-12-15T23:41:13.760 DEBUG:boto:Token: None 2023-12-15T23:41:13.760 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.760 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.762 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0e3763e0744aa8d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.763 DEBUG:boto:path=/kskgfn-53/obj51 2023-12-15T23:41:13.763 DEBUG:boto:auth_path=/kskgfn-53/obj51 2023-12-15T23:41:13.763 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.763 DEBUG:boto:Path: /kskgfn-53/obj51 2023-12-15T23:41:13.763 DEBUG:boto:Data: 2023-12-15T23:41:13.763 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.763 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.763 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.763 DEBUG:boto:Params: {} 2023-12-15T23:41:13.763 DEBUG:boto:Token: None 2023-12-15T23:41:13.763 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj51 2023-12-15T23:41:13.764 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ahTa99R5lvf8LrwYJKh2l5IBiTk= 2023-12-15T23:41:13.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahTa99R5lvf8LrwYJKh2l5IBiTk='} 2023-12-15T23:41:13.806 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfa05d48341a8654-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.806 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.806 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.806 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.806 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.806 DEBUG:boto:Data: 2023-12-15T23:41:13.806 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.806 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.806 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.806 DEBUG:boto:Params: {} 2023-12-15T23:41:13.807 DEBUG:boto:Token: None 2023-12-15T23:41:13.807 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.807 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.809 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a5794220e1ee68e-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.810 DEBUG:boto:path=/kskgfn-53/obj68 2023-12-15T23:41:13.810 DEBUG:boto:auth_path=/kskgfn-53/obj68 2023-12-15T23:41:13.810 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.810 DEBUG:boto:Path: /kskgfn-53/obj68 2023-12-15T23:41:13.810 DEBUG:boto:Data: 2023-12-15T23:41:13.810 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.810 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.810 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.810 DEBUG:boto:Params: {} 2023-12-15T23:41:13.810 DEBUG:boto:Token: None 2023-12-15T23:41:13.810 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj68 2023-12-15T23:41:13.811 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:eaU5nW8J40dPVYJvicjynAVukDk= 2023-12-15T23:41:13.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eaU5nW8J40dPVYJvicjynAVukDk='} 2023-12-15T23:41:13.816 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ede23a07071a212a-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.816 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.816 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.816 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.817 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.817 DEBUG:boto:Data: 2023-12-15T23:41:13.817 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.817 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.817 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.817 DEBUG:boto:Params: {} 2023-12-15T23:41:13.817 DEBUG:boto:Token: None 2023-12-15T23:41:13.817 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.817 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.820 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004107d53a4e619a10-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.820 DEBUG:boto:path=/kskgfn-53/obj85 2023-12-15T23:41:13.820 DEBUG:boto:auth_path=/kskgfn-53/obj85 2023-12-15T23:41:13.820 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.820 DEBUG:boto:Path: /kskgfn-53/obj85 2023-12-15T23:41:13.820 DEBUG:boto:Data: 2023-12-15T23:41:13.821 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.821 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.821 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.821 DEBUG:boto:Params: {} 2023-12-15T23:41:13.821 DEBUG:boto:Token: None 2023-12-15T23:41:13.821 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj85 2023-12-15T23:41:13.821 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qwgptfnwFq8VQJMQb65WDVG7NtQ= 2023-12-15T23:41:13.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwgptfnwFq8VQJMQb65WDVG7NtQ='} 2023-12-15T23:41:13.827 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075c7a601b5aac3a2-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.827 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:13.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:13.828 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:13.876 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:13.876 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:13.920 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:13.921 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:13.927 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 10 2023-12-15T23:41:13.974 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:13.975 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:13.975 DEBUG:boto:Method: HEAD 2023-12-15T23:41:13.975 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:13.975 DEBUG:boto:Data: 2023-12-15T23:41:13.975 DEBUG:boto:Headers: {} 2023-12-15T23:41:13.975 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.975 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.975 DEBUG:boto:Params: {} 2023-12-15T23:41:13.975 DEBUG:boto:Token: None 2023-12-15T23:41:13.975 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/ 2023-12-15T23:41:13.976 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:41:13.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:41:13.978 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083190f8838336753-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:13.978 DEBUG:boto:path=/kskgfn-53/obj19 2023-12-15T23:41:13.978 DEBUG:boto:auth_path=/kskgfn-53/obj19 2023-12-15T23:41:13.978 DEBUG:boto:Method: PUT 2023-12-15T23:41:13.978 DEBUG:boto:Path: /kskgfn-53/obj19 2023-12-15T23:41:13.978 DEBUG:boto:Data: 2023-12-15T23:41:13.979 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:13.979 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:13.979 DEBUG:boto:Port: 8000 2023-12-15T23:41:13.979 DEBUG:boto:Params: {} 2023-12-15T23:41:13.979 DEBUG:boto:Token: None 2023-12-15T23:41:13.979 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:13 GMT /kskgfn-53/obj19 2023-12-15T23:41:13.979 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Lcvjl262c0FXeGQJFOS9uZKF9kU= 2023-12-15T23:41:13.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lcvjl262c0FXeGQJFOS9uZKF9kU='} 2023-12-15T23:41:14.022 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004ee9db807af05e5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.022 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.022 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.022 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.022 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.022 DEBUG:boto:Data: 2023-12-15T23:41:14.022 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.022 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.022 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.023 DEBUG:boto:Params: {} 2023-12-15T23:41:14.023 DEBUG:boto:Token: None 2023-12-15T23:41:14.023 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.023 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.025 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000703cb9fd04bbf580-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.025 DEBUG:boto:path=/kskgfn-53/obj38 2023-12-15T23:41:14.026 DEBUG:boto:auth_path=/kskgfn-53/obj38 2023-12-15T23:41:14.026 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.026 DEBUG:boto:Path: /kskgfn-53/obj38 2023-12-15T23:41:14.026 DEBUG:boto:Data: 2023-12-15T23:41:14.026 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.026 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.026 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.026 DEBUG:boto:Params: {} 2023-12-15T23:41:14.026 DEBUG:boto:Token: None 2023-12-15T23:41:14.026 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj38 2023-12-15T23:41:14.026 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Ef2yUqC3DZrTYe5b+x9F9l4U1HM= 2023-12-15T23:41:14.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ef2yUqC3DZrTYe5b+x9F9l4U1HM='} 2023-12-15T23:41:14.030 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006badfaf627b823cd-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.031 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.031 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.031 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.031 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.031 DEBUG:boto:Data: 2023-12-15T23:41:14.031 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.031 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.031 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.031 DEBUG:boto:Params: {} 2023-12-15T23:41:14.031 DEBUG:boto:Token: None 2023-12-15T23:41:14.032 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.032 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.033 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031a2ae2f18291ccb-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.034 DEBUG:boto:path=/kskgfn-53/obj57 2023-12-15T23:41:14.034 DEBUG:boto:auth_path=/kskgfn-53/obj57 2023-12-15T23:41:14.034 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.034 DEBUG:boto:Path: /kskgfn-53/obj57 2023-12-15T23:41:14.034 DEBUG:boto:Data: 2023-12-15T23:41:14.034 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.034 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.034 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.034 DEBUG:boto:Params: {} 2023-12-15T23:41:14.034 DEBUG:boto:Token: None 2023-12-15T23:41:14.035 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj57 2023-12-15T23:41:14.035 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:LZE2unOOdD2BMo7l2mp3ukNa1qk= 2023-12-15T23:41:14.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZE2unOOdD2BMo7l2mp3ukNa1qk='} 2023-12-15T23:41:14.078 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd252790f000163d-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.078 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.078 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.078 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.078 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.078 DEBUG:boto:Data: 2023-12-15T23:41:14.078 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.078 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.078 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.078 DEBUG:boto:Params: {} 2023-12-15T23:41:14.078 DEBUG:boto:Token: None 2023-12-15T23:41:14.079 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.079 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.081 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e72077afeca56816-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.081 DEBUG:boto:path=/kskgfn-53/obj76 2023-12-15T23:41:14.081 DEBUG:boto:auth_path=/kskgfn-53/obj76 2023-12-15T23:41:14.081 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.082 DEBUG:boto:Path: /kskgfn-53/obj76 2023-12-15T23:41:14.082 DEBUG:boto:Data: 2023-12-15T23:41:14.082 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.082 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.082 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.082 DEBUG:boto:Params: {} 2023-12-15T23:41:14.082 DEBUG:boto:Token: None 2023-12-15T23:41:14.082 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj76 2023-12-15T23:41:14.082 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Qv4zIK8DF5jGQDOK2gaXtn/uUpw= 2023-12-15T23:41:14.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qv4zIK8DF5jGQDOK2gaXtn/uUpw='} 2023-12-15T23:41:14.087 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9b745b2d7a7385e-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.088 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.088 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.088 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.088 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.088 DEBUG:boto:Data: 2023-12-15T23:41:14.088 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.088 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.088 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.088 DEBUG:boto:Params: {} 2023-12-15T23:41:14.088 DEBUG:boto:Token: None 2023-12-15T23:41:14.088 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.089 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.091 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f8ad5d88991f8dc-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.091 DEBUG:boto:path=/kskgfn-53/obj95 2023-12-15T23:41:14.091 DEBUG:boto:auth_path=/kskgfn-53/obj95 2023-12-15T23:41:14.091 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.091 DEBUG:boto:Path: /kskgfn-53/obj95 2023-12-15T23:41:14.091 DEBUG:boto:Data: 2023-12-15T23:41:14.091 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.091 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.092 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.092 DEBUG:boto:Params: {} 2023-12-15T23:41:14.092 DEBUG:boto:Token: None 2023-12-15T23:41:14.092 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj95 2023-12-15T23:41:14.092 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2/mC2jADrhAQMMVk7mVohiu9IvQ= 2023-12-15T23:41:14.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/mC2jADrhAQMMVk7mVohiu9IvQ='} 2023-12-15T23:41:14.134 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cbaad139c8744884-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.134 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.134 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:14.184 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:14.184 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:14.231 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:14.231 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:14.239 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 15 2023-12-15T23:41:14.294 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.294 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.294 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.294 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.294 DEBUG:boto:Data: 2023-12-15T23:41:14.294 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.294 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.294 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.294 DEBUG:boto:Params: {} 2023-12-15T23:41:14.295 DEBUG:boto:Token: None 2023-12-15T23:41:14.295 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.295 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.297 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000043e8608f8a96a43b-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.298 DEBUG:boto:path=/kskgfn-53/obj23 2023-12-15T23:41:14.298 DEBUG:boto:auth_path=/kskgfn-53/obj23 2023-12-15T23:41:14.298 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.298 DEBUG:boto:Path: /kskgfn-53/obj23 2023-12-15T23:41:14.298 DEBUG:boto:Data: 2023-12-15T23:41:14.298 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.298 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.298 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.298 DEBUG:boto:Params: {} 2023-12-15T23:41:14.299 DEBUG:boto:Token: None 2023-12-15T23:41:14.299 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj23 2023-12-15T23:41:14.299 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:ay2R9X8KTTCXMudmO/Z2VaERdaE= 2023-12-15T23:41:14.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ay2R9X8KTTCXMudmO/Z2VaERdaE='} 2023-12-15T23:41:14.303 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000060dc32112d46d782-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.304 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.304 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.304 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.304 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.304 DEBUG:boto:Data: 2023-12-15T23:41:14.304 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.304 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.304 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.304 DEBUG:boto:Params: {} 2023-12-15T23:41:14.304 DEBUG:boto:Token: None 2023-12-15T23:41:14.305 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.305 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.307 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000af6af19cee8fef81-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.307 DEBUG:boto:path=/kskgfn-53/obj46 2023-12-15T23:41:14.307 DEBUG:boto:auth_path=/kskgfn-53/obj46 2023-12-15T23:41:14.307 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.307 DEBUG:boto:Path: /kskgfn-53/obj46 2023-12-15T23:41:14.308 DEBUG:boto:Data: 2023-12-15T23:41:14.308 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.308 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.308 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.308 DEBUG:boto:Params: {} 2023-12-15T23:41:14.308 DEBUG:boto:Token: None 2023-12-15T23:41:14.308 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj46 2023-12-15T23:41:14.308 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:HZnmaQdylDYqkahk2D52qVEwlhY= 2023-12-15T23:41:14.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZnmaQdylDYqkahk2D52qVEwlhY='} 2023-12-15T23:41:14.353 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b79fac11c937bcbe-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.354 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.354 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.354 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.354 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.354 DEBUG:boto:Data: 2023-12-15T23:41:14.354 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.354 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.354 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.354 DEBUG:boto:Params: {} 2023-12-15T23:41:14.354 DEBUG:boto:Token: None 2023-12-15T23:41:14.355 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.355 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.357 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007383e26960fd2dba-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.358 DEBUG:boto:path=/kskgfn-53/obj69 2023-12-15T23:41:14.358 DEBUG:boto:auth_path=/kskgfn-53/obj69 2023-12-15T23:41:14.358 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.358 DEBUG:boto:Path: /kskgfn-53/obj69 2023-12-15T23:41:14.358 DEBUG:boto:Data: 2023-12-15T23:41:14.358 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.358 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.358 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.358 DEBUG:boto:Params: {} 2023-12-15T23:41:14.358 DEBUG:boto:Token: None 2023-12-15T23:41:14.359 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj69 2023-12-15T23:41:14.359 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:FYMsut7IudYuYJ0OkbUo00qAVlU= 2023-12-15T23:41:14.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYMsut7IudYuYJ0OkbUo00qAVlU='} 2023-12-15T23:41:14.364 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e63b861682d6044c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.364 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.364 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.365 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.365 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.365 DEBUG:boto:Data: 2023-12-15T23:41:14.365 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.365 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.365 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.365 DEBUG:boto:Params: {} 2023-12-15T23:41:14.365 DEBUG:boto:Token: None 2023-12-15T23:41:14.365 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.365 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.368 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ba20ce209700f61-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.368 DEBUG:boto:path=/kskgfn-53/obj92 2023-12-15T23:41:14.368 DEBUG:boto:auth_path=/kskgfn-53/obj92 2023-12-15T23:41:14.368 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.368 DEBUG:boto:Path: /kskgfn-53/obj92 2023-12-15T23:41:14.368 DEBUG:boto:Data: 2023-12-15T23:41:14.368 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.368 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.369 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.369 DEBUG:boto:Params: {} 2023-12-15T23:41:14.369 DEBUG:boto:Token: None 2023-12-15T23:41:14.369 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj92 2023-12-15T23:41:14.369 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:Oao2ClMfqDMDSCrDFw+31h8dySM= 2023-12-15T23:41:14.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oao2ClMfqDMDSCrDFw+31h8dySM='} 2023-12-15T23:41:14.374 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5834acce73df1c1-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.374 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.374 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.374 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.374 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.375 DEBUG:boto:Data: 2023-12-15T23:41:14.375 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.375 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.375 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.375 DEBUG:boto:Params: {} 2023-12-15T23:41:14.375 DEBUG:boto:Token: None 2023-12-15T23:41:14.375 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.375 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.377 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000027594af11129a852-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.378 DEBUG:boto:path=/kskgfn-53/obj115 2023-12-15T23:41:14.378 DEBUG:boto:auth_path=/kskgfn-53/obj115 2023-12-15T23:41:14.378 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.378 DEBUG:boto:Path: /kskgfn-53/obj115 2023-12-15T23:41:14.378 DEBUG:boto:Data: 2023-12-15T23:41:14.378 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.378 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.378 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.378 DEBUG:boto:Params: {} 2023-12-15T23:41:14.378 DEBUG:boto:Token: None 2023-12-15T23:41:14.379 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj115 2023-12-15T23:41:14.379 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:j6+LJ7BUGKASMtH8NCUIvzh7Lsw= 2023-12-15T23:41:14.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j6+LJ7BUGKASMtH8NCUIvzh7Lsw='} 2023-12-15T23:41:14.422 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000204e9f1292211748-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.422 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.422 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:14.471 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:14.471 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 20 2023-12-15T23:41:14.585 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.585 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.585 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.585 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.586 DEBUG:boto:Data: 2023-12-15T23:41:14.586 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.586 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.586 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.586 DEBUG:boto:Params: {} 2023-12-15T23:41:14.586 DEBUG:boto:Token: None 2023-12-15T23:41:14.586 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.586 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.589 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000702afd66ec1ab012-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.589 DEBUG:boto:path=/kskgfn-53/obj29 2023-12-15T23:41:14.589 DEBUG:boto:auth_path=/kskgfn-53/obj29 2023-12-15T23:41:14.590 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.590 DEBUG:boto:Path: /kskgfn-53/obj29 2023-12-15T23:41:14.590 DEBUG:boto:Data: 2023-12-15T23:41:14.590 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.590 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.590 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.590 DEBUG:boto:Params: {} 2023-12-15T23:41:14.590 DEBUG:boto:Token: None 2023-12-15T23:41:14.590 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj29 2023-12-15T23:41:14.591 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:4rF+isFbTHScRZDN9iK/3ymctpg= 2023-12-15T23:41:14.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4rF+isFbTHScRZDN9iK/3ymctpg='} 2023-12-15T23:41:14.596 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008591ba76ae8cde4d-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.596 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.596 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.596 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.596 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.596 DEBUG:boto:Data: 2023-12-15T23:41:14.596 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.597 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.597 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.597 DEBUG:boto:Params: {} 2023-12-15T23:41:14.597 DEBUG:boto:Token: None 2023-12-15T23:41:14.597 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.597 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.599 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000543ef6a112690a8c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.600 DEBUG:boto:path=/kskgfn-53/obj58 2023-12-15T23:41:14.600 DEBUG:boto:auth_path=/kskgfn-53/obj58 2023-12-15T23:41:14.600 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.600 DEBUG:boto:Path: /kskgfn-53/obj58 2023-12-15T23:41:14.600 DEBUG:boto:Data: 2023-12-15T23:41:14.600 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.600 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.600 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.600 DEBUG:boto:Params: {} 2023-12-15T23:41:14.601 DEBUG:boto:Token: None 2023-12-15T23:41:14.601 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj58 2023-12-15T23:41:14.601 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:MkRMhh27AzoUMFGrpn3L+19fGww= 2023-12-15T23:41:14.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MkRMhh27AzoUMFGrpn3L+19fGww='} 2023-12-15T23:41:14.606 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fb28a32be542827a-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.606 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.606 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.606 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.606 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.606 DEBUG:boto:Data: 2023-12-15T23:41:14.606 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.606 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.606 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.606 DEBUG:boto:Params: {} 2023-12-15T23:41:14.607 DEBUG:boto:Token: None 2023-12-15T23:41:14.607 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.607 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ff26927a7e3fb1c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.610 DEBUG:boto:path=/kskgfn-53/obj87 2023-12-15T23:41:14.610 DEBUG:boto:auth_path=/kskgfn-53/obj87 2023-12-15T23:41:14.610 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.610 DEBUG:boto:Path: /kskgfn-53/obj87 2023-12-15T23:41:14.610 DEBUG:boto:Data: 2023-12-15T23:41:14.610 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.610 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.610 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.610 DEBUG:boto:Params: {} 2023-12-15T23:41:14.610 DEBUG:boto:Token: None 2023-12-15T23:41:14.611 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj87 2023-12-15T23:41:14.611 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:DbL4SF6T6pLb9yLAqPBr8MXVnWg= 2023-12-15T23:41:14.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DbL4SF6T6pLb9yLAqPBr8MXVnWg='} 2023-12-15T23:41:14.615 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008d8856cfadd7a332-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.616 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.616 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.616 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.616 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.616 DEBUG:boto:Data: 2023-12-15T23:41:14.616 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.616 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.616 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.616 DEBUG:boto:Params: {} 2023-12-15T23:41:14.617 DEBUG:boto:Token: None 2023-12-15T23:41:14.617 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.617 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.619 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f2c72c6b19516317-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.619 DEBUG:boto:path=/kskgfn-53/obj116 2023-12-15T23:41:14.620 DEBUG:boto:auth_path=/kskgfn-53/obj116 2023-12-15T23:41:14.620 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.620 DEBUG:boto:Path: /kskgfn-53/obj116 2023-12-15T23:41:14.620 DEBUG:boto:Data: 2023-12-15T23:41:14.620 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.620 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.620 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.620 DEBUG:boto:Params: {} 2023-12-15T23:41:14.621 DEBUG:boto:Token: None 2023-12-15T23:41:14.621 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj116 2023-12-15T23:41:14.621 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:WhuJYcJjQdwDxDdQPhSzBq3Csmk= 2023-12-15T23:41:14.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WhuJYcJjQdwDxDdQPhSzBq3Csmk='} 2023-12-15T23:41:14.666 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9472cde1a8bf11e-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.666 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.666 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.666 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.666 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.666 DEBUG:boto:Data: 2023-12-15T23:41:14.666 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.666 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.667 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.667 DEBUG:boto:Params: {} 2023-12-15T23:41:14.667 DEBUG:boto:Token: None 2023-12-15T23:41:14.667 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.667 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.670 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c13e0d3b1cb85ac2-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.670 DEBUG:boto:path=/kskgfn-53/obj145 2023-12-15T23:41:14.670 DEBUG:boto:auth_path=/kskgfn-53/obj145 2023-12-15T23:41:14.670 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.670 DEBUG:boto:Path: /kskgfn-53/obj145 2023-12-15T23:41:14.670 DEBUG:boto:Data: 2023-12-15T23:41:14.670 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.670 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.671 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.671 DEBUG:boto:Params: {} 2023-12-15T23:41:14.671 DEBUG:boto:Token: None 2023-12-15T23:41:14.671 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj145 2023-12-15T23:41:14.671 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:mBMTxq8LGfd6eV30ES0Oh1hntWc= 2023-12-15T23:41:14.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBMTxq8LGfd6eV30ES0Oh1hntWc='} 2023-12-15T23:41:14.676 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000057b23d638ef109cf-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.676 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:14.677 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:14.726 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:14.726 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:14.774 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:14.774 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 25 2023-12-15T23:41:14.854 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.854 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.854 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.854 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.854 DEBUG:boto:Data: 2023-12-15T23:41:14.855 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.855 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.855 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.855 DEBUG:boto:Params: {} 2023-12-15T23:41:14.855 DEBUG:boto:Token: None 2023-12-15T23:41:14.855 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.855 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.858 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b51ef64d32ffa1e0-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.859 DEBUG:boto:path=/kskgfn-53/obj31 2023-12-15T23:41:14.859 DEBUG:boto:auth_path=/kskgfn-53/obj31 2023-12-15T23:41:14.859 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.859 DEBUG:boto:Path: /kskgfn-53/obj31 2023-12-15T23:41:14.859 DEBUG:boto:Data: 2023-12-15T23:41:14.859 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.859 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.859 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.860 DEBUG:boto:Params: {} 2023-12-15T23:41:14.860 DEBUG:boto:Token: None 2023-12-15T23:41:14.860 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj31 2023-12-15T23:41:14.860 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:xpeVBtwK8VZUax1ubIPzTuqaC6Q= 2023-12-15T23:41:14.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xpeVBtwK8VZUax1ubIPzTuqaC6Q='} 2023-12-15T23:41:14.870 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:41:14.867+0000 7f7d70c7a640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:41:14.902 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e97874e820a844ad-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.902 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.902 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.903 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.903 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.903 DEBUG:boto:Data: 2023-12-15T23:41:14.903 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.903 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.903 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.903 DEBUG:boto:Params: {} 2023-12-15T23:41:14.903 DEBUG:boto:Token: None 2023-12-15T23:41:14.903 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.904 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.907 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bcdafc692679c1e7-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.907 DEBUG:boto:path=/kskgfn-53/obj62 2023-12-15T23:41:14.907 DEBUG:boto:auth_path=/kskgfn-53/obj62 2023-12-15T23:41:14.907 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.907 DEBUG:boto:Path: /kskgfn-53/obj62 2023-12-15T23:41:14.907 DEBUG:boto:Data: 2023-12-15T23:41:14.908 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.908 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.908 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.908 DEBUG:boto:Params: {} 2023-12-15T23:41:14.908 DEBUG:boto:Token: None 2023-12-15T23:41:14.908 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj62 2023-12-15T23:41:14.908 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:9jwqeOoxKYTBASER5HbKS1mOID8= 2023-12-15T23:41:14.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9jwqeOoxKYTBASER5HbKS1mOID8='} 2023-12-15T23:41:14.914 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e10aef09257e6c92-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.914 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.914 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.914 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.914 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.914 DEBUG:boto:Data: 2023-12-15T23:41:14.914 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.914 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.914 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.915 DEBUG:boto:Params: {} 2023-12-15T23:41:14.915 DEBUG:boto:Token: None 2023-12-15T23:41:14.915 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.915 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.918 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000343db117ab74f02c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.918 DEBUG:boto:path=/kskgfn-53/obj93 2023-12-15T23:41:14.918 DEBUG:boto:auth_path=/kskgfn-53/obj93 2023-12-15T23:41:14.918 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.918 DEBUG:boto:Path: /kskgfn-53/obj93 2023-12-15T23:41:14.918 DEBUG:boto:Data: 2023-12-15T23:41:14.919 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.919 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.919 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.919 DEBUG:boto:Params: {} 2023-12-15T23:41:14.919 DEBUG:boto:Token: None 2023-12-15T23:41:14.919 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj93 2023-12-15T23:41:14.919 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:OnIeEOzuWxCLqCuxK/pZyp5Rqws= 2023-12-15T23:41:14.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OnIeEOzuWxCLqCuxK/pZyp5Rqws='} 2023-12-15T23:41:14.961 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000588924f0c58d6213-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.962 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.962 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.962 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.962 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.962 DEBUG:boto:Data: 2023-12-15T23:41:14.962 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.962 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.963 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.963 DEBUG:boto:Params: {} 2023-12-15T23:41:14.963 DEBUG:boto:Token: None 2023-12-15T23:41:14.963 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.963 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.966 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbab7cc2a06cf91f-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.966 DEBUG:boto:path=/kskgfn-53/obj124 2023-12-15T23:41:14.966 DEBUG:boto:auth_path=/kskgfn-53/obj124 2023-12-15T23:41:14.966 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.966 DEBUG:boto:Path: /kskgfn-53/obj124 2023-12-15T23:41:14.966 DEBUG:boto:Data: 2023-12-15T23:41:14.967 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.967 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.967 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.967 DEBUG:boto:Params: {} 2023-12-15T23:41:14.967 DEBUG:boto:Token: None 2023-12-15T23:41:14.967 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj124 2023-12-15T23:41:14.967 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:x6LpgwhzZdEx4eqaQZCywjYwM74= 2023-12-15T23:41:14.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x6LpgwhzZdEx4eqaQZCywjYwM74='} 2023-12-15T23:41:14.973 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d2b8bcf77225a85-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.973 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:14.973 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:14.973 DEBUG:boto:Method: HEAD 2023-12-15T23:41:14.973 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:14.973 DEBUG:boto:Data: 2023-12-15T23:41:14.973 DEBUG:boto:Headers: {} 2023-12-15T23:41:14.974 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.974 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.974 DEBUG:boto:Params: {} 2023-12-15T23:41:14.974 DEBUG:boto:Token: None 2023-12-15T23:41:14.974 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/ 2023-12-15T23:41:14.974 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:41:14.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:41:14.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005d4f2fedfe6c0b1a-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:14.977 DEBUG:boto:path=/kskgfn-53/obj155 2023-12-15T23:41:14.977 DEBUG:boto:auth_path=/kskgfn-53/obj155 2023-12-15T23:41:14.977 DEBUG:boto:Method: PUT 2023-12-15T23:41:14.978 DEBUG:boto:Path: /kskgfn-53/obj155 2023-12-15T23:41:14.978 DEBUG:boto:Data: 2023-12-15T23:41:14.978 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:14.978 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:14.978 DEBUG:boto:Port: 8000 2023-12-15T23:41:14.978 DEBUG:boto:Params: {} 2023-12-15T23:41:14.978 DEBUG:boto:Token: None 2023-12-15T23:41:14.978 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:14 GMT /kskgfn-53/obj155 2023-12-15T23:41:14.978 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6I3GJIiYsRIvha1F0p2vpQa+BGg= 2023-12-15T23:41:14.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6I3GJIiYsRIvha1F0p2vpQa+BGg='} 2023-12-15T23:41:15.022 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9d8ae8439f35daf-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.022 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:15.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:41:15.022 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:41:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:15.122 INFO:teuthology.orchestra.run.smithi093.stdout:tenant: 2023-12-15T23:41:15.122 INFO:teuthology.orchestra.run.smithi093.stdout:bucket name: kskgfn-53 2023-12-15T23:41:15.136 INFO:teuthology.orchestra.run.smithi093.stdout:total entries: 30 2023-12-15T23:41:15.204 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:15.204 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:15.205 DEBUG:boto:Method: HEAD 2023-12-15T23:41:15.205 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:15.205 DEBUG:boto:Data: 2023-12-15T23:41:15.205 DEBUG:boto:Headers: {} 2023-12-15T23:41:15.205 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.205 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.205 DEBUG:boto:Params: {} 2023-12-15T23:41:15.205 DEBUG:boto:Token: None 2023-12-15T23:41:15.205 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/ 2023-12-15T23:41:15.206 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:41:15.206 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:41:15.209 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b3eb7728800cf0f2-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.209 DEBUG:boto:path=/kskgfn-53/obj37 2023-12-15T23:41:15.209 DEBUG:boto:auth_path=/kskgfn-53/obj37 2023-12-15T23:41:15.209 DEBUG:boto:Method: PUT 2023-12-15T23:41:15.209 DEBUG:boto:Path: /kskgfn-53/obj37 2023-12-15T23:41:15.209 DEBUG:boto:Data: 2023-12-15T23:41:15.210 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:15.210 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.210 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.210 DEBUG:boto:Params: {} 2023-12-15T23:41:15.210 DEBUG:boto:Token: None 2023-12-15T23:41:15.210 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/obj37 2023-12-15T23:41:15.210 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:t/vOr3tvyEzca8Izfcxze46BQEM= 2023-12-15T23:41:15.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t/vOr3tvyEzca8Izfcxze46BQEM='} 2023-12-15T23:41:15.215 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b8e847d85003b58-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.215 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:15.216 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:15.216 DEBUG:boto:Method: HEAD 2023-12-15T23:41:15.216 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:15.216 DEBUG:boto:Data: 2023-12-15T23:41:15.216 DEBUG:boto:Headers: {} 2023-12-15T23:41:15.216 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.216 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.216 DEBUG:boto:Params: {} 2023-12-15T23:41:15.216 DEBUG:boto:Token: None 2023-12-15T23:41:15.216 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/ 2023-12-15T23:41:15.217 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:41:15.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:41:15.219 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000357bdddb58562e1b-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.219 DEBUG:boto:path=/kskgfn-53/obj74 2023-12-15T23:41:15.219 DEBUG:boto:auth_path=/kskgfn-53/obj74 2023-12-15T23:41:15.220 DEBUG:boto:Method: PUT 2023-12-15T23:41:15.220 DEBUG:boto:Path: /kskgfn-53/obj74 2023-12-15T23:41:15.220 DEBUG:boto:Data: 2023-12-15T23:41:15.220 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:15.220 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.220 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.220 DEBUG:boto:Params: {} 2023-12-15T23:41:15.220 DEBUG:boto:Token: None 2023-12-15T23:41:15.220 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/obj74 2023-12-15T23:41:15.220 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:qAvf2PgJ+ShfqikwjatdEFztv0M= 2023-12-15T23:41:15.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qAvf2PgJ+ShfqikwjatdEFztv0M='} 2023-12-15T23:41:15.225 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fdc1117225c07905-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.225 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:15.225 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:15.225 DEBUG:boto:Method: HEAD 2023-12-15T23:41:15.226 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:15.226 DEBUG:boto:Data: 2023-12-15T23:41:15.226 DEBUG:boto:Headers: {} 2023-12-15T23:41:15.226 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.226 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.226 DEBUG:boto:Params: {} 2023-12-15T23:41:15.226 DEBUG:boto:Token: None 2023-12-15T23:41:15.226 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/ 2023-12-15T23:41:15.226 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:41:15.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:41:15.229 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ff8cd562efeb2fe1-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.229 DEBUG:boto:path=/kskgfn-53/obj111 2023-12-15T23:41:15.230 DEBUG:boto:auth_path=/kskgfn-53/obj111 2023-12-15T23:41:15.230 DEBUG:boto:Method: PUT 2023-12-15T23:41:15.230 DEBUG:boto:Path: /kskgfn-53/obj111 2023-12-15T23:41:15.230 DEBUG:boto:Data: 2023-12-15T23:41:15.230 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:15.230 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.230 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.230 DEBUG:boto:Params: {} 2023-12-15T23:41:15.230 DEBUG:boto:Token: None 2023-12-15T23:41:15.230 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/obj111 2023-12-15T23:41:15.230 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:NjLclbJ/znJzEPVVhjjSAlpCvNk= 2023-12-15T23:41:15.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjLclbJ/znJzEPVVhjjSAlpCvNk='} 2023-12-15T23:41:15.278 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc5e374ba98bb4f8-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.278 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:15.278 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:15.278 DEBUG:boto:Method: HEAD 2023-12-15T23:41:15.278 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:15.278 DEBUG:boto:Data: 2023-12-15T23:41:15.278 DEBUG:boto:Headers: {} 2023-12-15T23:41:15.278 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.278 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.278 DEBUG:boto:Params: {} 2023-12-15T23:41:15.279 DEBUG:boto:Token: None 2023-12-15T23:41:15.279 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/ 2023-12-15T23:41:15.279 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:41:15.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:41:15.281 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d8c29c0a3e1e2b0-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.282 DEBUG:boto:path=/kskgfn-53/obj148 2023-12-15T23:41:15.282 DEBUG:boto:auth_path=/kskgfn-53/obj148 2023-12-15T23:41:15.282 DEBUG:boto:Method: PUT 2023-12-15T23:41:15.282 DEBUG:boto:Path: /kskgfn-53/obj148 2023-12-15T23:41:15.282 DEBUG:boto:Data: 2023-12-15T23:41:15.282 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:15.282 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.282 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.282 DEBUG:boto:Params: {} 2023-12-15T23:41:15.282 DEBUG:boto:Token: None 2023-12-15T23:41:15.283 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/obj148 2023-12-15T23:41:15.283 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:6B/8k3lPHhVLb9PH3ALcYzr/VDs= 2023-12-15T23:41:15.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6B/8k3lPHhVLb9PH3ALcYzr/VDs='} 2023-12-15T23:41:15.288 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005fad40194fe2fc9b-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.288 DEBUG:boto:path=/kskgfn-53/ 2023-12-15T23:41:15.288 DEBUG:boto:auth_path=/kskgfn-53/ 2023-12-15T23:41:15.288 DEBUG:boto:Method: HEAD 2023-12-15T23:41:15.288 DEBUG:boto:Path: /kskgfn-53/ 2023-12-15T23:41:15.288 DEBUG:boto:Data: 2023-12-15T23:41:15.288 DEBUG:boto:Headers: {} 2023-12-15T23:41:15.288 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.289 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.289 DEBUG:boto:Params: {} 2023-12-15T23:41:15.289 DEBUG:boto:Token: None 2023-12-15T23:41:15.289 DEBUG:boto:StringToSign: HEAD Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/ 2023-12-15T23:41:15.289 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:41:15.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:41:15.292 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a84f37693043792e-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.292 DEBUG:boto:path=/kskgfn-53/obj185 2023-12-15T23:41:15.292 DEBUG:boto:auth_path=/kskgfn-53/obj185 2023-12-15T23:41:15.292 DEBUG:boto:Method: PUT 2023-12-15T23:41:15.292 DEBUG:boto:Path: /kskgfn-53/obj185 2023-12-15T23:41:15.292 DEBUG:boto:Data: 2023-12-15T23:41:15.292 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:41:15.293 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:41:15.293 DEBUG:boto:Port: 8000 2023-12-15T23:41:15.293 DEBUG:boto:Params: {} 2023-12-15T23:41:15.293 DEBUG:boto:Token: None 2023-12-15T23:41:15.293 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Fri, 15 Dec 2023 23:41:15 GMT /kskgfn-53/obj185 2023-12-15T23:41:15.293 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:REaFaJoI9lbiPiRpVTZVEI2PT7Y= 2023-12-15T23:41:15.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:REaFaJoI9lbiPiRpVTZVEI2PT7Y='} 2023-12-15T23:41:15.338 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000df8a22d44dc37fc-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:41:15.338 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-53 2023-12-15T23:41:15.338 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:41:15.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:41:15.338 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-53 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:41:15.403 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:15.403 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:15.443 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:15.441+0000 7f9d2f331800 1 waiting to reach incremental sync.. 2023-12-15T23:41:20.444 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:20.443+0000 7f9d2f331800 1 waiting to reach incremental sync.. 2023-12-15T23:41:25.450 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:25.447+0000 7f9d2f331800 1 bucket sync caught up with source: 2023-12-15T23:41:25.453 INFO:teuthology.orchestra.run.smithi188.stderr: local status: [, , , , , , 00000000002.142.6, , , , , , 00000000002.104.6, , , , , 00000000002.138.6, , , , , , , , , , , , , , , 00000000001.109.6, , , , 00000000001.141.6] 2023-12-15T23:41:25.453 INFO:teuthology.orchestra.run.smithi188.stderr: remote markers: [, , , , , , 00000000002.142.6, , , , , , 00000000002.104.6, , , , , 00000000002.138.6, , , , , , , , , , , , , , , 00000000001.109.6, , , , 00000000001.141.6] 2023-12-15T23:41:25.453 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:41:25.447+0000 7f9d2f331800 0 bucket checkpoint complete 2023-12-15T23:41:25.467 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-53 2023-12-15T23:41:25.467 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:41:25.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:41:25.468 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-53 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:41:25.527 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:41:25.527 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:41:25.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:25.564+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:30.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:30.565+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:35.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:35.566+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:40.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:40.567+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:45.568+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:50.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:50.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:41:55.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:41:55.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:00.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:00.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:05.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:05.570+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:10.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:10.571+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:15.571+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:20.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:20.573+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:25.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:25.574+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:30.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:30.575+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:35.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:35.576+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:40.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:40.577+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:45.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:45.578+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:50.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:50.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:42:55.097 INFO:tasks.rgw.c2.client.0.smithi188.stdout:*** Caught signal (Segmentation fault) ** 2023-12-15T23:42:55.097 INFO:tasks.rgw.c2.client.0.smithi188.stdout: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:42:55.098 INFO:tasks.rgw.c2.client.0.smithi188.stdout: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:42:55.098 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:42:55.099 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout:2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:42:55.100 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:42:55.101 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:42:55.104 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:42:55.104 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:42:55.104 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:42:55.104 INFO:tasks.rgw.c2.client.0.smithi188.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:42:55.104 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.111 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 0> 2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:42:55.111 INFO:tasks.rgw.c2.client.0.smithi188.stdout: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:42:55.111 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.111 INFO:tasks.rgw.c2.client.0.smithi188.stdout: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:42:55.112 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:42:55.113 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:42:55.113 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:42:55.113 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:42:55.113 INFO:tasks.rgw.c2.client.0.smithi188.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:42:55.113 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.120 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 0> 2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:42:55.121 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:42:55.122 INFO:tasks.rgw.c2.client.0.smithi188.stdout: 2023-12-15T23:42:55.255 INFO:tasks.rgw.c2.client.0.smithi188.stderr:daemon-helper: command crashed with signal 11 2023-12-15T23:42:55.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:42:55.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:00.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:00.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:01.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:43:05.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:05.582+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:07.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~6s 2023-12-15T23:43:10.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:10.583+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:13.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~12s 2023-12-15T23:43:15.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:15.584+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:19.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~18s 2023-12-15T23:43:20.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:20.585+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~24s 2023-12-15T23:43:25.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:25.585+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:30.586+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:30.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~30s 2023-12-15T23:43:35.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:35.588+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:36.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~35s 2023-12-15T23:43:40.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:40.589+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:42.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~41s 2023-12-15T23:43:45.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:45.589+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:48.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~47s 2023-12-15T23:43:48.706 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:43:48.705+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:43:50.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:50.591+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:43:54.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~53s 2023-12-15T23:43:55.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:43:55.592+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:00.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~59s 2023-12-15T23:44:00.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:00.593+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:05.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:05.594+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:06.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~65s 2023-12-15T23:44:10.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:10.595+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:12.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~71s 2023-12-15T23:44:15.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:15.595+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:18.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~77s 2023-12-15T23:44:20.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:20.596+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:24.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~83s 2023-12-15T23:44:25.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:25.597+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:29.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~89s 2023-12-15T23:44:30.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:30.598+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:35.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:35.599+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:35.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~95s 2023-12-15T23:44:40.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:40.600+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:41.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~100s 2023-12-15T23:44:45.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:45.601+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:47.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~106s 2023-12-15T23:44:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:50.601+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:53.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~112s 2023-12-15T23:44:55.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:44:55.602+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:44:59.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~118s 2023-12-15T23:45:00.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:00.603+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:05.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~124s 2023-12-15T23:45:05.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:05.604+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:10.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:10.605+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:11.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~130s 2023-12-15T23:45:15.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:15.606+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:17.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~136s 2023-12-15T23:45:20.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:20.607+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:23.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~142s 2023-12-15T23:45:25.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:25.608+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:29.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~148s 2023-12-15T23:45:30.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:30.609+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:34.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~154s 2023-12-15T23:45:35.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:35.610+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:40.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:40.611+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:40.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~160s 2023-12-15T23:45:45.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:45.611+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:46.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~165s 2023-12-15T23:45:50.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:50.612+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:52.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~171s 2023-12-15T23:45:55.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:45:55.612+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:45:58.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~177s 2023-12-15T23:46:00.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:00.614+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:46:04.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~183s 2023-12-15T23:46:05.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:05.615+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:46:10.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~189s 2023-12-15T23:46:10.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:10.616+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:46:15.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:15.617+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:46:16.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~195s 2023-12-15T23:46:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:20.618+0000 7f90877af800 -1 bucket checkpoint timed out waiting to reach incremental sync 2023-12-15T23:46:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:20.618+0000 7f90877af800 0 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:46:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:46:20.618+0000 7f90877af800 -1 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:46:20.638 DEBUG:teuthology.orchestra.run:got remote process result: 110 2023-12-15T23:46:20.640 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init ... FAIL 2023-12-15T23:46:20.641 DEBUG:boto:path=/kskgfn-54/ 2023-12-15T23:46:20.642 DEBUG:boto:auth_path=/kskgfn-54/ 2023-12-15T23:46:20.642 DEBUG:boto:Method: PUT 2023-12-15T23:46:20.642 DEBUG:boto:Path: /kskgfn-54/ 2023-12-15T23:46:20.642 DEBUG:boto:Data: 2023-12-15T23:46:20.642 DEBUG:boto:Headers: {} 2023-12-15T23:46:20.642 DEBUG:boto:Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:46:20.642 DEBUG:boto:Port: 8000 2023-12-15T23:46:20.642 DEBUG:boto:Params: {} 2023-12-15T23:46:20.643 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:46:20.643 DEBUG:boto:Token: None 2023-12-15T23:46:20.643 DEBUG:boto:StringToSign: PUT Fri, 15 Dec 2023 23:46:20 GMT /kskgfn-54/ 2023-12-15T23:46:20.644 DEBUG:boto:Signature: AWS RQ4G229IF2X1XV5EJM37:lGptbmDjuIU60uPUIQPYc+va1qs= 2023-12-15T23:46:20.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:46:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lGptbmDjuIU60uPUIQPYc+va1qs=', 'Content-Length': '0'} 2023-12-15T23:46:20.664 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000929bf45baf21d6df-00657ce54c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:46:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:46:20.664 DEBUG:rgw_multi.tests:created bucket=kskgfn-54 2023-12-15T23:46:20.664 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:20.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:20.665 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:20.715 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:20.715 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:20.748 INFO:teuthology.orchestra.run.smithi093.stderr:No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:46:20.764 INFO:teuthology.orchestra.run.smithi093.stdout:[{"marker":"1_1702683980.662037_609.1","last_update":"2023-12-15T23:46:20.662037Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:46:20.764 DEBUG:rgw_multi.tests:master meta markers={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:20.765 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2023-12-15T23:46:20.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:20.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:20.765 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:20.818 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:20.818 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:20.851 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:20.851+0000 7ff7b4327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:20.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:20.852+0000 7ff7b4327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:20.870 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:20Z"} 2023-12-15T23:46:20.870 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:20Z"} 2023-12-15T23:46:20.870 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:20.870 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:20.870 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:20.870 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:22.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~201s 2023-12-15T23:46:25.871 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:25.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:25.872 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:25.925 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:25.925 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:25.959 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:25.958+0000 7fb380211800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:25.960 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:25.959+0000 7fb380211800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:25.978 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:25Z"} 2023-12-15T23:46:25.978 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:25Z"} 2023-12-15T23:46:25.978 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:25.978 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:25.978 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:25.978 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:28.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~207s 2023-12-15T23:46:30.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:30.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:30.980 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:31.034 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:31.034 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:31.067 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:31.066+0000 7f226671f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:31.068 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:31.068+0000 7f226671f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:31.084 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:31Z"} 2023-12-15T23:46:31.085 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:31Z"} 2023-12-15T23:46:31.085 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:31.085 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:31.085 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:31.085 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:34.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~213s 2023-12-15T23:46:36.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:36.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:36.087 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:36.139 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:36.139 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:36.173 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:36.171+0000 7f53c5b2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:36.174 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:36.173+0000 7f53c5b2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:36.192 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:36Z"} 2023-12-15T23:46:36.192 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:36Z"} 2023-12-15T23:46:36.192 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:36.193 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:36.193 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:36.193 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:39.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~219s 2023-12-15T23:46:41.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:41.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:41.194 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:41.248 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:41.248 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:41.281 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:41.280+0000 7f7c9af2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:41.283 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:41.281+0000 7f7c9af2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:41.300 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:41Z"} 2023-12-15T23:46:41.300 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:41Z"} 2023-12-15T23:46:41.300 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:41.300 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:41.300 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:41.300 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:45.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~225s 2023-12-15T23:46:46.302 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:46.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:46.303 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:46.355 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:46.356 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:46.388 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:46.388+0000 7fbcc4b22800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:46.389 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:46.389+0000 7fbcc4b22800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:46.407 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:46Z"} 2023-12-15T23:46:46.407 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:46Z"} 2023-12-15T23:46:46.407 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:46.407 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:46.408 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:46.408 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:51.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:51.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:51.410 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:51.463 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:51.463 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:51.497 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:51.496+0000 7f8a87e0f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:51.498 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:51.497+0000 7f8a87e0f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:51.516 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:51Z"} 2023-12-15T23:46:51.516 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:51Z"} 2023-12-15T23:46:51.516 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:51.517 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:51.517 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:51.517 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:51.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~230s 2023-12-15T23:46:56.518 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:56.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:46:56.518 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:46:56.572 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:46:56.572 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:46:56.605 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:56.605+0000 7f5eeb122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:56.607 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:46:56.606+0000 7f5eeb122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:46:56.624 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:56Z"} 2023-12-15T23:46:56.625 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:56Z"} 2023-12-15T23:46:56.625 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:46:56.625 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:56.625 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:46:56.626 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:46:57.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~236s 2023-12-15T23:47:01.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:01.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:01.627 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:01.682 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:01.682 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:01.715 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:01.715+0000 7fa109b32800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:01.716 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:01.716+0000 7fa109b32800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:01.734 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:01Z"} 2023-12-15T23:47:01.734 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:01Z"} 2023-12-15T23:47:01.734 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:01.735 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:01.735 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:01.735 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:03.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~242s 2023-12-15T23:47:06.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:06.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:06.736 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:06.789 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:06.789 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:06.824 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:06.823+0000 7f53db511800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:06.825 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:06.825+0000 7f53db511800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:06.843 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:06Z"} 2023-12-15T23:47:06.843 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:06Z"} 2023-12-15T23:47:06.843 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:06.843 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:06.843 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:06.844 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:09.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~248s 2023-12-15T23:47:11.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:11.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:11.845 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:11.901 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:11.901 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:11.934 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:11.933+0000 7fc82e810800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:11.935 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:11.935+0000 7fc82e810800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:11.953 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:11Z"} 2023-12-15T23:47:11.954 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:11Z"} 2023-12-15T23:47:11.954 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:11.954 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:11.955 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:11.955 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:15.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~254s 2023-12-15T23:47:16.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:16.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:16.956 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:17.009 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:17.010 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:17.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:17.043+0000 7fcd5a526800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:17.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:17.044+0000 7fcd5a526800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:17.061 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:17Z"} 2023-12-15T23:47:17.061 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:17Z"} 2023-12-15T23:47:17.061 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:17.061 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:17.061 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:17.061 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:21.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~260s 2023-12-15T23:47:22.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:22.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:22.063 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:22.115 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:22.115 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:22.149 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:22.148+0000 7f1fb0332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:22.150 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:22.150+0000 7f1fb0332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:22.168 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:22Z"} 2023-12-15T23:47:22.168 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:22Z"} 2023-12-15T23:47:22.168 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:22.168 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:22.168 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:22.168 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:27.169 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:27.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:27.170 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:27.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~266s 2023-12-15T23:47:27.222 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:27.223 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:27.256 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:27.254+0000 7fc7c3933800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:27.257 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:27.256+0000 7fc7c3933800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:27.275 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:27Z"} 2023-12-15T23:47:27.276 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:27Z"} 2023-12-15T23:47:27.276 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:27.276 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:27.276 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:27.276 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:32.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:32.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:32.278 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:32.330 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:32.330 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:32.363 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:32.362+0000 7fa0d7f28800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:32.365 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:32.363+0000 7fa0d7f28800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:32.382 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:32Z"} 2023-12-15T23:47:32.382 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:32Z"} 2023-12-15T23:47:32.382 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:32.382 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:32.382 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:32.382 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:33.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~272s 2023-12-15T23:47:37.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:37.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:37.384 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:37.436 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:37.437 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:37.470 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:37.470+0000 7f6b1752c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:37.471 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:37.471+0000 7f6b1752c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:37.490 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:37Z"} 2023-12-15T23:47:37.490 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:37Z"} 2023-12-15T23:47:37.490 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:37.490 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:37.490 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:37.490 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:39.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~278s 2023-12-15T23:47:42.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:42.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:42.493 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:42.545 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:42.546 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:42.579 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:42.578+0000 7f5e2f0c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:42.580 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:42.580+0000 7f5e2f0c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:42.599 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:42Z"} 2023-12-15T23:47:42.599 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:42Z"} 2023-12-15T23:47:42.599 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:42.599 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:42.600 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:42.600 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:44.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~284s 2023-12-15T23:47:47.601 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:47.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:47.602 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:47.655 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:47.655 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:47.688 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:47.687+0000 7f4282928800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:47.689 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:47.689+0000 7f4282928800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:47.707 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:47Z"} 2023-12-15T23:47:47.707 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:47Z"} 2023-12-15T23:47:47.707 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:47.708 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:47.708 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:47.708 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:50.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~289s 2023-12-15T23:47:52.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:52.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:52.710 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:52.763 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:52.763 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:52.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:52.795+0000 7fc2f4126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:52.797 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:52.797+0000 7fc2f4126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:52.814 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:52Z"} 2023-12-15T23:47:52.814 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:52Z"} 2023-12-15T23:47:52.815 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:52.815 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:52.815 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:52.815 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:47:56.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~295s 2023-12-15T23:47:57.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:57.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:47:57.817 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:47:57.870 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:47:57.870 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:47:57.902 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:57.902+0000 7fcfa5531800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:57.904 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:47:57.903+0000 7fcfa5531800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:47:57.921 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:57Z"} 2023-12-15T23:47:57.921 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:57Z"} 2023-12-15T23:47:57.921 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:47:57.921 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:57.921 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:47:57.921 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:48:02.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~301s 2023-12-15T23:48:02.651 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-15T23:48:02.922 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:48:02.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:48:02.922 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:48:02.975 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:48:02.975 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:48:03.010 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:48:03.009+0000 7ff43e331800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:48:03.011 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:48:03.011+0000 7ff43e331800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:48:03.029 INFO:teuthology.orchestra.run.smithi188.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:48:03Z"} 2023-12-15T23:48:03.029 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:48:03Z"} 2023-12-15T23:48:03.029 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:48:03.030 DEBUG:rgw_multi.tests:log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:48:03.030 DEBUG:rgw_multi.tests:sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:48:03.030 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:48:03.556 INFO:tasks.ceph.c2.osd.0:Sent signal 15 2023-12-15T23:48:03.557 INFO:tasks.ceph.c2.osd.1:Sent signal 15 2023-12-15T23:48:03.557 INFO:tasks.ceph.c2.osd.2:Sent signal 15 2023-12-15T23:48:03.557 INFO:tasks.ceph.c2.osd.3:Sent signal 15 2023-12-15T23:48:03.557 INFO:tasks.ceph.c2.osd.4:Sent signal 15 2023-12-15T23:48:03.558 INFO:tasks.ceph.c2.osd.5:Sent signal 15 2023-12-15T23:48:03.558 INFO:tasks.ceph.c2.mon.a:Sent signal 15 2023-12-15T23:48:03.558 INFO:tasks.rgw.c2.client.1:Sent signal 15 2023-12-15T23:48:03.558 INFO:tasks.ceph.c2.mgr.x:Sent signal 15 2023-12-15T23:48:03.559 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fd087edc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 3 (PID: 83634) UID: 0 2023-12-15T23:48:03.559 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fd087edc640 -1 osd.3 55 *** Got signal Terminated *** 2023-12-15T23:48:03.559 INFO:tasks.ceph.c2.osd.3.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fd087edc640 -1 osd.3 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 83708) UID: 0 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 osd.0 55 *** Got signal Terminated *** 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.0.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 osd.0 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 4 (PID: 83636) UID: 0 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 osd.4 55 *** Got signal Terminated *** 2023-12-15T23:48:03.560 INFO:tasks.ceph.c2.osd.4.smithi192.stderr:2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 osd.4 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 83710) UID: 0 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 osd.1 55 *** Got signal Terminated *** 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.1.smithi188.stderr:2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T23:48:03.558+0000 7f758913c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 5 (PID: 83638) UID: 0 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T23:48:03.558+0000 7f758913c640 -1 osd.5 55 *** Got signal Terminated *** 2023-12-15T23:48:03.561 INFO:tasks.ceph.c2.osd.5.smithi192.stderr:2023-12-15T23:48:03.558+0000 7f758913c640 -1 osd.5 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.562 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f1dad340640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 83712) UID: 0 2023-12-15T23:48:03.562 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f1dad340640 -1 osd.2 55 *** Got signal Terminated *** 2023-12-15T23:48:03.562 INFO:tasks.ceph.c2.osd.2.smithi188.stderr:2023-12-15T23:48:03.557+0000 7f1dad340640 -1 osd.2 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:48:03.562 INFO:tasks.rgw.c2.client.1.smithi192.stdout:2023-12-15T23:48:03.558+0000 7f36739df640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 87030) UID: 0 2023-12-15T23:48:03.563 INFO:tasks.rgw.c2.client.1.smithi192.stdout:2023-12-15T23:48:03.558+0000 7f367723e880 -1 shutting down 2023-12-15T23:48:03.563 INFO:tasks.ceph.c2.mon.a.smithi188.stderr:2023-12-15T23:48:03.558+0000 7fea165fe640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 83523) UID: 0 2023-12-15T23:48:03.563 INFO:tasks.ceph.c2.mon.a.smithi188.stderr:2023-12-15T23:48:03.558+0000 7fea165fe640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-15T23:48:08.031 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:48:08.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:48:08.032 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:48:08.086 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:48:08.086 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.088 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:53:08.087+0000 7ff0cbd2c800 0 monclient(hunting): authenticate timed out after 300 2023-12-15T23:53:08.088 INFO:teuthology.orchestra.run.smithi188.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-15T23:53:08.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T23:53:08.091 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init ... FAIL 2023-12-15T23:53:08.091 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.091 INFO:tasks.rgw_multisite_tests:====================================================================== 2023-12-15T23:53:08.091 INFO:tasks.rgw_multisite_tests:ERROR: rgw_multi.tests.test_role_sync 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 1697, in test_role_sync 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: roles, zone_role = create_role_per_zone(zonegroup_conns) 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 511, in create_role_per_zone 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: role = zone.create_role("", role_name, policy_document, "") 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw_multi/zone_rados.py", line 130, in create_role 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: return self.iam_conn.create_role(rolename, policy_document, path) 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/boto/iam/connection.py", line 1155, in create_role 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: return self.get_response('CreateRole', params) 2023-12-15T23:53:08.092 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/boto/iam/connection.py", line 102, in get_response 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests: raise self.ResponseError(response.status, response.reason, body) 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto.exception.BotoServerError: BotoServerError: 403 Forbidden 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:AccessDeniedtx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone25642-test-zone2-test-zonegroup 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create role zone=test-zone1 name=roles-kskgfn-1 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: POST 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: / 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {'RoleName': 'roles-kskgfn-1', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:53:08.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: CanonicalRequest: 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:POST 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:/ 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:host:smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:x-amz-date:20231215T232618Z 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:host;x-amz-date 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:5101ddfa0fa136f561fb828a95a08a23f90379eb6d4c02ee494136d72d346522 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:20231215T232618Z 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:20231215/front/smithi093/aws4_request 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:a6a9b5dbab23488b6973deb120e8cbd53a7322bb17431ea97500853488783d6f 2023-12-15T23:53:08.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:8a891933098d3d0a4eb19eb1a39524c4dc5fe9fda613182ba440fc4152513bf1 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20231215T232618Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=RQ4G229IF2X1XV5EJM37/20231215/front/smithi093/aws4_request,SignedHeaders=host;x-amz-date,Signature=8a891933098d3d0a4eb19eb1a39524c4dc5fe9fda613182ba440fc4152513bf1', 'Host': 'smithi093.front.sepia.ceph.com:8000'} 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000630ba7bf983729b1-00657ce09a-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '731'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'02e4b550-76a0-4196-9f48-bb59dc87e6a2roles-kskgfn-1/arn:aws:iam:::role/roles-kskgfn-12023-12-15T23:26:18.602Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx00000630ba7bf983729b1-00657ce09a-4716-test-zone1' 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create role zone=test-zone2 name=roles-kskgfn-2 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: POST 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: / 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {'RoleName': 'roles-kskgfn-2', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}', 'Path': '', 'Action': 'CreateRole', 'Version': '2010-05-08'} 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: CanonicalRequest: 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:POST 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:/ 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:host:smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:x-amz-date:20231215T232618Z 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:host;x-amz-date 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:5ef263925bdaab12358c97e19f3d0637fba86f6f57c20e0bc0092a96b766a819 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:20231215T232618Z 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:20231215/front/smithi188/aws4_request 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:017f0513275bbcf79ab465b284ce7c4c0b2f9811366f320b986e174caf306280 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.096 INFO:tasks.rgw_multisite_tests:6743950e043b0492b464cbc88a339fbe74e132836d834447bc122ae41a82ae19 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'X-Amz-Date': '20231215T232618Z', 'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8', 'Content-Length': '325', 'Authorization': 'AWS4-HMAC-SHA256 Credential=RQ4G229IF2X1XV5EJM37/20231215/front/smithi188/aws4_request,SignedHeaders=host;x-amz-date,Signature=6743950e043b0492b464cbc88a339fbe74e132836d834447bc122ae41a82ae19', 'Host': 'smithi188.front.sepia.ceph.com:8000'} 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '217'), ('x-amz-request-id', 'tx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:26:18 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'AccessDeniedtx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone25642-test-zone2-test-zonegroup' 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:boto: ERROR: 403 Forbidden 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:boto: ERROR: b'AccessDeniedtx00000f1b2fdbaf597d31c-00657ce09a-5642-test-zone25642-test-zone2-test-zonegroup' 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:====================================================================== 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_bucket_incremental_sync_after_data_sync_init 2023-12-15T23:53:08.097 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 1813, in test_bucket_incremental_sync_after_data_sync_init 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 395, in zonegroup_bucket_checkpoint 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 387, in zone_bucket_checkpoint 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw_multisite.py", line 197, in admin 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests: assert r == 0 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests:AssertionError: 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2023-12-15T23:53:08.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:35:49 GMT 2023-12-15T23:53:08.099 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:IW6HKOkNj6zw1yZbgfJcVOZUszk= 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:49 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:IW6HKOkNj6zw1yZbgfJcVOZUszk=', 'Content-Length': '0'} 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008102a58ca57d0ffc-00657ce2d5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:49 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=kskgfn-52 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: [{"marker":"1_1702683349.794097_490.1","last_update":"2023-12-15T23:35:49.794097Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.100 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:35:49.962+0000 7f71e8322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:35:49.964+0000 7f71e8322800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.786786_487.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.786786Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.786786_487.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.786786Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:49Z"} 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683349.786786_487.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:35:49.786786Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683349.786786_487.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683349.794097_490.1 target=1_1702683349.786786_487.1 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.101 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:35:55.067+0000 7f9e96332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:35:55.069+0000 7f9e96332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.794097_490.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.794097Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:55Z"} 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683349.794097_490.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:35:49.794097Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:35:55Z"} 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683349.794097_490.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:35:49.794097Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683349.794097_490.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:35:55 GMT 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:HqTusPuy/ZVRbbccld1LaqeOyas= 2023-12-15T23:53:08.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:35:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HqTusPuy/ZVRbbccld1LaqeOyas=', 'Content-Length': '0'} 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f26b1dbce3321a6d-00657ce2db-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.104 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:35:55 GMT 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ymoOWKD2FHCZX4wLdra9dWSOiQc= 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:35:55 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ymoOWKD2FHCZX4wLdra9dWSOiQc='} 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ff5af59d5c01009-00657ce2db-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-52 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:35:55.227+0000 7f2c14816800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:00.229+0000 7f2c14816800 1 bucket sync caught up with source: 2023-12-15T23:53:08.105 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:00.229+0000 7f2c14816800 0 bucket checkpoint complete 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-52 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:36:00.351+0000 7f0fbef24800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:36:05.353+0000 7f0fbef24800 1 bucket sync caught up with source: 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: local status: [, , , , , 00000000001.126.6, , , , , ] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: remote markers: [, , , , , 00000000001.126.6, , , , , ] 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:36:05.353+0000 7f0fbef24800 0 bucket checkpoint complete 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: comparing bucket=kskgfn-52 zones={test-zone2, test-zone1} 2023-12-15T23:53:08.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.107 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI= 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI=', 'Content-Length': '0'} 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8ec59614611337f-00657ce2e5-5826-test-zone2'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI= 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:tQspzfG7m/N5mq7P9fX8dBdUPrI=', 'Content-Length': '0'} 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e7092a1f79380ab9-00657ce2e5-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket1 objects: 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:/kskgfn-52/?versions 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:53:08.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b6540ce9b6fbb1f-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=dummy 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket2 objects: 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:/kskgfn-52/?versions 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048a4e3eae04c740a-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=dummy 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.113 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:/kskgfn-52/?versions 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000161a699367a95775-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?versions&max-keys=999 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:/kskgfn-52/?versions 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM= 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9AVLDRES79LMxo1jMaCDWYsteaM=', 'Content-Length': '0'} 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000026fe0e7746d7beb-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52999falsedummynulltrue2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.115 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=dummy 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.116 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089cff8d2c273fd3f-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096ba8b430731f084-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.119 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w= 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w=', 'Content-Length': '0'} 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fa58388b82730a7-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w= 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:rs8NxGOLkrDsCW4agIvEcN5IY2w=', 'Content-Length': '0'} 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049f4961d8985cf7b-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=dummy 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.122 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecf5e0cc511f65cf-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy?versionId=null 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc= 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:BcsGgpj6JdQEOCrcTav/B6jSusc=', 'Content-Length': '0'} 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c4ec2e6bc814cee-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.125 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c55c68435619eed-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8b3a6f4b2601a68-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.128 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0= 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0=', 'Content-Length': '0'} 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d80323758c10ce86-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.129 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0= 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ow8sJfXNj2vuOETqN98JPTpF7U0=', 'Content-Length': '0'} 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041bc89ce7b05cb37-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=dummy 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME= 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME=', 'Content-Length': '0'} 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '85829102-5436-4ffc-bbf4-ae2b811bdc9c:kskgfn-52:85829102-5436-4ffc-bbf4-ae2b811bdc9c.4716.23'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057d6720820586f01-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/dummy 2023-12-15T23:53:08.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/dummy 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/dummy 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:/kskgfn-52/dummy 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.132 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME= 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:wj7kEHOX4O6Bhk9x4il9rC0nTME=', 'Content-Length': '0'} 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Fri, 15 Dec 2023 23:35:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a855fb92a89969b4-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf094991f957cb58-00657ce2e5-5826-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/?prefix=dummy 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:GET 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:05 GMT 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.135 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E= 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:05 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:EWQ4SGqeQhNOAv+DF4AlvhDOR2E=', 'Content-Length': '0'} 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b551afc0368f1652-00657ce2e5-4716-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:05 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'kskgfn-52dummy1000falsedummy2023-12-15T23:35:55.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDrgw-multisite-test-userMultisite Test UserNormal' 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: success, bucket identical: bucket=kskgfn-52 zones={test-zone2, test-zone1} 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: DEBUG: waiting for process to exit 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: INFO: waiting for 300 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:36:05.502+0000 7f73dd5df640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 115630) UID: 0 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:36:05.502+0000 7f73e0e3e880 -1 shutting down 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Stopped 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:53:08.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007843e841037c2964-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/obj11 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/obj11 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/obj11 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.138 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:/kskgfn-52/obj11 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:/rHZGVQ6b1tmQl/FpH5K1sJHUUU= 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:/rHZGVQ6b1tmQl/FpH5K1sJHUUU='} 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eaa0f9fbb277b800-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000042c47a62576cd168-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/obj22 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/obj22 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/obj22 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:/kskgfn-52/obj22 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:7IJqId/0bpfV6eK/b4QiIpF7Jlc= 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:7IJqId/0bpfV6eK/b4QiIpF7Jlc='} 2023-12-15T23:53:08.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c21bf57aeab5fc80-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.142 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f03ae70d955a7b8-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/obj33 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/obj33 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/obj33 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:/kskgfn-52/obj33 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:Q4/lfflRHH65Iy4+nmAbBSED6pM= 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Q4/lfflRHH65Iy4+nmAbBSED6pM='} 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c9d44e51fb86e60-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000060fb3bf918516cb2-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/obj44 2023-12-15T23:53:08.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/obj44 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/obj44 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:/kskgfn-52/obj44 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.146 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:zZi7kCb2pdOL9s98AzwkGSsmrIg= 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:zZi7kCb2pdOL9s98AzwkGSsmrIg='} 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cad3a43cee3c112b-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/ 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/ 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/ 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.147 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:/kskgfn-52/ 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY= 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cmjhaYFLyIUhNO95ig+rWT3taJY=', 'Content-Length': '0'} 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002161868f0e0cb7df-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-52/obj55 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-52/obj55 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-52/obj55 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:36:11 GMT 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:/kskgfn-52/obj55 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:MicGUi/IlgORLnoziy0oBq22EBo= 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:36:11 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MicGUi/IlgORLnoziy0oBq22EBo='} 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000029632341b1b3632e-00657ce2eb-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:36:11 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.149 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:11.782+0000 7f6f9ce8c800 5 RGW-SYNC:data: waiting on data sync status lease 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:11.783+0000 7f6f9ce8c800 5 RGW-SYNC:data: acquired data sync status lease 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Restarting daemon 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Started 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: Dload Upload Total Spent Left Speed 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 7 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: curl: (7) Failed to connect to smithi188.front.sepia.ceph.com port 8000: Connection refused 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > curl http://smithi188.front.sepia.ceph.com:8000 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-15T23:53:08.150 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: Dload Upload Total Spent Left Speed 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: anonymous 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-52 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 has been restored 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:13.006+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:36:14.219+0000 7f7d70c7a640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:18.007+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.151 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:23.009+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:28.010+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:33.012+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:38.013+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:43.014+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.152 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:48.015+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:53.016+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:36:58.018+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:03.020+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:08.021+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.153 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:13.022+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:18.024+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:23.025+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:28.026+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:33.028+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.154 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:38.029+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:43.030+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , ] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:48.031+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:53.034+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:37:58.035+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:03.036+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:08.038+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , , 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:13.039+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:18.040+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:23.041+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:28.042+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:33.043+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:38.044+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:43.045+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000001.68.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi093.stdout: INFO: 2023-12-15T23:38:47.936+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:53:08.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:48.047+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:53.048+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:38:58.049+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:03.050+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:08.052+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.158 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:13.053+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:18.055+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:23.056+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:28.056+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:33.057+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.159 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:38.060+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:43.061+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:48.062+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:53.063+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:39:58.065+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:03.066+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.160 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:08.068+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:13.069+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:18.071+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:23.071+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.161 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:28.072+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:33.074+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:38.076+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:43.077+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:48.079+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.162 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:53.080+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:40:58.081+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:03.083+0000 7fa2c7612800 1 waiting for incremental sync to catch up: 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , 00000000001.56.6, , , , 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , 00000000001.56.6, , , 00000000001.130.6, 00000000002.84.6, 00000000002.70.6] 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:08.084+0000 7fa2c7612800 0 bucket checkpoint timed out waiting for incremental sync to catch up 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:08.084+0000 7fa2c7612800 0 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:08.084+0000 7fa2c7612800 -1 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.163 INFO:tasks.rgw_multisite_tests:====================================================================== 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 1842, in test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 395, in zonegroup_bucket_checkpoint 2023-12-15T23:53:08.164 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 387, in zone_bucket_checkpoint 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw_multisite.py", line 197, in admin 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests: assert r == 0 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:AssertionError: 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:08 GMT 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:T0n5Beig4KPsrz7TRt8s23Re6dU= 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:08 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:T0n5Beig4KPsrz7TRt8s23Re6dU=', 'Content-Length': '0'} 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008020672d1e2c28f9-00657ce414-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:08 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=kskgfn-53 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.166 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: [{"marker":"1_1702683668.131542_497.1","last_update":"2023-12-15T23:41:08.131542Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:08.325+0000 7f99c1137800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:08.326+0000 7f99c1137800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.167 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.122541_494.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.122541Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:08Z"} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.122541_494.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.122541Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:08Z"} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683668.122541_494.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:08.122541Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683668.122541_494.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683668.131542_497.1 target=1_1702683668.122541_494.1 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:13.431+0000 7fec53b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:13.432+0000 7fec53b20800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.131542_497.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.131542Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:13Z"} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683668.131542_497.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:08.131542Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:41:13Z"} 2023-12-15T23:53:08.168 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683668.131542_497.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:08.131542Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683668.131542_497.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ea8bc56b527094a5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj11 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj11 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj11 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj11 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:CISWj0jciDNT74FgPISYiuhaGaY= 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:CISWj0jciDNT74FgPISYiuhaGaY='} 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000260be847174e23d8-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.172 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ebc5e4b66b4978f-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj22 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj22 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj22 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.173 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj22 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:RiW7miNMZTnF8r8q7PR7l1G5fig= 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:RiW7miNMZTnF8r8q7PR7l1G5fig='} 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c22e132a35235fce-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c48eb9efda6aa7d5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj33 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj33 2023-12-15T23:53:08.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj33 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj33 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.176 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:iCZLKg8c1MccXVG6c2TNtwPizKY= 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:iCZLKg8c1MccXVG6c2TNtwPizKY='} 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f53a0ed69863db2d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.177 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9becb92b3558b26-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj44 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj44 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj44 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj44 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:z0ve9lRj6hMP+csd3cKuYv9rLLc= 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:z0ve9lRj6hMP+csd3cKuYv9rLLc='} 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000017dc67a6aec0c566-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.180 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b276865c3d2260d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj55 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj55 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj55 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.181 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj55 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:o0K64qV1vIs3PkbNCoH6FcSr4Yo= 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:o0K64qV1vIs3PkbNCoH6FcSr4Yo='} 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009be17e5072d42034-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.182 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 5 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e086ba89d86a00af-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj17 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj17 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj17 2023-12-15T23:53:08.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj17 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:cbKm3rC9bFQLlYFEPLZANwWP0Yg= 2023-12-15T23:53:08.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:cbKm3rC9bFQLlYFEPLZANwWP0Yg='} 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000436493abf2a4ff71-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.186 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007f34691216eca192-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj34 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj34 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj34 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj34 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:1S44Dz1X3DJFBMj5RxWnFmcNHaY= 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:1S44Dz1X3DJFBMj5RxWnFmcNHaY='} 2023-12-15T23:53:08.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007690bd74d6cb64ae-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.189 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0e3763e0744aa8d-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj51 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj51 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj51 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj51 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ahTa99R5lvf8LrwYJKh2l5IBiTk= 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ahTa99R5lvf8LrwYJKh2l5IBiTk='} 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfa05d48341a8654-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.192 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a5794220e1ee68e-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj68 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj68 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj68 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj68 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:eaU5nW8J40dPVYJvicjynAVukDk= 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:eaU5nW8J40dPVYJvicjynAVukDk='} 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ede23a07071a212a-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004107d53a4e619a10-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj85 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj85 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj85 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.196 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj85 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:qwgptfnwFq8VQJMQb65WDVG7NtQ= 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qwgptfnwFq8VQJMQb65WDVG7NtQ='} 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075c7a601b5aac3a2-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.197 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 10 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.198 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4= 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ig+oYtYmCPiHNjksZ3tffGEQPo4=', 'Content-Length': '0'} 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083190f8838336753-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj19 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj19 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj19 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:13 GMT 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj19 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:Lcvjl262c0FXeGQJFOS9uZKF9kU= 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:13 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Lcvjl262c0FXeGQJFOS9uZKF9kU='} 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004ee9db807af05e5-00657ce419-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:13 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000703cb9fd04bbf580-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj38 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj38 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj38 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj38 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:Ef2yUqC3DZrTYe5b+x9F9l4U1HM= 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Ef2yUqC3DZrTYe5b+x9F9l4U1HM='} 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006badfaf627b823cd-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031a2ae2f18291ccb-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj57 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj57 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj57 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.205 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj57 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:LZE2unOOdD2BMo7l2mp3ukNa1qk= 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:LZE2unOOdD2BMo7l2mp3ukNa1qk='} 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd252790f000163d-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e72077afeca56816-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj76 2023-12-15T23:53:08.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj76 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj76 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.208 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj76 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:Qv4zIK8DF5jGQDOK2gaXtn/uUpw= 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Qv4zIK8DF5jGQDOK2gaXtn/uUpw='} 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9b745b2d7a7385e-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f8ad5d88991f8dc-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj95 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj95 2023-12-15T23:53:08.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj95 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.211 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj95 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2/mC2jADrhAQMMVk7mVohiu9IvQ= 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2/mC2jADrhAQMMVk7mVohiu9IvQ='} 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cbaad139c8744884-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 15 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.213 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000043e8608f8a96a43b-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj23 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj23 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj23 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj23 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:ay2R9X8KTTCXMudmO/Z2VaERdaE= 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:ay2R9X8KTTCXMudmO/Z2VaERdaE='} 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000060dc32112d46d782-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.216 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000af6af19cee8fef81-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj46 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj46 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj46 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.217 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj46 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:HZnmaQdylDYqkahk2D52qVEwlhY= 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:HZnmaQdylDYqkahk2D52qVEwlhY='} 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b79fac11c937bcbe-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007383e26960fd2dba-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj69 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj69 2023-12-15T23:53:08.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj69 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj69 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.220 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:FYMsut7IudYuYJ0OkbUo00qAVlU= 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:FYMsut7IudYuYJ0OkbUo00qAVlU='} 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e63b861682d6044c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.221 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ba20ce209700f61-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj92 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj92 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj92 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj92 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:Oao2ClMfqDMDSCrDFw+31h8dySM= 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:Oao2ClMfqDMDSCrDFw+31h8dySM='} 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5834acce73df1c1-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000027594af11129a852-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj115 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj115 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj115 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.225 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj115 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:j6+LJ7BUGKASMtH8NCUIvzh7Lsw= 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:j6+LJ7BUGKASMtH8NCUIvzh7Lsw='} 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000204e9f1292211748-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.226 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 20 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.227 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000702afd66ec1ab012-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj29 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj29 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj29 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj29 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:4rF+isFbTHScRZDN9iK/3ymctpg= 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:4rF+isFbTHScRZDN9iK/3ymctpg='} 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008591ba76ae8cde4d-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000543ef6a112690a8c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj58 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj58 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj58 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.231 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj58 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:MkRMhh27AzoUMFGrpn3L+19fGww= 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:MkRMhh27AzoUMFGrpn3L+19fGww='} 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fb28a32be542827a-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ff26927a7e3fb1c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj87 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj87 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj87 2023-12-15T23:53:08.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj87 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:DbL4SF6T6pLb9yLAqPBr8MXVnWg= 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:DbL4SF6T6pLb9yLAqPBr8MXVnWg='} 2023-12-15T23:53:08.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008d8856cfadd7a332-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.235 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f2c72c6b19516317-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj116 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj116 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj116 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj116 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:WhuJYcJjQdwDxDdQPhSzBq3Csmk= 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:WhuJYcJjQdwDxDdQPhSzBq3Csmk='} 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9472cde1a8bf11e-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.238 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c13e0d3b1cb85ac2-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj145 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj145 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj145 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.239 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj145 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:mBMTxq8LGfd6eV30ES0Oh1hntWc= 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:mBMTxq8LGfd6eV30ES0Oh1hntWc='} 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000057b23d638ef109cf-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.240 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 25 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.241 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b51ef64d32ffa1e0-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj31 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj31 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj31 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj31 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:xpeVBtwK8VZUax1ubIPzTuqaC6Q= 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:xpeVBtwK8VZUax1ubIPzTuqaC6Q='} 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:41:14.867+0000 7f7d70c7a640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e97874e820a844ad-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.244 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bcdafc692679c1e7-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj62 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj62 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj62 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.245 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj62 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:9jwqeOoxKYTBASER5HbKS1mOID8= 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:9jwqeOoxKYTBASER5HbKS1mOID8='} 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e10aef09257e6c92-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000343db117ab74f02c-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj93 2023-12-15T23:53:08.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj93 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj93 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj93 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.248 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:OnIeEOzuWxCLqCuxK/pZyp5Rqws= 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:OnIeEOzuWxCLqCuxK/pZyp5Rqws='} 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000588924f0c58d6213-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.249 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cbab7cc2a06cf91f-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj124 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj124 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj124 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj124 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:x6LpgwhzZdEx4eqaQZCywjYwM74= 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:x6LpgwhzZdEx4eqaQZCywjYwM74='} 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d2b8bcf77225a85-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.252 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU= 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:he1FISv2eG3BCnv2a/pgH7q25BU=', 'Content-Length': '0'} 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005d4f2fedfe6c0b1a-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj155 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj155 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj155 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:14 GMT 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj155 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:6I3GJIiYsRIvha1F0p2vpQa+BGg= 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:14 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6I3GJIiYsRIvha1F0p2vpQa+BGg='} 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9d8ae8439f35daf-00657ce41a-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:14 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'kskgfn-53', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket kskgfn-53 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.254 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: tenant: 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: bucket name: kskgfn-53 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: total entries: 30 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.255 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b3eb7728800cf0f2-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj37 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj37 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj37 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj37 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:t/vOr3tvyEzca8Izfcxze46BQEM= 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:t/vOr3tvyEzca8Izfcxze46BQEM='} 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b8e847d85003b58-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.258 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000357bdddb58562e1b-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj74 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj74 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj74 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj74 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:qAvf2PgJ+ShfqikwjatdEFztv0M= 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:qAvf2PgJ+ShfqikwjatdEFztv0M='} 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fdc1117225c07905-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ff8cd562efeb2fe1-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj111 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj111 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj111 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.262 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj111 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:NjLclbJ/znJzEPVVhjjSAlpCvNk= 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:NjLclbJ/znJzEPVVhjjSAlpCvNk='} 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc5e374ba98bb4f8-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d8c29c0a3e1e2b0-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj148 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj148 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj148 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj148 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:6B/8k3lPHhVLb9PH3ALcYzr/VDs= 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:6B/8k3lPHhVLb9PH3ALcYzr/VDs='} 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005fad40194fe2fc9b-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/ 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/ 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/ 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:HEAD 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.266 INFO:tasks.rgw_multisite_tests:/kskgfn-53/ 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s= 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:2hZm1b0WRDP/5Pxwj4cyrezx/0s=', 'Content-Length': '0'} 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a84f37693043792e-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-53/obj185 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-53/obj185 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-53/obj185 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:application/octet-stream 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:41:15 GMT 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:/kskgfn-53/obj185 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:REaFaJoI9lbiPiRpVTZVEI2PT7Y= 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Fri, 15 Dec 2023 23:41:15 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:REaFaJoI9lbiPiRpVTZVEI2PT7Y='} 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000df8a22d44dc37fc-00657ce41b-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Fri, 15 Dec 2023 23:41:15 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=kskgfn-53 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket kskgfn-53 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.268 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:15.441+0000 7f9d2f331800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:20.443+0000 7f9d2f331800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:25.447+0000 7f9d2f331800 1 bucket sync caught up with source: 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: local status: [, , , , , , 00000000002.142.6, , , , , , 00000000002.104.6, , , , , 00000000002.138.6, , , , , , , , , , , , , , , 00000000001.109.6, , , , 00000000001.141.6] 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: remote markers: [, , , , , , 00000000002.142.6, , , , , , 00000000002.104.6, , , , , 00000000002.138.6, , , , , , , , , , , , , , , 00000000001.109.6, , , , 00000000001.141.6] 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:41:25.447+0000 7f9d2f331800 0 bucket checkpoint complete 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone2 target=test-zone1 bucket=kskgfn-53 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'kskgfn-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket kskgfn-53 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:25.564+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:30.565+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.269 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:35.566+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:40.567+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:45.568+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:50.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:41:55.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:00.569+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:05.570+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:10.571+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:15.571+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:20.573+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:25.574+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:30.575+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:35.576+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:40.577+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:45.578+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:50.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: *** Caught signal (Segmentation fault) ** 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:53:08.271 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:53:08.272 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 0> 2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:53:08.273 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.274 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 0> 2023-12-15T23:42:55.097+0000 7f7d70c7a640 -1 *** Caught signal (Segmentation fault) ** 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: in thread 7f7d70c7a640 thread_name:data-sync 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: ceph version 19.0.0-202-ge787ab71 (e787ab71a54a65a1c318d8bb7b1e65f35409fcd9) reef (dev) 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7f7d94854db0] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7f7d948c1992] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 3: radosgw(+0xc70c1c) [0x55f05d026c1c] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 4: radosgw(+0x382372) [0x55f05c738372] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 5: radosgw(+0x8286f9) [0x55f05cbde6f9] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 6: radosgw(+0x9b3217) [0x55f05cd69217] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x125) [0x55f05c95ee65] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x489) [0x55f05c9608a9] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x55f05c96169d] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4dc) [0x55f05cd7bb2c] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 11: radosgw(+0x776be8) [0x55f05cb2cbe8] 2023-12-15T23:53:08.275 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x55f05cb2f103] 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7f7d9489f802] 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7f7d9483f450] 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stdout: INFO: 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi188.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:42:55.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:00.580+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:05.582+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~6s 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:10.583+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~12s 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:15.584+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~18s 2023-12-15T23:53:08.276 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:20.585+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~24s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:25.585+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:30.586+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~30s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:35.588+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~35s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:40.589+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~41s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:45.589+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~47s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi093.stdout: INFO: 2023-12-15T23:43:48.705+0000 7f8dc25ac640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:50.591+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~53s 2023-12-15T23:53:08.277 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:43:55.592+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~59s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:00.593+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:05.594+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~65s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:10.595+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~71s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:15.595+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~77s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:20.596+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~83s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:25.597+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~89s 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:30.598+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:35.599+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.278 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~95s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:40.600+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~100s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:45.601+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~106s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:50.601+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~112s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:44:55.602+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~118s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:00.603+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~124s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:05.604+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:10.605+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~130s 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:15.606+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.279 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~136s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:20.607+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~142s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:25.608+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~148s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:30.609+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~154s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:35.610+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:40.611+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~160s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:45.611+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~165s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:50.612+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~171s 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:45:55.612+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.280 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~177s 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:00.614+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~183s 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:05.615+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~189s 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:10.616+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:15.617+0000 7f90877af800 1 waiting to reach incremental sync.. 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~195s 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:20.618+0000 7f90877af800 -1 bucket checkpoint timed out waiting to reach incremental sync 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:20.618+0000 7f90877af800 0 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: 2023-12-15T23:46:20.618+0000 7f90877af800 -1 bucket sync checkpoint failed: (110) Connection timed out 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2023-12-15T23:53:08.281 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests:====================================================================== 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 1874, in test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 208, in zonegroup_meta_checkpoint 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 185, in zone_meta_checkpoint 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2023-12-15T23:53:08.282 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/../src/test/rgw/rgw_multi/tests.py", line 142, in meta_sync_status 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:AssertionError: 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/kskgfn-54/ 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/kskgfn-54/ 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /kskgfn-54/ 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi093.front.sepia.ceph.com:8000 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2023-12-15T23:53:08.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:PUT 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:Fri, 15 Dec 2023 23:46:20 GMT 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:/kskgfn-54/ 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:AWS RQ4G229IF2X1XV5EJM37:lGptbmDjuIU60uPUIQPYc+va1qs= 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Fri, 15 Dec 2023 23:46:20 GMT', 'Authorization': 'AWS RQ4G229IF2X1XV5EJM37:lGptbmDjuIU60uPUIQPYc+va1qs=', 'Content-Length': '0'} 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000929bf45baf21d6df-00657ce54c-4716-test-zone1'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Fri, 15 Dec 2023 23:46:20 GMT'), ('Connection', 'Keep-Alive')] 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=kskgfn-54 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.284 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stderr: INFO: No --period given, using current period=8bfcaea7-8c6a-42ca-968d-33484415a55a 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi093.stdout: INFO: [{"marker":"1_1702683980.662037_609.1","last_update":"2023-12-15T23:46:20.662037Z"},{"marker":"1_1702682778.606100_223.1","last_update":"2023-12-15T23:26:18.606100Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:20.851+0000 7ff7b4327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:20.852+0000 7ff7b4327800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:20Z"} 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:20Z"} 2023-12-15T23:53:08.285 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~201s 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:25.958+0000 7fb380211800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:25.959+0000 7fb380211800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:25Z"} 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:25Z"} 2023-12-15T23:53:08.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~207s 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:31.066+0000 7f226671f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:31.068+0000 7f226671f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:31Z"} 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:31Z"} 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.287 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~213s 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:36.171+0000 7f53c5b2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:36.173+0000 7f53c5b2b800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:36Z"} 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:36Z"} 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.288 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~219s 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:41.280+0000 7f7c9af2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:41.281+0000 7f7c9af2c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:41Z"} 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:41Z"} 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.289 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~225s 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:46.388+0000 7fbcc4b22800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:46.389+0000 7fbcc4b22800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:46Z"} 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:46Z"} 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.290 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:51.496+0000 7f8a87e0f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:51.497+0000 7f8a87e0f800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:51Z"} 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:51Z"} 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~230s 2023-12-15T23:53:08.291 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:56.605+0000 7f5eeb122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:46:56.606+0000 7f5eeb122800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:56Z"} 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:46:56Z"} 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~236s 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.292 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:01.715+0000 7fa109b32800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:01.716+0000 7fa109b32800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:01Z"} 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:01Z"} 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~242s 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.293 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:06.823+0000 7f53db511800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:06.825+0000 7f53db511800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:06Z"} 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:06Z"} 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~248s 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:11.933+0000 7fc82e810800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:11.935+0000 7fc82e810800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:11Z"} 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:11Z"} 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~254s 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:17.043+0000 7fcd5a526800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:17.044+0000 7fcd5a526800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:17Z"} 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:17Z"} 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~260s 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:22.148+0000 7f1fb0332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:22.150+0000 7f1fb0332800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:22Z"} 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:22Z"} 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~266s 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:27.254+0000 7fc7c3933800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:27.256+0000 7fc7c3933800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:27Z"} 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:27Z"} 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:32.362+0000 7fa0d7f28800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:32.363+0000 7fa0d7f28800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:32Z"} 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:32Z"} 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~272s 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:37.470+0000 7f6b1752c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.299 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:37.471+0000 7f6b1752c800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:37Z"} 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:37Z"} 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~278s 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:42.578+0000 7f5e2f0c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:42.580+0000 7f5e2f0c0800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:42Z"} 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:42Z"} 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~284s 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:47.687+0000 7f4282928800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:47.689+0000 7f4282928800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:47Z"} 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:47Z"} 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~289s 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:52.795+0000 7fc2f4126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:52.797+0000 7fc2f4126800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:52Z"} 2023-12-15T23:53:08.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:52Z"} 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~295s 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:57.902+0000 7fcfa5531800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:47:57.903+0000 7fcfa5531800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:57Z"} 2023-12-15T23:53:08.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:47:57Z"} 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~301s 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: BARK! unmounting mounts and killing all daemons 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:48:03.009+0000 7ff43e331800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:48:03.011+0000 7ff43e331800 20 RGW-SYNC:meta: read sync status 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:48:03Z"} 2023-12-15T23:53:08.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"8bfcaea7-8c6a-42ca-968d-33484415a55a","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1702683675.143837_521.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2023-12-15T23:41:15.143837Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1702682778.606100_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2023-12-15T23:26:18.606100Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2023-12-15T23:48:03Z"} 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1702683675.143837_521.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2023-12-15T23:41:15.143837Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1702682778.606100_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2023-12-15T23:26:18.606100Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1702683980.662037_609.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1702683675.143837_521.1', 1: '1_1702682778.606100_223.1', 2: '', 3: ''} 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=0 master=1_1702683980.662037_609.1 target=1_1702683675.143837_521.1 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mgr.x: INFO: Sent signal 15 2023-12-15T23:53:08.305 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fd087edc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 3 (PID: 83634) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fd087edc640 -1 osd.3 55 *** Got signal Terminated *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fd087edc640 -1 osd.3 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 83708) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 osd.0 55 *** Got signal Terminated *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f8c7daac640 -1 osd.0 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 4 (PID: 83636) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 osd.4 55 *** Got signal Terminated *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fe1e5eb5640 -1 osd.4 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 83710) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 osd.1 55 *** Got signal Terminated *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7fb458d1e640 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7f758913c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 5 (PID: 83638) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7f758913c640 -1 osd.5 55 *** Got signal Terminated *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi192.stderr: INFO: 2023-12-15T23:48:03.558+0000 7f758913c640 -1 osd.5 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f1dad340640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 83712) UID: 0 2023-12-15T23:53:08.306 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f1dad340640 -1 osd.2 55 *** Got signal Terminated *** 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi188.stderr: INFO: 2023-12-15T23:48:03.557+0000 7f1dad340640 -1 osd.2 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1.smithi192.stdout: INFO: 2023-12-15T23:48:03.558+0000 7f36739df640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 87030) UID: 0 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1.smithi192.stdout: INFO: 2023-12-15T23:48:03.558+0000 7f367723e880 -1 shutting down 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a.smithi188.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fea165fe640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 83523) UID: 0 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a.smithi188.stderr: INFO: 2023-12-15T23:48:03.558+0000 7fea165fe640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setuser ceph since I am not root 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: ignoring --setgroup ceph since I am not root 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: 2023-12-15T23:53:08.087+0000 7ff0cbd2c800 0 monclient(hunting): authenticate timed out after 300 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi188.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2023-12-15T23:53:08.307 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2023-12-15T23:53:08.308 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.308 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2023-12-15T23:53:08.308 INFO:tasks.rgw_multisite_tests:Ran 39 tests in 3545.095s 2023-12-15T23:53:08.308 INFO:tasks.rgw_multisite_tests: 2023-12-15T23:53:08.308 INFO:tasks.rgw_multisite_tests:FAILED (SKIP=2, errors=1, failures=3) 2023-12-15T23:53:08.309 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw_multisite_tests.py", line 95, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2023-12-15T23:53:08.419 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8067ac8a33f64ef5afba66075054b485 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw_multisite_tests.py", line 95, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2023-12-15T23:53:08.420 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite-tests 2023-12-15T23:53:08.429 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite 2023-12-15T23:53:08.446 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-12-15T23:53:08.455 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2023-12-15T23:53:08.455 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:53:08.467 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:53:08.455+0000 7f8de0de9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 89766) UID: 0 2023-12-15T23:53:08.467 INFO:tasks.rgw.c1.client.0.smithi093.stdout:2023-12-15T23:53:08.455+0000 7f8de4648880 -1 shutting down 2023-12-15T23:53:11.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2023-12-15T23:53:14.557 INFO:tasks.rgw.c1.client.0:Stopped 2023-12-15T23:53:14.557 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock 2023-12-15T23:53:14.576 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f /etc/ceph/vault-root-token 2023-12-15T23:53:14.650 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['gc', 'process', '--include-all'] 2023-12-15T23:53:14.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2023-12-15T23:53:14.651 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 gc process --include-all 2023-12-15T23:53:14.735 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:53:14.735 INFO:teuthology.orchestra.run.smithi093.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:53:14.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.746+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.747+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:14.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.747+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.748+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:14.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.748+0000 7f3231d3e800 20 realm test-realm 60dac693-64f5-45c2-a83a-5740fda91d5c 2023-12-15T23:53:14.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.748+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.749+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:14.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.749+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.749+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=10 2023-12-15T23:53:14.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.749+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=1323 2023-12-15T23:53:14.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.750+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.751+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:14.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.751+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.751+0000 7f3231d3e800 20 rados_obj.operate() r=0 bl.length=1037 2023-12-15T23:53:14.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 zone test-zone1 found 2023-12-15T23:53:14.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 4 Realm: test-realm (60dac693-64f5-45c2-a83a-5740fda91d5c) 2023-12-15T23:53:14.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 4 ZoneGroup: test-zonegroup (test-zonegroup) 2023-12-15T23:53:14.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 4 Zone: test-zone1 (85829102-5436-4ffc-bbf4-ae2b811bdc9c) 2023-12-15T23:53:14.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 4 using period configuration: 8bfcaea7-8c6a-42ca-968d-33484415a55a:10 2023-12-15T23:53:14.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 period zonegroup name test-zonegroup 2023-12-15T23:53:14.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 using current period zonegroup test-zonegroup 2023-12-15T23:53:14.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:14.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:14.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 init(): pipe_map (zone=160ba887-62cd-49c7-8578-f3cea1ced053 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2023-12-15T23:53:14.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:14.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:14.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:14.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.752+0000 7f3231d3e800 20 rados->read ofs=0 len=0 2023-12-15T23:53:14.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:14.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 init(): pipe_map (zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2023-12-15T23:53:14.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:14.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:14.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:14.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:14.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 started sync module instance, tier type = 2023-12-15T23:53:14.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 generating connection object for zone test-zone2 id 160ba887-62cd-49c7-8578-f3cea1ced053 2023-12-15T23:53:14.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.753+0000 7f3231d3e800 20 started zone id=85829102-5436-4ffc-bbf4-ae2b811bdc9c (name=test-zone1) with tier type = 2023-12-15T23:53:14.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=0 2023-12-15T23:53:14.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=1 2023-12-15T23:53:14.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=2 2023-12-15T23:53:14.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=3 2023-12-15T23:53:14.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=4 2023-12-15T23:53:14.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=5 2023-12-15T23:53:14.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.763+0000 7f3231d3e800 20 add_watcher() i=6 2023-12-15T23:53:14.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.764+0000 7f3231d3e800 20 add_watcher() i=7 2023-12-15T23:53:14.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.764+0000 7f3231d3e800 2 all 8 watchers are set, enabling cache 2023-12-15T23:53:14.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.767+0000 7f31f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T23:53:14.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.767+0000 7f3231d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T23:53:14.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.767+0000 7f3231d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T23:53:14.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.822+0000 7f31f27e4640 20 reqs_thread_entry: start 2023-12-15T23:53:14.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.822+0000 7f3231d3e800 20 init_complete bucket index max shards: 11 2023-12-15T23:53:14.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.822+0000 7f3231d3e800 20 Filter name: none 2023-12-15T23:53:14.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.822+0000 7f3163fff640 20 reqs_thread_entry: start 2023-12-15T23:53:14.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.822+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-15T23:53:14.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.823+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.824+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.824+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.825+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-15T23:53:14.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.827+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.828+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.828+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.830+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-15T23:53:14.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.831+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.832+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.832+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.833+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-15T23:53:14.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.834+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.835+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.835+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.836+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-15T23:53:14.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.838+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.839+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.839+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.840+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-15T23:53:14.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.842+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.842+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.843+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.844+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-15T23:53:14.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.846+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.846+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.847+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.848+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-15T23:53:14.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.851+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.852+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.852+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.854+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-15T23:53:14.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.856+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.856+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.857+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.858+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-15T23:53:14.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.859+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.859+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.860+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.861+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-15T23:53:14.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.862+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.862+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.863+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.863+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-15T23:53:14.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.865+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.865+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.865+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.866+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-15T23:53:14.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.868+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.869+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.869+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.870+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-15T23:53:14.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.871+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.872+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.872+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.873+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-15T23:53:14.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.875+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.876+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.876+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.878+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-15T23:53:14.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.879+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.879+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.879+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.881+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-15T23:53:14.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.882+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.882+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.883+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.884+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-15T23:53:14.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.885+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.885+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.886+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.887+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-15T23:53:14.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.888+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.888+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.889+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.889+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-15T23:53:14.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.891+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.891+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.891+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.893+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-15T23:53:14.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.895+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.895+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.895+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.896+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-15T23:53:14.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.899+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.899+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.899+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.900+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-15T23:53:14.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.902+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.902+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.902+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.903+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-15T23:53:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.905+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.905+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.905+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.907+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-15T23:53:14.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.909+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.909+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.909+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.910+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-15T23:53:14.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.911+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.912+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.912+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.913+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-15T23:53:14.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.914+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.914+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.914+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.915+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-15T23:53:14.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.917+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.917+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.918+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.919+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-15T23:53:14.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.920+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.921+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.921+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.922+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-15T23:53:14.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.924+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.924+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.925+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.926+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-15T23:53:14.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.927+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.928+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.928+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.929+0000 7f3231d3e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-15T23:53:14.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.930+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.931+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:14.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.931+0000 7f3231d3e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:14.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.933+0000 7f31f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T23:53:14.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.936+0000 7f3231d3e800 20 remove_watcher() i=0 2023-12-15T23:53:14.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.936+0000 7f3231d3e800 2 removed watcher, disabling cache 2023-12-15T23:53:14.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.937+0000 7f3231d3e800 20 remove_watcher() i=1 2023-12-15T23:53:14.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.938+0000 7f3231d3e800 20 remove_watcher() i=2 2023-12-15T23:53:14.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.939+0000 7f3231d3e800 20 remove_watcher() i=3 2023-12-15T23:53:14.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.940+0000 7f3231d3e800 20 remove_watcher() i=4 2023-12-15T23:53:14.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.941+0000 7f3231d3e800 20 remove_watcher() i=5 2023-12-15T23:53:14.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.943+0000 7f3231d3e800 20 remove_watcher() i=6 2023-12-15T23:53:14.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-15T23:53:14.944+0000 7f3231d3e800 20 remove_watcher() i=7 2023-12-15T23:53:14.948 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2023-12-15T23:53:14.949 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:53:14.950 INFO:tasks.rgw.c1.client.1.smithi183.stdout:2023-12-15T23:53:14.949+0000 7fe15732f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 87180) UID: 0 2023-12-15T23:53:14.950 INFO:tasks.rgw.c1.client.1.smithi183.stdout:2023-12-15T23:53:14.950+0000 7fe15ab8e880 -1 shutting down 2023-12-15T23:53:17.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 is failed for ~0s 2023-12-15T23:53:17.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2023-12-15T23:53:21.050 INFO:tasks.rgw.c1.client.1:Stopped 2023-12-15T23:53:21.051 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock 2023-12-15T23:53:21.069 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/vault-root-token 2023-12-15T23:53:21.141 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['gc', 'process', '--include-all'] 2023-12-15T23:53:21.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2023-12-15T23:53:21.141 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 gc process --include-all 2023-12-15T23:53:21.227 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:53:21.228 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:53:21.241 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.241+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.242 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.242+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:21.242 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.242+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.243 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.243+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:21.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.243+0000 7f5348bad800 20 realm test-realm 60dac693-64f5-45c2-a83a-5740fda91d5c 2023-12-15T23:53:21.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.243+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.243+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:21.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.243+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.244+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=10 2023-12-15T23:53:21.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.244+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.244+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=1323 2023-12-15T23:53:21.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.244+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:21.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=110 2023-12-15T23:53:21.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.248 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.245+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 rados_obj.operate() r=0 bl.length=1037 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 zone test-zone1 found 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 4 Realm: test-realm (60dac693-64f5-45c2-a83a-5740fda91d5c) 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 4 ZoneGroup: test-zonegroup (test-zonegroup) 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 4 Zone: test-zone1 (85829102-5436-4ffc-bbf4-ae2b811bdc9c) 2023-12-15T23:53:21.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 4 using period configuration: 8bfcaea7-8c6a-42ca-968d-33484415a55a:10 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 period zonegroup name test-zonegroup 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 using current period zonegroup test-zonegroup 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.246+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 init(): pipe_map (zone=160ba887-62cd-49c7-8578-f3cea1ced053 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2023-12-15T23:53:21.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 rados->read ofs=0 len=0 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 init(): pipe_map (zone=85829102-5436-4ffc-bbf4-ae2b811bdc9c bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2023-12-15T23:53:21.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0},d={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0}} 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=85829102-5436-4ffc-bbf4-ae2b811bdc9c,az=0},d={b=*,z=160ba887-62cd-49c7-8578-f3cea1ced053,az=0}} 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 started sync module instance, tier type = 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 generating connection object for zone test-zone2 id 160ba887-62cd-49c7-8578-f3cea1ced053 2023-12-15T23:53:21.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.247+0000 7f5348bad800 20 started zone id=85829102-5436-4ffc-bbf4-ae2b811bdc9c (name=test-zone1) with tier type = 2023-12-15T23:53:21.258 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=0 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=1 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=2 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=3 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=4 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=5 2023-12-15T23:53:21.259 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.258+0000 7f5348bad800 20 add_watcher() i=6 2023-12-15T23:53:21.260 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.259+0000 7f5348bad800 20 add_watcher() i=7 2023-12-15T23:53:21.260 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.259+0000 7f5348bad800 2 all 8 watchers are set, enabling cache 2023-12-15T23:53:21.262 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.262+0000 7f53077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T23:53:21.262 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.262+0000 7f5348bad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-15T23:53:21.262 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.262+0000 7f5348bad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-15T23:53:21.316 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.315+0000 7f53067fc640 20 reqs_thread_entry: start 2023-12-15T23:53:21.316 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.315+0000 7f5348bad800 20 init_complete bucket index max shards: 11 2023-12-15T23:53:21.316 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.315+0000 7f5348bad800 20 Filter name: none 2023-12-15T23:53:21.316 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.315+0000 7f5277fff640 20 reqs_thread_entry: start 2023-12-15T23:53:21.317 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.315+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-15T23:53:21.317 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.317+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.318 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.317+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.318 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.317+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.319 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.318+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-15T23:53:21.320 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.320+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.321 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.320+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.321 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.321+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.322 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.322+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-15T23:53:21.323 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.323+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.324 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.323+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.324 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.323+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.324+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-15T23:53:21.327 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.326+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.327 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.327+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.328 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.327+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.329 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.329+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-15T23:53:21.331 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.330+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.331 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.331+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.332 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.331+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.332+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-15T23:53:21.335 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.335+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.335 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.335+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.336 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.335+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.338 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.337+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-15T23:53:21.339 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.339+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.340 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.339+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.340 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.340+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.341 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.341+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-15T23:53:21.343 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.343+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.344 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.344+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.344 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.344+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.345+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-15T23:53:21.347 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.347+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.347 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.347+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.348 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.347+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.348 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.348+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-15T23:53:21.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.349+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.350+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.350+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.351+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-15T23:53:21.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.352+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.353 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.352+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.353 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.353+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.354 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.354+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-15T23:53:21.356 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.356+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.356 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.356+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.357 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.356+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.358 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.358+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-15T23:53:21.360 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.359+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.360 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.360+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.360 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.360+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.361 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.361+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-15T23:53:21.363 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.362+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.363 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.363+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.363 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.363+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.364 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.364+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-15T23:53:21.366 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.365+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.366 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.366+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.366 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.366+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.367 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.367+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-15T23:53:21.368 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.368+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.369 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.369+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.369 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.369+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.370 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.370+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-15T23:53:21.372 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.371+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.372 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.372+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.372 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.372+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.373 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.373+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-15T23:53:21.374 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.374+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.375 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.375+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.375 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.375+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.377 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.376+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-15T23:53:21.378 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.378+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.378+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.379+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.380 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.380+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-15T23:53:21.381 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.381+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.381+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.382+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.383 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.383+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-15T23:53:21.384 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.384+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.385 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.384+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.385 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.384+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.385 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.385+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-15T23:53:21.386 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.386+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.387+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.387+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.388+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-15T23:53:21.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.389+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.390+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.390+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.391 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.391+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-15T23:53:21.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.392+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.393+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.393+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.394+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-15T23:53:21.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.396+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.396+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.396+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.398+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-15T23:53:21.400 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.399+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.400 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.400+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.400 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.400+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.401+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-15T23:53:21.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.403+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.403+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.403+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.404+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-15T23:53:21.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.406+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.407+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.407+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.409+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-15T23:53:21.410 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.410+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.410+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.411+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.412+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-15T23:53:21.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.413+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.413+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.414+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.415+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-15T23:53:21.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.416+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.416+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.417 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.416+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.417 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.417+0000 7f5348bad800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-15T23:53:21.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.419+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.419+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-15T23:53:21.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.419+0000 7f5348bad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-15T23:53:21.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.421+0000 7f53077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-15T23:53:21.423 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.423+0000 7f5348bad800 20 remove_watcher() i=0 2023-12-15T23:53:21.424 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.423+0000 7f5348bad800 2 removed watcher, disabling cache 2023-12-15T23:53:21.425 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.425+0000 7f5348bad800 20 remove_watcher() i=1 2023-12-15T23:53:21.426 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.426+0000 7f5348bad800 20 remove_watcher() i=2 2023-12-15T23:53:21.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.427+0000 7f5348bad800 20 remove_watcher() i=3 2023-12-15T23:53:21.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.428+0000 7f5348bad800 20 remove_watcher() i=4 2023-12-15T23:53:21.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.429+0000 7f5348bad800 20 remove_watcher() i=5 2023-12-15T23:53:21.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.430+0000 7f5348bad800 20 remove_watcher() i=6 2023-12-15T23:53:21.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-12-15T23:53:21.431+0000 7f5348bad800 20 remove_watcher() i=7 2023-12-15T23:53:21.436 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2023-12-15T23:53:21.436 INFO:teuthology.orchestra.run:waiting for 300 2023-12-15T23:53:21.436 INFO:tasks.rgw.c2.client.0:Stopped 2023-12-15T23:53:21.436 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock 2023-12-15T23:53:21.454 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/vault-root-token 2023-12-15T23:53:21.527 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['gc', 'process', '--include-all'] 2023-12-15T23:53:21.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'gc', 'process', '--include-all'] 2023-12-15T23:53:21.528 DEBUG:teuthology.orchestra.run.smithi188:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all 2023-12-15T23:53:21.615 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setuser ceph since I am not root 2023-12-15T23:53:21.615 INFO:teuthology.orchestra.run.smithi188.stderr:ignoring --setgroup ceph since I am not root 2023-12-15T23:53:23.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 has been restored 2023-12-15T23:58:21.617 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-15T23:58:21.616+0000 7f914232e800 0 monclient(hunting): authenticate timed out after 300 2023-12-15T23:58:21.618 INFO:teuthology.orchestra.run.smithi188.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-15T23:58:21.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-15T23:58:21.621 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2023-12-15T23:58:21.633 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-15T23:58:21.647 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2023-12-15T23:58:21.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2023-12-16T00:00:21.698 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-16T00:00:21.699 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json' 2023-12-16T00:00:21.725 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T00:00:21.725 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T00:00:21.725 DEBUG:tasks.ceph.c2.osd.0:waiting for process to exit 2023-12-16T00:00:21.725 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.731 INFO:tasks.ceph.c2.osd.0:Stopped 2023-12-16T00:00:21.731 DEBUG:tasks.ceph.c2.osd.1:waiting for process to exit 2023-12-16T00:00:21.731 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.731 INFO:tasks.ceph.c2.osd.1:Stopped 2023-12-16T00:00:21.732 DEBUG:tasks.ceph.c2.osd.2:waiting for process to exit 2023-12-16T00:00:21.732 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.732 INFO:tasks.ceph.c2.osd.2:Stopped 2023-12-16T00:00:21.732 DEBUG:tasks.ceph.c2.osd.3:waiting for process to exit 2023-12-16T00:00:21.732 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.732 INFO:tasks.ceph.c2.osd.3:Stopped 2023-12-16T00:00:21.733 DEBUG:tasks.ceph.c2.osd.4:waiting for process to exit 2023-12-16T00:00:21.733 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.733 INFO:tasks.ceph.c2.osd.4:Stopped 2023-12-16T00:00:21.733 DEBUG:tasks.ceph.c2.osd.5:waiting for process to exit 2023-12-16T00:00:21.733 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.734 INFO:tasks.ceph.c2.osd.5:Stopped 2023-12-16T00:00:21.734 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T00:00:21.734 DEBUG:tasks.ceph.c2.mgr.x:waiting for process to exit 2023-12-16T00:00:21.734 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.734 INFO:tasks.ceph.c2.mgr.x:Stopped 2023-12-16T00:00:21.735 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T00:00:21.735 DEBUG:tasks.ceph.c2.mon.a:waiting for process to exit 2023-12-16T00:00:21.735 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:00:21.735 INFO:tasks.ceph.c2.mon.a:Stopped 2023-12-16T00:00:21.735 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T00:00:21.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2023-12-16T00:00:21.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-0 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-16T00:00:21.894 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/c2-0 2023-12-16T00:00:21.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-1 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-16T00:00:21.978 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/c2-1 2023-12-16T00:00:22.126 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-2 on ubuntu@smithi188.front.sepia.ceph.com 2023-12-16T00:00:22.127 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/c2-2 2023-12-16T00:00:22.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-3 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-16T00:00:22.324 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/c2-3 2023-12-16T00:00:22.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-4 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-16T00:00:22.485 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/c2-4 2023-12-16T00:00:22.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-5 on ubuntu@smithi192.front.sepia.ceph.com 2023-12-16T00:00:22.568 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/c2-5 2023-12-16T00:00:22.688 INFO:tasks.ceph:Archiving mon data... 2023-12-16T00:00:22.689 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/c2-a to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/data/c2.mon.a.tgz 2023-12-16T00:00:22.690 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-12-16T00:00:22.707 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.xvaBvyPLcn 2023-12-16T00:00:22.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/c2-a -- . > /tmp/tmp.xvaBvyPLcn 2023-12-16T00:00:22.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.xvaBvyPLcn 2023-12-16T00:00:22.971 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.xvaBvyPLcn is 323KB 2023-12-16T00:00:23.071 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.xvaBvyPLcn 2023-12-16T00:00:23.086 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T00:00:23.086 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:00:23.090 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:00:23.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:00:23.128 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:00:23.159 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json' 2023-12-16T00:00:23.166 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-16T00:00:23.181 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2023-12-16T00:00:23.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:00:23.512 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:23.534 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:00:23.538 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2097,"stamp":"2023-12-16T00:00:22.169801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34355,"ondisk_log_size":34355,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":269080,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":259190,"kb_avail":628876520,"statfs":{"total":644245094400,"available":643969556480,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":265411233},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005288"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561765+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-15T23:56:15.561765+0000","last_peered":"2023-12-15T23:56:15.561765+0000","last_clean":"2023-12-15T23:56:15.561765+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-15T23:56:15.561765+0000","last_undegraded":"2023-12-15T23:56:15.561765+0000","last_fullsized":"2023-12-15T23:56:15.561765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359557+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:57:30.359557+0000","last_peered":"2023-12-15T23:57:30.359557+0000","last_clean":"2023-12-15T23:57:30.359557+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:57:30.359557+0000","last_undegraded":"2023-12-15T23:57:30.359557+0000","last_fullsized":"2023-12-15T23:57:30.359557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328209+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-15T23:55:25.328209+0000","last_peered":"2023-12-15T23:55:25.328209+0000","last_clean":"2023-12-15T23:55:25.328209+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-15T23:55:25.328209+0000","last_undegraded":"2023-12-15T23:55:25.328209+0000","last_fullsized":"2023-12-15T23:55:25.328209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:16:04.440737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340462+0000","last_change":"2023-12-15T22:53:26.165400+0000","last_active":"2023-12-15T23:56:15.340462+0000","last_peered":"2023-12-15T23:56:15.340462+0000","last_clean":"2023-12-15T23:56:15.340462+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-15T23:56:15.340462+0000","last_undegraded":"2023-12-15T23:56:15.340462+0000","last_fullsized":"2023-12-15T23:56:15.340462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581276+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:57:30.581276+0000","last_peered":"2023-12-15T23:57:30.581276+0000","last_clean":"2023-12-15T23:57:30.581276+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:57:30.581276+0000","last_undegraded":"2023-12-15T23:57:30.581276+0000","last_fullsized":"2023-12-15T23:57:30.581276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325398+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-15T23:55:25.325398+0000","last_peered":"2023-12-15T23:55:25.325398+0000","last_clean":"2023-12-15T23:55:25.325398+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-15T23:55:25.325398+0000","last_undegraded":"2023-12-15T23:55:25.325398+0000","last_fullsized":"2023-12-15T23:55:25.325398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335549+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:56:31.335549+0000","last_peered":"2023-12-15T23:56:31.335549+0000","last_clean":"2023-12-15T23:56:31.335549+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:56:31.335549+0000","last_undegraded":"2023-12-15T23:56:31.335549+0000","last_fullsized":"2023-12-15T23:56:31.335549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:22.850613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583442+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:57:40.583442+0000","last_peered":"2023-12-15T23:57:40.583442+0000","last_clean":"2023-12-15T23:57:40.583442+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:57:40.583442+0000","last_undegraded":"2023-12-15T23:57:40.583442+0000","last_fullsized":"2023-12-15T23:57:40.583442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318703+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-15T23:55:26.318703+0000","last_peered":"2023-12-15T23:55:26.318703+0000","last_clean":"2023-12-15T23:55:26.318703+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-15T23:55:26.318703+0000","last_undegraded":"2023-12-15T23:55:26.318703+0000","last_fullsized":"2023-12-15T23:55:26.318703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:34.568365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561835+0000","last_change":"2023-12-15T22:53:26.155908+0000","last_active":"2023-12-15T23:56:15.561835+0000","last_peered":"2023-12-15T23:56:15.561835+0000","last_clean":"2023-12-15T23:56:15.561835+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-15T23:56:15.561835+0000","last_undegraded":"2023-12-15T23:56:15.561835+0000","last_fullsized":"2023-12-15T23:56:15.561835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354290+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:57:10.354290+0000","last_peered":"2023-12-15T23:57:10.354290+0000","last_clean":"2023-12-15T23:57:10.354290+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:57:10.354290+0000","last_undegraded":"2023-12-15T23:57:10.354290+0000","last_fullsized":"2023-12-15T23:57:10.354290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328460+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-15T23:55:25.328460+0000","last_peered":"2023-12-15T23:55:25.328460+0000","last_clean":"2023-12-15T23:55:25.328460+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-15T23:55:25.328460+0000","last_undegraded":"2023-12-15T23:55:25.328460+0000","last_fullsized":"2023-12-15T23:55:25.328460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334057+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-15T23:56:26.334057+0000","last_peered":"2023-12-15T23:56:26.334057+0000","last_clean":"2023-12-15T23:56:26.334057+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-15T23:56:26.334057+0000","last_undegraded":"2023-12-15T23:56:26.334057+0000","last_fullsized":"2023-12-15T23:56:26.334057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:32.140453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325615+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-15T23:55:25.325615+0000","last_peered":"2023-12-15T23:55:25.325615+0000","last_clean":"2023-12-15T23:55:25.325615+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-15T23:55:25.325615+0000","last_undegraded":"2023-12-15T23:55:25.325615+0000","last_fullsized":"2023-12-15T23:55:25.325615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354303+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:57:10.354303+0000","last_peered":"2023-12-15T23:57:10.354303+0000","last_clean":"2023-12-15T23:57:10.354303+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:57:10.354303+0000","last_undegraded":"2023-12-15T23:57:10.354303+0000","last_fullsized":"2023-12-15T23:57:10.354303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'5","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343007+0000","last_change":"2023-12-15T22:53:26.162283+0000","last_active":"2023-12-15T23:56:25.343007+0000","last_peered":"2023-12-15T23:56:25.343007+0000","last_clean":"2023-12-15T23:56:25.343007+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-15T23:56:25.343007+0000","last_undegraded":"2023-12-15T23:56:25.343007+0000","last_fullsized":"2023-12-15T23:56:25.343007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328352+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-15T23:55:25.328352+0000","last_peered":"2023-12-15T23:55:25.328352+0000","last_clean":"2023-12-15T23:55:25.328352+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-15T23:55:25.328352+0000","last_undegraded":"2023-12-15T23:55:25.328352+0000","last_fullsized":"2023-12-15T23:55:25.328352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350353+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:57:31.350353+0000","last_peered":"2023-12-15T23:57:31.350353+0000","last_clean":"2023-12-15T23:57:31.350353+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:57:31.350353+0000","last_undegraded":"2023-12-15T23:57:31.350353+0000","last_fullsized":"2023-12-15T23:57:31.350353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'8","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339456+0000","last_change":"2023-12-15T22:53:26.156995+0000","last_active":"2023-12-15T23:56:15.339456+0000","last_peered":"2023-12-15T23:56:15.339456+0000","last_clean":"2023-12-15T23:56:15.339456+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-15T23:56:15.339456+0000","last_undegraded":"2023-12-15T23:56:15.339456+0000","last_fullsized":"2023-12-15T23:56:15.339456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:02.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325358+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-15T23:55:25.325358+0000","last_peered":"2023-12-15T23:55:25.325358+0000","last_clean":"2023-12-15T23:55:25.325358+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-15T23:55:25.325358+0000","last_undegraded":"2023-12-15T23:55:25.325358+0000","last_fullsized":"2023-12-15T23:55:25.325358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359263+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:57:30.359263+0000","last_peered":"2023-12-15T23:57:30.359263+0000","last_clean":"2023-12-15T23:57:30.359263+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:57:30.359263+0000","last_undegraded":"2023-12-15T23:57:30.359263+0000","last_fullsized":"2023-12-15T23:57:30.359263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337739+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:56:41.337739+0000","last_peered":"2023-12-15T23:56:41.337739+0000","last_clean":"2023-12-15T23:56:41.337739+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:56:41.337739+0000","last_undegraded":"2023-12-15T23:56:41.337739+0000","last_fullsized":"2023-12-15T23:56:41.337739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:05.670759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322111+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-15T23:55:25.322111+0000","last_peered":"2023-12-15T23:55:25.322111+0000","last_clean":"2023-12-15T23:55:25.322111+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-15T23:55:25.322111+0000","last_undegraded":"2023-12-15T23:55:25.322111+0000","last_fullsized":"2023-12-15T23:55:25.322111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:38.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351612+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:57:30.351612+0000","last_peered":"2023-12-15T23:57:30.351612+0000","last_clean":"2023-12-15T23:57:30.351612+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:57:30.351612+0000","last_undegraded":"2023-12-15T23:57:30.351612+0000","last_fullsized":"2023-12-15T23:57:30.351612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:11.503638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'10","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366685+0000","last_change":"2023-12-15T22:53:26.164117+0000","last_active":"2023-12-15T23:58:00.366685+0000","last_peered":"2023-12-15T23:58:00.366685+0000","last_clean":"2023-12-15T23:58:00.366685+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-15T23:58:00.366685+0000","last_undegraded":"2023-12-15T23:58:00.366685+0000","last_fullsized":"2023-12-15T23:58:00.366685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:38.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326264+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-15T23:55:56.326264+0000","last_peered":"2023-12-15T23:55:56.326264+0000","last_clean":"2023-12-15T23:55:56.326264+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-15T23:55:56.326264+0000","last_undegraded":"2023-12-15T23:55:56.326264+0000","last_fullsized":"2023-12-15T23:55:56.326264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:07.802909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559391+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-15T23:56:05.559391+0000","last_peered":"2023-12-15T23:56:05.559391+0000","last_clean":"2023-12-15T23:56:05.559391+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-15T23:56:05.559391+0000","last_undegraded":"2023-12-15T23:56:05.559391+0000","last_fullsized":"2023-12-15T23:56:05.559391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:37.299376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'10","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361963+0000","last_change":"2023-12-15T22:53:26.161032+0000","last_active":"2023-12-15T23:57:40.361963+0000","last_peered":"2023-12-15T23:57:40.361963+0000","last_clean":"2023-12-15T23:57:40.361963+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-15T23:57:40.361963+0000","last_undegraded":"2023-12-15T23:57:40.361963+0000","last_fullsized":"2023-12-15T23:57:40.361963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:26.370938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335545+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-15T23:55:55.335545+0000","last_peered":"2023-12-15T23:55:55.335545+0000","last_clean":"2023-12-15T23:55:55.335545+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-15T23:55:55.335545+0000","last_undegraded":"2023-12-15T23:55:55.335545+0000","last_fullsized":"2023-12-15T23:55:55.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331592+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-15T23:55:45.331592+0000","last_peered":"2023-12-15T23:55:45.331592+0000","last_clean":"2023-12-15T23:55:45.331592+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-15T23:55:45.331592+0000","last_undegraded":"2023-12-15T23:55:45.331592+0000","last_fullsized":"2023-12-15T23:55:45.331592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'28","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358304+0000","last_change":"2023-12-15T22:53:26.162543+0000","last_active":"2023-12-15T23:58:00.358304+0000","last_peered":"2023-12-15T23:58:00.358304+0000","last_clean":"2023-12-15T23:58:00.358304+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-15T23:58:00.358304+0000","last_undegraded":"2023-12-15T23:58:00.358304+0000","last_fullsized":"2023-12-15T23:58:00.358304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:06.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339086+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-15T23:56:10.339086+0000","last_peered":"2023-12-15T23:56:10.339086+0000","last_clean":"2023-12-15T23:56:10.339086+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-15T23:56:10.339086+0000","last_undegraded":"2023-12-15T23:56:10.339086+0000","last_fullsized":"2023-12-15T23:56:10.339086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333163+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-15T23:55:45.333163+0000","last_peered":"2023-12-15T23:55:45.333163+0000","last_clean":"2023-12-15T23:55:45.333163+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-15T23:55:45.333163+0000","last_undegraded":"2023-12-15T23:55:45.333163+0000","last_fullsized":"2023-12-15T23:55:45.333163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358223+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-15T23:58:00.358223+0000","last_peered":"2023-12-15T23:58:00.358223+0000","last_clean":"2023-12-15T23:58:00.358223+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-15T23:58:00.358223+0000","last_undegraded":"2023-12-15T23:58:00.358223+0000","last_fullsized":"2023-12-15T23:58:00.358223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:34.225706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326624+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-15T23:55:45.326624+0000","last_peered":"2023-12-15T23:55:45.326624+0000","last_clean":"2023-12-15T23:55:45.326624+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-15T23:55:45.326624+0000","last_undegraded":"2023-12-15T23:55:45.326624+0000","last_fullsized":"2023-12-15T23:55:45.326624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:09.630988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324219+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-15T23:55:46.324219+0000","last_peered":"2023-12-15T23:55:46.324219+0000","last_clean":"2023-12-15T23:55:46.324219+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-15T23:55:46.324219+0000","last_undegraded":"2023-12-15T23:55:46.324219+0000","last_fullsized":"2023-12-15T23:55:46.324219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334011+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-15T23:55:55.334011+0000","last_peered":"2023-12-15T23:55:55.334011+0000","last_clean":"2023-12-15T23:55:55.334011+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-15T23:55:55.334011+0000","last_undegraded":"2023-12-15T23:55:55.334011+0000","last_fullsized":"2023-12-15T23:55:55.334011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326697+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-15T23:55:45.326697+0000","last_peered":"2023-12-15T23:55:45.326697+0000","last_clean":"2023-12-15T23:55:45.326697+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-15T23:55:45.326697+0000","last_undegraded":"2023-12-15T23:55:45.326697+0000","last_fullsized":"2023-12-15T23:55:45.326697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:58.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333465+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-15T23:55:45.333465+0000","last_peered":"2023-12-15T23:55:45.333465+0000","last_clean":"2023-12-15T23:55:45.333465+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-15T23:55:45.333465+0000","last_undegraded":"2023-12-15T23:55:45.333465+0000","last_fullsized":"2023-12-15T23:55:45.333465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:03.096660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328420+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-15T23:55:55.328420+0000","last_peered":"2023-12-15T23:55:55.328420+0000","last_clean":"2023-12-15T23:55:55.328420+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-15T23:55:55.328420+0000","last_undegraded":"2023-12-15T23:55:55.328420+0000","last_fullsized":"2023-12-15T23:55:55.328420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:24.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324294+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-15T23:55:46.324294+0000","last_peered":"2023-12-15T23:55:46.324294+0000","last_clean":"2023-12-15T23:55:46.324294+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-15T23:55:46.324294+0000","last_undegraded":"2023-12-15T23:55:46.324294+0000","last_fullsized":"2023-12-15T23:55:46.324294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339461+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-15T23:56:10.339461+0000","last_peered":"2023-12-15T23:56:10.339461+0000","last_clean":"2023-12-15T23:56:10.339461+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-15T23:56:10.339461+0000","last_undegraded":"2023-12-15T23:56:10.339461+0000","last_fullsized":"2023-12-15T23:56:10.339461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566972+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-15T23:56:35.566972+0000","last_peered":"2023-12-15T23:56:35.566972+0000","last_clean":"2023-12-15T23:56:35.566972+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-15T23:56:35.566972+0000","last_undegraded":"2023-12-15T23:56:35.566972+0000","last_fullsized":"2023-12-15T23:56:35.566972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1693,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.372653+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-15T23:58:20.372653+0000","last_peered":"2023-12-15T23:58:20.372653+0000","last_clean":"2023-12-15T23:58:20.372653+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-15T23:58:20.372653+0000","last_undegraded":"2023-12-15T23:58:20.372653+0000","last_fullsized":"2023-12-15T23:58:20.372653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343290+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:56:30.343290+0000","last_peered":"2023-12-15T23:56:30.343290+0000","last_clean":"2023-12-15T23:56:30.343290+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:56:30.343290+0000","last_undegraded":"2023-12-15T23:56:30.343290+0000","last_fullsized":"2023-12-15T23:56:30.343290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360588+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-15T23:57:35.360588+0000","last_peered":"2023-12-15T23:57:35.360588+0000","last_clean":"2023-12-15T23:57:35.360588+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-15T23:57:35.360588+0000","last_undegraded":"2023-12-15T23:57:35.360588+0000","last_fullsized":"2023-12-15T23:57:35.360588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:45.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327893+0000","last_change":"2023-12-15T22:53:30.178391+0000","last_active":"2023-12-15T23:56:01.327893+0000","last_peered":"2023-12-15T23:56:01.327893+0000","last_clean":"2023-12-15T23:56:01.327893+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-15T23:56:01.327893+0000","last_undegraded":"2023-12-15T23:56:01.327893+0000","last_fullsized":"2023-12-15T23:56:01.327893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:53.334878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'309","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335674+0000","last_change":"2023-12-15T22:53:28.165506+0000","last_active":"2023-12-15T23:56:00.335674+0000","last_peered":"2023-12-15T23:56:00.335674+0000","last_clean":"2023-12-15T23:56:00.335674+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-15T23:56:00.335674+0000","last_undegraded":"2023-12-15T23:56:00.335674+0000","last_fullsized":"2023-12-15T23:56:00.335674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:40.852277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337214+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:56:30.337214+0000","last_peered":"2023-12-15T23:56:30.337214+0000","last_clean":"2023-12-15T23:56:30.337214+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:56:30.337214+0000","last_undegraded":"2023-12-15T23:56:30.337214+0000","last_fullsized":"2023-12-15T23:56:30.337214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:33.452389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327638+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-15T23:56:01.327638+0000","last_peered":"2023-12-15T23:56:01.327638+0000","last_clean":"2023-12-15T23:56:01.327638+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-15T23:56:01.327638+0000","last_undegraded":"2023-12-15T23:56:01.327638+0000","last_fullsized":"2023-12-15T23:56:01.327638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:24.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559157+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-15T23:56:05.559157+0000","last_peered":"2023-12-15T23:56:05.559157+0000","last_clean":"2023-12-15T23:56:05.559157+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-15T23:56:05.559157+0000","last_undegraded":"2023-12-15T23:56:05.559157+0000","last_fullsized":"2023-12-15T23:56:05.559157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334309+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-15T23:55:55.334309+0000","last_peered":"2023-12-15T23:55:55.334309+0000","last_clean":"2023-12-15T23:55:55.334309+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-15T23:55:55.334309+0000","last_undegraded":"2023-12-15T23:55:55.334309+0000","last_fullsized":"2023-12-15T23:55:55.334309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:30.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335875+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-15T23:55:55.335875+0000","last_peered":"2023-12-15T23:55:55.335875+0000","last_clean":"2023-12-15T23:55:55.335875+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-15T23:55:55.335875+0000","last_undegraded":"2023-12-15T23:55:55.335875+0000","last_fullsized":"2023-12-15T23:55:55.335875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337489+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-15T23:56:00.337489+0000","last_peered":"2023-12-15T23:56:00.337489+0000","last_clean":"2023-12-15T23:56:00.337489+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-15T23:56:00.337489+0000","last_undegraded":"2023-12-15T23:56:00.337489+0000","last_fullsized":"2023-12-15T23:56:00.337489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337350+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-15T23:56:00.337350+0000","last_peered":"2023-12-15T23:56:00.337350+0000","last_clean":"2023-12-15T23:56:00.337350+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-15T23:56:00.337350+0000","last_undegraded":"2023-12-15T23:56:00.337350+0000","last_fullsized":"2023-12-15T23:56:00.337350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:24.040020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.342184+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-15T23:56:50.342184+0000","last_peered":"2023-12-15T23:56:50.342184+0000","last_clean":"2023-12-15T23:56:50.342184+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-15T23:56:50.342184+0000","last_undegraded":"2023-12-15T23:56:50.342184+0000","last_fullsized":"2023-12-15T23:56:50.342184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:34.560913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346084+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-15T23:56:35.346084+0000","last_peered":"2023-12-15T23:56:35.346084+0000","last_clean":"2023-12-15T23:56:35.346084+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-15T23:56:35.346084+0000","last_undegraded":"2023-12-15T23:56:35.346084+0000","last_fullsized":"2023-12-15T23:56:35.346084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:31.974370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344321+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:56:30.344321+0000","last_peered":"2023-12-15T23:56:30.344321+0000","last_clean":"2023-12-15T23:56:30.344321+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:56:30.344321+0000","last_undegraded":"2023-12-15T23:56:30.344321+0000","last_fullsized":"2023-12-15T23:56:30.344321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:02:26.652903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.338524+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-15T23:56:05.338524+0000","last_peered":"2023-12-15T23:56:05.338524+0000","last_clean":"2023-12-15T23:56:05.338524+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-15T23:56:05.338524+0000","last_undegraded":"2023-12-15T23:56:05.338524+0000","last_fullsized":"2023-12-15T23:56:05.338524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":850,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336831+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-15T23:56:00.336831+0000","last_peered":"2023-12-15T23:56:00.336831+0000","last_clean":"2023-12-15T23:56:00.336831+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-15T23:56:00.336831+0000","last_undegraded":"2023-12-15T23:56:00.336831+0000","last_fullsized":"2023-12-15T23:56:00.336831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:16.093189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1989","reported_seq":3292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.330162+0000","last_change":"2023-12-15T22:53:28.164220+0000","last_active":"2023-12-15T23:56:00.330162+0000","last_peered":"2023-12-15T23:56:00.330162+0000","last_clean":"2023-12-15T23:56:00.330162+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-15T23:56:00.330162+0000","last_undegraded":"2023-12-15T23:56:00.330162+0000","last_fullsized":"2023-12-15T23:56:00.330162+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":200,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:24.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340087+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-15T23:56:15.340087+0000","last_peered":"2023-12-15T23:56:15.340087+0000","last_clean":"2023-12-15T23:56:15.340087+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-15T23:56:15.340087+0000","last_undegraded":"2023-12-15T23:56:15.340087+0000","last_fullsized":"2023-12-15T23:56:15.340087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340211+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-15T23:56:15.340211+0000","last_peered":"2023-12-15T23:56:15.340211+0000","last_clean":"2023-12-15T23:56:15.340211+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-15T23:56:15.340211+0000","last_undegraded":"2023-12-15T23:56:15.340211+0000","last_fullsized":"2023-12-15T23:56:15.340211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333143+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-15T23:55:45.333143+0000","last_peered":"2023-12-15T23:55:45.333143+0000","last_clean":"2023-12-15T23:55:45.333143+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-15T23:55:45.333143+0000","last_undegraded":"2023-12-15T23:55:45.333143+0000","last_fullsized":"2023-12-15T23:55:45.333143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558997+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-15T23:56:05.558997+0000","last_peered":"2023-12-15T23:56:05.558997+0000","last_clean":"2023-12-15T23:56:05.558997+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-15T23:56:05.558997+0000","last_undegraded":"2023-12-15T23:56:05.558997+0000","last_fullsized":"2023-12-15T23:56:05.558997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342197+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-15T23:56:20.342197+0000","last_peered":"2023-12-15T23:56:20.342197+0000","last_clean":"2023-12-15T23:56:20.342197+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-15T23:56:20.342197+0000","last_undegraded":"2023-12-15T23:56:20.342197+0000","last_fullsized":"2023-12-15T23:56:20.342197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326827+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-15T23:55:56.326827+0000","last_peered":"2023-12-15T23:55:56.326827+0000","last_clean":"2023-12-15T23:55:56.326827+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-15T23:55:56.326827+0000","last_undegraded":"2023-12-15T23:55:56.326827+0000","last_fullsized":"2023-12-15T23:55:56.326827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:33.627758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.328126+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-15T23:56:01.328126+0000","last_peered":"2023-12-15T23:56:01.328126+0000","last_clean":"2023-12-15T23:56:01.328126+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-15T23:56:01.328126+0000","last_undegraded":"2023-12-15T23:56:01.328126+0000","last_fullsized":"2023-12-15T23:56:01.328126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:42.868883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330495+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:56:11.330495+0000","last_peered":"2023-12-15T23:56:11.330495+0000","last_clean":"2023-12-15T23:56:11.330495+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:56:11.330495+0000","last_undegraded":"2023-12-15T23:56:11.330495+0000","last_fullsized":"2023-12-15T23:56:11.330495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345763+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:56:35.345763+0000","last_peered":"2023-12-15T23:56:35.345763+0000","last_clean":"2023-12-15T23:56:35.345763+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:56:35.345763+0000","last_undegraded":"2023-12-15T23:56:35.345763+0000","last_fullsized":"2023-12-15T23:56:35.345763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:05.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335521+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-15T23:56:31.335521+0000","last_peered":"2023-12-15T23:56:31.335521+0000","last_clean":"2023-12-15T23:56:31.335521+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-15T23:56:31.335521+0000","last_undegraded":"2023-12-15T23:56:31.335521+0000","last_fullsized":"2023-12-15T23:56:31.335521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.354044+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:57:46.354044+0000","last_peered":"2023-12-15T23:57:46.354044+0000","last_clean":"2023-12-15T23:57:46.354044+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:57:46.354044+0000","last_undegraded":"2023-12-15T23:57:46.354044+0000","last_fullsized":"2023-12-15T23:57:46.354044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:33.344075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345497+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:56:35.345497+0000","last_peered":"2023-12-15T23:56:35.345497+0000","last_clean":"2023-12-15T23:56:35.345497+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:56:35.345497+0000","last_undegraded":"2023-12-15T23:56:35.345497+0000","last_fullsized":"2023-12-15T23:56:35.345497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:52.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'201","reported_seq":429,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334656+0000","last_change":"2023-12-15T22:53:28.167522+0000","last_active":"2023-12-15T23:56:20.334656+0000","last_peered":"2023-12-15T23:56:20.334656+0000","last_clean":"2023-12-15T23:56:20.334656+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-15T23:56:20.334656+0000","last_undegraded":"2023-12-15T23:56:20.334656+0000","last_fullsized":"2023-12-15T23:56:20.334656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:57.781199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'5","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:53:26.162142+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332182+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-15T23:55:40.332182+0000","last_peered":"2023-12-15T23:55:40.332182+0000","last_clean":"2023-12-15T23:55:40.332182+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-15T23:55:40.332182+0000","last_undegraded":"2023-12-15T23:55:40.332182+0000","last_fullsized":"2023-12-15T23:55:40.332182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:14.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333796+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-15T23:55:45.333796+0000","last_peered":"2023-12-15T23:55:45.333796+0000","last_clean":"2023-12-15T23:55:45.333796+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-15T23:55:45.333796+0000","last_undegraded":"2023-12-15T23:55:45.333796+0000","last_fullsized":"2023-12-15T23:55:45.333796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334043+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-15T23:55:55.334043+0000","last_peered":"2023-12-15T23:55:55.334043+0000","last_clean":"2023-12-15T23:55:55.334043+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-15T23:55:55.334043+0000","last_undegraded":"2023-12-15T23:55:55.334043+0000","last_fullsized":"2023-12-15T23:55:55.334043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.329028+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-15T23:55:55.329028+0000","last_peered":"2023-12-15T23:55:55.329028+0000","last_clean":"2023-12-15T23:55:55.329028+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-15T23:55:55.329028+0000","last_undegraded":"2023-12-15T23:55:55.329028+0000","last_fullsized":"2023-12-15T23:55:55.329028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:00.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336144+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-15T23:56:25.336144+0000","last_peered":"2023-12-15T23:56:25.336144+0000","last_clean":"2023-12-15T23:56:25.336144+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-15T23:56:25.336144+0000","last_undegraded":"2023-12-15T23:56:25.336144+0000","last_fullsized":"2023-12-15T23:56:25.336144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:31.056179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":794,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335932+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-15T23:56:00.335932+0000","last_peered":"2023-12-15T23:56:00.335932+0000","last_clean":"2023-12-15T23:56:00.335932+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-15T23:56:00.335932+0000","last_undegraded":"2023-12-15T23:56:00.335932+0000","last_fullsized":"2023-12-15T23:56:00.335932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560472+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:56:10.560472+0000","last_peered":"2023-12-15T23:56:10.560472+0000","last_clean":"2023-12-15T23:56:10.560472+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:56:10.560472+0000","last_undegraded":"2023-12-15T23:56:10.560472+0000","last_fullsized":"2023-12-15T23:56:10.560472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345845+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:56:35.345845+0000","last_peered":"2023-12-15T23:56:35.345845+0000","last_clean":"2023-12-15T23:56:35.345845+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:56:35.345845+0000","last_undegraded":"2023-12-15T23:56:35.345845+0000","last_fullsized":"2023-12-15T23:56:35.345845+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:02.469293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:16.361776+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-15T23:58:16.361776+0000","last_peered":"2023-12-15T23:58:16.361776+0000","last_clean":"2023-12-15T23:58:16.361776+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-15T23:58:16.361776+0000","last_undegraded":"2023-12-15T23:58:16.361776+0000","last_fullsized":"2023-12-15T23:58:16.361776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:18.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370227+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-15T23:58:10.370227+0000","last_peered":"2023-12-15T23:58:10.370227+0000","last_clean":"2023-12-15T23:58:10.370227+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-15T23:58:10.370227+0000","last_undegraded":"2023-12-15T23:58:10.370227+0000","last_fullsized":"2023-12-15T23:58:10.370227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:26:44.954886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334633+0000","last_change":"2023-12-15T22:53:30.176318+0000","last_active":"2023-12-15T23:56:20.334633+0000","last_peered":"2023-12-15T23:56:20.334633+0000","last_clean":"2023-12-15T23:56:20.334633+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-15T23:56:20.334633+0000","last_undegraded":"2023-12-15T23:56:20.334633+0000","last_fullsized":"2023-12-15T23:56:20.334633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:13.030255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3261,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565177+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:56:30.565177+0000","last_peered":"2023-12-15T23:56:30.565177+0000","last_clean":"2023-12-15T23:56:30.565177+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:56:30.565177+0000","last_undegraded":"2023-12-15T23:56:30.565177+0000","last_fullsized":"2023-12-15T23:56:30.565177+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:36.870664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"49'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556660+0000","last_change":"2023-12-15T22:53:26.164024+0000","last_active":"2023-12-15T23:55:55.556660+0000","last_peered":"2023-12-15T23:55:55.556660+0000","last_clean":"2023-12-15T23:55:55.556660+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-15T23:55:55.556660+0000","last_undegraded":"2023-12-15T23:55:55.556660+0000","last_fullsized":"2023-12-15T23:55:55.556660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:41.322906+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-15T23:55:41.322906+0000","last_peered":"2023-12-15T23:55:41.322906+0000","last_clean":"2023-12-15T23:55:41.322906+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-15T23:55:41.322906+0000","last_undegraded":"2023-12-15T23:55:41.322906+0000","last_fullsized":"2023-12-15T23:55:41.322906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:47.568953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333892+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-15T23:55:45.333892+0000","last_peered":"2023-12-15T23:55:45.333892+0000","last_clean":"2023-12-15T23:55:45.333892+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-15T23:55:45.333892+0000","last_undegraded":"2023-12-15T23:55:45.333892+0000","last_fullsized":"2023-12-15T23:55:45.333892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335457+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-15T23:55:55.335457+0000","last_peered":"2023-12-15T23:55:55.335457+0000","last_clean":"2023-12-15T23:55:55.335457+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-15T23:55:55.335457+0000","last_undegraded":"2023-12-15T23:55:55.335457+0000","last_fullsized":"2023-12-15T23:55:55.335457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334772+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-15T23:55:55.334772+0000","last_peered":"2023-12-15T23:55:55.334772+0000","last_clean":"2023-12-15T23:55:55.334772+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-15T23:55:55.334772+0000","last_undegraded":"2023-12-15T23:55:55.334772+0000","last_fullsized":"2023-12-15T23:55:55.334772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:24.167330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335919+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-15T23:56:00.335919+0000","last_peered":"2023-12-15T23:56:00.335919+0000","last_clean":"2023-12-15T23:56:00.335919+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-15T23:56:00.335919+0000","last_undegraded":"2023-12-15T23:56:00.335919+0000","last_fullsized":"2023-12-15T23:56:00.335919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:13.618757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":795,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.562788+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-15T23:56:20.562788+0000","last_peered":"2023-12-15T23:56:20.562788+0000","last_clean":"2023-12-15T23:56:20.562788+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-15T23:56:20.562788+0000","last_undegraded":"2023-12-15T23:56:20.562788+0000","last_fullsized":"2023-12-15T23:56:20.562788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:39.943256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336566+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-15T23:56:36.336566+0000","last_peered":"2023-12-15T23:56:36.336566+0000","last_clean":"2023-12-15T23:56:36.336566+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-15T23:56:36.336566+0000","last_undegraded":"2023-12-15T23:56:36.336566+0000","last_fullsized":"2023-12-15T23:56:36.336566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:08.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1569,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344451+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-15T23:56:35.344451+0000","last_peered":"2023-12-15T23:56:35.344451+0000","last_clean":"2023-12-15T23:56:35.344451+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-15T23:56:35.344451+0000","last_undegraded":"2023-12-15T23:56:35.344451+0000","last_fullsized":"2023-12-15T23:56:35.344451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:15:15.009231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343006+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-15T23:56:30.343006+0000","last_peered":"2023-12-15T23:56:30.343006+0000","last_clean":"2023-12-15T23:56:30.343006+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-15T23:56:30.343006+0000","last_undegraded":"2023-12-15T23:56:30.343006+0000","last_fullsized":"2023-12-15T23:56:30.343006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353594+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:57:46.353594+0000","last_peered":"2023-12-15T23:57:46.353594+0000","last_clean":"2023-12-15T23:57:46.353594+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:57:46.353594+0000","last_undegraded":"2023-12-15T23:57:46.353594+0000","last_fullsized":"2023-12-15T23:57:46.353594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:32.398010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342201+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-15T23:56:20.342201+0000","last_peered":"2023-12-15T23:56:20.342201+0000","last_clean":"2023-12-15T23:56:20.342201+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-15T23:56:20.342201+0000","last_undegraded":"2023-12-15T23:56:20.342201+0000","last_fullsized":"2023-12-15T23:56:20.342201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:13.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'342","reported_seq":508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342111+0000","last_change":"2023-12-15T22:53:28.172209+0000","last_active":"2023-12-15T23:56:20.342111+0000","last_peered":"2023-12-15T23:56:20.342111+0000","last_clean":"2023-12-15T23:56:20.342111+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-15T23:56:20.342111+0000","last_undegraded":"2023-12-15T23:56:20.342111+0000","last_fullsized":"2023-12-15T23:56:20.342111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:40.476433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.371963+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-15T23:58:15.371963+0000","last_peered":"2023-12-15T23:58:15.371963+0000","last_clean":"2023-12-15T23:58:15.371963+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-15T23:58:15.371963+0000","last_undegraded":"2023-12-15T23:58:15.371963+0000","last_fullsized":"2023-12-15T23:58:15.371963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:21:22.340026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365463+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-15T23:57:55.365463+0000","last_peered":"2023-12-15T23:57:55.365463+0000","last_clean":"2023-12-15T23:57:55.365463+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-15T23:57:55.365463+0000","last_undegraded":"2023-12-15T23:57:55.365463+0000","last_fullsized":"2023-12-15T23:57:55.365463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339554+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-15T23:56:10.339554+0000","last_peered":"2023-12-15T23:56:10.339554+0000","last_clean":"2023-12-15T23:56:10.339554+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-15T23:56:10.339554+0000","last_undegraded":"2023-12-15T23:56:10.339554+0000","last_fullsized":"2023-12-15T23:56:10.339554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367610+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-15T23:58:05.367610+0000","last_peered":"2023-12-15T23:58:05.367610+0000","last_clean":"2023-12-15T23:58:05.367610+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-15T23:58:05.367610+0000","last_undegraded":"2023-12-15T23:58:05.367610+0000","last_fullsized":"2023-12-15T23:58:05.367610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:31.374833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":249,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340302+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-15T23:56:15.340302+0000","last_peered":"2023-12-15T23:56:15.340302+0000","last_clean":"2023-12-15T23:56:15.340302+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-15T23:56:15.340302+0000","last_undegraded":"2023-12-15T23:56:15.340302+0000","last_fullsized":"2023-12-15T23:56:15.340302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560374+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-15T23:56:10.560374+0000","last_peered":"2023-12-15T23:56:10.560374+0000","last_clean":"2023-12-15T23:56:10.560374+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-15T23:56:10.560374+0000","last_undegraded":"2023-12-15T23:56:10.560374+0000","last_fullsized":"2023-12-15T23:56:10.560374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:37.180934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362737+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:57:45.362737+0000","last_peered":"2023-12-15T23:57:45.362737+0000","last_clean":"2023-12-15T23:57:45.362737+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:57:45.362737+0000","last_undegraded":"2023-12-15T23:57:45.362737+0000","last_fullsized":"2023-12-15T23:57:45.362737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.338476+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-15T23:56:35.338476+0000","last_peered":"2023-12-15T23:56:35.338476+0000","last_clean":"2023-12-15T23:56:35.338476+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-15T23:56:35.338476+0000","last_undegraded":"2023-12-15T23:56:35.338476+0000","last_fullsized":"2023-12-15T23:56:35.338476+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:00:00.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3976,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345750+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-15T23:56:35.345750+0000","last_peered":"2023-12-15T23:56:35.345750+0000","last_clean":"2023-12-15T23:56:35.345750+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-15T23:56:35.345750+0000","last_undegraded":"2023-12-15T23:56:35.345750+0000","last_fullsized":"2023-12-15T23:56:35.345750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:58.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.370715+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-15T23:58:15.370715+0000","last_peered":"2023-12-15T23:58:15.370715+0000","last_clean":"2023-12-15T23:58:15.370715+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-15T23:58:15.370715+0000","last_undegraded":"2023-12-15T23:58:15.370715+0000","last_fullsized":"2023-12-15T23:58:15.370715+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:19:34.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369593+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-15T23:58:10.369593+0000","last_peered":"2023-12-15T23:58:10.369593+0000","last_clean":"2023-12-15T23:58:10.369593+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-15T23:58:10.369593+0000","last_undegraded":"2023-12-15T23:58:10.369593+0000","last_fullsized":"2023-12-15T23:58:10.369593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342347+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-15T23:56:20.342347+0000","last_peered":"2023-12-15T23:56:20.342347+0000","last_clean":"2023-12-15T23:56:20.342347+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-15T23:56:20.342347+0000","last_undegraded":"2023-12-15T23:56:20.342347+0000","last_fullsized":"2023-12-15T23:56:20.342347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:27.749157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'777","reported_seq":2399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341074+0000","last_change":"2023-12-15T22:53:28.168322+0000","last_active":"2023-12-15T23:56:20.341074+0000","last_peered":"2023-12-15T23:56:20.341074+0000","last_clean":"2023-12-15T23:56:20.341074+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-15T23:56:20.341074+0000","last_undegraded":"2023-12-15T23:56:20.341074+0000","last_fullsized":"2023-12-15T23:56:20.341074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588660+0000","last_change":"2023-12-15T22:53:26.160880+0000","last_active":"2023-12-15T23:58:00.588660+0000","last_peered":"2023-12-15T23:58:00.588660+0000","last_clean":"2023-12-15T23:58:00.588660+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-15T23:58:00.588660+0000","last_undegraded":"2023-12-15T23:58:00.588660+0000","last_fullsized":"2023-12-15T23:58:00.588660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356180+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-15T23:57:56.356180+0000","last_peered":"2023-12-15T23:57:56.356180+0000","last_clean":"2023-12-15T23:57:56.356180+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-15T23:57:56.356180+0000","last_undegraded":"2023-12-15T23:57:56.356180+0000","last_fullsized":"2023-12-15T23:57:56.356180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359022+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-15T23:58:05.359022+0000","last_peered":"2023-12-15T23:58:05.359022+0000","last_clean":"2023-12-15T23:58:05.359022+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-15T23:58:05.359022+0000","last_undegraded":"2023-12-15T23:58:05.359022+0000","last_fullsized":"2023-12-15T23:58:05.359022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:29.645708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560345+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-15T23:56:10.560345+0000","last_peered":"2023-12-15T23:56:10.560345+0000","last_clean":"2023-12-15T23:56:10.560345+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-15T23:56:10.560345+0000","last_undegraded":"2023-12-15T23:56:10.560345+0000","last_fullsized":"2023-12-15T23:56:10.560345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:55.500999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333744+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-15T23:56:15.333744+0000","last_peered":"2023-12-15T23:56:15.333744+0000","last_clean":"2023-12-15T23:56:15.333744+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-15T23:56:15.333744+0000","last_undegraded":"2023-12-15T23:56:15.333744+0000","last_fullsized":"2023-12-15T23:56:15.333744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:51.409885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357884+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-15T23:58:01.357884+0000","last_peered":"2023-12-15T23:58:01.357884+0000","last_clean":"2023-12-15T23:58:01.357884+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-15T23:58:01.357884+0000","last_undegraded":"2023-12-15T23:58:01.357884+0000","last_fullsized":"2023-12-15T23:58:01.357884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:39.186844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344266+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-15T23:56:35.344266+0000","last_peered":"2023-12-15T23:56:35.344266+0000","last_clean":"2023-12-15T23:56:35.344266+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-15T23:56:35.344266+0000","last_undegraded":"2023-12-15T23:56:35.344266+0000","last_fullsized":"2023-12-15T23:56:35.344266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:46.912902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1650,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.362356+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-15T23:58:20.362356+0000","last_peered":"2023-12-15T23:58:20.362356+0000","last_clean":"2023-12-15T23:58:20.362356+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-15T23:58:20.362356+0000","last_undegraded":"2023-12-15T23:58:20.362356+0000","last_fullsized":"2023-12-15T23:58:20.362356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:55.411932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344494+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-15T23:56:30.344494+0000","last_peered":"2023-12-15T23:56:30.344494+0000","last_clean":"2023-12-15T23:56:30.344494+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-15T23:56:30.344494+0000","last_undegraded":"2023-12-15T23:56:30.344494+0000","last_fullsized":"2023-12-15T23:56:30.344494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369737+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-15T23:58:10.369737+0000","last_peered":"2023-12-15T23:58:10.369737+0000","last_clean":"2023-12-15T23:58:10.369737+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-15T23:58:10.369737+0000","last_undegraded":"2023-12-15T23:58:10.369737+0000","last_fullsized":"2023-12-15T23:58:10.369737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331874+0000","last_change":"2023-12-15T22:53:30.176469+0000","last_active":"2023-12-15T23:56:16.331874+0000","last_peered":"2023-12-15T23:56:16.331874+0000","last_clean":"2023-12-15T23:56:16.331874+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-15T23:56:16.331874+0000","last_undegraded":"2023-12-15T23:56:16.331874+0000","last_fullsized":"2023-12-15T23:56:16.331874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:01.243566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.369293+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-15T23:58:05.369293+0000","last_peered":"2023-12-15T23:58:05.369293+0000","last_clean":"2023-12-15T23:58:05.369293+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-15T23:58:05.369293+0000","last_undegraded":"2023-12-15T23:58:05.369293+0000","last_fullsized":"2023-12-15T23:58:05.369293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'5","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340715+0000","last_change":"2023-12-15T22:53:26.163456+0000","last_active":"2023-12-15T23:56:15.340715+0000","last_peered":"2023-12-15T23:56:15.340715+0000","last_clean":"2023-12-15T23:56:15.340715+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-15T23:56:15.340715+0000","last_undegraded":"2023-12-15T23:56:15.340715+0000","last_fullsized":"2023-12-15T23:56:15.340715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368939+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-15T23:58:10.368939+0000","last_peered":"2023-12-15T23:58:10.368939+0000","last_clean":"2023-12-15T23:58:10.368939+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-15T23:58:10.368939+0000","last_undegraded":"2023-12-15T23:58:10.368939+0000","last_fullsized":"2023-12-15T23:58:10.368939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334578+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-15T23:55:55.334578+0000","last_peered":"2023-12-15T23:55:55.334578+0000","last_clean":"2023-12-15T23:55:55.334578+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-15T23:55:55.334578+0000","last_undegraded":"2023-12-15T23:55:55.334578+0000","last_fullsized":"2023-12-15T23:55:55.334578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:22.502479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331481+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-15T23:56:05.331481+0000","last_peered":"2023-12-15T23:56:05.331481+0000","last_clean":"2023-12-15T23:56:05.331481+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-15T23:56:05.331481+0000","last_undegraded":"2023-12-15T23:56:05.331481+0000","last_fullsized":"2023-12-15T23:56:05.331481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:58.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369516+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-15T23:58:10.369516+0000","last_peered":"2023-12-15T23:58:10.369516+0000","last_clean":"2023-12-15T23:58:10.369516+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-15T23:58:10.369516+0000","last_undegraded":"2023-12-15T23:58:10.369516+0000","last_fullsized":"2023-12-15T23:58:10.369516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370384+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-15T23:58:10.370384+0000","last_peered":"2023-12-15T23:58:10.370384+0000","last_clean":"2023-12-15T23:58:10.370384+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-15T23:58:10.370384+0000","last_undegraded":"2023-12-15T23:58:10.370384+0000","last_fullsized":"2023-12-15T23:58:10.370384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370814+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-15T23:58:10.370814+0000","last_peered":"2023-12-15T23:58:10.370814+0000","last_clean":"2023-12-15T23:58:10.370814+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-15T23:58:10.370814+0000","last_undegraded":"2023-12-15T23:58:10.370814+0000","last_fullsized":"2023-12-15T23:58:10.370814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:21.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341847+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-15T23:56:50.341847+0000","last_peered":"2023-12-15T23:56:50.341847+0000","last_clean":"2023-12-15T23:56:50.341847+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-15T23:56:50.341847+0000","last_undegraded":"2023-12-15T23:56:50.341847+0000","last_fullsized":"2023-12-15T23:56:50.341847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:13:08.808826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566493+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-15T23:56:35.566493+0000","last_peered":"2023-12-15T23:56:35.566493+0000","last_clean":"2023-12-15T23:56:35.566493+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-15T23:56:35.566493+0000","last_undegraded":"2023-12-15T23:56:35.566493+0000","last_fullsized":"2023-12-15T23:56:35.566493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:11.823256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344162+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-15T23:56:30.344162+0000","last_peered":"2023-12-15T23:56:30.344162+0000","last_clean":"2023-12-15T23:56:30.344162+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-15T23:56:30.344162+0000","last_undegraded":"2023-12-15T23:56:30.344162+0000","last_fullsized":"2023-12-15T23:56:30.344162+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:26.339363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370477+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-15T23:58:10.370477+0000","last_peered":"2023-12-15T23:58:10.370477+0000","last_clean":"2023-12-15T23:58:10.370477+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-15T23:58:10.370477+0000","last_undegraded":"2023-12-15T23:58:10.370477+0000","last_fullsized":"2023-12-15T23:58:10.370477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:31.522105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367802+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-15T23:58:05.367802+0000","last_peered":"2023-12-15T23:58:05.367802+0000","last_clean":"2023-12-15T23:58:05.367802+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-15T23:58:05.367802+0000","last_undegraded":"2023-12-15T23:58:05.367802+0000","last_fullsized":"2023-12-15T23:58:05.367802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:58.411627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1652","reported_seq":2674,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333978+0000","last_change":"2023-12-15T22:53:28.166989+0000","last_active":"2023-12-15T23:56:15.333978+0000","last_peered":"2023-12-15T23:56:15.333978+0000","last_clean":"2023-12-15T23:56:15.333978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-15T23:56:15.333978+0000","last_undegraded":"2023-12-15T23:56:15.333978+0000","last_fullsized":"2023-12-15T23:56:15.333978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:18.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340671+0000","last_change":"2023-12-15T22:53:26.163111+0000","last_active":"2023-12-15T23:56:15.340671+0000","last_peered":"2023-12-15T23:56:15.340671+0000","last_clean":"2023-12-15T23:56:15.340671+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-15T23:56:15.340671+0000","last_undegraded":"2023-12-15T23:56:15.340671+0000","last_fullsized":"2023-12-15T23:56:15.340671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335797+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-15T23:55:55.335797+0000","last_peered":"2023-12-15T23:55:55.335797+0000","last_clean":"2023-12-15T23:55:55.335797+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-15T23:55:55.335797+0000","last_undegraded":"2023-12-15T23:55:55.335797+0000","last_fullsized":"2023-12-15T23:55:55.335797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335758+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-15T23:55:55.335758+0000","last_peered":"2023-12-15T23:55:55.335758+0000","last_clean":"2023-12-15T23:55:55.335758+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-15T23:55:55.335758+0000","last_undegraded":"2023-12-15T23:55:55.335758+0000","last_fullsized":"2023-12-15T23:55:55.335758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332486+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-15T23:56:10.332486+0000","last_peered":"2023-12-15T23:56:10.332486+0000","last_clean":"2023-12-15T23:56:10.332486+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-15T23:56:10.332486+0000","last_undegraded":"2023-12-15T23:56:10.332486+0000","last_fullsized":"2023-12-15T23:56:10.332486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:12:03.582433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370332+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-15T23:58:10.370332+0000","last_peered":"2023-12-15T23:58:10.370332+0000","last_clean":"2023-12-15T23:58:10.370332+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-15T23:58:10.370332+0000","last_undegraded":"2023-12-15T23:58:10.370332+0000","last_fullsized":"2023-12-15T23:58:10.370332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360212+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-15T23:58:10.360212+0000","last_peered":"2023-12-15T23:58:10.360212+0000","last_clean":"2023-12-15T23:58:10.360212+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-15T23:58:10.360212+0000","last_undegraded":"2023-12-15T23:58:10.360212+0000","last_fullsized":"2023-12-15T23:58:10.360212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:59.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591341+0000","last_change":"2023-12-15T22:53:10.340508+0000","last_active":"2023-12-15T23:58:10.591341+0000","last_peered":"2023-12-15T23:58:10.591341+0000","last_clean":"2023-12-15T23:58:10.591341+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-15T23:58:10.591341+0000","last_undegraded":"2023-12-15T23:58:10.591341+0000","last_fullsized":"2023-12-15T23:58:10.591341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:57.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.563036+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-15T23:56:20.563036+0000","last_peered":"2023-12-15T23:56:20.563036+0000","last_clean":"2023-12-15T23:56:20.563036+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-15T23:56:20.563036+0000","last_undegraded":"2023-12-15T23:56:20.563036+0000","last_fullsized":"2023-12-15T23:56:20.563036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:04:25.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3530,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.351010+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:56:55.351010+0000","last_peered":"2023-12-15T23:56:55.351010+0000","last_clean":"2023-12-15T23:56:55.351010+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:56:55.351010+0000","last_undegraded":"2023-12-15T23:56:55.351010+0000","last_fullsized":"2023-12-15T23:56:55.351010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:09.097073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:46.338997+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-15T23:56:46.338997+0000","last_peered":"2023-12-15T23:56:46.338997+0000","last_clean":"2023-12-15T23:56:46.338997+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-15T23:56:46.338997+0000","last_undegraded":"2023-12-15T23:56:46.338997+0000","last_fullsized":"2023-12-15T23:56:46.338997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:50.579490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369071+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-15T23:58:10.369071+0000","last_peered":"2023-12-15T23:58:10.369071+0000","last_clean":"2023-12-15T23:58:10.369071+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-15T23:58:10.369071+0000","last_undegraded":"2023-12-15T23:58:10.369071+0000","last_fullsized":"2023-12-15T23:58:10.369071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:23.414022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368432+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-15T23:58:05.368432+0000","last_peered":"2023-12-15T23:58:05.368432+0000","last_clean":"2023-12-15T23:58:05.368432+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-15T23:58:05.368432+0000","last_undegraded":"2023-12-15T23:58:05.368432+0000","last_fullsized":"2023-12-15T23:58:05.368432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:01:44.643639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.589587+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-15T23:58:05.589587+0000","last_peered":"2023-12-15T23:58:05.589587+0000","last_clean":"2023-12-15T23:58:05.589587+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-15T23:58:05.589587+0000","last_undegraded":"2023-12-15T23:58:05.589587+0000","last_fullsized":"2023-12-15T23:58:05.589587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.019947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'4","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367754+0000","last_change":"2023-12-15T22:53:26.165088+0000","last_active":"2023-12-15T23:58:00.367754+0000","last_peered":"2023-12-15T23:58:00.367754+0000","last_clean":"2023-12-15T23:58:00.367754+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-15T23:58:00.367754+0000","last_undegraded":"2023-12-15T23:58:00.367754+0000","last_fullsized":"2023-12-15T23:58:00.367754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:14.026739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326539+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-15T23:55:56.326539+0000","last_peered":"2023-12-15T23:55:56.326539+0000","last_clean":"2023-12-15T23:55:56.326539+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-15T23:55:56.326539+0000","last_undegraded":"2023-12-15T23:55:56.326539+0000","last_fullsized":"2023-12-15T23:55:56.326539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-15T23:55:55.556758+0000","last_peered":"2023-12-15T23:55:55.556758+0000","last_clean":"2023-12-15T23:55:55.556758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-15T23:55:55.556758+0000","last_undegraded":"2023-12-15T23:55:55.556758+0000","last_fullsized":"2023-12-15T23:55:55.556758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:17.629224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331590+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-15T23:56:05.331590+0000","last_peered":"2023-12-15T23:56:05.331590+0000","last_clean":"2023-12-15T23:56:05.331590+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-15T23:56:05.331590+0000","last_undegraded":"2023-12-15T23:56:05.331590+0000","last_fullsized":"2023-12-15T23:56:05.331590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:20.899928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.329372+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-15T23:56:06.329372+0000","last_peered":"2023-12-15T23:56:06.329372+0000","last_clean":"2023-12-15T23:56:06.329372+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-15T23:56:06.329372+0000","last_undegraded":"2023-12-15T23:56:06.329372+0000","last_fullsized":"2023-12-15T23:56:06.329372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:33.385736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343663+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-15T23:56:25.343663+0000","last_peered":"2023-12-15T23:56:25.343663+0000","last_clean":"2023-12-15T23:56:25.343663+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-15T23:56:25.343663+0000","last_undegraded":"2023-12-15T23:56:25.343663+0000","last_fullsized":"2023-12-15T23:56:25.343663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578335+0000","last_change":"2023-12-15T22:53:10.339820+0000","last_active":"2023-12-15T23:57:20.578335+0000","last_peered":"2023-12-15T23:57:20.578335+0000","last_clean":"2023-12-15T23:57:20.578335+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:57:20.578335+0000","last_undegraded":"2023-12-15T23:57:20.578335+0000","last_fullsized":"2023-12-15T23:57:20.578335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:16.322332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342330+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-15T23:56:20.342330+0000","last_peered":"2023-12-15T23:56:20.342330+0000","last_clean":"2023-12-15T23:56:20.342330+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-15T23:56:20.342330+0000","last_undegraded":"2023-12-15T23:56:20.342330+0000","last_fullsized":"2023-12-15T23:56:20.342330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:25.701757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":884,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350904+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:56:55.350904+0000","last_peered":"2023-12-15T23:56:55.350904+0000","last_clean":"2023-12-15T23:56:55.350904+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:56:55.350904+0000","last_undegraded":"2023-12-15T23:56:55.350904+0000","last_fullsized":"2023-12-15T23:56:55.350904+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:19.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344331+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-15T23:56:30.344331+0000","last_peered":"2023-12-15T23:56:30.344331+0000","last_clean":"2023-12-15T23:56:30.344331+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-15T23:56:30.344331+0000","last_undegraded":"2023-12-15T23:56:30.344331+0000","last_fullsized":"2023-12-15T23:56:30.344331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:35.691834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340903+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-15T23:56:20.340903+0000","last_peered":"2023-12-15T23:56:20.340903+0000","last_clean":"2023-12-15T23:56:20.340903+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-15T23:56:20.340903+0000","last_undegraded":"2023-12-15T23:56:20.340903+0000","last_fullsized":"2023-12-15T23:56:20.340903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359147+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-15T23:58:05.359147+0000","last_peered":"2023-12-15T23:58:05.359147+0000","last_clean":"2023-12-15T23:58:05.359147+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-15T23:58:05.359147+0000","last_undegraded":"2023-12-15T23:58:05.359147+0000","last_fullsized":"2023-12-15T23:58:05.359147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:43.704505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'434","reported_seq":826,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359244+0000","last_change":"2023-12-15T22:53:28.165130+0000","last_active":"2023-12-15T23:58:05.359244+0000","last_peered":"2023-12-15T23:58:05.359244+0000","last_clean":"2023-12-15T23:58:05.359244+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-15T23:58:05.359244+0000","last_undegraded":"2023-12-15T23:58:05.359244+0000","last_fullsized":"2023-12-15T23:58:05.359244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:09.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.581910+0000","last_change":"2023-12-15T22:53:26.156795+0000","last_active":"2023-12-15T23:57:35.581910+0000","last_peered":"2023-12-15T23:57:35.581910+0000","last_clean":"2023-12-15T23:57:35.581910+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-15T23:57:35.581910+0000","last_undegraded":"2023-12-15T23:57:35.581910+0000","last_fullsized":"2023-12-15T23:57:35.581910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:29.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334631+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-15T23:55:55.334631+0000","last_peered":"2023-12-15T23:55:55.334631+0000","last_clean":"2023-12-15T23:55:55.334631+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-15T23:55:55.334631+0000","last_undegraded":"2023-12-15T23:55:55.334631+0000","last_fullsized":"2023-12-15T23:55:55.334631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:44.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369701+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-15T23:58:10.369701+0000","last_peered":"2023-12-15T23:58:10.369701+0000","last_clean":"2023-12-15T23:58:10.369701+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-15T23:58:10.369701+0000","last_undegraded":"2023-12-15T23:58:10.369701+0000","last_fullsized":"2023-12-15T23:58:10.369701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559219+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-15T23:56:05.559219+0000","last_peered":"2023-12-15T23:56:05.559219+0000","last_clean":"2023-12-15T23:56:05.559219+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-15T23:56:05.559219+0000","last_undegraded":"2023-12-15T23:56:05.559219+0000","last_fullsized":"2023-12-15T23:56:05.559219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:55.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336323+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-15T23:56:25.336323+0000","last_peered":"2023-12-15T23:56:25.336323+0000","last_clean":"2023-12-15T23:56:25.336323+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-15T23:56:25.336323+0000","last_undegraded":"2023-12-15T23:56:25.336323+0000","last_fullsized":"2023-12-15T23:56:25.336323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:58.115309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332781+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-15T23:56:10.332781+0000","last_peered":"2023-12-15T23:56:10.332781+0000","last_clean":"2023-12-15T23:56:10.332781+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-15T23:56:10.332781+0000","last_undegraded":"2023-12-15T23:56:10.332781+0000","last_fullsized":"2023-12-15T23:56:10.332781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:11.050275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584443+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:57:45.584443+0000","last_peered":"2023-12-15T23:57:45.584443+0000","last_clean":"2023-12-15T23:57:45.584443+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:57:45.584443+0000","last_undegraded":"2023-12-15T23:57:45.584443+0000","last_fullsized":"2023-12-15T23:57:45.584443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347388+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-15T23:56:45.347388+0000","last_peered":"2023-12-15T23:56:45.347388+0000","last_clean":"2023-12-15T23:56:45.347388+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-15T23:56:45.347388+0000","last_undegraded":"2023-12-15T23:56:45.347388+0000","last_fullsized":"2023-12-15T23:56:45.347388+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:15.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3437,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344672+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-15T23:56:35.344672+0000","last_peered":"2023-12-15T23:56:35.344672+0000","last_clean":"2023-12-15T23:56:35.344672+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-15T23:56:35.344672+0000","last_undegraded":"2023-12-15T23:56:35.344672+0000","last_fullsized":"2023-12-15T23:56:35.344672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:27:53.377560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348840+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:56:50.348840+0000","last_peered":"2023-12-15T23:56:50.348840+0000","last_clean":"2023-12-15T23:56:50.348840+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:56:50.348840+0000","last_undegraded":"2023-12-15T23:56:50.348840+0000","last_fullsized":"2023-12-15T23:56:50.348840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:13.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564275+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-15T23:56:25.564275+0000","last_peered":"2023-12-15T23:56:25.564275+0000","last_clean":"2023-12-15T23:56:25.564275+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-15T23:56:25.564275+0000","last_undegraded":"2023-12-15T23:56:25.564275+0000","last_fullsized":"2023-12-15T23:56:25.564275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:39.121105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358717+0000","last_change":"2023-12-15T22:53:30.183489+0000","last_active":"2023-12-15T23:58:06.358717+0000","last_peered":"2023-12-15T23:58:06.358717+0000","last_clean":"2023-12-15T23:58:06.358717+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-15T23:58:06.358717+0000","last_undegraded":"2023-12-15T23:58:06.358717+0000","last_fullsized":"2023-12-15T23:58:06.358717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:04.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'594","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362425+0000","last_change":"2023-12-15T22:53:28.166896+0000","last_active":"2023-12-15T23:57:45.362425+0000","last_peered":"2023-12-15T23:57:45.362425+0000","last_clean":"2023-12-15T23:57:45.362425+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-15T23:57:45.362425+0000","last_undegraded":"2023-12-15T23:57:45.362425+0000","last_fullsized":"2023-12-15T23:57:45.362425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:28.124124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367047+0000","last_change":"2023-12-15T22:53:26.161720+0000","last_active":"2023-12-15T23:58:00.367047+0000","last_peered":"2023-12-15T23:58:00.367047+0000","last_clean":"2023-12-15T23:58:00.367047+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-15T23:58:00.367047+0000","last_undegraded":"2023-12-15T23:58:00.367047+0000","last_fullsized":"2023-12-15T23:58:00.367047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:28.010705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326742+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-15T23:55:56.326742+0000","last_peered":"2023-12-15T23:55:56.326742+0000","last_clean":"2023-12-15T23:55:56.326742+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-15T23:55:56.326742+0000","last_undegraded":"2023-12-15T23:55:56.326742+0000","last_fullsized":"2023-12-15T23:55:56.326742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356136+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-15T23:57:56.356136+0000","last_peered":"2023-12-15T23:57:56.356136+0000","last_clean":"2023-12-15T23:57:56.356136+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-15T23:57:56.356136+0000","last_undegraded":"2023-12-15T23:57:56.356136+0000","last_fullsized":"2023-12-15T23:57:56.356136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:38.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342283+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-15T23:56:20.342283+0000","last_peered":"2023-12-15T23:56:20.342283+0000","last_clean":"2023-12-15T23:56:20.342283+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-15T23:56:20.342283+0000","last_undegraded":"2023-12-15T23:56:20.342283+0000","last_fullsized":"2023-12-15T23:56:20.342283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560515+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-15T23:56:10.560515+0000","last_peered":"2023-12-15T23:56:10.560515+0000","last_clean":"2023-12-15T23:56:10.560515+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-15T23:56:10.560515+0000","last_undegraded":"2023-12-15T23:56:10.560515+0000","last_fullsized":"2023-12-15T23:56:10.560515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:40.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330607+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:56:11.330607+0000","last_peered":"2023-12-15T23:56:11.330607+0000","last_clean":"2023-12-15T23:56:11.330607+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-15T23:56:11.330607+0000","last_undegraded":"2023-12-15T23:56:11.330607+0000","last_fullsized":"2023-12-15T23:56:11.330607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:15.547530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353777+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:57:46.353777+0000","last_peered":"2023-12-15T23:57:46.353777+0000","last_clean":"2023-12-15T23:57:46.353777+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:57:46.353777+0000","last_undegraded":"2023-12-15T23:57:46.353777+0000","last_fullsized":"2023-12-15T23:57:46.353777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:08.837316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566821+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-15T23:56:35.566821+0000","last_peered":"2023-12-15T23:56:35.566821+0000","last_clean":"2023-12-15T23:56:35.566821+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-15T23:56:35.566821+0000","last_undegraded":"2023-12-15T23:56:35.566821+0000","last_fullsized":"2023-12-15T23:56:35.566821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1758,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349715+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-15T23:56:50.349715+0000","last_peered":"2023-12-15T23:56:50.349715+0000","last_clean":"2023-12-15T23:56:50.349715+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-15T23:56:50.349715+0000","last_undegraded":"2023-12-15T23:56:50.349715+0000","last_fullsized":"2023-12-15T23:56:50.349715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:20.444898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348796+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:56:50.348796+0000","last_peered":"2023-12-15T23:56:50.348796+0000","last_clean":"2023-12-15T23:56:50.348796+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:56:50.348796+0000","last_undegraded":"2023-12-15T23:56:50.348796+0000","last_fullsized":"2023-12-15T23:56:50.348796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564359+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-15T23:56:25.564359+0000","last_peered":"2023-12-15T23:56:25.564359+0000","last_clean":"2023-12-15T23:56:25.564359+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-15T23:56:25.564359+0000","last_undegraded":"2023-12-15T23:56:25.564359+0000","last_fullsized":"2023-12-15T23:56:25.564359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:49.839990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583014+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:57:40.583014+0000","last_peered":"2023-12-15T23:57:40.583014+0000","last_clean":"2023-12-15T23:57:40.583014+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:57:40.583014+0000","last_undegraded":"2023-12-15T23:57:40.583014+0000","last_fullsized":"2023-12-15T23:57:40.583014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:36.864485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'312","reported_seq":520,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358697+0000","last_change":"2023-12-15T22:53:28.170097+0000","last_active":"2023-12-15T23:58:06.358697+0000","last_peered":"2023-12-15T23:58:06.358697+0000","last_clean":"2023-12-15T23:58:06.358697+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-15T23:58:06.358697+0000","last_undegraded":"2023-12-15T23:58:06.358697+0000","last_fullsized":"2023-12-15T23:58:06.358697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:11.019249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588540+0000","last_change":"2023-12-15T22:53:26.164887+0000","last_active":"2023-12-15T23:58:00.588540+0000","last_peered":"2023-12-15T23:58:00.588540+0000","last_clean":"2023-12-15T23:58:00.588540+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-15T23:58:00.588540+0000","last_undegraded":"2023-12-15T23:58:00.588540+0000","last_fullsized":"2023-12-15T23:58:00.588540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559374+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-15T23:56:05.559374+0000","last_peered":"2023-12-15T23:56:05.559374+0000","last_clean":"2023-12-15T23:56:05.559374+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-15T23:56:05.559374+0000","last_undegraded":"2023-12-15T23:56:05.559374+0000","last_fullsized":"2023-12-15T23:56:05.559374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:12.885816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356568+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-15T23:57:55.356568+0000","last_peered":"2023-12-15T23:57:55.356568+0000","last_clean":"2023-12-15T23:57:55.356568+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-15T23:57:55.356568+0000","last_undegraded":"2023-12-15T23:57:55.356568+0000","last_fullsized":"2023-12-15T23:57:55.356568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:54.088870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337183+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-15T23:56:05.337183+0000","last_peered":"2023-12-15T23:56:05.337183+0000","last_clean":"2023-12-15T23:56:05.337183+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-15T23:56:05.337183+0000","last_undegraded":"2023-12-15T23:56:05.337183+0000","last_fullsized":"2023-12-15T23:56:05.337183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:53.490096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339396+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-15T23:56:10.339396+0000","last_peered":"2023-12-15T23:56:10.339396+0000","last_clean":"2023-12-15T23:56:10.339396+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-15T23:56:10.339396+0000","last_undegraded":"2023-12-15T23:56:10.339396+0000","last_fullsized":"2023-12-15T23:56:10.339396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338360+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-15T23:56:10.338360+0000","last_peered":"2023-12-15T23:56:10.338360+0000","last_clean":"2023-12-15T23:56:10.338360+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-15T23:56:10.338360+0000","last_undegraded":"2023-12-15T23:56:10.338360+0000","last_fullsized":"2023-12-15T23:56:10.338360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584565+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:57:45.584565+0000","last_peered":"2023-12-15T23:57:45.584565+0000","last_clean":"2023-12-15T23:57:45.584565+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:57:45.584565+0000","last_undegraded":"2023-12-15T23:57:45.584565+0000","last_fullsized":"2023-12-15T23:57:45.584565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328974+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-15T23:55:55.328974+0000","last_peered":"2023-12-15T23:55:55.328974+0000","last_clean":"2023-12-15T23:55:55.328974+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-15T23:55:55.328974+0000","last_undegraded":"2023-12-15T23:55:55.328974+0000","last_fullsized":"2023-12-15T23:55:55.328974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:54.535000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1478,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.348066+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:57:21.348066+0000","last_peered":"2023-12-15T23:57:21.348066+0000","last_clean":"2023-12-15T23:57:21.348066+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:57:21.348066+0000","last_undegraded":"2023-12-15T23:57:21.348066+0000","last_fullsized":"2023-12-15T23:57:21.348066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573493+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:57:00.573493+0000","last_peered":"2023-12-15T23:57:00.573493+0000","last_clean":"2023-12-15T23:57:00.573493+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:57:00.573493+0000","last_undegraded":"2023-12-15T23:57:00.573493+0000","last_fullsized":"2023-12-15T23:57:00.573493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:49.584218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335364+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-15T23:56:31.335364+0000","last_peered":"2023-12-15T23:56:31.335364+0000","last_clean":"2023-12-15T23:56:31.335364+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-15T23:56:31.335364+0000","last_undegraded":"2023-12-15T23:56:31.335364+0000","last_fullsized":"2023-12-15T23:56:31.335364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:32.141954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565261+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-15T23:56:30.565261+0000","last_peered":"2023-12-15T23:56:30.565261+0000","last_clean":"2023-12-15T23:56:30.565261+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-15T23:56:30.565261+0000","last_undegraded":"2023-12-15T23:56:30.565261+0000","last_fullsized":"2023-12-15T23:56:30.565261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:18.046986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2092","reported_seq":3430,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344301+0000","last_change":"2023-12-15T22:53:28.171130+0000","last_active":"2023-12-15T23:56:30.344301+0000","last_peered":"2023-12-15T23:56:30.344301+0000","last_clean":"2023-12-15T23:56:30.344301+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-15T23:56:30.344301+0000","last_undegraded":"2023-12-15T23:56:30.344301+0000","last_fullsized":"2023-12-15T23:56:30.344301+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":200,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:14.487255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333562+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-15T23:56:15.333562+0000","last_peered":"2023-12-15T23:56:15.333562+0000","last_clean":"2023-12-15T23:56:15.333562+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-15T23:56:15.333562+0000","last_undegraded":"2023-12-15T23:56:15.333562+0000","last_fullsized":"2023-12-15T23:56:15.333562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:57.767288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363413+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:57:45.363413+0000","last_peered":"2023-12-15T23:57:45.363413+0000","last_clean":"2023-12-15T23:57:45.363413+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:57:45.363413+0000","last_undegraded":"2023-12-15T23:57:45.363413+0000","last_fullsized":"2023-12-15T23:57:45.363413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:11.540042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341710+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T23:56:25.341710+0000","last_peered":"2023-12-15T23:56:25.341710+0000","last_clean":"2023-12-15T23:56:25.341710+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T23:56:25.341710+0000","last_undegraded":"2023-12-15T23:56:25.341710+0000","last_fullsized":"2023-12-15T23:56:25.341710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580881+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:57:30.580881+0000","last_peered":"2023-12-15T23:57:30.580881+0000","last_clean":"2023-12-15T23:57:30.580881+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:57:30.580881+0000","last_undegraded":"2023-12-15T23:57:30.580881+0000","last_fullsized":"2023-12-15T23:57:30.580881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:56.749823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352586+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:57:41.352586+0000","last_peered":"2023-12-15T23:57:41.352586+0000","last_clean":"2023-12-15T23:57:41.352586+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:57:41.352586+0000","last_undegraded":"2023-12-15T23:57:41.352586+0000","last_fullsized":"2023-12-15T23:57:41.352586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:47.389382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369432+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-15T23:58:10.369432+0000","last_peered":"2023-12-15T23:58:10.369432+0000","last_clean":"2023-12-15T23:58:10.369432+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-15T23:58:10.369432+0000","last_undegraded":"2023-12-15T23:58:10.369432+0000","last_fullsized":"2023-12-15T23:58:10.369432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370878+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-15T23:58:10.370878+0000","last_peered":"2023-12-15T23:58:10.370878+0000","last_clean":"2023-12-15T23:58:10.370878+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-15T23:58:10.370878+0000","last_undegraded":"2023-12-15T23:58:10.370878+0000","last_fullsized":"2023-12-15T23:58:10.370878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:37.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368841+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-15T23:58:10.368841+0000","last_peered":"2023-12-15T23:58:10.368841+0000","last_clean":"2023-12-15T23:58:10.368841+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-15T23:58:10.368841+0000","last_undegraded":"2023-12-15T23:58:10.368841+0000","last_fullsized":"2023-12-15T23:58:10.368841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337269+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-15T23:56:05.337269+0000","last_peered":"2023-12-15T23:56:05.337269+0000","last_clean":"2023-12-15T23:56:05.337269+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-15T23:56:05.337269+0000","last_undegraded":"2023-12-15T23:56:05.337269+0000","last_fullsized":"2023-12-15T23:56:05.337269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:33.993237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343972+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:57:06.343972+0000","last_peered":"2023-12-15T23:57:06.343972+0000","last_clean":"2023-12-15T23:57:06.343972+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:57:06.343972+0000","last_undegraded":"2023-12-15T23:57:06.343972+0000","last_fullsized":"2023-12-15T23:57:06.343972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:50:27.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342556+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:57:01.342556+0000","last_peered":"2023-12-15T23:57:01.342556+0000","last_clean":"2023-12-15T23:57:01.342556+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:57:01.342556+0000","last_undegraded":"2023-12-15T23:57:01.342556+0000","last_fullsized":"2023-12-15T23:57:01.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:20.406306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345788+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-15T23:56:35.345788+0000","last_peered":"2023-12-15T23:56:35.345788+0000","last_clean":"2023-12-15T23:56:35.345788+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-15T23:56:35.345788+0000","last_undegraded":"2023-12-15T23:56:35.345788+0000","last_fullsized":"2023-12-15T23:56:35.345788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:37.028220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337339+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-15T23:56:30.337339+0000","last_peered":"2023-12-15T23:56:30.337339+0000","last_clean":"2023-12-15T23:56:30.337339+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-15T23:56:30.337339+0000","last_undegraded":"2023-12-15T23:56:30.337339+0000","last_fullsized":"2023-12-15T23:56:30.337339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:45.660409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2321","reported_seq":3328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336494+0000","last_change":"2023-12-15T22:53:28.162922+0000","last_active":"2023-12-15T23:56:36.336494+0000","last_peered":"2023-12-15T23:56:36.336494+0000","last_clean":"2023-12-15T23:56:36.336494+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-15T23:56:36.336494+0000","last_undegraded":"2023-12-15T23:56:36.336494+0000","last_fullsized":"2023-12-15T23:56:36.336494+0000","mapping_epoch":35,"log_start":"54'600","ondisk_log_start":"54'600","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":600,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:41.693500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'16","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340575+0000","last_change":"2023-12-15T22:53:26.162291+0000","last_active":"2023-12-15T23:56:15.340575+0000","last_peered":"2023-12-15T23:56:15.340575+0000","last_clean":"2023-12-15T23:56:15.340575+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-15T23:56:15.340575+0000","last_undegraded":"2023-12-15T23:56:15.340575+0000","last_fullsized":"2023-12-15T23:56:15.340575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581125+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:57:30.581125+0000","last_peered":"2023-12-15T23:57:30.581125+0000","last_clean":"2023-12-15T23:57:30.581125+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:57:30.581125+0000","last_undegraded":"2023-12-15T23:57:30.581125+0000","last_fullsized":"2023-12-15T23:57:30.581125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346527+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T23:56:40.346527+0000","last_peered":"2023-12-15T23:56:40.346527+0000","last_clean":"2023-12-15T23:56:40.346527+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T23:56:40.346527+0000","last_undegraded":"2023-12-15T23:56:40.346527+0000","last_fullsized":"2023-12-15T23:56:40.346527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350078+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:57:31.350078+0000","last_peered":"2023-12-15T23:57:31.350078+0000","last_clean":"2023-12-15T23:57:31.350078+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:57:31.350078+0000","last_undegraded":"2023-12-15T23:57:31.350078+0000","last_fullsized":"2023-12-15T23:57:31.350078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366870+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-15T23:57:55.366870+0000","last_peered":"2023-12-15T23:57:55.366870+0000","last_clean":"2023-12-15T23:57:55.366870+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-15T23:57:55.366870+0000","last_undegraded":"2023-12-15T23:57:55.366870+0000","last_fullsized":"2023-12-15T23:57:55.366870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591256+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-15T23:58:10.591256+0000","last_peered":"2023-12-15T23:58:10.591256+0000","last_clean":"2023-12-15T23:58:10.591256+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-15T23:58:10.591256+0000","last_undegraded":"2023-12-15T23:58:10.591256+0000","last_fullsized":"2023-12-15T23:58:10.591256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:28.787967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370208+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-15T23:58:10.370208+0000","last_peered":"2023-12-15T23:58:10.370208+0000","last_clean":"2023-12-15T23:58:10.370208+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-15T23:58:10.370208+0000","last_undegraded":"2023-12-15T23:58:10.370208+0000","last_fullsized":"2023-12-15T23:58:10.370208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368784+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-15T23:58:10.368784+0000","last_peered":"2023-12-15T23:58:10.368784+0000","last_clean":"2023-12-15T23:58:10.368784+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-15T23:58:10.368784+0000","last_undegraded":"2023-12-15T23:58:10.368784+0000","last_fullsized":"2023-12-15T23:58:10.368784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335801+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-15T23:55:55.335801+0000","last_peered":"2023-12-15T23:55:55.335801+0000","last_clean":"2023-12-15T23:55:55.335801+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-15T23:55:55.335801+0000","last_undegraded":"2023-12-15T23:55:55.335801+0000","last_fullsized":"2023-12-15T23:55:55.335801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5993,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353259+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:57:05.353259+0000","last_peered":"2023-12-15T23:57:05.353259+0000","last_clean":"2023-12-15T23:57:05.353259+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:57:05.353259+0000","last_undegraded":"2023-12-15T23:57:05.353259+0000","last_fullsized":"2023-12-15T23:57:05.353259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:23.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352049+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:57:00.352049+0000","last_peered":"2023-12-15T23:57:00.352049+0000","last_clean":"2023-12-15T23:57:00.352049+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:57:00.352049+0000","last_undegraded":"2023-12-15T23:57:00.352049+0000","last_fullsized":"2023-12-15T23:57:00.352049+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:36:08.674603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348850+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:56:50.348850+0000","last_peered":"2023-12-15T23:56:50.348850+0000","last_clean":"2023-12-15T23:56:50.348850+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:56:50.348850+0000","last_undegraded":"2023-12-15T23:56:50.348850+0000","last_fullsized":"2023-12-15T23:56:50.348850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334718+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-15T23:56:20.334718+0000","last_peered":"2023-12-15T23:56:20.334718+0000","last_clean":"2023-12-15T23:56:20.334718+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-15T23:56:20.334718+0000","last_undegraded":"2023-12-15T23:56:20.334718+0000","last_fullsized":"2023-12-15T23:56:20.334718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:40.887941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1390,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340552+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-15T23:56:20.340552+0000","last_peered":"2023-12-15T23:56:20.340552+0000","last_clean":"2023-12-15T23:56:20.340552+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-15T23:56:20.340552+0000","last_undegraded":"2023-12-15T23:56:20.340552+0000","last_fullsized":"2023-12-15T23:56:20.340552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343101+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-15T23:56:30.343101+0000","last_peered":"2023-12-15T23:56:30.343101+0000","last_clean":"2023-12-15T23:56:30.343101+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-15T23:56:30.343101+0000","last_undegraded":"2023-12-15T23:56:30.343101+0000","last_fullsized":"2023-12-15T23:56:30.343101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587693+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-15T23:57:55.587693+0000","last_peered":"2023-12-15T23:57:55.587693+0000","last_clean":"2023-12-15T23:57:55.587693+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-15T23:57:55.587693+0000","last_undegraded":"2023-12-15T23:57:55.587693+0000","last_fullsized":"2023-12-15T23:57:55.587693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337673+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T23:56:41.337673+0000","last_peered":"2023-12-15T23:56:41.337673+0000","last_clean":"2023-12-15T23:56:41.337673+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T23:56:41.337673+0000","last_undegraded":"2023-12-15T23:56:41.337673+0000","last_fullsized":"2023-12-15T23:56:41.337673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574363+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-15T23:57:05.574363+0000","last_peered":"2023-12-15T23:57:05.574363+0000","last_clean":"2023-12-15T23:57:05.574363+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-15T23:57:05.574363+0000","last_undegraded":"2023-12-15T23:57:05.574363+0000","last_fullsized":"2023-12-15T23:57:05.574363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359390+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-15T23:58:05.359390+0000","last_peered":"2023-12-15T23:58:05.359390+0000","last_clean":"2023-12-15T23:58:05.359390+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-15T23:58:05.359390+0000","last_undegraded":"2023-12-15T23:58:05.359390+0000","last_fullsized":"2023-12-15T23:58:05.359390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:36.759210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366654+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-15T23:58:00.366654+0000","last_peered":"2023-12-15T23:58:00.366654+0000","last_clean":"2023-12-15T23:58:00.366654+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-15T23:58:00.366654+0000","last_undegraded":"2023-12-15T23:58:00.366654+0000","last_fullsized":"2023-12-15T23:58:00.366654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363798+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:57:45.363798+0000","last_peered":"2023-12-15T23:57:45.363798+0000","last_clean":"2023-12-15T23:57:45.363798+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:57:45.363798+0000","last_undegraded":"2023-12-15T23:57:45.363798+0000","last_fullsized":"2023-12-15T23:57:45.363798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339569+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-15T23:56:10.339569+0000","last_peered":"2023-12-15T23:56:10.339569+0000","last_clean":"2023-12-15T23:56:10.339569+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-15T23:56:10.339569+0000","last_undegraded":"2023-12-15T23:56:10.339569+0000","last_fullsized":"2023-12-15T23:56:10.339569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:53.998326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326673+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-15T23:55:56.326673+0000","last_peered":"2023-12-15T23:55:56.326673+0000","last_clean":"2023-12-15T23:55:56.326673+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-15T23:55:56.326673+0000","last_undegraded":"2023-12-15T23:55:56.326673+0000","last_fullsized":"2023-12-15T23:55:56.326673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353438+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:57:05.353438+0000","last_peered":"2023-12-15T23:57:05.353438+0000","last_clean":"2023-12-15T23:57:05.353438+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:57:05.353438+0000","last_undegraded":"2023-12-15T23:57:05.353438+0000","last_fullsized":"2023-12-15T23:57:05.353438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:39.905516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.355945+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:57:15.355945+0000","last_peered":"2023-12-15T23:57:15.355945+0000","last_clean":"2023-12-15T23:57:15.355945+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:57:15.355945+0000","last_undegraded":"2023-12-15T23:57:15.355945+0000","last_fullsized":"2023-12-15T23:57:15.355945+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:17:26.396448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346010+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-15T23:56:35.346010+0000","last_peered":"2023-12-15T23:56:35.346010+0000","last_clean":"2023-12-15T23:56:35.346010+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-15T23:56:35.346010+0000","last_undegraded":"2023-12-15T23:56:35.346010+0000","last_fullsized":"2023-12-15T23:56:35.346010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:50.734122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1463,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334847+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-15T23:56:20.334847+0000","last_peered":"2023-12-15T23:56:20.334847+0000","last_clean":"2023-12-15T23:56:20.334847+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-15T23:56:20.334847+0000","last_undegraded":"2023-12-15T23:56:20.334847+0000","last_fullsized":"2023-12-15T23:56:20.334847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:01.265927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":521,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341886+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-15T23:56:20.341886+0000","last_peered":"2023-12-15T23:56:20.341886+0000","last_clean":"2023-12-15T23:56:20.341886+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-15T23:56:20.341886+0000","last_undegraded":"2023-12-15T23:56:20.341886+0000","last_fullsized":"2023-12-15T23:56:20.341886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'7","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343353+0000","last_change":"2023-12-15T22:53:26.161393+0000","last_active":"2023-12-15T23:56:25.343353+0000","last_peered":"2023-12-15T23:56:25.343353+0000","last_clean":"2023-12-15T23:56:25.343353+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-15T23:56:25.343353+0000","last_undegraded":"2023-12-15T23:56:25.343353+0000","last_fullsized":"2023-12-15T23:56:25.343353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366982+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-15T23:57:55.366982+0000","last_peered":"2023-12-15T23:57:55.366982+0000","last_clean":"2023-12-15T23:57:55.366982+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-15T23:57:55.366982+0000","last_undegraded":"2023-12-15T23:57:55.366982+0000","last_fullsized":"2023-12-15T23:57:55.366982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569523+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T23:56:45.569523+0000","last_peered":"2023-12-15T23:56:45.569523+0000","last_clean":"2023-12-15T23:56:45.569523+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T23:56:45.569523+0000","last_undegraded":"2023-12-15T23:56:45.569523+0000","last_fullsized":"2023-12-15T23:56:45.569523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341738+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T23:56:25.341738+0000","last_peered":"2023-12-15T23:56:25.341738+0000","last_clean":"2023-12-15T23:56:25.341738+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T23:56:25.341738+0000","last_undegraded":"2023-12-15T23:56:25.341738+0000","last_fullsized":"2023-12-15T23:56:25.341738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:48:45.986851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359720+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:57:30.359720+0000","last_peered":"2023-12-15T23:57:30.359720+0000","last_clean":"2023-12-15T23:57:30.359720+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:57:30.359720+0000","last_undegraded":"2023-12-15T23:57:30.359720+0000","last_fullsized":"2023-12-15T23:57:30.359720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368128+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-15T23:58:05.368128+0000","last_peered":"2023-12-15T23:58:05.368128+0000","last_clean":"2023-12-15T23:58:05.368128+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-15T23:58:05.368128+0000","last_undegraded":"2023-12-15T23:58:05.368128+0000","last_fullsized":"2023-12-15T23:58:05.368128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":970,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584747+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:57:45.584747+0000","last_peered":"2023-12-15T23:57:45.584747+0000","last_clean":"2023-12-15T23:57:45.584747+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:57:45.584747+0000","last_undegraded":"2023-12-15T23:57:45.584747+0000","last_fullsized":"2023-12-15T23:57:45.584747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:13.537930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357868+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:58:01.357868+0000","last_peered":"2023-12-15T23:58:01.357868+0000","last_clean":"2023-12-15T23:58:01.357868+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-15T23:58:01.357868+0000","last_undegraded":"2023-12-15T23:58:01.357868+0000","last_fullsized":"2023-12-15T23:58:01.357868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:57.510599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560276+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-15T23:56:10.560276+0000","last_peered":"2023-12-15T23:56:10.560276+0000","last_clean":"2023-12-15T23:56:10.560276+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-15T23:56:10.560276+0000","last_undegraded":"2023-12-15T23:56:10.560276+0000","last_fullsized":"2023-12-15T23:56:10.560276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337286+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-15T23:56:30.337286+0000","last_peered":"2023-12-15T23:56:30.337286+0000","last_clean":"2023-12-15T23:56:30.337286+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-15T23:56:30.337286+0000","last_undegraded":"2023-12-15T23:56:30.337286+0000","last_fullsized":"2023-12-15T23:56:30.337286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:38.545968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1255,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353261+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:57:05.353261+0000","last_peered":"2023-12-15T23:57:05.353261+0000","last_clean":"2023-12-15T23:57:05.353261+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:57:05.353261+0000","last_undegraded":"2023-12-15T23:57:05.353261+0000","last_fullsized":"2023-12-15T23:57:05.353261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341816+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:56:50.341816+0000","last_peered":"2023-12-15T23:56:50.341816+0000","last_clean":"2023-12-15T23:56:50.341816+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:56:50.341816+0000","last_undegraded":"2023-12-15T23:56:50.341816+0000","last_fullsized":"2023-12-15T23:56:50.341816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:46.037392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335881+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-15T23:56:25.335881+0000","last_peered":"2023-12-15T23:56:25.335881+0000","last_clean":"2023-12-15T23:56:25.335881+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-15T23:56:25.335881+0000","last_undegraded":"2023-12-15T23:56:25.335881+0000","last_fullsized":"2023-12-15T23:56:25.335881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:44.899079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'576","reported_seq":1445,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335444+0000","last_change":"2023-12-15T22:53:30.181085+0000","last_active":"2023-12-15T23:56:31.335444+0000","last_peered":"2023-12-15T23:56:31.335444+0000","last_clean":"2023-12-15T23:56:31.335444+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-15T23:56:31.335444+0000","last_undegraded":"2023-12-15T23:56:31.335444+0000","last_fullsized":"2023-12-15T23:56:31.335444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:42.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347586+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:56:45.347586+0000","last_peered":"2023-12-15T23:56:45.347586+0000","last_clean":"2023-12-15T23:56:45.347586+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:56:45.347586+0000","last_undegraded":"2023-12-15T23:56:45.347586+0000","last_fullsized":"2023-12-15T23:56:45.347586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:45.822160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336158+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-15T23:56:25.336158+0000","last_peered":"2023-12-15T23:56:25.336158+0000","last_clean":"2023-12-15T23:56:25.336158+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-15T23:56:25.336158+0000","last_undegraded":"2023-12-15T23:56:25.336158+0000","last_fullsized":"2023-12-15T23:56:25.336158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:41.864051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349876+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:57:31.349876+0000","last_peered":"2023-12-15T23:57:31.349876+0000","last_clean":"2023-12-15T23:57:31.349876+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:57:31.349876+0000","last_undegraded":"2023-12-15T23:57:31.349876+0000","last_fullsized":"2023-12-15T23:57:31.349876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366959+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-15T23:57:55.366959+0000","last_peered":"2023-12-15T23:57:55.366959+0000","last_clean":"2023-12-15T23:57:55.366959+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-15T23:57:55.366959+0000","last_undegraded":"2023-12-15T23:57:55.366959+0000","last_fullsized":"2023-12-15T23:57:55.366959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569612+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T23:56:45.569612+0000","last_peered":"2023-12-15T23:56:45.569612+0000","last_clean":"2023-12-15T23:56:45.569612+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T23:56:45.569612+0000","last_undegraded":"2023-12-15T23:56:45.569612+0000","last_fullsized":"2023-12-15T23:56:45.569612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.348824+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:57:20.348824+0000","last_peered":"2023-12-15T23:57:20.348824+0000","last_clean":"2023-12-15T23:57:20.348824+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:57:20.348824+0000","last_undegraded":"2023-12-15T23:57:20.348824+0000","last_fullsized":"2023-12-15T23:57:20.348824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:37.068698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352526+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:57:41.352526+0000","last_peered":"2023-12-15T23:57:41.352526+0000","last_clean":"2023-12-15T23:57:41.352526+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:57:41.352526+0000","last_undegraded":"2023-12-15T23:57:41.352526+0000","last_fullsized":"2023-12-15T23:57:41.352526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:38.074008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354579+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:57:45.354579+0000","last_peered":"2023-12-15T23:57:45.354579+0000","last_clean":"2023-12-15T23:57:45.354579+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:57:45.354579+0000","last_undegraded":"2023-12-15T23:57:45.354579+0000","last_fullsized":"2023-12-15T23:57:45.354579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:35.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339408+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-15T23:56:10.339408+0000","last_peered":"2023-12-15T23:56:10.339408+0000","last_clean":"2023-12-15T23:56:10.339408+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-15T23:56:10.339408+0000","last_undegraded":"2023-12-15T23:56:10.339408+0000","last_fullsized":"2023-12-15T23:56:10.339408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328762+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-15T23:55:55.328762+0000","last_peered":"2023-12-15T23:55:55.328762+0000","last_clean":"2023-12-15T23:55:55.328762+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-15T23:55:55.328762+0000","last_undegraded":"2023-12-15T23:55:55.328762+0000","last_fullsized":"2023-12-15T23:55:55.328762+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:41.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5894,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.353685+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:57:10.353685+0000","last_peered":"2023-12-15T23:57:10.353685+0000","last_clean":"2023-12-15T23:57:10.353685+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:57:10.353685+0000","last_undegraded":"2023-12-15T23:57:10.353685+0000","last_fullsized":"2023-12-15T23:57:10.353685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:57.639999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349295+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:56:50.349295+0000","last_peered":"2023-12-15T23:56:50.349295+0000","last_clean":"2023-12-15T23:56:50.349295+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:56:50.349295+0000","last_undegraded":"2023-12-15T23:56:50.349295+0000","last_fullsized":"2023-12-15T23:56:50.349295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:50:12.433334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335752+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-15T23:56:25.335752+0000","last_peered":"2023-12-15T23:56:25.335752+0000","last_clean":"2023-12-15T23:56:25.335752+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-15T23:56:25.335752+0000","last_undegraded":"2023-12-15T23:56:25.335752+0000","last_fullsized":"2023-12-15T23:56:25.335752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:55.341702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347565+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:56:45.347565+0000","last_peered":"2023-12-15T23:56:45.347565+0000","last_clean":"2023-12-15T23:56:45.347565+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:56:45.347565+0000","last_undegraded":"2023-12-15T23:56:45.347565+0000","last_fullsized":"2023-12-15T23:56:45.347565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:03.373955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'451","reported_seq":701,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335456+0000","last_change":"2023-12-15T22:53:28.170119+0000","last_active":"2023-12-15T23:56:31.335456+0000","last_peered":"2023-12-15T23:56:31.335456+0000","last_clean":"2023-12-15T23:56:31.335456+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-15T23:56:31.335456+0000","last_undegraded":"2023-12-15T23:56:31.335456+0000","last_fullsized":"2023-12-15T23:56:31.335456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:59.254922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342140+0000","last_change":"2023-12-15T22:53:26.159502+0000","last_active":"2023-12-15T23:56:25.342140+0000","last_peered":"2023-12-15T23:56:25.342140+0000","last_clean":"2023-12-15T23:56:25.342140+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-15T23:56:25.342140+0000","last_undegraded":"2023-12-15T23:56:25.342140+0000","last_fullsized":"2023-12-15T23:56:25.342140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354345+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:57:10.354345+0000","last_peered":"2023-12-15T23:57:10.354345+0000","last_clean":"2023-12-15T23:57:10.354345+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:57:10.354345+0000","last_undegraded":"2023-12-15T23:57:10.354345+0000","last_fullsized":"2023-12-15T23:57:10.354345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357070+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-15T23:57:55.357070+0000","last_peered":"2023-12-15T23:57:55.357070+0000","last_clean":"2023-12-15T23:57:55.357070+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-15T23:57:55.357070+0000","last_undegraded":"2023-12-15T23:57:55.357070+0000","last_fullsized":"2023-12-15T23:57:55.357070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:39.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342609+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:57:01.342609+0000","last_peered":"2023-12-15T23:57:01.342609+0000","last_clean":"2023-12-15T23:57:01.342609+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:57:01.342609+0000","last_undegraded":"2023-12-15T23:57:01.342609+0000","last_fullsized":"2023-12-15T23:57:01.342609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361757+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:57:40.361757+0000","last_peered":"2023-12-15T23:57:40.361757+0000","last_clean":"2023-12-15T23:57:40.361757+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:57:40.361757+0000","last_undegraded":"2023-12-15T23:57:40.361757+0000","last_fullsized":"2023-12-15T23:57:40.361757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:05.440726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363199+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:57:45.363199+0000","last_peered":"2023-12-15T23:57:45.363199+0000","last_clean":"2023-12-15T23:57:45.363199+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:57:45.363199+0000","last_undegraded":"2023-12-15T23:57:45.363199+0000","last_fullsized":"2023-12-15T23:57:45.363199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363708+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:57:45.363708+0000","last_peered":"2023-12-15T23:57:45.363708+0000","last_clean":"2023-12-15T23:57:45.363708+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:57:45.363708+0000","last_undegraded":"2023-12-15T23:57:45.363708+0000","last_fullsized":"2023-12-15T23:57:45.363708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339673+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-15T23:56:10.339673+0000","last_peered":"2023-12-15T23:56:10.339673+0000","last_clean":"2023-12-15T23:56:10.339673+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-15T23:56:10.339673+0000","last_undegraded":"2023-12-15T23:56:10.339673+0000","last_fullsized":"2023-12-15T23:56:10.339673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:23.866137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334729+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-15T23:56:20.334729+0000","last_peered":"2023-12-15T23:56:20.334729+0000","last_clean":"2023-12-15T23:56:20.334729+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-15T23:56:20.334729+0000","last_undegraded":"2023-12-15T23:56:20.334729+0000","last_fullsized":"2023-12-15T23:56:20.334729+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:44.091525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1396,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350460+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:56:55.350460+0000","last_peered":"2023-12-15T23:56:55.350460+0000","last_clean":"2023-12-15T23:56:55.350460+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:56:55.350460+0000","last_undegraded":"2023-12-15T23:56:55.350460+0000","last_fullsized":"2023-12-15T23:56:55.350460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:24.099749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345610+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:57:05.345610+0000","last_peered":"2023-12-15T23:57:05.345610+0000","last_clean":"2023-12-15T23:57:05.345610+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:57:05.345610+0000","last_undegraded":"2023-12-15T23:57:05.345610+0000","last_fullsized":"2023-12-15T23:57:05.345610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:44.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345642+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-15T23:56:35.345642+0000","last_peered":"2023-12-15T23:56:35.345642+0000","last_clean":"2023-12-15T23:56:35.345642+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-15T23:56:35.345642+0000","last_undegraded":"2023-12-15T23:56:35.345642+0000","last_fullsized":"2023-12-15T23:56:35.345642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:51.588416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565447+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-15T23:56:30.565447+0000","last_peered":"2023-12-15T23:56:30.565447+0000","last_clean":"2023-12-15T23:56:30.565447+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-15T23:56:30.565447+0000","last_undegraded":"2023-12-15T23:56:30.565447+0000","last_fullsized":"2023-12-15T23:56:30.565447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:16.498260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'508","reported_seq":744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335339+0000","last_change":"2023-12-15T22:53:28.169971+0000","last_active":"2023-12-15T23:56:31.335339+0000","last_peered":"2023-12-15T23:56:31.335339+0000","last_clean":"2023-12-15T23:56:31.335339+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-15T23:56:31.335339+0000","last_undegraded":"2023-12-15T23:56:31.335339+0000","last_fullsized":"2023-12-15T23:56:31.335339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:31.067844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342241+0000","last_change":"2023-12-15T22:53:26.156857+0000","last_active":"2023-12-15T23:56:25.342241+0000","last_peered":"2023-12-15T23:56:25.342241+0000","last_clean":"2023-12-15T23:56:25.342241+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-15T23:56:25.342241+0000","last_undegraded":"2023-12-15T23:56:25.342241+0000","last_fullsized":"2023-12-15T23:56:25.342241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359851+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:57:30.359851+0000","last_peered":"2023-12-15T23:57:30.359851+0000","last_clean":"2023-12-15T23:57:30.359851+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:57:30.359851+0000","last_undegraded":"2023-12-15T23:57:30.359851+0000","last_fullsized":"2023-12-15T23:57:30.359851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581105+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:57:30.581105+0000","last_peered":"2023-12-15T23:57:30.581105+0000","last_clean":"2023-12-15T23:57:30.581105+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:57:30.581105+0000","last_undegraded":"2023-12-15T23:57:30.581105+0000","last_fullsized":"2023-12-15T23:57:30.581105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.352632+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:57:05.352632+0000","last_peered":"2023-12-15T23:57:05.352632+0000","last_clean":"2023-12-15T23:57:05.352632+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:57:05.352632+0000","last_undegraded":"2023-12-15T23:57:05.352632+0000","last_fullsized":"2023-12-15T23:57:05.352632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:20.385525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361386+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:57:40.361386+0000","last_peered":"2023-12-15T23:57:40.361386+0000","last_clean":"2023-12-15T23:57:40.361386+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:57:40.361386+0000","last_undegraded":"2023-12-15T23:57:40.361386+0000","last_fullsized":"2023-12-15T23:57:40.361386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584426+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:57:45.584426+0000","last_peered":"2023-12-15T23:57:45.584426+0000","last_clean":"2023-12-15T23:57:45.584426+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:57:45.584426+0000","last_undegraded":"2023-12-15T23:57:45.584426+0000","last_fullsized":"2023-12-15T23:57:45.584426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:26.178233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357505+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:57:25.357505+0000","last_peered":"2023-12-15T23:57:25.357505+0000","last_clean":"2023-12-15T23:57:25.357505+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:57:25.357505+0000","last_undegraded":"2023-12-15T23:57:25.357505+0000","last_fullsized":"2023-12-15T23:57:25.357505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343680+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-15T23:56:25.343680+0000","last_peered":"2023-12-15T23:56:25.343680+0000","last_clean":"2023-12-15T23:56:25.343680+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-15T23:56:25.343680+0000","last_undegraded":"2023-12-15T23:56:25.343680+0000","last_fullsized":"2023-12-15T23:56:25.343680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:25.822041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341365+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-15T23:56:20.341365+0000","last_peered":"2023-12-15T23:56:20.341365+0000","last_clean":"2023-12-15T23:56:20.341365+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-15T23:56:20.341365+0000","last_undegraded":"2023-12-15T23:56:20.341365+0000","last_fullsized":"2023-12-15T23:56:20.341365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:41:05.257834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350550+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:56:55.350550+0000","last_peered":"2023-12-15T23:56:55.350550+0000","last_clean":"2023-12-15T23:56:55.350550+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:56:55.350550+0000","last_undegraded":"2023-12-15T23:56:55.350550+0000","last_fullsized":"2023-12-15T23:56:55.350550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351153+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:57:00.351153+0000","last_peered":"2023-12-15T23:57:00.351153+0000","last_clean":"2023-12-15T23:57:00.351153+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:57:00.351153+0000","last_undegraded":"2023-12-15T23:57:00.351153+0000","last_fullsized":"2023-12-15T23:57:00.351153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339623+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-15T23:56:40.339623+0000","last_peered":"2023-12-15T23:56:40.339623+0000","last_clean":"2023-12-15T23:56:40.339623+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-15T23:56:40.339623+0000","last_undegraded":"2023-12-15T23:56:40.339623+0000","last_fullsized":"2023-12-15T23:56:40.339623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:10.253710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337454+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-15T23:56:30.337454+0000","last_peered":"2023-12-15T23:56:30.337454+0000","last_clean":"2023-12-15T23:56:30.337454+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-15T23:56:30.337454+0000","last_undegraded":"2023-12-15T23:56:30.337454+0000","last_fullsized":"2023-12-15T23:56:30.337454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:22.564483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'257","reported_seq":415,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335270+0000","last_change":"2023-12-15T22:53:28.170194+0000","last_active":"2023-12-15T23:56:31.335270+0000","last_peered":"2023-12-15T23:56:31.335270+0000","last_clean":"2023-12-15T23:56:31.335270+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-15T23:56:31.335270+0000","last_undegraded":"2023-12-15T23:56:31.335270+0000","last_fullsized":"2023-12-15T23:56:31.335270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:38.876935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.347230+0000","last_change":"2023-12-15T22:53:26.165429+0000","last_active":"2023-12-15T23:56:40.347230+0000","last_peered":"2023-12-15T23:56:40.347230+0000","last_clean":"2023-12-15T23:56:40.347230+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-15T23:56:40.347230+0000","last_undegraded":"2023-12-15T23:56:40.347230+0000","last_fullsized":"2023-12-15T23:56:40.347230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580909+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:57:30.580909+0000","last_peered":"2023-12-15T23:57:30.580909+0000","last_clean":"2023-12-15T23:57:30.580909+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:57:30.580909+0000","last_undegraded":"2023-12-15T23:57:30.580909+0000","last_fullsized":"2023-12-15T23:57:30.580909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362785+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:57:45.362785+0000","last_peered":"2023-12-15T23:57:45.362785+0000","last_clean":"2023-12-15T23:57:45.362785+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:57:45.362785+0000","last_undegraded":"2023-12-15T23:57:45.362785+0000","last_fullsized":"2023-12-15T23:57:45.362785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354594+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:57:10.354594+0000","last_peered":"2023-12-15T23:57:10.354594+0000","last_clean":"2023-12-15T23:57:10.354594+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:57:10.354594+0000","last_undegraded":"2023-12-15T23:57:10.354594+0000","last_fullsized":"2023-12-15T23:57:10.354594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362345+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:57:40.362345+0000","last_peered":"2023-12-15T23:57:40.362345+0000","last_clean":"2023-12-15T23:57:40.362345+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:57:40.362345+0000","last_undegraded":"2023-12-15T23:57:40.362345+0000","last_fullsized":"2023-12-15T23:57:40.362345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.358388+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:57:25.358388+0000","last_peered":"2023-12-15T23:57:25.358388+0000","last_clean":"2023-12-15T23:57:25.358388+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:57:25.358388+0000","last_undegraded":"2023-12-15T23:57:25.358388+0000","last_fullsized":"2023-12-15T23:57:25.358388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353727+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:57:46.353727+0000","last_peered":"2023-12-15T23:57:46.353727+0000","last_clean":"2023-12-15T23:57:46.353727+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:57:46.353727+0000","last_undegraded":"2023-12-15T23:57:46.353727+0000","last_fullsized":"2023-12-15T23:57:46.353727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:28.187833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339815+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-15T23:56:10.339815+0000","last_peered":"2023-12-15T23:56:10.339815+0000","last_clean":"2023-12-15T23:56:10.339815+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-15T23:56:10.339815+0000","last_undegraded":"2023-12-15T23:56:10.339815+0000","last_fullsized":"2023-12-15T23:56:10.339815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:12.734358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351687+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:57:00.351687+0000","last_peered":"2023-12-15T23:57:00.351687+0000","last_clean":"2023-12-15T23:57:00.351687+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:57:00.351687+0000","last_undegraded":"2023-12-15T23:57:00.351687+0000","last_fullsized":"2023-12-15T23:57:00.351687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:08.485765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6349,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.332807+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-15T23:55:45.332807+0000","last_peered":"2023-12-15T23:55:45.332807+0000","last_clean":"2023-12-15T23:55:45.332807+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-15T23:55:45.332807+0000","last_undegraded":"2023-12-15T23:55:45.332807+0000","last_fullsized":"2023-12-15T23:55:45.332807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:16.965706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565280+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:56:30.565280+0000","last_peered":"2023-12-15T23:56:30.565280+0000","last_clean":"2023-12-15T23:56:30.565280+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:56:30.565280+0000","last_undegraded":"2023-12-15T23:56:30.565280+0000","last_fullsized":"2023-12-15T23:56:30.565280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:58.613135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327858+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-15T23:56:01.327858+0000","last_peered":"2023-12-15T23:56:01.327858+0000","last_clean":"2023-12-15T23:56:01.327858+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-15T23:56:01.327858+0000","last_undegraded":"2023-12-15T23:56:01.327858+0000","last_fullsized":"2023-12-15T23:56:01.327858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:26.351832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337075+0000","last_change":"2023-12-15T22:53:30.176406+0000","last_active":"2023-12-15T23:56:00.337075+0000","last_peered":"2023-12-15T23:56:00.337075+0000","last_clean":"2023-12-15T23:56:00.337075+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-15T23:56:00.337075+0000","last_undegraded":"2023-12-15T23:56:00.337075+0000","last_fullsized":"2023-12-15T23:56:00.337075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'664","reported_seq":1171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327978+0000","last_change":"2023-12-15T22:53:28.170239+0000","last_active":"2023-12-15T23:56:01.327978+0000","last_peered":"2023-12-15T23:56:01.327978+0000","last_clean":"2023-12-15T23:56:01.327978+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-15T23:56:01.327978+0000","last_undegraded":"2023-12-15T23:56:01.327978+0000","last_fullsized":"2023-12-15T23:56:01.327978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:43.649404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362601+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:57:40.362601+0000","last_peered":"2023-12-15T23:57:40.362601+0000","last_clean":"2023-12-15T23:57:40.362601+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:57:40.362601+0000","last_undegraded":"2023-12-15T23:57:40.362601+0000","last_fullsized":"2023-12-15T23:57:40.362601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:07:47.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.364059+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:57:45.364059+0000","last_peered":"2023-12-15T23:57:45.364059+0000","last_clean":"2023-12-15T23:57:45.364059+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:57:45.364059+0000","last_undegraded":"2023-12-15T23:57:45.364059+0000","last_fullsized":"2023-12-15T23:57:45.364059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:17:53.191887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326479+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-15T23:55:56.326479+0000","last_peered":"2023-12-15T23:55:56.326479+0000","last_clean":"2023-12-15T23:55:56.326479+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-15T23:55:56.326479+0000","last_undegraded":"2023-12-15T23:55:56.326479+0000","last_fullsized":"2023-12-15T23:55:56.326479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338312+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-15T23:56:10.338312+0000","last_peered":"2023-12-15T23:56:10.338312+0000","last_clean":"2023-12-15T23:56:10.338312+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-15T23:56:10.338312+0000","last_undegraded":"2023-12-15T23:56:10.338312+0000","last_fullsized":"2023-12-15T23:56:10.338312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558965+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-15T23:56:05.558965+0000","last_peered":"2023-12-15T23:56:05.558965+0000","last_clean":"2023-12-15T23:56:05.558965+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-15T23:56:05.558965+0000","last_undegraded":"2023-12-15T23:56:05.558965+0000","last_fullsized":"2023-12-15T23:56:05.558965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.340685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332420+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-15T23:56:10.332420+0000","last_peered":"2023-12-15T23:56:10.332420+0000","last_clean":"2023-12-15T23:56:10.332420+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-15T23:56:10.332420+0000","last_undegraded":"2023-12-15T23:56:10.332420+0000","last_fullsized":"2023-12-15T23:56:10.332420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:32.639017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560105+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-15T23:56:10.560105+0000","last_peered":"2023-12-15T23:56:10.560105+0000","last_clean":"2023-12-15T23:56:10.560105+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-15T23:56:10.560105+0000","last_undegraded":"2023-12-15T23:56:10.560105+0000","last_fullsized":"2023-12-15T23:56:10.560105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:15.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:11.344902+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:57:11.344902+0000","last_peered":"2023-12-15T23:57:11.344902+0000","last_clean":"2023-12-15T23:57:11.344902+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:57:11.344902+0000","last_undegraded":"2023-12-15T23:57:11.344902+0000","last_fullsized":"2023-12-15T23:57:11.344902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:19:56.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6459,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.571801+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:56:55.571801+0000","last_peered":"2023-12-15T23:56:55.571801+0000","last_clean":"2023-12-15T23:56:55.571801+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:56:55.571801+0000","last_undegraded":"2023-12-15T23:56:55.571801+0000","last_fullsized":"2023-12-15T23:56:55.571801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335217+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:56:31.335217+0000","last_peered":"2023-12-15T23:56:31.335217+0000","last_clean":"2023-12-15T23:56:31.335217+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:56:31.335217+0000","last_undegraded":"2023-12-15T23:56:31.335217+0000","last_fullsized":"2023-12-15T23:56:31.335217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:41.316820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327752+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-15T23:56:01.327752+0000","last_peered":"2023-12-15T23:56:01.327752+0000","last_clean":"2023-12-15T23:56:01.327752+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-15T23:56:01.327752+0000","last_undegraded":"2023-12-15T23:56:01.327752+0000","last_fullsized":"2023-12-15T23:56:01.327752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:21.948714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335881+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-15T23:56:00.335881+0000","last_peered":"2023-12-15T23:56:00.335881+0000","last_clean":"2023-12-15T23:56:00.335881+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-15T23:56:00.335881+0000","last_undegraded":"2023-12-15T23:56:00.335881+0000","last_fullsized":"2023-12-15T23:56:00.335881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:21.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'305","reported_seq":1269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337063+0000","last_change":"2023-12-15T22:53:28.171127+0000","last_active":"2023-12-15T23:56:00.337063+0000","last_peered":"2023-12-15T23:56:00.337063+0000","last_clean":"2023-12-15T23:56:00.337063+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-15T23:56:00.337063+0000","last_undegraded":"2023-12-15T23:56:00.337063+0000","last_fullsized":"2023-12-15T23:56:00.337063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:34.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:36.351648+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:57:36.351648+0000","last_peered":"2023-12-15T23:57:36.351648+0000","last_clean":"2023-12-15T23:57:36.351648+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:57:36.351648+0000","last_undegraded":"2023-12-15T23:57:36.351648+0000","last_fullsized":"2023-12-15T23:57:36.351648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:10.880484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578776+0000","last_change":"2023-12-15T22:53:10.339946+0000","last_active":"2023-12-15T23:57:20.578776+0000","last_peered":"2023-12-15T23:57:20.578776+0000","last_clean":"2023-12-15T23:57:20.578776+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-15T23:57:20.578776+0000","last_undegraded":"2023-12-15T23:57:20.578776+0000","last_fullsized":"2023-12-15T23:57:20.578776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556705+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-15T23:55:55.556705+0000","last_peered":"2023-12-15T23:55:55.556705+0000","last_clean":"2023-12-15T23:55:55.556705+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-15T23:55:55.556705+0000","last_undegraded":"2023-12-15T23:55:55.556705+0000","last_fullsized":"2023-12-15T23:55:55.556705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331477+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-15T23:55:45.331477+0000","last_peered":"2023-12-15T23:55:45.331477+0000","last_clean":"2023-12-15T23:55:45.331477+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-15T23:55:45.331477+0000","last_undegraded":"2023-12-15T23:55:45.331477+0000","last_fullsized":"2023-12-15T23:55:45.331477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559062+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-15T23:56:05.559062+0000","last_peered":"2023-12-15T23:56:05.559062+0000","last_clean":"2023-12-15T23:56:05.559062+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-15T23:56:05.559062+0000","last_undegraded":"2023-12-15T23:56:05.559062+0000","last_fullsized":"2023-12-15T23:56:05.559062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:07.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339351+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-15T23:56:10.339351+0000","last_peered":"2023-12-15T23:56:10.339351+0000","last_clean":"2023-12-15T23:56:10.339351+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-15T23:56:10.339351+0000","last_undegraded":"2023-12-15T23:56:10.339351+0000","last_fullsized":"2023-12-15T23:56:10.339351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338079+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-15T23:56:10.338079+0000","last_peered":"2023-12-15T23:56:10.338079+0000","last_clean":"2023-12-15T23:56:10.338079+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-15T23:56:10.338079+0000","last_undegraded":"2023-12-15T23:56:10.338079+0000","last_fullsized":"2023-12-15T23:56:10.338079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339159+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:56:10.339159+0000","last_peered":"2023-12-15T23:56:10.339159+0000","last_clean":"2023-12-15T23:56:10.339159+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:56:10.339159+0000","last_undegraded":"2023-12-15T23:56:10.339159+0000","last_fullsized":"2023-12-15T23:56:10.339159+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:33.647312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566664+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:56:35.566664+0000","last_peered":"2023-12-15T23:56:35.566664+0000","last_clean":"2023-12-15T23:56:35.566664+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:56:35.566664+0000","last_undegraded":"2023-12-15T23:56:35.566664+0000","last_fullsized":"2023-12-15T23:56:35.566664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:16.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349198+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:56:50.349198+0000","last_peered":"2023-12-15T23:56:50.349198+0000","last_clean":"2023-12-15T23:56:50.349198+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:56:50.349198+0000","last_undegraded":"2023-12-15T23:56:50.349198+0000","last_fullsized":"2023-12-15T23:56:50.349198+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:05.435125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346684+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:56:40.346684+0000","last_peered":"2023-12-15T23:56:40.346684+0000","last_clean":"2023-12-15T23:56:40.346684+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:56:40.346684+0000","last_undegraded":"2023-12-15T23:56:40.346684+0000","last_fullsized":"2023-12-15T23:56:40.346684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362877+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:57:45.362877+0000","last_peered":"2023-12-15T23:57:45.362877+0000","last_clean":"2023-12-15T23:57:45.362877+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:57:45.362877+0000","last_undegraded":"2023-12-15T23:57:45.362877+0000","last_fullsized":"2023-12-15T23:57:45.362877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:51:36.640304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":378,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368919+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-15T23:58:05.368919+0000","last_peered":"2023-12-15T23:58:05.368919+0000","last_clean":"2023-12-15T23:58:05.368919+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-15T23:58:05.368919+0000","last_undegraded":"2023-12-15T23:58:05.368919+0000","last_fullsized":"2023-12-15T23:58:05.368919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'13","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336008+0000","last_change":"2023-12-15T22:53:26.159079+0000","last_active":"2023-12-15T23:55:55.336008+0000","last_peered":"2023-12-15T23:55:55.336008+0000","last_clean":"2023-12-15T23:55:55.336008+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-15T23:55:55.336008+0000","last_undegraded":"2023-12-15T23:55:55.336008+0000","last_fullsized":"2023-12-15T23:55:55.336008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:12.478013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332497+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-15T23:55:40.332497+0000","last_peered":"2023-12-15T23:55:40.332497+0000","last_clean":"2023-12-15T23:55:40.332497+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-15T23:55:40.332497+0000","last_undegraded":"2023-12-15T23:55:40.332497+0000","last_fullsized":"2023-12-15T23:55:40.332497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328561+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-15T23:55:55.328561+0000","last_peered":"2023-12-15T23:55:55.328561+0000","last_clean":"2023-12-15T23:55:55.328561+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-15T23:55:55.328561+0000","last_undegraded":"2023-12-15T23:55:55.328561+0000","last_fullsized":"2023-12-15T23:55:55.328561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:40.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333269+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-15T23:55:45.333269+0000","last_peered":"2023-12-15T23:55:45.333269+0000","last_clean":"2023-12-15T23:55:45.333269+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-15T23:55:45.333269+0000","last_undegraded":"2023-12-15T23:55:45.333269+0000","last_fullsized":"2023-12-15T23:55:45.333269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.328850+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-15T23:56:06.328850+0000","last_peered":"2023-12-15T23:56:06.328850+0000","last_clean":"2023-12-15T23:56:06.328850+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-15T23:56:06.328850+0000","last_undegraded":"2023-12-15T23:56:06.328850+0000","last_fullsized":"2023-12-15T23:56:06.328850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:47.168313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332639+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-15T23:56:10.332639+0000","last_peered":"2023-12-15T23:56:10.332639+0000","last_clean":"2023-12-15T23:56:10.332639+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-15T23:56:10.332639+0000","last_undegraded":"2023-12-15T23:56:10.332639+0000","last_fullsized":"2023-12-15T23:56:10.332639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:04.124976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339169+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-15T23:56:10.339169+0000","last_peered":"2023-12-15T23:56:10.339169+0000","last_clean":"2023-12-15T23:56:10.339169+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-15T23:56:10.339169+0000","last_undegraded":"2023-12-15T23:56:10.339169+0000","last_fullsized":"2023-12-15T23:56:10.339169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:27.858155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338272+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:56:10.338272+0000","last_peered":"2023-12-15T23:56:10.338272+0000","last_clean":"2023-12-15T23:56:10.338272+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:56:10.338272+0000","last_undegraded":"2023-12-15T23:56:10.338272+0000","last_fullsized":"2023-12-15T23:56:10.338272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:45:30.242778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1074,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360241+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-15T23:57:35.360241+0000","last_peered":"2023-12-15T23:57:35.360241+0000","last_clean":"2023-12-15T23:57:35.360241+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-15T23:57:35.360241+0000","last_undegraded":"2023-12-15T23:57:35.360241+0000","last_fullsized":"2023-12-15T23:57:35.360241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:36.880386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345517+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:57:05.345517+0000","last_peered":"2023-12-15T23:57:05.345517+0000","last_clean":"2023-12-15T23:57:05.345517+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:57:05.345517+0000","last_undegraded":"2023-12-15T23:57:05.345517+0000","last_fullsized":"2023-12-15T23:57:05.345517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:04.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.563776+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:56:25.563776+0000","last_peered":"2023-12-15T23:56:25.563776+0000","last_clean":"2023-12-15T23:56:25.563776+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:56:25.563776+0000","last_undegraded":"2023-12-15T23:56:25.563776+0000","last_fullsized":"2023-12-15T23:56:25.563776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:40:17.731463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359433+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-15T23:58:05.359433+0000","last_peered":"2023-12-15T23:58:05.359433+0000","last_clean":"2023-12-15T23:58:05.359433+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-15T23:58:05.359433+0000","last_undegraded":"2023-12-15T23:58:05.359433+0000","last_fullsized":"2023-12-15T23:58:05.359433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:53.623883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'241","reported_seq":382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363959+0000","last_change":"2023-12-15T22:53:28.167550+0000","last_active":"2023-12-15T23:57:45.363959+0000","last_peered":"2023-12-15T23:57:45.363959+0000","last_clean":"2023-12-15T23:57:45.363959+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-15T23:57:45.363959+0000","last_undegraded":"2023-12-15T23:57:45.363959+0000","last_fullsized":"2023-12-15T23:57:45.363959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336091+0000","last_change":"2023-12-15T22:53:26.159624+0000","last_active":"2023-12-15T23:55:55.336091+0000","last_peered":"2023-12-15T23:55:55.336091+0000","last_clean":"2023-12-15T23:55:55.336091+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-15T23:55:55.336091+0000","last_undegraded":"2023-12-15T23:55:55.336091+0000","last_fullsized":"2023-12-15T23:55:55.336091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:17.442064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.331897+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-15T23:55:40.331897+0000","last_peered":"2023-12-15T23:55:40.331897+0000","last_clean":"2023-12-15T23:55:40.331897+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-15T23:55:40.331897+0000","last_undegraded":"2023-12-15T23:55:40.331897+0000","last_fullsized":"2023-12-15T23:55:40.331897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556515+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-15T23:55:55.556515+0000","last_peered":"2023-12-15T23:55:55.556515+0000","last_clean":"2023-12-15T23:55:55.556515+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-15T23:55:55.556515+0000","last_undegraded":"2023-12-15T23:55:55.556515+0000","last_fullsized":"2023-12-15T23:55:55.556515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333945+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-15T23:55:45.333945+0000","last_peered":"2023-12-15T23:55:45.333945+0000","last_clean":"2023-12-15T23:55:45.333945+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-15T23:55:45.333945+0000","last_undegraded":"2023-12-15T23:55:45.333945+0000","last_fullsized":"2023-12-15T23:55:45.333945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:32.086477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.336769+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-15T23:56:05.336769+0000","last_peered":"2023-12-15T23:56:05.336769+0000","last_clean":"2023-12-15T23:56:05.336769+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-15T23:56:05.336769+0000","last_undegraded":"2023-12-15T23:56:05.336769+0000","last_fullsized":"2023-12-15T23:56:05.336769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339145+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-15T23:56:10.339145+0000","last_peered":"2023-12-15T23:56:10.339145+0000","last_clean":"2023-12-15T23:56:10.339145+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-15T23:56:10.339145+0000","last_undegraded":"2023-12-15T23:56:10.339145+0000","last_fullsized":"2023-12-15T23:56:10.339145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339600+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-15T23:56:10.339600+0000","last_peered":"2023-12-15T23:56:10.339600+0000","last_clean":"2023-12-15T23:56:10.339600+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-15T23:56:10.339600+0000","last_undegraded":"2023-12-15T23:56:10.339600+0000","last_fullsized":"2023-12-15T23:56:10.339600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:50.364535+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-15T23:57:50.364535+0000","last_peered":"2023-12-15T23:57:50.364535+0000","last_clean":"2023-12-15T23:57:50.364535+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-15T23:57:50.364535+0000","last_undegraded":"2023-12-15T23:57:50.364535+0000","last_fullsized":"2023-12-15T23:57:50.364535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.349901+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:56:55.349901+0000","last_peered":"2023-12-15T23:56:55.349901+0000","last_clean":"2023-12-15T23:56:55.349901+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:56:55.349901+0000","last_undegraded":"2023-12-15T23:56:55.349901+0000","last_fullsized":"2023-12-15T23:56:55.349901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349864+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:56:50.349864+0000","last_peered":"2023-12-15T23:56:50.349864+0000","last_clean":"2023-12-15T23:56:50.349864+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:56:50.349864+0000","last_undegraded":"2023-12-15T23:56:50.349864+0000","last_fullsized":"2023-12-15T23:56:50.349864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:21.333233+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:56:21.333233+0000","last_peered":"2023-12-15T23:56:21.333233+0000","last_clean":"2023-12-15T23:56:21.333233+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:56:21.333233+0000","last_undegraded":"2023-12-15T23:56:21.333233+0000","last_fullsized":"2023-12-15T23:56:21.333233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:38.871309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344252+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:56:30.344252+0000","last_peered":"2023-12-15T23:56:30.344252+0000","last_clean":"2023-12-15T23:56:30.344252+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:56:30.344252+0000","last_undegraded":"2023-12-15T23:56:30.344252+0000","last_fullsized":"2023-12-15T23:56:30.344252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1842","reported_seq":2750,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344111+0000","last_change":"2023-12-15T22:53:28.170890+0000","last_active":"2023-12-15T23:56:30.344111+0000","last_peered":"2023-12-15T23:56:30.344111+0000","last_clean":"2023-12-15T23:56:30.344111+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-15T23:56:30.344111+0000","last_undegraded":"2023-12-15T23:56:30.344111+0000","last_fullsized":"2023-12-15T23:56:30.344111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:16.035980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343005+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-15T23:56:25.343005+0000","last_peered":"2023-12-15T23:56:25.343005+0000","last_clean":"2023-12-15T23:56:25.343005+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-15T23:56:25.343005+0000","last_undegraded":"2023-12-15T23:56:25.343005+0000","last_fullsized":"2023-12-15T23:56:25.343005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359523+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:57:30.359523+0000","last_peered":"2023-12-15T23:57:30.359523+0000","last_clean":"2023-12-15T23:57:30.359523+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:57:30.359523+0000","last_undegraded":"2023-12-15T23:57:30.359523+0000","last_fullsized":"2023-12-15T23:57:30.359523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:26.930020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326348+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-15T23:55:45.326348+0000","last_peered":"2023-12-15T23:55:45.326348+0000","last_clean":"2023-12-15T23:55:45.326348+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-15T23:55:45.326348+0000","last_undegraded":"2023-12-15T23:55:45.326348+0000","last_fullsized":"2023-12-15T23:55:45.326348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:43.407151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.357609+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:57:20.357609+0000","last_peered":"2023-12-15T23:57:20.357609+0000","last_clean":"2023-12-15T23:57:20.357609+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:57:20.357609+0000","last_undegraded":"2023-12-15T23:57:20.357609+0000","last_fullsized":"2023-12-15T23:57:20.357609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552614+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-15T23:55:40.552614+0000","last_peered":"2023-12-15T23:55:40.552614+0000","last_clean":"2023-12-15T23:55:40.552614+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-15T23:55:40.552614+0000","last_undegraded":"2023-12-15T23:55:40.552614+0000","last_fullsized":"2023-12-15T23:55:40.552614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329954+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-15T23:55:40.329954+0000","last_peered":"2023-12-15T23:55:40.329954+0000","last_clean":"2023-12-15T23:55:40.329954+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-15T23:55:40.329954+0000","last_undegraded":"2023-12-15T23:55:40.329954+0000","last_fullsized":"2023-12-15T23:55:40.329954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560395+0000","last_change":"2023-12-15T22:53:11.078111+0000","last_active":"2023-12-15T23:56:10.560395+0000","last_peered":"2023-12-15T23:56:10.560395+0000","last_clean":"2023-12-15T23:56:10.560395+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-15T23:56:10.560395+0000","last_undegraded":"2023-12-15T23:56:10.560395+0000","last_fullsized":"2023-12-15T23:56:10.560395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351884+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:57:00.351884+0000","last_peered":"2023-12-15T23:57:00.351884+0000","last_clean":"2023-12-15T23:57:00.351884+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:57:00.351884+0000","last_undegraded":"2023-12-15T23:57:00.351884+0000","last_fullsized":"2023-12-15T23:57:00.351884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:35.240310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4381,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.347747+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:57:21.347747+0000","last_peered":"2023-12-15T23:57:21.347747+0000","last_clean":"2023-12-15T23:57:21.347747+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:57:21.347747+0000","last_undegraded":"2023-12-15T23:57:21.347747+0000","last_fullsized":"2023-12-15T23:57:21.347747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:58.493238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349786+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:56:50.349786+0000","last_peered":"2023-12-15T23:56:50.349786+0000","last_clean":"2023-12-15T23:56:50.349786+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:56:50.349786+0000","last_undegraded":"2023-12-15T23:56:50.349786+0000","last_fullsized":"2023-12-15T23:56:50.349786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:42.139142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343348+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:56:25.343348+0000","last_peered":"2023-12-15T23:56:25.343348+0000","last_clean":"2023-12-15T23:56:25.343348+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:56:25.343348+0000","last_undegraded":"2023-12-15T23:56:25.343348+0000","last_fullsized":"2023-12-15T23:56:25.343348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:06.358488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337251+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:56:30.337251+0000","last_peered":"2023-12-15T23:56:30.337251+0000","last_clean":"2023-12-15T23:56:30.337251+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:56:30.337251+0000","last_undegraded":"2023-12-15T23:56:30.337251+0000","last_fullsized":"2023-12-15T23:56:30.337251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:33.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2119","reported_seq":2950,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335033+0000","last_change":"2023-12-15T22:53:28.169796+0000","last_active":"2023-12-15T23:56:31.335033+0000","last_peered":"2023-12-15T23:56:31.335033+0000","last_clean":"2023-12-15T23:56:31.335033+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-15T23:56:31.335033+0000","last_undegraded":"2023-12-15T23:56:31.335033+0000","last_fullsized":"2023-12-15T23:56:31.335033+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":400,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:11.825688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'5","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342010+0000","last_change":"2023-12-15T22:53:26.156319+0000","last_active":"2023-12-15T23:56:25.342010+0000","last_peered":"2023-12-15T23:56:25.342010+0000","last_clean":"2023-12-15T23:56:25.342010+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-15T23:56:25.342010+0000","last_undegraded":"2023-12-15T23:56:25.342010+0000","last_fullsized":"2023-12-15T23:56:25.342010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354866+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:57:10.354866+0000","last_peered":"2023-12-15T23:57:10.354866+0000","last_clean":"2023-12-15T23:57:10.354866+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:57:10.354866+0000","last_undegraded":"2023-12-15T23:57:10.354866+0000","last_fullsized":"2023-12-15T23:57:10.354866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556585+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-15T23:55:55.556585+0000","last_peered":"2023-12-15T23:55:55.556585+0000","last_clean":"2023-12-15T23:55:55.556585+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-15T23:55:55.556585+0000","last_undegraded":"2023-12-15T23:55:55.556585+0000","last_fullsized":"2023-12-15T23:55:55.556585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362341+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:57:40.362341+0000","last_peered":"2023-12-15T23:57:40.362341+0000","last_clean":"2023-12-15T23:57:40.362341+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:57:40.362341+0000","last_undegraded":"2023-12-15T23:57:40.362341+0000","last_fullsized":"2023-12-15T23:57:40.362341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:38.848380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329967+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-15T23:55:40.329967+0000","last_peered":"2023-12-15T23:55:40.329967+0000","last_clean":"2023-12-15T23:55:40.329967+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-15T23:55:40.329967+0000","last_undegraded":"2023-12-15T23:55:40.329967+0000","last_fullsized":"2023-12-15T23:55:40.329967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:43.553443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552603+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-15T23:55:40.552603+0000","last_peered":"2023-12-15T23:55:40.552603+0000","last_clean":"2023-12-15T23:55:40.552603+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-15T23:55:40.552603+0000","last_undegraded":"2023-12-15T23:55:40.552603+0000","last_fullsized":"2023-12-15T23:55:40.552603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:59.504031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338205+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-15T23:56:10.338205+0000","last_peered":"2023-12-15T23:56:10.338205+0000","last_clean":"2023-12-15T23:56:10.338205+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-15T23:56:10.338205+0000","last_undegraded":"2023-12-15T23:56:10.338205+0000","last_fullsized":"2023-12-15T23:56:10.338205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:45:21.838509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352260+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:57:00.352260+0000","last_peered":"2023-12-15T23:57:00.352260+0000","last_clean":"2023-12-15T23:57:00.352260+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:57:00.352260+0000","last_undegraded":"2023-12-15T23:57:00.352260+0000","last_fullsized":"2023-12-15T23:57:00.352260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:00.386613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1324,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572418+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:56:55.572418+0000","last_peered":"2023-12-15T23:56:55.572418+0000","last_clean":"2023-12-15T23:56:55.572418+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:56:55.572418+0000","last_undegraded":"2023-12-15T23:56:55.572418+0000","last_fullsized":"2023-12-15T23:56:55.572418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:23.586325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.356017+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:57:15.356017+0000","last_peered":"2023-12-15T23:57:15.356017+0000","last_clean":"2023-12-15T23:57:15.356017+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:57:15.356017+0000","last_undegraded":"2023-12-15T23:57:15.356017+0000","last_fullsized":"2023-12-15T23:57:15.356017+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343275+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:56:25.343275+0000","last_peered":"2023-12-15T23:56:25.343275+0000","last_clean":"2023-12-15T23:56:25.343275+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:56:25.343275+0000","last_undegraded":"2023-12-15T23:56:25.343275+0000","last_fullsized":"2023-12-15T23:56:25.343275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:25.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343129+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:56:30.343129+0000","last_peered":"2023-12-15T23:56:30.343129+0000","last_clean":"2023-12-15T23:56:30.343129+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:56:30.343129+0000","last_undegraded":"2023-12-15T23:56:30.343129+0000","last_fullsized":"2023-12-15T23:56:30.343129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:30.622729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":362,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565404+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:56:30.565404+0000","last_peered":"2023-12-15T23:56:30.565404+0000","last_clean":"2023-12-15T23:56:30.565404+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:56:30.565404+0000","last_undegraded":"2023-12-15T23:56:30.565404+0000","last_fullsized":"2023-12-15T23:56:30.565404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:28.380180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334009+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-15T23:56:26.334009+0000","last_peered":"2023-12-15T23:56:26.334009+0000","last_clean":"2023-12-15T23:56:26.334009+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-15T23:56:26.334009+0000","last_undegraded":"2023-12-15T23:56:26.334009+0000","last_fullsized":"2023-12-15T23:56:26.334009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:06.119748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328597+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-15T23:55:25.328597+0000","last_peered":"2023-12-15T23:55:25.328597+0000","last_clean":"2023-12-15T23:55:25.328597+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-15T23:55:25.328597+0000","last_undegraded":"2023-12-15T23:55:25.328597+0000","last_fullsized":"2023-12-15T23:55:25.328597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318664+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-15T23:55:26.318664+0000","last_peered":"2023-12-15T23:55:26.318664+0000","last_clean":"2023-12-15T23:55:26.318664+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-15T23:55:26.318664+0000","last_undegraded":"2023-12-15T23:55:26.318664+0000","last_fullsized":"2023-12-15T23:55:26.318664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321741+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-15T23:55:36.321741+0000","last_peered":"2023-12-15T23:55:36.321741+0000","last_clean":"2023-12-15T23:55:36.321741+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-15T23:55:36.321741+0000","last_undegraded":"2023-12-15T23:55:36.321741+0000","last_fullsized":"2023-12-15T23:55:36.321741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:50.986250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354891+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:57:45.354891+0000","last_peered":"2023-12-15T23:57:45.354891+0000","last_clean":"2023-12-15T23:57:45.354891+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:57:45.354891+0000","last_undegraded":"2023-12-15T23:57:45.354891+0000","last_fullsized":"2023-12-15T23:57:45.354891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:50.449966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578797+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:57:20.578797+0000","last_peered":"2023-12-15T23:57:20.578797+0000","last_clean":"2023-12-15T23:57:20.578797+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:57:20.578797+0000","last_undegraded":"2023-12-15T23:57:20.578797+0000","last_fullsized":"2023-12-15T23:57:20.578797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338114+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-15T23:56:10.338114+0000","last_peered":"2023-12-15T23:56:10.338114+0000","last_clean":"2023-12-15T23:56:10.338114+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-15T23:56:10.338114+0000","last_undegraded":"2023-12-15T23:56:10.338114+0000","last_fullsized":"2023-12-15T23:56:10.338114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:10:20.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342768+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:57:01.342768+0000","last_peered":"2023-12-15T23:57:01.342768+0000","last_clean":"2023-12-15T23:57:01.342768+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:57:01.342768+0000","last_undegraded":"2023-12-15T23:57:01.342768+0000","last_fullsized":"2023-12-15T23:57:01.342768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3844,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572342+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:56:55.572342+0000","last_peered":"2023-12-15T23:56:55.572342+0000","last_clean":"2023-12-15T23:56:55.572342+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:56:55.572342+0000","last_undegraded":"2023-12-15T23:56:55.572342+0000","last_fullsized":"2023-12-15T23:56:55.572342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:09.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:51.340241+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:56:51.340241+0000","last_peered":"2023-12-15T23:56:51.340241+0000","last_clean":"2023-12-15T23:56:51.340241+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:56:51.340241+0000","last_undegraded":"2023-12-15T23:56:51.340241+0000","last_fullsized":"2023-12-15T23:56:51.340241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:55.739562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349521+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:56:50.349521+0000","last_peered":"2023-12-15T23:56:50.349521+0000","last_clean":"2023-12-15T23:56:50.349521+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:56:50.349521+0000","last_undegraded":"2023-12-15T23:56:50.349521+0000","last_fullsized":"2023-12-15T23:56:50.349521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:02:18.788244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344265+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:56:30.344265+0000","last_peered":"2023-12-15T23:56:30.344265+0000","last_clean":"2023-12-15T23:56:30.344265+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:56:30.344265+0000","last_undegraded":"2023-12-15T23:56:30.344265+0000","last_fullsized":"2023-12-15T23:56:30.344265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:33:01.580743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9956","reported_seq":16962,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344181+0000","last_change":"2023-12-15T22:53:28.170727+0000","last_active":"2023-12-15T23:56:30.344181+0000","last_peered":"2023-12-15T23:56:30.344181+0000","last_clean":"2023-12-15T23:56:30.344181+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-15T23:56:30.344181+0000","last_undegraded":"2023-12-15T23:56:30.344181+0000","last_fullsized":"2023-12-15T23:56:30.344181+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":3000,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:29.326245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341884+0000","last_change":"2023-12-15T22:53:26.163866+0000","last_active":"2023-12-15T23:56:25.341884+0000","last_peered":"2023-12-15T23:56:25.341884+0000","last_clean":"2023-12-15T23:56:25.341884+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-15T23:56:25.341884+0000","last_undegraded":"2023-12-15T23:56:25.341884+0000","last_fullsized":"2023-12-15T23:56:25.341884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322406+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-15T23:55:25.322406+0000","last_peered":"2023-12-15T23:55:25.322406+0000","last_clean":"2023-12-15T23:55:25.322406+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-15T23:55:25.322406+0000","last_undegraded":"2023-12-15T23:55:25.322406+0000","last_fullsized":"2023-12-15T23:55:25.322406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:45.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328448+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-15T23:55:25.328448+0000","last_peered":"2023-12-15T23:55:25.328448+0000","last_clean":"2023-12-15T23:55:25.328448+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-15T23:55:25.328448+0000","last_undegraded":"2023-12-15T23:55:25.328448+0000","last_fullsized":"2023-12-15T23:55:25.328448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":241,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.551384+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-15T23:55:35.551384+0000","last_peered":"2023-12-15T23:55:35.551384+0000","last_clean":"2023-12-15T23:55:35.551384+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-15T23:55:35.551384+0000","last_undegraded":"2023-12-15T23:55:35.551384+0000","last_fullsized":"2023-12-15T23:55:35.551384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:20.673127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357853+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:57:25.357853+0000","last_peered":"2023-12-15T23:57:25.357853+0000","last_clean":"2023-12-15T23:57:25.357853+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:57:25.357853+0000","last_undegraded":"2023-12-15T23:57:25.357853+0000","last_fullsized":"2023-12-15T23:57:25.357853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:35.171333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363016+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:57:45.363016+0000","last_peered":"2023-12-15T23:57:45.363016+0000","last_clean":"2023-12-15T23:57:45.363016+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:57:45.363016+0000","last_undegraded":"2023-12-15T23:57:45.363016+0000","last_fullsized":"2023-12-15T23:57:45.363016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:28.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.337997+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-15T23:56:10.337997+0000","last_peered":"2023-12-15T23:56:10.337997+0000","last_clean":"2023-12-15T23:56:10.337997+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:56:10.337997+0000","last_undegraded":"2023-12-15T23:56:10.337997+0000","last_fullsized":"2023-12-15T23:56:10.337997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.062956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352318+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-15T23:57:41.352318+0000","last_peered":"2023-12-15T23:57:41.352318+0000","last_clean":"2023-12-15T23:57:41.352318+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-15T23:57:41.352318+0000","last_undegraded":"2023-12-15T23:57:41.352318+0000","last_fullsized":"2023-12-15T23:57:41.352318+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5869,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343539+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:57:06.343539+0000","last_peered":"2023-12-15T23:57:06.343539+0000","last_clean":"2023-12-15T23:57:06.343539+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:57:06.343539+0000","last_undegraded":"2023-12-15T23:57:06.343539+0000","last_fullsized":"2023-12-15T23:57:06.343539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:57.591782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351788+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:57:00.351788+0000","last_peered":"2023-12-15T23:57:00.351788+0000","last_clean":"2023-12-15T23:57:00.351788+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:57:00.351788+0000","last_undegraded":"2023-12-15T23:57:00.351788+0000","last_fullsized":"2023-12-15T23:57:00.351788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566684+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:56:35.566684+0000","last_peered":"2023-12-15T23:56:35.566684+0000","last_clean":"2023-12-15T23:56:35.566684+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:56:35.566684+0000","last_undegraded":"2023-12-15T23:56:35.566684+0000","last_fullsized":"2023-12-15T23:56:35.566684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:44.870107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1507,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347321+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:56:45.347321+0000","last_peered":"2023-12-15T23:56:45.347321+0000","last_clean":"2023-12-15T23:56:45.347321+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:56:45.347321+0000","last_undegraded":"2023-12-15T23:56:45.347321+0000","last_fullsized":"2023-12-15T23:56:45.347321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:02.140170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'237","reported_seq":413,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342292+0000","last_change":"2023-12-15T22:53:28.168042+0000","last_active":"2023-12-15T23:56:20.342292+0000","last_peered":"2023-12-15T23:56:20.342292+0000","last_clean":"2023-12-15T23:56:20.342292+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-15T23:56:20.342292+0000","last_undegraded":"2023-12-15T23:56:20.342292+0000","last_fullsized":"2023-12-15T23:56:20.342292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'23","reported_seq":147,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.332061+0000","last_change":"2023-12-15T22:53:26.162529+0000","last_active":"2023-12-15T23:56:16.332061+0000","last_peered":"2023-12-15T23:56:16.332061+0000","last_clean":"2023-12-15T23:56:16.332061+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-15T23:56:16.332061+0000","last_undegraded":"2023-12-15T23:56:16.332061+0000","last_fullsized":"2023-12-15T23:56:16.332061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:07.818847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318821+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-15T23:55:26.318821+0000","last_peered":"2023-12-15T23:55:26.318821+0000","last_clean":"2023-12-15T23:55:26.318821+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-15T23:55:26.318821+0000","last_undegraded":"2023-12-15T23:55:26.318821+0000","last_fullsized":"2023-12-15T23:55:26.318821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328501+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-15T23:55:25.328501+0000","last_peered":"2023-12-15T23:55:25.328501+0000","last_clean":"2023-12-15T23:55:25.328501+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-15T23:55:25.328501+0000","last_undegraded":"2023-12-15T23:55:25.328501+0000","last_fullsized":"2023-12-15T23:55:25.328501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:25.929011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321560+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-15T23:55:36.321560+0000","last_peered":"2023-12-15T23:55:36.321560+0000","last_clean":"2023-12-15T23:55:36.321560+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-15T23:55:36.321560+0000","last_undegraded":"2023-12-15T23:55:36.321560+0000","last_fullsized":"2023-12-15T23:55:36.321560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:57.672852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340190+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-15T23:56:15.340190+0000","last_peered":"2023-12-15T23:56:15.340190+0000","last_clean":"2023-12-15T23:56:15.340190+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-15T23:56:15.340190+0000","last_undegraded":"2023-12-15T23:56:15.340190+0000","last_fullsized":"2023-12-15T23:56:15.340190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336942+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-15T23:56:00.336942+0000","last_peered":"2023-12-15T23:56:00.336942+0000","last_clean":"2023-12-15T23:56:00.336942+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-15T23:56:00.336942+0000","last_undegraded":"2023-12-15T23:56:00.336942+0000","last_fullsized":"2023-12-15T23:56:00.336942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336133+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-15T23:56:00.336133+0000","last_peered":"2023-12-15T23:56:00.336133+0000","last_clean":"2023-12-15T23:56:00.336133+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-15T23:56:00.336133+0000","last_undegraded":"2023-12-15T23:56:00.336133+0000","last_fullsized":"2023-12-15T23:56:00.336133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.353458+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-15T23:57:40.353458+0000","last_peered":"2023-12-15T23:57:40.353458+0000","last_clean":"2023-12-15T23:57:40.353458+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-15T23:57:40.353458+0000","last_undegraded":"2023-12-15T23:57:40.353458+0000","last_fullsized":"2023-12-15T23:57:40.353458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:28:25.919204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4018,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574414+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:57:05.574414+0000","last_peered":"2023-12-15T23:57:05.574414+0000","last_clean":"2023-12-15T23:57:05.574414+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:57:05.574414+0000","last_undegraded":"2023-12-15T23:57:05.574414+0000","last_fullsized":"2023-12-15T23:57:05.574414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:19.550874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351766+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:57:00.351766+0000","last_peered":"2023-12-15T23:57:00.351766+0000","last_clean":"2023-12-15T23:57:00.351766+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:57:00.351766+0000","last_undegraded":"2023-12-15T23:57:00.351766+0000","last_fullsized":"2023-12-15T23:57:00.351766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:24.931139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345572+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:56:35.345572+0000","last_peered":"2023-12-15T23:56:35.345572+0000","last_clean":"2023-12-15T23:56:35.345572+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:56:35.345572+0000","last_undegraded":"2023-12-15T23:56:35.345572+0000","last_fullsized":"2023-12-15T23:56:35.345572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1435,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.335080+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:56:20.335080+0000","last_peered":"2023-12-15T23:56:20.335080+0000","last_clean":"2023-12-15T23:56:20.335080+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:56:20.335080+0000","last_undegraded":"2023-12-15T23:56:20.335080+0000","last_fullsized":"2023-12-15T23:56:20.335080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:02.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":340,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.568173+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:56:40.568173+0000","last_peered":"2023-12-15T23:56:40.568173+0000","last_clean":"2023-12-15T23:56:40.568173+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:56:40.568173+0000","last_undegraded":"2023-12-15T23:56:40.568173+0000","last_fullsized":"2023-12-15T23:56:40.568173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:04.096568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356849+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-15T23:57:56.356849+0000","last_peered":"2023-12-15T23:57:56.356849+0000","last_clean":"2023-12-15T23:57:56.356849+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-15T23:57:56.356849+0000","last_undegraded":"2023-12-15T23:57:56.356849+0000","last_fullsized":"2023-12-15T23:57:56.356849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:50.188900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318753+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-15T23:55:26.318753+0000","last_peered":"2023-12-15T23:55:26.318753+0000","last_clean":"2023-12-15T23:55:26.318753+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-15T23:55:26.318753+0000","last_undegraded":"2023-12-15T23:55:26.318753+0000","last_fullsized":"2023-12-15T23:55:26.318753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:32.193702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328603+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-15T23:55:25.328603+0000","last_peered":"2023-12-15T23:55:25.328603+0000","last_clean":"2023-12-15T23:55:25.328603+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-15T23:55:25.328603+0000","last_undegraded":"2023-12-15T23:55:25.328603+0000","last_fullsized":"2023-12-15T23:55:25.328603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:25.439900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.330732+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-15T23:55:35.330732+0000","last_peered":"2023-12-15T23:55:35.330732+0000","last_clean":"2023-12-15T23:55:35.330732+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-15T23:55:35.330732+0000","last_undegraded":"2023-12-15T23:55:35.330732+0000","last_fullsized":"2023-12-15T23:55:35.330732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:31.616855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336859+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-15T23:56:00.336859+0000","last_peered":"2023-12-15T23:56:00.336859+0000","last_clean":"2023-12-15T23:56:00.336859+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-15T23:56:00.336859+0000","last_undegraded":"2023-12-15T23:56:00.336859+0000","last_fullsized":"2023-12-15T23:56:00.336859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339319+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-15T23:56:15.339319+0000","last_peered":"2023-12-15T23:56:15.339319+0000","last_clean":"2023-12-15T23:56:15.339319+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-15T23:56:15.339319+0000","last_undegraded":"2023-12-15T23:56:15.339319+0000","last_fullsized":"2023-12-15T23:56:15.339319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.558216+0000","last_change":"2023-12-15T22:53:11.079680+0000","last_active":"2023-12-15T23:56:00.558216+0000","last_peered":"2023-12-15T23:56:00.558216+0000","last_clean":"2023-12-15T23:56:00.558216+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-15T23:56:00.558216+0000","last_undegraded":"2023-12-15T23:56:00.558216+0000","last_fullsized":"2023-12-15T23:56:00.558216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362232+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-15T23:57:40.362232+0000","last_peered":"2023-12-15T23:57:40.362232+0000","last_clean":"2023-12-15T23:57:40.362232+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-15T23:57:40.362232+0000","last_undegraded":"2023-12-15T23:57:40.362232+0000","last_fullsized":"2023-12-15T23:57:40.362232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:41:26.264663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3628,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345681+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:57:05.345681+0000","last_peered":"2023-12-15T23:57:05.345681+0000","last_clean":"2023-12-15T23:57:05.345681+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:57:05.345681+0000","last_undegraded":"2023-12-15T23:57:05.345681+0000","last_fullsized":"2023-12-15T23:57:05.345681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:01:11.119015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573007+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:57:00.573007+0000","last_peered":"2023-12-15T23:57:00.573007+0000","last_clean":"2023-12-15T23:57:00.573007+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:57:00.573007+0000","last_undegraded":"2023-12-15T23:57:00.573007+0000","last_fullsized":"2023-12-15T23:57:00.573007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345307+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:56:35.345307+0000","last_peered":"2023-12-15T23:56:35.345307+0000","last_clean":"2023-12-15T23:56:35.345307+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:56:35.345307+0000","last_undegraded":"2023-12-15T23:56:35.345307+0000","last_fullsized":"2023-12-15T23:56:35.345307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:05.380779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342047+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:56:20.342047+0000","last_peered":"2023-12-15T23:56:20.342047+0000","last_clean":"2023-12-15T23:56:20.342047+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:56:20.342047+0000","last_undegraded":"2023-12-15T23:56:20.342047+0000","last_fullsized":"2023-12-15T23:56:20.342047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:22.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341102+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:56:20.341102+0000","last_peered":"2023-12-15T23:56:20.341102+0000","last_clean":"2023-12-15T23:56:20.341102+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:56:20.341102+0000","last_undegraded":"2023-12-15T23:56:20.341102+0000","last_fullsized":"2023-12-15T23:56:20.341102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'15","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566777+0000","last_change":"2023-12-15T22:53:26.157853+0000","last_active":"2023-12-15T23:56:35.566777+0000","last_peered":"2023-12-15T23:56:35.566777+0000","last_clean":"2023-12-15T23:56:35.566777+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-15T23:56:35.566777+0000","last_undegraded":"2023-12-15T23:56:35.566777+0000","last_fullsized":"2023-12-15T23:56:35.566777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337000+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-15T23:56:00.337000+0000","last_peered":"2023-12-15T23:56:00.337000+0000","last_clean":"2023-12-15T23:56:00.337000+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-15T23:56:00.337000+0000","last_undegraded":"2023-12-15T23:56:00.337000+0000","last_fullsized":"2023-12-15T23:56:00.337000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.347051+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:57:10.347051+0000","last_peered":"2023-12-15T23:57:10.347051+0000","last_clean":"2023-12-15T23:57:10.347051+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:57:10.347051+0000","last_undegraded":"2023-12-15T23:57:10.347051+0000","last_fullsized":"2023-12-15T23:57:10.347051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:56:29.147167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326284+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-15T23:55:56.326284+0000","last_peered":"2023-12-15T23:55:56.326284+0000","last_clean":"2023-12-15T23:55:56.326284+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-15T23:55:56.326284+0000","last_undegraded":"2023-12-15T23:55:56.326284+0000","last_fullsized":"2023-12-15T23:55:56.326284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:33.642166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332245+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-15T23:55:40.332245+0000","last_peered":"2023-12-15T23:55:40.332245+0000","last_clean":"2023-12-15T23:55:40.332245+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-15T23:55:40.332245+0000","last_undegraded":"2023-12-15T23:55:40.332245+0000","last_fullsized":"2023-12-15T23:55:40.332245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329802+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-15T23:55:40.329802+0000","last_peered":"2023-12-15T23:55:40.329802+0000","last_clean":"2023-12-15T23:55:40.329802+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-15T23:55:40.329802+0000","last_undegraded":"2023-12-15T23:55:40.329802+0000","last_fullsized":"2023-12-15T23:55:40.329802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335944+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-15T23:56:00.335944+0000","last_peered":"2023-12-15T23:56:00.335944+0000","last_clean":"2023-12-15T23:56:00.335944+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-15T23:56:00.335944+0000","last_undegraded":"2023-12-15T23:56:00.335944+0000","last_fullsized":"2023-12-15T23:56:00.335944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:57.230909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583230+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-15T23:57:40.583230+0000","last_peered":"2023-12-15T23:57:40.583230+0000","last_clean":"2023-12-15T23:57:40.583230+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-15T23:57:40.583230+0000","last_undegraded":"2023-12-15T23:57:40.583230+0000","last_fullsized":"2023-12-15T23:57:40.583230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1274,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345598+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:57:05.345598+0000","last_peered":"2023-12-15T23:57:05.345598+0000","last_clean":"2023-12-15T23:57:05.345598+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:57:05.345598+0000","last_undegraded":"2023-12-15T23:57:05.345598+0000","last_fullsized":"2023-12-15T23:57:05.345598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:21.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573186+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:57:00.573186+0000","last_peered":"2023-12-15T23:57:00.573186+0000","last_clean":"2023-12-15T23:57:00.573186+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:57:00.573186+0000","last_undegraded":"2023-12-15T23:57:00.573186+0000","last_fullsized":"2023-12-15T23:57:00.573186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:30.130575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345396+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:56:35.345396+0000","last_peered":"2023-12-15T23:56:35.345396+0000","last_clean":"2023-12-15T23:56:35.345396+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:56:35.345396+0000","last_undegraded":"2023-12-15T23:56:35.345396+0000","last_fullsized":"2023-12-15T23:56:35.345396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342154+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:56:20.342154+0000","last_peered":"2023-12-15T23:56:20.342154+0000","last_clean":"2023-12-15T23:56:20.342154+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:56:20.342154+0000","last_undegraded":"2023-12-15T23:56:20.342154+0000","last_fullsized":"2023-12-15T23:56:20.342154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:41.240268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'185","reported_seq":372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340965+0000","last_change":"2023-12-15T22:53:28.164042+0000","last_active":"2023-12-15T23:56:20.340965+0000","last_peered":"2023-12-15T23:56:20.340965+0000","last_clean":"2023-12-15T23:56:20.340965+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-15T23:56:20.340965+0000","last_undegraded":"2023-12-15T23:56:20.340965+0000","last_fullsized":"2023-12-15T23:56:20.340965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:35.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331931+0000","last_change":"2023-12-15T22:53:26.160787+0000","last_active":"2023-12-15T23:56:16.331931+0000","last_peered":"2023-12-15T23:56:16.331931+0000","last_clean":"2023-12-15T23:56:16.331931+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-15T23:56:16.331931+0000","last_undegraded":"2023-12-15T23:56:16.331931+0000","last_fullsized":"2023-12-15T23:56:16.331931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:55.771958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331088+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:55:45.331088+0000","last_peered":"2023-12-15T23:55:45.331088+0000","last_clean":"2023-12-15T23:55:45.331088+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-15T23:55:45.331088+0000","last_undegraded":"2023-12-15T23:55:45.331088+0000","last_fullsized":"2023-12-15T23:55:45.331088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.360294+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:57:30.360294+0000","last_peered":"2023-12-15T23:57:30.360294+0000","last_clean":"2023-12-15T23:57:30.360294+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:57:30.360294+0000","last_undegraded":"2023-12-15T23:57:30.360294+0000","last_fullsized":"2023-12-15T23:57:30.360294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558888+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-15T23:56:05.558888+0000","last_peered":"2023-12-15T23:56:05.558888+0000","last_clean":"2023-12-15T23:56:05.558888+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-15T23:56:05.558888+0000","last_undegraded":"2023-12-15T23:56:05.558888+0000","last_fullsized":"2023-12-15T23:56:05.558888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:31.646743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321587+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-15T23:55:36.321587+0000","last_peered":"2023-12-15T23:55:36.321587+0000","last_clean":"2023-12-15T23:55:36.321587+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-15T23:55:36.321587+0000","last_undegraded":"2023-12-15T23:55:36.321587+0000","last_fullsized":"2023-12-15T23:55:36.321587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:22.684030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332350+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-15T23:55:40.332350+0000","last_peered":"2023-12-15T23:55:40.332350+0000","last_clean":"2023-12-15T23:55:40.332350+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-15T23:55:40.332350+0000","last_undegraded":"2023-12-15T23:55:40.332350+0000","last_fullsized":"2023-12-15T23:55:40.332350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334267+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-15T23:56:26.334267+0000","last_peered":"2023-12-15T23:56:26.334267+0000","last_clean":"2023-12-15T23:56:26.334267+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-15T23:56:26.334267+0000","last_undegraded":"2023-12-15T23:56:26.334267+0000","last_fullsized":"2023-12-15T23:56:26.334267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:17.634267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336045+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-15T23:56:25.336045+0000","last_peered":"2023-12-15T23:56:25.336045+0000","last_clean":"2023-12-15T23:56:25.336045+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-15T23:56:25.336045+0000","last_undegraded":"2023-12-15T23:56:25.336045+0000","last_fullsized":"2023-12-15T23:56:25.336045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:42.698596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587718+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-15T23:57:55.587718+0000","last_peered":"2023-12-15T23:57:55.587718+0000","last_clean":"2023-12-15T23:57:55.587718+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-15T23:57:55.587718+0000","last_undegraded":"2023-12-15T23:57:55.587718+0000","last_fullsized":"2023-12-15T23:57:55.587718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:27.446502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349717+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:57:31.349717+0000","last_peered":"2023-12-15T23:57:31.349717+0000","last_clean":"2023-12-15T23:57:31.349717+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:57:31.349717+0000","last_undegraded":"2023-12-15T23:57:31.349717+0000","last_fullsized":"2023-12-15T23:57:31.349717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343114+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-15T23:56:25.343114+0000","last_peered":"2023-12-15T23:56:25.343114+0000","last_clean":"2023-12-15T23:56:25.343114+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-15T23:56:25.343114+0000","last_undegraded":"2023-12-15T23:56:25.343114+0000","last_fullsized":"2023-12-15T23:56:25.343114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:07.455612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587659+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-15T23:57:55.587659+0000","last_peered":"2023-12-15T23:57:55.587659+0000","last_clean":"2023-12-15T23:57:55.587659+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-15T23:57:55.587659+0000","last_undegraded":"2023-12-15T23:57:55.587659+0000","last_fullsized":"2023-12-15T23:57:55.587659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351196+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:57:30.351196+0000","last_peered":"2023-12-15T23:57:30.351196+0000","last_clean":"2023-12-15T23:57:30.351196+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:57:30.351196+0000","last_undegraded":"2023-12-15T23:57:30.351196+0000","last_fullsized":"2023-12-15T23:57:30.351196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:08.012235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344047+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-15T23:56:30.344047+0000","last_peered":"2023-12-15T23:56:30.344047+0000","last_clean":"2023-12-15T23:56:30.344047+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-15T23:56:30.344047+0000","last_undegraded":"2023-12-15T23:56:30.344047+0000","last_fullsized":"2023-12-15T23:56:30.344047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365333+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-15T23:57:55.365333+0000","last_peered":"2023-12-15T23:57:55.365333+0000","last_clean":"2023-12-15T23:57:55.365333+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-15T23:57:55.365333+0000","last_undegraded":"2023-12-15T23:57:55.365333+0000","last_fullsized":"2023-12-15T23:57:55.365333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583197+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:57:40.583197+0000","last_peered":"2023-12-15T23:57:40.583197+0000","last_clean":"2023-12-15T23:57:40.583197+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:57:40.583197+0000","last_undegraded":"2023-12-15T23:57:40.583197+0000","last_fullsized":"2023-12-15T23:57:40.583197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341827+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-15T23:56:25.341827+0000","last_peered":"2023-12-15T23:56:25.341827+0000","last_clean":"2023-12-15T23:56:25.341827+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-15T23:56:25.341827+0000","last_undegraded":"2023-12-15T23:56:25.341827+0000","last_fullsized":"2023-12-15T23:56:25.341827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:34.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587497+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-15T23:57:55.587497+0000","last_peered":"2023-12-15T23:57:55.587497+0000","last_clean":"2023-12-15T23:57:55.587497+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-15T23:57:55.587497+0000","last_undegraded":"2023-12-15T23:57:55.587497+0000","last_fullsized":"2023-12-15T23:57:55.587497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363670+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:57:45.363670+0000","last_peered":"2023-12-15T23:57:45.363670+0000","last_clean":"2023-12-15T23:57:45.363670+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:57:45.363670+0000","last_undegraded":"2023-12-15T23:57:45.363670+0000","last_fullsized":"2023-12-15T23:57:45.363670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'5","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343413+0000","last_change":"2023-12-15T22:53:26.165809+0000","last_active":"2023-12-15T23:56:25.343413+0000","last_peered":"2023-12-15T23:56:25.343413+0000","last_clean":"2023-12-15T23:56:25.343413+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-15T23:56:25.343413+0000","last_undegraded":"2023-12-15T23:56:25.343413+0000","last_fullsized":"2023-12-15T23:56:25.343413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354702+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:57:45.354702+0000","last_peered":"2023-12-15T23:57:45.354702+0000","last_clean":"2023-12-15T23:57:45.354702+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:57:45.354702+0000","last_undegraded":"2023-12-15T23:57:45.354702+0000","last_fullsized":"2023-12-15T23:57:45.354702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:19.635825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366764+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-15T23:57:55.366764+0000","last_peered":"2023-12-15T23:57:55.366764+0000","last_clean":"2023-12-15T23:57:55.366764+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-15T23:57:55.366764+0000","last_undegraded":"2023-12-15T23:57:55.366764+0000","last_fullsized":"2023-12-15T23:57:55.366764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324460+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-15T23:55:46.324460+0000","last_peered":"2023-12-15T23:55:46.324460+0000","last_clean":"2023-12-15T23:55:46.324460+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-15T23:55:46.324460+0000","last_undegraded":"2023-12-15T23:55:46.324460+0000","last_fullsized":"2023-12-15T23:55:46.324460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.635572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349969+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:57:31.349969+0000","last_peered":"2023-12-15T23:57:31.349969+0000","last_clean":"2023-12-15T23:57:31.349969+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:57:31.349969+0000","last_undegraded":"2023-12-15T23:57:31.349969+0000","last_fullsized":"2023-12-15T23:57:31.349969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587564+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-15T23:57:55.587564+0000","last_peered":"2023-12-15T23:57:55.587564+0000","last_clean":"2023-12-15T23:57:55.587564+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-15T23:57:55.587564+0000","last_undegraded":"2023-12-15T23:57:55.587564+0000","last_fullsized":"2023-12-15T23:57:55.587564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'41","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564172+0000","last_change":"2023-12-15T22:53:26.155725+0000","last_active":"2023-12-15T23:56:25.564172+0000","last_peered":"2023-12-15T23:56:25.564172+0000","last_clean":"2023-12-15T23:56:25.564172+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-15T23:56:25.564172+0000","last_undegraded":"2023-12-15T23:56:25.564172+0000","last_fullsized":"2023-12-15T23:56:25.564172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580810+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:57:30.580810+0000","last_peered":"2023-12-15T23:57:30.580810+0000","last_clean":"2023-12-15T23:57:30.580810+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:57:30.580810+0000","last_undegraded":"2023-12-15T23:57:30.580810+0000","last_fullsized":"2023-12-15T23:57:30.580810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365999+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-15T23:57:55.365999+0000","last_peered":"2023-12-15T23:57:55.365999+0000","last_clean":"2023-12-15T23:57:55.365999+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-15T23:57:55.365999+0000","last_undegraded":"2023-12-15T23:57:55.365999+0000","last_fullsized":"2023-12-15T23:57:55.365999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339792+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:56:40.339792+0000","last_peered":"2023-12-15T23:56:40.339792+0000","last_clean":"2023-12-15T23:56:40.339792+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:56:40.339792+0000","last_undegraded":"2023-12-15T23:56:40.339792+0000","last_fullsized":"2023-12-15T23:56:40.339792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:46.435729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.358657+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:57:30.358657+0000","last_peered":"2023-12-15T23:57:30.358657+0000","last_clean":"2023-12-15T23:57:30.358657+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:57:30.358657+0000","last_undegraded":"2023-12-15T23:57:30.358657+0000","last_fullsized":"2023-12-15T23:57:30.358657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357081+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-15T23:57:55.357081+0000","last_peered":"2023-12-15T23:57:55.357081+0000","last_clean":"2023-12-15T23:57:55.357081+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-15T23:57:55.357081+0000","last_undegraded":"2023-12-15T23:57:55.357081+0000","last_fullsized":"2023-12-15T23:57:55.357081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:13:32.248104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'3","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366932+0000","last_change":"2023-12-15T22:53:26.155477+0000","last_active":"2023-12-15T23:58:00.366932+0000","last_peered":"2023-12-15T23:58:00.366932+0000","last_clean":"2023-12-15T23:58:00.366932+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-15T23:58:00.366932+0000","last_undegraded":"2023-12-15T23:58:00.366932+0000","last_fullsized":"2023-12-15T23:58:00.366932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:19.405614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336265+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-15T23:55:55.336265+0000","last_peered":"2023-12-15T23:55:55.336265+0000","last_clean":"2023-12-15T23:55:55.336265+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-15T23:55:55.336265+0000","last_undegraded":"2023-12-15T23:55:55.336265+0000","last_fullsized":"2023-12-15T23:55:55.336265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368735+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-15T23:58:10.368735+0000","last_peered":"2023-12-15T23:58:10.368735+0000","last_clean":"2023-12-15T23:58:10.368735+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-15T23:58:10.368735+0000","last_undegraded":"2023-12-15T23:58:10.368735+0000","last_fullsized":"2023-12-15T23:58:10.368735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.361584+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-15T23:58:15.361584+0000","last_peered":"2023-12-15T23:58:15.361584+0000","last_clean":"2023-12-15T23:58:15.361584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-15T23:58:15.361584+0000","last_undegraded":"2023-12-15T23:58:15.361584+0000","last_fullsized":"2023-12-15T23:58:15.361584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:45.682186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326761+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-15T23:55:56.326761+0000","last_peered":"2023-12-15T23:55:56.326761+0000","last_clean":"2023-12-15T23:55:56.326761+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-15T23:55:56.326761+0000","last_undegraded":"2023-12-15T23:55:56.326761+0000","last_fullsized":"2023-12-15T23:55:56.326761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335682+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-15T23:55:55.335682+0000","last_peered":"2023-12-15T23:55:55.335682+0000","last_clean":"2023-12-15T23:55:55.335682+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-15T23:55:55.335682+0000","last_undegraded":"2023-12-15T23:55:55.335682+0000","last_fullsized":"2023-12-15T23:55:55.335682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:09.497036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367621+0000","last_change":"2023-12-15T22:53:26.158639+0000","last_active":"2023-12-15T23:58:00.367621+0000","last_peered":"2023-12-15T23:58:00.367621+0000","last_clean":"2023-12-15T23:58:00.367621+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-15T23:58:00.367621+0000","last_undegraded":"2023-12-15T23:58:00.367621+0000","last_fullsized":"2023-12-15T23:58:00.367621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:32.844238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332721+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-15T23:56:10.332721+0000","last_peered":"2023-12-15T23:56:10.332721+0000","last_clean":"2023-12-15T23:56:10.332721+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-15T23:56:10.332721+0000","last_undegraded":"2023-12-15T23:56:10.332721+0000","last_fullsized":"2023-12-15T23:56:10.332721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:03.393324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335654+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-15T23:55:55.335654+0000","last_peered":"2023-12-15T23:55:55.335654+0000","last_clean":"2023-12-15T23:55:55.335654+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-15T23:55:55.335654+0000","last_undegraded":"2023-12-15T23:55:55.335654+0000","last_fullsized":"2023-12-15T23:55:55.335654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:13.846874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'19","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.357925+0000","last_change":"2023-12-15T22:53:26.165805+0000","last_active":"2023-12-15T23:58:00.357925+0000","last_peered":"2023-12-15T23:58:00.357925+0000","last_clean":"2023-12-15T23:58:00.357925+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-15T23:58:00.357925+0000","last_undegraded":"2023-12-15T23:58:00.357925+0000","last_fullsized":"2023-12-15T23:58:00.357925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:03.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334511+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-15T23:55:55.334511+0000","last_peered":"2023-12-15T23:55:55.334511+0000","last_clean":"2023-12-15T23:55:55.334511+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-15T23:55:55.334511+0000","last_undegraded":"2023-12-15T23:55:55.334511+0000","last_fullsized":"2023-12-15T23:55:55.334511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335851+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-15T23:55:55.335851+0000","last_peered":"2023-12-15T23:55:55.335851+0000","last_clean":"2023-12-15T23:55:55.335851+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-15T23:55:55.335851+0000","last_undegraded":"2023-12-15T23:55:55.335851+0000","last_fullsized":"2023-12-15T23:55:55.335851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340606+0000","last_change":"2023-12-15T22:53:26.165548+0000","last_active":"2023-12-15T23:56:15.340606+0000","last_peered":"2023-12-15T23:56:15.340606+0000","last_clean":"2023-12-15T23:56:15.340606+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-15T23:56:15.340606+0000","last_undegraded":"2023-12-15T23:56:15.340606+0000","last_fullsized":"2023-12-15T23:56:15.340606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326506+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-15T23:55:56.326506+0000","last_peered":"2023-12-15T23:55:56.326506+0000","last_clean":"2023-12-15T23:55:56.326506+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-15T23:55:56.326506+0000","last_undegraded":"2023-12-15T23:55:56.326506+0000","last_fullsized":"2023-12-15T23:55:56.326506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:05.103262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334464+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-15T23:55:55.334464+0000","last_peered":"2023-12-15T23:55:55.334464+0000","last_clean":"2023-12-15T23:55:55.334464+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-15T23:55:55.334464+0000","last_undegraded":"2023-12-15T23:55:55.334464+0000","last_fullsized":"2023-12-15T23:55:55.334464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'4","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.334068+0000","last_change":"2023-12-15T22:53:26.162667+0000","last_active":"2023-12-15T23:56:15.334068+0000","last_peered":"2023-12-15T23:56:15.334068+0000","last_clean":"2023-12-15T23:56:15.334068+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-15T23:56:15.334068+0000","last_undegraded":"2023-12-15T23:56:15.334068+0000","last_fullsized":"2023-12-15T23:56:15.334068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:35.730252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335764+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-15T23:55:55.335764+0000","last_peered":"2023-12-15T23:55:55.335764+0000","last_clean":"2023-12-15T23:55:55.335764+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-15T23:55:55.335764+0000","last_undegraded":"2023-12-15T23:55:55.335764+0000","last_fullsized":"2023-12-15T23:55:55.335764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338439+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-15T23:56:10.338439+0000","last_peered":"2023-12-15T23:56:10.338439+0000","last_clean":"2023-12-15T23:56:10.338439+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-15T23:56:10.338439+0000","last_undegraded":"2023-12-15T23:56:10.338439+0000","last_fullsized":"2023-12-15T23:56:10.338439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333909+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-15T23:56:15.333909+0000","last_peered":"2023-12-15T23:56:15.333909+0000","last_clean":"2023-12-15T23:56:15.333909+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-15T23:56:15.333909+0000","last_undegraded":"2023-12-15T23:56:15.333909+0000","last_fullsized":"2023-12-15T23:56:15.333909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:29:17.328062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556616+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-15T23:55:55.556616+0000","last_peered":"2023-12-15T23:55:55.556616+0000","last_clean":"2023-12-15T23:55:55.556616+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-15T23:55:55.556616+0000","last_undegraded":"2023-12-15T23:55:55.556616+0000","last_fullsized":"2023-12-15T23:55:55.556616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328947+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-15T23:55:55.328947+0000","last_peered":"2023-12-15T23:55:55.328947+0000","last_clean":"2023-12-15T23:55:55.328947+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-15T23:55:55.328947+0000","last_undegraded":"2023-12-15T23:55:55.328947+0000","last_fullsized":"2023-12-15T23:55:55.328947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'22","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340969+0000","last_change":"2023-12-15T22:53:26.161460+0000","last_active":"2023-12-15T23:56:15.340969+0000","last_peered":"2023-12-15T23:56:15.340969+0000","last_clean":"2023-12-15T23:56:15.340969+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-15T23:56:15.340969+0000","last_undegraded":"2023-12-15T23:56:15.340969+0000","last_fullsized":"2023-12-15T23:56:15.340969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:57.157307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369558+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-15T23:58:10.369558+0000","last_peered":"2023-12-15T23:58:10.369558+0000","last_clean":"2023-12-15T23:58:10.369558+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-15T23:58:10.369558+0000","last_undegraded":"2023-12-15T23:58:10.369558+0000","last_fullsized":"2023-12-15T23:58:10.369558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336071+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-15T23:55:55.336071+0000","last_peered":"2023-12-15T23:55:55.336071+0000","last_clean":"2023-12-15T23:55:55.336071+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-15T23:55:55.336071+0000","last_undegraded":"2023-12-15T23:55:55.336071+0000","last_fullsized":"2023-12-15T23:55:55.336071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335777+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-15T23:55:55.335777+0000","last_peered":"2023-12-15T23:55:55.335777+0000","last_clean":"2023-12-15T23:55:55.335777+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-15T23:55:55.335777+0000","last_undegraded":"2023-12-15T23:55:55.335777+0000","last_fullsized":"2023-12-15T23:55:55.335777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:38.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.333892+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-15T23:55:55.333892+0000","last_peered":"2023-12-15T23:55:55.333892+0000","last_clean":"2023-12-15T23:55:55.333892+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-15T23:55:55.333892+0000","last_undegraded":"2023-12-15T23:55:55.333892+0000","last_fullsized":"2023-12-15T23:55:55.333892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337514+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-15T23:56:00.337514+0000","last_peered":"2023-12-15T23:56:00.337514+0000","last_clean":"2023-12-15T23:56:00.337514+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-15T23:56:00.337514+0000","last_undegraded":"2023-12-15T23:56:00.337514+0000","last_fullsized":"2023-12-15T23:56:00.337514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328806+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-15T23:55:55.328806+0000","last_peered":"2023-12-15T23:55:55.328806+0000","last_clean":"2023-12-15T23:55:55.328806+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-15T23:55:55.328806+0000","last_undegraded":"2023-12-15T23:55:55.328806+0000","last_fullsized":"2023-12-15T23:55:55.328806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:55.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556597+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-15T23:55:55.556597+0000","last_peered":"2023-12-15T23:55:55.556597+0000","last_clean":"2023-12-15T23:55:55.556597+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-15T23:55:55.556597+0000","last_undegraded":"2023-12-15T23:55:55.556597+0000","last_fullsized":"2023-12-15T23:55:55.556597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333280+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-15T23:55:45.333280+0000","last_peered":"2023-12-15T23:55:45.333280+0000","last_clean":"2023-12-15T23:55:45.333280+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-15T23:55:45.333280+0000","last_undegraded":"2023-12-15T23:55:45.333280+0000","last_fullsized":"2023-12-15T23:55:45.333280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":599,"ondisk_log_size":599,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22796,"ondisk_log_size":22796,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608376,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.72299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.68400000000000005},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.626,"5min":0.67700000000000005,"15min":0.78200000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.74199999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.61899999999999999},"last":0.443}]},{"osd":5,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.375,"15min":0.373},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.52500000000000002,"5min":0.60099999999999998,"15min":1.149},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.64500000000000002},"last":0.40500000000000003}]}]},{"osd":5,"up_from":11,"seq":47244641078,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.495}]},{"osd":1,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71699999999999997,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.754,"15min":0.754},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.372,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.48399999999999999,"5min":0.56699999999999995,"15min":0.63},"last":0.374}]},{"osd":4,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641080,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Dec 15 23:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.27800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.502,"15min":0.80100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45200000000000001,"5min":0.57399999999999995,"15min":0.78700000000000003},"last":0.372}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.38700000000000001}]}]},{"osd":2,"up_from":11,"seq":47244641077,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.193},"max":{"1min":0.55500000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.48499999999999999,"5min":0.87,"15min":0.87},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.35799999999999998},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52400000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.29399999999999998},"max":{"1min":0.77200000000000002,"5min":1.169,"15min":1.169},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70999999999999996}]}]},{"osd":1,"up_from":11,"seq":47244641078,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47132,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810468,"statfs":{"total":107374182400,"available":107325919232,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.436,"5min":0.48699999999999999,"15min":0.53100000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51700000000000002,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.377}]},{"osd":2,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.72799999999999998,"15min":0.75700000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":0.878},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.622}]}]},{"osd":0,"up_from":11,"seq":47244641078,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.315},"min":{"1min":0.224,"5min":0.21099999999999999,"15min":0.17299999999999999},"max":{"1min":0.44900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.20799999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.373},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.22800000000000001},"max":{"1min":0.746,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.23999999999999999},"max":{"1min":0.73699999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.875,"15min":0.875},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.78900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:00:23.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:00:23.888 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:23.909 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:00:23.911 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2097,"stamp":"2023-12-16T00:00:22.169801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34355,"ondisk_log_size":34355,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":269080,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":259190,"kb_avail":628876520,"statfs":{"total":644245094400,"available":643969556480,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":265411233},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005288"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561765+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-15T23:56:15.561765+0000","last_peered":"2023-12-15T23:56:15.561765+0000","last_clean":"2023-12-15T23:56:15.561765+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-15T23:56:15.561765+0000","last_undegraded":"2023-12-15T23:56:15.561765+0000","last_fullsized":"2023-12-15T23:56:15.561765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359557+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:57:30.359557+0000","last_peered":"2023-12-15T23:57:30.359557+0000","last_clean":"2023-12-15T23:57:30.359557+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:57:30.359557+0000","last_undegraded":"2023-12-15T23:57:30.359557+0000","last_fullsized":"2023-12-15T23:57:30.359557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328209+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-15T23:55:25.328209+0000","last_peered":"2023-12-15T23:55:25.328209+0000","last_clean":"2023-12-15T23:55:25.328209+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-15T23:55:25.328209+0000","last_undegraded":"2023-12-15T23:55:25.328209+0000","last_fullsized":"2023-12-15T23:55:25.328209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:16:04.440737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340462+0000","last_change":"2023-12-15T22:53:26.165400+0000","last_active":"2023-12-15T23:56:15.340462+0000","last_peered":"2023-12-15T23:56:15.340462+0000","last_clean":"2023-12-15T23:56:15.340462+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-15T23:56:15.340462+0000","last_undegraded":"2023-12-15T23:56:15.340462+0000","last_fullsized":"2023-12-15T23:56:15.340462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581276+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:57:30.581276+0000","last_peered":"2023-12-15T23:57:30.581276+0000","last_clean":"2023-12-15T23:57:30.581276+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:57:30.581276+0000","last_undegraded":"2023-12-15T23:57:30.581276+0000","last_fullsized":"2023-12-15T23:57:30.581276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325398+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-15T23:55:25.325398+0000","last_peered":"2023-12-15T23:55:25.325398+0000","last_clean":"2023-12-15T23:55:25.325398+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-15T23:55:25.325398+0000","last_undegraded":"2023-12-15T23:55:25.325398+0000","last_fullsized":"2023-12-15T23:55:25.325398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335549+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:56:31.335549+0000","last_peered":"2023-12-15T23:56:31.335549+0000","last_clean":"2023-12-15T23:56:31.335549+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:56:31.335549+0000","last_undegraded":"2023-12-15T23:56:31.335549+0000","last_fullsized":"2023-12-15T23:56:31.335549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:22.850613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583442+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:57:40.583442+0000","last_peered":"2023-12-15T23:57:40.583442+0000","last_clean":"2023-12-15T23:57:40.583442+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:57:40.583442+0000","last_undegraded":"2023-12-15T23:57:40.583442+0000","last_fullsized":"2023-12-15T23:57:40.583442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318703+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-15T23:55:26.318703+0000","last_peered":"2023-12-15T23:55:26.318703+0000","last_clean":"2023-12-15T23:55:26.318703+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-15T23:55:26.318703+0000","last_undegraded":"2023-12-15T23:55:26.318703+0000","last_fullsized":"2023-12-15T23:55:26.318703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:34.568365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561835+0000","last_change":"2023-12-15T22:53:26.155908+0000","last_active":"2023-12-15T23:56:15.561835+0000","last_peered":"2023-12-15T23:56:15.561835+0000","last_clean":"2023-12-15T23:56:15.561835+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-15T23:56:15.561835+0000","last_undegraded":"2023-12-15T23:56:15.561835+0000","last_fullsized":"2023-12-15T23:56:15.561835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354290+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:57:10.354290+0000","last_peered":"2023-12-15T23:57:10.354290+0000","last_clean":"2023-12-15T23:57:10.354290+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:57:10.354290+0000","last_undegraded":"2023-12-15T23:57:10.354290+0000","last_fullsized":"2023-12-15T23:57:10.354290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328460+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-15T23:55:25.328460+0000","last_peered":"2023-12-15T23:55:25.328460+0000","last_clean":"2023-12-15T23:55:25.328460+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-15T23:55:25.328460+0000","last_undegraded":"2023-12-15T23:55:25.328460+0000","last_fullsized":"2023-12-15T23:55:25.328460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334057+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-15T23:56:26.334057+0000","last_peered":"2023-12-15T23:56:26.334057+0000","last_clean":"2023-12-15T23:56:26.334057+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-15T23:56:26.334057+0000","last_undegraded":"2023-12-15T23:56:26.334057+0000","last_fullsized":"2023-12-15T23:56:26.334057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:32.140453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325615+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-15T23:55:25.325615+0000","last_peered":"2023-12-15T23:55:25.325615+0000","last_clean":"2023-12-15T23:55:25.325615+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-15T23:55:25.325615+0000","last_undegraded":"2023-12-15T23:55:25.325615+0000","last_fullsized":"2023-12-15T23:55:25.325615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354303+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:57:10.354303+0000","last_peered":"2023-12-15T23:57:10.354303+0000","last_clean":"2023-12-15T23:57:10.354303+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:57:10.354303+0000","last_undegraded":"2023-12-15T23:57:10.354303+0000","last_fullsized":"2023-12-15T23:57:10.354303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'5","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343007+0000","last_change":"2023-12-15T22:53:26.162283+0000","last_active":"2023-12-15T23:56:25.343007+0000","last_peered":"2023-12-15T23:56:25.343007+0000","last_clean":"2023-12-15T23:56:25.343007+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-15T23:56:25.343007+0000","last_undegraded":"2023-12-15T23:56:25.343007+0000","last_fullsized":"2023-12-15T23:56:25.343007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328352+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-15T23:55:25.328352+0000","last_peered":"2023-12-15T23:55:25.328352+0000","last_clean":"2023-12-15T23:55:25.328352+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-15T23:55:25.328352+0000","last_undegraded":"2023-12-15T23:55:25.328352+0000","last_fullsized":"2023-12-15T23:55:25.328352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350353+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:57:31.350353+0000","last_peered":"2023-12-15T23:57:31.350353+0000","last_clean":"2023-12-15T23:57:31.350353+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:57:31.350353+0000","last_undegraded":"2023-12-15T23:57:31.350353+0000","last_fullsized":"2023-12-15T23:57:31.350353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'8","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339456+0000","last_change":"2023-12-15T22:53:26.156995+0000","last_active":"2023-12-15T23:56:15.339456+0000","last_peered":"2023-12-15T23:56:15.339456+0000","last_clean":"2023-12-15T23:56:15.339456+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-15T23:56:15.339456+0000","last_undegraded":"2023-12-15T23:56:15.339456+0000","last_fullsized":"2023-12-15T23:56:15.339456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:02.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325358+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-15T23:55:25.325358+0000","last_peered":"2023-12-15T23:55:25.325358+0000","last_clean":"2023-12-15T23:55:25.325358+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-15T23:55:25.325358+0000","last_undegraded":"2023-12-15T23:55:25.325358+0000","last_fullsized":"2023-12-15T23:55:25.325358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359263+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:57:30.359263+0000","last_peered":"2023-12-15T23:57:30.359263+0000","last_clean":"2023-12-15T23:57:30.359263+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:57:30.359263+0000","last_undegraded":"2023-12-15T23:57:30.359263+0000","last_fullsized":"2023-12-15T23:57:30.359263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337739+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:56:41.337739+0000","last_peered":"2023-12-15T23:56:41.337739+0000","last_clean":"2023-12-15T23:56:41.337739+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:56:41.337739+0000","last_undegraded":"2023-12-15T23:56:41.337739+0000","last_fullsized":"2023-12-15T23:56:41.337739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:05.670759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322111+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-15T23:55:25.322111+0000","last_peered":"2023-12-15T23:55:25.322111+0000","last_clean":"2023-12-15T23:55:25.322111+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-15T23:55:25.322111+0000","last_undegraded":"2023-12-15T23:55:25.322111+0000","last_fullsized":"2023-12-15T23:55:25.322111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:38.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351612+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:57:30.351612+0000","last_peered":"2023-12-15T23:57:30.351612+0000","last_clean":"2023-12-15T23:57:30.351612+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:57:30.351612+0000","last_undegraded":"2023-12-15T23:57:30.351612+0000","last_fullsized":"2023-12-15T23:57:30.351612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:11.503638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'10","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366685+0000","last_change":"2023-12-15T22:53:26.164117+0000","last_active":"2023-12-15T23:58:00.366685+0000","last_peered":"2023-12-15T23:58:00.366685+0000","last_clean":"2023-12-15T23:58:00.366685+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-15T23:58:00.366685+0000","last_undegraded":"2023-12-15T23:58:00.366685+0000","last_fullsized":"2023-12-15T23:58:00.366685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:38.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326264+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-15T23:55:56.326264+0000","last_peered":"2023-12-15T23:55:56.326264+0000","last_clean":"2023-12-15T23:55:56.326264+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-15T23:55:56.326264+0000","last_undegraded":"2023-12-15T23:55:56.326264+0000","last_fullsized":"2023-12-15T23:55:56.326264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:07.802909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559391+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-15T23:56:05.559391+0000","last_peered":"2023-12-15T23:56:05.559391+0000","last_clean":"2023-12-15T23:56:05.559391+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-15T23:56:05.559391+0000","last_undegraded":"2023-12-15T23:56:05.559391+0000","last_fullsized":"2023-12-15T23:56:05.559391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:37.299376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'10","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361963+0000","last_change":"2023-12-15T22:53:26.161032+0000","last_active":"2023-12-15T23:57:40.361963+0000","last_peered":"2023-12-15T23:57:40.361963+0000","last_clean":"2023-12-15T23:57:40.361963+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-15T23:57:40.361963+0000","last_undegraded":"2023-12-15T23:57:40.361963+0000","last_fullsized":"2023-12-15T23:57:40.361963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:26.370938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335545+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-15T23:55:55.335545+0000","last_peered":"2023-12-15T23:55:55.335545+0000","last_clean":"2023-12-15T23:55:55.335545+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-15T23:55:55.335545+0000","last_undegraded":"2023-12-15T23:55:55.335545+0000","last_fullsized":"2023-12-15T23:55:55.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331592+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-15T23:55:45.331592+0000","last_peered":"2023-12-15T23:55:45.331592+0000","last_clean":"2023-12-15T23:55:45.331592+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-15T23:55:45.331592+0000","last_undegraded":"2023-12-15T23:55:45.331592+0000","last_fullsized":"2023-12-15T23:55:45.331592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'28","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358304+0000","last_change":"2023-12-15T22:53:26.162543+0000","last_active":"2023-12-15T23:58:00.358304+0000","last_peered":"2023-12-15T23:58:00.358304+0000","last_clean":"2023-12-15T23:58:00.358304+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-15T23:58:00.358304+0000","last_undegraded":"2023-12-15T23:58:00.358304+0000","last_fullsized":"2023-12-15T23:58:00.358304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:06.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339086+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-15T23:56:10.339086+0000","last_peered":"2023-12-15T23:56:10.339086+0000","last_clean":"2023-12-15T23:56:10.339086+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-15T23:56:10.339086+0000","last_undegraded":"2023-12-15T23:56:10.339086+0000","last_fullsized":"2023-12-15T23:56:10.339086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333163+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-15T23:55:45.333163+0000","last_peered":"2023-12-15T23:55:45.333163+0000","last_clean":"2023-12-15T23:55:45.333163+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-15T23:55:45.333163+0000","last_undegraded":"2023-12-15T23:55:45.333163+0000","last_fullsized":"2023-12-15T23:55:45.333163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358223+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-15T23:58:00.358223+0000","last_peered":"2023-12-15T23:58:00.358223+0000","last_clean":"2023-12-15T23:58:00.358223+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-15T23:58:00.358223+0000","last_undegraded":"2023-12-15T23:58:00.358223+0000","last_fullsized":"2023-12-15T23:58:00.358223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:34.225706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326624+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-15T23:55:45.326624+0000","last_peered":"2023-12-15T23:55:45.326624+0000","last_clean":"2023-12-15T23:55:45.326624+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-15T23:55:45.326624+0000","last_undegraded":"2023-12-15T23:55:45.326624+0000","last_fullsized":"2023-12-15T23:55:45.326624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:09.630988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324219+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-15T23:55:46.324219+0000","last_peered":"2023-12-15T23:55:46.324219+0000","last_clean":"2023-12-15T23:55:46.324219+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-15T23:55:46.324219+0000","last_undegraded":"2023-12-15T23:55:46.324219+0000","last_fullsized":"2023-12-15T23:55:46.324219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334011+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-15T23:55:55.334011+0000","last_peered":"2023-12-15T23:55:55.334011+0000","last_clean":"2023-12-15T23:55:55.334011+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-15T23:55:55.334011+0000","last_undegraded":"2023-12-15T23:55:55.334011+0000","last_fullsized":"2023-12-15T23:55:55.334011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326697+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-15T23:55:45.326697+0000","last_peered":"2023-12-15T23:55:45.326697+0000","last_clean":"2023-12-15T23:55:45.326697+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-15T23:55:45.326697+0000","last_undegraded":"2023-12-15T23:55:45.326697+0000","last_fullsized":"2023-12-15T23:55:45.326697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:58.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333465+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-15T23:55:45.333465+0000","last_peered":"2023-12-15T23:55:45.333465+0000","last_clean":"2023-12-15T23:55:45.333465+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-15T23:55:45.333465+0000","last_undegraded":"2023-12-15T23:55:45.333465+0000","last_fullsized":"2023-12-15T23:55:45.333465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:03.096660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328420+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-15T23:55:55.328420+0000","last_peered":"2023-12-15T23:55:55.328420+0000","last_clean":"2023-12-15T23:55:55.328420+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-15T23:55:55.328420+0000","last_undegraded":"2023-12-15T23:55:55.328420+0000","last_fullsized":"2023-12-15T23:55:55.328420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:24.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324294+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-15T23:55:46.324294+0000","last_peered":"2023-12-15T23:55:46.324294+0000","last_clean":"2023-12-15T23:55:46.324294+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-15T23:55:46.324294+0000","last_undegraded":"2023-12-15T23:55:46.324294+0000","last_fullsized":"2023-12-15T23:55:46.324294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339461+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-15T23:56:10.339461+0000","last_peered":"2023-12-15T23:56:10.339461+0000","last_clean":"2023-12-15T23:56:10.339461+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-15T23:56:10.339461+0000","last_undegraded":"2023-12-15T23:56:10.339461+0000","last_fullsized":"2023-12-15T23:56:10.339461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566972+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-15T23:56:35.566972+0000","last_peered":"2023-12-15T23:56:35.566972+0000","last_clean":"2023-12-15T23:56:35.566972+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-15T23:56:35.566972+0000","last_undegraded":"2023-12-15T23:56:35.566972+0000","last_fullsized":"2023-12-15T23:56:35.566972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1693,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.372653+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-15T23:58:20.372653+0000","last_peered":"2023-12-15T23:58:20.372653+0000","last_clean":"2023-12-15T23:58:20.372653+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-15T23:58:20.372653+0000","last_undegraded":"2023-12-15T23:58:20.372653+0000","last_fullsized":"2023-12-15T23:58:20.372653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343290+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:56:30.343290+0000","last_peered":"2023-12-15T23:56:30.343290+0000","last_clean":"2023-12-15T23:56:30.343290+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:56:30.343290+0000","last_undegraded":"2023-12-15T23:56:30.343290+0000","last_fullsized":"2023-12-15T23:56:30.343290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360588+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-15T23:57:35.360588+0000","last_peered":"2023-12-15T23:57:35.360588+0000","last_clean":"2023-12-15T23:57:35.360588+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-15T23:57:35.360588+0000","last_undegraded":"2023-12-15T23:57:35.360588+0000","last_fullsized":"2023-12-15T23:57:35.360588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:45.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327893+0000","last_change":"2023-12-15T22:53:30.178391+0000","last_active":"2023-12-15T23:56:01.327893+0000","last_peered":"2023-12-15T23:56:01.327893+0000","last_clean":"2023-12-15T23:56:01.327893+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-15T23:56:01.327893+0000","last_undegraded":"2023-12-15T23:56:01.327893+0000","last_fullsized":"2023-12-15T23:56:01.327893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:53.334878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'309","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335674+0000","last_change":"2023-12-15T22:53:28.165506+0000","last_active":"2023-12-15T23:56:00.335674+0000","last_peered":"2023-12-15T23:56:00.335674+0000","last_clean":"2023-12-15T23:56:00.335674+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-15T23:56:00.335674+0000","last_undegraded":"2023-12-15T23:56:00.335674+0000","last_fullsized":"2023-12-15T23:56:00.335674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:40.852277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337214+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:56:30.337214+0000","last_peered":"2023-12-15T23:56:30.337214+0000","last_clean":"2023-12-15T23:56:30.337214+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:56:30.337214+0000","last_undegraded":"2023-12-15T23:56:30.337214+0000","last_fullsized":"2023-12-15T23:56:30.337214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:33.452389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327638+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-15T23:56:01.327638+0000","last_peered":"2023-12-15T23:56:01.327638+0000","last_clean":"2023-12-15T23:56:01.327638+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-15T23:56:01.327638+0000","last_undegraded":"2023-12-15T23:56:01.327638+0000","last_fullsized":"2023-12-15T23:56:01.327638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:24.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559157+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-15T23:56:05.559157+0000","last_peered":"2023-12-15T23:56:05.559157+0000","last_clean":"2023-12-15T23:56:05.559157+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-15T23:56:05.559157+0000","last_undegraded":"2023-12-15T23:56:05.559157+0000","last_fullsized":"2023-12-15T23:56:05.559157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334309+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-15T23:55:55.334309+0000","last_peered":"2023-12-15T23:55:55.334309+0000","last_clean":"2023-12-15T23:55:55.334309+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-15T23:55:55.334309+0000","last_undegraded":"2023-12-15T23:55:55.334309+0000","last_fullsized":"2023-12-15T23:55:55.334309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:30.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335875+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-15T23:55:55.335875+0000","last_peered":"2023-12-15T23:55:55.335875+0000","last_clean":"2023-12-15T23:55:55.335875+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-15T23:55:55.335875+0000","last_undegraded":"2023-12-15T23:55:55.335875+0000","last_fullsized":"2023-12-15T23:55:55.335875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337489+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-15T23:56:00.337489+0000","last_peered":"2023-12-15T23:56:00.337489+0000","last_clean":"2023-12-15T23:56:00.337489+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-15T23:56:00.337489+0000","last_undegraded":"2023-12-15T23:56:00.337489+0000","last_fullsized":"2023-12-15T23:56:00.337489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337350+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-15T23:56:00.337350+0000","last_peered":"2023-12-15T23:56:00.337350+0000","last_clean":"2023-12-15T23:56:00.337350+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-15T23:56:00.337350+0000","last_undegraded":"2023-12-15T23:56:00.337350+0000","last_fullsized":"2023-12-15T23:56:00.337350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:24.040020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.342184+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-15T23:56:50.342184+0000","last_peered":"2023-12-15T23:56:50.342184+0000","last_clean":"2023-12-15T23:56:50.342184+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-15T23:56:50.342184+0000","last_undegraded":"2023-12-15T23:56:50.342184+0000","last_fullsized":"2023-12-15T23:56:50.342184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:34.560913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346084+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-15T23:56:35.346084+0000","last_peered":"2023-12-15T23:56:35.346084+0000","last_clean":"2023-12-15T23:56:35.346084+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-15T23:56:35.346084+0000","last_undegraded":"2023-12-15T23:56:35.346084+0000","last_fullsized":"2023-12-15T23:56:35.346084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:31.974370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344321+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:56:30.344321+0000","last_peered":"2023-12-15T23:56:30.344321+0000","last_clean":"2023-12-15T23:56:30.344321+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:56:30.344321+0000","last_undegraded":"2023-12-15T23:56:30.344321+0000","last_fullsized":"2023-12-15T23:56:30.344321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:02:26.652903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.338524+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-15T23:56:05.338524+0000","last_peered":"2023-12-15T23:56:05.338524+0000","last_clean":"2023-12-15T23:56:05.338524+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-15T23:56:05.338524+0000","last_undegraded":"2023-12-15T23:56:05.338524+0000","last_fullsized":"2023-12-15T23:56:05.338524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":850,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336831+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-15T23:56:00.336831+0000","last_peered":"2023-12-15T23:56:00.336831+0000","last_clean":"2023-12-15T23:56:00.336831+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-15T23:56:00.336831+0000","last_undegraded":"2023-12-15T23:56:00.336831+0000","last_fullsized":"2023-12-15T23:56:00.336831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:16.093189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1989","reported_seq":3292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.330162+0000","last_change":"2023-12-15T22:53:28.164220+0000","last_active":"2023-12-15T23:56:00.330162+0000","last_peered":"2023-12-15T23:56:00.330162+0000","last_clean":"2023-12-15T23:56:00.330162+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-15T23:56:00.330162+0000","last_undegraded":"2023-12-15T23:56:00.330162+0000","last_fullsized":"2023-12-15T23:56:00.330162+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":200,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:24.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340087+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-15T23:56:15.340087+0000","last_peered":"2023-12-15T23:56:15.340087+0000","last_clean":"2023-12-15T23:56:15.340087+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-15T23:56:15.340087+0000","last_undegraded":"2023-12-15T23:56:15.340087+0000","last_fullsized":"2023-12-15T23:56:15.340087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340211+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-15T23:56:15.340211+0000","last_peered":"2023-12-15T23:56:15.340211+0000","last_clean":"2023-12-15T23:56:15.340211+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-15T23:56:15.340211+0000","last_undegraded":"2023-12-15T23:56:15.340211+0000","last_fullsized":"2023-12-15T23:56:15.340211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333143+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-15T23:55:45.333143+0000","last_peered":"2023-12-15T23:55:45.333143+0000","last_clean":"2023-12-15T23:55:45.333143+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-15T23:55:45.333143+0000","last_undegraded":"2023-12-15T23:55:45.333143+0000","last_fullsized":"2023-12-15T23:55:45.333143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558997+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-15T23:56:05.558997+0000","last_peered":"2023-12-15T23:56:05.558997+0000","last_clean":"2023-12-15T23:56:05.558997+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-15T23:56:05.558997+0000","last_undegraded":"2023-12-15T23:56:05.558997+0000","last_fullsized":"2023-12-15T23:56:05.558997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342197+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-15T23:56:20.342197+0000","last_peered":"2023-12-15T23:56:20.342197+0000","last_clean":"2023-12-15T23:56:20.342197+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-15T23:56:20.342197+0000","last_undegraded":"2023-12-15T23:56:20.342197+0000","last_fullsized":"2023-12-15T23:56:20.342197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326827+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-15T23:55:56.326827+0000","last_peered":"2023-12-15T23:55:56.326827+0000","last_clean":"2023-12-15T23:55:56.326827+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-15T23:55:56.326827+0000","last_undegraded":"2023-12-15T23:55:56.326827+0000","last_fullsized":"2023-12-15T23:55:56.326827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:33.627758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.328126+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-15T23:56:01.328126+0000","last_peered":"2023-12-15T23:56:01.328126+0000","last_clean":"2023-12-15T23:56:01.328126+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-15T23:56:01.328126+0000","last_undegraded":"2023-12-15T23:56:01.328126+0000","last_fullsized":"2023-12-15T23:56:01.328126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:42.868883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330495+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:56:11.330495+0000","last_peered":"2023-12-15T23:56:11.330495+0000","last_clean":"2023-12-15T23:56:11.330495+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:56:11.330495+0000","last_undegraded":"2023-12-15T23:56:11.330495+0000","last_fullsized":"2023-12-15T23:56:11.330495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345763+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:56:35.345763+0000","last_peered":"2023-12-15T23:56:35.345763+0000","last_clean":"2023-12-15T23:56:35.345763+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:56:35.345763+0000","last_undegraded":"2023-12-15T23:56:35.345763+0000","last_fullsized":"2023-12-15T23:56:35.345763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:05.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335521+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-15T23:56:31.335521+0000","last_peered":"2023-12-15T23:56:31.335521+0000","last_clean":"2023-12-15T23:56:31.335521+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-15T23:56:31.335521+0000","last_undegraded":"2023-12-15T23:56:31.335521+0000","last_fullsized":"2023-12-15T23:56:31.335521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.354044+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:57:46.354044+0000","last_peered":"2023-12-15T23:57:46.354044+0000","last_clean":"2023-12-15T23:57:46.354044+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:57:46.354044+0000","last_undegraded":"2023-12-15T23:57:46.354044+0000","last_fullsized":"2023-12-15T23:57:46.354044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:33.344075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345497+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:56:35.345497+0000","last_peered":"2023-12-15T23:56:35.345497+0000","last_clean":"2023-12-15T23:56:35.345497+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:56:35.345497+0000","last_undegraded":"2023-12-15T23:56:35.345497+0000","last_fullsized":"2023-12-15T23:56:35.345497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:52.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'201","reported_seq":429,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334656+0000","last_change":"2023-12-15T22:53:28.167522+0000","last_active":"2023-12-15T23:56:20.334656+0000","last_peered":"2023-12-15T23:56:20.334656+0000","last_clean":"2023-12-15T23:56:20.334656+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-15T23:56:20.334656+0000","last_undegraded":"2023-12-15T23:56:20.334656+0000","last_fullsized":"2023-12-15T23:56:20.334656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:57.781199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'5","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:53:26.162142+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332182+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-15T23:55:40.332182+0000","last_peered":"2023-12-15T23:55:40.332182+0000","last_clean":"2023-12-15T23:55:40.332182+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-15T23:55:40.332182+0000","last_undegraded":"2023-12-15T23:55:40.332182+0000","last_fullsized":"2023-12-15T23:55:40.332182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:14.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333796+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-15T23:55:45.333796+0000","last_peered":"2023-12-15T23:55:45.333796+0000","last_clean":"2023-12-15T23:55:45.333796+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-15T23:55:45.333796+0000","last_undegraded":"2023-12-15T23:55:45.333796+0000","last_fullsized":"2023-12-15T23:55:45.333796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334043+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-15T23:55:55.334043+0000","last_peered":"2023-12-15T23:55:55.334043+0000","last_clean":"2023-12-15T23:55:55.334043+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-15T23:55:55.334043+0000","last_undegraded":"2023-12-15T23:55:55.334043+0000","last_fullsized":"2023-12-15T23:55:55.334043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.329028+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-15T23:55:55.329028+0000","last_peered":"2023-12-15T23:55:55.329028+0000","last_clean":"2023-12-15T23:55:55.329028+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-15T23:55:55.329028+0000","last_undegraded":"2023-12-15T23:55:55.329028+0000","last_fullsized":"2023-12-15T23:55:55.329028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:00.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336144+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-15T23:56:25.336144+0000","last_peered":"2023-12-15T23:56:25.336144+0000","last_clean":"2023-12-15T23:56:25.336144+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-15T23:56:25.336144+0000","last_undegraded":"2023-12-15T23:56:25.336144+0000","last_fullsized":"2023-12-15T23:56:25.336144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:31.056179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":794,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335932+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-15T23:56:00.335932+0000","last_peered":"2023-12-15T23:56:00.335932+0000","last_clean":"2023-12-15T23:56:00.335932+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-15T23:56:00.335932+0000","last_undegraded":"2023-12-15T23:56:00.335932+0000","last_fullsized":"2023-12-15T23:56:00.335932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560472+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:56:10.560472+0000","last_peered":"2023-12-15T23:56:10.560472+0000","last_clean":"2023-12-15T23:56:10.560472+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:56:10.560472+0000","last_undegraded":"2023-12-15T23:56:10.560472+0000","last_fullsized":"2023-12-15T23:56:10.560472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345845+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:56:35.345845+0000","last_peered":"2023-12-15T23:56:35.345845+0000","last_clean":"2023-12-15T23:56:35.345845+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:56:35.345845+0000","last_undegraded":"2023-12-15T23:56:35.345845+0000","last_fullsized":"2023-12-15T23:56:35.345845+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:02.469293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:16.361776+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-15T23:58:16.361776+0000","last_peered":"2023-12-15T23:58:16.361776+0000","last_clean":"2023-12-15T23:58:16.361776+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-15T23:58:16.361776+0000","last_undegraded":"2023-12-15T23:58:16.361776+0000","last_fullsized":"2023-12-15T23:58:16.361776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:18.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370227+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-15T23:58:10.370227+0000","last_peered":"2023-12-15T23:58:10.370227+0000","last_clean":"2023-12-15T23:58:10.370227+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-15T23:58:10.370227+0000","last_undegraded":"2023-12-15T23:58:10.370227+0000","last_fullsized":"2023-12-15T23:58:10.370227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:26:44.954886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334633+0000","last_change":"2023-12-15T22:53:30.176318+0000","last_active":"2023-12-15T23:56:20.334633+0000","last_peered":"2023-12-15T23:56:20.334633+0000","last_clean":"2023-12-15T23:56:20.334633+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-15T23:56:20.334633+0000","last_undegraded":"2023-12-15T23:56:20.334633+0000","last_fullsized":"2023-12-15T23:56:20.334633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:13.030255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3261,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565177+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:56:30.565177+0000","last_peered":"2023-12-15T23:56:30.565177+0000","last_clean":"2023-12-15T23:56:30.565177+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:56:30.565177+0000","last_undegraded":"2023-12-15T23:56:30.565177+0000","last_fullsized":"2023-12-15T23:56:30.565177+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:36.870664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"49'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556660+0000","last_change":"2023-12-15T22:53:26.164024+0000","last_active":"2023-12-15T23:55:55.556660+0000","last_peered":"2023-12-15T23:55:55.556660+0000","last_clean":"2023-12-15T23:55:55.556660+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-15T23:55:55.556660+0000","last_undegraded":"2023-12-15T23:55:55.556660+0000","last_fullsized":"2023-12-15T23:55:55.556660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:41.322906+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-15T23:55:41.322906+0000","last_peered":"2023-12-15T23:55:41.322906+0000","last_clean":"2023-12-15T23:55:41.322906+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-15T23:55:41.322906+0000","last_undegraded":"2023-12-15T23:55:41.322906+0000","last_fullsized":"2023-12-15T23:55:41.322906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:47.568953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333892+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-15T23:55:45.333892+0000","last_peered":"2023-12-15T23:55:45.333892+0000","last_clean":"2023-12-15T23:55:45.333892+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-15T23:55:45.333892+0000","last_undegraded":"2023-12-15T23:55:45.333892+0000","last_fullsized":"2023-12-15T23:55:45.333892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335457+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-15T23:55:55.335457+0000","last_peered":"2023-12-15T23:55:55.335457+0000","last_clean":"2023-12-15T23:55:55.335457+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-15T23:55:55.335457+0000","last_undegraded":"2023-12-15T23:55:55.335457+0000","last_fullsized":"2023-12-15T23:55:55.335457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334772+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-15T23:55:55.334772+0000","last_peered":"2023-12-15T23:55:55.334772+0000","last_clean":"2023-12-15T23:55:55.334772+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-15T23:55:55.334772+0000","last_undegraded":"2023-12-15T23:55:55.334772+0000","last_fullsized":"2023-12-15T23:55:55.334772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:24.167330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335919+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-15T23:56:00.335919+0000","last_peered":"2023-12-15T23:56:00.335919+0000","last_clean":"2023-12-15T23:56:00.335919+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-15T23:56:00.335919+0000","last_undegraded":"2023-12-15T23:56:00.335919+0000","last_fullsized":"2023-12-15T23:56:00.335919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:13.618757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":795,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.562788+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-15T23:56:20.562788+0000","last_peered":"2023-12-15T23:56:20.562788+0000","last_clean":"2023-12-15T23:56:20.562788+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-15T23:56:20.562788+0000","last_undegraded":"2023-12-15T23:56:20.562788+0000","last_fullsized":"2023-12-15T23:56:20.562788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:39.943256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336566+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-15T23:56:36.336566+0000","last_peered":"2023-12-15T23:56:36.336566+0000","last_clean":"2023-12-15T23:56:36.336566+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-15T23:56:36.336566+0000","last_undegraded":"2023-12-15T23:56:36.336566+0000","last_fullsized":"2023-12-15T23:56:36.336566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:08.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1569,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344451+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-15T23:56:35.344451+0000","last_peered":"2023-12-15T23:56:35.344451+0000","last_clean":"2023-12-15T23:56:35.344451+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-15T23:56:35.344451+0000","last_undegraded":"2023-12-15T23:56:35.344451+0000","last_fullsized":"2023-12-15T23:56:35.344451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:15:15.009231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343006+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-15T23:56:30.343006+0000","last_peered":"2023-12-15T23:56:30.343006+0000","last_clean":"2023-12-15T23:56:30.343006+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-15T23:56:30.343006+0000","last_undegraded":"2023-12-15T23:56:30.343006+0000","last_fullsized":"2023-12-15T23:56:30.343006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353594+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:57:46.353594+0000","last_peered":"2023-12-15T23:57:46.353594+0000","last_clean":"2023-12-15T23:57:46.353594+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:57:46.353594+0000","last_undegraded":"2023-12-15T23:57:46.353594+0000","last_fullsized":"2023-12-15T23:57:46.353594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:32.398010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342201+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-15T23:56:20.342201+0000","last_peered":"2023-12-15T23:56:20.342201+0000","last_clean":"2023-12-15T23:56:20.342201+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-15T23:56:20.342201+0000","last_undegraded":"2023-12-15T23:56:20.342201+0000","last_fullsized":"2023-12-15T23:56:20.342201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:13.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'342","reported_seq":508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342111+0000","last_change":"2023-12-15T22:53:28.172209+0000","last_active":"2023-12-15T23:56:20.342111+0000","last_peered":"2023-12-15T23:56:20.342111+0000","last_clean":"2023-12-15T23:56:20.342111+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-15T23:56:20.342111+0000","last_undegraded":"2023-12-15T23:56:20.342111+0000","last_fullsized":"2023-12-15T23:56:20.342111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:40.476433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.371963+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-15T23:58:15.371963+0000","last_peered":"2023-12-15T23:58:15.371963+0000","last_clean":"2023-12-15T23:58:15.371963+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-15T23:58:15.371963+0000","last_undegraded":"2023-12-15T23:58:15.371963+0000","last_fullsized":"2023-12-15T23:58:15.371963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:21:22.340026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365463+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-15T23:57:55.365463+0000","last_peered":"2023-12-15T23:57:55.365463+0000","last_clean":"2023-12-15T23:57:55.365463+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-15T23:57:55.365463+0000","last_undegraded":"2023-12-15T23:57:55.365463+0000","last_fullsized":"2023-12-15T23:57:55.365463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339554+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-15T23:56:10.339554+0000","last_peered":"2023-12-15T23:56:10.339554+0000","last_clean":"2023-12-15T23:56:10.339554+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-15T23:56:10.339554+0000","last_undegraded":"2023-12-15T23:56:10.339554+0000","last_fullsized":"2023-12-15T23:56:10.339554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367610+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-15T23:58:05.367610+0000","last_peered":"2023-12-15T23:58:05.367610+0000","last_clean":"2023-12-15T23:58:05.367610+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-15T23:58:05.367610+0000","last_undegraded":"2023-12-15T23:58:05.367610+0000","last_fullsized":"2023-12-15T23:58:05.367610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:31.374833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":249,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340302+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-15T23:56:15.340302+0000","last_peered":"2023-12-15T23:56:15.340302+0000","last_clean":"2023-12-15T23:56:15.340302+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-15T23:56:15.340302+0000","last_undegraded":"2023-12-15T23:56:15.340302+0000","last_fullsized":"2023-12-15T23:56:15.340302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560374+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-15T23:56:10.560374+0000","last_peered":"2023-12-15T23:56:10.560374+0000","last_clean":"2023-12-15T23:56:10.560374+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-15T23:56:10.560374+0000","last_undegraded":"2023-12-15T23:56:10.560374+0000","last_fullsized":"2023-12-15T23:56:10.560374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:37.180934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362737+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:57:45.362737+0000","last_peered":"2023-12-15T23:57:45.362737+0000","last_clean":"2023-12-15T23:57:45.362737+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:57:45.362737+0000","last_undegraded":"2023-12-15T23:57:45.362737+0000","last_fullsized":"2023-12-15T23:57:45.362737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.338476+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-15T23:56:35.338476+0000","last_peered":"2023-12-15T23:56:35.338476+0000","last_clean":"2023-12-15T23:56:35.338476+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-15T23:56:35.338476+0000","last_undegraded":"2023-12-15T23:56:35.338476+0000","last_fullsized":"2023-12-15T23:56:35.338476+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:00:00.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3976,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345750+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-15T23:56:35.345750+0000","last_peered":"2023-12-15T23:56:35.345750+0000","last_clean":"2023-12-15T23:56:35.345750+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-15T23:56:35.345750+0000","last_undegraded":"2023-12-15T23:56:35.345750+0000","last_fullsized":"2023-12-15T23:56:35.345750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:58.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.370715+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-15T23:58:15.370715+0000","last_peered":"2023-12-15T23:58:15.370715+0000","last_clean":"2023-12-15T23:58:15.370715+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-15T23:58:15.370715+0000","last_undegraded":"2023-12-15T23:58:15.370715+0000","last_fullsized":"2023-12-15T23:58:15.370715+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:19:34.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369593+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-15T23:58:10.369593+0000","last_peered":"2023-12-15T23:58:10.369593+0000","last_clean":"2023-12-15T23:58:10.369593+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-15T23:58:10.369593+0000","last_undegraded":"2023-12-15T23:58:10.369593+0000","last_fullsized":"2023-12-15T23:58:10.369593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342347+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-15T23:56:20.342347+0000","last_peered":"2023-12-15T23:56:20.342347+0000","last_clean":"2023-12-15T23:56:20.342347+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-15T23:56:20.342347+0000","last_undegraded":"2023-12-15T23:56:20.342347+0000","last_fullsized":"2023-12-15T23:56:20.342347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:27.749157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'777","reported_seq":2399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341074+0000","last_change":"2023-12-15T22:53:28.168322+0000","last_active":"2023-12-15T23:56:20.341074+0000","last_peered":"2023-12-15T23:56:20.341074+0000","last_clean":"2023-12-15T23:56:20.341074+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-15T23:56:20.341074+0000","last_undegraded":"2023-12-15T23:56:20.341074+0000","last_fullsized":"2023-12-15T23:56:20.341074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588660+0000","last_change":"2023-12-15T22:53:26.160880+0000","last_active":"2023-12-15T23:58:00.588660+0000","last_peered":"2023-12-15T23:58:00.588660+0000","last_clean":"2023-12-15T23:58:00.588660+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-15T23:58:00.588660+0000","last_undegraded":"2023-12-15T23:58:00.588660+0000","last_fullsized":"2023-12-15T23:58:00.588660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356180+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-15T23:57:56.356180+0000","last_peered":"2023-12-15T23:57:56.356180+0000","last_clean":"2023-12-15T23:57:56.356180+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-15T23:57:56.356180+0000","last_undegraded":"2023-12-15T23:57:56.356180+0000","last_fullsized":"2023-12-15T23:57:56.356180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359022+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-15T23:58:05.359022+0000","last_peered":"2023-12-15T23:58:05.359022+0000","last_clean":"2023-12-15T23:58:05.359022+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-15T23:58:05.359022+0000","last_undegraded":"2023-12-15T23:58:05.359022+0000","last_fullsized":"2023-12-15T23:58:05.359022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:29.645708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560345+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-15T23:56:10.560345+0000","last_peered":"2023-12-15T23:56:10.560345+0000","last_clean":"2023-12-15T23:56:10.560345+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-15T23:56:10.560345+0000","last_undegraded":"2023-12-15T23:56:10.560345+0000","last_fullsized":"2023-12-15T23:56:10.560345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:55.500999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333744+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-15T23:56:15.333744+0000","last_peered":"2023-12-15T23:56:15.333744+0000","last_clean":"2023-12-15T23:56:15.333744+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-15T23:56:15.333744+0000","last_undegraded":"2023-12-15T23:56:15.333744+0000","last_fullsized":"2023-12-15T23:56:15.333744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:51.409885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357884+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-15T23:58:01.357884+0000","last_peered":"2023-12-15T23:58:01.357884+0000","last_clean":"2023-12-15T23:58:01.357884+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-15T23:58:01.357884+0000","last_undegraded":"2023-12-15T23:58:01.357884+0000","last_fullsized":"2023-12-15T23:58:01.357884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:39.186844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344266+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-15T23:56:35.344266+0000","last_peered":"2023-12-15T23:56:35.344266+0000","last_clean":"2023-12-15T23:56:35.344266+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-15T23:56:35.344266+0000","last_undegraded":"2023-12-15T23:56:35.344266+0000","last_fullsized":"2023-12-15T23:56:35.344266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:46.912902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1650,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.362356+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-15T23:58:20.362356+0000","last_peered":"2023-12-15T23:58:20.362356+0000","last_clean":"2023-12-15T23:58:20.362356+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-15T23:58:20.362356+0000","last_undegraded":"2023-12-15T23:58:20.362356+0000","last_fullsized":"2023-12-15T23:58:20.362356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:55.411932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344494+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-15T23:56:30.344494+0000","last_peered":"2023-12-15T23:56:30.344494+0000","last_clean":"2023-12-15T23:56:30.344494+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-15T23:56:30.344494+0000","last_undegraded":"2023-12-15T23:56:30.344494+0000","last_fullsized":"2023-12-15T23:56:30.344494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369737+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-15T23:58:10.369737+0000","last_peered":"2023-12-15T23:58:10.369737+0000","last_clean":"2023-12-15T23:58:10.369737+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-15T23:58:10.369737+0000","last_undegraded":"2023-12-15T23:58:10.369737+0000","last_fullsized":"2023-12-15T23:58:10.369737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331874+0000","last_change":"2023-12-15T22:53:30.176469+0000","last_active":"2023-12-15T23:56:16.331874+0000","last_peered":"2023-12-15T23:56:16.331874+0000","last_clean":"2023-12-15T23:56:16.331874+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-15T23:56:16.331874+0000","last_undegraded":"2023-12-15T23:56:16.331874+0000","last_fullsized":"2023-12-15T23:56:16.331874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:01.243566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.369293+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-15T23:58:05.369293+0000","last_peered":"2023-12-15T23:58:05.369293+0000","last_clean":"2023-12-15T23:58:05.369293+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-15T23:58:05.369293+0000","last_undegraded":"2023-12-15T23:58:05.369293+0000","last_fullsized":"2023-12-15T23:58:05.369293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'5","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340715+0000","last_change":"2023-12-15T22:53:26.163456+0000","last_active":"2023-12-15T23:56:15.340715+0000","last_peered":"2023-12-15T23:56:15.340715+0000","last_clean":"2023-12-15T23:56:15.340715+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-15T23:56:15.340715+0000","last_undegraded":"2023-12-15T23:56:15.340715+0000","last_fullsized":"2023-12-15T23:56:15.340715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368939+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-15T23:58:10.368939+0000","last_peered":"2023-12-15T23:58:10.368939+0000","last_clean":"2023-12-15T23:58:10.368939+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-15T23:58:10.368939+0000","last_undegraded":"2023-12-15T23:58:10.368939+0000","last_fullsized":"2023-12-15T23:58:10.368939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334578+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-15T23:55:55.334578+0000","last_peered":"2023-12-15T23:55:55.334578+0000","last_clean":"2023-12-15T23:55:55.334578+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-15T23:55:55.334578+0000","last_undegraded":"2023-12-15T23:55:55.334578+0000","last_fullsized":"2023-12-15T23:55:55.334578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:22.502479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331481+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-15T23:56:05.331481+0000","last_peered":"2023-12-15T23:56:05.331481+0000","last_clean":"2023-12-15T23:56:05.331481+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-15T23:56:05.331481+0000","last_undegraded":"2023-12-15T23:56:05.331481+0000","last_fullsized":"2023-12-15T23:56:05.331481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:58.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369516+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-15T23:58:10.369516+0000","last_peered":"2023-12-15T23:58:10.369516+0000","last_clean":"2023-12-15T23:58:10.369516+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-15T23:58:10.369516+0000","last_undegraded":"2023-12-15T23:58:10.369516+0000","last_fullsized":"2023-12-15T23:58:10.369516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370384+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-15T23:58:10.370384+0000","last_peered":"2023-12-15T23:58:10.370384+0000","last_clean":"2023-12-15T23:58:10.370384+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-15T23:58:10.370384+0000","last_undegraded":"2023-12-15T23:58:10.370384+0000","last_fullsized":"2023-12-15T23:58:10.370384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370814+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-15T23:58:10.370814+0000","last_peered":"2023-12-15T23:58:10.370814+0000","last_clean":"2023-12-15T23:58:10.370814+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-15T23:58:10.370814+0000","last_undegraded":"2023-12-15T23:58:10.370814+0000","last_fullsized":"2023-12-15T23:58:10.370814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:21.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341847+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-15T23:56:50.341847+0000","last_peered":"2023-12-15T23:56:50.341847+0000","last_clean":"2023-12-15T23:56:50.341847+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-15T23:56:50.341847+0000","last_undegraded":"2023-12-15T23:56:50.341847+0000","last_fullsized":"2023-12-15T23:56:50.341847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:13:08.808826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566493+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-15T23:56:35.566493+0000","last_peered":"2023-12-15T23:56:35.566493+0000","last_clean":"2023-12-15T23:56:35.566493+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-15T23:56:35.566493+0000","last_undegraded":"2023-12-15T23:56:35.566493+0000","last_fullsized":"2023-12-15T23:56:35.566493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:11.823256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344162+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-15T23:56:30.344162+0000","last_peered":"2023-12-15T23:56:30.344162+0000","last_clean":"2023-12-15T23:56:30.344162+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-15T23:56:30.344162+0000","last_undegraded":"2023-12-15T23:56:30.344162+0000","last_fullsized":"2023-12-15T23:56:30.344162+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:26.339363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370477+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-15T23:58:10.370477+0000","last_peered":"2023-12-15T23:58:10.370477+0000","last_clean":"2023-12-15T23:58:10.370477+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-15T23:58:10.370477+0000","last_undegraded":"2023-12-15T23:58:10.370477+0000","last_fullsized":"2023-12-15T23:58:10.370477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:31.522105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367802+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-15T23:58:05.367802+0000","last_peered":"2023-12-15T23:58:05.367802+0000","last_clean":"2023-12-15T23:58:05.367802+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-15T23:58:05.367802+0000","last_undegraded":"2023-12-15T23:58:05.367802+0000","last_fullsized":"2023-12-15T23:58:05.367802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:58.411627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1652","reported_seq":2674,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333978+0000","last_change":"2023-12-15T22:53:28.166989+0000","last_active":"2023-12-15T23:56:15.333978+0000","last_peered":"2023-12-15T23:56:15.333978+0000","last_clean":"2023-12-15T23:56:15.333978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-15T23:56:15.333978+0000","last_undegraded":"2023-12-15T23:56:15.333978+0000","last_fullsized":"2023-12-15T23:56:15.333978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:18.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340671+0000","last_change":"2023-12-15T22:53:26.163111+0000","last_active":"2023-12-15T23:56:15.340671+0000","last_peered":"2023-12-15T23:56:15.340671+0000","last_clean":"2023-12-15T23:56:15.340671+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-15T23:56:15.340671+0000","last_undegraded":"2023-12-15T23:56:15.340671+0000","last_fullsized":"2023-12-15T23:56:15.340671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335797+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-15T23:55:55.335797+0000","last_peered":"2023-12-15T23:55:55.335797+0000","last_clean":"2023-12-15T23:55:55.335797+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-15T23:55:55.335797+0000","last_undegraded":"2023-12-15T23:55:55.335797+0000","last_fullsized":"2023-12-15T23:55:55.335797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335758+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-15T23:55:55.335758+0000","last_peered":"2023-12-15T23:55:55.335758+0000","last_clean":"2023-12-15T23:55:55.335758+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-15T23:55:55.335758+0000","last_undegraded":"2023-12-15T23:55:55.335758+0000","last_fullsized":"2023-12-15T23:55:55.335758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332486+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-15T23:56:10.332486+0000","last_peered":"2023-12-15T23:56:10.332486+0000","last_clean":"2023-12-15T23:56:10.332486+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-15T23:56:10.332486+0000","last_undegraded":"2023-12-15T23:56:10.332486+0000","last_fullsized":"2023-12-15T23:56:10.332486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:12:03.582433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370332+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-15T23:58:10.370332+0000","last_peered":"2023-12-15T23:58:10.370332+0000","last_clean":"2023-12-15T23:58:10.370332+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-15T23:58:10.370332+0000","last_undegraded":"2023-12-15T23:58:10.370332+0000","last_fullsized":"2023-12-15T23:58:10.370332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360212+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-15T23:58:10.360212+0000","last_peered":"2023-12-15T23:58:10.360212+0000","last_clean":"2023-12-15T23:58:10.360212+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-15T23:58:10.360212+0000","last_undegraded":"2023-12-15T23:58:10.360212+0000","last_fullsized":"2023-12-15T23:58:10.360212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:59.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591341+0000","last_change":"2023-12-15T22:53:10.340508+0000","last_active":"2023-12-15T23:58:10.591341+0000","last_peered":"2023-12-15T23:58:10.591341+0000","last_clean":"2023-12-15T23:58:10.591341+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-15T23:58:10.591341+0000","last_undegraded":"2023-12-15T23:58:10.591341+0000","last_fullsized":"2023-12-15T23:58:10.591341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:57.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.563036+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-15T23:56:20.563036+0000","last_peered":"2023-12-15T23:56:20.563036+0000","last_clean":"2023-12-15T23:56:20.563036+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-15T23:56:20.563036+0000","last_undegraded":"2023-12-15T23:56:20.563036+0000","last_fullsized":"2023-12-15T23:56:20.563036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:04:25.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3530,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.351010+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:56:55.351010+0000","last_peered":"2023-12-15T23:56:55.351010+0000","last_clean":"2023-12-15T23:56:55.351010+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:56:55.351010+0000","last_undegraded":"2023-12-15T23:56:55.351010+0000","last_fullsized":"2023-12-15T23:56:55.351010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:09.097073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:46.338997+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-15T23:56:46.338997+0000","last_peered":"2023-12-15T23:56:46.338997+0000","last_clean":"2023-12-15T23:56:46.338997+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-15T23:56:46.338997+0000","last_undegraded":"2023-12-15T23:56:46.338997+0000","last_fullsized":"2023-12-15T23:56:46.338997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:50.579490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369071+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-15T23:58:10.369071+0000","last_peered":"2023-12-15T23:58:10.369071+0000","last_clean":"2023-12-15T23:58:10.369071+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-15T23:58:10.369071+0000","last_undegraded":"2023-12-15T23:58:10.369071+0000","last_fullsized":"2023-12-15T23:58:10.369071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:23.414022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368432+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-15T23:58:05.368432+0000","last_peered":"2023-12-15T23:58:05.368432+0000","last_clean":"2023-12-15T23:58:05.368432+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-15T23:58:05.368432+0000","last_undegraded":"2023-12-15T23:58:05.368432+0000","last_fullsized":"2023-12-15T23:58:05.368432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:01:44.643639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.589587+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-15T23:58:05.589587+0000","last_peered":"2023-12-15T23:58:05.589587+0000","last_clean":"2023-12-15T23:58:05.589587+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-15T23:58:05.589587+0000","last_undegraded":"2023-12-15T23:58:05.589587+0000","last_fullsized":"2023-12-15T23:58:05.589587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.019947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'4","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367754+0000","last_change":"2023-12-15T22:53:26.165088+0000","last_active":"2023-12-15T23:58:00.367754+0000","last_peered":"2023-12-15T23:58:00.367754+0000","last_clean":"2023-12-15T23:58:00.367754+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-15T23:58:00.367754+0000","last_undegraded":"2023-12-15T23:58:00.367754+0000","last_fullsized":"2023-12-15T23:58:00.367754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:14.026739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326539+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-15T23:55:56.326539+0000","last_peered":"2023-12-15T23:55:56.326539+0000","last_clean":"2023-12-15T23:55:56.326539+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-15T23:55:56.326539+0000","last_undegraded":"2023-12-15T23:55:56.326539+0000","last_fullsized":"2023-12-15T23:55:56.326539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-15T23:55:55.556758+0000","last_peered":"2023-12-15T23:55:55.556758+0000","last_clean":"2023-12-15T23:55:55.556758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-15T23:55:55.556758+0000","last_undegraded":"2023-12-15T23:55:55.556758+0000","last_fullsized":"2023-12-15T23:55:55.556758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:17.629224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331590+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-15T23:56:05.331590+0000","last_peered":"2023-12-15T23:56:05.331590+0000","last_clean":"2023-12-15T23:56:05.331590+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-15T23:56:05.331590+0000","last_undegraded":"2023-12-15T23:56:05.331590+0000","last_fullsized":"2023-12-15T23:56:05.331590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:20.899928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.329372+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-15T23:56:06.329372+0000","last_peered":"2023-12-15T23:56:06.329372+0000","last_clean":"2023-12-15T23:56:06.329372+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-15T23:56:06.329372+0000","last_undegraded":"2023-12-15T23:56:06.329372+0000","last_fullsized":"2023-12-15T23:56:06.329372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:33.385736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343663+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-15T23:56:25.343663+0000","last_peered":"2023-12-15T23:56:25.343663+0000","last_clean":"2023-12-15T23:56:25.343663+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-15T23:56:25.343663+0000","last_undegraded":"2023-12-15T23:56:25.343663+0000","last_fullsized":"2023-12-15T23:56:25.343663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578335+0000","last_change":"2023-12-15T22:53:10.339820+0000","last_active":"2023-12-15T23:57:20.578335+0000","last_peered":"2023-12-15T23:57:20.578335+0000","last_clean":"2023-12-15T23:57:20.578335+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:57:20.578335+0000","last_undegraded":"2023-12-15T23:57:20.578335+0000","last_fullsized":"2023-12-15T23:57:20.578335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:16.322332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342330+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-15T23:56:20.342330+0000","last_peered":"2023-12-15T23:56:20.342330+0000","last_clean":"2023-12-15T23:56:20.342330+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-15T23:56:20.342330+0000","last_undegraded":"2023-12-15T23:56:20.342330+0000","last_fullsized":"2023-12-15T23:56:20.342330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:25.701757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":884,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350904+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:56:55.350904+0000","last_peered":"2023-12-15T23:56:55.350904+0000","last_clean":"2023-12-15T23:56:55.350904+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:56:55.350904+0000","last_undegraded":"2023-12-15T23:56:55.350904+0000","last_fullsized":"2023-12-15T23:56:55.350904+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:19.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344331+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-15T23:56:30.344331+0000","last_peered":"2023-12-15T23:56:30.344331+0000","last_clean":"2023-12-15T23:56:30.344331+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-15T23:56:30.344331+0000","last_undegraded":"2023-12-15T23:56:30.344331+0000","last_fullsized":"2023-12-15T23:56:30.344331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:35.691834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340903+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-15T23:56:20.340903+0000","last_peered":"2023-12-15T23:56:20.340903+0000","last_clean":"2023-12-15T23:56:20.340903+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-15T23:56:20.340903+0000","last_undegraded":"2023-12-15T23:56:20.340903+0000","last_fullsized":"2023-12-15T23:56:20.340903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359147+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-15T23:58:05.359147+0000","last_peered":"2023-12-15T23:58:05.359147+0000","last_clean":"2023-12-15T23:58:05.359147+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-15T23:58:05.359147+0000","last_undegraded":"2023-12-15T23:58:05.359147+0000","last_fullsized":"2023-12-15T23:58:05.359147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:43.704505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'434","reported_seq":826,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359244+0000","last_change":"2023-12-15T22:53:28.165130+0000","last_active":"2023-12-15T23:58:05.359244+0000","last_peered":"2023-12-15T23:58:05.359244+0000","last_clean":"2023-12-15T23:58:05.359244+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-15T23:58:05.359244+0000","last_undegraded":"2023-12-15T23:58:05.359244+0000","last_fullsized":"2023-12-15T23:58:05.359244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:09.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.581910+0000","last_change":"2023-12-15T22:53:26.156795+0000","last_active":"2023-12-15T23:57:35.581910+0000","last_peered":"2023-12-15T23:57:35.581910+0000","last_clean":"2023-12-15T23:57:35.581910+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-15T23:57:35.581910+0000","last_undegraded":"2023-12-15T23:57:35.581910+0000","last_fullsized":"2023-12-15T23:57:35.581910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:29.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334631+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-15T23:55:55.334631+0000","last_peered":"2023-12-15T23:55:55.334631+0000","last_clean":"2023-12-15T23:55:55.334631+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-15T23:55:55.334631+0000","last_undegraded":"2023-12-15T23:55:55.334631+0000","last_fullsized":"2023-12-15T23:55:55.334631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:44.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369701+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-15T23:58:10.369701+0000","last_peered":"2023-12-15T23:58:10.369701+0000","last_clean":"2023-12-15T23:58:10.369701+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-15T23:58:10.369701+0000","last_undegraded":"2023-12-15T23:58:10.369701+0000","last_fullsized":"2023-12-15T23:58:10.369701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559219+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-15T23:56:05.559219+0000","last_peered":"2023-12-15T23:56:05.559219+0000","last_clean":"2023-12-15T23:56:05.559219+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-15T23:56:05.559219+0000","last_undegraded":"2023-12-15T23:56:05.559219+0000","last_fullsized":"2023-12-15T23:56:05.559219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:55.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336323+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-15T23:56:25.336323+0000","last_peered":"2023-12-15T23:56:25.336323+0000","last_clean":"2023-12-15T23:56:25.336323+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-15T23:56:25.336323+0000","last_undegraded":"2023-12-15T23:56:25.336323+0000","last_fullsized":"2023-12-15T23:56:25.336323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:58.115309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332781+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-15T23:56:10.332781+0000","last_peered":"2023-12-15T23:56:10.332781+0000","last_clean":"2023-12-15T23:56:10.332781+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-15T23:56:10.332781+0000","last_undegraded":"2023-12-15T23:56:10.332781+0000","last_fullsized":"2023-12-15T23:56:10.332781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:11.050275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584443+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:57:45.584443+0000","last_peered":"2023-12-15T23:57:45.584443+0000","last_clean":"2023-12-15T23:57:45.584443+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:57:45.584443+0000","last_undegraded":"2023-12-15T23:57:45.584443+0000","last_fullsized":"2023-12-15T23:57:45.584443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347388+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-15T23:56:45.347388+0000","last_peered":"2023-12-15T23:56:45.347388+0000","last_clean":"2023-12-15T23:56:45.347388+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-15T23:56:45.347388+0000","last_undegraded":"2023-12-15T23:56:45.347388+0000","last_fullsized":"2023-12-15T23:56:45.347388+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:15.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3437,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344672+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-15T23:56:35.344672+0000","last_peered":"2023-12-15T23:56:35.344672+0000","last_clean":"2023-12-15T23:56:35.344672+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-15T23:56:35.344672+0000","last_undegraded":"2023-12-15T23:56:35.344672+0000","last_fullsized":"2023-12-15T23:56:35.344672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:27:53.377560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348840+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:56:50.348840+0000","last_peered":"2023-12-15T23:56:50.348840+0000","last_clean":"2023-12-15T23:56:50.348840+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:56:50.348840+0000","last_undegraded":"2023-12-15T23:56:50.348840+0000","last_fullsized":"2023-12-15T23:56:50.348840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:13.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564275+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-15T23:56:25.564275+0000","last_peered":"2023-12-15T23:56:25.564275+0000","last_clean":"2023-12-15T23:56:25.564275+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-15T23:56:25.564275+0000","last_undegraded":"2023-12-15T23:56:25.564275+0000","last_fullsized":"2023-12-15T23:56:25.564275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:39.121105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358717+0000","last_change":"2023-12-15T22:53:30.183489+0000","last_active":"2023-12-15T23:58:06.358717+0000","last_peered":"2023-12-15T23:58:06.358717+0000","last_clean":"2023-12-15T23:58:06.358717+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-15T23:58:06.358717+0000","last_undegraded":"2023-12-15T23:58:06.358717+0000","last_fullsized":"2023-12-15T23:58:06.358717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:04.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'594","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362425+0000","last_change":"2023-12-15T22:53:28.166896+0000","last_active":"2023-12-15T23:57:45.362425+0000","last_peered":"2023-12-15T23:57:45.362425+0000","last_clean":"2023-12-15T23:57:45.362425+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-15T23:57:45.362425+0000","last_undegraded":"2023-12-15T23:57:45.362425+0000","last_fullsized":"2023-12-15T23:57:45.362425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:28.124124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367047+0000","last_change":"2023-12-15T22:53:26.161720+0000","last_active":"2023-12-15T23:58:00.367047+0000","last_peered":"2023-12-15T23:58:00.367047+0000","last_clean":"2023-12-15T23:58:00.367047+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-15T23:58:00.367047+0000","last_undegraded":"2023-12-15T23:58:00.367047+0000","last_fullsized":"2023-12-15T23:58:00.367047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:28.010705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326742+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-15T23:55:56.326742+0000","last_peered":"2023-12-15T23:55:56.326742+0000","last_clean":"2023-12-15T23:55:56.326742+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-15T23:55:56.326742+0000","last_undegraded":"2023-12-15T23:55:56.326742+0000","last_fullsized":"2023-12-15T23:55:56.326742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356136+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-15T23:57:56.356136+0000","last_peered":"2023-12-15T23:57:56.356136+0000","last_clean":"2023-12-15T23:57:56.356136+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-15T23:57:56.356136+0000","last_undegraded":"2023-12-15T23:57:56.356136+0000","last_fullsized":"2023-12-15T23:57:56.356136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:38.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342283+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-15T23:56:20.342283+0000","last_peered":"2023-12-15T23:56:20.342283+0000","last_clean":"2023-12-15T23:56:20.342283+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-15T23:56:20.342283+0000","last_undegraded":"2023-12-15T23:56:20.342283+0000","last_fullsized":"2023-12-15T23:56:20.342283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560515+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-15T23:56:10.560515+0000","last_peered":"2023-12-15T23:56:10.560515+0000","last_clean":"2023-12-15T23:56:10.560515+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-15T23:56:10.560515+0000","last_undegraded":"2023-12-15T23:56:10.560515+0000","last_fullsized":"2023-12-15T23:56:10.560515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:40.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330607+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:56:11.330607+0000","last_peered":"2023-12-15T23:56:11.330607+0000","last_clean":"2023-12-15T23:56:11.330607+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-15T23:56:11.330607+0000","last_undegraded":"2023-12-15T23:56:11.330607+0000","last_fullsized":"2023-12-15T23:56:11.330607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:15.547530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353777+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:57:46.353777+0000","last_peered":"2023-12-15T23:57:46.353777+0000","last_clean":"2023-12-15T23:57:46.353777+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:57:46.353777+0000","last_undegraded":"2023-12-15T23:57:46.353777+0000","last_fullsized":"2023-12-15T23:57:46.353777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:08.837316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566821+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-15T23:56:35.566821+0000","last_peered":"2023-12-15T23:56:35.566821+0000","last_clean":"2023-12-15T23:56:35.566821+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-15T23:56:35.566821+0000","last_undegraded":"2023-12-15T23:56:35.566821+0000","last_fullsized":"2023-12-15T23:56:35.566821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1758,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349715+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-15T23:56:50.349715+0000","last_peered":"2023-12-15T23:56:50.349715+0000","last_clean":"2023-12-15T23:56:50.349715+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-15T23:56:50.349715+0000","last_undegraded":"2023-12-15T23:56:50.349715+0000","last_fullsized":"2023-12-15T23:56:50.349715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:20.444898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348796+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:56:50.348796+0000","last_peered":"2023-12-15T23:56:50.348796+0000","last_clean":"2023-12-15T23:56:50.348796+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:56:50.348796+0000","last_undegraded":"2023-12-15T23:56:50.348796+0000","last_fullsized":"2023-12-15T23:56:50.348796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564359+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-15T23:56:25.564359+0000","last_peered":"2023-12-15T23:56:25.564359+0000","last_clean":"2023-12-15T23:56:25.564359+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-15T23:56:25.564359+0000","last_undegraded":"2023-12-15T23:56:25.564359+0000","last_fullsized":"2023-12-15T23:56:25.564359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:49.839990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583014+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:57:40.583014+0000","last_peered":"2023-12-15T23:57:40.583014+0000","last_clean":"2023-12-15T23:57:40.583014+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:57:40.583014+0000","last_undegraded":"2023-12-15T23:57:40.583014+0000","last_fullsized":"2023-12-15T23:57:40.583014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:36.864485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'312","reported_seq":520,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358697+0000","last_change":"2023-12-15T22:53:28.170097+0000","last_active":"2023-12-15T23:58:06.358697+0000","last_peered":"2023-12-15T23:58:06.358697+0000","last_clean":"2023-12-15T23:58:06.358697+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-15T23:58:06.358697+0000","last_undegraded":"2023-12-15T23:58:06.358697+0000","last_fullsized":"2023-12-15T23:58:06.358697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:11.019249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588540+0000","last_change":"2023-12-15T22:53:26.164887+0000","last_active":"2023-12-15T23:58:00.588540+0000","last_peered":"2023-12-15T23:58:00.588540+0000","last_clean":"2023-12-15T23:58:00.588540+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-15T23:58:00.588540+0000","last_undegraded":"2023-12-15T23:58:00.588540+0000","last_fullsized":"2023-12-15T23:58:00.588540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559374+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-15T23:56:05.559374+0000","last_peered":"2023-12-15T23:56:05.559374+0000","last_clean":"2023-12-15T23:56:05.559374+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-15T23:56:05.559374+0000","last_undegraded":"2023-12-15T23:56:05.559374+0000","last_fullsized":"2023-12-15T23:56:05.559374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:12.885816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356568+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-15T23:57:55.356568+0000","last_peered":"2023-12-15T23:57:55.356568+0000","last_clean":"2023-12-15T23:57:55.356568+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-15T23:57:55.356568+0000","last_undegraded":"2023-12-15T23:57:55.356568+0000","last_fullsized":"2023-12-15T23:57:55.356568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:54.088870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337183+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-15T23:56:05.337183+0000","last_peered":"2023-12-15T23:56:05.337183+0000","last_clean":"2023-12-15T23:56:05.337183+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-15T23:56:05.337183+0000","last_undegraded":"2023-12-15T23:56:05.337183+0000","last_fullsized":"2023-12-15T23:56:05.337183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:53.490096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339396+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-15T23:56:10.339396+0000","last_peered":"2023-12-15T23:56:10.339396+0000","last_clean":"2023-12-15T23:56:10.339396+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-15T23:56:10.339396+0000","last_undegraded":"2023-12-15T23:56:10.339396+0000","last_fullsized":"2023-12-15T23:56:10.339396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338360+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-15T23:56:10.338360+0000","last_peered":"2023-12-15T23:56:10.338360+0000","last_clean":"2023-12-15T23:56:10.338360+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-15T23:56:10.338360+0000","last_undegraded":"2023-12-15T23:56:10.338360+0000","last_fullsized":"2023-12-15T23:56:10.338360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584565+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:57:45.584565+0000","last_peered":"2023-12-15T23:57:45.584565+0000","last_clean":"2023-12-15T23:57:45.584565+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:57:45.584565+0000","last_undegraded":"2023-12-15T23:57:45.584565+0000","last_fullsized":"2023-12-15T23:57:45.584565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328974+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-15T23:55:55.328974+0000","last_peered":"2023-12-15T23:55:55.328974+0000","last_clean":"2023-12-15T23:55:55.328974+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-15T23:55:55.328974+0000","last_undegraded":"2023-12-15T23:55:55.328974+0000","last_fullsized":"2023-12-15T23:55:55.328974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:54.535000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1478,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.348066+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:57:21.348066+0000","last_peered":"2023-12-15T23:57:21.348066+0000","last_clean":"2023-12-15T23:57:21.348066+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:57:21.348066+0000","last_undegraded":"2023-12-15T23:57:21.348066+0000","last_fullsized":"2023-12-15T23:57:21.348066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573493+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:57:00.573493+0000","last_peered":"2023-12-15T23:57:00.573493+0000","last_clean":"2023-12-15T23:57:00.573493+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:57:00.573493+0000","last_undegraded":"2023-12-15T23:57:00.573493+0000","last_fullsized":"2023-12-15T23:57:00.573493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:49.584218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335364+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-15T23:56:31.335364+0000","last_peered":"2023-12-15T23:56:31.335364+0000","last_clean":"2023-12-15T23:56:31.335364+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-15T23:56:31.335364+0000","last_undegraded":"2023-12-15T23:56:31.335364+0000","last_fullsized":"2023-12-15T23:56:31.335364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:32.141954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565261+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-15T23:56:30.565261+0000","last_peered":"2023-12-15T23:56:30.565261+0000","last_clean":"2023-12-15T23:56:30.565261+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-15T23:56:30.565261+0000","last_undegraded":"2023-12-15T23:56:30.565261+0000","last_fullsized":"2023-12-15T23:56:30.565261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:18.046986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2092","reported_seq":3430,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344301+0000","last_change":"2023-12-15T22:53:28.171130+0000","last_active":"2023-12-15T23:56:30.344301+0000","last_peered":"2023-12-15T23:56:30.344301+0000","last_clean":"2023-12-15T23:56:30.344301+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-15T23:56:30.344301+0000","last_undegraded":"2023-12-15T23:56:30.344301+0000","last_fullsized":"2023-12-15T23:56:30.344301+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":200,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:14.487255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333562+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-15T23:56:15.333562+0000","last_peered":"2023-12-15T23:56:15.333562+0000","last_clean":"2023-12-15T23:56:15.333562+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-15T23:56:15.333562+0000","last_undegraded":"2023-12-15T23:56:15.333562+0000","last_fullsized":"2023-12-15T23:56:15.333562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:57.767288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363413+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:57:45.363413+0000","last_peered":"2023-12-15T23:57:45.363413+0000","last_clean":"2023-12-15T23:57:45.363413+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:57:45.363413+0000","last_undegraded":"2023-12-15T23:57:45.363413+0000","last_fullsized":"2023-12-15T23:57:45.363413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:11.540042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341710+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T23:56:25.341710+0000","last_peered":"2023-12-15T23:56:25.341710+0000","last_clean":"2023-12-15T23:56:25.341710+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T23:56:25.341710+0000","last_undegraded":"2023-12-15T23:56:25.341710+0000","last_fullsized":"2023-12-15T23:56:25.341710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580881+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:57:30.580881+0000","last_peered":"2023-12-15T23:57:30.580881+0000","last_clean":"2023-12-15T23:57:30.580881+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:57:30.580881+0000","last_undegraded":"2023-12-15T23:57:30.580881+0000","last_fullsized":"2023-12-15T23:57:30.580881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:56.749823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352586+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:57:41.352586+0000","last_peered":"2023-12-15T23:57:41.352586+0000","last_clean":"2023-12-15T23:57:41.352586+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:57:41.352586+0000","last_undegraded":"2023-12-15T23:57:41.352586+0000","last_fullsized":"2023-12-15T23:57:41.352586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:47.389382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369432+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-15T23:58:10.369432+0000","last_peered":"2023-12-15T23:58:10.369432+0000","last_clean":"2023-12-15T23:58:10.369432+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-15T23:58:10.369432+0000","last_undegraded":"2023-12-15T23:58:10.369432+0000","last_fullsized":"2023-12-15T23:58:10.369432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370878+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-15T23:58:10.370878+0000","last_peered":"2023-12-15T23:58:10.370878+0000","last_clean":"2023-12-15T23:58:10.370878+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-15T23:58:10.370878+0000","last_undegraded":"2023-12-15T23:58:10.370878+0000","last_fullsized":"2023-12-15T23:58:10.370878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:37.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368841+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-15T23:58:10.368841+0000","last_peered":"2023-12-15T23:58:10.368841+0000","last_clean":"2023-12-15T23:58:10.368841+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-15T23:58:10.368841+0000","last_undegraded":"2023-12-15T23:58:10.368841+0000","last_fullsized":"2023-12-15T23:58:10.368841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337269+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-15T23:56:05.337269+0000","last_peered":"2023-12-15T23:56:05.337269+0000","last_clean":"2023-12-15T23:56:05.337269+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-15T23:56:05.337269+0000","last_undegraded":"2023-12-15T23:56:05.337269+0000","last_fullsized":"2023-12-15T23:56:05.337269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:33.993237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343972+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:57:06.343972+0000","last_peered":"2023-12-15T23:57:06.343972+0000","last_clean":"2023-12-15T23:57:06.343972+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:57:06.343972+0000","last_undegraded":"2023-12-15T23:57:06.343972+0000","last_fullsized":"2023-12-15T23:57:06.343972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:50:27.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342556+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:57:01.342556+0000","last_peered":"2023-12-15T23:57:01.342556+0000","last_clean":"2023-12-15T23:57:01.342556+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:57:01.342556+0000","last_undegraded":"2023-12-15T23:57:01.342556+0000","last_fullsized":"2023-12-15T23:57:01.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:20.406306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345788+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-15T23:56:35.345788+0000","last_peered":"2023-12-15T23:56:35.345788+0000","last_clean":"2023-12-15T23:56:35.345788+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-15T23:56:35.345788+0000","last_undegraded":"2023-12-15T23:56:35.345788+0000","last_fullsized":"2023-12-15T23:56:35.345788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:37.028220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337339+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-15T23:56:30.337339+0000","last_peered":"2023-12-15T23:56:30.337339+0000","last_clean":"2023-12-15T23:56:30.337339+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-15T23:56:30.337339+0000","last_undegraded":"2023-12-15T23:56:30.337339+0000","last_fullsized":"2023-12-15T23:56:30.337339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:45.660409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2321","reported_seq":3328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336494+0000","last_change":"2023-12-15T22:53:28.162922+0000","last_active":"2023-12-15T23:56:36.336494+0000","last_peered":"2023-12-15T23:56:36.336494+0000","last_clean":"2023-12-15T23:56:36.336494+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-15T23:56:36.336494+0000","last_undegraded":"2023-12-15T23:56:36.336494+0000","last_fullsized":"2023-12-15T23:56:36.336494+0000","mapping_epoch":35,"log_start":"54'600","ondisk_log_start":"54'600","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":600,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:41.693500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'16","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340575+0000","last_change":"2023-12-15T22:53:26.162291+0000","last_active":"2023-12-15T23:56:15.340575+0000","last_peered":"2023-12-15T23:56:15.340575+0000","last_clean":"2023-12-15T23:56:15.340575+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-15T23:56:15.340575+0000","last_undegraded":"2023-12-15T23:56:15.340575+0000","last_fullsized":"2023-12-15T23:56:15.340575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581125+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:57:30.581125+0000","last_peered":"2023-12-15T23:57:30.581125+0000","last_clean":"2023-12-15T23:57:30.581125+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:57:30.581125+0000","last_undegraded":"2023-12-15T23:57:30.581125+0000","last_fullsized":"2023-12-15T23:57:30.581125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346527+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T23:56:40.346527+0000","last_peered":"2023-12-15T23:56:40.346527+0000","last_clean":"2023-12-15T23:56:40.346527+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T23:56:40.346527+0000","last_undegraded":"2023-12-15T23:56:40.346527+0000","last_fullsized":"2023-12-15T23:56:40.346527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350078+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:57:31.350078+0000","last_peered":"2023-12-15T23:57:31.350078+0000","last_clean":"2023-12-15T23:57:31.350078+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:57:31.350078+0000","last_undegraded":"2023-12-15T23:57:31.350078+0000","last_fullsized":"2023-12-15T23:57:31.350078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366870+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-15T23:57:55.366870+0000","last_peered":"2023-12-15T23:57:55.366870+0000","last_clean":"2023-12-15T23:57:55.366870+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-15T23:57:55.366870+0000","last_undegraded":"2023-12-15T23:57:55.366870+0000","last_fullsized":"2023-12-15T23:57:55.366870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591256+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-15T23:58:10.591256+0000","last_peered":"2023-12-15T23:58:10.591256+0000","last_clean":"2023-12-15T23:58:10.591256+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-15T23:58:10.591256+0000","last_undegraded":"2023-12-15T23:58:10.591256+0000","last_fullsized":"2023-12-15T23:58:10.591256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:28.787967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370208+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-15T23:58:10.370208+0000","last_peered":"2023-12-15T23:58:10.370208+0000","last_clean":"2023-12-15T23:58:10.370208+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-15T23:58:10.370208+0000","last_undegraded":"2023-12-15T23:58:10.370208+0000","last_fullsized":"2023-12-15T23:58:10.370208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368784+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-15T23:58:10.368784+0000","last_peered":"2023-12-15T23:58:10.368784+0000","last_clean":"2023-12-15T23:58:10.368784+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-15T23:58:10.368784+0000","last_undegraded":"2023-12-15T23:58:10.368784+0000","last_fullsized":"2023-12-15T23:58:10.368784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335801+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-15T23:55:55.335801+0000","last_peered":"2023-12-15T23:55:55.335801+0000","last_clean":"2023-12-15T23:55:55.335801+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-15T23:55:55.335801+0000","last_undegraded":"2023-12-15T23:55:55.335801+0000","last_fullsized":"2023-12-15T23:55:55.335801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5993,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353259+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:57:05.353259+0000","last_peered":"2023-12-15T23:57:05.353259+0000","last_clean":"2023-12-15T23:57:05.353259+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:57:05.353259+0000","last_undegraded":"2023-12-15T23:57:05.353259+0000","last_fullsized":"2023-12-15T23:57:05.353259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:23.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352049+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:57:00.352049+0000","last_peered":"2023-12-15T23:57:00.352049+0000","last_clean":"2023-12-15T23:57:00.352049+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:57:00.352049+0000","last_undegraded":"2023-12-15T23:57:00.352049+0000","last_fullsized":"2023-12-15T23:57:00.352049+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:36:08.674603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348850+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:56:50.348850+0000","last_peered":"2023-12-15T23:56:50.348850+0000","last_clean":"2023-12-15T23:56:50.348850+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:56:50.348850+0000","last_undegraded":"2023-12-15T23:56:50.348850+0000","last_fullsized":"2023-12-15T23:56:50.348850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334718+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-15T23:56:20.334718+0000","last_peered":"2023-12-15T23:56:20.334718+0000","last_clean":"2023-12-15T23:56:20.334718+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-15T23:56:20.334718+0000","last_undegraded":"2023-12-15T23:56:20.334718+0000","last_fullsized":"2023-12-15T23:56:20.334718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:40.887941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1390,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340552+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-15T23:56:20.340552+0000","last_peered":"2023-12-15T23:56:20.340552+0000","last_clean":"2023-12-15T23:56:20.340552+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-15T23:56:20.340552+0000","last_undegraded":"2023-12-15T23:56:20.340552+0000","last_fullsized":"2023-12-15T23:56:20.340552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343101+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-15T23:56:30.343101+0000","last_peered":"2023-12-15T23:56:30.343101+0000","last_clean":"2023-12-15T23:56:30.343101+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-15T23:56:30.343101+0000","last_undegraded":"2023-12-15T23:56:30.343101+0000","last_fullsized":"2023-12-15T23:56:30.343101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587693+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-15T23:57:55.587693+0000","last_peered":"2023-12-15T23:57:55.587693+0000","last_clean":"2023-12-15T23:57:55.587693+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-15T23:57:55.587693+0000","last_undegraded":"2023-12-15T23:57:55.587693+0000","last_fullsized":"2023-12-15T23:57:55.587693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337673+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T23:56:41.337673+0000","last_peered":"2023-12-15T23:56:41.337673+0000","last_clean":"2023-12-15T23:56:41.337673+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T23:56:41.337673+0000","last_undegraded":"2023-12-15T23:56:41.337673+0000","last_fullsized":"2023-12-15T23:56:41.337673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574363+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-15T23:57:05.574363+0000","last_peered":"2023-12-15T23:57:05.574363+0000","last_clean":"2023-12-15T23:57:05.574363+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-15T23:57:05.574363+0000","last_undegraded":"2023-12-15T23:57:05.574363+0000","last_fullsized":"2023-12-15T23:57:05.574363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359390+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-15T23:58:05.359390+0000","last_peered":"2023-12-15T23:58:05.359390+0000","last_clean":"2023-12-15T23:58:05.359390+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-15T23:58:05.359390+0000","last_undegraded":"2023-12-15T23:58:05.359390+0000","last_fullsized":"2023-12-15T23:58:05.359390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:36.759210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366654+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-15T23:58:00.366654+0000","last_peered":"2023-12-15T23:58:00.366654+0000","last_clean":"2023-12-15T23:58:00.366654+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-15T23:58:00.366654+0000","last_undegraded":"2023-12-15T23:58:00.366654+0000","last_fullsized":"2023-12-15T23:58:00.366654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363798+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:57:45.363798+0000","last_peered":"2023-12-15T23:57:45.363798+0000","last_clean":"2023-12-15T23:57:45.363798+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:57:45.363798+0000","last_undegraded":"2023-12-15T23:57:45.363798+0000","last_fullsized":"2023-12-15T23:57:45.363798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339569+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-15T23:56:10.339569+0000","last_peered":"2023-12-15T23:56:10.339569+0000","last_clean":"2023-12-15T23:56:10.339569+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-15T23:56:10.339569+0000","last_undegraded":"2023-12-15T23:56:10.339569+0000","last_fullsized":"2023-12-15T23:56:10.339569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:53.998326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326673+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-15T23:55:56.326673+0000","last_peered":"2023-12-15T23:55:56.326673+0000","last_clean":"2023-12-15T23:55:56.326673+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-15T23:55:56.326673+0000","last_undegraded":"2023-12-15T23:55:56.326673+0000","last_fullsized":"2023-12-15T23:55:56.326673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353438+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:57:05.353438+0000","last_peered":"2023-12-15T23:57:05.353438+0000","last_clean":"2023-12-15T23:57:05.353438+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:57:05.353438+0000","last_undegraded":"2023-12-15T23:57:05.353438+0000","last_fullsized":"2023-12-15T23:57:05.353438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:39.905516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.355945+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:57:15.355945+0000","last_peered":"2023-12-15T23:57:15.355945+0000","last_clean":"2023-12-15T23:57:15.355945+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:57:15.355945+0000","last_undegraded":"2023-12-15T23:57:15.355945+0000","last_fullsized":"2023-12-15T23:57:15.355945+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:17:26.396448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346010+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-15T23:56:35.346010+0000","last_peered":"2023-12-15T23:56:35.346010+0000","last_clean":"2023-12-15T23:56:35.346010+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-15T23:56:35.346010+0000","last_undegraded":"2023-12-15T23:56:35.346010+0000","last_fullsized":"2023-12-15T23:56:35.346010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:50.734122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1463,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334847+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-15T23:56:20.334847+0000","last_peered":"2023-12-15T23:56:20.334847+0000","last_clean":"2023-12-15T23:56:20.334847+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-15T23:56:20.334847+0000","last_undegraded":"2023-12-15T23:56:20.334847+0000","last_fullsized":"2023-12-15T23:56:20.334847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:01.265927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":521,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341886+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-15T23:56:20.341886+0000","last_peered":"2023-12-15T23:56:20.341886+0000","last_clean":"2023-12-15T23:56:20.341886+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-15T23:56:20.341886+0000","last_undegraded":"2023-12-15T23:56:20.341886+0000","last_fullsized":"2023-12-15T23:56:20.341886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'7","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343353+0000","last_change":"2023-12-15T22:53:26.161393+0000","last_active":"2023-12-15T23:56:25.343353+0000","last_peered":"2023-12-15T23:56:25.343353+0000","last_clean":"2023-12-15T23:56:25.343353+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-15T23:56:25.343353+0000","last_undegraded":"2023-12-15T23:56:25.343353+0000","last_fullsized":"2023-12-15T23:56:25.343353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366982+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-15T23:57:55.366982+0000","last_peered":"2023-12-15T23:57:55.366982+0000","last_clean":"2023-12-15T23:57:55.366982+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-15T23:57:55.366982+0000","last_undegraded":"2023-12-15T23:57:55.366982+0000","last_fullsized":"2023-12-15T23:57:55.366982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569523+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T23:56:45.569523+0000","last_peered":"2023-12-15T23:56:45.569523+0000","last_clean":"2023-12-15T23:56:45.569523+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T23:56:45.569523+0000","last_undegraded":"2023-12-15T23:56:45.569523+0000","last_fullsized":"2023-12-15T23:56:45.569523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341738+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T23:56:25.341738+0000","last_peered":"2023-12-15T23:56:25.341738+0000","last_clean":"2023-12-15T23:56:25.341738+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T23:56:25.341738+0000","last_undegraded":"2023-12-15T23:56:25.341738+0000","last_fullsized":"2023-12-15T23:56:25.341738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:48:45.986851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359720+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:57:30.359720+0000","last_peered":"2023-12-15T23:57:30.359720+0000","last_clean":"2023-12-15T23:57:30.359720+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:57:30.359720+0000","last_undegraded":"2023-12-15T23:57:30.359720+0000","last_fullsized":"2023-12-15T23:57:30.359720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368128+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-15T23:58:05.368128+0000","last_peered":"2023-12-15T23:58:05.368128+0000","last_clean":"2023-12-15T23:58:05.368128+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-15T23:58:05.368128+0000","last_undegraded":"2023-12-15T23:58:05.368128+0000","last_fullsized":"2023-12-15T23:58:05.368128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":970,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584747+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:57:45.584747+0000","last_peered":"2023-12-15T23:57:45.584747+0000","last_clean":"2023-12-15T23:57:45.584747+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:57:45.584747+0000","last_undegraded":"2023-12-15T23:57:45.584747+0000","last_fullsized":"2023-12-15T23:57:45.584747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:13.537930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357868+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:58:01.357868+0000","last_peered":"2023-12-15T23:58:01.357868+0000","last_clean":"2023-12-15T23:58:01.357868+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-15T23:58:01.357868+0000","last_undegraded":"2023-12-15T23:58:01.357868+0000","last_fullsized":"2023-12-15T23:58:01.357868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:57.510599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560276+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-15T23:56:10.560276+0000","last_peered":"2023-12-15T23:56:10.560276+0000","last_clean":"2023-12-15T23:56:10.560276+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-15T23:56:10.560276+0000","last_undegraded":"2023-12-15T23:56:10.560276+0000","last_fullsized":"2023-12-15T23:56:10.560276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337286+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-15T23:56:30.337286+0000","last_peered":"2023-12-15T23:56:30.337286+0000","last_clean":"2023-12-15T23:56:30.337286+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-15T23:56:30.337286+0000","last_undegraded":"2023-12-15T23:56:30.337286+0000","last_fullsized":"2023-12-15T23:56:30.337286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:38.545968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1255,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353261+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:57:05.353261+0000","last_peered":"2023-12-15T23:57:05.353261+0000","last_clean":"2023-12-15T23:57:05.353261+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:57:05.353261+0000","last_undegraded":"2023-12-15T23:57:05.353261+0000","last_fullsized":"2023-12-15T23:57:05.353261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341816+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:56:50.341816+0000","last_peered":"2023-12-15T23:56:50.341816+0000","last_clean":"2023-12-15T23:56:50.341816+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:56:50.341816+0000","last_undegraded":"2023-12-15T23:56:50.341816+0000","last_fullsized":"2023-12-15T23:56:50.341816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:46.037392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335881+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-15T23:56:25.335881+0000","last_peered":"2023-12-15T23:56:25.335881+0000","last_clean":"2023-12-15T23:56:25.335881+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-15T23:56:25.335881+0000","last_undegraded":"2023-12-15T23:56:25.335881+0000","last_fullsized":"2023-12-15T23:56:25.335881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:44.899079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'576","reported_seq":1445,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335444+0000","last_change":"2023-12-15T22:53:30.181085+0000","last_active":"2023-12-15T23:56:31.335444+0000","last_peered":"2023-12-15T23:56:31.335444+0000","last_clean":"2023-12-15T23:56:31.335444+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-15T23:56:31.335444+0000","last_undegraded":"2023-12-15T23:56:31.335444+0000","last_fullsized":"2023-12-15T23:56:31.335444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:42.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347586+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:56:45.347586+0000","last_peered":"2023-12-15T23:56:45.347586+0000","last_clean":"2023-12-15T23:56:45.347586+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:56:45.347586+0000","last_undegraded":"2023-12-15T23:56:45.347586+0000","last_fullsized":"2023-12-15T23:56:45.347586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:45.822160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336158+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-15T23:56:25.336158+0000","last_peered":"2023-12-15T23:56:25.336158+0000","last_clean":"2023-12-15T23:56:25.336158+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-15T23:56:25.336158+0000","last_undegraded":"2023-12-15T23:56:25.336158+0000","last_fullsized":"2023-12-15T23:56:25.336158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:41.864051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349876+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:57:31.349876+0000","last_peered":"2023-12-15T23:57:31.349876+0000","last_clean":"2023-12-15T23:57:31.349876+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:57:31.349876+0000","last_undegraded":"2023-12-15T23:57:31.349876+0000","last_fullsized":"2023-12-15T23:57:31.349876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366959+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-15T23:57:55.366959+0000","last_peered":"2023-12-15T23:57:55.366959+0000","last_clean":"2023-12-15T23:57:55.366959+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-15T23:57:55.366959+0000","last_undegraded":"2023-12-15T23:57:55.366959+0000","last_fullsized":"2023-12-15T23:57:55.366959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569612+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T23:56:45.569612+0000","last_peered":"2023-12-15T23:56:45.569612+0000","last_clean":"2023-12-15T23:56:45.569612+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T23:56:45.569612+0000","last_undegraded":"2023-12-15T23:56:45.569612+0000","last_fullsized":"2023-12-15T23:56:45.569612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.348824+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:57:20.348824+0000","last_peered":"2023-12-15T23:57:20.348824+0000","last_clean":"2023-12-15T23:57:20.348824+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:57:20.348824+0000","last_undegraded":"2023-12-15T23:57:20.348824+0000","last_fullsized":"2023-12-15T23:57:20.348824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:37.068698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352526+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:57:41.352526+0000","last_peered":"2023-12-15T23:57:41.352526+0000","last_clean":"2023-12-15T23:57:41.352526+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:57:41.352526+0000","last_undegraded":"2023-12-15T23:57:41.352526+0000","last_fullsized":"2023-12-15T23:57:41.352526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:38.074008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354579+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:57:45.354579+0000","last_peered":"2023-12-15T23:57:45.354579+0000","last_clean":"2023-12-15T23:57:45.354579+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:57:45.354579+0000","last_undegraded":"2023-12-15T23:57:45.354579+0000","last_fullsized":"2023-12-15T23:57:45.354579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:35.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339408+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-15T23:56:10.339408+0000","last_peered":"2023-12-15T23:56:10.339408+0000","last_clean":"2023-12-15T23:56:10.339408+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-15T23:56:10.339408+0000","last_undegraded":"2023-12-15T23:56:10.339408+0000","last_fullsized":"2023-12-15T23:56:10.339408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328762+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-15T23:55:55.328762+0000","last_peered":"2023-12-15T23:55:55.328762+0000","last_clean":"2023-12-15T23:55:55.328762+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-15T23:55:55.328762+0000","last_undegraded":"2023-12-15T23:55:55.328762+0000","last_fullsized":"2023-12-15T23:55:55.328762+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:41.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5894,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.353685+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:57:10.353685+0000","last_peered":"2023-12-15T23:57:10.353685+0000","last_clean":"2023-12-15T23:57:10.353685+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:57:10.353685+0000","last_undegraded":"2023-12-15T23:57:10.353685+0000","last_fullsized":"2023-12-15T23:57:10.353685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:57.639999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349295+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:56:50.349295+0000","last_peered":"2023-12-15T23:56:50.349295+0000","last_clean":"2023-12-15T23:56:50.349295+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:56:50.349295+0000","last_undegraded":"2023-12-15T23:56:50.349295+0000","last_fullsized":"2023-12-15T23:56:50.349295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:50:12.433334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335752+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-15T23:56:25.335752+0000","last_peered":"2023-12-15T23:56:25.335752+0000","last_clean":"2023-12-15T23:56:25.335752+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-15T23:56:25.335752+0000","last_undegraded":"2023-12-15T23:56:25.335752+0000","last_fullsized":"2023-12-15T23:56:25.335752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:55.341702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347565+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:56:45.347565+0000","last_peered":"2023-12-15T23:56:45.347565+0000","last_clean":"2023-12-15T23:56:45.347565+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:56:45.347565+0000","last_undegraded":"2023-12-15T23:56:45.347565+0000","last_fullsized":"2023-12-15T23:56:45.347565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:03.373955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'451","reported_seq":701,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335456+0000","last_change":"2023-12-15T22:53:28.170119+0000","last_active":"2023-12-15T23:56:31.335456+0000","last_peered":"2023-12-15T23:56:31.335456+0000","last_clean":"2023-12-15T23:56:31.335456+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-15T23:56:31.335456+0000","last_undegraded":"2023-12-15T23:56:31.335456+0000","last_fullsized":"2023-12-15T23:56:31.335456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:59.254922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342140+0000","last_change":"2023-12-15T22:53:26.159502+0000","last_active":"2023-12-15T23:56:25.342140+0000","last_peered":"2023-12-15T23:56:25.342140+0000","last_clean":"2023-12-15T23:56:25.342140+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-15T23:56:25.342140+0000","last_undegraded":"2023-12-15T23:56:25.342140+0000","last_fullsized":"2023-12-15T23:56:25.342140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354345+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:57:10.354345+0000","last_peered":"2023-12-15T23:57:10.354345+0000","last_clean":"2023-12-15T23:57:10.354345+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:57:10.354345+0000","last_undegraded":"2023-12-15T23:57:10.354345+0000","last_fullsized":"2023-12-15T23:57:10.354345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357070+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-15T23:57:55.357070+0000","last_peered":"2023-12-15T23:57:55.357070+0000","last_clean":"2023-12-15T23:57:55.357070+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-15T23:57:55.357070+0000","last_undegraded":"2023-12-15T23:57:55.357070+0000","last_fullsized":"2023-12-15T23:57:55.357070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:39.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342609+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:57:01.342609+0000","last_peered":"2023-12-15T23:57:01.342609+0000","last_clean":"2023-12-15T23:57:01.342609+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:57:01.342609+0000","last_undegraded":"2023-12-15T23:57:01.342609+0000","last_fullsized":"2023-12-15T23:57:01.342609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361757+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:57:40.361757+0000","last_peered":"2023-12-15T23:57:40.361757+0000","last_clean":"2023-12-15T23:57:40.361757+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:57:40.361757+0000","last_undegraded":"2023-12-15T23:57:40.361757+0000","last_fullsized":"2023-12-15T23:57:40.361757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:05.440726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363199+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:57:45.363199+0000","last_peered":"2023-12-15T23:57:45.363199+0000","last_clean":"2023-12-15T23:57:45.363199+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:57:45.363199+0000","last_undegraded":"2023-12-15T23:57:45.363199+0000","last_fullsized":"2023-12-15T23:57:45.363199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363708+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:57:45.363708+0000","last_peered":"2023-12-15T23:57:45.363708+0000","last_clean":"2023-12-15T23:57:45.363708+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:57:45.363708+0000","last_undegraded":"2023-12-15T23:57:45.363708+0000","last_fullsized":"2023-12-15T23:57:45.363708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339673+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-15T23:56:10.339673+0000","last_peered":"2023-12-15T23:56:10.339673+0000","last_clean":"2023-12-15T23:56:10.339673+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-15T23:56:10.339673+0000","last_undegraded":"2023-12-15T23:56:10.339673+0000","last_fullsized":"2023-12-15T23:56:10.339673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:23.866137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334729+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-15T23:56:20.334729+0000","last_peered":"2023-12-15T23:56:20.334729+0000","last_clean":"2023-12-15T23:56:20.334729+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-15T23:56:20.334729+0000","last_undegraded":"2023-12-15T23:56:20.334729+0000","last_fullsized":"2023-12-15T23:56:20.334729+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:44.091525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1396,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350460+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:56:55.350460+0000","last_peered":"2023-12-15T23:56:55.350460+0000","last_clean":"2023-12-15T23:56:55.350460+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:56:55.350460+0000","last_undegraded":"2023-12-15T23:56:55.350460+0000","last_fullsized":"2023-12-15T23:56:55.350460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:24.099749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345610+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:57:05.345610+0000","last_peered":"2023-12-15T23:57:05.345610+0000","last_clean":"2023-12-15T23:57:05.345610+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:57:05.345610+0000","last_undegraded":"2023-12-15T23:57:05.345610+0000","last_fullsized":"2023-12-15T23:57:05.345610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:44.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345642+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-15T23:56:35.345642+0000","last_peered":"2023-12-15T23:56:35.345642+0000","last_clean":"2023-12-15T23:56:35.345642+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-15T23:56:35.345642+0000","last_undegraded":"2023-12-15T23:56:35.345642+0000","last_fullsized":"2023-12-15T23:56:35.345642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:51.588416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565447+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-15T23:56:30.565447+0000","last_peered":"2023-12-15T23:56:30.565447+0000","last_clean":"2023-12-15T23:56:30.565447+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-15T23:56:30.565447+0000","last_undegraded":"2023-12-15T23:56:30.565447+0000","last_fullsized":"2023-12-15T23:56:30.565447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:16.498260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'508","reported_seq":744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335339+0000","last_change":"2023-12-15T22:53:28.169971+0000","last_active":"2023-12-15T23:56:31.335339+0000","last_peered":"2023-12-15T23:56:31.335339+0000","last_clean":"2023-12-15T23:56:31.335339+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-15T23:56:31.335339+0000","last_undegraded":"2023-12-15T23:56:31.335339+0000","last_fullsized":"2023-12-15T23:56:31.335339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:31.067844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342241+0000","last_change":"2023-12-15T22:53:26.156857+0000","last_active":"2023-12-15T23:56:25.342241+0000","last_peered":"2023-12-15T23:56:25.342241+0000","last_clean":"2023-12-15T23:56:25.342241+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-15T23:56:25.342241+0000","last_undegraded":"2023-12-15T23:56:25.342241+0000","last_fullsized":"2023-12-15T23:56:25.342241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359851+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:57:30.359851+0000","last_peered":"2023-12-15T23:57:30.359851+0000","last_clean":"2023-12-15T23:57:30.359851+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:57:30.359851+0000","last_undegraded":"2023-12-15T23:57:30.359851+0000","last_fullsized":"2023-12-15T23:57:30.359851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581105+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:57:30.581105+0000","last_peered":"2023-12-15T23:57:30.581105+0000","last_clean":"2023-12-15T23:57:30.581105+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:57:30.581105+0000","last_undegraded":"2023-12-15T23:57:30.581105+0000","last_fullsized":"2023-12-15T23:57:30.581105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.352632+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:57:05.352632+0000","last_peered":"2023-12-15T23:57:05.352632+0000","last_clean":"2023-12-15T23:57:05.352632+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:57:05.352632+0000","last_undegraded":"2023-12-15T23:57:05.352632+0000","last_fullsized":"2023-12-15T23:57:05.352632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:20.385525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361386+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:57:40.361386+0000","last_peered":"2023-12-15T23:57:40.361386+0000","last_clean":"2023-12-15T23:57:40.361386+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:57:40.361386+0000","last_undegraded":"2023-12-15T23:57:40.361386+0000","last_fullsized":"2023-12-15T23:57:40.361386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584426+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:57:45.584426+0000","last_peered":"2023-12-15T23:57:45.584426+0000","last_clean":"2023-12-15T23:57:45.584426+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:57:45.584426+0000","last_undegraded":"2023-12-15T23:57:45.584426+0000","last_fullsized":"2023-12-15T23:57:45.584426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:26.178233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357505+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:57:25.357505+0000","last_peered":"2023-12-15T23:57:25.357505+0000","last_clean":"2023-12-15T23:57:25.357505+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:57:25.357505+0000","last_undegraded":"2023-12-15T23:57:25.357505+0000","last_fullsized":"2023-12-15T23:57:25.357505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343680+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-15T23:56:25.343680+0000","last_peered":"2023-12-15T23:56:25.343680+0000","last_clean":"2023-12-15T23:56:25.343680+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-15T23:56:25.343680+0000","last_undegraded":"2023-12-15T23:56:25.343680+0000","last_fullsized":"2023-12-15T23:56:25.343680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:25.822041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341365+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-15T23:56:20.341365+0000","last_peered":"2023-12-15T23:56:20.341365+0000","last_clean":"2023-12-15T23:56:20.341365+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-15T23:56:20.341365+0000","last_undegraded":"2023-12-15T23:56:20.341365+0000","last_fullsized":"2023-12-15T23:56:20.341365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:41:05.257834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350550+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:56:55.350550+0000","last_peered":"2023-12-15T23:56:55.350550+0000","last_clean":"2023-12-15T23:56:55.350550+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:56:55.350550+0000","last_undegraded":"2023-12-15T23:56:55.350550+0000","last_fullsized":"2023-12-15T23:56:55.350550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351153+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:57:00.351153+0000","last_peered":"2023-12-15T23:57:00.351153+0000","last_clean":"2023-12-15T23:57:00.351153+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:57:00.351153+0000","last_undegraded":"2023-12-15T23:57:00.351153+0000","last_fullsized":"2023-12-15T23:57:00.351153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339623+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-15T23:56:40.339623+0000","last_peered":"2023-12-15T23:56:40.339623+0000","last_clean":"2023-12-15T23:56:40.339623+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-15T23:56:40.339623+0000","last_undegraded":"2023-12-15T23:56:40.339623+0000","last_fullsized":"2023-12-15T23:56:40.339623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:10.253710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337454+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-15T23:56:30.337454+0000","last_peered":"2023-12-15T23:56:30.337454+0000","last_clean":"2023-12-15T23:56:30.337454+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-15T23:56:30.337454+0000","last_undegraded":"2023-12-15T23:56:30.337454+0000","last_fullsized":"2023-12-15T23:56:30.337454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:22.564483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'257","reported_seq":415,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335270+0000","last_change":"2023-12-15T22:53:28.170194+0000","last_active":"2023-12-15T23:56:31.335270+0000","last_peered":"2023-12-15T23:56:31.335270+0000","last_clean":"2023-12-15T23:56:31.335270+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-15T23:56:31.335270+0000","last_undegraded":"2023-12-15T23:56:31.335270+0000","last_fullsized":"2023-12-15T23:56:31.335270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:38.876935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.347230+0000","last_change":"2023-12-15T22:53:26.165429+0000","last_active":"2023-12-15T23:56:40.347230+0000","last_peered":"2023-12-15T23:56:40.347230+0000","last_clean":"2023-12-15T23:56:40.347230+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-15T23:56:40.347230+0000","last_undegraded":"2023-12-15T23:56:40.347230+0000","last_fullsized":"2023-12-15T23:56:40.347230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580909+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:57:30.580909+0000","last_peered":"2023-12-15T23:57:30.580909+0000","last_clean":"2023-12-15T23:57:30.580909+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:57:30.580909+0000","last_undegraded":"2023-12-15T23:57:30.580909+0000","last_fullsized":"2023-12-15T23:57:30.580909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362785+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:57:45.362785+0000","last_peered":"2023-12-15T23:57:45.362785+0000","last_clean":"2023-12-15T23:57:45.362785+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:57:45.362785+0000","last_undegraded":"2023-12-15T23:57:45.362785+0000","last_fullsized":"2023-12-15T23:57:45.362785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354594+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:57:10.354594+0000","last_peered":"2023-12-15T23:57:10.354594+0000","last_clean":"2023-12-15T23:57:10.354594+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:57:10.354594+0000","last_undegraded":"2023-12-15T23:57:10.354594+0000","last_fullsized":"2023-12-15T23:57:10.354594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362345+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:57:40.362345+0000","last_peered":"2023-12-15T23:57:40.362345+0000","last_clean":"2023-12-15T23:57:40.362345+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:57:40.362345+0000","last_undegraded":"2023-12-15T23:57:40.362345+0000","last_fullsized":"2023-12-15T23:57:40.362345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.358388+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:57:25.358388+0000","last_peered":"2023-12-15T23:57:25.358388+0000","last_clean":"2023-12-15T23:57:25.358388+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:57:25.358388+0000","last_undegraded":"2023-12-15T23:57:25.358388+0000","last_fullsized":"2023-12-15T23:57:25.358388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353727+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:57:46.353727+0000","last_peered":"2023-12-15T23:57:46.353727+0000","last_clean":"2023-12-15T23:57:46.353727+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:57:46.353727+0000","last_undegraded":"2023-12-15T23:57:46.353727+0000","last_fullsized":"2023-12-15T23:57:46.353727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:28.187833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339815+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-15T23:56:10.339815+0000","last_peered":"2023-12-15T23:56:10.339815+0000","last_clean":"2023-12-15T23:56:10.339815+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-15T23:56:10.339815+0000","last_undegraded":"2023-12-15T23:56:10.339815+0000","last_fullsized":"2023-12-15T23:56:10.339815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:12.734358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351687+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:57:00.351687+0000","last_peered":"2023-12-15T23:57:00.351687+0000","last_clean":"2023-12-15T23:57:00.351687+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:57:00.351687+0000","last_undegraded":"2023-12-15T23:57:00.351687+0000","last_fullsized":"2023-12-15T23:57:00.351687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:08.485765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6349,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.332807+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-15T23:55:45.332807+0000","last_peered":"2023-12-15T23:55:45.332807+0000","last_clean":"2023-12-15T23:55:45.332807+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-15T23:55:45.332807+0000","last_undegraded":"2023-12-15T23:55:45.332807+0000","last_fullsized":"2023-12-15T23:55:45.332807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:16.965706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565280+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:56:30.565280+0000","last_peered":"2023-12-15T23:56:30.565280+0000","last_clean":"2023-12-15T23:56:30.565280+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:56:30.565280+0000","last_undegraded":"2023-12-15T23:56:30.565280+0000","last_fullsized":"2023-12-15T23:56:30.565280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:58.613135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327858+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-15T23:56:01.327858+0000","last_peered":"2023-12-15T23:56:01.327858+0000","last_clean":"2023-12-15T23:56:01.327858+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-15T23:56:01.327858+0000","last_undegraded":"2023-12-15T23:56:01.327858+0000","last_fullsized":"2023-12-15T23:56:01.327858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:26.351832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337075+0000","last_change":"2023-12-15T22:53:30.176406+0000","last_active":"2023-12-15T23:56:00.337075+0000","last_peered":"2023-12-15T23:56:00.337075+0000","last_clean":"2023-12-15T23:56:00.337075+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-15T23:56:00.337075+0000","last_undegraded":"2023-12-15T23:56:00.337075+0000","last_fullsized":"2023-12-15T23:56:00.337075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'664","reported_seq":1171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327978+0000","last_change":"2023-12-15T22:53:28.170239+0000","last_active":"2023-12-15T23:56:01.327978+0000","last_peered":"2023-12-15T23:56:01.327978+0000","last_clean":"2023-12-15T23:56:01.327978+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-15T23:56:01.327978+0000","last_undegraded":"2023-12-15T23:56:01.327978+0000","last_fullsized":"2023-12-15T23:56:01.327978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:43.649404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362601+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:57:40.362601+0000","last_peered":"2023-12-15T23:57:40.362601+0000","last_clean":"2023-12-15T23:57:40.362601+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:57:40.362601+0000","last_undegraded":"2023-12-15T23:57:40.362601+0000","last_fullsized":"2023-12-15T23:57:40.362601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:07:47.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.364059+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:57:45.364059+0000","last_peered":"2023-12-15T23:57:45.364059+0000","last_clean":"2023-12-15T23:57:45.364059+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:57:45.364059+0000","last_undegraded":"2023-12-15T23:57:45.364059+0000","last_fullsized":"2023-12-15T23:57:45.364059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:17:53.191887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326479+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-15T23:55:56.326479+0000","last_peered":"2023-12-15T23:55:56.326479+0000","last_clean":"2023-12-15T23:55:56.326479+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-15T23:55:56.326479+0000","last_undegraded":"2023-12-15T23:55:56.326479+0000","last_fullsized":"2023-12-15T23:55:56.326479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338312+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-15T23:56:10.338312+0000","last_peered":"2023-12-15T23:56:10.338312+0000","last_clean":"2023-12-15T23:56:10.338312+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-15T23:56:10.338312+0000","last_undegraded":"2023-12-15T23:56:10.338312+0000","last_fullsized":"2023-12-15T23:56:10.338312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558965+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-15T23:56:05.558965+0000","last_peered":"2023-12-15T23:56:05.558965+0000","last_clean":"2023-12-15T23:56:05.558965+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-15T23:56:05.558965+0000","last_undegraded":"2023-12-15T23:56:05.558965+0000","last_fullsized":"2023-12-15T23:56:05.558965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.340685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332420+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-15T23:56:10.332420+0000","last_peered":"2023-12-15T23:56:10.332420+0000","last_clean":"2023-12-15T23:56:10.332420+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-15T23:56:10.332420+0000","last_undegraded":"2023-12-15T23:56:10.332420+0000","last_fullsized":"2023-12-15T23:56:10.332420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:32.639017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560105+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-15T23:56:10.560105+0000","last_peered":"2023-12-15T23:56:10.560105+0000","last_clean":"2023-12-15T23:56:10.560105+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-15T23:56:10.560105+0000","last_undegraded":"2023-12-15T23:56:10.560105+0000","last_fullsized":"2023-12-15T23:56:10.560105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:15.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:11.344902+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:57:11.344902+0000","last_peered":"2023-12-15T23:57:11.344902+0000","last_clean":"2023-12-15T23:57:11.344902+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:57:11.344902+0000","last_undegraded":"2023-12-15T23:57:11.344902+0000","last_fullsized":"2023-12-15T23:57:11.344902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:19:56.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6459,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.571801+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:56:55.571801+0000","last_peered":"2023-12-15T23:56:55.571801+0000","last_clean":"2023-12-15T23:56:55.571801+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:56:55.571801+0000","last_undegraded":"2023-12-15T23:56:55.571801+0000","last_fullsized":"2023-12-15T23:56:55.571801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335217+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:56:31.335217+0000","last_peered":"2023-12-15T23:56:31.335217+0000","last_clean":"2023-12-15T23:56:31.335217+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:56:31.335217+0000","last_undegraded":"2023-12-15T23:56:31.335217+0000","last_fullsized":"2023-12-15T23:56:31.335217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:41.316820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327752+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-15T23:56:01.327752+0000","last_peered":"2023-12-15T23:56:01.327752+0000","last_clean":"2023-12-15T23:56:01.327752+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-15T23:56:01.327752+0000","last_undegraded":"2023-12-15T23:56:01.327752+0000","last_fullsized":"2023-12-15T23:56:01.327752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:21.948714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335881+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-15T23:56:00.335881+0000","last_peered":"2023-12-15T23:56:00.335881+0000","last_clean":"2023-12-15T23:56:00.335881+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-15T23:56:00.335881+0000","last_undegraded":"2023-12-15T23:56:00.335881+0000","last_fullsized":"2023-12-15T23:56:00.335881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:21.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'305","reported_seq":1269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337063+0000","last_change":"2023-12-15T22:53:28.171127+0000","last_active":"2023-12-15T23:56:00.337063+0000","last_peered":"2023-12-15T23:56:00.337063+0000","last_clean":"2023-12-15T23:56:00.337063+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-15T23:56:00.337063+0000","last_undegraded":"2023-12-15T23:56:00.337063+0000","last_fullsized":"2023-12-15T23:56:00.337063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:34.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:36.351648+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:57:36.351648+0000","last_peered":"2023-12-15T23:57:36.351648+0000","last_clean":"2023-12-15T23:57:36.351648+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:57:36.351648+0000","last_undegraded":"2023-12-15T23:57:36.351648+0000","last_fullsized":"2023-12-15T23:57:36.351648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:10.880484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578776+0000","last_change":"2023-12-15T22:53:10.339946+0000","last_active":"2023-12-15T23:57:20.578776+0000","last_peered":"2023-12-15T23:57:20.578776+0000","last_clean":"2023-12-15T23:57:20.578776+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-15T23:57:20.578776+0000","last_undegraded":"2023-12-15T23:57:20.578776+0000","last_fullsized":"2023-12-15T23:57:20.578776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556705+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-15T23:55:55.556705+0000","last_peered":"2023-12-15T23:55:55.556705+0000","last_clean":"2023-12-15T23:55:55.556705+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-15T23:55:55.556705+0000","last_undegraded":"2023-12-15T23:55:55.556705+0000","last_fullsized":"2023-12-15T23:55:55.556705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331477+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-15T23:55:45.331477+0000","last_peered":"2023-12-15T23:55:45.331477+0000","last_clean":"2023-12-15T23:55:45.331477+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-15T23:55:45.331477+0000","last_undegraded":"2023-12-15T23:55:45.331477+0000","last_fullsized":"2023-12-15T23:55:45.331477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559062+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-15T23:56:05.559062+0000","last_peered":"2023-12-15T23:56:05.559062+0000","last_clean":"2023-12-15T23:56:05.559062+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-15T23:56:05.559062+0000","last_undegraded":"2023-12-15T23:56:05.559062+0000","last_fullsized":"2023-12-15T23:56:05.559062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:07.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339351+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-15T23:56:10.339351+0000","last_peered":"2023-12-15T23:56:10.339351+0000","last_clean":"2023-12-15T23:56:10.339351+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-15T23:56:10.339351+0000","last_undegraded":"2023-12-15T23:56:10.339351+0000","last_fullsized":"2023-12-15T23:56:10.339351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338079+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-15T23:56:10.338079+0000","last_peered":"2023-12-15T23:56:10.338079+0000","last_clean":"2023-12-15T23:56:10.338079+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-15T23:56:10.338079+0000","last_undegraded":"2023-12-15T23:56:10.338079+0000","last_fullsized":"2023-12-15T23:56:10.338079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339159+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:56:10.339159+0000","last_peered":"2023-12-15T23:56:10.339159+0000","last_clean":"2023-12-15T23:56:10.339159+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:56:10.339159+0000","last_undegraded":"2023-12-15T23:56:10.339159+0000","last_fullsized":"2023-12-15T23:56:10.339159+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:33.647312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566664+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:56:35.566664+0000","last_peered":"2023-12-15T23:56:35.566664+0000","last_clean":"2023-12-15T23:56:35.566664+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:56:35.566664+0000","last_undegraded":"2023-12-15T23:56:35.566664+0000","last_fullsized":"2023-12-15T23:56:35.566664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:16.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349198+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:56:50.349198+0000","last_peered":"2023-12-15T23:56:50.349198+0000","last_clean":"2023-12-15T23:56:50.349198+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:56:50.349198+0000","last_undegraded":"2023-12-15T23:56:50.349198+0000","last_fullsized":"2023-12-15T23:56:50.349198+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:05.435125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346684+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:56:40.346684+0000","last_peered":"2023-12-15T23:56:40.346684+0000","last_clean":"2023-12-15T23:56:40.346684+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:56:40.346684+0000","last_undegraded":"2023-12-15T23:56:40.346684+0000","last_fullsized":"2023-12-15T23:56:40.346684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362877+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:57:45.362877+0000","last_peered":"2023-12-15T23:57:45.362877+0000","last_clean":"2023-12-15T23:57:45.362877+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:57:45.362877+0000","last_undegraded":"2023-12-15T23:57:45.362877+0000","last_fullsized":"2023-12-15T23:57:45.362877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:51:36.640304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":378,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368919+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-15T23:58:05.368919+0000","last_peered":"2023-12-15T23:58:05.368919+0000","last_clean":"2023-12-15T23:58:05.368919+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-15T23:58:05.368919+0000","last_undegraded":"2023-12-15T23:58:05.368919+0000","last_fullsized":"2023-12-15T23:58:05.368919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'13","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336008+0000","last_change":"2023-12-15T22:53:26.159079+0000","last_active":"2023-12-15T23:55:55.336008+0000","last_peered":"2023-12-15T23:55:55.336008+0000","last_clean":"2023-12-15T23:55:55.336008+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-15T23:55:55.336008+0000","last_undegraded":"2023-12-15T23:55:55.336008+0000","last_fullsized":"2023-12-15T23:55:55.336008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:12.478013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332497+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-15T23:55:40.332497+0000","last_peered":"2023-12-15T23:55:40.332497+0000","last_clean":"2023-12-15T23:55:40.332497+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-15T23:55:40.332497+0000","last_undegraded":"2023-12-15T23:55:40.332497+0000","last_fullsized":"2023-12-15T23:55:40.332497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328561+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-15T23:55:55.328561+0000","last_peered":"2023-12-15T23:55:55.328561+0000","last_clean":"2023-12-15T23:55:55.328561+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-15T23:55:55.328561+0000","last_undegraded":"2023-12-15T23:55:55.328561+0000","last_fullsized":"2023-12-15T23:55:55.328561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:40.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333269+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-15T23:55:45.333269+0000","last_peered":"2023-12-15T23:55:45.333269+0000","last_clean":"2023-12-15T23:55:45.333269+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-15T23:55:45.333269+0000","last_undegraded":"2023-12-15T23:55:45.333269+0000","last_fullsized":"2023-12-15T23:55:45.333269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.328850+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-15T23:56:06.328850+0000","last_peered":"2023-12-15T23:56:06.328850+0000","last_clean":"2023-12-15T23:56:06.328850+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-15T23:56:06.328850+0000","last_undegraded":"2023-12-15T23:56:06.328850+0000","last_fullsized":"2023-12-15T23:56:06.328850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:47.168313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332639+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-15T23:56:10.332639+0000","last_peered":"2023-12-15T23:56:10.332639+0000","last_clean":"2023-12-15T23:56:10.332639+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-15T23:56:10.332639+0000","last_undegraded":"2023-12-15T23:56:10.332639+0000","last_fullsized":"2023-12-15T23:56:10.332639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:04.124976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339169+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-15T23:56:10.339169+0000","last_peered":"2023-12-15T23:56:10.339169+0000","last_clean":"2023-12-15T23:56:10.339169+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-15T23:56:10.339169+0000","last_undegraded":"2023-12-15T23:56:10.339169+0000","last_fullsized":"2023-12-15T23:56:10.339169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:27.858155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338272+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:56:10.338272+0000","last_peered":"2023-12-15T23:56:10.338272+0000","last_clean":"2023-12-15T23:56:10.338272+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:56:10.338272+0000","last_undegraded":"2023-12-15T23:56:10.338272+0000","last_fullsized":"2023-12-15T23:56:10.338272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:45:30.242778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1074,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360241+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-15T23:57:35.360241+0000","last_peered":"2023-12-15T23:57:35.360241+0000","last_clean":"2023-12-15T23:57:35.360241+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-15T23:57:35.360241+0000","last_undegraded":"2023-12-15T23:57:35.360241+0000","last_fullsized":"2023-12-15T23:57:35.360241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:36.880386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345517+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:57:05.345517+0000","last_peered":"2023-12-15T23:57:05.345517+0000","last_clean":"2023-12-15T23:57:05.345517+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:57:05.345517+0000","last_undegraded":"2023-12-15T23:57:05.345517+0000","last_fullsized":"2023-12-15T23:57:05.345517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:04.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.563776+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:56:25.563776+0000","last_peered":"2023-12-15T23:56:25.563776+0000","last_clean":"2023-12-15T23:56:25.563776+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:56:25.563776+0000","last_undegraded":"2023-12-15T23:56:25.563776+0000","last_fullsized":"2023-12-15T23:56:25.563776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:40:17.731463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359433+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-15T23:58:05.359433+0000","last_peered":"2023-12-15T23:58:05.359433+0000","last_clean":"2023-12-15T23:58:05.359433+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-15T23:58:05.359433+0000","last_undegraded":"2023-12-15T23:58:05.359433+0000","last_fullsized":"2023-12-15T23:58:05.359433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:53.623883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'241","reported_seq":382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363959+0000","last_change":"2023-12-15T22:53:28.167550+0000","last_active":"2023-12-15T23:57:45.363959+0000","last_peered":"2023-12-15T23:57:45.363959+0000","last_clean":"2023-12-15T23:57:45.363959+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-15T23:57:45.363959+0000","last_undegraded":"2023-12-15T23:57:45.363959+0000","last_fullsized":"2023-12-15T23:57:45.363959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336091+0000","last_change":"2023-12-15T22:53:26.159624+0000","last_active":"2023-12-15T23:55:55.336091+0000","last_peered":"2023-12-15T23:55:55.336091+0000","last_clean":"2023-12-15T23:55:55.336091+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-15T23:55:55.336091+0000","last_undegraded":"2023-12-15T23:55:55.336091+0000","last_fullsized":"2023-12-15T23:55:55.336091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:17.442064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.331897+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-15T23:55:40.331897+0000","last_peered":"2023-12-15T23:55:40.331897+0000","last_clean":"2023-12-15T23:55:40.331897+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-15T23:55:40.331897+0000","last_undegraded":"2023-12-15T23:55:40.331897+0000","last_fullsized":"2023-12-15T23:55:40.331897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556515+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-15T23:55:55.556515+0000","last_peered":"2023-12-15T23:55:55.556515+0000","last_clean":"2023-12-15T23:55:55.556515+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-15T23:55:55.556515+0000","last_undegraded":"2023-12-15T23:55:55.556515+0000","last_fullsized":"2023-12-15T23:55:55.556515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333945+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-15T23:55:45.333945+0000","last_peered":"2023-12-15T23:55:45.333945+0000","last_clean":"2023-12-15T23:55:45.333945+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-15T23:55:45.333945+0000","last_undegraded":"2023-12-15T23:55:45.333945+0000","last_fullsized":"2023-12-15T23:55:45.333945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:32.086477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.336769+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-15T23:56:05.336769+0000","last_peered":"2023-12-15T23:56:05.336769+0000","last_clean":"2023-12-15T23:56:05.336769+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-15T23:56:05.336769+0000","last_undegraded":"2023-12-15T23:56:05.336769+0000","last_fullsized":"2023-12-15T23:56:05.336769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339145+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-15T23:56:10.339145+0000","last_peered":"2023-12-15T23:56:10.339145+0000","last_clean":"2023-12-15T23:56:10.339145+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-15T23:56:10.339145+0000","last_undegraded":"2023-12-15T23:56:10.339145+0000","last_fullsized":"2023-12-15T23:56:10.339145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339600+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-15T23:56:10.339600+0000","last_peered":"2023-12-15T23:56:10.339600+0000","last_clean":"2023-12-15T23:56:10.339600+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-15T23:56:10.339600+0000","last_undegraded":"2023-12-15T23:56:10.339600+0000","last_fullsized":"2023-12-15T23:56:10.339600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:50.364535+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-15T23:57:50.364535+0000","last_peered":"2023-12-15T23:57:50.364535+0000","last_clean":"2023-12-15T23:57:50.364535+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-15T23:57:50.364535+0000","last_undegraded":"2023-12-15T23:57:50.364535+0000","last_fullsized":"2023-12-15T23:57:50.364535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.349901+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:56:55.349901+0000","last_peered":"2023-12-15T23:56:55.349901+0000","last_clean":"2023-12-15T23:56:55.349901+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:56:55.349901+0000","last_undegraded":"2023-12-15T23:56:55.349901+0000","last_fullsized":"2023-12-15T23:56:55.349901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349864+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:56:50.349864+0000","last_peered":"2023-12-15T23:56:50.349864+0000","last_clean":"2023-12-15T23:56:50.349864+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:56:50.349864+0000","last_undegraded":"2023-12-15T23:56:50.349864+0000","last_fullsized":"2023-12-15T23:56:50.349864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:21.333233+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:56:21.333233+0000","last_peered":"2023-12-15T23:56:21.333233+0000","last_clean":"2023-12-15T23:56:21.333233+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:56:21.333233+0000","last_undegraded":"2023-12-15T23:56:21.333233+0000","last_fullsized":"2023-12-15T23:56:21.333233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:38.871309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344252+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:56:30.344252+0000","last_peered":"2023-12-15T23:56:30.344252+0000","last_clean":"2023-12-15T23:56:30.344252+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:56:30.344252+0000","last_undegraded":"2023-12-15T23:56:30.344252+0000","last_fullsized":"2023-12-15T23:56:30.344252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1842","reported_seq":2750,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344111+0000","last_change":"2023-12-15T22:53:28.170890+0000","last_active":"2023-12-15T23:56:30.344111+0000","last_peered":"2023-12-15T23:56:30.344111+0000","last_clean":"2023-12-15T23:56:30.344111+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-15T23:56:30.344111+0000","last_undegraded":"2023-12-15T23:56:30.344111+0000","last_fullsized":"2023-12-15T23:56:30.344111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:16.035980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343005+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-15T23:56:25.343005+0000","last_peered":"2023-12-15T23:56:25.343005+0000","last_clean":"2023-12-15T23:56:25.343005+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-15T23:56:25.343005+0000","last_undegraded":"2023-12-15T23:56:25.343005+0000","last_fullsized":"2023-12-15T23:56:25.343005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359523+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:57:30.359523+0000","last_peered":"2023-12-15T23:57:30.359523+0000","last_clean":"2023-12-15T23:57:30.359523+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:57:30.359523+0000","last_undegraded":"2023-12-15T23:57:30.359523+0000","last_fullsized":"2023-12-15T23:57:30.359523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:26.930020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326348+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-15T23:55:45.326348+0000","last_peered":"2023-12-15T23:55:45.326348+0000","last_clean":"2023-12-15T23:55:45.326348+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-15T23:55:45.326348+0000","last_undegraded":"2023-12-15T23:55:45.326348+0000","last_fullsized":"2023-12-15T23:55:45.326348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:43.407151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.357609+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:57:20.357609+0000","last_peered":"2023-12-15T23:57:20.357609+0000","last_clean":"2023-12-15T23:57:20.357609+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:57:20.357609+0000","last_undegraded":"2023-12-15T23:57:20.357609+0000","last_fullsized":"2023-12-15T23:57:20.357609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552614+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-15T23:55:40.552614+0000","last_peered":"2023-12-15T23:55:40.552614+0000","last_clean":"2023-12-15T23:55:40.552614+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-15T23:55:40.552614+0000","last_undegraded":"2023-12-15T23:55:40.552614+0000","last_fullsized":"2023-12-15T23:55:40.552614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329954+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-15T23:55:40.329954+0000","last_peered":"2023-12-15T23:55:40.329954+0000","last_clean":"2023-12-15T23:55:40.329954+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-15T23:55:40.329954+0000","last_undegraded":"2023-12-15T23:55:40.329954+0000","last_fullsized":"2023-12-15T23:55:40.329954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560395+0000","last_change":"2023-12-15T22:53:11.078111+0000","last_active":"2023-12-15T23:56:10.560395+0000","last_peered":"2023-12-15T23:56:10.560395+0000","last_clean":"2023-12-15T23:56:10.560395+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-15T23:56:10.560395+0000","last_undegraded":"2023-12-15T23:56:10.560395+0000","last_fullsized":"2023-12-15T23:56:10.560395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351884+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:57:00.351884+0000","last_peered":"2023-12-15T23:57:00.351884+0000","last_clean":"2023-12-15T23:57:00.351884+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:57:00.351884+0000","last_undegraded":"2023-12-15T23:57:00.351884+0000","last_fullsized":"2023-12-15T23:57:00.351884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:35.240310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4381,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.347747+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:57:21.347747+0000","last_peered":"2023-12-15T23:57:21.347747+0000","last_clean":"2023-12-15T23:57:21.347747+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:57:21.347747+0000","last_undegraded":"2023-12-15T23:57:21.347747+0000","last_fullsized":"2023-12-15T23:57:21.347747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:58.493238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349786+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:56:50.349786+0000","last_peered":"2023-12-15T23:56:50.349786+0000","last_clean":"2023-12-15T23:56:50.349786+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:56:50.349786+0000","last_undegraded":"2023-12-15T23:56:50.349786+0000","last_fullsized":"2023-12-15T23:56:50.349786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:42.139142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343348+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:56:25.343348+0000","last_peered":"2023-12-15T23:56:25.343348+0000","last_clean":"2023-12-15T23:56:25.343348+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:56:25.343348+0000","last_undegraded":"2023-12-15T23:56:25.343348+0000","last_fullsized":"2023-12-15T23:56:25.343348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:06.358488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337251+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:56:30.337251+0000","last_peered":"2023-12-15T23:56:30.337251+0000","last_clean":"2023-12-15T23:56:30.337251+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:56:30.337251+0000","last_undegraded":"2023-12-15T23:56:30.337251+0000","last_fullsized":"2023-12-15T23:56:30.337251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:33.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2119","reported_seq":2950,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335033+0000","last_change":"2023-12-15T22:53:28.169796+0000","last_active":"2023-12-15T23:56:31.335033+0000","last_peered":"2023-12-15T23:56:31.335033+0000","last_clean":"2023-12-15T23:56:31.335033+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-15T23:56:31.335033+0000","last_undegraded":"2023-12-15T23:56:31.335033+0000","last_fullsized":"2023-12-15T23:56:31.335033+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":400,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:11.825688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'5","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342010+0000","last_change":"2023-12-15T22:53:26.156319+0000","last_active":"2023-12-15T23:56:25.342010+0000","last_peered":"2023-12-15T23:56:25.342010+0000","last_clean":"2023-12-15T23:56:25.342010+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-15T23:56:25.342010+0000","last_undegraded":"2023-12-15T23:56:25.342010+0000","last_fullsized":"2023-12-15T23:56:25.342010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354866+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:57:10.354866+0000","last_peered":"2023-12-15T23:57:10.354866+0000","last_clean":"2023-12-15T23:57:10.354866+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:57:10.354866+0000","last_undegraded":"2023-12-15T23:57:10.354866+0000","last_fullsized":"2023-12-15T23:57:10.354866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556585+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-15T23:55:55.556585+0000","last_peered":"2023-12-15T23:55:55.556585+0000","last_clean":"2023-12-15T23:55:55.556585+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-15T23:55:55.556585+0000","last_undegraded":"2023-12-15T23:55:55.556585+0000","last_fullsized":"2023-12-15T23:55:55.556585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362341+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:57:40.362341+0000","last_peered":"2023-12-15T23:57:40.362341+0000","last_clean":"2023-12-15T23:57:40.362341+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:57:40.362341+0000","last_undegraded":"2023-12-15T23:57:40.362341+0000","last_fullsized":"2023-12-15T23:57:40.362341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:38.848380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329967+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-15T23:55:40.329967+0000","last_peered":"2023-12-15T23:55:40.329967+0000","last_clean":"2023-12-15T23:55:40.329967+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-15T23:55:40.329967+0000","last_undegraded":"2023-12-15T23:55:40.329967+0000","last_fullsized":"2023-12-15T23:55:40.329967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:43.553443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552603+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-15T23:55:40.552603+0000","last_peered":"2023-12-15T23:55:40.552603+0000","last_clean":"2023-12-15T23:55:40.552603+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-15T23:55:40.552603+0000","last_undegraded":"2023-12-15T23:55:40.552603+0000","last_fullsized":"2023-12-15T23:55:40.552603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:59.504031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338205+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-15T23:56:10.338205+0000","last_peered":"2023-12-15T23:56:10.338205+0000","last_clean":"2023-12-15T23:56:10.338205+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-15T23:56:10.338205+0000","last_undegraded":"2023-12-15T23:56:10.338205+0000","last_fullsized":"2023-12-15T23:56:10.338205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:45:21.838509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352260+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:57:00.352260+0000","last_peered":"2023-12-15T23:57:00.352260+0000","last_clean":"2023-12-15T23:57:00.352260+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:57:00.352260+0000","last_undegraded":"2023-12-15T23:57:00.352260+0000","last_fullsized":"2023-12-15T23:57:00.352260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:00.386613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1324,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572418+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:56:55.572418+0000","last_peered":"2023-12-15T23:56:55.572418+0000","last_clean":"2023-12-15T23:56:55.572418+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:56:55.572418+0000","last_undegraded":"2023-12-15T23:56:55.572418+0000","last_fullsized":"2023-12-15T23:56:55.572418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:23.586325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.356017+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:57:15.356017+0000","last_peered":"2023-12-15T23:57:15.356017+0000","last_clean":"2023-12-15T23:57:15.356017+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:57:15.356017+0000","last_undegraded":"2023-12-15T23:57:15.356017+0000","last_fullsized":"2023-12-15T23:57:15.356017+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343275+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:56:25.343275+0000","last_peered":"2023-12-15T23:56:25.343275+0000","last_clean":"2023-12-15T23:56:25.343275+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:56:25.343275+0000","last_undegraded":"2023-12-15T23:56:25.343275+0000","last_fullsized":"2023-12-15T23:56:25.343275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:25.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343129+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:56:30.343129+0000","last_peered":"2023-12-15T23:56:30.343129+0000","last_clean":"2023-12-15T23:56:30.343129+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:56:30.343129+0000","last_undegraded":"2023-12-15T23:56:30.343129+0000","last_fullsized":"2023-12-15T23:56:30.343129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:30.622729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":362,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565404+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:56:30.565404+0000","last_peered":"2023-12-15T23:56:30.565404+0000","last_clean":"2023-12-15T23:56:30.565404+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:56:30.565404+0000","last_undegraded":"2023-12-15T23:56:30.565404+0000","last_fullsized":"2023-12-15T23:56:30.565404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:28.380180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334009+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-15T23:56:26.334009+0000","last_peered":"2023-12-15T23:56:26.334009+0000","last_clean":"2023-12-15T23:56:26.334009+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-15T23:56:26.334009+0000","last_undegraded":"2023-12-15T23:56:26.334009+0000","last_fullsized":"2023-12-15T23:56:26.334009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:06.119748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328597+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-15T23:55:25.328597+0000","last_peered":"2023-12-15T23:55:25.328597+0000","last_clean":"2023-12-15T23:55:25.328597+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-15T23:55:25.328597+0000","last_undegraded":"2023-12-15T23:55:25.328597+0000","last_fullsized":"2023-12-15T23:55:25.328597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318664+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-15T23:55:26.318664+0000","last_peered":"2023-12-15T23:55:26.318664+0000","last_clean":"2023-12-15T23:55:26.318664+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-15T23:55:26.318664+0000","last_undegraded":"2023-12-15T23:55:26.318664+0000","last_fullsized":"2023-12-15T23:55:26.318664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321741+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-15T23:55:36.321741+0000","last_peered":"2023-12-15T23:55:36.321741+0000","last_clean":"2023-12-15T23:55:36.321741+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-15T23:55:36.321741+0000","last_undegraded":"2023-12-15T23:55:36.321741+0000","last_fullsized":"2023-12-15T23:55:36.321741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:50.986250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354891+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:57:45.354891+0000","last_peered":"2023-12-15T23:57:45.354891+0000","last_clean":"2023-12-15T23:57:45.354891+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:57:45.354891+0000","last_undegraded":"2023-12-15T23:57:45.354891+0000","last_fullsized":"2023-12-15T23:57:45.354891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:50.449966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578797+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:57:20.578797+0000","last_peered":"2023-12-15T23:57:20.578797+0000","last_clean":"2023-12-15T23:57:20.578797+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:57:20.578797+0000","last_undegraded":"2023-12-15T23:57:20.578797+0000","last_fullsized":"2023-12-15T23:57:20.578797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338114+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-15T23:56:10.338114+0000","last_peered":"2023-12-15T23:56:10.338114+0000","last_clean":"2023-12-15T23:56:10.338114+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-15T23:56:10.338114+0000","last_undegraded":"2023-12-15T23:56:10.338114+0000","last_fullsized":"2023-12-15T23:56:10.338114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:10:20.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342768+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:57:01.342768+0000","last_peered":"2023-12-15T23:57:01.342768+0000","last_clean":"2023-12-15T23:57:01.342768+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:57:01.342768+0000","last_undegraded":"2023-12-15T23:57:01.342768+0000","last_fullsized":"2023-12-15T23:57:01.342768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3844,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572342+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:56:55.572342+0000","last_peered":"2023-12-15T23:56:55.572342+0000","last_clean":"2023-12-15T23:56:55.572342+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:56:55.572342+0000","last_undegraded":"2023-12-15T23:56:55.572342+0000","last_fullsized":"2023-12-15T23:56:55.572342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:09.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:51.340241+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:56:51.340241+0000","last_peered":"2023-12-15T23:56:51.340241+0000","last_clean":"2023-12-15T23:56:51.340241+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:56:51.340241+0000","last_undegraded":"2023-12-15T23:56:51.340241+0000","last_fullsized":"2023-12-15T23:56:51.340241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:55.739562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349521+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:56:50.349521+0000","last_peered":"2023-12-15T23:56:50.349521+0000","last_clean":"2023-12-15T23:56:50.349521+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:56:50.349521+0000","last_undegraded":"2023-12-15T23:56:50.349521+0000","last_fullsized":"2023-12-15T23:56:50.349521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:02:18.788244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344265+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:56:30.344265+0000","last_peered":"2023-12-15T23:56:30.344265+0000","last_clean":"2023-12-15T23:56:30.344265+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:56:30.344265+0000","last_undegraded":"2023-12-15T23:56:30.344265+0000","last_fullsized":"2023-12-15T23:56:30.344265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:33:01.580743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9956","reported_seq":16962,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344181+0000","last_change":"2023-12-15T22:53:28.170727+0000","last_active":"2023-12-15T23:56:30.344181+0000","last_peered":"2023-12-15T23:56:30.344181+0000","last_clean":"2023-12-15T23:56:30.344181+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-15T23:56:30.344181+0000","last_undegraded":"2023-12-15T23:56:30.344181+0000","last_fullsized":"2023-12-15T23:56:30.344181+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":3000,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:29.326245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341884+0000","last_change":"2023-12-15T22:53:26.163866+0000","last_active":"2023-12-15T23:56:25.341884+0000","last_peered":"2023-12-15T23:56:25.341884+0000","last_clean":"2023-12-15T23:56:25.341884+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-15T23:56:25.341884+0000","last_undegraded":"2023-12-15T23:56:25.341884+0000","last_fullsized":"2023-12-15T23:56:25.341884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322406+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-15T23:55:25.322406+0000","last_peered":"2023-12-15T23:55:25.322406+0000","last_clean":"2023-12-15T23:55:25.322406+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-15T23:55:25.322406+0000","last_undegraded":"2023-12-15T23:55:25.322406+0000","last_fullsized":"2023-12-15T23:55:25.322406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:45.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328448+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-15T23:55:25.328448+0000","last_peered":"2023-12-15T23:55:25.328448+0000","last_clean":"2023-12-15T23:55:25.328448+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-15T23:55:25.328448+0000","last_undegraded":"2023-12-15T23:55:25.328448+0000","last_fullsized":"2023-12-15T23:55:25.328448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":241,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.551384+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-15T23:55:35.551384+0000","last_peered":"2023-12-15T23:55:35.551384+0000","last_clean":"2023-12-15T23:55:35.551384+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-15T23:55:35.551384+0000","last_undegraded":"2023-12-15T23:55:35.551384+0000","last_fullsized":"2023-12-15T23:55:35.551384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:20.673127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357853+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:57:25.357853+0000","last_peered":"2023-12-15T23:57:25.357853+0000","last_clean":"2023-12-15T23:57:25.357853+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:57:25.357853+0000","last_undegraded":"2023-12-15T23:57:25.357853+0000","last_fullsized":"2023-12-15T23:57:25.357853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:35.171333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363016+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:57:45.363016+0000","last_peered":"2023-12-15T23:57:45.363016+0000","last_clean":"2023-12-15T23:57:45.363016+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:57:45.363016+0000","last_undegraded":"2023-12-15T23:57:45.363016+0000","last_fullsized":"2023-12-15T23:57:45.363016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:28.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.337997+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-15T23:56:10.337997+0000","last_peered":"2023-12-15T23:56:10.337997+0000","last_clean":"2023-12-15T23:56:10.337997+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:56:10.337997+0000","last_undegraded":"2023-12-15T23:56:10.337997+0000","last_fullsized":"2023-12-15T23:56:10.337997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.062956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352318+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-15T23:57:41.352318+0000","last_peered":"2023-12-15T23:57:41.352318+0000","last_clean":"2023-12-15T23:57:41.352318+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-15T23:57:41.352318+0000","last_undegraded":"2023-12-15T23:57:41.352318+0000","last_fullsized":"2023-12-15T23:57:41.352318+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5869,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343539+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:57:06.343539+0000","last_peered":"2023-12-15T23:57:06.343539+0000","last_clean":"2023-12-15T23:57:06.343539+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:57:06.343539+0000","last_undegraded":"2023-12-15T23:57:06.343539+0000","last_fullsized":"2023-12-15T23:57:06.343539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:57.591782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351788+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:57:00.351788+0000","last_peered":"2023-12-15T23:57:00.351788+0000","last_clean":"2023-12-15T23:57:00.351788+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:57:00.351788+0000","last_undegraded":"2023-12-15T23:57:00.351788+0000","last_fullsized":"2023-12-15T23:57:00.351788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566684+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:56:35.566684+0000","last_peered":"2023-12-15T23:56:35.566684+0000","last_clean":"2023-12-15T23:56:35.566684+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:56:35.566684+0000","last_undegraded":"2023-12-15T23:56:35.566684+0000","last_fullsized":"2023-12-15T23:56:35.566684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:44.870107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1507,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347321+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:56:45.347321+0000","last_peered":"2023-12-15T23:56:45.347321+0000","last_clean":"2023-12-15T23:56:45.347321+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:56:45.347321+0000","last_undegraded":"2023-12-15T23:56:45.347321+0000","last_fullsized":"2023-12-15T23:56:45.347321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:02.140170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'237","reported_seq":413,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342292+0000","last_change":"2023-12-15T22:53:28.168042+0000","last_active":"2023-12-15T23:56:20.342292+0000","last_peered":"2023-12-15T23:56:20.342292+0000","last_clean":"2023-12-15T23:56:20.342292+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-15T23:56:20.342292+0000","last_undegraded":"2023-12-15T23:56:20.342292+0000","last_fullsized":"2023-12-15T23:56:20.342292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'23","reported_seq":147,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.332061+0000","last_change":"2023-12-15T22:53:26.162529+0000","last_active":"2023-12-15T23:56:16.332061+0000","last_peered":"2023-12-15T23:56:16.332061+0000","last_clean":"2023-12-15T23:56:16.332061+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-15T23:56:16.332061+0000","last_undegraded":"2023-12-15T23:56:16.332061+0000","last_fullsized":"2023-12-15T23:56:16.332061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:07.818847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318821+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-15T23:55:26.318821+0000","last_peered":"2023-12-15T23:55:26.318821+0000","last_clean":"2023-12-15T23:55:26.318821+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-15T23:55:26.318821+0000","last_undegraded":"2023-12-15T23:55:26.318821+0000","last_fullsized":"2023-12-15T23:55:26.318821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328501+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-15T23:55:25.328501+0000","last_peered":"2023-12-15T23:55:25.328501+0000","last_clean":"2023-12-15T23:55:25.328501+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-15T23:55:25.328501+0000","last_undegraded":"2023-12-15T23:55:25.328501+0000","last_fullsized":"2023-12-15T23:55:25.328501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:25.929011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321560+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-15T23:55:36.321560+0000","last_peered":"2023-12-15T23:55:36.321560+0000","last_clean":"2023-12-15T23:55:36.321560+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-15T23:55:36.321560+0000","last_undegraded":"2023-12-15T23:55:36.321560+0000","last_fullsized":"2023-12-15T23:55:36.321560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:57.672852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340190+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-15T23:56:15.340190+0000","last_peered":"2023-12-15T23:56:15.340190+0000","last_clean":"2023-12-15T23:56:15.340190+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-15T23:56:15.340190+0000","last_undegraded":"2023-12-15T23:56:15.340190+0000","last_fullsized":"2023-12-15T23:56:15.340190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336942+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-15T23:56:00.336942+0000","last_peered":"2023-12-15T23:56:00.336942+0000","last_clean":"2023-12-15T23:56:00.336942+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-15T23:56:00.336942+0000","last_undegraded":"2023-12-15T23:56:00.336942+0000","last_fullsized":"2023-12-15T23:56:00.336942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336133+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-15T23:56:00.336133+0000","last_peered":"2023-12-15T23:56:00.336133+0000","last_clean":"2023-12-15T23:56:00.336133+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-15T23:56:00.336133+0000","last_undegraded":"2023-12-15T23:56:00.336133+0000","last_fullsized":"2023-12-15T23:56:00.336133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.353458+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-15T23:57:40.353458+0000","last_peered":"2023-12-15T23:57:40.353458+0000","last_clean":"2023-12-15T23:57:40.353458+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-15T23:57:40.353458+0000","last_undegraded":"2023-12-15T23:57:40.353458+0000","last_fullsized":"2023-12-15T23:57:40.353458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:28:25.919204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4018,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574414+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:57:05.574414+0000","last_peered":"2023-12-15T23:57:05.574414+0000","last_clean":"2023-12-15T23:57:05.574414+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:57:05.574414+0000","last_undegraded":"2023-12-15T23:57:05.574414+0000","last_fullsized":"2023-12-15T23:57:05.574414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:19.550874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351766+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:57:00.351766+0000","last_peered":"2023-12-15T23:57:00.351766+0000","last_clean":"2023-12-15T23:57:00.351766+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:57:00.351766+0000","last_undegraded":"2023-12-15T23:57:00.351766+0000","last_fullsized":"2023-12-15T23:57:00.351766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:24.931139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345572+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:56:35.345572+0000","last_peered":"2023-12-15T23:56:35.345572+0000","last_clean":"2023-12-15T23:56:35.345572+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:56:35.345572+0000","last_undegraded":"2023-12-15T23:56:35.345572+0000","last_fullsized":"2023-12-15T23:56:35.345572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1435,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.335080+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:56:20.335080+0000","last_peered":"2023-12-15T23:56:20.335080+0000","last_clean":"2023-12-15T23:56:20.335080+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:56:20.335080+0000","last_undegraded":"2023-12-15T23:56:20.335080+0000","last_fullsized":"2023-12-15T23:56:20.335080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:02.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":340,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.568173+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:56:40.568173+0000","last_peered":"2023-12-15T23:56:40.568173+0000","last_clean":"2023-12-15T23:56:40.568173+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:56:40.568173+0000","last_undegraded":"2023-12-15T23:56:40.568173+0000","last_fullsized":"2023-12-15T23:56:40.568173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:04.096568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356849+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-15T23:57:56.356849+0000","last_peered":"2023-12-15T23:57:56.356849+0000","last_clean":"2023-12-15T23:57:56.356849+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-15T23:57:56.356849+0000","last_undegraded":"2023-12-15T23:57:56.356849+0000","last_fullsized":"2023-12-15T23:57:56.356849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:50.188900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318753+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-15T23:55:26.318753+0000","last_peered":"2023-12-15T23:55:26.318753+0000","last_clean":"2023-12-15T23:55:26.318753+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-15T23:55:26.318753+0000","last_undegraded":"2023-12-15T23:55:26.318753+0000","last_fullsized":"2023-12-15T23:55:26.318753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:32.193702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328603+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-15T23:55:25.328603+0000","last_peered":"2023-12-15T23:55:25.328603+0000","last_clean":"2023-12-15T23:55:25.328603+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-15T23:55:25.328603+0000","last_undegraded":"2023-12-15T23:55:25.328603+0000","last_fullsized":"2023-12-15T23:55:25.328603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:25.439900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.330732+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-15T23:55:35.330732+0000","last_peered":"2023-12-15T23:55:35.330732+0000","last_clean":"2023-12-15T23:55:35.330732+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-15T23:55:35.330732+0000","last_undegraded":"2023-12-15T23:55:35.330732+0000","last_fullsized":"2023-12-15T23:55:35.330732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:31.616855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336859+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-15T23:56:00.336859+0000","last_peered":"2023-12-15T23:56:00.336859+0000","last_clean":"2023-12-15T23:56:00.336859+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-15T23:56:00.336859+0000","last_undegraded":"2023-12-15T23:56:00.336859+0000","last_fullsized":"2023-12-15T23:56:00.336859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339319+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-15T23:56:15.339319+0000","last_peered":"2023-12-15T23:56:15.339319+0000","last_clean":"2023-12-15T23:56:15.339319+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-15T23:56:15.339319+0000","last_undegraded":"2023-12-15T23:56:15.339319+0000","last_fullsized":"2023-12-15T23:56:15.339319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.558216+0000","last_change":"2023-12-15T22:53:11.079680+0000","last_active":"2023-12-15T23:56:00.558216+0000","last_peered":"2023-12-15T23:56:00.558216+0000","last_clean":"2023-12-15T23:56:00.558216+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-15T23:56:00.558216+0000","last_undegraded":"2023-12-15T23:56:00.558216+0000","last_fullsized":"2023-12-15T23:56:00.558216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362232+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-15T23:57:40.362232+0000","last_peered":"2023-12-15T23:57:40.362232+0000","last_clean":"2023-12-15T23:57:40.362232+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-15T23:57:40.362232+0000","last_undegraded":"2023-12-15T23:57:40.362232+0000","last_fullsized":"2023-12-15T23:57:40.362232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:41:26.264663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3628,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345681+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:57:05.345681+0000","last_peered":"2023-12-15T23:57:05.345681+0000","last_clean":"2023-12-15T23:57:05.345681+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:57:05.345681+0000","last_undegraded":"2023-12-15T23:57:05.345681+0000","last_fullsized":"2023-12-15T23:57:05.345681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:01:11.119015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573007+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:57:00.573007+0000","last_peered":"2023-12-15T23:57:00.573007+0000","last_clean":"2023-12-15T23:57:00.573007+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:57:00.573007+0000","last_undegraded":"2023-12-15T23:57:00.573007+0000","last_fullsized":"2023-12-15T23:57:00.573007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345307+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:56:35.345307+0000","last_peered":"2023-12-15T23:56:35.345307+0000","last_clean":"2023-12-15T23:56:35.345307+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:56:35.345307+0000","last_undegraded":"2023-12-15T23:56:35.345307+0000","last_fullsized":"2023-12-15T23:56:35.345307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:05.380779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342047+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:56:20.342047+0000","last_peered":"2023-12-15T23:56:20.342047+0000","last_clean":"2023-12-15T23:56:20.342047+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:56:20.342047+0000","last_undegraded":"2023-12-15T23:56:20.342047+0000","last_fullsized":"2023-12-15T23:56:20.342047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:22.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341102+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:56:20.341102+0000","last_peered":"2023-12-15T23:56:20.341102+0000","last_clean":"2023-12-15T23:56:20.341102+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:56:20.341102+0000","last_undegraded":"2023-12-15T23:56:20.341102+0000","last_fullsized":"2023-12-15T23:56:20.341102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'15","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566777+0000","last_change":"2023-12-15T22:53:26.157853+0000","last_active":"2023-12-15T23:56:35.566777+0000","last_peered":"2023-12-15T23:56:35.566777+0000","last_clean":"2023-12-15T23:56:35.566777+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-15T23:56:35.566777+0000","last_undegraded":"2023-12-15T23:56:35.566777+0000","last_fullsized":"2023-12-15T23:56:35.566777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337000+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-15T23:56:00.337000+0000","last_peered":"2023-12-15T23:56:00.337000+0000","last_clean":"2023-12-15T23:56:00.337000+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-15T23:56:00.337000+0000","last_undegraded":"2023-12-15T23:56:00.337000+0000","last_fullsized":"2023-12-15T23:56:00.337000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.347051+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:57:10.347051+0000","last_peered":"2023-12-15T23:57:10.347051+0000","last_clean":"2023-12-15T23:57:10.347051+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:57:10.347051+0000","last_undegraded":"2023-12-15T23:57:10.347051+0000","last_fullsized":"2023-12-15T23:57:10.347051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:56:29.147167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326284+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-15T23:55:56.326284+0000","last_peered":"2023-12-15T23:55:56.326284+0000","last_clean":"2023-12-15T23:55:56.326284+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-15T23:55:56.326284+0000","last_undegraded":"2023-12-15T23:55:56.326284+0000","last_fullsized":"2023-12-15T23:55:56.326284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:33.642166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332245+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-15T23:55:40.332245+0000","last_peered":"2023-12-15T23:55:40.332245+0000","last_clean":"2023-12-15T23:55:40.332245+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-15T23:55:40.332245+0000","last_undegraded":"2023-12-15T23:55:40.332245+0000","last_fullsized":"2023-12-15T23:55:40.332245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329802+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-15T23:55:40.329802+0000","last_peered":"2023-12-15T23:55:40.329802+0000","last_clean":"2023-12-15T23:55:40.329802+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-15T23:55:40.329802+0000","last_undegraded":"2023-12-15T23:55:40.329802+0000","last_fullsized":"2023-12-15T23:55:40.329802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335944+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-15T23:56:00.335944+0000","last_peered":"2023-12-15T23:56:00.335944+0000","last_clean":"2023-12-15T23:56:00.335944+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-15T23:56:00.335944+0000","last_undegraded":"2023-12-15T23:56:00.335944+0000","last_fullsized":"2023-12-15T23:56:00.335944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:57.230909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583230+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-15T23:57:40.583230+0000","last_peered":"2023-12-15T23:57:40.583230+0000","last_clean":"2023-12-15T23:57:40.583230+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-15T23:57:40.583230+0000","last_undegraded":"2023-12-15T23:57:40.583230+0000","last_fullsized":"2023-12-15T23:57:40.583230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1274,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345598+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:57:05.345598+0000","last_peered":"2023-12-15T23:57:05.345598+0000","last_clean":"2023-12-15T23:57:05.345598+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:57:05.345598+0000","last_undegraded":"2023-12-15T23:57:05.345598+0000","last_fullsized":"2023-12-15T23:57:05.345598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:21.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573186+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:57:00.573186+0000","last_peered":"2023-12-15T23:57:00.573186+0000","last_clean":"2023-12-15T23:57:00.573186+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:57:00.573186+0000","last_undegraded":"2023-12-15T23:57:00.573186+0000","last_fullsized":"2023-12-15T23:57:00.573186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:30.130575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345396+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:56:35.345396+0000","last_peered":"2023-12-15T23:56:35.345396+0000","last_clean":"2023-12-15T23:56:35.345396+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:56:35.345396+0000","last_undegraded":"2023-12-15T23:56:35.345396+0000","last_fullsized":"2023-12-15T23:56:35.345396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342154+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:56:20.342154+0000","last_peered":"2023-12-15T23:56:20.342154+0000","last_clean":"2023-12-15T23:56:20.342154+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:56:20.342154+0000","last_undegraded":"2023-12-15T23:56:20.342154+0000","last_fullsized":"2023-12-15T23:56:20.342154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:41.240268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'185","reported_seq":372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340965+0000","last_change":"2023-12-15T22:53:28.164042+0000","last_active":"2023-12-15T23:56:20.340965+0000","last_peered":"2023-12-15T23:56:20.340965+0000","last_clean":"2023-12-15T23:56:20.340965+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-15T23:56:20.340965+0000","last_undegraded":"2023-12-15T23:56:20.340965+0000","last_fullsized":"2023-12-15T23:56:20.340965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:35.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331931+0000","last_change":"2023-12-15T22:53:26.160787+0000","last_active":"2023-12-15T23:56:16.331931+0000","last_peered":"2023-12-15T23:56:16.331931+0000","last_clean":"2023-12-15T23:56:16.331931+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-15T23:56:16.331931+0000","last_undegraded":"2023-12-15T23:56:16.331931+0000","last_fullsized":"2023-12-15T23:56:16.331931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:55.771958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331088+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:55:45.331088+0000","last_peered":"2023-12-15T23:55:45.331088+0000","last_clean":"2023-12-15T23:55:45.331088+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-15T23:55:45.331088+0000","last_undegraded":"2023-12-15T23:55:45.331088+0000","last_fullsized":"2023-12-15T23:55:45.331088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.360294+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:57:30.360294+0000","last_peered":"2023-12-15T23:57:30.360294+0000","last_clean":"2023-12-15T23:57:30.360294+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:57:30.360294+0000","last_undegraded":"2023-12-15T23:57:30.360294+0000","last_fullsized":"2023-12-15T23:57:30.360294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558888+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-15T23:56:05.558888+0000","last_peered":"2023-12-15T23:56:05.558888+0000","last_clean":"2023-12-15T23:56:05.558888+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-15T23:56:05.558888+0000","last_undegraded":"2023-12-15T23:56:05.558888+0000","last_fullsized":"2023-12-15T23:56:05.558888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:31.646743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321587+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-15T23:55:36.321587+0000","last_peered":"2023-12-15T23:55:36.321587+0000","last_clean":"2023-12-15T23:55:36.321587+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-15T23:55:36.321587+0000","last_undegraded":"2023-12-15T23:55:36.321587+0000","last_fullsized":"2023-12-15T23:55:36.321587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:22.684030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332350+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-15T23:55:40.332350+0000","last_peered":"2023-12-15T23:55:40.332350+0000","last_clean":"2023-12-15T23:55:40.332350+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-15T23:55:40.332350+0000","last_undegraded":"2023-12-15T23:55:40.332350+0000","last_fullsized":"2023-12-15T23:55:40.332350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334267+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-15T23:56:26.334267+0000","last_peered":"2023-12-15T23:56:26.334267+0000","last_clean":"2023-12-15T23:56:26.334267+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-15T23:56:26.334267+0000","last_undegraded":"2023-12-15T23:56:26.334267+0000","last_fullsized":"2023-12-15T23:56:26.334267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:17.634267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336045+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-15T23:56:25.336045+0000","last_peered":"2023-12-15T23:56:25.336045+0000","last_clean":"2023-12-15T23:56:25.336045+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-15T23:56:25.336045+0000","last_undegraded":"2023-12-15T23:56:25.336045+0000","last_fullsized":"2023-12-15T23:56:25.336045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:42.698596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587718+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-15T23:57:55.587718+0000","last_peered":"2023-12-15T23:57:55.587718+0000","last_clean":"2023-12-15T23:57:55.587718+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-15T23:57:55.587718+0000","last_undegraded":"2023-12-15T23:57:55.587718+0000","last_fullsized":"2023-12-15T23:57:55.587718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:27.446502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349717+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:57:31.349717+0000","last_peered":"2023-12-15T23:57:31.349717+0000","last_clean":"2023-12-15T23:57:31.349717+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:57:31.349717+0000","last_undegraded":"2023-12-15T23:57:31.349717+0000","last_fullsized":"2023-12-15T23:57:31.349717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343114+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-15T23:56:25.343114+0000","last_peered":"2023-12-15T23:56:25.343114+0000","last_clean":"2023-12-15T23:56:25.343114+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-15T23:56:25.343114+0000","last_undegraded":"2023-12-15T23:56:25.343114+0000","last_fullsized":"2023-12-15T23:56:25.343114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:07.455612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587659+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-15T23:57:55.587659+0000","last_peered":"2023-12-15T23:57:55.587659+0000","last_clean":"2023-12-15T23:57:55.587659+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-15T23:57:55.587659+0000","last_undegraded":"2023-12-15T23:57:55.587659+0000","last_fullsized":"2023-12-15T23:57:55.587659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351196+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:57:30.351196+0000","last_peered":"2023-12-15T23:57:30.351196+0000","last_clean":"2023-12-15T23:57:30.351196+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:57:30.351196+0000","last_undegraded":"2023-12-15T23:57:30.351196+0000","last_fullsized":"2023-12-15T23:57:30.351196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:08.012235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344047+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-15T23:56:30.344047+0000","last_peered":"2023-12-15T23:56:30.344047+0000","last_clean":"2023-12-15T23:56:30.344047+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-15T23:56:30.344047+0000","last_undegraded":"2023-12-15T23:56:30.344047+0000","last_fullsized":"2023-12-15T23:56:30.344047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365333+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-15T23:57:55.365333+0000","last_peered":"2023-12-15T23:57:55.365333+0000","last_clean":"2023-12-15T23:57:55.365333+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-15T23:57:55.365333+0000","last_undegraded":"2023-12-15T23:57:55.365333+0000","last_fullsized":"2023-12-15T23:57:55.365333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583197+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:57:40.583197+0000","last_peered":"2023-12-15T23:57:40.583197+0000","last_clean":"2023-12-15T23:57:40.583197+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:57:40.583197+0000","last_undegraded":"2023-12-15T23:57:40.583197+0000","last_fullsized":"2023-12-15T23:57:40.583197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341827+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-15T23:56:25.341827+0000","last_peered":"2023-12-15T23:56:25.341827+0000","last_clean":"2023-12-15T23:56:25.341827+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-15T23:56:25.341827+0000","last_undegraded":"2023-12-15T23:56:25.341827+0000","last_fullsized":"2023-12-15T23:56:25.341827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:34.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587497+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-15T23:57:55.587497+0000","last_peered":"2023-12-15T23:57:55.587497+0000","last_clean":"2023-12-15T23:57:55.587497+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-15T23:57:55.587497+0000","last_undegraded":"2023-12-15T23:57:55.587497+0000","last_fullsized":"2023-12-15T23:57:55.587497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363670+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:57:45.363670+0000","last_peered":"2023-12-15T23:57:45.363670+0000","last_clean":"2023-12-15T23:57:45.363670+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:57:45.363670+0000","last_undegraded":"2023-12-15T23:57:45.363670+0000","last_fullsized":"2023-12-15T23:57:45.363670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'5","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343413+0000","last_change":"2023-12-15T22:53:26.165809+0000","last_active":"2023-12-15T23:56:25.343413+0000","last_peered":"2023-12-15T23:56:25.343413+0000","last_clean":"2023-12-15T23:56:25.343413+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-15T23:56:25.343413+0000","last_undegraded":"2023-12-15T23:56:25.343413+0000","last_fullsized":"2023-12-15T23:56:25.343413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354702+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:57:45.354702+0000","last_peered":"2023-12-15T23:57:45.354702+0000","last_clean":"2023-12-15T23:57:45.354702+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:57:45.354702+0000","last_undegraded":"2023-12-15T23:57:45.354702+0000","last_fullsized":"2023-12-15T23:57:45.354702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:19.635825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366764+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-15T23:57:55.366764+0000","last_peered":"2023-12-15T23:57:55.366764+0000","last_clean":"2023-12-15T23:57:55.366764+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-15T23:57:55.366764+0000","last_undegraded":"2023-12-15T23:57:55.366764+0000","last_fullsized":"2023-12-15T23:57:55.366764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324460+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-15T23:55:46.324460+0000","last_peered":"2023-12-15T23:55:46.324460+0000","last_clean":"2023-12-15T23:55:46.324460+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-15T23:55:46.324460+0000","last_undegraded":"2023-12-15T23:55:46.324460+0000","last_fullsized":"2023-12-15T23:55:46.324460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.635572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349969+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:57:31.349969+0000","last_peered":"2023-12-15T23:57:31.349969+0000","last_clean":"2023-12-15T23:57:31.349969+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:57:31.349969+0000","last_undegraded":"2023-12-15T23:57:31.349969+0000","last_fullsized":"2023-12-15T23:57:31.349969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587564+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-15T23:57:55.587564+0000","last_peered":"2023-12-15T23:57:55.587564+0000","last_clean":"2023-12-15T23:57:55.587564+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-15T23:57:55.587564+0000","last_undegraded":"2023-12-15T23:57:55.587564+0000","last_fullsized":"2023-12-15T23:57:55.587564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'41","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564172+0000","last_change":"2023-12-15T22:53:26.155725+0000","last_active":"2023-12-15T23:56:25.564172+0000","last_peered":"2023-12-15T23:56:25.564172+0000","last_clean":"2023-12-15T23:56:25.564172+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-15T23:56:25.564172+0000","last_undegraded":"2023-12-15T23:56:25.564172+0000","last_fullsized":"2023-12-15T23:56:25.564172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580810+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:57:30.580810+0000","last_peered":"2023-12-15T23:57:30.580810+0000","last_clean":"2023-12-15T23:57:30.580810+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:57:30.580810+0000","last_undegraded":"2023-12-15T23:57:30.580810+0000","last_fullsized":"2023-12-15T23:57:30.580810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365999+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-15T23:57:55.365999+0000","last_peered":"2023-12-15T23:57:55.365999+0000","last_clean":"2023-12-15T23:57:55.365999+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-15T23:57:55.365999+0000","last_undegraded":"2023-12-15T23:57:55.365999+0000","last_fullsized":"2023-12-15T23:57:55.365999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339792+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:56:40.339792+0000","last_peered":"2023-12-15T23:56:40.339792+0000","last_clean":"2023-12-15T23:56:40.339792+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:56:40.339792+0000","last_undegraded":"2023-12-15T23:56:40.339792+0000","last_fullsized":"2023-12-15T23:56:40.339792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:46.435729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.358657+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:57:30.358657+0000","last_peered":"2023-12-15T23:57:30.358657+0000","last_clean":"2023-12-15T23:57:30.358657+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:57:30.358657+0000","last_undegraded":"2023-12-15T23:57:30.358657+0000","last_fullsized":"2023-12-15T23:57:30.358657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357081+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-15T23:57:55.357081+0000","last_peered":"2023-12-15T23:57:55.357081+0000","last_clean":"2023-12-15T23:57:55.357081+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-15T23:57:55.357081+0000","last_undegraded":"2023-12-15T23:57:55.357081+0000","last_fullsized":"2023-12-15T23:57:55.357081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:13:32.248104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'3","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366932+0000","last_change":"2023-12-15T22:53:26.155477+0000","last_active":"2023-12-15T23:58:00.366932+0000","last_peered":"2023-12-15T23:58:00.366932+0000","last_clean":"2023-12-15T23:58:00.366932+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-15T23:58:00.366932+0000","last_undegraded":"2023-12-15T23:58:00.366932+0000","last_fullsized":"2023-12-15T23:58:00.366932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:19.405614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336265+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-15T23:55:55.336265+0000","last_peered":"2023-12-15T23:55:55.336265+0000","last_clean":"2023-12-15T23:55:55.336265+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-15T23:55:55.336265+0000","last_undegraded":"2023-12-15T23:55:55.336265+0000","last_fullsized":"2023-12-15T23:55:55.336265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368735+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-15T23:58:10.368735+0000","last_peered":"2023-12-15T23:58:10.368735+0000","last_clean":"2023-12-15T23:58:10.368735+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-15T23:58:10.368735+0000","last_undegraded":"2023-12-15T23:58:10.368735+0000","last_fullsized":"2023-12-15T23:58:10.368735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.361584+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-15T23:58:15.361584+0000","last_peered":"2023-12-15T23:58:15.361584+0000","last_clean":"2023-12-15T23:58:15.361584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-15T23:58:15.361584+0000","last_undegraded":"2023-12-15T23:58:15.361584+0000","last_fullsized":"2023-12-15T23:58:15.361584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:45.682186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326761+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-15T23:55:56.326761+0000","last_peered":"2023-12-15T23:55:56.326761+0000","last_clean":"2023-12-15T23:55:56.326761+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-15T23:55:56.326761+0000","last_undegraded":"2023-12-15T23:55:56.326761+0000","last_fullsized":"2023-12-15T23:55:56.326761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335682+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-15T23:55:55.335682+0000","last_peered":"2023-12-15T23:55:55.335682+0000","last_clean":"2023-12-15T23:55:55.335682+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-15T23:55:55.335682+0000","last_undegraded":"2023-12-15T23:55:55.335682+0000","last_fullsized":"2023-12-15T23:55:55.335682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:09.497036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367621+0000","last_change":"2023-12-15T22:53:26.158639+0000","last_active":"2023-12-15T23:58:00.367621+0000","last_peered":"2023-12-15T23:58:00.367621+0000","last_clean":"2023-12-15T23:58:00.367621+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-15T23:58:00.367621+0000","last_undegraded":"2023-12-15T23:58:00.367621+0000","last_fullsized":"2023-12-15T23:58:00.367621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:32.844238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332721+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-15T23:56:10.332721+0000","last_peered":"2023-12-15T23:56:10.332721+0000","last_clean":"2023-12-15T23:56:10.332721+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-15T23:56:10.332721+0000","last_undegraded":"2023-12-15T23:56:10.332721+0000","last_fullsized":"2023-12-15T23:56:10.332721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:03.393324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335654+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-15T23:55:55.335654+0000","last_peered":"2023-12-15T23:55:55.335654+0000","last_clean":"2023-12-15T23:55:55.335654+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-15T23:55:55.335654+0000","last_undegraded":"2023-12-15T23:55:55.335654+0000","last_fullsized":"2023-12-15T23:55:55.335654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:13.846874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'19","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.357925+0000","last_change":"2023-12-15T22:53:26.165805+0000","last_active":"2023-12-15T23:58:00.357925+0000","last_peered":"2023-12-15T23:58:00.357925+0000","last_clean":"2023-12-15T23:58:00.357925+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-15T23:58:00.357925+0000","last_undegraded":"2023-12-15T23:58:00.357925+0000","last_fullsized":"2023-12-15T23:58:00.357925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:03.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334511+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-15T23:55:55.334511+0000","last_peered":"2023-12-15T23:55:55.334511+0000","last_clean":"2023-12-15T23:55:55.334511+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-15T23:55:55.334511+0000","last_undegraded":"2023-12-15T23:55:55.334511+0000","last_fullsized":"2023-12-15T23:55:55.334511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335851+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-15T23:55:55.335851+0000","last_peered":"2023-12-15T23:55:55.335851+0000","last_clean":"2023-12-15T23:55:55.335851+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-15T23:55:55.335851+0000","last_undegraded":"2023-12-15T23:55:55.335851+0000","last_fullsized":"2023-12-15T23:55:55.335851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340606+0000","last_change":"2023-12-15T22:53:26.165548+0000","last_active":"2023-12-15T23:56:15.340606+0000","last_peered":"2023-12-15T23:56:15.340606+0000","last_clean":"2023-12-15T23:56:15.340606+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-15T23:56:15.340606+0000","last_undegraded":"2023-12-15T23:56:15.340606+0000","last_fullsized":"2023-12-15T23:56:15.340606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326506+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-15T23:55:56.326506+0000","last_peered":"2023-12-15T23:55:56.326506+0000","last_clean":"2023-12-15T23:55:56.326506+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-15T23:55:56.326506+0000","last_undegraded":"2023-12-15T23:55:56.326506+0000","last_fullsized":"2023-12-15T23:55:56.326506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:05.103262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334464+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-15T23:55:55.334464+0000","last_peered":"2023-12-15T23:55:55.334464+0000","last_clean":"2023-12-15T23:55:55.334464+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-15T23:55:55.334464+0000","last_undegraded":"2023-12-15T23:55:55.334464+0000","last_fullsized":"2023-12-15T23:55:55.334464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'4","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.334068+0000","last_change":"2023-12-15T22:53:26.162667+0000","last_active":"2023-12-15T23:56:15.334068+0000","last_peered":"2023-12-15T23:56:15.334068+0000","last_clean":"2023-12-15T23:56:15.334068+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-15T23:56:15.334068+0000","last_undegraded":"2023-12-15T23:56:15.334068+0000","last_fullsized":"2023-12-15T23:56:15.334068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:35.730252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335764+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-15T23:55:55.335764+0000","last_peered":"2023-12-15T23:55:55.335764+0000","last_clean":"2023-12-15T23:55:55.335764+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-15T23:55:55.335764+0000","last_undegraded":"2023-12-15T23:55:55.335764+0000","last_fullsized":"2023-12-15T23:55:55.335764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338439+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-15T23:56:10.338439+0000","last_peered":"2023-12-15T23:56:10.338439+0000","last_clean":"2023-12-15T23:56:10.338439+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-15T23:56:10.338439+0000","last_undegraded":"2023-12-15T23:56:10.338439+0000","last_fullsized":"2023-12-15T23:56:10.338439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333909+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-15T23:56:15.333909+0000","last_peered":"2023-12-15T23:56:15.333909+0000","last_clean":"2023-12-15T23:56:15.333909+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-15T23:56:15.333909+0000","last_undegraded":"2023-12-15T23:56:15.333909+0000","last_fullsized":"2023-12-15T23:56:15.333909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:29:17.328062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556616+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-15T23:55:55.556616+0000","last_peered":"2023-12-15T23:55:55.556616+0000","last_clean":"2023-12-15T23:55:55.556616+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-15T23:55:55.556616+0000","last_undegraded":"2023-12-15T23:55:55.556616+0000","last_fullsized":"2023-12-15T23:55:55.556616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328947+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-15T23:55:55.328947+0000","last_peered":"2023-12-15T23:55:55.328947+0000","last_clean":"2023-12-15T23:55:55.328947+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-15T23:55:55.328947+0000","last_undegraded":"2023-12-15T23:55:55.328947+0000","last_fullsized":"2023-12-15T23:55:55.328947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'22","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340969+0000","last_change":"2023-12-15T22:53:26.161460+0000","last_active":"2023-12-15T23:56:15.340969+0000","last_peered":"2023-12-15T23:56:15.340969+0000","last_clean":"2023-12-15T23:56:15.340969+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-15T23:56:15.340969+0000","last_undegraded":"2023-12-15T23:56:15.340969+0000","last_fullsized":"2023-12-15T23:56:15.340969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:57.157307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369558+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-15T23:58:10.369558+0000","last_peered":"2023-12-15T23:58:10.369558+0000","last_clean":"2023-12-15T23:58:10.369558+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-15T23:58:10.369558+0000","last_undegraded":"2023-12-15T23:58:10.369558+0000","last_fullsized":"2023-12-15T23:58:10.369558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336071+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-15T23:55:55.336071+0000","last_peered":"2023-12-15T23:55:55.336071+0000","last_clean":"2023-12-15T23:55:55.336071+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-15T23:55:55.336071+0000","last_undegraded":"2023-12-15T23:55:55.336071+0000","last_fullsized":"2023-12-15T23:55:55.336071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335777+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-15T23:55:55.335777+0000","last_peered":"2023-12-15T23:55:55.335777+0000","last_clean":"2023-12-15T23:55:55.335777+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-15T23:55:55.335777+0000","last_undegraded":"2023-12-15T23:55:55.335777+0000","last_fullsized":"2023-12-15T23:55:55.335777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:38.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.333892+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-15T23:55:55.333892+0000","last_peered":"2023-12-15T23:55:55.333892+0000","last_clean":"2023-12-15T23:55:55.333892+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-15T23:55:55.333892+0000","last_undegraded":"2023-12-15T23:55:55.333892+0000","last_fullsized":"2023-12-15T23:55:55.333892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337514+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-15T23:56:00.337514+0000","last_peered":"2023-12-15T23:56:00.337514+0000","last_clean":"2023-12-15T23:56:00.337514+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-15T23:56:00.337514+0000","last_undegraded":"2023-12-15T23:56:00.337514+0000","last_fullsized":"2023-12-15T23:56:00.337514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328806+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-15T23:55:55.328806+0000","last_peered":"2023-12-15T23:55:55.328806+0000","last_clean":"2023-12-15T23:55:55.328806+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-15T23:55:55.328806+0000","last_undegraded":"2023-12-15T23:55:55.328806+0000","last_fullsized":"2023-12-15T23:55:55.328806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:55.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556597+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-15T23:55:55.556597+0000","last_peered":"2023-12-15T23:55:55.556597+0000","last_clean":"2023-12-15T23:55:55.556597+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-15T23:55:55.556597+0000","last_undegraded":"2023-12-15T23:55:55.556597+0000","last_fullsized":"2023-12-15T23:55:55.556597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333280+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-15T23:55:45.333280+0000","last_peered":"2023-12-15T23:55:45.333280+0000","last_clean":"2023-12-15T23:55:45.333280+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-15T23:55:45.333280+0000","last_undegraded":"2023-12-15T23:55:45.333280+0000","last_fullsized":"2023-12-15T23:55:45.333280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":599,"ondisk_log_size":599,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22796,"ondisk_log_size":22796,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608376,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.72299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.68400000000000005},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.626,"5min":0.67700000000000005,"15min":0.78200000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.74199999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.61899999999999999},"last":0.443}]},{"osd":5,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.375,"15min":0.373},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.52500000000000002,"5min":0.60099999999999998,"15min":1.149},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.64500000000000002},"last":0.40500000000000003}]}]},{"osd":5,"up_from":11,"seq":47244641078,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.495}]},{"osd":1,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71699999999999997,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.754,"15min":0.754},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.372,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.48399999999999999,"5min":0.56699999999999995,"15min":0.63},"last":0.374}]},{"osd":4,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641080,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Dec 15 23:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.27800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.502,"15min":0.80100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45200000000000001,"5min":0.57399999999999995,"15min":0.78700000000000003},"last":0.372}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.38700000000000001}]}]},{"osd":2,"up_from":11,"seq":47244641077,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.193},"max":{"1min":0.55500000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.48499999999999999,"5min":0.87,"15min":0.87},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.35799999999999998},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52400000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.29399999999999998},"max":{"1min":0.77200000000000002,"5min":1.169,"15min":1.169},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70999999999999996}]}]},{"osd":1,"up_from":11,"seq":47244641078,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47132,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810468,"statfs":{"total":107374182400,"available":107325919232,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.436,"5min":0.48699999999999999,"15min":0.53100000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51700000000000002,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.377}]},{"osd":2,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.72799999999999998,"15min":0.75700000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":0.878},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.622}]}]},{"osd":0,"up_from":11,"seq":47244641078,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.315},"min":{"1min":0.224,"5min":0.21099999999999999,"15min":0.17299999999999999},"max":{"1min":0.44900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.20799999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.373},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.22800000000000001},"max":{"1min":0.746,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.23999999999999999},"max":{"1min":0.73699999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.875,"15min":0.875},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.78900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:00:23.935 INFO:tasks.ceph.ceph_manager.c1:clean! 2023-12-16T00:00:23.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:00:24.254 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:24.274 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:00:24.277 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2098,"stamp":"2023-12-16T00:00:24.171389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34355,"ondisk_log_size":34355,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":269080,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":259190,"kb_avail":628876520,"statfs":{"total":644245094400,"available":643969556480,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":265411233},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006328"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561765+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-15T23:56:15.561765+0000","last_peered":"2023-12-15T23:56:15.561765+0000","last_clean":"2023-12-15T23:56:15.561765+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-15T23:56:15.561765+0000","last_undegraded":"2023-12-15T23:56:15.561765+0000","last_fullsized":"2023-12-15T23:56:15.561765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359557+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:57:30.359557+0000","last_peered":"2023-12-15T23:57:30.359557+0000","last_clean":"2023-12-15T23:57:30.359557+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:57:30.359557+0000","last_undegraded":"2023-12-15T23:57:30.359557+0000","last_fullsized":"2023-12-15T23:57:30.359557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328209+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-15T23:55:25.328209+0000","last_peered":"2023-12-15T23:55:25.328209+0000","last_clean":"2023-12-15T23:55:25.328209+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-15T23:55:25.328209+0000","last_undegraded":"2023-12-15T23:55:25.328209+0000","last_fullsized":"2023-12-15T23:55:25.328209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:16:04.440737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340462+0000","last_change":"2023-12-15T22:53:26.165400+0000","last_active":"2023-12-15T23:56:15.340462+0000","last_peered":"2023-12-15T23:56:15.340462+0000","last_clean":"2023-12-15T23:56:15.340462+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-15T23:56:15.340462+0000","last_undegraded":"2023-12-15T23:56:15.340462+0000","last_fullsized":"2023-12-15T23:56:15.340462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581276+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:57:30.581276+0000","last_peered":"2023-12-15T23:57:30.581276+0000","last_clean":"2023-12-15T23:57:30.581276+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:57:30.581276+0000","last_undegraded":"2023-12-15T23:57:30.581276+0000","last_fullsized":"2023-12-15T23:57:30.581276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325398+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-15T23:55:25.325398+0000","last_peered":"2023-12-15T23:55:25.325398+0000","last_clean":"2023-12-15T23:55:25.325398+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-15T23:55:25.325398+0000","last_undegraded":"2023-12-15T23:55:25.325398+0000","last_fullsized":"2023-12-15T23:55:25.325398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335549+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:56:31.335549+0000","last_peered":"2023-12-15T23:56:31.335549+0000","last_clean":"2023-12-15T23:56:31.335549+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:56:31.335549+0000","last_undegraded":"2023-12-15T23:56:31.335549+0000","last_fullsized":"2023-12-15T23:56:31.335549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:22.850613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583442+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:57:40.583442+0000","last_peered":"2023-12-15T23:57:40.583442+0000","last_clean":"2023-12-15T23:57:40.583442+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:57:40.583442+0000","last_undegraded":"2023-12-15T23:57:40.583442+0000","last_fullsized":"2023-12-15T23:57:40.583442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318703+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-15T23:55:26.318703+0000","last_peered":"2023-12-15T23:55:26.318703+0000","last_clean":"2023-12-15T23:55:26.318703+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-15T23:55:26.318703+0000","last_undegraded":"2023-12-15T23:55:26.318703+0000","last_fullsized":"2023-12-15T23:55:26.318703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:34.568365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561835+0000","last_change":"2023-12-15T22:53:26.155908+0000","last_active":"2023-12-15T23:56:15.561835+0000","last_peered":"2023-12-15T23:56:15.561835+0000","last_clean":"2023-12-15T23:56:15.561835+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-15T23:56:15.561835+0000","last_undegraded":"2023-12-15T23:56:15.561835+0000","last_fullsized":"2023-12-15T23:56:15.561835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354290+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:57:10.354290+0000","last_peered":"2023-12-15T23:57:10.354290+0000","last_clean":"2023-12-15T23:57:10.354290+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:57:10.354290+0000","last_undegraded":"2023-12-15T23:57:10.354290+0000","last_fullsized":"2023-12-15T23:57:10.354290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328460+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-15T23:55:25.328460+0000","last_peered":"2023-12-15T23:55:25.328460+0000","last_clean":"2023-12-15T23:55:25.328460+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-15T23:55:25.328460+0000","last_undegraded":"2023-12-15T23:55:25.328460+0000","last_fullsized":"2023-12-15T23:55:25.328460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334057+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-15T23:56:26.334057+0000","last_peered":"2023-12-15T23:56:26.334057+0000","last_clean":"2023-12-15T23:56:26.334057+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-15T23:56:26.334057+0000","last_undegraded":"2023-12-15T23:56:26.334057+0000","last_fullsized":"2023-12-15T23:56:26.334057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:32.140453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325615+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-15T23:55:25.325615+0000","last_peered":"2023-12-15T23:55:25.325615+0000","last_clean":"2023-12-15T23:55:25.325615+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-15T23:55:25.325615+0000","last_undegraded":"2023-12-15T23:55:25.325615+0000","last_fullsized":"2023-12-15T23:55:25.325615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354303+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:57:10.354303+0000","last_peered":"2023-12-15T23:57:10.354303+0000","last_clean":"2023-12-15T23:57:10.354303+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:57:10.354303+0000","last_undegraded":"2023-12-15T23:57:10.354303+0000","last_fullsized":"2023-12-15T23:57:10.354303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'5","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343007+0000","last_change":"2023-12-15T22:53:26.162283+0000","last_active":"2023-12-15T23:56:25.343007+0000","last_peered":"2023-12-15T23:56:25.343007+0000","last_clean":"2023-12-15T23:56:25.343007+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-15T23:56:25.343007+0000","last_undegraded":"2023-12-15T23:56:25.343007+0000","last_fullsized":"2023-12-15T23:56:25.343007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328352+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-15T23:55:25.328352+0000","last_peered":"2023-12-15T23:55:25.328352+0000","last_clean":"2023-12-15T23:55:25.328352+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-15T23:55:25.328352+0000","last_undegraded":"2023-12-15T23:55:25.328352+0000","last_fullsized":"2023-12-15T23:55:25.328352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350353+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:57:31.350353+0000","last_peered":"2023-12-15T23:57:31.350353+0000","last_clean":"2023-12-15T23:57:31.350353+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:57:31.350353+0000","last_undegraded":"2023-12-15T23:57:31.350353+0000","last_fullsized":"2023-12-15T23:57:31.350353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'8","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339456+0000","last_change":"2023-12-15T22:53:26.156995+0000","last_active":"2023-12-15T23:56:15.339456+0000","last_peered":"2023-12-15T23:56:15.339456+0000","last_clean":"2023-12-15T23:56:15.339456+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-15T23:56:15.339456+0000","last_undegraded":"2023-12-15T23:56:15.339456+0000","last_fullsized":"2023-12-15T23:56:15.339456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:02.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.325358+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-15T23:55:25.325358+0000","last_peered":"2023-12-15T23:55:25.325358+0000","last_clean":"2023-12-15T23:55:25.325358+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-15T23:55:25.325358+0000","last_undegraded":"2023-12-15T23:55:25.325358+0000","last_fullsized":"2023-12-15T23:55:25.325358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359263+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:57:30.359263+0000","last_peered":"2023-12-15T23:57:30.359263+0000","last_clean":"2023-12-15T23:57:30.359263+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:57:30.359263+0000","last_undegraded":"2023-12-15T23:57:30.359263+0000","last_fullsized":"2023-12-15T23:57:30.359263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337739+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:56:41.337739+0000","last_peered":"2023-12-15T23:56:41.337739+0000","last_clean":"2023-12-15T23:56:41.337739+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:56:41.337739+0000","last_undegraded":"2023-12-15T23:56:41.337739+0000","last_fullsized":"2023-12-15T23:56:41.337739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:05.670759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322111+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-15T23:55:25.322111+0000","last_peered":"2023-12-15T23:55:25.322111+0000","last_clean":"2023-12-15T23:55:25.322111+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-15T23:55:25.322111+0000","last_undegraded":"2023-12-15T23:55:25.322111+0000","last_fullsized":"2023-12-15T23:55:25.322111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:38.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351612+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:57:30.351612+0000","last_peered":"2023-12-15T23:57:30.351612+0000","last_clean":"2023-12-15T23:57:30.351612+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:57:30.351612+0000","last_undegraded":"2023-12-15T23:57:30.351612+0000","last_fullsized":"2023-12-15T23:57:30.351612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:11.503638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'10","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366685+0000","last_change":"2023-12-15T22:53:26.164117+0000","last_active":"2023-12-15T23:58:00.366685+0000","last_peered":"2023-12-15T23:58:00.366685+0000","last_clean":"2023-12-15T23:58:00.366685+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-15T23:58:00.366685+0000","last_undegraded":"2023-12-15T23:58:00.366685+0000","last_fullsized":"2023-12-15T23:58:00.366685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:38.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326264+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-15T23:55:56.326264+0000","last_peered":"2023-12-15T23:55:56.326264+0000","last_clean":"2023-12-15T23:55:56.326264+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-15T23:55:56.326264+0000","last_undegraded":"2023-12-15T23:55:56.326264+0000","last_fullsized":"2023-12-15T23:55:56.326264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:07.802909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559391+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-15T23:56:05.559391+0000","last_peered":"2023-12-15T23:56:05.559391+0000","last_clean":"2023-12-15T23:56:05.559391+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-15T23:56:05.559391+0000","last_undegraded":"2023-12-15T23:56:05.559391+0000","last_fullsized":"2023-12-15T23:56:05.559391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:37.299376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'10","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361963+0000","last_change":"2023-12-15T22:53:26.161032+0000","last_active":"2023-12-15T23:57:40.361963+0000","last_peered":"2023-12-15T23:57:40.361963+0000","last_clean":"2023-12-15T23:57:40.361963+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-15T23:57:40.361963+0000","last_undegraded":"2023-12-15T23:57:40.361963+0000","last_fullsized":"2023-12-15T23:57:40.361963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:26.370938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335545+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-15T23:55:55.335545+0000","last_peered":"2023-12-15T23:55:55.335545+0000","last_clean":"2023-12-15T23:55:55.335545+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-15T23:55:55.335545+0000","last_undegraded":"2023-12-15T23:55:55.335545+0000","last_fullsized":"2023-12-15T23:55:55.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331592+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-15T23:55:45.331592+0000","last_peered":"2023-12-15T23:55:45.331592+0000","last_clean":"2023-12-15T23:55:45.331592+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-15T23:55:45.331592+0000","last_undegraded":"2023-12-15T23:55:45.331592+0000","last_fullsized":"2023-12-15T23:55:45.331592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'28","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358304+0000","last_change":"2023-12-15T22:53:26.162543+0000","last_active":"2023-12-15T23:58:00.358304+0000","last_peered":"2023-12-15T23:58:00.358304+0000","last_clean":"2023-12-15T23:58:00.358304+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-15T23:58:00.358304+0000","last_undegraded":"2023-12-15T23:58:00.358304+0000","last_fullsized":"2023-12-15T23:58:00.358304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:06.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339086+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-15T23:56:10.339086+0000","last_peered":"2023-12-15T23:56:10.339086+0000","last_clean":"2023-12-15T23:56:10.339086+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-15T23:56:10.339086+0000","last_undegraded":"2023-12-15T23:56:10.339086+0000","last_fullsized":"2023-12-15T23:56:10.339086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333163+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-15T23:55:45.333163+0000","last_peered":"2023-12-15T23:55:45.333163+0000","last_clean":"2023-12-15T23:55:45.333163+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-15T23:55:45.333163+0000","last_undegraded":"2023-12-15T23:55:45.333163+0000","last_fullsized":"2023-12-15T23:55:45.333163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358223+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-15T23:58:00.358223+0000","last_peered":"2023-12-15T23:58:00.358223+0000","last_clean":"2023-12-15T23:58:00.358223+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-15T23:58:00.358223+0000","last_undegraded":"2023-12-15T23:58:00.358223+0000","last_fullsized":"2023-12-15T23:58:00.358223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:34.225706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326624+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-15T23:55:45.326624+0000","last_peered":"2023-12-15T23:55:45.326624+0000","last_clean":"2023-12-15T23:55:45.326624+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-15T23:55:45.326624+0000","last_undegraded":"2023-12-15T23:55:45.326624+0000","last_fullsized":"2023-12-15T23:55:45.326624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:09.630988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324219+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-15T23:55:46.324219+0000","last_peered":"2023-12-15T23:55:46.324219+0000","last_clean":"2023-12-15T23:55:46.324219+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-15T23:55:46.324219+0000","last_undegraded":"2023-12-15T23:55:46.324219+0000","last_fullsized":"2023-12-15T23:55:46.324219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334011+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-15T23:55:55.334011+0000","last_peered":"2023-12-15T23:55:55.334011+0000","last_clean":"2023-12-15T23:55:55.334011+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-15T23:55:55.334011+0000","last_undegraded":"2023-12-15T23:55:55.334011+0000","last_fullsized":"2023-12-15T23:55:55.334011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326697+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-15T23:55:45.326697+0000","last_peered":"2023-12-15T23:55:45.326697+0000","last_clean":"2023-12-15T23:55:45.326697+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-15T23:55:45.326697+0000","last_undegraded":"2023-12-15T23:55:45.326697+0000","last_fullsized":"2023-12-15T23:55:45.326697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:58.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333465+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-15T23:55:45.333465+0000","last_peered":"2023-12-15T23:55:45.333465+0000","last_clean":"2023-12-15T23:55:45.333465+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-15T23:55:45.333465+0000","last_undegraded":"2023-12-15T23:55:45.333465+0000","last_fullsized":"2023-12-15T23:55:45.333465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:03.096660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328420+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-15T23:55:55.328420+0000","last_peered":"2023-12-15T23:55:55.328420+0000","last_clean":"2023-12-15T23:55:55.328420+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-15T23:55:55.328420+0000","last_undegraded":"2023-12-15T23:55:55.328420+0000","last_fullsized":"2023-12-15T23:55:55.328420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:24.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324294+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-15T23:55:46.324294+0000","last_peered":"2023-12-15T23:55:46.324294+0000","last_clean":"2023-12-15T23:55:46.324294+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-15T23:55:46.324294+0000","last_undegraded":"2023-12-15T23:55:46.324294+0000","last_fullsized":"2023-12-15T23:55:46.324294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339461+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-15T23:56:10.339461+0000","last_peered":"2023-12-15T23:56:10.339461+0000","last_clean":"2023-12-15T23:56:10.339461+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-15T23:56:10.339461+0000","last_undegraded":"2023-12-15T23:56:10.339461+0000","last_fullsized":"2023-12-15T23:56:10.339461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566972+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-15T23:56:35.566972+0000","last_peered":"2023-12-15T23:56:35.566972+0000","last_clean":"2023-12-15T23:56:35.566972+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-15T23:56:35.566972+0000","last_undegraded":"2023-12-15T23:56:35.566972+0000","last_fullsized":"2023-12-15T23:56:35.566972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1693,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.372653+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-15T23:58:20.372653+0000","last_peered":"2023-12-15T23:58:20.372653+0000","last_clean":"2023-12-15T23:58:20.372653+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-15T23:58:20.372653+0000","last_undegraded":"2023-12-15T23:58:20.372653+0000","last_fullsized":"2023-12-15T23:58:20.372653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343290+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:56:30.343290+0000","last_peered":"2023-12-15T23:56:30.343290+0000","last_clean":"2023-12-15T23:56:30.343290+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:56:30.343290+0000","last_undegraded":"2023-12-15T23:56:30.343290+0000","last_fullsized":"2023-12-15T23:56:30.343290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360588+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-15T23:57:35.360588+0000","last_peered":"2023-12-15T23:57:35.360588+0000","last_clean":"2023-12-15T23:57:35.360588+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-15T23:57:35.360588+0000","last_undegraded":"2023-12-15T23:57:35.360588+0000","last_fullsized":"2023-12-15T23:57:35.360588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:45.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327893+0000","last_change":"2023-12-15T22:53:30.178391+0000","last_active":"2023-12-15T23:56:01.327893+0000","last_peered":"2023-12-15T23:56:01.327893+0000","last_clean":"2023-12-15T23:56:01.327893+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-15T23:56:01.327893+0000","last_undegraded":"2023-12-15T23:56:01.327893+0000","last_fullsized":"2023-12-15T23:56:01.327893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:53.334878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'309","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335674+0000","last_change":"2023-12-15T22:53:28.165506+0000","last_active":"2023-12-15T23:56:00.335674+0000","last_peered":"2023-12-15T23:56:00.335674+0000","last_clean":"2023-12-15T23:56:00.335674+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-15T23:56:00.335674+0000","last_undegraded":"2023-12-15T23:56:00.335674+0000","last_fullsized":"2023-12-15T23:56:00.335674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:40.852277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337214+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:56:30.337214+0000","last_peered":"2023-12-15T23:56:30.337214+0000","last_clean":"2023-12-15T23:56:30.337214+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:56:30.337214+0000","last_undegraded":"2023-12-15T23:56:30.337214+0000","last_fullsized":"2023-12-15T23:56:30.337214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:33.452389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327638+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-15T23:56:01.327638+0000","last_peered":"2023-12-15T23:56:01.327638+0000","last_clean":"2023-12-15T23:56:01.327638+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-15T23:56:01.327638+0000","last_undegraded":"2023-12-15T23:56:01.327638+0000","last_fullsized":"2023-12-15T23:56:01.327638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:24.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559157+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-15T23:56:05.559157+0000","last_peered":"2023-12-15T23:56:05.559157+0000","last_clean":"2023-12-15T23:56:05.559157+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-15T23:56:05.559157+0000","last_undegraded":"2023-12-15T23:56:05.559157+0000","last_fullsized":"2023-12-15T23:56:05.559157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334309+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-15T23:55:55.334309+0000","last_peered":"2023-12-15T23:55:55.334309+0000","last_clean":"2023-12-15T23:55:55.334309+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-15T23:55:55.334309+0000","last_undegraded":"2023-12-15T23:55:55.334309+0000","last_fullsized":"2023-12-15T23:55:55.334309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:30.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335875+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-15T23:55:55.335875+0000","last_peered":"2023-12-15T23:55:55.335875+0000","last_clean":"2023-12-15T23:55:55.335875+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-15T23:55:55.335875+0000","last_undegraded":"2023-12-15T23:55:55.335875+0000","last_fullsized":"2023-12-15T23:55:55.335875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337489+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-15T23:56:00.337489+0000","last_peered":"2023-12-15T23:56:00.337489+0000","last_clean":"2023-12-15T23:56:00.337489+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-15T23:56:00.337489+0000","last_undegraded":"2023-12-15T23:56:00.337489+0000","last_fullsized":"2023-12-15T23:56:00.337489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337350+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-15T23:56:00.337350+0000","last_peered":"2023-12-15T23:56:00.337350+0000","last_clean":"2023-12-15T23:56:00.337350+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-15T23:56:00.337350+0000","last_undegraded":"2023-12-15T23:56:00.337350+0000","last_fullsized":"2023-12-15T23:56:00.337350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:24.040020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.342184+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-15T23:56:50.342184+0000","last_peered":"2023-12-15T23:56:50.342184+0000","last_clean":"2023-12-15T23:56:50.342184+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-15T23:56:50.342184+0000","last_undegraded":"2023-12-15T23:56:50.342184+0000","last_fullsized":"2023-12-15T23:56:50.342184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:34.560913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346084+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-15T23:56:35.346084+0000","last_peered":"2023-12-15T23:56:35.346084+0000","last_clean":"2023-12-15T23:56:35.346084+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-15T23:56:35.346084+0000","last_undegraded":"2023-12-15T23:56:35.346084+0000","last_fullsized":"2023-12-15T23:56:35.346084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:31.974370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344321+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:56:30.344321+0000","last_peered":"2023-12-15T23:56:30.344321+0000","last_clean":"2023-12-15T23:56:30.344321+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:56:30.344321+0000","last_undegraded":"2023-12-15T23:56:30.344321+0000","last_fullsized":"2023-12-15T23:56:30.344321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:02:26.652903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.338524+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-15T23:56:05.338524+0000","last_peered":"2023-12-15T23:56:05.338524+0000","last_clean":"2023-12-15T23:56:05.338524+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-15T23:56:05.338524+0000","last_undegraded":"2023-12-15T23:56:05.338524+0000","last_fullsized":"2023-12-15T23:56:05.338524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":850,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336831+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-15T23:56:00.336831+0000","last_peered":"2023-12-15T23:56:00.336831+0000","last_clean":"2023-12-15T23:56:00.336831+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-15T23:56:00.336831+0000","last_undegraded":"2023-12-15T23:56:00.336831+0000","last_fullsized":"2023-12-15T23:56:00.336831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:16.093189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1989","reported_seq":3292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.330162+0000","last_change":"2023-12-15T22:53:28.164220+0000","last_active":"2023-12-15T23:56:00.330162+0000","last_peered":"2023-12-15T23:56:00.330162+0000","last_clean":"2023-12-15T23:56:00.330162+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-15T23:56:00.330162+0000","last_undegraded":"2023-12-15T23:56:00.330162+0000","last_fullsized":"2023-12-15T23:56:00.330162+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":200,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:24.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340087+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-15T23:56:15.340087+0000","last_peered":"2023-12-15T23:56:15.340087+0000","last_clean":"2023-12-15T23:56:15.340087+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-15T23:56:15.340087+0000","last_undegraded":"2023-12-15T23:56:15.340087+0000","last_fullsized":"2023-12-15T23:56:15.340087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340211+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-15T23:56:15.340211+0000","last_peered":"2023-12-15T23:56:15.340211+0000","last_clean":"2023-12-15T23:56:15.340211+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-15T23:56:15.340211+0000","last_undegraded":"2023-12-15T23:56:15.340211+0000","last_fullsized":"2023-12-15T23:56:15.340211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333143+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-15T23:55:45.333143+0000","last_peered":"2023-12-15T23:55:45.333143+0000","last_clean":"2023-12-15T23:55:45.333143+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-15T23:55:45.333143+0000","last_undegraded":"2023-12-15T23:55:45.333143+0000","last_fullsized":"2023-12-15T23:55:45.333143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558997+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-15T23:56:05.558997+0000","last_peered":"2023-12-15T23:56:05.558997+0000","last_clean":"2023-12-15T23:56:05.558997+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-15T23:56:05.558997+0000","last_undegraded":"2023-12-15T23:56:05.558997+0000","last_fullsized":"2023-12-15T23:56:05.558997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342197+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-15T23:56:20.342197+0000","last_peered":"2023-12-15T23:56:20.342197+0000","last_clean":"2023-12-15T23:56:20.342197+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-15T23:56:20.342197+0000","last_undegraded":"2023-12-15T23:56:20.342197+0000","last_fullsized":"2023-12-15T23:56:20.342197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326827+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-15T23:55:56.326827+0000","last_peered":"2023-12-15T23:55:56.326827+0000","last_clean":"2023-12-15T23:55:56.326827+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-15T23:55:56.326827+0000","last_undegraded":"2023-12-15T23:55:56.326827+0000","last_fullsized":"2023-12-15T23:55:56.326827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:33.627758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.328126+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-15T23:56:01.328126+0000","last_peered":"2023-12-15T23:56:01.328126+0000","last_clean":"2023-12-15T23:56:01.328126+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-15T23:56:01.328126+0000","last_undegraded":"2023-12-15T23:56:01.328126+0000","last_fullsized":"2023-12-15T23:56:01.328126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:42.868883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330495+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:56:11.330495+0000","last_peered":"2023-12-15T23:56:11.330495+0000","last_clean":"2023-12-15T23:56:11.330495+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:56:11.330495+0000","last_undegraded":"2023-12-15T23:56:11.330495+0000","last_fullsized":"2023-12-15T23:56:11.330495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345763+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:56:35.345763+0000","last_peered":"2023-12-15T23:56:35.345763+0000","last_clean":"2023-12-15T23:56:35.345763+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:56:35.345763+0000","last_undegraded":"2023-12-15T23:56:35.345763+0000","last_fullsized":"2023-12-15T23:56:35.345763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:05.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335521+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-15T23:56:31.335521+0000","last_peered":"2023-12-15T23:56:31.335521+0000","last_clean":"2023-12-15T23:56:31.335521+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-15T23:56:31.335521+0000","last_undegraded":"2023-12-15T23:56:31.335521+0000","last_fullsized":"2023-12-15T23:56:31.335521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.354044+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:57:46.354044+0000","last_peered":"2023-12-15T23:57:46.354044+0000","last_clean":"2023-12-15T23:57:46.354044+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:57:46.354044+0000","last_undegraded":"2023-12-15T23:57:46.354044+0000","last_fullsized":"2023-12-15T23:57:46.354044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:33.344075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345497+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:56:35.345497+0000","last_peered":"2023-12-15T23:56:35.345497+0000","last_clean":"2023-12-15T23:56:35.345497+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:56:35.345497+0000","last_undegraded":"2023-12-15T23:56:35.345497+0000","last_fullsized":"2023-12-15T23:56:35.345497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:52.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'201","reported_seq":429,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334656+0000","last_change":"2023-12-15T22:53:28.167522+0000","last_active":"2023-12-15T23:56:20.334656+0000","last_peered":"2023-12-15T23:56:20.334656+0000","last_clean":"2023-12-15T23:56:20.334656+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-15T23:56:20.334656+0000","last_undegraded":"2023-12-15T23:56:20.334656+0000","last_fullsized":"2023-12-15T23:56:20.334656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:57.781199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'5","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:53:26.162142+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332182+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-15T23:55:40.332182+0000","last_peered":"2023-12-15T23:55:40.332182+0000","last_clean":"2023-12-15T23:55:40.332182+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-15T23:55:40.332182+0000","last_undegraded":"2023-12-15T23:55:40.332182+0000","last_fullsized":"2023-12-15T23:55:40.332182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:14.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333796+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-15T23:55:45.333796+0000","last_peered":"2023-12-15T23:55:45.333796+0000","last_clean":"2023-12-15T23:55:45.333796+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-15T23:55:45.333796+0000","last_undegraded":"2023-12-15T23:55:45.333796+0000","last_fullsized":"2023-12-15T23:55:45.333796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334043+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-15T23:55:55.334043+0000","last_peered":"2023-12-15T23:55:55.334043+0000","last_clean":"2023-12-15T23:55:55.334043+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-15T23:55:55.334043+0000","last_undegraded":"2023-12-15T23:55:55.334043+0000","last_fullsized":"2023-12-15T23:55:55.334043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.329028+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-15T23:55:55.329028+0000","last_peered":"2023-12-15T23:55:55.329028+0000","last_clean":"2023-12-15T23:55:55.329028+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-15T23:55:55.329028+0000","last_undegraded":"2023-12-15T23:55:55.329028+0000","last_fullsized":"2023-12-15T23:55:55.329028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:00.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336144+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-15T23:56:25.336144+0000","last_peered":"2023-12-15T23:56:25.336144+0000","last_clean":"2023-12-15T23:56:25.336144+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-15T23:56:25.336144+0000","last_undegraded":"2023-12-15T23:56:25.336144+0000","last_fullsized":"2023-12-15T23:56:25.336144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:31.056179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":794,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335932+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-15T23:56:00.335932+0000","last_peered":"2023-12-15T23:56:00.335932+0000","last_clean":"2023-12-15T23:56:00.335932+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-15T23:56:00.335932+0000","last_undegraded":"2023-12-15T23:56:00.335932+0000","last_fullsized":"2023-12-15T23:56:00.335932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560472+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:56:10.560472+0000","last_peered":"2023-12-15T23:56:10.560472+0000","last_clean":"2023-12-15T23:56:10.560472+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:56:10.560472+0000","last_undegraded":"2023-12-15T23:56:10.560472+0000","last_fullsized":"2023-12-15T23:56:10.560472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345845+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:56:35.345845+0000","last_peered":"2023-12-15T23:56:35.345845+0000","last_clean":"2023-12-15T23:56:35.345845+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:56:35.345845+0000","last_undegraded":"2023-12-15T23:56:35.345845+0000","last_fullsized":"2023-12-15T23:56:35.345845+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:02.469293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:16.361776+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-15T23:58:16.361776+0000","last_peered":"2023-12-15T23:58:16.361776+0000","last_clean":"2023-12-15T23:58:16.361776+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-15T23:58:16.361776+0000","last_undegraded":"2023-12-15T23:58:16.361776+0000","last_fullsized":"2023-12-15T23:58:16.361776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:18.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370227+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-15T23:58:10.370227+0000","last_peered":"2023-12-15T23:58:10.370227+0000","last_clean":"2023-12-15T23:58:10.370227+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-15T23:58:10.370227+0000","last_undegraded":"2023-12-15T23:58:10.370227+0000","last_fullsized":"2023-12-15T23:58:10.370227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:26:44.954886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334633+0000","last_change":"2023-12-15T22:53:30.176318+0000","last_active":"2023-12-15T23:56:20.334633+0000","last_peered":"2023-12-15T23:56:20.334633+0000","last_clean":"2023-12-15T23:56:20.334633+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-15T23:56:20.334633+0000","last_undegraded":"2023-12-15T23:56:20.334633+0000","last_fullsized":"2023-12-15T23:56:20.334633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:13.030255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3261,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565177+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:56:30.565177+0000","last_peered":"2023-12-15T23:56:30.565177+0000","last_clean":"2023-12-15T23:56:30.565177+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:56:30.565177+0000","last_undegraded":"2023-12-15T23:56:30.565177+0000","last_fullsized":"2023-12-15T23:56:30.565177+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:36.870664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"49'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556660+0000","last_change":"2023-12-15T22:53:26.164024+0000","last_active":"2023-12-15T23:55:55.556660+0000","last_peered":"2023-12-15T23:55:55.556660+0000","last_clean":"2023-12-15T23:55:55.556660+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-15T23:55:55.556660+0000","last_undegraded":"2023-12-15T23:55:55.556660+0000","last_fullsized":"2023-12-15T23:55:55.556660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:41.322906+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-15T23:55:41.322906+0000","last_peered":"2023-12-15T23:55:41.322906+0000","last_clean":"2023-12-15T23:55:41.322906+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-15T23:55:41.322906+0000","last_undegraded":"2023-12-15T23:55:41.322906+0000","last_fullsized":"2023-12-15T23:55:41.322906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:47.568953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333892+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-15T23:55:45.333892+0000","last_peered":"2023-12-15T23:55:45.333892+0000","last_clean":"2023-12-15T23:55:45.333892+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-15T23:55:45.333892+0000","last_undegraded":"2023-12-15T23:55:45.333892+0000","last_fullsized":"2023-12-15T23:55:45.333892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335457+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-15T23:55:55.335457+0000","last_peered":"2023-12-15T23:55:55.335457+0000","last_clean":"2023-12-15T23:55:55.335457+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-15T23:55:55.335457+0000","last_undegraded":"2023-12-15T23:55:55.335457+0000","last_fullsized":"2023-12-15T23:55:55.335457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334772+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-15T23:55:55.334772+0000","last_peered":"2023-12-15T23:55:55.334772+0000","last_clean":"2023-12-15T23:55:55.334772+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-15T23:55:55.334772+0000","last_undegraded":"2023-12-15T23:55:55.334772+0000","last_fullsized":"2023-12-15T23:55:55.334772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:24.167330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335919+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-15T23:56:00.335919+0000","last_peered":"2023-12-15T23:56:00.335919+0000","last_clean":"2023-12-15T23:56:00.335919+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-15T23:56:00.335919+0000","last_undegraded":"2023-12-15T23:56:00.335919+0000","last_fullsized":"2023-12-15T23:56:00.335919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:13.618757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":795,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.562788+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-15T23:56:20.562788+0000","last_peered":"2023-12-15T23:56:20.562788+0000","last_clean":"2023-12-15T23:56:20.562788+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-15T23:56:20.562788+0000","last_undegraded":"2023-12-15T23:56:20.562788+0000","last_fullsized":"2023-12-15T23:56:20.562788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:39.943256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336566+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-15T23:56:36.336566+0000","last_peered":"2023-12-15T23:56:36.336566+0000","last_clean":"2023-12-15T23:56:36.336566+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-15T23:56:36.336566+0000","last_undegraded":"2023-12-15T23:56:36.336566+0000","last_fullsized":"2023-12-15T23:56:36.336566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:08.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1569,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344451+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-15T23:56:35.344451+0000","last_peered":"2023-12-15T23:56:35.344451+0000","last_clean":"2023-12-15T23:56:35.344451+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-15T23:56:35.344451+0000","last_undegraded":"2023-12-15T23:56:35.344451+0000","last_fullsized":"2023-12-15T23:56:35.344451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:15:15.009231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343006+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-15T23:56:30.343006+0000","last_peered":"2023-12-15T23:56:30.343006+0000","last_clean":"2023-12-15T23:56:30.343006+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-15T23:56:30.343006+0000","last_undegraded":"2023-12-15T23:56:30.343006+0000","last_fullsized":"2023-12-15T23:56:30.343006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353594+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:57:46.353594+0000","last_peered":"2023-12-15T23:57:46.353594+0000","last_clean":"2023-12-15T23:57:46.353594+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:57:46.353594+0000","last_undegraded":"2023-12-15T23:57:46.353594+0000","last_fullsized":"2023-12-15T23:57:46.353594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:32.398010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342201+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-15T23:56:20.342201+0000","last_peered":"2023-12-15T23:56:20.342201+0000","last_clean":"2023-12-15T23:56:20.342201+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-15T23:56:20.342201+0000","last_undegraded":"2023-12-15T23:56:20.342201+0000","last_fullsized":"2023-12-15T23:56:20.342201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:13.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'342","reported_seq":508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342111+0000","last_change":"2023-12-15T22:53:28.172209+0000","last_active":"2023-12-15T23:56:20.342111+0000","last_peered":"2023-12-15T23:56:20.342111+0000","last_clean":"2023-12-15T23:56:20.342111+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-15T23:56:20.342111+0000","last_undegraded":"2023-12-15T23:56:20.342111+0000","last_fullsized":"2023-12-15T23:56:20.342111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:40.476433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.371963+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-15T23:58:15.371963+0000","last_peered":"2023-12-15T23:58:15.371963+0000","last_clean":"2023-12-15T23:58:15.371963+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-15T23:58:15.371963+0000","last_undegraded":"2023-12-15T23:58:15.371963+0000","last_fullsized":"2023-12-15T23:58:15.371963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:21:22.340026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365463+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-15T23:57:55.365463+0000","last_peered":"2023-12-15T23:57:55.365463+0000","last_clean":"2023-12-15T23:57:55.365463+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-15T23:57:55.365463+0000","last_undegraded":"2023-12-15T23:57:55.365463+0000","last_fullsized":"2023-12-15T23:57:55.365463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339554+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-15T23:56:10.339554+0000","last_peered":"2023-12-15T23:56:10.339554+0000","last_clean":"2023-12-15T23:56:10.339554+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-15T23:56:10.339554+0000","last_undegraded":"2023-12-15T23:56:10.339554+0000","last_fullsized":"2023-12-15T23:56:10.339554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367610+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-15T23:58:05.367610+0000","last_peered":"2023-12-15T23:58:05.367610+0000","last_clean":"2023-12-15T23:58:05.367610+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-15T23:58:05.367610+0000","last_undegraded":"2023-12-15T23:58:05.367610+0000","last_fullsized":"2023-12-15T23:58:05.367610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:31.374833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":249,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340302+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-15T23:56:15.340302+0000","last_peered":"2023-12-15T23:56:15.340302+0000","last_clean":"2023-12-15T23:56:15.340302+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-15T23:56:15.340302+0000","last_undegraded":"2023-12-15T23:56:15.340302+0000","last_fullsized":"2023-12-15T23:56:15.340302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560374+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-15T23:56:10.560374+0000","last_peered":"2023-12-15T23:56:10.560374+0000","last_clean":"2023-12-15T23:56:10.560374+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-15T23:56:10.560374+0000","last_undegraded":"2023-12-15T23:56:10.560374+0000","last_fullsized":"2023-12-15T23:56:10.560374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:37.180934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362737+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:57:45.362737+0000","last_peered":"2023-12-15T23:57:45.362737+0000","last_clean":"2023-12-15T23:57:45.362737+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:57:45.362737+0000","last_undegraded":"2023-12-15T23:57:45.362737+0000","last_fullsized":"2023-12-15T23:57:45.362737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.338476+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-15T23:56:35.338476+0000","last_peered":"2023-12-15T23:56:35.338476+0000","last_clean":"2023-12-15T23:56:35.338476+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-15T23:56:35.338476+0000","last_undegraded":"2023-12-15T23:56:35.338476+0000","last_fullsized":"2023-12-15T23:56:35.338476+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:00:00.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3976,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345750+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-15T23:56:35.345750+0000","last_peered":"2023-12-15T23:56:35.345750+0000","last_clean":"2023-12-15T23:56:35.345750+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-15T23:56:35.345750+0000","last_undegraded":"2023-12-15T23:56:35.345750+0000","last_fullsized":"2023-12-15T23:56:35.345750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:58.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.370715+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-15T23:58:15.370715+0000","last_peered":"2023-12-15T23:58:15.370715+0000","last_clean":"2023-12-15T23:58:15.370715+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-15T23:58:15.370715+0000","last_undegraded":"2023-12-15T23:58:15.370715+0000","last_fullsized":"2023-12-15T23:58:15.370715+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:19:34.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369593+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-15T23:58:10.369593+0000","last_peered":"2023-12-15T23:58:10.369593+0000","last_clean":"2023-12-15T23:58:10.369593+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-15T23:58:10.369593+0000","last_undegraded":"2023-12-15T23:58:10.369593+0000","last_fullsized":"2023-12-15T23:58:10.369593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342347+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-15T23:56:20.342347+0000","last_peered":"2023-12-15T23:56:20.342347+0000","last_clean":"2023-12-15T23:56:20.342347+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-15T23:56:20.342347+0000","last_undegraded":"2023-12-15T23:56:20.342347+0000","last_fullsized":"2023-12-15T23:56:20.342347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:27.749157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'777","reported_seq":2399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341074+0000","last_change":"2023-12-15T22:53:28.168322+0000","last_active":"2023-12-15T23:56:20.341074+0000","last_peered":"2023-12-15T23:56:20.341074+0000","last_clean":"2023-12-15T23:56:20.341074+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-15T23:56:20.341074+0000","last_undegraded":"2023-12-15T23:56:20.341074+0000","last_fullsized":"2023-12-15T23:56:20.341074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588660+0000","last_change":"2023-12-15T22:53:26.160880+0000","last_active":"2023-12-15T23:58:00.588660+0000","last_peered":"2023-12-15T23:58:00.588660+0000","last_clean":"2023-12-15T23:58:00.588660+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-15T23:58:00.588660+0000","last_undegraded":"2023-12-15T23:58:00.588660+0000","last_fullsized":"2023-12-15T23:58:00.588660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356180+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-15T23:57:56.356180+0000","last_peered":"2023-12-15T23:57:56.356180+0000","last_clean":"2023-12-15T23:57:56.356180+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-15T23:57:56.356180+0000","last_undegraded":"2023-12-15T23:57:56.356180+0000","last_fullsized":"2023-12-15T23:57:56.356180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359022+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-15T23:58:05.359022+0000","last_peered":"2023-12-15T23:58:05.359022+0000","last_clean":"2023-12-15T23:58:05.359022+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-15T23:58:05.359022+0000","last_undegraded":"2023-12-15T23:58:05.359022+0000","last_fullsized":"2023-12-15T23:58:05.359022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:29.645708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560345+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-15T23:56:10.560345+0000","last_peered":"2023-12-15T23:56:10.560345+0000","last_clean":"2023-12-15T23:56:10.560345+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-15T23:56:10.560345+0000","last_undegraded":"2023-12-15T23:56:10.560345+0000","last_fullsized":"2023-12-15T23:56:10.560345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:55.500999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333744+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-15T23:56:15.333744+0000","last_peered":"2023-12-15T23:56:15.333744+0000","last_clean":"2023-12-15T23:56:15.333744+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-15T23:56:15.333744+0000","last_undegraded":"2023-12-15T23:56:15.333744+0000","last_fullsized":"2023-12-15T23:56:15.333744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:51.409885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357884+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-15T23:58:01.357884+0000","last_peered":"2023-12-15T23:58:01.357884+0000","last_clean":"2023-12-15T23:58:01.357884+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-15T23:58:01.357884+0000","last_undegraded":"2023-12-15T23:58:01.357884+0000","last_fullsized":"2023-12-15T23:58:01.357884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:39.186844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344266+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-15T23:56:35.344266+0000","last_peered":"2023-12-15T23:56:35.344266+0000","last_clean":"2023-12-15T23:56:35.344266+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-15T23:56:35.344266+0000","last_undegraded":"2023-12-15T23:56:35.344266+0000","last_fullsized":"2023-12-15T23:56:35.344266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:46.912902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1650,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.362356+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-15T23:58:20.362356+0000","last_peered":"2023-12-15T23:58:20.362356+0000","last_clean":"2023-12-15T23:58:20.362356+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-15T23:58:20.362356+0000","last_undegraded":"2023-12-15T23:58:20.362356+0000","last_fullsized":"2023-12-15T23:58:20.362356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:55.411932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344494+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-15T23:56:30.344494+0000","last_peered":"2023-12-15T23:56:30.344494+0000","last_clean":"2023-12-15T23:56:30.344494+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-15T23:56:30.344494+0000","last_undegraded":"2023-12-15T23:56:30.344494+0000","last_fullsized":"2023-12-15T23:56:30.344494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369737+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-15T23:58:10.369737+0000","last_peered":"2023-12-15T23:58:10.369737+0000","last_clean":"2023-12-15T23:58:10.369737+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-15T23:58:10.369737+0000","last_undegraded":"2023-12-15T23:58:10.369737+0000","last_fullsized":"2023-12-15T23:58:10.369737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331874+0000","last_change":"2023-12-15T22:53:30.176469+0000","last_active":"2023-12-15T23:56:16.331874+0000","last_peered":"2023-12-15T23:56:16.331874+0000","last_clean":"2023-12-15T23:56:16.331874+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-15T23:56:16.331874+0000","last_undegraded":"2023-12-15T23:56:16.331874+0000","last_fullsized":"2023-12-15T23:56:16.331874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:01.243566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.369293+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-15T23:58:05.369293+0000","last_peered":"2023-12-15T23:58:05.369293+0000","last_clean":"2023-12-15T23:58:05.369293+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-15T23:58:05.369293+0000","last_undegraded":"2023-12-15T23:58:05.369293+0000","last_fullsized":"2023-12-15T23:58:05.369293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'5","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340715+0000","last_change":"2023-12-15T22:53:26.163456+0000","last_active":"2023-12-15T23:56:15.340715+0000","last_peered":"2023-12-15T23:56:15.340715+0000","last_clean":"2023-12-15T23:56:15.340715+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-15T23:56:15.340715+0000","last_undegraded":"2023-12-15T23:56:15.340715+0000","last_fullsized":"2023-12-15T23:56:15.340715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368939+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-15T23:58:10.368939+0000","last_peered":"2023-12-15T23:58:10.368939+0000","last_clean":"2023-12-15T23:58:10.368939+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-15T23:58:10.368939+0000","last_undegraded":"2023-12-15T23:58:10.368939+0000","last_fullsized":"2023-12-15T23:58:10.368939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334578+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-15T23:55:55.334578+0000","last_peered":"2023-12-15T23:55:55.334578+0000","last_clean":"2023-12-15T23:55:55.334578+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-15T23:55:55.334578+0000","last_undegraded":"2023-12-15T23:55:55.334578+0000","last_fullsized":"2023-12-15T23:55:55.334578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:22.502479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331481+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-15T23:56:05.331481+0000","last_peered":"2023-12-15T23:56:05.331481+0000","last_clean":"2023-12-15T23:56:05.331481+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-15T23:56:05.331481+0000","last_undegraded":"2023-12-15T23:56:05.331481+0000","last_fullsized":"2023-12-15T23:56:05.331481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:58.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369516+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-15T23:58:10.369516+0000","last_peered":"2023-12-15T23:58:10.369516+0000","last_clean":"2023-12-15T23:58:10.369516+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-15T23:58:10.369516+0000","last_undegraded":"2023-12-15T23:58:10.369516+0000","last_fullsized":"2023-12-15T23:58:10.369516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370384+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-15T23:58:10.370384+0000","last_peered":"2023-12-15T23:58:10.370384+0000","last_clean":"2023-12-15T23:58:10.370384+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-15T23:58:10.370384+0000","last_undegraded":"2023-12-15T23:58:10.370384+0000","last_fullsized":"2023-12-15T23:58:10.370384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370814+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-15T23:58:10.370814+0000","last_peered":"2023-12-15T23:58:10.370814+0000","last_clean":"2023-12-15T23:58:10.370814+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-15T23:58:10.370814+0000","last_undegraded":"2023-12-15T23:58:10.370814+0000","last_fullsized":"2023-12-15T23:58:10.370814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:21.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341847+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-15T23:56:50.341847+0000","last_peered":"2023-12-15T23:56:50.341847+0000","last_clean":"2023-12-15T23:56:50.341847+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-15T23:56:50.341847+0000","last_undegraded":"2023-12-15T23:56:50.341847+0000","last_fullsized":"2023-12-15T23:56:50.341847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:13:08.808826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566493+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-15T23:56:35.566493+0000","last_peered":"2023-12-15T23:56:35.566493+0000","last_clean":"2023-12-15T23:56:35.566493+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-15T23:56:35.566493+0000","last_undegraded":"2023-12-15T23:56:35.566493+0000","last_fullsized":"2023-12-15T23:56:35.566493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:11.823256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344162+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-15T23:56:30.344162+0000","last_peered":"2023-12-15T23:56:30.344162+0000","last_clean":"2023-12-15T23:56:30.344162+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-15T23:56:30.344162+0000","last_undegraded":"2023-12-15T23:56:30.344162+0000","last_fullsized":"2023-12-15T23:56:30.344162+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:26.339363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370477+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-15T23:58:10.370477+0000","last_peered":"2023-12-15T23:58:10.370477+0000","last_clean":"2023-12-15T23:58:10.370477+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-15T23:58:10.370477+0000","last_undegraded":"2023-12-15T23:58:10.370477+0000","last_fullsized":"2023-12-15T23:58:10.370477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:31.522105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367802+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-15T23:58:05.367802+0000","last_peered":"2023-12-15T23:58:05.367802+0000","last_clean":"2023-12-15T23:58:05.367802+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-15T23:58:05.367802+0000","last_undegraded":"2023-12-15T23:58:05.367802+0000","last_fullsized":"2023-12-15T23:58:05.367802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:58.411627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1652","reported_seq":2674,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333978+0000","last_change":"2023-12-15T22:53:28.166989+0000","last_active":"2023-12-15T23:56:15.333978+0000","last_peered":"2023-12-15T23:56:15.333978+0000","last_clean":"2023-12-15T23:56:15.333978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-15T23:56:15.333978+0000","last_undegraded":"2023-12-15T23:56:15.333978+0000","last_fullsized":"2023-12-15T23:56:15.333978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:18.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340671+0000","last_change":"2023-12-15T22:53:26.163111+0000","last_active":"2023-12-15T23:56:15.340671+0000","last_peered":"2023-12-15T23:56:15.340671+0000","last_clean":"2023-12-15T23:56:15.340671+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-15T23:56:15.340671+0000","last_undegraded":"2023-12-15T23:56:15.340671+0000","last_fullsized":"2023-12-15T23:56:15.340671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335797+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-15T23:55:55.335797+0000","last_peered":"2023-12-15T23:55:55.335797+0000","last_clean":"2023-12-15T23:55:55.335797+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-15T23:55:55.335797+0000","last_undegraded":"2023-12-15T23:55:55.335797+0000","last_fullsized":"2023-12-15T23:55:55.335797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335758+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-15T23:55:55.335758+0000","last_peered":"2023-12-15T23:55:55.335758+0000","last_clean":"2023-12-15T23:55:55.335758+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-15T23:55:55.335758+0000","last_undegraded":"2023-12-15T23:55:55.335758+0000","last_fullsized":"2023-12-15T23:55:55.335758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332486+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-15T23:56:10.332486+0000","last_peered":"2023-12-15T23:56:10.332486+0000","last_clean":"2023-12-15T23:56:10.332486+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-15T23:56:10.332486+0000","last_undegraded":"2023-12-15T23:56:10.332486+0000","last_fullsized":"2023-12-15T23:56:10.332486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:12:03.582433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370332+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-15T23:58:10.370332+0000","last_peered":"2023-12-15T23:58:10.370332+0000","last_clean":"2023-12-15T23:58:10.370332+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-15T23:58:10.370332+0000","last_undegraded":"2023-12-15T23:58:10.370332+0000","last_fullsized":"2023-12-15T23:58:10.370332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360212+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-15T23:58:10.360212+0000","last_peered":"2023-12-15T23:58:10.360212+0000","last_clean":"2023-12-15T23:58:10.360212+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-15T23:58:10.360212+0000","last_undegraded":"2023-12-15T23:58:10.360212+0000","last_fullsized":"2023-12-15T23:58:10.360212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:59.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591341+0000","last_change":"2023-12-15T22:53:10.340508+0000","last_active":"2023-12-15T23:58:10.591341+0000","last_peered":"2023-12-15T23:58:10.591341+0000","last_clean":"2023-12-15T23:58:10.591341+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-15T23:58:10.591341+0000","last_undegraded":"2023-12-15T23:58:10.591341+0000","last_fullsized":"2023-12-15T23:58:10.591341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:57.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.563036+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-15T23:56:20.563036+0000","last_peered":"2023-12-15T23:56:20.563036+0000","last_clean":"2023-12-15T23:56:20.563036+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-15T23:56:20.563036+0000","last_undegraded":"2023-12-15T23:56:20.563036+0000","last_fullsized":"2023-12-15T23:56:20.563036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:04:25.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3530,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.351010+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:56:55.351010+0000","last_peered":"2023-12-15T23:56:55.351010+0000","last_clean":"2023-12-15T23:56:55.351010+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:56:55.351010+0000","last_undegraded":"2023-12-15T23:56:55.351010+0000","last_fullsized":"2023-12-15T23:56:55.351010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:09.097073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:46.338997+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-15T23:56:46.338997+0000","last_peered":"2023-12-15T23:56:46.338997+0000","last_clean":"2023-12-15T23:56:46.338997+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-15T23:56:46.338997+0000","last_undegraded":"2023-12-15T23:56:46.338997+0000","last_fullsized":"2023-12-15T23:56:46.338997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:50.579490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369071+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-15T23:58:10.369071+0000","last_peered":"2023-12-15T23:58:10.369071+0000","last_clean":"2023-12-15T23:58:10.369071+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-15T23:58:10.369071+0000","last_undegraded":"2023-12-15T23:58:10.369071+0000","last_fullsized":"2023-12-15T23:58:10.369071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:23.414022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368432+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-15T23:58:05.368432+0000","last_peered":"2023-12-15T23:58:05.368432+0000","last_clean":"2023-12-15T23:58:05.368432+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-15T23:58:05.368432+0000","last_undegraded":"2023-12-15T23:58:05.368432+0000","last_fullsized":"2023-12-15T23:58:05.368432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:01:44.643639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.589587+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-15T23:58:05.589587+0000","last_peered":"2023-12-15T23:58:05.589587+0000","last_clean":"2023-12-15T23:58:05.589587+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-15T23:58:05.589587+0000","last_undegraded":"2023-12-15T23:58:05.589587+0000","last_fullsized":"2023-12-15T23:58:05.589587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.019947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'4","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367754+0000","last_change":"2023-12-15T22:53:26.165088+0000","last_active":"2023-12-15T23:58:00.367754+0000","last_peered":"2023-12-15T23:58:00.367754+0000","last_clean":"2023-12-15T23:58:00.367754+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-15T23:58:00.367754+0000","last_undegraded":"2023-12-15T23:58:00.367754+0000","last_fullsized":"2023-12-15T23:58:00.367754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:14.026739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326539+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-15T23:55:56.326539+0000","last_peered":"2023-12-15T23:55:56.326539+0000","last_clean":"2023-12-15T23:55:56.326539+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-15T23:55:56.326539+0000","last_undegraded":"2023-12-15T23:55:56.326539+0000","last_fullsized":"2023-12-15T23:55:56.326539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-15T23:55:55.556758+0000","last_peered":"2023-12-15T23:55:55.556758+0000","last_clean":"2023-12-15T23:55:55.556758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-15T23:55:55.556758+0000","last_undegraded":"2023-12-15T23:55:55.556758+0000","last_fullsized":"2023-12-15T23:55:55.556758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:17.629224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331590+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-15T23:56:05.331590+0000","last_peered":"2023-12-15T23:56:05.331590+0000","last_clean":"2023-12-15T23:56:05.331590+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-15T23:56:05.331590+0000","last_undegraded":"2023-12-15T23:56:05.331590+0000","last_fullsized":"2023-12-15T23:56:05.331590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:20.899928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.329372+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-15T23:56:06.329372+0000","last_peered":"2023-12-15T23:56:06.329372+0000","last_clean":"2023-12-15T23:56:06.329372+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-15T23:56:06.329372+0000","last_undegraded":"2023-12-15T23:56:06.329372+0000","last_fullsized":"2023-12-15T23:56:06.329372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:33.385736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343663+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-15T23:56:25.343663+0000","last_peered":"2023-12-15T23:56:25.343663+0000","last_clean":"2023-12-15T23:56:25.343663+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-15T23:56:25.343663+0000","last_undegraded":"2023-12-15T23:56:25.343663+0000","last_fullsized":"2023-12-15T23:56:25.343663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578335+0000","last_change":"2023-12-15T22:53:10.339820+0000","last_active":"2023-12-15T23:57:20.578335+0000","last_peered":"2023-12-15T23:57:20.578335+0000","last_clean":"2023-12-15T23:57:20.578335+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:57:20.578335+0000","last_undegraded":"2023-12-15T23:57:20.578335+0000","last_fullsized":"2023-12-15T23:57:20.578335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:16.322332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342330+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-15T23:56:20.342330+0000","last_peered":"2023-12-15T23:56:20.342330+0000","last_clean":"2023-12-15T23:56:20.342330+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-15T23:56:20.342330+0000","last_undegraded":"2023-12-15T23:56:20.342330+0000","last_fullsized":"2023-12-15T23:56:20.342330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:25.701757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":884,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350904+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:56:55.350904+0000","last_peered":"2023-12-15T23:56:55.350904+0000","last_clean":"2023-12-15T23:56:55.350904+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:56:55.350904+0000","last_undegraded":"2023-12-15T23:56:55.350904+0000","last_fullsized":"2023-12-15T23:56:55.350904+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:19.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344331+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-15T23:56:30.344331+0000","last_peered":"2023-12-15T23:56:30.344331+0000","last_clean":"2023-12-15T23:56:30.344331+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-15T23:56:30.344331+0000","last_undegraded":"2023-12-15T23:56:30.344331+0000","last_fullsized":"2023-12-15T23:56:30.344331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:35.691834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340903+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-15T23:56:20.340903+0000","last_peered":"2023-12-15T23:56:20.340903+0000","last_clean":"2023-12-15T23:56:20.340903+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-15T23:56:20.340903+0000","last_undegraded":"2023-12-15T23:56:20.340903+0000","last_fullsized":"2023-12-15T23:56:20.340903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359147+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-15T23:58:05.359147+0000","last_peered":"2023-12-15T23:58:05.359147+0000","last_clean":"2023-12-15T23:58:05.359147+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-15T23:58:05.359147+0000","last_undegraded":"2023-12-15T23:58:05.359147+0000","last_fullsized":"2023-12-15T23:58:05.359147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:43.704505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'434","reported_seq":826,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359244+0000","last_change":"2023-12-15T22:53:28.165130+0000","last_active":"2023-12-15T23:58:05.359244+0000","last_peered":"2023-12-15T23:58:05.359244+0000","last_clean":"2023-12-15T23:58:05.359244+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-15T23:58:05.359244+0000","last_undegraded":"2023-12-15T23:58:05.359244+0000","last_fullsized":"2023-12-15T23:58:05.359244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:09.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.581910+0000","last_change":"2023-12-15T22:53:26.156795+0000","last_active":"2023-12-15T23:57:35.581910+0000","last_peered":"2023-12-15T23:57:35.581910+0000","last_clean":"2023-12-15T23:57:35.581910+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-15T23:57:35.581910+0000","last_undegraded":"2023-12-15T23:57:35.581910+0000","last_fullsized":"2023-12-15T23:57:35.581910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:29.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334631+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-15T23:55:55.334631+0000","last_peered":"2023-12-15T23:55:55.334631+0000","last_clean":"2023-12-15T23:55:55.334631+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-15T23:55:55.334631+0000","last_undegraded":"2023-12-15T23:55:55.334631+0000","last_fullsized":"2023-12-15T23:55:55.334631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:44.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369701+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-15T23:58:10.369701+0000","last_peered":"2023-12-15T23:58:10.369701+0000","last_clean":"2023-12-15T23:58:10.369701+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-15T23:58:10.369701+0000","last_undegraded":"2023-12-15T23:58:10.369701+0000","last_fullsized":"2023-12-15T23:58:10.369701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559219+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-15T23:56:05.559219+0000","last_peered":"2023-12-15T23:56:05.559219+0000","last_clean":"2023-12-15T23:56:05.559219+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-15T23:56:05.559219+0000","last_undegraded":"2023-12-15T23:56:05.559219+0000","last_fullsized":"2023-12-15T23:56:05.559219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:55.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336323+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-15T23:56:25.336323+0000","last_peered":"2023-12-15T23:56:25.336323+0000","last_clean":"2023-12-15T23:56:25.336323+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-15T23:56:25.336323+0000","last_undegraded":"2023-12-15T23:56:25.336323+0000","last_fullsized":"2023-12-15T23:56:25.336323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:58.115309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332781+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-15T23:56:10.332781+0000","last_peered":"2023-12-15T23:56:10.332781+0000","last_clean":"2023-12-15T23:56:10.332781+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-15T23:56:10.332781+0000","last_undegraded":"2023-12-15T23:56:10.332781+0000","last_fullsized":"2023-12-15T23:56:10.332781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:11.050275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584443+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:57:45.584443+0000","last_peered":"2023-12-15T23:57:45.584443+0000","last_clean":"2023-12-15T23:57:45.584443+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:57:45.584443+0000","last_undegraded":"2023-12-15T23:57:45.584443+0000","last_fullsized":"2023-12-15T23:57:45.584443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347388+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-15T23:56:45.347388+0000","last_peered":"2023-12-15T23:56:45.347388+0000","last_clean":"2023-12-15T23:56:45.347388+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-15T23:56:45.347388+0000","last_undegraded":"2023-12-15T23:56:45.347388+0000","last_fullsized":"2023-12-15T23:56:45.347388+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:15.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3437,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344672+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-15T23:56:35.344672+0000","last_peered":"2023-12-15T23:56:35.344672+0000","last_clean":"2023-12-15T23:56:35.344672+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-15T23:56:35.344672+0000","last_undegraded":"2023-12-15T23:56:35.344672+0000","last_fullsized":"2023-12-15T23:56:35.344672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:27:53.377560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348840+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:56:50.348840+0000","last_peered":"2023-12-15T23:56:50.348840+0000","last_clean":"2023-12-15T23:56:50.348840+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:56:50.348840+0000","last_undegraded":"2023-12-15T23:56:50.348840+0000","last_fullsized":"2023-12-15T23:56:50.348840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:13.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564275+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-15T23:56:25.564275+0000","last_peered":"2023-12-15T23:56:25.564275+0000","last_clean":"2023-12-15T23:56:25.564275+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-15T23:56:25.564275+0000","last_undegraded":"2023-12-15T23:56:25.564275+0000","last_fullsized":"2023-12-15T23:56:25.564275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:39.121105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358717+0000","last_change":"2023-12-15T22:53:30.183489+0000","last_active":"2023-12-15T23:58:06.358717+0000","last_peered":"2023-12-15T23:58:06.358717+0000","last_clean":"2023-12-15T23:58:06.358717+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-15T23:58:06.358717+0000","last_undegraded":"2023-12-15T23:58:06.358717+0000","last_fullsized":"2023-12-15T23:58:06.358717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:04.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'594","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362425+0000","last_change":"2023-12-15T22:53:28.166896+0000","last_active":"2023-12-15T23:57:45.362425+0000","last_peered":"2023-12-15T23:57:45.362425+0000","last_clean":"2023-12-15T23:57:45.362425+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-15T23:57:45.362425+0000","last_undegraded":"2023-12-15T23:57:45.362425+0000","last_fullsized":"2023-12-15T23:57:45.362425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:28.124124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367047+0000","last_change":"2023-12-15T22:53:26.161720+0000","last_active":"2023-12-15T23:58:00.367047+0000","last_peered":"2023-12-15T23:58:00.367047+0000","last_clean":"2023-12-15T23:58:00.367047+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-15T23:58:00.367047+0000","last_undegraded":"2023-12-15T23:58:00.367047+0000","last_fullsized":"2023-12-15T23:58:00.367047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:28.010705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326742+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-15T23:55:56.326742+0000","last_peered":"2023-12-15T23:55:56.326742+0000","last_clean":"2023-12-15T23:55:56.326742+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-15T23:55:56.326742+0000","last_undegraded":"2023-12-15T23:55:56.326742+0000","last_fullsized":"2023-12-15T23:55:56.326742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356136+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-15T23:57:56.356136+0000","last_peered":"2023-12-15T23:57:56.356136+0000","last_clean":"2023-12-15T23:57:56.356136+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-15T23:57:56.356136+0000","last_undegraded":"2023-12-15T23:57:56.356136+0000","last_fullsized":"2023-12-15T23:57:56.356136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:38.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342283+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-15T23:56:20.342283+0000","last_peered":"2023-12-15T23:56:20.342283+0000","last_clean":"2023-12-15T23:56:20.342283+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-15T23:56:20.342283+0000","last_undegraded":"2023-12-15T23:56:20.342283+0000","last_fullsized":"2023-12-15T23:56:20.342283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560515+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-15T23:56:10.560515+0000","last_peered":"2023-12-15T23:56:10.560515+0000","last_clean":"2023-12-15T23:56:10.560515+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-15T23:56:10.560515+0000","last_undegraded":"2023-12-15T23:56:10.560515+0000","last_fullsized":"2023-12-15T23:56:10.560515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:40.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330607+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:56:11.330607+0000","last_peered":"2023-12-15T23:56:11.330607+0000","last_clean":"2023-12-15T23:56:11.330607+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-15T23:56:11.330607+0000","last_undegraded":"2023-12-15T23:56:11.330607+0000","last_fullsized":"2023-12-15T23:56:11.330607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:15.547530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353777+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:57:46.353777+0000","last_peered":"2023-12-15T23:57:46.353777+0000","last_clean":"2023-12-15T23:57:46.353777+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:57:46.353777+0000","last_undegraded":"2023-12-15T23:57:46.353777+0000","last_fullsized":"2023-12-15T23:57:46.353777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:08.837316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566821+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-15T23:56:35.566821+0000","last_peered":"2023-12-15T23:56:35.566821+0000","last_clean":"2023-12-15T23:56:35.566821+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-15T23:56:35.566821+0000","last_undegraded":"2023-12-15T23:56:35.566821+0000","last_fullsized":"2023-12-15T23:56:35.566821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1758,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349715+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-15T23:56:50.349715+0000","last_peered":"2023-12-15T23:56:50.349715+0000","last_clean":"2023-12-15T23:56:50.349715+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-15T23:56:50.349715+0000","last_undegraded":"2023-12-15T23:56:50.349715+0000","last_fullsized":"2023-12-15T23:56:50.349715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:20.444898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348796+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:56:50.348796+0000","last_peered":"2023-12-15T23:56:50.348796+0000","last_clean":"2023-12-15T23:56:50.348796+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:56:50.348796+0000","last_undegraded":"2023-12-15T23:56:50.348796+0000","last_fullsized":"2023-12-15T23:56:50.348796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564359+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-15T23:56:25.564359+0000","last_peered":"2023-12-15T23:56:25.564359+0000","last_clean":"2023-12-15T23:56:25.564359+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-15T23:56:25.564359+0000","last_undegraded":"2023-12-15T23:56:25.564359+0000","last_fullsized":"2023-12-15T23:56:25.564359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:49.839990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583014+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:57:40.583014+0000","last_peered":"2023-12-15T23:57:40.583014+0000","last_clean":"2023-12-15T23:57:40.583014+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:57:40.583014+0000","last_undegraded":"2023-12-15T23:57:40.583014+0000","last_fullsized":"2023-12-15T23:57:40.583014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:36.864485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'312","reported_seq":520,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358697+0000","last_change":"2023-12-15T22:53:28.170097+0000","last_active":"2023-12-15T23:58:06.358697+0000","last_peered":"2023-12-15T23:58:06.358697+0000","last_clean":"2023-12-15T23:58:06.358697+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-15T23:58:06.358697+0000","last_undegraded":"2023-12-15T23:58:06.358697+0000","last_fullsized":"2023-12-15T23:58:06.358697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:11.019249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588540+0000","last_change":"2023-12-15T22:53:26.164887+0000","last_active":"2023-12-15T23:58:00.588540+0000","last_peered":"2023-12-15T23:58:00.588540+0000","last_clean":"2023-12-15T23:58:00.588540+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-15T23:58:00.588540+0000","last_undegraded":"2023-12-15T23:58:00.588540+0000","last_fullsized":"2023-12-15T23:58:00.588540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559374+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-15T23:56:05.559374+0000","last_peered":"2023-12-15T23:56:05.559374+0000","last_clean":"2023-12-15T23:56:05.559374+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-15T23:56:05.559374+0000","last_undegraded":"2023-12-15T23:56:05.559374+0000","last_fullsized":"2023-12-15T23:56:05.559374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:12.885816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356568+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-15T23:57:55.356568+0000","last_peered":"2023-12-15T23:57:55.356568+0000","last_clean":"2023-12-15T23:57:55.356568+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-15T23:57:55.356568+0000","last_undegraded":"2023-12-15T23:57:55.356568+0000","last_fullsized":"2023-12-15T23:57:55.356568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:54.088870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337183+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-15T23:56:05.337183+0000","last_peered":"2023-12-15T23:56:05.337183+0000","last_clean":"2023-12-15T23:56:05.337183+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-15T23:56:05.337183+0000","last_undegraded":"2023-12-15T23:56:05.337183+0000","last_fullsized":"2023-12-15T23:56:05.337183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:53.490096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339396+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-15T23:56:10.339396+0000","last_peered":"2023-12-15T23:56:10.339396+0000","last_clean":"2023-12-15T23:56:10.339396+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-15T23:56:10.339396+0000","last_undegraded":"2023-12-15T23:56:10.339396+0000","last_fullsized":"2023-12-15T23:56:10.339396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338360+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-15T23:56:10.338360+0000","last_peered":"2023-12-15T23:56:10.338360+0000","last_clean":"2023-12-15T23:56:10.338360+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-15T23:56:10.338360+0000","last_undegraded":"2023-12-15T23:56:10.338360+0000","last_fullsized":"2023-12-15T23:56:10.338360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584565+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:57:45.584565+0000","last_peered":"2023-12-15T23:57:45.584565+0000","last_clean":"2023-12-15T23:57:45.584565+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:57:45.584565+0000","last_undegraded":"2023-12-15T23:57:45.584565+0000","last_fullsized":"2023-12-15T23:57:45.584565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328974+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-15T23:55:55.328974+0000","last_peered":"2023-12-15T23:55:55.328974+0000","last_clean":"2023-12-15T23:55:55.328974+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-15T23:55:55.328974+0000","last_undegraded":"2023-12-15T23:55:55.328974+0000","last_fullsized":"2023-12-15T23:55:55.328974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:54.535000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1478,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.348066+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:57:21.348066+0000","last_peered":"2023-12-15T23:57:21.348066+0000","last_clean":"2023-12-15T23:57:21.348066+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:57:21.348066+0000","last_undegraded":"2023-12-15T23:57:21.348066+0000","last_fullsized":"2023-12-15T23:57:21.348066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573493+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:57:00.573493+0000","last_peered":"2023-12-15T23:57:00.573493+0000","last_clean":"2023-12-15T23:57:00.573493+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:57:00.573493+0000","last_undegraded":"2023-12-15T23:57:00.573493+0000","last_fullsized":"2023-12-15T23:57:00.573493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:49.584218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335364+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-15T23:56:31.335364+0000","last_peered":"2023-12-15T23:56:31.335364+0000","last_clean":"2023-12-15T23:56:31.335364+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-15T23:56:31.335364+0000","last_undegraded":"2023-12-15T23:56:31.335364+0000","last_fullsized":"2023-12-15T23:56:31.335364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:32.141954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565261+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-15T23:56:30.565261+0000","last_peered":"2023-12-15T23:56:30.565261+0000","last_clean":"2023-12-15T23:56:30.565261+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-15T23:56:30.565261+0000","last_undegraded":"2023-12-15T23:56:30.565261+0000","last_fullsized":"2023-12-15T23:56:30.565261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:18.046986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2092","reported_seq":3430,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344301+0000","last_change":"2023-12-15T22:53:28.171130+0000","last_active":"2023-12-15T23:56:30.344301+0000","last_peered":"2023-12-15T23:56:30.344301+0000","last_clean":"2023-12-15T23:56:30.344301+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-15T23:56:30.344301+0000","last_undegraded":"2023-12-15T23:56:30.344301+0000","last_fullsized":"2023-12-15T23:56:30.344301+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":200,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:14.487255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333562+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-15T23:56:15.333562+0000","last_peered":"2023-12-15T23:56:15.333562+0000","last_clean":"2023-12-15T23:56:15.333562+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-15T23:56:15.333562+0000","last_undegraded":"2023-12-15T23:56:15.333562+0000","last_fullsized":"2023-12-15T23:56:15.333562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:57.767288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363413+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:57:45.363413+0000","last_peered":"2023-12-15T23:57:45.363413+0000","last_clean":"2023-12-15T23:57:45.363413+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:57:45.363413+0000","last_undegraded":"2023-12-15T23:57:45.363413+0000","last_fullsized":"2023-12-15T23:57:45.363413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:11.540042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341710+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T23:56:25.341710+0000","last_peered":"2023-12-15T23:56:25.341710+0000","last_clean":"2023-12-15T23:56:25.341710+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T23:56:25.341710+0000","last_undegraded":"2023-12-15T23:56:25.341710+0000","last_fullsized":"2023-12-15T23:56:25.341710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580881+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:57:30.580881+0000","last_peered":"2023-12-15T23:57:30.580881+0000","last_clean":"2023-12-15T23:57:30.580881+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:57:30.580881+0000","last_undegraded":"2023-12-15T23:57:30.580881+0000","last_fullsized":"2023-12-15T23:57:30.580881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:56.749823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352586+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:57:41.352586+0000","last_peered":"2023-12-15T23:57:41.352586+0000","last_clean":"2023-12-15T23:57:41.352586+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:57:41.352586+0000","last_undegraded":"2023-12-15T23:57:41.352586+0000","last_fullsized":"2023-12-15T23:57:41.352586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:47.389382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369432+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-15T23:58:10.369432+0000","last_peered":"2023-12-15T23:58:10.369432+0000","last_clean":"2023-12-15T23:58:10.369432+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-15T23:58:10.369432+0000","last_undegraded":"2023-12-15T23:58:10.369432+0000","last_fullsized":"2023-12-15T23:58:10.369432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370878+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-15T23:58:10.370878+0000","last_peered":"2023-12-15T23:58:10.370878+0000","last_clean":"2023-12-15T23:58:10.370878+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-15T23:58:10.370878+0000","last_undegraded":"2023-12-15T23:58:10.370878+0000","last_fullsized":"2023-12-15T23:58:10.370878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:37.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368841+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-15T23:58:10.368841+0000","last_peered":"2023-12-15T23:58:10.368841+0000","last_clean":"2023-12-15T23:58:10.368841+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-15T23:58:10.368841+0000","last_undegraded":"2023-12-15T23:58:10.368841+0000","last_fullsized":"2023-12-15T23:58:10.368841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337269+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-15T23:56:05.337269+0000","last_peered":"2023-12-15T23:56:05.337269+0000","last_clean":"2023-12-15T23:56:05.337269+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-15T23:56:05.337269+0000","last_undegraded":"2023-12-15T23:56:05.337269+0000","last_fullsized":"2023-12-15T23:56:05.337269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:33.993237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343972+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:57:06.343972+0000","last_peered":"2023-12-15T23:57:06.343972+0000","last_clean":"2023-12-15T23:57:06.343972+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:57:06.343972+0000","last_undegraded":"2023-12-15T23:57:06.343972+0000","last_fullsized":"2023-12-15T23:57:06.343972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:50:27.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342556+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:57:01.342556+0000","last_peered":"2023-12-15T23:57:01.342556+0000","last_clean":"2023-12-15T23:57:01.342556+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:57:01.342556+0000","last_undegraded":"2023-12-15T23:57:01.342556+0000","last_fullsized":"2023-12-15T23:57:01.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:20.406306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345788+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-15T23:56:35.345788+0000","last_peered":"2023-12-15T23:56:35.345788+0000","last_clean":"2023-12-15T23:56:35.345788+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-15T23:56:35.345788+0000","last_undegraded":"2023-12-15T23:56:35.345788+0000","last_fullsized":"2023-12-15T23:56:35.345788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:37.028220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337339+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-15T23:56:30.337339+0000","last_peered":"2023-12-15T23:56:30.337339+0000","last_clean":"2023-12-15T23:56:30.337339+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-15T23:56:30.337339+0000","last_undegraded":"2023-12-15T23:56:30.337339+0000","last_fullsized":"2023-12-15T23:56:30.337339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:45.660409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2321","reported_seq":3328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336494+0000","last_change":"2023-12-15T22:53:28.162922+0000","last_active":"2023-12-15T23:56:36.336494+0000","last_peered":"2023-12-15T23:56:36.336494+0000","last_clean":"2023-12-15T23:56:36.336494+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-15T23:56:36.336494+0000","last_undegraded":"2023-12-15T23:56:36.336494+0000","last_fullsized":"2023-12-15T23:56:36.336494+0000","mapping_epoch":35,"log_start":"54'600","ondisk_log_start":"54'600","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":600,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:41.693500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'16","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340575+0000","last_change":"2023-12-15T22:53:26.162291+0000","last_active":"2023-12-15T23:56:15.340575+0000","last_peered":"2023-12-15T23:56:15.340575+0000","last_clean":"2023-12-15T23:56:15.340575+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-15T23:56:15.340575+0000","last_undegraded":"2023-12-15T23:56:15.340575+0000","last_fullsized":"2023-12-15T23:56:15.340575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581125+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:57:30.581125+0000","last_peered":"2023-12-15T23:57:30.581125+0000","last_clean":"2023-12-15T23:57:30.581125+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:57:30.581125+0000","last_undegraded":"2023-12-15T23:57:30.581125+0000","last_fullsized":"2023-12-15T23:57:30.581125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346527+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T23:56:40.346527+0000","last_peered":"2023-12-15T23:56:40.346527+0000","last_clean":"2023-12-15T23:56:40.346527+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T23:56:40.346527+0000","last_undegraded":"2023-12-15T23:56:40.346527+0000","last_fullsized":"2023-12-15T23:56:40.346527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350078+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:57:31.350078+0000","last_peered":"2023-12-15T23:57:31.350078+0000","last_clean":"2023-12-15T23:57:31.350078+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:57:31.350078+0000","last_undegraded":"2023-12-15T23:57:31.350078+0000","last_fullsized":"2023-12-15T23:57:31.350078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366870+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-15T23:57:55.366870+0000","last_peered":"2023-12-15T23:57:55.366870+0000","last_clean":"2023-12-15T23:57:55.366870+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-15T23:57:55.366870+0000","last_undegraded":"2023-12-15T23:57:55.366870+0000","last_fullsized":"2023-12-15T23:57:55.366870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591256+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-15T23:58:10.591256+0000","last_peered":"2023-12-15T23:58:10.591256+0000","last_clean":"2023-12-15T23:58:10.591256+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-15T23:58:10.591256+0000","last_undegraded":"2023-12-15T23:58:10.591256+0000","last_fullsized":"2023-12-15T23:58:10.591256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:28.787967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370208+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-15T23:58:10.370208+0000","last_peered":"2023-12-15T23:58:10.370208+0000","last_clean":"2023-12-15T23:58:10.370208+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-15T23:58:10.370208+0000","last_undegraded":"2023-12-15T23:58:10.370208+0000","last_fullsized":"2023-12-15T23:58:10.370208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368784+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-15T23:58:10.368784+0000","last_peered":"2023-12-15T23:58:10.368784+0000","last_clean":"2023-12-15T23:58:10.368784+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-15T23:58:10.368784+0000","last_undegraded":"2023-12-15T23:58:10.368784+0000","last_fullsized":"2023-12-15T23:58:10.368784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335801+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-15T23:55:55.335801+0000","last_peered":"2023-12-15T23:55:55.335801+0000","last_clean":"2023-12-15T23:55:55.335801+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-15T23:55:55.335801+0000","last_undegraded":"2023-12-15T23:55:55.335801+0000","last_fullsized":"2023-12-15T23:55:55.335801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5993,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353259+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:57:05.353259+0000","last_peered":"2023-12-15T23:57:05.353259+0000","last_clean":"2023-12-15T23:57:05.353259+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:57:05.353259+0000","last_undegraded":"2023-12-15T23:57:05.353259+0000","last_fullsized":"2023-12-15T23:57:05.353259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:23.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352049+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:57:00.352049+0000","last_peered":"2023-12-15T23:57:00.352049+0000","last_clean":"2023-12-15T23:57:00.352049+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:57:00.352049+0000","last_undegraded":"2023-12-15T23:57:00.352049+0000","last_fullsized":"2023-12-15T23:57:00.352049+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:36:08.674603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348850+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:56:50.348850+0000","last_peered":"2023-12-15T23:56:50.348850+0000","last_clean":"2023-12-15T23:56:50.348850+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:56:50.348850+0000","last_undegraded":"2023-12-15T23:56:50.348850+0000","last_fullsized":"2023-12-15T23:56:50.348850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334718+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-15T23:56:20.334718+0000","last_peered":"2023-12-15T23:56:20.334718+0000","last_clean":"2023-12-15T23:56:20.334718+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-15T23:56:20.334718+0000","last_undegraded":"2023-12-15T23:56:20.334718+0000","last_fullsized":"2023-12-15T23:56:20.334718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:40.887941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1390,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340552+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-15T23:56:20.340552+0000","last_peered":"2023-12-15T23:56:20.340552+0000","last_clean":"2023-12-15T23:56:20.340552+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-15T23:56:20.340552+0000","last_undegraded":"2023-12-15T23:56:20.340552+0000","last_fullsized":"2023-12-15T23:56:20.340552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343101+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-15T23:56:30.343101+0000","last_peered":"2023-12-15T23:56:30.343101+0000","last_clean":"2023-12-15T23:56:30.343101+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-15T23:56:30.343101+0000","last_undegraded":"2023-12-15T23:56:30.343101+0000","last_fullsized":"2023-12-15T23:56:30.343101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587693+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-15T23:57:55.587693+0000","last_peered":"2023-12-15T23:57:55.587693+0000","last_clean":"2023-12-15T23:57:55.587693+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-15T23:57:55.587693+0000","last_undegraded":"2023-12-15T23:57:55.587693+0000","last_fullsized":"2023-12-15T23:57:55.587693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337673+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T23:56:41.337673+0000","last_peered":"2023-12-15T23:56:41.337673+0000","last_clean":"2023-12-15T23:56:41.337673+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T23:56:41.337673+0000","last_undegraded":"2023-12-15T23:56:41.337673+0000","last_fullsized":"2023-12-15T23:56:41.337673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574363+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-15T23:57:05.574363+0000","last_peered":"2023-12-15T23:57:05.574363+0000","last_clean":"2023-12-15T23:57:05.574363+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-15T23:57:05.574363+0000","last_undegraded":"2023-12-15T23:57:05.574363+0000","last_fullsized":"2023-12-15T23:57:05.574363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359390+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-15T23:58:05.359390+0000","last_peered":"2023-12-15T23:58:05.359390+0000","last_clean":"2023-12-15T23:58:05.359390+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-15T23:58:05.359390+0000","last_undegraded":"2023-12-15T23:58:05.359390+0000","last_fullsized":"2023-12-15T23:58:05.359390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:36.759210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366654+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-15T23:58:00.366654+0000","last_peered":"2023-12-15T23:58:00.366654+0000","last_clean":"2023-12-15T23:58:00.366654+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-15T23:58:00.366654+0000","last_undegraded":"2023-12-15T23:58:00.366654+0000","last_fullsized":"2023-12-15T23:58:00.366654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363798+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:57:45.363798+0000","last_peered":"2023-12-15T23:57:45.363798+0000","last_clean":"2023-12-15T23:57:45.363798+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:57:45.363798+0000","last_undegraded":"2023-12-15T23:57:45.363798+0000","last_fullsized":"2023-12-15T23:57:45.363798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339569+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-15T23:56:10.339569+0000","last_peered":"2023-12-15T23:56:10.339569+0000","last_clean":"2023-12-15T23:56:10.339569+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-15T23:56:10.339569+0000","last_undegraded":"2023-12-15T23:56:10.339569+0000","last_fullsized":"2023-12-15T23:56:10.339569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:53.998326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326673+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-15T23:55:56.326673+0000","last_peered":"2023-12-15T23:55:56.326673+0000","last_clean":"2023-12-15T23:55:56.326673+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-15T23:55:56.326673+0000","last_undegraded":"2023-12-15T23:55:56.326673+0000","last_fullsized":"2023-12-15T23:55:56.326673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353438+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:57:05.353438+0000","last_peered":"2023-12-15T23:57:05.353438+0000","last_clean":"2023-12-15T23:57:05.353438+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:57:05.353438+0000","last_undegraded":"2023-12-15T23:57:05.353438+0000","last_fullsized":"2023-12-15T23:57:05.353438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:39.905516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.355945+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:57:15.355945+0000","last_peered":"2023-12-15T23:57:15.355945+0000","last_clean":"2023-12-15T23:57:15.355945+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:57:15.355945+0000","last_undegraded":"2023-12-15T23:57:15.355945+0000","last_fullsized":"2023-12-15T23:57:15.355945+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:17:26.396448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346010+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-15T23:56:35.346010+0000","last_peered":"2023-12-15T23:56:35.346010+0000","last_clean":"2023-12-15T23:56:35.346010+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-15T23:56:35.346010+0000","last_undegraded":"2023-12-15T23:56:35.346010+0000","last_fullsized":"2023-12-15T23:56:35.346010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:50.734122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1463,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334847+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-15T23:56:20.334847+0000","last_peered":"2023-12-15T23:56:20.334847+0000","last_clean":"2023-12-15T23:56:20.334847+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-15T23:56:20.334847+0000","last_undegraded":"2023-12-15T23:56:20.334847+0000","last_fullsized":"2023-12-15T23:56:20.334847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:01.265927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":521,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341886+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-15T23:56:20.341886+0000","last_peered":"2023-12-15T23:56:20.341886+0000","last_clean":"2023-12-15T23:56:20.341886+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-15T23:56:20.341886+0000","last_undegraded":"2023-12-15T23:56:20.341886+0000","last_fullsized":"2023-12-15T23:56:20.341886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'7","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343353+0000","last_change":"2023-12-15T22:53:26.161393+0000","last_active":"2023-12-15T23:56:25.343353+0000","last_peered":"2023-12-15T23:56:25.343353+0000","last_clean":"2023-12-15T23:56:25.343353+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-15T23:56:25.343353+0000","last_undegraded":"2023-12-15T23:56:25.343353+0000","last_fullsized":"2023-12-15T23:56:25.343353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366982+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-15T23:57:55.366982+0000","last_peered":"2023-12-15T23:57:55.366982+0000","last_clean":"2023-12-15T23:57:55.366982+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-15T23:57:55.366982+0000","last_undegraded":"2023-12-15T23:57:55.366982+0000","last_fullsized":"2023-12-15T23:57:55.366982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569523+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T23:56:45.569523+0000","last_peered":"2023-12-15T23:56:45.569523+0000","last_clean":"2023-12-15T23:56:45.569523+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T23:56:45.569523+0000","last_undegraded":"2023-12-15T23:56:45.569523+0000","last_fullsized":"2023-12-15T23:56:45.569523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341738+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T23:56:25.341738+0000","last_peered":"2023-12-15T23:56:25.341738+0000","last_clean":"2023-12-15T23:56:25.341738+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T23:56:25.341738+0000","last_undegraded":"2023-12-15T23:56:25.341738+0000","last_fullsized":"2023-12-15T23:56:25.341738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:48:45.986851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359720+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:57:30.359720+0000","last_peered":"2023-12-15T23:57:30.359720+0000","last_clean":"2023-12-15T23:57:30.359720+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:57:30.359720+0000","last_undegraded":"2023-12-15T23:57:30.359720+0000","last_fullsized":"2023-12-15T23:57:30.359720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368128+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-15T23:58:05.368128+0000","last_peered":"2023-12-15T23:58:05.368128+0000","last_clean":"2023-12-15T23:58:05.368128+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-15T23:58:05.368128+0000","last_undegraded":"2023-12-15T23:58:05.368128+0000","last_fullsized":"2023-12-15T23:58:05.368128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":970,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584747+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:57:45.584747+0000","last_peered":"2023-12-15T23:57:45.584747+0000","last_clean":"2023-12-15T23:57:45.584747+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:57:45.584747+0000","last_undegraded":"2023-12-15T23:57:45.584747+0000","last_fullsized":"2023-12-15T23:57:45.584747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:13.537930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357868+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:58:01.357868+0000","last_peered":"2023-12-15T23:58:01.357868+0000","last_clean":"2023-12-15T23:58:01.357868+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-15T23:58:01.357868+0000","last_undegraded":"2023-12-15T23:58:01.357868+0000","last_fullsized":"2023-12-15T23:58:01.357868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:57.510599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560276+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-15T23:56:10.560276+0000","last_peered":"2023-12-15T23:56:10.560276+0000","last_clean":"2023-12-15T23:56:10.560276+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-15T23:56:10.560276+0000","last_undegraded":"2023-12-15T23:56:10.560276+0000","last_fullsized":"2023-12-15T23:56:10.560276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337286+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-15T23:56:30.337286+0000","last_peered":"2023-12-15T23:56:30.337286+0000","last_clean":"2023-12-15T23:56:30.337286+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-15T23:56:30.337286+0000","last_undegraded":"2023-12-15T23:56:30.337286+0000","last_fullsized":"2023-12-15T23:56:30.337286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:38.545968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1255,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353261+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:57:05.353261+0000","last_peered":"2023-12-15T23:57:05.353261+0000","last_clean":"2023-12-15T23:57:05.353261+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:57:05.353261+0000","last_undegraded":"2023-12-15T23:57:05.353261+0000","last_fullsized":"2023-12-15T23:57:05.353261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341816+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:56:50.341816+0000","last_peered":"2023-12-15T23:56:50.341816+0000","last_clean":"2023-12-15T23:56:50.341816+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:56:50.341816+0000","last_undegraded":"2023-12-15T23:56:50.341816+0000","last_fullsized":"2023-12-15T23:56:50.341816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:46.037392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335881+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-15T23:56:25.335881+0000","last_peered":"2023-12-15T23:56:25.335881+0000","last_clean":"2023-12-15T23:56:25.335881+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-15T23:56:25.335881+0000","last_undegraded":"2023-12-15T23:56:25.335881+0000","last_fullsized":"2023-12-15T23:56:25.335881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:44.899079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'576","reported_seq":1445,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335444+0000","last_change":"2023-12-15T22:53:30.181085+0000","last_active":"2023-12-15T23:56:31.335444+0000","last_peered":"2023-12-15T23:56:31.335444+0000","last_clean":"2023-12-15T23:56:31.335444+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-15T23:56:31.335444+0000","last_undegraded":"2023-12-15T23:56:31.335444+0000","last_fullsized":"2023-12-15T23:56:31.335444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:42.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347586+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:56:45.347586+0000","last_peered":"2023-12-15T23:56:45.347586+0000","last_clean":"2023-12-15T23:56:45.347586+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:56:45.347586+0000","last_undegraded":"2023-12-15T23:56:45.347586+0000","last_fullsized":"2023-12-15T23:56:45.347586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:45.822160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336158+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-15T23:56:25.336158+0000","last_peered":"2023-12-15T23:56:25.336158+0000","last_clean":"2023-12-15T23:56:25.336158+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-15T23:56:25.336158+0000","last_undegraded":"2023-12-15T23:56:25.336158+0000","last_fullsized":"2023-12-15T23:56:25.336158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:41.864051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349876+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:57:31.349876+0000","last_peered":"2023-12-15T23:57:31.349876+0000","last_clean":"2023-12-15T23:57:31.349876+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:57:31.349876+0000","last_undegraded":"2023-12-15T23:57:31.349876+0000","last_fullsized":"2023-12-15T23:57:31.349876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366959+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-15T23:57:55.366959+0000","last_peered":"2023-12-15T23:57:55.366959+0000","last_clean":"2023-12-15T23:57:55.366959+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-15T23:57:55.366959+0000","last_undegraded":"2023-12-15T23:57:55.366959+0000","last_fullsized":"2023-12-15T23:57:55.366959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569612+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T23:56:45.569612+0000","last_peered":"2023-12-15T23:56:45.569612+0000","last_clean":"2023-12-15T23:56:45.569612+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T23:56:45.569612+0000","last_undegraded":"2023-12-15T23:56:45.569612+0000","last_fullsized":"2023-12-15T23:56:45.569612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.348824+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:57:20.348824+0000","last_peered":"2023-12-15T23:57:20.348824+0000","last_clean":"2023-12-15T23:57:20.348824+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:57:20.348824+0000","last_undegraded":"2023-12-15T23:57:20.348824+0000","last_fullsized":"2023-12-15T23:57:20.348824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:37.068698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352526+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:57:41.352526+0000","last_peered":"2023-12-15T23:57:41.352526+0000","last_clean":"2023-12-15T23:57:41.352526+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:57:41.352526+0000","last_undegraded":"2023-12-15T23:57:41.352526+0000","last_fullsized":"2023-12-15T23:57:41.352526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:38.074008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354579+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:57:45.354579+0000","last_peered":"2023-12-15T23:57:45.354579+0000","last_clean":"2023-12-15T23:57:45.354579+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:57:45.354579+0000","last_undegraded":"2023-12-15T23:57:45.354579+0000","last_fullsized":"2023-12-15T23:57:45.354579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:35.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339408+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-15T23:56:10.339408+0000","last_peered":"2023-12-15T23:56:10.339408+0000","last_clean":"2023-12-15T23:56:10.339408+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-15T23:56:10.339408+0000","last_undegraded":"2023-12-15T23:56:10.339408+0000","last_fullsized":"2023-12-15T23:56:10.339408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328762+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-15T23:55:55.328762+0000","last_peered":"2023-12-15T23:55:55.328762+0000","last_clean":"2023-12-15T23:55:55.328762+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-15T23:55:55.328762+0000","last_undegraded":"2023-12-15T23:55:55.328762+0000","last_fullsized":"2023-12-15T23:55:55.328762+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:41.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5894,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.353685+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:57:10.353685+0000","last_peered":"2023-12-15T23:57:10.353685+0000","last_clean":"2023-12-15T23:57:10.353685+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:57:10.353685+0000","last_undegraded":"2023-12-15T23:57:10.353685+0000","last_fullsized":"2023-12-15T23:57:10.353685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:57.639999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349295+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:56:50.349295+0000","last_peered":"2023-12-15T23:56:50.349295+0000","last_clean":"2023-12-15T23:56:50.349295+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:56:50.349295+0000","last_undegraded":"2023-12-15T23:56:50.349295+0000","last_fullsized":"2023-12-15T23:56:50.349295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:50:12.433334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335752+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-15T23:56:25.335752+0000","last_peered":"2023-12-15T23:56:25.335752+0000","last_clean":"2023-12-15T23:56:25.335752+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-15T23:56:25.335752+0000","last_undegraded":"2023-12-15T23:56:25.335752+0000","last_fullsized":"2023-12-15T23:56:25.335752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:55.341702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347565+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:56:45.347565+0000","last_peered":"2023-12-15T23:56:45.347565+0000","last_clean":"2023-12-15T23:56:45.347565+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:56:45.347565+0000","last_undegraded":"2023-12-15T23:56:45.347565+0000","last_fullsized":"2023-12-15T23:56:45.347565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:03.373955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'451","reported_seq":701,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335456+0000","last_change":"2023-12-15T22:53:28.170119+0000","last_active":"2023-12-15T23:56:31.335456+0000","last_peered":"2023-12-15T23:56:31.335456+0000","last_clean":"2023-12-15T23:56:31.335456+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-15T23:56:31.335456+0000","last_undegraded":"2023-12-15T23:56:31.335456+0000","last_fullsized":"2023-12-15T23:56:31.335456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:59.254922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342140+0000","last_change":"2023-12-15T22:53:26.159502+0000","last_active":"2023-12-15T23:56:25.342140+0000","last_peered":"2023-12-15T23:56:25.342140+0000","last_clean":"2023-12-15T23:56:25.342140+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-15T23:56:25.342140+0000","last_undegraded":"2023-12-15T23:56:25.342140+0000","last_fullsized":"2023-12-15T23:56:25.342140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354345+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:57:10.354345+0000","last_peered":"2023-12-15T23:57:10.354345+0000","last_clean":"2023-12-15T23:57:10.354345+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:57:10.354345+0000","last_undegraded":"2023-12-15T23:57:10.354345+0000","last_fullsized":"2023-12-15T23:57:10.354345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357070+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-15T23:57:55.357070+0000","last_peered":"2023-12-15T23:57:55.357070+0000","last_clean":"2023-12-15T23:57:55.357070+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-15T23:57:55.357070+0000","last_undegraded":"2023-12-15T23:57:55.357070+0000","last_fullsized":"2023-12-15T23:57:55.357070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:39.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342609+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:57:01.342609+0000","last_peered":"2023-12-15T23:57:01.342609+0000","last_clean":"2023-12-15T23:57:01.342609+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:57:01.342609+0000","last_undegraded":"2023-12-15T23:57:01.342609+0000","last_fullsized":"2023-12-15T23:57:01.342609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361757+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:57:40.361757+0000","last_peered":"2023-12-15T23:57:40.361757+0000","last_clean":"2023-12-15T23:57:40.361757+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:57:40.361757+0000","last_undegraded":"2023-12-15T23:57:40.361757+0000","last_fullsized":"2023-12-15T23:57:40.361757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:05.440726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363199+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:57:45.363199+0000","last_peered":"2023-12-15T23:57:45.363199+0000","last_clean":"2023-12-15T23:57:45.363199+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:57:45.363199+0000","last_undegraded":"2023-12-15T23:57:45.363199+0000","last_fullsized":"2023-12-15T23:57:45.363199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363708+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:57:45.363708+0000","last_peered":"2023-12-15T23:57:45.363708+0000","last_clean":"2023-12-15T23:57:45.363708+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:57:45.363708+0000","last_undegraded":"2023-12-15T23:57:45.363708+0000","last_fullsized":"2023-12-15T23:57:45.363708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339673+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-15T23:56:10.339673+0000","last_peered":"2023-12-15T23:56:10.339673+0000","last_clean":"2023-12-15T23:56:10.339673+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-15T23:56:10.339673+0000","last_undegraded":"2023-12-15T23:56:10.339673+0000","last_fullsized":"2023-12-15T23:56:10.339673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:23.866137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334729+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-15T23:56:20.334729+0000","last_peered":"2023-12-15T23:56:20.334729+0000","last_clean":"2023-12-15T23:56:20.334729+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-15T23:56:20.334729+0000","last_undegraded":"2023-12-15T23:56:20.334729+0000","last_fullsized":"2023-12-15T23:56:20.334729+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:44.091525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1396,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350460+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:56:55.350460+0000","last_peered":"2023-12-15T23:56:55.350460+0000","last_clean":"2023-12-15T23:56:55.350460+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:56:55.350460+0000","last_undegraded":"2023-12-15T23:56:55.350460+0000","last_fullsized":"2023-12-15T23:56:55.350460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:24.099749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345610+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:57:05.345610+0000","last_peered":"2023-12-15T23:57:05.345610+0000","last_clean":"2023-12-15T23:57:05.345610+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:57:05.345610+0000","last_undegraded":"2023-12-15T23:57:05.345610+0000","last_fullsized":"2023-12-15T23:57:05.345610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:44.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345642+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-15T23:56:35.345642+0000","last_peered":"2023-12-15T23:56:35.345642+0000","last_clean":"2023-12-15T23:56:35.345642+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-15T23:56:35.345642+0000","last_undegraded":"2023-12-15T23:56:35.345642+0000","last_fullsized":"2023-12-15T23:56:35.345642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:51.588416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565447+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-15T23:56:30.565447+0000","last_peered":"2023-12-15T23:56:30.565447+0000","last_clean":"2023-12-15T23:56:30.565447+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-15T23:56:30.565447+0000","last_undegraded":"2023-12-15T23:56:30.565447+0000","last_fullsized":"2023-12-15T23:56:30.565447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:16.498260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'508","reported_seq":744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335339+0000","last_change":"2023-12-15T22:53:28.169971+0000","last_active":"2023-12-15T23:56:31.335339+0000","last_peered":"2023-12-15T23:56:31.335339+0000","last_clean":"2023-12-15T23:56:31.335339+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-15T23:56:31.335339+0000","last_undegraded":"2023-12-15T23:56:31.335339+0000","last_fullsized":"2023-12-15T23:56:31.335339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:31.067844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342241+0000","last_change":"2023-12-15T22:53:26.156857+0000","last_active":"2023-12-15T23:56:25.342241+0000","last_peered":"2023-12-15T23:56:25.342241+0000","last_clean":"2023-12-15T23:56:25.342241+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-15T23:56:25.342241+0000","last_undegraded":"2023-12-15T23:56:25.342241+0000","last_fullsized":"2023-12-15T23:56:25.342241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359851+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:57:30.359851+0000","last_peered":"2023-12-15T23:57:30.359851+0000","last_clean":"2023-12-15T23:57:30.359851+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:57:30.359851+0000","last_undegraded":"2023-12-15T23:57:30.359851+0000","last_fullsized":"2023-12-15T23:57:30.359851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581105+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:57:30.581105+0000","last_peered":"2023-12-15T23:57:30.581105+0000","last_clean":"2023-12-15T23:57:30.581105+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:57:30.581105+0000","last_undegraded":"2023-12-15T23:57:30.581105+0000","last_fullsized":"2023-12-15T23:57:30.581105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.352632+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:57:05.352632+0000","last_peered":"2023-12-15T23:57:05.352632+0000","last_clean":"2023-12-15T23:57:05.352632+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:57:05.352632+0000","last_undegraded":"2023-12-15T23:57:05.352632+0000","last_fullsized":"2023-12-15T23:57:05.352632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:20.385525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361386+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:57:40.361386+0000","last_peered":"2023-12-15T23:57:40.361386+0000","last_clean":"2023-12-15T23:57:40.361386+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:57:40.361386+0000","last_undegraded":"2023-12-15T23:57:40.361386+0000","last_fullsized":"2023-12-15T23:57:40.361386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584426+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:57:45.584426+0000","last_peered":"2023-12-15T23:57:45.584426+0000","last_clean":"2023-12-15T23:57:45.584426+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:57:45.584426+0000","last_undegraded":"2023-12-15T23:57:45.584426+0000","last_fullsized":"2023-12-15T23:57:45.584426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:26.178233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357505+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:57:25.357505+0000","last_peered":"2023-12-15T23:57:25.357505+0000","last_clean":"2023-12-15T23:57:25.357505+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:57:25.357505+0000","last_undegraded":"2023-12-15T23:57:25.357505+0000","last_fullsized":"2023-12-15T23:57:25.357505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343680+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-15T23:56:25.343680+0000","last_peered":"2023-12-15T23:56:25.343680+0000","last_clean":"2023-12-15T23:56:25.343680+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-15T23:56:25.343680+0000","last_undegraded":"2023-12-15T23:56:25.343680+0000","last_fullsized":"2023-12-15T23:56:25.343680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:25.822041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341365+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-15T23:56:20.341365+0000","last_peered":"2023-12-15T23:56:20.341365+0000","last_clean":"2023-12-15T23:56:20.341365+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-15T23:56:20.341365+0000","last_undegraded":"2023-12-15T23:56:20.341365+0000","last_fullsized":"2023-12-15T23:56:20.341365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:41:05.257834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350550+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:56:55.350550+0000","last_peered":"2023-12-15T23:56:55.350550+0000","last_clean":"2023-12-15T23:56:55.350550+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:56:55.350550+0000","last_undegraded":"2023-12-15T23:56:55.350550+0000","last_fullsized":"2023-12-15T23:56:55.350550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351153+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:57:00.351153+0000","last_peered":"2023-12-15T23:57:00.351153+0000","last_clean":"2023-12-15T23:57:00.351153+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:57:00.351153+0000","last_undegraded":"2023-12-15T23:57:00.351153+0000","last_fullsized":"2023-12-15T23:57:00.351153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339623+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-15T23:56:40.339623+0000","last_peered":"2023-12-15T23:56:40.339623+0000","last_clean":"2023-12-15T23:56:40.339623+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-15T23:56:40.339623+0000","last_undegraded":"2023-12-15T23:56:40.339623+0000","last_fullsized":"2023-12-15T23:56:40.339623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:10.253710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337454+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-15T23:56:30.337454+0000","last_peered":"2023-12-15T23:56:30.337454+0000","last_clean":"2023-12-15T23:56:30.337454+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-15T23:56:30.337454+0000","last_undegraded":"2023-12-15T23:56:30.337454+0000","last_fullsized":"2023-12-15T23:56:30.337454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:22.564483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'257","reported_seq":415,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335270+0000","last_change":"2023-12-15T22:53:28.170194+0000","last_active":"2023-12-15T23:56:31.335270+0000","last_peered":"2023-12-15T23:56:31.335270+0000","last_clean":"2023-12-15T23:56:31.335270+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-15T23:56:31.335270+0000","last_undegraded":"2023-12-15T23:56:31.335270+0000","last_fullsized":"2023-12-15T23:56:31.335270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:38.876935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.347230+0000","last_change":"2023-12-15T22:53:26.165429+0000","last_active":"2023-12-15T23:56:40.347230+0000","last_peered":"2023-12-15T23:56:40.347230+0000","last_clean":"2023-12-15T23:56:40.347230+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-15T23:56:40.347230+0000","last_undegraded":"2023-12-15T23:56:40.347230+0000","last_fullsized":"2023-12-15T23:56:40.347230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580909+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:57:30.580909+0000","last_peered":"2023-12-15T23:57:30.580909+0000","last_clean":"2023-12-15T23:57:30.580909+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:57:30.580909+0000","last_undegraded":"2023-12-15T23:57:30.580909+0000","last_fullsized":"2023-12-15T23:57:30.580909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362785+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:57:45.362785+0000","last_peered":"2023-12-15T23:57:45.362785+0000","last_clean":"2023-12-15T23:57:45.362785+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:57:45.362785+0000","last_undegraded":"2023-12-15T23:57:45.362785+0000","last_fullsized":"2023-12-15T23:57:45.362785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354594+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:57:10.354594+0000","last_peered":"2023-12-15T23:57:10.354594+0000","last_clean":"2023-12-15T23:57:10.354594+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:57:10.354594+0000","last_undegraded":"2023-12-15T23:57:10.354594+0000","last_fullsized":"2023-12-15T23:57:10.354594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362345+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:57:40.362345+0000","last_peered":"2023-12-15T23:57:40.362345+0000","last_clean":"2023-12-15T23:57:40.362345+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:57:40.362345+0000","last_undegraded":"2023-12-15T23:57:40.362345+0000","last_fullsized":"2023-12-15T23:57:40.362345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.358388+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:57:25.358388+0000","last_peered":"2023-12-15T23:57:25.358388+0000","last_clean":"2023-12-15T23:57:25.358388+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:57:25.358388+0000","last_undegraded":"2023-12-15T23:57:25.358388+0000","last_fullsized":"2023-12-15T23:57:25.358388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353727+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:57:46.353727+0000","last_peered":"2023-12-15T23:57:46.353727+0000","last_clean":"2023-12-15T23:57:46.353727+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:57:46.353727+0000","last_undegraded":"2023-12-15T23:57:46.353727+0000","last_fullsized":"2023-12-15T23:57:46.353727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:28.187833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339815+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-15T23:56:10.339815+0000","last_peered":"2023-12-15T23:56:10.339815+0000","last_clean":"2023-12-15T23:56:10.339815+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-15T23:56:10.339815+0000","last_undegraded":"2023-12-15T23:56:10.339815+0000","last_fullsized":"2023-12-15T23:56:10.339815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:12.734358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351687+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:57:00.351687+0000","last_peered":"2023-12-15T23:57:00.351687+0000","last_clean":"2023-12-15T23:57:00.351687+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:57:00.351687+0000","last_undegraded":"2023-12-15T23:57:00.351687+0000","last_fullsized":"2023-12-15T23:57:00.351687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:08.485765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6349,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.332807+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-15T23:55:45.332807+0000","last_peered":"2023-12-15T23:55:45.332807+0000","last_clean":"2023-12-15T23:55:45.332807+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-15T23:55:45.332807+0000","last_undegraded":"2023-12-15T23:55:45.332807+0000","last_fullsized":"2023-12-15T23:55:45.332807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:16.965706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565280+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:56:30.565280+0000","last_peered":"2023-12-15T23:56:30.565280+0000","last_clean":"2023-12-15T23:56:30.565280+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:56:30.565280+0000","last_undegraded":"2023-12-15T23:56:30.565280+0000","last_fullsized":"2023-12-15T23:56:30.565280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:58.613135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327858+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-15T23:56:01.327858+0000","last_peered":"2023-12-15T23:56:01.327858+0000","last_clean":"2023-12-15T23:56:01.327858+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-15T23:56:01.327858+0000","last_undegraded":"2023-12-15T23:56:01.327858+0000","last_fullsized":"2023-12-15T23:56:01.327858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:26.351832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337075+0000","last_change":"2023-12-15T22:53:30.176406+0000","last_active":"2023-12-15T23:56:00.337075+0000","last_peered":"2023-12-15T23:56:00.337075+0000","last_clean":"2023-12-15T23:56:00.337075+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-15T23:56:00.337075+0000","last_undegraded":"2023-12-15T23:56:00.337075+0000","last_fullsized":"2023-12-15T23:56:00.337075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'664","reported_seq":1171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327978+0000","last_change":"2023-12-15T22:53:28.170239+0000","last_active":"2023-12-15T23:56:01.327978+0000","last_peered":"2023-12-15T23:56:01.327978+0000","last_clean":"2023-12-15T23:56:01.327978+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-15T23:56:01.327978+0000","last_undegraded":"2023-12-15T23:56:01.327978+0000","last_fullsized":"2023-12-15T23:56:01.327978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:43.649404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362601+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:57:40.362601+0000","last_peered":"2023-12-15T23:57:40.362601+0000","last_clean":"2023-12-15T23:57:40.362601+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:57:40.362601+0000","last_undegraded":"2023-12-15T23:57:40.362601+0000","last_fullsized":"2023-12-15T23:57:40.362601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:07:47.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.364059+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:57:45.364059+0000","last_peered":"2023-12-15T23:57:45.364059+0000","last_clean":"2023-12-15T23:57:45.364059+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:57:45.364059+0000","last_undegraded":"2023-12-15T23:57:45.364059+0000","last_fullsized":"2023-12-15T23:57:45.364059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:17:53.191887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326479+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-15T23:55:56.326479+0000","last_peered":"2023-12-15T23:55:56.326479+0000","last_clean":"2023-12-15T23:55:56.326479+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-15T23:55:56.326479+0000","last_undegraded":"2023-12-15T23:55:56.326479+0000","last_fullsized":"2023-12-15T23:55:56.326479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338312+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-15T23:56:10.338312+0000","last_peered":"2023-12-15T23:56:10.338312+0000","last_clean":"2023-12-15T23:56:10.338312+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-15T23:56:10.338312+0000","last_undegraded":"2023-12-15T23:56:10.338312+0000","last_fullsized":"2023-12-15T23:56:10.338312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558965+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-15T23:56:05.558965+0000","last_peered":"2023-12-15T23:56:05.558965+0000","last_clean":"2023-12-15T23:56:05.558965+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-15T23:56:05.558965+0000","last_undegraded":"2023-12-15T23:56:05.558965+0000","last_fullsized":"2023-12-15T23:56:05.558965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.340685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332420+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-15T23:56:10.332420+0000","last_peered":"2023-12-15T23:56:10.332420+0000","last_clean":"2023-12-15T23:56:10.332420+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-15T23:56:10.332420+0000","last_undegraded":"2023-12-15T23:56:10.332420+0000","last_fullsized":"2023-12-15T23:56:10.332420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:32.639017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560105+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-15T23:56:10.560105+0000","last_peered":"2023-12-15T23:56:10.560105+0000","last_clean":"2023-12-15T23:56:10.560105+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-15T23:56:10.560105+0000","last_undegraded":"2023-12-15T23:56:10.560105+0000","last_fullsized":"2023-12-15T23:56:10.560105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:15.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:11.344902+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:57:11.344902+0000","last_peered":"2023-12-15T23:57:11.344902+0000","last_clean":"2023-12-15T23:57:11.344902+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:57:11.344902+0000","last_undegraded":"2023-12-15T23:57:11.344902+0000","last_fullsized":"2023-12-15T23:57:11.344902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:19:56.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6459,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.571801+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:56:55.571801+0000","last_peered":"2023-12-15T23:56:55.571801+0000","last_clean":"2023-12-15T23:56:55.571801+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:56:55.571801+0000","last_undegraded":"2023-12-15T23:56:55.571801+0000","last_fullsized":"2023-12-15T23:56:55.571801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335217+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:56:31.335217+0000","last_peered":"2023-12-15T23:56:31.335217+0000","last_clean":"2023-12-15T23:56:31.335217+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:56:31.335217+0000","last_undegraded":"2023-12-15T23:56:31.335217+0000","last_fullsized":"2023-12-15T23:56:31.335217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:41.316820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327752+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-15T23:56:01.327752+0000","last_peered":"2023-12-15T23:56:01.327752+0000","last_clean":"2023-12-15T23:56:01.327752+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-15T23:56:01.327752+0000","last_undegraded":"2023-12-15T23:56:01.327752+0000","last_fullsized":"2023-12-15T23:56:01.327752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:21.948714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335881+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-15T23:56:00.335881+0000","last_peered":"2023-12-15T23:56:00.335881+0000","last_clean":"2023-12-15T23:56:00.335881+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-15T23:56:00.335881+0000","last_undegraded":"2023-12-15T23:56:00.335881+0000","last_fullsized":"2023-12-15T23:56:00.335881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:21.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'305","reported_seq":1269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337063+0000","last_change":"2023-12-15T22:53:28.171127+0000","last_active":"2023-12-15T23:56:00.337063+0000","last_peered":"2023-12-15T23:56:00.337063+0000","last_clean":"2023-12-15T23:56:00.337063+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-15T23:56:00.337063+0000","last_undegraded":"2023-12-15T23:56:00.337063+0000","last_fullsized":"2023-12-15T23:56:00.337063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:34.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:36.351648+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:57:36.351648+0000","last_peered":"2023-12-15T23:57:36.351648+0000","last_clean":"2023-12-15T23:57:36.351648+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:57:36.351648+0000","last_undegraded":"2023-12-15T23:57:36.351648+0000","last_fullsized":"2023-12-15T23:57:36.351648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:10.880484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578776+0000","last_change":"2023-12-15T22:53:10.339946+0000","last_active":"2023-12-15T23:57:20.578776+0000","last_peered":"2023-12-15T23:57:20.578776+0000","last_clean":"2023-12-15T23:57:20.578776+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-15T23:57:20.578776+0000","last_undegraded":"2023-12-15T23:57:20.578776+0000","last_fullsized":"2023-12-15T23:57:20.578776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556705+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-15T23:55:55.556705+0000","last_peered":"2023-12-15T23:55:55.556705+0000","last_clean":"2023-12-15T23:55:55.556705+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-15T23:55:55.556705+0000","last_undegraded":"2023-12-15T23:55:55.556705+0000","last_fullsized":"2023-12-15T23:55:55.556705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331477+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-15T23:55:45.331477+0000","last_peered":"2023-12-15T23:55:45.331477+0000","last_clean":"2023-12-15T23:55:45.331477+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-15T23:55:45.331477+0000","last_undegraded":"2023-12-15T23:55:45.331477+0000","last_fullsized":"2023-12-15T23:55:45.331477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559062+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-15T23:56:05.559062+0000","last_peered":"2023-12-15T23:56:05.559062+0000","last_clean":"2023-12-15T23:56:05.559062+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-15T23:56:05.559062+0000","last_undegraded":"2023-12-15T23:56:05.559062+0000","last_fullsized":"2023-12-15T23:56:05.559062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:07.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339351+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-15T23:56:10.339351+0000","last_peered":"2023-12-15T23:56:10.339351+0000","last_clean":"2023-12-15T23:56:10.339351+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-15T23:56:10.339351+0000","last_undegraded":"2023-12-15T23:56:10.339351+0000","last_fullsized":"2023-12-15T23:56:10.339351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338079+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-15T23:56:10.338079+0000","last_peered":"2023-12-15T23:56:10.338079+0000","last_clean":"2023-12-15T23:56:10.338079+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-15T23:56:10.338079+0000","last_undegraded":"2023-12-15T23:56:10.338079+0000","last_fullsized":"2023-12-15T23:56:10.338079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339159+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:56:10.339159+0000","last_peered":"2023-12-15T23:56:10.339159+0000","last_clean":"2023-12-15T23:56:10.339159+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:56:10.339159+0000","last_undegraded":"2023-12-15T23:56:10.339159+0000","last_fullsized":"2023-12-15T23:56:10.339159+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:33.647312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566664+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:56:35.566664+0000","last_peered":"2023-12-15T23:56:35.566664+0000","last_clean":"2023-12-15T23:56:35.566664+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:56:35.566664+0000","last_undegraded":"2023-12-15T23:56:35.566664+0000","last_fullsized":"2023-12-15T23:56:35.566664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:16.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349198+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:56:50.349198+0000","last_peered":"2023-12-15T23:56:50.349198+0000","last_clean":"2023-12-15T23:56:50.349198+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:56:50.349198+0000","last_undegraded":"2023-12-15T23:56:50.349198+0000","last_fullsized":"2023-12-15T23:56:50.349198+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:05.435125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346684+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:56:40.346684+0000","last_peered":"2023-12-15T23:56:40.346684+0000","last_clean":"2023-12-15T23:56:40.346684+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:56:40.346684+0000","last_undegraded":"2023-12-15T23:56:40.346684+0000","last_fullsized":"2023-12-15T23:56:40.346684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362877+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:57:45.362877+0000","last_peered":"2023-12-15T23:57:45.362877+0000","last_clean":"2023-12-15T23:57:45.362877+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:57:45.362877+0000","last_undegraded":"2023-12-15T23:57:45.362877+0000","last_fullsized":"2023-12-15T23:57:45.362877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:51:36.640304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":378,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368919+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-15T23:58:05.368919+0000","last_peered":"2023-12-15T23:58:05.368919+0000","last_clean":"2023-12-15T23:58:05.368919+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-15T23:58:05.368919+0000","last_undegraded":"2023-12-15T23:58:05.368919+0000","last_fullsized":"2023-12-15T23:58:05.368919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'13","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336008+0000","last_change":"2023-12-15T22:53:26.159079+0000","last_active":"2023-12-15T23:55:55.336008+0000","last_peered":"2023-12-15T23:55:55.336008+0000","last_clean":"2023-12-15T23:55:55.336008+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-15T23:55:55.336008+0000","last_undegraded":"2023-12-15T23:55:55.336008+0000","last_fullsized":"2023-12-15T23:55:55.336008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:12.478013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332497+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-15T23:55:40.332497+0000","last_peered":"2023-12-15T23:55:40.332497+0000","last_clean":"2023-12-15T23:55:40.332497+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-15T23:55:40.332497+0000","last_undegraded":"2023-12-15T23:55:40.332497+0000","last_fullsized":"2023-12-15T23:55:40.332497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328561+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-15T23:55:55.328561+0000","last_peered":"2023-12-15T23:55:55.328561+0000","last_clean":"2023-12-15T23:55:55.328561+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-15T23:55:55.328561+0000","last_undegraded":"2023-12-15T23:55:55.328561+0000","last_fullsized":"2023-12-15T23:55:55.328561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:40.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333269+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-15T23:55:45.333269+0000","last_peered":"2023-12-15T23:55:45.333269+0000","last_clean":"2023-12-15T23:55:45.333269+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-15T23:55:45.333269+0000","last_undegraded":"2023-12-15T23:55:45.333269+0000","last_fullsized":"2023-12-15T23:55:45.333269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.328850+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-15T23:56:06.328850+0000","last_peered":"2023-12-15T23:56:06.328850+0000","last_clean":"2023-12-15T23:56:06.328850+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-15T23:56:06.328850+0000","last_undegraded":"2023-12-15T23:56:06.328850+0000","last_fullsized":"2023-12-15T23:56:06.328850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:47.168313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332639+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-15T23:56:10.332639+0000","last_peered":"2023-12-15T23:56:10.332639+0000","last_clean":"2023-12-15T23:56:10.332639+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-15T23:56:10.332639+0000","last_undegraded":"2023-12-15T23:56:10.332639+0000","last_fullsized":"2023-12-15T23:56:10.332639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:04.124976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339169+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-15T23:56:10.339169+0000","last_peered":"2023-12-15T23:56:10.339169+0000","last_clean":"2023-12-15T23:56:10.339169+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-15T23:56:10.339169+0000","last_undegraded":"2023-12-15T23:56:10.339169+0000","last_fullsized":"2023-12-15T23:56:10.339169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:27.858155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338272+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:56:10.338272+0000","last_peered":"2023-12-15T23:56:10.338272+0000","last_clean":"2023-12-15T23:56:10.338272+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:56:10.338272+0000","last_undegraded":"2023-12-15T23:56:10.338272+0000","last_fullsized":"2023-12-15T23:56:10.338272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:45:30.242778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1074,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360241+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-15T23:57:35.360241+0000","last_peered":"2023-12-15T23:57:35.360241+0000","last_clean":"2023-12-15T23:57:35.360241+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-15T23:57:35.360241+0000","last_undegraded":"2023-12-15T23:57:35.360241+0000","last_fullsized":"2023-12-15T23:57:35.360241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:36.880386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345517+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:57:05.345517+0000","last_peered":"2023-12-15T23:57:05.345517+0000","last_clean":"2023-12-15T23:57:05.345517+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:57:05.345517+0000","last_undegraded":"2023-12-15T23:57:05.345517+0000","last_fullsized":"2023-12-15T23:57:05.345517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:04.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.563776+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:56:25.563776+0000","last_peered":"2023-12-15T23:56:25.563776+0000","last_clean":"2023-12-15T23:56:25.563776+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:56:25.563776+0000","last_undegraded":"2023-12-15T23:56:25.563776+0000","last_fullsized":"2023-12-15T23:56:25.563776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:40:17.731463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359433+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-15T23:58:05.359433+0000","last_peered":"2023-12-15T23:58:05.359433+0000","last_clean":"2023-12-15T23:58:05.359433+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-15T23:58:05.359433+0000","last_undegraded":"2023-12-15T23:58:05.359433+0000","last_fullsized":"2023-12-15T23:58:05.359433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:53.623883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'241","reported_seq":382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363959+0000","last_change":"2023-12-15T22:53:28.167550+0000","last_active":"2023-12-15T23:57:45.363959+0000","last_peered":"2023-12-15T23:57:45.363959+0000","last_clean":"2023-12-15T23:57:45.363959+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-15T23:57:45.363959+0000","last_undegraded":"2023-12-15T23:57:45.363959+0000","last_fullsized":"2023-12-15T23:57:45.363959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336091+0000","last_change":"2023-12-15T22:53:26.159624+0000","last_active":"2023-12-15T23:55:55.336091+0000","last_peered":"2023-12-15T23:55:55.336091+0000","last_clean":"2023-12-15T23:55:55.336091+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-15T23:55:55.336091+0000","last_undegraded":"2023-12-15T23:55:55.336091+0000","last_fullsized":"2023-12-15T23:55:55.336091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:17.442064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.331897+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-15T23:55:40.331897+0000","last_peered":"2023-12-15T23:55:40.331897+0000","last_clean":"2023-12-15T23:55:40.331897+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-15T23:55:40.331897+0000","last_undegraded":"2023-12-15T23:55:40.331897+0000","last_fullsized":"2023-12-15T23:55:40.331897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556515+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-15T23:55:55.556515+0000","last_peered":"2023-12-15T23:55:55.556515+0000","last_clean":"2023-12-15T23:55:55.556515+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-15T23:55:55.556515+0000","last_undegraded":"2023-12-15T23:55:55.556515+0000","last_fullsized":"2023-12-15T23:55:55.556515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333945+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-15T23:55:45.333945+0000","last_peered":"2023-12-15T23:55:45.333945+0000","last_clean":"2023-12-15T23:55:45.333945+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-15T23:55:45.333945+0000","last_undegraded":"2023-12-15T23:55:45.333945+0000","last_fullsized":"2023-12-15T23:55:45.333945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:32.086477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.336769+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-15T23:56:05.336769+0000","last_peered":"2023-12-15T23:56:05.336769+0000","last_clean":"2023-12-15T23:56:05.336769+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-15T23:56:05.336769+0000","last_undegraded":"2023-12-15T23:56:05.336769+0000","last_fullsized":"2023-12-15T23:56:05.336769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339145+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-15T23:56:10.339145+0000","last_peered":"2023-12-15T23:56:10.339145+0000","last_clean":"2023-12-15T23:56:10.339145+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-15T23:56:10.339145+0000","last_undegraded":"2023-12-15T23:56:10.339145+0000","last_fullsized":"2023-12-15T23:56:10.339145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339600+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-15T23:56:10.339600+0000","last_peered":"2023-12-15T23:56:10.339600+0000","last_clean":"2023-12-15T23:56:10.339600+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-15T23:56:10.339600+0000","last_undegraded":"2023-12-15T23:56:10.339600+0000","last_fullsized":"2023-12-15T23:56:10.339600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:50.364535+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-15T23:57:50.364535+0000","last_peered":"2023-12-15T23:57:50.364535+0000","last_clean":"2023-12-15T23:57:50.364535+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-15T23:57:50.364535+0000","last_undegraded":"2023-12-15T23:57:50.364535+0000","last_fullsized":"2023-12-15T23:57:50.364535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.349901+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:56:55.349901+0000","last_peered":"2023-12-15T23:56:55.349901+0000","last_clean":"2023-12-15T23:56:55.349901+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:56:55.349901+0000","last_undegraded":"2023-12-15T23:56:55.349901+0000","last_fullsized":"2023-12-15T23:56:55.349901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349864+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:56:50.349864+0000","last_peered":"2023-12-15T23:56:50.349864+0000","last_clean":"2023-12-15T23:56:50.349864+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:56:50.349864+0000","last_undegraded":"2023-12-15T23:56:50.349864+0000","last_fullsized":"2023-12-15T23:56:50.349864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:21.333233+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:56:21.333233+0000","last_peered":"2023-12-15T23:56:21.333233+0000","last_clean":"2023-12-15T23:56:21.333233+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:56:21.333233+0000","last_undegraded":"2023-12-15T23:56:21.333233+0000","last_fullsized":"2023-12-15T23:56:21.333233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:38.871309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344252+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:56:30.344252+0000","last_peered":"2023-12-15T23:56:30.344252+0000","last_clean":"2023-12-15T23:56:30.344252+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:56:30.344252+0000","last_undegraded":"2023-12-15T23:56:30.344252+0000","last_fullsized":"2023-12-15T23:56:30.344252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1842","reported_seq":2750,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344111+0000","last_change":"2023-12-15T22:53:28.170890+0000","last_active":"2023-12-15T23:56:30.344111+0000","last_peered":"2023-12-15T23:56:30.344111+0000","last_clean":"2023-12-15T23:56:30.344111+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-15T23:56:30.344111+0000","last_undegraded":"2023-12-15T23:56:30.344111+0000","last_fullsized":"2023-12-15T23:56:30.344111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:16.035980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343005+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-15T23:56:25.343005+0000","last_peered":"2023-12-15T23:56:25.343005+0000","last_clean":"2023-12-15T23:56:25.343005+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-15T23:56:25.343005+0000","last_undegraded":"2023-12-15T23:56:25.343005+0000","last_fullsized":"2023-12-15T23:56:25.343005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359523+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:57:30.359523+0000","last_peered":"2023-12-15T23:57:30.359523+0000","last_clean":"2023-12-15T23:57:30.359523+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:57:30.359523+0000","last_undegraded":"2023-12-15T23:57:30.359523+0000","last_fullsized":"2023-12-15T23:57:30.359523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:26.930020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326348+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-15T23:55:45.326348+0000","last_peered":"2023-12-15T23:55:45.326348+0000","last_clean":"2023-12-15T23:55:45.326348+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-15T23:55:45.326348+0000","last_undegraded":"2023-12-15T23:55:45.326348+0000","last_fullsized":"2023-12-15T23:55:45.326348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:43.407151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.357609+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:57:20.357609+0000","last_peered":"2023-12-15T23:57:20.357609+0000","last_clean":"2023-12-15T23:57:20.357609+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:57:20.357609+0000","last_undegraded":"2023-12-15T23:57:20.357609+0000","last_fullsized":"2023-12-15T23:57:20.357609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552614+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-15T23:55:40.552614+0000","last_peered":"2023-12-15T23:55:40.552614+0000","last_clean":"2023-12-15T23:55:40.552614+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-15T23:55:40.552614+0000","last_undegraded":"2023-12-15T23:55:40.552614+0000","last_fullsized":"2023-12-15T23:55:40.552614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329954+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-15T23:55:40.329954+0000","last_peered":"2023-12-15T23:55:40.329954+0000","last_clean":"2023-12-15T23:55:40.329954+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-15T23:55:40.329954+0000","last_undegraded":"2023-12-15T23:55:40.329954+0000","last_fullsized":"2023-12-15T23:55:40.329954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560395+0000","last_change":"2023-12-15T22:53:11.078111+0000","last_active":"2023-12-15T23:56:10.560395+0000","last_peered":"2023-12-15T23:56:10.560395+0000","last_clean":"2023-12-15T23:56:10.560395+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-15T23:56:10.560395+0000","last_undegraded":"2023-12-15T23:56:10.560395+0000","last_fullsized":"2023-12-15T23:56:10.560395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351884+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:57:00.351884+0000","last_peered":"2023-12-15T23:57:00.351884+0000","last_clean":"2023-12-15T23:57:00.351884+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:57:00.351884+0000","last_undegraded":"2023-12-15T23:57:00.351884+0000","last_fullsized":"2023-12-15T23:57:00.351884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:35.240310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4381,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.347747+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:57:21.347747+0000","last_peered":"2023-12-15T23:57:21.347747+0000","last_clean":"2023-12-15T23:57:21.347747+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:57:21.347747+0000","last_undegraded":"2023-12-15T23:57:21.347747+0000","last_fullsized":"2023-12-15T23:57:21.347747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:58.493238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349786+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:56:50.349786+0000","last_peered":"2023-12-15T23:56:50.349786+0000","last_clean":"2023-12-15T23:56:50.349786+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:56:50.349786+0000","last_undegraded":"2023-12-15T23:56:50.349786+0000","last_fullsized":"2023-12-15T23:56:50.349786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:42.139142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343348+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:56:25.343348+0000","last_peered":"2023-12-15T23:56:25.343348+0000","last_clean":"2023-12-15T23:56:25.343348+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:56:25.343348+0000","last_undegraded":"2023-12-15T23:56:25.343348+0000","last_fullsized":"2023-12-15T23:56:25.343348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:06.358488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337251+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:56:30.337251+0000","last_peered":"2023-12-15T23:56:30.337251+0000","last_clean":"2023-12-15T23:56:30.337251+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:56:30.337251+0000","last_undegraded":"2023-12-15T23:56:30.337251+0000","last_fullsized":"2023-12-15T23:56:30.337251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:33.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2119","reported_seq":2950,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335033+0000","last_change":"2023-12-15T22:53:28.169796+0000","last_active":"2023-12-15T23:56:31.335033+0000","last_peered":"2023-12-15T23:56:31.335033+0000","last_clean":"2023-12-15T23:56:31.335033+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-15T23:56:31.335033+0000","last_undegraded":"2023-12-15T23:56:31.335033+0000","last_fullsized":"2023-12-15T23:56:31.335033+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":400,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:11.825688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'5","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342010+0000","last_change":"2023-12-15T22:53:26.156319+0000","last_active":"2023-12-15T23:56:25.342010+0000","last_peered":"2023-12-15T23:56:25.342010+0000","last_clean":"2023-12-15T23:56:25.342010+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-15T23:56:25.342010+0000","last_undegraded":"2023-12-15T23:56:25.342010+0000","last_fullsized":"2023-12-15T23:56:25.342010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354866+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:57:10.354866+0000","last_peered":"2023-12-15T23:57:10.354866+0000","last_clean":"2023-12-15T23:57:10.354866+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:57:10.354866+0000","last_undegraded":"2023-12-15T23:57:10.354866+0000","last_fullsized":"2023-12-15T23:57:10.354866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556585+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-15T23:55:55.556585+0000","last_peered":"2023-12-15T23:55:55.556585+0000","last_clean":"2023-12-15T23:55:55.556585+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-15T23:55:55.556585+0000","last_undegraded":"2023-12-15T23:55:55.556585+0000","last_fullsized":"2023-12-15T23:55:55.556585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362341+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:57:40.362341+0000","last_peered":"2023-12-15T23:57:40.362341+0000","last_clean":"2023-12-15T23:57:40.362341+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:57:40.362341+0000","last_undegraded":"2023-12-15T23:57:40.362341+0000","last_fullsized":"2023-12-15T23:57:40.362341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:38.848380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329967+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-15T23:55:40.329967+0000","last_peered":"2023-12-15T23:55:40.329967+0000","last_clean":"2023-12-15T23:55:40.329967+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-15T23:55:40.329967+0000","last_undegraded":"2023-12-15T23:55:40.329967+0000","last_fullsized":"2023-12-15T23:55:40.329967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:43.553443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552603+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-15T23:55:40.552603+0000","last_peered":"2023-12-15T23:55:40.552603+0000","last_clean":"2023-12-15T23:55:40.552603+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-15T23:55:40.552603+0000","last_undegraded":"2023-12-15T23:55:40.552603+0000","last_fullsized":"2023-12-15T23:55:40.552603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:59.504031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338205+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-15T23:56:10.338205+0000","last_peered":"2023-12-15T23:56:10.338205+0000","last_clean":"2023-12-15T23:56:10.338205+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-15T23:56:10.338205+0000","last_undegraded":"2023-12-15T23:56:10.338205+0000","last_fullsized":"2023-12-15T23:56:10.338205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:45:21.838509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352260+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:57:00.352260+0000","last_peered":"2023-12-15T23:57:00.352260+0000","last_clean":"2023-12-15T23:57:00.352260+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:57:00.352260+0000","last_undegraded":"2023-12-15T23:57:00.352260+0000","last_fullsized":"2023-12-15T23:57:00.352260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:00.386613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1324,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572418+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:56:55.572418+0000","last_peered":"2023-12-15T23:56:55.572418+0000","last_clean":"2023-12-15T23:56:55.572418+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:56:55.572418+0000","last_undegraded":"2023-12-15T23:56:55.572418+0000","last_fullsized":"2023-12-15T23:56:55.572418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:23.586325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.356017+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:57:15.356017+0000","last_peered":"2023-12-15T23:57:15.356017+0000","last_clean":"2023-12-15T23:57:15.356017+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:57:15.356017+0000","last_undegraded":"2023-12-15T23:57:15.356017+0000","last_fullsized":"2023-12-15T23:57:15.356017+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343275+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:56:25.343275+0000","last_peered":"2023-12-15T23:56:25.343275+0000","last_clean":"2023-12-15T23:56:25.343275+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:56:25.343275+0000","last_undegraded":"2023-12-15T23:56:25.343275+0000","last_fullsized":"2023-12-15T23:56:25.343275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:25.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343129+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:56:30.343129+0000","last_peered":"2023-12-15T23:56:30.343129+0000","last_clean":"2023-12-15T23:56:30.343129+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:56:30.343129+0000","last_undegraded":"2023-12-15T23:56:30.343129+0000","last_fullsized":"2023-12-15T23:56:30.343129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:30.622729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":362,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565404+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:56:30.565404+0000","last_peered":"2023-12-15T23:56:30.565404+0000","last_clean":"2023-12-15T23:56:30.565404+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:56:30.565404+0000","last_undegraded":"2023-12-15T23:56:30.565404+0000","last_fullsized":"2023-12-15T23:56:30.565404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:28.380180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334009+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-15T23:56:26.334009+0000","last_peered":"2023-12-15T23:56:26.334009+0000","last_clean":"2023-12-15T23:56:26.334009+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-15T23:56:26.334009+0000","last_undegraded":"2023-12-15T23:56:26.334009+0000","last_fullsized":"2023-12-15T23:56:26.334009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:06.119748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328597+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-15T23:55:25.328597+0000","last_peered":"2023-12-15T23:55:25.328597+0000","last_clean":"2023-12-15T23:55:25.328597+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-15T23:55:25.328597+0000","last_undegraded":"2023-12-15T23:55:25.328597+0000","last_fullsized":"2023-12-15T23:55:25.328597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318664+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-15T23:55:26.318664+0000","last_peered":"2023-12-15T23:55:26.318664+0000","last_clean":"2023-12-15T23:55:26.318664+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-15T23:55:26.318664+0000","last_undegraded":"2023-12-15T23:55:26.318664+0000","last_fullsized":"2023-12-15T23:55:26.318664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321741+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-15T23:55:36.321741+0000","last_peered":"2023-12-15T23:55:36.321741+0000","last_clean":"2023-12-15T23:55:36.321741+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-15T23:55:36.321741+0000","last_undegraded":"2023-12-15T23:55:36.321741+0000","last_fullsized":"2023-12-15T23:55:36.321741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:50.986250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354891+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:57:45.354891+0000","last_peered":"2023-12-15T23:57:45.354891+0000","last_clean":"2023-12-15T23:57:45.354891+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:57:45.354891+0000","last_undegraded":"2023-12-15T23:57:45.354891+0000","last_fullsized":"2023-12-15T23:57:45.354891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:50.449966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578797+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:57:20.578797+0000","last_peered":"2023-12-15T23:57:20.578797+0000","last_clean":"2023-12-15T23:57:20.578797+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:57:20.578797+0000","last_undegraded":"2023-12-15T23:57:20.578797+0000","last_fullsized":"2023-12-15T23:57:20.578797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338114+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-15T23:56:10.338114+0000","last_peered":"2023-12-15T23:56:10.338114+0000","last_clean":"2023-12-15T23:56:10.338114+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-15T23:56:10.338114+0000","last_undegraded":"2023-12-15T23:56:10.338114+0000","last_fullsized":"2023-12-15T23:56:10.338114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:10:20.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342768+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:57:01.342768+0000","last_peered":"2023-12-15T23:57:01.342768+0000","last_clean":"2023-12-15T23:57:01.342768+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:57:01.342768+0000","last_undegraded":"2023-12-15T23:57:01.342768+0000","last_fullsized":"2023-12-15T23:57:01.342768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3844,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572342+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:56:55.572342+0000","last_peered":"2023-12-15T23:56:55.572342+0000","last_clean":"2023-12-15T23:56:55.572342+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:56:55.572342+0000","last_undegraded":"2023-12-15T23:56:55.572342+0000","last_fullsized":"2023-12-15T23:56:55.572342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:09.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:51.340241+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:56:51.340241+0000","last_peered":"2023-12-15T23:56:51.340241+0000","last_clean":"2023-12-15T23:56:51.340241+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:56:51.340241+0000","last_undegraded":"2023-12-15T23:56:51.340241+0000","last_fullsized":"2023-12-15T23:56:51.340241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:55.739562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349521+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:56:50.349521+0000","last_peered":"2023-12-15T23:56:50.349521+0000","last_clean":"2023-12-15T23:56:50.349521+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:56:50.349521+0000","last_undegraded":"2023-12-15T23:56:50.349521+0000","last_fullsized":"2023-12-15T23:56:50.349521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:02:18.788244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344265+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:56:30.344265+0000","last_peered":"2023-12-15T23:56:30.344265+0000","last_clean":"2023-12-15T23:56:30.344265+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:56:30.344265+0000","last_undegraded":"2023-12-15T23:56:30.344265+0000","last_fullsized":"2023-12-15T23:56:30.344265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:33:01.580743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9956","reported_seq":16962,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344181+0000","last_change":"2023-12-15T22:53:28.170727+0000","last_active":"2023-12-15T23:56:30.344181+0000","last_peered":"2023-12-15T23:56:30.344181+0000","last_clean":"2023-12-15T23:56:30.344181+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-15T23:56:30.344181+0000","last_undegraded":"2023-12-15T23:56:30.344181+0000","last_fullsized":"2023-12-15T23:56:30.344181+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":3000,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:29.326245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341884+0000","last_change":"2023-12-15T22:53:26.163866+0000","last_active":"2023-12-15T23:56:25.341884+0000","last_peered":"2023-12-15T23:56:25.341884+0000","last_clean":"2023-12-15T23:56:25.341884+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-15T23:56:25.341884+0000","last_undegraded":"2023-12-15T23:56:25.341884+0000","last_fullsized":"2023-12-15T23:56:25.341884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.322406+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-15T23:55:25.322406+0000","last_peered":"2023-12-15T23:55:25.322406+0000","last_clean":"2023-12-15T23:55:25.322406+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-15T23:55:25.322406+0000","last_undegraded":"2023-12-15T23:55:25.322406+0000","last_fullsized":"2023-12-15T23:55:25.322406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:45.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328448+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-15T23:55:25.328448+0000","last_peered":"2023-12-15T23:55:25.328448+0000","last_clean":"2023-12-15T23:55:25.328448+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-15T23:55:25.328448+0000","last_undegraded":"2023-12-15T23:55:25.328448+0000","last_fullsized":"2023-12-15T23:55:25.328448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":241,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.551384+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-15T23:55:35.551384+0000","last_peered":"2023-12-15T23:55:35.551384+0000","last_clean":"2023-12-15T23:55:35.551384+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-15T23:55:35.551384+0000","last_undegraded":"2023-12-15T23:55:35.551384+0000","last_fullsized":"2023-12-15T23:55:35.551384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:20.673127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357853+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:57:25.357853+0000","last_peered":"2023-12-15T23:57:25.357853+0000","last_clean":"2023-12-15T23:57:25.357853+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:57:25.357853+0000","last_undegraded":"2023-12-15T23:57:25.357853+0000","last_fullsized":"2023-12-15T23:57:25.357853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:35.171333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363016+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:57:45.363016+0000","last_peered":"2023-12-15T23:57:45.363016+0000","last_clean":"2023-12-15T23:57:45.363016+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:57:45.363016+0000","last_undegraded":"2023-12-15T23:57:45.363016+0000","last_fullsized":"2023-12-15T23:57:45.363016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:28.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.337997+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-15T23:56:10.337997+0000","last_peered":"2023-12-15T23:56:10.337997+0000","last_clean":"2023-12-15T23:56:10.337997+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:56:10.337997+0000","last_undegraded":"2023-12-15T23:56:10.337997+0000","last_fullsized":"2023-12-15T23:56:10.337997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.062956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352318+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-15T23:57:41.352318+0000","last_peered":"2023-12-15T23:57:41.352318+0000","last_clean":"2023-12-15T23:57:41.352318+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-15T23:57:41.352318+0000","last_undegraded":"2023-12-15T23:57:41.352318+0000","last_fullsized":"2023-12-15T23:57:41.352318+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5869,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343539+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:57:06.343539+0000","last_peered":"2023-12-15T23:57:06.343539+0000","last_clean":"2023-12-15T23:57:06.343539+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:57:06.343539+0000","last_undegraded":"2023-12-15T23:57:06.343539+0000","last_fullsized":"2023-12-15T23:57:06.343539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:57.591782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351788+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:57:00.351788+0000","last_peered":"2023-12-15T23:57:00.351788+0000","last_clean":"2023-12-15T23:57:00.351788+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:57:00.351788+0000","last_undegraded":"2023-12-15T23:57:00.351788+0000","last_fullsized":"2023-12-15T23:57:00.351788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566684+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:56:35.566684+0000","last_peered":"2023-12-15T23:56:35.566684+0000","last_clean":"2023-12-15T23:56:35.566684+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:56:35.566684+0000","last_undegraded":"2023-12-15T23:56:35.566684+0000","last_fullsized":"2023-12-15T23:56:35.566684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:44.870107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1507,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347321+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:56:45.347321+0000","last_peered":"2023-12-15T23:56:45.347321+0000","last_clean":"2023-12-15T23:56:45.347321+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:56:45.347321+0000","last_undegraded":"2023-12-15T23:56:45.347321+0000","last_fullsized":"2023-12-15T23:56:45.347321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:02.140170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'237","reported_seq":413,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342292+0000","last_change":"2023-12-15T22:53:28.168042+0000","last_active":"2023-12-15T23:56:20.342292+0000","last_peered":"2023-12-15T23:56:20.342292+0000","last_clean":"2023-12-15T23:56:20.342292+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-15T23:56:20.342292+0000","last_undegraded":"2023-12-15T23:56:20.342292+0000","last_fullsized":"2023-12-15T23:56:20.342292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'23","reported_seq":147,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.332061+0000","last_change":"2023-12-15T22:53:26.162529+0000","last_active":"2023-12-15T23:56:16.332061+0000","last_peered":"2023-12-15T23:56:16.332061+0000","last_clean":"2023-12-15T23:56:16.332061+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-15T23:56:16.332061+0000","last_undegraded":"2023-12-15T23:56:16.332061+0000","last_fullsized":"2023-12-15T23:56:16.332061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:07.818847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318821+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-15T23:55:26.318821+0000","last_peered":"2023-12-15T23:55:26.318821+0000","last_clean":"2023-12-15T23:55:26.318821+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-15T23:55:26.318821+0000","last_undegraded":"2023-12-15T23:55:26.318821+0000","last_fullsized":"2023-12-15T23:55:26.318821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328501+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-15T23:55:25.328501+0000","last_peered":"2023-12-15T23:55:25.328501+0000","last_clean":"2023-12-15T23:55:25.328501+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-15T23:55:25.328501+0000","last_undegraded":"2023-12-15T23:55:25.328501+0000","last_fullsized":"2023-12-15T23:55:25.328501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:25.929011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321560+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-15T23:55:36.321560+0000","last_peered":"2023-12-15T23:55:36.321560+0000","last_clean":"2023-12-15T23:55:36.321560+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-15T23:55:36.321560+0000","last_undegraded":"2023-12-15T23:55:36.321560+0000","last_fullsized":"2023-12-15T23:55:36.321560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:57.672852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340190+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-15T23:56:15.340190+0000","last_peered":"2023-12-15T23:56:15.340190+0000","last_clean":"2023-12-15T23:56:15.340190+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-15T23:56:15.340190+0000","last_undegraded":"2023-12-15T23:56:15.340190+0000","last_fullsized":"2023-12-15T23:56:15.340190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336942+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-15T23:56:00.336942+0000","last_peered":"2023-12-15T23:56:00.336942+0000","last_clean":"2023-12-15T23:56:00.336942+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-15T23:56:00.336942+0000","last_undegraded":"2023-12-15T23:56:00.336942+0000","last_fullsized":"2023-12-15T23:56:00.336942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336133+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-15T23:56:00.336133+0000","last_peered":"2023-12-15T23:56:00.336133+0000","last_clean":"2023-12-15T23:56:00.336133+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-15T23:56:00.336133+0000","last_undegraded":"2023-12-15T23:56:00.336133+0000","last_fullsized":"2023-12-15T23:56:00.336133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.353458+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-15T23:57:40.353458+0000","last_peered":"2023-12-15T23:57:40.353458+0000","last_clean":"2023-12-15T23:57:40.353458+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-15T23:57:40.353458+0000","last_undegraded":"2023-12-15T23:57:40.353458+0000","last_fullsized":"2023-12-15T23:57:40.353458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:28:25.919204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4018,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574414+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:57:05.574414+0000","last_peered":"2023-12-15T23:57:05.574414+0000","last_clean":"2023-12-15T23:57:05.574414+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:57:05.574414+0000","last_undegraded":"2023-12-15T23:57:05.574414+0000","last_fullsized":"2023-12-15T23:57:05.574414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:19.550874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351766+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:57:00.351766+0000","last_peered":"2023-12-15T23:57:00.351766+0000","last_clean":"2023-12-15T23:57:00.351766+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:57:00.351766+0000","last_undegraded":"2023-12-15T23:57:00.351766+0000","last_fullsized":"2023-12-15T23:57:00.351766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:24.931139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345572+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:56:35.345572+0000","last_peered":"2023-12-15T23:56:35.345572+0000","last_clean":"2023-12-15T23:56:35.345572+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:56:35.345572+0000","last_undegraded":"2023-12-15T23:56:35.345572+0000","last_fullsized":"2023-12-15T23:56:35.345572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1435,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.335080+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:56:20.335080+0000","last_peered":"2023-12-15T23:56:20.335080+0000","last_clean":"2023-12-15T23:56:20.335080+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:56:20.335080+0000","last_undegraded":"2023-12-15T23:56:20.335080+0000","last_fullsized":"2023-12-15T23:56:20.335080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:02.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":340,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.568173+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:56:40.568173+0000","last_peered":"2023-12-15T23:56:40.568173+0000","last_clean":"2023-12-15T23:56:40.568173+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:56:40.568173+0000","last_undegraded":"2023-12-15T23:56:40.568173+0000","last_fullsized":"2023-12-15T23:56:40.568173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:04.096568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356849+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-15T23:57:56.356849+0000","last_peered":"2023-12-15T23:57:56.356849+0000","last_clean":"2023-12-15T23:57:56.356849+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-15T23:57:56.356849+0000","last_undegraded":"2023-12-15T23:57:56.356849+0000","last_fullsized":"2023-12-15T23:57:56.356849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:50.188900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:26.318753+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-15T23:55:26.318753+0000","last_peered":"2023-12-15T23:55:26.318753+0000","last_clean":"2023-12-15T23:55:26.318753+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-15T23:55:26.318753+0000","last_undegraded":"2023-12-15T23:55:26.318753+0000","last_fullsized":"2023-12-15T23:55:26.318753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:32.193702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:25.328603+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-15T23:55:25.328603+0000","last_peered":"2023-12-15T23:55:25.328603+0000","last_clean":"2023-12-15T23:55:25.328603+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-15T23:55:25.328603+0000","last_undegraded":"2023-12-15T23:55:25.328603+0000","last_fullsized":"2023-12-15T23:55:25.328603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:25.439900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.330732+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-15T23:55:35.330732+0000","last_peered":"2023-12-15T23:55:35.330732+0000","last_clean":"2023-12-15T23:55:35.330732+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-15T23:55:35.330732+0000","last_undegraded":"2023-12-15T23:55:35.330732+0000","last_fullsized":"2023-12-15T23:55:35.330732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:31.616855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336859+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-15T23:56:00.336859+0000","last_peered":"2023-12-15T23:56:00.336859+0000","last_clean":"2023-12-15T23:56:00.336859+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-15T23:56:00.336859+0000","last_undegraded":"2023-12-15T23:56:00.336859+0000","last_fullsized":"2023-12-15T23:56:00.336859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339319+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-15T23:56:15.339319+0000","last_peered":"2023-12-15T23:56:15.339319+0000","last_clean":"2023-12-15T23:56:15.339319+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-15T23:56:15.339319+0000","last_undegraded":"2023-12-15T23:56:15.339319+0000","last_fullsized":"2023-12-15T23:56:15.339319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.558216+0000","last_change":"2023-12-15T22:53:11.079680+0000","last_active":"2023-12-15T23:56:00.558216+0000","last_peered":"2023-12-15T23:56:00.558216+0000","last_clean":"2023-12-15T23:56:00.558216+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-15T23:56:00.558216+0000","last_undegraded":"2023-12-15T23:56:00.558216+0000","last_fullsized":"2023-12-15T23:56:00.558216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362232+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-15T23:57:40.362232+0000","last_peered":"2023-12-15T23:57:40.362232+0000","last_clean":"2023-12-15T23:57:40.362232+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-15T23:57:40.362232+0000","last_undegraded":"2023-12-15T23:57:40.362232+0000","last_fullsized":"2023-12-15T23:57:40.362232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:41:26.264663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3628,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345681+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:57:05.345681+0000","last_peered":"2023-12-15T23:57:05.345681+0000","last_clean":"2023-12-15T23:57:05.345681+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:57:05.345681+0000","last_undegraded":"2023-12-15T23:57:05.345681+0000","last_fullsized":"2023-12-15T23:57:05.345681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:01:11.119015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573007+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:57:00.573007+0000","last_peered":"2023-12-15T23:57:00.573007+0000","last_clean":"2023-12-15T23:57:00.573007+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:57:00.573007+0000","last_undegraded":"2023-12-15T23:57:00.573007+0000","last_fullsized":"2023-12-15T23:57:00.573007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345307+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:56:35.345307+0000","last_peered":"2023-12-15T23:56:35.345307+0000","last_clean":"2023-12-15T23:56:35.345307+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:56:35.345307+0000","last_undegraded":"2023-12-15T23:56:35.345307+0000","last_fullsized":"2023-12-15T23:56:35.345307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:05.380779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342047+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:56:20.342047+0000","last_peered":"2023-12-15T23:56:20.342047+0000","last_clean":"2023-12-15T23:56:20.342047+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:56:20.342047+0000","last_undegraded":"2023-12-15T23:56:20.342047+0000","last_fullsized":"2023-12-15T23:56:20.342047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:22.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341102+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:56:20.341102+0000","last_peered":"2023-12-15T23:56:20.341102+0000","last_clean":"2023-12-15T23:56:20.341102+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:56:20.341102+0000","last_undegraded":"2023-12-15T23:56:20.341102+0000","last_fullsized":"2023-12-15T23:56:20.341102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'15","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566777+0000","last_change":"2023-12-15T22:53:26.157853+0000","last_active":"2023-12-15T23:56:35.566777+0000","last_peered":"2023-12-15T23:56:35.566777+0000","last_clean":"2023-12-15T23:56:35.566777+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-15T23:56:35.566777+0000","last_undegraded":"2023-12-15T23:56:35.566777+0000","last_fullsized":"2023-12-15T23:56:35.566777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337000+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-15T23:56:00.337000+0000","last_peered":"2023-12-15T23:56:00.337000+0000","last_clean":"2023-12-15T23:56:00.337000+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-15T23:56:00.337000+0000","last_undegraded":"2023-12-15T23:56:00.337000+0000","last_fullsized":"2023-12-15T23:56:00.337000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.347051+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:57:10.347051+0000","last_peered":"2023-12-15T23:57:10.347051+0000","last_clean":"2023-12-15T23:57:10.347051+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:57:10.347051+0000","last_undegraded":"2023-12-15T23:57:10.347051+0000","last_fullsized":"2023-12-15T23:57:10.347051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:56:29.147167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326284+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-15T23:55:56.326284+0000","last_peered":"2023-12-15T23:55:56.326284+0000","last_clean":"2023-12-15T23:55:56.326284+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-15T23:55:56.326284+0000","last_undegraded":"2023-12-15T23:55:56.326284+0000","last_fullsized":"2023-12-15T23:55:56.326284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:33.642166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332245+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-15T23:55:40.332245+0000","last_peered":"2023-12-15T23:55:40.332245+0000","last_clean":"2023-12-15T23:55:40.332245+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-15T23:55:40.332245+0000","last_undegraded":"2023-12-15T23:55:40.332245+0000","last_fullsized":"2023-12-15T23:55:40.332245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329802+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-15T23:55:40.329802+0000","last_peered":"2023-12-15T23:55:40.329802+0000","last_clean":"2023-12-15T23:55:40.329802+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-15T23:55:40.329802+0000","last_undegraded":"2023-12-15T23:55:40.329802+0000","last_fullsized":"2023-12-15T23:55:40.329802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335944+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-15T23:56:00.335944+0000","last_peered":"2023-12-15T23:56:00.335944+0000","last_clean":"2023-12-15T23:56:00.335944+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-15T23:56:00.335944+0000","last_undegraded":"2023-12-15T23:56:00.335944+0000","last_fullsized":"2023-12-15T23:56:00.335944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:57.230909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583230+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-15T23:57:40.583230+0000","last_peered":"2023-12-15T23:57:40.583230+0000","last_clean":"2023-12-15T23:57:40.583230+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-15T23:57:40.583230+0000","last_undegraded":"2023-12-15T23:57:40.583230+0000","last_fullsized":"2023-12-15T23:57:40.583230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1274,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345598+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:57:05.345598+0000","last_peered":"2023-12-15T23:57:05.345598+0000","last_clean":"2023-12-15T23:57:05.345598+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:57:05.345598+0000","last_undegraded":"2023-12-15T23:57:05.345598+0000","last_fullsized":"2023-12-15T23:57:05.345598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:21.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573186+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:57:00.573186+0000","last_peered":"2023-12-15T23:57:00.573186+0000","last_clean":"2023-12-15T23:57:00.573186+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:57:00.573186+0000","last_undegraded":"2023-12-15T23:57:00.573186+0000","last_fullsized":"2023-12-15T23:57:00.573186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:30.130575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345396+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:56:35.345396+0000","last_peered":"2023-12-15T23:56:35.345396+0000","last_clean":"2023-12-15T23:56:35.345396+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:56:35.345396+0000","last_undegraded":"2023-12-15T23:56:35.345396+0000","last_fullsized":"2023-12-15T23:56:35.345396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342154+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:56:20.342154+0000","last_peered":"2023-12-15T23:56:20.342154+0000","last_clean":"2023-12-15T23:56:20.342154+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:56:20.342154+0000","last_undegraded":"2023-12-15T23:56:20.342154+0000","last_fullsized":"2023-12-15T23:56:20.342154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:41.240268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'185","reported_seq":372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340965+0000","last_change":"2023-12-15T22:53:28.164042+0000","last_active":"2023-12-15T23:56:20.340965+0000","last_peered":"2023-12-15T23:56:20.340965+0000","last_clean":"2023-12-15T23:56:20.340965+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-15T23:56:20.340965+0000","last_undegraded":"2023-12-15T23:56:20.340965+0000","last_fullsized":"2023-12-15T23:56:20.340965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:35.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331931+0000","last_change":"2023-12-15T22:53:26.160787+0000","last_active":"2023-12-15T23:56:16.331931+0000","last_peered":"2023-12-15T23:56:16.331931+0000","last_clean":"2023-12-15T23:56:16.331931+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-15T23:56:16.331931+0000","last_undegraded":"2023-12-15T23:56:16.331931+0000","last_fullsized":"2023-12-15T23:56:16.331931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:55.771958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331088+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:55:45.331088+0000","last_peered":"2023-12-15T23:55:45.331088+0000","last_clean":"2023-12-15T23:55:45.331088+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-15T23:55:45.331088+0000","last_undegraded":"2023-12-15T23:55:45.331088+0000","last_fullsized":"2023-12-15T23:55:45.331088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.360294+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:57:30.360294+0000","last_peered":"2023-12-15T23:57:30.360294+0000","last_clean":"2023-12-15T23:57:30.360294+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:57:30.360294+0000","last_undegraded":"2023-12-15T23:57:30.360294+0000","last_fullsized":"2023-12-15T23:57:30.360294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558888+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-15T23:56:05.558888+0000","last_peered":"2023-12-15T23:56:05.558888+0000","last_clean":"2023-12-15T23:56:05.558888+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-15T23:56:05.558888+0000","last_undegraded":"2023-12-15T23:56:05.558888+0000","last_fullsized":"2023-12-15T23:56:05.558888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:31.646743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321587+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-15T23:55:36.321587+0000","last_peered":"2023-12-15T23:55:36.321587+0000","last_clean":"2023-12-15T23:55:36.321587+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-15T23:55:36.321587+0000","last_undegraded":"2023-12-15T23:55:36.321587+0000","last_fullsized":"2023-12-15T23:55:36.321587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:22.684030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332350+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-15T23:55:40.332350+0000","last_peered":"2023-12-15T23:55:40.332350+0000","last_clean":"2023-12-15T23:55:40.332350+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-15T23:55:40.332350+0000","last_undegraded":"2023-12-15T23:55:40.332350+0000","last_fullsized":"2023-12-15T23:55:40.332350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334267+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-15T23:56:26.334267+0000","last_peered":"2023-12-15T23:56:26.334267+0000","last_clean":"2023-12-15T23:56:26.334267+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-15T23:56:26.334267+0000","last_undegraded":"2023-12-15T23:56:26.334267+0000","last_fullsized":"2023-12-15T23:56:26.334267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:17.634267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336045+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-15T23:56:25.336045+0000","last_peered":"2023-12-15T23:56:25.336045+0000","last_clean":"2023-12-15T23:56:25.336045+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-15T23:56:25.336045+0000","last_undegraded":"2023-12-15T23:56:25.336045+0000","last_fullsized":"2023-12-15T23:56:25.336045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:42.698596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587718+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-15T23:57:55.587718+0000","last_peered":"2023-12-15T23:57:55.587718+0000","last_clean":"2023-12-15T23:57:55.587718+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-15T23:57:55.587718+0000","last_undegraded":"2023-12-15T23:57:55.587718+0000","last_fullsized":"2023-12-15T23:57:55.587718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:27.446502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349717+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:57:31.349717+0000","last_peered":"2023-12-15T23:57:31.349717+0000","last_clean":"2023-12-15T23:57:31.349717+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:57:31.349717+0000","last_undegraded":"2023-12-15T23:57:31.349717+0000","last_fullsized":"2023-12-15T23:57:31.349717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343114+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-15T23:56:25.343114+0000","last_peered":"2023-12-15T23:56:25.343114+0000","last_clean":"2023-12-15T23:56:25.343114+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-15T23:56:25.343114+0000","last_undegraded":"2023-12-15T23:56:25.343114+0000","last_fullsized":"2023-12-15T23:56:25.343114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:07.455612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587659+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-15T23:57:55.587659+0000","last_peered":"2023-12-15T23:57:55.587659+0000","last_clean":"2023-12-15T23:57:55.587659+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-15T23:57:55.587659+0000","last_undegraded":"2023-12-15T23:57:55.587659+0000","last_fullsized":"2023-12-15T23:57:55.587659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351196+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:57:30.351196+0000","last_peered":"2023-12-15T23:57:30.351196+0000","last_clean":"2023-12-15T23:57:30.351196+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:57:30.351196+0000","last_undegraded":"2023-12-15T23:57:30.351196+0000","last_fullsized":"2023-12-15T23:57:30.351196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:08.012235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344047+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-15T23:56:30.344047+0000","last_peered":"2023-12-15T23:56:30.344047+0000","last_clean":"2023-12-15T23:56:30.344047+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-15T23:56:30.344047+0000","last_undegraded":"2023-12-15T23:56:30.344047+0000","last_fullsized":"2023-12-15T23:56:30.344047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365333+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-15T23:57:55.365333+0000","last_peered":"2023-12-15T23:57:55.365333+0000","last_clean":"2023-12-15T23:57:55.365333+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-15T23:57:55.365333+0000","last_undegraded":"2023-12-15T23:57:55.365333+0000","last_fullsized":"2023-12-15T23:57:55.365333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583197+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:57:40.583197+0000","last_peered":"2023-12-15T23:57:40.583197+0000","last_clean":"2023-12-15T23:57:40.583197+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:57:40.583197+0000","last_undegraded":"2023-12-15T23:57:40.583197+0000","last_fullsized":"2023-12-15T23:57:40.583197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341827+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-15T23:56:25.341827+0000","last_peered":"2023-12-15T23:56:25.341827+0000","last_clean":"2023-12-15T23:56:25.341827+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-15T23:56:25.341827+0000","last_undegraded":"2023-12-15T23:56:25.341827+0000","last_fullsized":"2023-12-15T23:56:25.341827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:34.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587497+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-15T23:57:55.587497+0000","last_peered":"2023-12-15T23:57:55.587497+0000","last_clean":"2023-12-15T23:57:55.587497+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-15T23:57:55.587497+0000","last_undegraded":"2023-12-15T23:57:55.587497+0000","last_fullsized":"2023-12-15T23:57:55.587497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363670+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:57:45.363670+0000","last_peered":"2023-12-15T23:57:45.363670+0000","last_clean":"2023-12-15T23:57:45.363670+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:57:45.363670+0000","last_undegraded":"2023-12-15T23:57:45.363670+0000","last_fullsized":"2023-12-15T23:57:45.363670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'5","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343413+0000","last_change":"2023-12-15T22:53:26.165809+0000","last_active":"2023-12-15T23:56:25.343413+0000","last_peered":"2023-12-15T23:56:25.343413+0000","last_clean":"2023-12-15T23:56:25.343413+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-15T23:56:25.343413+0000","last_undegraded":"2023-12-15T23:56:25.343413+0000","last_fullsized":"2023-12-15T23:56:25.343413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354702+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:57:45.354702+0000","last_peered":"2023-12-15T23:57:45.354702+0000","last_clean":"2023-12-15T23:57:45.354702+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:57:45.354702+0000","last_undegraded":"2023-12-15T23:57:45.354702+0000","last_fullsized":"2023-12-15T23:57:45.354702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:19.635825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366764+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-15T23:57:55.366764+0000","last_peered":"2023-12-15T23:57:55.366764+0000","last_clean":"2023-12-15T23:57:55.366764+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-15T23:57:55.366764+0000","last_undegraded":"2023-12-15T23:57:55.366764+0000","last_fullsized":"2023-12-15T23:57:55.366764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324460+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-15T23:55:46.324460+0000","last_peered":"2023-12-15T23:55:46.324460+0000","last_clean":"2023-12-15T23:55:46.324460+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-15T23:55:46.324460+0000","last_undegraded":"2023-12-15T23:55:46.324460+0000","last_fullsized":"2023-12-15T23:55:46.324460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.635572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349969+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:57:31.349969+0000","last_peered":"2023-12-15T23:57:31.349969+0000","last_clean":"2023-12-15T23:57:31.349969+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:57:31.349969+0000","last_undegraded":"2023-12-15T23:57:31.349969+0000","last_fullsized":"2023-12-15T23:57:31.349969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587564+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-15T23:57:55.587564+0000","last_peered":"2023-12-15T23:57:55.587564+0000","last_clean":"2023-12-15T23:57:55.587564+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-15T23:57:55.587564+0000","last_undegraded":"2023-12-15T23:57:55.587564+0000","last_fullsized":"2023-12-15T23:57:55.587564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'41","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564172+0000","last_change":"2023-12-15T22:53:26.155725+0000","last_active":"2023-12-15T23:56:25.564172+0000","last_peered":"2023-12-15T23:56:25.564172+0000","last_clean":"2023-12-15T23:56:25.564172+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-15T23:56:25.564172+0000","last_undegraded":"2023-12-15T23:56:25.564172+0000","last_fullsized":"2023-12-15T23:56:25.564172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580810+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:57:30.580810+0000","last_peered":"2023-12-15T23:57:30.580810+0000","last_clean":"2023-12-15T23:57:30.580810+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:57:30.580810+0000","last_undegraded":"2023-12-15T23:57:30.580810+0000","last_fullsized":"2023-12-15T23:57:30.580810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365999+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-15T23:57:55.365999+0000","last_peered":"2023-12-15T23:57:55.365999+0000","last_clean":"2023-12-15T23:57:55.365999+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-15T23:57:55.365999+0000","last_undegraded":"2023-12-15T23:57:55.365999+0000","last_fullsized":"2023-12-15T23:57:55.365999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339792+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:56:40.339792+0000","last_peered":"2023-12-15T23:56:40.339792+0000","last_clean":"2023-12-15T23:56:40.339792+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:56:40.339792+0000","last_undegraded":"2023-12-15T23:56:40.339792+0000","last_fullsized":"2023-12-15T23:56:40.339792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:46.435729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.358657+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:57:30.358657+0000","last_peered":"2023-12-15T23:57:30.358657+0000","last_clean":"2023-12-15T23:57:30.358657+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:57:30.358657+0000","last_undegraded":"2023-12-15T23:57:30.358657+0000","last_fullsized":"2023-12-15T23:57:30.358657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357081+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-15T23:57:55.357081+0000","last_peered":"2023-12-15T23:57:55.357081+0000","last_clean":"2023-12-15T23:57:55.357081+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-15T23:57:55.357081+0000","last_undegraded":"2023-12-15T23:57:55.357081+0000","last_fullsized":"2023-12-15T23:57:55.357081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:13:32.248104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'3","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366932+0000","last_change":"2023-12-15T22:53:26.155477+0000","last_active":"2023-12-15T23:58:00.366932+0000","last_peered":"2023-12-15T23:58:00.366932+0000","last_clean":"2023-12-15T23:58:00.366932+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-15T23:58:00.366932+0000","last_undegraded":"2023-12-15T23:58:00.366932+0000","last_fullsized":"2023-12-15T23:58:00.366932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:19.405614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336265+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-15T23:55:55.336265+0000","last_peered":"2023-12-15T23:55:55.336265+0000","last_clean":"2023-12-15T23:55:55.336265+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-15T23:55:55.336265+0000","last_undegraded":"2023-12-15T23:55:55.336265+0000","last_fullsized":"2023-12-15T23:55:55.336265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368735+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-15T23:58:10.368735+0000","last_peered":"2023-12-15T23:58:10.368735+0000","last_clean":"2023-12-15T23:58:10.368735+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-15T23:58:10.368735+0000","last_undegraded":"2023-12-15T23:58:10.368735+0000","last_fullsized":"2023-12-15T23:58:10.368735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.361584+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-15T23:58:15.361584+0000","last_peered":"2023-12-15T23:58:15.361584+0000","last_clean":"2023-12-15T23:58:15.361584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-15T23:58:15.361584+0000","last_undegraded":"2023-12-15T23:58:15.361584+0000","last_fullsized":"2023-12-15T23:58:15.361584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:45.682186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326761+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-15T23:55:56.326761+0000","last_peered":"2023-12-15T23:55:56.326761+0000","last_clean":"2023-12-15T23:55:56.326761+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-15T23:55:56.326761+0000","last_undegraded":"2023-12-15T23:55:56.326761+0000","last_fullsized":"2023-12-15T23:55:56.326761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335682+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-15T23:55:55.335682+0000","last_peered":"2023-12-15T23:55:55.335682+0000","last_clean":"2023-12-15T23:55:55.335682+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-15T23:55:55.335682+0000","last_undegraded":"2023-12-15T23:55:55.335682+0000","last_fullsized":"2023-12-15T23:55:55.335682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:09.497036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367621+0000","last_change":"2023-12-15T22:53:26.158639+0000","last_active":"2023-12-15T23:58:00.367621+0000","last_peered":"2023-12-15T23:58:00.367621+0000","last_clean":"2023-12-15T23:58:00.367621+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-15T23:58:00.367621+0000","last_undegraded":"2023-12-15T23:58:00.367621+0000","last_fullsized":"2023-12-15T23:58:00.367621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:32.844238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332721+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-15T23:56:10.332721+0000","last_peered":"2023-12-15T23:56:10.332721+0000","last_clean":"2023-12-15T23:56:10.332721+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-15T23:56:10.332721+0000","last_undegraded":"2023-12-15T23:56:10.332721+0000","last_fullsized":"2023-12-15T23:56:10.332721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:03.393324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335654+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-15T23:55:55.335654+0000","last_peered":"2023-12-15T23:55:55.335654+0000","last_clean":"2023-12-15T23:55:55.335654+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-15T23:55:55.335654+0000","last_undegraded":"2023-12-15T23:55:55.335654+0000","last_fullsized":"2023-12-15T23:55:55.335654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:13.846874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'19","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.357925+0000","last_change":"2023-12-15T22:53:26.165805+0000","last_active":"2023-12-15T23:58:00.357925+0000","last_peered":"2023-12-15T23:58:00.357925+0000","last_clean":"2023-12-15T23:58:00.357925+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-15T23:58:00.357925+0000","last_undegraded":"2023-12-15T23:58:00.357925+0000","last_fullsized":"2023-12-15T23:58:00.357925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:03.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334511+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-15T23:55:55.334511+0000","last_peered":"2023-12-15T23:55:55.334511+0000","last_clean":"2023-12-15T23:55:55.334511+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-15T23:55:55.334511+0000","last_undegraded":"2023-12-15T23:55:55.334511+0000","last_fullsized":"2023-12-15T23:55:55.334511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335851+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-15T23:55:55.335851+0000","last_peered":"2023-12-15T23:55:55.335851+0000","last_clean":"2023-12-15T23:55:55.335851+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-15T23:55:55.335851+0000","last_undegraded":"2023-12-15T23:55:55.335851+0000","last_fullsized":"2023-12-15T23:55:55.335851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340606+0000","last_change":"2023-12-15T22:53:26.165548+0000","last_active":"2023-12-15T23:56:15.340606+0000","last_peered":"2023-12-15T23:56:15.340606+0000","last_clean":"2023-12-15T23:56:15.340606+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-15T23:56:15.340606+0000","last_undegraded":"2023-12-15T23:56:15.340606+0000","last_fullsized":"2023-12-15T23:56:15.340606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326506+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-15T23:55:56.326506+0000","last_peered":"2023-12-15T23:55:56.326506+0000","last_clean":"2023-12-15T23:55:56.326506+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-15T23:55:56.326506+0000","last_undegraded":"2023-12-15T23:55:56.326506+0000","last_fullsized":"2023-12-15T23:55:56.326506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:05.103262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334464+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-15T23:55:55.334464+0000","last_peered":"2023-12-15T23:55:55.334464+0000","last_clean":"2023-12-15T23:55:55.334464+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-15T23:55:55.334464+0000","last_undegraded":"2023-12-15T23:55:55.334464+0000","last_fullsized":"2023-12-15T23:55:55.334464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'4","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.334068+0000","last_change":"2023-12-15T22:53:26.162667+0000","last_active":"2023-12-15T23:56:15.334068+0000","last_peered":"2023-12-15T23:56:15.334068+0000","last_clean":"2023-12-15T23:56:15.334068+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-15T23:56:15.334068+0000","last_undegraded":"2023-12-15T23:56:15.334068+0000","last_fullsized":"2023-12-15T23:56:15.334068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:35.730252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335764+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-15T23:55:55.335764+0000","last_peered":"2023-12-15T23:55:55.335764+0000","last_clean":"2023-12-15T23:55:55.335764+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-15T23:55:55.335764+0000","last_undegraded":"2023-12-15T23:55:55.335764+0000","last_fullsized":"2023-12-15T23:55:55.335764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338439+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-15T23:56:10.338439+0000","last_peered":"2023-12-15T23:56:10.338439+0000","last_clean":"2023-12-15T23:56:10.338439+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-15T23:56:10.338439+0000","last_undegraded":"2023-12-15T23:56:10.338439+0000","last_fullsized":"2023-12-15T23:56:10.338439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333909+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-15T23:56:15.333909+0000","last_peered":"2023-12-15T23:56:15.333909+0000","last_clean":"2023-12-15T23:56:15.333909+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-15T23:56:15.333909+0000","last_undegraded":"2023-12-15T23:56:15.333909+0000","last_fullsized":"2023-12-15T23:56:15.333909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:29:17.328062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556616+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-15T23:55:55.556616+0000","last_peered":"2023-12-15T23:55:55.556616+0000","last_clean":"2023-12-15T23:55:55.556616+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-15T23:55:55.556616+0000","last_undegraded":"2023-12-15T23:55:55.556616+0000","last_fullsized":"2023-12-15T23:55:55.556616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328947+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-15T23:55:55.328947+0000","last_peered":"2023-12-15T23:55:55.328947+0000","last_clean":"2023-12-15T23:55:55.328947+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-15T23:55:55.328947+0000","last_undegraded":"2023-12-15T23:55:55.328947+0000","last_fullsized":"2023-12-15T23:55:55.328947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'22","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340969+0000","last_change":"2023-12-15T22:53:26.161460+0000","last_active":"2023-12-15T23:56:15.340969+0000","last_peered":"2023-12-15T23:56:15.340969+0000","last_clean":"2023-12-15T23:56:15.340969+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-15T23:56:15.340969+0000","last_undegraded":"2023-12-15T23:56:15.340969+0000","last_fullsized":"2023-12-15T23:56:15.340969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:57.157307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369558+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-15T23:58:10.369558+0000","last_peered":"2023-12-15T23:58:10.369558+0000","last_clean":"2023-12-15T23:58:10.369558+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-15T23:58:10.369558+0000","last_undegraded":"2023-12-15T23:58:10.369558+0000","last_fullsized":"2023-12-15T23:58:10.369558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336071+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-15T23:55:55.336071+0000","last_peered":"2023-12-15T23:55:55.336071+0000","last_clean":"2023-12-15T23:55:55.336071+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-15T23:55:55.336071+0000","last_undegraded":"2023-12-15T23:55:55.336071+0000","last_fullsized":"2023-12-15T23:55:55.336071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335777+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-15T23:55:55.335777+0000","last_peered":"2023-12-15T23:55:55.335777+0000","last_clean":"2023-12-15T23:55:55.335777+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-15T23:55:55.335777+0000","last_undegraded":"2023-12-15T23:55:55.335777+0000","last_fullsized":"2023-12-15T23:55:55.335777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:38.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.333892+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-15T23:55:55.333892+0000","last_peered":"2023-12-15T23:55:55.333892+0000","last_clean":"2023-12-15T23:55:55.333892+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-15T23:55:55.333892+0000","last_undegraded":"2023-12-15T23:55:55.333892+0000","last_fullsized":"2023-12-15T23:55:55.333892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337514+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-15T23:56:00.337514+0000","last_peered":"2023-12-15T23:56:00.337514+0000","last_clean":"2023-12-15T23:56:00.337514+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-15T23:56:00.337514+0000","last_undegraded":"2023-12-15T23:56:00.337514+0000","last_fullsized":"2023-12-15T23:56:00.337514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328806+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-15T23:55:55.328806+0000","last_peered":"2023-12-15T23:55:55.328806+0000","last_clean":"2023-12-15T23:55:55.328806+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-15T23:55:55.328806+0000","last_undegraded":"2023-12-15T23:55:55.328806+0000","last_fullsized":"2023-12-15T23:55:55.328806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:55.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556597+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-15T23:55:55.556597+0000","last_peered":"2023-12-15T23:55:55.556597+0000","last_clean":"2023-12-15T23:55:55.556597+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-15T23:55:55.556597+0000","last_undegraded":"2023-12-15T23:55:55.556597+0000","last_fullsized":"2023-12-15T23:55:55.556597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333280+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-15T23:55:45.333280+0000","last_peered":"2023-12-15T23:55:45.333280+0000","last_clean":"2023-12-15T23:55:45.333280+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-15T23:55:45.333280+0000","last_undegraded":"2023-12-15T23:55:45.333280+0000","last_fullsized":"2023-12-15T23:55:45.333280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":599,"ondisk_log_size":599,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22796,"ondisk_log_size":22796,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608376,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.627,"5min":0.69899999999999995,"15min":0.72299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.68400000000000005},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.626,"5min":0.67700000000000005,"15min":0.78200000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.377,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.74199999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.61899999999999999},"last":0.443}]},{"osd":5,"last update":"Fri Dec 15 23:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.375,"15min":0.373},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.52500000000000002,"5min":0.60099999999999998,"15min":1.149},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.64500000000000002},"last":0.40500000000000003}]}]},{"osd":5,"up_from":11,"seq":47244641078,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.495}]},{"osd":1,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71699999999999997,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.754,"15min":0.754},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.372,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.48399999999999999,"5min":0.56699999999999995,"15min":0.63},"last":0.374}]},{"osd":4,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641080,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Dec 15 23:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.27800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.502,"15min":0.80100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45200000000000001,"5min":0.57399999999999995,"15min":0.78700000000000003},"last":0.372}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.38700000000000001}]}]},{"osd":2,"up_from":11,"seq":47244641077,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.193},"max":{"1min":0.55500000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.48499999999999999,"5min":0.87,"15min":0.87},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.35799999999999998},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52400000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.29399999999999998},"max":{"1min":0.77200000000000002,"5min":1.169,"15min":1.169},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70999999999999996}]}]},{"osd":1,"up_from":11,"seq":47244641078,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47132,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810468,"statfs":{"total":107374182400,"available":107325919232,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.436,"5min":0.48699999999999999,"15min":0.53100000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51700000000000002,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.377}]},{"osd":2,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.72799999999999998,"15min":0.75700000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":0.878},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.622}]}]},{"osd":0,"up_from":11,"seq":47244641078,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.315},"min":{"1min":0.224,"5min":0.21099999999999999,"15min":0.17299999999999999},"max":{"1min":0.44900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.20799999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.373},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.22800000000000001},"max":{"1min":0.746,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.23999999999999999},"max":{"1min":0.73699999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.875,"15min":0.875},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.78900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:00:24.298 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2023-12-16T00:00:24.579 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:24.580 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"ca043eb7-b8b1-425e-9d77-8b4dba62c7c4","created":"2023-12-15T22:51:56.150553+0000","modified":"2023-12-15T23:09:02.287707+0000","last_up_change":"2023-12-15T22:52:05.581827+0000","last_in_change":"2023-12-15T22:51:57.782156+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-12-15T22:52:05.989487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-12-15T22:52:06.248998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2023-12-15T22:52:51.745456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2023-12-15T22:52:53.486972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2023-12-15T22:53:02.948027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2023-12-15T22:53:04.361038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2023-12-15T22:53:06.344347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2023-12-15T22:53:08.384069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"test-zone1.rgw.buckets.data","create_time":"2023-12-15T22:53:24.456993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"test-zone1.rgw.log","create_time":"2023-12-15T22:53:26.331547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test-zone1.rgw.control","create_time":"2023-12-15T22:53:28.190015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test-zone1.rgw.meta","create_time":"2023-12-15T22:53:30.227082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test-zone1.rgw.otp","create_time":"2023-12-15T22:53:56.623788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test-zone1.rgw.buckets.index","create_time":"2023-12-15T22:54:03.027184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"test-zone1.rgw.buckets.non-ec","create_time":"2023-12-15T23:08:36.139771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2895c77-ea02-472e-8365-2c4168dc7216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6809","nonce":3795688080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6811","nonce":3795688080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6815","nonce":3795688080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3795688080},{"type":"v1","addr":"172.21.15.93:6813","nonce":3795688080}]},"public_addr":"172.21.15.93:6809/3795688080","cluster_addr":"172.21.15.93:6811/3795688080","heartbeat_back_addr":"172.21.15.93:6815/3795688080","heartbeat_front_addr":"172.21.15.93:6813/3795688080","state":["exists","up"]},{"osd":1,"uuid":"d11b8e90-0a3c-41fe-8376-2deb8ea4c388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6801","nonce":1313249003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6803","nonce":1313249003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6807","nonce":1313249003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1313249003},{"type":"v1","addr":"172.21.15.93:6805","nonce":1313249003}]},"public_addr":"172.21.15.93:6801/1313249003","cluster_addr":"172.21.15.93:6803/1313249003","heartbeat_back_addr":"172.21.15.93:6807/1313249003","heartbeat_front_addr":"172.21.15.93:6805/1313249003","state":["exists","up"]},{"osd":2,"uuid":"01a766eb-4905-4f0f-88b3-272b0bd4265b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6817","nonce":1745339019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6819","nonce":1745339019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6823","nonce":1745339019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1745339019},{"type":"v1","addr":"172.21.15.93:6821","nonce":1745339019}]},"public_addr":"172.21.15.93:6817/1745339019","cluster_addr":"172.21.15.93:6819/1745339019","heartbeat_back_addr":"172.21.15.93:6823/1745339019","heartbeat_front_addr":"172.21.15.93:6821/1745339019","state":["exists","up"]},{"osd":3,"uuid":"c4e80006-d170-4303-816b-0249ee0f62a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6817","nonce":3659828503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6819","nonce":3659828503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6823","nonce":3659828503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3659828503},{"type":"v1","addr":"172.21.15.183:6821","nonce":3659828503}]},"public_addr":"172.21.15.183:6817/3659828503","cluster_addr":"172.21.15.183:6819/3659828503","heartbeat_back_addr":"172.21.15.183:6823/3659828503","heartbeat_front_addr":"172.21.15.183:6821/3659828503","state":["exists","up"]},{"osd":4,"uuid":"a43f287a-5db3-475d-8a39-cb5a33400bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6809","nonce":3040168975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6811","nonce":3040168975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6815","nonce":3040168975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3040168975},{"type":"v1","addr":"172.21.15.183:6813","nonce":3040168975}]},"public_addr":"172.21.15.183:6809/3040168975","cluster_addr":"172.21.15.183:6811/3040168975","heartbeat_back_addr":"172.21.15.183:6815/3040168975","heartbeat_front_addr":"172.21.15.183:6813/3040168975","state":["exists","up"]},{"osd":5,"uuid":"886ec69f-1076-4e87-a873-fbeb53284364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6801","nonce":4200067776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6803","nonce":4200067776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6807","nonce":4200067776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":4200067776},{"type":"v1","addr":"172.21.15.183:6805","nonce":4200067776}]},"public_addr":"172.21.15.183:6801/4200067776","cluster_addr":"172.21.15.183:6803/4200067776","heartbeat_back_addr":"172.21.15.183:6807/4200067776","heartbeat_front_addr":"172.21.15.183:6805/4200067776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.159139+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.094022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.098210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.215926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.153298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-15T22:52:02.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.20","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":3,"to":1}]},{"pgid":"3.3d","mappings":[{"from":0,"to":1}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]},{"pgid":"9.17","mappings":[{"from":3,"to":4}]},{"pgid":"9.1e","mappings":[{"from":3,"to":5}]},{"pgid":"9.1f","mappings":[{"from":1,"to":4}]},{"pgid":"9.2f","mappings":[{"from":2,"to":4}]},{"pgid":"12.1c","mappings":[{"from":0,"to":3}]},{"pgid":"14.0","mappings":[{"from":0,"to":3}]},{"pgid":"14.19","mappings":[{"from":3,"to":5}]},{"pgid":"14.1a","mappings":[{"from":0,"to":5}]},{"pgid":"15.c","mappings":[{"from":4,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T00:00:25.592 INFO:tasks.ceph:Scrubbing c1.osd.0 2023-12-16T00:00:25.593 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:25.724 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:25.724 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:25.725 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:25.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 0 2023-12-16T00:00:26.014 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 0 to deep-scrub 2023-12-16T00:00:26.027 INFO:tasks.ceph:Scrubbing c1.osd.1 2023-12-16T00:00:26.027 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:26.149 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:26.149 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:26.149 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:26.159 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 1 2023-12-16T00:00:26.438 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 1 to deep-scrub 2023-12-16T00:00:26.451 INFO:tasks.ceph:Scrubbing c1.osd.2 2023-12-16T00:00:26.451 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:26.573 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:26.574 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:26.574 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:26.584 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 2 2023-12-16T00:00:26.862 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 2 to deep-scrub 2023-12-16T00:00:26.875 INFO:tasks.ceph:Scrubbing c1.osd.3 2023-12-16T00:00:26.875 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:26.999 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:27.000 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:27.000 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:27.010 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 3 2023-12-16T00:00:27.286 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 3 to deep-scrub 2023-12-16T00:00:27.299 INFO:tasks.ceph:Scrubbing c1.osd.4 2023-12-16T00:00:27.299 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:27.422 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:27.423 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:27.423 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:27.433 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 4 2023-12-16T00:00:27.710 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 4 to deep-scrub 2023-12-16T00:00:27.722 INFO:tasks.ceph:Scrubbing c1.osd.5 2023-12-16T00:00:27.722 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-16T00:00:27.846 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-16T00:00:27.846 INFO:teuthology.orchestra.run.smithi093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T00:00:27.846 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-16T00:00:27.857 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 5 2023-12-16T00:00:28.135 INFO:teuthology.orchestra.run.smithi093.stderr:instructed osd(s) 5 to deep-scrub 2023-12-16T00:00:28.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:00:28.467 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:28.486 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:00:28.489 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2100,"stamp":"2023-12-16T00:00:28.173220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34355,"ondisk_log_size":34355,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":269080,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":259190,"kb_avail":628876520,"statfs":{"total":644245094400,"available":643969556480,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":265411233},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006105"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561765+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-15T23:56:15.561765+0000","last_peered":"2023-12-15T23:56:15.561765+0000","last_clean":"2023-12-15T23:56:15.561765+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-15T23:56:15.561765+0000","last_undegraded":"2023-12-15T23:56:15.561765+0000","last_fullsized":"2023-12-15T23:56:15.561765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359557+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:57:30.359557+0000","last_peered":"2023-12-15T23:57:30.359557+0000","last_clean":"2023-12-15T23:57:30.359557+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:57:30.359557+0000","last_undegraded":"2023-12-15T23:57:30.359557+0000","last_fullsized":"2023-12-15T23:57:30.359557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.364756+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-15T23:57:55.364756+0000","last_peered":"2023-12-15T23:57:55.364756+0000","last_clean":"2023-12-15T23:57:55.364756+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-15T23:57:55.364756+0000","last_undegraded":"2023-12-15T23:57:55.364756+0000","last_fullsized":"2023-12-15T23:57:55.364756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:16:04.440737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340462+0000","last_change":"2023-12-15T22:53:26.165400+0000","last_active":"2023-12-15T23:56:15.340462+0000","last_peered":"2023-12-15T23:56:15.340462+0000","last_clean":"2023-12-15T23:56:15.340462+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-15T23:56:15.340462+0000","last_undegraded":"2023-12-15T23:56:15.340462+0000","last_fullsized":"2023-12-15T23:56:15.340462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581276+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:57:30.581276+0000","last_peered":"2023-12-15T23:57:30.581276+0000","last_clean":"2023-12-15T23:57:30.581276+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:57:30.581276+0000","last_undegraded":"2023-12-15T23:57:30.581276+0000","last_fullsized":"2023-12-15T23:57:30.581276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365604+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-15T23:57:55.365604+0000","last_peered":"2023-12-15T23:57:55.365604+0000","last_clean":"2023-12-15T23:57:55.365604+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-15T23:57:55.365604+0000","last_undegraded":"2023-12-15T23:57:55.365604+0000","last_fullsized":"2023-12-15T23:57:55.365604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335549+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:56:31.335549+0000","last_peered":"2023-12-15T23:56:31.335549+0000","last_clean":"2023-12-15T23:56:31.335549+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:56:31.335549+0000","last_undegraded":"2023-12-15T23:56:31.335549+0000","last_fullsized":"2023-12-15T23:56:31.335549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:22.850613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583442+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:57:40.583442+0000","last_peered":"2023-12-15T23:57:40.583442+0000","last_clean":"2023-12-15T23:57:40.583442+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:57:40.583442+0000","last_undegraded":"2023-12-15T23:57:40.583442+0000","last_fullsized":"2023-12-15T23:57:40.583442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356271+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-15T23:57:56.356271+0000","last_peered":"2023-12-15T23:57:56.356271+0000","last_clean":"2023-12-15T23:57:56.356271+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-15T23:57:56.356271+0000","last_undegraded":"2023-12-15T23:57:56.356271+0000","last_fullsized":"2023-12-15T23:57:56.356271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:34.568365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.561835+0000","last_change":"2023-12-15T22:53:26.155908+0000","last_active":"2023-12-15T23:56:15.561835+0000","last_peered":"2023-12-15T23:56:15.561835+0000","last_clean":"2023-12-15T23:56:15.561835+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-15T23:56:15.561835+0000","last_undegraded":"2023-12-15T23:56:15.561835+0000","last_fullsized":"2023-12-15T23:56:15.561835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354290+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:57:10.354290+0000","last_peered":"2023-12-15T23:57:10.354290+0000","last_clean":"2023-12-15T23:57:10.354290+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:57:10.354290+0000","last_undegraded":"2023-12-15T23:57:10.354290+0000","last_fullsized":"2023-12-15T23:57:10.354290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366702+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-15T23:57:55.366702+0000","last_peered":"2023-12-15T23:57:55.366702+0000","last_clean":"2023-12-15T23:57:55.366702+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-15T23:57:55.366702+0000","last_undegraded":"2023-12-15T23:57:55.366702+0000","last_fullsized":"2023-12-15T23:57:55.366702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:38.035228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334057+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-15T23:56:26.334057+0000","last_peered":"2023-12-15T23:56:26.334057+0000","last_clean":"2023-12-15T23:56:26.334057+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-15T23:56:26.334057+0000","last_undegraded":"2023-12-15T23:56:26.334057+0000","last_fullsized":"2023-12-15T23:56:26.334057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:32.140453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365773+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-15T23:57:55.365773+0000","last_peered":"2023-12-15T23:57:55.365773+0000","last_clean":"2023-12-15T23:57:55.365773+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-15T23:57:55.365773+0000","last_undegraded":"2023-12-15T23:57:55.365773+0000","last_fullsized":"2023-12-15T23:57:55.365773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354303+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:57:10.354303+0000","last_peered":"2023-12-15T23:57:10.354303+0000","last_clean":"2023-12-15T23:57:10.354303+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:57:10.354303+0000","last_undegraded":"2023-12-15T23:57:10.354303+0000","last_fullsized":"2023-12-15T23:57:10.354303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'5","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343007+0000","last_change":"2023-12-15T22:53:26.162283+0000","last_active":"2023-12-15T23:56:25.343007+0000","last_peered":"2023-12-15T23:56:25.343007+0000","last_clean":"2023-12-15T23:56:25.343007+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-15T23:56:25.343007+0000","last_undegraded":"2023-12-15T23:56:25.343007+0000","last_fullsized":"2023-12-15T23:56:25.343007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.364964+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-15T23:57:55.364964+0000","last_peered":"2023-12-15T23:57:55.364964+0000","last_clean":"2023-12-15T23:57:55.364964+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-15T23:57:55.364964+0000","last_undegraded":"2023-12-15T23:57:55.364964+0000","last_fullsized":"2023-12-15T23:57:55.364964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350353+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:57:31.350353+0000","last_peered":"2023-12-15T23:57:31.350353+0000","last_clean":"2023-12-15T23:57:31.350353+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:57:31.350353+0000","last_undegraded":"2023-12-15T23:57:31.350353+0000","last_fullsized":"2023-12-15T23:57:31.350353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'8","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339456+0000","last_change":"2023-12-15T22:53:26.156995+0000","last_active":"2023-12-15T23:56:15.339456+0000","last_peered":"2023-12-15T23:56:15.339456+0000","last_clean":"2023-12-15T23:56:15.339456+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-15T23:56:15.339456+0000","last_undegraded":"2023-12-15T23:56:15.339456+0000","last_fullsized":"2023-12-15T23:56:15.339456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:02.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365563+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-15T23:57:55.365563+0000","last_peered":"2023-12-15T23:57:55.365563+0000","last_clean":"2023-12-15T23:57:55.365563+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-15T23:57:55.365563+0000","last_undegraded":"2023-12-15T23:57:55.365563+0000","last_fullsized":"2023-12-15T23:57:55.365563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359263+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:57:30.359263+0000","last_peered":"2023-12-15T23:57:30.359263+0000","last_clean":"2023-12-15T23:57:30.359263+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:57:30.359263+0000","last_undegraded":"2023-12-15T23:57:30.359263+0000","last_fullsized":"2023-12-15T23:57:30.359263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337739+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:56:41.337739+0000","last_peered":"2023-12-15T23:56:41.337739+0000","last_clean":"2023-12-15T23:56:41.337739+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:56:41.337739+0000","last_undegraded":"2023-12-15T23:56:41.337739+0000","last_fullsized":"2023-12-15T23:56:41.337739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:21:05.670759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356609+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-15T23:57:55.356609+0000","last_peered":"2023-12-15T23:57:55.356609+0000","last_clean":"2023-12-15T23:57:55.356609+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-15T23:57:55.356609+0000","last_undegraded":"2023-12-15T23:57:55.356609+0000","last_fullsized":"2023-12-15T23:57:55.356609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:38.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351612+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:57:30.351612+0000","last_peered":"2023-12-15T23:57:30.351612+0000","last_clean":"2023-12-15T23:57:30.351612+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:57:30.351612+0000","last_undegraded":"2023-12-15T23:57:30.351612+0000","last_fullsized":"2023-12-15T23:57:30.351612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:11.503638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'10","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366685+0000","last_change":"2023-12-15T22:53:26.164117+0000","last_active":"2023-12-15T23:58:00.366685+0000","last_peered":"2023-12-15T23:58:00.366685+0000","last_clean":"2023-12-15T23:58:00.366685+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-15T23:58:00.366685+0000","last_undegraded":"2023-12-15T23:58:00.366685+0000","last_fullsized":"2023-12-15T23:58:00.366685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:38.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326264+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-15T23:55:56.326264+0000","last_peered":"2023-12-15T23:55:56.326264+0000","last_clean":"2023-12-15T23:55:56.326264+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-15T23:55:56.326264+0000","last_undegraded":"2023-12-15T23:55:56.326264+0000","last_fullsized":"2023-12-15T23:55:56.326264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:07.802909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559391+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-15T23:56:05.559391+0000","last_peered":"2023-12-15T23:56:05.559391+0000","last_clean":"2023-12-15T23:56:05.559391+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-15T23:56:05.559391+0000","last_undegraded":"2023-12-15T23:56:05.559391+0000","last_fullsized":"2023-12-15T23:56:05.559391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:37.299376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'10","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361963+0000","last_change":"2023-12-15T22:53:26.161032+0000","last_active":"2023-12-15T23:57:40.361963+0000","last_peered":"2023-12-15T23:57:40.361963+0000","last_clean":"2023-12-15T23:57:40.361963+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-15T23:57:40.361963+0000","last_undegraded":"2023-12-15T23:57:40.361963+0000","last_fullsized":"2023-12-15T23:57:40.361963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:26.370938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335545+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-15T23:55:55.335545+0000","last_peered":"2023-12-15T23:55:55.335545+0000","last_clean":"2023-12-15T23:55:55.335545+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-15T23:55:55.335545+0000","last_undegraded":"2023-12-15T23:55:55.335545+0000","last_fullsized":"2023-12-15T23:55:55.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331592+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-15T23:55:45.331592+0000","last_peered":"2023-12-15T23:55:45.331592+0000","last_clean":"2023-12-15T23:55:45.331592+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-15T23:55:45.331592+0000","last_undegraded":"2023-12-15T23:55:45.331592+0000","last_fullsized":"2023-12-15T23:55:45.331592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'28","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358304+0000","last_change":"2023-12-15T22:53:26.162543+0000","last_active":"2023-12-15T23:58:00.358304+0000","last_peered":"2023-12-15T23:58:00.358304+0000","last_clean":"2023-12-15T23:58:00.358304+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-15T23:58:00.358304+0000","last_undegraded":"2023-12-15T23:58:00.358304+0000","last_fullsized":"2023-12-15T23:58:00.358304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:06.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339086+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-15T23:56:10.339086+0000","last_peered":"2023-12-15T23:56:10.339086+0000","last_clean":"2023-12-15T23:56:10.339086+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-15T23:56:10.339086+0000","last_undegraded":"2023-12-15T23:56:10.339086+0000","last_fullsized":"2023-12-15T23:56:10.339086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333163+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-15T23:55:45.333163+0000","last_peered":"2023-12-15T23:55:45.333163+0000","last_clean":"2023-12-15T23:55:45.333163+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-15T23:55:45.333163+0000","last_undegraded":"2023-12-15T23:55:45.333163+0000","last_fullsized":"2023-12-15T23:55:45.333163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.358223+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-15T23:58:00.358223+0000","last_peered":"2023-12-15T23:58:00.358223+0000","last_clean":"2023-12-15T23:58:00.358223+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-15T23:58:00.358223+0000","last_undegraded":"2023-12-15T23:58:00.358223+0000","last_fullsized":"2023-12-15T23:58:00.358223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:34.225706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326624+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-15T23:55:45.326624+0000","last_peered":"2023-12-15T23:55:45.326624+0000","last_clean":"2023-12-15T23:55:45.326624+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-15T23:55:45.326624+0000","last_undegraded":"2023-12-15T23:55:45.326624+0000","last_fullsized":"2023-12-15T23:55:45.326624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:09.630988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324219+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-15T23:55:46.324219+0000","last_peered":"2023-12-15T23:55:46.324219+0000","last_clean":"2023-12-15T23:55:46.324219+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-15T23:55:46.324219+0000","last_undegraded":"2023-12-15T23:55:46.324219+0000","last_fullsized":"2023-12-15T23:55:46.324219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:08.196454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334011+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-15T23:55:55.334011+0000","last_peered":"2023-12-15T23:55:55.334011+0000","last_clean":"2023-12-15T23:55:55.334011+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-15T23:55:55.334011+0000","last_undegraded":"2023-12-15T23:55:55.334011+0000","last_fullsized":"2023-12-15T23:55:55.334011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326697+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-15T23:55:45.326697+0000","last_peered":"2023-12-15T23:55:45.326697+0000","last_clean":"2023-12-15T23:55:45.326697+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-15T23:55:45.326697+0000","last_undegraded":"2023-12-15T23:55:45.326697+0000","last_fullsized":"2023-12-15T23:55:45.326697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:58.756424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333465+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-15T23:55:45.333465+0000","last_peered":"2023-12-15T23:55:45.333465+0000","last_clean":"2023-12-15T23:55:45.333465+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-15T23:55:45.333465+0000","last_undegraded":"2023-12-15T23:55:45.333465+0000","last_fullsized":"2023-12-15T23:55:45.333465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:03.096660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328420+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-15T23:55:55.328420+0000","last_peered":"2023-12-15T23:55:55.328420+0000","last_clean":"2023-12-15T23:55:55.328420+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-15T23:55:55.328420+0000","last_undegraded":"2023-12-15T23:55:55.328420+0000","last_fullsized":"2023-12-15T23:55:55.328420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:24.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:46.324294+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-15T23:55:46.324294+0000","last_peered":"2023-12-15T23:55:46.324294+0000","last_clean":"2023-12-15T23:55:46.324294+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-15T23:55:46.324294+0000","last_undegraded":"2023-12-15T23:55:46.324294+0000","last_fullsized":"2023-12-15T23:55:46.324294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339461+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-15T23:56:10.339461+0000","last_peered":"2023-12-15T23:56:10.339461+0000","last_clean":"2023-12-15T23:56:10.339461+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-15T23:56:10.339461+0000","last_undegraded":"2023-12-15T23:56:10.339461+0000","last_fullsized":"2023-12-15T23:56:10.339461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566972+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-15T23:56:35.566972+0000","last_peered":"2023-12-15T23:56:35.566972+0000","last_clean":"2023-12-15T23:56:35.566972+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-15T23:56:35.566972+0000","last_undegraded":"2023-12-15T23:56:35.566972+0000","last_fullsized":"2023-12-15T23:56:35.566972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1693,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.372653+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-15T23:58:20.372653+0000","last_peered":"2023-12-15T23:58:20.372653+0000","last_clean":"2023-12-15T23:58:20.372653+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-15T23:58:20.372653+0000","last_undegraded":"2023-12-15T23:58:20.372653+0000","last_fullsized":"2023-12-15T23:58:20.372653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343290+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:56:30.343290+0000","last_peered":"2023-12-15T23:56:30.343290+0000","last_clean":"2023-12-15T23:56:30.343290+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:56:30.343290+0000","last_undegraded":"2023-12-15T23:56:30.343290+0000","last_fullsized":"2023-12-15T23:56:30.343290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360588+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-15T23:57:35.360588+0000","last_peered":"2023-12-15T23:57:35.360588+0000","last_clean":"2023-12-15T23:57:35.360588+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-15T23:57:35.360588+0000","last_undegraded":"2023-12-15T23:57:35.360588+0000","last_fullsized":"2023-12-15T23:57:35.360588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:45.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327893+0000","last_change":"2023-12-15T22:53:30.178391+0000","last_active":"2023-12-15T23:56:01.327893+0000","last_peered":"2023-12-15T23:56:01.327893+0000","last_clean":"2023-12-15T23:56:01.327893+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-15T23:56:01.327893+0000","last_undegraded":"2023-12-15T23:56:01.327893+0000","last_fullsized":"2023-12-15T23:56:01.327893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:53.334878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'309","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335674+0000","last_change":"2023-12-15T22:53:28.165506+0000","last_active":"2023-12-15T23:56:00.335674+0000","last_peered":"2023-12-15T23:56:00.335674+0000","last_clean":"2023-12-15T23:56:00.335674+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-15T23:56:00.335674+0000","last_undegraded":"2023-12-15T23:56:00.335674+0000","last_fullsized":"2023-12-15T23:56:00.335674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:40.852277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337214+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:56:30.337214+0000","last_peered":"2023-12-15T23:56:30.337214+0000","last_clean":"2023-12-15T23:56:30.337214+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:56:30.337214+0000","last_undegraded":"2023-12-15T23:56:30.337214+0000","last_fullsized":"2023-12-15T23:56:30.337214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:33.452389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327638+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-15T23:56:01.327638+0000","last_peered":"2023-12-15T23:56:01.327638+0000","last_clean":"2023-12-15T23:56:01.327638+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-15T23:56:01.327638+0000","last_undegraded":"2023-12-15T23:56:01.327638+0000","last_fullsized":"2023-12-15T23:56:01.327638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:24.822481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559157+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-15T23:56:05.559157+0000","last_peered":"2023-12-15T23:56:05.559157+0000","last_clean":"2023-12-15T23:56:05.559157+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-15T23:56:05.559157+0000","last_undegraded":"2023-12-15T23:56:05.559157+0000","last_fullsized":"2023-12-15T23:56:05.559157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334309+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-15T23:55:55.334309+0000","last_peered":"2023-12-15T23:55:55.334309+0000","last_clean":"2023-12-15T23:55:55.334309+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-15T23:55:55.334309+0000","last_undegraded":"2023-12-15T23:55:55.334309+0000","last_fullsized":"2023-12-15T23:55:55.334309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:30.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335875+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-15T23:55:55.335875+0000","last_peered":"2023-12-15T23:55:55.335875+0000","last_clean":"2023-12-15T23:55:55.335875+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-15T23:55:55.335875+0000","last_undegraded":"2023-12-15T23:55:55.335875+0000","last_fullsized":"2023-12-15T23:55:55.335875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337489+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-15T23:56:00.337489+0000","last_peered":"2023-12-15T23:56:00.337489+0000","last_clean":"2023-12-15T23:56:00.337489+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-15T23:56:00.337489+0000","last_undegraded":"2023-12-15T23:56:00.337489+0000","last_fullsized":"2023-12-15T23:56:00.337489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337350+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-15T23:56:00.337350+0000","last_peered":"2023-12-15T23:56:00.337350+0000","last_clean":"2023-12-15T23:56:00.337350+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-15T23:56:00.337350+0000","last_undegraded":"2023-12-15T23:56:00.337350+0000","last_fullsized":"2023-12-15T23:56:00.337350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:24.040020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.342184+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-15T23:56:50.342184+0000","last_peered":"2023-12-15T23:56:50.342184+0000","last_clean":"2023-12-15T23:56:50.342184+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-15T23:56:50.342184+0000","last_undegraded":"2023-12-15T23:56:50.342184+0000","last_fullsized":"2023-12-15T23:56:50.342184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:34.560913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346084+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-15T23:56:35.346084+0000","last_peered":"2023-12-15T23:56:35.346084+0000","last_clean":"2023-12-15T23:56:35.346084+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-15T23:56:35.346084+0000","last_undegraded":"2023-12-15T23:56:35.346084+0000","last_fullsized":"2023-12-15T23:56:35.346084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:31.974370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344321+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:56:30.344321+0000","last_peered":"2023-12-15T23:56:30.344321+0000","last_clean":"2023-12-15T23:56:30.344321+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:56:30.344321+0000","last_undegraded":"2023-12-15T23:56:30.344321+0000","last_fullsized":"2023-12-15T23:56:30.344321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:02:26.652903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.338524+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-15T23:56:05.338524+0000","last_peered":"2023-12-15T23:56:05.338524+0000","last_clean":"2023-12-15T23:56:05.338524+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-15T23:56:05.338524+0000","last_undegraded":"2023-12-15T23:56:05.338524+0000","last_fullsized":"2023-12-15T23:56:05.338524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":850,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336831+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-15T23:56:00.336831+0000","last_peered":"2023-12-15T23:56:00.336831+0000","last_clean":"2023-12-15T23:56:00.336831+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-15T23:56:00.336831+0000","last_undegraded":"2023-12-15T23:56:00.336831+0000","last_fullsized":"2023-12-15T23:56:00.336831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:16.093189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1989","reported_seq":3292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.330162+0000","last_change":"2023-12-15T22:53:28.164220+0000","last_active":"2023-12-15T23:56:00.330162+0000","last_peered":"2023-12-15T23:56:00.330162+0000","last_clean":"2023-12-15T23:56:00.330162+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-15T23:56:00.330162+0000","last_undegraded":"2023-12-15T23:56:00.330162+0000","last_fullsized":"2023-12-15T23:56:00.330162+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":200,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:24.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340087+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-15T23:56:15.340087+0000","last_peered":"2023-12-15T23:56:15.340087+0000","last_clean":"2023-12-15T23:56:15.340087+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-15T23:56:15.340087+0000","last_undegraded":"2023-12-15T23:56:15.340087+0000","last_fullsized":"2023-12-15T23:56:15.340087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:58.367040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340211+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-15T23:56:15.340211+0000","last_peered":"2023-12-15T23:56:15.340211+0000","last_clean":"2023-12-15T23:56:15.340211+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-15T23:56:15.340211+0000","last_undegraded":"2023-12-15T23:56:15.340211+0000","last_fullsized":"2023-12-15T23:56:15.340211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333143+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-15T23:55:45.333143+0000","last_peered":"2023-12-15T23:55:45.333143+0000","last_clean":"2023-12-15T23:55:45.333143+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-15T23:55:45.333143+0000","last_undegraded":"2023-12-15T23:55:45.333143+0000","last_fullsized":"2023-12-15T23:55:45.333143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558997+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-15T23:56:05.558997+0000","last_peered":"2023-12-15T23:56:05.558997+0000","last_clean":"2023-12-15T23:56:05.558997+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-15T23:56:05.558997+0000","last_undegraded":"2023-12-15T23:56:05.558997+0000","last_fullsized":"2023-12-15T23:56:05.558997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:17.905589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342197+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-15T23:56:20.342197+0000","last_peered":"2023-12-15T23:56:20.342197+0000","last_clean":"2023-12-15T23:56:20.342197+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-15T23:56:20.342197+0000","last_undegraded":"2023-12-15T23:56:20.342197+0000","last_fullsized":"2023-12-15T23:56:20.342197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326827+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-15T23:55:56.326827+0000","last_peered":"2023-12-15T23:55:56.326827+0000","last_clean":"2023-12-15T23:55:56.326827+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-15T23:55:56.326827+0000","last_undegraded":"2023-12-15T23:55:56.326827+0000","last_fullsized":"2023-12-15T23:55:56.326827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:33.627758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.328126+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-15T23:56:01.328126+0000","last_peered":"2023-12-15T23:56:01.328126+0000","last_clean":"2023-12-15T23:56:01.328126+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-15T23:56:01.328126+0000","last_undegraded":"2023-12-15T23:56:01.328126+0000","last_fullsized":"2023-12-15T23:56:01.328126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:42.868883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330495+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:56:11.330495+0000","last_peered":"2023-12-15T23:56:11.330495+0000","last_clean":"2023-12-15T23:56:11.330495+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:56:11.330495+0000","last_undegraded":"2023-12-15T23:56:11.330495+0000","last_fullsized":"2023-12-15T23:56:11.330495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345763+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:56:35.345763+0000","last_peered":"2023-12-15T23:56:35.345763+0000","last_clean":"2023-12-15T23:56:35.345763+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:56:35.345763+0000","last_undegraded":"2023-12-15T23:56:35.345763+0000","last_fullsized":"2023-12-15T23:56:35.345763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:05.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335521+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-15T23:56:31.335521+0000","last_peered":"2023-12-15T23:56:31.335521+0000","last_clean":"2023-12-15T23:56:31.335521+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-15T23:56:31.335521+0000","last_undegraded":"2023-12-15T23:56:31.335521+0000","last_fullsized":"2023-12-15T23:56:31.335521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.354044+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:57:46.354044+0000","last_peered":"2023-12-15T23:57:46.354044+0000","last_clean":"2023-12-15T23:57:46.354044+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:57:46.354044+0000","last_undegraded":"2023-12-15T23:57:46.354044+0000","last_fullsized":"2023-12-15T23:57:46.354044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:33.344075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345497+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:56:35.345497+0000","last_peered":"2023-12-15T23:56:35.345497+0000","last_clean":"2023-12-15T23:56:35.345497+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:56:35.345497+0000","last_undegraded":"2023-12-15T23:56:35.345497+0000","last_fullsized":"2023-12-15T23:56:35.345497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:52.415900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'201","reported_seq":429,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334656+0000","last_change":"2023-12-15T22:53:28.167522+0000","last_active":"2023-12-15T23:56:20.334656+0000","last_peered":"2023-12-15T23:56:20.334656+0000","last_clean":"2023-12-15T23:56:20.334656+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-15T23:56:20.334656+0000","last_undegraded":"2023-12-15T23:56:20.334656+0000","last_fullsized":"2023-12-15T23:56:20.334656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:57.781199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'5","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335936+0000","last_change":"2023-12-15T22:53:26.162142+0000","last_active":"2023-12-15T23:55:55.335936+0000","last_peered":"2023-12-15T23:55:55.335936+0000","last_clean":"2023-12-15T23:55:55.335936+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-15T23:55:55.335936+0000","last_undegraded":"2023-12-15T23:55:55.335936+0000","last_fullsized":"2023-12-15T23:55:55.335936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332182+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-15T23:55:40.332182+0000","last_peered":"2023-12-15T23:55:40.332182+0000","last_clean":"2023-12-15T23:55:40.332182+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-15T23:55:40.332182+0000","last_undegraded":"2023-12-15T23:55:40.332182+0000","last_fullsized":"2023-12-15T23:55:40.332182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:04:14.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333796+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-15T23:55:45.333796+0000","last_peered":"2023-12-15T23:55:45.333796+0000","last_clean":"2023-12-15T23:55:45.333796+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-15T23:55:45.333796+0000","last_undegraded":"2023-12-15T23:55:45.333796+0000","last_fullsized":"2023-12-15T23:55:45.333796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334043+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-15T23:55:55.334043+0000","last_peered":"2023-12-15T23:55:55.334043+0000","last_clean":"2023-12-15T23:55:55.334043+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-15T23:55:55.334043+0000","last_undegraded":"2023-12-15T23:55:55.334043+0000","last_fullsized":"2023-12-15T23:55:55.334043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:18.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.329028+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-15T23:55:55.329028+0000","last_peered":"2023-12-15T23:55:55.329028+0000","last_clean":"2023-12-15T23:55:55.329028+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-15T23:55:55.329028+0000","last_undegraded":"2023-12-15T23:55:55.329028+0000","last_fullsized":"2023-12-15T23:55:55.329028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:00.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336144+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-15T23:56:25.336144+0000","last_peered":"2023-12-15T23:56:25.336144+0000","last_clean":"2023-12-15T23:56:25.336144+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-15T23:56:25.336144+0000","last_undegraded":"2023-12-15T23:56:25.336144+0000","last_fullsized":"2023-12-15T23:56:25.336144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:31.056179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":794,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335932+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-15T23:56:00.335932+0000","last_peered":"2023-12-15T23:56:00.335932+0000","last_clean":"2023-12-15T23:56:00.335932+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-15T23:56:00.335932+0000","last_undegraded":"2023-12-15T23:56:00.335932+0000","last_fullsized":"2023-12-15T23:56:00.335932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560472+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:56:10.560472+0000","last_peered":"2023-12-15T23:56:10.560472+0000","last_clean":"2023-12-15T23:56:10.560472+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:56:10.560472+0000","last_undegraded":"2023-12-15T23:56:10.560472+0000","last_fullsized":"2023-12-15T23:56:10.560472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:30.721913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345845+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:56:35.345845+0000","last_peered":"2023-12-15T23:56:35.345845+0000","last_clean":"2023-12-15T23:56:35.345845+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:56:35.345845+0000","last_undegraded":"2023-12-15T23:56:35.345845+0000","last_fullsized":"2023-12-15T23:56:35.345845+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:02.469293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:16.361776+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-15T23:58:16.361776+0000","last_peered":"2023-12-15T23:58:16.361776+0000","last_clean":"2023-12-15T23:58:16.361776+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-15T23:58:16.361776+0000","last_undegraded":"2023-12-15T23:58:16.361776+0000","last_fullsized":"2023-12-15T23:58:16.361776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:18.365584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370227+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-15T23:58:10.370227+0000","last_peered":"2023-12-15T23:58:10.370227+0000","last_clean":"2023-12-15T23:58:10.370227+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-15T23:58:10.370227+0000","last_undegraded":"2023-12-15T23:58:10.370227+0000","last_fullsized":"2023-12-15T23:58:10.370227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:26:44.954886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334633+0000","last_change":"2023-12-15T22:53:30.176318+0000","last_active":"2023-12-15T23:56:20.334633+0000","last_peered":"2023-12-15T23:56:20.334633+0000","last_clean":"2023-12-15T23:56:20.334633+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-15T23:56:20.334633+0000","last_undegraded":"2023-12-15T23:56:20.334633+0000","last_fullsized":"2023-12-15T23:56:20.334633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:13.030255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3261,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565177+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:56:30.565177+0000","last_peered":"2023-12-15T23:56:30.565177+0000","last_clean":"2023-12-15T23:56:30.565177+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:56:30.565177+0000","last_undegraded":"2023-12-15T23:56:30.565177+0000","last_fullsized":"2023-12-15T23:56:30.565177+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:36.870664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"49'4","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556660+0000","last_change":"2023-12-15T22:53:26.164024+0000","last_active":"2023-12-15T23:55:55.556660+0000","last_peered":"2023-12-15T23:55:55.556660+0000","last_clean":"2023-12-15T23:55:55.556660+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-15T23:55:55.556660+0000","last_undegraded":"2023-12-15T23:55:55.556660+0000","last_fullsized":"2023-12-15T23:55:55.556660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:57.245681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:41.322906+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-15T23:55:41.322906+0000","last_peered":"2023-12-15T23:55:41.322906+0000","last_clean":"2023-12-15T23:55:41.322906+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-15T23:55:41.322906+0000","last_undegraded":"2023-12-15T23:55:41.322906+0000","last_fullsized":"2023-12-15T23:55:41.322906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:47.568953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333892+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-15T23:55:45.333892+0000","last_peered":"2023-12-15T23:55:45.333892+0000","last_clean":"2023-12-15T23:55:45.333892+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-15T23:55:45.333892+0000","last_undegraded":"2023-12-15T23:55:45.333892+0000","last_fullsized":"2023-12-15T23:55:45.333892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335457+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-15T23:55:55.335457+0000","last_peered":"2023-12-15T23:55:55.335457+0000","last_clean":"2023-12-15T23:55:55.335457+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-15T23:55:55.335457+0000","last_undegraded":"2023-12-15T23:55:55.335457+0000","last_fullsized":"2023-12-15T23:55:55.335457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:36.631382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.334772+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-15T23:55:55.334772+0000","last_peered":"2023-12-15T23:55:55.334772+0000","last_clean":"2023-12-15T23:55:55.334772+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-15T23:55:55.334772+0000","last_undegraded":"2023-12-15T23:55:55.334772+0000","last_fullsized":"2023-12-15T23:55:55.334772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:24.167330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335919+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-15T23:56:00.335919+0000","last_peered":"2023-12-15T23:56:00.335919+0000","last_clean":"2023-12-15T23:56:00.335919+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-15T23:56:00.335919+0000","last_undegraded":"2023-12-15T23:56:00.335919+0000","last_fullsized":"2023-12-15T23:56:00.335919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:13.618757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":795,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.562788+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-15T23:56:20.562788+0000","last_peered":"2023-12-15T23:56:20.562788+0000","last_clean":"2023-12-15T23:56:20.562788+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-15T23:56:20.562788+0000","last_undegraded":"2023-12-15T23:56:20.562788+0000","last_fullsized":"2023-12-15T23:56:20.562788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:39.943256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336566+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-15T23:56:36.336566+0000","last_peered":"2023-12-15T23:56:36.336566+0000","last_clean":"2023-12-15T23:56:36.336566+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-15T23:56:36.336566+0000","last_undegraded":"2023-12-15T23:56:36.336566+0000","last_fullsized":"2023-12-15T23:56:36.336566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:08.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1569,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344451+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-15T23:56:35.344451+0000","last_peered":"2023-12-15T23:56:35.344451+0000","last_clean":"2023-12-15T23:56:35.344451+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-15T23:56:35.344451+0000","last_undegraded":"2023-12-15T23:56:35.344451+0000","last_fullsized":"2023-12-15T23:56:35.344451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:15:15.009231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343006+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-15T23:56:30.343006+0000","last_peered":"2023-12-15T23:56:30.343006+0000","last_clean":"2023-12-15T23:56:30.343006+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-15T23:56:30.343006+0000","last_undegraded":"2023-12-15T23:56:30.343006+0000","last_fullsized":"2023-12-15T23:56:30.343006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353594+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:57:46.353594+0000","last_peered":"2023-12-15T23:57:46.353594+0000","last_clean":"2023-12-15T23:57:46.353594+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:57:46.353594+0000","last_undegraded":"2023-12-15T23:57:46.353594+0000","last_fullsized":"2023-12-15T23:57:46.353594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:32.398010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342201+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-15T23:56:20.342201+0000","last_peered":"2023-12-15T23:56:20.342201+0000","last_clean":"2023-12-15T23:56:20.342201+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-15T23:56:20.342201+0000","last_undegraded":"2023-12-15T23:56:20.342201+0000","last_fullsized":"2023-12-15T23:56:20.342201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:13.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'342","reported_seq":508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342111+0000","last_change":"2023-12-15T22:53:28.172209+0000","last_active":"2023-12-15T23:56:20.342111+0000","last_peered":"2023-12-15T23:56:20.342111+0000","last_clean":"2023-12-15T23:56:20.342111+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-15T23:56:20.342111+0000","last_undegraded":"2023-12-15T23:56:20.342111+0000","last_fullsized":"2023-12-15T23:56:20.342111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:40.476433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.371963+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-15T23:58:15.371963+0000","last_peered":"2023-12-15T23:58:15.371963+0000","last_clean":"2023-12-15T23:58:15.371963+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-15T23:58:15.371963+0000","last_undegraded":"2023-12-15T23:58:15.371963+0000","last_fullsized":"2023-12-15T23:58:15.371963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:21:22.340026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365463+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-15T23:57:55.365463+0000","last_peered":"2023-12-15T23:57:55.365463+0000","last_clean":"2023-12-15T23:57:55.365463+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-15T23:57:55.365463+0000","last_undegraded":"2023-12-15T23:57:55.365463+0000","last_fullsized":"2023-12-15T23:57:55.365463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339554+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-15T23:56:10.339554+0000","last_peered":"2023-12-15T23:56:10.339554+0000","last_clean":"2023-12-15T23:56:10.339554+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-15T23:56:10.339554+0000","last_undegraded":"2023-12-15T23:56:10.339554+0000","last_fullsized":"2023-12-15T23:56:10.339554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:25.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367610+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-15T23:58:05.367610+0000","last_peered":"2023-12-15T23:58:05.367610+0000","last_clean":"2023-12-15T23:58:05.367610+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-15T23:58:05.367610+0000","last_undegraded":"2023-12-15T23:58:05.367610+0000","last_fullsized":"2023-12-15T23:58:05.367610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:31.374833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":249,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340302+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-15T23:56:15.340302+0000","last_peered":"2023-12-15T23:56:15.340302+0000","last_clean":"2023-12-15T23:56:15.340302+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-15T23:56:15.340302+0000","last_undegraded":"2023-12-15T23:56:15.340302+0000","last_fullsized":"2023-12-15T23:56:15.340302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560374+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-15T23:56:10.560374+0000","last_peered":"2023-12-15T23:56:10.560374+0000","last_clean":"2023-12-15T23:56:10.560374+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-15T23:56:10.560374+0000","last_undegraded":"2023-12-15T23:56:10.560374+0000","last_fullsized":"2023-12-15T23:56:10.560374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:37.180934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362737+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:57:45.362737+0000","last_peered":"2023-12-15T23:57:45.362737+0000","last_clean":"2023-12-15T23:57:45.362737+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:57:45.362737+0000","last_undegraded":"2023-12-15T23:57:45.362737+0000","last_fullsized":"2023-12-15T23:57:45.362737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.338476+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-15T23:56:35.338476+0000","last_peered":"2023-12-15T23:56:35.338476+0000","last_clean":"2023-12-15T23:56:35.338476+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-15T23:56:35.338476+0000","last_undegraded":"2023-12-15T23:56:35.338476+0000","last_fullsized":"2023-12-15T23:56:35.338476+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:00:00.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3976,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345750+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-15T23:56:35.345750+0000","last_peered":"2023-12-15T23:56:35.345750+0000","last_clean":"2023-12-15T23:56:35.345750+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-15T23:56:35.345750+0000","last_undegraded":"2023-12-15T23:56:35.345750+0000","last_fullsized":"2023-12-15T23:56:35.345750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:58.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.370715+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-15T23:58:15.370715+0000","last_peered":"2023-12-15T23:58:15.370715+0000","last_clean":"2023-12-15T23:58:15.370715+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-15T23:58:15.370715+0000","last_undegraded":"2023-12-15T23:58:15.370715+0000","last_fullsized":"2023-12-15T23:58:15.370715+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:19:34.575534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369593+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-15T23:58:10.369593+0000","last_peered":"2023-12-15T23:58:10.369593+0000","last_clean":"2023-12-15T23:58:10.369593+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-15T23:58:10.369593+0000","last_undegraded":"2023-12-15T23:58:10.369593+0000","last_fullsized":"2023-12-15T23:58:10.369593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342347+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-15T23:56:20.342347+0000","last_peered":"2023-12-15T23:56:20.342347+0000","last_clean":"2023-12-15T23:56:20.342347+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-15T23:56:20.342347+0000","last_undegraded":"2023-12-15T23:56:20.342347+0000","last_fullsized":"2023-12-15T23:56:20.342347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:27.749157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'777","reported_seq":2399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341074+0000","last_change":"2023-12-15T22:53:28.168322+0000","last_active":"2023-12-15T23:56:20.341074+0000","last_peered":"2023-12-15T23:56:20.341074+0000","last_clean":"2023-12-15T23:56:20.341074+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-15T23:56:20.341074+0000","last_undegraded":"2023-12-15T23:56:20.341074+0000","last_fullsized":"2023-12-15T23:56:20.341074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'4","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588660+0000","last_change":"2023-12-15T22:53:26.160880+0000","last_active":"2023-12-15T23:58:00.588660+0000","last_peered":"2023-12-15T23:58:00.588660+0000","last_clean":"2023-12-15T23:58:00.588660+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-15T23:58:00.588660+0000","last_undegraded":"2023-12-15T23:58:00.588660+0000","last_fullsized":"2023-12-15T23:58:00.588660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356180+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-15T23:57:56.356180+0000","last_peered":"2023-12-15T23:57:56.356180+0000","last_clean":"2023-12-15T23:57:56.356180+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-15T23:57:56.356180+0000","last_undegraded":"2023-12-15T23:57:56.356180+0000","last_fullsized":"2023-12-15T23:57:56.356180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369279+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-15T23:58:10.369279+0000","last_peered":"2023-12-15T23:58:10.369279+0000","last_clean":"2023-12-15T23:58:10.369279+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-15T23:58:10.369279+0000","last_undegraded":"2023-12-15T23:58:10.369279+0000","last_fullsized":"2023-12-15T23:58:10.369279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":282,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359022+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-15T23:58:05.359022+0000","last_peered":"2023-12-15T23:58:05.359022+0000","last_clean":"2023-12-15T23:58:05.359022+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-15T23:58:05.359022+0000","last_undegraded":"2023-12-15T23:58:05.359022+0000","last_fullsized":"2023-12-15T23:58:05.359022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:29.645708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560345+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-15T23:56:10.560345+0000","last_peered":"2023-12-15T23:56:10.560345+0000","last_clean":"2023-12-15T23:56:10.560345+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-15T23:56:10.560345+0000","last_undegraded":"2023-12-15T23:56:10.560345+0000","last_fullsized":"2023-12-15T23:56:10.560345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:55.500999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333744+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-15T23:56:15.333744+0000","last_peered":"2023-12-15T23:56:15.333744+0000","last_clean":"2023-12-15T23:56:15.333744+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-15T23:56:15.333744+0000","last_undegraded":"2023-12-15T23:56:15.333744+0000","last_fullsized":"2023-12-15T23:56:15.333744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:51.409885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357884+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-15T23:58:01.357884+0000","last_peered":"2023-12-15T23:58:01.357884+0000","last_clean":"2023-12-15T23:58:01.357884+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-15T23:58:01.357884+0000","last_undegraded":"2023-12-15T23:58:01.357884+0000","last_fullsized":"2023-12-15T23:58:01.357884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:39.186844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344266+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-15T23:56:35.344266+0000","last_peered":"2023-12-15T23:56:35.344266+0000","last_clean":"2023-12-15T23:56:35.344266+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-15T23:56:35.344266+0000","last_undegraded":"2023-12-15T23:56:35.344266+0000","last_fullsized":"2023-12-15T23:56:35.344266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:46.912902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1650,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.362356+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-15T23:58:20.362356+0000","last_peered":"2023-12-15T23:58:20.362356+0000","last_clean":"2023-12-15T23:58:20.362356+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-15T23:58:20.362356+0000","last_undegraded":"2023-12-15T23:58:20.362356+0000","last_fullsized":"2023-12-15T23:58:20.362356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:55.411932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344494+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-15T23:56:30.344494+0000","last_peered":"2023-12-15T23:56:30.344494+0000","last_clean":"2023-12-15T23:56:30.344494+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-15T23:56:30.344494+0000","last_undegraded":"2023-12-15T23:56:30.344494+0000","last_fullsized":"2023-12-15T23:56:30.344494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:22.199553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369737+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-15T23:58:10.369737+0000","last_peered":"2023-12-15T23:58:10.369737+0000","last_clean":"2023-12-15T23:58:10.369737+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-15T23:58:10.369737+0000","last_undegraded":"2023-12-15T23:58:10.369737+0000","last_fullsized":"2023-12-15T23:58:10.369737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:21.362807+0000","last_change":"2023-12-15T22:53:30.176469+0000","last_active":"2023-12-15T23:58:21.362807+0000","last_peered":"2023-12-15T23:58:21.362807+0000","last_clean":"2023-12-15T23:58:21.362807+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-15T23:58:21.362807+0000","last_undegraded":"2023-12-15T23:58:21.362807+0000","last_fullsized":"2023-12-15T23:58:21.362807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:01.243566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2086,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.369293+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-15T23:58:05.369293+0000","last_peered":"2023-12-15T23:58:05.369293+0000","last_clean":"2023-12-15T23:58:05.369293+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-15T23:58:05.369293+0000","last_undegraded":"2023-12-15T23:58:05.369293+0000","last_fullsized":"2023-12-15T23:58:05.369293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'5","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340715+0000","last_change":"2023-12-15T22:53:26.163456+0000","last_active":"2023-12-15T23:56:15.340715+0000","last_peered":"2023-12-15T23:56:15.340715+0000","last_clean":"2023-12-15T23:56:15.340715+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-15T23:56:15.340715+0000","last_undegraded":"2023-12-15T23:56:15.340715+0000","last_fullsized":"2023-12-15T23:56:15.340715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368939+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-15T23:58:10.368939+0000","last_peered":"2023-12-15T23:58:10.368939+0000","last_clean":"2023-12-15T23:58:10.368939+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-15T23:58:10.368939+0000","last_undegraded":"2023-12-15T23:58:10.368939+0000","last_fullsized":"2023-12-15T23:58:10.368939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369984+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-15T23:58:10.369984+0000","last_peered":"2023-12-15T23:58:10.369984+0000","last_clean":"2023-12-15T23:58:10.369984+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-15T23:58:10.369984+0000","last_undegraded":"2023-12-15T23:58:10.369984+0000","last_fullsized":"2023-12-15T23:58:10.369984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:22.502479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331481+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-15T23:56:05.331481+0000","last_peered":"2023-12-15T23:56:05.331481+0000","last_clean":"2023-12-15T23:56:05.331481+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-15T23:56:05.331481+0000","last_undegraded":"2023-12-15T23:56:05.331481+0000","last_fullsized":"2023-12-15T23:56:05.331481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:58.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369516+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-15T23:58:10.369516+0000","last_peered":"2023-12-15T23:58:10.369516+0000","last_clean":"2023-12-15T23:58:10.369516+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-15T23:58:10.369516+0000","last_undegraded":"2023-12-15T23:58:10.369516+0000","last_fullsized":"2023-12-15T23:58:10.369516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370384+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-15T23:58:10.370384+0000","last_peered":"2023-12-15T23:58:10.370384+0000","last_clean":"2023-12-15T23:58:10.370384+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-15T23:58:10.370384+0000","last_undegraded":"2023-12-15T23:58:10.370384+0000","last_fullsized":"2023-12-15T23:58:10.370384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370814+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-15T23:58:10.370814+0000","last_peered":"2023-12-15T23:58:10.370814+0000","last_clean":"2023-12-15T23:58:10.370814+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-15T23:58:10.370814+0000","last_undegraded":"2023-12-15T23:58:10.370814+0000","last_fullsized":"2023-12-15T23:58:10.370814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:21.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341847+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-15T23:56:50.341847+0000","last_peered":"2023-12-15T23:56:50.341847+0000","last_clean":"2023-12-15T23:56:50.341847+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-15T23:56:50.341847+0000","last_undegraded":"2023-12-15T23:56:50.341847+0000","last_fullsized":"2023-12-15T23:56:50.341847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:13:08.808826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566493+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-15T23:56:35.566493+0000","last_peered":"2023-12-15T23:56:35.566493+0000","last_clean":"2023-12-15T23:56:35.566493+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-15T23:56:35.566493+0000","last_undegraded":"2023-12-15T23:56:35.566493+0000","last_fullsized":"2023-12-15T23:56:35.566493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:11.823256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344162+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-15T23:56:30.344162+0000","last_peered":"2023-12-15T23:56:30.344162+0000","last_clean":"2023-12-15T23:56:30.344162+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-15T23:56:30.344162+0000","last_undegraded":"2023-12-15T23:56:30.344162+0000","last_fullsized":"2023-12-15T23:56:30.344162+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:26.339363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370477+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-15T23:58:10.370477+0000","last_peered":"2023-12-15T23:58:10.370477+0000","last_clean":"2023-12-15T23:58:10.370477+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-15T23:58:10.370477+0000","last_undegraded":"2023-12-15T23:58:10.370477+0000","last_fullsized":"2023-12-15T23:58:10.370477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:31.522105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.367802+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-15T23:58:05.367802+0000","last_peered":"2023-12-15T23:58:05.367802+0000","last_clean":"2023-12-15T23:58:05.367802+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-15T23:58:05.367802+0000","last_undegraded":"2023-12-15T23:58:05.367802+0000","last_fullsized":"2023-12-15T23:58:05.367802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:58.411627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1652","reported_seq":2675,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:20.362756+0000","last_change":"2023-12-15T22:53:28.166989+0000","last_active":"2023-12-15T23:58:20.362756+0000","last_peered":"2023-12-15T23:58:20.362756+0000","last_clean":"2023-12-15T23:58:20.362756+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-15T23:58:20.362756+0000","last_undegraded":"2023-12-15T23:58:20.362756+0000","last_fullsized":"2023-12-15T23:58:20.362756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:18.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'8","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340671+0000","last_change":"2023-12-15T22:53:26.163111+0000","last_active":"2023-12-15T23:56:15.340671+0000","last_peered":"2023-12-15T23:56:15.340671+0000","last_clean":"2023-12-15T23:56:15.340671+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-15T23:56:15.340671+0000","last_undegraded":"2023-12-15T23:56:15.340671+0000","last_fullsized":"2023-12-15T23:56:15.340671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:05:57.223319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370466+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-15T23:58:10.370466+0000","last_peered":"2023-12-15T23:58:10.370466+0000","last_clean":"2023-12-15T23:58:10.370466+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-15T23:58:10.370466+0000","last_undegraded":"2023-12-15T23:58:10.370466+0000","last_fullsized":"2023-12-15T23:58:10.370466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369084+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-15T23:58:10.369084+0000","last_peered":"2023-12-15T23:58:10.369084+0000","last_clean":"2023-12-15T23:58:10.369084+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-15T23:58:10.369084+0000","last_undegraded":"2023-12-15T23:58:10.369084+0000","last_fullsized":"2023-12-15T23:58:10.369084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332486+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-15T23:56:10.332486+0000","last_peered":"2023-12-15T23:56:10.332486+0000","last_clean":"2023-12-15T23:56:10.332486+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-15T23:56:10.332486+0000","last_undegraded":"2023-12-15T23:56:10.332486+0000","last_fullsized":"2023-12-15T23:56:10.332486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:12:03.582433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370332+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-15T23:58:10.370332+0000","last_peered":"2023-12-15T23:58:10.370332+0000","last_clean":"2023-12-15T23:58:10.370332+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-15T23:58:10.370332+0000","last_undegraded":"2023-12-15T23:58:10.370332+0000","last_fullsized":"2023-12-15T23:58:10.370332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360212+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-15T23:58:10.360212+0000","last_peered":"2023-12-15T23:58:10.360212+0000","last_clean":"2023-12-15T23:58:10.360212+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-15T23:58:10.360212+0000","last_undegraded":"2023-12-15T23:58:10.360212+0000","last_fullsized":"2023-12-15T23:58:10.360212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:59.674797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591341+0000","last_change":"2023-12-15T22:53:10.340508+0000","last_active":"2023-12-15T23:58:10.591341+0000","last_peered":"2023-12-15T23:58:10.591341+0000","last_clean":"2023-12-15T23:58:10.591341+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-15T23:58:10.591341+0000","last_undegraded":"2023-12-15T23:58:10.591341+0000","last_fullsized":"2023-12-15T23:58:10.591341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:57.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.563036+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-15T23:56:20.563036+0000","last_peered":"2023-12-15T23:56:20.563036+0000","last_clean":"2023-12-15T23:56:20.563036+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-15T23:56:20.563036+0000","last_undegraded":"2023-12-15T23:56:20.563036+0000","last_fullsized":"2023-12-15T23:56:20.563036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:04:25.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3530,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.351010+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:56:55.351010+0000","last_peered":"2023-12-15T23:56:55.351010+0000","last_clean":"2023-12-15T23:56:55.351010+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:56:55.351010+0000","last_undegraded":"2023-12-15T23:56:55.351010+0000","last_fullsized":"2023-12-15T23:56:55.351010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:09.097073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:46.338997+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-15T23:56:46.338997+0000","last_peered":"2023-12-15T23:56:46.338997+0000","last_clean":"2023-12-15T23:56:46.338997+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-15T23:56:46.338997+0000","last_undegraded":"2023-12-15T23:56:46.338997+0000","last_fullsized":"2023-12-15T23:56:46.338997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:50.579490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369071+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-15T23:58:10.369071+0000","last_peered":"2023-12-15T23:58:10.369071+0000","last_clean":"2023-12-15T23:58:10.369071+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-15T23:58:10.369071+0000","last_undegraded":"2023-12-15T23:58:10.369071+0000","last_fullsized":"2023-12-15T23:58:10.369071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:09:23.414022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1502,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368432+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-15T23:58:05.368432+0000","last_peered":"2023-12-15T23:58:05.368432+0000","last_clean":"2023-12-15T23:58:05.368432+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-15T23:58:05.368432+0000","last_undegraded":"2023-12-15T23:58:05.368432+0000","last_fullsized":"2023-12-15T23:58:05.368432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:01:44.643639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.589587+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-15T23:58:05.589587+0000","last_peered":"2023-12-15T23:58:05.589587+0000","last_clean":"2023-12-15T23:58:05.589587+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-15T23:58:05.589587+0000","last_undegraded":"2023-12-15T23:58:05.589587+0000","last_fullsized":"2023-12-15T23:58:05.589587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:30.019947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'4","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367754+0000","last_change":"2023-12-15T22:53:26.165088+0000","last_active":"2023-12-15T23:58:00.367754+0000","last_peered":"2023-12-15T23:58:00.367754+0000","last_clean":"2023-12-15T23:58:00.367754+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-15T23:58:00.367754+0000","last_undegraded":"2023-12-15T23:58:00.367754+0000","last_fullsized":"2023-12-15T23:58:00.367754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:14.026739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:11.360297+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-15T23:58:11.360297+0000","last_peered":"2023-12-15T23:58:11.360297+0000","last_clean":"2023-12-15T23:58:11.360297+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-15T23:58:11.360297+0000","last_undegraded":"2023-12-15T23:58:11.360297+0000","last_fullsized":"2023-12-15T23:58:11.360297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:27.626126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.590893+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-15T23:58:10.590893+0000","last_peered":"2023-12-15T23:58:10.590893+0000","last_clean":"2023-12-15T23:58:10.590893+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-15T23:58:10.590893+0000","last_undegraded":"2023-12-15T23:58:10.590893+0000","last_fullsized":"2023-12-15T23:58:10.590893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:17.629224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.331590+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-15T23:56:05.331590+0000","last_peered":"2023-12-15T23:56:05.331590+0000","last_clean":"2023-12-15T23:56:05.331590+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-15T23:56:05.331590+0000","last_undegraded":"2023-12-15T23:56:05.331590+0000","last_fullsized":"2023-12-15T23:56:05.331590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:20.899928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.329372+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-15T23:56:06.329372+0000","last_peered":"2023-12-15T23:56:06.329372+0000","last_clean":"2023-12-15T23:56:06.329372+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-15T23:56:06.329372+0000","last_undegraded":"2023-12-15T23:56:06.329372+0000","last_fullsized":"2023-12-15T23:56:06.329372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:09:33.385736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343663+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-15T23:56:25.343663+0000","last_peered":"2023-12-15T23:56:25.343663+0000","last_clean":"2023-12-15T23:56:25.343663+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-15T23:56:25.343663+0000","last_undegraded":"2023-12-15T23:56:25.343663+0000","last_fullsized":"2023-12-15T23:56:25.343663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578335+0000","last_change":"2023-12-15T22:53:10.339820+0000","last_active":"2023-12-15T23:57:20.578335+0000","last_peered":"2023-12-15T23:57:20.578335+0000","last_clean":"2023-12-15T23:57:20.578335+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:57:20.578335+0000","last_undegraded":"2023-12-15T23:57:20.578335+0000","last_fullsized":"2023-12-15T23:57:20.578335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:16.322332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342330+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-15T23:56:20.342330+0000","last_peered":"2023-12-15T23:56:20.342330+0000","last_clean":"2023-12-15T23:56:20.342330+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-15T23:56:20.342330+0000","last_undegraded":"2023-12-15T23:56:20.342330+0000","last_fullsized":"2023-12-15T23:56:20.342330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:25.701757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":884,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350904+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:56:55.350904+0000","last_peered":"2023-12-15T23:56:55.350904+0000","last_clean":"2023-12-15T23:56:55.350904+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:56:55.350904+0000","last_undegraded":"2023-12-15T23:56:55.350904+0000","last_fullsized":"2023-12-15T23:56:55.350904+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:19.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344331+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-15T23:56:30.344331+0000","last_peered":"2023-12-15T23:56:30.344331+0000","last_clean":"2023-12-15T23:56:30.344331+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-15T23:56:30.344331+0000","last_undegraded":"2023-12-15T23:56:30.344331+0000","last_fullsized":"2023-12-15T23:56:30.344331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:35.691834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340903+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-15T23:56:20.340903+0000","last_peered":"2023-12-15T23:56:20.340903+0000","last_clean":"2023-12-15T23:56:20.340903+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-15T23:56:20.340903+0000","last_undegraded":"2023-12-15T23:56:20.340903+0000","last_fullsized":"2023-12-15T23:56:20.340903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359147+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-15T23:58:05.359147+0000","last_peered":"2023-12-15T23:58:05.359147+0000","last_clean":"2023-12-15T23:58:05.359147+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-15T23:58:05.359147+0000","last_undegraded":"2023-12-15T23:58:05.359147+0000","last_fullsized":"2023-12-15T23:58:05.359147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:43.704505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'434","reported_seq":826,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359244+0000","last_change":"2023-12-15T22:53:28.165130+0000","last_active":"2023-12-15T23:58:05.359244+0000","last_peered":"2023-12-15T23:58:05.359244+0000","last_clean":"2023-12-15T23:58:05.359244+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-15T23:58:05.359244+0000","last_undegraded":"2023-12-15T23:58:05.359244+0000","last_fullsized":"2023-12-15T23:58:05.359244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:09.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'11","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.581910+0000","last_change":"2023-12-15T22:53:26.156795+0000","last_active":"2023-12-15T23:57:35.581910+0000","last_peered":"2023-12-15T23:57:35.581910+0000","last_clean":"2023-12-15T23:57:35.581910+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-15T23:57:35.581910+0000","last_undegraded":"2023-12-15T23:57:35.581910+0000","last_fullsized":"2023-12-15T23:57:35.581910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:29.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370033+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-15T23:58:10.370033+0000","last_peered":"2023-12-15T23:58:10.370033+0000","last_clean":"2023-12-15T23:58:10.370033+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-15T23:58:10.370033+0000","last_undegraded":"2023-12-15T23:58:10.370033+0000","last_fullsized":"2023-12-15T23:58:10.370033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:44.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369701+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-15T23:58:10.369701+0000","last_peered":"2023-12-15T23:58:10.369701+0000","last_clean":"2023-12-15T23:58:10.369701+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-15T23:58:10.369701+0000","last_undegraded":"2023-12-15T23:58:10.369701+0000","last_fullsized":"2023-12-15T23:58:10.369701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559219+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-15T23:56:05.559219+0000","last_peered":"2023-12-15T23:56:05.559219+0000","last_clean":"2023-12-15T23:56:05.559219+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-15T23:56:05.559219+0000","last_undegraded":"2023-12-15T23:56:05.559219+0000","last_fullsized":"2023-12-15T23:56:05.559219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:55.654294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336323+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-15T23:56:25.336323+0000","last_peered":"2023-12-15T23:56:25.336323+0000","last_clean":"2023-12-15T23:56:25.336323+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-15T23:56:25.336323+0000","last_undegraded":"2023-12-15T23:56:25.336323+0000","last_fullsized":"2023-12-15T23:56:25.336323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:58.115309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332781+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-15T23:56:10.332781+0000","last_peered":"2023-12-15T23:56:10.332781+0000","last_clean":"2023-12-15T23:56:10.332781+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-15T23:56:10.332781+0000","last_undegraded":"2023-12-15T23:56:10.332781+0000","last_fullsized":"2023-12-15T23:56:10.332781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:11.050275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584443+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:57:45.584443+0000","last_peered":"2023-12-15T23:57:45.584443+0000","last_clean":"2023-12-15T23:57:45.584443+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:57:45.584443+0000","last_undegraded":"2023-12-15T23:57:45.584443+0000","last_fullsized":"2023-12-15T23:57:45.584443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347388+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-15T23:56:45.347388+0000","last_peered":"2023-12-15T23:56:45.347388+0000","last_clean":"2023-12-15T23:56:45.347388+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-15T23:56:45.347388+0000","last_undegraded":"2023-12-15T23:56:45.347388+0000","last_fullsized":"2023-12-15T23:56:45.347388+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:15.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3437,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.344672+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-15T23:56:35.344672+0000","last_peered":"2023-12-15T23:56:35.344672+0000","last_clean":"2023-12-15T23:56:35.344672+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-15T23:56:35.344672+0000","last_undegraded":"2023-12-15T23:56:35.344672+0000","last_fullsized":"2023-12-15T23:56:35.344672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:27:53.377560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348840+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:56:50.348840+0000","last_peered":"2023-12-15T23:56:50.348840+0000","last_clean":"2023-12-15T23:56:50.348840+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:56:50.348840+0000","last_undegraded":"2023-12-15T23:56:50.348840+0000","last_fullsized":"2023-12-15T23:56:50.348840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:13.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564275+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-15T23:56:25.564275+0000","last_peered":"2023-12-15T23:56:25.564275+0000","last_clean":"2023-12-15T23:56:25.564275+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-15T23:56:25.564275+0000","last_undegraded":"2023-12-15T23:56:25.564275+0000","last_fullsized":"2023-12-15T23:56:25.564275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:39.121105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358717+0000","last_change":"2023-12-15T22:53:30.183489+0000","last_active":"2023-12-15T23:58:06.358717+0000","last_peered":"2023-12-15T23:58:06.358717+0000","last_clean":"2023-12-15T23:58:06.358717+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-15T23:58:06.358717+0000","last_undegraded":"2023-12-15T23:58:06.358717+0000","last_fullsized":"2023-12-15T23:58:06.358717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:04.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'594","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362425+0000","last_change":"2023-12-15T22:53:28.166896+0000","last_active":"2023-12-15T23:57:45.362425+0000","last_peered":"2023-12-15T23:57:45.362425+0000","last_clean":"2023-12-15T23:57:45.362425+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-15T23:57:45.362425+0000","last_undegraded":"2023-12-15T23:57:45.362425+0000","last_fullsized":"2023-12-15T23:57:45.362425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:28.124124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367047+0000","last_change":"2023-12-15T22:53:26.161720+0000","last_active":"2023-12-15T23:58:00.367047+0000","last_peered":"2023-12-15T23:58:00.367047+0000","last_clean":"2023-12-15T23:58:00.367047+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-15T23:58:00.367047+0000","last_undegraded":"2023-12-15T23:58:00.367047+0000","last_fullsized":"2023-12-15T23:58:00.367047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:28.010705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:11.360579+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-15T23:58:11.360579+0000","last_peered":"2023-12-15T23:58:11.360579+0000","last_clean":"2023-12-15T23:58:11.360579+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-15T23:58:11.360579+0000","last_undegraded":"2023-12-15T23:58:11.360579+0000","last_fullsized":"2023-12-15T23:58:11.360579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356136+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-15T23:57:56.356136+0000","last_peered":"2023-12-15T23:57:56.356136+0000","last_clean":"2023-12-15T23:57:56.356136+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-15T23:57:56.356136+0000","last_undegraded":"2023-12-15T23:57:56.356136+0000","last_fullsized":"2023-12-15T23:57:56.356136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:38.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342283+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-15T23:56:20.342283+0000","last_peered":"2023-12-15T23:56:20.342283+0000","last_clean":"2023-12-15T23:56:20.342283+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-15T23:56:20.342283+0000","last_undegraded":"2023-12-15T23:56:20.342283+0000","last_fullsized":"2023-12-15T23:56:20.342283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560515+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-15T23:56:10.560515+0000","last_peered":"2023-12-15T23:56:10.560515+0000","last_clean":"2023-12-15T23:56:10.560515+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-15T23:56:10.560515+0000","last_undegraded":"2023-12-15T23:56:10.560515+0000","last_fullsized":"2023-12-15T23:56:10.560515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:40.859283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:11.330607+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:56:11.330607+0000","last_peered":"2023-12-15T23:56:11.330607+0000","last_clean":"2023-12-15T23:56:11.330607+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-15T23:56:11.330607+0000","last_undegraded":"2023-12-15T23:56:11.330607+0000","last_fullsized":"2023-12-15T23:56:11.330607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:15.547530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353777+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:57:46.353777+0000","last_peered":"2023-12-15T23:57:46.353777+0000","last_clean":"2023-12-15T23:57:46.353777+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:57:46.353777+0000","last_undegraded":"2023-12-15T23:57:46.353777+0000","last_fullsized":"2023-12-15T23:57:46.353777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:08.837316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566821+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-15T23:56:35.566821+0000","last_peered":"2023-12-15T23:56:35.566821+0000","last_clean":"2023-12-15T23:56:35.566821+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-15T23:56:35.566821+0000","last_undegraded":"2023-12-15T23:56:35.566821+0000","last_fullsized":"2023-12-15T23:56:35.566821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1758,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349715+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-15T23:56:50.349715+0000","last_peered":"2023-12-15T23:56:50.349715+0000","last_clean":"2023-12-15T23:56:50.349715+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-15T23:56:50.349715+0000","last_undegraded":"2023-12-15T23:56:50.349715+0000","last_fullsized":"2023-12-15T23:56:50.349715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:20.444898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348796+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:56:50.348796+0000","last_peered":"2023-12-15T23:56:50.348796+0000","last_clean":"2023-12-15T23:56:50.348796+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:56:50.348796+0000","last_undegraded":"2023-12-15T23:56:50.348796+0000","last_fullsized":"2023-12-15T23:56:50.348796+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564359+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-15T23:56:25.564359+0000","last_peered":"2023-12-15T23:56:25.564359+0000","last_clean":"2023-12-15T23:56:25.564359+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-15T23:56:25.564359+0000","last_undegraded":"2023-12-15T23:56:25.564359+0000","last_fullsized":"2023-12-15T23:56:25.564359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:49.839990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583014+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:57:40.583014+0000","last_peered":"2023-12-15T23:57:40.583014+0000","last_clean":"2023-12-15T23:57:40.583014+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:57:40.583014+0000","last_undegraded":"2023-12-15T23:57:40.583014+0000","last_fullsized":"2023-12-15T23:57:40.583014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:36.864485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'312","reported_seq":520,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.358697+0000","last_change":"2023-12-15T22:53:28.170097+0000","last_active":"2023-12-15T23:58:06.358697+0000","last_peered":"2023-12-15T23:58:06.358697+0000","last_clean":"2023-12-15T23:58:06.358697+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-15T23:58:06.358697+0000","last_undegraded":"2023-12-15T23:58:06.358697+0000","last_fullsized":"2023-12-15T23:58:06.358697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:11.019249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.588540+0000","last_change":"2023-12-15T22:53:26.164887+0000","last_active":"2023-12-15T23:58:00.588540+0000","last_peered":"2023-12-15T23:58:00.588540+0000","last_clean":"2023-12-15T23:58:00.588540+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-15T23:58:00.588540+0000","last_undegraded":"2023-12-15T23:58:00.588540+0000","last_fullsized":"2023-12-15T23:58:00.588540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559374+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-15T23:56:05.559374+0000","last_peered":"2023-12-15T23:56:05.559374+0000","last_clean":"2023-12-15T23:56:05.559374+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-15T23:56:05.559374+0000","last_undegraded":"2023-12-15T23:56:05.559374+0000","last_fullsized":"2023-12-15T23:56:05.559374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:12.885816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356568+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-15T23:57:55.356568+0000","last_peered":"2023-12-15T23:57:55.356568+0000","last_clean":"2023-12-15T23:57:55.356568+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-15T23:57:55.356568+0000","last_undegraded":"2023-12-15T23:57:55.356568+0000","last_fullsized":"2023-12-15T23:57:55.356568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:54.088870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337183+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-15T23:56:05.337183+0000","last_peered":"2023-12-15T23:56:05.337183+0000","last_clean":"2023-12-15T23:56:05.337183+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-15T23:56:05.337183+0000","last_undegraded":"2023-12-15T23:56:05.337183+0000","last_fullsized":"2023-12-15T23:56:05.337183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:53.490096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339396+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-15T23:56:10.339396+0000","last_peered":"2023-12-15T23:56:10.339396+0000","last_clean":"2023-12-15T23:56:10.339396+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-15T23:56:10.339396+0000","last_undegraded":"2023-12-15T23:56:10.339396+0000","last_fullsized":"2023-12-15T23:56:10.339396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338360+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-15T23:56:10.338360+0000","last_peered":"2023-12-15T23:56:10.338360+0000","last_clean":"2023-12-15T23:56:10.338360+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-15T23:56:10.338360+0000","last_undegraded":"2023-12-15T23:56:10.338360+0000","last_fullsized":"2023-12-15T23:56:10.338360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584565+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:57:45.584565+0000","last_peered":"2023-12-15T23:57:45.584565+0000","last_clean":"2023-12-15T23:57:45.584565+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:57:45.584565+0000","last_undegraded":"2023-12-15T23:57:45.584565+0000","last_fullsized":"2023-12-15T23:57:45.584565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:47:07.032492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360585+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-15T23:58:10.360585+0000","last_peered":"2023-12-15T23:58:10.360585+0000","last_clean":"2023-12-15T23:58:10.360585+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-15T23:58:10.360585+0000","last_undegraded":"2023-12-15T23:58:10.360585+0000","last_fullsized":"2023-12-15T23:58:10.360585+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:54.535000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1478,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.348066+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:57:21.348066+0000","last_peered":"2023-12-15T23:57:21.348066+0000","last_clean":"2023-12-15T23:57:21.348066+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:57:21.348066+0000","last_undegraded":"2023-12-15T23:57:21.348066+0000","last_fullsized":"2023-12-15T23:57:21.348066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573493+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:57:00.573493+0000","last_peered":"2023-12-15T23:57:00.573493+0000","last_clean":"2023-12-15T23:57:00.573493+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:57:00.573493+0000","last_undegraded":"2023-12-15T23:57:00.573493+0000","last_fullsized":"2023-12-15T23:57:00.573493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:49.584218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335364+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-15T23:56:31.335364+0000","last_peered":"2023-12-15T23:56:31.335364+0000","last_clean":"2023-12-15T23:56:31.335364+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-15T23:56:31.335364+0000","last_undegraded":"2023-12-15T23:56:31.335364+0000","last_fullsized":"2023-12-15T23:56:31.335364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:32.141954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565261+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-15T23:56:30.565261+0000","last_peered":"2023-12-15T23:56:30.565261+0000","last_clean":"2023-12-15T23:56:30.565261+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-15T23:56:30.565261+0000","last_undegraded":"2023-12-15T23:56:30.565261+0000","last_fullsized":"2023-12-15T23:56:30.565261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:18.046986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2092","reported_seq":3430,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344301+0000","last_change":"2023-12-15T22:53:28.171130+0000","last_active":"2023-12-15T23:56:30.344301+0000","last_peered":"2023-12-15T23:56:30.344301+0000","last_clean":"2023-12-15T23:56:30.344301+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-15T23:56:30.344301+0000","last_undegraded":"2023-12-15T23:56:30.344301+0000","last_fullsized":"2023-12-15T23:56:30.344301+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":200,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:14.487255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333562+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-15T23:56:15.333562+0000","last_peered":"2023-12-15T23:56:15.333562+0000","last_clean":"2023-12-15T23:56:15.333562+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-15T23:56:15.333562+0000","last_undegraded":"2023-12-15T23:56:15.333562+0000","last_fullsized":"2023-12-15T23:56:15.333562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:51:57.767288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363413+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:57:45.363413+0000","last_peered":"2023-12-15T23:57:45.363413+0000","last_clean":"2023-12-15T23:57:45.363413+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:57:45.363413+0000","last_undegraded":"2023-12-15T23:57:45.363413+0000","last_fullsized":"2023-12-15T23:57:45.363413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:11.540042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373428+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-15T23:58:25.373428+0000","last_peered":"2023-12-15T23:58:25.373428+0000","last_clean":"2023-12-15T23:58:25.373428+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-15T23:58:25.373428+0000","last_undegraded":"2023-12-15T23:58:25.373428+0000","last_fullsized":"2023-12-15T23:58:25.373428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580881+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:57:30.580881+0000","last_peered":"2023-12-15T23:57:30.580881+0000","last_clean":"2023-12-15T23:57:30.580881+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:57:30.580881+0000","last_undegraded":"2023-12-15T23:57:30.580881+0000","last_fullsized":"2023-12-15T23:57:30.580881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:35:56.749823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352586+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:57:41.352586+0000","last_peered":"2023-12-15T23:57:41.352586+0000","last_clean":"2023-12-15T23:57:41.352586+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:57:41.352586+0000","last_undegraded":"2023-12-15T23:57:41.352586+0000","last_fullsized":"2023-12-15T23:57:41.352586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:47.389382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369432+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-15T23:58:10.369432+0000","last_peered":"2023-12-15T23:58:10.369432+0000","last_clean":"2023-12-15T23:58:10.369432+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-15T23:58:10.369432+0000","last_undegraded":"2023-12-15T23:58:10.369432+0000","last_fullsized":"2023-12-15T23:58:10.369432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:50:04.821806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370878+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-15T23:58:10.370878+0000","last_peered":"2023-12-15T23:58:10.370878+0000","last_clean":"2023-12-15T23:58:10.370878+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-15T23:58:10.370878+0000","last_undegraded":"2023-12-15T23:58:10.370878+0000","last_fullsized":"2023-12-15T23:58:10.370878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:37.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368841+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-15T23:58:10.368841+0000","last_peered":"2023-12-15T23:58:10.368841+0000","last_clean":"2023-12-15T23:58:10.368841+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-15T23:58:10.368841+0000","last_undegraded":"2023-12-15T23:58:10.368841+0000","last_fullsized":"2023-12-15T23:58:10.368841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.337269+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-15T23:56:05.337269+0000","last_peered":"2023-12-15T23:56:05.337269+0000","last_clean":"2023-12-15T23:56:05.337269+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-15T23:56:05.337269+0000","last_undegraded":"2023-12-15T23:56:05.337269+0000","last_fullsized":"2023-12-15T23:56:05.337269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:33.993237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343972+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:57:06.343972+0000","last_peered":"2023-12-15T23:57:06.343972+0000","last_clean":"2023-12-15T23:57:06.343972+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:57:06.343972+0000","last_undegraded":"2023-12-15T23:57:06.343972+0000","last_fullsized":"2023-12-15T23:57:06.343972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:50:27.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342556+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:57:01.342556+0000","last_peered":"2023-12-15T23:57:01.342556+0000","last_clean":"2023-12-15T23:57:01.342556+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:57:01.342556+0000","last_undegraded":"2023-12-15T23:57:01.342556+0000","last_fullsized":"2023-12-15T23:57:01.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:20.406306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345788+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-15T23:56:35.345788+0000","last_peered":"2023-12-15T23:56:35.345788+0000","last_clean":"2023-12-15T23:56:35.345788+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-15T23:56:35.345788+0000","last_undegraded":"2023-12-15T23:56:35.345788+0000","last_fullsized":"2023-12-15T23:56:35.345788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:37.028220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337339+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-15T23:56:30.337339+0000","last_peered":"2023-12-15T23:56:30.337339+0000","last_clean":"2023-12-15T23:56:30.337339+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-15T23:56:30.337339+0000","last_undegraded":"2023-12-15T23:56:30.337339+0000","last_fullsized":"2023-12-15T23:56:30.337339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:45.660409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2321","reported_seq":3328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:36.336494+0000","last_change":"2023-12-15T22:53:28.162922+0000","last_active":"2023-12-15T23:56:36.336494+0000","last_peered":"2023-12-15T23:56:36.336494+0000","last_clean":"2023-12-15T23:56:36.336494+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-15T23:56:36.336494+0000","last_undegraded":"2023-12-15T23:56:36.336494+0000","last_fullsized":"2023-12-15T23:56:36.336494+0000","mapping_epoch":35,"log_start":"54'600","ondisk_log_start":"54'600","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":600,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:41.693500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'16","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340575+0000","last_change":"2023-12-15T22:53:26.162291+0000","last_active":"2023-12-15T23:56:15.340575+0000","last_peered":"2023-12-15T23:56:15.340575+0000","last_clean":"2023-12-15T23:56:15.340575+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-15T23:56:15.340575+0000","last_undegraded":"2023-12-15T23:56:15.340575+0000","last_fullsized":"2023-12-15T23:56:15.340575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581125+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:57:30.581125+0000","last_peered":"2023-12-15T23:57:30.581125+0000","last_clean":"2023-12-15T23:57:30.581125+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:57:30.581125+0000","last_undegraded":"2023-12-15T23:57:30.581125+0000","last_fullsized":"2023-12-15T23:57:30.581125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:41.519251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346527+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T23:56:40.346527+0000","last_peered":"2023-12-15T23:56:40.346527+0000","last_clean":"2023-12-15T23:56:40.346527+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T23:56:40.346527+0000","last_undegraded":"2023-12-15T23:56:40.346527+0000","last_fullsized":"2023-12-15T23:56:40.346527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:05.485582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.350078+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:57:31.350078+0000","last_peered":"2023-12-15T23:57:31.350078+0000","last_clean":"2023-12-15T23:57:31.350078+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:57:31.350078+0000","last_undegraded":"2023-12-15T23:57:31.350078+0000","last_fullsized":"2023-12-15T23:57:31.350078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366870+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-15T23:57:55.366870+0000","last_peered":"2023-12-15T23:57:55.366870+0000","last_clean":"2023-12-15T23:57:55.366870+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-15T23:57:55.366870+0000","last_undegraded":"2023-12-15T23:57:55.366870+0000","last_fullsized":"2023-12-15T23:57:55.366870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:26.924124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.591256+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-15T23:58:10.591256+0000","last_peered":"2023-12-15T23:58:10.591256+0000","last_clean":"2023-12-15T23:58:10.591256+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-15T23:58:10.591256+0000","last_undegraded":"2023-12-15T23:58:10.591256+0000","last_fullsized":"2023-12-15T23:58:10.591256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:28.787967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370208+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-15T23:58:10.370208+0000","last_peered":"2023-12-15T23:58:10.370208+0000","last_clean":"2023-12-15T23:58:10.370208+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-15T23:58:10.370208+0000","last_undegraded":"2023-12-15T23:58:10.370208+0000","last_fullsized":"2023-12-15T23:58:10.370208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:47.846728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368784+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-15T23:58:10.368784+0000","last_peered":"2023-12-15T23:58:10.368784+0000","last_clean":"2023-12-15T23:58:10.368784+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-15T23:58:10.368784+0000","last_undegraded":"2023-12-15T23:58:10.368784+0000","last_fullsized":"2023-12-15T23:58:10.368784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:50.301627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369138+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-15T23:58:10.369138+0000","last_peered":"2023-12-15T23:58:10.369138+0000","last_clean":"2023-12-15T23:58:10.369138+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-15T23:58:10.369138+0000","last_undegraded":"2023-12-15T23:58:10.369138+0000","last_fullsized":"2023-12-15T23:58:10.369138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5993,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353259+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:57:05.353259+0000","last_peered":"2023-12-15T23:57:05.353259+0000","last_clean":"2023-12-15T23:57:05.353259+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:57:05.353259+0000","last_undegraded":"2023-12-15T23:57:05.353259+0000","last_fullsized":"2023-12-15T23:57:05.353259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:23.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352049+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:57:00.352049+0000","last_peered":"2023-12-15T23:57:00.352049+0000","last_clean":"2023-12-15T23:57:00.352049+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:57:00.352049+0000","last_undegraded":"2023-12-15T23:57:00.352049+0000","last_fullsized":"2023-12-15T23:57:00.352049+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:36:08.674603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.348850+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:56:50.348850+0000","last_peered":"2023-12-15T23:56:50.348850+0000","last_clean":"2023-12-15T23:56:50.348850+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:56:50.348850+0000","last_undegraded":"2023-12-15T23:56:50.348850+0000","last_fullsized":"2023-12-15T23:56:50.348850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:47.552964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334718+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-15T23:56:20.334718+0000","last_peered":"2023-12-15T23:56:20.334718+0000","last_clean":"2023-12-15T23:56:20.334718+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-15T23:56:20.334718+0000","last_undegraded":"2023-12-15T23:56:20.334718+0000","last_fullsized":"2023-12-15T23:56:20.334718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:40.887941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1390,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340552+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-15T23:56:20.340552+0000","last_peered":"2023-12-15T23:56:20.340552+0000","last_clean":"2023-12-15T23:56:20.340552+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-15T23:56:20.340552+0000","last_undegraded":"2023-12-15T23:56:20.340552+0000","last_fullsized":"2023-12-15T23:56:20.340552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":196,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343101+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-15T23:56:30.343101+0000","last_peered":"2023-12-15T23:56:30.343101+0000","last_clean":"2023-12-15T23:56:30.343101+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-15T23:56:30.343101+0000","last_undegraded":"2023-12-15T23:56:30.343101+0000","last_fullsized":"2023-12-15T23:56:30.343101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587693+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-15T23:57:55.587693+0000","last_peered":"2023-12-15T23:57:55.587693+0000","last_clean":"2023-12-15T23:57:55.587693+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-15T23:57:55.587693+0000","last_undegraded":"2023-12-15T23:57:55.587693+0000","last_fullsized":"2023-12-15T23:57:55.587693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:34.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:41.337673+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T23:56:41.337673+0000","last_peered":"2023-12-15T23:56:41.337673+0000","last_clean":"2023-12-15T23:56:41.337673+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T23:56:41.337673+0000","last_undegraded":"2023-12-15T23:56:41.337673+0000","last_fullsized":"2023-12-15T23:56:41.337673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574363+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-15T23:57:05.574363+0000","last_peered":"2023-12-15T23:57:05.574363+0000","last_clean":"2023-12-15T23:57:05.574363+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-15T23:57:05.574363+0000","last_undegraded":"2023-12-15T23:57:05.574363+0000","last_fullsized":"2023-12-15T23:57:05.574363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359390+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-15T23:58:05.359390+0000","last_peered":"2023-12-15T23:58:05.359390+0000","last_clean":"2023-12-15T23:58:05.359390+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-15T23:58:05.359390+0000","last_undegraded":"2023-12-15T23:58:05.359390+0000","last_fullsized":"2023-12-15T23:58:05.359390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:36.759210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":924,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366654+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-15T23:58:00.366654+0000","last_peered":"2023-12-15T23:58:00.366654+0000","last_clean":"2023-12-15T23:58:00.366654+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-15T23:58:00.366654+0000","last_undegraded":"2023-12-15T23:58:00.366654+0000","last_fullsized":"2023-12-15T23:58:00.366654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:39.069170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363798+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:57:45.363798+0000","last_peered":"2023-12-15T23:57:45.363798+0000","last_clean":"2023-12-15T23:57:45.363798+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:57:45.363798+0000","last_undegraded":"2023-12-15T23:57:45.363798+0000","last_fullsized":"2023-12-15T23:57:45.363798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:45.988435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339569+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-15T23:56:10.339569+0000","last_peered":"2023-12-15T23:56:10.339569+0000","last_clean":"2023-12-15T23:56:10.339569+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-15T23:56:10.339569+0000","last_undegraded":"2023-12-15T23:56:10.339569+0000","last_fullsized":"2023-12-15T23:56:10.339569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:53.998326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:11.360493+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-15T23:58:11.360493+0000","last_peered":"2023-12-15T23:58:11.360493+0000","last_clean":"2023-12-15T23:58:11.360493+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-15T23:58:11.360493+0000","last_undegraded":"2023-12-15T23:58:11.360493+0000","last_fullsized":"2023-12-15T23:58:11.360493+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:11:00.445945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353438+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:57:05.353438+0000","last_peered":"2023-12-15T23:57:05.353438+0000","last_clean":"2023-12-15T23:57:05.353438+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:57:05.353438+0000","last_undegraded":"2023-12-15T23:57:05.353438+0000","last_fullsized":"2023-12-15T23:57:05.353438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:39.905516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.355945+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:57:15.355945+0000","last_peered":"2023-12-15T23:57:15.355945+0000","last_clean":"2023-12-15T23:57:15.355945+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:57:15.355945+0000","last_undegraded":"2023-12-15T23:57:15.355945+0000","last_fullsized":"2023-12-15T23:57:15.355945+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:17:26.396448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.346010+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-15T23:56:35.346010+0000","last_peered":"2023-12-15T23:56:35.346010+0000","last_clean":"2023-12-15T23:56:35.346010+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-15T23:56:35.346010+0000","last_undegraded":"2023-12-15T23:56:35.346010+0000","last_fullsized":"2023-12-15T23:56:35.346010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:16:50.734122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1463,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334847+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-15T23:56:20.334847+0000","last_peered":"2023-12-15T23:56:20.334847+0000","last_clean":"2023-12-15T23:56:20.334847+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-15T23:56:20.334847+0000","last_undegraded":"2023-12-15T23:56:20.334847+0000","last_fullsized":"2023-12-15T23:56:20.334847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:01.265927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":521,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341886+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-15T23:56:20.341886+0000","last_peered":"2023-12-15T23:56:20.341886+0000","last_clean":"2023-12-15T23:56:20.341886+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-15T23:56:20.341886+0000","last_undegraded":"2023-12-15T23:56:20.341886+0000","last_fullsized":"2023-12-15T23:56:20.341886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:43:56.400622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'7","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343353+0000","last_change":"2023-12-15T22:53:26.161393+0000","last_active":"2023-12-15T23:56:25.343353+0000","last_peered":"2023-12-15T23:56:25.343353+0000","last_clean":"2023-12-15T23:56:25.343353+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-15T23:56:25.343353+0000","last_undegraded":"2023-12-15T23:56:25.343353+0000","last_fullsized":"2023-12-15T23:56:25.343353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366982+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-15T23:57:55.366982+0000","last_peered":"2023-12-15T23:57:55.366982+0000","last_clean":"2023-12-15T23:57:55.366982+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-15T23:57:55.366982+0000","last_undegraded":"2023-12-15T23:57:55.366982+0000","last_fullsized":"2023-12-15T23:57:55.366982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:38.256297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569523+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T23:56:45.569523+0000","last_peered":"2023-12-15T23:56:45.569523+0000","last_clean":"2023-12-15T23:56:45.569523+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T23:56:45.569523+0000","last_undegraded":"2023-12-15T23:56:45.569523+0000","last_fullsized":"2023-12-15T23:56:45.569523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:45.709921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373464+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-15T23:58:25.373464+0000","last_peered":"2023-12-15T23:58:25.373464+0000","last_clean":"2023-12-15T23:58:25.373464+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-15T23:58:25.373464+0000","last_undegraded":"2023-12-15T23:58:25.373464+0000","last_fullsized":"2023-12-15T23:58:25.373464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:48:45.986851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359720+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:57:30.359720+0000","last_peered":"2023-12-15T23:57:30.359720+0000","last_clean":"2023-12-15T23:57:30.359720+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:57:30.359720+0000","last_undegraded":"2023-12-15T23:57:30.359720+0000","last_fullsized":"2023-12-15T23:57:30.359720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":291,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368128+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-15T23:58:05.368128+0000","last_peered":"2023-12-15T23:58:05.368128+0000","last_clean":"2023-12-15T23:58:05.368128+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-15T23:58:05.368128+0000","last_undegraded":"2023-12-15T23:58:05.368128+0000","last_fullsized":"2023-12-15T23:58:05.368128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":970,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584747+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:57:45.584747+0000","last_peered":"2023-12-15T23:57:45.584747+0000","last_clean":"2023-12-15T23:57:45.584747+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:57:45.584747+0000","last_undegraded":"2023-12-15T23:57:45.584747+0000","last_fullsized":"2023-12-15T23:57:45.584747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:03:13.537930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:01.357868+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-15T23:58:01.357868+0000","last_peered":"2023-12-15T23:58:01.357868+0000","last_clean":"2023-12-15T23:58:01.357868+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-15T23:58:01.357868+0000","last_undegraded":"2023-12-15T23:58:01.357868+0000","last_fullsized":"2023-12-15T23:58:01.357868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:24:57.510599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560276+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-15T23:56:10.560276+0000","last_peered":"2023-12-15T23:56:10.560276+0000","last_clean":"2023-12-15T23:56:10.560276+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-15T23:56:10.560276+0000","last_undegraded":"2023-12-15T23:56:10.560276+0000","last_fullsized":"2023-12-15T23:56:10.560276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:20:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337286+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-15T23:56:30.337286+0000","last_peered":"2023-12-15T23:56:30.337286+0000","last_clean":"2023-12-15T23:56:30.337286+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-15T23:56:30.337286+0000","last_undegraded":"2023-12-15T23:56:30.337286+0000","last_fullsized":"2023-12-15T23:56:30.337286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:28:38.545968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1255,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.353261+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:57:05.353261+0000","last_peered":"2023-12-15T23:57:05.353261+0000","last_clean":"2023-12-15T23:57:05.353261+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:57:05.353261+0000","last_undegraded":"2023-12-15T23:57:05.353261+0000","last_fullsized":"2023-12-15T23:57:05.353261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.341816+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:56:50.341816+0000","last_peered":"2023-12-15T23:56:50.341816+0000","last_clean":"2023-12-15T23:56:50.341816+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:56:50.341816+0000","last_undegraded":"2023-12-15T23:56:50.341816+0000","last_fullsized":"2023-12-15T23:56:50.341816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:46.037392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335881+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-15T23:56:25.335881+0000","last_peered":"2023-12-15T23:56:25.335881+0000","last_clean":"2023-12-15T23:56:25.335881+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-15T23:56:25.335881+0000","last_undegraded":"2023-12-15T23:56:25.335881+0000","last_fullsized":"2023-12-15T23:56:25.335881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:44.899079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'576","reported_seq":1445,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335444+0000","last_change":"2023-12-15T22:53:30.181085+0000","last_active":"2023-12-15T23:56:31.335444+0000","last_peered":"2023-12-15T23:56:31.335444+0000","last_clean":"2023-12-15T23:56:31.335444+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-15T23:56:31.335444+0000","last_undegraded":"2023-12-15T23:56:31.335444+0000","last_fullsized":"2023-12-15T23:56:31.335444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:14:42.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":483,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347586+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:56:45.347586+0000","last_peered":"2023-12-15T23:56:45.347586+0000","last_clean":"2023-12-15T23:56:45.347586+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:56:45.347586+0000","last_undegraded":"2023-12-15T23:56:45.347586+0000","last_fullsized":"2023-12-15T23:56:45.347586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:45.822160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336158+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-15T23:56:25.336158+0000","last_peered":"2023-12-15T23:56:25.336158+0000","last_clean":"2023-12-15T23:56:25.336158+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-15T23:56:25.336158+0000","last_undegraded":"2023-12-15T23:56:25.336158+0000","last_fullsized":"2023-12-15T23:56:25.336158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:41.864051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349876+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:57:31.349876+0000","last_peered":"2023-12-15T23:57:31.349876+0000","last_clean":"2023-12-15T23:57:31.349876+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:57:31.349876+0000","last_undegraded":"2023-12-15T23:57:31.349876+0000","last_fullsized":"2023-12-15T23:57:31.349876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366959+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-15T23:57:55.366959+0000","last_peered":"2023-12-15T23:57:55.366959+0000","last_clean":"2023-12-15T23:57:55.366959+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-15T23:57:55.366959+0000","last_undegraded":"2023-12-15T23:57:55.366959+0000","last_fullsized":"2023-12-15T23:57:55.366959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.569612+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T23:56:45.569612+0000","last_peered":"2023-12-15T23:56:45.569612+0000","last_clean":"2023-12-15T23:56:45.569612+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T23:56:45.569612+0000","last_undegraded":"2023-12-15T23:56:45.569612+0000","last_fullsized":"2023-12-15T23:56:45.569612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.348824+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:57:20.348824+0000","last_peered":"2023-12-15T23:57:20.348824+0000","last_clean":"2023-12-15T23:57:20.348824+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:57:20.348824+0000","last_undegraded":"2023-12-15T23:57:20.348824+0000","last_fullsized":"2023-12-15T23:57:20.348824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:37.068698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352526+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:57:41.352526+0000","last_peered":"2023-12-15T23:57:41.352526+0000","last_clean":"2023-12-15T23:57:41.352526+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:57:41.352526+0000","last_undegraded":"2023-12-15T23:57:41.352526+0000","last_fullsized":"2023-12-15T23:57:41.352526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:38.074008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354579+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:57:45.354579+0000","last_peered":"2023-12-15T23:57:45.354579+0000","last_clean":"2023-12-15T23:57:45.354579+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:57:45.354579+0000","last_undegraded":"2023-12-15T23:57:45.354579+0000","last_fullsized":"2023-12-15T23:57:45.354579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:35.667246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339408+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-15T23:56:10.339408+0000","last_peered":"2023-12-15T23:56:10.339408+0000","last_clean":"2023-12-15T23:56:10.339408+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-15T23:56:10.339408+0000","last_undegraded":"2023-12-15T23:56:10.339408+0000","last_fullsized":"2023-12-15T23:56:10.339408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.360399+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-15T23:58:10.360399+0000","last_peered":"2023-12-15T23:58:10.360399+0000","last_clean":"2023-12-15T23:58:10.360399+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-15T23:58:10.360399+0000","last_undegraded":"2023-12-15T23:58:10.360399+0000","last_fullsized":"2023-12-15T23:58:10.360399+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:41.994050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5894,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.353685+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:57:10.353685+0000","last_peered":"2023-12-15T23:57:10.353685+0000","last_clean":"2023-12-15T23:57:10.353685+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:57:10.353685+0000","last_undegraded":"2023-12-15T23:57:10.353685+0000","last_fullsized":"2023-12-15T23:57:10.353685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:57.639999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349295+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:56:50.349295+0000","last_peered":"2023-12-15T23:56:50.349295+0000","last_clean":"2023-12-15T23:56:50.349295+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:56:50.349295+0000","last_undegraded":"2023-12-15T23:56:50.349295+0000","last_fullsized":"2023-12-15T23:56:50.349295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:50:12.433334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.335752+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-15T23:56:25.335752+0000","last_peered":"2023-12-15T23:56:25.335752+0000","last_clean":"2023-12-15T23:56:25.335752+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-15T23:56:25.335752+0000","last_undegraded":"2023-12-15T23:56:25.335752+0000","last_fullsized":"2023-12-15T23:56:25.335752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:55.341702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347565+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:56:45.347565+0000","last_peered":"2023-12-15T23:56:45.347565+0000","last_clean":"2023-12-15T23:56:45.347565+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:56:45.347565+0000","last_undegraded":"2023-12-15T23:56:45.347565+0000","last_fullsized":"2023-12-15T23:56:45.347565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:03.373955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'451","reported_seq":701,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335456+0000","last_change":"2023-12-15T22:53:28.170119+0000","last_active":"2023-12-15T23:56:31.335456+0000","last_peered":"2023-12-15T23:56:31.335456+0000","last_clean":"2023-12-15T23:56:31.335456+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-15T23:56:31.335456+0000","last_undegraded":"2023-12-15T23:56:31.335456+0000","last_fullsized":"2023-12-15T23:56:31.335456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:59.254922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'10","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342140+0000","last_change":"2023-12-15T22:53:26.159502+0000","last_active":"2023-12-15T23:56:25.342140+0000","last_peered":"2023-12-15T23:56:25.342140+0000","last_clean":"2023-12-15T23:56:25.342140+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-15T23:56:25.342140+0000","last_undegraded":"2023-12-15T23:56:25.342140+0000","last_fullsized":"2023-12-15T23:56:25.342140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:20.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354345+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:57:10.354345+0000","last_peered":"2023-12-15T23:57:10.354345+0000","last_clean":"2023-12-15T23:57:10.354345+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:57:10.354345+0000","last_undegraded":"2023-12-15T23:57:10.354345+0000","last_fullsized":"2023-12-15T23:57:10.354345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:52.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357070+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-15T23:57:55.357070+0000","last_peered":"2023-12-15T23:57:55.357070+0000","last_clean":"2023-12-15T23:57:55.357070+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-15T23:57:55.357070+0000","last_undegraded":"2023-12-15T23:57:55.357070+0000","last_fullsized":"2023-12-15T23:57:55.357070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:39.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342609+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:57:01.342609+0000","last_peered":"2023-12-15T23:57:01.342609+0000","last_clean":"2023-12-15T23:57:01.342609+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:57:01.342609+0000","last_undegraded":"2023-12-15T23:57:01.342609+0000","last_fullsized":"2023-12-15T23:57:01.342609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:22:06.285685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361757+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:57:40.361757+0000","last_peered":"2023-12-15T23:57:40.361757+0000","last_clean":"2023-12-15T23:57:40.361757+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:57:40.361757+0000","last_undegraded":"2023-12-15T23:57:40.361757+0000","last_fullsized":"2023-12-15T23:57:40.361757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:05.440726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363199+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:57:45.363199+0000","last_peered":"2023-12-15T23:57:45.363199+0000","last_clean":"2023-12-15T23:57:45.363199+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:57:45.363199+0000","last_undegraded":"2023-12-15T23:57:45.363199+0000","last_fullsized":"2023-12-15T23:57:45.363199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363708+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:57:45.363708+0000","last_peered":"2023-12-15T23:57:45.363708+0000","last_clean":"2023-12-15T23:57:45.363708+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:57:45.363708+0000","last_undegraded":"2023-12-15T23:57:45.363708+0000","last_fullsized":"2023-12-15T23:57:45.363708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:53:48.295717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339673+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-15T23:56:10.339673+0000","last_peered":"2023-12-15T23:56:10.339673+0000","last_clean":"2023-12-15T23:56:10.339673+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-15T23:56:10.339673+0000","last_undegraded":"2023-12-15T23:56:10.339673+0000","last_fullsized":"2023-12-15T23:56:10.339673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:23.866137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.334729+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-15T23:56:20.334729+0000","last_peered":"2023-12-15T23:56:20.334729+0000","last_clean":"2023-12-15T23:56:20.334729+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-15T23:56:20.334729+0000","last_undegraded":"2023-12-15T23:56:20.334729+0000","last_fullsized":"2023-12-15T23:56:20.334729+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:59:44.091525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1396,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350460+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:56:55.350460+0000","last_peered":"2023-12-15T23:56:55.350460+0000","last_clean":"2023-12-15T23:56:55.350460+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:56:55.350460+0000","last_undegraded":"2023-12-15T23:56:55.350460+0000","last_fullsized":"2023-12-15T23:56:55.350460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:24.099749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345610+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:57:05.345610+0000","last_peered":"2023-12-15T23:57:05.345610+0000","last_clean":"2023-12-15T23:57:05.345610+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:57:05.345610+0000","last_undegraded":"2023-12-15T23:57:05.345610+0000","last_fullsized":"2023-12-15T23:57:05.345610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:44.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345642+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-15T23:56:35.345642+0000","last_peered":"2023-12-15T23:56:35.345642+0000","last_clean":"2023-12-15T23:56:35.345642+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-15T23:56:35.345642+0000","last_undegraded":"2023-12-15T23:56:35.345642+0000","last_fullsized":"2023-12-15T23:56:35.345642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:57:51.588416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565447+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-15T23:56:30.565447+0000","last_peered":"2023-12-15T23:56:30.565447+0000","last_clean":"2023-12-15T23:56:30.565447+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-15T23:56:30.565447+0000","last_undegraded":"2023-12-15T23:56:30.565447+0000","last_fullsized":"2023-12-15T23:56:30.565447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:16.498260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'508","reported_seq":744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335339+0000","last_change":"2023-12-15T22:53:28.169971+0000","last_active":"2023-12-15T23:56:31.335339+0000","last_peered":"2023-12-15T23:56:31.335339+0000","last_clean":"2023-12-15T23:56:31.335339+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-15T23:56:31.335339+0000","last_undegraded":"2023-12-15T23:56:31.335339+0000","last_fullsized":"2023-12-15T23:56:31.335339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:31.067844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'4","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342241+0000","last_change":"2023-12-15T22:53:26.156857+0000","last_active":"2023-12-15T23:56:25.342241+0000","last_peered":"2023-12-15T23:56:25.342241+0000","last_clean":"2023-12-15T23:56:25.342241+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-15T23:56:25.342241+0000","last_undegraded":"2023-12-15T23:56:25.342241+0000","last_fullsized":"2023-12-15T23:56:25.342241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:26.114882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359851+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:57:30.359851+0000","last_peered":"2023-12-15T23:57:30.359851+0000","last_clean":"2023-12-15T23:57:30.359851+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:57:30.359851+0000","last_undegraded":"2023-12-15T23:57:30.359851+0000","last_fullsized":"2023-12-15T23:57:30.359851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:46.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.581105+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:57:30.581105+0000","last_peered":"2023-12-15T23:57:30.581105+0000","last_clean":"2023-12-15T23:57:30.581105+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:57:30.581105+0000","last_undegraded":"2023-12-15T23:57:30.581105+0000","last_fullsized":"2023-12-15T23:57:30.581105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:00.417864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.352632+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:57:05.352632+0000","last_peered":"2023-12-15T23:57:05.352632+0000","last_clean":"2023-12-15T23:57:05.352632+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:57:05.352632+0000","last_undegraded":"2023-12-15T23:57:05.352632+0000","last_fullsized":"2023-12-15T23:57:05.352632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:20.385525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.361386+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:57:40.361386+0000","last_peered":"2023-12-15T23:57:40.361386+0000","last_clean":"2023-12-15T23:57:40.361386+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:57:40.361386+0000","last_undegraded":"2023-12-15T23:57:40.361386+0000","last_fullsized":"2023-12-15T23:57:40.361386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:29:02.416195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.584426+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:57:45.584426+0000","last_peered":"2023-12-15T23:57:45.584426+0000","last_clean":"2023-12-15T23:57:45.584426+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:57:45.584426+0000","last_undegraded":"2023-12-15T23:57:45.584426+0000","last_fullsized":"2023-12-15T23:57:45.584426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:26.178233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357505+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:57:25.357505+0000","last_peered":"2023-12-15T23:57:25.357505+0000","last_clean":"2023-12-15T23:57:25.357505+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:57:25.357505+0000","last_undegraded":"2023-12-15T23:57:25.357505+0000","last_fullsized":"2023-12-15T23:57:25.357505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343680+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-15T23:56:25.343680+0000","last_peered":"2023-12-15T23:56:25.343680+0000","last_clean":"2023-12-15T23:56:25.343680+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-15T23:56:25.343680+0000","last_undegraded":"2023-12-15T23:56:25.343680+0000","last_fullsized":"2023-12-15T23:56:25.343680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:25.822041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341365+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-15T23:56:20.341365+0000","last_peered":"2023-12-15T23:56:20.341365+0000","last_clean":"2023-12-15T23:56:20.341365+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-15T23:56:20.341365+0000","last_undegraded":"2023-12-15T23:56:20.341365+0000","last_fullsized":"2023-12-15T23:56:20.341365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:41:05.257834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.350550+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:56:55.350550+0000","last_peered":"2023-12-15T23:56:55.350550+0000","last_clean":"2023-12-15T23:56:55.350550+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:56:55.350550+0000","last_undegraded":"2023-12-15T23:56:55.350550+0000","last_fullsized":"2023-12-15T23:56:55.350550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:50:04.145644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351153+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:57:00.351153+0000","last_peered":"2023-12-15T23:57:00.351153+0000","last_clean":"2023-12-15T23:57:00.351153+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:57:00.351153+0000","last_undegraded":"2023-12-15T23:57:00.351153+0000","last_fullsized":"2023-12-15T23:57:00.351153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339623+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-15T23:56:40.339623+0000","last_peered":"2023-12-15T23:56:40.339623+0000","last_clean":"2023-12-15T23:56:40.339623+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-15T23:56:40.339623+0000","last_undegraded":"2023-12-15T23:56:40.339623+0000","last_fullsized":"2023-12-15T23:56:40.339623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:10.253710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337454+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-15T23:56:30.337454+0000","last_peered":"2023-12-15T23:56:30.337454+0000","last_clean":"2023-12-15T23:56:30.337454+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-15T23:56:30.337454+0000","last_undegraded":"2023-12-15T23:56:30.337454+0000","last_fullsized":"2023-12-15T23:56:30.337454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:22.564483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'257","reported_seq":415,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335270+0000","last_change":"2023-12-15T22:53:28.170194+0000","last_active":"2023-12-15T23:56:31.335270+0000","last_peered":"2023-12-15T23:56:31.335270+0000","last_clean":"2023-12-15T23:56:31.335270+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-15T23:56:31.335270+0000","last_undegraded":"2023-12-15T23:56:31.335270+0000","last_fullsized":"2023-12-15T23:56:31.335270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:11:38.876935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.347230+0000","last_change":"2023-12-15T22:53:26.165429+0000","last_active":"2023-12-15T23:56:40.347230+0000","last_peered":"2023-12-15T23:56:40.347230+0000","last_clean":"2023-12-15T23:56:40.347230+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-15T23:56:40.347230+0000","last_undegraded":"2023-12-15T23:56:40.347230+0000","last_fullsized":"2023-12-15T23:56:40.347230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580909+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:57:30.580909+0000","last_peered":"2023-12-15T23:57:30.580909+0000","last_clean":"2023-12-15T23:57:30.580909+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:57:30.580909+0000","last_undegraded":"2023-12-15T23:57:30.580909+0000","last_fullsized":"2023-12-15T23:57:30.580909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:54.449348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362785+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:57:45.362785+0000","last_peered":"2023-12-15T23:57:45.362785+0000","last_clean":"2023-12-15T23:57:45.362785+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:57:45.362785+0000","last_undegraded":"2023-12-15T23:57:45.362785+0000","last_fullsized":"2023-12-15T23:57:45.362785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354594+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:57:10.354594+0000","last_peered":"2023-12-15T23:57:10.354594+0000","last_clean":"2023-12-15T23:57:10.354594+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:57:10.354594+0000","last_undegraded":"2023-12-15T23:57:10.354594+0000","last_fullsized":"2023-12-15T23:57:10.354594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:51:20.180684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362345+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:57:40.362345+0000","last_peered":"2023-12-15T23:57:40.362345+0000","last_clean":"2023-12-15T23:57:40.362345+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:57:40.362345+0000","last_undegraded":"2023-12-15T23:57:40.362345+0000","last_fullsized":"2023-12-15T23:57:40.362345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:18:05.150912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.358388+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:57:25.358388+0000","last_peered":"2023-12-15T23:57:25.358388+0000","last_clean":"2023-12-15T23:57:25.358388+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:57:25.358388+0000","last_undegraded":"2023-12-15T23:57:25.358388+0000","last_fullsized":"2023-12-15T23:57:25.358388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:25:53.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:46.353727+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:57:46.353727+0000","last_peered":"2023-12-15T23:57:46.353727+0000","last_clean":"2023-12-15T23:57:46.353727+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:57:46.353727+0000","last_undegraded":"2023-12-15T23:57:46.353727+0000","last_fullsized":"2023-12-15T23:57:46.353727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:59:28.187833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339815+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-15T23:56:10.339815+0000","last_peered":"2023-12-15T23:56:10.339815+0000","last_clean":"2023-12-15T23:56:10.339815+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-15T23:56:10.339815+0000","last_undegraded":"2023-12-15T23:56:10.339815+0000","last_fullsized":"2023-12-15T23:56:10.339815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:12.734358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351687+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:57:00.351687+0000","last_peered":"2023-12-15T23:57:00.351687+0000","last_clean":"2023-12-15T23:57:00.351687+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:57:00.351687+0000","last_undegraded":"2023-12-15T23:57:00.351687+0000","last_fullsized":"2023-12-15T23:57:00.351687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:24:08.485765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6349,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.332807+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-15T23:55:45.332807+0000","last_peered":"2023-12-15T23:55:45.332807+0000","last_clean":"2023-12-15T23:55:45.332807+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-15T23:55:45.332807+0000","last_undegraded":"2023-12-15T23:55:45.332807+0000","last_fullsized":"2023-12-15T23:55:45.332807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:16.965706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565280+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:56:30.565280+0000","last_peered":"2023-12-15T23:56:30.565280+0000","last_clean":"2023-12-15T23:56:30.565280+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:56:30.565280+0000","last_undegraded":"2023-12-15T23:56:30.565280+0000","last_fullsized":"2023-12-15T23:56:30.565280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:58.613135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327858+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-15T23:56:01.327858+0000","last_peered":"2023-12-15T23:56:01.327858+0000","last_clean":"2023-12-15T23:56:01.327858+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-15T23:56:01.327858+0000","last_undegraded":"2023-12-15T23:56:01.327858+0000","last_fullsized":"2023-12-15T23:56:01.327858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:53:26.351832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337075+0000","last_change":"2023-12-15T22:53:30.176406+0000","last_active":"2023-12-15T23:56:00.337075+0000","last_peered":"2023-12-15T23:56:00.337075+0000","last_clean":"2023-12-15T23:56:00.337075+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-15T23:56:00.337075+0000","last_undegraded":"2023-12-15T23:56:00.337075+0000","last_fullsized":"2023-12-15T23:56:00.337075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'664","reported_seq":1171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327978+0000","last_change":"2023-12-15T22:53:28.170239+0000","last_active":"2023-12-15T23:56:01.327978+0000","last_peered":"2023-12-15T23:56:01.327978+0000","last_clean":"2023-12-15T23:56:01.327978+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-15T23:56:01.327978+0000","last_undegraded":"2023-12-15T23:56:01.327978+0000","last_fullsized":"2023-12-15T23:56:01.327978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:16:43.649404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362601+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:57:40.362601+0000","last_peered":"2023-12-15T23:57:40.362601+0000","last_clean":"2023-12-15T23:57:40.362601+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:57:40.362601+0000","last_undegraded":"2023-12-15T23:57:40.362601+0000","last_fullsized":"2023-12-15T23:57:40.362601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:07:47.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.364059+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:57:45.364059+0000","last_peered":"2023-12-15T23:57:45.364059+0000","last_clean":"2023-12-15T23:57:45.364059+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:57:45.364059+0000","last_undegraded":"2023-12-15T23:57:45.364059+0000","last_fullsized":"2023-12-15T23:57:45.364059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:17:53.191887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326479+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-15T23:55:56.326479+0000","last_peered":"2023-12-15T23:55:56.326479+0000","last_clean":"2023-12-15T23:55:56.326479+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-15T23:55:56.326479+0000","last_undegraded":"2023-12-15T23:55:56.326479+0000","last_fullsized":"2023-12-15T23:55:56.326479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338312+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-15T23:56:10.338312+0000","last_peered":"2023-12-15T23:56:10.338312+0000","last_clean":"2023-12-15T23:56:10.338312+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-15T23:56:10.338312+0000","last_undegraded":"2023-12-15T23:56:10.338312+0000","last_fullsized":"2023-12-15T23:56:10.338312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:49.396138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558965+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-15T23:56:05.558965+0000","last_peered":"2023-12-15T23:56:05.558965+0000","last_clean":"2023-12-15T23:56:05.558965+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-15T23:56:05.558965+0000","last_undegraded":"2023-12-15T23:56:05.558965+0000","last_fullsized":"2023-12-15T23:56:05.558965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.340685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332420+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-15T23:56:10.332420+0000","last_peered":"2023-12-15T23:56:10.332420+0000","last_clean":"2023-12-15T23:56:10.332420+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-15T23:56:10.332420+0000","last_undegraded":"2023-12-15T23:56:10.332420+0000","last_fullsized":"2023-12-15T23:56:10.332420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:32.639017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560105+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-15T23:56:10.560105+0000","last_peered":"2023-12-15T23:56:10.560105+0000","last_clean":"2023-12-15T23:56:10.560105+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-15T23:56:10.560105+0000","last_undegraded":"2023-12-15T23:56:10.560105+0000","last_fullsized":"2023-12-15T23:56:10.560105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:15.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:11.344902+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:57:11.344902+0000","last_peered":"2023-12-15T23:57:11.344902+0000","last_clean":"2023-12-15T23:57:11.344902+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:57:11.344902+0000","last_undegraded":"2023-12-15T23:57:11.344902+0000","last_fullsized":"2023-12-15T23:57:11.344902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:19:56.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6459,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.571801+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:56:55.571801+0000","last_peered":"2023-12-15T23:56:55.571801+0000","last_clean":"2023-12-15T23:56:55.571801+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:56:55.571801+0000","last_undegraded":"2023-12-15T23:56:55.571801+0000","last_fullsized":"2023-12-15T23:56:55.571801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:44.932642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335217+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:56:31.335217+0000","last_peered":"2023-12-15T23:56:31.335217+0000","last_clean":"2023-12-15T23:56:31.335217+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:56:31.335217+0000","last_undegraded":"2023-12-15T23:56:31.335217+0000","last_fullsized":"2023-12-15T23:56:31.335217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:35:41.316820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:01.327752+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-15T23:56:01.327752+0000","last_peered":"2023-12-15T23:56:01.327752+0000","last_clean":"2023-12-15T23:56:01.327752+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-15T23:56:01.327752+0000","last_undegraded":"2023-12-15T23:56:01.327752+0000","last_fullsized":"2023-12-15T23:56:01.327752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:21.948714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335881+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-15T23:56:00.335881+0000","last_peered":"2023-12-15T23:56:00.335881+0000","last_clean":"2023-12-15T23:56:00.335881+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-15T23:56:00.335881+0000","last_undegraded":"2023-12-15T23:56:00.335881+0000","last_fullsized":"2023-12-15T23:56:00.335881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:21.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'305","reported_seq":1269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337063+0000","last_change":"2023-12-15T22:53:28.171127+0000","last_active":"2023-12-15T23:56:00.337063+0000","last_peered":"2023-12-15T23:56:00.337063+0000","last_clean":"2023-12-15T23:56:00.337063+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-15T23:56:00.337063+0000","last_undegraded":"2023-12-15T23:56:00.337063+0000","last_fullsized":"2023-12-15T23:56:00.337063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:34.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:36.351648+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:57:36.351648+0000","last_peered":"2023-12-15T23:57:36.351648+0000","last_clean":"2023-12-15T23:57:36.351648+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:57:36.351648+0000","last_undegraded":"2023-12-15T23:57:36.351648+0000","last_fullsized":"2023-12-15T23:57:36.351648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:10.880484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578776+0000","last_change":"2023-12-15T22:53:10.339946+0000","last_active":"2023-12-15T23:57:20.578776+0000","last_peered":"2023-12-15T23:57:20.578776+0000","last_clean":"2023-12-15T23:57:20.578776+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-15T23:57:20.578776+0000","last_undegraded":"2023-12-15T23:57:20.578776+0000","last_fullsized":"2023-12-15T23:57:20.578776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:00.828548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556705+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-15T23:55:55.556705+0000","last_peered":"2023-12-15T23:55:55.556705+0000","last_clean":"2023-12-15T23:55:55.556705+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-15T23:55:55.556705+0000","last_undegraded":"2023-12-15T23:55:55.556705+0000","last_fullsized":"2023-12-15T23:55:55.556705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:11.766843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331477+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-15T23:55:45.331477+0000","last_peered":"2023-12-15T23:55:45.331477+0000","last_clean":"2023-12-15T23:55:45.331477+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-15T23:55:45.331477+0000","last_undegraded":"2023-12-15T23:55:45.331477+0000","last_fullsized":"2023-12-15T23:55:45.331477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.559062+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-15T23:56:05.559062+0000","last_peered":"2023-12-15T23:56:05.559062+0000","last_clean":"2023-12-15T23:56:05.559062+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-15T23:56:05.559062+0000","last_undegraded":"2023-12-15T23:56:05.559062+0000","last_fullsized":"2023-12-15T23:56:05.559062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:07.029772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339351+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-15T23:56:10.339351+0000","last_peered":"2023-12-15T23:56:10.339351+0000","last_clean":"2023-12-15T23:56:10.339351+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-15T23:56:10.339351+0000","last_undegraded":"2023-12-15T23:56:10.339351+0000","last_fullsized":"2023-12-15T23:56:10.339351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338079+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-15T23:56:10.338079+0000","last_peered":"2023-12-15T23:56:10.338079+0000","last_clean":"2023-12-15T23:56:10.338079+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-15T23:56:10.338079+0000","last_undegraded":"2023-12-15T23:56:10.338079+0000","last_fullsized":"2023-12-15T23:56:10.338079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339159+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:56:10.339159+0000","last_peered":"2023-12-15T23:56:10.339159+0000","last_clean":"2023-12-15T23:56:10.339159+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:56:10.339159+0000","last_undegraded":"2023-12-15T23:56:10.339159+0000","last_fullsized":"2023-12-15T23:56:10.339159+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:33.647312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566664+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:56:35.566664+0000","last_peered":"2023-12-15T23:56:35.566664+0000","last_clean":"2023-12-15T23:56:35.566664+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:56:35.566664+0000","last_undegraded":"2023-12-15T23:56:35.566664+0000","last_fullsized":"2023-12-15T23:56:35.566664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:27:16.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349198+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:56:50.349198+0000","last_peered":"2023-12-15T23:56:50.349198+0000","last_clean":"2023-12-15T23:56:50.349198+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:56:50.349198+0000","last_undegraded":"2023-12-15T23:56:50.349198+0000","last_fullsized":"2023-12-15T23:56:50.349198+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:05.435125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.346684+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:56:40.346684+0000","last_peered":"2023-12-15T23:56:40.346684+0000","last_clean":"2023-12-15T23:56:40.346684+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:56:40.346684+0000","last_undegraded":"2023-12-15T23:56:40.346684+0000","last_fullsized":"2023-12-15T23:56:40.346684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:31:12.934733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.362877+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:57:45.362877+0000","last_peered":"2023-12-15T23:57:45.362877+0000","last_clean":"2023-12-15T23:57:45.362877+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:57:45.362877+0000","last_undegraded":"2023-12-15T23:57:45.362877+0000","last_fullsized":"2023-12-15T23:57:45.362877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:51:36.640304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":378,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.368919+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-15T23:58:05.368919+0000","last_peered":"2023-12-15T23:58:05.368919+0000","last_clean":"2023-12-15T23:58:05.368919+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-15T23:58:05.368919+0000","last_undegraded":"2023-12-15T23:58:05.368919+0000","last_fullsized":"2023-12-15T23:58:05.368919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:51:14.082183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'13","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336008+0000","last_change":"2023-12-15T22:53:26.159079+0000","last_active":"2023-12-15T23:55:55.336008+0000","last_peered":"2023-12-15T23:55:55.336008+0000","last_clean":"2023-12-15T23:55:55.336008+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-15T23:55:55.336008+0000","last_undegraded":"2023-12-15T23:55:55.336008+0000","last_fullsized":"2023-12-15T23:55:55.336008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:12.478013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332497+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-15T23:55:40.332497+0000","last_peered":"2023-12-15T23:55:40.332497+0000","last_clean":"2023-12-15T23:55:40.332497+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-15T23:55:40.332497+0000","last_undegraded":"2023-12-15T23:55:40.332497+0000","last_fullsized":"2023-12-15T23:55:40.332497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328561+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-15T23:55:55.328561+0000","last_peered":"2023-12-15T23:55:55.328561+0000","last_clean":"2023-12-15T23:55:55.328561+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-15T23:55:55.328561+0000","last_undegraded":"2023-12-15T23:55:55.328561+0000","last_fullsized":"2023-12-15T23:55:55.328561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:21:40.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333269+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-15T23:55:45.333269+0000","last_peered":"2023-12-15T23:55:45.333269+0000","last_clean":"2023-12-15T23:55:45.333269+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-15T23:55:45.333269+0000","last_undegraded":"2023-12-15T23:55:45.333269+0000","last_fullsized":"2023-12-15T23:55:45.333269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:52.442746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:06.328850+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-15T23:56:06.328850+0000","last_peered":"2023-12-15T23:56:06.328850+0000","last_clean":"2023-12-15T23:56:06.328850+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-15T23:56:06.328850+0000","last_undegraded":"2023-12-15T23:56:06.328850+0000","last_fullsized":"2023-12-15T23:56:06.328850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:47.168313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332639+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-15T23:56:10.332639+0000","last_peered":"2023-12-15T23:56:10.332639+0000","last_clean":"2023-12-15T23:56:10.332639+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-15T23:56:10.332639+0000","last_undegraded":"2023-12-15T23:56:10.332639+0000","last_fullsized":"2023-12-15T23:56:10.332639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:04.124976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339169+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-15T23:56:10.339169+0000","last_peered":"2023-12-15T23:56:10.339169+0000","last_clean":"2023-12-15T23:56:10.339169+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-15T23:56:10.339169+0000","last_undegraded":"2023-12-15T23:56:10.339169+0000","last_fullsized":"2023-12-15T23:56:10.339169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:27.858155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":33,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338272+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:56:10.338272+0000","last_peered":"2023-12-15T23:56:10.338272+0000","last_clean":"2023-12-15T23:56:10.338272+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:56:10.338272+0000","last_undegraded":"2023-12-15T23:56:10.338272+0000","last_fullsized":"2023-12-15T23:56:10.338272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:45:30.242778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1074,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:35.360241+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-15T23:57:35.360241+0000","last_peered":"2023-12-15T23:57:35.360241+0000","last_clean":"2023-12-15T23:57:35.360241+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-15T23:57:35.360241+0000","last_undegraded":"2023-12-15T23:57:35.360241+0000","last_fullsized":"2023-12-15T23:57:35.360241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:06:36.880386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345517+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:57:05.345517+0000","last_peered":"2023-12-15T23:57:05.345517+0000","last_clean":"2023-12-15T23:57:05.345517+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:57:05.345517+0000","last_undegraded":"2023-12-15T23:57:05.345517+0000","last_fullsized":"2023-12-15T23:57:05.345517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:04.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.563776+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:56:25.563776+0000","last_peered":"2023-12-15T23:56:25.563776+0000","last_clean":"2023-12-15T23:56:25.563776+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:56:25.563776+0000","last_undegraded":"2023-12-15T23:56:25.563776+0000","last_fullsized":"2023-12-15T23:56:25.563776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:40:17.731463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1744,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:05.359433+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-15T23:58:05.359433+0000","last_peered":"2023-12-15T23:58:05.359433+0000","last_clean":"2023-12-15T23:58:05.359433+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-15T23:58:05.359433+0000","last_undegraded":"2023-12-15T23:58:05.359433+0000","last_fullsized":"2023-12-15T23:58:05.359433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:53.623883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'241","reported_seq":382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363959+0000","last_change":"2023-12-15T22:53:28.167550+0000","last_active":"2023-12-15T23:57:45.363959+0000","last_peered":"2023-12-15T23:57:45.363959+0000","last_clean":"2023-12-15T23:57:45.363959+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-15T23:57:45.363959+0000","last_undegraded":"2023-12-15T23:57:45.363959+0000","last_fullsized":"2023-12-15T23:57:45.363959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:32:59.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336091+0000","last_change":"2023-12-15T22:53:26.159624+0000","last_active":"2023-12-15T23:55:55.336091+0000","last_peered":"2023-12-15T23:55:55.336091+0000","last_clean":"2023-12-15T23:55:55.336091+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-15T23:55:55.336091+0000","last_undegraded":"2023-12-15T23:55:55.336091+0000","last_fullsized":"2023-12-15T23:55:55.336091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:17.442064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.331897+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-15T23:55:40.331897+0000","last_peered":"2023-12-15T23:55:40.331897+0000","last_clean":"2023-12-15T23:55:40.331897+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-15T23:55:40.331897+0000","last_undegraded":"2023-12-15T23:55:40.331897+0000","last_fullsized":"2023-12-15T23:55:40.331897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556515+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-15T23:55:55.556515+0000","last_peered":"2023-12-15T23:55:55.556515+0000","last_clean":"2023-12-15T23:55:55.556515+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-15T23:55:55.556515+0000","last_undegraded":"2023-12-15T23:55:55.556515+0000","last_fullsized":"2023-12-15T23:55:55.556515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:50:20.512624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333945+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-15T23:55:45.333945+0000","last_peered":"2023-12-15T23:55:45.333945+0000","last_clean":"2023-12-15T23:55:45.333945+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-15T23:55:45.333945+0000","last_undegraded":"2023-12-15T23:55:45.333945+0000","last_fullsized":"2023-12-15T23:55:45.333945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:15:32.086477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.336769+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-15T23:56:05.336769+0000","last_peered":"2023-12-15T23:56:05.336769+0000","last_clean":"2023-12-15T23:56:05.336769+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-15T23:56:05.336769+0000","last_undegraded":"2023-12-15T23:56:05.336769+0000","last_fullsized":"2023-12-15T23:56:05.336769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339145+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-15T23:56:10.339145+0000","last_peered":"2023-12-15T23:56:10.339145+0000","last_clean":"2023-12-15T23:56:10.339145+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-15T23:56:10.339145+0000","last_undegraded":"2023-12-15T23:56:10.339145+0000","last_fullsized":"2023-12-15T23:56:10.339145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.339600+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-15T23:56:10.339600+0000","last_peered":"2023-12-15T23:56:10.339600+0000","last_clean":"2023-12-15T23:56:10.339600+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-15T23:56:10.339600+0000","last_undegraded":"2023-12-15T23:56:10.339600+0000","last_fullsized":"2023-12-15T23:56:10.339600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:17:49.172161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:50.364535+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-15T23:57:50.364535+0000","last_peered":"2023-12-15T23:57:50.364535+0000","last_clean":"2023-12-15T23:57:50.364535+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-15T23:57:50.364535+0000","last_undegraded":"2023-12-15T23:57:50.364535+0000","last_fullsized":"2023-12-15T23:57:50.364535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:12:41.314286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.349901+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:56:55.349901+0000","last_peered":"2023-12-15T23:56:55.349901+0000","last_clean":"2023-12-15T23:56:55.349901+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:56:55.349901+0000","last_undegraded":"2023-12-15T23:56:55.349901+0000","last_fullsized":"2023-12-15T23:56:55.349901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:34.042876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349864+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:56:50.349864+0000","last_peered":"2023-12-15T23:56:50.349864+0000","last_clean":"2023-12-15T23:56:50.349864+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:56:50.349864+0000","last_undegraded":"2023-12-15T23:56:50.349864+0000","last_fullsized":"2023-12-15T23:56:50.349864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:18.085421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:21.333233+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:56:21.333233+0000","last_peered":"2023-12-15T23:56:21.333233+0000","last_clean":"2023-12-15T23:56:21.333233+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:56:21.333233+0000","last_undegraded":"2023-12-15T23:56:21.333233+0000","last_fullsized":"2023-12-15T23:56:21.333233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:38.871309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344252+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:56:30.344252+0000","last_peered":"2023-12-15T23:56:30.344252+0000","last_clean":"2023-12-15T23:56:30.344252+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:56:30.344252+0000","last_undegraded":"2023-12-15T23:56:30.344252+0000","last_fullsized":"2023-12-15T23:56:30.344252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:50.375179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1842","reported_seq":2750,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344111+0000","last_change":"2023-12-15T22:53:28.170890+0000","last_active":"2023-12-15T23:56:30.344111+0000","last_peered":"2023-12-15T23:56:30.344111+0000","last_clean":"2023-12-15T23:56:30.344111+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-15T23:56:30.344111+0000","last_undegraded":"2023-12-15T23:56:30.344111+0000","last_fullsized":"2023-12-15T23:56:30.344111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:16.035980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343005+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-15T23:56:25.343005+0000","last_peered":"2023-12-15T23:56:25.343005+0000","last_clean":"2023-12-15T23:56:25.343005+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-15T23:56:25.343005+0000","last_undegraded":"2023-12-15T23:56:25.343005+0000","last_fullsized":"2023-12-15T23:56:25.343005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:49.603636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.359523+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:57:30.359523+0000","last_peered":"2023-12-15T23:57:30.359523+0000","last_clean":"2023-12-15T23:57:30.359523+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:57:30.359523+0000","last_undegraded":"2023-12-15T23:57:30.359523+0000","last_fullsized":"2023-12-15T23:57:30.359523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:31:26.930020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.326348+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-15T23:55:45.326348+0000","last_peered":"2023-12-15T23:55:45.326348+0000","last_clean":"2023-12-15T23:55:45.326348+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-15T23:55:45.326348+0000","last_undegraded":"2023-12-15T23:55:45.326348+0000","last_fullsized":"2023-12-15T23:55:45.326348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:43.407151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.357609+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:57:20.357609+0000","last_peered":"2023-12-15T23:57:20.357609+0000","last_clean":"2023-12-15T23:57:20.357609+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:57:20.357609+0000","last_undegraded":"2023-12-15T23:57:20.357609+0000","last_fullsized":"2023-12-15T23:57:20.357609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:20.023504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552614+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-15T23:55:40.552614+0000","last_peered":"2023-12-15T23:55:40.552614+0000","last_clean":"2023-12-15T23:55:40.552614+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-15T23:55:40.552614+0000","last_undegraded":"2023-12-15T23:55:40.552614+0000","last_fullsized":"2023-12-15T23:55:40.552614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329954+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-15T23:55:40.329954+0000","last_peered":"2023-12-15T23:55:40.329954+0000","last_clean":"2023-12-15T23:55:40.329954+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-15T23:55:40.329954+0000","last_undegraded":"2023-12-15T23:55:40.329954+0000","last_fullsized":"2023-12-15T23:55:40.329954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.560395+0000","last_change":"2023-12-15T22:53:11.078111+0000","last_active":"2023-12-15T23:56:10.560395+0000","last_peered":"2023-12-15T23:56:10.560395+0000","last_clean":"2023-12-15T23:56:10.560395+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-15T23:56:10.560395+0000","last_undegraded":"2023-12-15T23:56:10.560395+0000","last_fullsized":"2023-12-15T23:56:10.560395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:39.953836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351884+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:57:00.351884+0000","last_peered":"2023-12-15T23:57:00.351884+0000","last_clean":"2023-12-15T23:57:00.351884+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:57:00.351884+0000","last_undegraded":"2023-12-15T23:57:00.351884+0000","last_fullsized":"2023-12-15T23:57:00.351884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:35.240310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4381,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:21.347747+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:57:21.347747+0000","last_peered":"2023-12-15T23:57:21.347747+0000","last_clean":"2023-12-15T23:57:21.347747+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:57:21.347747+0000","last_undegraded":"2023-12-15T23:57:21.347747+0000","last_fullsized":"2023-12-15T23:57:21.347747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:58.493238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349786+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:56:50.349786+0000","last_peered":"2023-12-15T23:56:50.349786+0000","last_clean":"2023-12-15T23:56:50.349786+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:56:50.349786+0000","last_undegraded":"2023-12-15T23:56:50.349786+0000","last_fullsized":"2023-12-15T23:56:50.349786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:42.139142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343348+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:56:25.343348+0000","last_peered":"2023-12-15T23:56:25.343348+0000","last_clean":"2023-12-15T23:56:25.343348+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:56:25.343348+0000","last_undegraded":"2023-12-15T23:56:25.343348+0000","last_fullsized":"2023-12-15T23:56:25.343348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:06.358488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.337251+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:56:30.337251+0000","last_peered":"2023-12-15T23:56:30.337251+0000","last_clean":"2023-12-15T23:56:30.337251+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:56:30.337251+0000","last_undegraded":"2023-12-15T23:56:30.337251+0000","last_fullsized":"2023-12-15T23:56:30.337251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:33.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2119","reported_seq":2950,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:31.335033+0000","last_change":"2023-12-15T22:53:28.169796+0000","last_active":"2023-12-15T23:56:31.335033+0000","last_peered":"2023-12-15T23:56:31.335033+0000","last_clean":"2023-12-15T23:56:31.335033+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-15T23:56:31.335033+0000","last_undegraded":"2023-12-15T23:56:31.335033+0000","last_fullsized":"2023-12-15T23:56:31.335033+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":400,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:22:11.825688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'5","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.342010+0000","last_change":"2023-12-15T22:53:26.156319+0000","last_active":"2023-12-15T23:56:25.342010+0000","last_peered":"2023-12-15T23:56:25.342010+0000","last_clean":"2023-12-15T23:56:25.342010+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-15T23:56:25.342010+0000","last_undegraded":"2023-12-15T23:56:25.342010+0000","last_fullsized":"2023-12-15T23:56:25.342010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:31:15.921642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.354866+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:57:10.354866+0000","last_peered":"2023-12-15T23:57:10.354866+0000","last_clean":"2023-12-15T23:57:10.354866+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:57:10.354866+0000","last_undegraded":"2023-12-15T23:57:10.354866+0000","last_fullsized":"2023-12-15T23:57:10.354866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:48.539767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556585+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-15T23:55:55.556585+0000","last_peered":"2023-12-15T23:55:55.556585+0000","last_clean":"2023-12-15T23:55:55.556585+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-15T23:55:55.556585+0000","last_undegraded":"2023-12-15T23:55:55.556585+0000","last_fullsized":"2023-12-15T23:55:55.556585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:01.386722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362341+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:57:40.362341+0000","last_peered":"2023-12-15T23:57:40.362341+0000","last_clean":"2023-12-15T23:57:40.362341+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:57:40.362341+0000","last_undegraded":"2023-12-15T23:57:40.362341+0000","last_fullsized":"2023-12-15T23:57:40.362341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:40:38.848380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329967+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-15T23:55:40.329967+0000","last_peered":"2023-12-15T23:55:40.329967+0000","last_clean":"2023-12-15T23:55:40.329967+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-15T23:55:40.329967+0000","last_undegraded":"2023-12-15T23:55:40.329967+0000","last_fullsized":"2023-12-15T23:55:40.329967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:43.553443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.552603+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-15T23:55:40.552603+0000","last_peered":"2023-12-15T23:55:40.552603+0000","last_clean":"2023-12-15T23:55:40.552603+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-15T23:55:40.552603+0000","last_undegraded":"2023-12-15T23:55:40.552603+0000","last_fullsized":"2023-12-15T23:55:40.552603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:59.504031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338205+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-15T23:56:10.338205+0000","last_peered":"2023-12-15T23:56:10.338205+0000","last_clean":"2023-12-15T23:56:10.338205+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-15T23:56:10.338205+0000","last_undegraded":"2023-12-15T23:56:10.338205+0000","last_fullsized":"2023-12-15T23:56:10.338205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:45:21.838509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.352260+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:57:00.352260+0000","last_peered":"2023-12-15T23:57:00.352260+0000","last_clean":"2023-12-15T23:57:00.352260+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:57:00.352260+0000","last_undegraded":"2023-12-15T23:57:00.352260+0000","last_fullsized":"2023-12-15T23:57:00.352260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:55:00.386613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1324,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572418+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:56:55.572418+0000","last_peered":"2023-12-15T23:56:55.572418+0000","last_clean":"2023-12-15T23:56:55.572418+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:56:55.572418+0000","last_undegraded":"2023-12-15T23:56:55.572418+0000","last_fullsized":"2023-12-15T23:56:55.572418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:23.586325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:15.356017+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:57:15.356017+0000","last_peered":"2023-12-15T23:57:15.356017+0000","last_clean":"2023-12-15T23:57:15.356017+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:57:15.356017+0000","last_undegraded":"2023-12-15T23:57:15.356017+0000","last_fullsized":"2023-12-15T23:57:15.356017+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:18.646225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343275+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:56:25.343275+0000","last_peered":"2023-12-15T23:56:25.343275+0000","last_clean":"2023-12-15T23:56:25.343275+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:56:25.343275+0000","last_undegraded":"2023-12-15T23:56:25.343275+0000","last_fullsized":"2023-12-15T23:56:25.343275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:25.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.343129+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:56:30.343129+0000","last_peered":"2023-12-15T23:56:30.343129+0000","last_clean":"2023-12-15T23:56:30.343129+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:56:30.343129+0000","last_undegraded":"2023-12-15T23:56:30.343129+0000","last_fullsized":"2023-12-15T23:56:30.343129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:30.622729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":362,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.565404+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:56:30.565404+0000","last_peered":"2023-12-15T23:56:30.565404+0000","last_clean":"2023-12-15T23:56:30.565404+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:56:30.565404+0000","last_undegraded":"2023-12-15T23:56:30.565404+0000","last_fullsized":"2023-12-15T23:56:30.565404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:06:28.380180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334009+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-15T23:56:26.334009+0000","last_peered":"2023-12-15T23:56:26.334009+0000","last_clean":"2023-12-15T23:56:26.334009+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-15T23:56:26.334009+0000","last_undegraded":"2023-12-15T23:56:26.334009+0000","last_fullsized":"2023-12-15T23:56:26.334009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:06.119748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366844+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-15T23:57:55.366844+0000","last_peered":"2023-12-15T23:57:55.366844+0000","last_clean":"2023-12-15T23:57:55.366844+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-15T23:57:55.366844+0000","last_undegraded":"2023-12-15T23:57:55.366844+0000","last_fullsized":"2023-12-15T23:57:55.366844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356242+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-15T23:57:56.356242+0000","last_peered":"2023-12-15T23:57:56.356242+0000","last_clean":"2023-12-15T23:57:56.356242+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-15T23:57:56.356242+0000","last_undegraded":"2023-12-15T23:57:56.356242+0000","last_fullsized":"2023-12-15T23:57:56.356242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321741+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-15T23:55:36.321741+0000","last_peered":"2023-12-15T23:55:36.321741+0000","last_clean":"2023-12-15T23:55:36.321741+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-15T23:55:36.321741+0000","last_undegraded":"2023-12-15T23:55:36.321741+0000","last_fullsized":"2023-12-15T23:55:36.321741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:50.986250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354891+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:57:45.354891+0000","last_peered":"2023-12-15T23:57:45.354891+0000","last_clean":"2023-12-15T23:57:45.354891+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:57:45.354891+0000","last_undegraded":"2023-12-15T23:57:45.354891+0000","last_fullsized":"2023-12-15T23:57:45.354891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:50.449966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:20.578797+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:57:20.578797+0000","last_peered":"2023-12-15T23:57:20.578797+0000","last_clean":"2023-12-15T23:57:20.578797+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:57:20.578797+0000","last_undegraded":"2023-12-15T23:57:20.578797+0000","last_fullsized":"2023-12-15T23:57:20.578797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.874565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338114+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-15T23:56:10.338114+0000","last_peered":"2023-12-15T23:56:10.338114+0000","last_clean":"2023-12-15T23:56:10.338114+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-15T23:56:10.338114+0000","last_undegraded":"2023-12-15T23:56:10.338114+0000","last_fullsized":"2023-12-15T23:56:10.338114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:10:20.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:01.342768+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:57:01.342768+0000","last_peered":"2023-12-15T23:57:01.342768+0000","last_clean":"2023-12-15T23:57:01.342768+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:57:01.342768+0000","last_undegraded":"2023-12-15T23:57:01.342768+0000","last_fullsized":"2023-12-15T23:57:01.342768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:55.120521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3844,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:55.572342+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:56:55.572342+0000","last_peered":"2023-12-15T23:56:55.572342+0000","last_clean":"2023-12-15T23:56:55.572342+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:56:55.572342+0000","last_undegraded":"2023-12-15T23:56:55.572342+0000","last_fullsized":"2023-12-15T23:56:55.572342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:09.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:51.340241+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:56:51.340241+0000","last_peered":"2023-12-15T23:56:51.340241+0000","last_clean":"2023-12-15T23:56:51.340241+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:56:51.340241+0000","last_undegraded":"2023-12-15T23:56:51.340241+0000","last_fullsized":"2023-12-15T23:56:51.340241+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:55.739562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:50.349521+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:56:50.349521+0000","last_peered":"2023-12-15T23:56:50.349521+0000","last_clean":"2023-12-15T23:56:50.349521+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:56:50.349521+0000","last_undegraded":"2023-12-15T23:56:50.349521+0000","last_fullsized":"2023-12-15T23:56:50.349521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:02:18.788244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344265+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:56:30.344265+0000","last_peered":"2023-12-15T23:56:30.344265+0000","last_clean":"2023-12-15T23:56:30.344265+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:56:30.344265+0000","last_undegraded":"2023-12-15T23:56:30.344265+0000","last_fullsized":"2023-12-15T23:56:30.344265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:33:01.580743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9956","reported_seq":16962,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344181+0000","last_change":"2023-12-15T22:53:28.170727+0000","last_active":"2023-12-15T23:56:30.344181+0000","last_peered":"2023-12-15T23:56:30.344181+0000","last_clean":"2023-12-15T23:56:30.344181+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-15T23:56:30.344181+0000","last_undegraded":"2023-12-15T23:56:30.344181+0000","last_fullsized":"2023-12-15T23:56:30.344181+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":3000,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:29.326245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341884+0000","last_change":"2023-12-15T22:53:26.163866+0000","last_active":"2023-12-15T23:56:25.341884+0000","last_peered":"2023-12-15T23:56:25.341884+0000","last_clean":"2023-12-15T23:56:25.341884+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-15T23:56:25.341884+0000","last_undegraded":"2023-12-15T23:56:25.341884+0000","last_fullsized":"2023-12-15T23:56:25.341884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:27.317004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.356928+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-15T23:57:55.356928+0000","last_peered":"2023-12-15T23:57:55.356928+0000","last_clean":"2023-12-15T23:57:55.356928+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-15T23:57:55.356928+0000","last_undegraded":"2023-12-15T23:57:55.356928+0000","last_fullsized":"2023-12-15T23:57:55.356928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:18:45.223421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366687+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-15T23:57:55.366687+0000","last_peered":"2023-12-15T23:57:55.366687+0000","last_clean":"2023-12-15T23:57:55.366687+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-15T23:57:55.366687+0000","last_undegraded":"2023-12-15T23:57:55.366687+0000","last_fullsized":"2023-12-15T23:57:55.366687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":241,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.551384+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-15T23:55:35.551384+0000","last_peered":"2023-12-15T23:55:35.551384+0000","last_clean":"2023-12-15T23:55:35.551384+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-15T23:55:35.551384+0000","last_undegraded":"2023-12-15T23:55:35.551384+0000","last_fullsized":"2023-12-15T23:55:35.551384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:20.673127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:25.357853+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:57:25.357853+0000","last_peered":"2023-12-15T23:57:25.357853+0000","last_clean":"2023-12-15T23:57:25.357853+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:57:25.357853+0000","last_undegraded":"2023-12-15T23:57:25.357853+0000","last_fullsized":"2023-12-15T23:57:25.357853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:35.171333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363016+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:57:45.363016+0000","last_peered":"2023-12-15T23:57:45.363016+0000","last_clean":"2023-12-15T23:57:45.363016+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:57:45.363016+0000","last_undegraded":"2023-12-15T23:57:45.363016+0000","last_fullsized":"2023-12-15T23:57:45.363016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:28.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.337997+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-15T23:56:10.337997+0000","last_peered":"2023-12-15T23:56:10.337997+0000","last_clean":"2023-12-15T23:56:10.337997+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:56:10.337997+0000","last_undegraded":"2023-12-15T23:56:10.337997+0000","last_fullsized":"2023-12-15T23:56:10.337997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.062956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:41.352318+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-15T23:57:41.352318+0000","last_peered":"2023-12-15T23:57:41.352318+0000","last_clean":"2023-12-15T23:57:41.352318+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-15T23:57:41.352318+0000","last_undegraded":"2023-12-15T23:57:41.352318+0000","last_fullsized":"2023-12-15T23:57:41.352318+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5869,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:06.343539+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:57:06.343539+0000","last_peered":"2023-12-15T23:57:06.343539+0000","last_clean":"2023-12-15T23:57:06.343539+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:57:06.343539+0000","last_undegraded":"2023-12-15T23:57:06.343539+0000","last_fullsized":"2023-12-15T23:57:06.343539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:04:57.591782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351788+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:57:00.351788+0000","last_peered":"2023-12-15T23:57:00.351788+0000","last_clean":"2023-12-15T23:57:00.351788+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:57:00.351788+0000","last_undegraded":"2023-12-15T23:57:00.351788+0000","last_fullsized":"2023-12-15T23:57:00.351788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:21:42.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566684+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:56:35.566684+0000","last_peered":"2023-12-15T23:56:35.566684+0000","last_clean":"2023-12-15T23:56:35.566684+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:56:35.566684+0000","last_undegraded":"2023-12-15T23:56:35.566684+0000","last_fullsized":"2023-12-15T23:56:35.566684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:44:44.870107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1507,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:45.347321+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:56:45.347321+0000","last_peered":"2023-12-15T23:56:45.347321+0000","last_clean":"2023-12-15T23:56:45.347321+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:56:45.347321+0000","last_undegraded":"2023-12-15T23:56:45.347321+0000","last_fullsized":"2023-12-15T23:56:45.347321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:02.140170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'237","reported_seq":413,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342292+0000","last_change":"2023-12-15T22:53:28.168042+0000","last_active":"2023-12-15T23:56:20.342292+0000","last_peered":"2023-12-15T23:56:20.342292+0000","last_clean":"2023-12-15T23:56:20.342292+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-15T23:56:20.342292+0000","last_undegraded":"2023-12-15T23:56:20.342292+0000","last_fullsized":"2023-12-15T23:56:20.342292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'23","reported_seq":147,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.332061+0000","last_change":"2023-12-15T22:53:26.162529+0000","last_active":"2023-12-15T23:56:16.332061+0000","last_peered":"2023-12-15T23:56:16.332061+0000","last_clean":"2023-12-15T23:56:16.332061+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-15T23:56:16.332061+0000","last_undegraded":"2023-12-15T23:56:16.332061+0000","last_fullsized":"2023-12-15T23:56:16.332061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:05:07.818847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356423+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-15T23:57:56.356423+0000","last_peered":"2023-12-15T23:57:56.356423+0000","last_clean":"2023-12-15T23:57:56.356423+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-15T23:57:56.356423+0000","last_undegraded":"2023-12-15T23:57:56.356423+0000","last_fullsized":"2023-12-15T23:57:56.356423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365185+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-15T23:57:55.365185+0000","last_peered":"2023-12-15T23:57:55.365185+0000","last_clean":"2023-12-15T23:57:55.365185+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-15T23:57:55.365185+0000","last_undegraded":"2023-12-15T23:57:55.365185+0000","last_fullsized":"2023-12-15T23:57:55.365185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:25.929011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321560+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-15T23:55:36.321560+0000","last_peered":"2023-12-15T23:55:36.321560+0000","last_clean":"2023-12-15T23:55:36.321560+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-15T23:55:36.321560+0000","last_undegraded":"2023-12-15T23:55:36.321560+0000","last_fullsized":"2023-12-15T23:55:36.321560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:37:57.672852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340190+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-15T23:56:15.340190+0000","last_peered":"2023-12-15T23:56:15.340190+0000","last_clean":"2023-12-15T23:56:15.340190+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-15T23:56:15.340190+0000","last_undegraded":"2023-12-15T23:56:15.340190+0000","last_fullsized":"2023-12-15T23:56:15.340190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:45:59.585565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336942+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-15T23:56:00.336942+0000","last_peered":"2023-12-15T23:56:00.336942+0000","last_clean":"2023-12-15T23:56:00.336942+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-15T23:56:00.336942+0000","last_undegraded":"2023-12-15T23:56:00.336942+0000","last_fullsized":"2023-12-15T23:56:00.336942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336133+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-15T23:56:00.336133+0000","last_peered":"2023-12-15T23:56:00.336133+0000","last_clean":"2023-12-15T23:56:00.336133+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-15T23:56:00.336133+0000","last_undegraded":"2023-12-15T23:56:00.336133+0000","last_fullsized":"2023-12-15T23:56:00.336133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:24:54.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.353458+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-15T23:57:40.353458+0000","last_peered":"2023-12-15T23:57:40.353458+0000","last_clean":"2023-12-15T23:57:40.353458+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-15T23:57:40.353458+0000","last_undegraded":"2023-12-15T23:57:40.353458+0000","last_fullsized":"2023-12-15T23:57:40.353458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:28:25.919204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4018,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.574414+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:57:05.574414+0000","last_peered":"2023-12-15T23:57:05.574414+0000","last_clean":"2023-12-15T23:57:05.574414+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:57:05.574414+0000","last_undegraded":"2023-12-15T23:57:05.574414+0000","last_fullsized":"2023-12-15T23:57:05.574414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:19.550874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.351766+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:57:00.351766+0000","last_peered":"2023-12-15T23:57:00.351766+0000","last_clean":"2023-12-15T23:57:00.351766+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:57:00.351766+0000","last_undegraded":"2023-12-15T23:57:00.351766+0000","last_fullsized":"2023-12-15T23:57:00.351766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:24.931139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345572+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:56:35.345572+0000","last_peered":"2023-12-15T23:56:35.345572+0000","last_clean":"2023-12-15T23:56:35.345572+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:56:35.345572+0000","last_undegraded":"2023-12-15T23:56:35.345572+0000","last_fullsized":"2023-12-15T23:56:35.345572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:57:39.825347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1435,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.335080+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:56:20.335080+0000","last_peered":"2023-12-15T23:56:20.335080+0000","last_clean":"2023-12-15T23:56:20.335080+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:56:20.335080+0000","last_undegraded":"2023-12-15T23:56:20.335080+0000","last_fullsized":"2023-12-15T23:56:20.335080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:02.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":340,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.568173+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:56:40.568173+0000","last_peered":"2023-12-15T23:56:40.568173+0000","last_clean":"2023-12-15T23:56:40.568173+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:56:40.568173+0000","last_undegraded":"2023-12-15T23:56:40.568173+0000","last_fullsized":"2023-12-15T23:56:40.568173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:54:04.096568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356849+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-15T23:57:56.356849+0000","last_peered":"2023-12-15T23:57:56.356849+0000","last_clean":"2023-12-15T23:57:56.356849+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-15T23:57:56.356849+0000","last_undegraded":"2023-12-15T23:57:56.356849+0000","last_fullsized":"2023-12-15T23:57:56.356849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:50.188900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:56.356337+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-15T23:57:56.356337+0000","last_peered":"2023-12-15T23:57:56.356337+0000","last_clean":"2023-12-15T23:57:56.356337+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-15T23:57:56.356337+0000","last_undegraded":"2023-12-15T23:57:56.356337+0000","last_fullsized":"2023-12-15T23:57:56.356337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:32.193702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365352+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-15T23:57:55.365352+0000","last_peered":"2023-12-15T23:57:55.365352+0000","last_clean":"2023-12-15T23:57:55.365352+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-15T23:57:55.365352+0000","last_undegraded":"2023-12-15T23:57:55.365352+0000","last_fullsized":"2023-12-15T23:57:55.365352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:25.439900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:35.330732+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-15T23:55:35.330732+0000","last_peered":"2023-12-15T23:55:35.330732+0000","last_clean":"2023-12-15T23:55:35.330732+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-15T23:55:35.330732+0000","last_undegraded":"2023-12-15T23:55:35.330732+0000","last_fullsized":"2023-12-15T23:55:35.330732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:31.616855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":139,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.336859+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-15T23:56:00.336859+0000","last_peered":"2023-12-15T23:56:00.336859+0000","last_clean":"2023-12-15T23:56:00.336859+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-15T23:56:00.336859+0000","last_undegraded":"2023-12-15T23:56:00.336859+0000","last_fullsized":"2023-12-15T23:56:00.336859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:58.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.339319+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-15T23:56:15.339319+0000","last_peered":"2023-12-15T23:56:15.339319+0000","last_clean":"2023-12-15T23:56:15.339319+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-15T23:56:15.339319+0000","last_undegraded":"2023-12-15T23:56:15.339319+0000","last_fullsized":"2023-12-15T23:56:15.339319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:17.906221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.558216+0000","last_change":"2023-12-15T22:53:11.079680+0000","last_active":"2023-12-15T23:56:00.558216+0000","last_peered":"2023-12-15T23:56:00.558216+0000","last_clean":"2023-12-15T23:56:00.558216+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-15T23:56:00.558216+0000","last_undegraded":"2023-12-15T23:56:00.558216+0000","last_fullsized":"2023-12-15T23:56:00.558216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:04:52.000725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.362232+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-15T23:57:40.362232+0000","last_peered":"2023-12-15T23:57:40.362232+0000","last_clean":"2023-12-15T23:57:40.362232+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-15T23:57:40.362232+0000","last_undegraded":"2023-12-15T23:57:40.362232+0000","last_fullsized":"2023-12-15T23:57:40.362232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:41:26.264663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3628,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345681+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:57:05.345681+0000","last_peered":"2023-12-15T23:57:05.345681+0000","last_clean":"2023-12-15T23:57:05.345681+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:57:05.345681+0000","last_undegraded":"2023-12-15T23:57:05.345681+0000","last_fullsized":"2023-12-15T23:57:05.345681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:01:11.119015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573007+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:57:00.573007+0000","last_peered":"2023-12-15T23:57:00.573007+0000","last_clean":"2023-12-15T23:57:00.573007+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:57:00.573007+0000","last_undegraded":"2023-12-15T23:57:00.573007+0000","last_fullsized":"2023-12-15T23:57:00.573007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:02:12.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345307+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:56:35.345307+0000","last_peered":"2023-12-15T23:56:35.345307+0000","last_clean":"2023-12-15T23:56:35.345307+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:56:35.345307+0000","last_undegraded":"2023-12-15T23:56:35.345307+0000","last_fullsized":"2023-12-15T23:56:35.345307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:39:05.380779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342047+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:56:20.342047+0000","last_peered":"2023-12-15T23:56:20.342047+0000","last_clean":"2023-12-15T23:56:20.342047+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:56:20.342047+0000","last_undegraded":"2023-12-15T23:56:20.342047+0000","last_fullsized":"2023-12-15T23:56:20.342047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:22.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.341102+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:56:20.341102+0000","last_peered":"2023-12-15T23:56:20.341102+0000","last_clean":"2023-12-15T23:56:20.341102+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:56:20.341102+0000","last_undegraded":"2023-12-15T23:56:20.341102+0000","last_fullsized":"2023-12-15T23:56:20.341102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:39.229263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'15","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.566777+0000","last_change":"2023-12-15T22:53:26.157853+0000","last_active":"2023-12-15T23:56:35.566777+0000","last_peered":"2023-12-15T23:56:35.566777+0000","last_clean":"2023-12-15T23:56:35.566777+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-15T23:56:35.566777+0000","last_undegraded":"2023-12-15T23:56:35.566777+0000","last_fullsized":"2023-12-15T23:56:35.566777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:00.196715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337000+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-15T23:56:00.337000+0000","last_peered":"2023-12-15T23:56:00.337000+0000","last_clean":"2023-12-15T23:56:00.337000+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-15T23:56:00.337000+0000","last_undegraded":"2023-12-15T23:56:00.337000+0000","last_fullsized":"2023-12-15T23:56:00.337000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:21.495029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:10.347051+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:57:10.347051+0000","last_peered":"2023-12-15T23:57:10.347051+0000","last_clean":"2023-12-15T23:57:10.347051+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:57:10.347051+0000","last_undegraded":"2023-12-15T23:57:10.347051+0000","last_fullsized":"2023-12-15T23:57:10.347051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:56:29.147167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326284+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-15T23:55:56.326284+0000","last_peered":"2023-12-15T23:55:56.326284+0000","last_clean":"2023-12-15T23:55:56.326284+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-15T23:55:56.326284+0000","last_undegraded":"2023-12-15T23:55:56.326284+0000","last_fullsized":"2023-12-15T23:55:56.326284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:33.642166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332245+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-15T23:55:40.332245+0000","last_peered":"2023-12-15T23:55:40.332245+0000","last_clean":"2023-12-15T23:55:40.332245+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-15T23:55:40.332245+0000","last_undegraded":"2023-12-15T23:55:40.332245+0000","last_fullsized":"2023-12-15T23:55:40.332245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:17:20.806970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.329802+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-15T23:55:40.329802+0000","last_peered":"2023-12-15T23:55:40.329802+0000","last_clean":"2023-12-15T23:55:40.329802+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-15T23:55:40.329802+0000","last_undegraded":"2023-12-15T23:55:40.329802+0000","last_fullsized":"2023-12-15T23:55:40.329802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:45.992206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.335944+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-15T23:56:00.335944+0000","last_peered":"2023-12-15T23:56:00.335944+0000","last_clean":"2023-12-15T23:56:00.335944+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-15T23:56:00.335944+0000","last_undegraded":"2023-12-15T23:56:00.335944+0000","last_fullsized":"2023-12-15T23:56:00.335944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:57.230909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583230+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-15T23:57:40.583230+0000","last_peered":"2023-12-15T23:57:40.583230+0000","last_clean":"2023-12-15T23:57:40.583230+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-15T23:57:40.583230+0000","last_undegraded":"2023-12-15T23:57:40.583230+0000","last_fullsized":"2023-12-15T23:57:40.583230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:44:10.101705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1274,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:05.345598+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:57:05.345598+0000","last_peered":"2023-12-15T23:57:05.345598+0000","last_clean":"2023-12-15T23:57:05.345598+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:57:05.345598+0000","last_undegraded":"2023-12-15T23:57:05.345598+0000","last_fullsized":"2023-12-15T23:57:05.345598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:21.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:00.573186+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:57:00.573186+0000","last_peered":"2023-12-15T23:57:00.573186+0000","last_clean":"2023-12-15T23:57:00.573186+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:57:00.573186+0000","last_undegraded":"2023-12-15T23:57:00.573186+0000","last_fullsized":"2023-12-15T23:57:00.573186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:26:30.130575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:35.345396+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:56:35.345396+0000","last_peered":"2023-12-15T23:56:35.345396+0000","last_clean":"2023-12-15T23:56:35.345396+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:56:35.345396+0000","last_undegraded":"2023-12-15T23:56:35.345396+0000","last_fullsized":"2023-12-15T23:56:35.345396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:55.248074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.342154+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:56:20.342154+0000","last_peered":"2023-12-15T23:56:20.342154+0000","last_clean":"2023-12-15T23:56:20.342154+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:56:20.342154+0000","last_undegraded":"2023-12-15T23:56:20.342154+0000","last_fullsized":"2023-12-15T23:56:20.342154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:22:41.240268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'185","reported_seq":372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:20.340965+0000","last_change":"2023-12-15T22:53:28.164042+0000","last_active":"2023-12-15T23:56:20.340965+0000","last_peered":"2023-12-15T23:56:20.340965+0000","last_clean":"2023-12-15T23:56:20.340965+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-15T23:56:20.340965+0000","last_undegraded":"2023-12-15T23:56:20.340965+0000","last_fullsized":"2023-12-15T23:56:20.340965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:00:35.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:16.331931+0000","last_change":"2023-12-15T22:53:26.160787+0000","last_active":"2023-12-15T23:56:16.331931+0000","last_peered":"2023-12-15T23:56:16.331931+0000","last_clean":"2023-12-15T23:56:16.331931+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-15T23:56:16.331931+0000","last_undegraded":"2023-12-15T23:56:16.331931+0000","last_fullsized":"2023-12-15T23:56:16.331931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:40:55.771958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.331088+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:55:45.331088+0000","last_peered":"2023-12-15T23:55:45.331088+0000","last_clean":"2023-12-15T23:55:45.331088+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-15T23:55:45.331088+0000","last_undegraded":"2023-12-15T23:55:45.331088+0000","last_fullsized":"2023-12-15T23:55:45.331088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:46.521209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.360294+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:57:30.360294+0000","last_peered":"2023-12-15T23:57:30.360294+0000","last_clean":"2023-12-15T23:57:30.360294+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:57:30.360294+0000","last_undegraded":"2023-12-15T23:57:30.360294+0000","last_fullsized":"2023-12-15T23:57:30.360294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:05.558888+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-15T23:56:05.558888+0000","last_peered":"2023-12-15T23:56:05.558888+0000","last_clean":"2023-12-15T23:56:05.558888+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-15T23:56:05.558888+0000","last_undegraded":"2023-12-15T23:56:05.558888+0000","last_fullsized":"2023-12-15T23:56:05.558888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:31.646743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:36.321587+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-15T23:55:36.321587+0000","last_peered":"2023-12-15T23:55:36.321587+0000","last_clean":"2023-12-15T23:55:36.321587+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-15T23:55:36.321587+0000","last_undegraded":"2023-12-15T23:55:36.321587+0000","last_fullsized":"2023-12-15T23:55:36.321587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:22.684030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:40.332350+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-15T23:55:40.332350+0000","last_peered":"2023-12-15T23:55:40.332350+0000","last_clean":"2023-12-15T23:55:40.332350+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-15T23:55:40.332350+0000","last_undegraded":"2023-12-15T23:55:40.332350+0000","last_fullsized":"2023-12-15T23:55:40.332350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:12:14.316422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:26.334267+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-15T23:56:26.334267+0000","last_peered":"2023-12-15T23:56:26.334267+0000","last_clean":"2023-12-15T23:56:26.334267+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-15T23:56:26.334267+0000","last_undegraded":"2023-12-15T23:56:26.334267+0000","last_fullsized":"2023-12-15T23:56:26.334267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:10:17.634267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.336045+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-15T23:56:25.336045+0000","last_peered":"2023-12-15T23:56:25.336045+0000","last_clean":"2023-12-15T23:56:25.336045+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-15T23:56:25.336045+0000","last_undegraded":"2023-12-15T23:56:25.336045+0000","last_fullsized":"2023-12-15T23:56:25.336045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:42.698596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587718+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-15T23:57:55.587718+0000","last_peered":"2023-12-15T23:57:55.587718+0000","last_clean":"2023-12-15T23:57:55.587718+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-15T23:57:55.587718+0000","last_undegraded":"2023-12-15T23:57:55.587718+0000","last_fullsized":"2023-12-15T23:57:55.587718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:27.446502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349717+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:57:31.349717+0000","last_peered":"2023-12-15T23:57:31.349717+0000","last_clean":"2023-12-15T23:57:31.349717+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:57:31.349717+0000","last_undegraded":"2023-12-15T23:57:31.349717+0000","last_fullsized":"2023-12-15T23:57:31.349717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:58:10.879214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343114+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-15T23:56:25.343114+0000","last_peered":"2023-12-15T23:56:25.343114+0000","last_clean":"2023-12-15T23:56:25.343114+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-15T23:56:25.343114+0000","last_undegraded":"2023-12-15T23:56:25.343114+0000","last_fullsized":"2023-12-15T23:56:25.343114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:07.455612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587659+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-15T23:57:55.587659+0000","last_peered":"2023-12-15T23:57:55.587659+0000","last_clean":"2023-12-15T23:57:55.587659+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-15T23:57:55.587659+0000","last_undegraded":"2023-12-15T23:57:55.587659+0000","last_fullsized":"2023-12-15T23:57:55.587659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:56:27.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.351196+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:57:30.351196+0000","last_peered":"2023-12-15T23:57:30.351196+0000","last_clean":"2023-12-15T23:57:30.351196+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:57:30.351196+0000","last_undegraded":"2023-12-15T23:57:30.351196+0000","last_fullsized":"2023-12-15T23:57:30.351196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:08.012235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:30.344047+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-15T23:56:30.344047+0000","last_peered":"2023-12-15T23:56:30.344047+0000","last_clean":"2023-12-15T23:56:30.344047+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-15T23:56:30.344047+0000","last_undegraded":"2023-12-15T23:56:30.344047+0000","last_fullsized":"2023-12-15T23:56:30.344047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T22:57:18.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365333+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-15T23:57:55.365333+0000","last_peered":"2023-12-15T23:57:55.365333+0000","last_clean":"2023-12-15T23:57:55.365333+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-15T23:57:55.365333+0000","last_undegraded":"2023-12-15T23:57:55.365333+0000","last_fullsized":"2023-12-15T23:57:55.365333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:47:39.305978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:40.583197+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:57:40.583197+0000","last_peered":"2023-12-15T23:57:40.583197+0000","last_clean":"2023-12-15T23:57:40.583197+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:57:40.583197+0000","last_undegraded":"2023-12-15T23:57:40.583197+0000","last_fullsized":"2023-12-15T23:57:40.583197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:18:50.974386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.341827+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-15T23:56:25.341827+0000","last_peered":"2023-12-15T23:56:25.341827+0000","last_clean":"2023-12-15T23:56:25.341827+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-15T23:56:25.341827+0000","last_undegraded":"2023-12-15T23:56:25.341827+0000","last_fullsized":"2023-12-15T23:56:25.341827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:12:34.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587497+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-15T23:57:55.587497+0000","last_peered":"2023-12-15T23:57:55.587497+0000","last_clean":"2023-12-15T23:57:55.587497+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-15T23:57:55.587497+0000","last_undegraded":"2023-12-15T23:57:55.587497+0000","last_fullsized":"2023-12-15T23:57:55.587497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.363670+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:57:45.363670+0000","last_peered":"2023-12-15T23:57:45.363670+0000","last_clean":"2023-12-15T23:57:45.363670+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:57:45.363670+0000","last_undegraded":"2023-12-15T23:57:45.363670+0000","last_fullsized":"2023-12-15T23:57:45.363670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'5","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.343413+0000","last_change":"2023-12-15T22:53:26.165809+0000","last_active":"2023-12-15T23:56:25.343413+0000","last_peered":"2023-12-15T23:56:25.343413+0000","last_clean":"2023-12-15T23:56:25.343413+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-15T23:56:25.343413+0000","last_undegraded":"2023-12-15T23:56:25.343413+0000","last_fullsized":"2023-12-15T23:56:25.343413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:11:30.297246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:45.354702+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:57:45.354702+0000","last_peered":"2023-12-15T23:57:45.354702+0000","last_clean":"2023-12-15T23:57:45.354702+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:57:45.354702+0000","last_undegraded":"2023-12-15T23:57:45.354702+0000","last_fullsized":"2023-12-15T23:57:45.354702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:19.635825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.366764+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-15T23:57:55.366764+0000","last_peered":"2023-12-15T23:57:55.366764+0000","last_clean":"2023-12-15T23:57:55.366764+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-15T23:57:55.366764+0000","last_undegraded":"2023-12-15T23:57:55.366764+0000","last_fullsized":"2023-12-15T23:57:55.366764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:05.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:06.359153+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-15T23:58:06.359153+0000","last_peered":"2023-12-15T23:58:06.359153+0000","last_clean":"2023-12-15T23:58:06.359153+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-15T23:58:06.359153+0000","last_undegraded":"2023-12-15T23:58:06.359153+0000","last_fullsized":"2023-12-15T23:58:06.359153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.635572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:31.349969+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:57:31.349969+0000","last_peered":"2023-12-15T23:57:31.349969+0000","last_clean":"2023-12-15T23:57:31.349969+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:57:31.349969+0000","last_undegraded":"2023-12-15T23:57:31.349969+0000","last_fullsized":"2023-12-15T23:57:31.349969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.587564+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-15T23:57:55.587564+0000","last_peered":"2023-12-15T23:57:55.587564+0000","last_clean":"2023-12-15T23:57:55.587564+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-15T23:57:55.587564+0000","last_undegraded":"2023-12-15T23:57:55.587564+0000","last_fullsized":"2023-12-15T23:57:55.587564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'41","reported_seq":204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:25.564172+0000","last_change":"2023-12-15T22:53:26.155725+0000","last_active":"2023-12-15T23:56:25.564172+0000","last_peered":"2023-12-15T23:56:25.564172+0000","last_clean":"2023-12-15T23:56:25.564172+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-15T23:56:25.564172+0000","last_undegraded":"2023-12-15T23:56:25.564172+0000","last_fullsized":"2023-12-15T23:56:25.564172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:49.314631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.580810+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:57:30.580810+0000","last_peered":"2023-12-15T23:57:30.580810+0000","last_clean":"2023-12-15T23:57:30.580810+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:57:30.580810+0000","last_undegraded":"2023-12-15T23:57:30.580810+0000","last_fullsized":"2023-12-15T23:57:30.580810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:49.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.365999+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-15T23:57:55.365999+0000","last_peered":"2023-12-15T23:57:55.365999+0000","last_clean":"2023-12-15T23:57:55.365999+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-15T23:57:55.365999+0000","last_undegraded":"2023-12-15T23:57:55.365999+0000","last_fullsized":"2023-12-15T23:57:55.365999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:56:39.512649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:40.339792+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:56:40.339792+0000","last_peered":"2023-12-15T23:56:40.339792+0000","last_clean":"2023-12-15T23:56:40.339792+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:56:40.339792+0000","last_undegraded":"2023-12-15T23:56:40.339792+0000","last_fullsized":"2023-12-15T23:56:40.339792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:46.435729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:30.358657+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:57:30.358657+0000","last_peered":"2023-12-15T23:57:30.358657+0000","last_clean":"2023-12-15T23:57:30.358657+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:57:30.358657+0000","last_undegraded":"2023-12-15T23:57:30.358657+0000","last_fullsized":"2023-12-15T23:57:30.358657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:57:55.357081+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-15T23:57:55.357081+0000","last_peered":"2023-12-15T23:57:55.357081+0000","last_clean":"2023-12-15T23:57:55.357081+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-15T23:57:55.357081+0000","last_undegraded":"2023-12-15T23:57:55.357081+0000","last_fullsized":"2023-12-15T23:57:55.357081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:13:32.248104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'3","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.366932+0000","last_change":"2023-12-15T22:53:26.155477+0000","last_active":"2023-12-15T23:58:00.366932+0000","last_peered":"2023-12-15T23:58:00.366932+0000","last_clean":"2023-12-15T23:58:00.366932+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-15T23:58:00.366932+0000","last_undegraded":"2023-12-15T23:58:00.366932+0000","last_fullsized":"2023-12-15T23:58:00.366932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:19.405614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336265+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-15T23:55:55.336265+0000","last_peered":"2023-12-15T23:55:55.336265+0000","last_clean":"2023-12-15T23:55:55.336265+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-15T23:55:55.336265+0000","last_undegraded":"2023-12-15T23:55:55.336265+0000","last_fullsized":"2023-12-15T23:55:55.336265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368735+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-15T23:58:10.368735+0000","last_peered":"2023-12-15T23:58:10.368735+0000","last_clean":"2023-12-15T23:58:10.368735+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-15T23:58:10.368735+0000","last_undegraded":"2023-12-15T23:58:10.368735+0000","last_fullsized":"2023-12-15T23:58:10.368735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:41.869462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:15.361584+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-15T23:58:15.361584+0000","last_peered":"2023-12-15T23:58:15.361584+0000","last_clean":"2023-12-15T23:58:15.361584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-15T23:58:15.361584+0000","last_undegraded":"2023-12-15T23:58:15.361584+0000","last_fullsized":"2023-12-15T23:58:15.361584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:45.682186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:56.326761+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-15T23:55:56.326761+0000","last_peered":"2023-12-15T23:55:56.326761+0000","last_clean":"2023-12-15T23:55:56.326761+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-15T23:55:56.326761+0000","last_undegraded":"2023-12-15T23:55:56.326761+0000","last_fullsized":"2023-12-15T23:55:56.326761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.402740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370350+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-15T23:58:10.370350+0000","last_peered":"2023-12-15T23:58:10.370350+0000","last_clean":"2023-12-15T23:58:10.370350+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-15T23:58:10.370350+0000","last_undegraded":"2023-12-15T23:58:10.370350+0000","last_fullsized":"2023-12-15T23:58:10.370350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:52:09.497036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'10","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.367621+0000","last_change":"2023-12-15T22:53:26.158639+0000","last_active":"2023-12-15T23:58:00.367621+0000","last_peered":"2023-12-15T23:58:00.367621+0000","last_clean":"2023-12-15T23:58:00.367621+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-15T23:58:00.367621+0000","last_undegraded":"2023-12-15T23:58:00.367621+0000","last_fullsized":"2023-12-15T23:58:00.367621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:32.844238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.332721+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-15T23:56:10.332721+0000","last_peered":"2023-12-15T23:56:10.332721+0000","last_clean":"2023-12-15T23:56:10.332721+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-15T23:56:10.332721+0000","last_undegraded":"2023-12-15T23:56:10.332721+0000","last_fullsized":"2023-12-15T23:56:10.332721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:43:03.393324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.368950+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-15T23:58:10.368950+0000","last_peered":"2023-12-15T23:58:10.368950+0000","last_clean":"2023-12-15T23:58:10.368950+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-15T23:58:10.368950+0000","last_undegraded":"2023-12-15T23:58:10.368950+0000","last_fullsized":"2023-12-15T23:58:10.368950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:13.846874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'19","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:00.357925+0000","last_change":"2023-12-15T22:53:26.165805+0000","last_active":"2023-12-15T23:58:00.357925+0000","last_peered":"2023-12-15T23:58:00.357925+0000","last_clean":"2023-12-15T23:58:00.357925+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-15T23:58:00.357925+0000","last_undegraded":"2023-12-15T23:58:00.357925+0000","last_fullsized":"2023-12-15T23:58:00.357925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:03.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369936+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-15T23:58:10.369936+0000","last_peered":"2023-12-15T23:58:10.369936+0000","last_clean":"2023-12-15T23:58:10.369936+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-15T23:58:10.369936+0000","last_undegraded":"2023-12-15T23:58:10.369936+0000","last_fullsized":"2023-12-15T23:58:10.369936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:57.896687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370535+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-15T23:58:10.370535+0000","last_peered":"2023-12-15T23:58:10.370535+0000","last_clean":"2023-12-15T23:58:10.370535+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-15T23:58:10.370535+0000","last_undegraded":"2023-12-15T23:58:10.370535+0000","last_fullsized":"2023-12-15T23:58:10.370535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:32.561764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'2","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340606+0000","last_change":"2023-12-15T22:53:26.165548+0000","last_active":"2023-12-15T23:56:15.340606+0000","last_peered":"2023-12-15T23:56:15.340606+0000","last_clean":"2023-12-15T23:56:15.340606+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-15T23:56:15.340606+0000","last_undegraded":"2023-12-15T23:56:15.340606+0000","last_fullsized":"2023-12-15T23:56:15.340606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:25:04.226639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:11.360251+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-15T23:58:11.360251+0000","last_peered":"2023-12-15T23:58:11.360251+0000","last_clean":"2023-12-15T23:58:11.360251+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-15T23:58:11.360251+0000","last_undegraded":"2023-12-15T23:58:11.360251+0000","last_fullsized":"2023-12-15T23:58:11.360251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:05.103262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369893+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-15T23:58:10.369893+0000","last_peered":"2023-12-15T23:58:10.369893+0000","last_clean":"2023-12-15T23:58:10.369893+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-15T23:58:10.369893+0000","last_undegraded":"2023-12-15T23:58:10.369893+0000","last_fullsized":"2023-12-15T23:58:10.369893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:47.460201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'4","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.334068+0000","last_change":"2023-12-15T22:53:26.162667+0000","last_active":"2023-12-15T23:56:15.334068+0000","last_peered":"2023-12-15T23:56:15.334068+0000","last_clean":"2023-12-15T23:56:15.334068+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-15T23:56:15.334068+0000","last_undegraded":"2023-12-15T23:56:15.334068+0000","last_fullsized":"2023-12-15T23:56:15.334068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:35.730252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.370437+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-15T23:58:10.370437+0000","last_peered":"2023-12-15T23:58:10.370437+0000","last_clean":"2023-12-15T23:58:10.370437+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-15T23:58:10.370437+0000","last_undegraded":"2023-12-15T23:58:10.370437+0000","last_fullsized":"2023-12-15T23:58:10.370437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:35:19.912191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:10.338439+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-15T23:56:10.338439+0000","last_peered":"2023-12-15T23:56:10.338439+0000","last_clean":"2023-12-15T23:56:10.338439+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-15T23:56:10.338439+0000","last_undegraded":"2023-12-15T23:56:10.338439+0000","last_fullsized":"2023-12-15T23:56:10.338439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:44:19.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.333909+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-15T23:56:15.333909+0000","last_peered":"2023-12-15T23:56:15.333909+0000","last_clean":"2023-12-15T23:56:15.333909+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-15T23:56:15.333909+0000","last_undegraded":"2023-12-15T23:56:15.333909+0000","last_fullsized":"2023-12-15T23:56:15.333909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:29:17.328062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.590748+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-15T23:58:10.590748+0000","last_peered":"2023-12-15T23:58:10.590748+0000","last_clean":"2023-12-15T23:58:10.590748+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-15T23:58:10.590748+0000","last_undegraded":"2023-12-15T23:58:10.590748+0000","last_fullsized":"2023-12-15T23:58:10.590748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:01:27.935613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328947+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-15T23:55:55.328947+0000","last_peered":"2023-12-15T23:55:55.328947+0000","last_clean":"2023-12-15T23:55:55.328947+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-15T23:55:55.328947+0000","last_undegraded":"2023-12-15T23:55:55.328947+0000","last_fullsized":"2023-12-15T23:55:55.328947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:44.726760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'22","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:15.340969+0000","last_change":"2023-12-15T22:53:26.161460+0000","last_active":"2023-12-15T23:56:15.340969+0000","last_peered":"2023-12-15T23:56:15.340969+0000","last_clean":"2023-12-15T23:56:15.340969+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-15T23:56:15.340969+0000","last_undegraded":"2023-12-15T23:56:15.340969+0000","last_fullsized":"2023-12-15T23:56:15.340969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:57.157307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:10.369558+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-15T23:58:10.369558+0000","last_peered":"2023-12-15T23:58:10.369558+0000","last_clean":"2023-12-15T23:58:10.369558+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-15T23:58:10.369558+0000","last_undegraded":"2023-12-15T23:58:10.369558+0000","last_fullsized":"2023-12-15T23:58:10.369558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:22.513658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.336071+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-15T23:55:55.336071+0000","last_peered":"2023-12-15T23:55:55.336071+0000","last_clean":"2023-12-15T23:55:55.336071+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-15T23:55:55.336071+0000","last_undegraded":"2023-12-15T23:55:55.336071+0000","last_fullsized":"2023-12-15T23:55:55.336071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T23:31:25.619524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.335777+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-15T23:55:55.335777+0000","last_peered":"2023-12-15T23:55:55.335777+0000","last_clean":"2023-12-15T23:55:55.335777+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-15T23:55:55.335777+0000","last_undegraded":"2023-12-15T23:55:55.335777+0000","last_fullsized":"2023-12-15T23:55:55.335777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:56:38.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.333892+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-15T23:55:55.333892+0000","last_peered":"2023-12-15T23:55:55.333892+0000","last_clean":"2023-12-15T23:55:55.333892+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-15T23:55:55.333892+0000","last_undegraded":"2023-12-15T23:55:55.333892+0000","last_fullsized":"2023-12-15T23:55:55.333892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:09.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:56:00.337514+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-15T23:56:00.337514+0000","last_peered":"2023-12-15T23:56:00.337514+0000","last_clean":"2023-12-15T23:56:00.337514+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-15T23:56:00.337514+0000","last_undegraded":"2023-12-15T23:56:00.337514+0000","last_fullsized":"2023-12-15T23:56:00.337514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:17:41.853165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.328806+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-15T23:55:55.328806+0000","last_peered":"2023-12-15T23:55:55.328806+0000","last_clean":"2023-12-15T23:55:55.328806+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-15T23:55:55.328806+0000","last_undegraded":"2023-12-15T23:55:55.328806+0000","last_fullsized":"2023-12-15T23:55:55.328806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:15:55.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:55.556597+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-15T23:55:55.556597+0000","last_peered":"2023-12-15T23:55:55.556597+0000","last_clean":"2023-12-15T23:55:55.556597+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-15T23:55:55.556597+0000","last_undegraded":"2023-12-15T23:55:55.556597+0000","last_fullsized":"2023-12-15T23:55:55.556597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:07.624386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:55:45.333280+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-15T23:55:45.333280+0000","last_peered":"2023-12-15T23:55:45.333280+0000","last_clean":"2023-12-15T23:55:45.333280+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-15T23:55:45.333280+0000","last_undegraded":"2023-12-15T23:55:45.333280+0000","last_fullsized":"2023-12-15T23:55:45.333280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:24.509081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":599,"ondisk_log_size":599,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22796,"ondisk_log_size":22796,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608377,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.44800000000000001,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.32500000000000001}]},{"osd":1,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":1.004},"last":0.311},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.439}]},{"osd":3,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.309,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.375,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":1.149},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.63},"last":0.41899999999999998}]}]},{"osd":5,"up_from":11,"seq":47244641079,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.30399999999999999},"max":{"1min":0.63500000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.495}]},{"osd":1,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71699999999999997,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.754,"15min":0.754},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.372,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":0.48399999999999999,"5min":0.56699999999999995,"15min":0.63},"last":0.374}]},{"osd":4,"last update":"Fri Dec 15 23:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.51200000000000001,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56399999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641081,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.73299999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Dec 15 23:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.27800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.502,"15min":0.80100000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45200000000000001,"5min":0.57399999999999995,"15min":0.78700000000000003},"last":0.39100000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.36199999999999999}]}]},{"osd":2,"up_from":11,"seq":47244641078,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32000000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.193},"max":{"1min":0.55500000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.48499999999999999,"5min":0.87,"15min":0.87},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.35799999999999998},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52400000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.29399999999999998},"max":{"1min":0.77200000000000002,"5min":1.169,"15min":1.169},"last":0.62}]},{"osd":5,"last update":"Fri Dec 15 23:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52900000000000003}]}]},{"osd":1,"up_from":11,"seq":47244641079,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47132,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810468,"statfs":{"total":107374182400,"available":107325919232,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.436,"5min":0.48699999999999999,"15min":0.53100000000000003},"last":0.308},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51700000000000002,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.72799999999999998,"15min":0.75700000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.86199999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":0.878},"last":0.625}]},{"osd":5,"last update":"Fri Dec 15 23:59:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60999999999999999}]}]},{"osd":0,"up_from":11,"seq":47244641079,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.315},"min":{"1min":0.224,"5min":0.21099999999999999,"15min":0.17299999999999999},"max":{"1min":0.44900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.20799999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.35499999999999998},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.22800000000000001},"max":{"1min":0.746,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.432},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.23999999999999999},"max":{"1min":0.73699999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.875,"15min":0.875},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Dec 15 23:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.78900000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:00:28.513 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.513 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.514 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.514 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.514 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.514 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.514 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.515 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.515 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.515 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.515 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.515 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.516 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.517 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.517 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.517 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.517 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.517 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.518 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.518 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.518 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.518 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.518 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.519 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.520 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.520 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.520 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.520 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.520 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.521 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.521 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.521 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.521 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.521 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 11.1b last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.522 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.523 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.523 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.523 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.523 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.523 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.524 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.525 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.525 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.525 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.525 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.525 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.526 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.526 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.526 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.526 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.526 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 10.18 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.527 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.528 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.528 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.528 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.528 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.528 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.529 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.529 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.529 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.529 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.529 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.530 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.531 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.531 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.531 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.531 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.531 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.532 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.532 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.532 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.532 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.532 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.533 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.534 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.534 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.534 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.534 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.534 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.535 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.535 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.535 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.535 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.535 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.536 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.537 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.537 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.537 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.537 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.537 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.538 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.539 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.540 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.541 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.541 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.541 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.541 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.541 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.542 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.543 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.543 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.543 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.543 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.543 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.544 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.545 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.545 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.545 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.545 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.545 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.546 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.547 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.547 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.547 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.547 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.547 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.548 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.548 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.548 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.548 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.548 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.549 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.550 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.551 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.551 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.551 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.551 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.551 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.552 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.552 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.552 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.552 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.552 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.553 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.553 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.553 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.553 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.553 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.554 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.555 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.555 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.555 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.555 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.555 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.556 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.556 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.556 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.556 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.556 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.557 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.557 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.557 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.557 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.557 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.558 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.559 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.559 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.559 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.559 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.559 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.560 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.561 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.561 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.561 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.561 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.561 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.562 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.563 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.563 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.563 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.563 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.563 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.564 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.565 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.565 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.565 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.565 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.565 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.566 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.567 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.567 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.567 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.567 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.567 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.568 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.569 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.569 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.569 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.569 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.569 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.570 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.570 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.570 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.570 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.570 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.571 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.572 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.572 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.572 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.572 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.572 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.573 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.573 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.573 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.573 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.573 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.574 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.575 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.576 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.577 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.577 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.577 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.577 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.577 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.578 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.578 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.578 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.578 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.578 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.579 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.580 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.581 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.581 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.581 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.581 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.581 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.582 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.583 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.583 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.583 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.583 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.583 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.584 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.585 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.585 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.585 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.585 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.585 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.586 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.587 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.587 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.587 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.587 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.587 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.588 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.588 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.588 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.588 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.588 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.589 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.590 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.591 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.591 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.591 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.591 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.591 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.592 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.592 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.592 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.592 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.592 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.593 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.593 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.593 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.593 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.593 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.594 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.595 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.595 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.595 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.595 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.595 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.596 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.597 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.597 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.597 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.597 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.597 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.598 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.599 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.599 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.599 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.599 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.599 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.600 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.601 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.601 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.601 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.601 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.601 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.602 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.603 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.603 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.603 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.603 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.603 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.604 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.604 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.604 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.604 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.604 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 9.20 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.605 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.606 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.607 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.608 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.608 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.608 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.608 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.608 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.609 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.609 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:28.609 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:00:48.611 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:00:48.947 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:00:48.969 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:00:48.972 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2110,"stamp":"2023-12-16T00:00:48.183318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":380209,"num_omap_keys":1665,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34693,"ondisk_log_size":34693,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":273240,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":263350,"kb_avail":628872360,"statfs":{"total":644245094400,"available":643965296640,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":269671073},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":204920,"num_omap_keys":889,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006429"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.598552+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-15T23:58:40.598552+0000","last_peered":"2023-12-15T23:58:40.598552+0000","last_clean":"2023-12-15T23:58:40.598552+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-15T23:58:40.598552+0000","last_undegraded":"2023-12-15T23:58:40.598552+0000","last_fullsized":"2023-12-15T23:58:40.598552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393475+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:59:35.393475+0000","last_peered":"2023-12-15T23:59:35.393475+0000","last_clean":"2023-12-15T23:59:35.393475+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:59:35.393475+0000","last_undegraded":"2023-12-15T23:59:35.393475+0000","last_fullsized":"2023-12-15T23:59:35.393475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'4","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378161+0000","last_change":"2023-12-15T22:53:26.165400+0000","last_active":"2023-12-15T23:58:40.378161+0000","last_peered":"2023-12-15T23:58:40.378161+0000","last_clean":"2023-12-15T23:58:40.378161+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-15T23:58:40.378161+0000","last_undegraded":"2023-12-15T23:58:40.378161+0000","last_fullsized":"2023-12-15T23:58:40.378161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612905+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:59:35.612905+0000","last_peered":"2023-12-15T23:59:35.612905+0000","last_clean":"2023-12-15T23:59:35.612905+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:59:35.612905+0000","last_undegraded":"2023-12-15T23:59:35.612905+0000","last_fullsized":"2023-12-15T23:59:35.612905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:56.372169+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:58:56.372169+0000","last_peered":"2023-12-15T23:58:56.372169+0000","last_clean":"2023-12-15T23:58:56.372169+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:58:56.372169+0000","last_undegraded":"2023-12-15T23:58:56.372169+0000","last_fullsized":"2023-12-15T23:58:56.372169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615260+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:59:45.615260+0000","last_peered":"2023-12-15T23:59:45.615260+0000","last_clean":"2023-12-15T23:59:45.615260+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:59:45.615260+0000","last_undegraded":"2023-12-15T23:59:45.615260+0000","last_fullsized":"2023-12-15T23:59:45.615260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953869+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953869+0000","last_peered":"2023-12-16T00:00:26.953869+0000","last_clean":"2023-12-16T00:00:26.953869+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953869+0000","last_undegraded":"2023-12-16T00:00:26.953869+0000","last_fullsized":"2023-12-16T00:00:26.953869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386973+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:59:10.386973+0000","last_peered":"2023-12-15T23:59:10.386973+0000","last_clean":"2023-12-15T23:59:10.386973+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:59:10.386973+0000","last_undegraded":"2023-12-15T23:59:10.386973+0000","last_fullsized":"2023-12-15T23:59:10.386973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369003+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-15T23:58:46.369003+0000","last_peered":"2023-12-15T23:58:46.369003+0000","last_clean":"2023-12-15T23:58:46.369003+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-15T23:58:46.369003+0000","last_undegraded":"2023-12-15T23:58:46.369003+0000","last_fullsized":"2023-12-15T23:58:46.369003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386984+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:59:10.386984+0000","last_peered":"2023-12-15T23:59:10.386984+0000","last_clean":"2023-12-15T23:59:10.386984+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:59:10.386984+0000","last_undegraded":"2023-12-15T23:59:10.386984+0000","last_fullsized":"2023-12-15T23:59:10.386984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205134+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205134+0000","last_peered":"2023-12-16T00:00:31.205134+0000","last_clean":"2023-12-16T00:00:31.205134+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205134+0000","last_undegraded":"2023-12-16T00:00:31.205134+0000","last_fullsized":"2023-12-16T00:00:31.205134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382500+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:59:36.382500+0000","last_peered":"2023-12-15T23:59:36.382500+0000","last_clean":"2023-12-15T23:59:36.382500+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:59:36.382500+0000","last_undegraded":"2023-12-15T23:59:36.382500+0000","last_fullsized":"2023-12-15T23:59:36.382500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'8","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378322+0000","last_change":"2023-12-15T22:53:26.156995+0000","last_active":"2023-12-15T23:58:40.378322+0000","last_peered":"2023-12-15T23:58:40.378322+0000","last_clean":"2023-12-15T23:58:40.378322+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-15T23:58:40.378322+0000","last_undegraded":"2023-12-15T23:58:40.378322+0000","last_fullsized":"2023-12-15T23:58:40.378322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.394007+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:59:35.394007+0000","last_peered":"2023-12-15T23:59:35.394007+0000","last_clean":"2023-12-15T23:59:35.394007+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:59:35.394007+0000","last_undegraded":"2023-12-15T23:59:35.394007+0000","last_fullsized":"2023-12-15T23:59:35.394007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:01.373078+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:59:01.373078+0000","last_peered":"2023-12-15T23:59:01.373078+0000","last_clean":"2023-12-15T23:59:01.373078+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:59:01.373078+0000","last_undegraded":"2023-12-15T23:59:01.373078+0000","last_fullsized":"2023-12-15T23:59:01.373078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380896+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:59:35.380896+0000","last_peered":"2023-12-15T23:59:35.380896+0000","last_clean":"2023-12-15T23:59:35.380896+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:59:35.380896+0000","last_undegraded":"2023-12-15T23:59:35.380896+0000","last_fullsized":"2023-12-15T23:59:35.380896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712145+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712145+0000","last_peered":"2023-12-16T00:00:37.712145+0000","last_clean":"2023-12-16T00:00:37.712145+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712145+0000","last_undegraded":"2023-12-16T00:00:37.712145+0000","last_fullsized":"2023-12-16T00:00:37.712145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.596338+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-15T23:58:30.596338+0000","last_peered":"2023-12-15T23:58:30.596338+0000","last_clean":"2023-12-15T23:58:30.596338+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-15T23:58:30.596338+0000","last_undegraded":"2023-12-15T23:58:30.596338+0000","last_fullsized":"2023-12-15T23:58:30.596338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129461+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129461+0000","last_peered":"2023-12-16T00:00:29.129461+0000","last_clean":"2023-12-16T00:00:29.129461+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129461+0000","last_undegraded":"2023-12-16T00:00:29.129461+0000","last_fullsized":"2023-12-16T00:00:29.129461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'28","reported_seq":183,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387993+0000","last_change":"2023-12-15T22:53:26.162543+0000","last_active":"2023-12-16T00:00:05.387993+0000","last_peered":"2023-12-16T00:00:05.387993+0000","last_clean":"2023-12-16T00:00:05.387993+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:00:05.387993+0000","last_undegraded":"2023-12-16T00:00:05.387993+0000","last_fullsized":"2023-12-16T00:00:05.387993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.374756+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-15T23:58:30.374756+0000","last_peered":"2023-12-15T23:58:30.374756+0000","last_clean":"2023-12-15T23:58:30.374756+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-15T23:58:30.374756+0000","last_undegraded":"2023-12-15T23:58:30.374756+0000","last_fullsized":"2023-12-15T23:58:30.374756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387875+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-16T00:00:05.387875+0000","last_peered":"2023-12-16T00:00:05.387875+0000","last_clean":"2023-12-16T00:00:05.387875+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:00:05.387875+0000","last_undegraded":"2023-12-16T00:00:05.387875+0000","last_fullsized":"2023-12-16T00:00:05.387875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373566+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-15T23:58:25.373566+0000","last_peered":"2023-12-15T23:58:25.373566+0000","last_clean":"2023-12-15T23:58:25.373566+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-15T23:58:25.373566+0000","last_undegraded":"2023-12-15T23:58:25.373566+0000","last_fullsized":"2023-12-15T23:58:25.373566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.363478+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-15T23:58:25.363478+0000","last_peered":"2023-12-15T23:58:25.363478+0000","last_clean":"2023-12-15T23:58:25.363478+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-15T23:58:25.363478+0000","last_undegraded":"2023-12-15T23:58:25.363478+0000","last_fullsized":"2023-12-15T23:58:25.363478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375299+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-15T23:58:30.375299+0000","last_peered":"2023-12-15T23:58:30.375299+0000","last_clean":"2023-12-15T23:58:30.375299+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-15T23:58:30.375299+0000","last_undegraded":"2023-12-15T23:58:30.375299+0000","last_fullsized":"2023-12-15T23:58:30.375299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1694,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404611+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:20.404611+0000","last_peered":"2023-12-16T00:00:20.404611+0000","last_clean":"2023-12-16T00:00:20.404611+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:20.404611+0000","last_undegraded":"2023-12-16T00:00:20.404611+0000","last_fullsized":"2023-12-16T00:00:20.404611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384079+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:59:00.384079+0000","last_peered":"2023-12-15T23:59:00.384079+0000","last_clean":"2023-12-15T23:59:00.384079+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:59:00.384079+0000","last_undegraded":"2023-12-15T23:59:00.384079+0000","last_fullsized":"2023-12-15T23:59:00.384079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365438+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365438+0000","last_peered":"2023-12-16T00:00:40.365438+0000","last_clean":"2023-12-16T00:00:40.365438+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365438+0000","last_undegraded":"2023-12-16T00:00:40.365438+0000","last_fullsized":"2023-12-16T00:00:40.365438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089678+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089678+0000","last_peered":"2023-12-16T00:00:38.089678+0000","last_clean":"2023-12-16T00:00:38.089678+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089678+0000","last_undegraded":"2023-12-16T00:00:38.089678+0000","last_fullsized":"2023-12-16T00:00:38.089678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.371389+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:58:55.371389+0000","last_peered":"2023-12-15T23:58:55.371389+0000","last_clean":"2023-12-15T23:58:55.371389+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:58:55.371389+0000","last_undegraded":"2023-12-15T23:58:55.371389+0000","last_fullsized":"2023-12-15T23:58:55.371389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:26.363866+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-15T23:58:26.363866+0000","last_peered":"2023-12-15T23:58:26.363866+0000","last_clean":"2023-12-15T23:58:26.363866+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-15T23:58:26.363866+0000","last_undegraded":"2023-12-15T23:58:26.363866+0000","last_fullsized":"2023-12-15T23:58:26.363866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374483+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-15T23:58:25.374483+0000","last_peered":"2023-12-15T23:58:25.374483+0000","last_clean":"2023-12-15T23:58:25.374483+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-15T23:58:25.374483+0000","last_undegraded":"2023-12-15T23:58:25.374483+0000","last_fullsized":"2023-12-15T23:58:25.374483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373764+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-15T23:58:25.373764+0000","last_peered":"2023-12-15T23:58:25.373764+0000","last_clean":"2023-12-15T23:58:25.373764+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-15T23:58:25.373764+0000","last_undegraded":"2023-12-15T23:58:25.373764+0000","last_fullsized":"2023-12-15T23:58:25.373764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.370400+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-15T23:58:50.370400+0000","last_peered":"2023-12-15T23:58:50.370400+0000","last_clean":"2023-12-15T23:58:50.370400+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-15T23:58:50.370400+0000","last_undegraded":"2023-12-15T23:58:50.370400+0000","last_fullsized":"2023-12-15T23:58:50.370400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.383995+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:59:00.383995+0000","last_peered":"2023-12-15T23:59:00.383995+0000","last_clean":"2023-12-15T23:59:00.383995+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:59:00.383995+0000","last_undegraded":"2023-12-15T23:59:00.383995+0000","last_fullsized":"2023-12-15T23:59:00.383995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:35.376674+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-15T23:58:35.376674+0000","last_peered":"2023-12-15T23:58:35.376674+0000","last_clean":"2023-12-15T23:58:35.376674+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-15T23:58:35.376674+0000","last_undegraded":"2023-12-15T23:58:35.376674+0000","last_fullsized":"2023-12-15T23:58:35.376674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":851,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.374714+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-15T23:58:30.374714+0000","last_peered":"2023-12-15T23:58:30.374714+0000","last_clean":"2023-12-15T23:58:30.374714+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-15T23:58:30.374714+0000","last_undegraded":"2023-12-15T23:58:30.374714+0000","last_fullsized":"2023-12-15T23:58:30.374714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3316,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871555+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871555+0000","last_peered":"2023-12-16T00:00:34.871555+0000","last_clean":"2023-12-16T00:00:34.871555+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871555+0000","last_undegraded":"2023-12-16T00:00:34.871555+0000","last_fullsized":"2023-12-16T00:00:34.871555+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377597+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-15T23:58:40.377597+0000","last_peered":"2023-12-15T23:58:40.377597+0000","last_clean":"2023-12-15T23:58:40.377597+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-15T23:58:40.377597+0000","last_undegraded":"2023-12-15T23:58:40.377597+0000","last_fullsized":"2023-12-15T23:58:40.377597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377786+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-15T23:58:40.377786+0000","last_peered":"2023-12-15T23:58:40.377786+0000","last_clean":"2023-12-15T23:58:40.377786+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-15T23:58:40.377786+0000","last_undegraded":"2023-12-15T23:58:40.377786+0000","last_fullsized":"2023-12-15T23:58:40.377786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377832+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-15T23:58:40.377832+0000","last_peered":"2023-12-15T23:58:40.377832+0000","last_clean":"2023-12-15T23:58:40.377832+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-15T23:58:40.377832+0000","last_undegraded":"2023-12-15T23:58:40.377832+0000","last_fullsized":"2023-12-15T23:58:40.377832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:26.364543+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-15T23:58:26.364543+0000","last_peered":"2023-12-15T23:58:26.364543+0000","last_clean":"2023-12-15T23:58:26.364543+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-15T23:58:26.364543+0000","last_undegraded":"2023-12-15T23:58:26.364543+0000","last_fullsized":"2023-12-15T23:58:26.364543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:41.367924+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:58:41.367924+0000","last_peered":"2023-12-15T23:58:41.367924+0000","last_clean":"2023-12-15T23:58:41.367924+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:58:41.367924+0000","last_undegraded":"2023-12-15T23:58:41.367924+0000","last_fullsized":"2023-12-15T23:58:41.367924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384625+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:59:05.384625+0000","last_peered":"2023-12-15T23:59:05.384625+0000","last_clean":"2023-12-15T23:59:05.384625+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:59:05.384625+0000","last_undegraded":"2023-12-15T23:59:05.384625+0000","last_fullsized":"2023-12-15T23:59:05.384625+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712427+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-16T00:00:27.712427+0000","last_peered":"2023-12-16T00:00:27.712427+0000","last_clean":"2023-12-16T00:00:27.712427+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:00:27.712427+0000","last_undegraded":"2023-12-16T00:00:27.712427+0000","last_fullsized":"2023-12-16T00:00:27.712427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384930+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:59:46.384930+0000","last_peered":"2023-12-15T23:59:46.384930+0000","last_clean":"2023-12-15T23:59:46.384930+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:59:46.384930+0000","last_undegraded":"2023-12-15T23:59:46.384930+0000","last_fullsized":"2023-12-15T23:59:46.384930+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.382976+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:59:00.382976+0000","last_peered":"2023-12-15T23:59:00.382976+0000","last_clean":"2023-12-15T23:59:00.382976+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:59:00.382976+0000","last_undegraded":"2023-12-15T23:59:00.382976+0000","last_fullsized":"2023-12-15T23:59:00.382976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":450,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887135+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887135+0000","last_peered":"2023-12-16T00:00:41.887135+0000","last_clean":"2023-12-16T00:00:41.887135+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887135+0000","last_undegraded":"2023-12-16T00:00:41.887135+0000","last_fullsized":"2023-12-16T00:00:41.887135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270401+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270401+0000","last_peered":"2023-12-16T00:00:39.270401+0000","last_clean":"2023-12-16T00:00:39.270401+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270401+0000","last_undegraded":"2023-12-16T00:00:39.270401+0000","last_fullsized":"2023-12-16T00:00:39.270401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016303+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-16T00:00:26.016303+0000","last_peered":"2023-12-16T00:00:26.016303+0000","last_clean":"2023-12-16T00:00:26.016303+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:00:26.016303+0000","last_undegraded":"2023-12-16T00:00:26.016303+0000","last_fullsized":"2023-12-16T00:00:26.016303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.369062+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-15T23:58:45.369062+0000","last_peered":"2023-12-15T23:58:45.369062+0000","last_clean":"2023-12-15T23:58:45.369062+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-15T23:58:45.369062+0000","last_undegraded":"2023-12-15T23:58:45.369062+0000","last_fullsized":"2023-12-15T23:58:45.369062+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":795,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374207+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-15T23:58:25.374207+0000","last_peered":"2023-12-15T23:58:25.374207+0000","last_clean":"2023-12-15T23:58:25.374207+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-15T23:58:25.374207+0000","last_undegraded":"2023-12-15T23:58:25.374207+0000","last_fullsized":"2023-12-15T23:58:25.374207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.598448+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:58:40.598448+0000","last_peered":"2023-12-15T23:58:40.598448+0000","last_clean":"2023-12-15T23:58:40.598448+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:58:40.598448+0000","last_undegraded":"2023-12-15T23:58:40.598448+0000","last_fullsized":"2023-12-15T23:58:40.598448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":984,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384699+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:59:05.384699+0000","last_peered":"2023-12-15T23:59:05.384699+0000","last_clean":"2023-12-15T23:59:05.384699+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:59:05.384699+0000","last_undegraded":"2023-12-15T23:59:05.384699+0000","last_fullsized":"2023-12-15T23:59:05.384699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:16.392432+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-16T00:00:16.392432+0000","last_peered":"2023-12-16T00:00:16.392432+0000","last_clean":"2023-12-16T00:00:16.392432+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:00:16.392432+0000","last_undegraded":"2023-12-16T00:00:16.392432+0000","last_fullsized":"2023-12-16T00:00:16.392432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403315+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-16T00:00:15.403315+0000","last_peered":"2023-12-16T00:00:15.403315+0000","last_clean":"2023-12-16T00:00:15.403315+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:00:15.403315+0000","last_undegraded":"2023-12-16T00:00:15.403315+0000","last_fullsized":"2023-12-16T00:00:15.403315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905676+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905676+0000","last_peered":"2023-12-16T00:00:44.905676+0000","last_clean":"2023-12-16T00:00:44.905676+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905676+0000","last_undegraded":"2023-12-16T00:00:44.905676+0000","last_fullsized":"2023-12-16T00:00:44.905676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3262,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.601821+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:58:55.601821+0000","last_peered":"2023-12-15T23:58:55.601821+0000","last_clean":"2023-12-15T23:58:55.601821+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:58:55.601821+0000","last_undegraded":"2023-12-15T23:58:55.601821+0000","last_fullsized":"2023-12-15T23:58:55.601821+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838095+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838095+0000","last_peered":"2023-12-16T00:00:38.838095+0000","last_clean":"2023-12-16T00:00:38.838095+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838095+0000","last_undegraded":"2023-12-16T00:00:38.838095+0000","last_fullsized":"2023-12-16T00:00:38.838095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711864+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-16T00:00:27.711864+0000","last_peered":"2023-12-16T00:00:27.711864+0000","last_clean":"2023-12-16T00:00:27.711864+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:00:27.711864+0000","last_undegraded":"2023-12-16T00:00:27.711864+0000","last_fullsized":"2023-12-16T00:00:27.711864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374185+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-15T23:58:25.374185+0000","last_peered":"2023-12-15T23:58:25.374185+0000","last_clean":"2023-12-15T23:58:25.374185+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-15T23:58:25.374185+0000","last_undegraded":"2023-12-15T23:58:25.374185+0000","last_fullsized":"2023-12-15T23:58:25.374185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.598462+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-15T23:58:40.598462+0000","last_peered":"2023-12-15T23:58:40.598462+0000","last_clean":"2023-12-15T23:58:40.598462+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-15T23:58:40.598462+0000","last_undegraded":"2023-12-15T23:58:40.598462+0000","last_fullsized":"2023-12-15T23:58:40.598462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289103+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-16T00:00:27.289103+0000","last_peered":"2023-12-16T00:00:27.289103+0000","last_clean":"2023-12-16T00:00:27.289103+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:00:27.289103+0000","last_undegraded":"2023-12-16T00:00:27.289103+0000","last_fullsized":"2023-12-16T00:00:27.289103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384367+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:59:46.384367+0000","last_peered":"2023-12-15T23:59:46.384367+0000","last_clean":"2023-12-15T23:59:46.384367+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:59:46.384367+0000","last_undegraded":"2023-12-15T23:59:46.384367+0000","last_fullsized":"2023-12-15T23:59:46.384367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137476+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-16T00:00:28.137476+0000","last_peered":"2023-12-16T00:00:28.137476+0000","last_clean":"2023-12-16T00:00:28.137476+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:00:28.137476+0000","last_undegraded":"2023-12-16T00:00:28.137476+0000","last_fullsized":"2023-12-16T00:00:28.137476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'342","reported_seq":510,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137384+0000","last_change":"2023-12-15T22:53:28.172209+0000","last_active":"2023-12-16T00:00:28.137384+0000","last_peered":"2023-12-16T00:00:28.137384+0000","last_clean":"2023-12-16T00:00:28.137384+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:28.137384+0000","last_undegraded":"2023-12-16T00:00:28.137384+0000","last_fullsized":"2023-12-16T00:00:28.137384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404716+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-16T00:00:20.404716+0000","last_peered":"2023-12-16T00:00:20.404716+0000","last_clean":"2023-12-16T00:00:20.404716+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:00:20.404716+0000","last_undegraded":"2023-12-16T00:00:20.404716+0000","last_fullsized":"2023-12-16T00:00:20.404716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400328+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:05.400328+0000","last_peered":"2023-12-16T00:00:05.400328+0000","last_clean":"2023-12-16T00:00:05.400328+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:05.400328+0000","last_undegraded":"2023-12-16T00:00:05.400328+0000","last_fullsized":"2023-12-16T00:00:05.400328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403768+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:15.403768+0000","last_peered":"2023-12-16T00:00:15.403768+0000","last_clean":"2023-12-16T00:00:15.403768+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:15.403768+0000","last_undegraded":"2023-12-16T00:00:15.403768+0000","last_fullsized":"2023-12-16T00:00:15.403768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440185+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-16T00:00:26.440185+0000","last_peered":"2023-12-16T00:00:26.440185+0000","last_clean":"2023-12-16T00:00:26.440185+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:00:26.440185+0000","last_undegraded":"2023-12-16T00:00:26.440185+0000","last_fullsized":"2023-12-16T00:00:26.440185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397530+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:59:50.397530+0000","last_peered":"2023-12-15T23:59:50.397530+0000","last_clean":"2023-12-15T23:59:50.397530+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:59:50.397530+0000","last_undegraded":"2023-12-15T23:59:50.397530+0000","last_fullsized":"2023-12-15T23:59:50.397530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402635+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-16T00:00:15.402635+0000","last_peered":"2023-12-16T00:00:15.402635+0000","last_clean":"2023-12-16T00:00:15.402635+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:00:15.402635+0000","last_undegraded":"2023-12-16T00:00:15.402635+0000","last_fullsized":"2023-12-16T00:00:15.402635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402738+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-16T00:00:15.402738+0000","last_peered":"2023-12-16T00:00:15.402738+0000","last_clean":"2023-12-16T00:00:15.402738+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:00:15.402738+0000","last_undegraded":"2023-12-16T00:00:15.402738+0000","last_fullsized":"2023-12-16T00:00:15.402738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016636+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-16T00:00:26.016636+0000","last_peered":"2023-12-16T00:00:26.016636+0000","last_clean":"2023-12-16T00:00:26.016636+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:00:26.016636+0000","last_undegraded":"2023-12-16T00:00:26.016636+0000","last_fullsized":"2023-12-16T00:00:26.016636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'777","reported_seq":2401,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288779+0000","last_change":"2023-12-15T22:53:28.168322+0000","last_active":"2023-12-16T00:00:27.288779+0000","last_peered":"2023-12-16T00:00:27.288779+0000","last_clean":"2023-12-16T00:00:27.288779+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:27.288779+0000","last_undegraded":"2023-12-16T00:00:27.288779+0000","last_fullsized":"2023-12-16T00:00:27.288779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867711+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867711+0000","last_peered":"2023-12-16T00:00:31.867711+0000","last_clean":"2023-12-16T00:00:31.867711+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867711+0000","last_undegraded":"2023-12-16T00:00:31.867711+0000","last_fullsized":"2023-12-16T00:00:31.867711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389472+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:06.389472+0000","last_peered":"2023-12-16T00:00:06.389472+0000","last_clean":"2023-12-16T00:00:06.389472+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:06.389472+0000","last_undegraded":"2023-12-16T00:00:06.389472+0000","last_fullsized":"2023-12-16T00:00:06.389472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.389884+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:15.389884+0000","last_peered":"2023-12-16T00:00:15.389884+0000","last_clean":"2023-12-16T00:00:15.389884+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:15.389884+0000","last_undegraded":"2023-12-16T00:00:15.389884+0000","last_fullsized":"2023-12-16T00:00:15.389884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440121+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-16T00:00:26.440121+0000","last_peered":"2023-12-16T00:00:26.440121+0000","last_clean":"2023-12-16T00:00:26.440121+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:00:26.440121+0000","last_undegraded":"2023-12-16T00:00:26.440121+0000","last_fullsized":"2023-12-16T00:00:26.440121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864668+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-16T00:00:26.864668+0000","last_peered":"2023-12-16T00:00:26.864668+0000","last_clean":"2023-12-16T00:00:26.864668+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:00:26.864668+0000","last_undegraded":"2023-12-16T00:00:26.864668+0000","last_fullsized":"2023-12-16T00:00:26.864668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389798+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-16T00:00:06.389798+0000","last_peered":"2023-12-16T00:00:06.389798+0000","last_clean":"2023-12-16T00:00:06.389798+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:00:06.389798+0000","last_undegraded":"2023-12-16T00:00:06.389798+0000","last_fullsized":"2023-12-16T00:00:06.389798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1651,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391131+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-16T00:00:20.391131+0000","last_peered":"2023-12-16T00:00:20.391131+0000","last_clean":"2023-12-16T00:00:20.391131+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:00:20.391131+0000","last_undegraded":"2023-12-16T00:00:20.391131+0000","last_fullsized":"2023-12-16T00:00:20.391131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016723+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-16T00:00:26.016723+0000","last_peered":"2023-12-16T00:00:26.016723+0000","last_clean":"2023-12-16T00:00:26.016723+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:00:26.016723+0000","last_undegraded":"2023-12-16T00:00:26.016723+0000","last_fullsized":"2023-12-16T00:00:26.016723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402873+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-16T00:00:15.402873+0000","last_peered":"2023-12-16T00:00:15.402873+0000","last_clean":"2023-12-16T00:00:15.402873+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:00:15.402873+0000","last_undegraded":"2023-12-16T00:00:15.402873+0000","last_fullsized":"2023-12-16T00:00:15.402873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394608+0000","last_change":"2023-12-15T22:53:30.176469+0000","last_active":"2023-12-16T00:00:26.394608+0000","last_peered":"2023-12-16T00:00:26.394608+0000","last_clean":"2023-12-16T00:00:26.394608+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:26.394608+0000","last_undegraded":"2023-12-16T00:00:26.394608+0000","last_fullsized":"2023-12-16T00:00:26.394608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2087,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402018+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-16T00:00:10.402018+0000","last_peered":"2023-12-16T00:00:10.402018+0000","last_clean":"2023-12-16T00:00:10.402018+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:00:10.402018+0000","last_undegraded":"2023-12-16T00:00:10.402018+0000","last_fullsized":"2023-12-16T00:00:10.402018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'5","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137187+0000","last_change":"2023-12-15T22:53:26.163456+0000","last_active":"2023-12-16T00:00:28.137187+0000","last_peered":"2023-12-16T00:00:28.137187+0000","last_clean":"2023-12-16T00:00:28.137187+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:28.137187+0000","last_undegraded":"2023-12-16T00:00:28.137187+0000","last_fullsized":"2023-12-16T00:00:28.137187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404800+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-16T00:00:20.404800+0000","last_peered":"2023-12-16T00:00:20.404800+0000","last_clean":"2023-12-16T00:00:20.404800+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:00:20.404800+0000","last_undegraded":"2023-12-16T00:00:20.404800+0000","last_fullsized":"2023-12-16T00:00:20.404800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.369903+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-15T23:58:50.369903+0000","last_peered":"2023-12-15T23:58:50.369903+0000","last_clean":"2023-12-15T23:58:50.369903+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-15T23:58:50.369903+0000","last_undegraded":"2023-12-15T23:58:50.369903+0000","last_fullsized":"2023-12-15T23:58:50.369903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137741+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-16T00:00:28.137741+0000","last_peered":"2023-12-16T00:00:28.137741+0000","last_clean":"2023-12-16T00:00:28.137741+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:00:28.137741+0000","last_undegraded":"2023-12-16T00:00:28.137741+0000","last_fullsized":"2023-12-16T00:00:28.137741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403136+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-16T00:00:15.403136+0000","last_peered":"2023-12-16T00:00:15.403136+0000","last_clean":"2023-12-16T00:00:15.403136+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:00:15.403136+0000","last_undegraded":"2023-12-16T00:00:15.403136+0000","last_fullsized":"2023-12-16T00:00:15.403136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402706+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-16T00:00:10.402706+0000","last_peered":"2023-12-16T00:00:10.402706+0000","last_clean":"2023-12-16T00:00:10.402706+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:00:10.402706+0000","last_undegraded":"2023-12-16T00:00:10.402706+0000","last_fullsized":"2023-12-16T00:00:10.402706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137184+0000","last_change":"2023-12-15T22:53:26.163111+0000","last_active":"2023-12-16T00:00:28.137184+0000","last_peered":"2023-12-16T00:00:28.137184+0000","last_clean":"2023-12-16T00:00:28.137184+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:28.137184+0000","last_undegraded":"2023-12-16T00:00:28.137184+0000","last_fullsized":"2023-12-16T00:00:28.137184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391200+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-16T00:00:20.391200+0000","last_peered":"2023-12-16T00:00:20.391200+0000","last_clean":"2023-12-16T00:00:20.391200+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:00:20.391200+0000","last_undegraded":"2023-12-16T00:00:20.391200+0000","last_fullsized":"2023-12-16T00:00:20.391200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.625033+0000","last_change":"2023-12-15T22:53:10.340508+0000","last_active":"2023-12-16T00:00:20.625033+0000","last_peered":"2023-12-16T00:00:20.625033+0000","last_clean":"2023-12-16T00:00:20.625033+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:20.625033+0000","last_undegraded":"2023-12-16T00:00:20.625033+0000","last_fullsized":"2023-12-16T00:00:20.625033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384776+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:59:05.384776+0000","last_peered":"2023-12-15T23:59:05.384776+0000","last_clean":"2023-12-15T23:59:05.384776+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:59:05.384776+0000","last_undegraded":"2023-12-15T23:59:05.384776+0000","last_fullsized":"2023-12-15T23:59:05.384776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:51.370794+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-15T23:58:51.370794+0000","last_peered":"2023-12-15T23:58:51.370794+0000","last_clean":"2023-12-15T23:58:51.370794+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-15T23:58:51.370794+0000","last_undegraded":"2023-12-15T23:58:51.370794+0000","last_fullsized":"2023-12-15T23:58:51.370794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403966+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:15.403966+0000","last_peered":"2023-12-16T00:00:15.403966+0000","last_clean":"2023-12-16T00:00:15.403966+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:15.403966+0000","last_undegraded":"2023-12-16T00:00:15.403966+0000","last_fullsized":"2023-12-16T00:00:15.403966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1503,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401785+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-16T00:00:10.401785+0000","last_peered":"2023-12-16T00:00:10.401785+0000","last_clean":"2023-12-16T00:00:10.401785+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:00:10.401785+0000","last_undegraded":"2023-12-16T00:00:10.401785+0000","last_fullsized":"2023-12-16T00:00:10.401785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.621598+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-16T00:00:10.621598+0000","last_peered":"2023-12-16T00:00:10.621598+0000","last_clean":"2023-12-16T00:00:10.621598+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:00:10.621598+0000","last_undegraded":"2023-12-16T00:00:10.621598+0000","last_fullsized":"2023-12-16T00:00:10.621598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233326+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233326+0000","last_peered":"2023-12-16T00:00:26.233326+0000","last_clean":"2023-12-16T00:00:26.233326+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233326+0000","last_undegraded":"2023-12-16T00:00:26.233326+0000","last_fullsized":"2023-12-16T00:00:26.233326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378090+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-15T23:58:40.378090+0000","last_peered":"2023-12-15T23:58:40.378090+0000","last_clean":"2023-12-15T23:58:40.378090+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-15T23:58:40.378090+0000","last_undegraded":"2023-12-15T23:58:40.378090+0000","last_fullsized":"2023-12-15T23:58:40.378090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608513+0000","last_change":"2023-12-15T22:53:10.339820+0000","last_active":"2023-12-15T23:59:20.608513+0000","last_peered":"2023-12-15T23:59:20.608513+0000","last_clean":"2023-12-15T23:59:20.608513+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:59:20.608513+0000","last_undegraded":"2023-12-15T23:59:20.608513+0000","last_fullsized":"2023-12-15T23:59:20.608513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":885,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385917+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:59:05.385917+0000","last_peered":"2023-12-15T23:59:05.385917+0000","last_clean":"2023-12-15T23:59:05.385917+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:59:05.385917+0000","last_undegraded":"2023-12-15T23:59:05.385917+0000","last_fullsized":"2023-12-15T23:59:05.385917+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137791+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-16T00:00:28.137791+0000","last_peered":"2023-12-16T00:00:28.137791+0000","last_clean":"2023-12-16T00:00:28.137791+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:00:28.137791+0000","last_undegraded":"2023-12-16T00:00:28.137791+0000","last_fullsized":"2023-12-16T00:00:28.137791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289035+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-16T00:00:27.289035+0000","last_peered":"2023-12-16T00:00:27.289035+0000","last_clean":"2023-12-16T00:00:27.289035+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:00:27.289035+0000","last_undegraded":"2023-12-16T00:00:27.289035+0000","last_fullsized":"2023-12-16T00:00:27.289035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.388836+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-16T00:00:10.388836+0000","last_peered":"2023-12-16T00:00:10.388836+0000","last_clean":"2023-12-16T00:00:10.388836+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:00:10.388836+0000","last_undegraded":"2023-12-16T00:00:10.388836+0000","last_fullsized":"2023-12-16T00:00:10.388836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":864,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835775+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835775+0000","last_peered":"2023-12-16T00:00:29.835775+0000","last_clean":"2023-12-16T00:00:29.835775+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835775+0000","last_undegraded":"2023-12-16T00:00:29.835775+0000","last_fullsized":"2023-12-16T00:00:29.835775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867182+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867182+0000","last_peered":"2023-12-16T00:00:33.867182+0000","last_clean":"2023-12-16T00:00:33.867182+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867182+0000","last_undegraded":"2023-12-16T00:00:33.867182+0000","last_fullsized":"2023-12-16T00:00:33.867182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":207,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.368096+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-15T23:58:40.368096+0000","last_peered":"2023-12-15T23:58:40.368096+0000","last_clean":"2023-12-15T23:58:40.368096+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-15T23:58:40.368096+0000","last_undegraded":"2023-12-15T23:58:40.368096+0000","last_fullsized":"2023-12-15T23:58:40.368096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864656+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-16T00:00:26.864656+0000","last_peered":"2023-12-16T00:00:26.864656+0000","last_clean":"2023-12-16T00:00:26.864656+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:00:26.864656+0000","last_undegraded":"2023-12-16T00:00:26.864656+0000","last_fullsized":"2023-12-16T00:00:26.864656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616043+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:59:50.616043+0000","last_peered":"2023-12-15T23:59:50.616043+0000","last_clean":"2023-12-15T23:59:50.616043+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:59:50.616043+0000","last_undegraded":"2023-12-15T23:59:50.616043+0000","last_fullsized":"2023-12-15T23:59:50.616043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381375+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-15T23:58:50.381375+0000","last_peered":"2023-12-15T23:58:50.381375+0000","last_clean":"2023-12-15T23:58:50.381375+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-15T23:58:50.381375+0000","last_undegraded":"2023-12-15T23:58:50.381375+0000","last_fullsized":"2023-12-15T23:58:50.381375+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384309+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:59:00.384309+0000","last_peered":"2023-12-15T23:59:00.384309+0000","last_clean":"2023-12-15T23:59:00.384309+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:59:00.384309+0000","last_undegraded":"2023-12-15T23:59:00.384309+0000","last_fullsized":"2023-12-15T23:59:00.384309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440575+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-16T00:00:26.440575+0000","last_peered":"2023-12-16T00:00:26.440575+0000","last_clean":"2023-12-16T00:00:26.440575+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:00:26.440575+0000","last_undegraded":"2023-12-16T00:00:26.440575+0000","last_fullsized":"2023-12-16T00:00:26.440575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:11.390702+0000","last_change":"2023-12-15T22:53:30.183489+0000","last_active":"2023-12-16T00:00:11.390702+0000","last_peered":"2023-12-16T00:00:11.390702+0000","last_clean":"2023-12-16T00:00:11.390702+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:11.390702+0000","last_undegraded":"2023-12-16T00:00:11.390702+0000","last_fullsized":"2023-12-16T00:00:11.390702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786863+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786863+0000","last_peered":"2023-12-16T00:00:33.786863+0000","last_clean":"2023-12-16T00:00:33.786863+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786863+0000","last_undegraded":"2023-12-16T00:00:33.786863+0000","last_fullsized":"2023-12-16T00:00:33.786863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121731+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121731+0000","last_peered":"2023-12-16T00:00:35.121731+0000","last_clean":"2023-12-16T00:00:35.121731+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121731+0000","last_undegraded":"2023-12-16T00:00:35.121731+0000","last_fullsized":"2023-12-16T00:00:35.121731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389440+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:06.389440+0000","last_peered":"2023-12-16T00:00:06.389440+0000","last_clean":"2023-12-16T00:00:06.389440+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:06.389440+0000","last_undegraded":"2023-12-16T00:00:06.389440+0000","last_fullsized":"2023-12-16T00:00:06.389440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:35.376836+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-15T23:58:35.376836+0000","last_peered":"2023-12-15T23:58:35.376836+0000","last_clean":"2023-12-15T23:58:35.376836+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-15T23:58:35.376836+0000","last_undegraded":"2023-12-15T23:58:35.376836+0000","last_fullsized":"2023-12-15T23:58:35.376836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440142+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-16T00:00:26.440142+0000","last_peered":"2023-12-16T00:00:26.440142+0000","last_clean":"2023-12-16T00:00:26.440142+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:00:26.440142+0000","last_undegraded":"2023-12-16T00:00:26.440142+0000","last_fullsized":"2023-12-16T00:00:26.440142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711777+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:27.711777+0000","last_peered":"2023-12-16T00:00:27.711777+0000","last_clean":"2023-12-16T00:00:27.711777+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:00:27.711777+0000","last_undegraded":"2023-12-16T00:00:27.711777+0000","last_fullsized":"2023-12-16T00:00:27.711777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385854+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:59:51.385854+0000","last_peered":"2023-12-15T23:59:51.385854+0000","last_clean":"2023-12-15T23:59:51.385854+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:59:51.385854+0000","last_undegraded":"2023-12-15T23:59:51.385854+0000","last_fullsized":"2023-12-15T23:59:51.385854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1759,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.382120+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-15T23:58:55.382120+0000","last_peered":"2023-12-15T23:58:55.382120+0000","last_clean":"2023-12-15T23:58:55.382120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-15T23:58:55.382120+0000","last_undegraded":"2023-12-15T23:58:55.382120+0000","last_fullsized":"2023-12-15T23:58:55.382120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384254+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:59:00.384254+0000","last_peered":"2023-12-15T23:59:00.384254+0000","last_clean":"2023-12-15T23:59:00.384254+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:59:00.384254+0000","last_undegraded":"2023-12-15T23:59:00.384254+0000","last_fullsized":"2023-12-15T23:59:00.384254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440574+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-16T00:00:26.440574+0000","last_peered":"2023-12-16T00:00:26.440574+0000","last_clean":"2023-12-16T00:00:26.440574+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:00:26.440574+0000","last_undegraded":"2023-12-16T00:00:26.440574+0000","last_fullsized":"2023-12-16T00:00:26.440574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.613663+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:59:40.613663+0000","last_peered":"2023-12-15T23:59:40.613663+0000","last_clean":"2023-12-15T23:59:40.613663+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:59:40.613663+0000","last_undegraded":"2023-12-15T23:59:40.613663+0000","last_fullsized":"2023-12-15T23:59:40.613663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'312","reported_seq":521,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:11.390667+0000","last_change":"2023-12-15T22:53:28.170097+0000","last_active":"2023-12-16T00:00:11.390667+0000","last_peered":"2023-12-16T00:00:11.390667+0000","last_clean":"2023-12-16T00:00:11.390667+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:11.390667+0000","last_undegraded":"2023-12-16T00:00:11.390667+0000","last_fullsized":"2023-12-16T00:00:11.390667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710437+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710437+0000","last_peered":"2023-12-16T00:00:43.710437+0000","last_clean":"2023-12-16T00:00:43.710437+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710437+0000","last_undegraded":"2023-12-16T00:00:43.710437+0000","last_fullsized":"2023-12-16T00:00:43.710437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387461+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:05.387461+0000","last_peered":"2023-12-16T00:00:05.387461+0000","last_clean":"2023-12-16T00:00:05.387461+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:05.387461+0000","last_undegraded":"2023-12-16T00:00:05.387461+0000","last_fullsized":"2023-12-16T00:00:05.387461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288427+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-16T00:00:27.288427+0000","last_peered":"2023-12-16T00:00:27.288427+0000","last_clean":"2023-12-16T00:00:27.288427+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:00:27.288427+0000","last_undegraded":"2023-12-16T00:00:27.288427+0000","last_fullsized":"2023-12-16T00:00:27.288427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616155+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:59:50.616155+0000","last_peered":"2023-12-15T23:59:50.616155+0000","last_clean":"2023-12-15T23:59:50.616155+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:59:50.616155+0000","last_undegraded":"2023-12-15T23:59:50.616155+0000","last_fullsized":"2023-12-15T23:59:50.616155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382667+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:59:36.382667+0000","last_peered":"2023-12-15T23:59:36.382667+0000","last_clean":"2023-12-15T23:59:36.382667+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:59:36.382667+0000","last_undegraded":"2023-12-15T23:59:36.382667+0000","last_fullsized":"2023-12-15T23:59:36.382667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.607669+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:59:15.607669+0000","last_peered":"2023-12-15T23:59:15.607669+0000","last_clean":"2023-12-15T23:59:15.607669+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:59:15.607669+0000","last_undegraded":"2023-12-15T23:59:15.607669+0000","last_fullsized":"2023-12-15T23:59:15.607669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369335+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-15T23:58:46.369335+0000","last_peered":"2023-12-15T23:58:46.369335+0000","last_clean":"2023-12-15T23:58:46.369335+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-15T23:58:46.369335+0000","last_undegraded":"2023-12-15T23:58:46.369335+0000","last_fullsized":"2023-12-15T23:58:46.369335+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.598229+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-15T23:58:40.598229+0000","last_peered":"2023-12-15T23:58:40.598229+0000","last_clean":"2023-12-15T23:58:40.598229+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-15T23:58:40.598229+0000","last_undegraded":"2023-12-15T23:58:40.598229+0000","last_fullsized":"2023-12-15T23:58:40.598229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3463,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752760+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752760+0000","last_peered":"2023-12-16T00:00:39.752760+0000","last_clean":"2023-12-16T00:00:39.752760+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752760+0000","last_undegraded":"2023-12-16T00:00:39.752760+0000","last_fullsized":"2023-12-16T00:00:39.752760+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864722+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-16T00:00:26.864722+0000","last_peered":"2023-12-16T00:00:26.864722+0000","last_clean":"2023-12-16T00:00:26.864722+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:00:26.864722+0000","last_undegraded":"2023-12-16T00:00:26.864722+0000","last_fullsized":"2023-12-16T00:00:26.864722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396920+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:59:50.396920+0000","last_peered":"2023-12-15T23:59:50.396920+0000","last_clean":"2023-12-15T23:59:50.396920+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:59:50.396920+0000","last_undegraded":"2023-12-15T23:59:50.396920+0000","last_fullsized":"2023-12-15T23:59:50.396920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405397+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:25.405397+0000","last_peered":"2023-12-16T00:00:25.405397+0000","last_clean":"2023-12-16T00:00:25.405397+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:25.405397+0000","last_undegraded":"2023-12-16T00:00:25.405397+0000","last_fullsized":"2023-12-16T00:00:25.405397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612548+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:59:35.612548+0000","last_peered":"2023-12-15T23:59:35.612548+0000","last_clean":"2023-12-15T23:59:35.612548+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:59:35.612548+0000","last_undegraded":"2023-12-15T23:59:35.612548+0000","last_fullsized":"2023-12-15T23:59:35.612548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384782+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:59:46.384782+0000","last_peered":"2023-12-15T23:59:46.384782+0000","last_clean":"2023-12-15T23:59:46.384782+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:59:46.384782+0000","last_undegraded":"2023-12-15T23:59:46.384782+0000","last_fullsized":"2023-12-15T23:59:46.384782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404945+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-16T00:00:20.404945+0000","last_peered":"2023-12-16T00:00:20.404945+0000","last_clean":"2023-12-16T00:00:20.404945+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:00:20.404945+0000","last_undegraded":"2023-12-16T00:00:20.404945+0000","last_fullsized":"2023-12-16T00:00:20.404945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:21.378650+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:59:21.378650+0000","last_peered":"2023-12-15T23:59:21.378650+0000","last_clean":"2023-12-15T23:59:21.378650+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:59:21.378650+0000","last_undegraded":"2023-12-15T23:59:21.378650+0000","last_fullsized":"2023-12-15T23:59:21.378650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:16.377291+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:59:16.377291+0000","last_peered":"2023-12-15T23:59:16.377291+0000","last_clean":"2023-12-15T23:59:16.377291+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:59:16.377291+0000","last_undegraded":"2023-12-15T23:59:16.377291+0000","last_fullsized":"2023-12-15T23:59:16.377291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380634+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-15T23:58:50.380634+0000","last_peered":"2023-12-15T23:58:50.380634+0000","last_clean":"2023-12-15T23:58:50.380634+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-15T23:58:50.380634+0000","last_undegraded":"2023-12-15T23:58:50.380634+0000","last_fullsized":"2023-12-15T23:58:50.380634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.368976+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-15T23:58:45.368976+0000","last_peered":"2023-12-15T23:58:45.368976+0000","last_clean":"2023-12-15T23:58:45.368976+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-15T23:58:45.368976+0000","last_undegraded":"2023-12-15T23:58:45.368976+0000","last_fullsized":"2023-12-15T23:58:45.368976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3370,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447059+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447059+0000","last_peered":"2023-12-16T00:00:43.447059+0000","last_clean":"2023-12-16T00:00:43.447059+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447059+0000","last_undegraded":"2023-12-16T00:00:43.447059+0000","last_fullsized":"2023-12-16T00:00:43.447059+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612756+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:59:35.612756+0000","last_peered":"2023-12-15T23:59:35.612756+0000","last_clean":"2023-12-15T23:59:35.612756+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:59:35.612756+0000","last_undegraded":"2023-12-15T23:59:35.612756+0000","last_fullsized":"2023-12-15T23:59:35.612756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379446+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-15T23:58:45.379446+0000","last_peered":"2023-12-15T23:58:45.379446+0000","last_clean":"2023-12-15T23:58:45.379446+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-15T23:58:45.379446+0000","last_undegraded":"2023-12-15T23:58:45.379446+0000","last_fullsized":"2023-12-15T23:58:45.379446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382308+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:59:36.382308+0000","last_peered":"2023-12-15T23:59:36.382308+0000","last_clean":"2023-12-15T23:59:36.382308+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:59:36.382308+0000","last_undegraded":"2023-12-15T23:59:36.382308+0000","last_fullsized":"2023-12-15T23:59:36.382308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399480+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:00.399480+0000","last_peered":"2023-12-16T00:00:00.399480+0000","last_clean":"2023-12-16T00:00:00.399480+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:00.399480+0000","last_undegraded":"2023-12-16T00:00:00.399480+0000","last_fullsized":"2023-12-16T00:00:00.399480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.624945+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-16T00:00:20.624945+0000","last_peered":"2023-12-16T00:00:20.624945+0000","last_clean":"2023-12-16T00:00:20.624945+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:00:20.624945+0000","last_undegraded":"2023-12-16T00:00:20.624945+0000","last_fullsized":"2023-12-16T00:00:20.624945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404812+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-16T00:00:20.404812+0000","last_peered":"2023-12-16T00:00:20.404812+0000","last_clean":"2023-12-16T00:00:20.404812+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:00:20.404812+0000","last_undegraded":"2023-12-16T00:00:20.404812+0000","last_fullsized":"2023-12-16T00:00:20.404812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404882+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-16T00:00:20.404882+0000","last_peered":"2023-12-16T00:00:20.404882+0000","last_clean":"2023-12-16T00:00:20.404882+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:00:20.404882+0000","last_undegraded":"2023-12-16T00:00:20.404882+0000","last_fullsized":"2023-12-16T00:00:20.404882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5994,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389933+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:59:20.389933+0000","last_peered":"2023-12-15T23:59:20.389933+0000","last_clean":"2023-12-15T23:59:20.389933+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:59:20.389933+0000","last_undegraded":"2023-12-15T23:59:20.389933+0000","last_fullsized":"2023-12-15T23:59:20.389933+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388623+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:59:15.388623+0000","last_peered":"2023-12-15T23:59:15.388623+0000","last_clean":"2023-12-15T23:59:15.388623+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:59:15.388623+0000","last_undegraded":"2023-12-15T23:59:15.388623+0000","last_fullsized":"2023-12-15T23:59:15.388623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385563+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:59:05.385563+0000","last_peered":"2023-12-15T23:59:05.385563+0000","last_clean":"2023-12-15T23:59:05.385563+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:59:05.385563+0000","last_undegraded":"2023-12-15T23:59:05.385563+0000","last_fullsized":"2023-12-15T23:59:05.385563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865032+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-16T00:00:26.865032+0000","last_peered":"2023-12-16T00:00:26.865032+0000","last_clean":"2023-12-16T00:00:26.865032+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:00:26.865032+0000","last_undegraded":"2023-12-16T00:00:26.865032+0000","last_fullsized":"2023-12-16T00:00:26.865032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1392,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288826+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-16T00:00:27.288826+0000","last_peered":"2023-12-16T00:00:27.288826+0000","last_clean":"2023-12-16T00:00:27.288826+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:00:27.288826+0000","last_undegraded":"2023-12-16T00:00:27.288826+0000","last_fullsized":"2023-12-16T00:00:27.288826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378221+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-15T23:58:40.378221+0000","last_peered":"2023-12-15T23:58:40.378221+0000","last_clean":"2023-12-15T23:58:40.378221+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-15T23:58:40.378221+0000","last_undegraded":"2023-12-15T23:58:40.378221+0000","last_fullsized":"2023-12-15T23:58:40.378221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620685+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:05.620685+0000","last_peered":"2023-12-16T00:00:05.620685+0000","last_clean":"2023-12-16T00:00:05.620685+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:05.620685+0000","last_undegraded":"2023-12-16T00:00:05.620685+0000","last_fullsized":"2023-12-16T00:00:05.620685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369089+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-15T23:58:46.369089+0000","last_peered":"2023-12-15T23:58:46.369089+0000","last_clean":"2023-12-15T23:58:46.369089+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-15T23:58:46.369089+0000","last_undegraded":"2023-12-15T23:58:46.369089+0000","last_fullsized":"2023-12-15T23:58:46.369089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.604678+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-15T23:59:05.604678+0000","last_peered":"2023-12-15T23:59:05.604678+0000","last_clean":"2023-12-15T23:59:05.604678+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-15T23:59:05.604678+0000","last_undegraded":"2023-12-15T23:59:05.604678+0000","last_fullsized":"2023-12-15T23:59:05.604678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.390276+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:15.390276+0000","last_peered":"2023-12-16T00:00:15.390276+0000","last_clean":"2023-12-16T00:00:15.390276+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:15.390276+0000","last_undegraded":"2023-12-16T00:00:15.390276+0000","last_fullsized":"2023-12-16T00:00:15.390276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401475+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:05.401475+0000","last_peered":"2023-12-16T00:00:05.401475+0000","last_clean":"2023-12-16T00:00:05.401475+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:05.401475+0000","last_undegraded":"2023-12-16T00:00:05.401475+0000","last_fullsized":"2023-12-16T00:00:05.401475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396260+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:59:50.396260+0000","last_peered":"2023-12-15T23:59:50.396260+0000","last_clean":"2023-12-15T23:59:50.396260+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:59:50.396260+0000","last_undegraded":"2023-12-15T23:59:50.396260+0000","last_fullsized":"2023-12-15T23:59:50.396260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016252+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-16T00:00:26.016252+0000","last_peered":"2023-12-16T00:00:26.016252+0000","last_clean":"2023-12-16T00:00:26.016252+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:00:26.016252+0000","last_undegraded":"2023-12-16T00:00:26.016252+0000","last_fullsized":"2023-12-16T00:00:26.016252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388533+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:59:20.388533+0000","last_peered":"2023-12-15T23:59:20.388533+0000","last_clean":"2023-12-15T23:59:20.388533+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:59:20.388533+0000","last_undegraded":"2023-12-15T23:59:20.388533+0000","last_fullsized":"2023-12-15T23:59:20.388533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.392864+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:59:30.392864+0000","last_peered":"2023-12-15T23:59:30.392864+0000","last_clean":"2023-12-15T23:59:30.392864+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:59:30.392864+0000","last_undegraded":"2023-12-15T23:59:30.392864+0000","last_fullsized":"2023-12-15T23:59:30.392864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380901+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-15T23:58:50.380901+0000","last_peered":"2023-12-15T23:58:50.380901+0000","last_clean":"2023-12-15T23:58:50.380901+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-15T23:58:50.380901+0000","last_undegraded":"2023-12-15T23:58:50.380901+0000","last_fullsized":"2023-12-15T23:58:50.380901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865018+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-16T00:00:26.865018+0000","last_peered":"2023-12-16T00:00:26.865018+0000","last_clean":"2023-12-16T00:00:26.865018+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:00:26.865018+0000","last_undegraded":"2023-12-16T00:00:26.865018+0000","last_fullsized":"2023-12-16T00:00:26.865018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":523,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016554+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-16T00:00:26.016554+0000","last_peered":"2023-12-16T00:00:26.016554+0000","last_clean":"2023-12-16T00:00:26.016554+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:00:26.016554+0000","last_undegraded":"2023-12-16T00:00:26.016554+0000","last_fullsized":"2023-12-16T00:00:26.016554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'7","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377753+0000","last_change":"2023-12-15T22:53:26.161393+0000","last_active":"2023-12-15T23:58:40.377753+0000","last_peered":"2023-12-15T23:58:40.377753+0000","last_clean":"2023-12-15T23:58:40.377753+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-15T23:58:40.377753+0000","last_undegraded":"2023-12-15T23:58:40.377753+0000","last_fullsized":"2023-12-15T23:58:40.377753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400974+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:05.400974+0000","last_peered":"2023-12-16T00:00:05.400974+0000","last_clean":"2023-12-16T00:00:05.400974+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:05.400974+0000","last_undegraded":"2023-12-16T00:00:05.400974+0000","last_fullsized":"2023-12-16T00:00:05.400974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600834+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-15T23:58:50.600834+0000","last_peered":"2023-12-15T23:58:50.600834+0000","last_clean":"2023-12-15T23:58:50.600834+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-15T23:58:50.600834+0000","last_undegraded":"2023-12-15T23:58:50.600834+0000","last_fullsized":"2023-12-15T23:58:50.600834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405423+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:00:25.405423+0000","last_peered":"2023-12-16T00:00:25.405423+0000","last_clean":"2023-12-16T00:00:25.405423+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:00:25.405423+0000","last_undegraded":"2023-12-16T00:00:25.405423+0000","last_fullsized":"2023-12-16T00:00:25.405423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392199+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:59:35.392199+0000","last_peered":"2023-12-15T23:59:35.392199+0000","last_clean":"2023-12-15T23:59:35.392199+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:59:35.392199+0000","last_undegraded":"2023-12-15T23:59:35.392199+0000","last_fullsized":"2023-12-15T23:59:35.392199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.404304+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:15.404304+0000","last_peered":"2023-12-16T00:00:15.404304+0000","last_clean":"2023-12-16T00:00:15.404304+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:15.404304+0000","last_undegraded":"2023-12-16T00:00:15.404304+0000","last_fullsized":"2023-12-16T00:00:15.404304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":971,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616350+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:59:50.616350+0000","last_peered":"2023-12-15T23:59:50.616350+0000","last_clean":"2023-12-15T23:59:50.616350+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:59:50.616350+0000","last_undegraded":"2023-12-15T23:59:50.616350+0000","last_fullsized":"2023-12-15T23:59:50.616350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389786+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:06.389786+0000","last_peered":"2023-12-16T00:00:06.389786+0000","last_clean":"2023-12-16T00:00:06.389786+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:00:06.389786+0000","last_undegraded":"2023-12-16T00:00:06.389786+0000","last_fullsized":"2023-12-16T00:00:06.389786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440322+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-16T00:00:26.440322+0000","last_peered":"2023-12-16T00:00:26.440322+0000","last_clean":"2023-12-16T00:00:26.440322+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:00:26.440322+0000","last_undegraded":"2023-12-16T00:00:26.440322+0000","last_fullsized":"2023-12-16T00:00:26.440322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.367743+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-15T23:58:40.367743+0000","last_peered":"2023-12-15T23:58:40.367743+0000","last_clean":"2023-12-15T23:58:40.367743+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-15T23:58:40.367743+0000","last_undegraded":"2023-12-15T23:58:40.367743+0000","last_fullsized":"2023-12-15T23:58:40.367743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1256,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388381+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:59:20.388381+0000","last_peered":"2023-12-15T23:59:20.388381+0000","last_clean":"2023-12-15T23:59:20.388381+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:59:20.388381+0000","last_undegraded":"2023-12-15T23:59:20.388381+0000","last_fullsized":"2023-12-15T23:59:20.388381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.372484+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:59:00.372484+0000","last_peered":"2023-12-15T23:59:00.372484+0000","last_clean":"2023-12-15T23:59:00.372484+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:59:00.372484+0000","last_undegraded":"2023-12-15T23:59:00.372484+0000","last_fullsized":"2023-12-15T23:59:00.372484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865152+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-16T00:00:26.865152+0000","last_peered":"2023-12-16T00:00:26.865152+0000","last_clean":"2023-12-16T00:00:26.865152+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:00:26.865152+0000","last_undegraded":"2023-12-16T00:00:26.865152+0000","last_fullsized":"2023-12-16T00:00:26.865152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'576","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369436+0000","last_change":"2023-12-15T22:53:30.181085+0000","last_active":"2023-12-15T23:58:46.369436+0000","last_peered":"2023-12-15T23:58:46.369436+0000","last_clean":"2023-12-15T23:58:46.369436+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-15T23:58:46.369436+0000","last_undegraded":"2023-12-15T23:58:46.369436+0000","last_fullsized":"2023-12-15T23:58:46.369436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384345+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:59:00.384345+0000","last_peered":"2023-12-15T23:59:00.384345+0000","last_clean":"2023-12-15T23:59:00.384345+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:59:00.384345+0000","last_undegraded":"2023-12-15T23:59:00.384345+0000","last_fullsized":"2023-12-15T23:59:00.384345+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.367946+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-15T23:58:40.367946+0000","last_peered":"2023-12-15T23:58:40.367946+0000","last_clean":"2023-12-15T23:58:40.367946+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-15T23:58:40.367946+0000","last_undegraded":"2023-12-15T23:58:40.367946+0000","last_fullsized":"2023-12-15T23:58:40.367946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382155+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:59:36.382155+0000","last_peered":"2023-12-15T23:59:36.382155+0000","last_clean":"2023-12-15T23:59:36.382155+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:59:36.382155+0000","last_undegraded":"2023-12-15T23:59:36.382155+0000","last_fullsized":"2023-12-15T23:59:36.382155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400947+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:05.400947+0000","last_peered":"2023-12-16T00:00:05.400947+0000","last_clean":"2023-12-16T00:00:05.400947+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:05.400947+0000","last_undegraded":"2023-12-16T00:00:05.400947+0000","last_fullsized":"2023-12-16T00:00:05.400947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600907+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-15T23:58:50.600907+0000","last_peered":"2023-12-15T23:58:50.600907+0000","last_clean":"2023-12-15T23:58:50.600907+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-15T23:58:50.600907+0000","last_undegraded":"2023-12-15T23:58:50.600907+0000","last_fullsized":"2023-12-15T23:58:50.600907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.377078+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:59:20.377078+0000","last_peered":"2023-12-15T23:59:20.377078+0000","last_clean":"2023-12-15T23:59:20.377078+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:59:20.377078+0000","last_undegraded":"2023-12-15T23:59:20.377078+0000","last_fullsized":"2023-12-15T23:59:20.377078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384717+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:59:46.384717+0000","last_peered":"2023-12-15T23:59:46.384717+0000","last_clean":"2023-12-15T23:59:46.384717+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:59:46.384717+0000","last_undegraded":"2023-12-15T23:59:46.384717+0000","last_fullsized":"2023-12-15T23:59:46.384717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384215+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:59:50.384215+0000","last_peered":"2023-12-15T23:59:50.384215+0000","last_clean":"2023-12-15T23:59:50.384215+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:59:50.384215+0000","last_undegraded":"2023-12-15T23:59:50.384215+0000","last_fullsized":"2023-12-15T23:59:50.384215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137138+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-16T00:00:28.137138+0000","last_peered":"2023-12-16T00:00:28.137138+0000","last_clean":"2023-12-16T00:00:28.137138+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:00:28.137138+0000","last_undegraded":"2023-12-16T00:00:28.137138+0000","last_fullsized":"2023-12-16T00:00:28.137138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5895,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389070+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:59:20.389070+0000","last_peered":"2023-12-15T23:59:20.389070+0000","last_clean":"2023-12-15T23:59:20.389070+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:59:20.389070+0000","last_undegraded":"2023-12-15T23:59:20.389070+0000","last_fullsized":"2023-12-15T23:59:20.389070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.383626+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:59:00.383626+0000","last_peered":"2023-12-15T23:59:00.383626+0000","last_clean":"2023-12-15T23:59:00.383626+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:59:00.383626+0000","last_undegraded":"2023-12-15T23:59:00.383626+0000","last_fullsized":"2023-12-15T23:59:00.383626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865135+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-16T00:00:26.865135+0000","last_peered":"2023-12-16T00:00:26.865135+0000","last_clean":"2023-12-16T00:00:26.865135+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:00:26.865135+0000","last_undegraded":"2023-12-16T00:00:26.865135+0000","last_fullsized":"2023-12-16T00:00:26.865135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384326+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:59:00.384326+0000","last_peered":"2023-12-15T23:59:00.384326+0000","last_clean":"2023-12-15T23:59:00.384326+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:59:00.384326+0000","last_undegraded":"2023-12-15T23:59:00.384326+0000","last_fullsized":"2023-12-15T23:59:00.384326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":738,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359684+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359684+0000","last_peered":"2023-12-16T00:00:30.359684+0000","last_clean":"2023-12-16T00:00:30.359684+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359684+0000","last_undegraded":"2023-12-16T00:00:30.359684+0000","last_fullsized":"2023-12-16T00:00:30.359684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090903+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090903+0000","last_peered":"2023-12-16T00:00:39.090903+0000","last_clean":"2023-12-16T00:00:39.090903+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090903+0000","last_undegraded":"2023-12-16T00:00:39.090903+0000","last_fullsized":"2023-12-16T00:00:39.090903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.385504+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:59:10.385504+0000","last_peered":"2023-12-15T23:59:10.385504+0000","last_clean":"2023-12-15T23:59:10.385504+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:59:10.385504+0000","last_undegraded":"2023-12-15T23:59:10.385504+0000","last_fullsized":"2023-12-15T23:59:10.385504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387948+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:05.387948+0000","last_peered":"2023-12-16T00:00:05.387948+0000","last_clean":"2023-12-16T00:00:05.387948+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:05.387948+0000","last_undegraded":"2023-12-16T00:00:05.387948+0000","last_fullsized":"2023-12-16T00:00:05.387948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:06.374589+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:59:06.374589+0000","last_peered":"2023-12-15T23:59:06.374589+0000","last_clean":"2023-12-15T23:59:06.374589+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:59:06.374589+0000","last_undegraded":"2023-12-15T23:59:06.374589+0000","last_fullsized":"2023-12-15T23:59:06.374589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395428+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:59:45.395428+0000","last_peered":"2023-12-15T23:59:45.395428+0000","last_clean":"2023-12-15T23:59:45.395428+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:59:45.395428+0000","last_undegraded":"2023-12-15T23:59:45.395428+0000","last_fullsized":"2023-12-15T23:59:45.395428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396667+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:59:50.396667+0000","last_peered":"2023-12-15T23:59:50.396667+0000","last_clean":"2023-12-15T23:59:50.396667+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:59:50.396667+0000","last_undegraded":"2023-12-15T23:59:50.396667+0000","last_fullsized":"2023-12-15T23:59:50.396667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396171+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:59:50.396171+0000","last_peered":"2023-12-15T23:59:50.396171+0000","last_clean":"2023-12-15T23:59:50.396171+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:59:50.396171+0000","last_undegraded":"2023-12-15T23:59:50.396171+0000","last_fullsized":"2023-12-15T23:59:50.396171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016233+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-16T00:00:26.016233+0000","last_peered":"2023-12-16T00:00:26.016233+0000","last_clean":"2023-12-16T00:00:26.016233+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:00:26.016233+0000","last_undegraded":"2023-12-16T00:00:26.016233+0000","last_fullsized":"2023-12-16T00:00:26.016233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385205+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:59:05.385205+0000","last_peered":"2023-12-15T23:59:05.385205+0000","last_clean":"2023-12-15T23:59:05.385205+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:59:05.385205+0000","last_undegraded":"2023-12-15T23:59:05.385205+0000","last_fullsized":"2023-12-15T23:59:05.385205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.376091+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:59:15.376091+0000","last_peered":"2023-12-15T23:59:15.376091+0000","last_clean":"2023-12-15T23:59:15.376091+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:59:15.376091+0000","last_undegraded":"2023-12-15T23:59:15.376091+0000","last_fullsized":"2023-12-15T23:59:15.376091+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380433+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-15T23:58:50.380433+0000","last_peered":"2023-12-15T23:58:50.380433+0000","last_clean":"2023-12-15T23:58:50.380433+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-15T23:58:50.380433+0000","last_undegraded":"2023-12-15T23:58:50.380433+0000","last_fullsized":"2023-12-15T23:58:50.380433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.599649+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-15T23:58:45.599649+0000","last_peered":"2023-12-15T23:58:45.599649+0000","last_clean":"2023-12-15T23:58:45.599649+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-15T23:58:45.599649+0000","last_undegraded":"2023-12-15T23:58:45.599649+0000","last_fullsized":"2023-12-15T23:58:45.599649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":775,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388034+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388034+0000","last_peered":"2023-12-16T00:00:42.388034+0000","last_clean":"2023-12-16T00:00:42.388034+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388034+0000","last_undegraded":"2023-12-16T00:00:42.388034+0000","last_fullsized":"2023-12-16T00:00:42.388034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096277+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096277+0000","last_peered":"2023-12-16T00:00:28.096277+0000","last_clean":"2023-12-16T00:00:28.096277+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096277+0000","last_undegraded":"2023-12-16T00:00:28.096277+0000","last_fullsized":"2023-12-16T00:00:28.096277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392326+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:59:35.392326+0000","last_peered":"2023-12-15T23:59:35.392326+0000","last_clean":"2023-12-15T23:59:35.392326+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:59:35.392326+0000","last_undegraded":"2023-12-15T23:59:35.392326+0000","last_fullsized":"2023-12-15T23:59:35.392326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612737+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:59:35.612737+0000","last_peered":"2023-12-15T23:59:35.612737+0000","last_clean":"2023-12-15T23:59:35.612737+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:59:35.612737+0000","last_undegraded":"2023-12-15T23:59:35.612737+0000","last_fullsized":"2023-12-15T23:59:35.612737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388063+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:59:15.388063+0000","last_peered":"2023-12-15T23:59:15.388063+0000","last_clean":"2023-12-15T23:59:15.388063+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:59:15.388063+0000","last_undegraded":"2023-12-15T23:59:15.388063+0000","last_fullsized":"2023-12-15T23:59:15.388063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395993+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:59:45.395993+0000","last_peered":"2023-12-15T23:59:45.395993+0000","last_clean":"2023-12-15T23:59:45.395993+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:59:45.395993+0000","last_undegraded":"2023-12-15T23:59:45.395993+0000","last_fullsized":"2023-12-15T23:59:45.395993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616027+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:59:50.616027+0000","last_peered":"2023-12-15T23:59:50.616027+0000","last_clean":"2023-12-15T23:59:50.616027+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:59:50.616027+0000","last_undegraded":"2023-12-15T23:59:50.616027+0000","last_fullsized":"2023-12-15T23:59:50.616027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390990+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:59:25.390990+0000","last_peered":"2023-12-15T23:59:25.390990+0000","last_clean":"2023-12-15T23:59:25.390990+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:59:25.390990+0000","last_undegraded":"2023-12-15T23:59:25.390990+0000","last_fullsized":"2023-12-15T23:59:25.390990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378108+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-15T23:58:40.378108+0000","last_peered":"2023-12-15T23:58:40.378108+0000","last_clean":"2023-12-15T23:58:40.378108+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-15T23:58:40.378108+0000","last_undegraded":"2023-12-15T23:58:40.378108+0000","last_fullsized":"2023-12-15T23:58:40.378108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384294+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:59:05.384294+0000","last_peered":"2023-12-15T23:59:05.384294+0000","last_clean":"2023-12-15T23:59:05.384294+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:59:05.384294+0000","last_undegraded":"2023-12-15T23:59:05.384294+0000","last_fullsized":"2023-12-15T23:59:05.384294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387794+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:59:15.387794+0000","last_peered":"2023-12-15T23:59:15.387794+0000","last_clean":"2023-12-15T23:59:15.387794+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:59:15.387794+0000","last_undegraded":"2023-12-15T23:59:15.387794+0000","last_fullsized":"2023-12-15T23:59:15.387794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.370147+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-15T23:58:50.370147+0000","last_peered":"2023-12-15T23:58:50.370147+0000","last_clean":"2023-12-15T23:58:50.370147+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-15T23:58:50.370147+0000","last_undegraded":"2023-12-15T23:58:50.370147+0000","last_fullsized":"2023-12-15T23:58:50.370147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.369107+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-15T23:58:45.369107+0000","last_peered":"2023-12-15T23:58:45.369107+0000","last_clean":"2023-12-15T23:58:45.369107+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-15T23:58:45.369107+0000","last_undegraded":"2023-12-15T23:58:45.369107+0000","last_fullsized":"2023-12-15T23:58:45.369107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":445,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.332983+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.332983+0000","last_peered":"2023-12-16T00:00:36.332983+0000","last_clean":"2023-12-16T00:00:36.332983+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.332983+0000","last_undegraded":"2023-12-16T00:00:36.332983+0000","last_fullsized":"2023-12-16T00:00:36.332983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'11","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.382938+0000","last_change":"2023-12-15T22:53:26.165429+0000","last_active":"2023-12-15T23:58:55.382938+0000","last_peered":"2023-12-15T23:58:55.382938+0000","last_clean":"2023-12-15T23:58:55.382938+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-15T23:58:55.382938+0000","last_undegraded":"2023-12-15T23:58:55.382938+0000","last_fullsized":"2023-12-15T23:58:55.382938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612574+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:59:35.612574+0000","last_peered":"2023-12-15T23:59:35.612574+0000","last_clean":"2023-12-15T23:59:35.612574+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:59:35.612574+0000","last_undegraded":"2023-12-15T23:59:35.612574+0000","last_fullsized":"2023-12-15T23:59:35.612574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397612+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:59:50.397612+0000","last_peered":"2023-12-15T23:59:50.397612+0000","last_clean":"2023-12-15T23:59:50.397612+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:59:50.397612+0000","last_undegraded":"2023-12-15T23:59:50.397612+0000","last_fullsized":"2023-12-15T23:59:50.397612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.390173+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:59:20.390173+0000","last_peered":"2023-12-15T23:59:20.390173+0000","last_clean":"2023-12-15T23:59:20.390173+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:59:20.390173+0000","last_undegraded":"2023-12-15T23:59:20.390173+0000","last_fullsized":"2023-12-15T23:59:20.390173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.394959+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:59:45.394959+0000","last_peered":"2023-12-15T23:59:45.394959+0000","last_clean":"2023-12-15T23:59:45.394959+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:59:45.394959+0000","last_undegraded":"2023-12-15T23:59:45.394959+0000","last_fullsized":"2023-12-15T23:59:45.394959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389387+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:59:25.389387+0000","last_peered":"2023-12-15T23:59:25.389387+0000","last_clean":"2023-12-15T23:59:25.389387+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:59:25.389387+0000","last_undegraded":"2023-12-15T23:59:25.389387+0000","last_fullsized":"2023-12-15T23:59:25.389387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385796+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:59:51.385796+0000","last_peered":"2023-12-15T23:59:51.385796+0000","last_clean":"2023-12-15T23:59:51.385796+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:59:51.385796+0000","last_undegraded":"2023-12-15T23:59:51.385796+0000","last_fullsized":"2023-12-15T23:59:51.385796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016281+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-16T00:00:26.016281+0000","last_peered":"2023-12-16T00:00:26.016281+0000","last_clean":"2023-12-16T00:00:26.016281+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:00:26.016281+0000","last_undegraded":"2023-12-16T00:00:26.016281+0000","last_fullsized":"2023-12-16T00:00:26.016281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389408+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:59:25.389408+0000","last_peered":"2023-12-15T23:59:25.389408+0000","last_clean":"2023-12-15T23:59:25.389408+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:59:25.389408+0000","last_undegraded":"2023-12-15T23:59:25.389408+0000","last_fullsized":"2023-12-15T23:59:25.389408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.603511+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:59:00.603511+0000","last_peered":"2023-12-15T23:59:00.603511+0000","last_clean":"2023-12-15T23:59:00.603511+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:59:00.603511+0000","last_undegraded":"2023-12-15T23:59:00.603511+0000","last_fullsized":"2023-12-15T23:59:00.603511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:31.365519+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-15T23:58:31.365519+0000","last_peered":"2023-12-15T23:58:31.365519+0000","last_clean":"2023-12-15T23:58:31.365519+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-15T23:58:31.365519+0000","last_undegraded":"2023-12-15T23:58:31.365519+0000","last_fullsized":"2023-12-15T23:58:31.365519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375077+0000","last_change":"2023-12-15T22:53:30.176406+0000","last_active":"2023-12-15T23:58:30.375077+0000","last_peered":"2023-12-15T23:58:30.375077+0000","last_clean":"2023-12-15T23:58:30.375077+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-15T23:58:30.375077+0000","last_undegraded":"2023-12-15T23:58:30.375077+0000","last_fullsized":"2023-12-15T23:58:30.375077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329655+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329655+0000","last_peered":"2023-12-16T00:00:31.329655+0000","last_clean":"2023-12-16T00:00:31.329655+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329655+0000","last_undegraded":"2023-12-16T00:00:31.329655+0000","last_fullsized":"2023-12-16T00:00:31.329655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.393828+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:59:40.393828+0000","last_peered":"2023-12-15T23:59:40.393828+0000","last_clean":"2023-12-15T23:59:40.393828+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:59:40.393828+0000","last_undegraded":"2023-12-15T23:59:40.393828+0000","last_fullsized":"2023-12-15T23:59:40.393828+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396486+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:59:50.396486+0000","last_peered":"2023-12-15T23:59:50.396486+0000","last_clean":"2023-12-15T23:59:50.396486+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:59:50.396486+0000","last_undegraded":"2023-12-15T23:59:50.396486+0000","last_fullsized":"2023-12-15T23:59:50.396486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375555+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-15T23:58:30.375555+0000","last_peered":"2023-12-15T23:58:30.375555+0000","last_clean":"2023-12-15T23:58:30.375555+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-15T23:58:30.375555+0000","last_undegraded":"2023-12-15T23:58:30.375555+0000","last_fullsized":"2023-12-15T23:58:30.375555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.365121+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-15T23:58:30.365121+0000","last_peered":"2023-12-15T23:58:30.365121+0000","last_clean":"2023-12-15T23:58:30.365121+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-15T23:58:30.365121+0000","last_undegraded":"2023-12-15T23:58:30.365121+0000","last_fullsized":"2023-12-15T23:58:30.365121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.595789+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-15T23:58:30.595789+0000","last_peered":"2023-12-15T23:58:30.595789+0000","last_clean":"2023-12-15T23:58:30.595789+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-15T23:58:30.595789+0000","last_undegraded":"2023-12-15T23:58:30.595789+0000","last_fullsized":"2023-12-15T23:58:30.595789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382094+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:59:36.382094+0000","last_peered":"2023-12-15T23:59:36.382094+0000","last_clean":"2023-12-15T23:59:36.382094+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:59:36.382094+0000","last_undegraded":"2023-12-15T23:59:36.382094+0000","last_fullsized":"2023-12-15T23:59:36.382094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6460,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608437+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:59:20.608437+0000","last_peered":"2023-12-15T23:59:20.608437+0000","last_clean":"2023-12-15T23:59:20.608437+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:59:20.608437+0000","last_undegraded":"2023-12-15T23:59:20.608437+0000","last_fullsized":"2023-12-15T23:59:20.608437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:01.373114+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:59:01.373114+0000","last_peered":"2023-12-15T23:59:01.373114+0000","last_clean":"2023-12-15T23:59:01.373114+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:59:01.373114+0000","last_undegraded":"2023-12-15T23:59:01.373114+0000","last_fullsized":"2023-12-15T23:59:01.373114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:31.365416+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-15T23:58:31.365416+0000","last_peered":"2023-12-15T23:58:31.365416+0000","last_clean":"2023-12-15T23:58:31.365416+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-15T23:58:31.365416+0000","last_undegraded":"2023-12-15T23:58:31.365416+0000","last_fullsized":"2023-12-15T23:58:31.365416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375693+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-15T23:58:30.375693+0000","last_peered":"2023-12-15T23:58:30.375693+0000","last_clean":"2023-12-15T23:58:30.375693+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-15T23:58:30.375693+0000","last_undegraded":"2023-12-15T23:58:30.375693+0000","last_fullsized":"2023-12-15T23:58:30.375693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1300,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.734941+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.734941+0000","last_peered":"2023-12-16T00:00:35.734941+0000","last_clean":"2023-12-16T00:00:35.734941+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.734941+0000","last_undegraded":"2023-12-16T00:00:35.734941+0000","last_fullsized":"2023-12-16T00:00:35.734941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383765+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:59:41.383765+0000","last_peered":"2023-12-15T23:59:41.383765+0000","last_clean":"2023-12-15T23:59:41.383765+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:59:41.383765+0000","last_undegraded":"2023-12-15T23:59:41.383765+0000","last_fullsized":"2023-12-15T23:59:41.383765+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609028+0000","last_change":"2023-12-15T22:53:10.339946+0000","last_active":"2023-12-15T23:59:20.609028+0000","last_peered":"2023-12-15T23:59:20.609028+0000","last_clean":"2023-12-15T23:59:20.609028+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-15T23:59:20.609028+0000","last_undegraded":"2023-12-15T23:59:20.609028+0000","last_fullsized":"2023-12-15T23:59:20.609028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375182+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-15T23:58:30.375182+0000","last_peered":"2023-12-15T23:58:30.375182+0000","last_clean":"2023-12-15T23:58:30.375182+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-15T23:58:30.375182+0000","last_undegraded":"2023-12-15T23:58:30.375182+0000","last_fullsized":"2023-12-15T23:58:30.375182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375214+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-15T23:58:30.375214+0000","last_peered":"2023-12-15T23:58:30.375214+0000","last_clean":"2023-12-15T23:58:30.375214+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-15T23:58:30.375214+0000","last_undegraded":"2023-12-15T23:58:30.375214+0000","last_fullsized":"2023-12-15T23:58:30.375214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377949+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:58:40.377949+0000","last_peered":"2023-12-15T23:58:40.377949+0000","last_clean":"2023-12-15T23:58:40.377949+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:58:40.377949+0000","last_undegraded":"2023-12-15T23:58:40.377949+0000","last_fullsized":"2023-12-15T23:58:40.377949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.605075+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:59:05.605075+0000","last_peered":"2023-12-15T23:59:05.605075+0000","last_clean":"2023-12-15T23:59:05.605075+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:59:05.605075+0000","last_undegraded":"2023-12-15T23:59:05.605075+0000","last_fullsized":"2023-12-15T23:59:05.605075+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387908+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:59:15.387908+0000","last_peered":"2023-12-15T23:59:15.387908+0000","last_clean":"2023-12-15T23:59:15.387908+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:59:15.387908+0000","last_undegraded":"2023-12-15T23:59:15.387908+0000","last_fullsized":"2023-12-15T23:59:15.387908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384346+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:59:05.384346+0000","last_peered":"2023-12-15T23:59:05.384346+0000","last_clean":"2023-12-15T23:59:05.384346+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:59:05.384346+0000","last_undegraded":"2023-12-15T23:59:05.384346+0000","last_fullsized":"2023-12-15T23:59:05.384346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.396387+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:59:45.396387+0000","last_peered":"2023-12-15T23:59:45.396387+0000","last_clean":"2023-12-15T23:59:45.396387+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:59:45.396387+0000","last_undegraded":"2023-12-15T23:59:45.396387+0000","last_fullsized":"2023-12-15T23:59:45.396387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":379,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402107+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-16T00:00:10.402107+0000","last_peered":"2023-12-16T00:00:10.402107+0000","last_clean":"2023-12-16T00:00:10.402107+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:00:10.402107+0000","last_undegraded":"2023-12-16T00:00:10.402107+0000","last_fullsized":"2023-12-16T00:00:10.402107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'13","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374278+0000","last_change":"2023-12-15T22:53:26.159079+0000","last_active":"2023-12-15T23:58:25.374278+0000","last_peered":"2023-12-15T23:58:25.374278+0000","last_clean":"2023-12-15T23:58:25.374278+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-15T23:58:25.374278+0000","last_undegraded":"2023-12-15T23:58:25.374278+0000","last_fullsized":"2023-12-15T23:58:25.374278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016319+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-16T00:00:26.016319+0000","last_peered":"2023-12-16T00:00:26.016319+0000","last_clean":"2023-12-16T00:00:26.016319+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:00:26.016319+0000","last_undegraded":"2023-12-16T00:00:26.016319+0000","last_fullsized":"2023-12-16T00:00:26.016319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.365345+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-15T23:58:30.365345+0000","last_peered":"2023-12-15T23:58:30.365345+0000","last_clean":"2023-12-15T23:58:30.365345+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-15T23:58:30.365345+0000","last_undegraded":"2023-12-15T23:58:30.365345+0000","last_fullsized":"2023-12-15T23:58:30.365345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.374866+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-15T23:58:30.374866+0000","last_peered":"2023-12-15T23:58:30.374866+0000","last_clean":"2023-12-15T23:58:30.374866+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-15T23:58:30.374866+0000","last_undegraded":"2023-12-15T23:58:30.374866+0000","last_fullsized":"2023-12-15T23:58:30.374866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378351+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:58:40.378351+0000","last_peered":"2023-12-15T23:58:40.378351+0000","last_clean":"2023-12-15T23:58:40.378351+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:58:40.378351+0000","last_undegraded":"2023-12-15T23:58:40.378351+0000","last_fullsized":"2023-12-15T23:58:40.378351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.379341+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:59:30.379341+0000","last_peered":"2023-12-15T23:59:30.379341+0000","last_clean":"2023-12-15T23:59:30.379341+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:59:30.379341+0000","last_undegraded":"2023-12-15T23:59:30.379341+0000","last_fullsized":"2023-12-15T23:59:30.379341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600593+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:58:50.600593+0000","last_peered":"2023-12-15T23:58:50.600593+0000","last_clean":"2023-12-15T23:58:50.600593+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:58:50.600593+0000","last_undegraded":"2023-12-15T23:58:50.600593+0000","last_fullsized":"2023-12-15T23:58:50.600593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1745,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.389126+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-16T00:00:10.389126+0000","last_peered":"2023-12-16T00:00:10.389126+0000","last_clean":"2023-12-16T00:00:10.389126+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:00:10.389126+0000","last_undegraded":"2023-12-16T00:00:10.389126+0000","last_fullsized":"2023-12-16T00:00:10.389126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'241","reported_seq":383,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395227+0000","last_change":"2023-12-15T22:53:28.167550+0000","last_active":"2023-12-15T23:59:45.395227+0000","last_peered":"2023-12-15T23:59:45.395227+0000","last_clean":"2023-12-15T23:59:45.395227+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-15T23:59:45.395227+0000","last_undegraded":"2023-12-15T23:59:45.395227+0000","last_fullsized":"2023-12-15T23:59:45.395227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'7","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374357+0000","last_change":"2023-12-15T22:53:26.159624+0000","last_active":"2023-12-15T23:58:25.374357+0000","last_peered":"2023-12-15T23:58:25.374357+0000","last_clean":"2023-12-15T23:58:25.374357+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-15T23:58:25.374357+0000","last_undegraded":"2023-12-15T23:58:25.374357+0000","last_fullsized":"2023-12-15T23:58:25.374357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137167+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-16T00:00:28.137167+0000","last_peered":"2023-12-16T00:00:28.137167+0000","last_clean":"2023-12-16T00:00:28.137167+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:00:28.137167+0000","last_undegraded":"2023-12-16T00:00:28.137167+0000","last_fullsized":"2023-12-16T00:00:28.137167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.374833+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-15T23:58:30.374833+0000","last_peered":"2023-12-15T23:58:30.374833+0000","last_clean":"2023-12-15T23:58:30.374833+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-15T23:58:30.374833+0000","last_undegraded":"2023-12-15T23:58:30.374833+0000","last_fullsized":"2023-12-15T23:58:30.374833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375435+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-15T23:58:30.375435+0000","last_peered":"2023-12-15T23:58:30.375435+0000","last_clean":"2023-12-15T23:58:30.375435+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-15T23:58:30.375435+0000","last_undegraded":"2023-12-15T23:58:30.375435+0000","last_fullsized":"2023-12-15T23:58:30.375435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389257+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:59:20.389257+0000","last_peered":"2023-12-15T23:59:20.389257+0000","last_clean":"2023-12-15T23:59:20.389257+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:59:20.389257+0000","last_undegraded":"2023-12-15T23:59:20.389257+0000","last_fullsized":"2023-12-15T23:59:20.389257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387446+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:59:15.387446+0000","last_peered":"2023-12-15T23:59:15.387446+0000","last_clean":"2023-12-15T23:59:15.387446+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:59:15.387446+0000","last_undegraded":"2023-12-15T23:59:15.387446+0000","last_fullsized":"2023-12-15T23:59:15.387446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369538+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:58:46.369538+0000","last_peered":"2023-12-15T23:58:46.369538+0000","last_clean":"2023-12-15T23:58:46.369538+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:58:46.369538+0000","last_undegraded":"2023-12-15T23:58:46.369538+0000","last_fullsized":"2023-12-15T23:58:46.369538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380105+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:58:50.380105+0000","last_peered":"2023-12-15T23:58:50.380105+0000","last_clean":"2023-12-15T23:58:50.380105+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:58:50.380105+0000","last_undegraded":"2023-12-15T23:58:50.380105+0000","last_fullsized":"2023-12-15T23:58:50.380105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2780,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693751+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693751+0000","last_peered":"2023-12-16T00:00:36.693751+0000","last_clean":"2023-12-16T00:00:36.693751+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693751+0000","last_undegraded":"2023-12-16T00:00:36.693751+0000","last_fullsized":"2023-12-16T00:00:36.693751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379507+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-15T23:58:45.379507+0000","last_peered":"2023-12-15T23:58:45.379507+0000","last_clean":"2023-12-15T23:58:45.379507+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-15T23:58:45.379507+0000","last_undegraded":"2023-12-15T23:58:45.379507+0000","last_fullsized":"2023-12-15T23:58:45.379507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393456+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:59:35.393456+0000","last_peered":"2023-12-15T23:59:35.393456+0000","last_clean":"2023-12-15T23:59:35.393456+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:59:35.393456+0000","last_undegraded":"2023-12-15T23:59:35.393456+0000","last_fullsized":"2023-12-15T23:59:35.393456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388768+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:59:20.388768+0000","last_peered":"2023-12-15T23:59:20.388768+0000","last_clean":"2023-12-15T23:59:20.388768+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:59:20.388768+0000","last_undegraded":"2023-12-15T23:59:20.388768+0000","last_fullsized":"2023-12-15T23:59:20.388768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288524+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-16T00:00:27.288524+0000","last_peered":"2023-12-16T00:00:27.288524+0000","last_clean":"2023-12-16T00:00:27.288524+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:00:27.288524+0000","last_undegraded":"2023-12-16T00:00:27.288524+0000","last_fullsized":"2023-12-16T00:00:27.288524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677763+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677763+0000","last_peered":"2023-12-16T00:00:42.677763+0000","last_clean":"2023-12-16T00:00:42.677763+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677763+0000","last_undegraded":"2023-12-16T00:00:42.677763+0000","last_fullsized":"2023-12-16T00:00:42.677763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.391372+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:59:25.391372+0000","last_peered":"2023-12-15T23:59:25.391372+0000","last_clean":"2023-12-15T23:59:25.391372+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:59:25.391372+0000","last_undegraded":"2023-12-15T23:59:25.391372+0000","last_fullsized":"2023-12-15T23:59:25.391372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383526+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:59:41.383526+0000","last_peered":"2023-12-15T23:59:41.383526+0000","last_clean":"2023-12-15T23:59:41.383526+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:59:41.383526+0000","last_undegraded":"2023-12-15T23:59:41.383526+0000","last_fullsized":"2023-12-15T23:59:41.383526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388655+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:59:15.388655+0000","last_peered":"2023-12-15T23:59:15.388655+0000","last_clean":"2023-12-15T23:59:15.388655+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:59:15.388655+0000","last_undegraded":"2023-12-15T23:59:15.388655+0000","last_fullsized":"2023-12-15T23:59:15.388655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381278+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:58:50.381278+0000","last_peered":"2023-12-15T23:58:50.381278+0000","last_clean":"2023-12-15T23:58:50.381278+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:58:50.381278+0000","last_undegraded":"2023-12-15T23:58:50.381278+0000","last_fullsized":"2023-12-15T23:58:50.381278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.370031+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:58:50.370031+0000","last_peered":"2023-12-15T23:58:50.370031+0000","last_clean":"2023-12-15T23:58:50.370031+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:58:50.370031+0000","last_undegraded":"2023-12-15T23:58:50.370031+0000","last_fullsized":"2023-12-15T23:58:50.370031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2979,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499811+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499811+0000","last_peered":"2023-12-16T00:00:45.499811+0000","last_clean":"2023-12-16T00:00:45.499811+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499811+0000","last_undegraded":"2023-12-16T00:00:45.499811+0000","last_fullsized":"2023-12-16T00:00:45.499811+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'5","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379861+0000","last_change":"2023-12-15T22:53:26.156319+0000","last_active":"2023-12-15T23:58:45.379861+0000","last_peered":"2023-12-15T23:58:45.379861+0000","last_clean":"2023-12-15T23:58:45.379861+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-15T23:58:45.379861+0000","last_undegraded":"2023-12-15T23:58:45.379861+0000","last_fullsized":"2023-12-15T23:58:45.379861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386068+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:59:10.386068+0000","last_peered":"2023-12-15T23:59:10.386068+0000","last_clean":"2023-12-15T23:59:10.386068+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:59:10.386068+0000","last_undegraded":"2023-12-15T23:59:10.386068+0000","last_fullsized":"2023-12-15T23:59:10.386068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":553,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395934+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:59:45.395934+0000","last_peered":"2023-12-15T23:59:45.395934+0000","last_clean":"2023-12-15T23:59:45.395934+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:59:45.395934+0000","last_undegraded":"2023-12-15T23:59:45.395934+0000","last_fullsized":"2023-12-15T23:59:45.395934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440205+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-16T00:00:26.440205+0000","last_peered":"2023-12-16T00:00:26.440205+0000","last_clean":"2023-12-16T00:00:26.440205+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:00:26.440205+0000","last_undegraded":"2023-12-16T00:00:26.440205+0000","last_fullsized":"2023-12-16T00:00:26.440205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375407+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-15T23:58:30.375407+0000","last_peered":"2023-12-15T23:58:30.375407+0000","last_clean":"2023-12-15T23:58:30.375407+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-15T23:58:30.375407+0000","last_undegraded":"2023-12-15T23:58:30.375407+0000","last_fullsized":"2023-12-15T23:58:30.375407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390239+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:59:25.390239+0000","last_peered":"2023-12-15T23:59:25.390239+0000","last_clean":"2023-12-15T23:59:25.390239+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:59:25.390239+0000","last_undegraded":"2023-12-15T23:59:25.390239+0000","last_fullsized":"2023-12-15T23:59:25.390239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1325,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609089+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:59:20.609089+0000","last_peered":"2023-12-15T23:59:20.609089+0000","last_clean":"2023-12-15T23:59:20.609089+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:59:20.609089+0000","last_undegraded":"2023-12-15T23:59:20.609089+0000","last_fullsized":"2023-12-15T23:59:20.609089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392528+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:59:35.392528+0000","last_peered":"2023-12-15T23:59:35.392528+0000","last_clean":"2023-12-15T23:59:35.392528+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:59:35.392528+0000","last_undegraded":"2023-12-15T23:59:35.392528+0000","last_fullsized":"2023-12-15T23:59:35.392528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381199+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:58:50.381199+0000","last_peered":"2023-12-15T23:58:50.381199+0000","last_clean":"2023-12-15T23:58:50.381199+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:58:50.381199+0000","last_undegraded":"2023-12-15T23:58:50.381199+0000","last_fullsized":"2023-12-15T23:58:50.381199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381226+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:58:50.381226+0000","last_peered":"2023-12-15T23:58:50.381226+0000","last_clean":"2023-12-15T23:58:50.381226+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:58:50.381226+0000","last_undegraded":"2023-12-15T23:58:50.381226+0000","last_fullsized":"2023-12-15T23:58:50.381226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600868+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:58:50.600868+0000","last_peered":"2023-12-15T23:58:50.600868+0000","last_clean":"2023-12-15T23:58:50.600868+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:58:50.600868+0000","last_undegraded":"2023-12-15T23:58:50.600868+0000","last_fullsized":"2023-12-15T23:58:50.600868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.368941+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-15T23:58:46.368941+0000","last_peered":"2023-12-15T23:58:46.368941+0000","last_clean":"2023-12-15T23:58:46.368941+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-15T23:58:46.368941+0000","last_undegraded":"2023-12-15T23:58:46.368941+0000","last_fullsized":"2023-12-15T23:58:46.368941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384529+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:59:50.384529+0000","last_peered":"2023-12-15T23:59:50.384529+0000","last_clean":"2023-12-15T23:59:50.384529+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:59:50.384529+0000","last_undegraded":"2023-12-15T23:59:50.384529+0000","last_fullsized":"2023-12-15T23:59:50.384529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609047+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:59:20.609047+0000","last_peered":"2023-12-15T23:59:20.609047+0000","last_clean":"2023-12-15T23:59:20.609047+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:59:20.609047+0000","last_undegraded":"2023-12-15T23:59:20.609047+0000","last_fullsized":"2023-12-15T23:59:20.609047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375262+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-15T23:58:30.375262+0000","last_peered":"2023-12-15T23:58:30.375262+0000","last_clean":"2023-12-15T23:58:30.375262+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-15T23:58:30.375262+0000","last_undegraded":"2023-12-15T23:58:30.375262+0000","last_fullsized":"2023-12-15T23:58:30.375262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.380079+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:59:26.380079+0000","last_peered":"2023-12-15T23:59:26.380079+0000","last_clean":"2023-12-15T23:59:26.380079+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:59:26.380079+0000","last_undegraded":"2023-12-15T23:59:26.380079+0000","last_fullsized":"2023-12-15T23:59:26.380079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3845,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609000+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:59:20.609000+0000","last_peered":"2023-12-15T23:59:20.609000+0000","last_clean":"2023-12-15T23:59:20.609000+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:59:20.609000+0000","last_undegraded":"2023-12-15T23:59:20.609000+0000","last_fullsized":"2023-12-15T23:59:20.609000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:16.377353+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:59:16.377353+0000","last_peered":"2023-12-15T23:59:16.377353+0000","last_clean":"2023-12-15T23:59:16.377353+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:59:16.377353+0000","last_undegraded":"2023-12-15T23:59:16.377353+0000","last_fullsized":"2023-12-15T23:59:16.377353+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386931+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:59:10.386931+0000","last_peered":"2023-12-15T23:59:10.386931+0000","last_clean":"2023-12-15T23:59:10.386931+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:59:10.386931+0000","last_undegraded":"2023-12-15T23:59:10.386931+0000","last_fullsized":"2023-12-15T23:59:10.386931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381047+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:58:50.381047+0000","last_peered":"2023-12-15T23:58:50.381047+0000","last_clean":"2023-12-15T23:58:50.381047+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:58:50.381047+0000","last_undegraded":"2023-12-15T23:58:50.381047+0000","last_fullsized":"2023-12-15T23:58:50.381047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9956","reported_seq":16963,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380926+0000","last_change":"2023-12-15T22:53:28.170727+0000","last_active":"2023-12-15T23:58:50.380926+0000","last_peered":"2023-12-15T23:58:50.380926+0000","last_clean":"2023-12-15T23:58:50.380926+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-15T23:58:50.380926+0000","last_undegraded":"2023-12-15T23:58:50.380926+0000","last_fullsized":"2023-12-15T23:58:50.380926+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":3000,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992853+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992853+0000","last_peered":"2023-12-16T00:00:42.992853+0000","last_clean":"2023-12-16T00:00:42.992853+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992853+0000","last_undegraded":"2023-12-16T00:00:42.992853+0000","last_fullsized":"2023-12-16T00:00:42.992853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390648+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:59:25.390648+0000","last_peered":"2023-12-15T23:59:25.390648+0000","last_clean":"2023-12-15T23:59:25.390648+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:59:25.390648+0000","last_undegraded":"2023-12-15T23:59:25.390648+0000","last_fullsized":"2023-12-15T23:59:25.390648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397998+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:59:50.397998+0000","last_peered":"2023-12-15T23:59:50.397998+0000","last_clean":"2023-12-15T23:59:50.397998+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:59:50.397998+0000","last_undegraded":"2023-12-15T23:59:50.397998+0000","last_fullsized":"2023-12-15T23:59:50.397998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.375091+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-15T23:58:30.375091+0000","last_peered":"2023-12-15T23:58:30.375091+0000","last_clean":"2023-12-15T23:58:30.375091+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-15T23:58:30.375091+0000","last_undegraded":"2023-12-15T23:58:30.375091+0000","last_fullsized":"2023-12-15T23:58:30.375091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:01.388134+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:01.388134+0000","last_peered":"2023-12-16T00:00:01.388134+0000","last_clean":"2023-12-16T00:00:01.388134+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:01.388134+0000","last_undegraded":"2023-12-16T00:00:01.388134+0000","last_fullsized":"2023-12-16T00:00:01.388134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5870,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.379443+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:59:26.379443+0000","last_peered":"2023-12-15T23:59:26.379443+0000","last_clean":"2023-12-15T23:59:26.379443+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:59:26.379443+0000","last_undegraded":"2023-12-15T23:59:26.379443+0000","last_fullsized":"2023-12-15T23:59:26.379443+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388322+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:59:20.388322+0000","last_peered":"2023-12-15T23:59:20.388322+0000","last_clean":"2023-12-15T23:59:20.388322+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:59:20.388322+0000","last_undegraded":"2023-12-15T23:59:20.388322+0000","last_fullsized":"2023-12-15T23:59:20.388322+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.602125+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:58:55.602125+0000","last_peered":"2023-12-15T23:58:55.602125+0000","last_clean":"2023-12-15T23:58:55.602125+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:58:55.602125+0000","last_undegraded":"2023-12-15T23:58:55.602125+0000","last_fullsized":"2023-12-15T23:58:55.602125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385322+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:59:05.385322+0000","last_peered":"2023-12-15T23:59:05.385322+0000","last_clean":"2023-12-15T23:59:05.385322+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:59:05.385322+0000","last_undegraded":"2023-12-15T23:59:05.385322+0000","last_fullsized":"2023-12-15T23:59:05.385322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'237","reported_seq":414,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379303+0000","last_change":"2023-12-15T22:53:28.168042+0000","last_active":"2023-12-15T23:58:45.379303+0000","last_peered":"2023-12-15T23:58:45.379303+0000","last_clean":"2023-12-15T23:58:45.379303+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-15T23:58:45.379303+0000","last_undegraded":"2023-12-15T23:58:45.379303+0000","last_fullsized":"2023-12-15T23:58:45.379303+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'23","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:41.368136+0000","last_change":"2023-12-15T22:53:26.162529+0000","last_active":"2023-12-15T23:58:41.368136+0000","last_peered":"2023-12-15T23:58:41.368136+0000","last_clean":"2023-12-15T23:58:41.368136+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-15T23:58:41.368136+0000","last_undegraded":"2023-12-15T23:58:41.368136+0000","last_fullsized":"2023-12-15T23:58:41.368136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377753+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-15T23:58:40.377753+0000","last_peered":"2023-12-15T23:58:40.377753+0000","last_clean":"2023-12-15T23:58:40.377753+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-15T23:58:40.377753+0000","last_undegraded":"2023-12-15T23:58:40.377753+0000","last_fullsized":"2023-12-15T23:58:40.377753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373908+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-15T23:58:25.373908+0000","last_peered":"2023-12-15T23:58:25.373908+0000","last_clean":"2023-12-15T23:58:25.373908+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-15T23:58:25.373908+0000","last_undegraded":"2023-12-15T23:58:25.373908+0000","last_fullsized":"2023-12-15T23:58:25.373908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374472+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-15T23:58:25.374472+0000","last_peered":"2023-12-15T23:58:25.374472+0000","last_clean":"2023-12-15T23:58:25.374472+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-15T23:58:25.374472+0000","last_undegraded":"2023-12-15T23:58:25.374472+0000","last_fullsized":"2023-12-15T23:58:25.374472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.386435+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:00.386435+0000","last_peered":"2023-12-16T00:00:00.386435+0000","last_clean":"2023-12-16T00:00:00.386435+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:00.386435+0000","last_undegraded":"2023-12-16T00:00:00.386435+0000","last_fullsized":"2023-12-16T00:00:00.386435+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4019,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.609770+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:59:25.609770+0000","last_peered":"2023-12-15T23:59:25.609770+0000","last_clean":"2023-12-15T23:59:25.609770+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:59:25.609770+0000","last_undegraded":"2023-12-15T23:59:25.609770+0000","last_fullsized":"2023-12-15T23:59:25.609770+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389659+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:59:20.389659+0000","last_peered":"2023-12-15T23:59:20.389659+0000","last_clean":"2023-12-15T23:59:20.389659+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:59:20.389659+0000","last_undegraded":"2023-12-15T23:59:20.389659+0000","last_fullsized":"2023-12-15T23:59:20.389659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.381825+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:58:55.381825+0000","last_peered":"2023-12-15T23:58:55.381825+0000","last_clean":"2023-12-15T23:58:55.381825+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:58:55.381825+0000","last_undegraded":"2023-12-15T23:58:55.381825+0000","last_fullsized":"2023-12-15T23:58:55.381825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1436,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.369094+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:58:45.369094+0000","last_peered":"2023-12-15T23:58:45.369094+0000","last_clean":"2023-12-15T23:58:45.369094+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:58:45.369094+0000","last_undegraded":"2023-12-15T23:58:45.369094+0000","last_fullsized":"2023-12-15T23:58:45.369094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":341,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.603693+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:59:00.603693+0000","last_peered":"2023-12-15T23:59:00.603693+0000","last_clean":"2023-12-15T23:59:00.603693+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:59:00.603693+0000","last_undegraded":"2023-12-15T23:59:00.603693+0000","last_fullsized":"2023-12-15T23:59:00.603693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373858+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-15T23:58:25.373858+0000","last_peered":"2023-12-15T23:58:25.373858+0000","last_clean":"2023-12-15T23:58:25.373858+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-15T23:58:25.373858+0000","last_undegraded":"2023-12-15T23:58:25.373858+0000","last_fullsized":"2023-12-15T23:58:25.373858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378105+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-15T23:58:40.378105+0000","last_peered":"2023-12-15T23:58:40.378105+0000","last_clean":"2023-12-15T23:58:40.378105+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-15T23:58:40.378105+0000","last_undegraded":"2023-12-15T23:58:40.378105+0000","last_fullsized":"2023-12-15T23:58:40.378105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.594982+0000","last_change":"2023-12-15T22:53:11.079680+0000","last_active":"2023-12-15T23:58:25.594982+0000","last_peered":"2023-12-15T23:58:25.594982+0000","last_clean":"2023-12-15T23:58:25.594982+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-15T23:58:25.594982+0000","last_undegraded":"2023-12-15T23:58:25.594982+0000","last_fullsized":"2023-12-15T23:58:25.594982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399036+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:00.399036+0000","last_peered":"2023-12-16T00:00:00.399036+0000","last_clean":"2023-12-16T00:00:00.399036+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:00.399036+0000","last_undegraded":"2023-12-16T00:00:00.399036+0000","last_fullsized":"2023-12-16T00:00:00.399036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3629,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378366+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:59:25.378366+0000","last_peered":"2023-12-15T23:59:25.378366+0000","last_clean":"2023-12-15T23:59:25.378366+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:59:25.378366+0000","last_undegraded":"2023-12-15T23:59:25.378366+0000","last_fullsized":"2023-12-15T23:59:25.378366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608453+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:59:20.608453+0000","last_peered":"2023-12-15T23:59:20.608453+0000","last_clean":"2023-12-15T23:59:20.608453+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:59:20.608453+0000","last_undegraded":"2023-12-15T23:59:20.608453+0000","last_fullsized":"2023-12-15T23:59:20.608453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.382431+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:58:55.382431+0000","last_peered":"2023-12-15T23:58:55.382431+0000","last_clean":"2023-12-15T23:58:55.382431+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:58:55.382431+0000","last_undegraded":"2023-12-15T23:58:55.382431+0000","last_fullsized":"2023-12-15T23:58:55.382431+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379928+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:58:45.379928+0000","last_peered":"2023-12-15T23:58:45.379928+0000","last_clean":"2023-12-15T23:58:45.379928+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:58:45.379928+0000","last_undegraded":"2023-12-15T23:58:45.379928+0000","last_fullsized":"2023-12-15T23:58:45.379928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":248,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.380349+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:58:45.380349+0000","last_peered":"2023-12-15T23:58:45.380349+0000","last_clean":"2023-12-15T23:58:45.380349+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:58:45.380349+0000","last_undegraded":"2023-12-15T23:58:45.380349+0000","last_fullsized":"2023-12-15T23:58:45.380349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'15","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.602264+0000","last_change":"2023-12-15T22:53:26.157853+0000","last_active":"2023-12-15T23:58:55.602264+0000","last_peered":"2023-12-15T23:58:55.602264+0000","last_clean":"2023-12-15T23:58:55.602264+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-15T23:58:55.602264+0000","last_undegraded":"2023-12-15T23:58:55.602264+0000","last_fullsized":"2023-12-15T23:58:55.602264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.373974+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-15T23:58:25.373974+0000","last_peered":"2023-12-15T23:58:25.373974+0000","last_clean":"2023-12-15T23:58:25.373974+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-15T23:58:25.373974+0000","last_undegraded":"2023-12-15T23:58:25.373974+0000","last_fullsized":"2023-12-15T23:58:25.373974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.375076+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:59:10.375076+0000","last_peered":"2023-12-15T23:59:10.375076+0000","last_clean":"2023-12-15T23:59:10.375076+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:59:10.375076+0000","last_undegraded":"2023-12-15T23:59:10.375076+0000","last_fullsized":"2023-12-15T23:59:10.375076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374226+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-15T23:58:25.374226+0000","last_peered":"2023-12-15T23:58:25.374226+0000","last_clean":"2023-12-15T23:58:25.374226+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-15T23:58:25.374226+0000","last_undegraded":"2023-12-15T23:58:25.374226+0000","last_fullsized":"2023-12-15T23:58:25.374226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.618769+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:00.618769+0000","last_peered":"2023-12-16T00:00:00.618769+0000","last_clean":"2023-12-16T00:00:00.618769+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:00.618769+0000","last_undegraded":"2023-12-16T00:00:00.618769+0000","last_fullsized":"2023-12-16T00:00:00.618769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1275,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378284+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:59:25.378284+0000","last_peered":"2023-12-15T23:59:25.378284+0000","last_clean":"2023-12-15T23:59:25.378284+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:59:25.378284+0000","last_undegraded":"2023-12-15T23:59:25.378284+0000","last_fullsized":"2023-12-15T23:59:25.378284+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608574+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:59:20.608574+0000","last_peered":"2023-12-15T23:59:20.608574+0000","last_clean":"2023-12-15T23:59:20.608574+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:59:20.608574+0000","last_undegraded":"2023-12-15T23:59:20.608574+0000","last_fullsized":"2023-12-15T23:59:20.608574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":386,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.381640+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:58:55.381640+0000","last_peered":"2023-12-15T23:58:55.381640+0000","last_clean":"2023-12-15T23:58:55.381640+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:58:55.381640+0000","last_undegraded":"2023-12-15T23:58:55.381640+0000","last_fullsized":"2023-12-15T23:58:55.381640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379999+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:58:45.379999+0000","last_peered":"2023-12-15T23:58:45.379999+0000","last_clean":"2023-12-15T23:58:45.379999+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:58:45.379999+0000","last_undegraded":"2023-12-15T23:58:45.379999+0000","last_fullsized":"2023-12-15T23:58:45.379999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049253+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049253+0000","last_peered":"2023-12-16T00:00:42.049253+0000","last_clean":"2023-12-16T00:00:42.049253+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049253+0000","last_undegraded":"2023-12-16T00:00:42.049253+0000","last_fullsized":"2023-12-16T00:00:42.049253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'9","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:41.367994+0000","last_change":"2023-12-15T22:53:26.160787+0000","last_active":"2023-12-15T23:58:41.367994+0000","last_peered":"2023-12-15T23:58:41.367994+0000","last_clean":"2023-12-15T23:58:41.367994+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-15T23:58:41.367994+0000","last_undegraded":"2023-12-15T23:58:41.367994+0000","last_fullsized":"2023-12-15T23:58:41.367994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392748+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:59:35.392748+0000","last_peered":"2023-12-15T23:59:35.392748+0000","last_clean":"2023-12-15T23:59:35.392748+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:59:35.392748+0000","last_undegraded":"2023-12-15T23:59:35.392748+0000","last_fullsized":"2023-12-15T23:59:35.392748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:30.595860+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-15T23:58:30.595860+0000","last_peered":"2023-12-15T23:58:30.595860+0000","last_clean":"2023-12-15T23:58:30.595860+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-15T23:58:30.595860+0000","last_undegraded":"2023-12-15T23:58:30.595860+0000","last_fullsized":"2023-12-15T23:58:30.595860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369239+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-15T23:58:46.369239+0000","last_peered":"2023-12-15T23:58:46.369239+0000","last_clean":"2023-12-15T23:58:46.369239+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-15T23:58:46.369239+0000","last_undegraded":"2023-12-15T23:58:46.369239+0000","last_fullsized":"2023-12-15T23:58:46.369239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.367791+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-15T23:58:40.367791+0000","last_peered":"2023-12-15T23:58:40.367791+0000","last_clean":"2023-12-15T23:58:40.367791+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-15T23:58:40.367791+0000","last_undegraded":"2023-12-15T23:58:40.367791+0000","last_fullsized":"2023-12-15T23:58:40.367791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620720+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:05.620720+0000","last_peered":"2023-12-16T00:00:05.620720+0000","last_clean":"2023-12-16T00:00:05.620720+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:05.620720+0000","last_undegraded":"2023-12-16T00:00:05.620720+0000","last_fullsized":"2023-12-16T00:00:05.620720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382010+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:59:36.382010+0000","last_peered":"2023-12-15T23:59:36.382010+0000","last_clean":"2023-12-15T23:59:36.382010+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:59:36.382010+0000","last_undegraded":"2023-12-15T23:59:36.382010+0000","last_fullsized":"2023-12-15T23:59:36.382010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377990+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-15T23:58:40.377990+0000","last_peered":"2023-12-15T23:58:40.377990+0000","last_clean":"2023-12-15T23:58:40.377990+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-15T23:58:40.377990+0000","last_undegraded":"2023-12-15T23:58:40.377990+0000","last_fullsized":"2023-12-15T23:58:40.377990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620638+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:05.620638+0000","last_peered":"2023-12-16T00:00:05.620638+0000","last_clean":"2023-12-16T00:00:05.620638+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:05.620638+0000","last_undegraded":"2023-12-16T00:00:05.620638+0000","last_fullsized":"2023-12-16T00:00:05.620638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380482+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:59:35.380482+0000","last_peered":"2023-12-15T23:59:35.380482+0000","last_clean":"2023-12-15T23:59:35.380482+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:59:35.380482+0000","last_undegraded":"2023-12-15T23:59:35.380482+0000","last_fullsized":"2023-12-15T23:59:35.380482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377636+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-15T23:58:40.377636+0000","last_peered":"2023-12-15T23:58:40.377636+0000","last_clean":"2023-12-15T23:58:40.377636+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-15T23:58:40.377636+0000","last_undegraded":"2023-12-15T23:58:40.377636+0000","last_fullsized":"2023-12-15T23:58:40.377636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401415+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:05.401415+0000","last_peered":"2023-12-16T00:00:05.401415+0000","last_clean":"2023-12-16T00:00:05.401415+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:05.401415+0000","last_undegraded":"2023-12-16T00:00:05.401415+0000","last_fullsized":"2023-12-16T00:00:05.401415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615003+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:59:45.615003+0000","last_peered":"2023-12-15T23:59:45.615003+0000","last_clean":"2023-12-15T23:59:45.615003+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:59:45.615003+0000","last_undegraded":"2023-12-15T23:59:45.615003+0000","last_fullsized":"2023-12-15T23:59:45.615003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378012+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-15T23:58:40.378012+0000","last_peered":"2023-12-15T23:58:40.378012+0000","last_clean":"2023-12-15T23:58:40.378012+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-15T23:58:40.378012+0000","last_undegraded":"2023-12-15T23:58:40.378012+0000","last_fullsized":"2023-12-15T23:58:40.378012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620423+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:05.620423+0000","last_peered":"2023-12-16T00:00:05.620423+0000","last_clean":"2023-12-16T00:00:05.620423+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:05.620423+0000","last_undegraded":"2023-12-16T00:00:05.620423+0000","last_fullsized":"2023-12-16T00:00:05.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396136+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:59:50.396136+0000","last_peered":"2023-12-15T23:59:50.396136+0000","last_clean":"2023-12-15T23:59:50.396136+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:59:50.396136+0000","last_undegraded":"2023-12-15T23:59:50.396136+0000","last_fullsized":"2023-12-15T23:59:50.396136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.741962+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.741962+0000","last_peered":"2023-12-16T00:00:38.741962+0000","last_clean":"2023-12-16T00:00:38.741962+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.741962+0000","last_undegraded":"2023-12-16T00:00:38.741962+0000","last_fullsized":"2023-12-16T00:00:38.741962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384350+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:59:50.384350+0000","last_peered":"2023-12-15T23:59:50.384350+0000","last_clean":"2023-12-15T23:59:50.384350+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:59:50.384350+0000","last_undegraded":"2023-12-15T23:59:50.384350+0000","last_fullsized":"2023-12-15T23:59:50.384350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400762+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:05.400762+0000","last_peered":"2023-12-16T00:00:05.400762+0000","last_clean":"2023-12-16T00:00:05.400762+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:05.400762+0000","last_undegraded":"2023-12-16T00:00:05.400762+0000","last_fullsized":"2023-12-16T00:00:05.400762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382239+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:59:36.382239+0000","last_peered":"2023-12-15T23:59:36.382239+0000","last_clean":"2023-12-15T23:59:36.382239+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:59:36.382239+0000","last_undegraded":"2023-12-15T23:59:36.382239+0000","last_fullsized":"2023-12-15T23:59:36.382239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620507+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:05.620507+0000","last_peered":"2023-12-16T00:00:05.620507+0000","last_clean":"2023-12-16T00:00:05.620507+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:05.620507+0000","last_undegraded":"2023-12-16T00:00:05.620507+0000","last_fullsized":"2023-12-16T00:00:05.620507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937524+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937524+0000","last_peered":"2023-12-16T00:00:28.937524+0000","last_clean":"2023-12-16T00:00:28.937524+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937524+0000","last_undegraded":"2023-12-16T00:00:28.937524+0000","last_fullsized":"2023-12-16T00:00:28.937524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612481+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:59:35.612481+0000","last_peered":"2023-12-15T23:59:35.612481+0000","last_clean":"2023-12-15T23:59:35.612481+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:59:35.612481+0000","last_undegraded":"2023-12-15T23:59:35.612481+0000","last_fullsized":"2023-12-15T23:59:35.612481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400859+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:05.400859+0000","last_peered":"2023-12-16T00:00:05.400859+0000","last_clean":"2023-12-16T00:00:05.400859+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:05.400859+0000","last_undegraded":"2023-12-16T00:00:05.400859+0000","last_fullsized":"2023-12-16T00:00:05.400859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.371667+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:58:55.371667+0000","last_peered":"2023-12-15T23:58:55.371667+0000","last_clean":"2023-12-15T23:58:55.371667+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:58:55.371667+0000","last_undegraded":"2023-12-15T23:58:55.371667+0000","last_fullsized":"2023-12-15T23:58:55.371667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392865+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:59:35.392865+0000","last_peered":"2023-12-15T23:59:35.392865+0000","last_clean":"2023-12-15T23:59:35.392865+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:59:35.392865+0000","last_undegraded":"2023-12-15T23:59:35.392865+0000","last_fullsized":"2023-12-15T23:59:35.392865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387959+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:05.387959+0000","last_peered":"2023-12-16T00:00:05.387959+0000","last_clean":"2023-12-16T00:00:05.387959+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:05.387959+0000","last_undegraded":"2023-12-16T00:00:05.387959+0000","last_fullsized":"2023-12-16T00:00:05.387959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400522+0000","last_change":"2023-12-15T22:53:26.155477+0000","last_active":"2023-12-16T00:00:05.400522+0000","last_peered":"2023-12-16T00:00:05.400522+0000","last_clean":"2023-12-16T00:00:05.400522+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:05.400522+0000","last_undegraded":"2023-12-16T00:00:05.400522+0000","last_fullsized":"2023-12-16T00:00:05.400522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391410+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-16T00:00:20.391410+0000","last_peered":"2023-12-16T00:00:20.391410+0000","last_clean":"2023-12-16T00:00:20.391410+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:00:20.391410+0000","last_undegraded":"2023-12-16T00:00:20.391410+0000","last_fullsized":"2023-12-16T00:00:20.391410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271600+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271600+0000","last_peered":"2023-12-16T00:00:41.271600+0000","last_clean":"2023-12-16T00:00:41.271600+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271600+0000","last_undegraded":"2023-12-16T00:00:41.271600+0000","last_fullsized":"2023-12-16T00:00:41.271600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'19","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387612+0000","last_change":"2023-12-15T22:53:26.165805+0000","last_active":"2023-12-16T00:00:05.387612+0000","last_peered":"2023-12-16T00:00:05.387612+0000","last_clean":"2023-12-16T00:00:05.387612+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:05.387612+0000","last_undegraded":"2023-12-16T00:00:05.387612+0000","last_fullsized":"2023-12-16T00:00:05.387612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'4","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864859+0000","last_change":"2023-12-15T22:53:26.162667+0000","last_active":"2023-12-16T00:00:26.864859+0000","last_peered":"2023-12-16T00:00:26.864859+0000","last_clean":"2023-12-16T00:00:26.864859+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:26.864859+0000","last_undegraded":"2023-12-16T00:00:26.864859+0000","last_fullsized":"2023-12-16T00:00:26.864859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864858+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-16T00:00:26.864858+0000","last_peered":"2023-12-16T00:00:26.864858+0000","last_clean":"2023-12-16T00:00:26.864858+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:00:26.864858+0000","last_undegraded":"2023-12-16T00:00:26.864858+0000","last_fullsized":"2023-12-16T00:00:26.864858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'22","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016459+0000","last_change":"2023-12-15T22:53:26.161460+0000","last_active":"2023-12-16T00:00:26.016459+0000","last_peered":"2023-12-16T00:00:26.016459+0000","last_clean":"2023-12-16T00:00:26.016459+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:00:26.016459+0000","last_undegraded":"2023-12-16T00:00:26.016459+0000","last_fullsized":"2023-12-16T00:00:26.016459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374044+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-15T23:58:25.374044+0000","last_peered":"2023-12-15T23:58:25.374044+0000","last_clean":"2023-12-15T23:58:25.374044+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-15T23:58:25.374044+0000","last_undegraded":"2023-12-15T23:58:25.374044+0000","last_fullsized":"2023-12-15T23:58:25.374044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.374506+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-15T23:58:25.374506+0000","last_peered":"2023-12-15T23:58:25.374506+0000","last_clean":"2023-12-15T23:58:25.374506+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-15T23:58:25.374506+0000","last_undegraded":"2023-12-15T23:58:25.374506+0000","last_fullsized":"2023-12-15T23:58:25.374506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:25.364016+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-15T23:58:25.364016+0000","last_peered":"2023-12-15T23:58:25.364016+0000","last_clean":"2023-12-15T23:58:25.364016+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-15T23:58:25.364016+0000","last_undegraded":"2023-12-15T23:58:25.364016+0000","last_fullsized":"2023-12-15T23:58:25.364016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":674,"ondisk_log_size":674,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":380209,"num_omap_keys":1665,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23059,"ondisk_log_size":23059,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608381,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.44800000000000001,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005}]},{"osd":1,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":1.004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.309,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.375,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":1.149},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.63},"last":0.437}]}]},{"osd":5,"up_from":11,"seq":47244641083,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.503,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.374,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69199999999999995,"5min":0.879,"15min":0.879},"last":0.498}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.371},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.754,"15min":0.754},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.63},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.436},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.61099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45000000000000001}]}]},{"osd":3,"up_from":11,"seq":47244641085,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Dec 15 23:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.27800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.502,"15min":0.80100000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45200000000000001,"5min":0.57399999999999995,"15min":0.78700000000000003},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.52500000000000002}]}]},{"osd":2,"up_from":11,"seq":47244641082,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":0.41899999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.311,"5min":0.33800000000000002,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.40300000000000002,"5min":0.87,"15min":0.87},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.33900000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.39500000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.45000000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.71899999999999997,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.29399999999999998},"max":{"1min":0.73599999999999999,"5min":1.169,"15min":1.169},"last":0.435}]},{"osd":5,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47899999999999998}]}]},{"osd":1,"up_from":11,"seq":47244641083,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.247,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":0.434,"5min":0.436,"15min":0.53100000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.26300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44900000000000001,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29999999999999999},"max":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.75700000000000001},"last":0.496}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.76700000000000002,"15min":0.878},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51000000000000001}]}]},{"osd":0,"up_from":11,"seq":47244641083,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.434,"5min":0.46400000000000002,"15min":0.51200000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23499999999999999,"15min":0.20799999999999999},"max":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.27100000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34000000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.45200000000000001,"5min":0.5,"15min":0.5},"last":0.376},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68999999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.33700000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.875},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:00:48.997 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.997 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.997 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.997 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.997 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.998 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.998 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.998 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.998 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.998 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.999 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.999 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.999 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.999 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:48.999 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.000 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.000 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.000 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.000 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.000 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.001 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.001 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.001 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.001 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.001 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.002 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.003 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.003 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.003 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.003 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.003 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.004 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.005 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.005 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.005 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.005 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.005 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.006 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.006 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.006 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.006 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.006 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.007 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.007 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.007 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.007 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.007 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.008 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.008 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.008 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.008 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.008 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.009 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.009 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.009 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.009 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.009 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.010 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.010 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.010 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.010 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.010 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.011 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.011 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.011 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.011 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.011 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.012 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.013 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.013 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.013 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.013 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.013 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.014 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.015 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.015 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.015 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.015 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.015 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.016 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.017 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.017 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.017 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.017 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.017 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.018 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.018 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.018 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.018 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.018 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.019 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.020 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.020 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.020 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.020 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.020 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.021 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.021 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.021 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.021 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.021 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.022 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.023 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.023 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.023 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.023 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.023 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.024 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.025 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.025 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.025 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.025 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.025 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.026 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.026 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.026 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.026 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.026 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.027 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.027 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.027 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.027 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.027 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.028 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.028 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.028 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.028 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.028 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.029 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.030 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.030 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.030 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.030 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.030 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.031 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.031 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.031 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.031 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.031 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.032 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.032 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.032 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.032 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.032 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.033 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.034 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.034 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.034 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.034 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.034 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.035 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.036 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.036 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.036 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.036 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.036 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.037 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.038 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.038 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.038 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.038 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.038 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.039 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.039 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.039 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.039 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.040 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.040 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.040 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.040 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.040 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.041 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.042 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.042 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.042 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.042 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.042 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.043 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.044 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.044 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.044 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.044 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.044 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.045 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.045 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.045 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.045 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.045 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.046 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.047 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.047 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.047 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.047 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.047 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.048 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.049 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.049 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.049 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.049 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.050 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.051 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.051 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.051 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.051 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.051 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.052 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.053 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.053 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.053 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.053 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.053 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.054 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.054 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.054 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.054 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.054 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.055 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.056 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.056 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.056 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.056 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.056 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.057 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.058 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.058 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.058 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.058 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.058 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.059 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.059 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.059 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.059 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.059 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.060 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.060 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.060 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.060 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.060 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.061 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.061 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.061 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.061 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.062 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.063 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.063 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.063 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.063 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.063 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.064 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.064 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.064 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.064 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.064 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.065 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.065 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.065 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.065 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.065 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.066 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.067 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.067 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.067 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.067 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.067 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.068 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.068 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.068 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.068 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.068 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.069 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.069 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.069 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.069 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.069 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.070 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.071 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.071 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.071 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.071 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.071 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.072 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.072 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.072 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.072 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.072 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.073 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.073 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.073 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.073 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.073 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.074 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.074 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.074 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.074 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.074 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.075 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.075 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.075 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.075 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.075 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.076 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.077 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.077 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.077 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.077 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.077 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.078 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.078 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.078 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.078 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.078 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.079 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.080 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.080 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.080 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.080 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.080 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.081 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.081 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.081 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.081 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.081 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.082 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.083 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.083 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.083 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.083 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.083 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.084 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.084 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.084 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.084 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.084 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.085 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.085 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.085 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.085 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.085 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.086 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.087 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.087 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.087 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.087 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.087 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.088 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.088 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.088 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.088 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:00:49.088 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:01:09.090 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:01:09.422 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:01:09.441 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:01:09.444 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2120,"stamp":"2023-12-16T00:01:08.193200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":608043,"num_omap_keys":2730,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34898,"ondisk_log_size":34898,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":273240,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":263350,"kb_avail":628872360,"statfs":{"total":644245094400,"available":643965296640,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":269671073},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006270"},"pg_stats":[{"pgid":"9.35","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440419+0000","last_change":"2023-12-15T22:53:26.163996+0000","last_active":"2023-12-16T00:00:26.440419+0000","last_peered":"2023-12-16T00:00:26.440419+0000","last_clean":"2023-12-16T00:00:26.440419+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:00:26.440419+0000","last_undegraded":"2023-12-16T00:00:26.440419+0000","last_fullsized":"2023-12-16T00:00:26.440419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393475+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:59:35.393475+0000","last_peered":"2023-12-15T23:59:35.393475+0000","last_clean":"2023-12-15T23:59:35.393475+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:59:35.393475+0000","last_undegraded":"2023-12-15T23:59:35.393475+0000","last_fullsized":"2023-12-15T23:59:35.393475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612905+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:59:35.612905+0000","last_peered":"2023-12-15T23:59:35.612905+0000","last_clean":"2023-12-15T23:59:35.612905+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:59:35.612905+0000","last_undegraded":"2023-12-15T23:59:35.612905+0000","last_fullsized":"2023-12-15T23:59:35.612905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'25","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:56.372169+0000","last_change":"2023-12-15T22:53:26.158548+0000","last_active":"2023-12-15T23:58:56.372169+0000","last_peered":"2023-12-15T23:58:56.372169+0000","last_clean":"2023-12-15T23:58:56.372169+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-15T23:58:56.372169+0000","last_undegraded":"2023-12-15T23:58:56.372169+0000","last_fullsized":"2023-12-15T23:58:56.372169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615260+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:59:45.615260+0000","last_peered":"2023-12-15T23:59:45.615260+0000","last_clean":"2023-12-15T23:59:45.615260+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:59:45.615260+0000","last_undegraded":"2023-12-15T23:59:45.615260+0000","last_fullsized":"2023-12-15T23:59:45.615260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386973+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-15T23:59:10.386973+0000","last_peered":"2023-12-15T23:59:10.386973+0000","last_clean":"2023-12-15T23:59:10.386973+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-15T23:59:10.386973+0000","last_undegraded":"2023-12-15T23:59:10.386973+0000","last_fullsized":"2023-12-15T23:59:10.386973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'2","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711983+0000","last_change":"2023-12-15T22:53:26.161461+0000","last_active":"2023-12-16T00:00:27.711983+0000","last_peered":"2023-12-16T00:00:27.711983+0000","last_clean":"2023-12-16T00:00:27.711983+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:00:27.711983+0000","last_undegraded":"2023-12-16T00:00:27.711983+0000","last_fullsized":"2023-12-16T00:00:27.711983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386984+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-15T23:59:10.386984+0000","last_peered":"2023-12-15T23:59:10.386984+0000","last_clean":"2023-12-15T23:59:10.386984+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-15T23:59:10.386984+0000","last_undegraded":"2023-12-15T23:59:10.386984+0000","last_fullsized":"2023-12-15T23:59:10.386984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382500+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:59:36.382500+0000","last_peered":"2023-12-15T23:59:36.382500+0000","last_clean":"2023-12-15T23:59:36.382500+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:59:36.382500+0000","last_undegraded":"2023-12-15T23:59:36.382500+0000","last_fullsized":"2023-12-15T23:59:36.382500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.394007+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:59:35.394007+0000","last_peered":"2023-12-15T23:59:35.394007+0000","last_clean":"2023-12-15T23:59:35.394007+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:59:35.394007+0000","last_undegraded":"2023-12-15T23:59:35.394007+0000","last_fullsized":"2023-12-15T23:59:35.394007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'6","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:01.373078+0000","last_change":"2023-12-15T22:53:26.160483+0000","last_active":"2023-12-15T23:59:01.373078+0000","last_peered":"2023-12-15T23:59:01.373078+0000","last_clean":"2023-12-15T23:59:01.373078+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-15T23:59:01.373078+0000","last_undegraded":"2023-12-15T23:59:01.373078+0000","last_fullsized":"2023-12-15T23:59:01.373078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380896+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:59:35.380896+0000","last_peered":"2023-12-15T23:59:35.380896+0000","last_clean":"2023-12-15T23:59:35.380896+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:59:35.380896+0000","last_undegraded":"2023-12-15T23:59:35.380896+0000","last_fullsized":"2023-12-15T23:59:35.380896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712145+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712145+0000","last_peered":"2023-12-16T00:00:37.712145+0000","last_clean":"2023-12-16T00:00:37.712145+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712145+0000","last_undegraded":"2023-12-16T00:00:37.712145+0000","last_fullsized":"2023-12-16T00:00:37.712145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129461+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129461+0000","last_peered":"2023-12-16T00:00:29.129461+0000","last_clean":"2023-12-16T00:00:29.129461+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129461+0000","last_undegraded":"2023-12-16T00:00:29.129461+0000","last_fullsized":"2023-12-16T00:00:29.129461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887146+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887146+0000","last_peered":"2023-12-16T00:01:04.887146+0000","last_clean":"2023-12-16T00:01:04.887146+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887146+0000","last_undegraded":"2023-12-16T00:01:04.887146+0000","last_fullsized":"2023-12-16T00:01:04.887146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387875+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-16T00:00:05.387875+0000","last_peered":"2023-12-16T00:00:05.387875+0000","last_clean":"2023-12-16T00:00:05.387875+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:00:05.387875+0000","last_undegraded":"2023-12-16T00:00:05.387875+0000","last_fullsized":"2023-12-16T00:00:05.387875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'5","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288766+0000","last_change":"2023-12-15T22:53:26.155727+0000","last_active":"2023-12-16T00:00:27.288766+0000","last_peered":"2023-12-16T00:00:27.288766+0000","last_clean":"2023-12-16T00:00:27.288766+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:00:27.288766+0000","last_undegraded":"2023-12-16T00:00:27.288766+0000","last_fullsized":"2023-12-16T00:00:27.288766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864867+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-16T00:00:26.864867+0000","last_peered":"2023-12-16T00:00:26.864867+0000","last_clean":"2023-12-16T00:00:26.864867+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:00:26.864867+0000","last_undegraded":"2023-12-16T00:00:26.864867+0000","last_fullsized":"2023-12-16T00:00:26.864867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1694,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404611+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:20.404611+0000","last_peered":"2023-12-16T00:00:20.404611+0000","last_clean":"2023-12-16T00:00:20.404611+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:20.404611+0000","last_undegraded":"2023-12-16T00:00:20.404611+0000","last_fullsized":"2023-12-16T00:00:20.404611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384079+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:59:00.384079+0000","last_peered":"2023-12-15T23:59:00.384079+0000","last_clean":"2023-12-15T23:59:00.384079+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:59:00.384079+0000","last_undegraded":"2023-12-15T23:59:00.384079+0000","last_fullsized":"2023-12-15T23:59:00.384079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.371389+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-15T23:58:55.371389+0000","last_peered":"2023-12-15T23:58:55.371389+0000","last_clean":"2023-12-15T23:58:55.371389+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-15T23:58:55.371389+0000","last_undegraded":"2023-12-15T23:58:55.371389+0000","last_fullsized":"2023-12-15T23:58:55.371389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711857+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-16T00:00:27.711857+0000","last_peered":"2023-12-16T00:00:27.711857+0000","last_clean":"2023-12-16T00:00:27.711857+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:00:27.711857+0000","last_undegraded":"2023-12-16T00:00:27.711857+0000","last_fullsized":"2023-12-16T00:00:27.711857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137042+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-16T00:00:28.137042+0000","last_peered":"2023-12-16T00:00:28.137042+0000","last_clean":"2023-12-16T00:00:28.137042+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:00:28.137042+0000","last_undegraded":"2023-12-16T00:00:28.137042+0000","last_fullsized":"2023-12-16T00:00:28.137042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.383995+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:59:00.383995+0000","last_peered":"2023-12-15T23:59:00.383995+0000","last_clean":"2023-12-15T23:59:00.383995+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:59:00.383995+0000","last_undegraded":"2023-12-15T23:59:00.383995+0000","last_fullsized":"2023-12-15T23:59:00.383995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016740+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-16T00:00:26.016740+0000","last_peered":"2023-12-16T00:00:26.016740+0000","last_clean":"2023-12-16T00:00:26.016740+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:00:26.016740+0000","last_undegraded":"2023-12-16T00:00:26.016740+0000","last_fullsized":"2023-12-16T00:00:26.016740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'20","reported_seq":852,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137588+0000","last_change":"2023-12-15T22:53:30.176885+0000","last_active":"2023-12-16T00:00:28.137588+0000","last_peered":"2023-12-16T00:00:28.137588+0000","last_clean":"2023-12-16T00:00:28.137588+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:00:28.137588+0000","last_undegraded":"2023-12-16T00:00:28.137588+0000","last_fullsized":"2023-12-16T00:00:28.137588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137246+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-16T00:00:28.137246+0000","last_peered":"2023-12-16T00:00:28.137246+0000","last_clean":"2023-12-16T00:00:28.137246+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:00:28.137246+0000","last_undegraded":"2023-12-16T00:00:28.137246+0000","last_fullsized":"2023-12-16T00:00:28.137246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137126+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-16T00:00:28.137126+0000","last_peered":"2023-12-16T00:00:28.137126+0000","last_clean":"2023-12-16T00:00:28.137126+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:00:28.137126+0000","last_undegraded":"2023-12-16T00:00:28.137126+0000","last_fullsized":"2023-12-16T00:00:28.137126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711788+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-16T00:00:27.711788+0000","last_peered":"2023-12-16T00:00:27.711788+0000","last_clean":"2023-12-16T00:00:27.711788+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:00:27.711788+0000","last_undegraded":"2023-12-16T00:00:27.711788+0000","last_fullsized":"2023-12-16T00:00:27.711788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:41.367924+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-15T23:58:41.367924+0000","last_peered":"2023-12-15T23:58:41.367924+0000","last_clean":"2023-12-15T23:58:41.367924+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-15T23:58:41.367924+0000","last_undegraded":"2023-12-15T23:58:41.367924+0000","last_fullsized":"2023-12-15T23:58:41.367924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384625+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:59:05.384625+0000","last_peered":"2023-12-15T23:59:05.384625+0000","last_clean":"2023-12-15T23:59:05.384625+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:59:05.384625+0000","last_undegraded":"2023-12-15T23:59:05.384625+0000","last_fullsized":"2023-12-15T23:59:05.384625+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712427+0000","last_change":"2023-12-15T22:53:58.168152+0000","last_active":"2023-12-16T00:00:27.712427+0000","last_peered":"2023-12-16T00:00:27.712427+0000","last_clean":"2023-12-16T00:00:27.712427+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:00:27.712427+0000","last_undegraded":"2023-12-16T00:00:27.712427+0000","last_fullsized":"2023-12-16T00:00:27.712427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384930+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:59:46.384930+0000","last_peered":"2023-12-15T23:59:46.384930+0000","last_clean":"2023-12-15T23:59:46.384930+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:59:46.384930+0000","last_undegraded":"2023-12-15T23:59:46.384930+0000","last_fullsized":"2023-12-15T23:59:46.384930+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.382976+0000","last_change":"2023-12-15T22:53:30.183425+0000","last_active":"2023-12-15T23:59:00.382976+0000","last_peered":"2023-12-15T23:59:00.382976+0000","last_clean":"2023-12-15T23:59:00.382976+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-15T23:59:00.382976+0000","last_undegraded":"2023-12-15T23:59:00.382976+0000","last_fullsized":"2023-12-15T23:59:00.382976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":450,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887135+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887135+0000","last_peered":"2023-12-16T00:00:41.887135+0000","last_clean":"2023-12-16T00:00:41.887135+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887135+0000","last_undegraded":"2023-12-16T00:00:41.887135+0000","last_fullsized":"2023-12-16T00:00:41.887135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016303+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-16T00:00:26.016303+0000","last_peered":"2023-12-16T00:00:26.016303+0000","last_clean":"2023-12-16T00:00:26.016303+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:00:26.016303+0000","last_undegraded":"2023-12-16T00:00:26.016303+0000","last_fullsized":"2023-12-16T00:00:26.016303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288485+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-16T00:00:27.288485+0000","last_peered":"2023-12-16T00:00:27.288485+0000","last_clean":"2023-12-16T00:00:27.288485+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:00:27.288485+0000","last_undegraded":"2023-12-16T00:00:27.288485+0000","last_fullsized":"2023-12-16T00:00:27.288485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.598448+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-15T23:58:40.598448+0000","last_peered":"2023-12-15T23:58:40.598448+0000","last_clean":"2023-12-15T23:58:40.598448+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-15T23:58:40.598448+0000","last_undegraded":"2023-12-15T23:58:40.598448+0000","last_fullsized":"2023-12-15T23:58:40.598448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":984,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384699+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:59:05.384699+0000","last_peered":"2023-12-15T23:59:05.384699+0000","last_clean":"2023-12-15T23:59:05.384699+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:59:05.384699+0000","last_undegraded":"2023-12-15T23:59:05.384699+0000","last_fullsized":"2023-12-15T23:59:05.384699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:16.392432+0000","last_change":"2023-12-15T22:53:58.170945+0000","last_active":"2023-12-16T00:00:16.392432+0000","last_peered":"2023-12-16T00:00:16.392432+0000","last_clean":"2023-12-16T00:00:16.392432+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:00:16.392432+0000","last_undegraded":"2023-12-16T00:00:16.392432+0000","last_fullsized":"2023-12-16T00:00:16.392432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403315+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-16T00:00:15.403315+0000","last_peered":"2023-12-16T00:00:15.403315+0000","last_clean":"2023-12-16T00:00:15.403315+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:00:15.403315+0000","last_undegraded":"2023-12-16T00:00:15.403315+0000","last_fullsized":"2023-12-16T00:00:15.403315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905676+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905676+0000","last_peered":"2023-12-16T00:00:44.905676+0000","last_clean":"2023-12-16T00:00:44.905676+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905676+0000","last_undegraded":"2023-12-16T00:00:44.905676+0000","last_fullsized":"2023-12-16T00:00:44.905676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2293","reported_seq":3262,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.601821+0000","last_change":"2023-12-15T22:53:28.164948+0000","last_active":"2023-12-15T23:58:55.601821+0000","last_peered":"2023-12-15T23:58:55.601821+0000","last_clean":"2023-12-15T23:58:55.601821+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-15T23:58:55.601821+0000","last_undegraded":"2023-12-15T23:58:55.601821+0000","last_fullsized":"2023-12-15T23:58:55.601821+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":500,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711864+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-16T00:00:27.711864+0000","last_peered":"2023-12-16T00:00:27.711864+0000","last_clean":"2023-12-16T00:00:27.711864+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:00:27.711864+0000","last_undegraded":"2023-12-16T00:00:27.711864+0000","last_fullsized":"2023-12-16T00:00:27.711864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":797,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440204+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-16T00:00:26.440204+0000","last_peered":"2023-12-16T00:00:26.440204+0000","last_clean":"2023-12-16T00:00:26.440204+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:00:26.440204+0000","last_undegraded":"2023-12-16T00:00:26.440204+0000","last_fullsized":"2023-12-16T00:00:26.440204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289103+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-16T00:00:27.289103+0000","last_peered":"2023-12-16T00:00:27.289103+0000","last_clean":"2023-12-16T00:00:27.289103+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:00:27.289103+0000","last_undegraded":"2023-12-16T00:00:27.289103+0000","last_fullsized":"2023-12-16T00:00:27.289103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384367+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:59:46.384367+0000","last_peered":"2023-12-15T23:59:46.384367+0000","last_clean":"2023-12-15T23:59:46.384367+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:59:46.384367+0000","last_undegraded":"2023-12-15T23:59:46.384367+0000","last_fullsized":"2023-12-15T23:59:46.384367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137476+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-16T00:00:28.137476+0000","last_peered":"2023-12-16T00:00:28.137476+0000","last_clean":"2023-12-16T00:00:28.137476+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:00:28.137476+0000","last_undegraded":"2023-12-16T00:00:28.137476+0000","last_fullsized":"2023-12-16T00:00:28.137476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'3","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404716+0000","last_change":"2023-12-15T22:53:26.159481+0000","last_active":"2023-12-16T00:00:20.404716+0000","last_peered":"2023-12-16T00:00:20.404716+0000","last_clean":"2023-12-16T00:00:20.404716+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:00:20.404716+0000","last_undegraded":"2023-12-16T00:00:20.404716+0000","last_fullsized":"2023-12-16T00:00:20.404716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400328+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:05.400328+0000","last_peered":"2023-12-16T00:00:05.400328+0000","last_clean":"2023-12-16T00:00:05.400328+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:05.400328+0000","last_undegraded":"2023-12-16T00:00:05.400328+0000","last_fullsized":"2023-12-16T00:00:05.400328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403768+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:15.403768+0000","last_peered":"2023-12-16T00:00:15.403768+0000","last_clean":"2023-12-16T00:00:15.403768+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:15.403768+0000","last_undegraded":"2023-12-16T00:00:15.403768+0000","last_fullsized":"2023-12-16T00:00:15.403768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440185+0000","last_change":"2023-12-15T22:53:08.335124+0000","last_active":"2023-12-16T00:00:26.440185+0000","last_peered":"2023-12-16T00:00:26.440185+0000","last_clean":"2023-12-16T00:00:26.440185+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:00:26.440185+0000","last_undegraded":"2023-12-16T00:00:26.440185+0000","last_fullsized":"2023-12-16T00:00:26.440185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397530+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:59:50.397530+0000","last_peered":"2023-12-15T23:59:50.397530+0000","last_clean":"2023-12-15T23:59:50.397530+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:59:50.397530+0000","last_undegraded":"2023-12-15T23:59:50.397530+0000","last_fullsized":"2023-12-15T23:59:50.397530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402635+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-16T00:00:15.402635+0000","last_peered":"2023-12-16T00:00:15.402635+0000","last_clean":"2023-12-16T00:00:15.402635+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:00:15.402635+0000","last_undegraded":"2023-12-16T00:00:15.402635+0000","last_fullsized":"2023-12-16T00:00:15.402635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402738+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-16T00:00:15.402738+0000","last_peered":"2023-12-16T00:00:15.402738+0000","last_clean":"2023-12-16T00:00:15.402738+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:00:15.402738+0000","last_undegraded":"2023-12-16T00:00:15.402738+0000","last_fullsized":"2023-12-16T00:00:15.402738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016636+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-16T00:00:26.016636+0000","last_peered":"2023-12-16T00:00:26.016636+0000","last_clean":"2023-12-16T00:00:26.016636+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:00:26.016636+0000","last_undegraded":"2023-12-16T00:00:26.016636+0000","last_fullsized":"2023-12-16T00:00:26.016636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867711+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867711+0000","last_peered":"2023-12-16T00:00:31.867711+0000","last_clean":"2023-12-16T00:00:31.867711+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867711+0000","last_undegraded":"2023-12-16T00:00:31.867711+0000","last_fullsized":"2023-12-16T00:00:31.867711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389472+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:06.389472+0000","last_peered":"2023-12-16T00:00:06.389472+0000","last_clean":"2023-12-16T00:00:06.389472+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:06.389472+0000","last_undegraded":"2023-12-16T00:00:06.389472+0000","last_fullsized":"2023-12-16T00:00:06.389472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.389884+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:15.389884+0000","last_peered":"2023-12-16T00:00:15.389884+0000","last_clean":"2023-12-16T00:00:15.389884+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:15.389884+0000","last_undegraded":"2023-12-16T00:00:15.389884+0000","last_fullsized":"2023-12-16T00:00:15.389884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440121+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-16T00:00:26.440121+0000","last_peered":"2023-12-16T00:00:26.440121+0000","last_clean":"2023-12-16T00:00:26.440121+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:00:26.440121+0000","last_undegraded":"2023-12-16T00:00:26.440121+0000","last_fullsized":"2023-12-16T00:00:26.440121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864668+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-16T00:00:26.864668+0000","last_peered":"2023-12-16T00:00:26.864668+0000","last_clean":"2023-12-16T00:00:26.864668+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:00:26.864668+0000","last_undegraded":"2023-12-16T00:00:26.864668+0000","last_fullsized":"2023-12-16T00:00:26.864668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389798+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-16T00:00:06.389798+0000","last_peered":"2023-12-16T00:00:06.389798+0000","last_clean":"2023-12-16T00:00:06.389798+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:00:06.389798+0000","last_undegraded":"2023-12-16T00:00:06.389798+0000","last_fullsized":"2023-12-16T00:00:06.389798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1651,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391131+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-16T00:00:20.391131+0000","last_peered":"2023-12-16T00:00:20.391131+0000","last_clean":"2023-12-16T00:00:20.391131+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:00:20.391131+0000","last_undegraded":"2023-12-16T00:00:20.391131+0000","last_fullsized":"2023-12-16T00:00:20.391131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016723+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-16T00:00:26.016723+0000","last_peered":"2023-12-16T00:00:26.016723+0000","last_clean":"2023-12-16T00:00:26.016723+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:00:26.016723+0000","last_undegraded":"2023-12-16T00:00:26.016723+0000","last_fullsized":"2023-12-16T00:00:26.016723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402873+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-16T00:00:15.402873+0000","last_peered":"2023-12-16T00:00:15.402873+0000","last_clean":"2023-12-16T00:00:15.402873+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:00:15.402873+0000","last_undegraded":"2023-12-16T00:00:15.402873+0000","last_fullsized":"2023-12-16T00:00:15.402873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725058+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725058+0000","last_peered":"2023-12-16T00:00:59.725058+0000","last_clean":"2023-12-16T00:00:59.725058+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725058+0000","last_undegraded":"2023-12-16T00:00:59.725058+0000","last_fullsized":"2023-12-16T00:00:59.725058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'776","reported_seq":2087,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402018+0000","last_change":"2023-12-15T22:53:28.169716+0000","last_active":"2023-12-16T00:00:10.402018+0000","last_peered":"2023-12-16T00:00:10.402018+0000","last_clean":"2023-12-16T00:00:10.402018+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:00:10.402018+0000","last_undegraded":"2023-12-16T00:00:10.402018+0000","last_fullsized":"2023-12-16T00:00:10.402018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867666+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867666+0000","last_peered":"2023-12-16T00:00:52.867666+0000","last_clean":"2023-12-16T00:00:52.867666+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867666+0000","last_undegraded":"2023-12-16T00:00:52.867666+0000","last_fullsized":"2023-12-16T00:00:52.867666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404800+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-16T00:00:20.404800+0000","last_peered":"2023-12-16T00:00:20.404800+0000","last_clean":"2023-12-16T00:00:20.404800+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:00:20.404800+0000","last_undegraded":"2023-12-16T00:00:20.404800+0000","last_fullsized":"2023-12-16T00:00:20.404800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137741+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-16T00:00:28.137741+0000","last_peered":"2023-12-16T00:00:28.137741+0000","last_clean":"2023-12-16T00:00:28.137741+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:00:28.137741+0000","last_undegraded":"2023-12-16T00:00:28.137741+0000","last_fullsized":"2023-12-16T00:00:28.137741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403136+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-16T00:00:15.403136+0000","last_peered":"2023-12-16T00:00:15.403136+0000","last_clean":"2023-12-16T00:00:15.403136+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:00:15.403136+0000","last_undegraded":"2023-12-16T00:00:15.403136+0000","last_fullsized":"2023-12-16T00:00:15.403136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402706+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-16T00:00:10.402706+0000","last_peered":"2023-12-16T00:00:10.402706+0000","last_clean":"2023-12-16T00:00:10.402706+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:00:10.402706+0000","last_undegraded":"2023-12-16T00:00:10.402706+0000","last_fullsized":"2023-12-16T00:00:10.402706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790096+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790096+0000","last_peered":"2023-12-16T00:00:57.790096+0000","last_clean":"2023-12-16T00:00:57.790096+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790096+0000","last_undegraded":"2023-12-16T00:00:57.790096+0000","last_fullsized":"2023-12-16T00:00:57.790096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391200+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-16T00:00:20.391200+0000","last_peered":"2023-12-16T00:00:20.391200+0000","last_clean":"2023-12-16T00:00:20.391200+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:00:20.391200+0000","last_undegraded":"2023-12-16T00:00:20.391200+0000","last_fullsized":"2023-12-16T00:00:20.391200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750337+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750337+0000","last_peered":"2023-12-16T00:00:48.750337+0000","last_clean":"2023-12-16T00:00:48.750337+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750337+0000","last_undegraded":"2023-12-16T00:00:48.750337+0000","last_fullsized":"2023-12-16T00:00:48.750337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3531,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384776+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-15T23:59:05.384776+0000","last_peered":"2023-12-15T23:59:05.384776+0000","last_clean":"2023-12-15T23:59:05.384776+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-15T23:59:05.384776+0000","last_undegraded":"2023-12-15T23:59:05.384776+0000","last_fullsized":"2023-12-15T23:59:05.384776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712324+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-16T00:00:27.712324+0000","last_peered":"2023-12-16T00:00:27.712324+0000","last_clean":"2023-12-16T00:00:27.712324+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:00:27.712324+0000","last_undegraded":"2023-12-16T00:00:27.712324+0000","last_fullsized":"2023-12-16T00:00:27.712324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403966+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:15.403966+0000","last_peered":"2023-12-16T00:00:15.403966+0000","last_clean":"2023-12-16T00:00:15.403966+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:15.403966+0000","last_undegraded":"2023-12-16T00:00:15.403966+0000","last_fullsized":"2023-12-16T00:00:15.403966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1503,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401785+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-16T00:00:10.401785+0000","last_peered":"2023-12-16T00:00:10.401785+0000","last_clean":"2023-12-16T00:00:10.401785+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:00:10.401785+0000","last_undegraded":"2023-12-16T00:00:10.401785+0000","last_fullsized":"2023-12-16T00:00:10.401785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'513","reported_seq":1144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.621598+0000","last_change":"2023-12-15T22:53:28.166344+0000","last_active":"2023-12-16T00:00:10.621598+0000","last_peered":"2023-12-16T00:00:10.621598+0000","last_clean":"2023-12-16T00:00:10.621598+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:00:10.621598+0000","last_undegraded":"2023-12-16T00:00:10.621598+0000","last_fullsized":"2023-12-16T00:00:10.621598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233326+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233326+0000","last_peered":"2023-12-16T00:00:26.233326+0000","last_clean":"2023-12-16T00:00:26.233326+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233326+0000","last_undegraded":"2023-12-16T00:00:26.233326+0000","last_fullsized":"2023-12-16T00:00:26.233326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016185+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-16T00:00:26.016185+0000","last_peered":"2023-12-16T00:00:26.016185+0000","last_clean":"2023-12-16T00:00:26.016185+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:00:26.016185+0000","last_undegraded":"2023-12-16T00:00:26.016185+0000","last_fullsized":"2023-12-16T00:00:26.016185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831199+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831199+0000","last_peered":"2023-12-16T00:01:04.831199+0000","last_clean":"2023-12-16T00:01:04.831199+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831199+0000","last_undegraded":"2023-12-16T00:01:04.831199+0000","last_fullsized":"2023-12-16T00:01:04.831199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":885,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385917+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-15T23:59:05.385917+0000","last_peered":"2023-12-15T23:59:05.385917+0000","last_clean":"2023-12-15T23:59:05.385917+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-15T23:59:05.385917+0000","last_undegraded":"2023-12-15T23:59:05.385917+0000","last_fullsized":"2023-12-15T23:59:05.385917+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137791+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-16T00:00:28.137791+0000","last_peered":"2023-12-16T00:00:28.137791+0000","last_clean":"2023-12-16T00:00:28.137791+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:00:28.137791+0000","last_undegraded":"2023-12-16T00:00:28.137791+0000","last_fullsized":"2023-12-16T00:00:28.137791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289035+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-16T00:00:27.289035+0000","last_peered":"2023-12-16T00:00:27.289035+0000","last_clean":"2023-12-16T00:00:27.289035+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:00:27.289035+0000","last_undegraded":"2023-12-16T00:00:27.289035+0000","last_fullsized":"2023-12-16T00:00:27.289035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.388836+0000","last_change":"2023-12-15T22:53:30.173995+0000","last_active":"2023-12-16T00:00:10.388836+0000","last_peered":"2023-12-16T00:00:10.388836+0000","last_clean":"2023-12-16T00:00:10.388836+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:00:10.388836+0000","last_undegraded":"2023-12-16T00:00:10.388836+0000","last_fullsized":"2023-12-16T00:00:10.388836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":864,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835775+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835775+0000","last_peered":"2023-12-16T00:00:29.835775+0000","last_clean":"2023-12-16T00:00:29.835775+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835775+0000","last_undegraded":"2023-12-16T00:00:29.835775+0000","last_fullsized":"2023-12-16T00:00:29.835775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867182+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867182+0000","last_peered":"2023-12-16T00:00:33.867182+0000","last_clean":"2023-12-16T00:00:33.867182+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867182+0000","last_undegraded":"2023-12-16T00:00:33.867182+0000","last_fullsized":"2023-12-16T00:00:33.867182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864514+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-16T00:00:26.864514+0000","last_peered":"2023-12-16T00:00:26.864514+0000","last_clean":"2023-12-16T00:00:26.864514+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:00:26.864514+0000","last_undegraded":"2023-12-16T00:00:26.864514+0000","last_fullsized":"2023-12-16T00:00:26.864514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864656+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-16T00:00:26.864656+0000","last_peered":"2023-12-16T00:00:26.864656+0000","last_clean":"2023-12-16T00:00:26.864656+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:00:26.864656+0000","last_undegraded":"2023-12-16T00:00:26.864656+0000","last_fullsized":"2023-12-16T00:00:26.864656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616043+0000","last_change":"2023-12-15T22:53:10.333978+0000","last_active":"2023-12-15T23:59:50.616043+0000","last_peered":"2023-12-15T23:59:50.616043+0000","last_clean":"2023-12-15T23:59:50.616043+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-15T23:59:50.616043+0000","last_undegraded":"2023-12-15T23:59:50.616043+0000","last_fullsized":"2023-12-15T23:59:50.616043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384309+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-15T23:59:00.384309+0000","last_peered":"2023-12-15T23:59:00.384309+0000","last_clean":"2023-12-15T23:59:00.384309+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-15T23:59:00.384309+0000","last_undegraded":"2023-12-15T23:59:00.384309+0000","last_fullsized":"2023-12-15T23:59:00.384309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440575+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-16T00:00:26.440575+0000","last_peered":"2023-12-16T00:00:26.440575+0000","last_clean":"2023-12-16T00:00:26.440575+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:00:26.440575+0000","last_undegraded":"2023-12-16T00:00:26.440575+0000","last_fullsized":"2023-12-16T00:00:26.440575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473143+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473143+0000","last_peered":"2023-12-16T00:00:47.473143+0000","last_clean":"2023-12-16T00:00:47.473143+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473143+0000","last_undegraded":"2023-12-16T00:00:47.473143+0000","last_fullsized":"2023-12-16T00:00:47.473143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786863+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786863+0000","last_peered":"2023-12-16T00:00:33.786863+0000","last_clean":"2023-12-16T00:00:33.786863+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786863+0000","last_undegraded":"2023-12-16T00:00:33.786863+0000","last_fullsized":"2023-12-16T00:00:33.786863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121731+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121731+0000","last_peered":"2023-12-16T00:00:35.121731+0000","last_clean":"2023-12-16T00:00:35.121731+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121731+0000","last_undegraded":"2023-12-16T00:00:35.121731+0000","last_fullsized":"2023-12-16T00:00:35.121731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389440+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:06.389440+0000","last_peered":"2023-12-16T00:00:06.389440+0000","last_clean":"2023-12-16T00:00:06.389440+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:06.389440+0000","last_undegraded":"2023-12-16T00:00:06.389440+0000","last_fullsized":"2023-12-16T00:00:06.389440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440142+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-16T00:00:26.440142+0000","last_peered":"2023-12-16T00:00:26.440142+0000","last_clean":"2023-12-16T00:00:26.440142+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:00:26.440142+0000","last_undegraded":"2023-12-16T00:00:26.440142+0000","last_fullsized":"2023-12-16T00:00:26.440142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711777+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:27.711777+0000","last_peered":"2023-12-16T00:00:27.711777+0000","last_clean":"2023-12-16T00:00:27.711777+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:00:27.711777+0000","last_undegraded":"2023-12-16T00:00:27.711777+0000","last_fullsized":"2023-12-16T00:00:27.711777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385854+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:59:51.385854+0000","last_peered":"2023-12-15T23:59:51.385854+0000","last_clean":"2023-12-15T23:59:51.385854+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:59:51.385854+0000","last_undegraded":"2023-12-15T23:59:51.385854+0000","last_fullsized":"2023-12-15T23:59:51.385854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1760,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016807+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-16T00:00:26.016807+0000","last_peered":"2023-12-16T00:00:26.016807+0000","last_clean":"2023-12-16T00:00:26.016807+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:00:26.016807+0000","last_undegraded":"2023-12-16T00:00:26.016807+0000","last_fullsized":"2023-12-16T00:00:26.016807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384254+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-15T23:59:00.384254+0000","last_peered":"2023-12-15T23:59:00.384254+0000","last_clean":"2023-12-15T23:59:00.384254+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-15T23:59:00.384254+0000","last_undegraded":"2023-12-15T23:59:00.384254+0000","last_fullsized":"2023-12-15T23:59:00.384254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"49'3","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440574+0000","last_change":"2023-12-15T22:53:32.192296+0000","last_active":"2023-12-16T00:00:26.440574+0000","last_peered":"2023-12-16T00:00:26.440574+0000","last_clean":"2023-12-16T00:00:26.440574+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:00:26.440574+0000","last_undegraded":"2023-12-16T00:00:26.440574+0000","last_fullsized":"2023-12-16T00:00:26.440574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.613663+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:59:40.613663+0000","last_peered":"2023-12-15T23:59:40.613663+0000","last_clean":"2023-12-15T23:59:40.613663+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:59:40.613663+0000","last_undegraded":"2023-12-15T23:59:40.613663+0000","last_fullsized":"2023-12-15T23:59:40.613663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":550,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529119+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529119+0000","last_peered":"2023-12-16T00:00:50.529119+0000","last_clean":"2023-12-16T00:00:50.529119+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529119+0000","last_undegraded":"2023-12-16T00:00:50.529119+0000","last_fullsized":"2023-12-16T00:00:50.529119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710437+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710437+0000","last_peered":"2023-12-16T00:00:43.710437+0000","last_clean":"2023-12-16T00:00:43.710437+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710437+0000","last_undegraded":"2023-12-16T00:00:43.710437+0000","last_fullsized":"2023-12-16T00:00:43.710437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387461+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:05.387461+0000","last_peered":"2023-12-16T00:00:05.387461+0000","last_clean":"2023-12-16T00:00:05.387461+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:05.387461+0000","last_undegraded":"2023-12-16T00:00:05.387461+0000","last_fullsized":"2023-12-16T00:00:05.387461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288427+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-16T00:00:27.288427+0000","last_peered":"2023-12-16T00:00:27.288427+0000","last_clean":"2023-12-16T00:00:27.288427+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:00:27.288427+0000","last_undegraded":"2023-12-16T00:00:27.288427+0000","last_fullsized":"2023-12-16T00:00:27.288427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616155+0000","last_change":"2023-12-15T22:53:10.334199+0000","last_active":"2023-12-15T23:59:50.616155+0000","last_peered":"2023-12-15T23:59:50.616155+0000","last_clean":"2023-12-15T23:59:50.616155+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-15T23:59:50.616155+0000","last_undegraded":"2023-12-15T23:59:50.616155+0000","last_fullsized":"2023-12-15T23:59:50.616155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382667+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:59:36.382667+0000","last_peered":"2023-12-15T23:59:36.382667+0000","last_clean":"2023-12-15T23:59:36.382667+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:59:36.382667+0000","last_undegraded":"2023-12-15T23:59:36.382667+0000","last_fullsized":"2023-12-15T23:59:36.382667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.607669+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:59:15.607669+0000","last_peered":"2023-12-15T23:59:15.607669+0000","last_clean":"2023-12-15T23:59:15.607669+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:59:15.607669+0000","last_undegraded":"2023-12-15T23:59:15.607669+0000","last_fullsized":"2023-12-15T23:59:15.607669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712301+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-16T00:00:27.712301+0000","last_peered":"2023-12-16T00:00:27.712301+0000","last_clean":"2023-12-16T00:00:27.712301+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:00:27.712301+0000","last_undegraded":"2023-12-16T00:00:27.712301+0000","last_fullsized":"2023-12-16T00:00:27.712301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440564+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-16T00:00:26.440564+0000","last_peered":"2023-12-16T00:00:26.440564+0000","last_clean":"2023-12-16T00:00:26.440564+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:00:26.440564+0000","last_undegraded":"2023-12-16T00:00:26.440564+0000","last_fullsized":"2023-12-16T00:00:26.440564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864722+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-16T00:00:26.864722+0000","last_peered":"2023-12-16T00:00:26.864722+0000","last_clean":"2023-12-16T00:00:26.864722+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:00:26.864722+0000","last_undegraded":"2023-12-16T00:00:26.864722+0000","last_fullsized":"2023-12-16T00:00:26.864722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396920+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:59:50.396920+0000","last_peered":"2023-12-15T23:59:50.396920+0000","last_clean":"2023-12-15T23:59:50.396920+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:59:50.396920+0000","last_undegraded":"2023-12-15T23:59:50.396920+0000","last_fullsized":"2023-12-15T23:59:50.396920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405397+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:25.405397+0000","last_peered":"2023-12-16T00:00:25.405397+0000","last_clean":"2023-12-16T00:00:25.405397+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:25.405397+0000","last_undegraded":"2023-12-16T00:00:25.405397+0000","last_fullsized":"2023-12-16T00:00:25.405397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612548+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:59:35.612548+0000","last_peered":"2023-12-15T23:59:35.612548+0000","last_clean":"2023-12-15T23:59:35.612548+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:59:35.612548+0000","last_undegraded":"2023-12-15T23:59:35.612548+0000","last_fullsized":"2023-12-15T23:59:35.612548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384782+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:59:46.384782+0000","last_peered":"2023-12-15T23:59:46.384782+0000","last_clean":"2023-12-15T23:59:46.384782+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:59:46.384782+0000","last_undegraded":"2023-12-15T23:59:46.384782+0000","last_fullsized":"2023-12-15T23:59:46.384782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404945+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-16T00:00:20.404945+0000","last_peered":"2023-12-16T00:00:20.404945+0000","last_clean":"2023-12-16T00:00:20.404945+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:00:20.404945+0000","last_undegraded":"2023-12-16T00:00:20.404945+0000","last_fullsized":"2023-12-16T00:00:20.404945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:21.378650+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:59:21.378650+0000","last_peered":"2023-12-15T23:59:21.378650+0000","last_clean":"2023-12-15T23:59:21.378650+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:59:21.378650+0000","last_undegraded":"2023-12-15T23:59:21.378650+0000","last_fullsized":"2023-12-15T23:59:21.378650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:16.377291+0000","last_change":"2023-12-15T22:53:58.170946+0000","last_active":"2023-12-15T23:59:16.377291+0000","last_peered":"2023-12-15T23:59:16.377291+0000","last_clean":"2023-12-15T23:59:16.377291+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-15T23:59:16.377291+0000","last_undegraded":"2023-12-15T23:59:16.377291+0000","last_fullsized":"2023-12-15T23:59:16.377291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016632+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-16T00:00:26.016632+0000","last_peered":"2023-12-16T00:00:26.016632+0000","last_clean":"2023-12-16T00:00:26.016632+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:00:26.016632+0000","last_undegraded":"2023-12-16T00:00:26.016632+0000","last_fullsized":"2023-12-16T00:00:26.016632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865077+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-16T00:00:26.865077+0000","last_peered":"2023-12-16T00:00:26.865077+0000","last_clean":"2023-12-16T00:00:26.865077+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:00:26.865077+0000","last_undegraded":"2023-12-16T00:00:26.865077+0000","last_fullsized":"2023-12-16T00:00:26.865077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612756+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:59:35.612756+0000","last_peered":"2023-12-15T23:59:35.612756+0000","last_clean":"2023-12-15T23:59:35.612756+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:59:35.612756+0000","last_undegraded":"2023-12-15T23:59:35.612756+0000","last_fullsized":"2023-12-15T23:59:35.612756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382308+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:59:36.382308+0000","last_peered":"2023-12-15T23:59:36.382308+0000","last_clean":"2023-12-15T23:59:36.382308+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:59:36.382308+0000","last_undegraded":"2023-12-15T23:59:36.382308+0000","last_fullsized":"2023-12-15T23:59:36.382308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399480+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:00.399480+0000","last_peered":"2023-12-16T00:00:00.399480+0000","last_clean":"2023-12-16T00:00:00.399480+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:00.399480+0000","last_undegraded":"2023-12-16T00:00:00.399480+0000","last_fullsized":"2023-12-16T00:00:00.399480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.624945+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-16T00:00:20.624945+0000","last_peered":"2023-12-16T00:00:20.624945+0000","last_clean":"2023-12-16T00:00:20.624945+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:00:20.624945+0000","last_undegraded":"2023-12-16T00:00:20.624945+0000","last_fullsized":"2023-12-16T00:00:20.624945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404812+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-16T00:00:20.404812+0000","last_peered":"2023-12-16T00:00:20.404812+0000","last_clean":"2023-12-16T00:00:20.404812+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:00:20.404812+0000","last_undegraded":"2023-12-16T00:00:20.404812+0000","last_fullsized":"2023-12-16T00:00:20.404812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404882+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-16T00:00:20.404882+0000","last_peered":"2023-12-16T00:00:20.404882+0000","last_clean":"2023-12-16T00:00:20.404882+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:00:20.404882+0000","last_undegraded":"2023-12-16T00:00:20.404882+0000","last_fullsized":"2023-12-16T00:00:20.404882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5994,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389933+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:59:20.389933+0000","last_peered":"2023-12-15T23:59:20.389933+0000","last_clean":"2023-12-15T23:59:20.389933+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:59:20.389933+0000","last_undegraded":"2023-12-15T23:59:20.389933+0000","last_fullsized":"2023-12-15T23:59:20.389933+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388623+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:59:15.388623+0000","last_peered":"2023-12-15T23:59:15.388623+0000","last_clean":"2023-12-15T23:59:15.388623+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:59:15.388623+0000","last_undegraded":"2023-12-15T23:59:15.388623+0000","last_fullsized":"2023-12-15T23:59:15.388623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385563+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-15T23:59:05.385563+0000","last_peered":"2023-12-15T23:59:05.385563+0000","last_clean":"2023-12-15T23:59:05.385563+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-15T23:59:05.385563+0000","last_undegraded":"2023-12-15T23:59:05.385563+0000","last_fullsized":"2023-12-15T23:59:05.385563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865032+0000","last_change":"2023-12-15T22:53:30.180941+0000","last_active":"2023-12-16T00:00:26.865032+0000","last_peered":"2023-12-16T00:00:26.865032+0000","last_clean":"2023-12-16T00:00:26.865032+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:00:26.865032+0000","last_undegraded":"2023-12-16T00:00:26.865032+0000","last_fullsized":"2023-12-16T00:00:26.865032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1392,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288826+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-16T00:00:27.288826+0000","last_peered":"2023-12-16T00:00:27.288826+0000","last_clean":"2023-12-16T00:00:27.288826+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:00:27.288826+0000","last_undegraded":"2023-12-16T00:00:27.288826+0000","last_fullsized":"2023-12-16T00:00:27.288826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'22","reported_seq":198,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288652+0000","last_change":"2023-12-15T22:53:26.159509+0000","last_active":"2023-12-16T00:00:27.288652+0000","last_peered":"2023-12-16T00:00:27.288652+0000","last_clean":"2023-12-16T00:00:27.288652+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:00:27.288652+0000","last_undegraded":"2023-12-16T00:00:27.288652+0000","last_fullsized":"2023-12-16T00:00:27.288652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620685+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:05.620685+0000","last_peered":"2023-12-16T00:00:05.620685+0000","last_clean":"2023-12-16T00:00:05.620685+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:05.620685+0000","last_undegraded":"2023-12-16T00:00:05.620685+0000","last_fullsized":"2023-12-16T00:00:05.620685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.390276+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:15.390276+0000","last_peered":"2023-12-16T00:00:15.390276+0000","last_clean":"2023-12-16T00:00:15.390276+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:15.390276+0000","last_undegraded":"2023-12-16T00:00:15.390276+0000","last_fullsized":"2023-12-16T00:00:15.390276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401475+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:05.401475+0000","last_peered":"2023-12-16T00:00:05.401475+0000","last_clean":"2023-12-16T00:00:05.401475+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:05.401475+0000","last_undegraded":"2023-12-16T00:00:05.401475+0000","last_fullsized":"2023-12-16T00:00:05.401475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396260+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:59:50.396260+0000","last_peered":"2023-12-15T23:59:50.396260+0000","last_clean":"2023-12-15T23:59:50.396260+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:59:50.396260+0000","last_undegraded":"2023-12-15T23:59:50.396260+0000","last_fullsized":"2023-12-15T23:59:50.396260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016252+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-16T00:00:26.016252+0000","last_peered":"2023-12-16T00:00:26.016252+0000","last_clean":"2023-12-16T00:00:26.016252+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:00:26.016252+0000","last_undegraded":"2023-12-16T00:00:26.016252+0000","last_fullsized":"2023-12-16T00:00:26.016252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388533+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:59:20.388533+0000","last_peered":"2023-12-15T23:59:20.388533+0000","last_clean":"2023-12-15T23:59:20.388533+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:59:20.388533+0000","last_undegraded":"2023-12-15T23:59:20.388533+0000","last_fullsized":"2023-12-15T23:59:20.388533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.392864+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:59:30.392864+0000","last_peered":"2023-12-15T23:59:30.392864+0000","last_clean":"2023-12-15T23:59:30.392864+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:59:30.392864+0000","last_undegraded":"2023-12-15T23:59:30.392864+0000","last_fullsized":"2023-12-15T23:59:30.392864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016665+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-16T00:00:26.016665+0000","last_peered":"2023-12-16T00:00:26.016665+0000","last_clean":"2023-12-16T00:00:26.016665+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:00:26.016665+0000","last_undegraded":"2023-12-16T00:00:26.016665+0000","last_fullsized":"2023-12-16T00:00:26.016665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865018+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-16T00:00:26.865018+0000","last_peered":"2023-12-16T00:00:26.865018+0000","last_clean":"2023-12-16T00:00:26.865018+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:00:26.865018+0000","last_undegraded":"2023-12-16T00:00:26.865018+0000","last_fullsized":"2023-12-16T00:00:26.865018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'262","reported_seq":523,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016554+0000","last_change":"2023-12-15T22:53:28.168278+0000","last_active":"2023-12-16T00:00:26.016554+0000","last_peered":"2023-12-16T00:00:26.016554+0000","last_clean":"2023-12-16T00:00:26.016554+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:00:26.016554+0000","last_undegraded":"2023-12-16T00:00:26.016554+0000","last_fullsized":"2023-12-16T00:00:26.016554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400974+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:05.400974+0000","last_peered":"2023-12-16T00:00:05.400974+0000","last_clean":"2023-12-16T00:00:05.400974+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:05.400974+0000","last_undegraded":"2023-12-16T00:00:05.400974+0000","last_fullsized":"2023-12-16T00:00:05.400974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405423+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:00:25.405423+0000","last_peered":"2023-12-16T00:00:25.405423+0000","last_clean":"2023-12-16T00:00:25.405423+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:00:25.405423+0000","last_undegraded":"2023-12-16T00:00:25.405423+0000","last_fullsized":"2023-12-16T00:00:25.405423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392199+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:59:35.392199+0000","last_peered":"2023-12-15T23:59:35.392199+0000","last_clean":"2023-12-15T23:59:35.392199+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:59:35.392199+0000","last_undegraded":"2023-12-15T23:59:35.392199+0000","last_fullsized":"2023-12-15T23:59:35.392199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.404304+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:15.404304+0000","last_peered":"2023-12-16T00:00:15.404304+0000","last_clean":"2023-12-16T00:00:15.404304+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:15.404304+0000","last_undegraded":"2023-12-16T00:00:15.404304+0000","last_fullsized":"2023-12-16T00:00:15.404304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":971,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616350+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:59:50.616350+0000","last_peered":"2023-12-15T23:59:50.616350+0000","last_clean":"2023-12-15T23:59:50.616350+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:59:50.616350+0000","last_undegraded":"2023-12-15T23:59:50.616350+0000","last_fullsized":"2023-12-15T23:59:50.616350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389786+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:06.389786+0000","last_peered":"2023-12-16T00:00:06.389786+0000","last_clean":"2023-12-16T00:00:06.389786+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:00:06.389786+0000","last_undegraded":"2023-12-16T00:00:06.389786+0000","last_fullsized":"2023-12-16T00:00:06.389786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440322+0000","last_change":"2023-12-15T22:53:11.080200+0000","last_active":"2023-12-16T00:00:26.440322+0000","last_peered":"2023-12-16T00:00:26.440322+0000","last_clean":"2023-12-16T00:00:26.440322+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:00:26.440322+0000","last_undegraded":"2023-12-16T00:00:26.440322+0000","last_fullsized":"2023-12-16T00:00:26.440322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1256,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388381+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:59:20.388381+0000","last_peered":"2023-12-15T23:59:20.388381+0000","last_clean":"2023-12-15T23:59:20.388381+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:59:20.388381+0000","last_undegraded":"2023-12-15T23:59:20.388381+0000","last_fullsized":"2023-12-15T23:59:20.388381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.372484+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-15T23:59:00.372484+0000","last_peered":"2023-12-15T23:59:00.372484+0000","last_clean":"2023-12-15T23:59:00.372484+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-15T23:59:00.372484+0000","last_undegraded":"2023-12-15T23:59:00.372484+0000","last_fullsized":"2023-12-15T23:59:00.372484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"49'1","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865152+0000","last_change":"2023-12-15T22:53:32.191558+0000","last_active":"2023-12-16T00:00:26.865152+0000","last_peered":"2023-12-16T00:00:26.865152+0000","last_clean":"2023-12-16T00:00:26.865152+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:00:26.865152+0000","last_undegraded":"2023-12-16T00:00:26.865152+0000","last_fullsized":"2023-12-16T00:00:26.865152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'252","reported_seq":484,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384345+0000","last_change":"2023-12-15T22:53:28.173336+0000","last_active":"2023-12-15T23:59:00.384345+0000","last_peered":"2023-12-15T23:59:00.384345+0000","last_clean":"2023-12-15T23:59:00.384345+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-15T23:59:00.384345+0000","last_undegraded":"2023-12-15T23:59:00.384345+0000","last_fullsized":"2023-12-15T23:59:00.384345+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864730+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-16T00:00:26.864730+0000","last_peered":"2023-12-16T00:00:26.864730+0000","last_clean":"2023-12-16T00:00:26.864730+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:00:26.864730+0000","last_undegraded":"2023-12-16T00:00:26.864730+0000","last_fullsized":"2023-12-16T00:00:26.864730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382155+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:59:36.382155+0000","last_peered":"2023-12-15T23:59:36.382155+0000","last_clean":"2023-12-15T23:59:36.382155+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:59:36.382155+0000","last_undegraded":"2023-12-15T23:59:36.382155+0000","last_fullsized":"2023-12-15T23:59:36.382155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400947+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:05.400947+0000","last_peered":"2023-12-16T00:00:05.400947+0000","last_clean":"2023-12-16T00:00:05.400947+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:05.400947+0000","last_undegraded":"2023-12-16T00:00:05.400947+0000","last_fullsized":"2023-12-16T00:00:05.400947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.377078+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-15T23:59:20.377078+0000","last_peered":"2023-12-15T23:59:20.377078+0000","last_clean":"2023-12-15T23:59:20.377078+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-15T23:59:20.377078+0000","last_undegraded":"2023-12-15T23:59:20.377078+0000","last_fullsized":"2023-12-15T23:59:20.377078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384717+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:59:46.384717+0000","last_peered":"2023-12-15T23:59:46.384717+0000","last_clean":"2023-12-15T23:59:46.384717+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:59:46.384717+0000","last_undegraded":"2023-12-15T23:59:46.384717+0000","last_fullsized":"2023-12-15T23:59:46.384717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384215+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:59:50.384215+0000","last_peered":"2023-12-15T23:59:50.384215+0000","last_clean":"2023-12-15T23:59:50.384215+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:59:50.384215+0000","last_undegraded":"2023-12-15T23:59:50.384215+0000","last_fullsized":"2023-12-15T23:59:50.384215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137138+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-16T00:00:28.137138+0000","last_peered":"2023-12-16T00:00:28.137138+0000","last_clean":"2023-12-16T00:00:28.137138+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:00:28.137138+0000","last_undegraded":"2023-12-16T00:00:28.137138+0000","last_fullsized":"2023-12-16T00:00:28.137138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5895,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389070+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:59:20.389070+0000","last_peered":"2023-12-15T23:59:20.389070+0000","last_clean":"2023-12-15T23:59:20.389070+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:59:20.389070+0000","last_undegraded":"2023-12-15T23:59:20.389070+0000","last_fullsized":"2023-12-15T23:59:20.389070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.383626+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-15T23:59:00.383626+0000","last_peered":"2023-12-15T23:59:00.383626+0000","last_clean":"2023-12-15T23:59:00.383626+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-15T23:59:00.383626+0000","last_undegraded":"2023-12-15T23:59:00.383626+0000","last_fullsized":"2023-12-15T23:59:00.383626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865135+0000","last_change":"2023-12-15T22:53:32.194522+0000","last_active":"2023-12-16T00:00:26.865135+0000","last_peered":"2023-12-16T00:00:26.865135+0000","last_clean":"2023-12-16T00:00:26.865135+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:00:26.865135+0000","last_undegraded":"2023-12-16T00:00:26.865135+0000","last_fullsized":"2023-12-16T00:00:26.865135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384326+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-15T23:59:00.384326+0000","last_peered":"2023-12-15T23:59:00.384326+0000","last_clean":"2023-12-15T23:59:00.384326+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-15T23:59:00.384326+0000","last_undegraded":"2023-12-15T23:59:00.384326+0000","last_fullsized":"2023-12-15T23:59:00.384326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.385504+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-15T23:59:10.385504+0000","last_peered":"2023-12-15T23:59:10.385504+0000","last_clean":"2023-12-15T23:59:10.385504+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-15T23:59:10.385504+0000","last_undegraded":"2023-12-15T23:59:10.385504+0000","last_fullsized":"2023-12-15T23:59:10.385504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387948+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:05.387948+0000","last_peered":"2023-12-16T00:00:05.387948+0000","last_clean":"2023-12-16T00:00:05.387948+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:05.387948+0000","last_undegraded":"2023-12-16T00:00:05.387948+0000","last_fullsized":"2023-12-16T00:00:05.387948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:06.374589+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-15T23:59:06.374589+0000","last_peered":"2023-12-15T23:59:06.374589+0000","last_clean":"2023-12-15T23:59:06.374589+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-15T23:59:06.374589+0000","last_undegraded":"2023-12-15T23:59:06.374589+0000","last_fullsized":"2023-12-15T23:59:06.374589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395428+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:59:45.395428+0000","last_peered":"2023-12-15T23:59:45.395428+0000","last_clean":"2023-12-15T23:59:45.395428+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:59:45.395428+0000","last_undegraded":"2023-12-15T23:59:45.395428+0000","last_fullsized":"2023-12-15T23:59:45.395428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396667+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:59:50.396667+0000","last_peered":"2023-12-15T23:59:50.396667+0000","last_clean":"2023-12-15T23:59:50.396667+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:59:50.396667+0000","last_undegraded":"2023-12-15T23:59:50.396667+0000","last_fullsized":"2023-12-15T23:59:50.396667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396171+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:59:50.396171+0000","last_peered":"2023-12-15T23:59:50.396171+0000","last_clean":"2023-12-15T23:59:50.396171+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:59:50.396171+0000","last_undegraded":"2023-12-15T23:59:50.396171+0000","last_fullsized":"2023-12-15T23:59:50.396171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016233+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-16T00:00:26.016233+0000","last_peered":"2023-12-16T00:00:26.016233+0000","last_clean":"2023-12-16T00:00:26.016233+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:00:26.016233+0000","last_undegraded":"2023-12-16T00:00:26.016233+0000","last_fullsized":"2023-12-16T00:00:26.016233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385205+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-15T23:59:05.385205+0000","last_peered":"2023-12-15T23:59:05.385205+0000","last_clean":"2023-12-15T23:59:05.385205+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-15T23:59:05.385205+0000","last_undegraded":"2023-12-15T23:59:05.385205+0000","last_fullsized":"2023-12-15T23:59:05.385205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.376091+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-15T23:59:15.376091+0000","last_peered":"2023-12-15T23:59:15.376091+0000","last_clean":"2023-12-15T23:59:15.376091+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-15T23:59:15.376091+0000","last_undegraded":"2023-12-15T23:59:15.376091+0000","last_fullsized":"2023-12-15T23:59:15.376091+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016649+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-16T00:00:26.016649+0000","last_peered":"2023-12-16T00:00:26.016649+0000","last_clean":"2023-12-16T00:00:26.016649+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:00:26.016649+0000","last_undegraded":"2023-12-16T00:00:26.016649+0000","last_fullsized":"2023-12-16T00:00:26.016649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440560+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-16T00:00:26.440560+0000","last_peered":"2023-12-16T00:00:26.440560+0000","last_clean":"2023-12-16T00:00:26.440560+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:00:26.440560+0000","last_undegraded":"2023-12-16T00:00:26.440560+0000","last_fullsized":"2023-12-16T00:00:26.440560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392326+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:59:35.392326+0000","last_peered":"2023-12-15T23:59:35.392326+0000","last_clean":"2023-12-15T23:59:35.392326+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:59:35.392326+0000","last_undegraded":"2023-12-15T23:59:35.392326+0000","last_fullsized":"2023-12-15T23:59:35.392326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612737+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:59:35.612737+0000","last_peered":"2023-12-15T23:59:35.612737+0000","last_clean":"2023-12-15T23:59:35.612737+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:59:35.612737+0000","last_undegraded":"2023-12-15T23:59:35.612737+0000","last_fullsized":"2023-12-15T23:59:35.612737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388063+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-15T23:59:15.388063+0000","last_peered":"2023-12-15T23:59:15.388063+0000","last_clean":"2023-12-15T23:59:15.388063+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-15T23:59:15.388063+0000","last_undegraded":"2023-12-15T23:59:15.388063+0000","last_fullsized":"2023-12-15T23:59:15.388063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395993+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:59:45.395993+0000","last_peered":"2023-12-15T23:59:45.395993+0000","last_clean":"2023-12-15T23:59:45.395993+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:59:45.395993+0000","last_undegraded":"2023-12-15T23:59:45.395993+0000","last_fullsized":"2023-12-15T23:59:45.395993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616027+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:59:50.616027+0000","last_peered":"2023-12-15T23:59:50.616027+0000","last_clean":"2023-12-15T23:59:50.616027+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:59:50.616027+0000","last_undegraded":"2023-12-15T23:59:50.616027+0000","last_fullsized":"2023-12-15T23:59:50.616027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390990+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-15T23:59:25.390990+0000","last_peered":"2023-12-15T23:59:25.390990+0000","last_clean":"2023-12-15T23:59:25.390990+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-15T23:59:25.390990+0000","last_undegraded":"2023-12-15T23:59:25.390990+0000","last_fullsized":"2023-12-15T23:59:25.390990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016287+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-16T00:00:26.016287+0000","last_peered":"2023-12-16T00:00:26.016287+0000","last_clean":"2023-12-16T00:00:26.016287+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:00:26.016287+0000","last_undegraded":"2023-12-16T00:00:26.016287+0000","last_fullsized":"2023-12-16T00:00:26.016287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384294+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-15T23:59:05.384294+0000","last_peered":"2023-12-15T23:59:05.384294+0000","last_clean":"2023-12-15T23:59:05.384294+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-15T23:59:05.384294+0000","last_undegraded":"2023-12-15T23:59:05.384294+0000","last_fullsized":"2023-12-15T23:59:05.384294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387794+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:59:15.387794+0000","last_peered":"2023-12-15T23:59:15.387794+0000","last_clean":"2023-12-15T23:59:15.387794+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:59:15.387794+0000","last_undegraded":"2023-12-15T23:59:15.387794+0000","last_fullsized":"2023-12-15T23:59:15.387794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865156+0000","last_change":"2023-12-15T22:53:32.194984+0000","last_active":"2023-12-16T00:00:26.865156+0000","last_peered":"2023-12-16T00:00:26.865156+0000","last_clean":"2023-12-16T00:00:26.865156+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:00:26.865156+0000","last_undegraded":"2023-12-16T00:00:26.865156+0000","last_fullsized":"2023-12-16T00:00:26.865156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865101+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-16T00:00:26.865101+0000","last_peered":"2023-12-16T00:00:26.865101+0000","last_clean":"2023-12-16T00:00:26.865101+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:00:26.865101+0000","last_undegraded":"2023-12-16T00:00:26.865101+0000","last_fullsized":"2023-12-16T00:00:26.865101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804691+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804691+0000","last_peered":"2023-12-16T00:01:00.804691+0000","last_clean":"2023-12-16T00:01:00.804691+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804691+0000","last_undegraded":"2023-12-16T00:01:00.804691+0000","last_fullsized":"2023-12-16T00:01:00.804691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612574+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:59:35.612574+0000","last_peered":"2023-12-15T23:59:35.612574+0000","last_clean":"2023-12-15T23:59:35.612574+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:59:35.612574+0000","last_undegraded":"2023-12-15T23:59:35.612574+0000","last_fullsized":"2023-12-15T23:59:35.612574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397612+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:59:50.397612+0000","last_peered":"2023-12-15T23:59:50.397612+0000","last_clean":"2023-12-15T23:59:50.397612+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:59:50.397612+0000","last_undegraded":"2023-12-15T23:59:50.397612+0000","last_fullsized":"2023-12-15T23:59:50.397612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.390173+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:59:20.390173+0000","last_peered":"2023-12-15T23:59:20.390173+0000","last_clean":"2023-12-15T23:59:20.390173+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:59:20.390173+0000","last_undegraded":"2023-12-15T23:59:20.390173+0000","last_fullsized":"2023-12-15T23:59:20.390173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.394959+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:59:45.394959+0000","last_peered":"2023-12-15T23:59:45.394959+0000","last_clean":"2023-12-15T23:59:45.394959+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:59:45.394959+0000","last_undegraded":"2023-12-15T23:59:45.394959+0000","last_fullsized":"2023-12-15T23:59:45.394959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":225,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389387+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-15T23:59:25.389387+0000","last_peered":"2023-12-15T23:59:25.389387+0000","last_clean":"2023-12-15T23:59:25.389387+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-15T23:59:25.389387+0000","last_undegraded":"2023-12-15T23:59:25.389387+0000","last_fullsized":"2023-12-15T23:59:25.389387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385796+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:59:51.385796+0000","last_peered":"2023-12-15T23:59:51.385796+0000","last_clean":"2023-12-15T23:59:51.385796+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:59:51.385796+0000","last_undegraded":"2023-12-15T23:59:51.385796+0000","last_fullsized":"2023-12-15T23:59:51.385796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016281+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-16T00:00:26.016281+0000","last_peered":"2023-12-16T00:00:26.016281+0000","last_clean":"2023-12-16T00:00:26.016281+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:00:26.016281+0000","last_undegraded":"2023-12-16T00:00:26.016281+0000","last_fullsized":"2023-12-16T00:00:26.016281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389408+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:59:25.389408+0000","last_peered":"2023-12-15T23:59:25.389408+0000","last_clean":"2023-12-15T23:59:25.389408+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:59:25.389408+0000","last_undegraded":"2023-12-15T23:59:25.389408+0000","last_fullsized":"2023-12-15T23:59:25.389408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.603511+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:59:00.603511+0000","last_peered":"2023-12-15T23:59:00.603511+0000","last_clean":"2023-12-15T23:59:00.603511+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:59:00.603511+0000","last_undegraded":"2023-12-15T23:59:00.603511+0000","last_fullsized":"2023-12-15T23:59:00.603511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712318+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-16T00:00:27.712318+0000","last_peered":"2023-12-16T00:00:27.712318+0000","last_clean":"2023-12-16T00:00:27.712318+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:00:27.712318+0000","last_undegraded":"2023-12-16T00:00:27.712318+0000","last_fullsized":"2023-12-16T00:00:27.712318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.393828+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:59:40.393828+0000","last_peered":"2023-12-15T23:59:40.393828+0000","last_clean":"2023-12-15T23:59:40.393828+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:59:40.393828+0000","last_undegraded":"2023-12-15T23:59:40.393828+0000","last_fullsized":"2023-12-15T23:59:40.393828+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396486+0000","last_change":"2023-12-15T22:53:10.342348+0000","last_active":"2023-12-15T23:59:50.396486+0000","last_peered":"2023-12-15T23:59:50.396486+0000","last_clean":"2023-12-15T23:59:50.396486+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-15T23:59:50.396486+0000","last_undegraded":"2023-12-15T23:59:50.396486+0000","last_fullsized":"2023-12-15T23:59:50.396486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440194+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-16T00:00:26.440194+0000","last_peered":"2023-12-16T00:00:26.440194+0000","last_clean":"2023-12-16T00:00:26.440194+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:00:26.440194+0000","last_undegraded":"2023-12-16T00:00:26.440194+0000","last_fullsized":"2023-12-16T00:00:26.440194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382094+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:59:36.382094+0000","last_peered":"2023-12-15T23:59:36.382094+0000","last_clean":"2023-12-15T23:59:36.382094+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:59:36.382094+0000","last_undegraded":"2023-12-15T23:59:36.382094+0000","last_fullsized":"2023-12-15T23:59:36.382094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6460,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608437+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:59:20.608437+0000","last_peered":"2023-12-15T23:59:20.608437+0000","last_clean":"2023-12-15T23:59:20.608437+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:59:20.608437+0000","last_undegraded":"2023-12-15T23:59:20.608437+0000","last_fullsized":"2023-12-15T23:59:20.608437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:01.373114+0000","last_change":"2023-12-15T22:53:58.170349+0000","last_active":"2023-12-15T23:59:01.373114+0000","last_peered":"2023-12-15T23:59:01.373114+0000","last_clean":"2023-12-15T23:59:01.373114+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-15T23:59:01.373114+0000","last_undegraded":"2023-12-15T23:59:01.373114+0000","last_fullsized":"2023-12-15T23:59:01.373114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712287+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-16T00:00:27.712287+0000","last_peered":"2023-12-16T00:00:27.712287+0000","last_clean":"2023-12-16T00:00:27.712287+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:00:27.712287+0000","last_undegraded":"2023-12-16T00:00:27.712287+0000","last_fullsized":"2023-12-16T00:00:27.712287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288950+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-16T00:00:27.288950+0000","last_peered":"2023-12-16T00:00:27.288950+0000","last_clean":"2023-12-16T00:00:27.288950+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:00:27.288950+0000","last_undegraded":"2023-12-16T00:00:27.288950+0000","last_fullsized":"2023-12-16T00:00:27.288950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383765+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:59:41.383765+0000","last_peered":"2023-12-15T23:59:41.383765+0000","last_clean":"2023-12-15T23:59:41.383765+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:59:41.383765+0000","last_undegraded":"2023-12-15T23:59:41.383765+0000","last_fullsized":"2023-12-15T23:59:41.383765+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783097+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783097+0000","last_peered":"2023-12-16T00:00:53.783097+0000","last_clean":"2023-12-16T00:00:53.783097+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783097+0000","last_undegraded":"2023-12-16T00:00:53.783097+0000","last_fullsized":"2023-12-16T00:00:53.783097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288444+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-16T00:00:27.288444+0000","last_peered":"2023-12-16T00:00:27.288444+0000","last_clean":"2023-12-16T00:00:27.288444+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:00:27.288444+0000","last_undegraded":"2023-12-16T00:00:27.288444+0000","last_fullsized":"2023-12-16T00:00:27.288444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.377949+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-15T23:58:40.377949+0000","last_peered":"2023-12-15T23:58:40.377949+0000","last_clean":"2023-12-15T23:58:40.377949+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-15T23:58:40.377949+0000","last_undegraded":"2023-12-15T23:58:40.377949+0000","last_fullsized":"2023-12-15T23:58:40.377949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.605075+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:59:05.605075+0000","last_peered":"2023-12-15T23:59:05.605075+0000","last_clean":"2023-12-15T23:59:05.605075+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:59:05.605075+0000","last_undegraded":"2023-12-15T23:59:05.605075+0000","last_fullsized":"2023-12-15T23:59:05.605075+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387908+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:59:15.387908+0000","last_peered":"2023-12-15T23:59:15.387908+0000","last_clean":"2023-12-15T23:59:15.387908+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:59:15.387908+0000","last_undegraded":"2023-12-15T23:59:15.387908+0000","last_fullsized":"2023-12-15T23:59:15.387908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384346+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:59:05.384346+0000","last_peered":"2023-12-15T23:59:05.384346+0000","last_clean":"2023-12-15T23:59:05.384346+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:59:05.384346+0000","last_undegraded":"2023-12-15T23:59:05.384346+0000","last_fullsized":"2023-12-15T23:59:05.384346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.396387+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:59:45.396387+0000","last_peered":"2023-12-15T23:59:45.396387+0000","last_clean":"2023-12-15T23:59:45.396387+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:59:45.396387+0000","last_undegraded":"2023-12-15T23:59:45.396387+0000","last_fullsized":"2023-12-15T23:59:45.396387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'176","reported_seq":379,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402107+0000","last_change":"2023-12-15T22:53:28.171094+0000","last_active":"2023-12-16T00:00:10.402107+0000","last_peered":"2023-12-16T00:00:10.402107+0000","last_clean":"2023-12-16T00:00:10.402107+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:00:10.402107+0000","last_undegraded":"2023-12-16T00:00:10.402107+0000","last_fullsized":"2023-12-16T00:00:10.402107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016319+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-16T00:00:26.016319+0000","last_peered":"2023-12-16T00:00:26.016319+0000","last_clean":"2023-12-16T00:00:26.016319+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:00:26.016319+0000","last_undegraded":"2023-12-16T00:00:26.016319+0000","last_fullsized":"2023-12-16T00:00:26.016319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137010+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-16T00:00:28.137010+0000","last_peered":"2023-12-16T00:00:28.137010+0000","last_clean":"2023-12-16T00:00:28.137010+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:00:28.137010+0000","last_undegraded":"2023-12-16T00:00:28.137010+0000","last_fullsized":"2023-12-16T00:00:28.137010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:40.378351+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-15T23:58:40.378351+0000","last_peered":"2023-12-15T23:58:40.378351+0000","last_clean":"2023-12-15T23:58:40.378351+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-15T23:58:40.378351+0000","last_undegraded":"2023-12-15T23:58:40.378351+0000","last_fullsized":"2023-12-15T23:58:40.378351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.379341+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:59:30.379341+0000","last_peered":"2023-12-15T23:59:30.379341+0000","last_clean":"2023-12-15T23:59:30.379341+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:59:30.379341+0000","last_undegraded":"2023-12-15T23:59:30.379341+0000","last_fullsized":"2023-12-15T23:59:30.379341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600593+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-15T23:58:50.600593+0000","last_peered":"2023-12-15T23:58:50.600593+0000","last_clean":"2023-12-15T23:58:50.600593+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-15T23:58:50.600593+0000","last_undegraded":"2023-12-15T23:58:50.600593+0000","last_fullsized":"2023-12-15T23:58:50.600593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1745,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.389126+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-16T00:00:10.389126+0000","last_peered":"2023-12-16T00:00:10.389126+0000","last_clean":"2023-12-16T00:00:10.389126+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:00:10.389126+0000","last_undegraded":"2023-12-16T00:00:10.389126+0000","last_fullsized":"2023-12-16T00:00:10.389126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283617+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283617+0000","last_peered":"2023-12-16T00:00:56.283617+0000","last_clean":"2023-12-16T00:00:56.283617+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283617+0000","last_undegraded":"2023-12-16T00:00:56.283617+0000","last_fullsized":"2023-12-16T00:00:56.283617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137167+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-16T00:00:28.137167+0000","last_peered":"2023-12-16T00:00:28.137167+0000","last_clean":"2023-12-16T00:00:28.137167+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:00:28.137167+0000","last_undegraded":"2023-12-16T00:00:28.137167+0000","last_fullsized":"2023-12-16T00:00:28.137167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016191+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-16T00:00:26.016191+0000","last_peered":"2023-12-16T00:00:26.016191+0000","last_clean":"2023-12-16T00:00:26.016191+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:00:26.016191+0000","last_undegraded":"2023-12-16T00:00:26.016191+0000","last_fullsized":"2023-12-16T00:00:26.016191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389257+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:59:20.389257+0000","last_peered":"2023-12-15T23:59:20.389257+0000","last_clean":"2023-12-15T23:59:20.389257+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:59:20.389257+0000","last_undegraded":"2023-12-15T23:59:20.389257+0000","last_fullsized":"2023-12-15T23:59:20.389257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387446+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:59:15.387446+0000","last_peered":"2023-12-15T23:59:15.387446+0000","last_clean":"2023-12-15T23:59:15.387446+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:59:15.387446+0000","last_undegraded":"2023-12-15T23:59:15.387446+0000","last_fullsized":"2023-12-15T23:59:15.387446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'6","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:46.369538+0000","last_change":"2023-12-15T22:53:32.195514+0000","last_active":"2023-12-15T23:58:46.369538+0000","last_peered":"2023-12-15T23:58:46.369538+0000","last_clean":"2023-12-15T23:58:46.369538+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-15T23:58:46.369538+0000","last_undegraded":"2023-12-15T23:58:46.369538+0000","last_fullsized":"2023-12-15T23:58:46.369538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.380105+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-15T23:58:50.380105+0000","last_peered":"2023-12-15T23:58:50.380105+0000","last_clean":"2023-12-15T23:58:50.380105+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-15T23:58:50.380105+0000","last_undegraded":"2023-12-15T23:58:50.380105+0000","last_fullsized":"2023-12-15T23:58:50.380105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2780,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693751+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693751+0000","last_peered":"2023-12-16T00:00:36.693751+0000","last_clean":"2023-12-16T00:00:36.693751+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693751+0000","last_undegraded":"2023-12-16T00:00:36.693751+0000","last_fullsized":"2023-12-16T00:00:36.693751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'4","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137225+0000","last_change":"2023-12-15T22:53:26.159253+0000","last_active":"2023-12-16T00:00:28.137225+0000","last_peered":"2023-12-16T00:00:28.137225+0000","last_clean":"2023-12-16T00:00:28.137225+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:00:28.137225+0000","last_undegraded":"2023-12-16T00:00:28.137225+0000","last_fullsized":"2023-12-16T00:00:28.137225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393456+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:59:35.393456+0000","last_peered":"2023-12-15T23:59:35.393456+0000","last_clean":"2023-12-15T23:59:35.393456+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:59:35.393456+0000","last_undegraded":"2023-12-15T23:59:35.393456+0000","last_fullsized":"2023-12-15T23:59:35.393456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388768+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-15T23:59:20.388768+0000","last_peered":"2023-12-15T23:59:20.388768+0000","last_clean":"2023-12-15T23:59:20.388768+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-15T23:59:20.388768+0000","last_undegraded":"2023-12-15T23:59:20.388768+0000","last_fullsized":"2023-12-15T23:59:20.388768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288524+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-16T00:00:27.288524+0000","last_peered":"2023-12-16T00:00:27.288524+0000","last_clean":"2023-12-16T00:00:27.288524+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:00:27.288524+0000","last_undegraded":"2023-12-16T00:00:27.288524+0000","last_fullsized":"2023-12-16T00:00:27.288524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.391372+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:59:25.391372+0000","last_peered":"2023-12-15T23:59:25.391372+0000","last_clean":"2023-12-15T23:59:25.391372+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:59:25.391372+0000","last_undegraded":"2023-12-15T23:59:25.391372+0000","last_fullsized":"2023-12-15T23:59:25.391372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383526+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:59:41.383526+0000","last_peered":"2023-12-15T23:59:41.383526+0000","last_clean":"2023-12-15T23:59:41.383526+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:59:41.383526+0000","last_undegraded":"2023-12-15T23:59:41.383526+0000","last_fullsized":"2023-12-15T23:59:41.383526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388655+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:59:15.388655+0000","last_peered":"2023-12-15T23:59:15.388655+0000","last_clean":"2023-12-15T23:59:15.388655+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:59:15.388655+0000","last_undegraded":"2023-12-15T23:59:15.388655+0000","last_fullsized":"2023-12-15T23:59:15.388655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381278+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-15T23:58:50.381278+0000","last_peered":"2023-12-15T23:58:50.381278+0000","last_clean":"2023-12-15T23:58:50.381278+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-15T23:58:50.381278+0000","last_undegraded":"2023-12-15T23:58:50.381278+0000","last_fullsized":"2023-12-15T23:58:50.381278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.370031+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-15T23:58:50.370031+0000","last_peered":"2023-12-15T23:58:50.370031+0000","last_clean":"2023-12-15T23:58:50.370031+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-15T23:58:50.370031+0000","last_undegraded":"2023-12-15T23:58:50.370031+0000","last_fullsized":"2023-12-15T23:58:50.370031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2979,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499811+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499811+0000","last_peered":"2023-12-16T00:00:45.499811+0000","last_clean":"2023-12-16T00:00:45.499811+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499811+0000","last_undegraded":"2023-12-16T00:00:45.499811+0000","last_fullsized":"2023-12-16T00:00:45.499811+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386068+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-15T23:59:10.386068+0000","last_peered":"2023-12-15T23:59:10.386068+0000","last_clean":"2023-12-15T23:59:10.386068+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-15T23:59:10.386068+0000","last_undegraded":"2023-12-15T23:59:10.386068+0000","last_fullsized":"2023-12-15T23:59:10.386068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":553,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395934+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:59:45.395934+0000","last_peered":"2023-12-15T23:59:45.395934+0000","last_clean":"2023-12-15T23:59:45.395934+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:59:45.395934+0000","last_undegraded":"2023-12-15T23:59:45.395934+0000","last_fullsized":"2023-12-15T23:59:45.395934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440205+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-16T00:00:26.440205+0000","last_peered":"2023-12-16T00:00:26.440205+0000","last_clean":"2023-12-16T00:00:26.440205+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:00:26.440205+0000","last_undegraded":"2023-12-16T00:00:26.440205+0000","last_fullsized":"2023-12-16T00:00:26.440205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288621+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-16T00:00:27.288621+0000","last_peered":"2023-12-16T00:00:27.288621+0000","last_clean":"2023-12-16T00:00:27.288621+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:00:27.288621+0000","last_undegraded":"2023-12-16T00:00:27.288621+0000","last_fullsized":"2023-12-16T00:00:27.288621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390239+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:59:25.390239+0000","last_peered":"2023-12-15T23:59:25.390239+0000","last_clean":"2023-12-15T23:59:25.390239+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:59:25.390239+0000","last_undegraded":"2023-12-15T23:59:25.390239+0000","last_fullsized":"2023-12-15T23:59:25.390239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1325,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609089+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:59:20.609089+0000","last_peered":"2023-12-15T23:59:20.609089+0000","last_clean":"2023-12-15T23:59:20.609089+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:59:20.609089+0000","last_undegraded":"2023-12-15T23:59:20.609089+0000","last_fullsized":"2023-12-15T23:59:20.609089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392528+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:59:35.392528+0000","last_peered":"2023-12-15T23:59:35.392528+0000","last_clean":"2023-12-15T23:59:35.392528+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:59:35.392528+0000","last_undegraded":"2023-12-15T23:59:35.392528+0000","last_fullsized":"2023-12-15T23:59:35.392528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381199+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-15T23:58:50.381199+0000","last_peered":"2023-12-15T23:58:50.381199+0000","last_clean":"2023-12-15T23:58:50.381199+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-15T23:58:50.381199+0000","last_undegraded":"2023-12-15T23:58:50.381199+0000","last_fullsized":"2023-12-15T23:58:50.381199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381226+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-15T23:58:50.381226+0000","last_peered":"2023-12-15T23:58:50.381226+0000","last_clean":"2023-12-15T23:58:50.381226+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-15T23:58:50.381226+0000","last_undegraded":"2023-12-15T23:58:50.381226+0000","last_fullsized":"2023-12-15T23:58:50.381226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.600868+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-15T23:58:50.600868+0000","last_peered":"2023-12-15T23:58:50.600868+0000","last_clean":"2023-12-15T23:58:50.600868+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-15T23:58:50.600868+0000","last_undegraded":"2023-12-15T23:58:50.600868+0000","last_fullsized":"2023-12-15T23:58:50.600868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711886+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-16T00:00:27.711886+0000","last_peered":"2023-12-16T00:00:27.711886+0000","last_clean":"2023-12-16T00:00:27.711886+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:00:27.711886+0000","last_undegraded":"2023-12-16T00:00:27.711886+0000","last_fullsized":"2023-12-16T00:00:27.711886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384529+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:59:50.384529+0000","last_peered":"2023-12-15T23:59:50.384529+0000","last_clean":"2023-12-15T23:59:50.384529+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:59:50.384529+0000","last_undegraded":"2023-12-15T23:59:50.384529+0000","last_fullsized":"2023-12-15T23:59:50.384529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609047+0000","last_change":"2023-12-15T22:53:08.330009+0000","last_active":"2023-12-15T23:59:20.609047+0000","last_peered":"2023-12-15T23:59:20.609047+0000","last_clean":"2023-12-15T23:59:20.609047+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-15T23:59:20.609047+0000","last_undegraded":"2023-12-15T23:59:20.609047+0000","last_fullsized":"2023-12-15T23:59:20.609047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288565+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-16T00:00:27.288565+0000","last_peered":"2023-12-16T00:00:27.288565+0000","last_clean":"2023-12-16T00:00:27.288565+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:00:27.288565+0000","last_undegraded":"2023-12-16T00:00:27.288565+0000","last_fullsized":"2023-12-16T00:00:27.288565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.380079+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:59:26.380079+0000","last_peered":"2023-12-15T23:59:26.380079+0000","last_clean":"2023-12-15T23:59:26.380079+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:59:26.380079+0000","last_undegraded":"2023-12-15T23:59:26.380079+0000","last_fullsized":"2023-12-15T23:59:26.380079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3845,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609000+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:59:20.609000+0000","last_peered":"2023-12-15T23:59:20.609000+0000","last_clean":"2023-12-15T23:59:20.609000+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:59:20.609000+0000","last_undegraded":"2023-12-15T23:59:20.609000+0000","last_fullsized":"2023-12-15T23:59:20.609000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:16.377353+0000","last_change":"2023-12-15T22:53:58.171197+0000","last_active":"2023-12-15T23:59:16.377353+0000","last_peered":"2023-12-15T23:59:16.377353+0000","last_clean":"2023-12-15T23:59:16.377353+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-15T23:59:16.377353+0000","last_undegraded":"2023-12-15T23:59:16.377353+0000","last_fullsized":"2023-12-15T23:59:16.377353+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386931+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:59:10.386931+0000","last_peered":"2023-12-15T23:59:10.386931+0000","last_clean":"2023-12-15T23:59:10.386931+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:59:10.386931+0000","last_undegraded":"2023-12-15T23:59:10.386931+0000","last_fullsized":"2023-12-15T23:59:10.386931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:50.381047+0000","last_change":"2023-12-15T22:53:30.176997+0000","last_active":"2023-12-15T23:58:50.381047+0000","last_peered":"2023-12-15T23:58:50.381047+0000","last_clean":"2023-12-15T23:58:50.381047+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-15T23:58:50.381047+0000","last_undegraded":"2023-12-15T23:58:50.381047+0000","last_fullsized":"2023-12-15T23:58:50.381047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16987,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805449+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805449+0000","last_peered":"2023-12-16T00:00:47.805449+0000","last_clean":"2023-12-16T00:00:47.805449+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805449+0000","last_undegraded":"2023-12-16T00:00:47.805449+0000","last_fullsized":"2023-12-16T00:00:47.805449+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390648+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-15T23:59:25.390648+0000","last_peered":"2023-12-15T23:59:25.390648+0000","last_clean":"2023-12-15T23:59:25.390648+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-15T23:59:25.390648+0000","last_undegraded":"2023-12-15T23:59:25.390648+0000","last_fullsized":"2023-12-15T23:59:25.390648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397998+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:59:50.397998+0000","last_peered":"2023-12-15T23:59:50.397998+0000","last_clean":"2023-12-15T23:59:50.397998+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:59:50.397998+0000","last_undegraded":"2023-12-15T23:59:50.397998+0000","last_fullsized":"2023-12-15T23:59:50.397998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288520+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-16T00:00:27.288520+0000","last_peered":"2023-12-16T00:00:27.288520+0000","last_clean":"2023-12-16T00:00:27.288520+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:00:27.288520+0000","last_undegraded":"2023-12-16T00:00:27.288520+0000","last_fullsized":"2023-12-16T00:00:27.288520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:01.388134+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:01.388134+0000","last_peered":"2023-12-16T00:00:01.388134+0000","last_clean":"2023-12-16T00:00:01.388134+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:01.388134+0000","last_undegraded":"2023-12-16T00:00:01.388134+0000","last_fullsized":"2023-12-16T00:00:01.388134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5870,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.379443+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:59:26.379443+0000","last_peered":"2023-12-15T23:59:26.379443+0000","last_clean":"2023-12-15T23:59:26.379443+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:59:26.379443+0000","last_undegraded":"2023-12-15T23:59:26.379443+0000","last_fullsized":"2023-12-15T23:59:26.379443+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388322+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:59:20.388322+0000","last_peered":"2023-12-15T23:59:20.388322+0000","last_clean":"2023-12-15T23:59:20.388322+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:59:20.388322+0000","last_undegraded":"2023-12-15T23:59:20.388322+0000","last_fullsized":"2023-12-15T23:59:20.388322+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.602125+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-15T23:58:55.602125+0000","last_peered":"2023-12-15T23:58:55.602125+0000","last_clean":"2023-12-15T23:58:55.602125+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-15T23:58:55.602125+0000","last_undegraded":"2023-12-15T23:58:55.602125+0000","last_fullsized":"2023-12-15T23:58:55.602125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1508,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.385322+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-15T23:59:05.385322+0000","last_peered":"2023-12-15T23:59:05.385322+0000","last_clean":"2023-12-15T23:59:05.385322+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-15T23:59:05.385322+0000","last_undegraded":"2023-12-15T23:59:05.385322+0000","last_fullsized":"2023-12-15T23:59:05.385322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253625+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253625+0000","last_peered":"2023-12-16T00:00:53.253625+0000","last_clean":"2023-12-16T00:00:53.253625+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253625+0000","last_undegraded":"2023-12-16T00:00:53.253625+0000","last_fullsized":"2023-12-16T00:00:53.253625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016195+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-16T00:00:26.016195+0000","last_peered":"2023-12-16T00:00:26.016195+0000","last_clean":"2023-12-16T00:00:26.016195+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:00:26.016195+0000","last_undegraded":"2023-12-16T00:00:26.016195+0000","last_fullsized":"2023-12-16T00:00:26.016195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288596+0000","last_change":"2023-12-15T22:53:10.339309+0000","last_active":"2023-12-16T00:00:27.288596+0000","last_peered":"2023-12-16T00:00:27.288596+0000","last_clean":"2023-12-16T00:00:27.288596+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:00:27.288596+0000","last_undegraded":"2023-12-16T00:00:27.288596+0000","last_fullsized":"2023-12-16T00:00:27.288596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.386435+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:00.386435+0000","last_peered":"2023-12-16T00:00:00.386435+0000","last_clean":"2023-12-16T00:00:00.386435+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:00.386435+0000","last_undegraded":"2023-12-16T00:00:00.386435+0000","last_fullsized":"2023-12-16T00:00:00.386435+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4019,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.609770+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:59:25.609770+0000","last_peered":"2023-12-15T23:59:25.609770+0000","last_clean":"2023-12-15T23:59:25.609770+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:59:25.609770+0000","last_undegraded":"2023-12-15T23:59:25.609770+0000","last_fullsized":"2023-12-15T23:59:25.609770+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389659+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:59:20.389659+0000","last_peered":"2023-12-15T23:59:20.389659+0000","last_clean":"2023-12-15T23:59:20.389659+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:59:20.389659+0000","last_undegraded":"2023-12-15T23:59:20.389659+0000","last_fullsized":"2023-12-15T23:59:20.389659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.381825+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-15T23:58:55.381825+0000","last_peered":"2023-12-15T23:58:55.381825+0000","last_clean":"2023-12-15T23:58:55.381825+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-15T23:58:55.381825+0000","last_undegraded":"2023-12-15T23:58:55.381825+0000","last_fullsized":"2023-12-15T23:58:55.381825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1436,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.369094+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-15T23:58:45.369094+0000","last_peered":"2023-12-15T23:58:45.369094+0000","last_clean":"2023-12-15T23:58:45.369094+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-15T23:58:45.369094+0000","last_undegraded":"2023-12-15T23:58:45.369094+0000","last_fullsized":"2023-12-15T23:58:45.369094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":341,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.603693+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-15T23:59:00.603693+0000","last_peered":"2023-12-15T23:59:00.603693+0000","last_clean":"2023-12-15T23:59:00.603693+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-15T23:59:00.603693+0000","last_undegraded":"2023-12-15T23:59:00.603693+0000","last_fullsized":"2023-12-15T23:59:00.603693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288505+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-16T00:00:27.288505+0000","last_peered":"2023-12-16T00:00:27.288505+0000","last_clean":"2023-12-16T00:00:27.288505+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:00:27.288505+0000","last_undegraded":"2023-12-16T00:00:27.288505+0000","last_fullsized":"2023-12-16T00:00:27.288505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399036+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:00.399036+0000","last_peered":"2023-12-16T00:00:00.399036+0000","last_clean":"2023-12-16T00:00:00.399036+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:00.399036+0000","last_undegraded":"2023-12-16T00:00:00.399036+0000","last_fullsized":"2023-12-16T00:00:00.399036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3629,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378366+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:59:25.378366+0000","last_peered":"2023-12-15T23:59:25.378366+0000","last_clean":"2023-12-15T23:59:25.378366+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:59:25.378366+0000","last_undegraded":"2023-12-15T23:59:25.378366+0000","last_fullsized":"2023-12-15T23:59:25.378366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608453+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:59:20.608453+0000","last_peered":"2023-12-15T23:59:20.608453+0000","last_clean":"2023-12-15T23:59:20.608453+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:59:20.608453+0000","last_undegraded":"2023-12-15T23:59:20.608453+0000","last_fullsized":"2023-12-15T23:59:20.608453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.382431+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-15T23:58:55.382431+0000","last_peered":"2023-12-15T23:58:55.382431+0000","last_clean":"2023-12-15T23:58:55.382431+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-15T23:58:55.382431+0000","last_undegraded":"2023-12-15T23:58:55.382431+0000","last_fullsized":"2023-12-15T23:58:55.382431+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379928+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-15T23:58:45.379928+0000","last_peered":"2023-12-15T23:58:45.379928+0000","last_clean":"2023-12-15T23:58:45.379928+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-15T23:58:45.379928+0000","last_undegraded":"2023-12-15T23:58:45.379928+0000","last_fullsized":"2023-12-15T23:58:45.379928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'111","reported_seq":248,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.380349+0000","last_change":"2023-12-15T22:53:28.166700+0000","last_active":"2023-12-15T23:58:45.380349+0000","last_peered":"2023-12-15T23:58:45.380349+0000","last_clean":"2023-12-15T23:58:45.380349+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-15T23:58:45.380349+0000","last_undegraded":"2023-12-15T23:58:45.380349+0000","last_fullsized":"2023-12-15T23:58:45.380349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808317+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808317+0000","last_peered":"2023-12-16T00:00:56.808317+0000","last_clean":"2023-12-16T00:00:56.808317+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808317+0000","last_undegraded":"2023-12-16T00:00:56.808317+0000","last_fullsized":"2023-12-16T00:00:56.808317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.375076+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-15T23:59:10.375076+0000","last_peered":"2023-12-15T23:59:10.375076+0000","last_clean":"2023-12-15T23:59:10.375076+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-15T23:59:10.375076+0000","last_undegraded":"2023-12-15T23:59:10.375076+0000","last_fullsized":"2023-12-15T23:59:10.375076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288549+0000","last_change":"2023-12-15T22:53:10.341499+0000","last_active":"2023-12-16T00:00:27.288549+0000","last_peered":"2023-12-16T00:00:27.288549+0000","last_clean":"2023-12-16T00:00:27.288549+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:00:27.288549+0000","last_undegraded":"2023-12-16T00:00:27.288549+0000","last_fullsized":"2023-12-16T00:00:27.288549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.618769+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:00.618769+0000","last_peered":"2023-12-16T00:00:00.618769+0000","last_clean":"2023-12-16T00:00:00.618769+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:00.618769+0000","last_undegraded":"2023-12-16T00:00:00.618769+0000","last_fullsized":"2023-12-16T00:00:00.618769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1275,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378284+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:59:25.378284+0000","last_peered":"2023-12-15T23:59:25.378284+0000","last_clean":"2023-12-15T23:59:25.378284+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:59:25.378284+0000","last_undegraded":"2023-12-15T23:59:25.378284+0000","last_fullsized":"2023-12-15T23:59:25.378284+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608574+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:59:20.608574+0000","last_peered":"2023-12-15T23:59:20.608574+0000","last_clean":"2023-12-15T23:59:20.608574+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:59:20.608574+0000","last_undegraded":"2023-12-15T23:59:20.608574+0000","last_fullsized":"2023-12-15T23:59:20.608574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":386,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.381640+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-15T23:58:55.381640+0000","last_peered":"2023-12-15T23:58:55.381640+0000","last_clean":"2023-12-15T23:58:55.381640+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-15T23:58:55.381640+0000","last_undegraded":"2023-12-15T23:58:55.381640+0000","last_fullsized":"2023-12-15T23:58:55.381640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:45.379999+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-15T23:58:45.379999+0000","last_peered":"2023-12-15T23:58:45.379999+0000","last_clean":"2023-12-15T23:58:45.379999+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-15T23:58:45.379999+0000","last_undegraded":"2023-12-15T23:58:45.379999+0000","last_fullsized":"2023-12-15T23:58:45.379999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049253+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049253+0000","last_peered":"2023-12-16T00:00:42.049253+0000","last_clean":"2023-12-16T00:00:42.049253+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049253+0000","last_undegraded":"2023-12-16T00:00:42.049253+0000","last_fullsized":"2023-12-16T00:00:42.049253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392748+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:59:35.392748+0000","last_peered":"2023-12-15T23:59:35.392748+0000","last_clean":"2023-12-15T23:59:35.392748+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:59:35.392748+0000","last_undegraded":"2023-12-15T23:59:35.392748+0000","last_fullsized":"2023-12-15T23:59:35.392748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711833+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-16T00:00:27.711833+0000","last_peered":"2023-12-16T00:00:27.711833+0000","last_clean":"2023-12-16T00:00:27.711833+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:00:27.711833+0000","last_undegraded":"2023-12-16T00:00:27.711833+0000","last_fullsized":"2023-12-16T00:00:27.711833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864860+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-16T00:00:26.864860+0000","last_peered":"2023-12-16T00:00:26.864860+0000","last_clean":"2023-12-16T00:00:26.864860+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:00:26.864860+0000","last_undegraded":"2023-12-16T00:00:26.864860+0000","last_fullsized":"2023-12-16T00:00:26.864860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620720+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:05.620720+0000","last_peered":"2023-12-16T00:00:05.620720+0000","last_clean":"2023-12-16T00:00:05.620720+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:05.620720+0000","last_undegraded":"2023-12-16T00:00:05.620720+0000","last_fullsized":"2023-12-16T00:00:05.620720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382010+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:59:36.382010+0000","last_peered":"2023-12-15T23:59:36.382010+0000","last_clean":"2023-12-15T23:59:36.382010+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:59:36.382010+0000","last_undegraded":"2023-12-15T23:59:36.382010+0000","last_fullsized":"2023-12-15T23:59:36.382010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'7","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137347+0000","last_change":"2023-12-15T22:53:26.165870+0000","last_active":"2023-12-16T00:00:28.137347+0000","last_peered":"2023-12-16T00:00:28.137347+0000","last_clean":"2023-12-16T00:00:28.137347+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:00:28.137347+0000","last_undegraded":"2023-12-16T00:00:28.137347+0000","last_fullsized":"2023-12-16T00:00:28.137347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620638+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:05.620638+0000","last_peered":"2023-12-16T00:00:05.620638+0000","last_clean":"2023-12-16T00:00:05.620638+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:05.620638+0000","last_undegraded":"2023-12-16T00:00:05.620638+0000","last_fullsized":"2023-12-16T00:00:05.620638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380482+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:59:35.380482+0000","last_peered":"2023-12-15T23:59:35.380482+0000","last_clean":"2023-12-15T23:59:35.380482+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:59:35.380482+0000","last_undegraded":"2023-12-15T23:59:35.380482+0000","last_fullsized":"2023-12-15T23:59:35.380482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'3","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137488+0000","last_change":"2023-12-15T22:53:26.158586+0000","last_active":"2023-12-16T00:00:28.137488+0000","last_peered":"2023-12-16T00:00:28.137488+0000","last_clean":"2023-12-16T00:00:28.137488+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:00:28.137488+0000","last_undegraded":"2023-12-16T00:00:28.137488+0000","last_fullsized":"2023-12-16T00:00:28.137488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401415+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:05.401415+0000","last_peered":"2023-12-16T00:00:05.401415+0000","last_clean":"2023-12-16T00:00:05.401415+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:05.401415+0000","last_undegraded":"2023-12-16T00:00:05.401415+0000","last_fullsized":"2023-12-16T00:00:05.401415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615003+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:59:45.615003+0000","last_peered":"2023-12-15T23:59:45.615003+0000","last_clean":"2023-12-15T23:59:45.615003+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:59:45.615003+0000","last_undegraded":"2023-12-15T23:59:45.615003+0000","last_fullsized":"2023-12-15T23:59:45.615003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'7","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288745+0000","last_change":"2023-12-15T22:53:26.156834+0000","last_active":"2023-12-16T00:00:27.288745+0000","last_peered":"2023-12-16T00:00:27.288745+0000","last_clean":"2023-12-16T00:00:27.288745+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:00:27.288745+0000","last_undegraded":"2023-12-16T00:00:27.288745+0000","last_fullsized":"2023-12-16T00:00:27.288745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620423+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:05.620423+0000","last_peered":"2023-12-16T00:00:05.620423+0000","last_clean":"2023-12-16T00:00:05.620423+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:05.620423+0000","last_undegraded":"2023-12-16T00:00:05.620423+0000","last_fullsized":"2023-12-16T00:00:05.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396136+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:59:50.396136+0000","last_peered":"2023-12-15T23:59:50.396136+0000","last_clean":"2023-12-15T23:59:50.396136+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:59:50.396136+0000","last_undegraded":"2023-12-15T23:59:50.396136+0000","last_fullsized":"2023-12-15T23:59:50.396136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384350+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:59:50.384350+0000","last_peered":"2023-12-15T23:59:50.384350+0000","last_clean":"2023-12-15T23:59:50.384350+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:59:50.384350+0000","last_undegraded":"2023-12-15T23:59:50.384350+0000","last_fullsized":"2023-12-15T23:59:50.384350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400762+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:05.400762+0000","last_peered":"2023-12-16T00:00:05.400762+0000","last_clean":"2023-12-16T00:00:05.400762+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:05.400762+0000","last_undegraded":"2023-12-16T00:00:05.400762+0000","last_fullsized":"2023-12-16T00:00:05.400762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382239+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:59:36.382239+0000","last_peered":"2023-12-15T23:59:36.382239+0000","last_clean":"2023-12-15T23:59:36.382239+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:59:36.382239+0000","last_undegraded":"2023-12-15T23:59:36.382239+0000","last_fullsized":"2023-12-15T23:59:36.382239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620507+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:05.620507+0000","last_peered":"2023-12-16T00:00:05.620507+0000","last_clean":"2023-12-16T00:00:05.620507+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:05.620507+0000","last_undegraded":"2023-12-16T00:00:05.620507+0000","last_fullsized":"2023-12-16T00:00:05.620507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612481+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:59:35.612481+0000","last_peered":"2023-12-15T23:59:35.612481+0000","last_clean":"2023-12-15T23:59:35.612481+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:59:35.612481+0000","last_undegraded":"2023-12-15T23:59:35.612481+0000","last_fullsized":"2023-12-15T23:59:35.612481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400859+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:05.400859+0000","last_peered":"2023-12-16T00:00:05.400859+0000","last_clean":"2023-12-16T00:00:05.400859+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:05.400859+0000","last_undegraded":"2023-12-16T00:00:05.400859+0000","last_fullsized":"2023-12-16T00:00:05.400859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:58:55.371667+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-15T23:58:55.371667+0000","last_peered":"2023-12-15T23:58:55.371667+0000","last_clean":"2023-12-15T23:58:55.371667+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-15T23:58:55.371667+0000","last_undegraded":"2023-12-15T23:58:55.371667+0000","last_fullsized":"2023-12-15T23:58:55.371667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392865+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:59:35.392865+0000","last_peered":"2023-12-15T23:59:35.392865+0000","last_clean":"2023-12-15T23:59:35.392865+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:59:35.392865+0000","last_undegraded":"2023-12-15T23:59:35.392865+0000","last_fullsized":"2023-12-15T23:59:35.392865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387959+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:05.387959+0000","last_peered":"2023-12-16T00:00:05.387959+0000","last_clean":"2023-12-16T00:00:05.387959+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:05.387959+0000","last_undegraded":"2023-12-16T00:00:05.387959+0000","last_fullsized":"2023-12-16T00:00:05.387959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940181+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940181+0000","last_peered":"2023-12-16T00:00:51.940181+0000","last_clean":"2023-12-16T00:00:51.940181+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940181+0000","last_undegraded":"2023-12-16T00:00:51.940181+0000","last_fullsized":"2023-12-16T00:00:51.940181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391410+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-16T00:00:20.391410+0000","last_peered":"2023-12-16T00:00:20.391410+0000","last_clean":"2023-12-16T00:00:20.391410+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:00:20.391410+0000","last_undegraded":"2023-12-16T00:00:20.391410+0000","last_fullsized":"2023-12-16T00:00:20.391410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271600+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271600+0000","last_peered":"2023-12-16T00:00:41.271600+0000","last_clean":"2023-12-16T00:00:41.271600+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271600+0000","last_undegraded":"2023-12-16T00:00:41.271600+0000","last_fullsized":"2023-12-16T00:00:41.271600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":246,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925084+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925084+0000","last_peered":"2023-12-16T00:00:48.925084+0000","last_clean":"2023-12-16T00:00:48.925084+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925084+0000","last_undegraded":"2023-12-16T00:00:48.925084+0000","last_fullsized":"2023-12-16T00:00:48.925084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828204+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828204+0000","last_peered":"2023-12-16T00:00:52.828204+0000","last_clean":"2023-12-16T00:00:52.828204+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828204+0000","last_undegraded":"2023-12-16T00:00:52.828204+0000","last_fullsized":"2023-12-16T00:00:52.828204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864858+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-16T00:00:26.864858+0000","last_peered":"2023-12-16T00:00:26.864858+0000","last_clean":"2023-12-16T00:00:26.864858+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:00:26.864858+0000","last_undegraded":"2023-12-16T00:00:26.864858+0000","last_fullsized":"2023-12-16T00:00:26.864858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276225+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276225+0000","last_peered":"2023-12-16T00:01:02.276225+0000","last_clean":"2023-12-16T00:01:02.276225+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276225+0000","last_undegraded":"2023-12-16T00:01:02.276225+0000","last_fullsized":"2023-12-16T00:01:02.276225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016487+0000","last_change":"2023-12-15T22:53:26.164137+0000","last_active":"2023-12-16T00:00:26.016487+0000","last_peered":"2023-12-16T00:00:26.016487+0000","last_clean":"2023-12-16T00:00:26.016487+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:00:26.016487+0000","last_undegraded":"2023-12-16T00:00:26.016487+0000","last_fullsized":"2023-12-16T00:00:26.016487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864906+0000","last_change":"2023-12-15T22:53:26.161779+0000","last_active":"2023-12-16T00:00:26.864906+0000","last_peered":"2023-12-16T00:00:26.864906+0000","last_clean":"2023-12-16T00:00:26.864906+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:00:26.864906+0000","last_undegraded":"2023-12-16T00:00:26.864906+0000","last_fullsized":"2023-12-16T00:00:26.864906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":772,"ondisk_log_size":772,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":608043,"num_omap_keys":2730,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23165,"ondisk_log_size":23165,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4629,"ondisk_log_size":4629,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608385,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46456,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811144,"statfs":{"total":107374182400,"available":107326611456,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.44800000000000001,"5min":0.33900000000000002,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.26900000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.5}]},{"osd":1,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.28699999999999998},"max":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":1.004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":1.044},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.309,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.30299999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:00:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.375,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":1.149},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27500000000000002},"max":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.63},"last":0.32000000000000001}]}]},{"osd":5,"up_from":11,"seq":47244641087,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.503,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.622}]},{"osd":1,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.374,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69199999999999995,"5min":0.879,"15min":0.879},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.371},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.754,"15min":0.754},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.63},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.61099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.377}]}]},{"osd":3,"up_from":11,"seq":47244641089,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37332,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820268,"statfs":{"total":107374182400,"available":107335954432,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.501},"min":{"1min":0.37,"5min":0.315,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":0.64600000000000002,"15min":0.74199999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.496}]},{"osd":2,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.70199999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.318},"max":{"1min":0.61099999999999999,"5min":0.67400000000000004,"15min":0.76500000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Dec 16 00:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.433}]},{"osd":5,"last update":"Sat Dec 16 00:00:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.504,"5min":0.58599999999999997,"15min":0.748},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41899999999999998,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.28100000000000003,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"last":0.47899999999999998}]}]},{"osd":2,"up_from":11,"seq":47244641086,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":0.41899999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.33800000000000002,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.40300000000000002,"5min":0.87,"15min":0.87},"last":0.371}]},{"osd":1,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.33900000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.39500000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.45000000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.71899999999999997,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.29399999999999998},"max":{"1min":0.73599999999999999,"5min":1.169,"15min":1.169},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45800000000000002}]}]},{"osd":1,"up_from":11,"seq":47244641087,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.247,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":0.434,"5min":0.436,"15min":0.53100000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.26300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44900000000000001,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.315},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29999999999999999},"max":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.75700000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.76700000000000002,"15min":0.878},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47399999999999998}]}]},{"osd":0,"up_from":11,"seq":47244641087,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.434,"5min":0.46400000000000002,"15min":0.51200000000000001},"last":0.308},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23499999999999999,"15min":0.20799999999999999},"max":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34000000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.45200000000000001,"5min":0.5,"15min":0.5},"last":0.254},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68999999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.57499999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.33700000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.875},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:01:09.468 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.469 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.469 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.469 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.469 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.469 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.470 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.470 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.470 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.470 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.470 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.471 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.472 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.472 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.472 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.472 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.472 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.473 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.473 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.473 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.473 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.473 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.474 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.475 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.475 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.475 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.475 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.475 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.476 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.476 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.476 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.476 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.476 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.477 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.478 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.478 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.478 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.478 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.478 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.479 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.480 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.480 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.480 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.480 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.480 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.481 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.481 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.481 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.481 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.481 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.482 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.483 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.484 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.484 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.484 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.484 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.484 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.485 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.486 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.486 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.486 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.486 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.486 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.487 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.488 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.488 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.488 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.488 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.488 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.489 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.489 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.489 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.489 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.489 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.490 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.491 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.491 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.491 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.491 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.491 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.492 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.493 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.493 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.493 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.493 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.493 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.494 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.494 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.494 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.494 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.494 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.495 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.496 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.497 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.497 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.497 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.497 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.497 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.498 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.498 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.498 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.498 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.499 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.500 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.500 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.500 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.500 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.500 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.501 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.502 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.502 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.502 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.502 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.502 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.503 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.504 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.504 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.504 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.504 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.504 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.505 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.505 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.505 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.505 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.505 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.506 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.507 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.508 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.508 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.508 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.508 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.508 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.509 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.510 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.510 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.510 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.510 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.510 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.511 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.511 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.511 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.511 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.511 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.512 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.513 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.513 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.513 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.513 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.513 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.514 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.515 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.515 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.515 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.515 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.515 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.516 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.516 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.516 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.516 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.516 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.517 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.518 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.518 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.518 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.518 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.518 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.519 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.520 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.520 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.520 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.520 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.520 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.521 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.522 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.522 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.522 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.522 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.522 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.523 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.524 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.524 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.524 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.524 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.524 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.525 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.525 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.525 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.525 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.525 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.526 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.527 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.528 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.528 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.528 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.528 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.528 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.529 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.529 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.529 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.529 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.529 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.530 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.530 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.530 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.530 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.530 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.531 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.532 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.533 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.533 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.533 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.533 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.533 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.534 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.534 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.534 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.534 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.534 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.535 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.536 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.536 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.536 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.536 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.536 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.537 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.537 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.537 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.537 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.537 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.538 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.538 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.538 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.538 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.538 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.539 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.540 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.540 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.540 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.540 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.540 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.541 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.542 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.542 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.542 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.542 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.542 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.543 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.544 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.544 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.544 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.544 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.544 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.545 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.545 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.545 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.545 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.545 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.546 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.547 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.547 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.547 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.547 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.547 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.548 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.549 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.549 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.549 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.549 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.549 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.550 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.550 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.550 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.550 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.550 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.551 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.551 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.551 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.551 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.551 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.552 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.552 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.552 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:09.552 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:01:29.553 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:01:29.894 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:01:29.914 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:01:29.917 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2130,"stamp":"2023-12-16T00:01:28.203054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660651,"num_omap_keys":2963,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35104,"ondisk_log_size":35104,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":295448,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":285558,"kb_avail":628850152,"statfs":{"total":644245094400,"available":643942555648,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":292412065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52608,"num_omap_keys":233,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006341"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393475+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-15T23:59:35.393475+0000","last_peered":"2023-12-15T23:59:35.393475+0000","last_clean":"2023-12-15T23:59:35.393475+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-15T23:59:35.393475+0000","last_undegraded":"2023-12-15T23:59:35.393475+0000","last_fullsized":"2023-12-15T23:59:35.393475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612905+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-15T23:59:35.612905+0000","last_peered":"2023-12-15T23:59:35.612905+0000","last_clean":"2023-12-15T23:59:35.612905+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-15T23:59:35.612905+0000","last_undegraded":"2023-12-15T23:59:35.612905+0000","last_fullsized":"2023-12-15T23:59:35.612905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615260+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:59:45.615260+0000","last_peered":"2023-12-15T23:59:45.615260+0000","last_clean":"2023-12-15T23:59:45.615260+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:59:45.615260+0000","last_undegraded":"2023-12-15T23:59:45.615260+0000","last_fullsized":"2023-12-15T23:59:45.615260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382500+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-15T23:59:36.382500+0000","last_peered":"2023-12-15T23:59:36.382500+0000","last_clean":"2023-12-15T23:59:36.382500+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-15T23:59:36.382500+0000","last_undegraded":"2023-12-15T23:59:36.382500+0000","last_fullsized":"2023-12-15T23:59:36.382500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.394007+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-15T23:59:35.394007+0000","last_peered":"2023-12-15T23:59:35.394007+0000","last_clean":"2023-12-15T23:59:35.394007+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-15T23:59:35.394007+0000","last_undegraded":"2023-12-15T23:59:35.394007+0000","last_fullsized":"2023-12-15T23:59:35.394007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380896+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-15T23:59:35.380896+0000","last_peered":"2023-12-15T23:59:35.380896+0000","last_clean":"2023-12-15T23:59:35.380896+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-15T23:59:35.380896+0000","last_undegraded":"2023-12-15T23:59:35.380896+0000","last_fullsized":"2023-12-15T23:59:35.380896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712145+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712145+0000","last_peered":"2023-12-16T00:00:37.712145+0000","last_clean":"2023-12-16T00:00:37.712145+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712145+0000","last_undegraded":"2023-12-16T00:00:37.712145+0000","last_fullsized":"2023-12-16T00:00:37.712145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129461+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129461+0000","last_peered":"2023-12-16T00:00:29.129461+0000","last_clean":"2023-12-16T00:00:29.129461+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129461+0000","last_undegraded":"2023-12-16T00:00:29.129461+0000","last_fullsized":"2023-12-16T00:00:29.129461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887146+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887146+0000","last_peered":"2023-12-16T00:01:04.887146+0000","last_clean":"2023-12-16T00:01:04.887146+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887146+0000","last_undegraded":"2023-12-16T00:01:04.887146+0000","last_fullsized":"2023-12-16T00:01:04.887146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'7","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387875+0000","last_change":"2023-12-15T22:53:26.162732+0000","last_active":"2023-12-16T00:00:05.387875+0000","last_peered":"2023-12-16T00:00:05.387875+0000","last_clean":"2023-12-16T00:00:05.387875+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:00:05.387875+0000","last_undegraded":"2023-12-16T00:00:05.387875+0000","last_fullsized":"2023-12-16T00:00:05.387875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864867+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-16T00:00:26.864867+0000","last_peered":"2023-12-16T00:00:26.864867+0000","last_clean":"2023-12-16T00:00:26.864867+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:00:26.864867+0000","last_undegraded":"2023-12-16T00:00:26.864867+0000","last_fullsized":"2023-12-16T00:00:26.864867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1694,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404611+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:20.404611+0000","last_peered":"2023-12-16T00:00:20.404611+0000","last_clean":"2023-12-16T00:00:20.404611+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:20.404611+0000","last_undegraded":"2023-12-16T00:00:20.404611+0000","last_fullsized":"2023-12-16T00:00:20.404611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.384079+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-15T23:59:00.384079+0000","last_peered":"2023-12-15T23:59:00.384079+0000","last_clean":"2023-12-15T23:59:00.384079+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-15T23:59:00.384079+0000","last_undegraded":"2023-12-15T23:59:00.384079+0000","last_fullsized":"2023-12-15T23:59:00.384079+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864737+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-16T00:00:26.864737+0000","last_peered":"2023-12-16T00:00:26.864737+0000","last_clean":"2023-12-16T00:00:26.864737+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:00:26.864737+0000","last_undegraded":"2023-12-16T00:00:26.864737+0000","last_fullsized":"2023-12-16T00:00:26.864737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711857+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-16T00:00:27.711857+0000","last_peered":"2023-12-16T00:00:27.711857+0000","last_clean":"2023-12-16T00:00:27.711857+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:00:27.711857+0000","last_undegraded":"2023-12-16T00:00:27.711857+0000","last_fullsized":"2023-12-16T00:00:27.711857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137042+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-16T00:00:28.137042+0000","last_peered":"2023-12-16T00:00:28.137042+0000","last_clean":"2023-12-16T00:00:28.137042+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:00:28.137042+0000","last_undegraded":"2023-12-16T00:00:28.137042+0000","last_fullsized":"2023-12-16T00:00:28.137042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.383995+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-15T23:59:00.383995+0000","last_peered":"2023-12-15T23:59:00.383995+0000","last_clean":"2023-12-15T23:59:00.383995+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-15T23:59:00.383995+0000","last_undegraded":"2023-12-15T23:59:00.383995+0000","last_fullsized":"2023-12-15T23:59:00.383995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016740+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-16T00:00:26.016740+0000","last_peered":"2023-12-16T00:00:26.016740+0000","last_clean":"2023-12-16T00:00:26.016740+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:00:26.016740+0000","last_undegraded":"2023-12-16T00:00:26.016740+0000","last_fullsized":"2023-12-16T00:00:26.016740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'10","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137246+0000","last_change":"2023-12-15T22:53:26.159694+0000","last_active":"2023-12-16T00:00:28.137246+0000","last_peered":"2023-12-16T00:00:28.137246+0000","last_clean":"2023-12-16T00:00:28.137246+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:00:28.137246+0000","last_undegraded":"2023-12-16T00:00:28.137246+0000","last_fullsized":"2023-12-16T00:00:28.137246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137126+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-16T00:00:28.137126+0000","last_peered":"2023-12-16T00:00:28.137126+0000","last_clean":"2023-12-16T00:00:28.137126+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:00:28.137126+0000","last_undegraded":"2023-12-16T00:00:28.137126+0000","last_fullsized":"2023-12-16T00:00:28.137126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711788+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-16T00:00:27.711788+0000","last_peered":"2023-12-16T00:00:27.711788+0000","last_clean":"2023-12-16T00:00:27.711788+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:00:27.711788+0000","last_undegraded":"2023-12-16T00:00:27.711788+0000","last_fullsized":"2023-12-16T00:00:27.711788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384625+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-15T23:59:05.384625+0000","last_peered":"2023-12-15T23:59:05.384625+0000","last_clean":"2023-12-15T23:59:05.384625+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-15T23:59:05.384625+0000","last_undegraded":"2023-12-15T23:59:05.384625+0000","last_fullsized":"2023-12-15T23:59:05.384625+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842553+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842553+0000","last_peered":"2023-12-16T00:01:24.842553+0000","last_clean":"2023-12-16T00:01:24.842553+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842553+0000","last_undegraded":"2023-12-16T00:01:24.842553+0000","last_fullsized":"2023-12-16T00:01:24.842553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'7","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384930+0000","last_change":"2023-12-15T22:53:32.199988+0000","last_active":"2023-12-15T23:59:46.384930+0000","last_peered":"2023-12-15T23:59:46.384930+0000","last_clean":"2023-12-15T23:59:46.384930+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-15T23:59:46.384930+0000","last_undegraded":"2023-12-15T23:59:46.384930+0000","last_fullsized":"2023-12-15T23:59:46.384930+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016303+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-16T00:00:26.016303+0000","last_peered":"2023-12-16T00:00:26.016303+0000","last_clean":"2023-12-16T00:00:26.016303+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:00:26.016303+0000","last_undegraded":"2023-12-16T00:00:26.016303+0000","last_fullsized":"2023-12-16T00:00:26.016303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288485+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-16T00:00:27.288485+0000","last_peered":"2023-12-16T00:00:27.288485+0000","last_clean":"2023-12-16T00:00:27.288485+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:00:27.288485+0000","last_undegraded":"2023-12-16T00:00:27.288485+0000","last_fullsized":"2023-12-16T00:00:27.288485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":984,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384699+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-15T23:59:05.384699+0000","last_peered":"2023-12-15T23:59:05.384699+0000","last_clean":"2023-12-15T23:59:05.384699+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-15T23:59:05.384699+0000","last_undegraded":"2023-12-15T23:59:05.384699+0000","last_fullsized":"2023-12-15T23:59:05.384699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840606+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840606+0000","last_peered":"2023-12-16T00:01:18.840606+0000","last_clean":"2023-12-16T00:01:18.840606+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840606+0000","last_undegraded":"2023-12-16T00:01:18.840606+0000","last_fullsized":"2023-12-16T00:01:18.840606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403315+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-16T00:00:15.403315+0000","last_peered":"2023-12-16T00:00:15.403315+0000","last_clean":"2023-12-16T00:00:15.403315+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:00:15.403315+0000","last_undegraded":"2023-12-16T00:00:15.403315+0000","last_fullsized":"2023-12-16T00:00:15.403315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711864+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-16T00:00:27.711864+0000","last_peered":"2023-12-16T00:00:27.711864+0000","last_clean":"2023-12-16T00:00:27.711864+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:00:27.711864+0000","last_undegraded":"2023-12-16T00:00:27.711864+0000","last_fullsized":"2023-12-16T00:00:27.711864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":797,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440204+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-16T00:00:26.440204+0000","last_peered":"2023-12-16T00:00:26.440204+0000","last_clean":"2023-12-16T00:00:26.440204+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:00:26.440204+0000","last_undegraded":"2023-12-16T00:00:26.440204+0000","last_fullsized":"2023-12-16T00:00:26.440204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289103+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-16T00:00:27.289103+0000","last_peered":"2023-12-16T00:00:27.289103+0000","last_clean":"2023-12-16T00:00:27.289103+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:00:27.289103+0000","last_undegraded":"2023-12-16T00:00:27.289103+0000","last_fullsized":"2023-12-16T00:00:27.289103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'9","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384367+0000","last_change":"2023-12-15T22:53:32.192976+0000","last_active":"2023-12-15T23:59:46.384367+0000","last_peered":"2023-12-15T23:59:46.384367+0000","last_clean":"2023-12-15T23:59:46.384367+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-15T23:59:46.384367+0000","last_undegraded":"2023-12-15T23:59:46.384367+0000","last_fullsized":"2023-12-15T23:59:46.384367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137476+0000","last_change":"2023-12-15T22:53:30.180928+0000","last_active":"2023-12-16T00:00:28.137476+0000","last_peered":"2023-12-16T00:00:28.137476+0000","last_clean":"2023-12-16T00:00:28.137476+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:00:28.137476+0000","last_undegraded":"2023-12-16T00:00:28.137476+0000","last_fullsized":"2023-12-16T00:00:28.137476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173626+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173626+0000","last_peered":"2023-12-16T00:01:08.173626+0000","last_clean":"2023-12-16T00:01:08.173626+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173626+0000","last_undegraded":"2023-12-16T00:01:08.173626+0000","last_fullsized":"2023-12-16T00:01:08.173626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400328+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:05.400328+0000","last_peered":"2023-12-16T00:00:05.400328+0000","last_clean":"2023-12-16T00:00:05.400328+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:05.400328+0000","last_undegraded":"2023-12-16T00:00:05.400328+0000","last_fullsized":"2023-12-16T00:00:05.400328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403768+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:15.403768+0000","last_peered":"2023-12-16T00:00:15.403768+0000","last_clean":"2023-12-16T00:00:15.403768+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:15.403768+0000","last_undegraded":"2023-12-16T00:00:15.403768+0000","last_fullsized":"2023-12-16T00:00:15.403768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999329+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999329+0000","last_peered":"2023-12-16T00:01:23.999329+0000","last_clean":"2023-12-16T00:01:23.999329+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999329+0000","last_undegraded":"2023-12-16T00:01:23.999329+0000","last_fullsized":"2023-12-16T00:01:23.999329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397530+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:59:50.397530+0000","last_peered":"2023-12-15T23:59:50.397530+0000","last_clean":"2023-12-15T23:59:50.397530+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:59:50.397530+0000","last_undegraded":"2023-12-15T23:59:50.397530+0000","last_fullsized":"2023-12-15T23:59:50.397530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402635+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-16T00:00:15.402635+0000","last_peered":"2023-12-16T00:00:15.402635+0000","last_clean":"2023-12-16T00:00:15.402635+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:00:15.402635+0000","last_undegraded":"2023-12-16T00:00:15.402635+0000","last_fullsized":"2023-12-16T00:00:15.402635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402738+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-16T00:00:15.402738+0000","last_peered":"2023-12-16T00:00:15.402738+0000","last_clean":"2023-12-16T00:00:15.402738+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:00:15.402738+0000","last_undegraded":"2023-12-16T00:00:15.402738+0000","last_fullsized":"2023-12-16T00:00:15.402738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016636+0000","last_change":"2023-12-15T22:53:30.175700+0000","last_active":"2023-12-16T00:00:26.016636+0000","last_peered":"2023-12-16T00:00:26.016636+0000","last_clean":"2023-12-16T00:00:26.016636+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:00:26.016636+0000","last_undegraded":"2023-12-16T00:00:26.016636+0000","last_fullsized":"2023-12-16T00:00:26.016636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867711+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867711+0000","last_peered":"2023-12-16T00:00:31.867711+0000","last_clean":"2023-12-16T00:00:31.867711+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867711+0000","last_undegraded":"2023-12-16T00:00:31.867711+0000","last_fullsized":"2023-12-16T00:00:31.867711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389472+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:06.389472+0000","last_peered":"2023-12-16T00:00:06.389472+0000","last_clean":"2023-12-16T00:00:06.389472+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:06.389472+0000","last_undegraded":"2023-12-16T00:00:06.389472+0000","last_fullsized":"2023-12-16T00:00:06.389472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.389884+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:15.389884+0000","last_peered":"2023-12-16T00:00:15.389884+0000","last_clean":"2023-12-16T00:00:15.389884+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:15.389884+0000","last_undegraded":"2023-12-16T00:00:15.389884+0000","last_fullsized":"2023-12-16T00:00:15.389884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440121+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-16T00:00:26.440121+0000","last_peered":"2023-12-16T00:00:26.440121+0000","last_clean":"2023-12-16T00:00:26.440121+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:00:26.440121+0000","last_undegraded":"2023-12-16T00:00:26.440121+0000","last_fullsized":"2023-12-16T00:00:26.440121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864668+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-16T00:00:26.864668+0000","last_peered":"2023-12-16T00:00:26.864668+0000","last_clean":"2023-12-16T00:00:26.864668+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:00:26.864668+0000","last_undegraded":"2023-12-16T00:00:26.864668+0000","last_fullsized":"2023-12-16T00:00:26.864668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389798+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-16T00:00:06.389798+0000","last_peered":"2023-12-16T00:00:06.389798+0000","last_clean":"2023-12-16T00:00:06.389798+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:00:06.389798+0000","last_undegraded":"2023-12-16T00:00:06.389798+0000","last_fullsized":"2023-12-16T00:00:06.389798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1651,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391131+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-16T00:00:20.391131+0000","last_peered":"2023-12-16T00:00:20.391131+0000","last_clean":"2023-12-16T00:00:20.391131+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:00:20.391131+0000","last_undegraded":"2023-12-16T00:00:20.391131+0000","last_fullsized":"2023-12-16T00:00:20.391131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016723+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-16T00:00:26.016723+0000","last_peered":"2023-12-16T00:00:26.016723+0000","last_clean":"2023-12-16T00:00:26.016723+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:00:26.016723+0000","last_undegraded":"2023-12-16T00:00:26.016723+0000","last_fullsized":"2023-12-16T00:00:26.016723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402873+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-16T00:00:15.402873+0000","last_peered":"2023-12-16T00:00:15.402873+0000","last_clean":"2023-12-16T00:00:15.402873+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:00:15.402873+0000","last_undegraded":"2023-12-16T00:00:15.402873+0000","last_fullsized":"2023-12-16T00:00:15.402873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725058+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725058+0000","last_peered":"2023-12-16T00:00:59.725058+0000","last_clean":"2023-12-16T00:00:59.725058+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725058+0000","last_undegraded":"2023-12-16T00:00:59.725058+0000","last_fullsized":"2023-12-16T00:00:59.725058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155892+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155892+0000","last_peered":"2023-12-16T00:01:18.155892+0000","last_clean":"2023-12-16T00:01:18.155892+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155892+0000","last_undegraded":"2023-12-16T00:01:18.155892+0000","last_fullsized":"2023-12-16T00:01:18.155892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867666+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867666+0000","last_peered":"2023-12-16T00:00:52.867666+0000","last_clean":"2023-12-16T00:00:52.867666+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867666+0000","last_undegraded":"2023-12-16T00:00:52.867666+0000","last_fullsized":"2023-12-16T00:00:52.867666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404800+0000","last_change":"2023-12-15T22:53:10.340357+0000","last_active":"2023-12-16T00:00:20.404800+0000","last_peered":"2023-12-16T00:00:20.404800+0000","last_clean":"2023-12-16T00:00:20.404800+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:00:20.404800+0000","last_undegraded":"2023-12-16T00:00:20.404800+0000","last_fullsized":"2023-12-16T00:00:20.404800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137741+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-16T00:00:28.137741+0000","last_peered":"2023-12-16T00:00:28.137741+0000","last_clean":"2023-12-16T00:00:28.137741+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:00:28.137741+0000","last_undegraded":"2023-12-16T00:00:28.137741+0000","last_fullsized":"2023-12-16T00:00:28.137741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403136+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-16T00:00:15.403136+0000","last_peered":"2023-12-16T00:00:15.403136+0000","last_clean":"2023-12-16T00:00:15.403136+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:00:15.403136+0000","last_undegraded":"2023-12-16T00:00:15.403136+0000","last_fullsized":"2023-12-16T00:00:15.403136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.402706+0000","last_change":"2023-12-15T22:53:30.183471+0000","last_active":"2023-12-16T00:00:10.402706+0000","last_peered":"2023-12-16T00:00:10.402706+0000","last_clean":"2023-12-16T00:00:10.402706+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:00:10.402706+0000","last_undegraded":"2023-12-16T00:00:10.402706+0000","last_fullsized":"2023-12-16T00:00:10.402706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790096+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790096+0000","last_peered":"2023-12-16T00:00:57.790096+0000","last_clean":"2023-12-16T00:00:57.790096+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790096+0000","last_undegraded":"2023-12-16T00:00:57.790096+0000","last_fullsized":"2023-12-16T00:00:57.790096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391200+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-16T00:00:20.391200+0000","last_peered":"2023-12-16T00:00:20.391200+0000","last_clean":"2023-12-16T00:00:20.391200+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:00:20.391200+0000","last_undegraded":"2023-12-16T00:00:20.391200+0000","last_fullsized":"2023-12-16T00:00:20.391200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750337+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750337+0000","last_peered":"2023-12-16T00:00:48.750337+0000","last_clean":"2023-12-16T00:00:48.750337+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750337+0000","last_undegraded":"2023-12-16T00:00:48.750337+0000","last_fullsized":"2023-12-16T00:00:48.750337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712324+0000","last_change":"2023-12-15T22:53:58.172794+0000","last_active":"2023-12-16T00:00:27.712324+0000","last_peered":"2023-12-16T00:00:27.712324+0000","last_clean":"2023-12-16T00:00:27.712324+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:00:27.712324+0000","last_undegraded":"2023-12-16T00:00:27.712324+0000","last_fullsized":"2023-12-16T00:00:27.712324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403966+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:15.403966+0000","last_peered":"2023-12-16T00:00:15.403966+0000","last_clean":"2023-12-16T00:00:15.403966+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:15.403966+0000","last_undegraded":"2023-12-16T00:00:15.403966+0000","last_fullsized":"2023-12-16T00:00:15.403966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'576","reported_seq":1503,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401785+0000","last_change":"2023-12-15T22:53:30.179311+0000","last_active":"2023-12-16T00:00:10.401785+0000","last_peered":"2023-12-16T00:00:10.401785+0000","last_clean":"2023-12-16T00:00:10.401785+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:00:10.401785+0000","last_undegraded":"2023-12-16T00:00:10.401785+0000","last_fullsized":"2023-12-16T00:00:10.401785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015540+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015540+0000","last_peered":"2023-12-16T00:01:22.015540+0000","last_clean":"2023-12-16T00:01:22.015540+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015540+0000","last_undegraded":"2023-12-16T00:01:22.015540+0000","last_fullsized":"2023-12-16T00:01:22.015540+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233326+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233326+0000","last_peered":"2023-12-16T00:00:26.233326+0000","last_clean":"2023-12-16T00:00:26.233326+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233326+0000","last_undegraded":"2023-12-16T00:00:26.233326+0000","last_fullsized":"2023-12-16T00:00:26.233326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016185+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-16T00:00:26.016185+0000","last_peered":"2023-12-16T00:00:26.016185+0000","last_clean":"2023-12-16T00:00:26.016185+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:00:26.016185+0000","last_undegraded":"2023-12-16T00:00:26.016185+0000","last_fullsized":"2023-12-16T00:00:26.016185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137791+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-16T00:00:28.137791+0000","last_peered":"2023-12-16T00:00:28.137791+0000","last_clean":"2023-12-16T00:00:28.137791+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:00:28.137791+0000","last_undegraded":"2023-12-16T00:00:28.137791+0000","last_fullsized":"2023-12-16T00:00:28.137791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289035+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-16T00:00:27.289035+0000","last_peered":"2023-12-16T00:00:27.289035+0000","last_clean":"2023-12-16T00:00:27.289035+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:00:27.289035+0000","last_undegraded":"2023-12-16T00:00:27.289035+0000","last_fullsized":"2023-12-16T00:00:27.289035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875695+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875695+0000","last_peered":"2023-12-16T00:01:05.875695+0000","last_clean":"2023-12-16T00:01:05.875695+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875695+0000","last_undegraded":"2023-12-16T00:01:05.875695+0000","last_fullsized":"2023-12-16T00:01:05.875695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":864,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835775+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835775+0000","last_peered":"2023-12-16T00:00:29.835775+0000","last_clean":"2023-12-16T00:00:29.835775+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835775+0000","last_undegraded":"2023-12-16T00:00:29.835775+0000","last_fullsized":"2023-12-16T00:00:29.835775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867182+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867182+0000","last_peered":"2023-12-16T00:00:33.867182+0000","last_clean":"2023-12-16T00:00:33.867182+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867182+0000","last_undegraded":"2023-12-16T00:00:33.867182+0000","last_fullsized":"2023-12-16T00:00:33.867182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864514+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-16T00:00:26.864514+0000","last_peered":"2023-12-16T00:00:26.864514+0000","last_clean":"2023-12-16T00:00:26.864514+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:00:26.864514+0000","last_undegraded":"2023-12-16T00:00:26.864514+0000","last_fullsized":"2023-12-16T00:00:26.864514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864656+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-16T00:00:26.864656+0000","last_peered":"2023-12-16T00:00:26.864656+0000","last_clean":"2023-12-16T00:00:26.864656+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:00:26.864656+0000","last_undegraded":"2023-12-16T00:00:26.864656+0000","last_fullsized":"2023-12-16T00:00:26.864656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873610+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873610+0000","last_peered":"2023-12-16T00:01:08.873610+0000","last_clean":"2023-12-16T00:01:08.873610+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873610+0000","last_undegraded":"2023-12-16T00:01:08.873610+0000","last_fullsized":"2023-12-16T00:01:08.873610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289163+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-16T00:00:27.289163+0000","last_peered":"2023-12-16T00:00:27.289163+0000","last_clean":"2023-12-16T00:00:27.289163+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:00:27.289163+0000","last_undegraded":"2023-12-16T00:00:27.289163+0000","last_fullsized":"2023-12-16T00:00:27.289163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'9","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440575+0000","last_change":"2023-12-15T22:53:32.189881+0000","last_active":"2023-12-16T00:00:26.440575+0000","last_peered":"2023-12-16T00:00:26.440575+0000","last_clean":"2023-12-16T00:00:26.440575+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:00:26.440575+0000","last_undegraded":"2023-12-16T00:00:26.440575+0000","last_fullsized":"2023-12-16T00:00:26.440575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473143+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473143+0000","last_peered":"2023-12-16T00:00:47.473143+0000","last_clean":"2023-12-16T00:00:47.473143+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473143+0000","last_undegraded":"2023-12-16T00:00:47.473143+0000","last_fullsized":"2023-12-16T00:00:47.473143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786863+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786863+0000","last_peered":"2023-12-16T00:00:33.786863+0000","last_clean":"2023-12-16T00:00:33.786863+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786863+0000","last_undegraded":"2023-12-16T00:00:33.786863+0000","last_fullsized":"2023-12-16T00:00:33.786863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121731+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121731+0000","last_peered":"2023-12-16T00:00:35.121731+0000","last_clean":"2023-12-16T00:00:35.121731+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121731+0000","last_undegraded":"2023-12-16T00:00:35.121731+0000","last_fullsized":"2023-12-16T00:00:35.121731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389440+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:06.389440+0000","last_peered":"2023-12-16T00:00:06.389440+0000","last_clean":"2023-12-16T00:00:06.389440+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:06.389440+0000","last_undegraded":"2023-12-16T00:00:06.389440+0000","last_fullsized":"2023-12-16T00:00:06.389440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440142+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-16T00:00:26.440142+0000","last_peered":"2023-12-16T00:00:26.440142+0000","last_clean":"2023-12-16T00:00:26.440142+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:00:26.440142+0000","last_undegraded":"2023-12-16T00:00:26.440142+0000","last_fullsized":"2023-12-16T00:00:26.440142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711777+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:27.711777+0000","last_peered":"2023-12-16T00:00:27.711777+0000","last_clean":"2023-12-16T00:00:27.711777+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:00:27.711777+0000","last_undegraded":"2023-12-16T00:00:27.711777+0000","last_fullsized":"2023-12-16T00:00:27.711777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385854+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:59:51.385854+0000","last_peered":"2023-12-15T23:59:51.385854+0000","last_clean":"2023-12-15T23:59:51.385854+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:59:51.385854+0000","last_undegraded":"2023-12-15T23:59:51.385854+0000","last_fullsized":"2023-12-15T23:59:51.385854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1760,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016807+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-16T00:00:26.016807+0000","last_peered":"2023-12-16T00:00:26.016807+0000","last_clean":"2023-12-16T00:00:26.016807+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:00:26.016807+0000","last_undegraded":"2023-12-16T00:00:26.016807+0000","last_fullsized":"2023-12-16T00:00:26.016807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289112+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-16T00:00:27.289112+0000","last_peered":"2023-12-16T00:00:27.289112+0000","last_clean":"2023-12-16T00:00:27.289112+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:00:27.289112+0000","last_undegraded":"2023-12-16T00:00:27.289112+0000","last_fullsized":"2023-12-16T00:00:27.289112+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984524+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984524+0000","last_peered":"2023-12-16T00:01:24.984524+0000","last_clean":"2023-12-16T00:01:24.984524+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984524+0000","last_undegraded":"2023-12-16T00:01:24.984524+0000","last_fullsized":"2023-12-16T00:01:24.984524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'576","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.613663+0000","last_change":"2023-12-15T22:53:30.179041+0000","last_active":"2023-12-15T23:59:40.613663+0000","last_peered":"2023-12-15T23:59:40.613663+0000","last_clean":"2023-12-15T23:59:40.613663+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-15T23:59:40.613663+0000","last_undegraded":"2023-12-15T23:59:40.613663+0000","last_fullsized":"2023-12-15T23:59:40.613663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":550,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529119+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529119+0000","last_peered":"2023-12-16T00:00:50.529119+0000","last_clean":"2023-12-16T00:00:50.529119+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529119+0000","last_undegraded":"2023-12-16T00:00:50.529119+0000","last_fullsized":"2023-12-16T00:00:50.529119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710437+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710437+0000","last_peered":"2023-12-16T00:00:43.710437+0000","last_clean":"2023-12-16T00:00:43.710437+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710437+0000","last_undegraded":"2023-12-16T00:00:43.710437+0000","last_fullsized":"2023-12-16T00:00:43.710437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387461+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:05.387461+0000","last_peered":"2023-12-16T00:00:05.387461+0000","last_clean":"2023-12-16T00:00:05.387461+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:05.387461+0000","last_undegraded":"2023-12-16T00:00:05.387461+0000","last_fullsized":"2023-12-16T00:00:05.387461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288427+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-16T00:00:27.288427+0000","last_peered":"2023-12-16T00:00:27.288427+0000","last_clean":"2023-12-16T00:00:27.288427+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:00:27.288427+0000","last_undegraded":"2023-12-16T00:00:27.288427+0000","last_fullsized":"2023-12-16T00:00:27.288427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.883952+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.883952+0000","last_peered":"2023-12-16T00:01:13.883952+0000","last_clean":"2023-12-16T00:01:13.883952+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.883952+0000","last_undegraded":"2023-12-16T00:01:13.883952+0000","last_fullsized":"2023-12-16T00:01:13.883952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382667+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:59:36.382667+0000","last_peered":"2023-12-15T23:59:36.382667+0000","last_clean":"2023-12-15T23:59:36.382667+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:59:36.382667+0000","last_undegraded":"2023-12-15T23:59:36.382667+0000","last_fullsized":"2023-12-15T23:59:36.382667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.607669+0000","last_change":"2023-12-15T22:53:58.166816+0000","last_active":"2023-12-15T23:59:15.607669+0000","last_peered":"2023-12-15T23:59:15.607669+0000","last_clean":"2023-12-15T23:59:15.607669+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-15T23:59:15.607669+0000","last_undegraded":"2023-12-15T23:59:15.607669+0000","last_fullsized":"2023-12-15T23:59:15.607669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'3","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712301+0000","last_change":"2023-12-15T22:53:32.195317+0000","last_active":"2023-12-16T00:00:27.712301+0000","last_peered":"2023-12-16T00:00:27.712301+0000","last_clean":"2023-12-16T00:00:27.712301+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:00:27.712301+0000","last_undegraded":"2023-12-16T00:00:27.712301+0000","last_fullsized":"2023-12-16T00:00:27.712301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440564+0000","last_change":"2023-12-15T22:53:30.176281+0000","last_active":"2023-12-16T00:00:26.440564+0000","last_peered":"2023-12-16T00:00:26.440564+0000","last_clean":"2023-12-16T00:00:26.440564+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:00:26.440564+0000","last_undegraded":"2023-12-16T00:00:26.440564+0000","last_fullsized":"2023-12-16T00:00:26.440564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864722+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-16T00:00:26.864722+0000","last_peered":"2023-12-16T00:00:26.864722+0000","last_clean":"2023-12-16T00:00:26.864722+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:00:26.864722+0000","last_undegraded":"2023-12-16T00:00:26.864722+0000","last_fullsized":"2023-12-16T00:00:26.864722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396920+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:59:50.396920+0000","last_peered":"2023-12-15T23:59:50.396920+0000","last_clean":"2023-12-15T23:59:50.396920+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:59:50.396920+0000","last_undegraded":"2023-12-15T23:59:50.396920+0000","last_fullsized":"2023-12-15T23:59:50.396920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405397+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:25.405397+0000","last_peered":"2023-12-16T00:00:25.405397+0000","last_clean":"2023-12-16T00:00:25.405397+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:25.405397+0000","last_undegraded":"2023-12-16T00:00:25.405397+0000","last_fullsized":"2023-12-16T00:00:25.405397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612548+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-15T23:59:35.612548+0000","last_peered":"2023-12-15T23:59:35.612548+0000","last_clean":"2023-12-15T23:59:35.612548+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-15T23:59:35.612548+0000","last_undegraded":"2023-12-15T23:59:35.612548+0000","last_fullsized":"2023-12-15T23:59:35.612548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384782+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:59:46.384782+0000","last_peered":"2023-12-15T23:59:46.384782+0000","last_clean":"2023-12-15T23:59:46.384782+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:59:46.384782+0000","last_undegraded":"2023-12-15T23:59:46.384782+0000","last_fullsized":"2023-12-15T23:59:46.384782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404945+0000","last_change":"2023-12-15T22:53:10.333755+0000","last_active":"2023-12-16T00:00:20.404945+0000","last_peered":"2023-12-16T00:00:20.404945+0000","last_clean":"2023-12-16T00:00:20.404945+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:00:20.404945+0000","last_undegraded":"2023-12-16T00:00:20.404945+0000","last_fullsized":"2023-12-16T00:00:20.404945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:21.378650+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-15T23:59:21.378650+0000","last_peered":"2023-12-15T23:59:21.378650+0000","last_clean":"2023-12-15T23:59:21.378650+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-15T23:59:21.378650+0000","last_undegraded":"2023-12-15T23:59:21.378650+0000","last_fullsized":"2023-12-15T23:59:21.378650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835797+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835797+0000","last_peered":"2023-12-16T00:01:22.835797+0000","last_clean":"2023-12-16T00:01:22.835797+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835797+0000","last_undegraded":"2023-12-16T00:01:22.835797+0000","last_fullsized":"2023-12-16T00:01:22.835797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016632+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-16T00:00:26.016632+0000","last_peered":"2023-12-16T00:00:26.016632+0000","last_clean":"2023-12-16T00:00:26.016632+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:00:26.016632+0000","last_undegraded":"2023-12-16T00:00:26.016632+0000","last_fullsized":"2023-12-16T00:00:26.016632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865077+0000","last_change":"2023-12-15T22:53:30.178446+0000","last_active":"2023-12-16T00:00:26.865077+0000","last_peered":"2023-12-16T00:00:26.865077+0000","last_clean":"2023-12-16T00:00:26.865077+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:00:26.865077+0000","last_undegraded":"2023-12-16T00:00:26.865077+0000","last_fullsized":"2023-12-16T00:00:26.865077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612756+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-15T23:59:35.612756+0000","last_peered":"2023-12-15T23:59:35.612756+0000","last_clean":"2023-12-15T23:59:35.612756+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-15T23:59:35.612756+0000","last_undegraded":"2023-12-15T23:59:35.612756+0000","last_fullsized":"2023-12-15T23:59:35.612756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382308+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-15T23:59:36.382308+0000","last_peered":"2023-12-15T23:59:36.382308+0000","last_clean":"2023-12-15T23:59:36.382308+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-15T23:59:36.382308+0000","last_undegraded":"2023-12-15T23:59:36.382308+0000","last_fullsized":"2023-12-15T23:59:36.382308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399480+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:00.399480+0000","last_peered":"2023-12-16T00:00:00.399480+0000","last_clean":"2023-12-16T00:00:00.399480+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:00.399480+0000","last_undegraded":"2023-12-16T00:00:00.399480+0000","last_fullsized":"2023-12-16T00:00:00.399480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.624945+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-16T00:00:20.624945+0000","last_peered":"2023-12-16T00:00:20.624945+0000","last_clean":"2023-12-16T00:00:20.624945+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:00:20.624945+0000","last_undegraded":"2023-12-16T00:00:20.624945+0000","last_fullsized":"2023-12-16T00:00:20.624945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404812+0000","last_change":"2023-12-15T22:53:08.334950+0000","last_active":"2023-12-16T00:00:20.404812+0000","last_peered":"2023-12-16T00:00:20.404812+0000","last_clean":"2023-12-16T00:00:20.404812+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:00:20.404812+0000","last_undegraded":"2023-12-16T00:00:20.404812+0000","last_fullsized":"2023-12-16T00:00:20.404812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404882+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-16T00:00:20.404882+0000","last_peered":"2023-12-16T00:00:20.404882+0000","last_clean":"2023-12-16T00:00:20.404882+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:00:20.404882+0000","last_undegraded":"2023-12-16T00:00:20.404882+0000","last_fullsized":"2023-12-16T00:00:20.404882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5994,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389933+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-15T23:59:20.389933+0000","last_peered":"2023-12-15T23:59:20.389933+0000","last_clean":"2023-12-15T23:59:20.389933+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-15T23:59:20.389933+0000","last_undegraded":"2023-12-15T23:59:20.389933+0000","last_fullsized":"2023-12-15T23:59:20.389933+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388623+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-15T23:59:15.388623+0000","last_peered":"2023-12-15T23:59:15.388623+0000","last_clean":"2023-12-15T23:59:15.388623+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-15T23:59:15.388623+0000","last_undegraded":"2023-12-15T23:59:15.388623+0000","last_fullsized":"2023-12-15T23:59:15.388623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289065+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-16T00:00:27.289065+0000","last_peered":"2023-12-16T00:00:27.289065+0000","last_clean":"2023-12-16T00:00:27.289065+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:00:27.289065+0000","last_undegraded":"2023-12-16T00:00:27.289065+0000","last_fullsized":"2023-12-16T00:00:27.289065+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790128+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790128+0000","last_peered":"2023-12-16T00:01:16.790128+0000","last_clean":"2023-12-16T00:01:16.790128+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790128+0000","last_undegraded":"2023-12-16T00:01:16.790128+0000","last_fullsized":"2023-12-16T00:01:16.790128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'259","reported_seq":1392,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288826+0000","last_change":"2023-12-15T22:53:28.173286+0000","last_active":"2023-12-16T00:00:27.288826+0000","last_peered":"2023-12-16T00:00:27.288826+0000","last_clean":"2023-12-16T00:00:27.288826+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:00:27.288826+0000","last_undegraded":"2023-12-16T00:00:27.288826+0000","last_fullsized":"2023-12-16T00:00:27.288826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007421+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007421+0000","last_peered":"2023-12-16T00:01:15.007421+0000","last_clean":"2023-12-16T00:01:15.007421+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007421+0000","last_undegraded":"2023-12-16T00:01:15.007421+0000","last_fullsized":"2023-12-16T00:01:15.007421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620685+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:05.620685+0000","last_peered":"2023-12-16T00:00:05.620685+0000","last_clean":"2023-12-16T00:00:05.620685+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:05.620685+0000","last_undegraded":"2023-12-16T00:00:05.620685+0000","last_fullsized":"2023-12-16T00:00:05.620685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.390276+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:15.390276+0000","last_peered":"2023-12-16T00:00:15.390276+0000","last_clean":"2023-12-16T00:00:15.390276+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:15.390276+0000","last_undegraded":"2023-12-16T00:00:15.390276+0000","last_fullsized":"2023-12-16T00:00:15.390276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401475+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:05.401475+0000","last_peered":"2023-12-16T00:00:05.401475+0000","last_clean":"2023-12-16T00:00:05.401475+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:05.401475+0000","last_undegraded":"2023-12-16T00:00:05.401475+0000","last_fullsized":"2023-12-16T00:00:05.401475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396260+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:59:50.396260+0000","last_peered":"2023-12-15T23:59:50.396260+0000","last_clean":"2023-12-15T23:59:50.396260+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:59:50.396260+0000","last_undegraded":"2023-12-15T23:59:50.396260+0000","last_fullsized":"2023-12-15T23:59:50.396260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016252+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-16T00:00:26.016252+0000","last_peered":"2023-12-16T00:00:26.016252+0000","last_clean":"2023-12-16T00:00:26.016252+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:00:26.016252+0000","last_undegraded":"2023-12-16T00:00:26.016252+0000","last_fullsized":"2023-12-16T00:00:26.016252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388533+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-15T23:59:20.388533+0000","last_peered":"2023-12-15T23:59:20.388533+0000","last_clean":"2023-12-15T23:59:20.388533+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-15T23:59:20.388533+0000","last_undegraded":"2023-12-15T23:59:20.388533+0000","last_fullsized":"2023-12-15T23:59:20.388533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.392864+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-15T23:59:30.392864+0000","last_peered":"2023-12-15T23:59:30.392864+0000","last_clean":"2023-12-15T23:59:30.392864+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-15T23:59:30.392864+0000","last_undegraded":"2023-12-15T23:59:30.392864+0000","last_fullsized":"2023-12-15T23:59:30.392864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016665+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-16T00:00:26.016665+0000","last_peered":"2023-12-16T00:00:26.016665+0000","last_clean":"2023-12-16T00:00:26.016665+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:00:26.016665+0000","last_undegraded":"2023-12-16T00:00:26.016665+0000","last_fullsized":"2023-12-16T00:00:26.016665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'576","reported_seq":1465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865018+0000","last_change":"2023-12-15T22:53:30.180943+0000","last_active":"2023-12-16T00:00:26.865018+0000","last_peered":"2023-12-16T00:00:26.865018+0000","last_clean":"2023-12-16T00:00:26.865018+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:00:26.865018+0000","last_undegraded":"2023-12-16T00:00:26.865018+0000","last_fullsized":"2023-12-16T00:00:26.865018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185657+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185657+0000","last_peered":"2023-12-16T00:01:12.185657+0000","last_clean":"2023-12-16T00:01:12.185657+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185657+0000","last_undegraded":"2023-12-16T00:01:12.185657+0000","last_fullsized":"2023-12-16T00:01:12.185657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400974+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:05.400974+0000","last_peered":"2023-12-16T00:00:05.400974+0000","last_clean":"2023-12-16T00:00:05.400974+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:05.400974+0000","last_undegraded":"2023-12-16T00:00:05.400974+0000","last_fullsized":"2023-12-16T00:00:05.400974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405423+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:00:25.405423+0000","last_peered":"2023-12-16T00:00:25.405423+0000","last_clean":"2023-12-16T00:00:25.405423+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:00:25.405423+0000","last_undegraded":"2023-12-16T00:00:25.405423+0000","last_fullsized":"2023-12-16T00:00:25.405423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392199+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-15T23:59:35.392199+0000","last_peered":"2023-12-15T23:59:35.392199+0000","last_clean":"2023-12-15T23:59:35.392199+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-15T23:59:35.392199+0000","last_undegraded":"2023-12-15T23:59:35.392199+0000","last_fullsized":"2023-12-15T23:59:35.392199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.404304+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:15.404304+0000","last_peered":"2023-12-16T00:00:15.404304+0000","last_clean":"2023-12-16T00:00:15.404304+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:15.404304+0000","last_undegraded":"2023-12-16T00:00:15.404304+0000","last_fullsized":"2023-12-16T00:00:15.404304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":971,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616350+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:59:50.616350+0000","last_peered":"2023-12-15T23:59:50.616350+0000","last_clean":"2023-12-15T23:59:50.616350+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:59:50.616350+0000","last_undegraded":"2023-12-15T23:59:50.616350+0000","last_fullsized":"2023-12-15T23:59:50.616350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389786+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:06.389786+0000","last_peered":"2023-12-16T00:00:06.389786+0000","last_clean":"2023-12-16T00:00:06.389786+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:00:06.389786+0000","last_undegraded":"2023-12-16T00:00:06.389786+0000","last_fullsized":"2023-12-16T00:00:06.389786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897125+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897125+0000","last_peered":"2023-12-16T00:01:15.897125+0000","last_clean":"2023-12-16T00:01:15.897125+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897125+0000","last_undegraded":"2023-12-16T00:01:15.897125+0000","last_fullsized":"2023-12-16T00:01:15.897125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1256,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388381+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-15T23:59:20.388381+0000","last_peered":"2023-12-15T23:59:20.388381+0000","last_clean":"2023-12-15T23:59:20.388381+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-15T23:59:20.388381+0000","last_undegraded":"2023-12-15T23:59:20.388381+0000","last_fullsized":"2023-12-15T23:59:20.388381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865212+0000","last_change":"2023-12-15T22:53:58.167871+0000","last_active":"2023-12-16T00:00:26.865212+0000","last_peered":"2023-12-16T00:00:26.865212+0000","last_clean":"2023-12-16T00:00:26.865212+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:00:26.865212+0000","last_undegraded":"2023-12-16T00:00:26.865212+0000","last_fullsized":"2023-12-16T00:00:26.865212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874738+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874738+0000","last_peered":"2023-12-16T00:01:08.874738+0000","last_clean":"2023-12-16T00:01:08.874738+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874738+0000","last_undegraded":"2023-12-16T00:01:08.874738+0000","last_fullsized":"2023-12-16T00:01:08.874738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864730+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-16T00:00:26.864730+0000","last_peered":"2023-12-16T00:00:26.864730+0000","last_clean":"2023-12-16T00:00:26.864730+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:00:26.864730+0000","last_undegraded":"2023-12-16T00:00:26.864730+0000","last_fullsized":"2023-12-16T00:00:26.864730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382155+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-15T23:59:36.382155+0000","last_peered":"2023-12-15T23:59:36.382155+0000","last_clean":"2023-12-15T23:59:36.382155+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-15T23:59:36.382155+0000","last_undegraded":"2023-12-15T23:59:36.382155+0000","last_fullsized":"2023-12-15T23:59:36.382155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400947+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:05.400947+0000","last_peered":"2023-12-16T00:00:05.400947+0000","last_clean":"2023-12-16T00:00:05.400947+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:05.400947+0000","last_undegraded":"2023-12-16T00:00:05.400947+0000","last_fullsized":"2023-12-16T00:00:05.400947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864376+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-16T00:00:26.864376+0000","last_peered":"2023-12-16T00:00:26.864376+0000","last_clean":"2023-12-16T00:00:26.864376+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:00:26.864376+0000","last_undegraded":"2023-12-16T00:00:26.864376+0000","last_fullsized":"2023-12-16T00:00:26.864376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384717+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:59:46.384717+0000","last_peered":"2023-12-15T23:59:46.384717+0000","last_clean":"2023-12-15T23:59:46.384717+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:59:46.384717+0000","last_undegraded":"2023-12-15T23:59:46.384717+0000","last_fullsized":"2023-12-15T23:59:46.384717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384215+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:59:50.384215+0000","last_peered":"2023-12-15T23:59:50.384215+0000","last_clean":"2023-12-15T23:59:50.384215+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:59:50.384215+0000","last_undegraded":"2023-12-15T23:59:50.384215+0000","last_fullsized":"2023-12-15T23:59:50.384215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137138+0000","last_change":"2023-12-15T22:53:10.341190+0000","last_active":"2023-12-16T00:00:28.137138+0000","last_peered":"2023-12-16T00:00:28.137138+0000","last_clean":"2023-12-16T00:00:28.137138+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:00:28.137138+0000","last_undegraded":"2023-12-16T00:00:28.137138+0000","last_fullsized":"2023-12-16T00:00:28.137138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5895,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389070+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-15T23:59:20.389070+0000","last_peered":"2023-12-15T23:59:20.389070+0000","last_clean":"2023-12-15T23:59:20.389070+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-15T23:59:20.389070+0000","last_undegraded":"2023-12-15T23:59:20.389070+0000","last_fullsized":"2023-12-15T23:59:20.389070+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137754+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-16T00:00:28.137754+0000","last_peered":"2023-12-16T00:00:28.137754+0000","last_clean":"2023-12-16T00:00:28.137754+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:00:28.137754+0000","last_undegraded":"2023-12-16T00:00:28.137754+0000","last_fullsized":"2023-12-16T00:00:28.137754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840119+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840119+0000","last_peered":"2023-12-16T00:01:10.840119+0000","last_clean":"2023-12-16T00:01:10.840119+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840119+0000","last_undegraded":"2023-12-16T00:01:10.840119+0000","last_fullsized":"2023-12-16T00:01:10.840119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288950+0000","last_change":"2023-12-15T22:53:30.180992+0000","last_active":"2023-12-16T00:00:27.288950+0000","last_peered":"2023-12-16T00:00:27.288950+0000","last_clean":"2023-12-16T00:00:27.288950+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:00:27.288950+0000","last_undegraded":"2023-12-16T00:00:27.288950+0000","last_fullsized":"2023-12-16T00:00:27.288950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387948+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:05.387948+0000","last_peered":"2023-12-16T00:00:05.387948+0000","last_clean":"2023-12-16T00:00:05.387948+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:05.387948+0000","last_undegraded":"2023-12-16T00:00:05.387948+0000","last_fullsized":"2023-12-16T00:00:05.387948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395428+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:59:45.395428+0000","last_peered":"2023-12-15T23:59:45.395428+0000","last_clean":"2023-12-15T23:59:45.395428+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:59:45.395428+0000","last_undegraded":"2023-12-15T23:59:45.395428+0000","last_fullsized":"2023-12-15T23:59:45.395428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396667+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:59:50.396667+0000","last_peered":"2023-12-15T23:59:50.396667+0000","last_clean":"2023-12-15T23:59:50.396667+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:59:50.396667+0000","last_undegraded":"2023-12-15T23:59:50.396667+0000","last_fullsized":"2023-12-15T23:59:50.396667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396171+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:59:50.396171+0000","last_peered":"2023-12-15T23:59:50.396171+0000","last_clean":"2023-12-15T23:59:50.396171+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:59:50.396171+0000","last_undegraded":"2023-12-15T23:59:50.396171+0000","last_fullsized":"2023-12-15T23:59:50.396171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016233+0000","last_change":"2023-12-15T22:53:11.077678+0000","last_active":"2023-12-16T00:00:26.016233+0000","last_peered":"2023-12-16T00:00:26.016233+0000","last_clean":"2023-12-16T00:00:26.016233+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:00:26.016233+0000","last_undegraded":"2023-12-16T00:00:26.016233+0000","last_fullsized":"2023-12-16T00:00:26.016233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865226+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-16T00:00:26.865226+0000","last_peered":"2023-12-16T00:00:26.865226+0000","last_clean":"2023-12-16T00:00:26.865226+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:00:26.865226+0000","last_undegraded":"2023-12-16T00:00:26.865226+0000","last_fullsized":"2023-12-16T00:00:26.865226+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016649+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-16T00:00:26.016649+0000","last_peered":"2023-12-16T00:00:26.016649+0000","last_clean":"2023-12-16T00:00:26.016649+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:00:26.016649+0000","last_undegraded":"2023-12-16T00:00:26.016649+0000","last_fullsized":"2023-12-16T00:00:26.016649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440560+0000","last_change":"2023-12-15T22:53:30.177873+0000","last_active":"2023-12-16T00:00:26.440560+0000","last_peered":"2023-12-16T00:00:26.440560+0000","last_clean":"2023-12-16T00:00:26.440560+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:00:26.440560+0000","last_undegraded":"2023-12-16T00:00:26.440560+0000","last_fullsized":"2023-12-16T00:00:26.440560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392326+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-15T23:59:35.392326+0000","last_peered":"2023-12-15T23:59:35.392326+0000","last_clean":"2023-12-15T23:59:35.392326+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-15T23:59:35.392326+0000","last_undegraded":"2023-12-15T23:59:35.392326+0000","last_fullsized":"2023-12-15T23:59:35.392326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612737+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-15T23:59:35.612737+0000","last_peered":"2023-12-15T23:59:35.612737+0000","last_clean":"2023-12-15T23:59:35.612737+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-15T23:59:35.612737+0000","last_undegraded":"2023-12-15T23:59:35.612737+0000","last_fullsized":"2023-12-15T23:59:35.612737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395993+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:59:45.395993+0000","last_peered":"2023-12-15T23:59:45.395993+0000","last_clean":"2023-12-15T23:59:45.395993+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:59:45.395993+0000","last_undegraded":"2023-12-15T23:59:45.395993+0000","last_fullsized":"2023-12-15T23:59:45.395993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616027+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:59:50.616027+0000","last_peered":"2023-12-15T23:59:50.616027+0000","last_clean":"2023-12-15T23:59:50.616027+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:59:50.616027+0000","last_undegraded":"2023-12-15T23:59:50.616027+0000","last_fullsized":"2023-12-15T23:59:50.616027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":802,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136932+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-16T00:00:28.136932+0000","last_peered":"2023-12-16T00:00:28.136932+0000","last_clean":"2023-12-16T00:00:28.136932+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:00:28.136932+0000","last_undegraded":"2023-12-16T00:00:28.136932+0000","last_fullsized":"2023-12-16T00:00:28.136932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016287+0000","last_change":"2023-12-15T22:53:11.078652+0000","last_active":"2023-12-16T00:00:26.016287+0000","last_peered":"2023-12-16T00:00:26.016287+0000","last_clean":"2023-12-16T00:00:26.016287+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:00:26.016287+0000","last_undegraded":"2023-12-16T00:00:26.016287+0000","last_fullsized":"2023-12-16T00:00:26.016287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016825+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-16T00:00:26.016825+0000","last_peered":"2023-12-16T00:00:26.016825+0000","last_clean":"2023-12-16T00:00:26.016825+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:00:26.016825+0000","last_undegraded":"2023-12-16T00:00:26.016825+0000","last_fullsized":"2023-12-16T00:00:26.016825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387794+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-15T23:59:15.387794+0000","last_peered":"2023-12-15T23:59:15.387794+0000","last_clean":"2023-12-15T23:59:15.387794+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-15T23:59:15.387794+0000","last_undegraded":"2023-12-15T23:59:15.387794+0000","last_fullsized":"2023-12-15T23:59:15.387794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'576","reported_seq":1442,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865101+0000","last_change":"2023-12-15T22:53:30.174928+0000","last_active":"2023-12-16T00:00:26.865101+0000","last_peered":"2023-12-16T00:00:26.865101+0000","last_clean":"2023-12-16T00:00:26.865101+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:00:26.865101+0000","last_undegraded":"2023-12-16T00:00:26.865101+0000","last_fullsized":"2023-12-16T00:00:26.865101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612574+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-15T23:59:35.612574+0000","last_peered":"2023-12-15T23:59:35.612574+0000","last_clean":"2023-12-15T23:59:35.612574+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-15T23:59:35.612574+0000","last_undegraded":"2023-12-15T23:59:35.612574+0000","last_fullsized":"2023-12-15T23:59:35.612574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397612+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:59:50.397612+0000","last_peered":"2023-12-15T23:59:50.397612+0000","last_clean":"2023-12-15T23:59:50.397612+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:59:50.397612+0000","last_undegraded":"2023-12-15T23:59:50.397612+0000","last_fullsized":"2023-12-15T23:59:50.397612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.390173+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-15T23:59:20.390173+0000","last_peered":"2023-12-15T23:59:20.390173+0000","last_clean":"2023-12-15T23:59:20.390173+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-15T23:59:20.390173+0000","last_undegraded":"2023-12-15T23:59:20.390173+0000","last_fullsized":"2023-12-15T23:59:20.390173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.394959+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:59:45.394959+0000","last_peered":"2023-12-15T23:59:45.394959+0000","last_clean":"2023-12-15T23:59:45.394959+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:59:45.394959+0000","last_undegraded":"2023-12-15T23:59:45.394959+0000","last_fullsized":"2023-12-15T23:59:45.394959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385796+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:59:51.385796+0000","last_peered":"2023-12-15T23:59:51.385796+0000","last_clean":"2023-12-15T23:59:51.385796+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:59:51.385796+0000","last_undegraded":"2023-12-15T23:59:51.385796+0000","last_fullsized":"2023-12-15T23:59:51.385796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016281+0000","last_change":"2023-12-15T22:53:11.079225+0000","last_active":"2023-12-16T00:00:26.016281+0000","last_peered":"2023-12-16T00:00:26.016281+0000","last_clean":"2023-12-16T00:00:26.016281+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:00:26.016281+0000","last_undegraded":"2023-12-16T00:00:26.016281+0000","last_fullsized":"2023-12-16T00:00:26.016281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389408+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:59:25.389408+0000","last_peered":"2023-12-15T23:59:25.389408+0000","last_clean":"2023-12-15T23:59:25.389408+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:59:25.389408+0000","last_undegraded":"2023-12-15T23:59:25.389408+0000","last_fullsized":"2023-12-15T23:59:25.389408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:00.603511+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-15T23:59:00.603511+0000","last_peered":"2023-12-15T23:59:00.603511+0000","last_clean":"2023-12-15T23:59:00.603511+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-15T23:59:00.603511+0000","last_undegraded":"2023-12-15T23:59:00.603511+0000","last_fullsized":"2023-12-15T23:59:00.603511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712318+0000","last_change":"2023-12-15T22:53:32.195361+0000","last_active":"2023-12-16T00:00:27.712318+0000","last_peered":"2023-12-16T00:00:27.712318+0000","last_clean":"2023-12-16T00:00:27.712318+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:00:27.712318+0000","last_undegraded":"2023-12-16T00:00:27.712318+0000","last_fullsized":"2023-12-16T00:00:27.712318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:40.393828+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-15T23:59:40.393828+0000","last_peered":"2023-12-15T23:59:40.393828+0000","last_clean":"2023-12-15T23:59:40.393828+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-15T23:59:40.393828+0000","last_undegraded":"2023-12-15T23:59:40.393828+0000","last_fullsized":"2023-12-15T23:59:40.393828+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279318+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279318+0000","last_peered":"2023-12-16T00:01:22.279318+0000","last_clean":"2023-12-16T00:01:22.279318+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279318+0000","last_undegraded":"2023-12-16T00:01:22.279318+0000","last_fullsized":"2023-12-16T00:01:22.279318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440194+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-16T00:00:26.440194+0000","last_peered":"2023-12-16T00:00:26.440194+0000","last_clean":"2023-12-16T00:00:26.440194+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:00:26.440194+0000","last_undegraded":"2023-12-16T00:00:26.440194+0000","last_fullsized":"2023-12-16T00:00:26.440194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382094+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:59:36.382094+0000","last_peered":"2023-12-15T23:59:36.382094+0000","last_clean":"2023-12-15T23:59:36.382094+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:59:36.382094+0000","last_undegraded":"2023-12-15T23:59:36.382094+0000","last_fullsized":"2023-12-15T23:59:36.382094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6460,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608437+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-15T23:59:20.608437+0000","last_peered":"2023-12-15T23:59:20.608437+0000","last_clean":"2023-12-15T23:59:20.608437+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-15T23:59:20.608437+0000","last_undegraded":"2023-12-15T23:59:20.608437+0000","last_fullsized":"2023-12-15T23:59:20.608437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805819+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805819+0000","last_peered":"2023-12-16T00:01:25.805819+0000","last_clean":"2023-12-16T00:01:25.805819+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805819+0000","last_undegraded":"2023-12-16T00:01:25.805819+0000","last_fullsized":"2023-12-16T00:01:25.805819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"49'4","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712287+0000","last_change":"2023-12-15T22:53:32.193327+0000","last_active":"2023-12-16T00:00:27.712287+0000","last_peered":"2023-12-16T00:00:27.712287+0000","last_clean":"2023-12-16T00:00:27.712287+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:00:27.712287+0000","last_undegraded":"2023-12-16T00:00:27.712287+0000","last_fullsized":"2023-12-16T00:00:27.712287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288950+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-16T00:00:27.288950+0000","last_peered":"2023-12-16T00:00:27.288950+0000","last_clean":"2023-12-16T00:00:27.288950+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:00:27.288950+0000","last_undegraded":"2023-12-16T00:00:27.288950+0000","last_fullsized":"2023-12-16T00:00:27.288950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383765+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-15T23:59:41.383765+0000","last_peered":"2023-12-15T23:59:41.383765+0000","last_clean":"2023-12-15T23:59:41.383765+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-15T23:59:41.383765+0000","last_undegraded":"2023-12-15T23:59:41.383765+0000","last_fullsized":"2023-12-15T23:59:41.383765+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288444+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-16T00:00:27.288444+0000","last_peered":"2023-12-16T00:00:27.288444+0000","last_clean":"2023-12-16T00:00:27.288444+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:00:27.288444+0000","last_undegraded":"2023-12-16T00:00:27.288444+0000","last_fullsized":"2023-12-16T00:00:27.288444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.605075+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-15T23:59:05.605075+0000","last_peered":"2023-12-15T23:59:05.605075+0000","last_clean":"2023-12-15T23:59:05.605075+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-15T23:59:05.605075+0000","last_undegraded":"2023-12-15T23:59:05.605075+0000","last_fullsized":"2023-12-15T23:59:05.605075+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387908+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-15T23:59:15.387908+0000","last_peered":"2023-12-15T23:59:15.387908+0000","last_clean":"2023-12-15T23:59:15.387908+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-15T23:59:15.387908+0000","last_undegraded":"2023-12-15T23:59:15.387908+0000","last_fullsized":"2023-12-15T23:59:15.387908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:05.384346+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-15T23:59:05.384346+0000","last_peered":"2023-12-15T23:59:05.384346+0000","last_clean":"2023-12-15T23:59:05.384346+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-15T23:59:05.384346+0000","last_undegraded":"2023-12-15T23:59:05.384346+0000","last_fullsized":"2023-12-15T23:59:05.384346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.396387+0000","last_change":"2023-12-15T22:53:30.183482+0000","last_active":"2023-12-15T23:59:45.396387+0000","last_peered":"2023-12-15T23:59:45.396387+0000","last_clean":"2023-12-15T23:59:45.396387+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-15T23:59:45.396387+0000","last_undegraded":"2023-12-15T23:59:45.396387+0000","last_fullsized":"2023-12-15T23:59:45.396387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":403,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022203+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022203+0000","last_peered":"2023-12-16T00:01:14.022203+0000","last_clean":"2023-12-16T00:01:14.022203+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022203+0000","last_undegraded":"2023-12-16T00:01:14.022203+0000","last_fullsized":"2023-12-16T00:01:14.022203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016319+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-16T00:00:26.016319+0000","last_peered":"2023-12-16T00:00:26.016319+0000","last_clean":"2023-12-16T00:00:26.016319+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:00:26.016319+0000","last_undegraded":"2023-12-16T00:00:26.016319+0000","last_fullsized":"2023-12-16T00:00:26.016319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137010+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-16T00:00:28.137010+0000","last_peered":"2023-12-16T00:00:28.137010+0000","last_clean":"2023-12-16T00:00:28.137010+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:00:28.137010+0000","last_undegraded":"2023-12-16T00:00:28.137010+0000","last_fullsized":"2023-12-16T00:00:28.137010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:30.379341+0000","last_change":"2023-12-15T22:53:58.170498+0000","last_active":"2023-12-15T23:59:30.379341+0000","last_peered":"2023-12-15T23:59:30.379341+0000","last_clean":"2023-12-15T23:59:30.379341+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-15T23:59:30.379341+0000","last_undegraded":"2023-12-15T23:59:30.379341+0000","last_fullsized":"2023-12-15T23:59:30.379341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'7","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440648+0000","last_change":"2023-12-15T22:53:32.190926+0000","last_active":"2023-12-16T00:00:26.440648+0000","last_peered":"2023-12-16T00:00:26.440648+0000","last_clean":"2023-12-16T00:00:26.440648+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:00:26.440648+0000","last_undegraded":"2023-12-16T00:00:26.440648+0000","last_fullsized":"2023-12-16T00:00:26.440648+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'576","reported_seq":1745,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.389126+0000","last_change":"2023-12-15T22:53:30.181431+0000","last_active":"2023-12-16T00:00:10.389126+0000","last_peered":"2023-12-16T00:00:10.389126+0000","last_clean":"2023-12-16T00:00:10.389126+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:00:10.389126+0000","last_undegraded":"2023-12-16T00:00:10.389126+0000","last_fullsized":"2023-12-16T00:00:10.389126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283617+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283617+0000","last_peered":"2023-12-16T00:00:56.283617+0000","last_clean":"2023-12-16T00:00:56.283617+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283617+0000","last_undegraded":"2023-12-16T00:00:56.283617+0000","last_fullsized":"2023-12-16T00:00:56.283617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137167+0000","last_change":"2023-12-15T22:53:10.335248+0000","last_active":"2023-12-16T00:00:28.137167+0000","last_peered":"2023-12-16T00:00:28.137167+0000","last_clean":"2023-12-16T00:00:28.137167+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:00:28.137167+0000","last_undegraded":"2023-12-16T00:00:28.137167+0000","last_fullsized":"2023-12-16T00:00:28.137167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016191+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-16T00:00:26.016191+0000","last_peered":"2023-12-16T00:00:26.016191+0000","last_clean":"2023-12-16T00:00:26.016191+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:00:26.016191+0000","last_undegraded":"2023-12-16T00:00:26.016191+0000","last_fullsized":"2023-12-16T00:00:26.016191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389257+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-15T23:59:20.389257+0000","last_peered":"2023-12-15T23:59:20.389257+0000","last_clean":"2023-12-15T23:59:20.389257+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-15T23:59:20.389257+0000","last_undegraded":"2023-12-15T23:59:20.389257+0000","last_fullsized":"2023-12-15T23:59:20.389257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.387446+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-15T23:59:15.387446+0000","last_peered":"2023-12-15T23:59:15.387446+0000","last_clean":"2023-12-15T23:59:15.387446+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-15T23:59:15.387446+0000","last_undegraded":"2023-12-15T23:59:15.387446+0000","last_fullsized":"2023-12-15T23:59:15.387446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016591+0000","last_change":"2023-12-15T22:53:30.181209+0000","last_active":"2023-12-16T00:00:26.016591+0000","last_peered":"2023-12-16T00:00:26.016591+0000","last_clean":"2023-12-16T00:00:26.016591+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:00:26.016591+0000","last_undegraded":"2023-12-16T00:00:26.016591+0000","last_fullsized":"2023-12-16T00:00:26.016591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.393456+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-15T23:59:35.393456+0000","last_peered":"2023-12-15T23:59:35.393456+0000","last_clean":"2023-12-15T23:59:35.393456+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-15T23:59:35.393456+0000","last_undegraded":"2023-12-15T23:59:35.393456+0000","last_fullsized":"2023-12-15T23:59:35.393456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288524+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-16T00:00:27.288524+0000","last_peered":"2023-12-16T00:00:27.288524+0000","last_clean":"2023-12-16T00:00:27.288524+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:00:27.288524+0000","last_undegraded":"2023-12-16T00:00:27.288524+0000","last_fullsized":"2023-12-16T00:00:27.288524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.391372+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:59:25.391372+0000","last_peered":"2023-12-15T23:59:25.391372+0000","last_clean":"2023-12-15T23:59:25.391372+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:59:25.391372+0000","last_undegraded":"2023-12-15T23:59:25.391372+0000","last_fullsized":"2023-12-15T23:59:25.391372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383526+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:59:41.383526+0000","last_peered":"2023-12-15T23:59:41.383526+0000","last_clean":"2023-12-15T23:59:41.383526+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:59:41.383526+0000","last_undegraded":"2023-12-15T23:59:41.383526+0000","last_fullsized":"2023-12-15T23:59:41.383526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:15.388655+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-15T23:59:15.388655+0000","last_peered":"2023-12-15T23:59:15.388655+0000","last_clean":"2023-12-15T23:59:15.388655+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-15T23:59:15.388655+0000","last_undegraded":"2023-12-15T23:59:15.388655+0000","last_fullsized":"2023-12-15T23:59:15.388655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865103+0000","last_change":"2023-12-15T22:53:30.177146+0000","last_active":"2023-12-16T00:00:26.865103+0000","last_peered":"2023-12-16T00:00:26.865103+0000","last_clean":"2023-12-16T00:00:26.865103+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:00:26.865103+0000","last_undegraded":"2023-12-16T00:00:26.865103+0000","last_fullsized":"2023-12-16T00:00:26.865103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":553,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395934+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:59:45.395934+0000","last_peered":"2023-12-15T23:59:45.395934+0000","last_clean":"2023-12-15T23:59:45.395934+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:59:45.395934+0000","last_undegraded":"2023-12-15T23:59:45.395934+0000","last_fullsized":"2023-12-15T23:59:45.395934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440205+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-16T00:00:26.440205+0000","last_peered":"2023-12-16T00:00:26.440205+0000","last_clean":"2023-12-16T00:00:26.440205+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:00:26.440205+0000","last_undegraded":"2023-12-16T00:00:26.440205+0000","last_fullsized":"2023-12-16T00:00:26.440205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288621+0000","last_change":"2023-12-15T22:53:11.078721+0000","last_active":"2023-12-16T00:00:27.288621+0000","last_peered":"2023-12-16T00:00:27.288621+0000","last_clean":"2023-12-16T00:00:27.288621+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:00:27.288621+0000","last_undegraded":"2023-12-16T00:00:27.288621+0000","last_fullsized":"2023-12-16T00:00:27.288621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390239+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:59:25.390239+0000","last_peered":"2023-12-15T23:59:25.390239+0000","last_clean":"2023-12-15T23:59:25.390239+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:59:25.390239+0000","last_undegraded":"2023-12-15T23:59:25.390239+0000","last_fullsized":"2023-12-15T23:59:25.390239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1325,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609089+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-15T23:59:20.609089+0000","last_peered":"2023-12-15T23:59:20.609089+0000","last_clean":"2023-12-15T23:59:20.609089+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-15T23:59:20.609089+0000","last_undegraded":"2023-12-15T23:59:20.609089+0000","last_fullsized":"2023-12-15T23:59:20.609089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392528+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:59:35.392528+0000","last_peered":"2023-12-15T23:59:35.392528+0000","last_clean":"2023-12-15T23:59:35.392528+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:59:35.392528+0000","last_undegraded":"2023-12-15T23:59:35.392528+0000","last_fullsized":"2023-12-15T23:59:35.392528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288909+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-16T00:00:27.288909+0000","last_peered":"2023-12-16T00:00:27.288909+0000","last_clean":"2023-12-16T00:00:27.288909+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:00:27.288909+0000","last_undegraded":"2023-12-16T00:00:27.288909+0000","last_fullsized":"2023-12-16T00:00:27.288909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":364,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440502+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-16T00:00:26.440502+0000","last_peered":"2023-12-16T00:00:26.440502+0000","last_clean":"2023-12-16T00:00:26.440502+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:00:26.440502+0000","last_undegraded":"2023-12-16T00:00:26.440502+0000","last_fullsized":"2023-12-16T00:00:26.440502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'5","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711886+0000","last_change":"2023-12-15T22:53:26.158464+0000","last_active":"2023-12-16T00:00:27.711886+0000","last_peered":"2023-12-16T00:00:27.711886+0000","last_clean":"2023-12-16T00:00:27.711886+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:00:27.711886+0000","last_undegraded":"2023-12-16T00:00:27.711886+0000","last_fullsized":"2023-12-16T00:00:27.711886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384529+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:59:50.384529+0000","last_peered":"2023-12-15T23:59:50.384529+0000","last_clean":"2023-12-15T23:59:50.384529+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:59:50.384529+0000","last_undegraded":"2023-12-15T23:59:50.384529+0000","last_fullsized":"2023-12-15T23:59:50.384529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288565+0000","last_change":"2023-12-15T22:53:10.340361+0000","last_active":"2023-12-16T00:00:27.288565+0000","last_peered":"2023-12-16T00:00:27.288565+0000","last_clean":"2023-12-16T00:00:27.288565+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:00:27.288565+0000","last_undegraded":"2023-12-16T00:00:27.288565+0000","last_fullsized":"2023-12-16T00:00:27.288565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.380079+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:59:26.380079+0000","last_peered":"2023-12-15T23:59:26.380079+0000","last_clean":"2023-12-15T23:59:26.380079+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:59:26.380079+0000","last_undegraded":"2023-12-15T23:59:26.380079+0000","last_fullsized":"2023-12-15T23:59:26.380079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3845,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.609000+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-15T23:59:20.609000+0000","last_peered":"2023-12-15T23:59:20.609000+0000","last_clean":"2023-12-15T23:59:20.609000+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-15T23:59:20.609000+0000","last_undegraded":"2023-12-15T23:59:20.609000+0000","last_fullsized":"2023-12-15T23:59:20.609000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824399+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824399+0000","last_peered":"2023-12-16T00:01:20.824399+0000","last_clean":"2023-12-16T00:01:20.824399+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824399+0000","last_undegraded":"2023-12-16T00:01:20.824399+0000","last_fullsized":"2023-12-16T00:01:20.824399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:10.386931+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-15T23:59:10.386931+0000","last_peered":"2023-12-15T23:59:10.386931+0000","last_clean":"2023-12-15T23:59:10.386931+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-15T23:59:10.386931+0000","last_undegraded":"2023-12-15T23:59:10.386931+0000","last_fullsized":"2023-12-15T23:59:10.386931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288401+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-16T00:00:27.288401+0000","last_peered":"2023-12-16T00:00:27.288401+0000","last_clean":"2023-12-16T00:00:27.288401+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:00:27.288401+0000","last_undegraded":"2023-12-16T00:00:27.288401+0000","last_fullsized":"2023-12-16T00:00:27.288401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397998+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:59:50.397998+0000","last_peered":"2023-12-15T23:59:50.397998+0000","last_clean":"2023-12-15T23:59:50.397998+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:59:50.397998+0000","last_undegraded":"2023-12-15T23:59:50.397998+0000","last_fullsized":"2023-12-15T23:59:50.397998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288520+0000","last_change":"2023-12-15T22:53:10.339563+0000","last_active":"2023-12-16T00:00:27.288520+0000","last_peered":"2023-12-16T00:00:27.288520+0000","last_clean":"2023-12-16T00:00:27.288520+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:00:27.288520+0000","last_undegraded":"2023-12-16T00:00:27.288520+0000","last_fullsized":"2023-12-16T00:00:27.288520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:01.388134+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:01.388134+0000","last_peered":"2023-12-16T00:00:01.388134+0000","last_clean":"2023-12-16T00:00:01.388134+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:01.388134+0000","last_undegraded":"2023-12-16T00:00:01.388134+0000","last_fullsized":"2023-12-16T00:00:01.388134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'138","reported_seq":5870,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.379443+0000","last_change":"2023-12-15T22:54:04.179170+0000","last_active":"2023-12-15T23:59:26.379443+0000","last_peered":"2023-12-15T23:59:26.379443+0000","last_clean":"2023-12-15T23:59:26.379443+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-15T23:59:26.379443+0000","last_undegraded":"2023-12-15T23:59:26.379443+0000","last_fullsized":"2023-12-15T23:59:26.379443+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.388322+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-15T23:59:20.388322+0000","last_peered":"2023-12-15T23:59:20.388322+0000","last_clean":"2023-12-15T23:59:20.388322+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-15T23:59:20.388322+0000","last_undegraded":"2023-12-15T23:59:20.388322+0000","last_fullsized":"2023-12-15T23:59:20.388322+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"49'8","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440593+0000","last_change":"2023-12-15T22:53:32.190784+0000","last_active":"2023-12-16T00:00:26.440593+0000","last_peered":"2023-12-16T00:00:26.440593+0000","last_clean":"2023-12-16T00:00:26.440593+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:00:26.440593+0000","last_undegraded":"2023-12-16T00:00:26.440593+0000","last_fullsized":"2023-12-16T00:00:26.440593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288972+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-16T00:00:27.288972+0000","last_peered":"2023-12-16T00:00:27.288972+0000","last_clean":"2023-12-16T00:00:27.288972+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:00:27.288972+0000","last_undegraded":"2023-12-16T00:00:27.288972+0000","last_fullsized":"2023-12-16T00:00:27.288972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016195+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-16T00:00:26.016195+0000","last_peered":"2023-12-16T00:00:26.016195+0000","last_clean":"2023-12-16T00:00:26.016195+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:00:26.016195+0000","last_undegraded":"2023-12-16T00:00:26.016195+0000","last_fullsized":"2023-12-16T00:00:26.016195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.386435+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:00.386435+0000","last_peered":"2023-12-16T00:00:00.386435+0000","last_clean":"2023-12-16T00:00:00.386435+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:00.386435+0000","last_undegraded":"2023-12-16T00:00:00.386435+0000","last_fullsized":"2023-12-16T00:00:00.386435+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4019,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.609770+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-15T23:59:25.609770+0000","last_peered":"2023-12-15T23:59:25.609770+0000","last_clean":"2023-12-15T23:59:25.609770+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-15T23:59:25.609770+0000","last_undegraded":"2023-12-15T23:59:25.609770+0000","last_fullsized":"2023-12-15T23:59:25.609770+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.389659+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-15T23:59:20.389659+0000","last_peered":"2023-12-15T23:59:20.389659+0000","last_clean":"2023-12-15T23:59:20.389659+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-15T23:59:20.389659+0000","last_undegraded":"2023-12-15T23:59:20.389659+0000","last_fullsized":"2023-12-15T23:59:20.389659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016690+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-16T00:00:26.016690+0000","last_peered":"2023-12-16T00:00:26.016690+0000","last_clean":"2023-12-16T00:00:26.016690+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:00:26.016690+0000","last_undegraded":"2023-12-16T00:00:26.016690+0000","last_fullsized":"2023-12-16T00:00:26.016690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'576","reported_seq":1437,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865110+0000","last_change":"2023-12-15T22:53:30.181002+0000","last_active":"2023-12-16T00:00:26.865110+0000","last_peered":"2023-12-16T00:00:26.865110+0000","last_clean":"2023-12-16T00:00:26.865110+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:00:26.865110+0000","last_undegraded":"2023-12-16T00:00:26.865110+0000","last_fullsized":"2023-12-16T00:00:26.865110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":342,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440508+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-16T00:00:26.440508+0000","last_peered":"2023-12-16T00:00:26.440508+0000","last_clean":"2023-12-16T00:00:26.440508+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:00:26.440508+0000","last_undegraded":"2023-12-16T00:00:26.440508+0000","last_fullsized":"2023-12-16T00:00:26.440508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288505+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-16T00:00:27.288505+0000","last_peered":"2023-12-16T00:00:27.288505+0000","last_clean":"2023-12-16T00:00:27.288505+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:00:27.288505+0000","last_undegraded":"2023-12-16T00:00:27.288505+0000","last_fullsized":"2023-12-16T00:00:27.288505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399036+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:00.399036+0000","last_peered":"2023-12-16T00:00:00.399036+0000","last_clean":"2023-12-16T00:00:00.399036+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:00.399036+0000","last_undegraded":"2023-12-16T00:00:00.399036+0000","last_fullsized":"2023-12-16T00:00:00.399036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3629,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378366+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-15T23:59:25.378366+0000","last_peered":"2023-12-15T23:59:25.378366+0000","last_clean":"2023-12-15T23:59:25.378366+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-15T23:59:25.378366+0000","last_undegraded":"2023-12-15T23:59:25.378366+0000","last_fullsized":"2023-12-15T23:59:25.378366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608453+0000","last_change":"2023-12-15T22:53:58.168150+0000","last_active":"2023-12-15T23:59:20.608453+0000","last_peered":"2023-12-15T23:59:20.608453+0000","last_clean":"2023-12-15T23:59:20.608453+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-15T23:59:20.608453+0000","last_undegraded":"2023-12-15T23:59:20.608453+0000","last_fullsized":"2023-12-15T23:59:20.608453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137616+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-16T00:00:28.137616+0000","last_peered":"2023-12-16T00:00:28.137616+0000","last_clean":"2023-12-16T00:00:28.137616+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:00:28.137616+0000","last_undegraded":"2023-12-16T00:00:28.137616+0000","last_fullsized":"2023-12-16T00:00:28.137616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137515+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-16T00:00:28.137515+0000","last_peered":"2023-12-16T00:00:28.137515+0000","last_clean":"2023-12-16T00:00:28.137515+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:00:28.137515+0000","last_undegraded":"2023-12-16T00:00:28.137515+0000","last_fullsized":"2023-12-16T00:00:28.137515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.618769+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:00.618769+0000","last_peered":"2023-12-16T00:00:00.618769+0000","last_clean":"2023-12-16T00:00:00.618769+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:00.618769+0000","last_undegraded":"2023-12-16T00:00:00.618769+0000","last_fullsized":"2023-12-16T00:00:00.618769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1275,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.378284+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-15T23:59:25.378284+0000","last_peered":"2023-12-15T23:59:25.378284+0000","last_clean":"2023-12-15T23:59:25.378284+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-15T23:59:25.378284+0000","last_undegraded":"2023-12-15T23:59:25.378284+0000","last_fullsized":"2023-12-15T23:59:25.378284+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:20.608574+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-15T23:59:20.608574+0000","last_peered":"2023-12-15T23:59:20.608574+0000","last_clean":"2023-12-15T23:59:20.608574+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-15T23:59:20.608574+0000","last_undegraded":"2023-12-15T23:59:20.608574+0000","last_fullsized":"2023-12-15T23:59:20.608574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":387,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016680+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-16T00:00:26.016680+0000","last_peered":"2023-12-16T00:00:26.016680+0000","last_clean":"2023-12-16T00:00:26.016680+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:00:26.016680+0000","last_undegraded":"2023-12-16T00:00:26.016680+0000","last_fullsized":"2023-12-16T00:00:26.016680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137530+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-16T00:00:28.137530+0000","last_peered":"2023-12-16T00:00:28.137530+0000","last_clean":"2023-12-16T00:00:28.137530+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:00:28.137530+0000","last_undegraded":"2023-12-16T00:00:28.137530+0000","last_fullsized":"2023-12-16T00:00:28.137530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392748+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-15T23:59:35.392748+0000","last_peered":"2023-12-15T23:59:35.392748+0000","last_clean":"2023-12-15T23:59:35.392748+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-15T23:59:35.392748+0000","last_undegraded":"2023-12-15T23:59:35.392748+0000","last_fullsized":"2023-12-15T23:59:35.392748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711833+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-16T00:00:27.711833+0000","last_peered":"2023-12-16T00:00:27.711833+0000","last_clean":"2023-12-16T00:00:27.711833+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:00:27.711833+0000","last_undegraded":"2023-12-16T00:00:27.711833+0000","last_fullsized":"2023-12-16T00:00:27.711833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864860+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-16T00:00:26.864860+0000","last_peered":"2023-12-16T00:00:26.864860+0000","last_clean":"2023-12-16T00:00:26.864860+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:00:26.864860+0000","last_undegraded":"2023-12-16T00:00:26.864860+0000","last_fullsized":"2023-12-16T00:00:26.864860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620720+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:05.620720+0000","last_peered":"2023-12-16T00:00:05.620720+0000","last_clean":"2023-12-16T00:00:05.620720+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:05.620720+0000","last_undegraded":"2023-12-16T00:00:05.620720+0000","last_fullsized":"2023-12-16T00:00:05.620720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382010+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-15T23:59:36.382010+0000","last_peered":"2023-12-15T23:59:36.382010+0000","last_clean":"2023-12-15T23:59:36.382010+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-15T23:59:36.382010+0000","last_undegraded":"2023-12-15T23:59:36.382010+0000","last_fullsized":"2023-12-15T23:59:36.382010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620638+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:05.620638+0000","last_peered":"2023-12-16T00:00:05.620638+0000","last_clean":"2023-12-16T00:00:05.620638+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:05.620638+0000","last_undegraded":"2023-12-16T00:00:05.620638+0000","last_fullsized":"2023-12-16T00:00:05.620638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.380482+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-15T23:59:35.380482+0000","last_peered":"2023-12-15T23:59:35.380482+0000","last_clean":"2023-12-15T23:59:35.380482+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-15T23:59:35.380482+0000","last_undegraded":"2023-12-15T23:59:35.380482+0000","last_fullsized":"2023-12-15T23:59:35.380482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808750+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808750+0000","last_peered":"2023-12-16T00:01:20.808750+0000","last_clean":"2023-12-16T00:01:20.808750+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808750+0000","last_undegraded":"2023-12-16T00:01:20.808750+0000","last_fullsized":"2023-12-16T00:01:20.808750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401415+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:05.401415+0000","last_peered":"2023-12-16T00:00:05.401415+0000","last_clean":"2023-12-16T00:00:05.401415+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:05.401415+0000","last_undegraded":"2023-12-16T00:00:05.401415+0000","last_fullsized":"2023-12-16T00:00:05.401415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615003+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:59:45.615003+0000","last_peered":"2023-12-15T23:59:45.615003+0000","last_clean":"2023-12-15T23:59:45.615003+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:59:45.615003+0000","last_undegraded":"2023-12-15T23:59:45.615003+0000","last_fullsized":"2023-12-15T23:59:45.615003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620423+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:05.620423+0000","last_peered":"2023-12-16T00:00:05.620423+0000","last_clean":"2023-12-16T00:00:05.620423+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:05.620423+0000","last_undegraded":"2023-12-16T00:00:05.620423+0000","last_fullsized":"2023-12-16T00:00:05.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396136+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:59:50.396136+0000","last_peered":"2023-12-15T23:59:50.396136+0000","last_clean":"2023-12-15T23:59:50.396136+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:59:50.396136+0000","last_undegraded":"2023-12-15T23:59:50.396136+0000","last_fullsized":"2023-12-15T23:59:50.396136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384350+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:59:50.384350+0000","last_peered":"2023-12-15T23:59:50.384350+0000","last_clean":"2023-12-15T23:59:50.384350+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:59:50.384350+0000","last_undegraded":"2023-12-15T23:59:50.384350+0000","last_fullsized":"2023-12-15T23:59:50.384350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400762+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:05.400762+0000","last_peered":"2023-12-16T00:00:05.400762+0000","last_clean":"2023-12-16T00:00:05.400762+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:05.400762+0000","last_undegraded":"2023-12-16T00:00:05.400762+0000","last_fullsized":"2023-12-16T00:00:05.400762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382239+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-15T23:59:36.382239+0000","last_peered":"2023-12-15T23:59:36.382239+0000","last_clean":"2023-12-15T23:59:36.382239+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-15T23:59:36.382239+0000","last_undegraded":"2023-12-15T23:59:36.382239+0000","last_fullsized":"2023-12-15T23:59:36.382239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620507+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:05.620507+0000","last_peered":"2023-12-16T00:00:05.620507+0000","last_clean":"2023-12-16T00:00:05.620507+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:05.620507+0000","last_undegraded":"2023-12-16T00:00:05.620507+0000","last_fullsized":"2023-12-16T00:00:05.620507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.612481+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-15T23:59:35.612481+0000","last_peered":"2023-12-15T23:59:35.612481+0000","last_clean":"2023-12-15T23:59:35.612481+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-15T23:59:35.612481+0000","last_undegraded":"2023-12-15T23:59:35.612481+0000","last_fullsized":"2023-12-15T23:59:35.612481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400859+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:05.400859+0000","last_peered":"2023-12-16T00:00:05.400859+0000","last_clean":"2023-12-16T00:00:05.400859+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:05.400859+0000","last_undegraded":"2023-12-16T00:00:05.400859+0000","last_fullsized":"2023-12-16T00:00:05.400859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864894+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-16T00:00:26.864894+0000","last_peered":"2023-12-16T00:00:26.864894+0000","last_clean":"2023-12-16T00:00:26.864894+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:00:26.864894+0000","last_undegraded":"2023-12-16T00:00:26.864894+0000","last_fullsized":"2023-12-16T00:00:26.864894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392865+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-15T23:59:35.392865+0000","last_peered":"2023-12-15T23:59:35.392865+0000","last_clean":"2023-12-15T23:59:35.392865+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-15T23:59:35.392865+0000","last_undegraded":"2023-12-15T23:59:35.392865+0000","last_fullsized":"2023-12-15T23:59:35.392865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387959+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:05.387959+0000","last_peered":"2023-12-16T00:00:05.387959+0000","last_clean":"2023-12-16T00:00:05.387959+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:05.387959+0000","last_undegraded":"2023-12-16T00:00:05.387959+0000","last_fullsized":"2023-12-16T00:00:05.387959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940181+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940181+0000","last_peered":"2023-12-16T00:00:51.940181+0000","last_clean":"2023-12-16T00:00:51.940181+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940181+0000","last_undegraded":"2023-12-16T00:00:51.940181+0000","last_fullsized":"2023-12-16T00:00:51.940181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'16","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391410+0000","last_change":"2023-12-15T22:53:26.161059+0000","last_active":"2023-12-16T00:00:20.391410+0000","last_peered":"2023-12-16T00:00:20.391410+0000","last_clean":"2023-12-16T00:00:20.391410+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:00:20.391410+0000","last_undegraded":"2023-12-16T00:00:20.391410+0000","last_fullsized":"2023-12-16T00:00:20.391410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271600+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271600+0000","last_peered":"2023-12-16T00:00:41.271600+0000","last_clean":"2023-12-16T00:00:41.271600+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271600+0000","last_undegraded":"2023-12-16T00:00:41.271600+0000","last_fullsized":"2023-12-16T00:00:41.271600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":246,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925084+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925084+0000","last_peered":"2023-12-16T00:00:48.925084+0000","last_clean":"2023-12-16T00:00:48.925084+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925084+0000","last_undegraded":"2023-12-16T00:00:48.925084+0000","last_fullsized":"2023-12-16T00:00:48.925084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828204+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828204+0000","last_peered":"2023-12-16T00:00:52.828204+0000","last_clean":"2023-12-16T00:00:52.828204+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828204+0000","last_undegraded":"2023-12-16T00:00:52.828204+0000","last_fullsized":"2023-12-16T00:00:52.828204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864858+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-16T00:00:26.864858+0000","last_peered":"2023-12-16T00:00:26.864858+0000","last_clean":"2023-12-16T00:00:26.864858+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:00:26.864858+0000","last_undegraded":"2023-12-16T00:00:26.864858+0000","last_fullsized":"2023-12-16T00:00:26.864858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276225+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276225+0000","last_peered":"2023-12-16T00:01:02.276225+0000","last_clean":"2023-12-16T00:01:02.276225+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276225+0000","last_undegraded":"2023-12-16T00:01:02.276225+0000","last_fullsized":"2023-12-16T00:01:02.276225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3431,"ondisk_log_size":3431,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":837,"ondisk_log_size":837,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":660651,"num_omap_keys":2963,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23295,"ondisk_log_size":23295,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4630,"ondisk_log_size":4630,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":377,"ondisk_log_size":377,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608389,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25600000000000001},"max":{"1min":0.57299999999999995,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.57199999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.378}]},{"osd":1,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.60499999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.498},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.435}]},{"osd":2,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.72199999999999998,"15min":1.004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.34999999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":1.149},"last":0.309},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.63},"last":0.40400000000000003}]}]},{"osd":5,"up_from":11,"seq":47244641091,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.503,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.374,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.80100000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69199999999999995,"5min":0.879,"15min":0.879},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.51200000000000001},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.73499999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.73699999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.371},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.754,"15min":0.754},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.63},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.60399999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.61099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41199999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641093,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55380,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802220,"statfs":{"total":107374182400,"available":107317473280,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.255},"max":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.45800000000000002,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48699999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40200000000000002,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.441},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.311}]},{"osd":5,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42199999999999999}]}]},{"osd":2,"up_from":11,"seq":47244641090,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":0.41899999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.311,"5min":0.33800000000000002,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.40300000000000002,"5min":0.87,"15min":0.87},"last":0.31}]},{"osd":1,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.33900000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.39500000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.45000000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.30199999999999999},"max":{"1min":0.78700000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.71899999999999997,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.443},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.29399999999999998},"max":{"1min":0.73599999999999999,"5min":1.169,"15min":1.169},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Dec 16 00:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.501}]}]},{"osd":1,"up_from":11,"seq":47244641091,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.247,"5min":0.23200000000000001,"15min":0.20399999999999999},"max":{"1min":0.434,"5min":0.436,"15min":0.53100000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.26300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44900000000000001,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29999999999999999},"max":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.80900000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.75700000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":0.76700000000000002,"15min":0.878},"last":0.499}]},{"osd":5,"last update":"Sat Dec 16 00:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.82099999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.436}]}]},{"osd":0,"up_from":11,"seq":47244641091,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.434,"5min":0.46400000000000002,"15min":0.51200000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23499999999999999,"15min":0.20799999999999999},"max":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.24099999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34000000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.45200000000000001,"5min":0.5,"15min":0.5},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68999999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.33700000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.875},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.80200000000000005,"15min":0.81499999999999995},"last":0.496}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:01:29.943 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.944 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.944 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.944 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.944 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.945 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.945 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.945 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.945 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.945 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.946 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.947 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.947 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.947 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.947 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.947 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.948 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.948 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.948 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.948 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.948 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.949 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.950 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.950 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.950 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.950 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.950 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.951 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.951 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.951 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.951 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.951 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.952 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.952 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.952 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.952 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.952 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.953 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.954 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.954 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.954 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.954 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.955 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.955 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.955 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.955 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.955 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.956 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.956 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.956 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.956 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.956 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.957 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.957 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.957 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.957 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.957 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.958 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.958 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.958 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.958 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.958 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.959 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.959 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.959 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.959 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.959 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.960 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.961 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.961 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.961 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.961 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.961 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.962 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.962 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.962 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.962 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.962 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.963 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.963 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.963 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.963 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.963 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.964 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.964 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.964 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.964 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.964 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.965 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.965 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.965 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.965 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.965 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.966 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.966 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.966 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.966 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.966 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.967 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.968 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.968 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.968 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.968 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.968 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.969 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.969 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.969 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.969 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.969 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.970 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.970 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.970 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.970 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.970 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.971 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.971 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.971 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.971 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.971 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.972 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.972 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.972 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.972 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.972 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.973 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.973 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.973 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.973 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.974 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.974 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.974 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.977 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.977 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.977 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.977 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.977 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.978 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.978 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.978 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.978 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.978 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.979 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.979 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.979 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.979 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.979 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.980 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.980 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.980 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.980 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.980 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.981 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.981 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.981 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.981 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.981 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.982 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.983 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.983 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.983 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.983 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.983 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.984 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.984 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.984 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.984 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.984 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.985 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.985 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.985 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.985 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.985 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.986 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.987 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.987 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.987 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.987 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.988 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.988 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.988 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.988 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.988 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.989 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.990 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.990 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.990 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.990 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.990 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.991 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.991 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.991 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.991 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.991 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.992 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.992 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.992 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.992 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.992 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.993 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.993 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.993 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.993 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.993 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.994 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.994 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.994 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.994 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.994 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.995 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.995 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.995 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.995 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.995 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.996 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.996 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.996 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.996 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.996 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.997 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.998 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.998 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.998 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.998 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:29.999 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.000 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.000 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.000 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.000 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.000 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.001 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.001 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.001 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.001 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.001 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.002 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.002 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.002 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.002 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.002 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.003 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.003 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.003 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.003 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.003 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.004 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.004 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.004 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.004 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.004 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.005 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.005 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.005 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.005 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.005 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.006 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.006 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.006 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.006 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.006 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.007 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.007 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.007 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.007 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.007 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.008 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.008 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.008 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.008 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.008 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.009 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.009 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.009 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.009 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.010 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.011 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.011 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.011 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.011 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.011 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.012 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.012 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.012 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.012 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.012 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.013 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.013 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.013 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.013 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.013 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.014 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.014 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.014 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.014 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.014 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.015 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.016 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.016 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.016 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.016 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.016 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.017 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.018 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.018 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.018 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.018 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.018 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.019 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.019 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.019 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.019 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.019 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.020 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.020 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.020 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.020 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.020 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.021 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.022 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.022 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.022 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.022 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.022 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.023 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.023 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.023 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.023 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.023 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.024 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.025 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.025 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.025 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.025 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.025 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.026 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:30.026 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:01:50.028 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:01:50.372 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:01:50.392 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:01:50.396 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2141,"stamp":"2023-12-16T00:01:50.214003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684395,"num_omap_keys":3079,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35227,"ondisk_log_size":35227,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":295448,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":285558,"kb_avail":628850152,"statfs":{"total":644245094400,"available":643942555648,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":292412065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005936"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288074+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-16T00:00:27.288074+0000","last_peered":"2023-12-16T00:00:27.288074+0000","last_clean":"2023-12-16T00:00:27.288074+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:00:27.288074+0000","last_undegraded":"2023-12-16T00:00:27.288074+0000","last_fullsized":"2023-12-16T00:00:27.288074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615260+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-15T23:59:45.615260+0000","last_peered":"2023-12-15T23:59:45.615260+0000","last_clean":"2023-12-15T23:59:45.615260+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-15T23:59:45.615260+0000","last_undegraded":"2023-12-15T23:59:45.615260+0000","last_fullsized":"2023-12-15T23:59:45.615260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711556+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-16T00:00:27.711556+0000","last_peered":"2023-12-16T00:00:27.711556+0000","last_clean":"2023-12-16T00:00:27.711556+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:00:27.711556+0000","last_undegraded":"2023-12-16T00:00:27.711556+0000","last_fullsized":"2023-12-16T00:00:27.711556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864382+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-16T00:00:26.864382+0000","last_peered":"2023-12-16T00:00:26.864382+0000","last_clean":"2023-12-16T00:00:26.864382+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:00:26.864382+0000","last_undegraded":"2023-12-16T00:00:26.864382+0000","last_fullsized":"2023-12-16T00:00:26.864382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712145+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712145+0000","last_peered":"2023-12-16T00:00:37.712145+0000","last_clean":"2023-12-16T00:00:37.712145+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712145+0000","last_undegraded":"2023-12-16T00:00:37.712145+0000","last_fullsized":"2023-12-16T00:00:37.712145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887146+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887146+0000","last_peered":"2023-12-16T00:01:04.887146+0000","last_clean":"2023-12-16T00:01:04.887146+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887146+0000","last_undegraded":"2023-12-16T00:01:04.887146+0000","last_fullsized":"2023-12-16T00:01:04.887146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682425+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682425+0000","last_peered":"2023-12-16T00:01:44.682425+0000","last_clean":"2023-12-16T00:01:44.682425+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682425+0000","last_undegraded":"2023-12-16T00:01:44.682425+0000","last_fullsized":"2023-12-16T00:01:44.682425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"49'5","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864867+0000","last_change":"2023-12-15T22:53:26.157077+0000","last_active":"2023-12-16T00:00:26.864867+0000","last_peered":"2023-12-16T00:00:26.864867+0000","last_clean":"2023-12-16T00:00:26.864867+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:00:26.864867+0000","last_undegraded":"2023-12-16T00:00:26.864867+0000","last_fullsized":"2023-12-16T00:00:26.864867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1694,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404611+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:20.404611+0000","last_peered":"2023-12-16T00:00:20.404611+0000","last_clean":"2023-12-16T00:00:20.404611+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:20.404611+0000","last_undegraded":"2023-12-16T00:00:20.404611+0000","last_fullsized":"2023-12-16T00:00:20.404611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289181+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-16T00:00:27.289181+0000","last_peered":"2023-12-16T00:00:27.289181+0000","last_clean":"2023-12-16T00:00:27.289181+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:00:27.289181+0000","last_undegraded":"2023-12-16T00:00:27.289181+0000","last_fullsized":"2023-12-16T00:00:27.289181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864737+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-16T00:00:26.864737+0000","last_peered":"2023-12-16T00:00:26.864737+0000","last_clean":"2023-12-16T00:00:26.864737+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:00:26.864737+0000","last_undegraded":"2023-12-16T00:00:26.864737+0000","last_fullsized":"2023-12-16T00:00:26.864737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711857+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-16T00:00:27.711857+0000","last_peered":"2023-12-16T00:00:27.711857+0000","last_clean":"2023-12-16T00:00:27.711857+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:00:27.711857+0000","last_undegraded":"2023-12-16T00:00:27.711857+0000","last_fullsized":"2023-12-16T00:00:27.711857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137042+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-16T00:00:28.137042+0000","last_peered":"2023-12-16T00:00:28.137042+0000","last_clean":"2023-12-16T00:00:28.137042+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:00:28.137042+0000","last_undegraded":"2023-12-16T00:00:28.137042+0000","last_fullsized":"2023-12-16T00:00:28.137042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137802+0000","last_change":"2023-12-15T22:53:58.167654+0000","last_active":"2023-12-16T00:00:28.137802+0000","last_peered":"2023-12-16T00:00:28.137802+0000","last_clean":"2023-12-16T00:00:28.137802+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:00:28.137802+0000","last_undegraded":"2023-12-16T00:00:28.137802+0000","last_fullsized":"2023-12-16T00:00:28.137802+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016740+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-16T00:00:26.016740+0000","last_peered":"2023-12-16T00:00:26.016740+0000","last_clean":"2023-12-16T00:00:26.016740+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:00:26.016740+0000","last_undegraded":"2023-12-16T00:00:26.016740+0000","last_fullsized":"2023-12-16T00:00:26.016740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752008+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752008+0000","last_peered":"2023-12-16T00:01:25.752008+0000","last_clean":"2023-12-16T00:01:25.752008+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752008+0000","last_undegraded":"2023-12-16T00:01:25.752008+0000","last_fullsized":"2023-12-16T00:01:25.752008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137126+0000","last_change":"2023-12-15T22:53:10.340880+0000","last_active":"2023-12-16T00:00:28.137126+0000","last_peered":"2023-12-16T00:00:28.137126+0000","last_clean":"2023-12-16T00:00:28.137126+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:00:28.137126+0000","last_undegraded":"2023-12-16T00:00:28.137126+0000","last_fullsized":"2023-12-16T00:00:28.137126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711788+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-16T00:00:27.711788+0000","last_peered":"2023-12-16T00:00:27.711788+0000","last_clean":"2023-12-16T00:00:27.711788+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:00:27.711788+0000","last_undegraded":"2023-12-16T00:00:27.711788+0000","last_fullsized":"2023-12-16T00:00:27.711788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842553+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842553+0000","last_peered":"2023-12-16T00:01:24.842553+0000","last_clean":"2023-12-16T00:01:24.842553+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842553+0000","last_undegraded":"2023-12-16T00:01:24.842553+0000","last_fullsized":"2023-12-16T00:01:24.842553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016303+0000","last_change":"2023-12-15T22:53:10.340303+0000","last_active":"2023-12-16T00:00:26.016303+0000","last_peered":"2023-12-16T00:00:26.016303+0000","last_clean":"2023-12-16T00:00:26.016303+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:00:26.016303+0000","last_undegraded":"2023-12-16T00:00:26.016303+0000","last_fullsized":"2023-12-16T00:00:26.016303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'12","reported_seq":796,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288485+0000","last_change":"2023-12-15T22:53:08.332822+0000","last_active":"2023-12-16T00:00:27.288485+0000","last_peered":"2023-12-16T00:00:27.288485+0000","last_clean":"2023-12-16T00:00:27.288485+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:00:27.288485+0000","last_undegraded":"2023-12-16T00:00:27.288485+0000","last_fullsized":"2023-12-16T00:00:27.288485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":985,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016955+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-16T00:00:26.016955+0000","last_peered":"2023-12-16T00:00:26.016955+0000","last_clean":"2023-12-16T00:00:26.016955+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:00:26.016955+0000","last_undegraded":"2023-12-16T00:00:26.016955+0000","last_fullsized":"2023-12-16T00:00:26.016955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840606+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840606+0000","last_peered":"2023-12-16T00:01:18.840606+0000","last_clean":"2023-12-16T00:01:18.840606+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840606+0000","last_undegraded":"2023-12-16T00:01:18.840606+0000","last_fullsized":"2023-12-16T00:01:18.840606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"49'6","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403315+0000","last_change":"2023-12-15T22:53:32.197134+0000","last_active":"2023-12-16T00:00:15.403315+0000","last_peered":"2023-12-16T00:00:15.403315+0000","last_clean":"2023-12-16T00:00:15.403315+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:00:15.403315+0000","last_undegraded":"2023-12-16T00:00:15.403315+0000","last_fullsized":"2023-12-16T00:00:15.403315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711864+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-16T00:00:27.711864+0000","last_peered":"2023-12-16T00:00:27.711864+0000","last_clean":"2023-12-16T00:00:27.711864+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:00:27.711864+0000","last_undegraded":"2023-12-16T00:00:27.711864+0000","last_fullsized":"2023-12-16T00:00:27.711864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'12","reported_seq":797,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440204+0000","last_change":"2023-12-15T22:53:08.329693+0000","last_active":"2023-12-16T00:00:26.440204+0000","last_peered":"2023-12-16T00:00:26.440204+0000","last_clean":"2023-12-16T00:00:26.440204+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:00:26.440204+0000","last_undegraded":"2023-12-16T00:00:26.440204+0000","last_fullsized":"2023-12-16T00:00:26.440204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289103+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-16T00:00:27.289103+0000","last_peered":"2023-12-16T00:00:27.289103+0000","last_clean":"2023-12-16T00:00:27.289103+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:00:27.289103+0000","last_undegraded":"2023-12-16T00:00:27.289103+0000","last_fullsized":"2023-12-16T00:00:27.289103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883691+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883691+0000","last_peered":"2023-12-16T00:01:42.883691+0000","last_clean":"2023-12-16T00:01:42.883691+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883691+0000","last_undegraded":"2023-12-16T00:01:42.883691+0000","last_fullsized":"2023-12-16T00:01:42.883691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173626+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173626+0000","last_peered":"2023-12-16T00:01:08.173626+0000","last_clean":"2023-12-16T00:01:08.173626+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173626+0000","last_undegraded":"2023-12-16T00:01:08.173626+0000","last_fullsized":"2023-12-16T00:01:08.173626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400328+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:05.400328+0000","last_peered":"2023-12-16T00:00:05.400328+0000","last_clean":"2023-12-16T00:00:05.400328+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:05.400328+0000","last_undegraded":"2023-12-16T00:00:05.400328+0000","last_fullsized":"2023-12-16T00:00:05.400328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403768+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:15.403768+0000","last_peered":"2023-12-16T00:00:15.403768+0000","last_clean":"2023-12-16T00:00:15.403768+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:15.403768+0000","last_undegraded":"2023-12-16T00:00:15.403768+0000","last_fullsized":"2023-12-16T00:00:15.403768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999329+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999329+0000","last_peered":"2023-12-16T00:01:23.999329+0000","last_clean":"2023-12-16T00:01:23.999329+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999329+0000","last_undegraded":"2023-12-16T00:01:23.999329+0000","last_fullsized":"2023-12-16T00:01:23.999329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397530+0000","last_change":"2023-12-15T22:53:10.340910+0000","last_active":"2023-12-15T23:59:50.397530+0000","last_peered":"2023-12-15T23:59:50.397530+0000","last_clean":"2023-12-15T23:59:50.397530+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-15T23:59:50.397530+0000","last_undegraded":"2023-12-15T23:59:50.397530+0000","last_fullsized":"2023-12-15T23:59:50.397530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402635+0000","last_change":"2023-12-15T22:53:58.169088+0000","last_active":"2023-12-16T00:00:15.402635+0000","last_peered":"2023-12-16T00:00:15.402635+0000","last_clean":"2023-12-16T00:00:15.402635+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:00:15.402635+0000","last_undegraded":"2023-12-16T00:00:15.402635+0000","last_fullsized":"2023-12-16T00:00:15.402635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402738+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-16T00:00:15.402738+0000","last_peered":"2023-12-16T00:00:15.402738+0000","last_clean":"2023-12-16T00:00:15.402738+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:00:15.402738+0000","last_undegraded":"2023-12-16T00:00:15.402738+0000","last_fullsized":"2023-12-16T00:00:15.402738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175678+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175678+0000","last_peered":"2023-12-16T00:01:32.175678+0000","last_clean":"2023-12-16T00:01:32.175678+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175678+0000","last_undegraded":"2023-12-16T00:01:32.175678+0000","last_fullsized":"2023-12-16T00:01:32.175678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867711+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867711+0000","last_peered":"2023-12-16T00:00:31.867711+0000","last_clean":"2023-12-16T00:00:31.867711+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867711+0000","last_undegraded":"2023-12-16T00:00:31.867711+0000","last_fullsized":"2023-12-16T00:00:31.867711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389472+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:06.389472+0000","last_peered":"2023-12-16T00:00:06.389472+0000","last_clean":"2023-12-16T00:00:06.389472+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:06.389472+0000","last_undegraded":"2023-12-16T00:00:06.389472+0000","last_fullsized":"2023-12-16T00:00:06.389472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.389884+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:15.389884+0000","last_peered":"2023-12-16T00:00:15.389884+0000","last_clean":"2023-12-16T00:00:15.389884+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:15.389884+0000","last_undegraded":"2023-12-16T00:00:15.389884+0000","last_fullsized":"2023-12-16T00:00:15.389884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440121+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-16T00:00:26.440121+0000","last_peered":"2023-12-16T00:00:26.440121+0000","last_clean":"2023-12-16T00:00:26.440121+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:00:26.440121+0000","last_undegraded":"2023-12-16T00:00:26.440121+0000","last_fullsized":"2023-12-16T00:00:26.440121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864668+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-16T00:00:26.864668+0000","last_peered":"2023-12-16T00:00:26.864668+0000","last_clean":"2023-12-16T00:00:26.864668+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:00:26.864668+0000","last_undegraded":"2023-12-16T00:00:26.864668+0000","last_fullsized":"2023-12-16T00:00:26.864668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389798+0000","last_change":"2023-12-15T22:53:10.339809+0000","last_active":"2023-12-16T00:00:06.389798+0000","last_peered":"2023-12-16T00:00:06.389798+0000","last_clean":"2023-12-16T00:00:06.389798+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:00:06.389798+0000","last_undegraded":"2023-12-16T00:00:06.389798+0000","last_fullsized":"2023-12-16T00:00:06.389798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'98","reported_seq":1651,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391131+0000","last_change":"2023-12-15T22:55:02.204131+0000","last_active":"2023-12-16T00:00:20.391131+0000","last_peered":"2023-12-16T00:00:20.391131+0000","last_clean":"2023-12-16T00:00:20.391131+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:00:20.391131+0000","last_undegraded":"2023-12-16T00:00:20.391131+0000","last_fullsized":"2023-12-16T00:00:20.391131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016723+0000","last_change":"2023-12-15T22:53:58.162163+0000","last_active":"2023-12-16T00:00:26.016723+0000","last_peered":"2023-12-16T00:00:26.016723+0000","last_clean":"2023-12-16T00:00:26.016723+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:00:26.016723+0000","last_undegraded":"2023-12-16T00:00:26.016723+0000","last_fullsized":"2023-12-16T00:00:26.016723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402873+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-16T00:00:15.402873+0000","last_peered":"2023-12-16T00:00:15.402873+0000","last_clean":"2023-12-16T00:00:15.402873+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:00:15.402873+0000","last_undegraded":"2023-12-16T00:00:15.402873+0000","last_fullsized":"2023-12-16T00:00:15.402873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725058+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725058+0000","last_peered":"2023-12-16T00:00:59.725058+0000","last_clean":"2023-12-16T00:00:59.725058+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725058+0000","last_undegraded":"2023-12-16T00:00:59.725058+0000","last_fullsized":"2023-12-16T00:00:59.725058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155892+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155892+0000","last_peered":"2023-12-16T00:01:18.155892+0000","last_clean":"2023-12-16T00:01:18.155892+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155892+0000","last_undegraded":"2023-12-16T00:01:18.155892+0000","last_fullsized":"2023-12-16T00:01:18.155892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867666+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867666+0000","last_peered":"2023-12-16T00:00:52.867666+0000","last_clean":"2023-12-16T00:00:52.867666+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867666+0000","last_undegraded":"2023-12-16T00:00:52.867666+0000","last_fullsized":"2023-12-16T00:00:52.867666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219646+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219646+0000","last_peered":"2023-12-16T00:01:31.219646+0000","last_clean":"2023-12-16T00:01:31.219646+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219646+0000","last_undegraded":"2023-12-16T00:01:31.219646+0000","last_fullsized":"2023-12-16T00:01:31.219646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137741+0000","last_change":"2023-12-15T22:53:58.167421+0000","last_active":"2023-12-16T00:00:28.137741+0000","last_peered":"2023-12-16T00:00:28.137741+0000","last_clean":"2023-12-16T00:00:28.137741+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:00:28.137741+0000","last_undegraded":"2023-12-16T00:00:28.137741+0000","last_fullsized":"2023-12-16T00:00:28.137741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"49'8","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403136+0000","last_change":"2023-12-15T22:53:32.189288+0000","last_active":"2023-12-16T00:00:15.403136+0000","last_peered":"2023-12-16T00:00:15.403136+0000","last_clean":"2023-12-16T00:00:15.403136+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:00:15.403136+0000","last_undegraded":"2023-12-16T00:00:15.403136+0000","last_fullsized":"2023-12-16T00:00:15.403136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699750+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699750+0000","last_peered":"2023-12-16T00:01:28.699750+0000","last_clean":"2023-12-16T00:01:28.699750+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699750+0000","last_undegraded":"2023-12-16T00:01:28.699750+0000","last_fullsized":"2023-12-16T00:01:28.699750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790096+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790096+0000","last_peered":"2023-12-16T00:00:57.790096+0000","last_clean":"2023-12-16T00:00:57.790096+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790096+0000","last_undegraded":"2023-12-16T00:00:57.790096+0000","last_fullsized":"2023-12-16T00:00:57.790096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391200+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-16T00:00:20.391200+0000","last_peered":"2023-12-16T00:00:20.391200+0000","last_clean":"2023-12-16T00:00:20.391200+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:00:20.391200+0000","last_undegraded":"2023-12-16T00:00:20.391200+0000","last_fullsized":"2023-12-16T00:00:20.391200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750337+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750337+0000","last_peered":"2023-12-16T00:00:48.750337+0000","last_clean":"2023-12-16T00:00:48.750337+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750337+0000","last_undegraded":"2023-12-16T00:00:48.750337+0000","last_fullsized":"2023-12-16T00:00:48.750337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745075+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745075+0000","last_peered":"2023-12-16T00:01:28.745075+0000","last_clean":"2023-12-16T00:01:28.745075+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745075+0000","last_undegraded":"2023-12-16T00:01:28.745075+0000","last_fullsized":"2023-12-16T00:01:28.745075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403966+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:15.403966+0000","last_peered":"2023-12-16T00:00:15.403966+0000","last_clean":"2023-12-16T00:00:15.403966+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:15.403966+0000","last_undegraded":"2023-12-16T00:00:15.403966+0000","last_fullsized":"2023-12-16T00:00:15.403966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231136+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231136+0000","last_peered":"2023-12-16T00:01:34.231136+0000","last_clean":"2023-12-16T00:01:34.231136+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231136+0000","last_undegraded":"2023-12-16T00:01:34.231136+0000","last_fullsized":"2023-12-16T00:01:34.231136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015540+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015540+0000","last_peered":"2023-12-16T00:01:22.015540+0000","last_clean":"2023-12-16T00:01:22.015540+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015540+0000","last_undegraded":"2023-12-16T00:01:22.015540+0000","last_fullsized":"2023-12-16T00:01:22.015540+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233326+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233326+0000","last_peered":"2023-12-16T00:00:26.233326+0000","last_clean":"2023-12-16T00:00:26.233326+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233326+0000","last_undegraded":"2023-12-16T00:00:26.233326+0000","last_fullsized":"2023-12-16T00:00:26.233326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016185+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-16T00:00:26.016185+0000","last_peered":"2023-12-16T00:00:26.016185+0000","last_clean":"2023-12-16T00:00:26.016185+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:00:26.016185+0000","last_undegraded":"2023-12-16T00:00:26.016185+0000","last_fullsized":"2023-12-16T00:00:26.016185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137791+0000","last_change":"2023-12-15T22:53:58.167345+0000","last_active":"2023-12-16T00:00:28.137791+0000","last_peered":"2023-12-16T00:00:28.137791+0000","last_clean":"2023-12-16T00:00:28.137791+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:00:28.137791+0000","last_undegraded":"2023-12-16T00:00:28.137791+0000","last_fullsized":"2023-12-16T00:00:28.137791+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289035+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-16T00:00:27.289035+0000","last_peered":"2023-12-16T00:00:27.289035+0000","last_clean":"2023-12-16T00:00:27.289035+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:00:27.289035+0000","last_undegraded":"2023-12-16T00:00:27.289035+0000","last_fullsized":"2023-12-16T00:00:27.289035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875695+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875695+0000","last_peered":"2023-12-16T00:01:05.875695+0000","last_clean":"2023-12-16T00:01:05.875695+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875695+0000","last_undegraded":"2023-12-16T00:01:05.875695+0000","last_fullsized":"2023-12-16T00:01:05.875695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":864,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835775+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835775+0000","last_peered":"2023-12-16T00:00:29.835775+0000","last_clean":"2023-12-16T00:00:29.835775+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835775+0000","last_undegraded":"2023-12-16T00:00:29.835775+0000","last_fullsized":"2023-12-16T00:00:29.835775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864514+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-16T00:00:26.864514+0000","last_peered":"2023-12-16T00:00:26.864514+0000","last_clean":"2023-12-16T00:00:26.864514+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:00:26.864514+0000","last_undegraded":"2023-12-16T00:00:26.864514+0000","last_fullsized":"2023-12-16T00:00:26.864514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864656+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-16T00:00:26.864656+0000","last_peered":"2023-12-16T00:00:26.864656+0000","last_clean":"2023-12-16T00:00:26.864656+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:00:26.864656+0000","last_undegraded":"2023-12-16T00:00:26.864656+0000","last_fullsized":"2023-12-16T00:00:26.864656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873610+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873610+0000","last_peered":"2023-12-16T00:01:08.873610+0000","last_clean":"2023-12-16T00:01:08.873610+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873610+0000","last_undegraded":"2023-12-16T00:01:08.873610+0000","last_fullsized":"2023-12-16T00:01:08.873610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289163+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-16T00:00:27.289163+0000","last_peered":"2023-12-16T00:00:27.289163+0000","last_clean":"2023-12-16T00:00:27.289163+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:00:27.289163+0000","last_undegraded":"2023-12-16T00:00:27.289163+0000","last_fullsized":"2023-12-16T00:00:27.289163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033890+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033890+0000","last_peered":"2023-12-16T00:01:34.033890+0000","last_clean":"2023-12-16T00:01:34.033890+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033890+0000","last_undegraded":"2023-12-16T00:01:34.033890+0000","last_fullsized":"2023-12-16T00:01:34.033890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473143+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473143+0000","last_peered":"2023-12-16T00:00:47.473143+0000","last_clean":"2023-12-16T00:00:47.473143+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473143+0000","last_undegraded":"2023-12-16T00:00:47.473143+0000","last_fullsized":"2023-12-16T00:00:47.473143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121731+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121731+0000","last_peered":"2023-12-16T00:00:35.121731+0000","last_clean":"2023-12-16T00:00:35.121731+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121731+0000","last_undegraded":"2023-12-16T00:00:35.121731+0000","last_fullsized":"2023-12-16T00:00:35.121731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389440+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:06.389440+0000","last_peered":"2023-12-16T00:00:06.389440+0000","last_clean":"2023-12-16T00:00:06.389440+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:06.389440+0000","last_undegraded":"2023-12-16T00:00:06.389440+0000","last_fullsized":"2023-12-16T00:00:06.389440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440142+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-16T00:00:26.440142+0000","last_peered":"2023-12-16T00:00:26.440142+0000","last_clean":"2023-12-16T00:00:26.440142+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:00:26.440142+0000","last_undegraded":"2023-12-16T00:00:26.440142+0000","last_fullsized":"2023-12-16T00:00:26.440142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711777+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:27.711777+0000","last_peered":"2023-12-16T00:00:27.711777+0000","last_clean":"2023-12-16T00:00:27.711777+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:00:27.711777+0000","last_undegraded":"2023-12-16T00:00:27.711777+0000","last_fullsized":"2023-12-16T00:00:27.711777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385854+0000","last_change":"2023-12-15T22:53:10.340537+0000","last_active":"2023-12-15T23:59:51.385854+0000","last_peered":"2023-12-15T23:59:51.385854+0000","last_clean":"2023-12-15T23:59:51.385854+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-15T23:59:51.385854+0000","last_undegraded":"2023-12-15T23:59:51.385854+0000","last_fullsized":"2023-12-15T23:59:51.385854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1760,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016807+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-16T00:00:26.016807+0000","last_peered":"2023-12-16T00:00:26.016807+0000","last_clean":"2023-12-16T00:00:26.016807+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:00:26.016807+0000","last_undegraded":"2023-12-16T00:00:26.016807+0000","last_fullsized":"2023-12-16T00:00:26.016807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289112+0000","last_change":"2023-12-15T22:53:58.170674+0000","last_active":"2023-12-16T00:00:27.289112+0000","last_peered":"2023-12-16T00:00:27.289112+0000","last_clean":"2023-12-16T00:00:27.289112+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:00:27.289112+0000","last_undegraded":"2023-12-16T00:00:27.289112+0000","last_fullsized":"2023-12-16T00:00:27.289112+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984524+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984524+0000","last_peered":"2023-12-16T00:01:24.984524+0000","last_clean":"2023-12-16T00:01:24.984524+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984524+0000","last_undegraded":"2023-12-16T00:01:24.984524+0000","last_fullsized":"2023-12-16T00:01:24.984524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":550,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529119+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529119+0000","last_peered":"2023-12-16T00:00:50.529119+0000","last_clean":"2023-12-16T00:00:50.529119+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529119+0000","last_undegraded":"2023-12-16T00:00:50.529119+0000","last_fullsized":"2023-12-16T00:00:50.529119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710437+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710437+0000","last_peered":"2023-12-16T00:00:43.710437+0000","last_clean":"2023-12-16T00:00:43.710437+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710437+0000","last_undegraded":"2023-12-16T00:00:43.710437+0000","last_fullsized":"2023-12-16T00:00:43.710437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387461+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:05.387461+0000","last_peered":"2023-12-16T00:00:05.387461+0000","last_clean":"2023-12-16T00:00:05.387461+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:05.387461+0000","last_undegraded":"2023-12-16T00:00:05.387461+0000","last_fullsized":"2023-12-16T00:00:05.387461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288427+0000","last_change":"2023-12-15T22:53:08.330175+0000","last_active":"2023-12-16T00:00:27.288427+0000","last_peered":"2023-12-16T00:00:27.288427+0000","last_clean":"2023-12-16T00:00:27.288427+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:00:27.288427+0000","last_undegraded":"2023-12-16T00:00:27.288427+0000","last_fullsized":"2023-12-16T00:00:27.288427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.883952+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.883952+0000","last_peered":"2023-12-16T00:01:13.883952+0000","last_clean":"2023-12-16T00:01:13.883952+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.883952+0000","last_undegraded":"2023-12-16T00:01:13.883952+0000","last_fullsized":"2023-12-16T00:01:13.883952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1479,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382667+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-15T23:59:36.382667+0000","last_peered":"2023-12-15T23:59:36.382667+0000","last_clean":"2023-12-15T23:59:36.382667+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-15T23:59:36.382667+0000","last_undegraded":"2023-12-15T23:59:36.382667+0000","last_fullsized":"2023-12-15T23:59:36.382667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682626+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682626+0000","last_peered":"2023-12-16T00:01:33.682626+0000","last_clean":"2023-12-16T00:01:33.682626+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682626+0000","last_undegraded":"2023-12-16T00:01:33.682626+0000","last_fullsized":"2023-12-16T00:01:33.682626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975152+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975152+0000","last_peered":"2023-12-16T00:01:38.975152+0000","last_clean":"2023-12-16T00:01:38.975152+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975152+0000","last_undegraded":"2023-12-16T00:01:38.975152+0000","last_fullsized":"2023-12-16T00:01:38.975152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'3","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864722+0000","last_change":"2023-12-15T22:53:26.164548+0000","last_active":"2023-12-16T00:00:26.864722+0000","last_peered":"2023-12-16T00:00:26.864722+0000","last_clean":"2023-12-16T00:00:26.864722+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:00:26.864722+0000","last_undegraded":"2023-12-16T00:00:26.864722+0000","last_fullsized":"2023-12-16T00:00:26.864722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396920+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-15T23:59:50.396920+0000","last_peered":"2023-12-15T23:59:50.396920+0000","last_clean":"2023-12-15T23:59:50.396920+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-15T23:59:50.396920+0000","last_undegraded":"2023-12-15T23:59:50.396920+0000","last_fullsized":"2023-12-15T23:59:50.396920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405397+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:25.405397+0000","last_peered":"2023-12-16T00:00:25.405397+0000","last_clean":"2023-12-16T00:00:25.405397+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:25.405397+0000","last_undegraded":"2023-12-16T00:00:25.405397+0000","last_fullsized":"2023-12-16T00:00:25.405397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384782+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-15T23:59:46.384782+0000","last_peered":"2023-12-15T23:59:46.384782+0000","last_clean":"2023-12-15T23:59:46.384782+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-15T23:59:46.384782+0000","last_undegraded":"2023-12-15T23:59:46.384782+0000","last_fullsized":"2023-12-15T23:59:46.384782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730461+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730461+0000","last_peered":"2023-12-16T00:01:36.730461+0000","last_clean":"2023-12-16T00:01:36.730461+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730461+0000","last_undegraded":"2023-12-16T00:01:36.730461+0000","last_fullsized":"2023-12-16T00:01:36.730461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712436+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-16T00:00:27.712436+0000","last_peered":"2023-12-16T00:00:27.712436+0000","last_clean":"2023-12-16T00:00:27.712436+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:00:27.712436+0000","last_undegraded":"2023-12-16T00:00:27.712436+0000","last_fullsized":"2023-12-16T00:00:27.712436+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016632+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-16T00:00:26.016632+0000","last_peered":"2023-12-16T00:00:26.016632+0000","last_clean":"2023-12-16T00:00:26.016632+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:00:26.016632+0000","last_undegraded":"2023-12-16T00:00:26.016632+0000","last_fullsized":"2023-12-16T00:00:26.016632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693630+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693630+0000","last_peered":"2023-12-16T00:01:41.693630+0000","last_clean":"2023-12-16T00:01:41.693630+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693630+0000","last_undegraded":"2023-12-16T00:01:41.693630+0000","last_fullsized":"2023-12-16T00:01:41.693630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439858+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-16T00:00:26.439858+0000","last_peered":"2023-12-16T00:00:26.439858+0000","last_clean":"2023-12-16T00:00:26.439858+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:00:26.439858+0000","last_undegraded":"2023-12-16T00:00:26.439858+0000","last_fullsized":"2023-12-16T00:00:26.439858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399480+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:00.399480+0000","last_peered":"2023-12-16T00:00:00.399480+0000","last_clean":"2023-12-16T00:00:00.399480+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:00.399480+0000","last_undegraded":"2023-12-16T00:00:00.399480+0000","last_fullsized":"2023-12-16T00:00:00.399480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.624945+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-16T00:00:20.624945+0000","last_peered":"2023-12-16T00:00:20.624945+0000","last_clean":"2023-12-16T00:00:20.624945+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:00:20.624945+0000","last_undegraded":"2023-12-16T00:00:20.624945+0000","last_fullsized":"2023-12-16T00:00:20.624945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148499+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148499+0000","last_peered":"2023-12-16T00:01:42.148499+0000","last_clean":"2023-12-16T00:01:42.148499+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148499+0000","last_undegraded":"2023-12-16T00:01:42.148499+0000","last_fullsized":"2023-12-16T00:01:42.148499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404882+0000","last_change":"2023-12-15T22:53:10.334473+0000","last_active":"2023-12-16T00:00:20.404882+0000","last_peered":"2023-12-16T00:00:20.404882+0000","last_clean":"2023-12-16T00:00:20.404882+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:00:20.404882+0000","last_undegraded":"2023-12-16T00:00:20.404882+0000","last_fullsized":"2023-12-16T00:00:20.404882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137671+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-16T00:00:28.137671+0000","last_peered":"2023-12-16T00:00:28.137671+0000","last_clean":"2023-12-16T00:00:28.137671+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:00:28.137671+0000","last_undegraded":"2023-12-16T00:00:28.137671+0000","last_fullsized":"2023-12-16T00:00:28.137671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289065+0000","last_change":"2023-12-15T22:53:32.193085+0000","last_active":"2023-12-16T00:00:27.289065+0000","last_peered":"2023-12-16T00:00:27.289065+0000","last_clean":"2023-12-16T00:00:27.289065+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:00:27.289065+0000","last_undegraded":"2023-12-16T00:00:27.289065+0000","last_fullsized":"2023-12-16T00:00:27.289065+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790128+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790128+0000","last_peered":"2023-12-16T00:01:16.790128+0000","last_clean":"2023-12-16T00:01:16.790128+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790128+0000","last_undegraded":"2023-12-16T00:01:16.790128+0000","last_fullsized":"2023-12-16T00:01:16.790128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1419,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174535+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174535+0000","last_peered":"2023-12-16T00:01:31.174535+0000","last_clean":"2023-12-16T00:01:31.174535+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174535+0000","last_undegraded":"2023-12-16T00:01:31.174535+0000","last_fullsized":"2023-12-16T00:01:31.174535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007421+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007421+0000","last_peered":"2023-12-16T00:01:15.007421+0000","last_clean":"2023-12-16T00:01:15.007421+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007421+0000","last_undegraded":"2023-12-16T00:01:15.007421+0000","last_fullsized":"2023-12-16T00:01:15.007421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620685+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:05.620685+0000","last_peered":"2023-12-16T00:00:05.620685+0000","last_clean":"2023-12-16T00:00:05.620685+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:05.620685+0000","last_undegraded":"2023-12-16T00:00:05.620685+0000","last_fullsized":"2023-12-16T00:00:05.620685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.390276+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:15.390276+0000","last_peered":"2023-12-16T00:00:15.390276+0000","last_clean":"2023-12-16T00:00:15.390276+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:15.390276+0000","last_undegraded":"2023-12-16T00:00:15.390276+0000","last_fullsized":"2023-12-16T00:00:15.390276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401475+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:05.401475+0000","last_peered":"2023-12-16T00:00:05.401475+0000","last_clean":"2023-12-16T00:00:05.401475+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:05.401475+0000","last_undegraded":"2023-12-16T00:00:05.401475+0000","last_fullsized":"2023-12-16T00:00:05.401475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396260+0000","last_change":"2023-12-15T22:53:08.332376+0000","last_active":"2023-12-15T23:59:50.396260+0000","last_peered":"2023-12-15T23:59:50.396260+0000","last_clean":"2023-12-15T23:59:50.396260+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-15T23:59:50.396260+0000","last_undegraded":"2023-12-15T23:59:50.396260+0000","last_fullsized":"2023-12-15T23:59:50.396260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016252+0000","last_change":"2023-12-15T22:53:10.340293+0000","last_active":"2023-12-16T00:00:26.016252+0000","last_peered":"2023-12-16T00:00:26.016252+0000","last_clean":"2023-12-16T00:00:26.016252+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:00:26.016252+0000","last_undegraded":"2023-12-16T00:00:26.016252+0000","last_fullsized":"2023-12-16T00:00:26.016252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137686+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-16T00:00:28.137686+0000","last_peered":"2023-12-16T00:00:28.137686+0000","last_clean":"2023-12-16T00:00:28.137686+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:00:28.137686+0000","last_undegraded":"2023-12-16T00:00:28.137686+0000","last_fullsized":"2023-12-16T00:00:28.137686+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016665+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-16T00:00:26.016665+0000","last_peered":"2023-12-16T00:00:26.016665+0000","last_clean":"2023-12-16T00:00:26.016665+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:00:26.016665+0000","last_undegraded":"2023-12-16T00:00:26.016665+0000","last_fullsized":"2023-12-16T00:00:26.016665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1474,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861451+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861451+0000","last_peered":"2023-12-16T00:01:34.861451+0000","last_clean":"2023-12-16T00:01:34.861451+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861451+0000","last_undegraded":"2023-12-16T00:01:34.861451+0000","last_fullsized":"2023-12-16T00:01:34.861451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185657+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185657+0000","last_peered":"2023-12-16T00:01:12.185657+0000","last_clean":"2023-12-16T00:01:12.185657+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185657+0000","last_undegraded":"2023-12-16T00:01:12.185657+0000","last_fullsized":"2023-12-16T00:01:12.185657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400974+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:05.400974+0000","last_peered":"2023-12-16T00:00:05.400974+0000","last_clean":"2023-12-16T00:00:05.400974+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:05.400974+0000","last_undegraded":"2023-12-16T00:00:05.400974+0000","last_fullsized":"2023-12-16T00:00:05.400974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405423+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:00:25.405423+0000","last_peered":"2023-12-16T00:00:25.405423+0000","last_clean":"2023-12-16T00:00:25.405423+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:00:25.405423+0000","last_undegraded":"2023-12-16T00:00:25.405423+0000","last_fullsized":"2023-12-16T00:00:25.405423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.404304+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:15.404304+0000","last_peered":"2023-12-16T00:00:15.404304+0000","last_clean":"2023-12-16T00:00:15.404304+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:15.404304+0000","last_undegraded":"2023-12-16T00:00:15.404304+0000","last_fullsized":"2023-12-16T00:00:15.404304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":971,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616350+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-15T23:59:50.616350+0000","last_peered":"2023-12-15T23:59:50.616350+0000","last_clean":"2023-12-15T23:59:50.616350+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-15T23:59:50.616350+0000","last_undegraded":"2023-12-15T23:59:50.616350+0000","last_fullsized":"2023-12-15T23:59:50.616350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389786+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:06.389786+0000","last_peered":"2023-12-16T00:00:06.389786+0000","last_clean":"2023-12-16T00:00:06.389786+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:00:06.389786+0000","last_undegraded":"2023-12-16T00:00:06.389786+0000","last_fullsized":"2023-12-16T00:00:06.389786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897125+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897125+0000","last_peered":"2023-12-16T00:01:15.897125+0000","last_clean":"2023-12-16T00:01:15.897125+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897125+0000","last_undegraded":"2023-12-16T00:01:15.897125+0000","last_fullsized":"2023-12-16T00:01:15.897125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1257,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016835+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-16T00:00:26.016835+0000","last_peered":"2023-12-16T00:00:26.016835+0000","last_clean":"2023-12-16T00:00:26.016835+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:00:26.016835+0000","last_undegraded":"2023-12-16T00:00:26.016835+0000","last_fullsized":"2023-12-16T00:00:26.016835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947140+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947140+0000","last_peered":"2023-12-16T00:01:30.947140+0000","last_clean":"2023-12-16T00:01:30.947140+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947140+0000","last_undegraded":"2023-12-16T00:01:30.947140+0000","last_fullsized":"2023-12-16T00:01:30.947140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874738+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874738+0000","last_peered":"2023-12-16T00:01:08.874738+0000","last_clean":"2023-12-16T00:01:08.874738+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874738+0000","last_undegraded":"2023-12-16T00:01:08.874738+0000","last_fullsized":"2023-12-16T00:01:08.874738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"49'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864730+0000","last_change":"2023-12-15T22:53:26.157576+0000","last_active":"2023-12-16T00:00:26.864730+0000","last_peered":"2023-12-16T00:00:26.864730+0000","last_clean":"2023-12-16T00:00:26.864730+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:00:26.864730+0000","last_undegraded":"2023-12-16T00:00:26.864730+0000","last_fullsized":"2023-12-16T00:00:26.864730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711361+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-16T00:00:27.711361+0000","last_peered":"2023-12-16T00:00:27.711361+0000","last_clean":"2023-12-16T00:00:27.711361+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:00:27.711361+0000","last_undegraded":"2023-12-16T00:00:27.711361+0000","last_fullsized":"2023-12-16T00:00:27.711361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400947+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:05.400947+0000","last_peered":"2023-12-16T00:00:05.400947+0000","last_clean":"2023-12-16T00:00:05.400947+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:05.400947+0000","last_undegraded":"2023-12-16T00:00:05.400947+0000","last_fullsized":"2023-12-16T00:00:05.400947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864376+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-16T00:00:26.864376+0000","last_peered":"2023-12-16T00:00:26.864376+0000","last_clean":"2023-12-16T00:00:26.864376+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:00:26.864376+0000","last_undegraded":"2023-12-16T00:00:26.864376+0000","last_fullsized":"2023-12-16T00:00:26.864376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:46.384717+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-15T23:59:46.384717+0000","last_peered":"2023-12-15T23:59:46.384717+0000","last_clean":"2023-12-15T23:59:46.384717+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-15T23:59:46.384717+0000","last_undegraded":"2023-12-15T23:59:46.384717+0000","last_fullsized":"2023-12-15T23:59:46.384717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384215+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-15T23:59:50.384215+0000","last_peered":"2023-12-15T23:59:50.384215+0000","last_clean":"2023-12-15T23:59:50.384215+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-15T23:59:50.384215+0000","last_undegraded":"2023-12-15T23:59:50.384215+0000","last_fullsized":"2023-12-15T23:59:50.384215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722628+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722628+0000","last_peered":"2023-12-16T00:01:26.722628+0000","last_clean":"2023-12-16T00:01:26.722628+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722628+0000","last_undegraded":"2023-12-16T00:01:26.722628+0000","last_fullsized":"2023-12-16T00:01:26.722628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5896,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289225+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-16T00:00:27.289225+0000","last_peered":"2023-12-16T00:00:27.289225+0000","last_clean":"2023-12-16T00:00:27.289225+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:00:27.289225+0000","last_undegraded":"2023-12-16T00:00:27.289225+0000","last_fullsized":"2023-12-16T00:00:27.289225+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137754+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-16T00:00:28.137754+0000","last_peered":"2023-12-16T00:00:28.137754+0000","last_clean":"2023-12-16T00:00:28.137754+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:00:28.137754+0000","last_undegraded":"2023-12-16T00:00:28.137754+0000","last_fullsized":"2023-12-16T00:00:28.137754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840119+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840119+0000","last_peered":"2023-12-16T00:01:10.840119+0000","last_clean":"2023-12-16T00:01:10.840119+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840119+0000","last_undegraded":"2023-12-16T00:01:10.840119+0000","last_fullsized":"2023-12-16T00:01:10.840119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228196+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228196+0000","last_peered":"2023-12-16T00:01:37.228196+0000","last_clean":"2023-12-16T00:01:37.228196+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228196+0000","last_undegraded":"2023-12-16T00:01:37.228196+0000","last_fullsized":"2023-12-16T00:01:37.228196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387948+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:05.387948+0000","last_peered":"2023-12-16T00:00:05.387948+0000","last_clean":"2023-12-16T00:00:05.387948+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:05.387948+0000","last_undegraded":"2023-12-16T00:00:05.387948+0000","last_fullsized":"2023-12-16T00:00:05.387948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395428+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-15T23:59:45.395428+0000","last_peered":"2023-12-15T23:59:45.395428+0000","last_clean":"2023-12-15T23:59:45.395428+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-15T23:59:45.395428+0000","last_undegraded":"2023-12-15T23:59:45.395428+0000","last_fullsized":"2023-12-15T23:59:45.395428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396667+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-15T23:59:50.396667+0000","last_peered":"2023-12-15T23:59:50.396667+0000","last_clean":"2023-12-15T23:59:50.396667+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-15T23:59:50.396667+0000","last_undegraded":"2023-12-15T23:59:50.396667+0000","last_fullsized":"2023-12-15T23:59:50.396667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396171+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-15T23:59:50.396171+0000","last_peered":"2023-12-15T23:59:50.396171+0000","last_clean":"2023-12-15T23:59:50.396171+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-15T23:59:50.396171+0000","last_undegraded":"2023-12-15T23:59:50.396171+0000","last_fullsized":"2023-12-15T23:59:50.396171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199772+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199772+0000","last_peered":"2023-12-16T00:01:34.199772+0000","last_clean":"2023-12-16T00:01:34.199772+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199772+0000","last_undegraded":"2023-12-16T00:01:34.199772+0000","last_fullsized":"2023-12-16T00:01:34.199772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865226+0000","last_change":"2023-12-15T22:53:58.167977+0000","last_active":"2023-12-16T00:00:26.865226+0000","last_peered":"2023-12-16T00:00:26.865226+0000","last_clean":"2023-12-16T00:00:26.865226+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:00:26.865226+0000","last_undegraded":"2023-12-16T00:00:26.865226+0000","last_fullsized":"2023-12-16T00:00:26.865226+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016649+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-16T00:00:26.016649+0000","last_peered":"2023-12-16T00:00:26.016649+0000","last_clean":"2023-12-16T00:00:26.016649+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:00:26.016649+0000","last_undegraded":"2023-12-16T00:00:26.016649+0000","last_fullsized":"2023-12-16T00:00:26.016649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921170+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921170+0000","last_peered":"2023-12-16T00:01:43.921170+0000","last_clean":"2023-12-16T00:01:43.921170+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921170+0000","last_undegraded":"2023-12-16T00:01:43.921170+0000","last_fullsized":"2023-12-16T00:01:43.921170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395993+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-15T23:59:45.395993+0000","last_peered":"2023-12-15T23:59:45.395993+0000","last_clean":"2023-12-15T23:59:45.395993+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-15T23:59:45.395993+0000","last_undegraded":"2023-12-15T23:59:45.395993+0000","last_fullsized":"2023-12-15T23:59:45.395993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.616027+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-15T23:59:50.616027+0000","last_peered":"2023-12-15T23:59:50.616027+0000","last_clean":"2023-12-15T23:59:50.616027+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-15T23:59:50.616027+0000","last_undegraded":"2023-12-15T23:59:50.616027+0000","last_fullsized":"2023-12-15T23:59:50.616027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":802,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136932+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-16T00:00:28.136932+0000","last_peered":"2023-12-16T00:00:28.136932+0000","last_clean":"2023-12-16T00:00:28.136932+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:00:28.136932+0000","last_undegraded":"2023-12-16T00:00:28.136932+0000","last_fullsized":"2023-12-16T00:00:28.136932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307393+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307393+0000","last_peered":"2023-12-16T00:01:26.307393+0000","last_clean":"2023-12-16T00:01:26.307393+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307393+0000","last_undegraded":"2023-12-16T00:01:26.307393+0000","last_fullsized":"2023-12-16T00:01:26.307393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016825+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-16T00:00:26.016825+0000","last_peered":"2023-12-16T00:00:26.016825+0000","last_clean":"2023-12-16T00:00:26.016825+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:00:26.016825+0000","last_undegraded":"2023-12-16T00:00:26.016825+0000","last_fullsized":"2023-12-16T00:00:26.016825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289198+0000","last_change":"2023-12-15T22:53:58.170059+0000","last_active":"2023-12-16T00:00:27.289198+0000","last_peered":"2023-12-16T00:00:27.289198+0000","last_clean":"2023-12-16T00:00:27.289198+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:00:27.289198+0000","last_undegraded":"2023-12-16T00:00:27.289198+0000","last_fullsized":"2023-12-16T00:00:27.289198+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950181+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950181+0000","last_peered":"2023-12-16T00:01:28.950181+0000","last_clean":"2023-12-16T00:01:28.950181+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950181+0000","last_undegraded":"2023-12-16T00:01:28.950181+0000","last_fullsized":"2023-12-16T00:01:28.950181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397612+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-15T23:59:50.397612+0000","last_peered":"2023-12-15T23:59:50.397612+0000","last_clean":"2023-12-15T23:59:50.397612+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-15T23:59:50.397612+0000","last_undegraded":"2023-12-15T23:59:50.397612+0000","last_fullsized":"2023-12-15T23:59:50.397612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.394959+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-15T23:59:45.394959+0000","last_peered":"2023-12-15T23:59:45.394959+0000","last_clean":"2023-12-15T23:59:45.394959+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-15T23:59:45.394959+0000","last_undegraded":"2023-12-15T23:59:45.394959+0000","last_fullsized":"2023-12-15T23:59:45.394959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:51.385796+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-15T23:59:51.385796+0000","last_peered":"2023-12-15T23:59:51.385796+0000","last_clean":"2023-12-15T23:59:51.385796+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-15T23:59:51.385796+0000","last_undegraded":"2023-12-15T23:59:51.385796+0000","last_fullsized":"2023-12-15T23:59:51.385796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255222+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255222+0000","last_peered":"2023-12-16T00:01:28.255222+0000","last_clean":"2023-12-16T00:01:28.255222+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255222+0000","last_undegraded":"2023-12-16T00:01:28.255222+0000","last_fullsized":"2023-12-16T00:01:28.255222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.389408+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-15T23:59:25.389408+0000","last_peered":"2023-12-15T23:59:25.389408+0000","last_clean":"2023-12-15T23:59:25.389408+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-15T23:59:25.389408+0000","last_undegraded":"2023-12-15T23:59:25.389408+0000","last_fullsized":"2023-12-15T23:59:25.389408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440712+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-16T00:00:26.440712+0000","last_peered":"2023-12-16T00:00:26.440712+0000","last_clean":"2023-12-16T00:00:26.440712+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:00:26.440712+0000","last_undegraded":"2023-12-16T00:00:26.440712+0000","last_fullsized":"2023-12-16T00:00:26.440712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676120+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676120+0000","last_peered":"2023-12-16T00:01:30.676120+0000","last_clean":"2023-12-16T00:01:30.676120+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676120+0000","last_undegraded":"2023-12-16T00:01:30.676120+0000","last_fullsized":"2023-12-16T00:01:30.676120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279318+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279318+0000","last_peered":"2023-12-16T00:01:22.279318+0000","last_clean":"2023-12-16T00:01:22.279318+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279318+0000","last_undegraded":"2023-12-16T00:01:22.279318+0000","last_fullsized":"2023-12-16T00:01:22.279318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440194+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-16T00:00:26.440194+0000","last_peered":"2023-12-16T00:00:26.440194+0000","last_clean":"2023-12-16T00:00:26.440194+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:00:26.440194+0000","last_undegraded":"2023-12-16T00:00:26.440194+0000","last_fullsized":"2023-12-16T00:00:26.440194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:36.382094+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-15T23:59:36.382094+0000","last_peered":"2023-12-15T23:59:36.382094+0000","last_clean":"2023-12-15T23:59:36.382094+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-15T23:59:36.382094+0000","last_undegraded":"2023-12-15T23:59:36.382094+0000","last_fullsized":"2023-12-15T23:59:36.382094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6461,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440808+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-16T00:00:26.440808+0000","last_peered":"2023-12-16T00:00:26.440808+0000","last_clean":"2023-12-16T00:00:26.440808+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:00:26.440808+0000","last_undegraded":"2023-12-16T00:00:26.440808+0000","last_fullsized":"2023-12-16T00:00:26.440808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749627+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749627+0000","last_peered":"2023-12-16T00:01:43.749627+0000","last_clean":"2023-12-16T00:01:43.749627+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749627+0000","last_undegraded":"2023-12-16T00:01:43.749627+0000","last_fullsized":"2023-12-16T00:01:43.749627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288950+0000","last_change":"2023-12-15T22:53:30.177218+0000","last_active":"2023-12-16T00:00:27.288950+0000","last_peered":"2023-12-16T00:00:27.288950+0000","last_clean":"2023-12-16T00:00:27.288950+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:00:27.288950+0000","last_undegraded":"2023-12-16T00:00:27.288950+0000","last_fullsized":"2023-12-16T00:00:27.288950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711961+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-16T00:00:27.711961+0000","last_peered":"2023-12-16T00:00:27.711961+0000","last_clean":"2023-12-16T00:00:27.711961+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:00:27.711961+0000","last_undegraded":"2023-12-16T00:00:27.711961+0000","last_fullsized":"2023-12-16T00:00:27.711961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288444+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-16T00:00:27.288444+0000","last_peered":"2023-12-16T00:00:27.288444+0000","last_clean":"2023-12-16T00:00:27.288444+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:00:27.288444+0000","last_undegraded":"2023-12-16T00:00:27.288444+0000","last_fullsized":"2023-12-16T00:00:27.288444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137784+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-16T00:00:28.137784+0000","last_peered":"2023-12-16T00:00:28.137784+0000","last_clean":"2023-12-16T00:00:28.137784+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:00:28.137784+0000","last_undegraded":"2023-12-16T00:00:28.137784+0000","last_fullsized":"2023-12-16T00:00:28.137784+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016714+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-16T00:00:26.016714+0000","last_peered":"2023-12-16T00:00:26.016714+0000","last_clean":"2023-12-16T00:00:26.016714+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:00:26.016714+0000","last_undegraded":"2023-12-16T00:00:26.016714+0000","last_fullsized":"2023-12-16T00:00:26.016714+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":403,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022203+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022203+0000","last_peered":"2023-12-16T00:01:14.022203+0000","last_clean":"2023-12-16T00:01:14.022203+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022203+0000","last_undegraded":"2023-12-16T00:01:14.022203+0000","last_fullsized":"2023-12-16T00:01:14.022203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016319+0000","last_change":"2023-12-15T22:53:10.335552+0000","last_active":"2023-12-16T00:00:26.016319+0000","last_peered":"2023-12-16T00:00:26.016319+0000","last_clean":"2023-12-16T00:00:26.016319+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:00:26.016319+0000","last_undegraded":"2023-12-16T00:00:26.016319+0000","last_fullsized":"2023-12-16T00:00:26.016319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137010+0000","last_change":"2023-12-15T22:53:08.335939+0000","last_active":"2023-12-16T00:00:28.137010+0000","last_peered":"2023-12-16T00:00:28.137010+0000","last_clean":"2023-12-16T00:00:28.137010+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:00:28.137010+0000","last_undegraded":"2023-12-16T00:00:28.137010+0000","last_fullsized":"2023-12-16T00:00:28.137010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748931+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748931+0000","last_peered":"2023-12-16T00:01:38.748931+0000","last_clean":"2023-12-16T00:01:38.748931+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748931+0000","last_undegraded":"2023-12-16T00:01:38.748931+0000","last_fullsized":"2023-12-16T00:01:38.748931+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1754,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889707+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889707+0000","last_peered":"2023-12-16T00:01:33.889707+0000","last_clean":"2023-12-16T00:01:33.889707+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889707+0000","last_undegraded":"2023-12-16T00:01:33.889707+0000","last_fullsized":"2023-12-16T00:01:33.889707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850184+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850184+0000","last_peered":"2023-12-16T00:01:41.850184+0000","last_clean":"2023-12-16T00:01:41.850184+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850184+0000","last_undegraded":"2023-12-16T00:01:41.850184+0000","last_fullsized":"2023-12-16T00:01:41.850184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016191+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-16T00:00:26.016191+0000","last_peered":"2023-12-16T00:00:26.016191+0000","last_clean":"2023-12-16T00:00:26.016191+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:00:26.016191+0000","last_undegraded":"2023-12-16T00:00:26.016191+0000","last_fullsized":"2023-12-16T00:00:26.016191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289222+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-16T00:00:27.289222+0000","last_peered":"2023-12-16T00:00:27.289222+0000","last_clean":"2023-12-16T00:00:27.289222+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:00:27.289222+0000","last_undegraded":"2023-12-16T00:00:27.289222+0000","last_fullsized":"2023-12-16T00:00:27.289222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016781+0000","last_change":"2023-12-15T22:53:58.161392+0000","last_active":"2023-12-16T00:00:26.016781+0000","last_peered":"2023-12-16T00:00:26.016781+0000","last_clean":"2023-12-16T00:00:26.016781+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:00:26.016781+0000","last_undegraded":"2023-12-16T00:00:26.016781+0000","last_fullsized":"2023-12-16T00:00:26.016781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207124+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207124+0000","last_peered":"2023-12-16T00:01:36.207124+0000","last_clean":"2023-12-16T00:01:36.207124+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207124+0000","last_undegraded":"2023-12-16T00:01:36.207124+0000","last_fullsized":"2023-12-16T00:01:36.207124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288524+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-16T00:00:27.288524+0000","last_peered":"2023-12-16T00:00:27.288524+0000","last_clean":"2023-12-16T00:00:27.288524+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:00:27.288524+0000","last_undegraded":"2023-12-16T00:00:27.288524+0000","last_fullsized":"2023-12-16T00:00:27.288524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.391372+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-15T23:59:25.391372+0000","last_peered":"2023-12-15T23:59:25.391372+0000","last_clean":"2023-12-15T23:59:25.391372+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-15T23:59:25.391372+0000","last_undegraded":"2023-12-15T23:59:25.391372+0000","last_fullsized":"2023-12-15T23:59:25.391372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'144","reported_seq":4382,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:41.383526+0000","last_change":"2023-12-15T22:54:04.181820+0000","last_active":"2023-12-15T23:59:41.383526+0000","last_peered":"2023-12-15T23:59:41.383526+0000","last_clean":"2023-12-15T23:59:41.383526+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-15T23:59:41.383526+0000","last_undegraded":"2023-12-15T23:59:41.383526+0000","last_fullsized":"2023-12-15T23:59:41.383526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137790+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-16T00:00:28.137790+0000","last_peered":"2023-12-16T00:00:28.137790+0000","last_clean":"2023-12-16T00:00:28.137790+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:00:28.137790+0000","last_undegraded":"2023-12-16T00:00:28.137790+0000","last_fullsized":"2023-12-16T00:00:28.137790+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902867+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902867+0000","last_peered":"2023-12-16T00:01:31.902867+0000","last_clean":"2023-12-16T00:01:31.902867+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902867+0000","last_undegraded":"2023-12-16T00:01:31.902867+0000","last_fullsized":"2023-12-16T00:01:31.902867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":553,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.395934+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-15T23:59:45.395934+0000","last_peered":"2023-12-15T23:59:45.395934+0000","last_clean":"2023-12-15T23:59:45.395934+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-15T23:59:45.395934+0000","last_undegraded":"2023-12-15T23:59:45.395934+0000","last_fullsized":"2023-12-15T23:59:45.395934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440205+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-16T00:00:26.440205+0000","last_peered":"2023-12-16T00:00:26.440205+0000","last_clean":"2023-12-16T00:00:26.440205+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:00:26.440205+0000","last_undegraded":"2023-12-16T00:00:26.440205+0000","last_fullsized":"2023-12-16T00:00:26.440205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239262+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239262+0000","last_peered":"2023-12-16T00:01:35.239262+0000","last_clean":"2023-12-16T00:01:35.239262+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239262+0000","last_undegraded":"2023-12-16T00:01:35.239262+0000","last_fullsized":"2023-12-16T00:01:35.239262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:25.390239+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-15T23:59:25.390239+0000","last_peered":"2023-12-15T23:59:25.390239+0000","last_clean":"2023-12-15T23:59:25.390239+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-15T23:59:25.390239+0000","last_undegraded":"2023-12-15T23:59:25.390239+0000","last_fullsized":"2023-12-15T23:59:25.390239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1326,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440794+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-16T00:00:26.440794+0000","last_peered":"2023-12-16T00:00:26.440794+0000","last_clean":"2023-12-16T00:00:26.440794+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:00:26.440794+0000","last_undegraded":"2023-12-16T00:00:26.440794+0000","last_fullsized":"2023-12-16T00:00:26.440794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:35.392528+0000","last_change":"2023-12-15T22:53:58.163207+0000","last_active":"2023-12-15T23:59:35.392528+0000","last_peered":"2023-12-15T23:59:35.392528+0000","last_clean":"2023-12-15T23:59:35.392528+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-15T23:59:35.392528+0000","last_undegraded":"2023-12-15T23:59:35.392528+0000","last_fullsized":"2023-12-15T23:59:35.392528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288909+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-16T00:00:27.288909+0000","last_peered":"2023-12-16T00:00:27.288909+0000","last_clean":"2023-12-16T00:00:27.288909+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:00:27.288909+0000","last_undegraded":"2023-12-16T00:00:27.288909+0000","last_fullsized":"2023-12-16T00:00:27.288909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'178","reported_seq":364,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440502+0000","last_change":"2023-12-15T22:53:28.169934+0000","last_active":"2023-12-16T00:00:26.440502+0000","last_peered":"2023-12-16T00:00:26.440502+0000","last_clean":"2023-12-16T00:00:26.440502+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:00:26.440502+0000","last_undegraded":"2023-12-16T00:00:26.440502+0000","last_fullsized":"2023-12-16T00:00:26.440502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725602+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725602+0000","last_peered":"2023-12-16T00:01:44.725602+0000","last_clean":"2023-12-16T00:01:44.725602+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725602+0000","last_undegraded":"2023-12-16T00:01:44.725602+0000","last_fullsized":"2023-12-16T00:01:44.725602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384529+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-15T23:59:50.384529+0000","last_peered":"2023-12-15T23:59:50.384529+0000","last_clean":"2023-12-15T23:59:50.384529+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-15T23:59:50.384529+0000","last_undegraded":"2023-12-15T23:59:50.384529+0000","last_fullsized":"2023-12-15T23:59:50.384529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195623+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195623+0000","last_peered":"2023-12-16T00:01:41.195623+0000","last_clean":"2023-12-16T00:01:41.195623+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195623+0000","last_undegraded":"2023-12-16T00:01:41.195623+0000","last_fullsized":"2023-12-16T00:01:41.195623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:26.380079+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-15T23:59:26.380079+0000","last_peered":"2023-12-15T23:59:26.380079+0000","last_clean":"2023-12-15T23:59:26.380079+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-15T23:59:26.380079+0000","last_undegraded":"2023-12-15T23:59:26.380079+0000","last_fullsized":"2023-12-15T23:59:26.380079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3846,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440733+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-16T00:00:26.440733+0000","last_peered":"2023-12-16T00:00:26.440733+0000","last_clean":"2023-12-16T00:00:26.440733+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:00:26.440733+0000","last_undegraded":"2023-12-16T00:00:26.440733+0000","last_fullsized":"2023-12-16T00:00:26.440733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137697+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-16T00:00:28.137697+0000","last_peered":"2023-12-16T00:00:28.137697+0000","last_clean":"2023-12-16T00:00:28.137697+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:00:28.137697+0000","last_undegraded":"2023-12-16T00:00:28.137697+0000","last_fullsized":"2023-12-16T00:00:28.137697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288401+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-16T00:00:27.288401+0000","last_peered":"2023-12-16T00:00:27.288401+0000","last_clean":"2023-12-16T00:00:27.288401+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:00:27.288401+0000","last_undegraded":"2023-12-16T00:00:27.288401+0000","last_fullsized":"2023-12-16T00:00:27.288401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.397998+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-15T23:59:50.397998+0000","last_peered":"2023-12-15T23:59:50.397998+0000","last_clean":"2023-12-15T23:59:50.397998+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-15T23:59:50.397998+0000","last_undegraded":"2023-12-15T23:59:50.397998+0000","last_fullsized":"2023-12-15T23:59:50.397998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219694+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219694+0000","last_peered":"2023-12-16T00:01:33.219694+0000","last_clean":"2023-12-16T00:01:33.219694+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219694+0000","last_undegraded":"2023-12-16T00:01:33.219694+0000","last_fullsized":"2023-12-16T00:01:33.219694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:01.388134+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:01.388134+0000","last_peered":"2023-12-16T00:00:01.388134+0000","last_clean":"2023-12-16T00:00:01.388134+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:01.388134+0000","last_undegraded":"2023-12-16T00:00:01.388134+0000","last_fullsized":"2023-12-16T00:00:01.388134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016743+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-16T00:00:26.016743+0000","last_peered":"2023-12-16T00:00:26.016743+0000","last_clean":"2023-12-16T00:00:26.016743+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:00:26.016743+0000","last_undegraded":"2023-12-16T00:00:26.016743+0000","last_fullsized":"2023-12-16T00:00:26.016743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288972+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-16T00:00:27.288972+0000","last_peered":"2023-12-16T00:00:27.288972+0000","last_clean":"2023-12-16T00:00:27.288972+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:00:27.288972+0000","last_undegraded":"2023-12-16T00:00:27.288972+0000","last_fullsized":"2023-12-16T00:00:27.288972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016195+0000","last_change":"2023-12-15T22:53:08.335667+0000","last_active":"2023-12-16T00:00:26.016195+0000","last_peered":"2023-12-16T00:00:26.016195+0000","last_clean":"2023-12-16T00:00:26.016195+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:00:26.016195+0000","last_undegraded":"2023-12-16T00:00:26.016195+0000","last_fullsized":"2023-12-16T00:00:26.016195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.386435+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:00.386435+0000","last_peered":"2023-12-16T00:00:00.386435+0000","last_clean":"2023-12-16T00:00:00.386435+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:00.386435+0000","last_undegraded":"2023-12-16T00:00:00.386435+0000","last_fullsized":"2023-12-16T00:00:00.386435+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137737+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-16T00:00:28.137737+0000","last_peered":"2023-12-16T00:00:28.137737+0000","last_clean":"2023-12-16T00:00:28.137737+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:00:28.137737+0000","last_undegraded":"2023-12-16T00:00:28.137737+0000","last_fullsized":"2023-12-16T00:00:28.137737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'8","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016690+0000","last_change":"2023-12-15T22:53:32.192495+0000","last_active":"2023-12-16T00:00:26.016690+0000","last_peered":"2023-12-16T00:00:26.016690+0000","last_clean":"2023-12-16T00:00:26.016690+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:00:26.016690+0000","last_undegraded":"2023-12-16T00:00:26.016690+0000","last_fullsized":"2023-12-16T00:00:26.016690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'188","reported_seq":342,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440508+0000","last_change":"2023-12-15T22:53:28.166075+0000","last_active":"2023-12-16T00:00:26.440508+0000","last_peered":"2023-12-16T00:00:26.440508+0000","last_clean":"2023-12-16T00:00:26.440508+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:00:26.440508+0000","last_undegraded":"2023-12-16T00:00:26.440508+0000","last_fullsized":"2023-12-16T00:00:26.440508+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:27.146395+0000","last_clean_scrub_stamp":"2023-12-15T22:53:27.146395+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288505+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-16T00:00:27.288505+0000","last_peered":"2023-12-16T00:00:27.288505+0000","last_clean":"2023-12-16T00:00:27.288505+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:00:27.288505+0000","last_undegraded":"2023-12-16T00:00:27.288505+0000","last_fullsized":"2023-12-16T00:00:27.288505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399036+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:00.399036+0000","last_peered":"2023-12-16T00:00:00.399036+0000","last_clean":"2023-12-16T00:00:00.399036+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:00.399036+0000","last_undegraded":"2023-12-16T00:00:00.399036+0000","last_fullsized":"2023-12-16T00:00:00.399036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3630,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865267+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-16T00:00:26.865267+0000","last_peered":"2023-12-16T00:00:26.865267+0000","last_clean":"2023-12-16T00:00:26.865267+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:00:26.865267+0000","last_undegraded":"2023-12-16T00:00:26.865267+0000","last_fullsized":"2023-12-16T00:00:26.865267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137616+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-16T00:00:28.137616+0000","last_peered":"2023-12-16T00:00:28.137616+0000","last_clean":"2023-12-16T00:00:28.137616+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:00:28.137616+0000","last_undegraded":"2023-12-16T00:00:28.137616+0000","last_fullsized":"2023-12-16T00:00:28.137616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137515+0000","last_change":"2023-12-15T22:53:30.180911+0000","last_active":"2023-12-16T00:00:28.137515+0000","last_peered":"2023-12-16T00:00:28.137515+0000","last_clean":"2023-12-16T00:00:28.137515+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:00:28.137515+0000","last_undegraded":"2023-12-16T00:00:28.137515+0000","last_fullsized":"2023-12-16T00:00:28.137515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.618769+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:00.618769+0000","last_peered":"2023-12-16T00:00:00.618769+0000","last_clean":"2023-12-16T00:00:00.618769+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:00.618769+0000","last_undegraded":"2023-12-16T00:00:00.618769+0000","last_fullsized":"2023-12-16T00:00:00.618769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'85","reported_seq":1276,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865244+0000","last_change":"2023-12-15T22:54:04.184429+0000","last_active":"2023-12-16T00:00:26.865244+0000","last_peered":"2023-12-16T00:00:26.865244+0000","last_clean":"2023-12-16T00:00:26.865244+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:00:26.865244+0000","last_undegraded":"2023-12-16T00:00:26.865244+0000","last_fullsized":"2023-12-16T00:00:26.865244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440658+0000","last_change":"2023-12-15T22:53:58.167012+0000","last_active":"2023-12-16T00:00:26.440658+0000","last_peered":"2023-12-16T00:00:26.440658+0000","last_clean":"2023-12-16T00:00:26.440658+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:00:26.440658+0000","last_undegraded":"2023-12-16T00:00:26.440658+0000","last_fullsized":"2023-12-16T00:00:26.440658+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":387,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016680+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-16T00:00:26.016680+0000","last_peered":"2023-12-16T00:00:26.016680+0000","last_clean":"2023-12-16T00:00:26.016680+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:00:26.016680+0000","last_undegraded":"2023-12-16T00:00:26.016680+0000","last_fullsized":"2023-12-16T00:00:26.016680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137530+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-16T00:00:28.137530+0000","last_peered":"2023-12-16T00:00:28.137530+0000","last_clean":"2023-12-16T00:00:28.137530+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:00:28.137530+0000","last_undegraded":"2023-12-16T00:00:28.137530+0000","last_fullsized":"2023-12-16T00:00:28.137530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711833+0000","last_change":"2023-12-15T22:53:10.340011+0000","last_active":"2023-12-16T00:00:27.711833+0000","last_peered":"2023-12-16T00:00:27.711833+0000","last_clean":"2023-12-16T00:00:27.711833+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:00:27.711833+0000","last_undegraded":"2023-12-16T00:00:27.711833+0000","last_fullsized":"2023-12-16T00:00:27.711833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'7","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864860+0000","last_change":"2023-12-15T22:53:26.157109+0000","last_active":"2023-12-16T00:00:26.864860+0000","last_peered":"2023-12-16T00:00:26.864860+0000","last_clean":"2023-12-16T00:00:26.864860+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:00:26.864860+0000","last_undegraded":"2023-12-16T00:00:26.864860+0000","last_fullsized":"2023-12-16T00:00:26.864860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620720+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:05.620720+0000","last_peered":"2023-12-16T00:00:05.620720+0000","last_clean":"2023-12-16T00:00:05.620720+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:05.620720+0000","last_undegraded":"2023-12-16T00:00:05.620720+0000","last_fullsized":"2023-12-16T00:00:05.620720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711283+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-16T00:00:27.711283+0000","last_peered":"2023-12-16T00:00:27.711283+0000","last_clean":"2023-12-16T00:00:27.711283+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:00:27.711283+0000","last_undegraded":"2023-12-16T00:00:27.711283+0000","last_fullsized":"2023-12-16T00:00:27.711283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620638+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:05.620638+0000","last_peered":"2023-12-16T00:00:05.620638+0000","last_clean":"2023-12-16T00:00:05.620638+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:05.620638+0000","last_undegraded":"2023-12-16T00:00:05.620638+0000","last_fullsized":"2023-12-16T00:00:05.620638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864089+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-16T00:00:26.864089+0000","last_peered":"2023-12-16T00:00:26.864089+0000","last_clean":"2023-12-16T00:00:26.864089+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:00:26.864089+0000","last_undegraded":"2023-12-16T00:00:26.864089+0000","last_fullsized":"2023-12-16T00:00:26.864089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808750+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808750+0000","last_peered":"2023-12-16T00:01:20.808750+0000","last_clean":"2023-12-16T00:01:20.808750+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808750+0000","last_undegraded":"2023-12-16T00:01:20.808750+0000","last_fullsized":"2023-12-16T00:01:20.808750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401415+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:05.401415+0000","last_peered":"2023-12-16T00:00:05.401415+0000","last_clean":"2023-12-16T00:00:05.401415+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:05.401415+0000","last_undegraded":"2023-12-16T00:00:05.401415+0000","last_fullsized":"2023-12-16T00:00:05.401415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:45.615003+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-15T23:59:45.615003+0000","last_peered":"2023-12-15T23:59:45.615003+0000","last_clean":"2023-12-15T23:59:45.615003+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-15T23:59:45.615003+0000","last_undegraded":"2023-12-15T23:59:45.615003+0000","last_fullsized":"2023-12-15T23:59:45.615003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620423+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:05.620423+0000","last_peered":"2023-12-16T00:00:05.620423+0000","last_clean":"2023-12-16T00:00:05.620423+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:05.620423+0000","last_undegraded":"2023-12-16T00:00:05.620423+0000","last_fullsized":"2023-12-16T00:00:05.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.396136+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-15T23:59:50.396136+0000","last_peered":"2023-12-15T23:59:50.396136+0000","last_clean":"2023-12-15T23:59:50.396136+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-15T23:59:50.396136+0000","last_undegraded":"2023-12-15T23:59:50.396136+0000","last_fullsized":"2023-12-15T23:59:50.396136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-15T23:59:50.384350+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-15T23:59:50.384350+0000","last_peered":"2023-12-15T23:59:50.384350+0000","last_clean":"2023-12-15T23:59:50.384350+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-15T23:59:50.384350+0000","last_undegraded":"2023-12-15T23:59:50.384350+0000","last_fullsized":"2023-12-15T23:59:50.384350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400762+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:05.400762+0000","last_peered":"2023-12-16T00:00:05.400762+0000","last_clean":"2023-12-16T00:00:05.400762+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:05.400762+0000","last_undegraded":"2023-12-16T00:00:05.400762+0000","last_fullsized":"2023-12-16T00:00:05.400762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711462+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-16T00:00:27.711462+0000","last_peered":"2023-12-16T00:00:27.711462+0000","last_clean":"2023-12-16T00:00:27.711462+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:00:27.711462+0000","last_undegraded":"2023-12-16T00:00:27.711462+0000","last_fullsized":"2023-12-16T00:00:27.711462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620507+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:05.620507+0000","last_peered":"2023-12-16T00:00:05.620507+0000","last_clean":"2023-12-16T00:00:05.620507+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:05.620507+0000","last_undegraded":"2023-12-16T00:00:05.620507+0000","last_fullsized":"2023-12-16T00:00:05.620507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400859+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:05.400859+0000","last_peered":"2023-12-16T00:00:05.400859+0000","last_clean":"2023-12-16T00:00:05.400859+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:05.400859+0000","last_undegraded":"2023-12-16T00:00:05.400859+0000","last_fullsized":"2023-12-16T00:00:05.400859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'5","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864894+0000","last_change":"2023-12-15T22:53:26.165124+0000","last_active":"2023-12-16T00:00:26.864894+0000","last_peered":"2023-12-16T00:00:26.864894+0000","last_clean":"2023-12-16T00:00:26.864894+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:00:26.864894+0000","last_undegraded":"2023-12-16T00:00:26.864894+0000","last_fullsized":"2023-12-16T00:00:26.864894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288153+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-16T00:00:27.288153+0000","last_peered":"2023-12-16T00:00:27.288153+0000","last_clean":"2023-12-16T00:00:27.288153+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:00:27.288153+0000","last_undegraded":"2023-12-16T00:00:27.288153+0000","last_fullsized":"2023-12-16T00:00:27.288153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387959+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:05.387959+0000","last_peered":"2023-12-16T00:00:05.387959+0000","last_clean":"2023-12-16T00:00:05.387959+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:05.387959+0000","last_undegraded":"2023-12-16T00:00:05.387959+0000","last_fullsized":"2023-12-16T00:00:05.387959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940181+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940181+0000","last_peered":"2023-12-16T00:00:51.940181+0000","last_clean":"2023-12-16T00:00:51.940181+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940181+0000","last_undegraded":"2023-12-16T00:00:51.940181+0000","last_fullsized":"2023-12-16T00:00:51.940181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691544+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691544+0000","last_peered":"2023-12-16T00:01:43.691544+0000","last_clean":"2023-12-16T00:01:43.691544+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691544+0000","last_undegraded":"2023-12-16T00:01:43.691544+0000","last_fullsized":"2023-12-16T00:01:43.691544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271600+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271600+0000","last_peered":"2023-12-16T00:00:41.271600+0000","last_clean":"2023-12-16T00:00:41.271600+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271600+0000","last_undegraded":"2023-12-16T00:00:41.271600+0000","last_fullsized":"2023-12-16T00:00:41.271600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":246,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925084+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925084+0000","last_peered":"2023-12-16T00:00:48.925084+0000","last_clean":"2023-12-16T00:00:48.925084+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925084+0000","last_undegraded":"2023-12-16T00:00:48.925084+0000","last_fullsized":"2023-12-16T00:00:48.925084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828204+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828204+0000","last_peered":"2023-12-16T00:00:52.828204+0000","last_clean":"2023-12-16T00:00:52.828204+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828204+0000","last_undegraded":"2023-12-16T00:00:52.828204+0000","last_fullsized":"2023-12-16T00:00:52.828204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'23","reported_seq":213,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864858+0000","last_change":"2023-12-15T22:53:26.159868+0000","last_active":"2023-12-16T00:00:26.864858+0000","last_peered":"2023-12-16T00:00:26.864858+0000","last_clean":"2023-12-16T00:00:26.864858+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:00:26.864858+0000","last_undegraded":"2023-12-16T00:00:26.864858+0000","last_fullsized":"2023-12-16T00:00:26.864858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276225+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276225+0000","last_peered":"2023-12-16T00:01:02.276225+0000","last_clean":"2023-12-16T00:01:02.276225+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276225+0000","last_undegraded":"2023-12-16T00:01:02.276225+0000","last_fullsized":"2023-12-16T00:01:02.276225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3476,"ondisk_log_size":3476,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23314,"ondisk_log_size":23314,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4636,"ondisk_log_size":4636,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":410,"ondisk_log_size":410,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608393,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25600000000000001},"max":{"1min":0.57299999999999995,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.57199999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.60499999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.501},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.434}]},{"osd":2,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.72199999999999998,"15min":1.004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.29399999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":1.149},"last":0.313},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.63},"last":0.41299999999999998}]}]},{"osd":5,"up_from":11,"seq":47244641095,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.96699999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.29299999999999998},"max":{"1min":0.63700000000000001,"5min":0.69999999999999996,"15min":0.80100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.879},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.754},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.63},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.47999999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641097,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55380,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802220,"statfs":{"total":107374182400,"available":107317473280,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.255},"max":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.45800000000000002,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40200000000000002,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.497}]},{"osd":2,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.433}]},{"osd":4,"last update":"Sat Dec 16 00:00:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.32000000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41699999999999998}]}]},{"osd":2,"up_from":11,"seq":47244641094,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.40699999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.46700000000000003,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.188,"15min":0.188},"max":{"1min":0.44,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.50700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.32600000000000001},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.5}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":1.169,"15min":1.169},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69599999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.629}]}]},{"osd":1,"up_from":11,"seq":47244641095,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.313,"15min":0.318},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20399999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.53100000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.438},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.878},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82099999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54300000000000004}]}]},{"osd":0,"up_from":11,"seq":47244641095,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.314,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.44900000000000001,"15min":0.51200000000000001},"last":0.249},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":0.51000000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.5,"15min":0.5},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42999999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65800000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.752,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.754,"15min":0.875},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66900000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:01:50.419 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.419 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.420 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.421 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.421 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.421 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.421 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.422 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.422 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.422 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.422 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.422 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.423 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.423 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.423 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.423 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.423 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.424 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.424 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.424 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.424 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.424 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.425 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.425 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.425 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.425 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.425 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.426 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.426 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.426 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.426 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.426 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.427 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.428 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.428 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.428 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.428 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.428 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.429 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.429 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.429 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.429 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.429 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.430 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.430 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.430 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.430 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.430 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.431 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.432 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.432 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.432 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.432 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.432 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.433 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.433 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.433 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.433 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.433 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.434 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.434 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.434 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.434 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.434 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.435 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.435 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.435 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.435 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.435 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.436 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.436 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.436 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.436 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.436 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.437 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.437 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.437 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.437 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.437 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.438 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.438 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.438 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.438 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.438 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.439 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.439 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.439 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.439 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.439 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.440 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.441 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.441 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.441 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.441 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.441 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.442 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.442 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.442 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.442 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.443 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.443 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.443 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.443 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.443 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.444 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.445 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.445 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.445 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.445 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.446 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.446 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.446 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.446 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.446 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.447 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.447 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.447 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.447 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.447 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.448 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.448 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.448 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.448 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.448 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.449 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.450 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.450 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.450 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.450 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.450 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.451 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.451 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.451 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.451 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.451 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.452 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.452 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.452 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.452 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.452 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.453 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.453 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.453 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.453 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.453 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.454 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.455 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.455 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.455 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.455 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.455 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.456 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.456 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.456 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.456 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.456 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.457 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.457 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.457 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.457 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.457 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.458 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.458 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.458 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.458 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.458 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.459 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.459 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.459 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.459 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.459 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.460 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.461 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.461 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.461 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.461 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.461 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.462 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.462 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.462 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.462 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.462 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.463 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.463 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.463 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.463 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.463 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.464 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.464 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.464 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.464 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.464 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.465 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.465 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.465 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.465 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.465 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.466 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.466 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.466 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.466 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.466 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.467 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.467 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.467 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.467 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.467 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.468 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.468 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.468 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.468 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.468 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.469 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.469 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.469 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.469 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.469 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.470 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.470 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.470 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.470 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.471 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.471 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.471 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.471 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.471 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.472 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.472 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.472 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.472 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.472 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.473 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.473 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.473 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.473 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.473 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.474 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.474 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.474 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.474 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.474 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.475 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.475 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.475 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.475 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.475 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.476 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.476 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.476 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.476 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.476 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.477 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.477 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.477 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.477 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.477 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2023-12-15T22:53:27.146395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=27, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.478 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.478 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.478 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.478 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.478 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.479 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.479 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.479 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.479 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.479 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.480 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.480 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.480 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.480 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.480 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.481 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.481 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.481 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.481 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.482 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.482 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.482 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.482 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.482 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.483 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.483 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.483 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.483 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.483 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.484 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.484 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.484 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.484 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.484 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.485 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.485 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.485 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.485 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.485 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.486 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.486 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.486 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.486 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.486 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.487 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.487 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.487 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.487 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.487 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.488 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.488 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.488 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.488 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.488 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.489 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.489 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.489 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.489 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.489 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.490 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.490 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.490 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.490 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.491 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.491 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.491 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:01:50.491 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:02:10.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:02:10.827 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:02:10.848 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:02:10.851 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2151,"stamp":"2023-12-16T00:02:10.223951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203703,"num_read_kb":200109,"num_write":41285,"num_write_kb":11275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":717313,"num_omap_keys":3203,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35435,"ondisk_log_size":35435,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":295448,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":285558,"kb_avail":628850152,"statfs":{"total":644245094400,"available":643942555648,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":292412065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18180,"num_omap_keys":68,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005745"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288074+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-16T00:00:27.288074+0000","last_peered":"2023-12-16T00:00:27.288074+0000","last_clean":"2023-12-16T00:00:27.288074+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:00:27.288074+0000","last_undegraded":"2023-12-16T00:00:27.288074+0000","last_fullsized":"2023-12-16T00:00:27.288074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711556+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-16T00:00:27.711556+0000","last_peered":"2023-12-16T00:00:27.711556+0000","last_clean":"2023-12-16T00:00:27.711556+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:00:27.711556+0000","last_undegraded":"2023-12-16T00:00:27.711556+0000","last_fullsized":"2023-12-16T00:00:27.711556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864382+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-16T00:00:26.864382+0000","last_peered":"2023-12-16T00:00:26.864382+0000","last_clean":"2023-12-16T00:00:26.864382+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:00:26.864382+0000","last_undegraded":"2023-12-16T00:00:26.864382+0000","last_fullsized":"2023-12-16T00:00:26.864382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712145+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712145+0000","last_peered":"2023-12-16T00:00:37.712145+0000","last_clean":"2023-12-16T00:00:37.712145+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712145+0000","last_undegraded":"2023-12-16T00:00:37.712145+0000","last_fullsized":"2023-12-16T00:00:37.712145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887146+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887146+0000","last_peered":"2023-12-16T00:01:04.887146+0000","last_clean":"2023-12-16T00:01:04.887146+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887146+0000","last_undegraded":"2023-12-16T00:01:04.887146+0000","last_fullsized":"2023-12-16T00:01:04.887146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682425+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682425+0000","last_peered":"2023-12-16T00:01:44.682425+0000","last_clean":"2023-12-16T00:01:44.682425+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682425+0000","last_undegraded":"2023-12-16T00:01:44.682425+0000","last_fullsized":"2023-12-16T00:01:44.682425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632624+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632624+0000","last_peered":"2023-12-16T00:02:00.632624+0000","last_clean":"2023-12-16T00:02:00.632624+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632624+0000","last_undegraded":"2023-12-16T00:02:00.632624+0000","last_fullsized":"2023-12-16T00:02:00.632624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1694,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404611+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:20.404611+0000","last_peered":"2023-12-16T00:00:20.404611+0000","last_clean":"2023-12-16T00:00:20.404611+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:20.404611+0000","last_undegraded":"2023-12-16T00:00:20.404611+0000","last_fullsized":"2023-12-16T00:00:20.404611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289181+0000","last_change":"2023-12-15T22:53:58.172062+0000","last_active":"2023-12-16T00:00:27.289181+0000","last_peered":"2023-12-16T00:00:27.289181+0000","last_clean":"2023-12-16T00:00:27.289181+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:00:27.289181+0000","last_undegraded":"2023-12-16T00:00:27.289181+0000","last_fullsized":"2023-12-16T00:00:27.289181+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'23","reported_seq":199,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864737+0000","last_change":"2023-12-15T22:53:26.157401+0000","last_active":"2023-12-16T00:00:26.864737+0000","last_peered":"2023-12-16T00:00:26.864737+0000","last_clean":"2023-12-16T00:00:26.864737+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:00:26.864737+0000","last_undegraded":"2023-12-16T00:00:26.864737+0000","last_fullsized":"2023-12-16T00:00:26.864737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711857+0000","last_change":"2023-12-15T22:53:10.336567+0000","last_active":"2023-12-16T00:00:27.711857+0000","last_peered":"2023-12-16T00:00:27.711857+0000","last_clean":"2023-12-16T00:00:27.711857+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:00:27.711857+0000","last_undegraded":"2023-12-16T00:00:27.711857+0000","last_fullsized":"2023-12-16T00:00:27.711857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137042+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-16T00:00:28.137042+0000","last_peered":"2023-12-16T00:00:28.137042+0000","last_clean":"2023-12-16T00:00:28.137042+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:00:28.137042+0000","last_undegraded":"2023-12-16T00:00:28.137042+0000","last_fullsized":"2023-12-16T00:00:28.137042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016740+0000","last_change":"2023-12-15T22:53:32.194855+0000","last_active":"2023-12-16T00:00:26.016740+0000","last_peered":"2023-12-16T00:00:26.016740+0000","last_clean":"2023-12-16T00:00:26.016740+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:00:26.016740+0000","last_undegraded":"2023-12-16T00:00:26.016740+0000","last_fullsized":"2023-12-16T00:00:26.016740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752008+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752008+0000","last_peered":"2023-12-16T00:01:25.752008+0000","last_clean":"2023-12-16T00:01:25.752008+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752008+0000","last_undegraded":"2023-12-16T00:01:25.752008+0000","last_fullsized":"2023-12-16T00:01:25.752008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844560+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844560+0000","last_peered":"2023-12-16T00:01:46.844560+0000","last_clean":"2023-12-16T00:01:46.844560+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844560+0000","last_undegraded":"2023-12-16T00:01:46.844560+0000","last_fullsized":"2023-12-16T00:01:46.844560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711788+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-16T00:00:27.711788+0000","last_peered":"2023-12-16T00:00:27.711788+0000","last_clean":"2023-12-16T00:00:27.711788+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:00:27.711788+0000","last_undegraded":"2023-12-16T00:00:27.711788+0000","last_fullsized":"2023-12-16T00:00:27.711788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842553+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842553+0000","last_peered":"2023-12-16T00:01:24.842553+0000","last_clean":"2023-12-16T00:01:24.842553+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842553+0000","last_undegraded":"2023-12-16T00:01:24.842553+0000","last_fullsized":"2023-12-16T00:01:24.842553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165978+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165978+0000","last_peered":"2023-12-16T00:01:55.165978+0000","last_clean":"2023-12-16T00:01:55.165978+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165978+0000","last_undegraded":"2023-12-16T00:01:55.165978+0000","last_fullsized":"2023-12-16T00:01:55.165978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359607+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359607+0000","last_peered":"2023-12-16T00:01:48.359607+0000","last_clean":"2023-12-16T00:01:48.359607+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359607+0000","last_undegraded":"2023-12-16T00:01:48.359607+0000","last_fullsized":"2023-12-16T00:01:48.359607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":985,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016955+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-16T00:00:26.016955+0000","last_peered":"2023-12-16T00:00:26.016955+0000","last_clean":"2023-12-16T00:00:26.016955+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:00:26.016955+0000","last_undegraded":"2023-12-16T00:00:26.016955+0000","last_fullsized":"2023-12-16T00:00:26.016955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840606+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840606+0000","last_peered":"2023-12-16T00:01:18.840606+0000","last_clean":"2023-12-16T00:01:18.840606+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840606+0000","last_undegraded":"2023-12-16T00:01:18.840606+0000","last_fullsized":"2023-12-16T00:01:18.840606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460740+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460740+0000","last_peered":"2023-12-16T00:02:04.460740+0000","last_clean":"2023-12-16T00:02:04.460740+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460740+0000","last_undegraded":"2023-12-16T00:02:04.460740+0000","last_fullsized":"2023-12-16T00:02:04.460740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711864+0000","last_change":"2023-12-15T22:53:11.078263+0000","last_active":"2023-12-16T00:00:27.711864+0000","last_peered":"2023-12-16T00:00:27.711864+0000","last_clean":"2023-12-16T00:00:27.711864+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:00:27.711864+0000","last_undegraded":"2023-12-16T00:00:27.711864+0000","last_fullsized":"2023-12-16T00:00:27.711864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:09.319032+0000","last_clean_scrub_stamp":"2023-12-15T22:53:09.319032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030702+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030702+0000","last_peered":"2023-12-16T00:02:05.030702+0000","last_clean":"2023-12-16T00:02:05.030702+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030702+0000","last_undegraded":"2023-12-16T00:02:05.030702+0000","last_fullsized":"2023-12-16T00:02:05.030702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289103+0000","last_change":"2023-12-15T22:53:58.170068+0000","last_active":"2023-12-16T00:00:27.289103+0000","last_peered":"2023-12-16T00:00:27.289103+0000","last_clean":"2023-12-16T00:00:27.289103+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:00:27.289103+0000","last_undegraded":"2023-12-16T00:00:27.289103+0000","last_fullsized":"2023-12-16T00:00:27.289103+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883691+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883691+0000","last_peered":"2023-12-16T00:01:42.883691+0000","last_clean":"2023-12-16T00:01:42.883691+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883691+0000","last_undegraded":"2023-12-16T00:01:42.883691+0000","last_fullsized":"2023-12-16T00:01:42.883691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":148,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173626+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173626+0000","last_peered":"2023-12-16T00:01:08.173626+0000","last_clean":"2023-12-16T00:01:08.173626+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173626+0000","last_undegraded":"2023-12-16T00:01:08.173626+0000","last_fullsized":"2023-12-16T00:01:08.173626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400328+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:05.400328+0000","last_peered":"2023-12-16T00:00:05.400328+0000","last_clean":"2023-12-16T00:00:05.400328+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:05.400328+0000","last_undegraded":"2023-12-16T00:00:05.400328+0000","last_fullsized":"2023-12-16T00:00:05.400328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403768+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:15.403768+0000","last_peered":"2023-12-16T00:00:15.403768+0000","last_clean":"2023-12-16T00:00:15.403768+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:15.403768+0000","last_undegraded":"2023-12-16T00:00:15.403768+0000","last_fullsized":"2023-12-16T00:00:15.403768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999329+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999329+0000","last_peered":"2023-12-16T00:01:23.999329+0000","last_clean":"2023-12-16T00:01:23.999329+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999329+0000","last_undegraded":"2023-12-16T00:01:23.999329+0000","last_fullsized":"2023-12-16T00:01:23.999329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382814+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382814+0000","last_peered":"2023-12-16T00:01:54.382814+0000","last_clean":"2023-12-16T00:01:54.382814+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382814+0000","last_undegraded":"2023-12-16T00:01:54.382814+0000","last_fullsized":"2023-12-16T00:01:54.382814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'6","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402738+0000","last_change":"2023-12-15T22:53:32.194623+0000","last_active":"2023-12-16T00:00:15.402738+0000","last_peered":"2023-12-16T00:00:15.402738+0000","last_clean":"2023-12-16T00:00:15.402738+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:00:15.402738+0000","last_undegraded":"2023-12-16T00:00:15.402738+0000","last_fullsized":"2023-12-16T00:00:15.402738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175678+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175678+0000","last_peered":"2023-12-16T00:01:32.175678+0000","last_clean":"2023-12-16T00:01:32.175678+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175678+0000","last_undegraded":"2023-12-16T00:01:32.175678+0000","last_fullsized":"2023-12-16T00:01:32.175678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867711+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867711+0000","last_peered":"2023-12-16T00:00:31.867711+0000","last_clean":"2023-12-16T00:00:31.867711+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867711+0000","last_undegraded":"2023-12-16T00:00:31.867711+0000","last_fullsized":"2023-12-16T00:00:31.867711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389472+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:06.389472+0000","last_peered":"2023-12-16T00:00:06.389472+0000","last_clean":"2023-12-16T00:00:06.389472+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:06.389472+0000","last_undegraded":"2023-12-16T00:00:06.389472+0000","last_fullsized":"2023-12-16T00:00:06.389472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.389884+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:15.389884+0000","last_peered":"2023-12-16T00:00:15.389884+0000","last_clean":"2023-12-16T00:00:15.389884+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:15.389884+0000","last_undegraded":"2023-12-16T00:00:15.389884+0000","last_fullsized":"2023-12-16T00:00:15.389884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'48","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440121+0000","last_change":"2023-12-15T22:53:06.321460+0000","last_active":"2023-12-16T00:00:26.440121+0000","last_peered":"2023-12-16T00:00:26.440121+0000","last_clean":"2023-12-16T00:00:26.440121+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:00:26.440121+0000","last_undegraded":"2023-12-16T00:00:26.440121+0000","last_fullsized":"2023-12-16T00:00:26.440121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864668+0000","last_change":"2023-12-15T22:53:08.336183+0000","last_active":"2023-12-16T00:00:26.864668+0000","last_peered":"2023-12-16T00:00:26.864668+0000","last_clean":"2023-12-16T00:00:26.864668+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:00:26.864668+0000","last_undegraded":"2023-12-16T00:00:26.864668+0000","last_fullsized":"2023-12-16T00:00:26.864668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739291+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739291+0000","last_peered":"2023-12-16T00:01:55.739291+0000","last_clean":"2023-12-16T00:01:55.739291+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739291+0000","last_undegraded":"2023-12-16T00:01:55.739291+0000","last_fullsized":"2023-12-16T00:01:55.739291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1698,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639363+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639363+0000","last_peered":"2023-12-16T00:01:56.639363+0000","last_clean":"2023-12-16T00:01:56.639363+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639363+0000","last_undegraded":"2023-12-16T00:01:56.639363+0000","last_fullsized":"2023-12-16T00:01:56.639363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115807+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115807+0000","last_peered":"2023-12-16T00:02:01.115807+0000","last_clean":"2023-12-16T00:02:01.115807+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115807+0000","last_undegraded":"2023-12-16T00:02:01.115807+0000","last_fullsized":"2023-12-16T00:02:01.115807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"52'6","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.402873+0000","last_change":"2023-12-15T22:53:32.195327+0000","last_active":"2023-12-16T00:00:15.402873+0000","last_peered":"2023-12-16T00:00:15.402873+0000","last_clean":"2023-12-16T00:00:15.402873+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:00:15.402873+0000","last_undegraded":"2023-12-16T00:00:15.402873+0000","last_fullsized":"2023-12-16T00:00:15.402873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725058+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725058+0000","last_peered":"2023-12-16T00:00:59.725058+0000","last_clean":"2023-12-16T00:00:59.725058+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725058+0000","last_undegraded":"2023-12-16T00:00:59.725058+0000","last_fullsized":"2023-12-16T00:00:59.725058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155892+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155892+0000","last_peered":"2023-12-16T00:01:18.155892+0000","last_clean":"2023-12-16T00:01:18.155892+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155892+0000","last_undegraded":"2023-12-16T00:01:18.155892+0000","last_fullsized":"2023-12-16T00:01:18.155892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867666+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867666+0000","last_peered":"2023-12-16T00:00:52.867666+0000","last_clean":"2023-12-16T00:00:52.867666+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867666+0000","last_undegraded":"2023-12-16T00:00:52.867666+0000","last_fullsized":"2023-12-16T00:00:52.867666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219646+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219646+0000","last_peered":"2023-12-16T00:01:31.219646+0000","last_clean":"2023-12-16T00:01:31.219646+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219646+0000","last_undegraded":"2023-12-16T00:01:31.219646+0000","last_fullsized":"2023-12-16T00:01:31.219646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125073+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125073+0000","last_peered":"2023-12-16T00:02:00.125073+0000","last_clean":"2023-12-16T00:02:00.125073+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125073+0000","last_undegraded":"2023-12-16T00:02:00.125073+0000","last_fullsized":"2023-12-16T00:02:00.125073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134515+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134515+0000","last_peered":"2023-12-16T00:01:59.134515+0000","last_clean":"2023-12-16T00:01:59.134515+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134515+0000","last_undegraded":"2023-12-16T00:01:59.134515+0000","last_fullsized":"2023-12-16T00:01:59.134515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699750+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699750+0000","last_peered":"2023-12-16T00:01:28.699750+0000","last_clean":"2023-12-16T00:01:28.699750+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699750+0000","last_undegraded":"2023-12-16T00:01:28.699750+0000","last_fullsized":"2023-12-16T00:01:28.699750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790096+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790096+0000","last_peered":"2023-12-16T00:00:57.790096+0000","last_clean":"2023-12-16T00:00:57.790096+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790096+0000","last_undegraded":"2023-12-16T00:00:57.790096+0000","last_fullsized":"2023-12-16T00:00:57.790096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.391200+0000","last_change":"2023-12-15T22:53:08.332680+0000","last_active":"2023-12-16T00:00:20.391200+0000","last_peered":"2023-12-16T00:00:20.391200+0000","last_clean":"2023-12-16T00:00:20.391200+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:00:20.391200+0000","last_undegraded":"2023-12-16T00:00:20.391200+0000","last_fullsized":"2023-12-16T00:00:20.391200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750337+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750337+0000","last_peered":"2023-12-16T00:00:48.750337+0000","last_clean":"2023-12-16T00:00:48.750337+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750337+0000","last_undegraded":"2023-12-16T00:00:48.750337+0000","last_fullsized":"2023-12-16T00:00:48.750337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745075+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745075+0000","last_peered":"2023-12-16T00:01:28.745075+0000","last_clean":"2023-12-16T00:01:28.745075+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745075+0000","last_undegraded":"2023-12-16T00:01:28.745075+0000","last_fullsized":"2023-12-16T00:01:28.745075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.403966+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:15.403966+0000","last_peered":"2023-12-16T00:00:15.403966+0000","last_clean":"2023-12-16T00:00:15.403966+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:15.403966+0000","last_undegraded":"2023-12-16T00:00:15.403966+0000","last_fullsized":"2023-12-16T00:00:15.403966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231136+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231136+0000","last_peered":"2023-12-16T00:01:34.231136+0000","last_clean":"2023-12-16T00:01:34.231136+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231136+0000","last_undegraded":"2023-12-16T00:01:34.231136+0000","last_fullsized":"2023-12-16T00:01:34.231136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015540+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015540+0000","last_peered":"2023-12-16T00:01:22.015540+0000","last_clean":"2023-12-16T00:01:22.015540+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015540+0000","last_undegraded":"2023-12-16T00:01:22.015540+0000","last_fullsized":"2023-12-16T00:01:22.015540+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233326+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233326+0000","last_peered":"2023-12-16T00:00:26.233326+0000","last_clean":"2023-12-16T00:00:26.233326+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233326+0000","last_undegraded":"2023-12-16T00:00:26.233326+0000","last_fullsized":"2023-12-16T00:00:26.233326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016185+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-16T00:00:26.016185+0000","last_peered":"2023-12-16T00:00:26.016185+0000","last_clean":"2023-12-16T00:00:26.016185+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:00:26.016185+0000","last_undegraded":"2023-12-16T00:00:26.016185+0000","last_fullsized":"2023-12-16T00:00:26.016185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158887+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158887+0000","last_peered":"2023-12-16T00:02:05.158887+0000","last_clean":"2023-12-16T00:02:05.158887+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158887+0000","last_undegraded":"2023-12-16T00:02:05.158887+0000","last_fullsized":"2023-12-16T00:02:05.158887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'8","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289035+0000","last_change":"2023-12-15T22:53:32.194750+0000","last_active":"2023-12-16T00:00:27.289035+0000","last_peered":"2023-12-16T00:00:27.289035+0000","last_clean":"2023-12-16T00:00:27.289035+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:00:27.289035+0000","last_undegraded":"2023-12-16T00:00:27.289035+0000","last_fullsized":"2023-12-16T00:00:27.289035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875695+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875695+0000","last_peered":"2023-12-16T00:01:05.875695+0000","last_clean":"2023-12-16T00:01:05.875695+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875695+0000","last_undegraded":"2023-12-16T00:01:05.875695+0000","last_fullsized":"2023-12-16T00:01:05.875695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":864,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835775+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835775+0000","last_peered":"2023-12-16T00:00:29.835775+0000","last_clean":"2023-12-16T00:00:29.835775+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835775+0000","last_undegraded":"2023-12-16T00:00:29.835775+0000","last_fullsized":"2023-12-16T00:00:29.835775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864514+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-16T00:00:26.864514+0000","last_peered":"2023-12-16T00:00:26.864514+0000","last_clean":"2023-12-16T00:00:26.864514+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:00:26.864514+0000","last_undegraded":"2023-12-16T00:00:26.864514+0000","last_fullsized":"2023-12-16T00:00:26.864514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864656+0000","last_change":"2023-12-15T22:53:08.335031+0000","last_active":"2023-12-16T00:00:26.864656+0000","last_peered":"2023-12-16T00:00:26.864656+0000","last_clean":"2023-12-16T00:00:26.864656+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:00:26.864656+0000","last_undegraded":"2023-12-16T00:00:26.864656+0000","last_fullsized":"2023-12-16T00:00:26.864656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289163+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-16T00:00:27.289163+0000","last_peered":"2023-12-16T00:00:27.289163+0000","last_clean":"2023-12-16T00:00:27.289163+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:00:27.289163+0000","last_undegraded":"2023-12-16T00:00:27.289163+0000","last_fullsized":"2023-12-16T00:00:27.289163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033890+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033890+0000","last_peered":"2023-12-16T00:01:34.033890+0000","last_clean":"2023-12-16T00:01:34.033890+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033890+0000","last_undegraded":"2023-12-16T00:01:34.033890+0000","last_fullsized":"2023-12-16T00:01:34.033890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473143+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473143+0000","last_peered":"2023-12-16T00:00:47.473143+0000","last_clean":"2023-12-16T00:00:47.473143+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473143+0000","last_undegraded":"2023-12-16T00:00:47.473143+0000","last_fullsized":"2023-12-16T00:00:47.473143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121731+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121731+0000","last_peered":"2023-12-16T00:00:35.121731+0000","last_clean":"2023-12-16T00:00:35.121731+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121731+0000","last_undegraded":"2023-12-16T00:00:35.121731+0000","last_fullsized":"2023-12-16T00:00:35.121731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389440+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:06.389440+0000","last_peered":"2023-12-16T00:00:06.389440+0000","last_clean":"2023-12-16T00:00:06.389440+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:06.389440+0000","last_undegraded":"2023-12-16T00:00:06.389440+0000","last_fullsized":"2023-12-16T00:00:06.389440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'69","reported_seq":171,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440142+0000","last_change":"2023-12-15T22:53:06.323077+0000","last_active":"2023-12-16T00:00:26.440142+0000","last_peered":"2023-12-16T00:00:26.440142+0000","last_clean":"2023-12-16T00:00:26.440142+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:00:26.440142+0000","last_undegraded":"2023-12-16T00:00:26.440142+0000","last_fullsized":"2023-12-16T00:00:26.440142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'12","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711777+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:27.711777+0000","last_peered":"2023-12-16T00:00:27.711777+0000","last_clean":"2023-12-16T00:00:27.711777+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:00:27.711777+0000","last_undegraded":"2023-12-16T00:00:27.711777+0000","last_fullsized":"2023-12-16T00:00:27.711777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'203","reported_seq":1760,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016807+0000","last_change":"2023-12-15T22:54:04.180007+0000","last_active":"2023-12-16T00:00:26.016807+0000","last_peered":"2023-12-16T00:00:26.016807+0000","last_clean":"2023-12-16T00:00:26.016807+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:00:26.016807+0000","last_undegraded":"2023-12-16T00:00:26.016807+0000","last_fullsized":"2023-12-16T00:00:26.016807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439849+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439849+0000","last_peered":"2023-12-16T00:02:00.439849+0000","last_clean":"2023-12-16T00:02:00.439849+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439849+0000","last_undegraded":"2023-12-16T00:02:00.439849+0000","last_fullsized":"2023-12-16T00:02:00.439849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984524+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984524+0000","last_peered":"2023-12-16T00:01:24.984524+0000","last_clean":"2023-12-16T00:01:24.984524+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984524+0000","last_undegraded":"2023-12-16T00:01:24.984524+0000","last_fullsized":"2023-12-16T00:01:24.984524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":550,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529119+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529119+0000","last_peered":"2023-12-16T00:00:50.529119+0000","last_clean":"2023-12-16T00:00:50.529119+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529119+0000","last_undegraded":"2023-12-16T00:00:50.529119+0000","last_fullsized":"2023-12-16T00:00:50.529119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710437+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710437+0000","last_peered":"2023-12-16T00:00:43.710437+0000","last_clean":"2023-12-16T00:00:43.710437+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710437+0000","last_undegraded":"2023-12-16T00:00:43.710437+0000","last_fullsized":"2023-12-16T00:00:43.710437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387461+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:05.387461+0000","last_peered":"2023-12-16T00:00:05.387461+0000","last_clean":"2023-12-16T00:00:05.387461+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:05.387461+0000","last_undegraded":"2023-12-16T00:00:05.387461+0000","last_fullsized":"2023-12-16T00:00:05.387461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416130+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416130+0000","last_peered":"2023-12-16T00:01:53.416130+0000","last_clean":"2023-12-16T00:01:53.416130+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416130+0000","last_undegraded":"2023-12-16T00:01:53.416130+0000","last_fullsized":"2023-12-16T00:01:53.416130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'142","reported_seq":1480,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712455+0000","last_change":"2023-12-15T22:54:04.183275+0000","last_active":"2023-12-16T00:00:27.712455+0000","last_peered":"2023-12-16T00:00:27.712455+0000","last_clean":"2023-12-16T00:00:27.712455+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:00:27.712455+0000","last_undegraded":"2023-12-16T00:00:27.712455+0000","last_fullsized":"2023-12-16T00:00:27.712455+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682626+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682626+0000","last_peered":"2023-12-16T00:01:33.682626+0000","last_clean":"2023-12-16T00:01:33.682626+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682626+0000","last_undegraded":"2023-12-16T00:01:33.682626+0000","last_fullsized":"2023-12-16T00:01:33.682626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975152+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975152+0000","last_peered":"2023-12-16T00:01:38.975152+0000","last_clean":"2023-12-16T00:01:38.975152+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975152+0000","last_undegraded":"2023-12-16T00:01:38.975152+0000","last_fullsized":"2023-12-16T00:01:38.975152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574125+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574125+0000","last_peered":"2023-12-16T00:01:55.574125+0000","last_clean":"2023-12-16T00:01:55.574125+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574125+0000","last_undegraded":"2023-12-16T00:01:55.574125+0000","last_fullsized":"2023-12-16T00:01:55.574125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288113+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288113+0000","last_peered":"2023-12-16T00:00:27.288113+0000","last_clean":"2023-12-16T00:00:27.288113+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:00:27.288113+0000","last_undegraded":"2023-12-16T00:00:27.288113+0000","last_fullsized":"2023-12-16T00:00:27.288113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405397+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:25.405397+0000","last_peered":"2023-12-16T00:00:25.405397+0000","last_clean":"2023-12-16T00:00:25.405397+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:25.405397+0000","last_undegraded":"2023-12-16T00:00:25.405397+0000","last_fullsized":"2023-12-16T00:00:25.405397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711551+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-16T00:00:27.711551+0000","last_peered":"2023-12-16T00:00:27.711551+0000","last_clean":"2023-12-16T00:00:27.711551+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:00:27.711551+0000","last_undegraded":"2023-12-16T00:00:27.711551+0000","last_fullsized":"2023-12-16T00:00:27.711551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730461+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730461+0000","last_peered":"2023-12-16T00:01:36.730461+0000","last_clean":"2023-12-16T00:01:36.730461+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730461+0000","last_undegraded":"2023-12-16T00:01:36.730461+0000","last_fullsized":"2023-12-16T00:01:36.730461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'143","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712436+0000","last_change":"2023-12-15T22:54:04.183295+0000","last_active":"2023-12-16T00:00:27.712436+0000","last_peered":"2023-12-16T00:00:27.712436+0000","last_clean":"2023-12-16T00:00:27.712436+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:00:27.712436+0000","last_undegraded":"2023-12-16T00:00:27.712436+0000","last_fullsized":"2023-12-16T00:00:27.712436+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'5","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016632+0000","last_change":"2023-12-15T22:53:32.191400+0000","last_active":"2023-12-16T00:00:26.016632+0000","last_peered":"2023-12-16T00:00:26.016632+0000","last_clean":"2023-12-16T00:00:26.016632+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:00:26.016632+0000","last_undegraded":"2023-12-16T00:00:26.016632+0000","last_fullsized":"2023-12-16T00:00:26.016632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693630+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693630+0000","last_peered":"2023-12-16T00:01:41.693630+0000","last_clean":"2023-12-16T00:01:41.693630+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693630+0000","last_undegraded":"2023-12-16T00:01:41.693630+0000","last_fullsized":"2023-12-16T00:01:41.693630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439858+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-16T00:00:26.439858+0000","last_peered":"2023-12-16T00:00:26.439858+0000","last_clean":"2023-12-16T00:00:26.439858+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:00:26.439858+0000","last_undegraded":"2023-12-16T00:00:26.439858+0000","last_fullsized":"2023-12-16T00:00:26.439858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015932+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:26.015932+0000","last_peered":"2023-12-16T00:00:26.015932+0000","last_clean":"2023-12-16T00:00:26.015932+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:26.015932+0000","last_undegraded":"2023-12-16T00:00:26.015932+0000","last_fullsized":"2023-12-16T00:00:26.015932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'84","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.624945+0000","last_change":"2023-12-15T22:53:06.323245+0000","last_active":"2023-12-16T00:00:20.624945+0000","last_peered":"2023-12-16T00:00:20.624945+0000","last_clean":"2023-12-16T00:00:20.624945+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:00:20.624945+0000","last_undegraded":"2023-12-16T00:00:20.624945+0000","last_fullsized":"2023-12-16T00:00:20.624945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148499+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148499+0000","last_peered":"2023-12-16T00:01:42.148499+0000","last_clean":"2023-12-16T00:01:42.148499+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148499+0000","last_undegraded":"2023-12-16T00:01:42.148499+0000","last_fullsized":"2023-12-16T00:01:42.148499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927412+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927412+0000","last_peered":"2023-12-16T00:01:48.927412+0000","last_clean":"2023-12-16T00:01:48.927412+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927412+0000","last_undegraded":"2023-12-16T00:01:48.927412+0000","last_fullsized":"2023-12-16T00:01:48.927412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137671+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-16T00:00:28.137671+0000","last_peered":"2023-12-16T00:00:28.137671+0000","last_clean":"2023-12-16T00:00:28.137671+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:00:28.137671+0000","last_undegraded":"2023-12-16T00:00:28.137671+0000","last_fullsized":"2023-12-16T00:00:28.137671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478525+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478525+0000","last_peered":"2023-12-16T00:02:02.478525+0000","last_clean":"2023-12-16T00:02:02.478525+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478525+0000","last_undegraded":"2023-12-16T00:02:02.478525+0000","last_fullsized":"2023-12-16T00:02:02.478525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790128+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790128+0000","last_peered":"2023-12-16T00:01:16.790128+0000","last_clean":"2023-12-16T00:01:16.790128+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790128+0000","last_undegraded":"2023-12-16T00:01:16.790128+0000","last_fullsized":"2023-12-16T00:01:16.790128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1419,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174535+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174535+0000","last_peered":"2023-12-16T00:01:31.174535+0000","last_clean":"2023-12-16T00:01:31.174535+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174535+0000","last_undegraded":"2023-12-16T00:01:31.174535+0000","last_fullsized":"2023-12-16T00:01:31.174535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007421+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007421+0000","last_peered":"2023-12-16T00:01:15.007421+0000","last_clean":"2023-12-16T00:01:15.007421+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007421+0000","last_undegraded":"2023-12-16T00:01:15.007421+0000","last_fullsized":"2023-12-16T00:01:15.007421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620685+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:05.620685+0000","last_peered":"2023-12-16T00:00:05.620685+0000","last_clean":"2023-12-16T00:00:05.620685+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:05.620685+0000","last_undegraded":"2023-12-16T00:00:05.620685+0000","last_fullsized":"2023-12-16T00:00:05.620685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.390276+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:15.390276+0000","last_peered":"2023-12-16T00:00:15.390276+0000","last_clean":"2023-12-16T00:00:15.390276+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:15.390276+0000","last_undegraded":"2023-12-16T00:00:15.390276+0000","last_fullsized":"2023-12-16T00:00:15.390276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401475+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:05.401475+0000","last_peered":"2023-12-16T00:00:05.401475+0000","last_clean":"2023-12-16T00:00:05.401475+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:05.401475+0000","last_undegraded":"2023-12-16T00:00:05.401475+0000","last_fullsized":"2023-12-16T00:00:05.401475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243276+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243276+0000","last_peered":"2023-12-16T00:01:47.243276+0000","last_clean":"2023-12-16T00:01:47.243276+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243276+0000","last_undegraded":"2023-12-16T00:01:47.243276+0000","last_fullsized":"2023-12-16T00:01:47.243276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137686+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-16T00:00:28.137686+0000","last_peered":"2023-12-16T00:00:28.137686+0000","last_clean":"2023-12-16T00:00:28.137686+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:00:28.137686+0000","last_undegraded":"2023-12-16T00:00:28.137686+0000","last_fullsized":"2023-12-16T00:00:28.137686+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'17","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016665+0000","last_change":"2023-12-15T22:53:32.191667+0000","last_active":"2023-12-16T00:00:26.016665+0000","last_peered":"2023-12-16T00:00:26.016665+0000","last_clean":"2023-12-16T00:00:26.016665+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:00:26.016665+0000","last_undegraded":"2023-12-16T00:00:26.016665+0000","last_fullsized":"2023-12-16T00:00:26.016665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1474,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861451+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861451+0000","last_peered":"2023-12-16T00:01:34.861451+0000","last_clean":"2023-12-16T00:01:34.861451+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861451+0000","last_undegraded":"2023-12-16T00:01:34.861451+0000","last_fullsized":"2023-12-16T00:01:34.861451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185657+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185657+0000","last_peered":"2023-12-16T00:01:12.185657+0000","last_clean":"2023-12-16T00:01:12.185657+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185657+0000","last_undegraded":"2023-12-16T00:01:12.185657+0000","last_fullsized":"2023-12-16T00:01:12.185657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400974+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:05.400974+0000","last_peered":"2023-12-16T00:00:05.400974+0000","last_clean":"2023-12-16T00:00:05.400974+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:05.400974+0000","last_undegraded":"2023-12-16T00:00:05.400974+0000","last_fullsized":"2023-12-16T00:00:05.400974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405423+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:00:25.405423+0000","last_peered":"2023-12-16T00:00:25.405423+0000","last_clean":"2023-12-16T00:00:25.405423+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:00:25.405423+0000","last_undegraded":"2023-12-16T00:00:25.405423+0000","last_fullsized":"2023-12-16T00:00:25.405423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:15.404304+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:15.404304+0000","last_peered":"2023-12-16T00:00:15.404304+0000","last_clean":"2023-12-16T00:00:15.404304+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:15.404304+0000","last_undegraded":"2023-12-16T00:00:15.404304+0000","last_fullsized":"2023-12-16T00:00:15.404304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'111","reported_seq":972,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440094+0000","last_change":"2023-12-15T22:53:06.321312+0000","last_active":"2023-12-16T00:00:26.440094+0000","last_peered":"2023-12-16T00:00:26.440094+0000","last_clean":"2023-12-16T00:00:26.440094+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:00:26.440094+0000","last_undegraded":"2023-12-16T00:00:26.440094+0000","last_fullsized":"2023-12-16T00:00:26.440094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:06.389786+0000","last_change":"2023-12-15T22:53:08.332331+0000","last_active":"2023-12-16T00:00:06.389786+0000","last_peered":"2023-12-16T00:00:06.389786+0000","last_clean":"2023-12-16T00:00:06.389786+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:00:06.389786+0000","last_undegraded":"2023-12-16T00:00:06.389786+0000","last_fullsized":"2023-12-16T00:00:06.389786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897125+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897125+0000","last_peered":"2023-12-16T00:01:15.897125+0000","last_clean":"2023-12-16T00:01:15.897125+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897125+0000","last_undegraded":"2023-12-16T00:01:15.897125+0000","last_fullsized":"2023-12-16T00:01:15.897125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1257,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016835+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-16T00:00:26.016835+0000","last_peered":"2023-12-16T00:00:26.016835+0000","last_clean":"2023-12-16T00:00:26.016835+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:00:26.016835+0000","last_undegraded":"2023-12-16T00:00:26.016835+0000","last_fullsized":"2023-12-16T00:00:26.016835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947140+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947140+0000","last_peered":"2023-12-16T00:01:30.947140+0000","last_clean":"2023-12-16T00:01:30.947140+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947140+0000","last_undegraded":"2023-12-16T00:01:30.947140+0000","last_fullsized":"2023-12-16T00:01:30.947140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874738+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874738+0000","last_peered":"2023-12-16T00:01:08.874738+0000","last_clean":"2023-12-16T00:01:08.874738+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874738+0000","last_undegraded":"2023-12-16T00:01:08.874738+0000","last_fullsized":"2023-12-16T00:01:08.874738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644838+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644838+0000","last_peered":"2023-12-16T00:01:58.644838+0000","last_clean":"2023-12-16T00:01:58.644838+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644838+0000","last_undegraded":"2023-12-16T00:01:58.644838+0000","last_fullsized":"2023-12-16T00:01:58.644838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711361+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-16T00:00:27.711361+0000","last_peered":"2023-12-16T00:00:27.711361+0000","last_clean":"2023-12-16T00:00:27.711361+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:00:27.711361+0000","last_undegraded":"2023-12-16T00:00:27.711361+0000","last_fullsized":"2023-12-16T00:00:27.711361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400947+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:05.400947+0000","last_peered":"2023-12-16T00:00:05.400947+0000","last_clean":"2023-12-16T00:00:05.400947+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:05.400947+0000","last_undegraded":"2023-12-16T00:00:05.400947+0000","last_fullsized":"2023-12-16T00:00:05.400947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864376+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-16T00:00:26.864376+0000","last_peered":"2023-12-16T00:00:26.864376+0000","last_clean":"2023-12-16T00:00:26.864376+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:00:26.864376+0000","last_undegraded":"2023-12-16T00:00:26.864376+0000","last_fullsized":"2023-12-16T00:00:26.864376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711655+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-16T00:00:27.711655+0000","last_peered":"2023-12-16T00:00:27.711655+0000","last_clean":"2023-12-16T00:00:27.711655+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:00:27.711655+0000","last_undegraded":"2023-12-16T00:00:27.711655+0000","last_fullsized":"2023-12-16T00:00:27.711655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864627+0000","last_change":"2023-12-15T22:53:08.334768+0000","last_active":"2023-12-16T00:00:26.864627+0000","last_peered":"2023-12-16T00:00:26.864627+0000","last_clean":"2023-12-16T00:00:26.864627+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:00:26.864627+0000","last_undegraded":"2023-12-16T00:00:26.864627+0000","last_fullsized":"2023-12-16T00:00:26.864627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722628+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722628+0000","last_peered":"2023-12-16T00:01:26.722628+0000","last_clean":"2023-12-16T00:01:26.722628+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722628+0000","last_undegraded":"2023-12-16T00:01:26.722628+0000","last_fullsized":"2023-12-16T00:01:26.722628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5896,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289225+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-16T00:00:27.289225+0000","last_peered":"2023-12-16T00:00:27.289225+0000","last_clean":"2023-12-16T00:00:27.289225+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:00:27.289225+0000","last_undegraded":"2023-12-16T00:00:27.289225+0000","last_fullsized":"2023-12-16T00:00:27.289225+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137754+0000","last_change":"2023-12-15T22:53:58.167620+0000","last_active":"2023-12-16T00:00:28.137754+0000","last_peered":"2023-12-16T00:00:28.137754+0000","last_clean":"2023-12-16T00:00:28.137754+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:00:28.137754+0000","last_undegraded":"2023-12-16T00:00:28.137754+0000","last_fullsized":"2023-12-16T00:00:28.137754+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840119+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840119+0000","last_peered":"2023-12-16T00:01:10.840119+0000","last_clean":"2023-12-16T00:01:10.840119+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840119+0000","last_undegraded":"2023-12-16T00:01:10.840119+0000","last_fullsized":"2023-12-16T00:01:10.840119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228196+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228196+0000","last_peered":"2023-12-16T00:01:37.228196+0000","last_clean":"2023-12-16T00:01:37.228196+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228196+0000","last_undegraded":"2023-12-16T00:01:37.228196+0000","last_fullsized":"2023-12-16T00:01:37.228196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387948+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:05.387948+0000","last_peered":"2023-12-16T00:00:05.387948+0000","last_clean":"2023-12-16T00:00:05.387948+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:05.387948+0000","last_undegraded":"2023-12-16T00:00:05.387948+0000","last_fullsized":"2023-12-16T00:00:05.387948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288256+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-16T00:00:27.288256+0000","last_peered":"2023-12-16T00:00:27.288256+0000","last_clean":"2023-12-16T00:00:27.288256+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:00:27.288256+0000","last_undegraded":"2023-12-16T00:00:27.288256+0000","last_fullsized":"2023-12-16T00:00:27.288256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288332+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-16T00:00:27.288332+0000","last_peered":"2023-12-16T00:00:27.288332+0000","last_clean":"2023-12-16T00:00:27.288332+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:00:27.288332+0000","last_undegraded":"2023-12-16T00:00:27.288332+0000","last_fullsized":"2023-12-16T00:00:27.288332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016112+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-16T00:00:26.016112+0000","last_peered":"2023-12-16T00:00:26.016112+0000","last_clean":"2023-12-16T00:00:26.016112+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:00:26.016112+0000","last_undegraded":"2023-12-16T00:00:26.016112+0000","last_fullsized":"2023-12-16T00:00:26.016112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199772+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199772+0000","last_peered":"2023-12-16T00:01:34.199772+0000","last_clean":"2023-12-16T00:01:34.199772+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199772+0000","last_undegraded":"2023-12-16T00:01:34.199772+0000","last_fullsized":"2023-12-16T00:01:34.199772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629203+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629203+0000","last_peered":"2023-12-16T00:01:50.629203+0000","last_clean":"2023-12-16T00:01:50.629203+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629203+0000","last_undegraded":"2023-12-16T00:01:50.629203+0000","last_fullsized":"2023-12-16T00:01:50.629203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016649+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-16T00:00:26.016649+0000","last_peered":"2023-12-16T00:00:26.016649+0000","last_clean":"2023-12-16T00:00:26.016649+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:00:26.016649+0000","last_undegraded":"2023-12-16T00:00:26.016649+0000","last_fullsized":"2023-12-16T00:00:26.016649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921170+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921170+0000","last_peered":"2023-12-16T00:01:43.921170+0000","last_clean":"2023-12-16T00:01:43.921170+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921170+0000","last_undegraded":"2023-12-16T00:01:43.921170+0000","last_fullsized":"2023-12-16T00:01:43.921170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136732+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-16T00:00:28.136732+0000","last_peered":"2023-12-16T00:00:28.136732+0000","last_clean":"2023-12-16T00:00:28.136732+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:00:28.136732+0000","last_undegraded":"2023-12-16T00:00:28.136732+0000","last_fullsized":"2023-12-16T00:00:28.136732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440118+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-16T00:00:26.440118+0000","last_peered":"2023-12-16T00:00:26.440118+0000","last_clean":"2023-12-16T00:00:26.440118+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:00:26.440118+0000","last_undegraded":"2023-12-16T00:00:26.440118+0000","last_fullsized":"2023-12-16T00:00:26.440118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":802,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136932+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-16T00:00:28.136932+0000","last_peered":"2023-12-16T00:00:28.136932+0000","last_clean":"2023-12-16T00:00:28.136932+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:00:28.136932+0000","last_undegraded":"2023-12-16T00:00:28.136932+0000","last_fullsized":"2023-12-16T00:00:28.136932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307393+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307393+0000","last_peered":"2023-12-16T00:01:26.307393+0000","last_clean":"2023-12-16T00:01:26.307393+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307393+0000","last_undegraded":"2023-12-16T00:01:26.307393+0000","last_fullsized":"2023-12-16T00:01:26.307393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016825+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-16T00:00:26.016825+0000","last_peered":"2023-12-16T00:00:26.016825+0000","last_clean":"2023-12-16T00:00:26.016825+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:00:26.016825+0000","last_undegraded":"2023-12-16T00:00:26.016825+0000","last_fullsized":"2023-12-16T00:00:26.016825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396521+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396521+0000","last_peered":"2023-12-16T00:01:59.396521+0000","last_clean":"2023-12-16T00:01:59.396521+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396521+0000","last_undegraded":"2023-12-16T00:01:59.396521+0000","last_fullsized":"2023-12-16T00:01:59.396521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950181+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950181+0000","last_peered":"2023-12-16T00:01:28.950181+0000","last_clean":"2023-12-16T00:01:28.950181+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950181+0000","last_undegraded":"2023-12-16T00:01:28.950181+0000","last_fullsized":"2023-12-16T00:01:28.950181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016027+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-16T00:00:26.016027+0000","last_peered":"2023-12-16T00:00:26.016027+0000","last_clean":"2023-12-16T00:00:26.016027+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:00:26.016027+0000","last_undegraded":"2023-12-16T00:00:26.016027+0000","last_fullsized":"2023-12-16T00:00:26.016027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711705+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-16T00:00:27.711705+0000","last_peered":"2023-12-16T00:00:27.711705+0000","last_clean":"2023-12-16T00:00:27.711705+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:00:27.711705+0000","last_undegraded":"2023-12-16T00:00:27.711705+0000","last_fullsized":"2023-12-16T00:00:27.711705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255222+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255222+0000","last_peered":"2023-12-16T00:01:28.255222+0000","last_clean":"2023-12-16T00:01:28.255222+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255222+0000","last_undegraded":"2023-12-16T00:01:28.255222+0000","last_fullsized":"2023-12-16T00:01:28.255222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440712+0000","last_change":"2023-12-15T22:53:58.169557+0000","last_active":"2023-12-16T00:00:26.440712+0000","last_peered":"2023-12-16T00:00:26.440712+0000","last_clean":"2023-12-16T00:00:26.440712+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:00:26.440712+0000","last_undegraded":"2023-12-16T00:00:26.440712+0000","last_fullsized":"2023-12-16T00:00:26.440712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676120+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676120+0000","last_peered":"2023-12-16T00:01:30.676120+0000","last_clean":"2023-12-16T00:01:30.676120+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676120+0000","last_undegraded":"2023-12-16T00:01:30.676120+0000","last_fullsized":"2023-12-16T00:01:30.676120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440194+0000","last_change":"2023-12-15T22:53:08.329125+0000","last_active":"2023-12-16T00:00:26.440194+0000","last_peered":"2023-12-16T00:00:26.440194+0000","last_clean":"2023-12-16T00:00:26.440194+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:00:26.440194+0000","last_undegraded":"2023-12-16T00:00:26.440194+0000","last_fullsized":"2023-12-16T00:00:26.440194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6461,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440808+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-16T00:00:26.440808+0000","last_peered":"2023-12-16T00:00:26.440808+0000","last_clean":"2023-12-16T00:00:26.440808+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:00:26.440808+0000","last_undegraded":"2023-12-16T00:00:26.440808+0000","last_fullsized":"2023-12-16T00:00:26.440808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749627+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749627+0000","last_peered":"2023-12-16T00:01:43.749627+0000","last_clean":"2023-12-16T00:01:43.749627+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749627+0000","last_undegraded":"2023-12-16T00:01:43.749627+0000","last_fullsized":"2023-12-16T00:01:43.749627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357239+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357239+0000","last_peered":"2023-12-16T00:01:50.357239+0000","last_clean":"2023-12-16T00:01:50.357239+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357239+0000","last_undegraded":"2023-12-16T00:01:50.357239+0000","last_fullsized":"2023-12-16T00:01:50.357239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711961+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-16T00:00:27.711961+0000","last_peered":"2023-12-16T00:00:27.711961+0000","last_clean":"2023-12-16T00:00:27.711961+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:00:27.711961+0000","last_undegraded":"2023-12-16T00:00:27.711961+0000","last_fullsized":"2023-12-16T00:00:27.711961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288444+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-16T00:00:27.288444+0000","last_peered":"2023-12-16T00:00:27.288444+0000","last_clean":"2023-12-16T00:00:27.288444+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:00:27.288444+0000","last_undegraded":"2023-12-16T00:00:27.288444+0000","last_fullsized":"2023-12-16T00:00:27.288444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137784+0000","last_change":"2023-12-15T22:53:58.164716+0000","last_active":"2023-12-16T00:00:28.137784+0000","last_peered":"2023-12-16T00:00:28.137784+0000","last_clean":"2023-12-16T00:00:28.137784+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:00:28.137784+0000","last_undegraded":"2023-12-16T00:00:28.137784+0000","last_fullsized":"2023-12-16T00:00:28.137784+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016714+0000","last_change":"2023-12-15T22:53:32.189880+0000","last_active":"2023-12-16T00:00:26.016714+0000","last_peered":"2023-12-16T00:00:26.016714+0000","last_clean":"2023-12-16T00:00:26.016714+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:00:26.016714+0000","last_undegraded":"2023-12-16T00:00:26.016714+0000","last_fullsized":"2023-12-16T00:00:26.016714+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":403,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022203+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022203+0000","last_peered":"2023-12-16T00:01:14.022203+0000","last_clean":"2023-12-16T00:01:14.022203+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022203+0000","last_undegraded":"2023-12-16T00:01:14.022203+0000","last_fullsized":"2023-12-16T00:01:14.022203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283922+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283922+0000","last_peered":"2023-12-16T00:01:51.283922+0000","last_clean":"2023-12-16T00:01:51.283922+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283922+0000","last_undegraded":"2023-12-16T00:01:51.283922+0000","last_fullsized":"2023-12-16T00:01:51.283922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891956+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891956+0000","last_peered":"2023-12-16T00:01:51.891956+0000","last_clean":"2023-12-16T00:01:51.891956+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891956+0000","last_undegraded":"2023-12-16T00:01:51.891956+0000","last_fullsized":"2023-12-16T00:01:51.891956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1754,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889707+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889707+0000","last_peered":"2023-12-16T00:01:33.889707+0000","last_clean":"2023-12-16T00:01:33.889707+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889707+0000","last_undegraded":"2023-12-16T00:01:33.889707+0000","last_fullsized":"2023-12-16T00:01:33.889707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850184+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850184+0000","last_peered":"2023-12-16T00:01:41.850184+0000","last_clean":"2023-12-16T00:01:41.850184+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850184+0000","last_undegraded":"2023-12-16T00:01:41.850184+0000","last_fullsized":"2023-12-16T00:01:41.850184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016191+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-16T00:00:26.016191+0000","last_peered":"2023-12-16T00:00:26.016191+0000","last_clean":"2023-12-16T00:00:26.016191+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:00:26.016191+0000","last_undegraded":"2023-12-16T00:00:26.016191+0000","last_fullsized":"2023-12-16T00:00:26.016191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289222+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-16T00:00:27.289222+0000","last_peered":"2023-12-16T00:00:27.289222+0000","last_clean":"2023-12-16T00:00:27.289222+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:00:27.289222+0000","last_undegraded":"2023-12-16T00:00:27.289222+0000","last_fullsized":"2023-12-16T00:00:27.289222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207124+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207124+0000","last_peered":"2023-12-16T00:01:36.207124+0000","last_clean":"2023-12-16T00:01:36.207124+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207124+0000","last_undegraded":"2023-12-16T00:01:36.207124+0000","last_fullsized":"2023-12-16T00:01:36.207124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288524+0000","last_change":"2023-12-15T22:53:08.330047+0000","last_active":"2023-12-16T00:00:27.288524+0000","last_peered":"2023-12-16T00:00:27.288524+0000","last_clean":"2023-12-16T00:00:27.288524+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:00:27.288524+0000","last_undegraded":"2023-12-16T00:00:27.288524+0000","last_fullsized":"2023-12-16T00:00:27.288524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137790+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-16T00:00:28.137790+0000","last_peered":"2023-12-16T00:00:28.137790+0000","last_clean":"2023-12-16T00:00:28.137790+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:00:28.137790+0000","last_undegraded":"2023-12-16T00:00:28.137790+0000","last_fullsized":"2023-12-16T00:00:28.137790+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.190460+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902867+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902867+0000","last_peered":"2023-12-16T00:01:31.902867+0000","last_clean":"2023-12-16T00:01:31.902867+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902867+0000","last_undegraded":"2023-12-16T00:01:31.902867+0000","last_fullsized":"2023-12-16T00:01:31.902867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":554,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288294+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-16T00:00:27.288294+0000","last_peered":"2023-12-16T00:00:27.288294+0000","last_clean":"2023-12-16T00:00:27.288294+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:00:27.288294+0000","last_undegraded":"2023-12-16T00:00:27.288294+0000","last_fullsized":"2023-12-16T00:00:27.288294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440205+0000","last_change":"2023-12-15T22:53:08.332933+0000","last_active":"2023-12-16T00:00:26.440205+0000","last_peered":"2023-12-16T00:00:26.440205+0000","last_clean":"2023-12-16T00:00:26.440205+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:00:26.440205+0000","last_undegraded":"2023-12-16T00:00:26.440205+0000","last_fullsized":"2023-12-16T00:00:26.440205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239262+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239262+0000","last_peered":"2023-12-16T00:01:35.239262+0000","last_clean":"2023-12-16T00:01:35.239262+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239262+0000","last_undegraded":"2023-12-16T00:01:35.239262+0000","last_fullsized":"2023-12-16T00:01:35.239262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1326,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440794+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-16T00:00:26.440794+0000","last_peered":"2023-12-16T00:00:26.440794+0000","last_clean":"2023-12-16T00:00:26.440794+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:00:26.440794+0000","last_undegraded":"2023-12-16T00:00:26.440794+0000","last_fullsized":"2023-12-16T00:00:26.440794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'6","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137632+0000","last_change":"2023-12-15T22:53:32.194832+0000","last_active":"2023-12-16T00:00:28.137632+0000","last_peered":"2023-12-16T00:00:28.137632+0000","last_clean":"2023-12-16T00:00:28.137632+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:00:28.137632+0000","last_undegraded":"2023-12-16T00:00:28.137632+0000","last_fullsized":"2023-12-16T00:00:28.137632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":56,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288909+0000","last_change":"2023-12-15T22:53:30.179743+0000","last_active":"2023-12-16T00:00:27.288909+0000","last_peered":"2023-12-16T00:00:27.288909+0000","last_clean":"2023-12-16T00:00:27.288909+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:00:27.288909+0000","last_undegraded":"2023-12-16T00:00:27.288909+0000","last_fullsized":"2023-12-16T00:00:27.288909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":388,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025286+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025286+0000","last_peered":"2023-12-16T00:02:04.025286+0000","last_clean":"2023-12-16T00:02:04.025286+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025286+0000","last_undegraded":"2023-12-16T00:02:04.025286+0000","last_fullsized":"2023-12-16T00:02:04.025286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725602+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725602+0000","last_peered":"2023-12-16T00:01:44.725602+0000","last_clean":"2023-12-16T00:01:44.725602+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725602+0000","last_undegraded":"2023-12-16T00:01:44.725602+0000","last_fullsized":"2023-12-16T00:01:44.725602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'61","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864617+0000","last_change":"2023-12-15T22:53:06.322389+0000","last_active":"2023-12-16T00:00:26.864617+0000","last_peered":"2023-12-16T00:00:26.864617+0000","last_clean":"2023-12-16T00:00:26.864617+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:00:26.864617+0000","last_undegraded":"2023-12-16T00:00:26.864617+0000","last_fullsized":"2023-12-16T00:00:26.864617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195623+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195623+0000","last_peered":"2023-12-16T00:01:41.195623+0000","last_clean":"2023-12-16T00:01:41.195623+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195623+0000","last_undegraded":"2023-12-16T00:01:41.195623+0000","last_fullsized":"2023-12-16T00:01:41.195623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'139","reported_seq":3846,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440733+0000","last_change":"2023-12-15T22:54:04.189231+0000","last_active":"2023-12-16T00:00:26.440733+0000","last_peered":"2023-12-16T00:00:26.440733+0000","last_clean":"2023-12-16T00:00:26.440733+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:00:26.440733+0000","last_undegraded":"2023-12-16T00:00:26.440733+0000","last_fullsized":"2023-12-16T00:00:26.440733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137697+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-16T00:00:28.137697+0000","last_peered":"2023-12-16T00:00:28.137697+0000","last_clean":"2023-12-16T00:00:28.137697+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:00:28.137697+0000","last_undegraded":"2023-12-16T00:00:28.137697+0000","last_fullsized":"2023-12-16T00:00:28.137697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288401+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-16T00:00:27.288401+0000","last_peered":"2023-12-16T00:00:27.288401+0000","last_clean":"2023-12-16T00:00:27.288401+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:00:27.288401+0000","last_undegraded":"2023-12-16T00:00:27.288401+0000","last_fullsized":"2023-12-16T00:00:27.288401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137077+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-16T00:00:28.137077+0000","last_peered":"2023-12-16T00:00:28.137077+0000","last_clean":"2023-12-16T00:00:28.137077+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:00:28.137077+0000","last_undegraded":"2023-12-16T00:00:28.137077+0000","last_fullsized":"2023-12-16T00:00:28.137077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219694+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219694+0000","last_peered":"2023-12-16T00:01:33.219694+0000","last_clean":"2023-12-16T00:01:33.219694+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219694+0000","last_undegraded":"2023-12-16T00:01:33.219694+0000","last_fullsized":"2023-12-16T00:01:33.219694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:01.388134+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:01.388134+0000","last_peered":"2023-12-16T00:00:01.388134+0000","last_clean":"2023-12-16T00:00:01.388134+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:01.388134+0000","last_undegraded":"2023-12-16T00:00:01.388134+0000","last_fullsized":"2023-12-16T00:00:01.388134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016743+0000","last_change":"2023-12-15T22:53:58.169802+0000","last_active":"2023-12-16T00:00:26.016743+0000","last_peered":"2023-12-16T00:00:26.016743+0000","last_clean":"2023-12-16T00:00:26.016743+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:00:26.016743+0000","last_undegraded":"2023-12-16T00:00:26.016743+0000","last_fullsized":"2023-12-16T00:00:26.016743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'576","reported_seq":1509,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288972+0000","last_change":"2023-12-15T22:53:30.180644+0000","last_active":"2023-12-16T00:00:27.288972+0000","last_peered":"2023-12-16T00:00:27.288972+0000","last_clean":"2023-12-16T00:00:27.288972+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:00:27.288972+0000","last_undegraded":"2023-12-16T00:00:27.288972+0000","last_fullsized":"2023-12-16T00:00:27.288972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158555+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158555+0000","last_peered":"2023-12-16T00:02:00.158555+0000","last_clean":"2023-12-16T00:02:00.158555+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158555+0000","last_undegraded":"2023-12-16T00:02:00.158555+0000","last_fullsized":"2023-12-16T00:02:00.158555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.386435+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:00.386435+0000","last_peered":"2023-12-16T00:00:00.386435+0000","last_clean":"2023-12-16T00:00:00.386435+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:00.386435+0000","last_undegraded":"2023-12-16T00:00:00.386435+0000","last_fullsized":"2023-12-16T00:00:00.386435+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137737+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-16T00:00:28.137737+0000","last_peered":"2023-12-16T00:00:28.137737+0000","last_clean":"2023-12-16T00:00:28.137737+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:00:28.137737+0000","last_undegraded":"2023-12-16T00:00:28.137737+0000","last_fullsized":"2023-12-16T00:00:28.137737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246171+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246171+0000","last_peered":"2023-12-16T00:01:50.246171+0000","last_clean":"2023-12-16T00:01:50.246171+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246171+0000","last_undegraded":"2023-12-16T00:01:50.246171+0000","last_fullsized":"2023-12-16T00:01:50.246171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986502+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986502+0000","last_peered":"2023-12-16T00:01:56.986502+0000","last_clean":"2023-12-16T00:01:56.986502+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986502+0000","last_undegraded":"2023-12-16T00:01:56.986502+0000","last_fullsized":"2023-12-16T00:01:56.986502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288505+0000","last_change":"2023-12-15T22:53:08.330094+0000","last_active":"2023-12-16T00:00:27.288505+0000","last_peered":"2023-12-16T00:00:27.288505+0000","last_clean":"2023-12-16T00:00:27.288505+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:00:27.288505+0000","last_undegraded":"2023-12-16T00:00:27.288505+0000","last_fullsized":"2023-12-16T00:00:27.288505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.399036+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:00.399036+0000","last_peered":"2023-12-16T00:00:00.399036+0000","last_clean":"2023-12-16T00:00:00.399036+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:00.399036+0000","last_undegraded":"2023-12-16T00:00:00.399036+0000","last_fullsized":"2023-12-16T00:00:00.399036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'110","reported_seq":3630,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865267+0000","last_change":"2023-12-15T22:54:04.179390+0000","last_active":"2023-12-16T00:00:26.865267+0000","last_peered":"2023-12-16T00:00:26.865267+0000","last_clean":"2023-12-16T00:00:26.865267+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:00:26.865267+0000","last_undegraded":"2023-12-16T00:00:26.865267+0000","last_fullsized":"2023-12-16T00:00:26.865267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137616+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-16T00:00:28.137616+0000","last_peered":"2023-12-16T00:00:28.137616+0000","last_clean":"2023-12-16T00:00:28.137616+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:00:28.137616+0000","last_undegraded":"2023-12-16T00:00:28.137616+0000","last_fullsized":"2023-12-16T00:00:28.137616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892770+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892770+0000","last_peered":"2023-12-16T00:01:49.892770+0000","last_clean":"2023-12-16T00:01:49.892770+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892770+0000","last_undegraded":"2023-12-16T00:01:49.892770+0000","last_fullsized":"2023-12-16T00:01:49.892770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:00.618769+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:00.618769+0000","last_peered":"2023-12-16T00:00:00.618769+0000","last_clean":"2023-12-16T00:00:00.618769+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:00.618769+0000","last_undegraded":"2023-12-16T00:00:00.618769+0000","last_fullsized":"2023-12-16T00:00:00.618769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'151","reported_seq":387,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016680+0000","last_change":"2023-12-15T22:53:32.191794+0000","last_active":"2023-12-16T00:00:26.016680+0000","last_peered":"2023-12-16T00:00:26.016680+0000","last_clean":"2023-12-16T00:00:26.016680+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:00:26.016680+0000","last_undegraded":"2023-12-16T00:00:26.016680+0000","last_fullsized":"2023-12-16T00:00:26.016680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137530+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-16T00:00:28.137530+0000","last_peered":"2023-12-16T00:00:28.137530+0000","last_clean":"2023-12-16T00:00:28.137530+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:00:28.137530+0000","last_undegraded":"2023-12-16T00:00:28.137530+0000","last_fullsized":"2023-12-16T00:00:28.137530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679948+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679948+0000","last_peered":"2023-12-16T00:01:47.679948+0000","last_clean":"2023-12-16T00:01:47.679948+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679948+0000","last_undegraded":"2023-12-16T00:01:47.679948+0000","last_fullsized":"2023-12-16T00:01:47.679948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634825+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634825+0000","last_peered":"2023-12-16T00:02:01.634825+0000","last_clean":"2023-12-16T00:02:01.634825+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634825+0000","last_undegraded":"2023-12-16T00:02:01.634825+0000","last_fullsized":"2023-12-16T00:02:01.634825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620720+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:05.620720+0000","last_peered":"2023-12-16T00:00:05.620720+0000","last_clean":"2023-12-16T00:00:05.620720+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:05.620720+0000","last_undegraded":"2023-12-16T00:00:05.620720+0000","last_fullsized":"2023-12-16T00:00:05.620720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711283+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-16T00:00:27.711283+0000","last_peered":"2023-12-16T00:00:27.711283+0000","last_clean":"2023-12-16T00:00:27.711283+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:00:27.711283+0000","last_undegraded":"2023-12-16T00:00:27.711283+0000","last_fullsized":"2023-12-16T00:00:27.711283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620638+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:05.620638+0000","last_peered":"2023-12-16T00:00:05.620638+0000","last_clean":"2023-12-16T00:00:05.620638+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:05.620638+0000","last_undegraded":"2023-12-16T00:00:05.620638+0000","last_fullsized":"2023-12-16T00:00:05.620638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864089+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-16T00:00:26.864089+0000","last_peered":"2023-12-16T00:00:26.864089+0000","last_clean":"2023-12-16T00:00:26.864089+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:00:26.864089+0000","last_undegraded":"2023-12-16T00:00:26.864089+0000","last_fullsized":"2023-12-16T00:00:26.864089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808750+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808750+0000","last_peered":"2023-12-16T00:01:20.808750+0000","last_clean":"2023-12-16T00:01:20.808750+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808750+0000","last_undegraded":"2023-12-16T00:01:20.808750+0000","last_fullsized":"2023-12-16T00:01:20.808750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401415+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:05.401415+0000","last_peered":"2023-12-16T00:00:05.401415+0000","last_clean":"2023-12-16T00:00:05.401415+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:05.401415+0000","last_undegraded":"2023-12-16T00:00:05.401415+0000","last_fullsized":"2023-12-16T00:00:05.401415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620423+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:05.620423+0000","last_peered":"2023-12-16T00:00:05.620423+0000","last_clean":"2023-12-16T00:00:05.620423+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:05.620423+0000","last_undegraded":"2023-12-16T00:00:05.620423+0000","last_fullsized":"2023-12-16T00:00:05.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864271+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-16T00:00:26.864271+0000","last_peered":"2023-12-16T00:00:26.864271+0000","last_clean":"2023-12-16T00:00:26.864271+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:00:26.864271+0000","last_undegraded":"2023-12-16T00:00:26.864271+0000","last_fullsized":"2023-12-16T00:00:26.864271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400762+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:05.400762+0000","last_peered":"2023-12-16T00:00:05.400762+0000","last_clean":"2023-12-16T00:00:05.400762+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:05.400762+0000","last_undegraded":"2023-12-16T00:00:05.400762+0000","last_fullsized":"2023-12-16T00:00:05.400762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711462+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-16T00:00:27.711462+0000","last_peered":"2023-12-16T00:00:27.711462+0000","last_clean":"2023-12-16T00:00:27.711462+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:00:27.711462+0000","last_undegraded":"2023-12-16T00:00:27.711462+0000","last_fullsized":"2023-12-16T00:00:27.711462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.620507+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:05.620507+0000","last_peered":"2023-12-16T00:00:05.620507+0000","last_clean":"2023-12-16T00:00:05.620507+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:05.620507+0000","last_undegraded":"2023-12-16T00:00:05.620507+0000","last_fullsized":"2023-12-16T00:00:05.620507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400859+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:05.400859+0000","last_peered":"2023-12-16T00:00:05.400859+0000","last_clean":"2023-12-16T00:00:05.400859+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:05.400859+0000","last_undegraded":"2023-12-16T00:00:05.400859+0000","last_fullsized":"2023-12-16T00:00:05.400859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591074+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591074+0000","last_peered":"2023-12-16T00:01:51.591074+0000","last_clean":"2023-12-16T00:01:51.591074+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591074+0000","last_undegraded":"2023-12-16T00:01:51.591074+0000","last_fullsized":"2023-12-16T00:01:51.591074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288153+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-16T00:00:27.288153+0000","last_peered":"2023-12-16T00:00:27.288153+0000","last_clean":"2023-12-16T00:00:27.288153+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:00:27.288153+0000","last_undegraded":"2023-12-16T00:00:27.288153+0000","last_fullsized":"2023-12-16T00:00:27.288153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.387959+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:05.387959+0000","last_peered":"2023-12-16T00:00:05.387959+0000","last_clean":"2023-12-16T00:00:05.387959+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:05.387959+0000","last_undegraded":"2023-12-16T00:00:05.387959+0000","last_fullsized":"2023-12-16T00:00:05.387959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940181+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940181+0000","last_peered":"2023-12-16T00:00:51.940181+0000","last_clean":"2023-12-16T00:00:51.940181+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940181+0000","last_undegraded":"2023-12-16T00:00:51.940181+0000","last_fullsized":"2023-12-16T00:00:51.940181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691544+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691544+0000","last_peered":"2023-12-16T00:01:43.691544+0000","last_clean":"2023-12-16T00:01:43.691544+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691544+0000","last_undegraded":"2023-12-16T00:01:43.691544+0000","last_fullsized":"2023-12-16T00:01:43.691544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271600+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271600+0000","last_peered":"2023-12-16T00:00:41.271600+0000","last_clean":"2023-12-16T00:00:41.271600+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271600+0000","last_undegraded":"2023-12-16T00:00:41.271600+0000","last_fullsized":"2023-12-16T00:00:41.271600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":246,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925084+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925084+0000","last_peered":"2023-12-16T00:00:48.925084+0000","last_clean":"2023-12-16T00:00:48.925084+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925084+0000","last_undegraded":"2023-12-16T00:00:48.925084+0000","last_fullsized":"2023-12-16T00:00:48.925084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828204+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828204+0000","last_peered":"2023-12-16T00:00:52.828204+0000","last_clean":"2023-12-16T00:00:52.828204+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828204+0000","last_undegraded":"2023-12-16T00:00:52.828204+0000","last_fullsized":"2023-12-16T00:00:52.828204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625023+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625023+0000","last_peered":"2023-12-16T00:01:54.625023+0000","last_clean":"2023-12-16T00:01:54.625023+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625023+0000","last_undegraded":"2023-12-16T00:01:54.625023+0000","last_fullsized":"2023-12-16T00:01:54.625023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276225+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276225+0000","last_peered":"2023-12-16T00:01:02.276225+0000","last_clean":"2023-12-16T00:01:02.276225+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276225+0000","last_undegraded":"2023-12-16T00:01:02.276225+0000","last_fullsized":"2023-12-16T00:01:02.276225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":47168,"num_omap_keys":182,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3605,"ondisk_log_size":3605,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2204,"ondisk_log_size":2204,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4636,"ondisk_log_size":4636,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":423,"ondisk_log_size":423,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608397,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25600000000000001},"max":{"1min":0.57299999999999995,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.504},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.57199999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.60499999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.72199999999999998,"15min":1.004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.36299999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":1.149},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.63},"last":0.39100000000000001}]}]},{"osd":5,"up_from":11,"seq":47244641099,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.96699999999999997},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.29299999999999998},"max":{"1min":0.63700000000000001,"5min":0.69999999999999996,"15min":0.80100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.879},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.754},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.63},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.30099999999999999}]}]},{"osd":3,"up_from":11,"seq":47244641101,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55380,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802220,"statfs":{"total":107374182400,"available":107317473280,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.255},"max":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.45800000000000002,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40200000000000002,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.502},{"interface":"front","average":{"1min":0.625,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Dec 16 00:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.45500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45400000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41499999999999998}]}]},{"osd":2,"up_from":11,"seq":47244641098,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.40699999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.247},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.46700000000000003,"5min":0.87,"15min":0.87},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.188,"15min":0.188},"max":{"1min":0.44,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.31},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.50700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.32600000000000001},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.499},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.435},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":1.169,"15min":1.169},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69599999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45000000000000001}]}]},{"osd":1,"up_from":11,"seq":47244641099,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.313,"15min":0.318},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20399999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.53100000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.31}]},{"osd":2,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.29099999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.878},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82099999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.50800000000000001}]}]},{"osd":0,"up_from":11,"seq":47244641099,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.314,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.44900000000000001,"15min":0.51200000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":0.51000000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.5,"15min":0.5},"last":0.31},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42999999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65800000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.499},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.752,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.432},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.754,"15min":0.875},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66900000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:02:10.876 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.876 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.876 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.877 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.877 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.877 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.877 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.877 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.878 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.878 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.878 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.878 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.878 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.879 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.879 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.879 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.879 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.879 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.880 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.881 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.881 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.881 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.881 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.881 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.882 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.882 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.882 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.882 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.882 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.883 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.884 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.884 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.884 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.884 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.884 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.885 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.885 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.885 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.885 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.885 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.886 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.886 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.886 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.886 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.886 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.887 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-15T22:53:09.319032+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.887 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.887 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.887 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.888 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.889 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.889 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.889 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.889 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.889 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.890 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.890 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.890 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.890 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.890 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.891 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.891 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.891 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.891 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.891 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.892 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.892 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.892 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.892 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.892 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.893 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.893 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.893 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.893 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.893 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.894 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.895 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.895 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.895 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.895 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.895 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.896 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.896 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.896 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.896 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.896 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.897 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.897 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.897 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.897 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.897 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.898 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.898 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.898 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.898 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.898 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.899 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.899 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.899 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.899 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.899 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.900 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.900 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.900 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.900 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.900 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.901 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.901 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.901 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.901 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.901 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.902 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.902 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.902 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.902 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.902 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.903 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.903 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.903 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.903 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.903 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.904 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.904 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.904 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.904 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.904 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.905 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.905 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.905 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.905 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.905 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.906 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.906 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.906 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.906 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.906 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.907 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.907 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.907 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.907 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.907 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.908 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.908 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.908 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.908 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.908 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.909 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.909 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.909 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.909 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.909 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.910 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.910 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.910 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.910 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.910 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.911 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.912 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.912 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.912 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.912 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.912 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.913 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.913 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.913 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.913 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.913 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.914 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.914 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.914 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.914 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.914 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.915 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.915 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.915 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.915 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.915 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.916 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.917 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.917 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.917 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.917 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.917 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.918 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.918 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.918 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.918 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.919 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.919 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.919 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.919 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.919 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.920 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.920 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.920 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.920 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.920 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.921 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.921 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.921 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.921 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.921 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.922 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.923 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.923 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.923 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.923 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.923 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.924 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.924 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.924 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.924 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.924 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.925 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.925 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.925 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.925 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.925 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.926 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.926 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.926 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.926 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.926 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.927 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.927 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.927 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.927 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.927 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.928 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.929 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.929 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.929 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.929 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.929 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.930 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.930 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.930 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.930 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.930 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.931 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.931 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.931 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.931 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.931 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.932 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.932 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.932 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.932 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.932 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.933 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.933 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.933 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.933 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.933 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.934 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.934 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.934 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.934 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.934 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.935 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.935 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.935 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.935 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.935 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.936 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.936 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.936 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.936 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.936 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.937 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.937 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.937 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.937 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.937 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.938 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.938 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.938 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.938 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.938 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.939 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:10.939 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:02:30.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:02:31.283 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:02:31.304 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:02:31.308 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2161,"stamp":"2023-12-16T00:02:30.233708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":790242,"num_omap_keys":3496,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35770,"ondisk_log_size":35770,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":295448,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":285558,"kb_avail":628850152,"statfs":{"total":644245094400,"available":643942555648,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":292412065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":45309,"num_omap_keys":170,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005712"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288074+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-16T00:00:27.288074+0000","last_peered":"2023-12-16T00:00:27.288074+0000","last_clean":"2023-12-16T00:00:27.288074+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:00:27.288074+0000","last_undegraded":"2023-12-16T00:00:27.288074+0000","last_fullsized":"2023-12-16T00:00:27.288074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711556+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-16T00:00:27.711556+0000","last_peered":"2023-12-16T00:00:27.711556+0000","last_clean":"2023-12-16T00:00:27.711556+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:00:27.711556+0000","last_undegraded":"2023-12-16T00:00:27.711556+0000","last_fullsized":"2023-12-16T00:00:27.711556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864382+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-16T00:00:26.864382+0000","last_peered":"2023-12-16T00:00:26.864382+0000","last_clean":"2023-12-16T00:00:26.864382+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:00:26.864382+0000","last_undegraded":"2023-12-16T00:00:26.864382+0000","last_fullsized":"2023-12-16T00:00:26.864382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632624+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632624+0000","last_peered":"2023-12-16T00:02:00.632624+0000","last_clean":"2023-12-16T00:02:00.632624+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632624+0000","last_undegraded":"2023-12-16T00:02:00.632624+0000","last_fullsized":"2023-12-16T00:02:00.632624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411379+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411379+0000","last_peered":"2023-12-16T00:02:07.411379+0000","last_clean":"2023-12-16T00:02:07.411379+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411379+0000","last_undegraded":"2023-12-16T00:02:07.411379+0000","last_fullsized":"2023-12-16T00:02:07.411379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.400645+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:05.400645+0000","last_peered":"2023-12-16T00:00:05.400645+0000","last_clean":"2023-12-16T00:00:05.400645+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:05.400645+0000","last_undegraded":"2023-12-16T00:00:05.400645+0000","last_fullsized":"2023-12-16T00:00:05.400645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620281+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620281+0000","last_peered":"2023-12-16T00:02:06.620281+0000","last_clean":"2023-12-16T00:02:06.620281+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620281+0000","last_undegraded":"2023-12-16T00:02:06.620281+0000","last_fullsized":"2023-12-16T00:02:06.620281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646490+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646490+0000","last_peered":"2023-12-16T00:02:14.646490+0000","last_clean":"2023-12-16T00:02:14.646490+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646490+0000","last_undegraded":"2023-12-16T00:02:14.646490+0000","last_fullsized":"2023-12-16T00:02:14.646490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137042+0000","last_change":"2023-12-15T22:53:08.331969+0000","last_active":"2023-12-16T00:00:28.137042+0000","last_peered":"2023-12-16T00:00:28.137042+0000","last_clean":"2023-12-16T00:00:28.137042+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:00:28.137042+0000","last_undegraded":"2023-12-16T00:00:28.137042+0000","last_fullsized":"2023-12-16T00:00:28.137042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'98","reported_seq":6167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016902+0000","last_change":"2023-12-15T22:54:04.188166+0000","last_active":"2023-12-16T00:00:26.016902+0000","last_peered":"2023-12-16T00:00:26.016902+0000","last_clean":"2023-12-16T00:00:26.016902+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:00:26.016902+0000","last_undegraded":"2023-12-16T00:00:26.016902+0000","last_fullsized":"2023-12-16T00:00:26.016902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118158+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118158+0000","last_peered":"2023-12-16T00:02:20.118158+0000","last_clean":"2023-12-16T00:02:20.118158+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118158+0000","last_undegraded":"2023-12-16T00:02:20.118158+0000","last_fullsized":"2023-12-16T00:02:20.118158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752008+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752008+0000","last_peered":"2023-12-16T00:01:25.752008+0000","last_clean":"2023-12-16T00:01:25.752008+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752008+0000","last_undegraded":"2023-12-16T00:01:25.752008+0000","last_fullsized":"2023-12-16T00:01:25.752008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844560+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844560+0000","last_peered":"2023-12-16T00:01:46.844560+0000","last_clean":"2023-12-16T00:01:46.844560+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844560+0000","last_undegraded":"2023-12-16T00:01:46.844560+0000","last_fullsized":"2023-12-16T00:01:46.844560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711788+0000","last_change":"2023-12-15T22:53:08.330733+0000","last_active":"2023-12-16T00:00:27.711788+0000","last_peered":"2023-12-16T00:00:27.711788+0000","last_clean":"2023-12-16T00:00:27.711788+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:00:27.711788+0000","last_undegraded":"2023-12-16T00:00:27.711788+0000","last_fullsized":"2023-12-16T00:00:27.711788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842553+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842553+0000","last_peered":"2023-12-16T00:01:24.842553+0000","last_clean":"2023-12-16T00:01:24.842553+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842553+0000","last_undegraded":"2023-12-16T00:01:24.842553+0000","last_fullsized":"2023-12-16T00:01:24.842553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165978+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165978+0000","last_peered":"2023-12-16T00:01:55.165978+0000","last_clean":"2023-12-16T00:01:55.165978+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165978+0000","last_undegraded":"2023-12-16T00:01:55.165978+0000","last_fullsized":"2023-12-16T00:01:55.165978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359607+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359607+0000","last_peered":"2023-12-16T00:01:48.359607+0000","last_clean":"2023-12-16T00:01:48.359607+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359607+0000","last_undegraded":"2023-12-16T00:01:48.359607+0000","last_fullsized":"2023-12-16T00:01:48.359607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'86","reported_seq":985,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016955+0000","last_change":"2023-12-15T22:54:04.188175+0000","last_active":"2023-12-16T00:00:26.016955+0000","last_peered":"2023-12-16T00:00:26.016955+0000","last_clean":"2023-12-16T00:00:26.016955+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:00:26.016955+0000","last_undegraded":"2023-12-16T00:00:26.016955+0000","last_fullsized":"2023-12-16T00:00:26.016955+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678066+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678066+0000","last_peered":"2023-12-16T00:02:07.678066+0000","last_clean":"2023-12-16T00:02:07.678066+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678066+0000","last_undegraded":"2023-12-16T00:02:07.678066+0000","last_fullsized":"2023-12-16T00:02:07.678066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030702+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030702+0000","last_peered":"2023-12-16T00:02:05.030702+0000","last_clean":"2023-12-16T00:02:05.030702+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030702+0000","last_undegraded":"2023-12-16T00:02:05.030702+0000","last_fullsized":"2023-12-16T00:02:05.030702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'71","reported_seq":1571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289195+0000","last_change":"2023-12-15T22:54:04.184519+0000","last_active":"2023-12-16T00:00:27.289195+0000","last_peered":"2023-12-16T00:00:27.289195+0000","last_clean":"2023-12-16T00:00:27.289195+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:00:27.289195+0000","last_undegraded":"2023-12-16T00:00:27.289195+0000","last_fullsized":"2023-12-16T00:00:27.289195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471920+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471920+0000","last_peered":"2023-12-16T00:02:18.471920+0000","last_clean":"2023-12-16T00:02:18.471920+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471920+0000","last_undegraded":"2023-12-16T00:02:18.471920+0000","last_fullsized":"2023-12-16T00:02:18.471920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883691+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883691+0000","last_peered":"2023-12-16T00:01:42.883691+0000","last_clean":"2023-12-16T00:01:42.883691+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883691+0000","last_undegraded":"2023-12-16T00:01:42.883691+0000","last_fullsized":"2023-12-16T00:01:42.883691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288080+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:27.288080+0000","last_peered":"2023-12-16T00:00:27.288080+0000","last_clean":"2023-12-16T00:00:27.288080+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:27.288080+0000","last_undegraded":"2023-12-16T00:00:27.288080+0000","last_fullsized":"2023-12-16T00:00:27.288080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136765+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:28.136765+0000","last_peered":"2023-12-16T00:00:28.136765+0000","last_clean":"2023-12-16T00:00:28.136765+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:28.136765+0000","last_undegraded":"2023-12-16T00:00:28.136765+0000","last_fullsized":"2023-12-16T00:00:28.136765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":251,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136861+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:28.136861+0000","last_peered":"2023-12-16T00:00:28.136861+0000","last_clean":"2023-12-16T00:00:28.136861+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:28.136861+0000","last_undegraded":"2023-12-16T00:00:28.136861+0000","last_fullsized":"2023-12-16T00:00:28.136861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999329+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999329+0000","last_peered":"2023-12-16T00:01:23.999329+0000","last_clean":"2023-12-16T00:01:23.999329+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999329+0000","last_undegraded":"2023-12-16T00:01:23.999329+0000","last_fullsized":"2023-12-16T00:01:23.999329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865329+0000","last_change":"2023-12-15T23:08:37.340893+0000","last_active":"2023-12-16T00:00:26.865329+0000","last_peered":"2023-12-16T00:00:26.865329+0000","last_clean":"2023-12-16T00:00:26.865329+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:00:26.865329+0000","last_undegraded":"2023-12-16T00:00:26.865329+0000","last_fullsized":"2023-12-16T00:00:26.865329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175678+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175678+0000","last_peered":"2023-12-16T00:01:32.175678+0000","last_clean":"2023-12-16T00:01:32.175678+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175678+0000","last_undegraded":"2023-12-16T00:01:32.175678+0000","last_fullsized":"2023-12-16T00:01:32.175678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711383+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:27.711383+0000","last_peered":"2023-12-16T00:00:27.711383+0000","last_clean":"2023-12-16T00:00:27.711383+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:27.711383+0000","last_undegraded":"2023-12-16T00:00:27.711383+0000","last_fullsized":"2023-12-16T00:00:27.711383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406725+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:25.406725+0000","last_peered":"2023-12-16T00:00:25.406725+0000","last_clean":"2023-12-16T00:00:25.406725+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:25.406725+0000","last_undegraded":"2023-12-16T00:00:25.406725+0000","last_fullsized":"2023-12-16T00:00:25.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":284,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864389+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:26.864389+0000","last_peered":"2023-12-16T00:00:26.864389+0000","last_clean":"2023-12-16T00:00:26.864389+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:26.864389+0000","last_undegraded":"2023-12-16T00:00:26.864389+0000","last_fullsized":"2023-12-16T00:00:26.864389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137037+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137037+0000","last_peered":"2023-12-16T00:02:18.137037+0000","last_clean":"2023-12-16T00:02:18.137037+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137037+0000","last_undegraded":"2023-12-16T00:02:18.137037+0000","last_fullsized":"2023-12-16T00:02:18.137037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679483+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679483+0000","last_peered":"2023-12-16T00:02:08.679483+0000","last_clean":"2023-12-16T00:02:08.679483+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679483+0000","last_undegraded":"2023-12-16T00:02:08.679483+0000","last_fullsized":"2023-12-16T00:02:08.679483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115807+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115807+0000","last_peered":"2023-12-16T00:02:01.115807+0000","last_clean":"2023-12-16T00:02:01.115807+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115807+0000","last_undegraded":"2023-12-16T00:02:01.115807+0000","last_fullsized":"2023-12-16T00:02:01.115807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725058+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725058+0000","last_peered":"2023-12-16T00:00:59.725058+0000","last_clean":"2023-12-16T00:00:59.725058+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725058+0000","last_undegraded":"2023-12-16T00:00:59.725058+0000","last_fullsized":"2023-12-16T00:00:59.725058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867666+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867666+0000","last_peered":"2023-12-16T00:00:52.867666+0000","last_clean":"2023-12-16T00:00:52.867666+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867666+0000","last_undegraded":"2023-12-16T00:00:52.867666+0000","last_fullsized":"2023-12-16T00:00:52.867666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405107+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:20.405107+0000","last_peered":"2023-12-16T00:00:20.405107+0000","last_clean":"2023-12-16T00:00:20.405107+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:20.405107+0000","last_undegraded":"2023-12-16T00:00:20.405107+0000","last_fullsized":"2023-12-16T00:00:20.405107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405853+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:25.405853+0000","last_peered":"2023-12-16T00:00:25.405853+0000","last_clean":"2023-12-16T00:00:25.405853+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:25.405853+0000","last_undegraded":"2023-12-16T00:00:25.405853+0000","last_fullsized":"2023-12-16T00:00:25.405853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"49'14","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864425+0000","last_change":"2023-12-15T22:53:04.318847+0000","last_active":"2023-12-16T00:00:26.864425+0000","last_peered":"2023-12-16T00:00:26.864425+0000","last_clean":"2023-12-16T00:00:26.864425+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:00:26.864425+0000","last_undegraded":"2023-12-16T00:00:26.864425+0000","last_fullsized":"2023-12-16T00:00:26.864425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403860+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:20.403860+0000","last_peered":"2023-12-16T00:00:20.403860+0000","last_clean":"2023-12-16T00:00:20.403860+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:20.403860+0000","last_undegraded":"2023-12-16T00:00:20.403860+0000","last_fullsized":"2023-12-16T00:00:20.403860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'12","reported_seq":799,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404399+0000","last_change":"2023-12-15T22:53:08.333036+0000","last_active":"2023-12-16T00:00:20.404399+0000","last_peered":"2023-12-16T00:00:20.404399+0000","last_clean":"2023-12-16T00:00:20.404399+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:00:20.404399+0000","last_undegraded":"2023-12-16T00:00:20.404399+0000","last_fullsized":"2023-12-16T00:00:20.404399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219646+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219646+0000","last_peered":"2023-12-16T00:01:31.219646+0000","last_clean":"2023-12-16T00:01:31.219646+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219646+0000","last_undegraded":"2023-12-16T00:01:31.219646+0000","last_fullsized":"2023-12-16T00:01:31.219646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'97","reported_seq":1226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440722+0000","last_change":"2023-12-15T22:54:04.185311+0000","last_active":"2023-12-16T00:00:26.440722+0000","last_peered":"2023-12-16T00:00:26.440722+0000","last_clean":"2023-12-16T00:00:26.440722+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:00:26.440722+0000","last_undegraded":"2023-12-16T00:00:26.440722+0000","last_fullsized":"2023-12-16T00:00:26.440722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125073+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125073+0000","last_peered":"2023-12-16T00:02:00.125073+0000","last_clean":"2023-12-16T00:02:00.125073+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125073+0000","last_undegraded":"2023-12-16T00:02:00.125073+0000","last_fullsized":"2023-12-16T00:02:00.125073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2712,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.953978+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.953978+0000","last_peered":"2023-12-16T00:00:37.953978+0000","last_clean":"2023-12-16T00:00:37.953978+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.953978+0000","last_undegraded":"2023-12-16T00:00:37.953978+0000","last_fullsized":"2023-12-16T00:00:37.953978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790096+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790096+0000","last_peered":"2023-12-16T00:00:57.790096+0000","last_clean":"2023-12-16T00:00:57.790096+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790096+0000","last_undegraded":"2023-12-16T00:00:57.790096+0000","last_fullsized":"2023-12-16T00:00:57.790096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405907+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:25.405907+0000","last_peered":"2023-12-16T00:00:25.405907+0000","last_clean":"2023-12-16T00:00:25.405907+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:25.405907+0000","last_undegraded":"2023-12-16T00:00:25.405907+0000","last_fullsized":"2023-12-16T00:00:25.405907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406538+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:25.406538+0000","last_peered":"2023-12-16T00:00:25.406538+0000","last_clean":"2023-12-16T00:00:25.406538+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:25.406538+0000","last_undegraded":"2023-12-16T00:00:25.406538+0000","last_fullsized":"2023-12-16T00:00:25.406538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864407+0000","last_change":"2023-12-15T22:53:04.317272+0000","last_active":"2023-12-16T00:00:26.864407+0000","last_peered":"2023-12-16T00:00:26.864407+0000","last_clean":"2023-12-16T00:00:26.864407+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:00:26.864407+0000","last_undegraded":"2023-12-16T00:00:26.864407+0000","last_fullsized":"2023-12-16T00:00:26.864407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404354+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:20.404354+0000","last_peered":"2023-12-16T00:00:20.404354+0000","last_clean":"2023-12-16T00:00:20.404354+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:20.404354+0000","last_undegraded":"2023-12-16T00:00:20.404354+0000","last_fullsized":"2023-12-16T00:00:20.404354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608975+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608975+0000","last_peered":"2023-12-16T00:02:21.608975+0000","last_clean":"2023-12-16T00:02:21.608975+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608975+0000","last_undegraded":"2023-12-16T00:02:21.608975+0000","last_fullsized":"2023-12-16T00:02:21.608975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750337+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750337+0000","last_peered":"2023-12-16T00:00:48.750337+0000","last_clean":"2023-12-16T00:00:48.750337+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750337+0000","last_undegraded":"2023-12-16T00:00:48.750337+0000","last_fullsized":"2023-12-16T00:00:48.750337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745075+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745075+0000","last_peered":"2023-12-16T00:01:28.745075+0000","last_clean":"2023-12-16T00:01:28.745075+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745075+0000","last_undegraded":"2023-12-16T00:01:28.745075+0000","last_fullsized":"2023-12-16T00:01:28.745075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'16","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137697+0000","last_change":"2023-12-15T22:53:32.194497+0000","last_active":"2023-12-16T00:00:28.137697+0000","last_peered":"2023-12-16T00:00:28.137697+0000","last_clean":"2023-12-16T00:00:28.137697+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:00:28.137697+0000","last_undegraded":"2023-12-16T00:00:28.137697+0000","last_fullsized":"2023-12-16T00:00:28.137697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394558+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:26.394558+0000","last_peered":"2023-12-16T00:00:26.394558+0000","last_clean":"2023-12-16T00:00:26.394558+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:26.394558+0000","last_undegraded":"2023-12-16T00:00:26.394558+0000","last_fullsized":"2023-12-16T00:00:26.394558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625758+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:25.625758+0000","last_peered":"2023-12-16T00:00:25.625758+0000","last_clean":"2023-12-16T00:00:25.625758+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:25.625758+0000","last_undegraded":"2023-12-16T00:00:25.625758+0000","last_fullsized":"2023-12-16T00:00:25.625758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016185+0000","last_change":"2023-12-15T22:53:08.334614+0000","last_active":"2023-12-16T00:00:26.016185+0000","last_peered":"2023-12-16T00:00:26.016185+0000","last_clean":"2023-12-16T00:00:26.016185+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:00:26.016185+0000","last_undegraded":"2023-12-16T00:00:26.016185+0000","last_fullsized":"2023-12-16T00:00:26.016185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158887+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158887+0000","last_peered":"2023-12-16T00:02:05.158887+0000","last_clean":"2023-12-16T00:02:05.158887+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158887+0000","last_undegraded":"2023-12-16T00:02:05.158887+0000","last_fullsized":"2023-12-16T00:02:05.158887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476783+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476783+0000","last_peered":"2023-12-16T00:02:05.476783+0000","last_clean":"2023-12-16T00:02:05.476783+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476783+0000","last_undegraded":"2023-12-16T00:02:05.476783+0000","last_fullsized":"2023-12-16T00:02:05.476783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405894+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:25.405894+0000","last_peered":"2023-12-16T00:00:25.405894+0000","last_clean":"2023-12-16T00:00:25.405894+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:25.405894+0000","last_undegraded":"2023-12-16T00:00:25.405894+0000","last_fullsized":"2023-12-16T00:00:25.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404156+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:20.404156+0000","last_peered":"2023-12-16T00:00:20.404156+0000","last_clean":"2023-12-16T00:00:20.404156+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:20.404156+0000","last_undegraded":"2023-12-16T00:00:20.404156+0000","last_fullsized":"2023-12-16T00:00:20.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"49'14","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440023+0000","last_change":"2023-12-15T22:53:04.317748+0000","last_active":"2023-12-16T00:00:26.440023+0000","last_peered":"2023-12-16T00:00:26.440023+0000","last_clean":"2023-12-16T00:00:26.440023+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:00:26.440023+0000","last_undegraded":"2023-12-16T00:00:26.440023+0000","last_fullsized":"2023-12-16T00:00:26.440023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'90","reported_seq":208,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864514+0000","last_change":"2023-12-15T22:53:06.320707+0000","last_active":"2023-12-16T00:00:26.864514+0000","last_peered":"2023-12-16T00:00:26.864514+0000","last_clean":"2023-12-16T00:00:26.864514+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:00:26.864514+0000","last_undegraded":"2023-12-16T00:00:26.864514+0000","last_fullsized":"2023-12-16T00:00:26.864514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674592+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674592+0000","last_peered":"2023-12-16T00:02:10.674592+0000","last_clean":"2023-12-16T00:02:10.674592+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674592+0000","last_undegraded":"2023-12-16T00:02:10.674592+0000","last_fullsized":"2023-12-16T00:02:10.674592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":53,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289163+0000","last_change":"2023-12-15T22:53:58.172757+0000","last_active":"2023-12-16T00:00:27.289163+0000","last_peered":"2023-12-16T00:00:27.289163+0000","last_clean":"2023-12-16T00:00:27.289163+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:00:27.289163+0000","last_undegraded":"2023-12-16T00:00:27.289163+0000","last_fullsized":"2023-12-16T00:00:27.289163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033890+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033890+0000","last_peered":"2023-12-16T00:01:34.033890+0000","last_clean":"2023-12-16T00:01:34.033890+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033890+0000","last_undegraded":"2023-12-16T00:01:34.033890+0000","last_fullsized":"2023-12-16T00:01:34.033890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394771+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:26.394771+0000","last_peered":"2023-12-16T00:00:26.394771+0000","last_clean":"2023-12-16T00:00:26.394771+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:26.394771+0000","last_undegraded":"2023-12-16T00:00:26.394771+0000","last_fullsized":"2023-12-16T00:00:26.394771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711244+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:27.711244+0000","last_peered":"2023-12-16T00:00:27.711244+0000","last_clean":"2023-12-16T00:00:27.711244+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:27.711244+0000","last_undegraded":"2023-12-16T00:00:27.711244+0000","last_fullsized":"2023-12-16T00:00:27.711244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159310+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159310+0000","last_peered":"2023-12-16T00:02:24.159310+0000","last_clean":"2023-12-16T00:02:24.159310+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159310+0000","last_undegraded":"2023-12-16T00:02:24.159310+0000","last_fullsized":"2023-12-16T00:02:24.159310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560230+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560230+0000","last_peered":"2023-12-16T00:02:16.560230+0000","last_clean":"2023-12-16T00:02:16.560230+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560230+0000","last_undegraded":"2023-12-16T00:02:16.560230+0000","last_fullsized":"2023-12-16T00:02:16.560230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1804,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043084+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043084+0000","last_peered":"2023-12-16T00:02:18.043084+0000","last_clean":"2023-12-16T00:02:18.043084+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043084+0000","last_undegraded":"2023-12-16T00:02:18.043084+0000","last_fullsized":"2023-12-16T00:02:18.043084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439849+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439849+0000","last_peered":"2023-12-16T00:02:00.439849+0000","last_clean":"2023-12-16T00:02:00.439849+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439849+0000","last_undegraded":"2023-12-16T00:02:00.439849+0000","last_fullsized":"2023-12-16T00:02:00.439849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984524+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984524+0000","last_peered":"2023-12-16T00:01:24.984524+0000","last_clean":"2023-12-16T00:01:24.984524+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984524+0000","last_undegraded":"2023-12-16T00:01:24.984524+0000","last_fullsized":"2023-12-16T00:01:24.984524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416130+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416130+0000","last_peered":"2023-12-16T00:01:53.416130+0000","last_clean":"2023-12-16T00:01:53.416130+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416130+0000","last_undegraded":"2023-12-16T00:01:53.416130+0000","last_fullsized":"2023-12-16T00:01:53.416130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392721+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:25.392721+0000","last_peered":"2023-12-16T00:00:25.392721+0000","last_clean":"2023-12-16T00:00:25.392721+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:25.392721+0000","last_undegraded":"2023-12-16T00:00:25.392721+0000","last_fullsized":"2023-12-16T00:00:25.392721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707263+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707263+0000","last_peered":"2023-12-16T00:02:10.707263+0000","last_clean":"2023-12-16T00:02:10.707263+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707263+0000","last_undegraded":"2023-12-16T00:02:10.707263+0000","last_fullsized":"2023-12-16T00:02:10.707263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682626+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682626+0000","last_peered":"2023-12-16T00:01:33.682626+0000","last_clean":"2023-12-16T00:01:33.682626+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682626+0000","last_undegraded":"2023-12-16T00:01:33.682626+0000","last_fullsized":"2023-12-16T00:01:33.682626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975152+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975152+0000","last_peered":"2023-12-16T00:01:38.975152+0000","last_clean":"2023-12-16T00:01:38.975152+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975152+0000","last_undegraded":"2023-12-16T00:01:38.975152+0000","last_fullsized":"2023-12-16T00:01:38.975152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574125+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574125+0000","last_peered":"2023-12-16T00:01:55.574125+0000","last_clean":"2023-12-16T00:01:55.574125+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574125+0000","last_undegraded":"2023-12-16T00:01:55.574125+0000","last_fullsized":"2023-12-16T00:01:55.574125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288113+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288113+0000","last_peered":"2023-12-16T00:00:27.288113+0000","last_clean":"2023-12-16T00:00:27.288113+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:00:27.288113+0000","last_undegraded":"2023-12-16T00:00:27.288113+0000","last_fullsized":"2023-12-16T00:00:27.288113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711551+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-16T00:00:27.711551+0000","last_peered":"2023-12-16T00:00:27.711551+0000","last_clean":"2023-12-16T00:00:27.711551+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:00:27.711551+0000","last_undegraded":"2023-12-16T00:00:27.711551+0000","last_fullsized":"2023-12-16T00:00:27.711551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.405663+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:20.405663+0000","last_peered":"2023-12-16T00:00:20.405663+0000","last_clean":"2023-12-16T00:00:20.405663+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:20.405663+0000","last_undegraded":"2023-12-16T00:00:20.405663+0000","last_fullsized":"2023-12-16T00:00:20.405663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404857+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:20.404857+0000","last_peered":"2023-12-16T00:00:20.404857+0000","last_clean":"2023-12-16T00:00:20.404857+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:20.404857+0000","last_undegraded":"2023-12-16T00:00:20.404857+0000","last_fullsized":"2023-12-16T00:00:20.404857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730461+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730461+0000","last_peered":"2023-12-16T00:01:36.730461+0000","last_clean":"2023-12-16T00:01:36.730461+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730461+0000","last_undegraded":"2023-12-16T00:01:36.730461+0000","last_fullsized":"2023-12-16T00:01:36.730461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1586,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520628+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520628+0000","last_peered":"2023-12-16T00:02:25.520628+0000","last_clean":"2023-12-16T00:02:25.520628+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520628+0000","last_undegraded":"2023-12-16T00:02:25.520628+0000","last_fullsized":"2023-12-16T00:02:25.520628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189597+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189597+0000","last_peered":"2023-12-16T00:02:22.189597+0000","last_clean":"2023-12-16T00:02:22.189597+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189597+0000","last_undegraded":"2023-12-16T00:02:22.189597+0000","last_fullsized":"2023-12-16T00:02:22.189597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693630+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693630+0000","last_peered":"2023-12-16T00:01:41.693630+0000","last_clean":"2023-12-16T00:01:41.693630+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693630+0000","last_undegraded":"2023-12-16T00:01:41.693630+0000","last_fullsized":"2023-12-16T00:01:41.693630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313044+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313044+0000","last_peered":"2023-12-16T00:00:43.313044+0000","last_clean":"2023-12-16T00:00:43.313044+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313044+0000","last_undegraded":"2023-12-16T00:00:43.313044+0000","last_fullsized":"2023-12-16T00:00:43.313044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439858+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-16T00:00:26.439858+0000","last_peered":"2023-12-16T00:00:26.439858+0000","last_clean":"2023-12-16T00:00:26.439858+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:00:26.439858+0000","last_undegraded":"2023-12-16T00:00:26.439858+0000","last_fullsized":"2023-12-16T00:00:26.439858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015932+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:26.015932+0000","last_peered":"2023-12-16T00:00:26.015932+0000","last_clean":"2023-12-16T00:00:26.015932+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:26.015932+0000","last_undegraded":"2023-12-16T00:00:26.015932+0000","last_fullsized":"2023-12-16T00:00:26.015932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":209,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139383+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139383+0000","last_peered":"2023-12-16T00:02:16.139383+0000","last_clean":"2023-12-16T00:02:16.139383+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139383+0000","last_undegraded":"2023-12-16T00:02:16.139383+0000","last_fullsized":"2023-12-16T00:02:16.139383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148499+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148499+0000","last_peered":"2023-12-16T00:01:42.148499+0000","last_clean":"2023-12-16T00:01:42.148499+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148499+0000","last_undegraded":"2023-12-16T00:01:42.148499+0000","last_fullsized":"2023-12-16T00:01:42.148499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927412+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927412+0000","last_peered":"2023-12-16T00:01:48.927412+0000","last_clean":"2023-12-16T00:01:48.927412+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927412+0000","last_undegraded":"2023-12-16T00:01:48.927412+0000","last_fullsized":"2023-12-16T00:01:48.927412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406587+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:25.406587+0000","last_peered":"2023-12-16T00:00:25.406587+0000","last_clean":"2023-12-16T00:00:25.406587+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:25.406587+0000","last_undegraded":"2023-12-16T00:00:25.406587+0000","last_fullsized":"2023-12-16T00:00:25.406587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137671+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-16T00:00:28.137671+0000","last_peered":"2023-12-16T00:00:28.137671+0000","last_clean":"2023-12-16T00:00:28.137671+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:00:28.137671+0000","last_undegraded":"2023-12-16T00:00:28.137671+0000","last_fullsized":"2023-12-16T00:00:28.137671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478525+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478525+0000","last_peered":"2023-12-16T00:02:02.478525+0000","last_clean":"2023-12-16T00:02:02.478525+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478525+0000","last_undegraded":"2023-12-16T00:02:02.478525+0000","last_fullsized":"2023-12-16T00:02:02.478525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790128+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790128+0000","last_peered":"2023-12-16T00:01:16.790128+0000","last_clean":"2023-12-16T00:01:16.790128+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790128+0000","last_undegraded":"2023-12-16T00:01:16.790128+0000","last_fullsized":"2023-12-16T00:01:16.790128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1419,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174535+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174535+0000","last_peered":"2023-12-16T00:01:31.174535+0000","last_clean":"2023-12-16T00:01:31.174535+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174535+0000","last_undegraded":"2023-12-16T00:01:31.174535+0000","last_fullsized":"2023-12-16T00:01:31.174535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007421+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007421+0000","last_peered":"2023-12-16T00:01:15.007421+0000","last_clean":"2023-12-16T00:01:15.007421+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007421+0000","last_undegraded":"2023-12-16T00:01:15.007421+0000","last_fullsized":"2023-12-16T00:01:15.007421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439851+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:26.439851+0000","last_peered":"2023-12-16T00:00:26.439851+0000","last_clean":"2023-12-16T00:00:26.439851+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:26.439851+0000","last_undegraded":"2023-12-16T00:00:26.439851+0000","last_fullsized":"2023-12-16T00:00:26.439851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"49'13","reported_seq":318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864379+0000","last_change":"2023-12-15T22:53:04.315043+0000","last_active":"2023-12-16T00:00:26.864379+0000","last_peered":"2023-12-16T00:00:26.864379+0000","last_clean":"2023-12-16T00:00:26.864379+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:00:26.864379+0000","last_undegraded":"2023-12-16T00:00:26.864379+0000","last_fullsized":"2023-12-16T00:00:26.864379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136830+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:28.136830+0000","last_peered":"2023-12-16T00:00:28.136830+0000","last_clean":"2023-12-16T00:00:28.136830+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:28.136830+0000","last_undegraded":"2023-12-16T00:00:28.136830+0000","last_fullsized":"2023-12-16T00:00:28.136830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243276+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243276+0000","last_peered":"2023-12-16T00:01:47.243276+0000","last_clean":"2023-12-16T00:01:47.243276+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243276+0000","last_undegraded":"2023-12-16T00:01:47.243276+0000","last_fullsized":"2023-12-16T00:01:47.243276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394692+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:26.394692+0000","last_peered":"2023-12-16T00:00:26.394692+0000","last_clean":"2023-12-16T00:00:26.394692+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:26.394692+0000","last_undegraded":"2023-12-16T00:00:26.394692+0000","last_fullsized":"2023-12-16T00:00:26.394692+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137686+0000","last_change":"2023-12-15T22:53:58.172848+0000","last_active":"2023-12-16T00:00:28.137686+0000","last_peered":"2023-12-16T00:00:28.137686+0000","last_clean":"2023-12-16T00:00:28.137686+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:00:28.137686+0000","last_undegraded":"2023-12-16T00:00:28.137686+0000","last_fullsized":"2023-12-16T00:00:28.137686+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012653+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012653+0000","last_peered":"2023-12-16T00:02:14.012653+0000","last_clean":"2023-12-16T00:02:14.012653+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012653+0000","last_undegraded":"2023-12-16T00:02:14.012653+0000","last_fullsized":"2023-12-16T00:02:14.012653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1474,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861451+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861451+0000","last_peered":"2023-12-16T00:01:34.861451+0000","last_clean":"2023-12-16T00:01:34.861451+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861451+0000","last_undegraded":"2023-12-16T00:01:34.861451+0000","last_fullsized":"2023-12-16T00:01:34.861451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185657+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185657+0000","last_peered":"2023-12-16T00:01:12.185657+0000","last_clean":"2023-12-16T00:01:12.185657+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185657+0000","last_undegraded":"2023-12-16T00:01:12.185657+0000","last_fullsized":"2023-12-16T00:01:12.185657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015799+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:26.015799+0000","last_peered":"2023-12-16T00:00:26.015799+0000","last_clean":"2023-12-16T00:00:26.015799+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:26.015799+0000","last_undegraded":"2023-12-16T00:00:26.015799+0000","last_fullsized":"2023-12-16T00:00:26.015799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":293,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136755+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:28.136755+0000","last_peered":"2023-12-16T00:00:28.136755+0000","last_clean":"2023-12-16T00:00:28.136755+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:28.136755+0000","last_undegraded":"2023-12-16T00:00:28.136755+0000","last_fullsized":"2023-12-16T00:00:28.136755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":990,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196219+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196219+0000","last_peered":"2023-12-16T00:02:25.196219+0000","last_clean":"2023-12-16T00:02:25.196219+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196219+0000","last_undegraded":"2023-12-16T00:02:25.196219+0000","last_fullsized":"2023-12-16T00:02:25.196219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897125+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897125+0000","last_peered":"2023-12-16T00:01:15.897125+0000","last_clean":"2023-12-16T00:01:15.897125+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897125+0000","last_undegraded":"2023-12-16T00:01:15.897125+0000","last_fullsized":"2023-12-16T00:01:15.897125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1257,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016835+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-16T00:00:26.016835+0000","last_peered":"2023-12-16T00:00:26.016835+0000","last_clean":"2023-12-16T00:00:26.016835+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:00:26.016835+0000","last_undegraded":"2023-12-16T00:00:26.016835+0000","last_fullsized":"2023-12-16T00:00:26.016835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947140+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947140+0000","last_peered":"2023-12-16T00:01:30.947140+0000","last_clean":"2023-12-16T00:01:30.947140+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947140+0000","last_undegraded":"2023-12-16T00:01:30.947140+0000","last_fullsized":"2023-12-16T00:01:30.947140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874738+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874738+0000","last_peered":"2023-12-16T00:01:08.874738+0000","last_clean":"2023-12-16T00:01:08.874738+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874738+0000","last_undegraded":"2023-12-16T00:01:08.874738+0000","last_fullsized":"2023-12-16T00:01:08.874738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644838+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644838+0000","last_peered":"2023-12-16T00:01:58.644838+0000","last_clean":"2023-12-16T00:01:58.644838+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644838+0000","last_undegraded":"2023-12-16T00:01:58.644838+0000","last_fullsized":"2023-12-16T00:01:58.644838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711361+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-16T00:00:27.711361+0000","last_peered":"2023-12-16T00:00:27.711361+0000","last_clean":"2023-12-16T00:00:27.711361+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:00:27.711361+0000","last_undegraded":"2023-12-16T00:00:27.711361+0000","last_fullsized":"2023-12-16T00:00:27.711361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864376+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-16T00:00:26.864376+0000","last_peered":"2023-12-16T00:00:26.864376+0000","last_clean":"2023-12-16T00:00:26.864376+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:00:26.864376+0000","last_undegraded":"2023-12-16T00:00:26.864376+0000","last_fullsized":"2023-12-16T00:00:26.864376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711655+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-16T00:00:27.711655+0000","last_peered":"2023-12-16T00:00:27.711655+0000","last_clean":"2023-12-16T00:00:27.711655+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:00:27.711655+0000","last_undegraded":"2023-12-16T00:00:27.711655+0000","last_fullsized":"2023-12-16T00:00:27.711655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662975+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662975+0000","last_peered":"2023-12-16T00:02:16.662975+0000","last_clean":"2023-12-16T00:02:16.662975+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662975+0000","last_undegraded":"2023-12-16T00:02:16.662975+0000","last_fullsized":"2023-12-16T00:02:16.662975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722628+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722628+0000","last_peered":"2023-12-16T00:01:26.722628+0000","last_clean":"2023-12-16T00:01:26.722628+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722628+0000","last_undegraded":"2023-12-16T00:01:26.722628+0000","last_fullsized":"2023-12-16T00:01:26.722628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392508+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:25.392508+0000","last_peered":"2023-12-16T00:00:25.392508+0000","last_clean":"2023-12-16T00:00:25.392508+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:25.392508+0000","last_undegraded":"2023-12-16T00:00:25.392508+0000","last_fullsized":"2023-12-16T00:00:25.392508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5896,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289225+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-16T00:00:27.289225+0000","last_peered":"2023-12-16T00:00:27.289225+0000","last_clean":"2023-12-16T00:00:27.289225+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:00:27.289225+0000","last_undegraded":"2023-12-16T00:00:27.289225+0000","last_fullsized":"2023-12-16T00:00:27.289225+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326922+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326922+0000","last_peered":"2023-12-16T00:02:24.326922+0000","last_clean":"2023-12-16T00:02:24.326922+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326922+0000","last_undegraded":"2023-12-16T00:02:24.326922+0000","last_fullsized":"2023-12-16T00:02:24.326922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840119+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840119+0000","last_peered":"2023-12-16T00:01:10.840119+0000","last_clean":"2023-12-16T00:01:10.840119+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840119+0000","last_undegraded":"2023-12-16T00:01:10.840119+0000","last_fullsized":"2023-12-16T00:01:10.840119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228196+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228196+0000","last_peered":"2023-12-16T00:01:37.228196+0000","last_clean":"2023-12-16T00:01:37.228196+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228196+0000","last_undegraded":"2023-12-16T00:01:37.228196+0000","last_fullsized":"2023-12-16T00:01:37.228196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288256+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-16T00:00:27.288256+0000","last_peered":"2023-12-16T00:00:27.288256+0000","last_clean":"2023-12-16T00:00:27.288256+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:00:27.288256+0000","last_undegraded":"2023-12-16T00:00:27.288256+0000","last_fullsized":"2023-12-16T00:00:27.288256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'70","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288332+0000","last_change":"2023-12-15T22:53:06.325127+0000","last_active":"2023-12-16T00:00:27.288332+0000","last_peered":"2023-12-16T00:00:27.288332+0000","last_clean":"2023-12-16T00:00:27.288332+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:00:27.288332+0000","last_undegraded":"2023-12-16T00:00:27.288332+0000","last_fullsized":"2023-12-16T00:00:27.288332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016112+0000","last_change":"2023-12-15T22:53:08.333466+0000","last_active":"2023-12-16T00:00:26.016112+0000","last_peered":"2023-12-16T00:00:26.016112+0000","last_clean":"2023-12-16T00:00:26.016112+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:00:26.016112+0000","last_undegraded":"2023-12-16T00:00:26.016112+0000","last_fullsized":"2023-12-16T00:00:26.016112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199772+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199772+0000","last_peered":"2023-12-16T00:01:34.199772+0000","last_clean":"2023-12-16T00:01:34.199772+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199772+0000","last_undegraded":"2023-12-16T00:01:34.199772+0000","last_fullsized":"2023-12-16T00:01:34.199772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629203+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629203+0000","last_peered":"2023-12-16T00:01:50.629203+0000","last_clean":"2023-12-16T00:01:50.629203+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629203+0000","last_undegraded":"2023-12-16T00:01:50.629203+0000","last_fullsized":"2023-12-16T00:01:50.629203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'1","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016649+0000","last_change":"2023-12-15T22:53:32.192343+0000","last_active":"2023-12-16T00:00:26.016649+0000","last_peered":"2023-12-16T00:00:26.016649+0000","last_clean":"2023-12-16T00:00:26.016649+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:00:26.016649+0000","last_undegraded":"2023-12-16T00:00:26.016649+0000","last_fullsized":"2023-12-16T00:00:26.016649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921170+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921170+0000","last_peered":"2023-12-16T00:01:43.921170+0000","last_clean":"2023-12-16T00:01:43.921170+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921170+0000","last_undegraded":"2023-12-16T00:01:43.921170+0000","last_fullsized":"2023-12-16T00:01:43.921170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136732+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-16T00:00:28.136732+0000","last_peered":"2023-12-16T00:00:28.136732+0000","last_clean":"2023-12-16T00:00:28.136732+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:00:28.136732+0000","last_undegraded":"2023-12-16T00:00:28.136732+0000","last_fullsized":"2023-12-16T00:00:28.136732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'98","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440118+0000","last_change":"2023-12-15T22:53:06.321636+0000","last_active":"2023-12-16T00:00:26.440118+0000","last_peered":"2023-12-16T00:00:26.440118+0000","last_clean":"2023-12-16T00:00:26.440118+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:00:26.440118+0000","last_undegraded":"2023-12-16T00:00:26.440118+0000","last_fullsized":"2023-12-16T00:00:26.440118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":802,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136932+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-16T00:00:28.136932+0000","last_peered":"2023-12-16T00:00:28.136932+0000","last_clean":"2023-12-16T00:00:28.136932+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:00:28.136932+0000","last_undegraded":"2023-12-16T00:00:28.136932+0000","last_fullsized":"2023-12-16T00:00:28.136932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307393+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307393+0000","last_peered":"2023-12-16T00:01:26.307393+0000","last_clean":"2023-12-16T00:01:26.307393+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307393+0000","last_undegraded":"2023-12-16T00:01:26.307393+0000","last_fullsized":"2023-12-16T00:01:26.307393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016825+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-16T00:00:26.016825+0000","last_peered":"2023-12-16T00:00:26.016825+0000","last_clean":"2023-12-16T00:00:26.016825+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:00:26.016825+0000","last_undegraded":"2023-12-16T00:00:26.016825+0000","last_fullsized":"2023-12-16T00:00:26.016825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396521+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396521+0000","last_peered":"2023-12-16T00:01:59.396521+0000","last_clean":"2023-12-16T00:01:59.396521+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396521+0000","last_undegraded":"2023-12-16T00:01:59.396521+0000","last_fullsized":"2023-12-16T00:01:59.396521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950181+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950181+0000","last_peered":"2023-12-16T00:01:28.950181+0000","last_clean":"2023-12-16T00:01:28.950181+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950181+0000","last_undegraded":"2023-12-16T00:01:28.950181+0000","last_fullsized":"2023-12-16T00:01:28.950181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016027+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-16T00:00:26.016027+0000","last_peered":"2023-12-16T00:00:26.016027+0000","last_clean":"2023-12-16T00:00:26.016027+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:00:26.016027+0000","last_undegraded":"2023-12-16T00:00:26.016027+0000","last_fullsized":"2023-12-16T00:00:26.016027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711705+0000","last_change":"2023-12-15T22:53:08.330677+0000","last_active":"2023-12-16T00:00:27.711705+0000","last_peered":"2023-12-16T00:00:27.711705+0000","last_clean":"2023-12-16T00:00:27.711705+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:00:27.711705+0000","last_undegraded":"2023-12-16T00:00:27.711705+0000","last_fullsized":"2023-12-16T00:00:27.711705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255222+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255222+0000","last_peered":"2023-12-16T00:01:28.255222+0000","last_clean":"2023-12-16T00:01:28.255222+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255222+0000","last_undegraded":"2023-12-16T00:01:28.255222+0000","last_fullsized":"2023-12-16T00:01:28.255222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112882+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112882+0000","last_peered":"2023-12-16T00:02:08.112882+0000","last_clean":"2023-12-16T00:02:08.112882+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112882+0000","last_undegraded":"2023-12-16T00:02:08.112882+0000","last_fullsized":"2023-12-16T00:02:08.112882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676120+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676120+0000","last_peered":"2023-12-16T00:01:30.676120+0000","last_clean":"2023-12-16T00:01:30.676120+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676120+0000","last_undegraded":"2023-12-16T00:01:30.676120+0000","last_fullsized":"2023-12-16T00:01:30.676120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106608+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106608+0000","last_peered":"2023-12-16T00:02:12.106608+0000","last_clean":"2023-12-16T00:02:12.106608+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106608+0000","last_undegraded":"2023-12-16T00:02:12.106608+0000","last_fullsized":"2023-12-16T00:02:12.106608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'139","reported_seq":6461,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440808+0000","last_change":"2023-12-15T22:54:04.193607+0000","last_active":"2023-12-16T00:00:26.440808+0000","last_peered":"2023-12-16T00:00:26.440808+0000","last_clean":"2023-12-16T00:00:26.440808+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:00:26.440808+0000","last_undegraded":"2023-12-16T00:00:26.440808+0000","last_fullsized":"2023-12-16T00:00:26.440808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749627+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749627+0000","last_peered":"2023-12-16T00:01:43.749627+0000","last_clean":"2023-12-16T00:01:43.749627+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749627+0000","last_undegraded":"2023-12-16T00:01:43.749627+0000","last_fullsized":"2023-12-16T00:01:43.749627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357239+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357239+0000","last_peered":"2023-12-16T00:01:50.357239+0000","last_clean":"2023-12-16T00:01:50.357239+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357239+0000","last_undegraded":"2023-12-16T00:01:50.357239+0000","last_fullsized":"2023-12-16T00:01:50.357239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"49'2","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711961+0000","last_change":"2023-12-15T22:55:02.192833+0000","last_active":"2023-12-16T00:00:27.711961+0000","last_peered":"2023-12-16T00:00:27.711961+0000","last_clean":"2023-12-16T00:00:27.711961+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:00:27.711961+0000","last_undegraded":"2023-12-16T00:00:27.711961+0000","last_fullsized":"2023-12-16T00:00:27.711961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318398+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288444+0000","last_change":"2023-12-15T22:53:08.335040+0000","last_active":"2023-12-16T00:00:27.288444+0000","last_peered":"2023-12-16T00:00:27.288444+0000","last_clean":"2023-12-16T00:00:27.288444+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:00:27.288444+0000","last_undegraded":"2023-12-16T00:00:27.288444+0000","last_fullsized":"2023-12-16T00:00:27.288444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168046+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168046+0000","last_peered":"2023-12-16T00:02:06.168046+0000","last_clean":"2023-12-16T00:02:06.168046+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168046+0000","last_undegraded":"2023-12-16T00:02:06.168046+0000","last_fullsized":"2023-12-16T00:02:06.168046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169539+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169539+0000","last_peered":"2023-12-16T00:02:23.169539+0000","last_clean":"2023-12-16T00:02:23.169539+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169539+0000","last_undegraded":"2023-12-16T00:02:23.169539+0000","last_fullsized":"2023-12-16T00:02:23.169539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283922+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283922+0000","last_peered":"2023-12-16T00:01:51.283922+0000","last_clean":"2023-12-16T00:01:51.283922+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283922+0000","last_undegraded":"2023-12-16T00:01:51.283922+0000","last_fullsized":"2023-12-16T00:01:51.283922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891956+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891956+0000","last_peered":"2023-12-16T00:01:51.891956+0000","last_clean":"2023-12-16T00:01:51.891956+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891956+0000","last_undegraded":"2023-12-16T00:01:51.891956+0000","last_fullsized":"2023-12-16T00:01:51.891956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1075,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:05.401070+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:05.401070+0000","last_peered":"2023-12-16T00:00:05.401070+0000","last_clean":"2023-12-16T00:00:05.401070+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:05.401070+0000","last_undegraded":"2023-12-16T00:00:05.401070+0000","last_fullsized":"2023-12-16T00:00:05.401070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850184+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850184+0000","last_peered":"2023-12-16T00:01:41.850184+0000","last_clean":"2023-12-16T00:01:41.850184+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850184+0000","last_undegraded":"2023-12-16T00:01:41.850184+0000","last_fullsized":"2023-12-16T00:01:41.850184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016191+0000","last_change":"2023-12-15T22:53:08.332459+0000","last_active":"2023-12-16T00:00:26.016191+0000","last_peered":"2023-12-16T00:00:26.016191+0000","last_clean":"2023-12-16T00:00:26.016191+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:00:26.016191+0000","last_undegraded":"2023-12-16T00:00:26.016191+0000","last_fullsized":"2023-12-16T00:00:26.016191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:10.401893+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:10.401893+0000","last_peered":"2023-12-16T00:00:10.401893+0000","last_clean":"2023-12-16T00:00:10.401893+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:10.401893+0000","last_undegraded":"2023-12-16T00:00:10.401893+0000","last_fullsized":"2023-12-16T00:00:10.401893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289222+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-16T00:00:27.289222+0000","last_peered":"2023-12-16T00:00:27.289222+0000","last_clean":"2023-12-16T00:00:27.289222+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:00:27.289222+0000","last_undegraded":"2023-12-16T00:00:27.289222+0000","last_fullsized":"2023-12-16T00:00:27.289222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207124+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207124+0000","last_peered":"2023-12-16T00:01:36.207124+0000","last_clean":"2023-12-16T00:01:36.207124+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207124+0000","last_undegraded":"2023-12-16T00:01:36.207124+0000","last_fullsized":"2023-12-16T00:01:36.207124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'54","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440140+0000","last_change":"2023-12-15T22:53:06.321608+0000","last_active":"2023-12-16T00:00:26.440140+0000","last_peered":"2023-12-16T00:00:26.440140+0000","last_clean":"2023-12-16T00:00:26.440140+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:00:26.440140+0000","last_undegraded":"2023-12-16T00:00:26.440140+0000","last_fullsized":"2023-12-16T00:00:26.440140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522822+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522822+0000","last_peered":"2023-12-16T00:02:20.522822+0000","last_clean":"2023-12-16T00:02:20.522822+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522822+0000","last_undegraded":"2023-12-16T00:02:20.522822+0000","last_fullsized":"2023-12-16T00:02:20.522822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137790+0000","last_change":"2023-12-15T22:53:58.171006+0000","last_active":"2023-12-16T00:00:28.137790+0000","last_peered":"2023-12-16T00:00:28.137790+0000","last_clean":"2023-12-16T00:00:28.137790+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:00:28.137790+0000","last_undegraded":"2023-12-16T00:00:28.137790+0000","last_fullsized":"2023-12-16T00:00:28.137790+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360890+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360890+0000","last_peered":"2023-12-16T00:02:21.360890+0000","last_clean":"2023-12-16T00:02:21.360890+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360890+0000","last_undegraded":"2023-12-16T00:02:21.360890+0000","last_fullsized":"2023-12-16T00:02:21.360890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902867+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902867+0000","last_peered":"2023-12-16T00:01:31.902867+0000","last_clean":"2023-12-16T00:01:31.902867+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902867+0000","last_undegraded":"2023-12-16T00:01:31.902867+0000","last_fullsized":"2023-12-16T00:01:31.902867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":554,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288294+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-16T00:00:27.288294+0000","last_peered":"2023-12-16T00:00:27.288294+0000","last_clean":"2023-12-16T00:00:27.288294+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:00:27.288294+0000","last_undegraded":"2023-12-16T00:00:27.288294+0000","last_fullsized":"2023-12-16T00:00:27.288294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'90","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288393+0000","last_change":"2023-12-15T22:53:06.321501+0000","last_active":"2023-12-16T00:00:27.288393+0000","last_peered":"2023-12-16T00:00:27.288393+0000","last_clean":"2023-12-16T00:00:27.288393+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:00:27.288393+0000","last_undegraded":"2023-12-16T00:00:27.288393+0000","last_fullsized":"2023-12-16T00:00:27.288393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087338+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087338+0000","last_peered":"2023-12-16T00:02:07.087338+0000","last_clean":"2023-12-16T00:02:07.087338+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087338+0000","last_undegraded":"2023-12-16T00:02:07.087338+0000","last_fullsized":"2023-12-16T00:02:07.087338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239262+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239262+0000","last_peered":"2023-12-16T00:01:35.239262+0000","last_clean":"2023-12-16T00:01:35.239262+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239262+0000","last_undegraded":"2023-12-16T00:01:35.239262+0000","last_fullsized":"2023-12-16T00:01:35.239262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1326,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440794+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-16T00:00:26.440794+0000","last_peered":"2023-12-16T00:00:26.440794+0000","last_clean":"2023-12-16T00:00:26.440794+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:00:26.440794+0000","last_undegraded":"2023-12-16T00:00:26.440794+0000","last_fullsized":"2023-12-16T00:00:26.440794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273146+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273146+0000","last_peered":"2023-12-16T00:02:14.273146+0000","last_clean":"2023-12-16T00:02:14.273146+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273146+0000","last_undegraded":"2023-12-16T00:02:14.273146+0000","last_fullsized":"2023-12-16T00:02:14.273146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478939+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478939+0000","last_peered":"2023-12-16T00:02:19.478939+0000","last_clean":"2023-12-16T00:02:19.478939+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478939+0000","last_undegraded":"2023-12-16T00:02:19.478939+0000","last_fullsized":"2023-12-16T00:02:19.478939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":388,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025286+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025286+0000","last_peered":"2023-12-16T00:02:04.025286+0000","last_clean":"2023-12-16T00:02:04.025286+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025286+0000","last_undegraded":"2023-12-16T00:02:04.025286+0000","last_fullsized":"2023-12-16T00:02:04.025286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725602+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725602+0000","last_peered":"2023-12-16T00:01:44.725602+0000","last_clean":"2023-12-16T00:01:44.725602+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725602+0000","last_undegraded":"2023-12-16T00:01:44.725602+0000","last_fullsized":"2023-12-16T00:01:44.725602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624495+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624495+0000","last_peered":"2023-12-16T00:02:24.624495+0000","last_clean":"2023-12-16T00:02:24.624495+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624495+0000","last_undegraded":"2023-12-16T00:02:24.624495+0000","last_fullsized":"2023-12-16T00:02:24.624495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195623+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195623+0000","last_peered":"2023-12-16T00:01:41.195623+0000","last_clean":"2023-12-16T00:01:41.195623+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195623+0000","last_undegraded":"2023-12-16T00:01:41.195623+0000","last_fullsized":"2023-12-16T00:01:41.195623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3898,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200859+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200859+0000","last_peered":"2023-12-16T00:02:19.200859+0000","last_clean":"2023-12-16T00:02:19.200859+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200859+0000","last_undegraded":"2023-12-16T00:02:19.200859+0000","last_fullsized":"2023-12-16T00:02:19.200859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"49'8","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137697+0000","last_change":"2023-12-15T22:53:32.194677+0000","last_active":"2023-12-16T00:00:28.137697+0000","last_peered":"2023-12-16T00:00:28.137697+0000","last_clean":"2023-12-16T00:00:28.137697+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:00:28.137697+0000","last_undegraded":"2023-12-16T00:00:28.137697+0000","last_fullsized":"2023-12-16T00:00:28.137697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288401+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-16T00:00:27.288401+0000","last_peered":"2023-12-16T00:00:27.288401+0000","last_clean":"2023-12-16T00:00:27.288401+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:00:27.288401+0000","last_undegraded":"2023-12-16T00:00:27.288401+0000","last_fullsized":"2023-12-16T00:00:27.288401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'12","reported_seq":801,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137077+0000","last_change":"2023-12-15T22:53:08.332806+0000","last_active":"2023-12-16T00:00:28.137077+0000","last_peered":"2023-12-16T00:00:28.137077+0000","last_clean":"2023-12-16T00:00:28.137077+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:00:28.137077+0000","last_undegraded":"2023-12-16T00:00:28.137077+0000","last_fullsized":"2023-12-16T00:00:28.137077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219694+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219694+0000","last_peered":"2023-12-16T00:01:33.219694+0000","last_clean":"2023-12-16T00:01:33.219694+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219694+0000","last_undegraded":"2023-12-16T00:01:33.219694+0000","last_fullsized":"2023-12-16T00:01:33.219694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092050+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092050+0000","last_peered":"2023-12-16T00:02:06.092050+0000","last_clean":"2023-12-16T00:02:06.092050+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092050+0000","last_undegraded":"2023-12-16T00:02:06.092050+0000","last_fullsized":"2023-12-16T00:02:06.092050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513266+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513266+0000","last_peered":"2023-12-16T00:02:15.513266+0000","last_clean":"2023-12-16T00:02:15.513266+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513266+0000","last_undegraded":"2023-12-16T00:02:15.513266+0000","last_fullsized":"2023-12-16T00:02:15.513266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158555+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158555+0000","last_peered":"2023-12-16T00:02:00.158555+0000","last_clean":"2023-12-16T00:02:00.158555+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158555+0000","last_undegraded":"2023-12-16T00:02:00.158555+0000","last_fullsized":"2023-12-16T00:02:00.158555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865424+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:26.865424+0000","last_peered":"2023-12-16T00:00:26.865424+0000","last_clean":"2023-12-16T00:00:26.865424+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:26.865424+0000","last_undegraded":"2023-12-16T00:00:26.865424+0000","last_fullsized":"2023-12-16T00:00:26.865424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137737+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-16T00:00:28.137737+0000","last_peered":"2023-12-16T00:00:28.137737+0000","last_clean":"2023-12-16T00:00:28.137737+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:00:28.137737+0000","last_undegraded":"2023-12-16T00:00:28.137737+0000","last_fullsized":"2023-12-16T00:00:28.137737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246171+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246171+0000","last_peered":"2023-12-16T00:01:50.246171+0000","last_clean":"2023-12-16T00:01:50.246171+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246171+0000","last_undegraded":"2023-12-16T00:01:50.246171+0000","last_fullsized":"2023-12-16T00:01:50.246171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986502+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986502+0000","last_peered":"2023-12-16T00:01:56.986502+0000","last_clean":"2023-12-16T00:01:56.986502+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986502+0000","last_undegraded":"2023-12-16T00:01:56.986502+0000","last_fullsized":"2023-12-16T00:01:56.986502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:21.393709+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:21.393709+0000","last_peered":"2023-12-16T00:00:21.393709+0000","last_clean":"2023-12-16T00:00:21.393709+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:21.393709+0000","last_undegraded":"2023-12-16T00:00:21.393709+0000","last_fullsized":"2023-12-16T00:00:21.393709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525340+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525340+0000","last_peered":"2023-12-16T00:02:21.525340+0000","last_clean":"2023-12-16T00:02:21.525340+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525340+0000","last_undegraded":"2023-12-16T00:02:21.525340+0000","last_fullsized":"2023-12-16T00:02:21.525340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3684,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689717+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689717+0000","last_peered":"2023-12-16T00:02:12.689717+0000","last_clean":"2023-12-16T00:02:12.689717+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689717+0000","last_undegraded":"2023-12-16T00:02:12.689717+0000","last_fullsized":"2023-12-16T00:02:12.689717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'35","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137616+0000","last_change":"2023-12-15T22:53:32.190145+0000","last_active":"2023-12-16T00:00:28.137616+0000","last_peered":"2023-12-16T00:00:28.137616+0000","last_clean":"2023-12-16T00:00:28.137616+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:00:28.137616+0000","last_undegraded":"2023-12-16T00:00:28.137616+0000","last_fullsized":"2023-12-16T00:00:28.137616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892770+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892770+0000","last_peered":"2023-12-16T00:01:49.892770+0000","last_clean":"2023-12-16T00:01:49.892770+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892770+0000","last_undegraded":"2023-12-16T00:01:49.892770+0000","last_fullsized":"2023-12-16T00:01:49.892770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288493+0000","last_change":"2023-12-15T22:53:08.334892+0000","last_active":"2023-12-16T00:00:27.288493+0000","last_peered":"2023-12-16T00:00:27.288493+0000","last_clean":"2023-12-16T00:00:27.288493+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:00:27.288493+0000","last_undegraded":"2023-12-16T00:00:27.288493+0000","last_fullsized":"2023-12-16T00:00:27.288493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020604+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020604+0000","last_peered":"2023-12-16T00:02:10.020604+0000","last_clean":"2023-12-16T00:02:10.020604+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020604+0000","last_undegraded":"2023-12-16T00:02:10.020604+0000","last_fullsized":"2023-12-16T00:02:10.020604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":55,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137530+0000","last_change":"2023-12-15T22:53:30.177058+0000","last_active":"2023-12-16T00:00:28.137530+0000","last_peered":"2023-12-16T00:00:28.137530+0000","last_clean":"2023-12-16T00:00:28.137530+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:00:28.137530+0000","last_undegraded":"2023-12-16T00:00:28.137530+0000","last_fullsized":"2023-12-16T00:00:28.137530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:29.157400+0000","last_clean_scrub_stamp":"2023-12-15T22:53:29.157400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'48","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711702+0000","last_change":"2023-12-15T22:53:06.320596+0000","last_active":"2023-12-16T00:00:27.711702+0000","last_peered":"2023-12-16T00:00:27.711702+0000","last_clean":"2023-12-16T00:00:27.711702+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:00:27.711702+0000","last_undegraded":"2023-12-16T00:00:27.711702+0000","last_fullsized":"2023-12-16T00:00:27.711702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016240+0000","last_change":"2023-12-15T22:53:08.333779+0000","last_active":"2023-12-16T00:00:26.016240+0000","last_peered":"2023-12-16T00:00:26.016240+0000","last_clean":"2023-12-16T00:00:26.016240+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:00:26.016240+0000","last_undegraded":"2023-12-16T00:00:26.016240+0000","last_fullsized":"2023-12-16T00:00:26.016240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679948+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679948+0000","last_peered":"2023-12-16T00:01:47.679948+0000","last_clean":"2023-12-16T00:01:47.679948+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679948+0000","last_undegraded":"2023-12-16T00:01:47.679948+0000","last_fullsized":"2023-12-16T00:01:47.679948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634825+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634825+0000","last_peered":"2023-12-16T00:02:01.634825+0000","last_clean":"2023-12-16T00:02:01.634825+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634825+0000","last_undegraded":"2023-12-16T00:02:01.634825+0000","last_fullsized":"2023-12-16T00:02:01.634825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439995+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:26.439995+0000","last_peered":"2023-12-16T00:00:26.439995+0000","last_clean":"2023-12-16T00:00:26.439995+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:26.439995+0000","last_undegraded":"2023-12-16T00:00:26.439995+0000","last_fullsized":"2023-12-16T00:00:26.439995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711283+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-16T00:00:27.711283+0000","last_peered":"2023-12-16T00:00:27.711283+0000","last_clean":"2023-12-16T00:00:27.711283+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:00:27.711283+0000","last_undegraded":"2023-12-16T00:00:27.711283+0000","last_fullsized":"2023-12-16T00:00:27.711283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439962+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:26.439962+0000","last_peered":"2023-12-16T00:00:26.439962+0000","last_clean":"2023-12-16T00:00:26.439962+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:26.439962+0000","last_undegraded":"2023-12-16T00:00:26.439962+0000","last_fullsized":"2023-12-16T00:00:26.439962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864089+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-16T00:00:26.864089+0000","last_peered":"2023-12-16T00:00:26.864089+0000","last_clean":"2023-12-16T00:00:26.864089+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:00:26.864089+0000","last_undegraded":"2023-12-16T00:00:26.864089+0000","last_fullsized":"2023-12-16T00:00:26.864089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808750+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808750+0000","last_peered":"2023-12-16T00:01:20.808750+0000","last_clean":"2023-12-16T00:01:20.808750+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808750+0000","last_undegraded":"2023-12-16T00:01:20.808750+0000","last_fullsized":"2023-12-16T00:01:20.808750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439970+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:26.439970+0000","last_peered":"2023-12-16T00:00:26.439970+0000","last_clean":"2023-12-16T00:00:26.439970+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:26.439970+0000","last_undegraded":"2023-12-16T00:00:26.439970+0000","last_fullsized":"2023-12-16T00:00:26.439970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864271+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-16T00:00:26.864271+0000","last_peered":"2023-12-16T00:00:26.864271+0000","last_clean":"2023-12-16T00:00:26.864271+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:00:26.864271+0000","last_undegraded":"2023-12-16T00:00:26.864271+0000","last_fullsized":"2023-12-16T00:00:26.864271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015729+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:26.015729+0000","last_peered":"2023-12-16T00:00:26.015729+0000","last_clean":"2023-12-16T00:00:26.015729+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:26.015729+0000","last_undegraded":"2023-12-16T00:00:26.015729+0000","last_fullsized":"2023-12-16T00:00:26.015729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394818+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:26.394818+0000","last_peered":"2023-12-16T00:00:26.394818+0000","last_clean":"2023-12-16T00:00:26.394818+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:26.394818+0000","last_undegraded":"2023-12-16T00:00:26.394818+0000","last_fullsized":"2023-12-16T00:00:26.394818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711462+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-16T00:00:27.711462+0000","last_peered":"2023-12-16T00:00:27.711462+0000","last_clean":"2023-12-16T00:00:27.711462+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:00:27.711462+0000","last_undegraded":"2023-12-16T00:00:27.711462+0000","last_fullsized":"2023-12-16T00:00:27.711462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439762+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:26.439762+0000","last_peered":"2023-12-16T00:00:26.439762+0000","last_clean":"2023-12-16T00:00:26.439762+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:26.439762+0000","last_undegraded":"2023-12-16T00:00:26.439762+0000","last_fullsized":"2023-12-16T00:00:26.439762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287952+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:27.287952+0000","last_peered":"2023-12-16T00:00:27.287952+0000","last_clean":"2023-12-16T00:00:27.287952+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:27.287952+0000","last_undegraded":"2023-12-16T00:00:27.287952+0000","last_fullsized":"2023-12-16T00:00:27.287952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591074+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591074+0000","last_peered":"2023-12-16T00:01:51.591074+0000","last_clean":"2023-12-16T00:01:51.591074+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591074+0000","last_undegraded":"2023-12-16T00:01:51.591074+0000","last_fullsized":"2023-12-16T00:01:51.591074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288153+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-16T00:00:27.288153+0000","last_peered":"2023-12-16T00:00:27.288153+0000","last_clean":"2023-12-16T00:00:27.288153+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:00:27.288153+0000","last_undegraded":"2023-12-16T00:00:27.288153+0000","last_fullsized":"2023-12-16T00:00:27.288153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864166+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:26.864166+0000","last_peered":"2023-12-16T00:00:26.864166+0000","last_clean":"2023-12-16T00:00:26.864166+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:26.864166+0000","last_undegraded":"2023-12-16T00:00:26.864166+0000","last_fullsized":"2023-12-16T00:00:26.864166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.404816+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:20.404816+0000","last_peered":"2023-12-16T00:00:20.404816+0000","last_clean":"2023-12-16T00:00:20.404816+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:20.404816+0000","last_undegraded":"2023-12-16T00:00:20.404816+0000","last_fullsized":"2023-12-16T00:00:20.404816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405738+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:25.405738+0000","last_peered":"2023-12-16T00:00:25.405738+0000","last_clean":"2023-12-16T00:00:25.405738+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:25.405738+0000","last_undegraded":"2023-12-16T00:00:25.405738+0000","last_fullsized":"2023-12-16T00:00:25.405738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406427+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:25.406427+0000","last_peered":"2023-12-16T00:00:25.406427+0000","last_clean":"2023-12-16T00:00:25.406427+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:25.406427+0000","last_undegraded":"2023-12-16T00:00:25.406427+0000","last_fullsized":"2023-12-16T00:00:25.406427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405803+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:25.405803+0000","last_peered":"2023-12-16T00:00:25.405803+0000","last_clean":"2023-12-16T00:00:25.405803+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:25.405803+0000","last_undegraded":"2023-12-16T00:00:25.405803+0000","last_fullsized":"2023-12-16T00:00:25.405803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405991+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:25.405991+0000","last_peered":"2023-12-16T00:00:25.405991+0000","last_clean":"2023-12-16T00:00:25.405991+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:25.405991+0000","last_undegraded":"2023-12-16T00:00:25.405991+0000","last_fullsized":"2023-12-16T00:00:25.405991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770757+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770757+0000","last_peered":"2023-12-16T00:00:42.770757+0000","last_clean":"2023-12-16T00:00:42.770757+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770757+0000","last_undegraded":"2023-12-16T00:00:42.770757+0000","last_fullsized":"2023-12-16T00:00:42.770757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394525+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:26.394525+0000","last_peered":"2023-12-16T00:00:26.394525+0000","last_clean":"2023-12-16T00:00:26.394525+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:26.394525+0000","last_undegraded":"2023-12-16T00:00:26.394525+0000","last_fullsized":"2023-12-16T00:00:26.394525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405768+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:25.405768+0000","last_peered":"2023-12-16T00:00:25.405768+0000","last_clean":"2023-12-16T00:00:25.405768+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:25.405768+0000","last_undegraded":"2023-12-16T00:00:25.405768+0000","last_fullsized":"2023-12-16T00:00:25.405768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828204+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828204+0000","last_peered":"2023-12-16T00:00:52.828204+0000","last_clean":"2023-12-16T00:00:52.828204+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828204+0000","last_undegraded":"2023-12-16T00:00:52.828204+0000","last_fullsized":"2023-12-16T00:00:52.828204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405869+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:25.405869+0000","last_peered":"2023-12-16T00:00:25.405869+0000","last_clean":"2023-12-16T00:00:25.405869+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:25.405869+0000","last_undegraded":"2023-12-16T00:00:25.405869+0000","last_fullsized":"2023-12-16T00:00:25.405869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625023+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625023+0000","last_peered":"2023-12-16T00:01:54.625023+0000","last_clean":"2023-12-16T00:01:54.625023+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625023+0000","last_undegraded":"2023-12-16T00:01:54.625023+0000","last_fullsized":"2023-12-16T00:01:54.625023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.625632+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:25.625632+0000","last_peered":"2023-12-16T00:00:25.625632+0000","last_clean":"2023-12-16T00:00:25.625632+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:25.625632+0000","last_undegraded":"2023-12-16T00:00:25.625632+0000","last_fullsized":"2023-12-16T00:00:25.625632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276225+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276225+0000","last_peered":"2023-12-16T00:01:02.276225+0000","last_clean":"2023-12-16T00:01:02.276225+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276225+0000","last_undegraded":"2023-12-16T00:01:02.276225+0000","last_fullsized":"2023-12-16T00:01:02.276225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:20.403946+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:20.403946+0000","last_peered":"2023-12-16T00:00:20.403946+0000","last_clean":"2023-12-16T00:00:20.403946+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:20.403946+0000","last_undegraded":"2023-12-16T00:00:20.403946+0000","last_fullsized":"2023-12-16T00:00:20.403946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111084,"num_omap_keys":423,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3816,"ondisk_log_size":3816,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2234,"ondisk_log_size":2234,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":890,"ondisk_log_size":890,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":461,"ondisk_log_size":461,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608401,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25600000000000001},"max":{"1min":0.57299999999999995,"5min":0.68100000000000005,"15min":0.72299999999999998},"last":0.372},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.57199999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.436}]},{"osd":1,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.26000000000000001},"max":{"1min":0.60499999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.72199999999999998,"15min":1.004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.32300000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":1.149},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.63},"last":0.34799999999999998}]}]},{"osd":5,"up_from":11,"seq":47244641103,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.373,"15min":0.30399999999999999},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.96699999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.29299999999999998},"max":{"1min":0.63700000000000001,"5min":0.69999999999999996,"15min":0.80100000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.879},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.754},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.63},"last":0.374}]},{"osd":4,"last update":"Sat Dec 16 00:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.32600000000000001}]}]},{"osd":3,"up_from":11,"seq":47244641105,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55380,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802220,"statfs":{"total":107374182400,"available":107317473280,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.255},"max":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.45800000000000002,"5min":0.311,"15min":0.29299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40200000000000002,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.439}]},{"osd":2,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Dec 16 00:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.45500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45400000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.379},{"interface":"front","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39800000000000002}]}]},{"osd":2,"up_from":11,"seq":47244641102,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46492,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811108,"statfs":{"total":107374182400,"available":107326574592,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.40699999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.46700000000000003,"5min":0.87,"15min":0.87},"last":0.247}]},{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.188,"15min":0.188},"max":{"1min":0.44,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.50700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.315}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.32600000000000001},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":1.169,"15min":1.169},"last":0.42299999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69599999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51200000000000001}]}]},{"osd":1,"up_from":11,"seq":47244641103,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.313,"15min":0.318},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20399999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.53100000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.57399999999999995,"15min":0.80100000000000005},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.249}]},{"osd":3,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.5}]},{"osd":4,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.878},"last":0.625}]},{"osd":5,"last update":"Sat Dec 16 00:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.82099999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64100000000000001}]}]},{"osd":0,"up_from":11,"seq":47244641103,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36812,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820788,"statfs":{"total":107374182400,"available":107336486912,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.314,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.44900000000000001,"15min":0.51200000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":0.51000000000000001,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.5,"15min":0.5},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42999999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65800000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.752,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.435},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.754,"15min":0.875},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Dec 16 00:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66900000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:02:31.334 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.335 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.335 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.335 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.335 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.336 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.336 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.336 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.336 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.336 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.337 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.337 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.337 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.337 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.337 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.338 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.338 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.338 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.338 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.339 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.339 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.339 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.339 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.340 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.340 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.340 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.340 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.340 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.341 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.341 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.341 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.342 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.343 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.343 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.343 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.344 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.344 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.344 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.344 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.344 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.345 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.345 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.345 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.345 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.346 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.346 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.346 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.346 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.347 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.347 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.347 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.347 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.348 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.348 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.348 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.348 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.349 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.349 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.349 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.349 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.350 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.350 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.350 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.351 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.351 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.351 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.351 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.351 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.352 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.352 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.352 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.352 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.353 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.353 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.353 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.353 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.354 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.354 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.354 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.354 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.354 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.355 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.355 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.355 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.356 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.356 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.356 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.356 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.356 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.357 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.357 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.357 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.358 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.358 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.358 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.358 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.359 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.359 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.359 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.360 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.360 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.360 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.360 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.360 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.361 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.361 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.361 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.361 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.362 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.362 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.362 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.362 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.363 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.363 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.363 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.363 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.364 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.364 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.364 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.364 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.365 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.365 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.365 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.365 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.365 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.366 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.366 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.366 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.366 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.367 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.367 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.367 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.367 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.368 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.368 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.368 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.368 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.369 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.369 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.369 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.369 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.369 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.370 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.370 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.370 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.370 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.371 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.371 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.371 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.371 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.371 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.372 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.372 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.372 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.372 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.373 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.373 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.373 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.373 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.373 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.374 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.374 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.374 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.374 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.375 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.375 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.375 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.375 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.376 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.376 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.376 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.376 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.377 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.377 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.377 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.377 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.377 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.378 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.378 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.378 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.378 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.379 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.379 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.379 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.379 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.380 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.380 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.380 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.380 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.380 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.381 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.381 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.381 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.381 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.382 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.382 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.382 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.382 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.383 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.383 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.383 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.383 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.384 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.384 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.384 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.384 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.385 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.385 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.385 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.385 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.385 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.386 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.386 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.386 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.386 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.387 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.387 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.387 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.387 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.388 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.388 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.388 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.388 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.388 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.389 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.389 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.389 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.389 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.389 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.390 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.390 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.390 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2023-12-15T22:53:29.157400+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=29, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.390 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.391 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.391 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.391 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.391 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.392 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.392 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.392 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.392 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.392 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.393 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.393 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.393 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.393 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.394 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.394 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.394 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.394 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.395 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.395 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.395 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.395 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.396 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.396 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.396 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.396 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.397 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.397 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.397 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.397 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.397 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.398 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.398 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.398 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.398 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.399 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.399 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.399 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.399 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.400 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.400 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.400 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:31.400 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:02:51.402 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:02:51.732 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:02:51.753 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:02:51.756 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2171,"stamp":"2023-12-16T00:02:50.243347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":832234,"num_omap_keys":3656,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36016,"ondisk_log_size":36016,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":303768,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":293878,"kb_avail":628841832,"statfs":{"total":644245094400,"available":643934035968,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":300931745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19079,"num_omap_keys":76,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005631"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288074+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-16T00:00:27.288074+0000","last_peered":"2023-12-16T00:00:27.288074+0000","last_clean":"2023-12-16T00:00:27.288074+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:00:27.288074+0000","last_undegraded":"2023-12-16T00:00:27.288074+0000","last_fullsized":"2023-12-16T00:00:27.288074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406259+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:25.406259+0000","last_peered":"2023-12-16T00:00:25.406259+0000","last_clean":"2023-12-16T00:00:25.406259+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:25.406259+0000","last_undegraded":"2023-12-16T00:00:25.406259+0000","last_fullsized":"2023-12-16T00:00:25.406259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405527+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:25.405527+0000","last_peered":"2023-12-16T00:00:25.405527+0000","last_clean":"2023-12-16T00:00:25.405527+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:25.405527+0000","last_undegraded":"2023-12-16T00:00:25.405527+0000","last_fullsized":"2023-12-16T00:00:25.405527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394413+0000","last_change":"2023-12-15T22:52:55.188198+0000","last_active":"2023-12-16T00:00:26.394413+0000","last_peered":"2023-12-16T00:00:26.394413+0000","last_clean":"2023-12-16T00:00:26.394413+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:00:26.394413+0000","last_undegraded":"2023-12-16T00:00:26.394413+0000","last_fullsized":"2023-12-16T00:00:26.394413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406056+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:25.406056+0000","last_peered":"2023-12-16T00:00:25.406056+0000","last_clean":"2023-12-16T00:00:25.406056+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:25.406056+0000","last_undegraded":"2023-12-16T00:00:25.406056+0000","last_fullsized":"2023-12-16T00:00:25.406056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405677+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:25.405677+0000","last_peered":"2023-12-16T00:00:25.405677+0000","last_clean":"2023-12-16T00:00:25.405677+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:25.405677+0000","last_undegraded":"2023-12-16T00:00:25.405677+0000","last_fullsized":"2023-12-16T00:00:25.405677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406410+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:25.406410+0000","last_peered":"2023-12-16T00:00:25.406410+0000","last_clean":"2023-12-16T00:00:25.406410+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:25.406410+0000","last_undegraded":"2023-12-16T00:00:25.406410+0000","last_fullsized":"2023-12-16T00:00:25.406410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711556+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-16T00:00:27.711556+0000","last_peered":"2023-12-16T00:00:27.711556+0000","last_clean":"2023-12-16T00:00:27.711556+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:00:27.711556+0000","last_undegraded":"2023-12-16T00:00:27.711556+0000","last_fullsized":"2023-12-16T00:00:27.711556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.405502+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:25.405502+0000","last_peered":"2023-12-16T00:00:25.405502+0000","last_clean":"2023-12-16T00:00:25.405502+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:25.405502+0000","last_undegraded":"2023-12-16T00:00:25.405502+0000","last_fullsized":"2023-12-16T00:00:25.405502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392252+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:25.392252+0000","last_peered":"2023-12-16T00:00:25.392252+0000","last_clean":"2023-12-16T00:00:25.392252+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:25.392252+0000","last_undegraded":"2023-12-16T00:00:25.392252+0000","last_fullsized":"2023-12-16T00:00:25.392252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864382+0000","last_change":"2023-12-15T22:52:55.190450+0000","last_active":"2023-12-16T00:00:26.864382+0000","last_peered":"2023-12-16T00:00:26.864382+0000","last_clean":"2023-12-16T00:00:26.864382+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:00:26.864382+0000","last_undegraded":"2023-12-16T00:00:26.864382+0000","last_fullsized":"2023-12-16T00:00:26.864382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711458+0000","last_change":"2023-12-15T22:52:55.188105+0000","last_active":"2023-12-16T00:00:27.711458+0000","last_peered":"2023-12-16T00:00:27.711458+0000","last_clean":"2023-12-16T00:00:27.711458+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:00:27.711458+0000","last_undegraded":"2023-12-16T00:00:27.711458+0000","last_fullsized":"2023-12-16T00:00:27.711458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136604+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:28.136604+0000","last_peered":"2023-12-16T00:00:28.136604+0000","last_clean":"2023-12-16T00:00:28.136604+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:28.136604+0000","last_undegraded":"2023-12-16T00:00:28.136604+0000","last_fullsized":"2023-12-16T00:00:28.136604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288055+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:27.288055+0000","last_peered":"2023-12-16T00:00:27.288055+0000","last_clean":"2023-12-16T00:00:27.288055+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:27.288055+0000","last_undegraded":"2023-12-16T00:00:27.288055+0000","last_fullsized":"2023-12-16T00:00:27.288055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136531+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:28.136531+0000","last_peered":"2023-12-16T00:00:28.136531+0000","last_clean":"2023-12-16T00:00:28.136531+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:28.136531+0000","last_undegraded":"2023-12-16T00:00:28.136531+0000","last_fullsized":"2023-12-16T00:00:28.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864287+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:26.864287+0000","last_peered":"2023-12-16T00:00:26.864287+0000","last_clean":"2023-12-16T00:00:26.864287+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:26.864287+0000","last_undegraded":"2023-12-16T00:00:26.864287+0000","last_fullsized":"2023-12-16T00:00:26.864287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711284+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:27.711284+0000","last_peered":"2023-12-16T00:00:27.711284+0000","last_clean":"2023-12-16T00:00:27.711284+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:27.711284+0000","last_undegraded":"2023-12-16T00:00:27.711284+0000","last_fullsized":"2023-12-16T00:00:27.711284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864300+0000","last_change":"2023-12-15T22:52:55.187666+0000","last_active":"2023-12-16T00:00:26.864300+0000","last_peered":"2023-12-16T00:00:26.864300+0000","last_clean":"2023-12-16T00:00:26.864300+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:00:26.864300+0000","last_undegraded":"2023-12-16T00:00:26.864300+0000","last_fullsized":"2023-12-16T00:00:26.864300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015810+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:26.015810+0000","last_peered":"2023-12-16T00:00:26.015810+0000","last_clean":"2023-12-16T00:00:26.015810+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:26.015810+0000","last_undegraded":"2023-12-16T00:00:26.015810+0000","last_fullsized":"2023-12-16T00:00:26.015810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632624+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632624+0000","last_peered":"2023-12-16T00:02:00.632624+0000","last_clean":"2023-12-16T00:02:00.632624+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632624+0000","last_undegraded":"2023-12-16T00:02:00.632624+0000","last_fullsized":"2023-12-16T00:02:00.632624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711519+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:27.711519+0000","last_peered":"2023-12-16T00:00:27.711519+0000","last_clean":"2023-12-16T00:00:27.711519+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:27.711519+0000","last_undegraded":"2023-12-16T00:00:27.711519+0000","last_fullsized":"2023-12-16T00:00:27.711519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440866+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:26.440866+0000","last_peered":"2023-12-16T00:00:26.440866+0000","last_clean":"2023-12-16T00:00:26.440866+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:26.440866+0000","last_undegraded":"2023-12-16T00:00:26.440866+0000","last_fullsized":"2023-12-16T00:00:26.440866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411379+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411379+0000","last_peered":"2023-12-16T00:02:07.411379+0000","last_clean":"2023-12-16T00:02:07.411379+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411379+0000","last_undegraded":"2023-12-16T00:02:07.411379+0000","last_fullsized":"2023-12-16T00:02:07.411379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620281+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620281+0000","last_peered":"2023-12-16T00:02:06.620281+0000","last_clean":"2023-12-16T00:02:06.620281+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620281+0000","last_undegraded":"2023-12-16T00:02:06.620281+0000","last_fullsized":"2023-12-16T00:02:06.620281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646490+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646490+0000","last_peered":"2023-12-16T00:02:14.646490+0000","last_clean":"2023-12-16T00:02:14.646490+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646490+0000","last_undegraded":"2023-12-16T00:02:14.646490+0000","last_fullsized":"2023-12-16T00:02:14.646490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439921+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:26.439921+0000","last_peered":"2023-12-16T00:00:26.439921+0000","last_clean":"2023-12-16T00:00:26.439921+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:26.439921+0000","last_undegraded":"2023-12-16T00:00:26.439921+0000","last_fullsized":"2023-12-16T00:00:26.439921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287917+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:27.287917+0000","last_peered":"2023-12-16T00:00:27.287917+0000","last_clean":"2023-12-16T00:00:27.287917+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:27.287917+0000","last_undegraded":"2023-12-16T00:00:27.287917+0000","last_fullsized":"2023-12-16T00:00:27.287917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016080+0000","last_change":"2023-12-15T22:53:06.322305+0000","last_active":"2023-12-16T00:00:26.016080+0000","last_peered":"2023-12-16T00:00:26.016080+0000","last_clean":"2023-12-16T00:00:26.016080+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:00:26.016080+0000","last_undegraded":"2023-12-16T00:00:26.016080+0000","last_fullsized":"2023-12-16T00:00:26.016080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099297+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099297+0000","last_peered":"2023-12-16T00:02:40.099297+0000","last_clean":"2023-12-16T00:02:40.099297+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099297+0000","last_undegraded":"2023-12-16T00:02:40.099297+0000","last_fullsized":"2023-12-16T00:02:40.099297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865442+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:26.865442+0000","last_peered":"2023-12-16T00:00:26.865442+0000","last_clean":"2023-12-16T00:00:26.865442+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:26.865442+0000","last_undegraded":"2023-12-16T00:00:26.865442+0000","last_fullsized":"2023-12-16T00:00:26.865442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6214,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272435+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272435+0000","last_peered":"2023-12-16T00:02:40.272435+0000","last_clean":"2023-12-16T00:02:40.272435+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272435+0000","last_undegraded":"2023-12-16T00:02:40.272435+0000","last_fullsized":"2023-12-16T00:02:40.272435+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118158+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118158+0000","last_peered":"2023-12-16T00:02:20.118158+0000","last_clean":"2023-12-16T00:02:20.118158+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118158+0000","last_undegraded":"2023-12-16T00:02:20.118158+0000","last_fullsized":"2023-12-16T00:02:20.118158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752008+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752008+0000","last_peered":"2023-12-16T00:01:25.752008+0000","last_clean":"2023-12-16T00:01:25.752008+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752008+0000","last_undegraded":"2023-12-16T00:01:25.752008+0000","last_fullsized":"2023-12-16T00:01:25.752008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844560+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844560+0000","last_peered":"2023-12-16T00:01:46.844560+0000","last_clean":"2023-12-16T00:01:46.844560+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844560+0000","last_undegraded":"2023-12-16T00:01:46.844560+0000","last_fullsized":"2023-12-16T00:01:46.844560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136583+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:28.136583+0000","last_peered":"2023-12-16T00:00:28.136583+0000","last_clean":"2023-12-16T00:00:28.136583+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:28.136583+0000","last_undegraded":"2023-12-16T00:00:28.136583+0000","last_fullsized":"2023-12-16T00:00:28.136583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439726+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:26.439726+0000","last_peered":"2023-12-16T00:00:26.439726+0000","last_clean":"2023-12-16T00:00:26.439726+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:26.439726+0000","last_undegraded":"2023-12-16T00:00:26.439726+0000","last_fullsized":"2023-12-16T00:00:26.439726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'42","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711690+0000","last_change":"2023-12-15T22:53:06.324744+0000","last_active":"2023-12-16T00:00:27.711690+0000","last_peered":"2023-12-16T00:00:27.711690+0000","last_clean":"2023-12-16T00:00:27.711690+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:00:27.711690+0000","last_undegraded":"2023-12-16T00:00:27.711690+0000","last_fullsized":"2023-12-16T00:00:27.711690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567518+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567518+0000","last_peered":"2023-12-16T00:02:27.567518+0000","last_clean":"2023-12-16T00:02:27.567518+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567518+0000","last_undegraded":"2023-12-16T00:02:27.567518+0000","last_fullsized":"2023-12-16T00:02:27.567518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165978+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165978+0000","last_peered":"2023-12-16T00:01:55.165978+0000","last_clean":"2023-12-16T00:01:55.165978+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165978+0000","last_undegraded":"2023-12-16T00:01:55.165978+0000","last_fullsized":"2023-12-16T00:01:55.165978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015847+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:26.015847+0000","last_peered":"2023-12-16T00:00:26.015847+0000","last_clean":"2023-12-16T00:00:26.015847+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:26.015847+0000","last_undegraded":"2023-12-16T00:00:26.015847+0000","last_fullsized":"2023-12-16T00:00:26.015847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"49'11","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864490+0000","last_change":"2023-12-15T22:53:04.321530+0000","last_active":"2023-12-16T00:00:26.864490+0000","last_peered":"2023-12-16T00:00:26.864490+0000","last_clean":"2023-12-16T00:00:26.864490+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:00:26.864490+0000","last_undegraded":"2023-12-16T00:00:26.864490+0000","last_fullsized":"2023-12-16T00:00:26.864490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359607+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359607+0000","last_peered":"2023-12-16T00:01:48.359607+0000","last_clean":"2023-12-16T00:01:48.359607+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359607+0000","last_undegraded":"2023-12-16T00:01:48.359607+0000","last_fullsized":"2023-12-16T00:01:48.359607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1028,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304198+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304198+0000","last_peered":"2023-12-16T00:02:29.304198+0000","last_clean":"2023-12-16T00:02:29.304198+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304198+0000","last_undegraded":"2023-12-16T00:02:29.304198+0000","last_fullsized":"2023-12-16T00:02:29.304198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678066+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678066+0000","last_peered":"2023-12-16T00:02:07.678066+0000","last_clean":"2023-12-16T00:02:07.678066+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678066+0000","last_undegraded":"2023-12-16T00:02:07.678066+0000","last_fullsized":"2023-12-16T00:02:07.678066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015801+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:26.015801+0000","last_peered":"2023-12-16T00:00:26.015801+0000","last_clean":"2023-12-16T00:00:26.015801+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:26.015801+0000","last_undegraded":"2023-12-16T00:00:26.015801+0000","last_fullsized":"2023-12-16T00:00:26.015801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136373+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:28.136373+0000","last_peered":"2023-12-16T00:00:28.136373+0000","last_clean":"2023-12-16T00:00:28.136373+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:28.136373+0000","last_undegraded":"2023-12-16T00:00:28.136373+0000","last_fullsized":"2023-12-16T00:00:28.136373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288324+0000","last_change":"2023-12-15T22:53:04.318819+0000","last_active":"2023-12-16T00:00:27.288324+0000","last_peered":"2023-12-16T00:00:27.288324+0000","last_clean":"2023-12-16T00:00:27.288324+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:00:27.288324+0000","last_undegraded":"2023-12-16T00:00:27.288324+0000","last_fullsized":"2023-12-16T00:00:27.288324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'48","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288375+0000","last_change":"2023-12-15T22:53:06.321646+0000","last_active":"2023-12-16T00:00:27.288375+0000","last_peered":"2023-12-16T00:00:27.288375+0000","last_clean":"2023-12-16T00:00:27.288375+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:00:27.288375+0000","last_undegraded":"2023-12-16T00:00:27.288375+0000","last_fullsized":"2023-12-16T00:00:27.288375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030702+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030702+0000","last_peered":"2023-12-16T00:02:05.030702+0000","last_clean":"2023-12-16T00:02:05.030702+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030702+0000","last_undegraded":"2023-12-16T00:02:05.030702+0000","last_fullsized":"2023-12-16T00:02:05.030702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712518+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:27.712518+0000","last_peered":"2023-12-16T00:00:27.712518+0000","last_clean":"2023-12-16T00:00:27.712518+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:27.712518+0000","last_undegraded":"2023-12-16T00:00:27.712518+0000","last_fullsized":"2023-12-16T00:00:27.712518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1614,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416872+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416872+0000","last_peered":"2023-12-16T00:02:35.416872+0000","last_clean":"2023-12-16T00:02:35.416872+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416872+0000","last_undegraded":"2023-12-16T00:02:35.416872+0000","last_fullsized":"2023-12-16T00:02:35.416872+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883691+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883691+0000","last_peered":"2023-12-16T00:01:42.883691+0000","last_clean":"2023-12-16T00:01:42.883691+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883691+0000","last_undegraded":"2023-12-16T00:01:42.883691+0000","last_fullsized":"2023-12-16T00:01:42.883691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831103+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831103+0000","last_peered":"2023-12-16T00:00:51.831103+0000","last_clean":"2023-12-16T00:00:51.831103+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831103+0000","last_undegraded":"2023-12-16T00:00:51.831103+0000","last_fullsized":"2023-12-16T00:00:51.831103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288080+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:27.288080+0000","last_peered":"2023-12-16T00:00:27.288080+0000","last_clean":"2023-12-16T00:00:27.288080+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:27.288080+0000","last_undegraded":"2023-12-16T00:00:27.288080+0000","last_fullsized":"2023-12-16T00:00:27.288080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136400+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:28.136400+0000","last_peered":"2023-12-16T00:00:28.136400+0000","last_clean":"2023-12-16T00:00:28.136400+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:28.136400+0000","last_undegraded":"2023-12-16T00:00:28.136400+0000","last_fullsized":"2023-12-16T00:00:28.136400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136765+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:28.136765+0000","last_peered":"2023-12-16T00:00:28.136765+0000","last_clean":"2023-12-16T00:00:28.136765+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:28.136765+0000","last_undegraded":"2023-12-16T00:00:28.136765+0000","last_fullsized":"2023-12-16T00:00:28.136765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409073+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:35.409073+0000","last_peered":"2023-12-16T00:00:35.409073+0000","last_clean":"2023-12-16T00:00:35.409073+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:35.409073+0000","last_undegraded":"2023-12-16T00:00:35.409073+0000","last_fullsized":"2023-12-16T00:00:35.409073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999329+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999329+0000","last_peered":"2023-12-16T00:01:23.999329+0000","last_clean":"2023-12-16T00:01:23.999329+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999329+0000","last_undegraded":"2023-12-16T00:01:23.999329+0000","last_fullsized":"2023-12-16T00:01:23.999329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600905+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600905+0000","last_peered":"2023-12-16T00:02:25.600905+0000","last_clean":"2023-12-16T00:02:25.600905+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600905+0000","last_undegraded":"2023-12-16T00:02:25.600905+0000","last_fullsized":"2023-12-16T00:02:25.600905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'97","reported_seq":3978,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016793+0000","last_change":"2023-12-15T22:54:04.188784+0000","last_active":"2023-12-16T00:00:26.016793+0000","last_peered":"2023-12-16T00:00:26.016793+0000","last_clean":"2023-12-16T00:00:26.016793+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:00:26.016793+0000","last_undegraded":"2023-12-16T00:00:26.016793+0000","last_fullsized":"2023-12-16T00:00:26.016793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175678+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175678+0000","last_peered":"2023-12-16T00:01:32.175678+0000","last_clean":"2023-12-16T00:01:32.175678+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175678+0000","last_undegraded":"2023-12-16T00:01:32.175678+0000","last_fullsized":"2023-12-16T00:01:32.175678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2432,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989730+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989730+0000","last_peered":"2023-12-16T00:00:45.989730+0000","last_clean":"2023-12-16T00:00:45.989730+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989730+0000","last_undegraded":"2023-12-16T00:00:45.989730+0000","last_fullsized":"2023-12-16T00:00:45.989730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711383+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:27.711383+0000","last_peered":"2023-12-16T00:00:27.711383+0000","last_clean":"2023-12-16T00:00:27.711383+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:27.711383+0000","last_undegraded":"2023-12-16T00:00:27.711383+0000","last_fullsized":"2023-12-16T00:00:27.711383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136427+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:28.136427+0000","last_peered":"2023-12-16T00:00:28.136427+0000","last_clean":"2023-12-16T00:00:28.136427+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:28.136427+0000","last_undegraded":"2023-12-16T00:00:28.136427+0000","last_fullsized":"2023-12-16T00:00:28.136427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"49'3","reported_seq":284,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864389+0000","last_change":"2023-12-15T22:53:04.316300+0000","last_active":"2023-12-16T00:00:26.864389+0000","last_peered":"2023-12-16T00:00:26.864389+0000","last_clean":"2023-12-16T00:00:26.864389+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:00:26.864389+0000","last_undegraded":"2023-12-16T00:00:26.864389+0000","last_fullsized":"2023-12-16T00:00:26.864389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137037+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137037+0000","last_peered":"2023-12-16T00:02:18.137037+0000","last_clean":"2023-12-16T00:02:18.137037+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137037+0000","last_undegraded":"2023-12-16T00:02:18.137037+0000","last_fullsized":"2023-12-16T00:02:18.137037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289289+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:27.289289+0000","last_peered":"2023-12-16T00:00:27.289289+0000","last_clean":"2023-12-16T00:00:27.289289+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:27.289289+0000","last_undegraded":"2023-12-16T00:00:27.289289+0000","last_fullsized":"2023-12-16T00:00:27.289289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136577+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:28.136577+0000","last_peered":"2023-12-16T00:00:28.136577+0000","last_clean":"2023-12-16T00:00:28.136577+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:28.136577+0000","last_undegraded":"2023-12-16T00:00:28.136577+0000","last_fullsized":"2023-12-16T00:00:28.136577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287840+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:27.287840+0000","last_peered":"2023-12-16T00:00:27.287840+0000","last_clean":"2023-12-16T00:00:27.287840+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:27.287840+0000","last_undegraded":"2023-12-16T00:00:27.287840+0000","last_fullsized":"2023-12-16T00:00:27.287840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611799+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611799+0000","last_peered":"2023-12-16T00:02:31.611799+0000","last_clean":"2023-12-16T00:02:31.611799+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611799+0000","last_undegraded":"2023-12-16T00:02:31.611799+0000","last_fullsized":"2023-12-16T00:02:31.611799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'88","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288358+0000","last_change":"2023-12-15T22:53:06.319704+0000","last_active":"2023-12-16T00:00:27.288358+0000","last_peered":"2023-12-16T00:00:27.288358+0000","last_clean":"2023-12-16T00:00:27.288358+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:00:27.288358+0000","last_undegraded":"2023-12-16T00:00:27.288358+0000","last_fullsized":"2023-12-16T00:00:27.288358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865330+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:26.865330+0000","last_peered":"2023-12-16T00:00:26.865330+0000","last_clean":"2023-12-16T00:00:26.865330+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:26.865330+0000","last_undegraded":"2023-12-16T00:00:26.865330+0000","last_fullsized":"2023-12-16T00:00:26.865330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1266,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402060+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402060+0000","last_peered":"2023-12-16T00:02:32.402060+0000","last_clean":"2023-12-16T00:02:32.402060+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402060+0000","last_undegraded":"2023-12-16T00:02:32.402060+0000","last_fullsized":"2023-12-16T00:02:32.402060+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015927+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:26.015927+0000","last_peered":"2023-12-16T00:00:26.015927+0000","last_clean":"2023-12-16T00:00:26.015927+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:26.015927+0000","last_undegraded":"2023-12-16T00:00:26.015927+0000","last_fullsized":"2023-12-16T00:00:26.015927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136335+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:28.136335+0000","last_peered":"2023-12-16T00:00:28.136335+0000","last_clean":"2023-12-16T00:00:28.136335+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:28.136335+0000","last_undegraded":"2023-12-16T00:00:28.136335+0000","last_fullsized":"2023-12-16T00:00:28.136335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'54","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016065+0000","last_change":"2023-12-15T22:53:06.321780+0000","last_active":"2023-12-16T00:00:26.016065+0000","last_peered":"2023-12-16T00:00:26.016065+0000","last_clean":"2023-12-16T00:00:26.016065+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:00:26.016065+0000","last_undegraded":"2023-12-16T00:00:26.016065+0000","last_fullsized":"2023-12-16T00:00:26.016065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440823+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:26.440823+0000","last_peered":"2023-12-16T00:00:26.440823+0000","last_clean":"2023-12-16T00:00:26.440823+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:26.440823+0000","last_undegraded":"2023-12-16T00:00:26.440823+0000","last_fullsized":"2023-12-16T00:00:26.440823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745075+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745075+0000","last_peered":"2023-12-16T00:01:28.745075+0000","last_clean":"2023-12-16T00:01:28.745075+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745075+0000","last_undegraded":"2023-12-16T00:01:28.745075+0000","last_fullsized":"2023-12-16T00:01:28.745075+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334191+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334191+0000","last_peered":"2023-12-16T00:02:27.334191+0000","last_clean":"2023-12-16T00:02:27.334191+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334191+0000","last_undegraded":"2023-12-16T00:02:27.334191+0000","last_fullsized":"2023-12-16T00:02:27.334191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711314+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:27.711314+0000","last_peered":"2023-12-16T00:00:27.711314+0000","last_clean":"2023-12-16T00:00:27.711314+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:27.711314+0000","last_undegraded":"2023-12-16T00:00:27.711314+0000","last_fullsized":"2023-12-16T00:00:27.711314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439680+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:26.439680+0000","last_peered":"2023-12-16T00:00:26.439680+0000","last_clean":"2023-12-16T00:00:26.439680+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:26.439680+0000","last_undegraded":"2023-12-16T00:00:26.439680+0000","last_fullsized":"2023-12-16T00:00:26.439680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864493+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:26.864493+0000","last_peered":"2023-12-16T00:00:26.864493+0000","last_clean":"2023-12-16T00:00:26.864493+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:26.864493+0000","last_undegraded":"2023-12-16T00:00:26.864493+0000","last_fullsized":"2023-12-16T00:00:26.864493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711661+0000","last_change":"2023-12-15T22:53:06.321072+0000","last_active":"2023-12-16T00:00:27.711661+0000","last_peered":"2023-12-16T00:00:27.711661+0000","last_clean":"2023-12-16T00:00:27.711661+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:00:27.711661+0000","last_undegraded":"2023-12-16T00:00:27.711661+0000","last_fullsized":"2023-12-16T00:00:27.711661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251660+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251660+0000","last_peered":"2023-12-16T00:02:37.251660+0000","last_clean":"2023-12-16T00:02:37.251660+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251660+0000","last_undegraded":"2023-12-16T00:02:37.251660+0000","last_fullsized":"2023-12-16T00:02:37.251660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016918+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:26.016918+0000","last_peered":"2023-12-16T00:00:26.016918+0000","last_clean":"2023-12-16T00:00:26.016918+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:26.016918+0000","last_undegraded":"2023-12-16T00:00:26.016918+0000","last_fullsized":"2023-12-16T00:00:26.016918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288152+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:27.288152+0000","last_peered":"2023-12-16T00:00:27.288152+0000","last_clean":"2023-12-16T00:00:27.288152+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:27.288152+0000","last_undegraded":"2023-12-16T00:00:27.288152+0000","last_fullsized":"2023-12-16T00:00:27.288152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327899+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327899+0000","last_peered":"2023-12-16T00:02:35.327899+0000","last_clean":"2023-12-16T00:02:35.327899+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327899+0000","last_undegraded":"2023-12-16T00:02:35.327899+0000","last_fullsized":"2023-12-16T00:02:35.327899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":223,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580112+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580112+0000","last_peered":"2023-12-16T00:02:28.580112+0000","last_clean":"2023-12-16T00:02:28.580112+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580112+0000","last_undegraded":"2023-12-16T00:02:28.580112+0000","last_fullsized":"2023-12-16T00:02:28.580112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674592+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674592+0000","last_peered":"2023-12-16T00:02:10.674592+0000","last_clean":"2023-12-16T00:02:10.674592+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674592+0000","last_undegraded":"2023-12-16T00:02:10.674592+0000","last_fullsized":"2023-12-16T00:02:10.674592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289309+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:27.289309+0000","last_peered":"2023-12-16T00:00:27.289309+0000","last_clean":"2023-12-16T00:00:27.289309+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:27.289309+0000","last_undegraded":"2023-12-16T00:00:27.289309+0000","last_fullsized":"2023-12-16T00:00:27.289309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'105","reported_seq":3439,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289206+0000","last_change":"2023-12-15T22:54:04.178601+0000","last_active":"2023-12-16T00:00:27.289206+0000","last_peered":"2023-12-16T00:00:27.289206+0000","last_clean":"2023-12-16T00:00:27.289206+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:00:27.289206+0000","last_undegraded":"2023-12-16T00:00:27.289206+0000","last_fullsized":"2023-12-16T00:00:27.289206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522168+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522168+0000","last_peered":"2023-12-16T00:02:28.522168+0000","last_clean":"2023-12-16T00:02:28.522168+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522168+0000","last_undegraded":"2023-12-16T00:02:28.522168+0000","last_fullsized":"2023-12-16T00:02:28.522168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033890+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033890+0000","last_peered":"2023-12-16T00:01:34.033890+0000","last_clean":"2023-12-16T00:01:34.033890+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033890+0000","last_undegraded":"2023-12-16T00:01:34.033890+0000","last_fullsized":"2023-12-16T00:01:34.033890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711349+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:27.711349+0000","last_peered":"2023-12-16T00:00:27.711349+0000","last_clean":"2023-12-16T00:00:27.711349+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:27.711349+0000","last_undegraded":"2023-12-16T00:00:27.711349+0000","last_fullsized":"2023-12-16T00:00:27.711349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711244+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:27.711244+0000","last_peered":"2023-12-16T00:00:27.711244+0000","last_clean":"2023-12-16T00:00:27.711244+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:27.711244+0000","last_undegraded":"2023-12-16T00:00:27.711244+0000","last_fullsized":"2023-12-16T00:00:27.711244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136780+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:28.136780+0000","last_peered":"2023-12-16T00:00:28.136780+0000","last_clean":"2023-12-16T00:00:28.136780+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:28.136780+0000","last_undegraded":"2023-12-16T00:00:28.136780+0000","last_fullsized":"2023-12-16T00:00:28.136780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159310+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159310+0000","last_peered":"2023-12-16T00:02:24.159310+0000","last_clean":"2023-12-16T00:02:24.159310+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159310+0000","last_undegraded":"2023-12-16T00:02:24.159310+0000","last_fullsized":"2023-12-16T00:02:24.159310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560230+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560230+0000","last_peered":"2023-12-16T00:02:16.560230+0000","last_clean":"2023-12-16T00:02:16.560230+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560230+0000","last_undegraded":"2023-12-16T00:02:16.560230+0000","last_fullsized":"2023-12-16T00:02:16.560230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440836+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:26.440836+0000","last_peered":"2023-12-16T00:00:26.440836+0000","last_clean":"2023-12-16T00:00:26.440836+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:26.440836+0000","last_undegraded":"2023-12-16T00:00:26.440836+0000","last_fullsized":"2023-12-16T00:00:26.440836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1804,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043084+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043084+0000","last_peered":"2023-12-16T00:02:18.043084+0000","last_clean":"2023-12-16T00:02:18.043084+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043084+0000","last_undegraded":"2023-12-16T00:02:18.043084+0000","last_fullsized":"2023-12-16T00:02:18.043084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439849+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439849+0000","last_peered":"2023-12-16T00:02:00.439849+0000","last_clean":"2023-12-16T00:02:00.439849+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439849+0000","last_undegraded":"2023-12-16T00:02:00.439849+0000","last_fullsized":"2023-12-16T00:02:00.439849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984524+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984524+0000","last_peered":"2023-12-16T00:01:24.984524+0000","last_clean":"2023-12-16T00:01:24.984524+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984524+0000","last_undegraded":"2023-12-16T00:01:24.984524+0000","last_fullsized":"2023-12-16T00:01:24.984524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439903+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:26.439903+0000","last_peered":"2023-12-16T00:00:26.439903+0000","last_clean":"2023-12-16T00:00:26.439903+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:26.439903+0000","last_undegraded":"2023-12-16T00:00:26.439903+0000","last_fullsized":"2023-12-16T00:00:26.439903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288269+0000","last_change":"2023-12-15T22:53:04.318693+0000","last_active":"2023-12-16T00:00:27.288269+0000","last_peered":"2023-12-16T00:00:27.288269+0000","last_clean":"2023-12-16T00:00:27.288269+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:00:27.288269+0000","last_undegraded":"2023-12-16T00:00:27.288269+0000","last_fullsized":"2023-12-16T00:00:27.288269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'103","reported_seq":227,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136908+0000","last_change":"2023-12-15T22:53:06.320794+0000","last_active":"2023-12-16T00:00:28.136908+0000","last_peered":"2023-12-16T00:00:28.136908+0000","last_clean":"2023-12-16T00:00:28.136908+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:00:28.136908+0000","last_undegraded":"2023-12-16T00:00:28.136908+0000","last_fullsized":"2023-12-16T00:00:28.136908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416130+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416130+0000","last_peered":"2023-12-16T00:01:53.416130+0000","last_clean":"2023-12-16T00:01:53.416130+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416130+0000","last_undegraded":"2023-12-16T00:01:53.416130+0000","last_fullsized":"2023-12-16T00:01:53.416130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865431+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:26.865431+0000","last_peered":"2023-12-16T00:00:26.865431+0000","last_clean":"2023-12-16T00:00:26.865431+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:26.865431+0000","last_undegraded":"2023-12-16T00:00:26.865431+0000","last_fullsized":"2023-12-16T00:00:26.865431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707263+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707263+0000","last_peered":"2023-12-16T00:02:10.707263+0000","last_clean":"2023-12-16T00:02:10.707263+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707263+0000","last_undegraded":"2023-12-16T00:02:10.707263+0000","last_fullsized":"2023-12-16T00:02:10.707263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682626+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682626+0000","last_peered":"2023-12-16T00:01:33.682626+0000","last_clean":"2023-12-16T00:01:33.682626+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682626+0000","last_undegraded":"2023-12-16T00:01:33.682626+0000","last_fullsized":"2023-12-16T00:01:33.682626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975152+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975152+0000","last_peered":"2023-12-16T00:01:38.975152+0000","last_clean":"2023-12-16T00:01:38.975152+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975152+0000","last_undegraded":"2023-12-16T00:01:38.975152+0000","last_fullsized":"2023-12-16T00:01:38.975152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288113+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288113+0000","last_peered":"2023-12-16T00:00:27.288113+0000","last_clean":"2023-12-16T00:00:27.288113+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:00:27.288113+0000","last_undegraded":"2023-12-16T00:00:27.288113+0000","last_fullsized":"2023-12-16T00:00:27.288113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711551+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-16T00:00:27.711551+0000","last_peered":"2023-12-16T00:00:27.711551+0000","last_clean":"2023-12-16T00:00:27.711551+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:00:27.711551+0000","last_undegraded":"2023-12-16T00:00:27.711551+0000","last_fullsized":"2023-12-16T00:00:27.711551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136858+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:28.136858+0000","last_peered":"2023-12-16T00:00:28.136858+0000","last_clean":"2023-12-16T00:00:28.136858+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:28.136858+0000","last_undegraded":"2023-12-16T00:00:28.136858+0000","last_fullsized":"2023-12-16T00:00:28.136858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016161+0000","last_change":"2023-12-15T22:53:08.335872+0000","last_active":"2023-12-16T00:00:26.016161+0000","last_peered":"2023-12-16T00:00:26.016161+0000","last_clean":"2023-12-16T00:00:26.016161+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:00:26.016161+0000","last_undegraded":"2023-12-16T00:00:26.016161+0000","last_fullsized":"2023-12-16T00:00:26.016161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289308+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:27.289308+0000","last_peered":"2023-12-16T00:00:27.289308+0000","last_clean":"2023-12-16T00:00:27.289308+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:27.289308+0000","last_undegraded":"2023-12-16T00:00:27.289308+0000","last_fullsized":"2023-12-16T00:00:27.289308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1586,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520628+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520628+0000","last_peered":"2023-12-16T00:02:25.520628+0000","last_clean":"2023-12-16T00:02:25.520628+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520628+0000","last_undegraded":"2023-12-16T00:02:25.520628+0000","last_fullsized":"2023-12-16T00:02:25.520628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189597+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189597+0000","last_peered":"2023-12-16T00:02:22.189597+0000","last_clean":"2023-12-16T00:02:22.189597+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189597+0000","last_undegraded":"2023-12-16T00:02:22.189597+0000","last_fullsized":"2023-12-16T00:02:22.189597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693630+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693630+0000","last_peered":"2023-12-16T00:01:41.693630+0000","last_clean":"2023-12-16T00:01:41.693630+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693630+0000","last_undegraded":"2023-12-16T00:01:41.693630+0000","last_fullsized":"2023-12-16T00:01:41.693630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3371,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.447098+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:43.447098+0000","last_peered":"2023-12-16T00:00:43.447098+0000","last_clean":"2023-12-16T00:00:43.447098+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:43.447098+0000","last_undegraded":"2023-12-16T00:00:43.447098+0000","last_fullsized":"2023-12-16T00:00:43.447098+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439858+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-16T00:00:26.439858+0000","last_peered":"2023-12-16T00:00:26.439858+0000","last_clean":"2023-12-16T00:00:26.439858+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:00:26.439858+0000","last_undegraded":"2023-12-16T00:00:26.439858+0000","last_fullsized":"2023-12-16T00:00:26.439858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136318+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:28.136318+0000","last_peered":"2023-12-16T00:00:28.136318+0000","last_clean":"2023-12-16T00:00:28.136318+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:28.136318+0000","last_undegraded":"2023-12-16T00:00:28.136318+0000","last_fullsized":"2023-12-16T00:00:28.136318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015932+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:26.015932+0000","last_peered":"2023-12-16T00:00:26.015932+0000","last_clean":"2023-12-16T00:00:26.015932+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:26.015932+0000","last_undegraded":"2023-12-16T00:00:26.015932+0000","last_fullsized":"2023-12-16T00:00:26.015932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137671+0000","last_change":"2023-12-15T22:53:58.171938+0000","last_active":"2023-12-16T00:00:28.137671+0000","last_peered":"2023-12-16T00:00:28.137671+0000","last_clean":"2023-12-16T00:00:28.137671+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:00:28.137671+0000","last_undegraded":"2023-12-16T00:00:28.137671+0000","last_fullsized":"2023-12-16T00:00:28.137671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478525+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478525+0000","last_peered":"2023-12-16T00:02:02.478525+0000","last_clean":"2023-12-16T00:02:02.478525+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478525+0000","last_undegraded":"2023-12-16T00:02:02.478525+0000","last_fullsized":"2023-12-16T00:02:02.478525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790128+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790128+0000","last_peered":"2023-12-16T00:01:16.790128+0000","last_clean":"2023-12-16T00:01:16.790128+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790128+0000","last_undegraded":"2023-12-16T00:01:16.790128+0000","last_fullsized":"2023-12-16T00:01:16.790128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1419,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174535+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174535+0000","last_peered":"2023-12-16T00:01:31.174535+0000","last_clean":"2023-12-16T00:01:31.174535+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174535+0000","last_undegraded":"2023-12-16T00:01:31.174535+0000","last_fullsized":"2023-12-16T00:01:31.174535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007421+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007421+0000","last_peered":"2023-12-16T00:01:15.007421+0000","last_clean":"2023-12-16T00:01:15.007421+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007421+0000","last_undegraded":"2023-12-16T00:01:15.007421+0000","last_fullsized":"2023-12-16T00:01:15.007421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439851+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:26.439851+0000","last_peered":"2023-12-16T00:00:26.439851+0000","last_clean":"2023-12-16T00:00:26.439851+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:26.439851+0000","last_undegraded":"2023-12-16T00:00:26.439851+0000","last_fullsized":"2023-12-16T00:00:26.439851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711293+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:27.711293+0000","last_peered":"2023-12-16T00:00:27.711293+0000","last_clean":"2023-12-16T00:00:27.711293+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:27.711293+0000","last_undegraded":"2023-12-16T00:00:27.711293+0000","last_fullsized":"2023-12-16T00:00:27.711293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439585+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:00:26.439585+0000","last_peered":"2023-12-16T00:00:26.439585+0000","last_clean":"2023-12-16T00:00:26.439585+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:00:26.439585+0000","last_undegraded":"2023-12-16T00:00:26.439585+0000","last_fullsized":"2023-12-16T00:00:26.439585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'91","reported_seq":926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136830+0000","last_change":"2023-12-15T22:53:06.323503+0000","last_active":"2023-12-16T00:00:28.136830+0000","last_peered":"2023-12-16T00:00:28.136830+0000","last_clean":"2023-12-16T00:00:28.136830+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:00:28.136830+0000","last_undegraded":"2023-12-16T00:00:28.136830+0000","last_fullsized":"2023-12-16T00:00:28.136830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243276+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243276+0000","last_peered":"2023-12-16T00:01:47.243276+0000","last_clean":"2023-12-16T00:01:47.243276+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243276+0000","last_undegraded":"2023-12-16T00:01:47.243276+0000","last_fullsized":"2023-12-16T00:01:47.243276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712554+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:27.712554+0000","last_peered":"2023-12-16T00:00:27.712554+0000","last_clean":"2023-12-16T00:00:27.712554+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:27.712554+0000","last_undegraded":"2023-12-16T00:00:27.712554+0000","last_fullsized":"2023-12-16T00:00:27.712554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160204+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160204+0000","last_peered":"2023-12-16T00:02:44.160204+0000","last_clean":"2023-12-16T00:02:44.160204+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160204+0000","last_undegraded":"2023-12-16T00:02:44.160204+0000","last_fullsized":"2023-12-16T00:02:44.160204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012653+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012653+0000","last_peered":"2023-12-16T00:02:14.012653+0000","last_clean":"2023-12-16T00:02:14.012653+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012653+0000","last_undegraded":"2023-12-16T00:02:14.012653+0000","last_fullsized":"2023-12-16T00:02:14.012653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1474,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861451+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861451+0000","last_peered":"2023-12-16T00:01:34.861451+0000","last_clean":"2023-12-16T00:01:34.861451+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861451+0000","last_undegraded":"2023-12-16T00:01:34.861451+0000","last_fullsized":"2023-12-16T00:01:34.861451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185657+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185657+0000","last_peered":"2023-12-16T00:01:12.185657+0000","last_clean":"2023-12-16T00:01:12.185657+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185657+0000","last_undegraded":"2023-12-16T00:01:12.185657+0000","last_fullsized":"2023-12-16T00:01:12.185657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015799+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:26.015799+0000","last_peered":"2023-12-16T00:00:26.015799+0000","last_clean":"2023-12-16T00:00:26.015799+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:26.015799+0000","last_undegraded":"2023-12-16T00:00:26.015799+0000","last_fullsized":"2023-12-16T00:00:26.015799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439568+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:26.439568+0000","last_peered":"2023-12-16T00:00:26.439568+0000","last_clean":"2023-12-16T00:00:26.439568+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:26.439568+0000","last_undegraded":"2023-12-16T00:00:26.439568+0000","last_fullsized":"2023-12-16T00:00:26.439568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":293,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136755+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:28.136755+0000","last_peered":"2023-12-16T00:00:28.136755+0000","last_clean":"2023-12-16T00:00:28.136755+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:28.136755+0000","last_undegraded":"2023-12-16T00:00:28.136755+0000","last_fullsized":"2023-12-16T00:00:28.136755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":990,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196219+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196219+0000","last_peered":"2023-12-16T00:02:25.196219+0000","last_clean":"2023-12-16T00:02:25.196219+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196219+0000","last_undegraded":"2023-12-16T00:02:25.196219+0000","last_fullsized":"2023-12-16T00:02:25.196219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1257,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016835+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-16T00:00:26.016835+0000","last_peered":"2023-12-16T00:00:26.016835+0000","last_clean":"2023-12-16T00:00:26.016835+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:00:26.016835+0000","last_undegraded":"2023-12-16T00:00:26.016835+0000","last_fullsized":"2023-12-16T00:00:26.016835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947140+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947140+0000","last_peered":"2023-12-16T00:01:30.947140+0000","last_clean":"2023-12-16T00:01:30.947140+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947140+0000","last_undegraded":"2023-12-16T00:01:30.947140+0000","last_fullsized":"2023-12-16T00:01:30.947140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874738+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874738+0000","last_peered":"2023-12-16T00:01:08.874738+0000","last_clean":"2023-12-16T00:01:08.874738+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874738+0000","last_undegraded":"2023-12-16T00:01:08.874738+0000","last_fullsized":"2023-12-16T00:01:08.874738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644838+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644838+0000","last_peered":"2023-12-16T00:01:58.644838+0000","last_clean":"2023-12-16T00:01:58.644838+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644838+0000","last_undegraded":"2023-12-16T00:01:58.644838+0000","last_fullsized":"2023-12-16T00:01:58.644838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711361+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-16T00:00:27.711361+0000","last_peered":"2023-12-16T00:00:27.711361+0000","last_clean":"2023-12-16T00:00:27.711361+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:00:27.711361+0000","last_undegraded":"2023-12-16T00:00:27.711361+0000","last_fullsized":"2023-12-16T00:00:27.711361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439586+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:26.439586+0000","last_peered":"2023-12-16T00:00:26.439586+0000","last_clean":"2023-12-16T00:00:26.439586+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:26.439586+0000","last_undegraded":"2023-12-16T00:00:26.439586+0000","last_fullsized":"2023-12-16T00:00:26.439586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"49'1","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864376+0000","last_change":"2023-12-15T22:53:04.319165+0000","last_active":"2023-12-16T00:00:26.864376+0000","last_peered":"2023-12-16T00:00:26.864376+0000","last_clean":"2023-12-16T00:00:26.864376+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:00:26.864376+0000","last_undegraded":"2023-12-16T00:00:26.864376+0000","last_fullsized":"2023-12-16T00:00:26.864376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'88","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711655+0000","last_change":"2023-12-15T22:53:06.323158+0000","last_active":"2023-12-16T00:00:27.711655+0000","last_peered":"2023-12-16T00:00:27.711655+0000","last_clean":"2023-12-16T00:00:27.711655+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:00:27.711655+0000","last_undegraded":"2023-12-16T00:00:27.711655+0000","last_fullsized":"2023-12-16T00:00:27.711655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662975+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662975+0000","last_peered":"2023-12-16T00:02:16.662975+0000","last_clean":"2023-12-16T00:02:16.662975+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662975+0000","last_undegraded":"2023-12-16T00:02:16.662975+0000","last_fullsized":"2023-12-16T00:02:16.662975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722628+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722628+0000","last_peered":"2023-12-16T00:01:26.722628+0000","last_clean":"2023-12-16T00:01:26.722628+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722628+0000","last_undegraded":"2023-12-16T00:01:26.722628+0000","last_fullsized":"2023-12-16T00:01:26.722628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865369+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:26.865369+0000","last_peered":"2023-12-16T00:00:26.865369+0000","last_clean":"2023-12-16T00:00:26.865369+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:26.865369+0000","last_undegraded":"2023-12-16T00:00:26.865369+0000","last_fullsized":"2023-12-16T00:00:26.865369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5896,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289225+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-16T00:00:27.289225+0000","last_peered":"2023-12-16T00:00:27.289225+0000","last_clean":"2023-12-16T00:00:27.289225+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:00:27.289225+0000","last_undegraded":"2023-12-16T00:00:27.289225+0000","last_fullsized":"2023-12-16T00:00:27.289225+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326922+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326922+0000","last_peered":"2023-12-16T00:02:24.326922+0000","last_clean":"2023-12-16T00:02:24.326922+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326922+0000","last_undegraded":"2023-12-16T00:02:24.326922+0000","last_fullsized":"2023-12-16T00:02:24.326922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840119+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840119+0000","last_peered":"2023-12-16T00:01:10.840119+0000","last_clean":"2023-12-16T00:01:10.840119+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840119+0000","last_undegraded":"2023-12-16T00:01:10.840119+0000","last_fullsized":"2023-12-16T00:01:10.840119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228196+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228196+0000","last_peered":"2023-12-16T00:01:37.228196+0000","last_clean":"2023-12-16T00:01:37.228196+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228196+0000","last_undegraded":"2023-12-16T00:01:37.228196+0000","last_fullsized":"2023-12-16T00:01:37.228196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288256+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-16T00:00:27.288256+0000","last_peered":"2023-12-16T00:00:27.288256+0000","last_clean":"2023-12-16T00:00:27.288256+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:00:27.288256+0000","last_undegraded":"2023-12-16T00:00:27.288256+0000","last_fullsized":"2023-12-16T00:00:27.288256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453503+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453503+0000","last_peered":"2023-12-16T00:02:34.453503+0000","last_clean":"2023-12-16T00:02:34.453503+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453503+0000","last_undegraded":"2023-12-16T00:02:34.453503+0000","last_fullsized":"2023-12-16T00:02:34.453503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116738+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116738+0000","last_peered":"2023-12-16T00:02:44.116738+0000","last_clean":"2023-12-16T00:02:44.116738+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116738+0000","last_undegraded":"2023-12-16T00:02:44.116738+0000","last_fullsized":"2023-12-16T00:02:44.116738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199772+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199772+0000","last_peered":"2023-12-16T00:01:34.199772+0000","last_clean":"2023-12-16T00:01:34.199772+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199772+0000","last_undegraded":"2023-12-16T00:01:34.199772+0000","last_fullsized":"2023-12-16T00:01:34.199772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865353+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:26.865353+0000","last_peered":"2023-12-16T00:00:26.865353+0000","last_clean":"2023-12-16T00:00:26.865353+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:26.865353+0000","last_undegraded":"2023-12-16T00:00:26.865353+0000","last_fullsized":"2023-12-16T00:00:26.865353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629203+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629203+0000","last_peered":"2023-12-16T00:01:50.629203+0000","last_clean":"2023-12-16T00:01:50.629203+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629203+0000","last_undegraded":"2023-12-16T00:01:50.629203+0000","last_fullsized":"2023-12-16T00:01:50.629203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339046+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339046+0000","last_peered":"2023-12-16T00:02:33.339046+0000","last_clean":"2023-12-16T00:02:33.339046+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339046+0000","last_undegraded":"2023-12-16T00:02:33.339046+0000","last_fullsized":"2023-12-16T00:02:33.339046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921170+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921170+0000","last_peered":"2023-12-16T00:01:43.921170+0000","last_clean":"2023-12-16T00:01:43.921170+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921170+0000","last_undegraded":"2023-12-16T00:01:43.921170+0000","last_fullsized":"2023-12-16T00:01:43.921170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136732+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-16T00:00:28.136732+0000","last_peered":"2023-12-16T00:00:28.136732+0000","last_clean":"2023-12-16T00:00:28.136732+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:00:28.136732+0000","last_undegraded":"2023-12-16T00:00:28.136732+0000","last_fullsized":"2023-12-16T00:00:28.136732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.355963+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.355963+0000","last_peered":"2023-12-16T00:02:33.355963+0000","last_clean":"2023-12-16T00:02:33.355963+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.355963+0000","last_undegraded":"2023-12-16T00:02:33.355963+0000","last_fullsized":"2023-12-16T00:02:33.355963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'12","reported_seq":802,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136932+0000","last_change":"2023-12-15T22:53:08.333055+0000","last_active":"2023-12-16T00:00:28.136932+0000","last_peered":"2023-12-16T00:00:28.136932+0000","last_clean":"2023-12-16T00:00:28.136932+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:00:28.136932+0000","last_undegraded":"2023-12-16T00:00:28.136932+0000","last_fullsized":"2023-12-16T00:00:28.136932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:07.313122+0000","last_clean_scrub_stamp":"2023-12-15T22:53:07.313122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307393+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307393+0000","last_peered":"2023-12-16T00:01:26.307393+0000","last_clean":"2023-12-16T00:01:26.307393+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307393+0000","last_undegraded":"2023-12-16T00:01:26.307393+0000","last_fullsized":"2023-12-16T00:01:26.307393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137941+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:28.137941+0000","last_peered":"2023-12-16T00:00:28.137941+0000","last_clean":"2023-12-16T00:00:28.137941+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:28.137941+0000","last_undegraded":"2023-12-16T00:00:28.137941+0000","last_fullsized":"2023-12-16T00:00:28.137941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'100","reported_seq":3513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016825+0000","last_change":"2023-12-15T22:54:04.186789+0000","last_active":"2023-12-16T00:00:26.016825+0000","last_peered":"2023-12-16T00:00:26.016825+0000","last_clean":"2023-12-16T00:00:26.016825+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:00:26.016825+0000","last_undegraded":"2023-12-16T00:00:26.016825+0000","last_fullsized":"2023-12-16T00:00:26.016825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396521+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396521+0000","last_peered":"2023-12-16T00:01:59.396521+0000","last_clean":"2023-12-16T00:01:59.396521+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396521+0000","last_undegraded":"2023-12-16T00:01:59.396521+0000","last_fullsized":"2023-12-16T00:01:59.396521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950181+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950181+0000","last_peered":"2023-12-16T00:01:28.950181+0000","last_clean":"2023-12-16T00:01:28.950181+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950181+0000","last_undegraded":"2023-12-16T00:01:28.950181+0000","last_fullsized":"2023-12-16T00:01:28.950181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016027+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-16T00:00:26.016027+0000","last_peered":"2023-12-16T00:00:26.016027+0000","last_clean":"2023-12-16T00:00:26.016027+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:00:26.016027+0000","last_undegraded":"2023-12-16T00:00:26.016027+0000","last_fullsized":"2023-12-16T00:00:26.016027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561074+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561074+0000","last_peered":"2023-12-16T00:02:30.561074+0000","last_clean":"2023-12-16T00:02:30.561074+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561074+0000","last_undegraded":"2023-12-16T00:02:30.561074+0000","last_fullsized":"2023-12-16T00:02:30.561074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255222+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255222+0000","last_peered":"2023-12-16T00:01:28.255222+0000","last_clean":"2023-12-16T00:01:28.255222+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255222+0000","last_undegraded":"2023-12-16T00:01:28.255222+0000","last_fullsized":"2023-12-16T00:01:28.255222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6351,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137904+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:28.137904+0000","last_peered":"2023-12-16T00:00:28.137904+0000","last_clean":"2023-12-16T00:00:28.137904+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:28.137904+0000","last_undegraded":"2023-12-16T00:00:28.137904+0000","last_fullsized":"2023-12-16T00:00:28.137904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112882+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112882+0000","last_peered":"2023-12-16T00:02:08.112882+0000","last_clean":"2023-12-16T00:02:08.112882+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112882+0000","last_undegraded":"2023-12-16T00:02:08.112882+0000","last_fullsized":"2023-12-16T00:02:08.112882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676120+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676120+0000","last_peered":"2023-12-16T00:01:30.676120+0000","last_clean":"2023-12-16T00:01:30.676120+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676120+0000","last_undegraded":"2023-12-16T00:01:30.676120+0000","last_fullsized":"2023-12-16T00:01:30.676120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711372+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:27.711372+0000","last_peered":"2023-12-16T00:00:27.711372+0000","last_clean":"2023-12-16T00:00:27.711372+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:27.711372+0000","last_undegraded":"2023-12-16T00:00:27.711372+0000","last_fullsized":"2023-12-16T00:00:27.711372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"49'8","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440026+0000","last_change":"2023-12-15T22:53:04.318019+0000","last_active":"2023-12-16T00:00:26.440026+0000","last_peered":"2023-12-16T00:00:26.440026+0000","last_clean":"2023-12-16T00:00:26.440026+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:00:26.440026+0000","last_undegraded":"2023-12-16T00:00:26.440026+0000","last_fullsized":"2023-12-16T00:00:26.440026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106608+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106608+0000","last_peered":"2023-12-16T00:02:12.106608+0000","last_clean":"2023-12-16T00:02:12.106608+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106608+0000","last_undegraded":"2023-12-16T00:02:12.106608+0000","last_fullsized":"2023-12-16T00:02:12.106608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6517,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437404+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437404+0000","last_peered":"2023-12-16T00:02:40.437404+0000","last_clean":"2023-12-16T00:02:40.437404+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437404+0000","last_undegraded":"2023-12-16T00:02:40.437404+0000","last_fullsized":"2023-12-16T00:02:40.437404+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749627+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749627+0000","last_peered":"2023-12-16T00:01:43.749627+0000","last_clean":"2023-12-16T00:01:43.749627+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749627+0000","last_undegraded":"2023-12-16T00:01:43.749627+0000","last_fullsized":"2023-12-16T00:01:43.749627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357239+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357239+0000","last_peered":"2023-12-16T00:01:50.357239+0000","last_clean":"2023-12-16T00:01:50.357239+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357239+0000","last_undegraded":"2023-12-16T00:01:50.357239+0000","last_fullsized":"2023-12-16T00:01:50.357239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562911+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562911+0000","last_peered":"2023-12-16T00:02:45.562911+0000","last_clean":"2023-12-16T00:02:45.562911+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562911+0000","last_undegraded":"2023-12-16T00:02:45.562911+0000","last_fullsized":"2023-12-16T00:02:45.562911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439932+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:26.439932+0000","last_peered":"2023-12-16T00:00:26.439932+0000","last_clean":"2023-12-16T00:00:26.439932+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:26.439932+0000","last_undegraded":"2023-12-16T00:00:26.439932+0000","last_fullsized":"2023-12-16T00:00:26.439932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287929+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:27.287929+0000","last_peered":"2023-12-16T00:00:27.287929+0000","last_clean":"2023-12-16T00:00:27.287929+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:27.287929+0000","last_undegraded":"2023-12-16T00:00:27.287929+0000","last_fullsized":"2023-12-16T00:00:27.287929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364080+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364080+0000","last_peered":"2023-12-16T00:02:37.364080+0000","last_clean":"2023-12-16T00:02:37.364080+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364080+0000","last_undegraded":"2023-12-16T00:02:37.364080+0000","last_fullsized":"2023-12-16T00:02:37.364080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491847+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491847+0000","last_peered":"2023-12-16T00:02:33.491847+0000","last_clean":"2023-12-16T00:02:33.491847+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491847+0000","last_undegraded":"2023-12-16T00:02:33.491847+0000","last_fullsized":"2023-12-16T00:02:33.491847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168046+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168046+0000","last_peered":"2023-12-16T00:02:06.168046+0000","last_clean":"2023-12-16T00:02:06.168046+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168046+0000","last_undegraded":"2023-12-16T00:02:06.168046+0000","last_fullsized":"2023-12-16T00:02:06.168046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169539+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169539+0000","last_peered":"2023-12-16T00:02:23.169539+0000","last_clean":"2023-12-16T00:02:23.169539+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169539+0000","last_undegraded":"2023-12-16T00:02:23.169539+0000","last_fullsized":"2023-12-16T00:02:23.169539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283922+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283922+0000","last_peered":"2023-12-16T00:01:51.283922+0000","last_clean":"2023-12-16T00:01:51.283922+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283922+0000","last_undegraded":"2023-12-16T00:01:51.283922+0000","last_fullsized":"2023-12-16T00:01:51.283922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864191+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:26.864191+0000","last_peered":"2023-12-16T00:00:26.864191+0000","last_clean":"2023-12-16T00:00:26.864191+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:26.864191+0000","last_undegraded":"2023-12-16T00:00:26.864191+0000","last_fullsized":"2023-12-16T00:00:26.864191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136439+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:28.136439+0000","last_peered":"2023-12-16T00:00:28.136439+0000","last_clean":"2023-12-16T00:00:28.136439+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:28.136439+0000","last_undegraded":"2023-12-16T00:00:28.136439+0000","last_fullsized":"2023-12-16T00:00:28.136439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711553+0000","last_change":"2023-12-15T22:53:04.318957+0000","last_active":"2023-12-16T00:00:27.711553+0000","last_peered":"2023-12-16T00:00:27.711553+0000","last_clean":"2023-12-16T00:00:27.711553+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:00:27.711553+0000","last_undegraded":"2023-12-16T00:00:27.711553+0000","last_fullsized":"2023-12-16T00:00:27.711553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891956+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891956+0000","last_peered":"2023-12-16T00:01:51.891956+0000","last_clean":"2023-12-16T00:01:51.891956+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891956+0000","last_undegraded":"2023-12-16T00:01:51.891956+0000","last_fullsized":"2023-12-16T00:01:51.891956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850184+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850184+0000","last_peered":"2023-12-16T00:01:41.850184+0000","last_clean":"2023-12-16T00:01:41.850184+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850184+0000","last_undegraded":"2023-12-16T00:01:41.850184+0000","last_fullsized":"2023-12-16T00:01:41.850184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439919+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:26.439919+0000","last_peered":"2023-12-16T00:00:26.439919+0000","last_clean":"2023-12-16T00:00:26.439919+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:26.439919+0000","last_undegraded":"2023-12-16T00:00:26.439919+0000","last_fullsized":"2023-12-16T00:00:26.439919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015643+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:26.015643+0000","last_peered":"2023-12-16T00:00:26.015643+0000","last_clean":"2023-12-16T00:00:26.015643+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:26.015643+0000","last_undegraded":"2023-12-16T00:00:26.015643+0000","last_fullsized":"2023-12-16T00:00:26.015643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288285+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:27.288285+0000","last_peered":"2023-12-16T00:00:27.288285+0000","last_clean":"2023-12-16T00:00:27.288285+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:27.288285+0000","last_undegraded":"2023-12-16T00:00:27.288285+0000","last_fullsized":"2023-12-16T00:00:27.288285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219351+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219351+0000","last_peered":"2023-12-16T00:02:41.219351+0000","last_clean":"2023-12-16T00:02:41.219351+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219351+0000","last_undegraded":"2023-12-16T00:02:41.219351+0000","last_fullsized":"2023-12-16T00:02:41.219351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'89","reported_seq":3160,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289222+0000","last_change":"2023-12-15T22:54:04.179021+0000","last_active":"2023-12-16T00:00:27.289222+0000","last_peered":"2023-12-16T00:00:27.289222+0000","last_clean":"2023-12-16T00:00:27.289222+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:00:27.289222+0000","last_undegraded":"2023-12-16T00:00:27.289222+0000","last_fullsized":"2023-12-16T00:00:27.289222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207124+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207124+0000","last_peered":"2023-12-16T00:01:36.207124+0000","last_clean":"2023-12-16T00:01:36.207124+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207124+0000","last_undegraded":"2023-12-16T00:01:36.207124+0000","last_fullsized":"2023-12-16T00:01:36.207124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864046+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:26.864046+0000","last_peered":"2023-12-16T00:00:26.864046+0000","last_clean":"2023-12-16T00:00:26.864046+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:26.864046+0000","last_undegraded":"2023-12-16T00:00:26.864046+0000","last_fullsized":"2023-12-16T00:00:26.864046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329154+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329154+0000","last_peered":"2023-12-16T00:02:30.329154+0000","last_clean":"2023-12-16T00:02:30.329154+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329154+0000","last_undegraded":"2023-12-16T00:02:30.329154+0000","last_fullsized":"2023-12-16T00:02:30.329154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522822+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522822+0000","last_peered":"2023-12-16T00:02:20.522822+0000","last_clean":"2023-12-16T00:02:20.522822+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522822+0000","last_undegraded":"2023-12-16T00:02:20.522822+0000","last_fullsized":"2023-12-16T00:02:20.522822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202172+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202172+0000","last_peered":"2023-12-16T00:02:33.202172+0000","last_clean":"2023-12-16T00:02:33.202172+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202172+0000","last_undegraded":"2023-12-16T00:02:33.202172+0000","last_fullsized":"2023-12-16T00:02:33.202172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360890+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360890+0000","last_peered":"2023-12-16T00:02:21.360890+0000","last_clean":"2023-12-16T00:02:21.360890+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360890+0000","last_undegraded":"2023-12-16T00:02:21.360890+0000","last_fullsized":"2023-12-16T00:02:21.360890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902867+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902867+0000","last_peered":"2023-12-16T00:01:31.902867+0000","last_clean":"2023-12-16T00:01:31.902867+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902867+0000","last_undegraded":"2023-12-16T00:01:31.902867+0000","last_fullsized":"2023-12-16T00:01:31.902867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"41'3","reported_seq":554,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288294+0000","last_change":"2023-12-15T22:53:04.322471+0000","last_active":"2023-12-16T00:00:27.288294+0000","last_peered":"2023-12-16T00:00:27.288294+0000","last_clean":"2023-12-16T00:00:27.288294+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:00:27.288294+0000","last_undegraded":"2023-12-16T00:00:27.288294+0000","last_fullsized":"2023-12-16T00:00:27.288294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316713+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316713+0000","last_peered":"2023-12-16T00:02:39.316713+0000","last_clean":"2023-12-16T00:02:39.316713+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316713+0000","last_undegraded":"2023-12-16T00:02:39.316713+0000","last_fullsized":"2023-12-16T00:02:39.316713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087338+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087338+0000","last_peered":"2023-12-16T00:02:07.087338+0000","last_clean":"2023-12-16T00:02:07.087338+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087338+0000","last_undegraded":"2023-12-16T00:02:07.087338+0000","last_fullsized":"2023-12-16T00:02:07.087338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239262+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239262+0000","last_peered":"2023-12-16T00:01:35.239262+0000","last_clean":"2023-12-16T00:01:35.239262+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239262+0000","last_undegraded":"2023-12-16T00:01:35.239262+0000","last_fullsized":"2023-12-16T00:01:35.239262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1326,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440794+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-16T00:00:26.440794+0000","last_peered":"2023-12-16T00:00:26.440794+0000","last_clean":"2023-12-16T00:00:26.440794+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:00:26.440794+0000","last_undegraded":"2023-12-16T00:00:26.440794+0000","last_fullsized":"2023-12-16T00:00:26.440794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273146+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273146+0000","last_peered":"2023-12-16T00:02:14.273146+0000","last_clean":"2023-12-16T00:02:14.273146+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273146+0000","last_undegraded":"2023-12-16T00:02:14.273146+0000","last_fullsized":"2023-12-16T00:02:14.273146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478939+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478939+0000","last_peered":"2023-12-16T00:02:19.478939+0000","last_clean":"2023-12-16T00:02:19.478939+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478939+0000","last_undegraded":"2023-12-16T00:02:19.478939+0000","last_fullsized":"2023-12-16T00:02:19.478939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":388,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025286+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025286+0000","last_peered":"2023-12-16T00:02:04.025286+0000","last_clean":"2023-12-16T00:02:04.025286+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025286+0000","last_undegraded":"2023-12-16T00:02:04.025286+0000","last_fullsized":"2023-12-16T00:02:04.025286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725602+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725602+0000","last_peered":"2023-12-16T00:01:44.725602+0000","last_clean":"2023-12-16T00:01:44.725602+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725602+0000","last_undegraded":"2023-12-16T00:01:44.725602+0000","last_fullsized":"2023-12-16T00:01:44.725602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406258+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:25.406258+0000","last_peered":"2023-12-16T00:00:25.406258+0000","last_clean":"2023-12-16T00:00:25.406258+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:25.406258+0000","last_undegraded":"2023-12-16T00:00:25.406258+0000","last_fullsized":"2023-12-16T00:00:25.406258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394388+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:26.394388+0000","last_peered":"2023-12-16T00:00:26.394388+0000","last_clean":"2023-12-16T00:00:26.394388+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:26.394388+0000","last_undegraded":"2023-12-16T00:00:26.394388+0000","last_fullsized":"2023-12-16T00:00:26.394388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711639+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:27.711639+0000","last_peered":"2023-12-16T00:00:27.711639+0000","last_clean":"2023-12-16T00:00:27.711639+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:27.711639+0000","last_undegraded":"2023-12-16T00:00:27.711639+0000","last_fullsized":"2023-12-16T00:00:27.711639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624495+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624495+0000","last_peered":"2023-12-16T00:02:24.624495+0000","last_clean":"2023-12-16T00:02:24.624495+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624495+0000","last_undegraded":"2023-12-16T00:02:24.624495+0000","last_fullsized":"2023-12-16T00:02:24.624495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195623+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195623+0000","last_peered":"2023-12-16T00:01:41.195623+0000","last_clean":"2023-12-16T00:01:41.195623+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195623+0000","last_undegraded":"2023-12-16T00:01:41.195623+0000","last_fullsized":"2023-12-16T00:01:41.195623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3898,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200859+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200859+0000","last_peered":"2023-12-16T00:02:19.200859+0000","last_clean":"2023-12-16T00:02:19.200859+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200859+0000","last_undegraded":"2023-12-16T00:02:19.200859+0000","last_fullsized":"2023-12-16T00:02:19.200859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339013+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339013+0000","last_peered":"2023-12-16T00:02:29.339013+0000","last_clean":"2023-12-16T00:02:29.339013+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339013+0000","last_undegraded":"2023-12-16T00:02:29.339013+0000","last_fullsized":"2023-12-16T00:02:29.339013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.392566+0000","last_change":"2023-12-15T22:52:55.189663+0000","last_active":"2023-12-16T00:00:25.392566+0000","last_peered":"2023-12-16T00:00:25.392566+0000","last_clean":"2023-12-16T00:00:25.392566+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:00:25.392566+0000","last_undegraded":"2023-12-16T00:00:25.392566+0000","last_fullsized":"2023-12-16T00:00:25.392566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406038+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:25.406038+0000","last_peered":"2023-12-16T00:00:25.406038+0000","last_clean":"2023-12-16T00:00:25.406038+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:25.406038+0000","last_undegraded":"2023-12-16T00:00:25.406038+0000","last_fullsized":"2023-12-16T00:00:25.406038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"32'1","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440058+0000","last_change":"2023-12-15T22:53:04.317752+0000","last_active":"2023-12-16T00:00:26.440058+0000","last_peered":"2023-12-16T00:00:26.440058+0000","last_clean":"2023-12-16T00:00:26.440058+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:00:26.440058+0000","last_undegraded":"2023-12-16T00:00:26.440058+0000","last_fullsized":"2023-12-16T00:00:26.440058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'70","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288401+0000","last_change":"2023-12-15T22:53:06.320257+0000","last_active":"2023-12-16T00:00:27.288401+0000","last_peered":"2023-12-16T00:00:27.288401+0000","last_clean":"2023-12-16T00:00:27.288401+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:00:27.288401+0000","last_undegraded":"2023-12-16T00:00:27.288401+0000","last_fullsized":"2023-12-16T00:00:27.288401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119101+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119101+0000","last_peered":"2023-12-16T00:02:43.119101+0000","last_clean":"2023-12-16T00:02:43.119101+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119101+0000","last_undegraded":"2023-12-16T00:02:43.119101+0000","last_fullsized":"2023-12-16T00:02:43.119101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219694+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219694+0000","last_peered":"2023-12-16T00:01:33.219694+0000","last_clean":"2023-12-16T00:01:33.219694+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219694+0000","last_undegraded":"2023-12-16T00:01:33.219694+0000","last_fullsized":"2023-12-16T00:01:33.219694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092050+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092050+0000","last_peered":"2023-12-16T00:02:06.092050+0000","last_clean":"2023-12-16T00:02:06.092050+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092050+0000","last_undegraded":"2023-12-16T00:02:06.092050+0000","last_fullsized":"2023-12-16T00:02:06.092050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513266+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513266+0000","last_peered":"2023-12-16T00:02:15.513266+0000","last_clean":"2023-12-16T00:02:15.513266+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513266+0000","last_undegraded":"2023-12-16T00:02:15.513266+0000","last_fullsized":"2023-12-16T00:02:15.513266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394508+0000","last_change":"2023-12-15T22:52:55.194248+0000","last_active":"2023-12-16T00:00:26.394508+0000","last_peered":"2023-12-16T00:00:26.394508+0000","last_clean":"2023-12-16T00:00:26.394508+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:00:26.394508+0000","last_undegraded":"2023-12-16T00:00:26.394508+0000","last_fullsized":"2023-12-16T00:00:26.394508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406554+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:25.406554+0000","last_peered":"2023-12-16T00:00:25.406554+0000","last_clean":"2023-12-16T00:00:25.406554+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:25.406554+0000","last_undegraded":"2023-12-16T00:00:25.406554+0000","last_fullsized":"2023-12-16T00:00:25.406554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711601+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:27.711601+0000","last_peered":"2023-12-16T00:00:27.711601+0000","last_clean":"2023-12-16T00:00:27.711601+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:27.711601+0000","last_undegraded":"2023-12-16T00:00:27.711601+0000","last_fullsized":"2023-12-16T00:00:27.711601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158555+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158555+0000","last_peered":"2023-12-16T00:02:00.158555+0000","last_clean":"2023-12-16T00:02:00.158555+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158555+0000","last_undegraded":"2023-12-16T00:02:00.158555+0000","last_fullsized":"2023-12-16T00:02:00.158555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865424+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:26.865424+0000","last_peered":"2023-12-16T00:00:26.865424+0000","last_clean":"2023-12-16T00:00:26.865424+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:26.865424+0000","last_undegraded":"2023-12-16T00:00:26.865424+0000","last_fullsized":"2023-12-16T00:00:26.865424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137737+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-16T00:00:28.137737+0000","last_peered":"2023-12-16T00:00:28.137737+0000","last_clean":"2023-12-16T00:00:28.137737+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:00:28.137737+0000","last_undegraded":"2023-12-16T00:00:28.137737+0000","last_fullsized":"2023-12-16T00:00:28.137737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246171+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246171+0000","last_peered":"2023-12-16T00:01:50.246171+0000","last_clean":"2023-12-16T00:01:50.246171+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246171+0000","last_undegraded":"2023-12-16T00:01:50.246171+0000","last_fullsized":"2023-12-16T00:01:50.246171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986502+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986502+0000","last_peered":"2023-12-16T00:01:56.986502+0000","last_clean":"2023-12-16T00:01:56.986502+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986502+0000","last_undegraded":"2023-12-16T00:01:56.986502+0000","last_fullsized":"2023-12-16T00:01:56.986502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711913+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:27.711913+0000","last_peered":"2023-12-16T00:00:27.711913+0000","last_clean":"2023-12-16T00:00:27.711913+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:27.711913+0000","last_undegraded":"2023-12-16T00:00:27.711913+0000","last_fullsized":"2023-12-16T00:00:27.711913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.394446+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:26.394446+0000","last_peered":"2023-12-16T00:00:26.394446+0000","last_clean":"2023-12-16T00:00:26.394446+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:26.394446+0000","last_undegraded":"2023-12-16T00:00:26.394446+0000","last_fullsized":"2023-12-16T00:00:26.394446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:25.406662+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:25.406662+0000","last_peered":"2023-12-16T00:00:25.406662+0000","last_clean":"2023-12-16T00:00:25.406662+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:25.406662+0000","last_undegraded":"2023-12-16T00:00:25.406662+0000","last_fullsized":"2023-12-16T00:00:25.406662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136842+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:28.136842+0000","last_peered":"2023-12-16T00:00:28.136842+0000","last_clean":"2023-12-16T00:00:28.136842+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:28.136842+0000","last_undegraded":"2023-12-16T00:00:28.136842+0000","last_fullsized":"2023-12-16T00:00:28.136842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'47","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016102+0000","last_change":"2023-12-15T22:53:06.319953+0000","last_active":"2023-12-16T00:00:26.016102+0000","last_peered":"2023-12-16T00:00:26.016102+0000","last_clean":"2023-12-16T00:00:26.016102+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:00:26.016102+0000","last_undegraded":"2023-12-16T00:00:26.016102+0000","last_fullsized":"2023-12-16T00:00:26.016102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525340+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525340+0000","last_peered":"2023-12-16T00:02:21.525340+0000","last_clean":"2023-12-16T00:02:21.525340+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525340+0000","last_undegraded":"2023-12-16T00:02:21.525340+0000","last_fullsized":"2023-12-16T00:02:21.525340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3684,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689717+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689717+0000","last_peered":"2023-12-16T00:02:12.689717+0000","last_clean":"2023-12-16T00:02:12.689717+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689717+0000","last_undegraded":"2023-12-16T00:02:12.689717+0000","last_fullsized":"2023-12-16T00:02:12.689717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296903+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296903+0000","last_peered":"2023-12-16T00:02:30.296903+0000","last_clean":"2023-12-16T00:02:30.296903+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296903+0000","last_undegraded":"2023-12-16T00:02:30.296903+0000","last_fullsized":"2023-12-16T00:02:30.296903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892770+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892770+0000","last_peered":"2023-12-16T00:01:49.892770+0000","last_clean":"2023-12-16T00:01:49.892770+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892770+0000","last_undegraded":"2023-12-16T00:01:49.892770+0000","last_fullsized":"2023-12-16T00:01:49.892770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'20","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016081+0000","last_change":"2023-12-15T22:53:06.321846+0000","last_active":"2023-12-16T00:00:26.016081+0000","last_peered":"2023-12-16T00:00:26.016081+0000","last_clean":"2023-12-16T00:00:26.016081+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:00:26.016081+0000","last_undegraded":"2023-12-16T00:00:26.016081+0000","last_fullsized":"2023-12-16T00:00:26.016081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550756+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550756+0000","last_peered":"2023-12-16T00:02:30.550756+0000","last_clean":"2023-12-16T00:02:30.550756+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550756+0000","last_undegraded":"2023-12-16T00:02:30.550756+0000","last_fullsized":"2023-12-16T00:02:30.550756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020604+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020604+0000","last_peered":"2023-12-16T00:02:10.020604+0000","last_clean":"2023-12-16T00:02:10.020604+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020604+0000","last_undegraded":"2023-12-16T00:02:10.020604+0000","last_fullsized":"2023-12-16T00:02:10.020604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237503+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237503+0000","last_peered":"2023-12-16T00:02:34.237503+0000","last_clean":"2023-12-16T00:02:34.237503+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237503+0000","last_undegraded":"2023-12-16T00:02:34.237503+0000","last_fullsized":"2023-12-16T00:02:34.237503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288125+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288125+0000","last_peered":"2023-12-16T00:00:27.288125+0000","last_clean":"2023-12-16T00:00:27.288125+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:27.288125+0000","last_undegraded":"2023-12-16T00:00:27.288125+0000","last_fullsized":"2023-12-16T00:00:27.288125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440066+0000","last_change":"2023-12-15T22:53:04.318407+0000","last_active":"2023-12-16T00:00:26.440066+0000","last_peered":"2023-12-16T00:00:26.440066+0000","last_clean":"2023-12-16T00:00:26.440066+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:00:26.440066+0000","last_undegraded":"2023-12-16T00:00:26.440066+0000","last_fullsized":"2023-12-16T00:00:26.440066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604391+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604391+0000","last_peered":"2023-12-16T00:02:31.604391+0000","last_clean":"2023-12-16T00:02:31.604391+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604391+0000","last_undegraded":"2023-12-16T00:02:31.604391+0000","last_fullsized":"2023-12-16T00:02:31.604391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327755+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327755+0000","last_peered":"2023-12-16T00:02:34.327755+0000","last_clean":"2023-12-16T00:02:34.327755+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327755+0000","last_undegraded":"2023-12-16T00:02:34.327755+0000","last_fullsized":"2023-12-16T00:02:34.327755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679948+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679948+0000","last_peered":"2023-12-16T00:01:47.679948+0000","last_clean":"2023-12-16T00:01:47.679948+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679948+0000","last_undegraded":"2023-12-16T00:01:47.679948+0000","last_fullsized":"2023-12-16T00:01:47.679948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634825+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634825+0000","last_peered":"2023-12-16T00:02:01.634825+0000","last_clean":"2023-12-16T00:02:01.634825+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634825+0000","last_undegraded":"2023-12-16T00:02:01.634825+0000","last_fullsized":"2023-12-16T00:02:01.634825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439995+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:26.439995+0000","last_peered":"2023-12-16T00:00:26.439995+0000","last_clean":"2023-12-16T00:00:26.439995+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:26.439995+0000","last_undegraded":"2023-12-16T00:00:26.439995+0000","last_fullsized":"2023-12-16T00:00:26.439995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711283+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-16T00:00:27.711283+0000","last_peered":"2023-12-16T00:00:27.711283+0000","last_clean":"2023-12-16T00:00:27.711283+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:00:27.711283+0000","last_undegraded":"2023-12-16T00:00:27.711283+0000","last_fullsized":"2023-12-16T00:00:27.711283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439962+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:26.439962+0000","last_peered":"2023-12-16T00:00:26.439962+0000","last_clean":"2023-12-16T00:00:26.439962+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:26.439962+0000","last_undegraded":"2023-12-16T00:00:26.439962+0000","last_fullsized":"2023-12-16T00:00:26.439962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864089+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-16T00:00:26.864089+0000","last_peered":"2023-12-16T00:00:26.864089+0000","last_clean":"2023-12-16T00:00:26.864089+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:00:26.864089+0000","last_undegraded":"2023-12-16T00:00:26.864089+0000","last_fullsized":"2023-12-16T00:00:26.864089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808750+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808750+0000","last_peered":"2023-12-16T00:01:20.808750+0000","last_clean":"2023-12-16T00:01:20.808750+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808750+0000","last_undegraded":"2023-12-16T00:01:20.808750+0000","last_fullsized":"2023-12-16T00:01:20.808750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439970+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:26.439970+0000","last_peered":"2023-12-16T00:00:26.439970+0000","last_clean":"2023-12-16T00:00:26.439970+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:26.439970+0000","last_undegraded":"2023-12-16T00:00:26.439970+0000","last_fullsized":"2023-12-16T00:00:26.439970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864271+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-16T00:00:26.864271+0000","last_peered":"2023-12-16T00:00:26.864271+0000","last_clean":"2023-12-16T00:00:26.864271+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:00:26.864271+0000","last_undegraded":"2023-12-16T00:00:26.864271+0000","last_fullsized":"2023-12-16T00:00:26.864271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015729+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:26.015729+0000","last_peered":"2023-12-16T00:00:26.015729+0000","last_clean":"2023-12-16T00:00:26.015729+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:26.015729+0000","last_undegraded":"2023-12-16T00:00:26.015729+0000","last_fullsized":"2023-12-16T00:00:26.015729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711975+0000","last_change":"2023-12-15T22:55:02.195615+0000","last_active":"2023-12-16T00:00:27.711975+0000","last_peered":"2023-12-16T00:00:27.711975+0000","last_clean":"2023-12-16T00:00:27.711975+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:00:27.711975+0000","last_undegraded":"2023-12-16T00:00:27.711975+0000","last_fullsized":"2023-12-16T00:00:27.711975+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711462+0000","last_change":"2023-12-15T22:52:55.191001+0000","last_active":"2023-12-16T00:00:27.711462+0000","last_peered":"2023-12-16T00:00:27.711462+0000","last_clean":"2023-12-16T00:00:27.711462+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:00:27.711462+0000","last_undegraded":"2023-12-16T00:00:27.711462+0000","last_fullsized":"2023-12-16T00:00:27.711462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439762+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:26.439762+0000","last_peered":"2023-12-16T00:00:26.439762+0000","last_clean":"2023-12-16T00:00:26.439762+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:26.439762+0000","last_undegraded":"2023-12-16T00:00:26.439762+0000","last_fullsized":"2023-12-16T00:00:26.439762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287952+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:27.287952+0000","last_peered":"2023-12-16T00:00:27.287952+0000","last_clean":"2023-12-16T00:00:27.287952+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:27.287952+0000","last_undegraded":"2023-12-16T00:00:27.287952+0000","last_fullsized":"2023-12-16T00:00:27.287952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591074+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591074+0000","last_peered":"2023-12-16T00:01:51.591074+0000","last_clean":"2023-12-16T00:01:51.591074+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591074+0000","last_undegraded":"2023-12-16T00:01:51.591074+0000","last_fullsized":"2023-12-16T00:01:51.591074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288153+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-16T00:00:27.288153+0000","last_peered":"2023-12-16T00:00:27.288153+0000","last_clean":"2023-12-16T00:00:27.288153+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:00:27.288153+0000","last_undegraded":"2023-12-16T00:00:27.288153+0000","last_fullsized":"2023-12-16T00:00:27.288153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864166+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:26.864166+0000","last_peered":"2023-12-16T00:00:26.864166+0000","last_clean":"2023-12-16T00:00:26.864166+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:26.864166+0000","last_undegraded":"2023-12-16T00:00:26.864166+0000","last_fullsized":"2023-12-16T00:00:26.864166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015898+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:26.015898+0000","last_peered":"2023-12-16T00:00:26.015898+0000","last_clean":"2023-12-16T00:00:26.015898+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:26.015898+0000","last_undegraded":"2023-12-16T00:00:26.015898+0000","last_fullsized":"2023-12-16T00:00:26.015898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711434+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:27.711434+0000","last_peered":"2023-12-16T00:00:27.711434+0000","last_clean":"2023-12-16T00:00:27.711434+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:27.711434+0000","last_undegraded":"2023-12-16T00:00:27.711434+0000","last_fullsized":"2023-12-16T00:00:27.711434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015739+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:26.015739+0000","last_peered":"2023-12-16T00:00:26.015739+0000","last_clean":"2023-12-16T00:00:26.015739+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:26.015739+0000","last_undegraded":"2023-12-16T00:00:26.015739+0000","last_fullsized":"2023-12-16T00:00:26.015739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864279+0000","last_change":"2023-12-15T22:52:55.191263+0000","last_active":"2023-12-16T00:00:26.864279+0000","last_peered":"2023-12-16T00:00:26.864279+0000","last_clean":"2023-12-16T00:00:26.864279+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:00:26.864279+0000","last_undegraded":"2023-12-16T00:00:26.864279+0000","last_fullsized":"2023-12-16T00:00:26.864279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288174+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:27.288174+0000","last_peered":"2023-12-16T00:00:27.288174+0000","last_clean":"2023-12-16T00:00:27.288174+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:27.288174+0000","last_undegraded":"2023-12-16T00:00:27.288174+0000","last_fullsized":"2023-12-16T00:00:27.288174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015869+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:26.015869+0000","last_peered":"2023-12-16T00:00:26.015869+0000","last_clean":"2023-12-16T00:00:26.015869+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:26.015869+0000","last_undegraded":"2023-12-16T00:00:26.015869+0000","last_fullsized":"2023-12-16T00:00:26.015869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711459+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:27.711459+0000","last_peered":"2023-12-16T00:00:27.711459+0000","last_clean":"2023-12-16T00:00:27.711459+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:27.711459+0000","last_undegraded":"2023-12-16T00:00:27.711459+0000","last_fullsized":"2023-12-16T00:00:27.711459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015891+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:26.015891+0000","last_peered":"2023-12-16T00:00:26.015891+0000","last_clean":"2023-12-16T00:00:26.015891+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:26.015891+0000","last_undegraded":"2023-12-16T00:00:26.015891+0000","last_fullsized":"2023-12-16T00:00:26.015891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288021+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:27.288021+0000","last_peered":"2023-12-16T00:00:27.288021+0000","last_clean":"2023-12-16T00:00:27.288021+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:27.288021+0000","last_undegraded":"2023-12-16T00:00:27.288021+0000","last_fullsized":"2023-12-16T00:00:27.288021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440012+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:26.440012+0000","last_peered":"2023-12-16T00:00:26.440012+0000","last_clean":"2023-12-16T00:00:26.440012+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:26.440012+0000","last_undegraded":"2023-12-16T00:00:26.440012+0000","last_fullsized":"2023-12-16T00:00:26.440012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864173+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:26.864173+0000","last_peered":"2023-12-16T00:00:26.864173+0000","last_clean":"2023-12-16T00:00:26.864173+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:26.864173+0000","last_undegraded":"2023-12-16T00:00:26.864173+0000","last_fullsized":"2023-12-16T00:00:26.864173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288186+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:27.288186+0000","last_peered":"2023-12-16T00:00:27.288186+0000","last_clean":"2023-12-16T00:00:27.288186+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:27.288186+0000","last_undegraded":"2023-12-16T00:00:27.288186+0000","last_fullsized":"2023-12-16T00:00:27.288186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136518+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:28.136518+0000","last_peered":"2023-12-16T00:00:28.136518+0000","last_clean":"2023-12-16T00:00:28.136518+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:28.136518+0000","last_undegraded":"2023-12-16T00:00:28.136518+0000","last_fullsized":"2023-12-16T00:00:28.136518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287997+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:27.287997+0000","last_peered":"2023-12-16T00:00:27.287997+0000","last_clean":"2023-12-16T00:00:27.287997+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:27.287997+0000","last_undegraded":"2023-12-16T00:00:27.287997+0000","last_fullsized":"2023-12-16T00:00:27.287997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439801+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:26.439801+0000","last_peered":"2023-12-16T00:00:26.439801+0000","last_clean":"2023-12-16T00:00:26.439801+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:26.439801+0000","last_undegraded":"2023-12-16T00:00:26.439801+0000","last_fullsized":"2023-12-16T00:00:26.439801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136640+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:28.136640+0000","last_peered":"2023-12-16T00:00:28.136640+0000","last_clean":"2023-12-16T00:00:28.136640+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:28.136640+0000","last_undegraded":"2023-12-16T00:00:28.136640+0000","last_fullsized":"2023-12-16T00:00:28.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153076,"num_omap_keys":583,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4000,"ondisk_log_size":4000,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2269,"ondisk_log_size":2269,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":892,"ondisk_log_size":892,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608405,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.372,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.65800000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.434},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":1.004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.40300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.46800000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.432,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.376}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.46899999999999997,"5min":0.60099999999999998,"15min":1.149},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":0.59499999999999997,"15min":0.63},"last":0.39500000000000002}]}]},{"osd":5,"up_from":11,"seq":47244641107,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.505,"15min":0.501},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65200000000000002,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.496},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.754,"15min":0.96699999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.69999999999999996,"15min":0.80100000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.879},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.623,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.67000000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.441}]},{"osd":3,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.371},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.54700000000000004,"5min":0.61099999999999999,"15min":0.754},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.29699999999999999,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.5,"5min":0.57399999999999995,"15min":0.63},"last":0.378}]},{"osd":4,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56699999999999995,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.31900000000000001}]}]},{"osd":3,"up_from":11,"seq":47244641109,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55380,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802220,"statfs":{"total":107374182400,"available":107317473280,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.65300000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.435,"5min":0.374,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.50900000000000001},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":1.25,"15min":1.25},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.45500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.24199999999999999},"max":{"1min":0.45400000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.432},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46300000000000002}]}]},{"osd":2,"up_from":11,"seq":47244641106,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"min":{"1min":0.23400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.42699999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55400000000000005,"5min":0.87,"15min":0.87},"last":0.379}]},{"osd":1,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44500000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51800000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.169,"15min":1.169},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82899999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76300000000000001}]}]},{"osd":1,"up_from":11,"seq":47244641107,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.312,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.20399999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.318},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.26900000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46400000000000002,"5min":0.51700000000000002,"15min":0.80100000000000005},"last":0.377}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.249,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45600000000000002,"5min":0.504,"15min":0.504},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.309},"max":{"1min":0.65300000000000002,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.70099999999999996,"5min":0.81100000000000005,"15min":0.878},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66800000000000004,"5min":0.78000000000000003,"15min":0.82099999999999995},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64600000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.755}]}]},{"osd":0,"up_from":11,"seq":47244641107,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.314},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.251},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.503,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.83599999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.40500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68300000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.875},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:02:51.779 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.780 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.780 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.780 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.780 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.781 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.781 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.781 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.781 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.781 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.782 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.782 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.782 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.782 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.782 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.783 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.783 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.783 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.783 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.783 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.784 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.784 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.784 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.784 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.784 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.785 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.785 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.785 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.785 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.785 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.786 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.786 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.786 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.786 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.787 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.787 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.787 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.787 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.788 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.788 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.788 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.788 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.788 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.789 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.789 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.789 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.789 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.790 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.790 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.790 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.790 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.790 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.791 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.791 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.791 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.791 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.792 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.792 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.792 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.792 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.793 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.793 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.793 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.793 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.793 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.794 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.794 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.794 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.794 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.795 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.795 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.795 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.795 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.795 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.796 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.796 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.796 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.796 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.796 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.797 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.797 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.797 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.797 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.798 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.798 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.798 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.798 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.798 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.799 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.799 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.799 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.799 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.800 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.800 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.800 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.800 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.801 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.801 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.801 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.801 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.801 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.802 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.802 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.802 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.802 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.802 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.803 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.803 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.803 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.803 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.803 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.804 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.804 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.804 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.804 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.805 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.805 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.805 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.805 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.805 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.806 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.806 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.806 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.806 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.806 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.807 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.807 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.807 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.807 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.808 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.808 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.808 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.808 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.808 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-15T22:53:07.313122+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=7, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.809 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.809 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.809 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.809 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.810 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.810 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.810 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.810 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.810 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.811 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.811 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.811 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.811 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.811 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.812 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.812 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.812 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.812 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.813 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.813 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.813 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.813 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.814 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.814 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.814 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.814 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.814 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.815 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.815 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.815 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.815 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.816 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.816 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.816 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.816 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.816 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.817 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.817 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.817 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.817 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.817 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.818 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.818 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.818 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.818 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.819 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.819 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.819 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.819 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.820 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.820 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.820 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.820 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.820 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.821 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.821 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.821 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.821 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.822 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.822 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.822 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.822 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.822 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.823 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.823 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.823 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.823 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.823 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.824 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.824 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.824 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.824 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.825 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.825 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.825 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.825 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.825 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.826 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.826 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.826 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.826 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.826 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.827 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.827 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.827 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.827 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.827 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.828 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.828 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.828 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.828 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.828 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.829 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.829 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.829 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.829 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.829 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.830 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.830 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.830 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.830 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.830 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.831 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.831 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.831 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.831 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.831 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.832 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:02:51.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:03:11.833 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:03:12.169 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:03:12.189 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:03:12.193 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2181,"stamp":"2023-12-16T00:03:10.253292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":864289,"num_omap_keys":3778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36237,"ondisk_log_size":36237,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":307928,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":298038,"kb_avail":628837672,"statfs":{"total":644245094400,"available":643929776128,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":305191585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18163,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005687"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859854+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859854+0000","last_peered":"2023-12-16T00:01:07.859854+0000","last_clean":"2023-12-16T00:01:07.859854+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859854+0000","last_undegraded":"2023-12-16T00:01:07.859854+0000","last_fullsized":"2023-12-16T00:01:07.859854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288074+0000","last_change":"2023-12-15T22:52:53.172755+0000","last_active":"2023-12-16T00:00:27.288074+0000","last_peered":"2023-12-16T00:00:27.288074+0000","last_clean":"2023-12-16T00:00:27.288074+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:00:27.288074+0000","last_undegraded":"2023-12-16T00:00:27.288074+0000","last_fullsized":"2023-12-16T00:00:27.288074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136676+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:28.136676+0000","last_peered":"2023-12-16T00:00:28.136676+0000","last_clean":"2023-12-16T00:00:28.136676+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:28.136676+0000","last_undegraded":"2023-12-16T00:00:28.136676+0000","last_fullsized":"2023-12-16T00:00:28.136676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":119,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.807951+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:00:49.807951+0000","last_peered":"2023-12-16T00:00:49.807951+0000","last_clean":"2023-12-16T00:00:49.807951+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:00:49.807951+0000","last_undegraded":"2023-12-16T00:00:49.807951+0000","last_fullsized":"2023-12-16T00:00:49.807951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288227+0000","last_change":"2023-12-15T22:52:55.185552+0000","last_active":"2023-12-16T00:00:27.288227+0000","last_peered":"2023-12-16T00:00:27.288227+0000","last_clean":"2023-12-16T00:00:27.288227+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:00:27.288227+0000","last_undegraded":"2023-12-16T00:00:27.288227+0000","last_fullsized":"2023-12-16T00:00:27.288227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.953922+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:00:26.953922+0000","last_peered":"2023-12-16T00:00:26.953922+0000","last_clean":"2023-12-16T00:00:26.953922+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:00:26.953922+0000","last_undegraded":"2023-12-16T00:00:26.953922+0000","last_fullsized":"2023-12-16T00:00:26.953922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136566+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:00:28.136566+0000","last_peered":"2023-12-16T00:00:28.136566+0000","last_clean":"2023-12-16T00:00:28.136566+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:00:28.136566+0000","last_undegraded":"2023-12-16T00:00:28.136566+0000","last_fullsized":"2023-12-16T00:00:28.136566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015974+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:26.015974+0000","last_peered":"2023-12-16T00:00:26.015974+0000","last_clean":"2023-12-16T00:00:26.015974+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:26.015974+0000","last_undegraded":"2023-12-16T00:00:26.015974+0000","last_fullsized":"2023-12-16T00:00:26.015974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829498+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829498+0000","last_peered":"2023-12-16T00:01:17.829498+0000","last_clean":"2023-12-16T00:01:17.829498+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829498+0000","last_undegraded":"2023-12-16T00:01:17.829498+0000","last_fullsized":"2023-12-16T00:01:17.829498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288059+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:27.288059+0000","last_peered":"2023-12-16T00:00:27.288059+0000","last_clean":"2023-12-16T00:00:27.288059+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:27.288059+0000","last_undegraded":"2023-12-16T00:00:27.288059+0000","last_fullsized":"2023-12-16T00:00:27.288059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136667+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:00:28.136667+0000","last_peered":"2023-12-16T00:00:28.136667+0000","last_clean":"2023-12-16T00:00:28.136667+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:00:28.136667+0000","last_undegraded":"2023-12-16T00:00:28.136667+0000","last_fullsized":"2023-12-16T00:00:28.136667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.205183+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:00:31.205183+0000","last_peered":"2023-12-16T00:00:31.205183+0000","last_clean":"2023-12-16T00:00:31.205183+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:00:31.205183+0000","last_undegraded":"2023-12-16T00:00:31.205183+0000","last_fullsized":"2023-12-16T00:00:31.205183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136544+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:28.136544+0000","last_peered":"2023-12-16T00:00:28.136544+0000","last_clean":"2023-12-16T00:00:28.136544+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:28.136544+0000","last_undegraded":"2023-12-16T00:00:28.136544+0000","last_fullsized":"2023-12-16T00:00:28.136544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711556+0000","last_change":"2023-12-15T22:52:55.187718+0000","last_active":"2023-12-16T00:00:27.711556+0000","last_peered":"2023-12-16T00:00:27.711556+0000","last_clean":"2023-12-16T00:00:27.711556+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:00:27.711556+0000","last_undegraded":"2023-12-16T00:00:27.711556+0000","last_fullsized":"2023-12-16T00:00:27.711556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":176,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:49.916346+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:00:49.916346+0000","last_peered":"2023-12-16T00:00:49.916346+0000","last_clean":"2023-12-16T00:00:49.916346+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:00:49.916346+0000","last_undegraded":"2023-12-16T00:00:49.916346+0000","last_fullsized":"2023-12-16T00:00:49.916346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288014+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:27.288014+0000","last_peered":"2023-12-16T00:00:27.288014+0000","last_clean":"2023-12-16T00:00:27.288014+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:27.288014+0000","last_undegraded":"2023-12-16T00:00:27.288014+0000","last_fullsized":"2023-12-16T00:00:27.288014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864177+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:26.864177+0000","last_peered":"2023-12-16T00:00:26.864177+0000","last_clean":"2023-12-16T00:00:26.864177+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:26.864177+0000","last_undegraded":"2023-12-16T00:00:26.864177+0000","last_fullsized":"2023-12-16T00:00:26.864177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629274+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629274+0000","last_peered":"2023-12-16T00:02:46.629274+0000","last_clean":"2023-12-16T00:02:46.629274+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629274+0000","last_undegraded":"2023-12-16T00:02:46.629274+0000","last_fullsized":"2023-12-16T00:02:46.629274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439798+0000","last_change":"2023-12-15T22:53:01.297436+0000","last_active":"2023-12-16T00:00:26.439798+0000","last_peered":"2023-12-16T00:00:26.439798+0000","last_clean":"2023-12-16T00:00:26.439798+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:00:26.439798+0000","last_undegraded":"2023-12-16T00:00:26.439798+0000","last_fullsized":"2023-12-16T00:00:26.439798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408921+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:35.408921+0000","last_peered":"2023-12-16T00:00:35.408921+0000","last_clean":"2023-12-16T00:00:35.408921+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:35.408921+0000","last_undegraded":"2023-12-16T00:00:35.408921+0000","last_fullsized":"2023-12-16T00:00:35.408921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408756+0000","last_change":"2023-12-15T22:52:53.175682+0000","last_active":"2023-12-16T00:00:35.408756+0000","last_peered":"2023-12-16T00:00:35.408756+0000","last_clean":"2023-12-16T00:00:35.408756+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:00:35.408756+0000","last_undegraded":"2023-12-16T00:00:35.408756+0000","last_fullsized":"2023-12-16T00:00:35.408756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136607+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:28.136607+0000","last_peered":"2023-12-16T00:00:28.136607+0000","last_clean":"2023-12-16T00:00:28.136607+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:28.136607+0000","last_undegraded":"2023-12-16T00:00:28.136607+0000","last_fullsized":"2023-12-16T00:00:28.136607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409311+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:35.409311+0000","last_peered":"2023-12-16T00:00:35.409311+0000","last_clean":"2023-12-16T00:00:35.409311+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:35.409311+0000","last_undegraded":"2023-12-16T00:00:35.409311+0000","last_fullsized":"2023-12-16T00:00:35.409311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.394905+0000","last_change":"2023-12-15T22:52:55.190518+0000","last_active":"2023-12-16T00:00:35.394905+0000","last_peered":"2023-12-16T00:00:35.394905+0000","last_clean":"2023-12-16T00:00:35.394905+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:00:35.394905+0000","last_undegraded":"2023-12-16T00:00:35.394905+0000","last_fullsized":"2023-12-16T00:00:35.394905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396946+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:36.396946+0000","last_peered":"2023-12-16T00:00:36.396946+0000","last_clean":"2023-12-16T00:00:36.396946+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:36.396946+0000","last_undegraded":"2023-12-16T00:00:36.396946+0000","last_fullsized":"2023-12-16T00:00:36.396946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164383+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164383+0000","last_peered":"2023-12-16T00:01:22.164383+0000","last_clean":"2023-12-16T00:01:22.164383+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164383+0000","last_undegraded":"2023-12-16T00:01:22.164383+0000","last_fullsized":"2023-12-16T00:01:22.164383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408417+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:35.408417+0000","last_peered":"2023-12-16T00:00:35.408417+0000","last_clean":"2023-12-16T00:00:35.408417+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:35.408417+0000","last_undegraded":"2023-12-16T00:00:35.408417+0000","last_fullsized":"2023-12-16T00:00:35.408417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632624+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632624+0000","last_peered":"2023-12-16T00:02:00.632624+0000","last_clean":"2023-12-16T00:02:00.632624+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632624+0000","last_undegraded":"2023-12-16T00:02:00.632624+0000","last_fullsized":"2023-12-16T00:02:00.632624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.397036+0000","last_change":"2023-12-15T22:53:01.293314+0000","last_active":"2023-12-16T00:00:36.397036+0000","last_peered":"2023-12-16T00:00:36.397036+0000","last_clean":"2023-12-16T00:00:36.397036+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:00:36.397036+0000","last_undegraded":"2023-12-16T00:00:36.397036+0000","last_fullsized":"2023-12-16T00:00:36.397036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015753+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:26.015753+0000","last_peered":"2023-12-16T00:00:26.015753+0000","last_clean":"2023-12-16T00:00:26.015753+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:26.015753+0000","last_undegraded":"2023-12-16T00:00:26.015753+0000","last_fullsized":"2023-12-16T00:00:26.015753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.631082+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:45.631082+0000","last_peered":"2023-12-16T00:00:45.631082+0000","last_clean":"2023-12-16T00:00:45.631082+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:45.631082+0000","last_undegraded":"2023-12-16T00:00:45.631082+0000","last_fullsized":"2023-12-16T00:00:45.631082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411379+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411379+0000","last_peered":"2023-12-16T00:02:07.411379+0000","last_clean":"2023-12-16T00:02:07.411379+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411379+0000","last_undegraded":"2023-12-16T00:02:07.411379+0000","last_fullsized":"2023-12-16T00:02:07.411379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.365472+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:00:40.365472+0000","last_peered":"2023-12-16T00:00:40.365472+0000","last_clean":"2023-12-16T00:00:40.365472+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:00:40.365472+0000","last_undegraded":"2023-12-16T00:00:40.365472+0000","last_fullsized":"2023-12-16T00:00:40.365472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":565,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.089755+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:00:38.089755+0000","last_peered":"2023-12-16T00:00:38.089755+0000","last_clean":"2023-12-16T00:00:38.089755+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:00:38.089755+0000","last_undegraded":"2023-12-16T00:00:38.089755+0000","last_fullsized":"2023-12-16T00:00:38.089755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620281+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620281+0000","last_peered":"2023-12-16T00:02:06.620281+0000","last_clean":"2023-12-16T00:02:06.620281+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620281+0000","last_undegraded":"2023-12-16T00:02:06.620281+0000","last_fullsized":"2023-12-16T00:02:06.620281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646490+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646490+0000","last_peered":"2023-12-16T00:02:14.646490+0000","last_clean":"2023-12-16T00:02:14.646490+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646490+0000","last_undegraded":"2023-12-16T00:02:14.646490+0000","last_fullsized":"2023-12-16T00:02:14.646490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630876+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:45.630876+0000","last_peered":"2023-12-16T00:00:45.630876+0000","last_clean":"2023-12-16T00:00:45.630876+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:45.630876+0000","last_undegraded":"2023-12-16T00:00:45.630876+0000","last_fullsized":"2023-12-16T00:00:45.630876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408467+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:35.408467+0000","last_peered":"2023-12-16T00:00:35.408467+0000","last_clean":"2023-12-16T00:00:35.408467+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:35.408467+0000","last_undegraded":"2023-12-16T00:00:35.408467+0000","last_fullsized":"2023-12-16T00:00:35.408467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136815+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:28.136815+0000","last_peered":"2023-12-16T00:00:28.136815+0000","last_clean":"2023-12-16T00:00:28.136815+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:28.136815+0000","last_undegraded":"2023-12-16T00:00:28.136815+0000","last_fullsized":"2023-12-16T00:00:28.136815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181021+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181021+0000","last_peered":"2023-12-16T00:02:54.181021+0000","last_clean":"2023-12-16T00:02:54.181021+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181021+0000","last_undegraded":"2023-12-16T00:02:54.181021+0000","last_fullsized":"2023-12-16T00:02:54.181021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099297+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099297+0000","last_peered":"2023-12-16T00:02:40.099297+0000","last_clean":"2023-12-16T00:02:40.099297+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099297+0000","last_undegraded":"2023-12-16T00:02:40.099297+0000","last_fullsized":"2023-12-16T00:02:40.099297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.399111+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:50.399111+0000","last_peered":"2023-12-16T00:00:50.399111+0000","last_clean":"2023-12-16T00:00:50.399111+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:50.399111+0000","last_undegraded":"2023-12-16T00:00:50.399111+0000","last_fullsized":"2023-12-16T00:00:50.399111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118158+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118158+0000","last_peered":"2023-12-16T00:02:20.118158+0000","last_clean":"2023-12-16T00:02:20.118158+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118158+0000","last_undegraded":"2023-12-16T00:02:20.118158+0000","last_fullsized":"2023-12-16T00:02:20.118158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":861,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781639+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781639+0000","last_peered":"2023-12-16T00:01:14.781639+0000","last_clean":"2023-12-16T00:01:14.781639+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781639+0000","last_undegraded":"2023-12-16T00:01:14.781639+0000","last_fullsized":"2023-12-16T00:01:14.781639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3317,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:34.871612+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:00:34.871612+0000","last_peered":"2023-12-16T00:00:34.871612+0000","last_clean":"2023-12-16T00:00:34.871612+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:00:34.871612+0000","last_undegraded":"2023-12-16T00:00:34.871612+0000","last_fullsized":"2023-12-16T00:00:34.871612+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752008+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752008+0000","last_peered":"2023-12-16T00:01:25.752008+0000","last_clean":"2023-12-16T00:01:25.752008+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752008+0000","last_undegraded":"2023-12-16T00:01:25.752008+0000","last_fullsized":"2023-12-16T00:01:25.752008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844560+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844560+0000","last_peered":"2023-12-16T00:01:46.844560+0000","last_clean":"2023-12-16T00:01:46.844560+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844560+0000","last_undegraded":"2023-12-16T00:01:46.844560+0000","last_fullsized":"2023-12-16T00:01:46.844560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409291+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:35.409291+0000","last_peered":"2023-12-16T00:00:35.409291+0000","last_clean":"2023-12-16T00:00:35.409291+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:35.409291+0000","last_undegraded":"2023-12-16T00:00:35.409291+0000","last_fullsized":"2023-12-16T00:00:35.409291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630689+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:45.630689+0000","last_peered":"2023-12-16T00:00:45.630689+0000","last_clean":"2023-12-16T00:00:45.630689+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:45.630689+0000","last_undegraded":"2023-12-16T00:00:45.630689+0000","last_fullsized":"2023-12-16T00:00:45.630689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016002+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:00:26.016002+0000","last_peered":"2023-12-16T00:00:26.016002+0000","last_clean":"2023-12-16T00:00:26.016002+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:00:26.016002+0000","last_undegraded":"2023-12-16T00:00:26.016002+0000","last_fullsized":"2023-12-16T00:00:26.016002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604968+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604968+0000","last_peered":"2023-12-16T00:02:47.604968+0000","last_clean":"2023-12-16T00:02:47.604968+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604968+0000","last_undegraded":"2023-12-16T00:02:47.604968+0000","last_fullsized":"2023-12-16T00:02:47.604968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567518+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567518+0000","last_peered":"2023-12-16T00:02:27.567518+0000","last_clean":"2023-12-16T00:02:27.567518+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567518+0000","last_undegraded":"2023-12-16T00:02:27.567518+0000","last_fullsized":"2023-12-16T00:02:27.567518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":124,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.270474+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:39.270474+0000","last_peered":"2023-12-16T00:00:39.270474+0000","last_clean":"2023-12-16T00:00:39.270474+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:39.270474+0000","last_undegraded":"2023-12-16T00:00:39.270474+0000","last_fullsized":"2023-12-16T00:00:39.270474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165978+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165978+0000","last_peered":"2023-12-16T00:01:55.165978+0000","last_clean":"2023-12-16T00:01:55.165978+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165978+0000","last_undegraded":"2023-12-16T00:01:55.165978+0000","last_fullsized":"2023-12-16T00:01:55.165978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408732+0000","last_change":"2023-12-15T22:52:55.188100+0000","last_active":"2023-12-16T00:00:35.408732+0000","last_peered":"2023-12-16T00:00:35.408732+0000","last_clean":"2023-12-16T00:00:35.408732+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:00:35.408732+0000","last_undegraded":"2023-12-16T00:00:35.408732+0000","last_fullsized":"2023-12-16T00:00:35.408732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408273+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:35.408273+0000","last_peered":"2023-12-16T00:00:35.408273+0000","last_clean":"2023-12-16T00:00:35.408273+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:35.408273+0000","last_undegraded":"2023-12-16T00:00:35.408273+0000","last_fullsized":"2023-12-16T00:00:35.408273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346301+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346301+0000","last_peered":"2023-12-16T00:03:02.346301+0000","last_clean":"2023-12-16T00:03:02.346301+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346301+0000","last_undegraded":"2023-12-16T00:03:02.346301+0000","last_fullsized":"2023-12-16T00:03:02.346301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'70","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864610+0000","last_change":"2023-12-15T22:53:06.321532+0000","last_active":"2023-12-16T00:00:26.864610+0000","last_peered":"2023-12-16T00:00:26.864610+0000","last_clean":"2023-12-16T00:00:26.864610+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:00:26.864610+0000","last_undegraded":"2023-12-16T00:00:26.864610+0000","last_fullsized":"2023-12-16T00:00:26.864610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359607+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359607+0000","last_peered":"2023-12-16T00:01:48.359607+0000","last_clean":"2023-12-16T00:01:48.359607+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359607+0000","last_undegraded":"2023-12-16T00:01:48.359607+0000","last_fullsized":"2023-12-16T00:01:48.359607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1028,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304198+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304198+0000","last_peered":"2023-12-16T00:02:29.304198+0000","last_clean":"2023-12-16T00:02:29.304198+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304198+0000","last_undegraded":"2023-12-16T00:02:29.304198+0000","last_fullsized":"2023-12-16T00:02:29.304198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.838138+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:38.838138+0000","last_peered":"2023-12-16T00:00:38.838138+0000","last_clean":"2023-12-16T00:00:38.838138+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:38.838138+0000","last_undegraded":"2023-12-16T00:00:38.838138+0000","last_fullsized":"2023-12-16T00:00:38.838138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678066+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678066+0000","last_peered":"2023-12-16T00:02:07.678066+0000","last_clean":"2023-12-16T00:02:07.678066+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678066+0000","last_undegraded":"2023-12-16T00:02:07.678066+0000","last_fullsized":"2023-12-16T00:02:07.678066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408824+0000","last_change":"2023-12-15T22:52:55.189050+0000","last_active":"2023-12-16T00:00:35.408824+0000","last_peered":"2023-12-16T00:00:35.408824+0000","last_clean":"2023-12-16T00:00:35.408824+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:00:35.408824+0000","last_undegraded":"2023-12-16T00:00:35.408824+0000","last_fullsized":"2023-12-16T00:00:35.408824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408763+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:35.408763+0000","last_peered":"2023-12-16T00:00:35.408763+0000","last_clean":"2023-12-16T00:00:35.408763+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:35.408763+0000","last_undegraded":"2023-12-16T00:00:35.408763+0000","last_fullsized":"2023-12-16T00:00:35.408763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415331+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415331+0000","last_peered":"2023-12-16T00:02:57.415331+0000","last_clean":"2023-12-16T00:02:57.415331+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415331+0000","last_undegraded":"2023-12-16T00:02:57.415331+0000","last_fullsized":"2023-12-16T00:02:57.415331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328480+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328480+0000","last_peered":"2023-12-16T00:02:51.328480+0000","last_clean":"2023-12-16T00:02:51.328480+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328480+0000","last_undegraded":"2023-12-16T00:02:51.328480+0000","last_fullsized":"2023-12-16T00:02:51.328480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030702+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030702+0000","last_peered":"2023-12-16T00:02:05.030702+0000","last_clean":"2023-12-16T00:02:05.030702+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030702+0000","last_undegraded":"2023-12-16T00:02:05.030702+0000","last_fullsized":"2023-12-16T00:02:05.030702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:46.399423+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:46.399423+0000","last_peered":"2023-12-16T00:00:46.399423+0000","last_clean":"2023-12-16T00:00:46.399423+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:46.399423+0000","last_undegraded":"2023-12-16T00:00:46.399423+0000","last_fullsized":"2023-12-16T00:00:46.399423+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288080+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:27.288080+0000","last_peered":"2023-12-16T00:00:27.288080+0000","last_clean":"2023-12-16T00:00:27.288080+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:27.288080+0000","last_undegraded":"2023-12-16T00:00:27.288080+0000","last_fullsized":"2023-12-16T00:00:27.288080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410772+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:40.410772+0000","last_peered":"2023-12-16T00:00:40.410772+0000","last_clean":"2023-12-16T00:00:40.410772+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:40.410772+0000","last_undegraded":"2023-12-16T00:00:40.410772+0000","last_fullsized":"2023-12-16T00:00:40.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136765+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:28.136765+0000","last_peered":"2023-12-16T00:00:28.136765+0000","last_clean":"2023-12-16T00:00:28.136765+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:28.136765+0000","last_undegraded":"2023-12-16T00:00:28.136765+0000","last_fullsized":"2023-12-16T00:00:28.136765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'118","reported_seq":252,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409073+0000","last_change":"2023-12-15T22:53:06.321684+0000","last_active":"2023-12-16T00:00:35.409073+0000","last_peered":"2023-12-16T00:00:35.409073+0000","last_clean":"2023-12-16T00:00:35.409073+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:00:35.409073+0000","last_undegraded":"2023-12-16T00:00:35.409073+0000","last_fullsized":"2023-12-16T00:00:35.409073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711383+0000","last_change":"2023-12-15T22:52:55.189448+0000","last_active":"2023-12-16T00:00:27.711383+0000","last_peered":"2023-12-16T00:00:27.711383+0000","last_clean":"2023-12-16T00:00:27.711383+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:00:27.711383+0000","last_undegraded":"2023-12-16T00:00:27.711383+0000","last_fullsized":"2023-12-16T00:00:27.711383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136427+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:28.136427+0000","last_peered":"2023-12-16T00:00:28.136427+0000","last_clean":"2023-12-16T00:00:28.136427+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:28.136427+0000","last_undegraded":"2023-12-16T00:00:28.136427+0000","last_fullsized":"2023-12-16T00:00:28.136427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470578+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470578+0000","last_peered":"2023-12-16T00:02:55.470578+0000","last_clean":"2023-12-16T00:02:55.470578+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470578+0000","last_undegraded":"2023-12-16T00:02:55.470578+0000","last_fullsized":"2023-12-16T00:02:55.470578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136577+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:28.136577+0000","last_peered":"2023-12-16T00:00:28.136577+0000","last_clean":"2023-12-16T00:00:28.136577+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:28.136577+0000","last_undegraded":"2023-12-16T00:00:28.136577+0000","last_fullsized":"2023-12-16T00:00:28.136577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287840+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:27.287840+0000","last_peered":"2023-12-16T00:00:27.287840+0000","last_clean":"2023-12-16T00:00:27.287840+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:27.287840+0000","last_undegraded":"2023-12-16T00:00:27.287840+0000","last_fullsized":"2023-12-16T00:00:27.287840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355510+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355510+0000","last_peered":"2023-12-16T00:02:46.355510+0000","last_clean":"2023-12-16T00:02:46.355510+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355510+0000","last_undegraded":"2023-12-16T00:02:46.355510+0000","last_fullsized":"2023-12-16T00:02:46.355510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398726+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:50.398726+0000","last_peered":"2023-12-16T00:00:50.398726+0000","last_clean":"2023-12-16T00:00:50.398726+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:50.398726+0000","last_undegraded":"2023-12-16T00:00:50.398726+0000","last_fullsized":"2023-12-16T00:00:50.398726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015927+0000","last_change":"2023-12-15T22:52:55.193978+0000","last_active":"2023-12-16T00:00:26.015927+0000","last_peered":"2023-12-16T00:00:26.015927+0000","last_clean":"2023-12-16T00:00:26.015927+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:00:26.015927+0000","last_undegraded":"2023-12-16T00:00:26.015927+0000","last_fullsized":"2023-12-16T00:00:26.015927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136335+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:28.136335+0000","last_peered":"2023-12-16T00:00:28.136335+0000","last_clean":"2023-12-16T00:00:28.136335+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:28.136335+0000","last_undegraded":"2023-12-16T00:00:28.136335+0000","last_fullsized":"2023-12-16T00:00:28.136335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137591+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137591+0000","last_peered":"2023-12-16T00:02:59.137591+0000","last_clean":"2023-12-16T00:02:59.137591+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137591+0000","last_undegraded":"2023-12-16T00:02:59.137591+0000","last_fullsized":"2023-12-16T00:02:59.137591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.629876+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:40.629876+0000","last_peered":"2023-12-16T00:00:40.629876+0000","last_clean":"2023-12-16T00:00:40.629876+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:40.629876+0000","last_undegraded":"2023-12-16T00:00:40.629876+0000","last_fullsized":"2023-12-16T00:00:40.629876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'85","reported_seq":3532,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016818+0000","last_change":"2023-12-15T22:54:04.188062+0000","last_active":"2023-12-16T00:00:26.016818+0000","last_peered":"2023-12-16T00:00:26.016818+0000","last_clean":"2023-12-16T00:00:26.016818+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:00:26.016818+0000","last_undegraded":"2023-12-16T00:00:26.016818+0000","last_fullsized":"2023-12-16T00:00:26.016818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334191+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334191+0000","last_peered":"2023-12-16T00:02:27.334191+0000","last_clean":"2023-12-16T00:02:27.334191+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334191+0000","last_undegraded":"2023-12-16T00:02:27.334191+0000","last_fullsized":"2023-12-16T00:02:27.334191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711314+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:27.711314+0000","last_peered":"2023-12-16T00:00:27.711314+0000","last_clean":"2023-12-16T00:00:27.711314+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:27.711314+0000","last_undegraded":"2023-12-16T00:00:27.711314+0000","last_fullsized":"2023-12-16T00:00:27.711314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439680+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:26.439680+0000","last_peered":"2023-12-16T00:00:26.439680+0000","last_clean":"2023-12-16T00:00:26.439680+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:26.439680+0000","last_undegraded":"2023-12-16T00:00:26.439680+0000","last_fullsized":"2023-12-16T00:00:26.439680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"49'1","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.395067+0000","last_change":"2023-12-15T22:53:04.315195+0000","last_active":"2023-12-16T00:00:35.395067+0000","last_peered":"2023-12-16T00:00:35.395067+0000","last_clean":"2023-12-16T00:00:35.395067+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:00:35.395067+0000","last_undegraded":"2023-12-16T00:00:35.395067+0000","last_fullsized":"2023-12-16T00:00:35.395067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251660+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251660+0000","last_peered":"2023-12-16T00:02:37.251660+0000","last_clean":"2023-12-16T00:02:37.251660+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251660+0000","last_undegraded":"2023-12-16T00:02:37.251660+0000","last_fullsized":"2023-12-16T00:02:37.251660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.831218+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:04.831218+0000","last_peered":"2023-12-16T00:01:04.831218+0000","last_clean":"2023-12-16T00:01:04.831218+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:04.831218+0000","last_undegraded":"2023-12-16T00:01:04.831218+0000","last_fullsized":"2023-12-16T00:01:04.831218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.409998+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:40.409998+0000","last_peered":"2023-12-16T00:00:40.409998+0000","last_clean":"2023-12-16T00:00:40.409998+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:40.409998+0000","last_undegraded":"2023-12-16T00:00:40.409998+0000","last_fullsized":"2023-12-16T00:00:40.409998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":886,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137786+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:00:28.137786+0000","last_peered":"2023-12-16T00:00:28.137786+0000","last_clean":"2023-12-16T00:00:28.137786+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:00:28.137786+0000","last_undegraded":"2023-12-16T00:00:28.137786+0000","last_fullsized":"2023-12-16T00:00:28.137786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288152+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:27.288152+0000","last_peered":"2023-12-16T00:00:27.288152+0000","last_clean":"2023-12-16T00:00:27.288152+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:27.288152+0000","last_undegraded":"2023-12-16T00:00:27.288152+0000","last_fullsized":"2023-12-16T00:00:27.288152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":223,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580112+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580112+0000","last_peered":"2023-12-16T00:02:28.580112+0000","last_clean":"2023-12-16T00:02:28.580112+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580112+0000","last_undegraded":"2023-12-16T00:02:28.580112+0000","last_fullsized":"2023-12-16T00:02:28.580112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522168+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522168+0000","last_peered":"2023-12-16T00:02:28.522168+0000","last_clean":"2023-12-16T00:02:28.522168+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522168+0000","last_undegraded":"2023-12-16T00:02:28.522168+0000","last_fullsized":"2023-12-16T00:02:28.522168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711349+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:27.711349+0000","last_peered":"2023-12-16T00:00:27.711349+0000","last_clean":"2023-12-16T00:00:27.711349+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:27.711349+0000","last_undegraded":"2023-12-16T00:00:27.711349+0000","last_fullsized":"2023-12-16T00:00:27.711349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711244+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:27.711244+0000","last_peered":"2023-12-16T00:00:27.711244+0000","last_clean":"2023-12-16T00:00:27.711244+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:27.711244+0000","last_undegraded":"2023-12-16T00:00:27.711244+0000","last_fullsized":"2023-12-16T00:00:27.711244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.413424+0000","last_change":"2023-12-15T22:53:04.318132+0000","last_active":"2023-12-16T00:00:50.413424+0000","last_peered":"2023-12-16T00:00:50.413424+0000","last_clean":"2023-12-16T00:00:50.413424+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:00:50.413424+0000","last_undegraded":"2023-12-16T00:00:50.413424+0000","last_fullsized":"2023-12-16T00:00:50.413424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630904+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:45.630904+0000","last_peered":"2023-12-16T00:00:45.630904+0000","last_clean":"2023-12-16T00:00:45.630904+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:45.630904+0000","last_undegraded":"2023-12-16T00:00:45.630904+0000","last_fullsized":"2023-12-16T00:00:45.630904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439849+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439849+0000","last_peered":"2023-12-16T00:02:00.439849+0000","last_clean":"2023-12-16T00:02:00.439849+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439849+0000","last_undegraded":"2023-12-16T00:02:00.439849+0000","last_fullsized":"2023-12-16T00:02:00.439849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628529+0000","last_change":"2023-12-15T22:52:55.189717+0000","last_active":"2023-12-16T00:00:35.628529+0000","last_peered":"2023-12-16T00:00:35.628529+0000","last_clean":"2023-12-16T00:00:35.628529+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:00:35.628529+0000","last_undegraded":"2023-12-16T00:00:35.628529+0000","last_fullsized":"2023-12-16T00:00:35.628529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173593+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865431+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:26.865431+0000","last_peered":"2023-12-16T00:00:26.865431+0000","last_clean":"2023-12-16T00:00:26.865431+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:26.865431+0000","last_undegraded":"2023-12-16T00:00:26.865431+0000","last_fullsized":"2023-12-16T00:00:26.865431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707263+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707263+0000","last_peered":"2023-12-16T00:02:10.707263+0000","last_clean":"2023-12-16T00:02:10.707263+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707263+0000","last_undegraded":"2023-12-16T00:02:10.707263+0000","last_fullsized":"2023-12-16T00:02:10.707263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682626+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682626+0000","last_peered":"2023-12-16T00:01:33.682626+0000","last_clean":"2023-12-16T00:01:33.682626+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682626+0000","last_undegraded":"2023-12-16T00:01:33.682626+0000","last_fullsized":"2023-12-16T00:01:33.682626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3464,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.752812+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:00:39.752812+0000","last_peered":"2023-12-16T00:00:39.752812+0000","last_clean":"2023-12-16T00:00:39.752812+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:00:39.752812+0000","last_undegraded":"2023-12-16T00:00:39.752812+0000","last_fullsized":"2023-12-16T00:00:39.752812+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288113+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:27.288113+0000","last_peered":"2023-12-16T00:00:27.288113+0000","last_clean":"2023-12-16T00:00:27.288113+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:00:27.288113+0000","last_undegraded":"2023-12-16T00:00:27.288113+0000","last_fullsized":"2023-12-16T00:00:27.288113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711551+0000","last_change":"2023-12-15T22:53:04.320970+0000","last_active":"2023-12-16T00:00:27.711551+0000","last_peered":"2023-12-16T00:00:27.711551+0000","last_clean":"2023-12-16T00:00:27.711551+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:00:27.711551+0000","last_undegraded":"2023-12-16T00:00:27.711551+0000","last_fullsized":"2023-12-16T00:00:27.711551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'46","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136858+0000","last_change":"2023-12-15T22:53:06.324836+0000","last_active":"2023-12-16T00:00:28.136858+0000","last_peered":"2023-12-16T00:00:28.136858+0000","last_clean":"2023-12-16T00:00:28.136858+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:00:28.136858+0000","last_undegraded":"2023-12-16T00:00:28.136858+0000","last_fullsized":"2023-12-16T00:00:28.136858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193045+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193045+0000","last_peered":"2023-12-16T00:02:53.193045+0000","last_clean":"2023-12-16T00:02:53.193045+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193045+0000","last_undegraded":"2023-12-16T00:02:53.193045+0000","last_fullsized":"2023-12-16T00:02:53.193045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1586,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520628+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520628+0000","last_peered":"2023-12-16T00:02:25.520628+0000","last_clean":"2023-12-16T00:02:25.520628+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520628+0000","last_undegraded":"2023-12-16T00:02:25.520628+0000","last_fullsized":"2023-12-16T00:02:25.520628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189597+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189597+0000","last_peered":"2023-12-16T00:02:22.189597+0000","last_clean":"2023-12-16T00:02:22.189597+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189597+0000","last_undegraded":"2023-12-16T00:02:22.189597+0000","last_fullsized":"2023-12-16T00:02:22.189597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693630+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693630+0000","last_peered":"2023-12-16T00:01:41.693630+0000","last_clean":"2023-12-16T00:01:41.693630+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693630+0000","last_undegraded":"2023-12-16T00:01:41.693630+0000","last_fullsized":"2023-12-16T00:01:41.693630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439858+0000","last_change":"2023-12-15T22:52:55.187490+0000","last_active":"2023-12-16T00:00:26.439858+0000","last_peered":"2023-12-16T00:00:26.439858+0000","last_clean":"2023-12-16T00:00:26.439858+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:00:26.439858+0000","last_undegraded":"2023-12-16T00:00:26.439858+0000","last_fullsized":"2023-12-16T00:00:26.439858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412902+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:50.412902+0000","last_peered":"2023-12-16T00:00:50.412902+0000","last_clean":"2023-12-16T00:00:50.412902+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:50.412902+0000","last_undegraded":"2023-12-16T00:00:50.412902+0000","last_fullsized":"2023-12-16T00:00:50.412902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015932+0000","last_change":"2023-12-15T22:53:04.319299+0000","last_active":"2023-12-16T00:00:26.015932+0000","last_peered":"2023-12-16T00:00:26.015932+0000","last_clean":"2023-12-16T00:00:26.015932+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:00:26.015932+0000","last_undegraded":"2023-12-16T00:00:26.015932+0000","last_fullsized":"2023-12-16T00:00:26.015932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166619+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166619+0000","last_peered":"2023-12-16T00:03:03.166619+0000","last_clean":"2023-12-16T00:03:03.166619+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166619+0000","last_undegraded":"2023-12-16T00:03:03.166619+0000","last_fullsized":"2023-12-16T00:03:03.166619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478525+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478525+0000","last_peered":"2023-12-16T00:02:02.478525+0000","last_clean":"2023-12-16T00:02:02.478525+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478525+0000","last_undegraded":"2023-12-16T00:02:02.478525+0000","last_fullsized":"2023-12-16T00:02:02.478525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439851+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:26.439851+0000","last_peered":"2023-12-16T00:00:26.439851+0000","last_clean":"2023-12-16T00:00:26.439851+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:26.439851+0000","last_undegraded":"2023-12-16T00:00:26.439851+0000","last_fullsized":"2023-12-16T00:00:26.439851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.400805+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:51.400805+0000","last_peered":"2023-12-16T00:00:51.400805+0000","last_clean":"2023-12-16T00:00:51.400805+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:51.400805+0000","last_undegraded":"2023-12-16T00:00:51.400805+0000","last_fullsized":"2023-12-16T00:00:51.400805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635206+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:01:05.635206+0000","last_peered":"2023-12-16T00:01:05.635206+0000","last_clean":"2023-12-16T00:01:05.635206+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:01:05.635206+0000","last_undegraded":"2023-12-16T00:01:05.635206+0000","last_fullsized":"2023-12-16T00:01:05.635206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.173986+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.173986+0000","last_peered":"2023-12-16T00:02:51.173986+0000","last_clean":"2023-12-16T00:02:51.173986+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.173986+0000","last_undegraded":"2023-12-16T00:02:51.173986+0000","last_fullsized":"2023-12-16T00:02:51.173986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712554+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:27.712554+0000","last_peered":"2023-12-16T00:00:27.712554+0000","last_clean":"2023-12-16T00:00:27.712554+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:27.712554+0000","last_undegraded":"2023-12-16T00:00:27.712554+0000","last_fullsized":"2023-12-16T00:00:27.712554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160204+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160204+0000","last_peered":"2023-12-16T00:02:44.160204+0000","last_clean":"2023-12-16T00:02:44.160204+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160204+0000","last_undegraded":"2023-12-16T00:02:44.160204+0000","last_fullsized":"2023-12-16T00:02:44.160204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012653+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012653+0000","last_peered":"2023-12-16T00:02:14.012653+0000","last_clean":"2023-12-16T00:02:14.012653+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012653+0000","last_undegraded":"2023-12-16T00:02:14.012653+0000","last_fullsized":"2023-12-16T00:02:14.012653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":184,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.250294+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:48.250294+0000","last_peered":"2023-12-16T00:00:48.250294+0000","last_clean":"2023-12-16T00:00:48.250294+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:48.250294+0000","last_undegraded":"2023-12-16T00:00:48.250294+0000","last_fullsized":"2023-12-16T00:00:48.250294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015799+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:26.015799+0000","last_peered":"2023-12-16T00:00:26.015799+0000","last_clean":"2023-12-16T00:00:26.015799+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:26.015799+0000","last_undegraded":"2023-12-16T00:00:26.015799+0000","last_fullsized":"2023-12-16T00:00:26.015799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633202+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:55.633202+0000","last_peered":"2023-12-16T00:00:55.633202+0000","last_clean":"2023-12-16T00:00:55.633202+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:55.633202+0000","last_undegraded":"2023-12-16T00:00:55.633202+0000","last_fullsized":"2023-12-16T00:00:55.633202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'1","reported_seq":293,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136755+0000","last_change":"2023-12-15T22:53:04.319250+0000","last_active":"2023-12-16T00:00:28.136755+0000","last_peered":"2023-12-16T00:00:28.136755+0000","last_clean":"2023-12-16T00:00:28.136755+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:00:28.136755+0000","last_undegraded":"2023-12-16T00:00:28.136755+0000","last_fullsized":"2023-12-16T00:00:28.136755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":990,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196219+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196219+0000","last_peered":"2023-12-16T00:02:25.196219+0000","last_clean":"2023-12-16T00:02:25.196219+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196219+0000","last_undegraded":"2023-12-16T00:02:25.196219+0000","last_fullsized":"2023-12-16T00:02:25.196219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398854+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:50.398854+0000","last_peered":"2023-12-16T00:00:50.398854+0000","last_clean":"2023-12-16T00:00:50.398854+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:50.398854+0000","last_undegraded":"2023-12-16T00:00:50.398854+0000","last_fullsized":"2023-12-16T00:00:50.398854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'88","reported_seq":1257,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016835+0000","last_change":"2023-12-15T22:54:04.188799+0000","last_active":"2023-12-16T00:00:26.016835+0000","last_peered":"2023-12-16T00:00:26.016835+0000","last_clean":"2023-12-16T00:00:26.016835+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:00:26.016835+0000","last_undegraded":"2023-12-16T00:00:26.016835+0000","last_fullsized":"2023-12-16T00:00:26.016835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947140+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947140+0000","last_peered":"2023-12-16T00:01:30.947140+0000","last_clean":"2023-12-16T00:01:30.947140+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947140+0000","last_undegraded":"2023-12-16T00:01:30.947140+0000","last_fullsized":"2023-12-16T00:01:30.947140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1456,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818269+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818269+0000","last_peered":"2023-12-16T00:01:02.818269+0000","last_clean":"2023-12-16T00:01:02.818269+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818269+0000","last_undegraded":"2023-12-16T00:01:02.818269+0000","last_fullsized":"2023-12-16T00:01:02.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":511,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:09.905760+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:09.905760+0000","last_peered":"2023-12-16T00:01:09.905760+0000","last_clean":"2023-12-16T00:01:09.905760+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:09.905760+0000","last_undegraded":"2023-12-16T00:01:09.905760+0000","last_fullsized":"2023-12-16T00:01:09.905760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644838+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644838+0000","last_peered":"2023-12-16T00:01:58.644838+0000","last_clean":"2023-12-16T00:01:58.644838+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644838+0000","last_undegraded":"2023-12-16T00:01:58.644838+0000","last_fullsized":"2023-12-16T00:01:58.644838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711361+0000","last_change":"2023-12-15T22:52:55.190959+0000","last_active":"2023-12-16T00:00:27.711361+0000","last_peered":"2023-12-16T00:00:27.711361+0000","last_clean":"2023-12-16T00:00:27.711361+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:00:27.711361+0000","last_undegraded":"2023-12-16T00:00:27.711361+0000","last_fullsized":"2023-12-16T00:00:27.711361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633270+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:55.633270+0000","last_peered":"2023-12-16T00:00:55.633270+0000","last_clean":"2023-12-16T00:00:55.633270+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:55.633270+0000","last_undegraded":"2023-12-16T00:00:55.633270+0000","last_fullsized":"2023-12-16T00:00:55.633270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581608+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581608+0000","last_peered":"2023-12-16T00:02:49.581608+0000","last_clean":"2023-12-16T00:02:49.581608+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581608+0000","last_undegraded":"2023-12-16T00:02:49.581608+0000","last_fullsized":"2023-12-16T00:02:49.581608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529727+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529727+0000","last_peered":"2023-12-16T00:02:53.529727+0000","last_clean":"2023-12-16T00:02:53.529727+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529727+0000","last_undegraded":"2023-12-16T00:02:53.529727+0000","last_fullsized":"2023-12-16T00:02:53.529727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662975+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662975+0000","last_peered":"2023-12-16T00:02:16.662975+0000","last_clean":"2023-12-16T00:02:16.662975+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662975+0000","last_undegraded":"2023-12-16T00:02:16.662975+0000","last_fullsized":"2023-12-16T00:02:16.662975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865369+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:26.865369+0000","last_peered":"2023-12-16T00:00:26.865369+0000","last_clean":"2023-12-16T00:00:26.865369+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:26.865369+0000","last_undegraded":"2023-12-16T00:00:26.865369+0000","last_fullsized":"2023-12-16T00:00:26.865369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'92","reported_seq":5896,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289225+0000","last_change":"2023-12-15T22:54:04.184510+0000","last_active":"2023-12-16T00:00:27.289225+0000","last_peered":"2023-12-16T00:00:27.289225+0000","last_clean":"2023-12-16T00:00:27.289225+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:00:27.289225+0000","last_undegraded":"2023-12-16T00:00:27.289225+0000","last_fullsized":"2023-12-16T00:00:27.289225+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326922+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326922+0000","last_peered":"2023-12-16T00:02:24.326922+0000","last_clean":"2023-12-16T00:02:24.326922+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326922+0000","last_undegraded":"2023-12-16T00:02:24.326922+0000","last_fullsized":"2023-12-16T00:02:24.326922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228196+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228196+0000","last_peered":"2023-12-16T00:01:37.228196+0000","last_clean":"2023-12-16T00:01:37.228196+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228196+0000","last_undegraded":"2023-12-16T00:01:37.228196+0000","last_fullsized":"2023-12-16T00:01:37.228196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:30.359714+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:00:30.359714+0000","last_peered":"2023-12-16T00:00:30.359714+0000","last_clean":"2023-12-16T00:00:30.359714+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:00:30.359714+0000","last_undegraded":"2023-12-16T00:00:30.359714+0000","last_fullsized":"2023-12-16T00:00:30.359714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:39.090940+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:39.090940+0000","last_peered":"2023-12-16T00:00:39.090940+0000","last_clean":"2023-12-16T00:00:39.090940+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:39.090940+0000","last_undegraded":"2023-12-16T00:00:39.090940+0000","last_fullsized":"2023-12-16T00:00:39.090940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015795+0000","last_change":"2023-12-15T22:52:55.192064+0000","last_active":"2023-12-16T00:00:26.015795+0000","last_peered":"2023-12-16T00:00:26.015795+0000","last_clean":"2023-12-16T00:00:26.015795+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:00:26.015795+0000","last_undegraded":"2023-12-16T00:00:26.015795+0000","last_fullsized":"2023-12-16T00:00:26.015795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711241+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:00:27.711241+0000","last_peered":"2023-12-16T00:00:27.711241+0000","last_clean":"2023-12-16T00:00:27.711241+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:00:27.711241+0000","last_undegraded":"2023-12-16T00:00:27.711241+0000","last_fullsized":"2023-12-16T00:00:27.711241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"49'1","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288256+0000","last_change":"2023-12-15T22:53:04.318502+0000","last_active":"2023-12-16T00:00:27.288256+0000","last_peered":"2023-12-16T00:00:27.288256+0000","last_clean":"2023-12-16T00:00:27.288256+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:00:27.288256+0000","last_undegraded":"2023-12-16T00:00:27.288256+0000","last_fullsized":"2023-12-16T00:00:27.288256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453503+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453503+0000","last_peered":"2023-12-16T00:02:34.453503+0000","last_clean":"2023-12-16T00:02:34.453503+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453503+0000","last_undegraded":"2023-12-16T00:02:34.453503+0000","last_fullsized":"2023-12-16T00:02:34.453503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116738+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116738+0000","last_peered":"2023-12-16T00:02:44.116738+0000","last_clean":"2023-12-16T00:02:44.116738+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116738+0000","last_undegraded":"2023-12-16T00:02:44.116738+0000","last_fullsized":"2023-12-16T00:02:44.116738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.396040+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:40.396040+0000","last_peered":"2023-12-16T00:00:40.396040+0000","last_clean":"2023-12-16T00:00:40.396040+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:40.396040+0000","last_undegraded":"2023-12-16T00:00:40.396040+0000","last_fullsized":"2023-12-16T00:00:40.396040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'91","reported_seq":1398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137824+0000","last_change":"2023-12-15T22:54:04.180504+0000","last_active":"2023-12-16T00:00:28.137824+0000","last_peered":"2023-12-16T00:00:28.137824+0000","last_clean":"2023-12-16T00:00:28.137824+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:00:28.137824+0000","last_undegraded":"2023-12-16T00:00:28.137824+0000","last_fullsized":"2023-12-16T00:00:28.137824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629203+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629203+0000","last_peered":"2023-12-16T00:01:50.629203+0000","last_clean":"2023-12-16T00:01:50.629203+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629203+0000","last_undegraded":"2023-12-16T00:01:50.629203+0000","last_fullsized":"2023-12-16T00:01:50.629203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339046+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339046+0000","last_peered":"2023-12-16T00:02:33.339046+0000","last_clean":"2023-12-16T00:02:33.339046+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339046+0000","last_undegraded":"2023-12-16T00:02:33.339046+0000","last_fullsized":"2023-12-16T00:02:33.339046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921170+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921170+0000","last_peered":"2023-12-16T00:01:43.921170+0000","last_clean":"2023-12-16T00:01:43.921170+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921170+0000","last_undegraded":"2023-12-16T00:01:43.921170+0000","last_fullsized":"2023-12-16T00:01:43.921170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.388117+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:00:42.388117+0000","last_peered":"2023-12-16T00:00:42.388117+0000","last_clean":"2023-12-16T00:00:42.388117+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:00:42.388117+0000","last_undegraded":"2023-12-16T00:00:42.388117+0000","last_fullsized":"2023-12-16T00:00:42.388117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.096310+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:28.096310+0000","last_peered":"2023-12-16T00:00:28.096310+0000","last_clean":"2023-12-16T00:00:28.096310+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:28.096310+0000","last_undegraded":"2023-12-16T00:00:28.096310+0000","last_fullsized":"2023-12-16T00:00:28.096310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136732+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-16T00:00:28.136732+0000","last_peered":"2023-12-16T00:00:28.136732+0000","last_clean":"2023-12-16T00:00:28.136732+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:00:28.136732+0000","last_undegraded":"2023-12-16T00:00:28.136732+0000","last_fullsized":"2023-12-16T00:00:28.136732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.355963+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.355963+0000","last_peered":"2023-12-16T00:02:33.355963+0000","last_clean":"2023-12-16T00:02:33.355963+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.355963+0000","last_undegraded":"2023-12-16T00:02:33.355963+0000","last_fullsized":"2023-12-16T00:02:33.355963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126683+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126683+0000","last_peered":"2023-12-16T00:02:49.126683+0000","last_clean":"2023-12-16T00:02:49.126683+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126683+0000","last_undegraded":"2023-12-16T00:02:49.126683+0000","last_fullsized":"2023-12-16T00:02:49.126683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307393+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307393+0000","last_peered":"2023-12-16T00:01:26.307393+0000","last_clean":"2023-12-16T00:01:26.307393+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307393+0000","last_undegraded":"2023-12-16T00:01:26.307393+0000","last_fullsized":"2023-12-16T00:01:26.307393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3556,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095750+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095750+0000","last_peered":"2023-12-16T00:02:46.095750+0000","last_clean":"2023-12-16T00:02:46.095750+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095750+0000","last_undegraded":"2023-12-16T00:02:46.095750+0000","last_fullsized":"2023-12-16T00:02:46.095750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396521+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396521+0000","last_peered":"2023-12-16T00:01:59.396521+0000","last_clean":"2023-12-16T00:01:59.396521+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396521+0000","last_undegraded":"2023-12-16T00:01:59.396521+0000","last_fullsized":"2023-12-16T00:01:59.396521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791782+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791782+0000","last_peered":"2023-12-16T00:01:12.791782+0000","last_clean":"2023-12-16T00:01:12.791782+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791782+0000","last_undegraded":"2023-12-16T00:01:12.791782+0000","last_fullsized":"2023-12-16T00:01:12.791782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950181+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950181+0000","last_peered":"2023-12-16T00:01:28.950181+0000","last_clean":"2023-12-16T00:01:28.950181+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950181+0000","last_undegraded":"2023-12-16T00:01:28.950181+0000","last_fullsized":"2023-12-16T00:01:28.950181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.333082+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:00:36.333082+0000","last_peered":"2023-12-16T00:00:36.333082+0000","last_clean":"2023-12-16T00:00:36.333082+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:00:36.333082+0000","last_undegraded":"2023-12-16T00:00:36.333082+0000","last_fullsized":"2023-12-16T00:00:36.333082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.804753+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:00.804753+0000","last_peered":"2023-12-16T00:01:00.804753+0000","last_clean":"2023-12-16T00:01:00.804753+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:00.804753+0000","last_undegraded":"2023-12-16T00:01:00.804753+0000","last_fullsized":"2023-12-16T00:01:00.804753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"49'1","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016027+0000","last_change":"2023-12-15T22:53:04.315574+0000","last_active":"2023-12-16T00:00:26.016027+0000","last_peered":"2023-12-16T00:00:26.016027+0000","last_clean":"2023-12-16T00:00:26.016027+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:00:26.016027+0000","last_undegraded":"2023-12-16T00:00:26.016027+0000","last_fullsized":"2023-12-16T00:00:26.016027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'96","reported_seq":226,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016043+0000","last_change":"2023-12-15T22:53:06.324846+0000","last_active":"2023-12-16T00:00:26.016043+0000","last_peered":"2023-12-16T00:00:26.016043+0000","last_clean":"2023-12-16T00:00:26.016043+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:00:26.016043+0000","last_undegraded":"2023-12-16T00:00:26.016043+0000","last_fullsized":"2023-12-16T00:00:26.016043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561074+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561074+0000","last_peered":"2023-12-16T00:02:30.561074+0000","last_clean":"2023-12-16T00:02:30.561074+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561074+0000","last_undegraded":"2023-12-16T00:02:30.561074+0000","last_fullsized":"2023-12-16T00:02:30.561074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112882+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112882+0000","last_peered":"2023-12-16T00:02:08.112882+0000","last_clean":"2023-12-16T00:02:08.112882+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112882+0000","last_undegraded":"2023-12-16T00:02:08.112882+0000","last_fullsized":"2023-12-16T00:02:08.112882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676120+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676120+0000","last_peered":"2023-12-16T00:01:30.676120+0000","last_clean":"2023-12-16T00:01:30.676120+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676120+0000","last_undegraded":"2023-12-16T00:01:30.676120+0000","last_fullsized":"2023-12-16T00:01:30.676120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772069+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772069+0000","last_peered":"2023-12-16T00:01:03.772069+0000","last_clean":"2023-12-16T00:01:03.772069+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772069+0000","last_undegraded":"2023-12-16T00:01:03.772069+0000","last_fullsized":"2023-12-16T00:01:03.772069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1205,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.329707+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:00:31.329707+0000","last_peered":"2023-12-16T00:00:31.329707+0000","last_clean":"2023-12-16T00:00:31.329707+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:00:31.329707+0000","last_undegraded":"2023-12-16T00:00:31.329707+0000","last_fullsized":"2023-12-16T00:00:31.329707+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396888+0000","last_change":"2023-12-15T22:52:55.184809+0000","last_active":"2023-12-16T00:00:36.396888+0000","last_peered":"2023-12-16T00:00:36.396888+0000","last_clean":"2023-12-16T00:00:36.396888+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:00:36.396888+0000","last_undegraded":"2023-12-16T00:00:36.396888+0000","last_fullsized":"2023-12-16T00:00:36.396888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287922+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:27.287922+0000","last_peered":"2023-12-16T00:00:27.287922+0000","last_clean":"2023-12-16T00:00:27.287922+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:27.287922+0000","last_undegraded":"2023-12-16T00:00:27.287922+0000","last_fullsized":"2023-12-16T00:00:27.287922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864529+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:26.864529+0000","last_peered":"2023-12-16T00:00:26.864529+0000","last_clean":"2023-12-16T00:00:26.864529+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:26.864529+0000","last_undegraded":"2023-12-16T00:00:26.864529+0000","last_fullsized":"2023-12-16T00:00:26.864529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106608+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106608+0000","last_peered":"2023-12-16T00:02:12.106608+0000","last_clean":"2023-12-16T00:02:12.106608+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106608+0000","last_undegraded":"2023-12-16T00:02:12.106608+0000","last_fullsized":"2023-12-16T00:02:12.106608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6517,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437404+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437404+0000","last_peered":"2023-12-16T00:02:40.437404+0000","last_clean":"2023-12-16T00:02:40.437404+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437404+0000","last_undegraded":"2023-12-16T00:02:40.437404+0000","last_fullsized":"2023-12-16T00:02:40.437404+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749627+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749627+0000","last_peered":"2023-12-16T00:01:43.749627+0000","last_clean":"2023-12-16T00:01:43.749627+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749627+0000","last_undegraded":"2023-12-16T00:01:43.749627+0000","last_fullsized":"2023-12-16T00:01:43.749627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357239+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357239+0000","last_peered":"2023-12-16T00:01:50.357239+0000","last_clean":"2023-12-16T00:01:50.357239+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357239+0000","last_undegraded":"2023-12-16T00:01:50.357239+0000","last_fullsized":"2023-12-16T00:01:50.357239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1301,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.735004+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:00:35.735004+0000","last_peered":"2023-12-16T00:00:35.735004+0000","last_clean":"2023-12-16T00:00:35.735004+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:00:35.735004+0000","last_undegraded":"2023-12-16T00:00:35.735004+0000","last_fullsized":"2023-12-16T00:00:35.735004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562911+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562911+0000","last_peered":"2023-12-16T00:02:45.562911+0000","last_clean":"2023-12-16T00:02:45.562911+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562911+0000","last_undegraded":"2023-12-16T00:02:45.562911+0000","last_fullsized":"2023-12-16T00:02:45.562911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.783150+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:00:53.783150+0000","last_peered":"2023-12-16T00:00:53.783150+0000","last_clean":"2023-12-16T00:00:53.783150+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:00:53.783150+0000","last_undegraded":"2023-12-16T00:00:53.783150+0000","last_fullsized":"2023-12-16T00:00:53.783150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628119+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:35.628119+0000","last_peered":"2023-12-16T00:00:35.628119+0000","last_clean":"2023-12-16T00:00:35.628119+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:35.628119+0000","last_undegraded":"2023-12-16T00:00:35.628119+0000","last_fullsized":"2023-12-16T00:00:35.628119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408648+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:35.408648+0000","last_peered":"2023-12-16T00:00:35.408648+0000","last_clean":"2023-12-16T00:00:35.408648+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:35.408648+0000","last_undegraded":"2023-12-16T00:00:35.408648+0000","last_fullsized":"2023-12-16T00:00:35.408648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'30","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016049+0000","last_change":"2023-12-15T22:53:06.317054+0000","last_active":"2023-12-16T00:00:26.016049+0000","last_peered":"2023-12-16T00:00:26.016049+0000","last_clean":"2023-12-16T00:00:26.016049+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:00:26.016049+0000","last_undegraded":"2023-12-16T00:00:26.016049+0000","last_fullsized":"2023-12-16T00:00:26.016049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491847+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491847+0000","last_peered":"2023-12-16T00:02:33.491847+0000","last_clean":"2023-12-16T00:02:33.491847+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491847+0000","last_undegraded":"2023-12-16T00:02:33.491847+0000","last_fullsized":"2023-12-16T00:02:33.491847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168046+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168046+0000","last_peered":"2023-12-16T00:02:06.168046+0000","last_clean":"2023-12-16T00:02:06.168046+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168046+0000","last_undegraded":"2023-12-16T00:02:06.168046+0000","last_fullsized":"2023-12-16T00:02:06.168046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169539+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169539+0000","last_peered":"2023-12-16T00:02:23.169539+0000","last_clean":"2023-12-16T00:02:23.169539+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169539+0000","last_undegraded":"2023-12-16T00:02:23.169539+0000","last_fullsized":"2023-12-16T00:02:23.169539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218040+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218040+0000","last_peered":"2023-12-16T00:01:04.218040+0000","last_clean":"2023-12-16T00:01:04.218040+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218040+0000","last_undegraded":"2023-12-16T00:01:04.218040+0000","last_fullsized":"2023-12-16T00:01:04.218040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283922+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283922+0000","last_peered":"2023-12-16T00:01:51.283922+0000","last_clean":"2023-12-16T00:01:51.283922+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283922+0000","last_undegraded":"2023-12-16T00:01:51.283922+0000","last_fullsized":"2023-12-16T00:01:51.283922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.394707+0000","last_change":"2023-12-15T22:52:55.191960+0000","last_active":"2023-12-16T00:00:35.394707+0000","last_peered":"2023-12-16T00:00:35.394707+0000","last_clean":"2023-12-16T00:00:35.394707+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:00:35.394707+0000","last_undegraded":"2023-12-16T00:00:35.394707+0000","last_fullsized":"2023-12-16T00:00:35.394707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409406+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:35.409406+0000","last_peered":"2023-12-16T00:00:35.409406+0000","last_clean":"2023-12-16T00:00:35.409406+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:35.409406+0000","last_undegraded":"2023-12-16T00:00:35.409406+0000","last_fullsized":"2023-12-16T00:00:35.409406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'62","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864540+0000","last_change":"2023-12-15T22:53:06.320156+0000","last_active":"2023-12-16T00:00:26.864540+0000","last_peered":"2023-12-16T00:00:26.864540+0000","last_clean":"2023-12-16T00:00:26.864540+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:00:26.864540+0000","last_undegraded":"2023-12-16T00:00:26.864540+0000","last_fullsized":"2023-12-16T00:00:26.864540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891956+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891956+0000","last_peered":"2023-12-16T00:01:51.891956+0000","last_clean":"2023-12-16T00:01:51.891956+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891956+0000","last_undegraded":"2023-12-16T00:01:51.891956+0000","last_fullsized":"2023-12-16T00:01:51.891956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:54.280053+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:54.280053+0000","last_peered":"2023-12-16T00:00:54.280053+0000","last_clean":"2023-12-16T00:00:54.280053+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:54.280053+0000","last_undegraded":"2023-12-16T00:00:54.280053+0000","last_fullsized":"2023-12-16T00:00:54.280053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850184+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850184+0000","last_peered":"2023-12-16T00:01:41.850184+0000","last_clean":"2023-12-16T00:01:41.850184+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850184+0000","last_undegraded":"2023-12-16T00:01:41.850184+0000","last_fullsized":"2023-12-16T00:01:41.850184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.627952+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:35.627952+0000","last_peered":"2023-12-16T00:00:35.627952+0000","last_clean":"2023-12-16T00:00:35.627952+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:35.627952+0000","last_undegraded":"2023-12-16T00:00:35.627952+0000","last_fullsized":"2023-12-16T00:00:35.627952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408854+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:35.408854+0000","last_peered":"2023-12-16T00:00:35.408854+0000","last_clean":"2023-12-16T00:00:35.408854+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:35.408854+0000","last_undegraded":"2023-12-16T00:00:35.408854+0000","last_fullsized":"2023-12-16T00:00:35.408854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411418+0000","last_change":"2023-12-15T22:53:04.317522+0000","last_active":"2023-12-16T00:00:45.411418+0000","last_peered":"2023-12-16T00:00:45.411418+0000","last_clean":"2023-12-16T00:00:45.411418+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:00:45.411418+0000","last_undegraded":"2023-12-16T00:00:45.411418+0000","last_fullsized":"2023-12-16T00:00:45.411418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'48","reported_seq":144,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136993+0000","last_change":"2023-12-15T22:53:06.324911+0000","last_active":"2023-12-16T00:00:28.136993+0000","last_peered":"2023-12-16T00:00:28.136993+0000","last_clean":"2023-12-16T00:00:28.136993+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:00:28.136993+0000","last_undegraded":"2023-12-16T00:00:28.136993+0000","last_fullsized":"2023-12-16T00:00:28.136993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219351+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219351+0000","last_peered":"2023-12-16T00:02:41.219351+0000","last_clean":"2023-12-16T00:02:41.219351+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219351+0000","last_undegraded":"2023-12-16T00:02:41.219351+0000","last_fullsized":"2023-12-16T00:02:41.219351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385103+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385103+0000","last_peered":"2023-12-16T00:02:50.385103+0000","last_clean":"2023-12-16T00:02:50.385103+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385103+0000","last_undegraded":"2023-12-16T00:02:50.385103+0000","last_fullsized":"2023-12-16T00:02:50.385103+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207124+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207124+0000","last_peered":"2023-12-16T00:01:36.207124+0000","last_clean":"2023-12-16T00:01:36.207124+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207124+0000","last_undegraded":"2023-12-16T00:01:36.207124+0000","last_fullsized":"2023-12-16T00:01:36.207124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2781,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.693822+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:00:36.693822+0000","last_peered":"2023-12-16T00:00:36.693822+0000","last_clean":"2023-12-16T00:00:36.693822+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:00:36.693822+0000","last_undegraded":"2023-12-16T00:00:36.693822+0000","last_fullsized":"2023-12-16T00:00:36.693822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873169+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873169+0000","last_peered":"2023-12-16T00:01:10.873169+0000","last_clean":"2023-12-16T00:01:10.873169+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873169+0000","last_undegraded":"2023-12-16T00:01:10.873169+0000","last_fullsized":"2023-12-16T00:01:10.873169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.394597+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:35.394597+0000","last_peered":"2023-12-16T00:00:35.394597+0000","last_clean":"2023-12-16T00:00:35.394597+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:35.394597+0000","last_undegraded":"2023-12-16T00:00:35.394597+0000","last_fullsized":"2023-12-16T00:00:35.394597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016012+0000","last_change":"2023-12-15T22:53:04.316099+0000","last_active":"2023-12-16T00:00:26.016012+0000","last_peered":"2023-12-16T00:00:26.016012+0000","last_clean":"2023-12-16T00:00:26.016012+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:00:26.016012+0000","last_undegraded":"2023-12-16T00:00:26.016012+0000","last_fullsized":"2023-12-16T00:00:26.016012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329154+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329154+0000","last_peered":"2023-12-16T00:02:30.329154+0000","last_clean":"2023-12-16T00:02:30.329154+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329154+0000","last_undegraded":"2023-12-16T00:02:30.329154+0000","last_fullsized":"2023-12-16T00:02:30.329154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522822+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522822+0000","last_peered":"2023-12-16T00:02:20.522822+0000","last_clean":"2023-12-16T00:02:20.522822+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522822+0000","last_undegraded":"2023-12-16T00:02:20.522822+0000","last_fullsized":"2023-12-16T00:02:20.522822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.677782+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:42.677782+0000","last_peered":"2023-12-16T00:00:42.677782+0000","last_clean":"2023-12-16T00:00:42.677782+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:42.677782+0000","last_undegraded":"2023-12-16T00:00:42.677782+0000","last_fullsized":"2023-12-16T00:00:42.677782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202172+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202172+0000","last_peered":"2023-12-16T00:02:33.202172+0000","last_clean":"2023-12-16T00:02:33.202172+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202172+0000","last_undegraded":"2023-12-16T00:02:33.202172+0000","last_fullsized":"2023-12-16T00:02:33.202172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360890+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360890+0000","last_peered":"2023-12-16T00:02:21.360890+0000","last_clean":"2023-12-16T00:02:21.360890+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360890+0000","last_undegraded":"2023-12-16T00:02:21.360890+0000","last_fullsized":"2023-12-16T00:02:21.360890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902867+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902867+0000","last_peered":"2023-12-16T00:01:31.902867+0000","last_clean":"2023-12-16T00:01:31.902867+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902867+0000","last_undegraded":"2023-12-16T00:01:31.902867+0000","last_fullsized":"2023-12-16T00:01:31.902867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2980,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.499882+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:00:45.499882+0000","last_peered":"2023-12-16T00:00:45.499882+0000","last_clean":"2023-12-16T00:00:45.499882+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:00:45.499882+0000","last_undegraded":"2023-12-16T00:00:45.499882+0000","last_fullsized":"2023-12-16T00:00:45.499882+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.854713+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:00:56.854713+0000","last_peered":"2023-12-16T00:00:56.854713+0000","last_clean":"2023-12-16T00:00:56.854713+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:00:56.854713+0000","last_undegraded":"2023-12-16T00:00:56.854713+0000","last_fullsized":"2023-12-16T00:00:56.854713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015893+0000","last_change":"2023-12-15T22:52:55.191318+0000","last_active":"2023-12-16T00:00:26.015893+0000","last_peered":"2023-12-16T00:00:26.015893+0000","last_clean":"2023-12-16T00:00:26.015893+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:00:26.015893+0000","last_undegraded":"2023-12-16T00:00:26.015893+0000","last_fullsized":"2023-12-16T00:00:26.015893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439748+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:26.439748+0000","last_peered":"2023-12-16T00:00:26.439748+0000","last_clean":"2023-12-16T00:00:26.439748+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:26.439748+0000","last_undegraded":"2023-12-16T00:00:26.439748+0000","last_fullsized":"2023-12-16T00:00:26.439748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":563,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377221+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377221+0000","last_peered":"2023-12-16T00:02:58.377221+0000","last_clean":"2023-12-16T00:02:58.377221+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377221+0000","last_undegraded":"2023-12-16T00:02:58.377221+0000","last_fullsized":"2023-12-16T00:02:58.377221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316713+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316713+0000","last_peered":"2023-12-16T00:02:39.316713+0000","last_clean":"2023-12-16T00:02:39.316713+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316713+0000","last_undegraded":"2023-12-16T00:02:39.316713+0000","last_fullsized":"2023-12-16T00:02:39.316713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087338+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087338+0000","last_peered":"2023-12-16T00:02:07.087338+0000","last_clean":"2023-12-16T00:02:07.087338+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087338+0000","last_undegraded":"2023-12-16T00:02:07.087338+0000","last_fullsized":"2023-12-16T00:02:07.087338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239262+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239262+0000","last_peered":"2023-12-16T00:01:35.239262+0000","last_clean":"2023-12-16T00:01:35.239262+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239262+0000","last_undegraded":"2023-12-16T00:01:35.239262+0000","last_fullsized":"2023-12-16T00:01:35.239262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'109","reported_seq":1326,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440794+0000","last_change":"2023-12-15T22:54:04.190757+0000","last_active":"2023-12-16T00:00:26.440794+0000","last_peered":"2023-12-16T00:00:26.440794+0000","last_clean":"2023-12-16T00:00:26.440794+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:00:26.440794+0000","last_undegraded":"2023-12-16T00:00:26.440794+0000","last_fullsized":"2023-12-16T00:00:26.440794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273146+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273146+0000","last_peered":"2023-12-16T00:02:14.273146+0000","last_clean":"2023-12-16T00:02:14.273146+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273146+0000","last_undegraded":"2023-12-16T00:02:14.273146+0000","last_fullsized":"2023-12-16T00:02:14.273146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478939+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478939+0000","last_peered":"2023-12-16T00:02:19.478939+0000","last_clean":"2023-12-16T00:02:19.478939+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478939+0000","last_undegraded":"2023-12-16T00:02:19.478939+0000","last_fullsized":"2023-12-16T00:02:19.478939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":388,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025286+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025286+0000","last_peered":"2023-12-16T00:02:04.025286+0000","last_clean":"2023-12-16T00:02:04.025286+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025286+0000","last_undegraded":"2023-12-16T00:02:04.025286+0000","last_fullsized":"2023-12-16T00:02:04.025286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725602+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725602+0000","last_peered":"2023-12-16T00:01:44.725602+0000","last_clean":"2023-12-16T00:01:44.725602+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725602+0000","last_undegraded":"2023-12-16T00:01:44.725602+0000","last_fullsized":"2023-12-16T00:01:44.725602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015840+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:26.015840+0000","last_peered":"2023-12-16T00:00:26.015840+0000","last_clean":"2023-12-16T00:00:26.015840+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:26.015840+0000","last_undegraded":"2023-12-16T00:00:26.015840+0000","last_fullsized":"2023-12-16T00:00:26.015840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711285+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:27.711285+0000","last_peered":"2023-12-16T00:00:27.711285+0000","last_clean":"2023-12-16T00:00:27.711285+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:27.711285+0000","last_undegraded":"2023-12-16T00:00:27.711285+0000","last_fullsized":"2023-12-16T00:00:27.711285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396965+0000","last_change":"2023-12-15T22:53:04.320983+0000","last_active":"2023-12-16T00:00:36.396965+0000","last_peered":"2023-12-16T00:00:36.396965+0000","last_clean":"2023-12-16T00:00:36.396965+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:00:36.396965+0000","last_undegraded":"2023-12-16T00:00:36.396965+0000","last_fullsized":"2023-12-16T00:00:36.396965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624495+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624495+0000","last_peered":"2023-12-16T00:02:24.624495+0000","last_clean":"2023-12-16T00:02:24.624495+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624495+0000","last_undegraded":"2023-12-16T00:02:24.624495+0000","last_fullsized":"2023-12-16T00:02:24.624495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.918187+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:16.918187+0000","last_peered":"2023-12-16T00:01:16.918187+0000","last_clean":"2023-12-16T00:01:16.918187+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:16.918187+0000","last_undegraded":"2023-12-16T00:01:16.918187+0000","last_fullsized":"2023-12-16T00:01:16.918187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195623+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195623+0000","last_peered":"2023-12-16T00:01:41.195623+0000","last_clean":"2023-12-16T00:01:41.195623+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195623+0000","last_undegraded":"2023-12-16T00:01:41.195623+0000","last_fullsized":"2023-12-16T00:01:41.195623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3898,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200859+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200859+0000","last_peered":"2023-12-16T00:02:19.200859+0000","last_clean":"2023-12-16T00:02:19.200859+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200859+0000","last_undegraded":"2023-12-16T00:02:19.200859+0000","last_fullsized":"2023-12-16T00:02:19.200859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339013+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339013+0000","last_peered":"2023-12-16T00:02:29.339013+0000","last_clean":"2023-12-16T00:02:29.339013+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339013+0000","last_undegraded":"2023-12-16T00:02:29.339013+0000","last_fullsized":"2023-12-16T00:02:29.339013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.802296+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:08.802296+0000","last_peered":"2023-12-16T00:01:08.802296+0000","last_clean":"2023-12-16T00:01:08.802296+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:08.802296+0000","last_undegraded":"2023-12-16T00:01:08.802296+0000","last_fullsized":"2023-12-16T00:01:08.802296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16988,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.805517+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:00:47.805517+0000","last_peered":"2023-12-16T00:00:47.805517+0000","last_clean":"2023-12-16T00:00:47.805517+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:00:47.805517+0000","last_undegraded":"2023-12-16T00:00:47.805517+0000","last_fullsized":"2023-12-16T00:00:47.805517+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.992882+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:00:42.992882+0000","last_peered":"2023-12-16T00:00:42.992882+0000","last_clean":"2023-12-16T00:00:42.992882+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:00:42.992882+0000","last_undegraded":"2023-12-16T00:00:42.992882+0000","last_fullsized":"2023-12-16T00:00:42.992882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015647+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:26.015647+0000","last_peered":"2023-12-16T00:00:26.015647+0000","last_clean":"2023-12-16T00:00:26.015647+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:26.015647+0000","last_undegraded":"2023-12-16T00:00:26.015647+0000","last_fullsized":"2023-12-16T00:00:26.015647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322913+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322913+0000","last_peered":"2023-12-16T00:02:48.322913+0000","last_clean":"2023-12-16T00:02:48.322913+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322913+0000","last_undegraded":"2023-12-16T00:02:48.322913+0000","last_fullsized":"2023-12-16T00:02:48.322913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119101+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119101+0000","last_peered":"2023-12-16T00:02:43.119101+0000","last_clean":"2023-12-16T00:02:43.119101+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119101+0000","last_undegraded":"2023-12-16T00:02:43.119101+0000","last_fullsized":"2023-12-16T00:02:43.119101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219694+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219694+0000","last_peered":"2023-12-16T00:01:33.219694+0000","last_clean":"2023-12-16T00:01:33.219694+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219694+0000","last_undegraded":"2023-12-16T00:01:33.219694+0000","last_fullsized":"2023-12-16T00:01:33.219694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092050+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092050+0000","last_peered":"2023-12-16T00:02:06.092050+0000","last_clean":"2023-12-16T00:02:06.092050+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092050+0000","last_undegraded":"2023-12-16T00:02:06.092050+0000","last_fullsized":"2023-12-16T00:02:06.092050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513266+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513266+0000","last_peered":"2023-12-16T00:02:15.513266+0000","last_clean":"2023-12-16T00:02:15.513266+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513266+0000","last_undegraded":"2023-12-16T00:02:15.513266+0000","last_fullsized":"2023-12-16T00:02:15.513266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.778805+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:00.778805+0000","last_peered":"2023-12-16T00:01:00.778805+0000","last_clean":"2023-12-16T00:01:00.778805+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:00.778805+0000","last_undegraded":"2023-12-16T00:01:00.778805+0000","last_fullsized":"2023-12-16T00:01:00.778805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136426+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:28.136426+0000","last_peered":"2023-12-16T00:00:28.136426+0000","last_clean":"2023-12-16T00:00:28.136426+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:28.136426+0000","last_undegraded":"2023-12-16T00:00:28.136426+0000","last_fullsized":"2023-12-16T00:00:28.136426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396819+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:36.396819+0000","last_peered":"2023-12-16T00:00:36.396819+0000","last_clean":"2023-12-16T00:00:36.396819+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:36.396819+0000","last_undegraded":"2023-12-16T00:00:36.396819+0000","last_fullsized":"2023-12-16T00:00:36.396819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'90","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136926+0000","last_change":"2023-12-15T22:53:06.320548+0000","last_active":"2023-12-16T00:00:28.136926+0000","last_peered":"2023-12-16T00:00:28.136926+0000","last_clean":"2023-12-16T00:00:28.136926+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:00:28.136926+0000","last_undegraded":"2023-12-16T00:00:28.136926+0000","last_fullsized":"2023-12-16T00:00:28.136926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158555+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158555+0000","last_peered":"2023-12-16T00:02:00.158555+0000","last_clean":"2023-12-16T00:02:00.158555+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158555+0000","last_undegraded":"2023-12-16T00:02:00.158555+0000","last_fullsized":"2023-12-16T00:02:00.158555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134818+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134818+0000","last_peered":"2023-12-16T00:01:23.134818+0000","last_clean":"2023-12-16T00:01:23.134818+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134818+0000","last_undegraded":"2023-12-16T00:01:23.134818+0000","last_fullsized":"2023-12-16T00:01:23.134818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865424+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:26.865424+0000","last_peered":"2023-12-16T00:00:26.865424+0000","last_clean":"2023-12-16T00:00:26.865424+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:26.865424+0000","last_undegraded":"2023-12-16T00:00:26.865424+0000","last_fullsized":"2023-12-16T00:00:26.865424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":51,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137737+0000","last_change":"2023-12-15T22:53:58.173519+0000","last_active":"2023-12-16T00:00:28.137737+0000","last_peered":"2023-12-16T00:00:28.137737+0000","last_clean":"2023-12-16T00:00:28.137737+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:00:28.137737+0000","last_undegraded":"2023-12-16T00:00:28.137737+0000","last_fullsized":"2023-12-16T00:00:28.137737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:57.147806+0000","last_clean_scrub_stamp":"2023-12-15T22:53:57.147806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246171+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246171+0000","last_peered":"2023-12-16T00:01:50.246171+0000","last_clean":"2023-12-16T00:01:50.246171+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246171+0000","last_undegraded":"2023-12-16T00:01:50.246171+0000","last_fullsized":"2023-12-16T00:01:50.246171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986502+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986502+0000","last_peered":"2023-12-16T00:01:56.986502+0000","last_clean":"2023-12-16T00:01:56.986502+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986502+0000","last_undegraded":"2023-12-16T00:01:56.986502+0000","last_fullsized":"2023-12-16T00:01:56.986502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711913+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:27.711913+0000","last_peered":"2023-12-16T00:00:27.711913+0000","last_clean":"2023-12-16T00:00:27.711913+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:27.711913+0000","last_undegraded":"2023-12-16T00:00:27.711913+0000","last_fullsized":"2023-12-16T00:00:27.711913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711370+0000","last_change":"2023-12-15T22:52:55.188058+0000","last_active":"2023-12-16T00:00:27.711370+0000","last_peered":"2023-12-16T00:00:27.711370+0000","last_clean":"2023-12-16T00:00:27.711370+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:00:27.711370+0000","last_undegraded":"2023-12-16T00:00:27.711370+0000","last_fullsized":"2023-12-16T00:00:27.711370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136417+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:28.136417+0000","last_peered":"2023-12-16T00:00:28.136417+0000","last_clean":"2023-12-16T00:00:28.136417+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:28.136417+0000","last_undegraded":"2023-12-16T00:00:28.136417+0000","last_fullsized":"2023-12-16T00:00:28.136417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409146+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:35.409146+0000","last_peered":"2023-12-16T00:00:35.409146+0000","last_clean":"2023-12-16T00:00:35.409146+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:35.409146+0000","last_undegraded":"2023-12-16T00:00:35.409146+0000","last_fullsized":"2023-12-16T00:00:35.409146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116464+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116464+0000","last_peered":"2023-12-16T00:03:01.116464+0000","last_clean":"2023-12-16T00:03:01.116464+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116464+0000","last_undegraded":"2023-12-16T00:03:01.116464+0000","last_fullsized":"2023-12-16T00:03:01.116464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525340+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525340+0000","last_peered":"2023-12-16T00:02:21.525340+0000","last_clean":"2023-12-16T00:02:21.525340+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525340+0000","last_undegraded":"2023-12-16T00:02:21.525340+0000","last_fullsized":"2023-12-16T00:02:21.525340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754975+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754975+0000","last_peered":"2023-12-16T00:00:51.754975+0000","last_clean":"2023-12-16T00:00:51.754975+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754975+0000","last_undegraded":"2023-12-16T00:00:51.754975+0000","last_fullsized":"2023-12-16T00:00:51.754975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3684,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689717+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689717+0000","last_peered":"2023-12-16T00:02:12.689717+0000","last_clean":"2023-12-16T00:02:12.689717+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689717+0000","last_undegraded":"2023-12-16T00:02:12.689717+0000","last_fullsized":"2023-12-16T00:02:12.689717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296903+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296903+0000","last_peered":"2023-12-16T00:02:30.296903+0000","last_clean":"2023-12-16T00:02:30.296903+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296903+0000","last_undegraded":"2023-12-16T00:02:30.296903+0000","last_fullsized":"2023-12-16T00:02:30.296903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892770+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892770+0000","last_peered":"2023-12-16T00:01:49.892770+0000","last_clean":"2023-12-16T00:01:49.892770+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892770+0000","last_undegraded":"2023-12-16T00:01:49.892770+0000","last_fullsized":"2023-12-16T00:01:49.892770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015826+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:26.015826+0000","last_peered":"2023-12-16T00:00:26.015826+0000","last_clean":"2023-12-16T00:00:26.015826+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:26.015826+0000","last_undegraded":"2023-12-16T00:00:26.015826+0000","last_fullsized":"2023-12-16T00:00:26.015826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864068+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:00:26.864068+0000","last_peered":"2023-12-16T00:00:26.864068+0000","last_clean":"2023-12-16T00:00:26.864068+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:00:26.864068+0000","last_undegraded":"2023-12-16T00:00:26.864068+0000","last_fullsized":"2023-12-16T00:00:26.864068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"49'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711596+0000","last_change":"2023-12-15T22:53:04.322476+0000","last_active":"2023-12-16T00:00:27.711596+0000","last_peered":"2023-12-16T00:00:27.711596+0000","last_clean":"2023-12-16T00:00:27.711596+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:00:27.711596+0000","last_undegraded":"2023-12-16T00:00:27.711596+0000","last_fullsized":"2023-12-16T00:00:27.711596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187899+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187899+0000","last_peered":"2023-12-16T00:02:56.187899+0000","last_clean":"2023-12-16T00:02:56.187899+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187899+0000","last_undegraded":"2023-12-16T00:02:56.187899+0000","last_fullsized":"2023-12-16T00:02:56.187899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550756+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550756+0000","last_peered":"2023-12-16T00:02:30.550756+0000","last_clean":"2023-12-16T00:02:30.550756+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550756+0000","last_undegraded":"2023-12-16T00:02:30.550756+0000","last_fullsized":"2023-12-16T00:02:30.550756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110061+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110061+0000","last_peered":"2023-12-16T00:01:24.110061+0000","last_clean":"2023-12-16T00:01:24.110061+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110061+0000","last_undegraded":"2023-12-16T00:01:24.110061+0000","last_fullsized":"2023-12-16T00:01:24.110061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020604+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020604+0000","last_peered":"2023-12-16T00:02:10.020604+0000","last_clean":"2023-12-16T00:02:10.020604+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020604+0000","last_undegraded":"2023-12-16T00:02:10.020604+0000","last_fullsized":"2023-12-16T00:02:10.020604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237503+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237503+0000","last_peered":"2023-12-16T00:02:34.237503+0000","last_clean":"2023-12-16T00:02:34.237503+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237503+0000","last_undegraded":"2023-12-16T00:02:34.237503+0000","last_fullsized":"2023-12-16T00:02:34.237503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.838215+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:04.838215+0000","last_peered":"2023-12-16T00:01:04.838215+0000","last_clean":"2023-12-16T00:01:04.838215+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:04.838215+0000","last_undegraded":"2023-12-16T00:01:04.838215+0000","last_fullsized":"2023-12-16T00:01:04.838215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408217+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:35.408217+0000","last_peered":"2023-12-16T00:00:35.408217+0000","last_clean":"2023-12-16T00:00:35.408217+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:35.408217+0000","last_undegraded":"2023-12-16T00:00:35.408217+0000","last_fullsized":"2023-12-16T00:00:35.408217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463634+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463634+0000","last_peered":"2023-12-16T00:03:05.463634+0000","last_clean":"2023-12-16T00:03:05.463634+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463634+0000","last_undegraded":"2023-12-16T00:03:05.463634+0000","last_fullsized":"2023-12-16T00:03:05.463634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327755+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327755+0000","last_peered":"2023-12-16T00:02:34.327755+0000","last_clean":"2023-12-16T00:02:34.327755+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327755+0000","last_undegraded":"2023-12-16T00:02:34.327755+0000","last_fullsized":"2023-12-16T00:02:34.327755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679948+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679948+0000","last_peered":"2023-12-16T00:01:47.679948+0000","last_clean":"2023-12-16T00:01:47.679948+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679948+0000","last_undegraded":"2023-12-16T00:01:47.679948+0000","last_fullsized":"2023-12-16T00:01:47.679948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634825+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634825+0000","last_peered":"2023-12-16T00:02:01.634825+0000","last_clean":"2023-12-16T00:02:01.634825+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634825+0000","last_undegraded":"2023-12-16T00:02:01.634825+0000","last_fullsized":"2023-12-16T00:02:01.634825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439995+0000","last_change":"2023-12-15T22:52:55.190091+0000","last_active":"2023-12-16T00:00:26.439995+0000","last_peered":"2023-12-16T00:00:26.439995+0000","last_clean":"2023-12-16T00:00:26.439995+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:00:26.439995+0000","last_undegraded":"2023-12-16T00:00:26.439995+0000","last_fullsized":"2023-12-16T00:00:26.439995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711283+0000","last_change":"2023-12-15T22:53:01.293215+0000","last_active":"2023-12-16T00:00:27.711283+0000","last_peered":"2023-12-16T00:00:27.711283+0000","last_clean":"2023-12-16T00:00:27.711283+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:00:27.711283+0000","last_undegraded":"2023-12-16T00:00:27.711283+0000","last_fullsized":"2023-12-16T00:00:27.711283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869290+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869290+0000","last_peered":"2023-12-16T00:01:06.869290+0000","last_clean":"2023-12-16T00:01:06.869290+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869290+0000","last_undegraded":"2023-12-16T00:01:06.869290+0000","last_fullsized":"2023-12-16T00:01:06.869290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439962+0000","last_change":"2023-12-15T22:52:55.189014+0000","last_active":"2023-12-16T00:00:26.439962+0000","last_peered":"2023-12-16T00:00:26.439962+0000","last_clean":"2023-12-16T00:00:26.439962+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:00:26.439962+0000","last_undegraded":"2023-12-16T00:00:26.439962+0000","last_fullsized":"2023-12-16T00:00:26.439962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864089+0000","last_change":"2023-12-15T22:52:53.175882+0000","last_active":"2023-12-16T00:00:26.864089+0000","last_peered":"2023-12-16T00:00:26.864089+0000","last_clean":"2023-12-16T00:00:26.864089+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:00:26.864089+0000","last_undegraded":"2023-12-16T00:00:26.864089+0000","last_fullsized":"2023-12-16T00:00:26.864089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":136,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.014957+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.014957+0000","last_peered":"2023-12-16T00:01:13.014957+0000","last_clean":"2023-12-16T00:01:13.014957+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.014957+0000","last_undegraded":"2023-12-16T00:01:13.014957+0000","last_fullsized":"2023-12-16T00:01:13.014957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439970+0000","last_change":"2023-12-15T22:52:55.189910+0000","last_active":"2023-12-16T00:00:26.439970+0000","last_peered":"2023-12-16T00:00:26.439970+0000","last_clean":"2023-12-16T00:00:26.439970+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:00:26.439970+0000","last_undegraded":"2023-12-16T00:00:26.439970+0000","last_fullsized":"2023-12-16T00:00:26.439970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:38.742008+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:00:38.742008+0000","last_peered":"2023-12-16T00:00:38.742008+0000","last_clean":"2023-12-16T00:00:38.742008+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:00:38.742008+0000","last_undegraded":"2023-12-16T00:00:38.742008+0000","last_fullsized":"2023-12-16T00:00:38.742008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864271+0000","last_change":"2023-12-15T22:52:55.191879+0000","last_active":"2023-12-16T00:00:26.864271+0000","last_peered":"2023-12-16T00:00:26.864271+0000","last_clean":"2023-12-16T00:00:26.864271+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:00:26.864271+0000","last_undegraded":"2023-12-16T00:00:26.864271+0000","last_fullsized":"2023-12-16T00:00:26.864271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015729+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:26.015729+0000","last_peered":"2023-12-16T00:00:26.015729+0000","last_clean":"2023-12-16T00:00:26.015729+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:26.015729+0000","last_undegraded":"2023-12-16T00:00:26.015729+0000","last_fullsized":"2023-12-16T00:00:26.015729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427778+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427778+0000","last_peered":"2023-12-16T00:03:03.427778+0000","last_clean":"2023-12-16T00:03:03.427778+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427778+0000","last_undegraded":"2023-12-16T00:03:03.427778+0000","last_fullsized":"2023-12-16T00:03:03.427778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439762+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:26.439762+0000","last_peered":"2023-12-16T00:00:26.439762+0000","last_clean":"2023-12-16T00:00:26.439762+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:26.439762+0000","last_undegraded":"2023-12-16T00:00:26.439762+0000","last_fullsized":"2023-12-16T00:00:26.439762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.937550+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:28.937550+0000","last_peered":"2023-12-16T00:00:28.937550+0000","last_clean":"2023-12-16T00:00:28.937550+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:28.937550+0000","last_undegraded":"2023-12-16T00:00:28.937550+0000","last_fullsized":"2023-12-16T00:00:28.937550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287952+0000","last_change":"2023-12-15T22:52:53.177294+0000","last_active":"2023-12-16T00:00:27.287952+0000","last_peered":"2023-12-16T00:00:27.287952+0000","last_clean":"2023-12-16T00:00:27.287952+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:00:27.287952+0000","last_undegraded":"2023-12-16T00:00:27.287952+0000","last_fullsized":"2023-12-16T00:00:27.287952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591074+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591074+0000","last_peered":"2023-12-16T00:01:51.591074+0000","last_clean":"2023-12-16T00:01:51.591074+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591074+0000","last_undegraded":"2023-12-16T00:01:51.591074+0000","last_fullsized":"2023-12-16T00:01:51.591074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288153+0000","last_change":"2023-12-15T22:52:55.183602+0000","last_active":"2023-12-16T00:00:27.288153+0000","last_peered":"2023-12-16T00:00:27.288153+0000","last_clean":"2023-12-16T00:00:27.288153+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:00:27.288153+0000","last_undegraded":"2023-12-16T00:00:27.288153+0000","last_fullsized":"2023-12-16T00:00:27.288153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864166+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:26.864166+0000","last_peered":"2023-12-16T00:00:26.864166+0000","last_clean":"2023-12-16T00:00:26.864166+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:26.864166+0000","last_undegraded":"2023-12-16T00:00:26.864166+0000","last_fullsized":"2023-12-16T00:00:26.864166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408812+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:35.408812+0000","last_peered":"2023-12-16T00:00:35.408812+0000","last_clean":"2023-12-16T00:00:35.408812+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:35.408812+0000","last_undegraded":"2023-12-16T00:00:35.408812+0000","last_fullsized":"2023-12-16T00:00:35.408812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.397150+0000","last_change":"2023-12-15T22:52:55.188823+0000","last_active":"2023-12-16T00:00:36.397150+0000","last_peered":"2023-12-16T00:00:36.397150+0000","last_clean":"2023-12-16T00:00:36.397150+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:00:36.397150+0000","last_undegraded":"2023-12-16T00:00:36.397150+0000","last_fullsized":"2023-12-16T00:00:36.397150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015739+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:26.015739+0000","last_peered":"2023-12-16T00:00:26.015739+0000","last_clean":"2023-12-16T00:00:26.015739+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:26.015739+0000","last_undegraded":"2023-12-16T00:00:26.015739+0000","last_fullsized":"2023-12-16T00:00:26.015739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288174+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:27.288174+0000","last_peered":"2023-12-16T00:00:27.288174+0000","last_clean":"2023-12-16T00:00:27.288174+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:27.288174+0000","last_undegraded":"2023-12-16T00:00:27.288174+0000","last_fullsized":"2023-12-16T00:00:27.288174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015869+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:26.015869+0000","last_peered":"2023-12-16T00:00:26.015869+0000","last_clean":"2023-12-16T00:00:26.015869+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:26.015869+0000","last_undegraded":"2023-12-16T00:00:26.015869+0000","last_fullsized":"2023-12-16T00:00:26.015869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711459+0000","last_change":"2023-12-15T22:52:55.194065+0000","last_active":"2023-12-16T00:00:27.711459+0000","last_peered":"2023-12-16T00:00:27.711459+0000","last_clean":"2023-12-16T00:00:27.711459+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:00:27.711459+0000","last_undegraded":"2023-12-16T00:00:27.711459+0000","last_fullsized":"2023-12-16T00:00:27.711459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015891+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:26.015891+0000","last_peered":"2023-12-16T00:00:26.015891+0000","last_clean":"2023-12-16T00:00:26.015891+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:26.015891+0000","last_undegraded":"2023-12-16T00:00:26.015891+0000","last_fullsized":"2023-12-16T00:00:26.015891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410115+0000","last_change":"2023-12-15T22:52:53.173663+0000","last_active":"2023-12-16T00:00:40.410115+0000","last_peered":"2023-12-16T00:00:40.410115+0000","last_clean":"2023-12-16T00:00:40.410115+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:00:40.410115+0000","last_undegraded":"2023-12-16T00:00:40.410115+0000","last_fullsized":"2023-12-16T00:00:40.410115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440012+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:26.440012+0000","last_peered":"2023-12-16T00:00:26.440012+0000","last_clean":"2023-12-16T00:00:26.440012+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:26.440012+0000","last_undegraded":"2023-12-16T00:00:26.440012+0000","last_fullsized":"2023-12-16T00:00:26.440012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.395098+0000","last_change":"2023-12-15T22:52:53.176233+0000","last_active":"2023-12-16T00:00:35.395098+0000","last_peered":"2023-12-16T00:00:35.395098+0000","last_clean":"2023-12-16T00:00:35.395098+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:00:35.395098+0000","last_undegraded":"2023-12-16T00:00:35.395098+0000","last_fullsized":"2023-12-16T00:00:35.395098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288186+0000","last_change":"2023-12-15T22:52:55.186895+0000","last_active":"2023-12-16T00:00:27.288186+0000","last_peered":"2023-12-16T00:00:27.288186+0000","last_clean":"2023-12-16T00:00:27.288186+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:00:27.288186+0000","last_undegraded":"2023-12-16T00:00:27.288186+0000","last_fullsized":"2023-12-16T00:00:27.288186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409528+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:35.409528+0000","last_peered":"2023-12-16T00:00:35.409528+0000","last_clean":"2023-12-16T00:00:35.409528+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:35.409528+0000","last_undegraded":"2023-12-16T00:00:35.409528+0000","last_fullsized":"2023-12-16T00:00:35.409528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":165,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124544+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124544+0000","last_peered":"2023-12-16T00:01:17.124544+0000","last_clean":"2023-12-16T00:01:17.124544+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124544+0000","last_undegraded":"2023-12-16T00:01:17.124544+0000","last_fullsized":"2023-12-16T00:01:17.124544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408164+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:35.408164+0000","last_peered":"2023-12-16T00:00:35.408164+0000","last_clean":"2023-12-16T00:00:35.408164+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:35.408164+0000","last_undegraded":"2023-12-16T00:00:35.408164+0000","last_fullsized":"2023-12-16T00:00:35.408164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015909+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:26.015909+0000","last_peered":"2023-12-16T00:00:26.015909+0000","last_clean":"2023-12-16T00:00:26.015909+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:26.015909+0000","last_undegraded":"2023-12-16T00:00:26.015909+0000","last_fullsized":"2023-12-16T00:00:26.015909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883750+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883750+0000","last_peered":"2023-12-16T00:01:06.883750+0000","last_clean":"2023-12-16T00:01:06.883750+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883750+0000","last_undegraded":"2023-12-16T00:01:06.883750+0000","last_fullsized":"2023-12-16T00:01:06.883750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628015+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:35.628015+0000","last_peered":"2023-12-16T00:00:35.628015+0000","last_clean":"2023-12-16T00:00:35.628015+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:35.628015+0000","last_undegraded":"2023-12-16T00:00:35.628015+0000","last_fullsized":"2023-12-16T00:00:35.628015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409418+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:35.409418+0000","last_peered":"2023-12-16T00:00:35.409418+0000","last_clean":"2023-12-16T00:00:35.409418+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:35.409418+0000","last_undegraded":"2023-12-16T00:00:35.409418+0000","last_fullsized":"2023-12-16T00:00:35.409418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":185131,"num_omap_keys":705,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4144,"ondisk_log_size":4144,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2332,"ondisk_log_size":2332,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":896,"ondisk_log_size":896,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608409,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.372,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.65800000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502}]},{"osd":1,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":1.004},"last":0.625},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.40300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.46800000000000003,"5min":0.56799999999999995,"15min":1.044},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.432,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.33500000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.46899999999999997,"5min":0.60099999999999998,"15min":1.149},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.52300000000000002,"5min":0.59499999999999997,"15min":0.63},"last":0.40899999999999997}]}]},{"osd":5,"up_from":11,"seq":47244641111,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.505,"15min":0.501},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65200000000000002,"5min":0.72099999999999997,"15min":0.72899999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.754,"15min":0.96699999999999997},"last":0.54000000000000004}]},{"osd":1,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.69999999999999996,"15min":0.80100000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.879},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.623,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.67000000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.371},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.54700000000000004,"5min":0.61099999999999999,"15min":0.754},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.29699999999999999,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.5,"5min":0.57399999999999995,"15min":0.63},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26000000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.56699999999999995,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.40699999999999997}]}]},{"osd":3,"up_from":11,"seq":47244641113,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71699999999999997},"last":0.5},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.65300000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.435,"5min":0.374,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.50900000000000001},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":1.25,"15min":1.25},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.435}]},{"osd":4,"last update":"Sat Dec 16 00:02:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.246},"max":{"1min":0.55300000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.36799999999999999},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.316}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38}]}]},{"osd":2,"up_from":11,"seq":47244641110,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"min":{"1min":0.23400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.42699999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55400000000000005,"5min":0.87,"15min":0.87},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44500000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51800000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.27500000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.441}]},{"osd":4,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.169,"15min":1.169},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82899999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45900000000000002}]}]},{"osd":1,"up_from":11,"seq":47244641111,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.312,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.20399999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.26900000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46400000000000002,"5min":0.51700000000000002,"15min":0.80100000000000005},"last":0.435}]},{"osd":2,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.48399999999999999,"15min":0.52200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.249,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45600000000000002,"5min":0.504,"15min":0.504},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.309},"max":{"1min":0.65300000000000002,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.70099999999999996,"5min":0.81100000000000005,"15min":0.878},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Dec 16 00:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66800000000000004,"5min":0.78000000000000003,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64600000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]}]},{"osd":0,"up_from":11,"seq":47244641111,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.25600000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.503,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.83599999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.40500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68300000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.875},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:03:12.218 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.218 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.219 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.219 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.219 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.219 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.220 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.220 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.220 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.220 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.220 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.221 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.221 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.221 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.221 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.222 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.222 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.222 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.222 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.222 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.223 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.224 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.224 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.224 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.224 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.224 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.225 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.225 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.225 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.225 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.225 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.226 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.226 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.226 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.226 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.227 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.227 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.227 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.227 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.228 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.228 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.228 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.228 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.228 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.229 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.229 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.229 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.230 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.230 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.230 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.230 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.230 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.231 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.231 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.231 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.231 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.232 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.232 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.232 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.233 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.233 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.233 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.233 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.233 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.234 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.234 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.234 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.234 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.235 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.235 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.235 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.235 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.235 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.236 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.236 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.236 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.236 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.237 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.237 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.237 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.237 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.238 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.238 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.238 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.238 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.238 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.239 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.239 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.239 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.239 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.239 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.240 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.240 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.240 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.240 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.241 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.241 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.241 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.241 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.241 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.242 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.242 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.242 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.242 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.242 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.243 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.243 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.243 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.243 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.244 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.244 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.244 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.244 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.244 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.245 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.245 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.245 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.245 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.246 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.246 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.246 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.246 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.246 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.247 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.247 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.247 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.247 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.248 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.248 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.248 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.248 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.249 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.249 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.249 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.249 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.250 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.250 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.250 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.250 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.250 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.251 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.251 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.251 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.251 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.252 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.252 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.252 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.252 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.253 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.253 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.253 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.253 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.253 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.254 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-12-15T22:53:57.147806+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=57, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.254 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.254 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.254 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.254 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.255 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.255 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.255 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.255 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.255 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.256 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.256 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.256 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.256 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.256 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.257 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.257 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.257 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.257 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.257 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.258 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.258 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.258 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.258 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.258 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.259 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.259 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.259 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.259 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.260 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.260 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.260 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.260 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.260 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.261 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.261 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.261 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.261 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.262 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.262 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.262 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.262 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.262 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.263 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.263 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.263 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:12.263 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:03:32.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:03:32.607 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:03:32.628 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:03:32.632 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2192,"stamp":"2023-12-16T00:03:32.263543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":908883,"num_omap_keys":3948,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36469,"ondisk_log_size":36469,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":307928,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":298038,"kb_avail":628837672,"statfs":{"total":644245094400,"available":643929776128,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":305191585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19505,"num_omap_keys":73,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005440"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358373+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358373+0000","last_peered":"2023-12-16T00:03:26.358373+0000","last_clean":"2023-12-16T00:03:26.358373+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358373+0000","last_undegraded":"2023-12-16T00:03:26.358373+0000","last_fullsized":"2023-12-16T00:03:26.358373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136676+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:28.136676+0000","last_peered":"2023-12-16T00:00:28.136676+0000","last_clean":"2023-12-16T00:00:28.136676+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:28.136676+0000","last_undegraded":"2023-12-16T00:00:28.136676+0000","last_fullsized":"2023-12-16T00:00:28.136676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439811+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:00:26.439811+0000","last_peered":"2023-12-16T00:00:26.439811+0000","last_clean":"2023-12-16T00:00:26.439811+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:00:26.439811+0000","last_undegraded":"2023-12-16T00:00:26.439811+0000","last_fullsized":"2023-12-16T00:00:26.439811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.778718+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:15.778718+0000","last_peered":"2023-12-16T00:01:15.778718+0000","last_clean":"2023-12-16T00:01:15.778718+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:15.778718+0000","last_undegraded":"2023-12-16T00:01:15.778718+0000","last_fullsized":"2023-12-16T00:01:15.778718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418691+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:01:10.418691+0000","last_peered":"2023-12-16T00:01:10.418691+0000","last_clean":"2023-12-16T00:01:10.418691+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:01:10.418691+0000","last_undegraded":"2023-12-16T00:01:10.418691+0000","last_fullsized":"2023-12-16T00:01:10.418691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015974+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:26.015974+0000","last_peered":"2023-12-16T00:00:26.015974+0000","last_clean":"2023-12-16T00:00:26.015974+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:26.015974+0000","last_undegraded":"2023-12-16T00:00:26.015974+0000","last_fullsized":"2023-12-16T00:00:26.015974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288059+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:27.288059+0000","last_peered":"2023-12-16T00:00:27.288059+0000","last_clean":"2023-12-16T00:00:27.288059+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:27.288059+0000","last_undegraded":"2023-12-16T00:00:27.288059+0000","last_fullsized":"2023-12-16T00:00:27.288059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418704+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:01:10.418704+0000","last_peered":"2023-12-16T00:01:10.418704+0000","last_clean":"2023-12-16T00:01:10.418704+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:01:10.418704+0000","last_undegraded":"2023-12-16T00:01:10.418704+0000","last_fullsized":"2023-12-16T00:01:10.418704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136544+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:28.136544+0000","last_peered":"2023-12-16T00:00:28.136544+0000","last_clean":"2023-12-16T00:00:28.136544+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:28.136544+0000","last_undegraded":"2023-12-16T00:00:28.136544+0000","last_fullsized":"2023-12-16T00:00:28.136544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477816+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477816+0000","last_peered":"2023-12-16T00:03:06.477816+0000","last_clean":"2023-12-16T00:03:06.477816+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477816+0000","last_undegraded":"2023-12-16T00:03:06.477816+0000","last_fullsized":"2023-12-16T00:03:06.477816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288014+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:27.288014+0000","last_peered":"2023-12-16T00:00:27.288014+0000","last_clean":"2023-12-16T00:00:27.288014+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:27.288014+0000","last_undegraded":"2023-12-16T00:00:27.288014+0000","last_fullsized":"2023-12-16T00:00:27.288014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136724+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:00:28.136724+0000","last_peered":"2023-12-16T00:00:28.136724+0000","last_clean":"2023-12-16T00:00:28.136724+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:00:28.136724+0000","last_undegraded":"2023-12-16T00:00:28.136724+0000","last_fullsized":"2023-12-16T00:00:28.136724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.749707+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:07.749707+0000","last_peered":"2023-12-16T00:01:07.749707+0000","last_clean":"2023-12-16T00:01:07.749707+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:07.749707+0000","last_undegraded":"2023-12-16T00:01:07.749707+0000","last_fullsized":"2023-12-16T00:01:07.749707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864177+0000","last_change":"2023-12-15T22:52:53.175461+0000","last_active":"2023-12-16T00:00:26.864177+0000","last_peered":"2023-12-16T00:00:26.864177+0000","last_clean":"2023-12-16T00:00:26.864177+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:00:26.864177+0000","last_undegraded":"2023-12-16T00:00:26.864177+0000","last_fullsized":"2023-12-16T00:00:26.864177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629274+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629274+0000","last_peered":"2023-12-16T00:02:46.629274+0000","last_clean":"2023-12-16T00:02:46.629274+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629274+0000","last_undegraded":"2023-12-16T00:02:46.629274+0000","last_fullsized":"2023-12-16T00:02:46.629274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.129532+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:00:29.129532+0000","last_peered":"2023-12-16T00:00:29.129532+0000","last_clean":"2023-12-16T00:00:29.129532+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:00:29.129532+0000","last_undegraded":"2023-12-16T00:00:29.129532+0000","last_fullsized":"2023-12-16T00:00:29.129532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408921+0000","last_change":"2023-12-15T22:52:55.189960+0000","last_active":"2023-12-16T00:00:35.408921+0000","last_peered":"2023-12-16T00:00:35.408921+0000","last_clean":"2023-12-16T00:00:35.408921+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:00:35.408921+0000","last_undegraded":"2023-12-16T00:00:35.408921+0000","last_fullsized":"2023-12-16T00:00:35.408921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412953+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:50.412953+0000","last_peered":"2023-12-16T00:00:50.412953+0000","last_clean":"2023-12-16T00:00:50.412953+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:50.412953+0000","last_undegraded":"2023-12-16T00:00:50.412953+0000","last_fullsized":"2023-12-16T00:00:50.412953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409311+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:35.409311+0000","last_peered":"2023-12-16T00:00:35.409311+0000","last_clean":"2023-12-16T00:00:35.409311+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:35.409311+0000","last_undegraded":"2023-12-16T00:00:35.409311+0000","last_fullsized":"2023-12-16T00:00:35.409311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396946+0000","last_change":"2023-12-15T22:52:53.171245+0000","last_active":"2023-12-16T00:00:36.396946+0000","last_peered":"2023-12-16T00:00:36.396946+0000","last_clean":"2023-12-16T00:00:36.396946+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:00:36.396946+0000","last_undegraded":"2023-12-16T00:00:36.396946+0000","last_fullsized":"2023-12-16T00:00:36.396946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408417+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:35.408417+0000","last_peered":"2023-12-16T00:00:35.408417+0000","last_clean":"2023-12-16T00:00:35.408417+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:35.408417+0000","last_undegraded":"2023-12-16T00:00:35.408417+0000","last_fullsized":"2023-12-16T00:00:35.408417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412379+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:50.412379+0000","last_peered":"2023-12-16T00:00:50.412379+0000","last_clean":"2023-12-16T00:00:50.412379+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:50.412379+0000","last_undegraded":"2023-12-16T00:00:50.412379+0000","last_fullsized":"2023-12-16T00:00:50.412379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.631082+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:45.631082+0000","last_peered":"2023-12-16T00:00:45.631082+0000","last_clean":"2023-12-16T00:00:45.631082+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:45.631082+0000","last_undegraded":"2023-12-16T00:00:45.631082+0000","last_fullsized":"2023-12-16T00:00:45.631082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411379+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411379+0000","last_peered":"2023-12-16T00:02:07.411379+0000","last_clean":"2023-12-16T00:02:07.411379+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411379+0000","last_undegraded":"2023-12-16T00:02:07.411379+0000","last_fullsized":"2023-12-16T00:02:07.411379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620281+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620281+0000","last_peered":"2023-12-16T00:02:06.620281+0000","last_clean":"2023-12-16T00:02:06.620281+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620281+0000","last_undegraded":"2023-12-16T00:02:06.620281+0000","last_fullsized":"2023-12-16T00:02:06.620281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630876+0000","last_change":"2023-12-15T22:52:55.192892+0000","last_active":"2023-12-16T00:00:45.630876+0000","last_peered":"2023-12-16T00:00:45.630876+0000","last_clean":"2023-12-16T00:00:45.630876+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:00:45.630876+0000","last_undegraded":"2023-12-16T00:00:45.630876+0000","last_fullsized":"2023-12-16T00:00:45.630876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408467+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:35.408467+0000","last_peered":"2023-12-16T00:00:35.408467+0000","last_clean":"2023-12-16T00:00:35.408467+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:35.408467+0000","last_undegraded":"2023-12-16T00:00:35.408467+0000","last_fullsized":"2023-12-16T00:00:35.408467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"41'1","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411861+0000","last_change":"2023-12-15T22:53:04.314222+0000","last_active":"2023-12-16T00:00:45.411861+0000","last_peered":"2023-12-16T00:00:45.411861+0000","last_clean":"2023-12-16T00:00:45.411861+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:00:45.411861+0000","last_undegraded":"2023-12-16T00:00:45.411861+0000","last_fullsized":"2023-12-16T00:00:45.411861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.399111+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:50.399111+0000","last_peered":"2023-12-16T00:00:50.399111+0000","last_clean":"2023-12-16T00:00:50.399111+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:50.399111+0000","last_undegraded":"2023-12-16T00:00:50.399111+0000","last_fullsized":"2023-12-16T00:00:50.399111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118158+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118158+0000","last_peered":"2023-12-16T00:02:20.118158+0000","last_clean":"2023-12-16T00:02:20.118158+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118158+0000","last_undegraded":"2023-12-16T00:02:20.118158+0000","last_fullsized":"2023-12-16T00:02:20.118158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409291+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:35.409291+0000","last_peered":"2023-12-16T00:00:35.409291+0000","last_clean":"2023-12-16T00:00:35.409291+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:35.409291+0000","last_undegraded":"2023-12-16T00:00:35.409291+0000","last_fullsized":"2023-12-16T00:00:35.409291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630689+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:45.630689+0000","last_peered":"2023-12-16T00:00:45.630689+0000","last_clean":"2023-12-16T00:00:45.630689+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:45.630689+0000","last_undegraded":"2023-12-16T00:00:45.630689+0000","last_fullsized":"2023-12-16T00:00:45.630689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415589+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:01:00.415589+0000","last_peered":"2023-12-16T00:01:00.415589+0000","last_clean":"2023-12-16T00:01:00.415589+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:01:00.415589+0000","last_undegraded":"2023-12-16T00:01:00.415589+0000","last_fullsized":"2023-12-16T00:01:00.415589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712618+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:00:27.712618+0000","last_peered":"2023-12-16T00:00:27.712618+0000","last_clean":"2023-12-16T00:00:27.712618+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:00:27.712618+0000","last_undegraded":"2023-12-16T00:00:27.712618+0000","last_fullsized":"2023-12-16T00:00:27.712618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.778894+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:26.778894+0000","last_peered":"2023-12-16T00:01:26.778894+0000","last_clean":"2023-12-16T00:01:26.778894+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:26.778894+0000","last_undegraded":"2023-12-16T00:01:26.778894+0000","last_fullsized":"2023-12-16T00:01:26.778894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.348968+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.348968+0000","last_peered":"2023-12-16T00:01:25.348968+0000","last_clean":"2023-12-16T00:01:25.348968+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.348968+0000","last_undegraded":"2023-12-16T00:01:25.348968+0000","last_fullsized":"2023-12-16T00:01:25.348968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":451,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.887185+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:00:41.887185+0000","last_peered":"2023-12-16T00:00:41.887185+0000","last_clean":"2023-12-16T00:00:41.887185+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:00:41.887185+0000","last_undegraded":"2023-12-16T00:00:41.887185+0000","last_fullsized":"2023-12-16T00:00:41.887185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408273+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:35.408273+0000","last_peered":"2023-12-16T00:00:35.408273+0000","last_clean":"2023-12-16T00:00:35.408273+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:35.408273+0000","last_undegraded":"2023-12-16T00:00:35.408273+0000","last_fullsized":"2023-12-16T00:00:35.408273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440876+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:00:26.440876+0000","last_peered":"2023-12-16T00:00:26.440876+0000","last_clean":"2023-12-16T00:00:26.440876+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:00:26.440876+0000","last_undegraded":"2023-12-16T00:00:26.440876+0000","last_fullsized":"2023-12-16T00:00:26.440876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1028,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304198+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304198+0000","last_peered":"2023-12-16T00:02:29.304198+0000","last_clean":"2023-12-16T00:02:29.304198+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304198+0000","last_undegraded":"2023-12-16T00:02:29.304198+0000","last_fullsized":"2023-12-16T00:02:29.304198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:44.905696+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:00:44.905696+0000","last_peered":"2023-12-16T00:00:44.905696+0000","last_clean":"2023-12-16T00:00:44.905696+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:00:44.905696+0000","last_undegraded":"2023-12-16T00:00:44.905696+0000","last_fullsized":"2023-12-16T00:00:44.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.901978+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:11.901978+0000","last_peered":"2023-12-16T00:01:11.901978+0000","last_clean":"2023-12-16T00:01:11.901978+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:11.901978+0000","last_undegraded":"2023-12-16T00:01:11.901978+0000","last_fullsized":"2023-12-16T00:01:11.901978+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408763+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:35.408763+0000","last_peered":"2023-12-16T00:00:35.408763+0000","last_clean":"2023-12-16T00:00:35.408763+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:35.408763+0000","last_undegraded":"2023-12-16T00:00:35.408763+0000","last_fullsized":"2023-12-16T00:00:35.408763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:46.399423+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:46.399423+0000","last_peered":"2023-12-16T00:00:46.399423+0000","last_clean":"2023-12-16T00:00:46.399423+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:46.399423+0000","last_undegraded":"2023-12-16T00:00:46.399423+0000","last_fullsized":"2023-12-16T00:00:46.399423+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.719966+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:31.719966+0000","last_peered":"2023-12-16T00:01:31.719966+0000","last_clean":"2023-12-16T00:01:31.719966+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:31.719966+0000","last_undegraded":"2023-12-16T00:01:31.719966+0000","last_fullsized":"2023-12-16T00:01:31.719966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288080+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:27.288080+0000","last_peered":"2023-12-16T00:00:27.288080+0000","last_clean":"2023-12-16T00:00:27.288080+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:27.288080+0000","last_undegraded":"2023-12-16T00:00:27.288080+0000","last_fullsized":"2023-12-16T00:00:27.288080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410772+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:40.410772+0000","last_peered":"2023-12-16T00:00:40.410772+0000","last_clean":"2023-12-16T00:00:40.410772+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:40.410772+0000","last_undegraded":"2023-12-16T00:00:40.410772+0000","last_fullsized":"2023-12-16T00:00:40.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"49'6","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136765+0000","last_change":"2023-12-15T22:53:04.315545+0000","last_active":"2023-12-16T00:00:28.136765+0000","last_peered":"2023-12-16T00:00:28.136765+0000","last_clean":"2023-12-16T00:00:28.136765+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:00:28.136765+0000","last_undegraded":"2023-12-16T00:00:28.136765+0000","last_fullsized":"2023-12-16T00:00:28.136765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214798+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214798+0000","last_peered":"2023-12-16T00:03:06.214798+0000","last_clean":"2023-12-16T00:03:06.214798+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214798+0000","last_undegraded":"2023-12-16T00:03:06.214798+0000","last_fullsized":"2023-12-16T00:03:06.214798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575227+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575227+0000","last_peered":"2023-12-16T00:03:30.575227+0000","last_clean":"2023-12-16T00:03:30.575227+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575227+0000","last_undegraded":"2023-12-16T00:03:30.575227+0000","last_fullsized":"2023-12-16T00:03:30.575227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136427+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:28.136427+0000","last_peered":"2023-12-16T00:00:28.136427+0000","last_clean":"2023-12-16T00:00:28.136427+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:28.136427+0000","last_undegraded":"2023-12-16T00:00:28.136427+0000","last_fullsized":"2023-12-16T00:00:28.136427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470578+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470578+0000","last_peered":"2023-12-16T00:02:55.470578+0000","last_clean":"2023-12-16T00:02:55.470578+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470578+0000","last_undegraded":"2023-12-16T00:02:55.470578+0000","last_fullsized":"2023-12-16T00:02:55.470578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136577+0000","last_change":"2023-12-15T22:52:55.187906+0000","last_active":"2023-12-16T00:00:28.136577+0000","last_peered":"2023-12-16T00:00:28.136577+0000","last_clean":"2023-12-16T00:00:28.136577+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:00:28.136577+0000","last_undegraded":"2023-12-16T00:00:28.136577+0000","last_fullsized":"2023-12-16T00:00:28.136577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287840+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:27.287840+0000","last_peered":"2023-12-16T00:00:27.287840+0000","last_clean":"2023-12-16T00:00:27.287840+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:27.287840+0000","last_undegraded":"2023-12-16T00:00:27.287840+0000","last_fullsized":"2023-12-16T00:00:27.287840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355510+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355510+0000","last_peered":"2023-12-16T00:02:46.355510+0000","last_clean":"2023-12-16T00:02:46.355510+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355510+0000","last_undegraded":"2023-12-16T00:02:46.355510+0000","last_fullsized":"2023-12-16T00:02:46.355510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398726+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:50.398726+0000","last_peered":"2023-12-16T00:00:50.398726+0000","last_clean":"2023-12-16T00:00:50.398726+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:50.398726+0000","last_undegraded":"2023-12-16T00:00:50.398726+0000","last_fullsized":"2023-12-16T00:00:50.398726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959687+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959687+0000","last_peered":"2023-12-16T00:03:20.959687+0000","last_clean":"2023-12-16T00:03:20.959687+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959687+0000","last_undegraded":"2023-12-16T00:03:20.959687+0000","last_fullsized":"2023-12-16T00:03:20.959687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136335+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:28.136335+0000","last_peered":"2023-12-16T00:00:28.136335+0000","last_clean":"2023-12-16T00:00:28.136335+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:28.136335+0000","last_undegraded":"2023-12-16T00:00:28.136335+0000","last_fullsized":"2023-12-16T00:00:28.136335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137591+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137591+0000","last_peered":"2023-12-16T00:02:59.137591+0000","last_clean":"2023-12-16T00:02:59.137591+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137591+0000","last_undegraded":"2023-12-16T00:02:59.137591+0000","last_fullsized":"2023-12-16T00:02:59.137591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.629876+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:40.629876+0000","last_peered":"2023-12-16T00:00:40.629876+0000","last_clean":"2023-12-16T00:00:40.629876+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:40.629876+0000","last_undegraded":"2023-12-16T00:00:40.629876+0000","last_fullsized":"2023-12-16T00:00:40.629876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334191+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334191+0000","last_peered":"2023-12-16T00:02:27.334191+0000","last_clean":"2023-12-16T00:02:27.334191+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334191+0000","last_undegraded":"2023-12-16T00:02:27.334191+0000","last_fullsized":"2023-12-16T00:02:27.334191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711314+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:27.711314+0000","last_peered":"2023-12-16T00:00:27.711314+0000","last_clean":"2023-12-16T00:00:27.711314+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:27.711314+0000","last_undegraded":"2023-12-16T00:00:27.711314+0000","last_fullsized":"2023-12-16T00:00:27.711314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439680+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:26.439680+0000","last_peered":"2023-12-16T00:00:26.439680+0000","last_clean":"2023-12-16T00:00:26.439680+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:26.439680+0000","last_undegraded":"2023-12-16T00:00:26.439680+0000","last_fullsized":"2023-12-16T00:00:26.439680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355512+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355512+0000","last_peered":"2023-12-16T00:03:09.355512+0000","last_clean":"2023-12-16T00:03:09.355512+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355512+0000","last_undegraded":"2023-12-16T00:03:09.355512+0000","last_fullsized":"2023-12-16T00:03:09.355512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.409998+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:40.409998+0000","last_peered":"2023-12-16T00:00:40.409998+0000","last_clean":"2023-12-16T00:00:40.409998+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:40.409998+0000","last_undegraded":"2023-12-16T00:00:40.409998+0000","last_fullsized":"2023-12-16T00:00:40.409998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'86","reported_seq":887,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420299+0000","last_change":"2023-12-15T22:54:04.178373+0000","last_active":"2023-12-16T00:01:15.420299+0000","last_peered":"2023-12-16T00:01:15.420299+0000","last_clean":"2023-12-16T00:01:15.420299+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:01:15.420299+0000","last_undegraded":"2023-12-16T00:01:15.420299+0000","last_fullsized":"2023-12-16T00:01:15.420299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.867211+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:00:33.867211+0000","last_peered":"2023-12-16T00:00:33.867211+0000","last_clean":"2023-12-16T00:00:33.867211+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:00:33.867211+0000","last_undegraded":"2023-12-16T00:00:33.867211+0000","last_fullsized":"2023-12-16T00:00:33.867211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288152+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:27.288152+0000","last_peered":"2023-12-16T00:00:27.288152+0000","last_clean":"2023-12-16T00:00:27.288152+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:27.288152+0000","last_undegraded":"2023-12-16T00:00:27.288152+0000","last_fullsized":"2023-12-16T00:00:27.288152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:33.786894+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:00:33.786894+0000","last_peered":"2023-12-16T00:00:33.786894+0000","last_clean":"2023-12-16T00:00:33.786894+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:00:33.786894+0000","last_undegraded":"2023-12-16T00:00:33.786894+0000","last_fullsized":"2023-12-16T00:00:33.786894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711349+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:27.711349+0000","last_peered":"2023-12-16T00:00:27.711349+0000","last_clean":"2023-12-16T00:00:27.711349+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:27.711349+0000","last_undegraded":"2023-12-16T00:00:27.711349+0000","last_fullsized":"2023-12-16T00:00:27.711349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711244+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:27.711244+0000","last_peered":"2023-12-16T00:00:27.711244+0000","last_clean":"2023-12-16T00:00:27.711244+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:27.711244+0000","last_undegraded":"2023-12-16T00:00:27.711244+0000","last_fullsized":"2023-12-16T00:00:27.711244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630904+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:45.630904+0000","last_peered":"2023-12-16T00:00:45.630904+0000","last_clean":"2023-12-16T00:00:45.630904+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:45.630904+0000","last_undegraded":"2023-12-16T00:00:45.630904+0000","last_fullsized":"2023-12-16T00:00:45.630904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1543,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904026+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904026+0000","last_peered":"2023-12-16T00:01:44.904026+0000","last_clean":"2023-12-16T00:01:44.904026+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904026+0000","last_undegraded":"2023-12-16T00:01:44.904026+0000","last_fullsized":"2023-12-16T00:01:44.904026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468686+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468686+0000","last_peered":"2023-12-16T00:03:22.468686+0000","last_clean":"2023-12-16T00:03:22.468686+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468686+0000","last_undegraded":"2023-12-16T00:03:22.468686+0000","last_fullsized":"2023-12-16T00:03:22.468686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244135+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244135+0000","last_peered":"2023-12-16T00:03:28.244135+0000","last_clean":"2023-12-16T00:03:28.244135+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244135+0000","last_undegraded":"2023-12-16T00:03:28.244135+0000","last_fullsized":"2023-12-16T00:03:28.244135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865431+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:26.865431+0000","last_peered":"2023-12-16T00:00:26.865431+0000","last_clean":"2023-12-16T00:00:26.865431+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:26.865431+0000","last_undegraded":"2023-12-16T00:00:26.865431+0000","last_fullsized":"2023-12-16T00:00:26.865431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707263+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707263+0000","last_peered":"2023-12-16T00:02:10.707263+0000","last_clean":"2023-12-16T00:02:10.707263+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707263+0000","last_undegraded":"2023-12-16T00:02:10.707263+0000","last_fullsized":"2023-12-16T00:02:10.707263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051777+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051777+0000","last_peered":"2023-12-16T00:01:33.051777+0000","last_clean":"2023-12-16T00:01:33.051777+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051777+0000","last_undegraded":"2023-12-16T00:01:33.051777+0000","last_fullsized":"2023-12-16T00:01:33.051777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350554+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350554+0000","last_peered":"2023-12-16T00:03:11.350554+0000","last_clean":"2023-12-16T00:03:11.350554+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350554+0000","last_undegraded":"2023-12-16T00:03:11.350554+0000","last_fullsized":"2023-12-16T00:03:11.350554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439652+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:00:26.439652+0000","last_peered":"2023-12-16T00:00:26.439652+0000","last_clean":"2023-12-16T00:00:26.439652+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:00:26.439652+0000","last_undegraded":"2023-12-16T00:00:26.439652+0000","last_fullsized":"2023-12-16T00:00:26.439652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461428+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461428+0000","last_peered":"2023-12-16T00:03:22.461428+0000","last_clean":"2023-12-16T00:03:22.461428+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461428+0000","last_undegraded":"2023-12-16T00:03:22.461428+0000","last_fullsized":"2023-12-16T00:03:22.461428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161228+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161228+0000","last_peered":"2023-12-16T00:03:14.161228+0000","last_clean":"2023-12-16T00:03:14.161228+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161228+0000","last_undegraded":"2023-12-16T00:03:14.161228+0000","last_fullsized":"2023-12-16T00:03:14.161228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193045+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193045+0000","last_peered":"2023-12-16T00:02:53.193045+0000","last_clean":"2023-12-16T00:02:53.193045+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193045+0000","last_undegraded":"2023-12-16T00:02:53.193045+0000","last_fullsized":"2023-12-16T00:02:53.193045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1586,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520628+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520628+0000","last_peered":"2023-12-16T00:02:25.520628+0000","last_clean":"2023-12-16T00:02:25.520628+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520628+0000","last_undegraded":"2023-12-16T00:02:25.520628+0000","last_fullsized":"2023-12-16T00:02:25.520628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.835817+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:22.835817+0000","last_peered":"2023-12-16T00:01:22.835817+0000","last_clean":"2023-12-16T00:01:22.835817+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:22.835817+0000","last_undegraded":"2023-12-16T00:01:22.835817+0000","last_fullsized":"2023-12-16T00:01:22.835817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414152+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414152+0000","last_peered":"2023-12-16T00:03:17.414152+0000","last_clean":"2023-12-16T00:03:17.414152+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414152+0000","last_undegraded":"2023-12-16T00:03:17.414152+0000","last_fullsized":"2023-12-16T00:03:17.414152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412902+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:50.412902+0000","last_peered":"2023-12-16T00:00:50.412902+0000","last_clean":"2023-12-16T00:00:50.412902+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:50.412902+0000","last_undegraded":"2023-12-16T00:00:50.412902+0000","last_fullsized":"2023-12-16T00:00:50.412902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711234+0000","last_change":"2023-12-15T22:52:53.171181+0000","last_active":"2023-12-16T00:00:27.711234+0000","last_peered":"2023-12-16T00:00:27.711234+0000","last_clean":"2023-12-16T00:00:27.711234+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:00:27.711234+0000","last_undegraded":"2023-12-16T00:00:27.711234+0000","last_fullsized":"2023-12-16T00:00:27.711234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990310+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990310+0000","last_peered":"2023-12-16T00:03:19.990310+0000","last_clean":"2023-12-16T00:03:19.990310+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990310+0000","last_undegraded":"2023-12-16T00:03:19.990310+0000","last_fullsized":"2023-12-16T00:03:19.990310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5995,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137901+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:00:28.137901+0000","last_peered":"2023-12-16T00:00:28.137901+0000","last_clean":"2023-12-16T00:00:28.137901+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:00:28.137901+0000","last_undegraded":"2023-12-16T00:00:28.137901+0000","last_fullsized":"2023-12-16T00:00:28.137901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166619+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166619+0000","last_peered":"2023-12-16T00:03:03.166619+0000","last_clean":"2023-12-16T00:03:03.166619+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166619+0000","last_undegraded":"2023-12-16T00:03:03.166619+0000","last_fullsized":"2023-12-16T00:03:03.166619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478525+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478525+0000","last_peered":"2023-12-16T00:02:02.478525+0000","last_clean":"2023-12-16T00:02:02.478525+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478525+0000","last_undegraded":"2023-12-16T00:02:02.478525+0000","last_fullsized":"2023-12-16T00:02:02.478525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439851+0000","last_change":"2023-12-15T22:52:55.191087+0000","last_active":"2023-12-16T00:00:26.439851+0000","last_peered":"2023-12-16T00:00:26.439851+0000","last_clean":"2023-12-16T00:00:26.439851+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:00:26.439851+0000","last_undegraded":"2023-12-16T00:00:26.439851+0000","last_fullsized":"2023-12-16T00:00:26.439851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.400805+0000","last_change":"2023-12-15T22:52:08.042135+0000","last_active":"2023-12-16T00:00:51.400805+0000","last_peered":"2023-12-16T00:00:51.400805+0000","last_clean":"2023-12-16T00:00:51.400805+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:00:51.400805+0000","last_undegraded":"2023-12-16T00:00:51.400805+0000","last_fullsized":"2023-12-16T00:00:51.400805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635206+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:01:05.635206+0000","last_peered":"2023-12-16T00:01:05.635206+0000","last_clean":"2023-12-16T00:01:05.635206+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:01:05.635206+0000","last_undegraded":"2023-12-16T00:01:05.635206+0000","last_fullsized":"2023-12-16T00:01:05.635206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.173986+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.173986+0000","last_peered":"2023-12-16T00:02:51.173986+0000","last_clean":"2023-12-16T00:02:51.173986+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.173986+0000","last_undegraded":"2023-12-16T00:02:51.173986+0000","last_fullsized":"2023-12-16T00:02:51.173986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712554+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:27.712554+0000","last_peered":"2023-12-16T00:00:27.712554+0000","last_clean":"2023-12-16T00:00:27.712554+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:27.712554+0000","last_undegraded":"2023-12-16T00:00:27.712554+0000","last_fullsized":"2023-12-16T00:00:27.712554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4133,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016860+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:00:26.016860+0000","last_peered":"2023-12-16T00:00:26.016860+0000","last_clean":"2023-12-16T00:00:26.016860+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:00:26.016860+0000","last_undegraded":"2023-12-16T00:00:26.016860+0000","last_fullsized":"2023-12-16T00:00:26.016860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160204+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160204+0000","last_peered":"2023-12-16T00:02:44.160204+0000","last_clean":"2023-12-16T00:02:44.160204+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160204+0000","last_undegraded":"2023-12-16T00:02:44.160204+0000","last_fullsized":"2023-12-16T00:02:44.160204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015799+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:26.015799+0000","last_peered":"2023-12-16T00:00:26.015799+0000","last_clean":"2023-12-16T00:00:26.015799+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:26.015799+0000","last_undegraded":"2023-12-16T00:00:26.015799+0000","last_fullsized":"2023-12-16T00:00:26.015799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633202+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:55.633202+0000","last_peered":"2023-12-16T00:00:55.633202+0000","last_clean":"2023-12-16T00:00:55.633202+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:55.633202+0000","last_undegraded":"2023-12-16T00:00:55.633202+0000","last_fullsized":"2023-12-16T00:00:55.633202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152518+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152518+0000","last_peered":"2023-12-16T00:03:24.152518+0000","last_clean":"2023-12-16T00:03:24.152518+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152518+0000","last_undegraded":"2023-12-16T00:03:24.152518+0000","last_fullsized":"2023-12-16T00:03:24.152518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":990,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196219+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196219+0000","last_peered":"2023-12-16T00:02:25.196219+0000","last_clean":"2023-12-16T00:02:25.196219+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196219+0000","last_undegraded":"2023-12-16T00:02:25.196219+0000","last_fullsized":"2023-12-16T00:02:25.196219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398854+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:50.398854+0000","last_peered":"2023-12-16T00:00:50.398854+0000","last_clean":"2023-12-16T00:00:50.398854+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:50.398854+0000","last_undegraded":"2023-12-16T00:00:50.398854+0000","last_fullsized":"2023-12-16T00:00:50.398854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1297,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966523+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966523+0000","last_peered":"2023-12-16T00:03:18.966523+0000","last_clean":"2023-12-16T00:03:18.966523+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966523+0000","last_undegraded":"2023-12-16T00:03:18.966523+0000","last_fullsized":"2023-12-16T00:03:18.966523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464093+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464093+0000","last_peered":"2023-12-16T00:03:25.464093+0000","last_clean":"2023-12-16T00:03:25.464093+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464093+0000","last_undegraded":"2023-12-16T00:03:25.464093+0000","last_fullsized":"2023-12-16T00:03:25.464093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633270+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:55.633270+0000","last_peered":"2023-12-16T00:00:55.633270+0000","last_clean":"2023-12-16T00:00:55.633270+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:55.633270+0000","last_undegraded":"2023-12-16T00:00:55.633270+0000","last_fullsized":"2023-12-16T00:00:55.633270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529727+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529727+0000","last_peered":"2023-12-16T00:02:53.529727+0000","last_clean":"2023-12-16T00:02:53.529727+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529727+0000","last_undegraded":"2023-12-16T00:02:53.529727+0000","last_fullsized":"2023-12-16T00:02:53.529727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662975+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662975+0000","last_peered":"2023-12-16T00:02:16.662975+0000","last_clean":"2023-12-16T00:02:16.662975+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662975+0000","last_undegraded":"2023-12-16T00:02:16.662975+0000","last_fullsized":"2023-12-16T00:02:16.662975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865369+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:26.865369+0000","last_peered":"2023-12-16T00:00:26.865369+0000","last_clean":"2023-12-16T00:00:26.865369+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:26.865369+0000","last_undegraded":"2023-12-16T00:00:26.865369+0000","last_fullsized":"2023-12-16T00:00:26.865369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5950,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323747+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323747+0000","last_peered":"2023-12-16T00:03:09.323747+0000","last_clean":"2023-12-16T00:03:09.323747+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323747+0000","last_undegraded":"2023-12-16T00:03:09.323747+0000","last_fullsized":"2023-12-16T00:03:09.323747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855239+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855239+0000","last_peered":"2023-12-16T00:03:23.855239+0000","last_clean":"2023-12-16T00:03:23.855239+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855239+0000","last_undegraded":"2023-12-16T00:03:23.855239+0000","last_fullsized":"2023-12-16T00:03:23.855239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864039+0000","last_change":"2023-12-15T22:52:53.173788+0000","last_active":"2023-12-16T00:00:26.864039+0000","last_peered":"2023-12-16T00:00:26.864039+0000","last_clean":"2023-12-16T00:00:26.864039+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:00:26.864039+0000","last_undegraded":"2023-12-16T00:00:26.864039+0000","last_fullsized":"2023-12-16T00:00:26.864039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.406014+0000","last_change":"2023-12-15T22:52:08.042151+0000","last_active":"2023-12-16T00:01:11.406014+0000","last_peered":"2023-12-16T00:01:11.406014+0000","last_clean":"2023-12-16T00:01:11.406014+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:01:11.406014+0000","last_undegraded":"2023-12-16T00:01:11.406014+0000","last_fullsized":"2023-12-16T00:01:11.406014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335082+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335082+0000","last_peered":"2023-12-16T00:03:07.335082+0000","last_clean":"2023-12-16T00:03:07.335082+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335082+0000","last_undegraded":"2023-12-16T00:03:07.335082+0000","last_fullsized":"2023-12-16T00:03:07.335082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453503+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453503+0000","last_peered":"2023-12-16T00:02:34.453503+0000","last_clean":"2023-12-16T00:02:34.453503+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453503+0000","last_undegraded":"2023-12-16T00:02:34.453503+0000","last_fullsized":"2023-12-16T00:02:34.453503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116738+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116738+0000","last_peered":"2023-12-16T00:02:44.116738+0000","last_clean":"2023-12-16T00:02:44.116738+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116738+0000","last_undegraded":"2023-12-16T00:02:44.116738+0000","last_fullsized":"2023-12-16T00:02:44.116738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.396040+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:40.396040+0000","last_peered":"2023-12-16T00:00:40.396040+0000","last_clean":"2023-12-16T00:00:40.396040+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:40.396040+0000","last_undegraded":"2023-12-16T00:00:40.396040+0000","last_fullsized":"2023-12-16T00:00:40.396040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629203+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629203+0000","last_peered":"2023-12-16T00:01:50.629203+0000","last_clean":"2023-12-16T00:01:50.629203+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629203+0000","last_undegraded":"2023-12-16T00:01:50.629203+0000","last_fullsized":"2023-12-16T00:01:50.629203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015977+0000","last_change":"2023-12-15T22:52:55.191759+0000","last_active":"2023-12-16T00:00:26.015977+0000","last_peered":"2023-12-16T00:00:26.015977+0000","last_clean":"2023-12-16T00:00:26.015977+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:00:26.015977+0000","last_undegraded":"2023-12-16T00:00:26.015977+0000","last_fullsized":"2023-12-16T00:00:26.015977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439702+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:00:26.439702+0000","last_peered":"2023-12-16T00:00:26.439702+0000","last_clean":"2023-12-16T00:00:26.439702+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:00:26.439702+0000","last_undegraded":"2023-12-16T00:00:26.439702+0000","last_fullsized":"2023-12-16T00:00:26.439702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287779+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:00:27.287779+0000","last_peered":"2023-12-16T00:00:27.287779+0000","last_clean":"2023-12-16T00:00:27.287779+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:00:27.287779+0000","last_undegraded":"2023-12-16T00:00:27.287779+0000","last_fullsized":"2023-12-16T00:00:27.287779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136732+0000","last_change":"2023-12-15T22:53:04.315724+0000","last_active":"2023-12-16T00:00:28.136732+0000","last_peered":"2023-12-16T00:00:28.136732+0000","last_clean":"2023-12-16T00:00:28.136732+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:00:28.136732+0000","last_undegraded":"2023-12-16T00:00:28.136732+0000","last_fullsized":"2023-12-16T00:00:28.136732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.355963+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.355963+0000","last_peered":"2023-12-16T00:02:33.355963+0000","last_clean":"2023-12-16T00:02:33.355963+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.355963+0000","last_undegraded":"2023-12-16T00:02:33.355963+0000","last_fullsized":"2023-12-16T00:02:33.355963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396521+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396521+0000","last_peered":"2023-12-16T00:01:59.396521+0000","last_clean":"2023-12-16T00:01:59.396521+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396521+0000","last_undegraded":"2023-12-16T00:01:59.396521+0000","last_fullsized":"2023-12-16T00:01:59.396521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439833+0000","last_change":"2023-12-15T22:52:55.191004+0000","last_active":"2023-12-16T00:00:26.439833+0000","last_peered":"2023-12-16T00:00:26.439833+0000","last_clean":"2023-12-16T00:00:26.439833+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:00:26.439833+0000","last_undegraded":"2023-12-16T00:00:26.439833+0000","last_fullsized":"2023-12-16T00:00:26.439833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136313+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:00:28.136313+0000","last_peered":"2023-12-16T00:00:28.136313+0000","last_clean":"2023-12-16T00:00:28.136313+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:00:28.136313+0000","last_undegraded":"2023-12-16T00:00:28.136313+0000","last_fullsized":"2023-12-16T00:00:28.136313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968135+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968135+0000","last_peered":"2023-12-16T00:03:15.968135+0000","last_clean":"2023-12-16T00:03:15.968135+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968135+0000","last_undegraded":"2023-12-16T00:03:15.968135+0000","last_fullsized":"2023-12-16T00:03:15.968135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561074+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561074+0000","last_peered":"2023-12-16T00:02:30.561074+0000","last_clean":"2023-12-16T00:02:30.561074+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561074+0000","last_undegraded":"2023-12-16T00:02:30.561074+0000","last_fullsized":"2023-12-16T00:02:30.561074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112882+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112882+0000","last_peered":"2023-12-16T00:02:08.112882+0000","last_clean":"2023-12-16T00:02:08.112882+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112882+0000","last_undegraded":"2023-12-16T00:02:08.112882+0000","last_fullsized":"2023-12-16T00:02:08.112882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":187,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016450+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:00:26.016450+0000","last_peered":"2023-12-16T00:00:26.016450+0000","last_clean":"2023-12-16T00:00:26.016450+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:00:26.016450+0000","last_undegraded":"2023-12-16T00:00:26.016450+0000","last_fullsized":"2023-12-16T00:00:26.016450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.413067+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:50.413067+0000","last_peered":"2023-12-16T00:00:50.413067+0000","last_clean":"2023-12-16T00:00:50.413067+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:50.413067+0000","last_undegraded":"2023-12-16T00:00:50.413067+0000","last_fullsized":"2023-12-16T00:00:50.413067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'61","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398779+0000","last_change":"2023-12-15T22:53:06.324400+0000","last_active":"2023-12-16T00:00:50.398779+0000","last_peered":"2023-12-16T00:00:50.398779+0000","last_clean":"2023-12-16T00:00:50.398779+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:00:50.398779+0000","last_undegraded":"2023-12-16T00:00:50.398779+0000","last_fullsized":"2023-12-16T00:00:50.398779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:05.303522+0000","last_clean_scrub_stamp":"2023-12-15T22:53:05.303522+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6517,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437404+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437404+0000","last_peered":"2023-12-16T00:02:40.437404+0000","last_clean":"2023-12-16T00:02:40.437404+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437404+0000","last_undegraded":"2023-12-16T00:02:40.437404+0000","last_fullsized":"2023-12-16T00:02:40.437404+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562911+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562911+0000","last_peered":"2023-12-16T00:02:45.562911+0000","last_clean":"2023-12-16T00:02:45.562911+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562911+0000","last_undegraded":"2023-12-16T00:02:45.562911+0000","last_fullsized":"2023-12-16T00:02:45.562911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628119+0000","last_change":"2023-12-15T22:52:55.190487+0000","last_active":"2023-12-16T00:00:35.628119+0000","last_peered":"2023-12-16T00:00:35.628119+0000","last_clean":"2023-12-16T00:00:35.628119+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:00:35.628119+0000","last_undegraded":"2023-12-16T00:00:35.628119+0000","last_fullsized":"2023-12-16T00:00:35.628119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408648+0000","last_change":"2023-12-15T22:52:53.172807+0000","last_active":"2023-12-16T00:00:35.408648+0000","last_peered":"2023-12-16T00:00:35.408648+0000","last_clean":"2023-12-16T00:00:35.408648+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:00:35.408648+0000","last_undegraded":"2023-12-16T00:00:35.408648+0000","last_fullsized":"2023-12-16T00:00:35.408648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137984+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:00:28.137984+0000","last_peered":"2023-12-16T00:00:28.137984+0000","last_clean":"2023-12-16T00:00:28.137984+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:00:28.137984+0000","last_undegraded":"2023-12-16T00:00:28.137984+0000","last_fullsized":"2023-12-16T00:00:28.137984+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168046+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168046+0000","last_peered":"2023-12-16T00:02:06.168046+0000","last_clean":"2023-12-16T00:02:06.168046+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168046+0000","last_undegraded":"2023-12-16T00:02:06.168046+0000","last_fullsized":"2023-12-16T00:02:06.168046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169539+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169539+0000","last_peered":"2023-12-16T00:02:23.169539+0000","last_clean":"2023-12-16T00:02:23.169539+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169539+0000","last_undegraded":"2023-12-16T00:02:23.169539+0000","last_fullsized":"2023-12-16T00:02:23.169539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.822697+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:40.822697+0000","last_peered":"2023-12-16T00:01:40.822697+0000","last_clean":"2023-12-16T00:01:40.822697+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:40.822697+0000","last_undegraded":"2023-12-16T00:01:40.822697+0000","last_fullsized":"2023-12-16T00:01:40.822697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409406+0000","last_change":"2023-12-15T22:52:53.176900+0000","last_active":"2023-12-16T00:00:35.409406+0000","last_peered":"2023-12-16T00:00:35.409406+0000","last_clean":"2023-12-16T00:00:35.409406+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:00:35.409406+0000","last_undegraded":"2023-12-16T00:00:35.409406+0000","last_fullsized":"2023-12-16T00:00:35.409406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289330+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:00:27.289330+0000","last_peered":"2023-12-16T00:00:27.289330+0000","last_clean":"2023-12-16T00:00:27.289330+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:00:27.289330+0000","last_undegraded":"2023-12-16T00:00:27.289330+0000","last_fullsized":"2023-12-16T00:00:27.289330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007766+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007766+0000","last_peered":"2023-12-16T00:01:36.007766+0000","last_clean":"2023-12-16T00:01:36.007766+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007766+0000","last_undegraded":"2023-12-16T00:01:36.007766+0000","last_fullsized":"2023-12-16T00:01:36.007766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":406,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.283672+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:00:56.283672+0000","last_peered":"2023-12-16T00:00:56.283672+0000","last_clean":"2023-12-16T00:00:56.283672+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:00:56.283672+0000","last_undegraded":"2023-12-16T00:00:56.283672+0000","last_fullsized":"2023-12-16T00:00:56.283672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.627952+0000","last_change":"2023-12-15T22:52:55.189162+0000","last_active":"2023-12-16T00:00:35.627952+0000","last_peered":"2023-12-16T00:00:35.627952+0000","last_clean":"2023-12-16T00:00:35.627952+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:00:35.627952+0000","last_undegraded":"2023-12-16T00:00:35.627952+0000","last_fullsized":"2023-12-16T00:00:35.627952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408854+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:35.408854+0000","last_peered":"2023-12-16T00:00:35.408854+0000","last_clean":"2023-12-16T00:00:35.408854+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:35.408854+0000","last_undegraded":"2023-12-16T00:00:35.408854+0000","last_fullsized":"2023-12-16T00:00:35.408854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385103+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385103+0000","last_peered":"2023-12-16T00:02:50.385103+0000","last_clean":"2023-12-16T00:02:50.385103+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385103+0000","last_undegraded":"2023-12-16T00:02:50.385103+0000","last_fullsized":"2023-12-16T00:02:50.385103+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823297+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823297+0000","last_peered":"2023-12-16T00:01:16.823297+0000","last_clean":"2023-12-16T00:01:16.823297+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823297+0000","last_undegraded":"2023-12-16T00:01:16.823297+0000","last_fullsized":"2023-12-16T00:01:16.823297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288168+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:00:27.288168+0000","last_peered":"2023-12-16T00:00:27.288168+0000","last_clean":"2023-12-16T00:00:27.288168+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:00:27.288168+0000","last_undegraded":"2023-12-16T00:00:27.288168+0000","last_fullsized":"2023-12-16T00:00:27.288168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.394597+0000","last_change":"2023-12-15T22:52:53.174169+0000","last_active":"2023-12-16T00:00:35.394597+0000","last_peered":"2023-12-16T00:00:35.394597+0000","last_clean":"2023-12-16T00:00:35.394597+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:00:35.394597+0000","last_undegraded":"2023-12-16T00:00:35.394597+0000","last_fullsized":"2023-12-16T00:00:35.394597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202172+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202172+0000","last_peered":"2023-12-16T00:02:33.202172+0000","last_clean":"2023-12-16T00:02:33.202172+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202172+0000","last_undegraded":"2023-12-16T00:02:33.202172+0000","last_fullsized":"2023-12-16T00:02:33.202172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360890+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360890+0000","last_peered":"2023-12-16T00:02:21.360890+0000","last_clean":"2023-12-16T00:02:21.360890+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360890+0000","last_undegraded":"2023-12-16T00:02:21.360890+0000","last_fullsized":"2023-12-16T00:02:21.360890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979291+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979291+0000","last_peered":"2023-12-16T00:03:26.979291+0000","last_clean":"2023-12-16T00:03:26.979291+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979291+0000","last_undegraded":"2023-12-16T00:03:26.979291+0000","last_fullsized":"2023-12-16T00:03:26.979291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630543+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:45.630543+0000","last_peered":"2023-12-16T00:00:45.630543+0000","last_clean":"2023-12-16T00:00:45.630543+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:45.630543+0000","last_undegraded":"2023-12-16T00:00:45.630543+0000","last_fullsized":"2023-12-16T00:00:45.630543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":563,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377221+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377221+0000","last_peered":"2023-12-16T00:02:58.377221+0000","last_clean":"2023-12-16T00:02:58.377221+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377221+0000","last_undegraded":"2023-12-16T00:02:58.377221+0000","last_fullsized":"2023-12-16T00:02:58.377221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1373,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.404974+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.404974+0000","last_peered":"2023-12-16T00:03:09.404974+0000","last_clean":"2023-12-16T00:03:09.404974+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.404974+0000","last_undegraded":"2023-12-16T00:03:09.404974+0000","last_fullsized":"2023-12-16T00:03:09.404974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273146+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273146+0000","last_peered":"2023-12-16T00:02:14.273146+0000","last_clean":"2023-12-16T00:02:14.273146+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273146+0000","last_undegraded":"2023-12-16T00:02:14.273146+0000","last_fullsized":"2023-12-16T00:02:14.273146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015840+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:26.015840+0000","last_peered":"2023-12-16T00:00:26.015840+0000","last_clean":"2023-12-16T00:00:26.015840+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:26.015840+0000","last_undegraded":"2023-12-16T00:00:26.015840+0000","last_fullsized":"2023-12-16T00:00:26.015840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711285+0000","last_change":"2023-12-15T22:52:53.168032+0000","last_active":"2023-12-16T00:00:27.711285+0000","last_peered":"2023-12-16T00:00:27.711285+0000","last_clean":"2023-12-16T00:00:27.711285+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:00:27.711285+0000","last_undegraded":"2023-12-16T00:00:27.711285+0000","last_fullsized":"2023-12-16T00:00:27.711285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624495+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624495+0000","last_peered":"2023-12-16T00:02:24.624495+0000","last_clean":"2023-12-16T00:02:24.624495+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624495+0000","last_undegraded":"2023-12-16T00:02:24.624495+0000","last_fullsized":"2023-12-16T00:02:24.624495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3898,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200859+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200859+0000","last_peered":"2023-12-16T00:02:19.200859+0000","last_clean":"2023-12-16T00:02:19.200859+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200859+0000","last_undegraded":"2023-12-16T00:02:19.200859+0000","last_fullsized":"2023-12-16T00:02:19.200859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339013+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339013+0000","last_peered":"2023-12-16T00:02:29.339013+0000","last_clean":"2023-12-16T00:02:29.339013+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339013+0000","last_undegraded":"2023-12-16T00:02:29.339013+0000","last_fullsized":"2023-12-16T00:02:29.339013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015647+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:26.015647+0000","last_peered":"2023-12-16T00:00:26.015647+0000","last_clean":"2023-12-16T00:00:26.015647+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:26.015647+0000","last_undegraded":"2023-12-16T00:00:26.015647+0000","last_fullsized":"2023-12-16T00:00:26.015647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119101+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119101+0000","last_peered":"2023-12-16T00:02:43.119101+0000","last_clean":"2023-12-16T00:02:43.119101+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119101+0000","last_undegraded":"2023-12-16T00:02:43.119101+0000","last_fullsized":"2023-12-16T00:02:43.119101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092050+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092050+0000","last_peered":"2023-12-16T00:02:06.092050+0000","last_clean":"2023-12-16T00:02:06.092050+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092050+0000","last_undegraded":"2023-12-16T00:02:06.092050+0000","last_fullsized":"2023-12-16T00:02:06.092050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059422+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059422+0000","last_peered":"2023-12-16T00:01:32.059422+0000","last_clean":"2023-12-16T00:01:32.059422+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059422+0000","last_undegraded":"2023-12-16T00:01:32.059422+0000","last_fullsized":"2023-12-16T00:01:32.059422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513266+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513266+0000","last_peered":"2023-12-16T00:02:15.513266+0000","last_clean":"2023-12-16T00:02:15.513266+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513266+0000","last_undegraded":"2023-12-16T00:02:15.513266+0000","last_fullsized":"2023-12-16T00:02:15.513266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":440,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:53.253697+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:00:53.253697+0000","last_peered":"2023-12-16T00:00:53.253697+0000","last_clean":"2023-12-16T00:00:53.253697+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:00:53.253697+0000","last_undegraded":"2023-12-16T00:00:53.253697+0000","last_fullsized":"2023-12-16T00:00:53.253697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136426+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:28.136426+0000","last_peered":"2023-12-16T00:00:28.136426+0000","last_clean":"2023-12-16T00:00:28.136426+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:28.136426+0000","last_undegraded":"2023-12-16T00:00:28.136426+0000","last_fullsized":"2023-12-16T00:00:28.136426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396819+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:36.396819+0000","last_peered":"2023-12-16T00:00:36.396819+0000","last_clean":"2023-12-16T00:00:36.396819+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:36.396819+0000","last_undegraded":"2023-12-16T00:00:36.396819+0000","last_fullsized":"2023-12-16T00:00:36.396819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865424+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:26.865424+0000","last_peered":"2023-12-16T00:00:26.865424+0000","last_clean":"2023-12-16T00:00:26.865424+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:26.865424+0000","last_undegraded":"2023-12-16T00:00:26.865424+0000","last_fullsized":"2023-12-16T00:00:26.865424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188451+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188451+0000","last_peered":"2023-12-16T00:03:12.188451+0000","last_clean":"2023-12-16T00:03:12.188451+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188451+0000","last_undegraded":"2023-12-16T00:03:12.188451+0000","last_fullsized":"2023-12-16T00:03:12.188451+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246171+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246171+0000","last_peered":"2023-12-16T00:01:50.246171+0000","last_clean":"2023-12-16T00:01:50.246171+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246171+0000","last_undegraded":"2023-12-16T00:01:50.246171+0000","last_fullsized":"2023-12-16T00:01:50.246171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1446,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.929992+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.929992+0000","last_peered":"2023-12-16T00:01:26.929992+0000","last_clean":"2023-12-16T00:01:26.929992+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.929992+0000","last_undegraded":"2023-12-16T00:01:26.929992+0000","last_fullsized":"2023-12-16T00:01:26.929992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986502+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986502+0000","last_peered":"2023-12-16T00:01:56.986502+0000","last_clean":"2023-12-16T00:01:56.986502+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986502+0000","last_undegraded":"2023-12-16T00:01:56.986502+0000","last_fullsized":"2023-12-16T00:01:56.986502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711913+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:27.711913+0000","last_peered":"2023-12-16T00:00:27.711913+0000","last_clean":"2023-12-16T00:00:27.711913+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:27.711913+0000","last_undegraded":"2023-12-16T00:00:27.711913+0000","last_fullsized":"2023-12-16T00:00:27.711913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136417+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:28.136417+0000","last_peered":"2023-12-16T00:00:28.136417+0000","last_clean":"2023-12-16T00:00:28.136417+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:28.136417+0000","last_undegraded":"2023-12-16T00:00:28.136417+0000","last_fullsized":"2023-12-16T00:00:28.136417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"49'12","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409146+0000","last_change":"2023-12-15T22:53:04.316410+0000","last_active":"2023-12-16T00:00:35.409146+0000","last_peered":"2023-12-16T00:00:35.409146+0000","last_clean":"2023-12-16T00:00:35.409146+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:00:35.409146+0000","last_undegraded":"2023-12-16T00:00:35.409146+0000","last_fullsized":"2023-12-16T00:00:35.409146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3684,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689717+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689717+0000","last_peered":"2023-12-16T00:02:12.689717+0000","last_clean":"2023-12-16T00:02:12.689717+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689717+0000","last_undegraded":"2023-12-16T00:02:12.689717+0000","last_fullsized":"2023-12-16T00:02:12.689717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296903+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296903+0000","last_peered":"2023-12-16T00:02:30.296903+0000","last_clean":"2023-12-16T00:02:30.296903+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296903+0000","last_undegraded":"2023-12-16T00:02:30.296903+0000","last_fullsized":"2023-12-16T00:02:30.296903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892770+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892770+0000","last_peered":"2023-12-16T00:01:49.892770+0000","last_clean":"2023-12-16T00:01:49.892770+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892770+0000","last_undegraded":"2023-12-16T00:01:49.892770+0000","last_fullsized":"2023-12-16T00:01:49.892770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038756+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038756+0000","last_peered":"2023-12-16T00:01:16.038756+0000","last_clean":"2023-12-16T00:01:16.038756+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038756+0000","last_undegraded":"2023-12-16T00:01:16.038756+0000","last_fullsized":"2023-12-16T00:01:16.038756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.808354+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:00:56.808354+0000","last_peered":"2023-12-16T00:00:56.808354+0000","last_clean":"2023-12-16T00:00:56.808354+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:00:56.808354+0000","last_undegraded":"2023-12-16T00:00:56.808354+0000","last_fullsized":"2023-12-16T00:00:56.808354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412330+0000","last_change":"2023-12-15T22:52:55.187879+0000","last_active":"2023-12-16T00:00:50.412330+0000","last_peered":"2023-12-16T00:00:50.412330+0000","last_clean":"2023-12-16T00:00:50.412330+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:00:50.412330+0000","last_undegraded":"2023-12-16T00:00:50.412330+0000","last_fullsized":"2023-12-16T00:00:50.412330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.404588+0000","last_change":"2023-12-15T22:52:53.174157+0000","last_active":"2023-12-16T00:01:10.404588+0000","last_peered":"2023-12-16T00:01:10.404588+0000","last_clean":"2023-12-16T00:01:10.404588+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:01:10.404588+0000","last_undegraded":"2023-12-16T00:01:10.404588+0000","last_fullsized":"2023-12-16T00:01:10.404588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":397,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020604+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020604+0000","last_peered":"2023-12-16T00:02:10.020604+0000","last_clean":"2023-12-16T00:02:10.020604+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020604+0000","last_undegraded":"2023-12-16T00:02:10.020604+0000","last_fullsized":"2023-12-16T00:02:10.020604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237503+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237503+0000","last_peered":"2023-12-16T00:02:34.237503+0000","last_clean":"2023-12-16T00:02:34.237503+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237503+0000","last_undegraded":"2023-12-16T00:02:34.237503+0000","last_fullsized":"2023-12-16T00:02:34.237503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":399,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.049319+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:00:42.049319+0000","last_peered":"2023-12-16T00:00:42.049319+0000","last_clean":"2023-12-16T00:00:42.049319+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:00:42.049319+0000","last_undegraded":"2023-12-16T00:00:42.049319+0000","last_fullsized":"2023-12-16T00:00:42.049319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408217+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:35.408217+0000","last_peered":"2023-12-16T00:00:35.408217+0000","last_clean":"2023-12-16T00:00:35.408217+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:35.408217+0000","last_undegraded":"2023-12-16T00:00:35.408217+0000","last_fullsized":"2023-12-16T00:00:35.408217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015726+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:00:26.015726+0000","last_peered":"2023-12-16T00:00:26.015726+0000","last_clean":"2023-12-16T00:00:26.015726+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:00:26.015726+0000","last_undegraded":"2023-12-16T00:00:26.015726+0000","last_fullsized":"2023-12-16T00:00:26.015726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483652+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483652+0000","last_peered":"2023-12-16T00:03:15.483652+0000","last_clean":"2023-12-16T00:03:15.483652+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483652+0000","last_undegraded":"2023-12-16T00:03:15.483652+0000","last_fullsized":"2023-12-16T00:03:15.483652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425524+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425524+0000","last_peered":"2023-12-16T00:03:09.425524+0000","last_clean":"2023-12-16T00:03:09.425524+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425524+0000","last_undegraded":"2023-12-16T00:03:09.425524+0000","last_fullsized":"2023-12-16T00:03:09.425524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374415+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374415+0000","last_peered":"2023-12-16T00:03:18.374415+0000","last_clean":"2023-12-16T00:03:18.374415+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374415+0000","last_undegraded":"2023-12-16T00:03:18.374415+0000","last_fullsized":"2023-12-16T00:03:18.374415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183013+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183013+0000","last_peered":"2023-12-16T00:03:26.183013+0000","last_clean":"2023-12-16T00:03:26.183013+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183013+0000","last_undegraded":"2023-12-16T00:03:26.183013+0000","last_fullsized":"2023-12-16T00:03:26.183013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605022+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605022+0000","last_peered":"2023-12-16T00:03:27.605022+0000","last_clean":"2023-12-16T00:03:27.605022+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605022+0000","last_undegraded":"2023-12-16T00:03:27.605022+0000","last_fullsized":"2023-12-16T00:03:27.605022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246529+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246529+0000","last_peered":"2023-12-16T00:03:24.246529+0000","last_clean":"2023-12-16T00:03:24.246529+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246529+0000","last_undegraded":"2023-12-16T00:03:24.246529+0000","last_fullsized":"2023-12-16T00:03:24.246529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015729+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:26.015729+0000","last_peered":"2023-12-16T00:00:26.015729+0000","last_clean":"2023-12-16T00:00:26.015729+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:26.015729+0000","last_undegraded":"2023-12-16T00:00:26.015729+0000","last_fullsized":"2023-12-16T00:00:26.015729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427778+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427778+0000","last_peered":"2023-12-16T00:03:03.427778+0000","last_clean":"2023-12-16T00:03:03.427778+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427778+0000","last_undegraded":"2023-12-16T00:03:03.427778+0000","last_fullsized":"2023-12-16T00:03:03.427778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439762+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:26.439762+0000","last_peered":"2023-12-16T00:00:26.439762+0000","last_clean":"2023-12-16T00:00:26.439762+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:26.439762+0000","last_undegraded":"2023-12-16T00:00:26.439762+0000","last_fullsized":"2023-12-16T00:00:26.439762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439937+0000","last_change":"2023-12-15T22:52:55.186792+0000","last_active":"2023-12-16T00:00:26.439937+0000","last_peered":"2023-12-16T00:00:26.439937+0000","last_clean":"2023-12-16T00:00:26.439937+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:00:26.439937+0000","last_undegraded":"2023-12-16T00:00:26.439937+0000","last_fullsized":"2023-12-16T00:00:26.439937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388607+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388607+0000","last_peered":"2023-12-16T00:03:15.388607+0000","last_clean":"2023-12-16T00:03:15.388607+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388607+0000","last_undegraded":"2023-12-16T00:03:15.388607+0000","last_fullsized":"2023-12-16T00:03:15.388607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.415990+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.415990+0000","last_peered":"2023-12-16T00:03:16.415990+0000","last_clean":"2023-12-16T00:03:16.415990+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.415990+0000","last_undegraded":"2023-12-16T00:03:16.415990+0000","last_fullsized":"2023-12-16T00:03:16.415990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.864166+0000","last_change":"2023-12-15T22:52:53.176751+0000","last_active":"2023-12-16T00:00:26.864166+0000","last_peered":"2023-12-16T00:00:26.864166+0000","last_clean":"2023-12-16T00:00:26.864166+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:00:26.864166+0000","last_undegraded":"2023-12-16T00:00:26.864166+0000","last_fullsized":"2023-12-16T00:00:26.864166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408812+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:35.408812+0000","last_peered":"2023-12-16T00:00:35.408812+0000","last_clean":"2023-12-16T00:00:35.408812+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:35.408812+0000","last_undegraded":"2023-12-16T00:00:35.408812+0000","last_fullsized":"2023-12-16T00:00:35.408812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015739+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:26.015739+0000","last_peered":"2023-12-16T00:00:26.015739+0000","last_clean":"2023-12-16T00:00:26.015739+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:26.015739+0000","last_undegraded":"2023-12-16T00:00:26.015739+0000","last_fullsized":"2023-12-16T00:00:26.015739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288174+0000","last_change":"2023-12-15T22:52:55.189248+0000","last_active":"2023-12-16T00:00:27.288174+0000","last_peered":"2023-12-16T00:00:27.288174+0000","last_clean":"2023-12-16T00:00:27.288174+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:00:27.288174+0000","last_undegraded":"2023-12-16T00:00:27.288174+0000","last_fullsized":"2023-12-16T00:00:27.288174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015869+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:26.015869+0000","last_peered":"2023-12-16T00:00:26.015869+0000","last_clean":"2023-12-16T00:00:26.015869+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:26.015869+0000","last_undegraded":"2023-12-16T00:00:26.015869+0000","last_fullsized":"2023-12-16T00:00:26.015869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469761+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469761+0000","last_peered":"2023-12-16T00:03:07.469761+0000","last_clean":"2023-12-16T00:03:07.469761+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469761+0000","last_undegraded":"2023-12-16T00:03:07.469761+0000","last_fullsized":"2023-12-16T00:03:07.469761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015891+0000","last_change":"2023-12-15T22:52:55.190405+0000","last_active":"2023-12-16T00:00:26.015891+0000","last_peered":"2023-12-16T00:00:26.015891+0000","last_clean":"2023-12-16T00:00:26.015891+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:00:26.015891+0000","last_undegraded":"2023-12-16T00:00:26.015891+0000","last_fullsized":"2023-12-16T00:00:26.015891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431217+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431217+0000","last_peered":"2023-12-16T00:03:20.431217+0000","last_clean":"2023-12-16T00:03:20.431217+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431217+0000","last_undegraded":"2023-12-16T00:03:20.431217+0000","last_fullsized":"2023-12-16T00:03:20.431217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440012+0000","last_change":"2023-12-15T22:52:55.189328+0000","last_active":"2023-12-16T00:00:26.440012+0000","last_peered":"2023-12-16T00:00:26.440012+0000","last_clean":"2023-12-16T00:00:26.440012+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:00:26.440012+0000","last_undegraded":"2023-12-16T00:00:26.440012+0000","last_fullsized":"2023-12-16T00:00:26.440012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328107+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328107+0000","last_peered":"2023-12-16T00:03:29.328107+0000","last_clean":"2023-12-16T00:03:29.328107+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328107+0000","last_undegraded":"2023-12-16T00:03:29.328107+0000","last_fullsized":"2023-12-16T00:03:29.328107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409528+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:35.409528+0000","last_peered":"2023-12-16T00:00:35.409528+0000","last_clean":"2023-12-16T00:00:35.409528+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:35.409528+0000","last_undegraded":"2023-12-16T00:00:35.409528+0000","last_fullsized":"2023-12-16T00:00:35.409528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408164+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:35.408164+0000","last_peered":"2023-12-16T00:00:35.408164+0000","last_clean":"2023-12-16T00:00:35.408164+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:35.408164+0000","last_undegraded":"2023-12-16T00:00:35.408164+0000","last_fullsized":"2023-12-16T00:00:35.408164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412865+0000","last_change":"2023-12-15T22:52:55.193808+0000","last_active":"2023-12-16T00:00:50.412865+0000","last_peered":"2023-12-16T00:00:50.412865+0000","last_clean":"2023-12-16T00:00:50.412865+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:00:50.412865+0000","last_undegraded":"2023-12-16T00:00:50.412865+0000","last_fullsized":"2023-12-16T00:00:50.412865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628015+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:35.628015+0000","last_peered":"2023-12-16T00:00:35.628015+0000","last_clean":"2023-12-16T00:00:35.628015+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:35.628015+0000","last_undegraded":"2023-12-16T00:00:35.628015+0000","last_fullsized":"2023-12-16T00:00:35.628015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409418+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:35.409418+0000","last_peered":"2023-12-16T00:00:35.409418+0000","last_clean":"2023-12-16T00:00:35.409418+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:35.409418+0000","last_undegraded":"2023-12-16T00:00:35.409418+0000","last_fullsized":"2023-12-16T00:00:35.409418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229475,"num_omap_keys":873,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4323,"ondisk_log_size":4323,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2378,"ondisk_log_size":2378,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":896,"ondisk_log_size":896,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608414,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.505}]},{"osd":1,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":0.72199999999999998,"15min":1.004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":1.044},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.54400000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.35299999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.374,"15min":0.373},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.57899999999999996,"15min":1.149},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63},"last":0.377}]}]},{"osd":5,"up_from":11,"seq":47244641116,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.747},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.879},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.37},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.61099999999999999,"15min":0.754},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26100000000000001},"max":{"1min":0.50700000000000001,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.318}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.31,"5min":0.307,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.35599999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641118,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.27400000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69299999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":1.25,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.379,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:02:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.246},"max":{"1min":0.55300000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.36799999999999999},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.442}]},{"osd":5,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.62,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47899999999999998}]}]},{"osd":2,"up_from":11,"seq":47244641115,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"min":{"1min":0.23400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.42699999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55400000000000005,"5min":0.87,"15min":0.87},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44500000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51800000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.169,"15min":1.169},"last":0.52700000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.499},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82899999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57799999999999996}]}]},{"osd":1,"up_from":11,"seq":47244641116,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.312,"15min":0.316},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.437,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.315},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.34100000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.80100000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.52200000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48899999999999999,"5min":0.504,"15min":0.504},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.71999999999999997,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.64700000000000002,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.44900000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.755,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.878},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.55100000000000005}]}]},{"osd":0,"up_from":11,"seq":47244641116,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.34499999999999997}]},{"osd":2,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.503,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.83599999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.40500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68300000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.875},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:03:32.656 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.656 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.656 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.656 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.657 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.657 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.657 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.657 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.658 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.658 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.658 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.658 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.658 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.659 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.659 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.659 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.659 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.660 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.660 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.660 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.660 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.660 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.661 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.661 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.661 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.661 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.662 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.662 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.662 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.662 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.662 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.663 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.663 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.663 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.664 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.664 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.664 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.664 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.665 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.665 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.665 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.665 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.666 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.666 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.666 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.666 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.666 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.667 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.667 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.667 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.667 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.668 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.668 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.668 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.669 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.669 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.669 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.669 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.670 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.670 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.670 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.670 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.670 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.671 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.671 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.671 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.671 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.672 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.672 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.672 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.672 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.672 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.673 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.673 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.673 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.673 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.674 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.674 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.674 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.674 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.675 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.675 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.675 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.675 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.675 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.676 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.676 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.676 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.676 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.677 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-15T22:53:05.303522+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=5, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.677 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.677 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.677 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.678 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.678 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.678 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.678 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.679 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.679 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.679 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.679 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.680 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.680 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.680 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.680 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.681 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.681 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.681 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.681 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.682 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.682 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.682 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.683 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.683 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.683 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.683 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.683 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.684 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.684 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.684 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.684 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.685 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.685 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.685 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.685 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.686 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.686 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.686 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.686 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.686 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.687 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.687 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.687 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.687 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.687 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.688 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.688 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.688 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.688 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.688 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.689 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.689 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.689 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.689 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.690 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:32.690 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:03:52.691 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:03:53.033 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:03:53.055 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:03:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2202,"stamp":"2023-12-16T00:03:52.273064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":917299,"num_omap_keys":3981,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36508,"ondisk_log_size":36508,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":307928,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":298038,"kb_avail":628837672,"statfs":{"total":644245094400,"available":643929776128,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":305191585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005321"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358393+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358393+0000","last_peered":"2023-12-16T00:03:26.358393+0000","last_clean":"2023-12-16T00:03:26.358393+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358393+0000","last_undegraded":"2023-12-16T00:03:26.358393+0000","last_fullsized":"2023-12-16T00:03:26.358393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136676+0000","last_change":"2023-12-15T22:52:55.188761+0000","last_active":"2023-12-16T00:00:28.136676+0000","last_peered":"2023-12-16T00:00:28.136676+0000","last_clean":"2023-12-16T00:00:28.136676+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:00:28.136676+0000","last_undegraded":"2023-12-16T00:00:28.136676+0000","last_fullsized":"2023-12-16T00:00:28.136676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.643981+0000","last_change":"2023-12-15T22:52:53.169738+0000","last_active":"2023-12-16T00:01:40.643981+0000","last_peered":"2023-12-16T00:01:40.643981+0000","last_clean":"2023-12-16T00:01:40.643981+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:01:40.643981+0000","last_undegraded":"2023-12-16T00:01:40.643981+0000","last_fullsized":"2023-12-16T00:01:40.643981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408466+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:21.408466+0000","last_peered":"2023-12-16T00:01:21.408466+0000","last_clean":"2023-12-16T00:01:21.408466+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:21.408466+0000","last_undegraded":"2023-12-16T00:01:21.408466+0000","last_fullsized":"2023-12-16T00:01:21.408466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439809+0000","last_change":"2023-12-15T22:53:01.291345+0000","last_active":"2023-12-16T00:00:26.439809+0000","last_peered":"2023-12-16T00:00:26.439809+0000","last_clean":"2023-12-16T00:00:26.439809+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:00:26.439809+0000","last_undegraded":"2023-12-16T00:00:26.439809+0000","last_fullsized":"2023-12-16T00:00:26.439809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418691+0000","last_change":"2023-12-15T22:52:53.174288+0000","last_active":"2023-12-16T00:01:10.418691+0000","last_peered":"2023-12-16T00:01:10.418691+0000","last_clean":"2023-12-16T00:01:10.418691+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:01:10.418691+0000","last_undegraded":"2023-12-16T00:01:10.418691+0000","last_fullsized":"2023-12-16T00:01:10.418691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015974+0000","last_change":"2023-12-15T22:52:55.194932+0000","last_active":"2023-12-16T00:00:26.015974+0000","last_peered":"2023-12-16T00:00:26.015974+0000","last_clean":"2023-12-16T00:00:26.015974+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:00:26.015974+0000","last_undegraded":"2023-12-16T00:00:26.015974+0000","last_fullsized":"2023-12-16T00:00:26.015974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288059+0000","last_change":"2023-12-15T22:52:53.172066+0000","last_active":"2023-12-16T00:00:27.288059+0000","last_peered":"2023-12-16T00:00:27.288059+0000","last_clean":"2023-12-16T00:00:27.288059+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:00:27.288059+0000","last_undegraded":"2023-12-16T00:00:27.288059+0000","last_fullsized":"2023-12-16T00:00:27.288059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418704+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:01:10.418704+0000","last_peered":"2023-12-16T00:01:10.418704+0000","last_clean":"2023-12-16T00:01:10.418704+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:01:10.418704+0000","last_undegraded":"2023-12-16T00:01:10.418704+0000","last_fullsized":"2023-12-16T00:01:10.418704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136544+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:28.136544+0000","last_peered":"2023-12-16T00:00:28.136544+0000","last_clean":"2023-12-16T00:00:28.136544+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:28.136544+0000","last_undegraded":"2023-12-16T00:00:28.136544+0000","last_fullsized":"2023-12-16T00:00:28.136544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477835+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477835+0000","last_peered":"2023-12-16T00:03:06.477835+0000","last_clean":"2023-12-16T00:03:06.477835+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477835+0000","last_undegraded":"2023-12-16T00:03:06.477835+0000","last_fullsized":"2023-12-16T00:03:06.477835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288014+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:27.288014+0000","last_peered":"2023-12-16T00:00:27.288014+0000","last_clean":"2023-12-16T00:00:27.288014+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:27.288014+0000","last_undegraded":"2023-12-16T00:00:27.288014+0000","last_fullsized":"2023-12-16T00:00:27.288014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426706+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:01:40.426706+0000","last_peered":"2023-12-16T00:01:40.426706+0000","last_clean":"2023-12-16T00:01:40.426706+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:01:40.426706+0000","last_undegraded":"2023-12-16T00:01:40.426706+0000","last_fullsized":"2023-12-16T00:01:40.426706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408096+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:21.408096+0000","last_peered":"2023-12-16T00:01:21.408096+0000","last_clean":"2023-12-16T00:01:21.408096+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:21.408096+0000","last_undegraded":"2023-12-16T00:01:21.408096+0000","last_fullsized":"2023-12-16T00:01:21.408096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:45.193861+0000","last_change":"2023-12-16T00:03:45.193882+0000","last_active":"2023-12-16T00:03:45.193861+0000","last_peered":"2023-12-16T00:03:45.193861+0000","last_clean":"2023-12-16T00:03:45.193861+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:03:45.193861+0000","last_undegraded":"2023-12-16T00:03:45.193861+0000","last_fullsized":"2023-12-16T00:03:45.193861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:45.193798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:27.535599+0000","scrub_duration":0.0012721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629295+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629295+0000","last_peered":"2023-12-16T00:02:46.629295+0000","last_clean":"2023-12-16T00:02:46.629295+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629295+0000","last_undegraded":"2023-12-16T00:02:46.629295+0000","last_fullsized":"2023-12-16T00:02:46.629295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426875+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:01:40.426875+0000","last_peered":"2023-12-16T00:01:40.426875+0000","last_clean":"2023-12-16T00:01:40.426875+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:01:40.426875+0000","last_undegraded":"2023-12-16T00:01:40.426875+0000","last_fullsized":"2023-12-16T00:01:40.426875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.099235+0000","last_change":"2023-12-16T00:03:44.099255+0000","last_active":"2023-12-16T00:03:44.099235+0000","last_peered":"2023-12-16T00:03:44.099235+0000","last_clean":"2023-12-16T00:03:44.099235+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:03:44.099235+0000","last_undegraded":"2023-12-16T00:03:44.099235+0000","last_fullsized":"2023-12-16T00:03:44.099235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.099172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:07.211984+0000","scrub_duration":0.0012518329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412953+0000","last_change":"2023-12-15T22:52:55.188103+0000","last_active":"2023-12-16T00:00:50.412953+0000","last_peered":"2023-12-16T00:00:50.412953+0000","last_clean":"2023-12-16T00:00:50.412953+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:00:50.412953+0000","last_undegraded":"2023-12-16T00:00:50.412953+0000","last_fullsized":"2023-12-16T00:00:50.412953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409311+0000","last_change":"2023-12-15T22:52:53.175790+0000","last_active":"2023-12-16T00:00:35.409311+0000","last_peered":"2023-12-16T00:00:35.409311+0000","last_clean":"2023-12-16T00:00:35.409311+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:00:35.409311+0000","last_undegraded":"2023-12-16T00:00:35.409311+0000","last_fullsized":"2023-12-16T00:00:35.409311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.493314+0000","last_change":"2023-12-16T00:03:36.493334+0000","last_active":"2023-12-16T00:03:36.493314+0000","last_peered":"2023-12-16T00:03:36.493314+0000","last_clean":"2023-12-16T00:03:36.493314+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:03:36.493314+0000","last_undegraded":"2023-12-16T00:03:36.493314+0000","last_fullsized":"2023-12-16T00:03:36.493314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.493246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:53.796792+0000","scrub_duration":0.00093940400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408417+0000","last_change":"2023-12-15T22:52:53.177818+0000","last_active":"2023-12-16T00:00:35.408417+0000","last_peered":"2023-12-16T00:00:35.408417+0000","last_clean":"2023-12-16T00:00:35.408417+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:00:35.408417+0000","last_undegraded":"2023-12-16T00:00:35.408417+0000","last_fullsized":"2023-12-16T00:00:35.408417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412379+0000","last_change":"2023-12-15T22:52:53.175144+0000","last_active":"2023-12-16T00:00:50.412379+0000","last_peered":"2023-12-16T00:00:50.412379+0000","last_clean":"2023-12-16T00:00:50.412379+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:00:50.412379+0000","last_undegraded":"2023-12-16T00:00:50.412379+0000","last_fullsized":"2023-12-16T00:00:50.412379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.631082+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:45.631082+0000","last_peered":"2023-12-16T00:00:45.631082+0000","last_clean":"2023-12-16T00:00:45.631082+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:45.631082+0000","last_undegraded":"2023-12-16T00:00:45.631082+0000","last_fullsized":"2023-12-16T00:00:45.631082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411379+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411379+0000","last_peered":"2023-12-16T00:02:07.411379+0000","last_clean":"2023-12-16T00:02:07.411379+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411379+0000","last_undegraded":"2023-12-16T00:02:07.411379+0000","last_fullsized":"2023-12-16T00:02:07.411379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620322+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620322+0000","last_peered":"2023-12-16T00:02:06.620322+0000","last_clean":"2023-12-16T00:02:06.620322+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620322+0000","last_undegraded":"2023-12-16T00:02:06.620322+0000","last_fullsized":"2023-12-16T00:02:06.620322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.542129+0000","last_change":"2023-12-16T00:03:49.542149+0000","last_active":"2023-12-16T00:03:49.542129+0000","last_peered":"2023-12-16T00:03:49.542129+0000","last_clean":"2023-12-16T00:03:49.542129+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:03:49.542129+0000","last_undegraded":"2023-12-16T00:03:49.542129+0000","last_fullsized":"2023-12-16T00:03:49.542129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.542068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:12.196084+0000","scrub_duration":0.0010559110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408467+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:35.408467+0000","last_peered":"2023-12-16T00:00:35.408467+0000","last_clean":"2023-12-16T00:00:35.408467+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:35.408467+0000","last_undegraded":"2023-12-16T00:00:35.408467+0000","last_fullsized":"2023-12-16T00:00:35.408467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.157297+0000","last_change":"2023-12-16T00:03:31.157320+0000","last_active":"2023-12-16T00:03:31.157297+0000","last_peered":"2023-12-16T00:03:31.157297+0000","last_clean":"2023-12-16T00:03:31.157297+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:03:31.157297+0000","last_undegraded":"2023-12-16T00:03:31.157297+0000","last_fullsized":"2023-12-16T00:03:31.157297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.157241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:58:18.132539+0000","scrub_duration":0.0024345880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.399111+0000","last_change":"2023-12-15T23:08:37.338938+0000","last_active":"2023-12-16T00:00:50.399111+0000","last_peered":"2023-12-16T00:00:50.399111+0000","last_clean":"2023-12-16T00:00:50.399111+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:00:50.399111+0000","last_undegraded":"2023-12-16T00:00:50.399111+0000","last_fullsized":"2023-12-16T00:00:50.399111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886891+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886891+0000","last_peered":"2023-12-16T00:01:52.886891+0000","last_clean":"2023-12-16T00:01:52.886891+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886891+0000","last_undegraded":"2023-12-16T00:01:52.886891+0000","last_fullsized":"2023-12-16T00:01:52.886891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118199+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118199+0000","last_peered":"2023-12-16T00:02:20.118199+0000","last_clean":"2023-12-16T00:02:20.118199+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118199+0000","last_undegraded":"2023-12-16T00:02:20.118199+0000","last_fullsized":"2023-12-16T00:02:20.118199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409291+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:35.409291+0000","last_peered":"2023-12-16T00:00:35.409291+0000","last_clean":"2023-12-16T00:00:35.409291+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:35.409291+0000","last_undegraded":"2023-12-16T00:00:35.409291+0000","last_fullsized":"2023-12-16T00:00:35.409291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630689+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:45.630689+0000","last_peered":"2023-12-16T00:00:45.630689+0000","last_clean":"2023-12-16T00:00:45.630689+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:45.630689+0000","last_undegraded":"2023-12-16T00:00:45.630689+0000","last_fullsized":"2023-12-16T00:00:45.630689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415589+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:01:00.415589+0000","last_peered":"2023-12-16T00:01:00.415589+0000","last_clean":"2023-12-16T00:01:00.415589+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:01:00.415589+0000","last_undegraded":"2023-12-16T00:01:00.415589+0000","last_fullsized":"2023-12-16T00:01:00.415589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405927+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:01:11.405927+0000","last_peered":"2023-12-16T00:01:11.405927+0000","last_clean":"2023-12-16T00:01:11.405927+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:01:11.405927+0000","last_undegraded":"2023-12-16T00:01:11.405927+0000","last_fullsized":"2023-12-16T00:01:11.405927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016881+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:00:26.016881+0000","last_peered":"2023-12-16T00:00:26.016881+0000","last_clean":"2023-12-16T00:00:26.016881+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:00:26.016881+0000","last_undegraded":"2023-12-16T00:00:26.016881+0000","last_fullsized":"2023-12-16T00:00:26.016881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.414205+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:46.414205+0000","last_peered":"2023-12-16T00:01:46.414205+0000","last_clean":"2023-12-16T00:01:46.414205+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:46.414205+0000","last_undegraded":"2023-12-16T00:01:46.414205+0000","last_fullsized":"2023-12-16T00:01:46.414205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.422218+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.422218+0000","last_peered":"2023-12-16T00:01:25.422218+0000","last_clean":"2023-12-16T00:01:25.422218+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.422218+0000","last_undegraded":"2023-12-16T00:01:25.422218+0000","last_fullsized":"2023-12-16T00:01:25.422218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403853+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:01:10.403853+0000","last_peered":"2023-12-16T00:01:10.403853+0000","last_clean":"2023-12-16T00:01:10.403853+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:01:10.403853+0000","last_undegraded":"2023-12-16T00:01:10.403853+0000","last_fullsized":"2023-12-16T00:01:10.403853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408273+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:35.408273+0000","last_peered":"2023-12-16T00:00:35.408273+0000","last_clean":"2023-12-16T00:00:35.408273+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:35.408273+0000","last_undegraded":"2023-12-16T00:00:35.408273+0000","last_fullsized":"2023-12-16T00:00:35.408273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.636643+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:01:10.636643+0000","last_peered":"2023-12-16T00:01:10.636643+0000","last_clean":"2023-12-16T00:01:10.636643+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:01:10.636643+0000","last_undegraded":"2023-12-16T00:01:10.636643+0000","last_fullsized":"2023-12-16T00:01:10.636643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1028,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304198+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304198+0000","last_peered":"2023-12-16T00:02:29.304198+0000","last_clean":"2023-12-16T00:02:29.304198+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304198+0000","last_undegraded":"2023-12-16T00:02:29.304198+0000","last_fullsized":"2023-12-16T00:02:29.304198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403828+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:01:10.403828+0000","last_peered":"2023-12-16T00:01:10.403828+0000","last_clean":"2023-12-16T00:01:10.403828+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:01:10.403828+0000","last_undegraded":"2023-12-16T00:01:10.403828+0000","last_fullsized":"2023-12-16T00:01:10.403828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638510+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:20.638510+0000","last_peered":"2023-12-16T00:01:20.638510+0000","last_clean":"2023-12-16T00:01:20.638510+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:20.638510+0000","last_undegraded":"2023-12-16T00:01:20.638510+0000","last_fullsized":"2023-12-16T00:01:20.638510+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408763+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:35.408763+0000","last_peered":"2023-12-16T00:00:35.408763+0000","last_clean":"2023-12-16T00:00:35.408763+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:35.408763+0000","last_undegraded":"2023-12-16T00:00:35.408763+0000","last_fullsized":"2023-12-16T00:00:35.408763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:46.399423+0000","last_change":"2023-12-15T23:08:37.336532+0000","last_active":"2023-12-16T00:00:46.399423+0000","last_peered":"2023-12-16T00:00:46.399423+0000","last_clean":"2023-12-16T00:00:46.399423+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:00:46.399423+0000","last_undegraded":"2023-12-16T00:00:46.399423+0000","last_fullsized":"2023-12-16T00:00:46.399423+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413716+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:46.413716+0000","last_peered":"2023-12-16T00:01:46.413716+0000","last_clean":"2023-12-16T00:01:46.413716+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:46.413716+0000","last_undegraded":"2023-12-16T00:01:46.413716+0000","last_fullsized":"2023-12-16T00:01:46.413716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288080+0000","last_change":"2023-12-15T22:52:55.185275+0000","last_active":"2023-12-16T00:00:27.288080+0000","last_peered":"2023-12-16T00:00:27.288080+0000","last_clean":"2023-12-16T00:00:27.288080+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:00:27.288080+0000","last_undegraded":"2023-12-16T00:00:27.288080+0000","last_fullsized":"2023-12-16T00:00:27.288080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410772+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:40.410772+0000","last_peered":"2023-12-16T00:00:40.410772+0000","last_clean":"2023-12-16T00:00:40.410772+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:40.410772+0000","last_undegraded":"2023-12-16T00:00:40.410772+0000","last_fullsized":"2023-12-16T00:00:40.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:42.076754+0000","last_change":"2023-12-16T00:03:42.076798+0000","last_active":"2023-12-16T00:03:42.076754+0000","last_peered":"2023-12-16T00:03:42.076754+0000","last_clean":"2023-12-16T00:03:42.076754+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:03:42.076754+0000","last_undegraded":"2023-12-16T00:03:42.076754+0000","last_fullsized":"2023-12-16T00:03:42.076754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_clean_scrub_stamp":"2023-12-16T00:03:42.076689+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:57.373234+0000","scrub_duration":0.0028837759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214798+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214798+0000","last_peered":"2023-12-16T00:03:06.214798+0000","last_clean":"2023-12-16T00:03:06.214798+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214798+0000","last_undegraded":"2023-12-16T00:03:06.214798+0000","last_fullsized":"2023-12-16T00:03:06.214798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.858072+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:45.858072+0000","last_peered":"2023-12-16T00:01:45.858072+0000","last_clean":"2023-12-16T00:01:45.858072+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:45.858072+0000","last_undegraded":"2023-12-16T00:01:45.858072+0000","last_fullsized":"2023-12-16T00:01:45.858072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575227+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575227+0000","last_peered":"2023-12-16T00:03:30.575227+0000","last_clean":"2023-12-16T00:03:30.575227+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575227+0000","last_undegraded":"2023-12-16T00:03:30.575227+0000","last_fullsized":"2023-12-16T00:03:30.575227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136427+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:28.136427+0000","last_peered":"2023-12-16T00:00:28.136427+0000","last_clean":"2023-12-16T00:00:28.136427+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:28.136427+0000","last_undegraded":"2023-12-16T00:00:28.136427+0000","last_fullsized":"2023-12-16T00:00:28.136427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470578+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470578+0000","last_peered":"2023-12-16T00:02:55.470578+0000","last_clean":"2023-12-16T00:02:55.470578+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470578+0000","last_undegraded":"2023-12-16T00:02:55.470578+0000","last_fullsized":"2023-12-16T00:02:55.470578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.935847+0000","last_change":"2023-12-16T00:03:47.935882+0000","last_active":"2023-12-16T00:03:47.935847+0000","last_peered":"2023-12-16T00:03:47.935847+0000","last_clean":"2023-12-16T00:03:47.935847+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:03:47.935847+0000","last_undegraded":"2023-12-16T00:03:47.935847+0000","last_fullsized":"2023-12-16T00:03:47.935847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.935771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:56.317416+0000","scrub_duration":0.0010477100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287840+0000","last_change":"2023-12-15T22:52:53.172094+0000","last_active":"2023-12-16T00:00:27.287840+0000","last_peered":"2023-12-16T00:00:27.287840+0000","last_clean":"2023-12-16T00:00:27.287840+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:00:27.287840+0000","last_undegraded":"2023-12-16T00:00:27.287840+0000","last_fullsized":"2023-12-16T00:00:27.287840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355510+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355510+0000","last_peered":"2023-12-16T00:02:46.355510+0000","last_clean":"2023-12-16T00:02:46.355510+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355510+0000","last_undegraded":"2023-12-16T00:02:46.355510+0000","last_fullsized":"2023-12-16T00:02:46.355510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398726+0000","last_change":"2023-12-15T23:08:37.341322+0000","last_active":"2023-12-16T00:00:50.398726+0000","last_peered":"2023-12-16T00:00:50.398726+0000","last_clean":"2023-12-16T00:00:50.398726+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:00:50.398726+0000","last_undegraded":"2023-12-16T00:00:50.398726+0000","last_fullsized":"2023-12-16T00:00:50.398726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959687+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959687+0000","last_peered":"2023-12-16T00:03:20.959687+0000","last_clean":"2023-12-16T00:03:20.959687+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959687+0000","last_undegraded":"2023-12-16T00:03:20.959687+0000","last_fullsized":"2023-12-16T00:03:20.959687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136335+0000","last_change":"2023-12-15T22:52:53.175413+0000","last_active":"2023-12-16T00:00:28.136335+0000","last_peered":"2023-12-16T00:00:28.136335+0000","last_clean":"2023-12-16T00:00:28.136335+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:00:28.136335+0000","last_undegraded":"2023-12-16T00:00:28.136335+0000","last_fullsized":"2023-12-16T00:00:28.136335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137591+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137591+0000","last_peered":"2023-12-16T00:02:59.137591+0000","last_clean":"2023-12-16T00:02:59.137591+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137591+0000","last_undegraded":"2023-12-16T00:02:59.137591+0000","last_fullsized":"2023-12-16T00:02:59.137591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.629876+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:40.629876+0000","last_peered":"2023-12-16T00:00:40.629876+0000","last_clean":"2023-12-16T00:00:40.629876+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:40.629876+0000","last_undegraded":"2023-12-16T00:00:40.629876+0000","last_fullsized":"2023-12-16T00:00:40.629876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334191+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334191+0000","last_peered":"2023-12-16T00:02:27.334191+0000","last_clean":"2023-12-16T00:02:27.334191+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334191+0000","last_undegraded":"2023-12-16T00:02:27.334191+0000","last_fullsized":"2023-12-16T00:02:27.334191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711314+0000","last_change":"2023-12-15T22:52:55.189970+0000","last_active":"2023-12-16T00:00:27.711314+0000","last_peered":"2023-12-16T00:00:27.711314+0000","last_clean":"2023-12-16T00:00:27.711314+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:00:27.711314+0000","last_undegraded":"2023-12-16T00:00:27.711314+0000","last_fullsized":"2023-12-16T00:00:27.711314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439680+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:26.439680+0000","last_peered":"2023-12-16T00:00:26.439680+0000","last_clean":"2023-12-16T00:00:26.439680+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:26.439680+0000","last_undegraded":"2023-12-16T00:00:26.439680+0000","last_fullsized":"2023-12-16T00:00:26.439680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355512+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355512+0000","last_peered":"2023-12-16T00:03:09.355512+0000","last_clean":"2023-12-16T00:03:09.355512+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355512+0000","last_undegraded":"2023-12-16T00:03:09.355512+0000","last_fullsized":"2023-12-16T00:03:09.355512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.409998+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:40.409998+0000","last_peered":"2023-12-16T00:00:40.409998+0000","last_clean":"2023-12-16T00:00:40.409998+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:40.409998+0000","last_undegraded":"2023-12-16T00:00:40.409998+0000","last_fullsized":"2023-12-16T00:00:40.409998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'115","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.070326+0000","last_change":"2023-12-16T00:03:41.070353+0000","last_active":"2023-12-16T00:03:41.070326+0000","last_peered":"2023-12-16T00:03:41.070326+0000","last_clean":"2023-12-16T00:03:41.070326+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:03:41.070326+0000","last_undegraded":"2023-12-16T00:03:41.070326+0000","last_fullsized":"2023-12-16T00:03:41.070326+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'115","last_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_deep_scrub":"54'115","last_deep_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.070267+0000","objects_scrubbed":29,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.536401+0000","scrub_duration":0.016426911999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642313+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:01:35.642313+0000","last_peered":"2023-12-16T00:01:35.642313+0000","last_clean":"2023-12-16T00:01:35.642313+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:01:35.642313+0000","last_undegraded":"2023-12-16T00:01:35.642313+0000","last_fullsized":"2023-12-16T00:01:35.642313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288152+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:27.288152+0000","last_peered":"2023-12-16T00:00:27.288152+0000","last_clean":"2023-12-16T00:00:27.288152+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:27.288152+0000","last_undegraded":"2023-12-16T00:00:27.288152+0000","last_fullsized":"2023-12-16T00:00:27.288152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.873647+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:08.873647+0000","last_peered":"2023-12-16T00:01:08.873647+0000","last_clean":"2023-12-16T00:01:08.873647+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:08.873647+0000","last_undegraded":"2023-12-16T00:01:08.873647+0000","last_fullsized":"2023-12-16T00:01:08.873647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427491+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:01:45.427491+0000","last_peered":"2023-12-16T00:01:45.427491+0000","last_clean":"2023-12-16T00:01:45.427491+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:01:45.427491+0000","last_undegraded":"2023-12-16T00:01:45.427491+0000","last_fullsized":"2023-12-16T00:01:45.427491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711349+0000","last_change":"2023-12-15T22:52:55.191556+0000","last_active":"2023-12-16T00:00:27.711349+0000","last_peered":"2023-12-16T00:00:27.711349+0000","last_clean":"2023-12-16T00:00:27.711349+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:00:27.711349+0000","last_undegraded":"2023-12-16T00:00:27.711349+0000","last_fullsized":"2023-12-16T00:00:27.711349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711244+0000","last_change":"2023-12-15T22:52:53.171627+0000","last_active":"2023-12-16T00:00:27.711244+0000","last_peered":"2023-12-16T00:00:27.711244+0000","last_clean":"2023-12-16T00:00:27.711244+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:00:27.711244+0000","last_undegraded":"2023-12-16T00:00:27.711244+0000","last_fullsized":"2023-12-16T00:00:27.711244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778083+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778083+0000","last_peered":"2023-12-16T00:02:03.778083+0000","last_clean":"2023-12-16T00:02:03.778083+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778083+0000","last_undegraded":"2023-12-16T00:02:03.778083+0000","last_fullsized":"2023-12-16T00:02:03.778083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630904+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:45.630904+0000","last_peered":"2023-12-16T00:00:45.630904+0000","last_clean":"2023-12-16T00:00:45.630904+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:45.630904+0000","last_undegraded":"2023-12-16T00:00:45.630904+0000","last_fullsized":"2023-12-16T00:00:45.630904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904049+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904049+0000","last_peered":"2023-12-16T00:01:44.904049+0000","last_clean":"2023-12-16T00:01:44.904049+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904049+0000","last_undegraded":"2023-12-16T00:01:44.904049+0000","last_fullsized":"2023-12-16T00:01:44.904049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468686+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468686+0000","last_peered":"2023-12-16T00:03:22.468686+0000","last_clean":"2023-12-16T00:03:22.468686+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468686+0000","last_undegraded":"2023-12-16T00:03:22.468686+0000","last_fullsized":"2023-12-16T00:03:22.468686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244135+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244135+0000","last_peered":"2023-12-16T00:03:28.244135+0000","last_clean":"2023-12-16T00:03:28.244135+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244135+0000","last_undegraded":"2023-12-16T00:03:28.244135+0000","last_fullsized":"2023-12-16T00:03:28.244135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.884007+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:13.884007+0000","last_peered":"2023-12-16T00:01:13.884007+0000","last_clean":"2023-12-16T00:01:13.884007+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:13.884007+0000","last_undegraded":"2023-12-16T00:01:13.884007+0000","last_fullsized":"2023-12-16T00:01:13.884007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865431+0000","last_change":"2023-12-15T23:08:37.336121+0000","last_active":"2023-12-16T00:00:26.865431+0000","last_peered":"2023-12-16T00:00:26.865431+0000","last_clean":"2023-12-16T00:00:26.865431+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:00:26.865431+0000","last_undegraded":"2023-12-16T00:00:26.865431+0000","last_fullsized":"2023-12-16T00:00:26.865431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1533,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707263+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707263+0000","last_peered":"2023-12-16T00:02:10.707263+0000","last_clean":"2023-12-16T00:02:10.707263+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707263+0000","last_undegraded":"2023-12-16T00:02:10.707263+0000","last_fullsized":"2023-12-16T00:02:10.707263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051798+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051798+0000","last_peered":"2023-12-16T00:01:33.051798+0000","last_clean":"2023-12-16T00:01:33.051798+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051798+0000","last_undegraded":"2023-12-16T00:01:33.051798+0000","last_fullsized":"2023-12-16T00:01:33.051798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350554+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350554+0000","last_peered":"2023-12-16T00:03:11.350554+0000","last_clean":"2023-12-16T00:03:11.350554+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350554+0000","last_undegraded":"2023-12-16T00:03:11.350554+0000","last_fullsized":"2023-12-16T00:03:11.350554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.643603+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:01:40.643603+0000","last_peered":"2023-12-16T00:01:40.643603+0000","last_clean":"2023-12-16T00:01:40.643603+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:01:40.643603+0000","last_undegraded":"2023-12-16T00:01:40.643603+0000","last_fullsized":"2023-12-16T00:01:40.643603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461428+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461428+0000","last_peered":"2023-12-16T00:03:22.461428+0000","last_clean":"2023-12-16T00:03:22.461428+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461428+0000","last_undegraded":"2023-12-16T00:03:22.461428+0000","last_fullsized":"2023-12-16T00:03:22.461428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161228+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161228+0000","last_peered":"2023-12-16T00:03:14.161228+0000","last_clean":"2023-12-16T00:03:14.161228+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161228+0000","last_undegraded":"2023-12-16T00:03:14.161228+0000","last_fullsized":"2023-12-16T00:03:14.161228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193045+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193045+0000","last_peered":"2023-12-16T00:02:53.193045+0000","last_clean":"2023-12-16T00:02:53.193045+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193045+0000","last_undegraded":"2023-12-16T00:02:53.193045+0000","last_fullsized":"2023-12-16T00:02:53.193045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1587,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520664+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520664+0000","last_peered":"2023-12-16T00:02:25.520664+0000","last_clean":"2023-12-16T00:02:25.520664+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520664+0000","last_undegraded":"2023-12-16T00:02:25.520664+0000","last_fullsized":"2023-12-16T00:02:25.520664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410634+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:31.410634+0000","last_peered":"2023-12-16T00:01:31.410634+0000","last_clean":"2023-12-16T00:01:31.410634+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:31.410634+0000","last_undegraded":"2023-12-16T00:01:31.410634+0000","last_fullsized":"2023-12-16T00:01:31.410634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414172+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414172+0000","last_peered":"2023-12-16T00:03:17.414172+0000","last_clean":"2023-12-16T00:03:17.414172+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414172+0000","last_undegraded":"2023-12-16T00:03:17.414172+0000","last_fullsized":"2023-12-16T00:03:17.414172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412902+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:50.412902+0000","last_peered":"2023-12-16T00:00:50.412902+0000","last_clean":"2023-12-16T00:00:50.412902+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:50.412902+0000","last_undegraded":"2023-12-16T00:00:50.412902+0000","last_fullsized":"2023-12-16T00:00:50.412902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.531828+0000","last_change":"2023-12-16T00:03:41.531828+0000","last_active":"2023-12-16T00:03:41.531828+0000","last_peered":"2023-12-16T00:03:41.531828+0000","last_clean":"2023-12-16T00:03:41.531828+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:03:41.531828+0000","last_undegraded":"2023-12-16T00:03:41.531828+0000","last_fullsized":"2023-12-16T00:03:41.531828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.531720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.997854+0000","scrub_duration":0.001119472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990310+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990310+0000","last_peered":"2023-12-16T00:03:19.990310+0000","last_clean":"2023-12-16T00:03:19.990310+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990310+0000","last_undegraded":"2023-12-16T00:03:19.990310+0000","last_fullsized":"2023-12-16T00:03:19.990310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5996,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425396+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:01:35.425396+0000","last_peered":"2023-12-16T00:01:35.425396+0000","last_clean":"2023-12-16T00:01:35.425396+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:01:35.425396+0000","last_undegraded":"2023-12-16T00:01:35.425396+0000","last_fullsized":"2023-12-16T00:01:35.425396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166639+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166639+0000","last_peered":"2023-12-16T00:03:03.166639+0000","last_clean":"2023-12-16T00:03:03.166639+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166639+0000","last_undegraded":"2023-12-16T00:03:03.166639+0000","last_fullsized":"2023-12-16T00:03:03.166639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478560+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478560+0000","last_peered":"2023-12-16T00:02:02.478560+0000","last_clean":"2023-12-16T00:02:02.478560+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478560+0000","last_undegraded":"2023-12-16T00:02:02.478560+0000","last_fullsized":"2023-12-16T00:02:02.478560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.639650+0000","last_change":"2023-12-16T00:03:36.639670+0000","last_active":"2023-12-16T00:03:36.639650+0000","last_peered":"2023-12-16T00:03:36.639650+0000","last_clean":"2023-12-16T00:03:36.639650+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:03:36.639650+0000","last_undegraded":"2023-12-16T00:03:36.639650+0000","last_fullsized":"2023-12-16T00:03:36.639650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.639584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:26.898631+0000","scrub_duration":0.0012042960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.612164+0000","last_change":"2023-12-16T00:03:31.612184+0000","last_active":"2023-12-16T00:03:31.612164+0000","last_peered":"2023-12-16T00:03:31.612164+0000","last_clean":"2023-12-16T00:03:31.612164+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:03:31.612164+0000","last_undegraded":"2023-12-16T00:03:31.612164+0000","last_fullsized":"2023-12-16T00:03:31.612164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.612104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:55.639396+0000","scrub_duration":0.001020881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635206+0000","last_change":"2023-12-15T22:52:53.172731+0000","last_active":"2023-12-16T00:01:05.635206+0000","last_peered":"2023-12-16T00:01:05.635206+0000","last_clean":"2023-12-16T00:01:05.635206+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:01:05.635206+0000","last_undegraded":"2023-12-16T00:01:05.635206+0000","last_fullsized":"2023-12-16T00:01:05.635206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.173986+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.173986+0000","last_peered":"2023-12-16T00:02:51.173986+0000","last_clean":"2023-12-16T00:02:51.173986+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.173986+0000","last_undegraded":"2023-12-16T00:02:51.173986+0000","last_fullsized":"2023-12-16T00:02:51.173986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130516+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130516+0000","last_peered":"2023-12-16T00:01:57.130516+0000","last_clean":"2023-12-16T00:01:57.130516+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130516+0000","last_undegraded":"2023-12-16T00:01:57.130516+0000","last_fullsized":"2023-12-16T00:01:57.130516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712554+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:27.712554+0000","last_peered":"2023-12-16T00:00:27.712554+0000","last_clean":"2023-12-16T00:00:27.712554+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:27.712554+0000","last_undegraded":"2023-12-16T00:00:27.712554+0000","last_fullsized":"2023-12-16T00:00:27.712554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425033+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:01:35.425033+0000","last_peered":"2023-12-16T00:01:35.425033+0000","last_clean":"2023-12-16T00:01:35.425033+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:01:35.425033+0000","last_undegraded":"2023-12-16T00:01:35.425033+0000","last_fullsized":"2023-12-16T00:01:35.425033+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160204+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160204+0000","last_peered":"2023-12-16T00:02:44.160204+0000","last_clean":"2023-12-16T00:02:44.160204+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160204+0000","last_undegraded":"2023-12-16T00:02:44.160204+0000","last_fullsized":"2023-12-16T00:02:44.160204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015799+0000","last_change":"2023-12-15T22:52:55.191435+0000","last_active":"2023-12-16T00:00:26.015799+0000","last_peered":"2023-12-16T00:00:26.015799+0000","last_clean":"2023-12-16T00:00:26.015799+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:00:26.015799+0000","last_undegraded":"2023-12-16T00:00:26.015799+0000","last_fullsized":"2023-12-16T00:00:26.015799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633202+0000","last_change":"2023-12-15T22:52:07.603240+0000","last_active":"2023-12-16T00:00:55.633202+0000","last_peered":"2023-12-16T00:00:55.633202+0000","last_clean":"2023-12-16T00:00:55.633202+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:00:55.633202+0000","last_undegraded":"2023-12-16T00:00:55.633202+0000","last_fullsized":"2023-12-16T00:00:55.633202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.425967+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:01:40.425967+0000","last_peered":"2023-12-16T00:01:40.425967+0000","last_clean":"2023-12-16T00:01:40.425967+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:01:40.425967+0000","last_undegraded":"2023-12-16T00:01:40.425967+0000","last_fullsized":"2023-12-16T00:01:40.425967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152518+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152518+0000","last_peered":"2023-12-16T00:03:24.152518+0000","last_clean":"2023-12-16T00:03:24.152518+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152518+0000","last_undegraded":"2023-12-16T00:03:24.152518+0000","last_fullsized":"2023-12-16T00:03:24.152518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":990,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196219+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196219+0000","last_peered":"2023-12-16T00:02:25.196219+0000","last_clean":"2023-12-16T00:02:25.196219+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196219+0000","last_undegraded":"2023-12-16T00:02:25.196219+0000","last_fullsized":"2023-12-16T00:02:25.196219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.398854+0000","last_change":"2023-12-15T23:08:37.339807+0000","last_active":"2023-12-16T00:00:50.398854+0000","last_peered":"2023-12-16T00:00:50.398854+0000","last_clean":"2023-12-16T00:00:50.398854+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:00:50.398854+0000","last_undegraded":"2023-12-16T00:00:50.398854+0000","last_fullsized":"2023-12-16T00:00:50.398854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1298,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966553+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966553+0000","last_peered":"2023-12-16T00:03:18.966553+0000","last_clean":"2023-12-16T00:03:18.966553+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966553+0000","last_undegraded":"2023-12-16T00:03:18.966553+0000","last_fullsized":"2023-12-16T00:03:18.966553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464112+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464112+0000","last_peered":"2023-12-16T00:03:25.464112+0000","last_clean":"2023-12-16T00:03:25.464112+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464112+0000","last_undegraded":"2023-12-16T00:03:25.464112+0000","last_fullsized":"2023-12-16T00:03:25.464112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633270+0000","last_change":"2023-12-15T22:52:07.607303+0000","last_active":"2023-12-16T00:00:55.633270+0000","last_peered":"2023-12-16T00:00:55.633270+0000","last_clean":"2023-12-16T00:00:55.633270+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:00:55.633270+0000","last_undegraded":"2023-12-16T00:00:55.633270+0000","last_fullsized":"2023-12-16T00:00:55.633270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529727+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529727+0000","last_peered":"2023-12-16T00:02:53.529727+0000","last_clean":"2023-12-16T00:02:53.529727+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529727+0000","last_undegraded":"2023-12-16T00:02:53.529727+0000","last_fullsized":"2023-12-16T00:02:53.529727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662975+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662975+0000","last_peered":"2023-12-16T00:02:16.662975+0000","last_clean":"2023-12-16T00:02:16.662975+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662975+0000","last_undegraded":"2023-12-16T00:02:16.662975+0000","last_fullsized":"2023-12-16T00:02:16.662975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865369+0000","last_change":"2023-12-15T23:08:37.342688+0000","last_active":"2023-12-16T00:00:26.865369+0000","last_peered":"2023-12-16T00:00:26.865369+0000","last_clean":"2023-12-16T00:00:26.865369+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:00:26.865369+0000","last_undegraded":"2023-12-16T00:00:26.865369+0000","last_fullsized":"2023-12-16T00:00:26.865369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5951,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323807+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323807+0000","last_peered":"2023-12-16T00:03:09.323807+0000","last_clean":"2023-12-16T00:03:09.323807+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323807+0000","last_undegraded":"2023-12-16T00:03:09.323807+0000","last_fullsized":"2023-12-16T00:03:09.323807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855239+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855239+0000","last_peered":"2023-12-16T00:03:23.855239+0000","last_clean":"2023-12-16T00:03:23.855239+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855239+0000","last_undegraded":"2023-12-16T00:03:23.855239+0000","last_fullsized":"2023-12-16T00:03:23.855239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.233208+0000","last_change":"2023-12-16T00:03:41.233244+0000","last_active":"2023-12-16T00:03:41.233208+0000","last_peered":"2023-12-16T00:03:41.233208+0000","last_clean":"2023-12-16T00:03:41.233208+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:03:41.233208+0000","last_undegraded":"2023-12-16T00:03:41.233208+0000","last_fullsized":"2023-12-16T00:03:41.233208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.233146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:29.219613+0000","scrub_duration":0.00094526300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.537375+0000","last_change":"2023-12-16T00:03:35.537411+0000","last_active":"2023-12-16T00:03:35.537375+0000","last_peered":"2023-12-16T00:03:35.537375+0000","last_clean":"2023-12-16T00:03:35.537375+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:03:35.537375+0000","last_undegraded":"2023-12-16T00:03:35.537375+0000","last_fullsized":"2023-12-16T00:03:35.537375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.537285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:54.142352+0000","scrub_duration":0.0011419679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335082+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335082+0000","last_peered":"2023-12-16T00:03:07.335082+0000","last_clean":"2023-12-16T00:03:07.335082+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335082+0000","last_undegraded":"2023-12-16T00:03:07.335082+0000","last_fullsized":"2023-12-16T00:03:07.335082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453503+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453503+0000","last_peered":"2023-12-16T00:02:34.453503+0000","last_clean":"2023-12-16T00:02:34.453503+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453503+0000","last_undegraded":"2023-12-16T00:02:34.453503+0000","last_fullsized":"2023-12-16T00:02:34.453503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116738+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116738+0000","last_peered":"2023-12-16T00:02:44.116738+0000","last_clean":"2023-12-16T00:02:44.116738+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116738+0000","last_undegraded":"2023-12-16T00:02:44.116738+0000","last_fullsized":"2023-12-16T00:02:44.116738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.396040+0000","last_change":"2023-12-15T23:08:37.337865+0000","last_active":"2023-12-16T00:00:40.396040+0000","last_peered":"2023-12-16T00:00:40.396040+0000","last_clean":"2023-12-16T00:00:40.396040+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:00:40.396040+0000","last_undegraded":"2023-12-16T00:00:40.396040+0000","last_fullsized":"2023-12-16T00:00:40.396040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629219+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629219+0000","last_peered":"2023-12-16T00:01:50.629219+0000","last_clean":"2023-12-16T00:01:50.629219+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629219+0000","last_undegraded":"2023-12-16T00:01:50.629219+0000","last_fullsized":"2023-12-16T00:01:50.629219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.896996+0000","last_change":"2023-12-16T00:03:35.896996+0000","last_active":"2023-12-16T00:03:35.896996+0000","last_peered":"2023-12-16T00:03:35.896996+0000","last_clean":"2023-12-16T00:03:35.896996+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:03:35.896996+0000","last_undegraded":"2023-12-16T00:03:35.896996+0000","last_fullsized":"2023-12-16T00:03:35.896996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.896905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.496966+0000","scrub_duration":0.0014309380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.643802+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:01:40.643802+0000","last_peered":"2023-12-16T00:01:40.643802+0000","last_clean":"2023-12-16T00:01:40.643802+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:01:40.643802+0000","last_undegraded":"2023-12-16T00:01:40.643802+0000","last_fullsized":"2023-12-16T00:01:40.643802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.423013+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:01:25.423013+0000","last_peered":"2023-12-16T00:01:25.423013+0000","last_clean":"2023-12-16T00:01:25.423013+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:01:25.423013+0000","last_undegraded":"2023-12-16T00:01:25.423013+0000","last_fullsized":"2023-12-16T00:01:25.423013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.079300+0000","last_change":"2023-12-16T00:03:38.079336+0000","last_active":"2023-12-16T00:03:38.079300+0000","last_peered":"2023-12-16T00:03:38.079300+0000","last_clean":"2023-12-16T00:03:38.079300+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:03:38.079300+0000","last_undegraded":"2023-12-16T00:03:38.079300+0000","last_fullsized":"2023-12-16T00:03:38.079300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.079227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:55.382772+0000","scrub_duration":0.0013798949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.355963+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.355963+0000","last_peered":"2023-12-16T00:02:33.355963+0000","last_clean":"2023-12-16T00:02:33.355963+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.355963+0000","last_undegraded":"2023-12-16T00:02:33.355963+0000","last_fullsized":"2023-12-16T00:02:33.355963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396540+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396540+0000","last_peered":"2023-12-16T00:01:59.396540+0000","last_clean":"2023-12-16T00:01:59.396540+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396540+0000","last_undegraded":"2023-12-16T00:01:59.396540+0000","last_fullsized":"2023-12-16T00:01:59.396540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.553856+0000","last_change":"2023-12-16T00:03:33.553856+0000","last_active":"2023-12-16T00:03:33.553856+0000","last_peered":"2023-12-16T00:03:33.553856+0000","last_clean":"2023-12-16T00:03:33.553856+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:03:33.553856+0000","last_undegraded":"2023-12-16T00:03:33.553856+0000","last_fullsized":"2023-12-16T00:03:33.553856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.553765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:14.335435+0000","scrub_duration":0.001373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136301+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:00:28.136301+0000","last_peered":"2023-12-16T00:00:28.136301+0000","last_clean":"2023-12-16T00:00:28.136301+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:00:28.136301+0000","last_undegraded":"2023-12-16T00:00:28.136301+0000","last_fullsized":"2023-12-16T00:00:28.136301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.424239+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:01:30.424239+0000","last_peered":"2023-12-16T00:01:30.424239+0000","last_clean":"2023-12-16T00:01:30.424239+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:01:30.424239+0000","last_undegraded":"2023-12-16T00:01:30.424239+0000","last_fullsized":"2023-12-16T00:01:30.424239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968135+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968135+0000","last_peered":"2023-12-16T00:03:15.968135+0000","last_clean":"2023-12-16T00:03:15.968135+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968135+0000","last_undegraded":"2023-12-16T00:03:15.968135+0000","last_fullsized":"2023-12-16T00:03:15.968135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561074+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561074+0000","last_peered":"2023-12-16T00:02:30.561074+0000","last_clean":"2023-12-16T00:02:30.561074+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561074+0000","last_undegraded":"2023-12-16T00:02:30.561074+0000","last_fullsized":"2023-12-16T00:02:30.561074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112882+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112882+0000","last_peered":"2023-12-16T00:02:08.112882+0000","last_clean":"2023-12-16T00:02:08.112882+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112882+0000","last_undegraded":"2023-12-16T00:02:08.112882+0000","last_fullsized":"2023-12-16T00:02:08.112882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":188,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426386+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:01:40.426386+0000","last_peered":"2023-12-16T00:01:40.426386+0000","last_clean":"2023-12-16T00:01:40.426386+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:01:40.426386+0000","last_undegraded":"2023-12-16T00:01:40.426386+0000","last_fullsized":"2023-12-16T00:01:40.426386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.279354+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:22.279354+0000","last_peered":"2023-12-16T00:01:22.279354+0000","last_clean":"2023-12-16T00:01:22.279354+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:22.279354+0000","last_undegraded":"2023-12-16T00:01:22.279354+0000","last_fullsized":"2023-12-16T00:01:22.279354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.413067+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:50.413067+0000","last_peered":"2023-12-16T00:00:50.413067+0000","last_clean":"2023-12-16T00:00:50.413067+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:50.413067+0000","last_undegraded":"2023-12-16T00:00:50.413067+0000","last_fullsized":"2023-12-16T00:00:50.413067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'66","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.166815+0000","last_change":"2023-12-16T00:03:47.166869+0000","last_active":"2023-12-16T00:03:47.166815+0000","last_peered":"2023-12-16T00:03:47.166815+0000","last_clean":"2023-12-16T00:03:47.166815+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:03:47.166815+0000","last_undegraded":"2023-12-16T00:03:47.166815+0000","last_fullsized":"2023-12-16T00:03:47.166815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.166746+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:27.979063+0000","scrub_duration":0.003753653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6517,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437404+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437404+0000","last_peered":"2023-12-16T00:02:40.437404+0000","last_clean":"2023-12-16T00:02:40.437404+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437404+0000","last_undegraded":"2023-12-16T00:02:40.437404+0000","last_fullsized":"2023-12-16T00:02:40.437404+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":57,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.805839+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:25.805839+0000","last_peered":"2023-12-16T00:01:25.805839+0000","last_clean":"2023-12-16T00:01:25.805839+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:25.805839+0000","last_undegraded":"2023-12-16T00:01:25.805839+0000","last_fullsized":"2023-12-16T00:01:25.805839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562947+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562947+0000","last_peered":"2023-12-16T00:02:45.562947+0000","last_clean":"2023-12-16T00:02:45.562947+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562947+0000","last_undegraded":"2023-12-16T00:02:45.562947+0000","last_fullsized":"2023-12-16T00:02:45.562947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.563416+0000","last_change":"2023-12-16T00:03:44.563437+0000","last_active":"2023-12-16T00:03:44.563416+0000","last_peered":"2023-12-16T00:03:44.563416+0000","last_clean":"2023-12-16T00:03:44.563416+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:03:44.563416+0000","last_undegraded":"2023-12-16T00:03:44.563416+0000","last_fullsized":"2023-12-16T00:03:44.563416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.563348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:00:12.730238+0000","scrub_duration":0.0015157739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.357363+0000","last_change":"2023-12-16T00:03:33.357383+0000","last_active":"2023-12-16T00:03:33.357363+0000","last_peered":"2023-12-16T00:03:33.357363+0000","last_clean":"2023-12-16T00:03:33.357363+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:03:33.357363+0000","last_undegraded":"2023-12-16T00:03:33.357363+0000","last_fullsized":"2023-12-16T00:03:33.357363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.357294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:08.995610+0000","scrub_duration":0.0012151390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418581+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:01:10.418581+0000","last_peered":"2023-12-16T00:01:10.418581+0000","last_clean":"2023-12-16T00:01:10.418581+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:01:10.418581+0000","last_undegraded":"2023-12-16T00:01:10.418581+0000","last_fullsized":"2023-12-16T00:01:10.418581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440820+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:00:26.440820+0000","last_peered":"2023-12-16T00:00:26.440820+0000","last_clean":"2023-12-16T00:00:26.440820+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:00:26.440820+0000","last_undegraded":"2023-12-16T00:00:26.440820+0000","last_fullsized":"2023-12-16T00:00:26.440820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168046+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168046+0000","last_peered":"2023-12-16T00:02:06.168046+0000","last_clean":"2023-12-16T00:02:06.168046+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168046+0000","last_undegraded":"2023-12-16T00:02:06.168046+0000","last_fullsized":"2023-12-16T00:02:06.168046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169539+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169539+0000","last_peered":"2023-12-16T00:02:23.169539+0000","last_clean":"2023-12-16T00:02:23.169539+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169539+0000","last_undegraded":"2023-12-16T00:02:23.169539+0000","last_fullsized":"2023-12-16T00:02:23.169539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.428078+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:45.428078+0000","last_peered":"2023-12-16T00:01:45.428078+0000","last_clean":"2023-12-16T00:01:45.428078+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:45.428078+0000","last_undegraded":"2023-12-16T00:01:45.428078+0000","last_fullsized":"2023-12-16T00:01:45.428078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.024920+0000","last_change":"2023-12-16T00:03:46.024939+0000","last_active":"2023-12-16T00:03:46.024920+0000","last_peered":"2023-12-16T00:03:46.024920+0000","last_clean":"2023-12-16T00:03:46.024920+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:03:46.024920+0000","last_undegraded":"2023-12-16T00:03:46.024920+0000","last_fullsized":"2023-12-16T00:03:46.024920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.024856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:58.107273+0000","scrub_duration":0.00094653599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418706+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:01:10.418706+0000","last_peered":"2023-12-16T00:01:10.418706+0000","last_clean":"2023-12-16T00:01:10.418706+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:01:10.418706+0000","last_undegraded":"2023-12-16T00:01:10.418706+0000","last_fullsized":"2023-12-16T00:01:10.418706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007813+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007813+0000","last_peered":"2023-12-16T00:01:36.007813+0000","last_clean":"2023-12-16T00:01:36.007813+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007813+0000","last_undegraded":"2023-12-16T00:01:36.007813+0000","last_fullsized":"2023-12-16T00:01:36.007813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427580+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:01:45.427580+0000","last_peered":"2023-12-16T00:01:45.427580+0000","last_clean":"2023-12-16T00:01:45.427580+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:01:45.427580+0000","last_undegraded":"2023-12-16T00:01:45.427580+0000","last_fullsized":"2023-12-16T00:01:45.427580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.604810+0000","last_change":"2023-12-16T00:03:38.604829+0000","last_active":"2023-12-16T00:03:38.604810+0000","last_peered":"2023-12-16T00:03:38.604810+0000","last_clean":"2023-12-16T00:03:38.604810+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:03:38.604810+0000","last_undegraded":"2023-12-16T00:03:38.604810+0000","last_fullsized":"2023-12-16T00:03:38.604810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.604746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:35.411237+0000","scrub_duration":0.001128876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408854+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:35.408854+0000","last_peered":"2023-12-16T00:00:35.408854+0000","last_clean":"2023-12-16T00:00:35.408854+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:35.408854+0000","last_undegraded":"2023-12-16T00:00:35.408854+0000","last_fullsized":"2023-12-16T00:00:35.408854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3203,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385103+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385103+0000","last_peered":"2023-12-16T00:02:50.385103+0000","last_clean":"2023-12-16T00:02:50.385103+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385103+0000","last_undegraded":"2023-12-16T00:02:50.385103+0000","last_fullsized":"2023-12-16T00:02:50.385103+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088942+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088942+0000","last_peered":"2023-12-16T00:02:04.088942+0000","last_clean":"2023-12-16T00:02:04.088942+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088942+0000","last_undegraded":"2023-12-16T00:02:04.088942+0000","last_fullsized":"2023-12-16T00:02:04.088942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823346+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823346+0000","last_peered":"2023-12-16T00:01:16.823346+0000","last_clean":"2023-12-16T00:01:16.823346+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823346+0000","last_undegraded":"2023-12-16T00:01:16.823346+0000","last_fullsized":"2023-12-16T00:01:16.823346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.427328+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:01:40.427328+0000","last_peered":"2023-12-16T00:01:40.427328+0000","last_clean":"2023-12-16T00:01:40.427328+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:01:40.427328+0000","last_undegraded":"2023-12-16T00:01:40.427328+0000","last_fullsized":"2023-12-16T00:01:40.427328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:40.253850+0000","last_change":"2023-12-16T00:03:40.253871+0000","last_active":"2023-12-16T00:03:40.253850+0000","last_peered":"2023-12-16T00:03:40.253850+0000","last_clean":"2023-12-16T00:03:40.253850+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:03:40.253850+0000","last_undegraded":"2023-12-16T00:03:40.253850+0000","last_fullsized":"2023-12-16T00:03:40.253850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_clean_scrub_stamp":"2023-12-16T00:03:40.253770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:14:18.023218+0000","scrub_duration":0.00092796800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202172+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202172+0000","last_peered":"2023-12-16T00:02:33.202172+0000","last_clean":"2023-12-16T00:02:33.202172+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202172+0000","last_undegraded":"2023-12-16T00:02:33.202172+0000","last_fullsized":"2023-12-16T00:02:33.202172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360912+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360912+0000","last_peered":"2023-12-16T00:02:21.360912+0000","last_clean":"2023-12-16T00:02:21.360912+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360912+0000","last_undegraded":"2023-12-16T00:02:21.360912+0000","last_fullsized":"2023-12-16T00:02:21.360912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979291+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979291+0000","last_peered":"2023-12-16T00:03:26.979291+0000","last_clean":"2023-12-16T00:03:26.979291+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979291+0000","last_undegraded":"2023-12-16T00:03:26.979291+0000","last_fullsized":"2023-12-16T00:03:26.979291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630543+0000","last_change":"2023-12-15T22:52:53.169349+0000","last_active":"2023-12-16T00:00:45.630543+0000","last_peered":"2023-12-16T00:00:45.630543+0000","last_clean":"2023-12-16T00:00:45.630543+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:00:45.630543+0000","last_undegraded":"2023-12-16T00:00:45.630543+0000","last_fullsized":"2023-12-16T00:00:45.630543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":563,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377221+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377221+0000","last_peered":"2023-12-16T00:02:58.377221+0000","last_clean":"2023-12-16T00:02:58.377221+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377221+0000","last_undegraded":"2023-12-16T00:02:58.377221+0000","last_fullsized":"2023-12-16T00:02:58.377221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1373,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.404974+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.404974+0000","last_peered":"2023-12-16T00:03:09.404974+0000","last_clean":"2023-12-16T00:03:09.404974+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.404974+0000","last_undegraded":"2023-12-16T00:03:09.404974+0000","last_fullsized":"2023-12-16T00:03:09.404974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273204+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273204+0000","last_peered":"2023-12-16T00:02:14.273204+0000","last_clean":"2023-12-16T00:02:14.273204+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273204+0000","last_undegraded":"2023-12-16T00:02:14.273204+0000","last_fullsized":"2023-12-16T00:02:14.273204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015840+0000","last_change":"2023-12-15T22:52:55.189817+0000","last_active":"2023-12-16T00:00:26.015840+0000","last_peered":"2023-12-16T00:00:26.015840+0000","last_clean":"2023-12-16T00:00:26.015840+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:00:26.015840+0000","last_undegraded":"2023-12-16T00:00:26.015840+0000","last_fullsized":"2023-12-16T00:00:26.015840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.602939+0000","last_change":"2023-12-16T00:03:44.602959+0000","last_active":"2023-12-16T00:03:44.602939+0000","last_peered":"2023-12-16T00:03:44.602939+0000","last_clean":"2023-12-16T00:03:44.602939+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:03:44.602939+0000","last_undegraded":"2023-12-16T00:03:44.602939+0000","last_fullsized":"2023-12-16T00:03:44.602939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.602862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:59.899408+0000","scrub_duration":0.0010205100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624495+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624495+0000","last_peered":"2023-12-16T00:02:24.624495+0000","last_clean":"2023-12-16T00:02:24.624495+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624495+0000","last_undegraded":"2023-12-16T00:02:24.624495+0000","last_fullsized":"2023-12-16T00:02:24.624495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3898,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200859+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200859+0000","last_peered":"2023-12-16T00:02:19.200859+0000","last_clean":"2023-12-16T00:02:19.200859+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200859+0000","last_undegraded":"2023-12-16T00:02:19.200859+0000","last_fullsized":"2023-12-16T00:02:19.200859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.824418+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:20.824418+0000","last_peered":"2023-12-16T00:01:20.824418+0000","last_clean":"2023-12-16T00:01:20.824418+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:20.824418+0000","last_undegraded":"2023-12-16T00:01:20.824418+0000","last_fullsized":"2023-12-16T00:01:20.824418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339052+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339052+0000","last_peered":"2023-12-16T00:02:29.339052+0000","last_clean":"2023-12-16T00:02:29.339052+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339052+0000","last_undegraded":"2023-12-16T00:02:29.339052+0000","last_fullsized":"2023-12-16T00:02:29.339052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015647+0000","last_change":"2023-12-15T22:52:53.177544+0000","last_active":"2023-12-16T00:00:26.015647+0000","last_peered":"2023-12-16T00:00:26.015647+0000","last_clean":"2023-12-16T00:00:26.015647+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:00:26.015647+0000","last_undegraded":"2023-12-16T00:00:26.015647+0000","last_fullsized":"2023-12-16T00:00:26.015647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119101+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119101+0000","last_peered":"2023-12-16T00:02:43.119101+0000","last_clean":"2023-12-16T00:02:43.119101+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119101+0000","last_undegraded":"2023-12-16T00:02:43.119101+0000","last_fullsized":"2023-12-16T00:02:43.119101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.803834+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:41.803834+0000","last_peered":"2023-12-16T00:01:41.803834+0000","last_clean":"2023-12-16T00:01:41.803834+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:41.803834+0000","last_undegraded":"2023-12-16T00:01:41.803834+0000","last_fullsized":"2023-12-16T00:01:41.803834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092050+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092050+0000","last_peered":"2023-12-16T00:02:06.092050+0000","last_clean":"2023-12-16T00:02:06.092050+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092050+0000","last_undegraded":"2023-12-16T00:02:06.092050+0000","last_fullsized":"2023-12-16T00:02:06.092050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059457+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059457+0000","last_peered":"2023-12-16T00:01:32.059457+0000","last_clean":"2023-12-16T00:01:32.059457+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059457+0000","last_undegraded":"2023-12-16T00:01:32.059457+0000","last_fullsized":"2023-12-16T00:01:32.059457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1519,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513307+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513307+0000","last_peered":"2023-12-16T00:02:15.513307+0000","last_clean":"2023-12-16T00:02:15.513307+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513307+0000","last_undegraded":"2023-12-16T00:02:15.513307+0000","last_fullsized":"2023-12-16T00:02:15.513307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418257+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:01:10.418257+0000","last_peered":"2023-12-16T00:01:10.418257+0000","last_clean":"2023-12-16T00:01:10.418257+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:01:10.418257+0000","last_undegraded":"2023-12-16T00:01:10.418257+0000","last_fullsized":"2023-12-16T00:01:10.418257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136426+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:28.136426+0000","last_peered":"2023-12-16T00:00:28.136426+0000","last_clean":"2023-12-16T00:00:28.136426+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:28.136426+0000","last_undegraded":"2023-12-16T00:00:28.136426+0000","last_fullsized":"2023-12-16T00:00:28.136426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'7","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:36.396819+0000","last_change":"2023-12-15T22:53:04.321481+0000","last_active":"2023-12-16T00:00:36.396819+0000","last_peered":"2023-12-16T00:00:36.396819+0000","last_clean":"2023-12-16T00:00:36.396819+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:00:36.396819+0000","last_undegraded":"2023-12-16T00:00:36.396819+0000","last_fullsized":"2023-12-16T00:00:36.396819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.865424+0000","last_change":"2023-12-15T23:08:37.341174+0000","last_active":"2023-12-16T00:00:26.865424+0000","last_peered":"2023-12-16T00:00:26.865424+0000","last_clean":"2023-12-16T00:00:26.865424+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:00:26.865424+0000","last_undegraded":"2023-12-16T00:00:26.865424+0000","last_fullsized":"2023-12-16T00:00:26.865424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4020,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440729+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:00:26.440729+0000","last_peered":"2023-12-16T00:00:26.440729+0000","last_clean":"2023-12-16T00:00:26.440729+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:00:26.440729+0000","last_undegraded":"2023-12-16T00:00:26.440729+0000","last_fullsized":"2023-12-16T00:00:26.440729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188451+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188451+0000","last_peered":"2023-12-16T00:03:12.188451+0000","last_clean":"2023-12-16T00:03:12.188451+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188451+0000","last_undegraded":"2023-12-16T00:03:12.188451+0000","last_fullsized":"2023-12-16T00:03:12.188451+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246193+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246193+0000","last_peered":"2023-12-16T00:01:50.246193+0000","last_clean":"2023-12-16T00:01:50.246193+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246193+0000","last_undegraded":"2023-12-16T00:01:50.246193+0000","last_fullsized":"2023-12-16T00:01:50.246193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.930016+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.930016+0000","last_peered":"2023-12-16T00:01:26.930016+0000","last_clean":"2023-12-16T00:01:26.930016+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.930016+0000","last_undegraded":"2023-12-16T00:01:26.930016+0000","last_fullsized":"2023-12-16T00:01:26.930016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986569+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986569+0000","last_peered":"2023-12-16T00:01:56.986569+0000","last_clean":"2023-12-16T00:01:56.986569+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986569+0000","last_undegraded":"2023-12-16T00:01:56.986569+0000","last_fullsized":"2023-12-16T00:01:56.986569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'2","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.711913+0000","last_change":"2023-12-15T22:55:02.191451+0000","last_active":"2023-12-16T00:00:27.711913+0000","last_peered":"2023-12-16T00:00:27.711913+0000","last_clean":"2023-12-16T00:00:27.711913+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:00:27.711913+0000","last_undegraded":"2023-12-16T00:00:27.711913+0000","last_fullsized":"2023-12-16T00:00:27.711913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136417+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:28.136417+0000","last_peered":"2023-12-16T00:00:28.136417+0000","last_clean":"2023-12-16T00:00:28.136417+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:28.136417+0000","last_undegraded":"2023-12-16T00:00:28.136417+0000","last_fullsized":"2023-12-16T00:00:28.136417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.193570+0000","last_change":"2023-12-16T00:03:34.193596+0000","last_active":"2023-12-16T00:03:34.193570+0000","last_peered":"2023-12-16T00:03:34.193570+0000","last_clean":"2023-12-16T00:03:34.193570+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:03:34.193570+0000","last_undegraded":"2023-12-16T00:03:34.193570+0000","last_fullsized":"2023-12-16T00:03:34.193570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.193509+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:52.798577+0000","scrub_duration":0.0029407489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3684,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689717+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689717+0000","last_peered":"2023-12-16T00:02:12.689717+0000","last_clean":"2023-12-16T00:02:12.689717+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689717+0000","last_undegraded":"2023-12-16T00:02:12.689717+0000","last_fullsized":"2023-12-16T00:02:12.689717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925849+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925849+0000","last_peered":"2023-12-16T00:01:40.925849+0000","last_clean":"2023-12-16T00:01:40.925849+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925849+0000","last_undegraded":"2023-12-16T00:01:40.925849+0000","last_fullsized":"2023-12-16T00:01:40.925849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296944+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296944+0000","last_peered":"2023-12-16T00:02:30.296944+0000","last_clean":"2023-12-16T00:02:30.296944+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296944+0000","last_undegraded":"2023-12-16T00:02:30.296944+0000","last_fullsized":"2023-12-16T00:02:30.296944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892789+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892789+0000","last_peered":"2023-12-16T00:01:49.892789+0000","last_clean":"2023-12-16T00:01:49.892789+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892789+0000","last_undegraded":"2023-12-16T00:01:49.892789+0000","last_fullsized":"2023-12-16T00:01:49.892789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":271,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038804+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038804+0000","last_peered":"2023-12-16T00:01:16.038804+0000","last_clean":"2023-12-16T00:01:16.038804+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038804+0000","last_undegraded":"2023-12-16T00:01:16.038804+0000","last_fullsized":"2023-12-16T00:01:16.038804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.637722+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:01:15.637722+0000","last_peered":"2023-12-16T00:01:15.637722+0000","last_clean":"2023-12-16T00:01:15.637722+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:01:15.637722+0000","last_undegraded":"2023-12-16T00:01:15.637722+0000","last_fullsized":"2023-12-16T00:01:15.637722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.009023+0000","last_change":"2023-12-16T00:03:47.009044+0000","last_active":"2023-12-16T00:03:47.009023+0000","last_peered":"2023-12-16T00:03:47.009023+0000","last_clean":"2023-12-16T00:03:47.009023+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:03:47.009023+0000","last_undegraded":"2023-12-16T00:03:47.009023+0000","last_fullsized":"2023-12-16T00:03:47.009023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.008959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:38:54.378679+0000","scrub_duration":0.00088682099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.212154+0000","last_change":"2023-12-16T00:03:36.212174+0000","last_active":"2023-12-16T00:03:36.212154+0000","last_peered":"2023-12-16T00:03:36.212154+0000","last_clean":"2023-12-16T00:03:36.212154+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:03:36.212154+0000","last_undegraded":"2023-12-16T00:03:36.212154+0000","last_fullsized":"2023-12-16T00:03:36.212154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.212089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:43.729491+0000","scrub_duration":0.0014192359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1322,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656778+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656778+0000","last_peered":"2023-12-16T00:02:04.656778+0000","last_clean":"2023-12-16T00:02:04.656778+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656778+0000","last_undegraded":"2023-12-16T00:02:04.656778+0000","last_fullsized":"2023-12-16T00:02:04.656778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993659+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993659+0000","last_peered":"2023-12-16T00:01:57.993659+0000","last_clean":"2023-12-16T00:01:57.993659+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993659+0000","last_undegraded":"2023-12-16T00:01:57.993659+0000","last_fullsized":"2023-12-16T00:01:57.993659+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020629+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020629+0000","last_peered":"2023-12-16T00:02:10.020629+0000","last_clean":"2023-12-16T00:02:10.020629+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020629+0000","last_undegraded":"2023-12-16T00:02:10.020629+0000","last_fullsized":"2023-12-16T00:02:10.020629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237522+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237522+0000","last_peered":"2023-12-16T00:02:34.237522+0000","last_clean":"2023-12-16T00:02:34.237522+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237522+0000","last_undegraded":"2023-12-16T00:02:34.237522+0000","last_fullsized":"2023-12-16T00:02:34.237522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":400,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418894+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:01:10.418894+0000","last_peered":"2023-12-16T00:01:10.418894+0000","last_clean":"2023-12-16T00:01:10.418894+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:01:10.418894+0000","last_undegraded":"2023-12-16T00:01:10.418894+0000","last_fullsized":"2023-12-16T00:01:10.418894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408217+0000","last_change":"2023-12-15T22:52:55.185262+0000","last_active":"2023-12-16T00:00:35.408217+0000","last_peered":"2023-12-16T00:00:35.408217+0000","last_clean":"2023-12-16T00:00:35.408217+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:00:35.408217+0000","last_undegraded":"2023-12-16T00:00:35.408217+0000","last_fullsized":"2023-12-16T00:00:35.408217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426518+0000","last_change":"2023-12-15T22:52:53.174724+0000","last_active":"2023-12-16T00:01:40.426518+0000","last_peered":"2023-12-16T00:01:40.426518+0000","last_clean":"2023-12-16T00:01:40.426518+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:01:40.426518+0000","last_undegraded":"2023-12-16T00:01:40.426518+0000","last_fullsized":"2023-12-16T00:01:40.426518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483652+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483652+0000","last_peered":"2023-12-16T00:03:15.483652+0000","last_clean":"2023-12-16T00:03:15.483652+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483652+0000","last_undegraded":"2023-12-16T00:03:15.483652+0000","last_fullsized":"2023-12-16T00:03:15.483652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425544+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425544+0000","last_peered":"2023-12-16T00:03:09.425544+0000","last_clean":"2023-12-16T00:03:09.425544+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425544+0000","last_undegraded":"2023-12-16T00:03:09.425544+0000","last_fullsized":"2023-12-16T00:03:09.425544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374415+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374415+0000","last_peered":"2023-12-16T00:03:18.374415+0000","last_clean":"2023-12-16T00:03:18.374415+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374415+0000","last_undegraded":"2023-12-16T00:03:18.374415+0000","last_fullsized":"2023-12-16T00:03:18.374415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183034+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183034+0000","last_peered":"2023-12-16T00:03:26.183034+0000","last_clean":"2023-12-16T00:03:26.183034+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183034+0000","last_undegraded":"2023-12-16T00:03:26.183034+0000","last_fullsized":"2023-12-16T00:03:26.183034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439745+0000","last_change":"2023-12-15T22:53:01.291644+0000","last_active":"2023-12-16T00:00:26.439745+0000","last_peered":"2023-12-16T00:00:26.439745+0000","last_clean":"2023-12-16T00:00:26.439745+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:00:26.439745+0000","last_undegraded":"2023-12-16T00:00:26.439745+0000","last_fullsized":"2023-12-16T00:00:26.439745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605022+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605022+0000","last_peered":"2023-12-16T00:03:27.605022+0000","last_clean":"2023-12-16T00:03:27.605022+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605022+0000","last_undegraded":"2023-12-16T00:03:27.605022+0000","last_fullsized":"2023-12-16T00:03:27.605022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015724+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:00:26.015724+0000","last_peered":"2023-12-16T00:00:26.015724+0000","last_clean":"2023-12-16T00:00:26.015724+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:00:26.015724+0000","last_undegraded":"2023-12-16T00:00:26.015724+0000","last_fullsized":"2023-12-16T00:00:26.015724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246529+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246529+0000","last_peered":"2023-12-16T00:03:24.246529+0000","last_clean":"2023-12-16T00:03:24.246529+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246529+0000","last_undegraded":"2023-12-16T00:03:24.246529+0000","last_fullsized":"2023-12-16T00:03:24.246529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015729+0000","last_change":"2023-12-15T22:52:53.172176+0000","last_active":"2023-12-16T00:00:26.015729+0000","last_peered":"2023-12-16T00:00:26.015729+0000","last_clean":"2023-12-16T00:00:26.015729+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:00:26.015729+0000","last_undegraded":"2023-12-16T00:00:26.015729+0000","last_fullsized":"2023-12-16T00:00:26.015729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427796+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427796+0000","last_peered":"2023-12-16T00:03:03.427796+0000","last_clean":"2023-12-16T00:03:03.427796+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427796+0000","last_undegraded":"2023-12-16T00:03:03.427796+0000","last_fullsized":"2023-12-16T00:03:03.427796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439762+0000","last_change":"2023-12-15T22:52:53.172301+0000","last_active":"2023-12-16T00:00:26.439762+0000","last_peered":"2023-12-16T00:00:26.439762+0000","last_clean":"2023-12-16T00:00:26.439762+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:00:26.439762+0000","last_undegraded":"2023-12-16T00:00:26.439762+0000","last_fullsized":"2023-12-16T00:00:26.439762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:50.574499+0000","last_change":"2023-12-16T00:03:50.574518+0000","last_active":"2023-12-16T00:03:50.574499+0000","last_peered":"2023-12-16T00:03:50.574499+0000","last_clean":"2023-12-16T00:03:50.574499+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:03:50.574499+0000","last_undegraded":"2023-12-16T00:03:50.574499+0000","last_fullsized":"2023-12-16T00:03:50.574499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_clean_scrub_stamp":"2023-12-16T00:03:50.574437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.601730+0000","scrub_duration":0.00092257299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388607+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388607+0000","last_peered":"2023-12-16T00:03:15.388607+0000","last_clean":"2023-12-16T00:03:15.388607+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388607+0000","last_undegraded":"2023-12-16T00:03:15.388607+0000","last_fullsized":"2023-12-16T00:03:15.388607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.416013+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.416013+0000","last_peered":"2023-12-16T00:03:16.416013+0000","last_clean":"2023-12-16T00:03:16.416013+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.416013+0000","last_undegraded":"2023-12-16T00:03:16.416013+0000","last_fullsized":"2023-12-16T00:03:16.416013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.232649+0000","last_change":"2023-12-16T00:03:35.232670+0000","last_active":"2023-12-16T00:03:35.232649+0000","last_peered":"2023-12-16T00:03:35.232649+0000","last_clean":"2023-12-16T00:03:35.232649+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:03:35.232649+0000","last_undegraded":"2023-12-16T00:03:35.232649+0000","last_fullsized":"2023-12-16T00:03:35.232649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.232583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:43.491905+0000","scrub_duration":0.001170903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408812+0000","last_change":"2023-12-15T22:52:55.188588+0000","last_active":"2023-12-16T00:00:35.408812+0000","last_peered":"2023-12-16T00:00:35.408812+0000","last_clean":"2023-12-16T00:00:35.408812+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:00:35.408812+0000","last_undegraded":"2023-12-16T00:00:35.408812+0000","last_fullsized":"2023-12-16T00:00:35.408812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015739+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:26.015739+0000","last_peered":"2023-12-16T00:00:26.015739+0000","last_clean":"2023-12-16T00:00:26.015739+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:26.015739+0000","last_undegraded":"2023-12-16T00:00:26.015739+0000","last_fullsized":"2023-12-16T00:00:26.015739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.297264+0000","last_change":"2023-12-16T00:03:49.297285+0000","last_active":"2023-12-16T00:03:49.297264+0000","last_peered":"2023-12-16T00:03:49.297264+0000","last_clean":"2023-12-16T00:03:49.297264+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:03:49.297264+0000","last_undegraded":"2023-12-16T00:03:49.297264+0000","last_fullsized":"2023-12-16T00:03:49.297264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.297202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:12.808001+0000","scrub_duration":0.001104505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015869+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:26.015869+0000","last_peered":"2023-12-16T00:00:26.015869+0000","last_clean":"2023-12-16T00:00:26.015869+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:26.015869+0000","last_undegraded":"2023-12-16T00:00:26.015869+0000","last_fullsized":"2023-12-16T00:00:26.015869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469761+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469761+0000","last_peered":"2023-12-16T00:03:07.469761+0000","last_clean":"2023-12-16T00:03:07.469761+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469761+0000","last_undegraded":"2023-12-16T00:03:07.469761+0000","last_fullsized":"2023-12-16T00:03:07.469761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.880758+0000","last_change":"2023-12-16T00:03:34.880778+0000","last_active":"2023-12-16T00:03:34.880758+0000","last_peered":"2023-12-16T00:03:34.880758+0000","last_clean":"2023-12-16T00:03:34.880758+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:03:34.880758+0000","last_undegraded":"2023-12-16T00:03:34.880758+0000","last_fullsized":"2023-12-16T00:03:34.880758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.880692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:10.519008+0000","scrub_duration":0.00091466200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431217+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431217+0000","last_peered":"2023-12-16T00:03:20.431217+0000","last_clean":"2023-12-16T00:03:20.431217+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431217+0000","last_undegraded":"2023-12-16T00:03:20.431217+0000","last_fullsized":"2023-12-16T00:03:20.431217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.559821+0000","last_change":"2023-12-16T00:03:46.559841+0000","last_active":"2023-12-16T00:03:46.559821+0000","last_peered":"2023-12-16T00:03:46.559821+0000","last_clean":"2023-12-16T00:03:46.559821+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:03:46.559821+0000","last_undegraded":"2023-12-16T00:03:46.559821+0000","last_fullsized":"2023-12-16T00:03:46.559821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.559754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:04.114550+0000","scrub_duration":0.0010144640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328107+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328107+0000","last_peered":"2023-12-16T00:03:29.328107+0000","last_clean":"2023-12-16T00:03:29.328107+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328107+0000","last_undegraded":"2023-12-16T00:03:29.328107+0000","last_fullsized":"2023-12-16T00:03:29.328107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409528+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:35.409528+0000","last_peered":"2023-12-16T00:00:35.409528+0000","last_clean":"2023-12-16T00:00:35.409528+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:35.409528+0000","last_undegraded":"2023-12-16T00:00:35.409528+0000","last_fullsized":"2023-12-16T00:00:35.409528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408164+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:35.408164+0000","last_peered":"2023-12-16T00:00:35.408164+0000","last_clean":"2023-12-16T00:00:35.408164+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:35.408164+0000","last_undegraded":"2023-12-16T00:00:35.408164+0000","last_fullsized":"2023-12-16T00:00:35.408164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.075972+0000","last_change":"2023-12-16T00:03:49.075991+0000","last_active":"2023-12-16T00:03:49.075972+0000","last_peered":"2023-12-16T00:03:49.075972+0000","last_clean":"2023-12-16T00:03:49.075972+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:03:49.075972+0000","last_undegraded":"2023-12-16T00:03:49.075972+0000","last_fullsized":"2023-12-16T00:03:49.075972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.075896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:14.857673+0000","scrub_duration":0.0010048839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628015+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:35.628015+0000","last_peered":"2023-12-16T00:00:35.628015+0000","last_clean":"2023-12-16T00:00:35.628015+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:35.628015+0000","last_undegraded":"2023-12-16T00:00:35.628015+0000","last_fullsized":"2023-12-16T00:00:35.628015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409418+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:35.409418+0000","last_peered":"2023-12-16T00:00:35.409418+0000","last_clean":"2023-12-16T00:00:35.409418+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:35.409418+0000","last_undegraded":"2023-12-16T00:00:35.409418+0000","last_fullsized":"2023-12-16T00:00:35.409418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237891,"num_omap_keys":906,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4352,"ondisk_log_size":4352,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2383,"ondisk_log_size":2383,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":896,"ondisk_log_size":896,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608418,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":0.72199999999999998,"15min":1.004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":1.044},"last":0.316},{"interface":"front","average":{"1min":0.38,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.54400000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.373}]},{"osd":5,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.374,"15min":0.373},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.57899999999999996,"15min":1.149},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63},"last":0.35099999999999998}]}]},{"osd":5,"up_from":11,"seq":47244641120,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.747},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.879},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.37},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.61099999999999999,"15min":0.754},"last":0.438},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26100000000000001},"max":{"1min":0.50700000000000001,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.31,"5min":0.307,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.39700000000000002}]}]},{"osd":3,"up_from":11,"seq":47244641122,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.27400000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69299999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47399999999999998}]},{"osd":1,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":1.25,"15min":1.25},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.379,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Dec 16 00:02:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.246},"max":{"1min":0.55300000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.36799999999999999},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.317}]},{"osd":5,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.62,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27500000000000002}]}]},{"osd":2,"up_from":11,"seq":47244641119,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.32200000000000001},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45400000000000001,"5min":0.55500000000000005,"15min":1.0169999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33500000000000002},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.41199999999999998,"5min":0.55400000000000005,"15min":0.87},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33900000000000002},"min":{"1min":0.23300000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.40999999999999998,"5min":0.50800000000000001,"15min":0.88900000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.436,"5min":0.52400000000000002,"15min":1.2769999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.72999999999999998,"5min":0.83199999999999996,"15min":1.2450000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.97999999999999998},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":1.2190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":1.169},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.4670000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.91000000000000003},"last":0.61299999999999999}]}]},{"osd":1,"up_from":11,"seq":47244641120,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.312,"15min":0.316},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.437,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.34100000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.80100000000000005},"last":0.309}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.52200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48899999999999999,"5min":0.504,"15min":0.504},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.71999999999999997,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.432},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.64700000000000002,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.44900000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.755,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.878},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.47899999999999998}]}]},{"osd":0,"up_from":11,"seq":47244641120,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.316,"15min":0.316},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40600000000000003,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.33700000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.47099999999999997,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.42799999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.83599999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.78300000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.875},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:03:53.091 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.091 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.091 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.092 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.092 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.092 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.092 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.092 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.093 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.093 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.093 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.093 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.094 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.094 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.094 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.094 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.094 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.095 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.095 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.095 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.095 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.096 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.096 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.096 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.096 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.097 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.097 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.097 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.097 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.098 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.098 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.098 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.099 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.099 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.099 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.099 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.100 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.100 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.100 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.100 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.100 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.101 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.101 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.101 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.102 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.102 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.102 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.102 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.103 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.103 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.103 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.103 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.104 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.104 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.104 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.104 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.105 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.105 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.105 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.105 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.106 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.106 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.106 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.106 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.107 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.107 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.107 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.107 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.108 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.108 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.108 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.108 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.109 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.109 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.109 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.109 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.110 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.110 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.110 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.110 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.111 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.111 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.111 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.112 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.112 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.112 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.113 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.113 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.113 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.113 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.114 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.114 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.114 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.114 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.114 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.115 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.115 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.115 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.116 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.116 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.116 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.116 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.117 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.117 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.117 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.117 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.118 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.118 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.118 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.118 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.119 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.119 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.119 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:03:53.119 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:04:13.121 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:04:13.456 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:04:13.477 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:04:13.481 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2212,"stamp":"2023-12-16T00:04:12.282875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":917299,"num_omap_keys":3981,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36512,"ondisk_log_size":36512,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":307928,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":298038,"kb_avail":628837672,"statfs":{"total":644245094400,"available":643929776128,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":305191585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005589"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358393+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358393+0000","last_peered":"2023-12-16T00:03:26.358393+0000","last_clean":"2023-12-16T00:03:26.358393+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358393+0000","last_undegraded":"2023-12-16T00:03:26.358393+0000","last_fullsized":"2023-12-16T00:03:26.358393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.880866+0000","last_change":"2023-12-16T00:03:59.880889+0000","last_active":"2023-12-16T00:03:59.880866+0000","last_peered":"2023-12-16T00:03:59.880866+0000","last_clean":"2023-12-16T00:03:59.880866+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:03:59.880866+0000","last_undegraded":"2023-12-16T00:03:59.880866+0000","last_fullsized":"2023-12-16T00:03:59.880866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.880808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:54.155437+0000","scrub_duration":0.00089921599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.541603+0000","last_change":"2023-12-16T00:04:07.541622+0000","last_active":"2023-12-16T00:04:07.541603+0000","last_peered":"2023-12-16T00:04:07.541603+0000","last_clean":"2023-12-16T00:04:07.541603+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:04:07.541603+0000","last_undegraded":"2023-12-16T00:04:07.541603+0000","last_fullsized":"2023-12-16T00:04:07.541603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.541533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:44.090049+0000","scrub_duration":0.0010501169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408466+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:21.408466+0000","last_peered":"2023-12-16T00:01:21.408466+0000","last_clean":"2023-12-16T00:01:21.408466+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:21.408466+0000","last_undegraded":"2023-12-16T00:01:21.408466+0000","last_fullsized":"2023-12-16T00:01:21.408466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.563813+0000","last_change":"2023-12-16T00:03:53.563813+0000","last_active":"2023-12-16T00:03:53.563813+0000","last_peered":"2023-12-16T00:03:53.563813+0000","last_clean":"2023-12-16T00:03:53.563813+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:03:53.563813+0000","last_undegraded":"2023-12-16T00:03:53.563813+0000","last_fullsized":"2023-12-16T00:03:53.563813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.563736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:33.029870+0000","scrub_duration":0.00070934700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:01.884589+0000","last_change":"2023-12-16T00:04:01.884628+0000","last_active":"2023-12-16T00:04:01.884589+0000","last_peered":"2023-12-16T00:04:01.884589+0000","last_clean":"2023-12-16T00:04:01.884589+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:04:01.884589+0000","last_undegraded":"2023-12-16T00:04:01.884589+0000","last_fullsized":"2023-12-16T00:04:01.884589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_clean_scrub_stamp":"2023-12-16T00:04:01.884510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:50.547528+0000","scrub_duration":0.00152728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.245549+0000","last_change":"2023-12-16T00:03:58.245569+0000","last_active":"2023-12-16T00:03:58.245549+0000","last_peered":"2023-12-16T00:03:58.245549+0000","last_clean":"2023-12-16T00:03:58.245549+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:03:58.245549+0000","last_undegraded":"2023-12-16T00:03:58.245549+0000","last_fullsized":"2023-12-16T00:03:58.245549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.245495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:53:53.747382+0000","scrub_duration":0.00088301999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.295639+0000","last_change":"2023-12-16T00:03:51.295660+0000","last_active":"2023-12-16T00:03:51.295639+0000","last_peered":"2023-12-16T00:03:51.295639+0000","last_clean":"2023-12-16T00:03:51.295639+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:03:51.295639+0000","last_undegraded":"2023-12-16T00:03:51.295639+0000","last_fullsized":"2023-12-16T00:03:51.295639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.295576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:17.077353+0000","scrub_duration":0.0012592949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418704+0000","last_change":"2023-12-15T22:52:55.187009+0000","last_active":"2023-12-16T00:01:10.418704+0000","last_peered":"2023-12-16T00:01:10.418704+0000","last_clean":"2023-12-16T00:01:10.418704+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:01:10.418704+0000","last_undegraded":"2023-12-16T00:01:10.418704+0000","last_fullsized":"2023-12-16T00:01:10.418704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136544+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:28.136544+0000","last_peered":"2023-12-16T00:00:28.136544+0000","last_clean":"2023-12-16T00:00:28.136544+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:28.136544+0000","last_undegraded":"2023-12-16T00:00:28.136544+0000","last_fullsized":"2023-12-16T00:00:28.136544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477835+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477835+0000","last_peered":"2023-12-16T00:03:06.477835+0000","last_clean":"2023-12-16T00:03:06.477835+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477835+0000","last_undegraded":"2023-12-16T00:03:06.477835+0000","last_fullsized":"2023-12-16T00:03:06.477835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288014+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:27.288014+0000","last_peered":"2023-12-16T00:00:27.288014+0000","last_clean":"2023-12-16T00:00:27.288014+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:27.288014+0000","last_undegraded":"2023-12-16T00:00:27.288014+0000","last_fullsized":"2023-12-16T00:00:27.288014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426706+0000","last_change":"2023-12-15T22:53:01.294469+0000","last_active":"2023-12-16T00:01:40.426706+0000","last_peered":"2023-12-16T00:01:40.426706+0000","last_clean":"2023-12-16T00:01:40.426706+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:01:40.426706+0000","last_undegraded":"2023-12-16T00:01:40.426706+0000","last_fullsized":"2023-12-16T00:01:40.426706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408096+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:21.408096+0000","last_peered":"2023-12-16T00:01:21.408096+0000","last_clean":"2023-12-16T00:01:21.408096+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:21.408096+0000","last_undegraded":"2023-12-16T00:01:21.408096+0000","last_fullsized":"2023-12-16T00:01:21.408096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:45.193861+0000","last_change":"2023-12-16T00:03:45.193882+0000","last_active":"2023-12-16T00:03:45.193861+0000","last_peered":"2023-12-16T00:03:45.193861+0000","last_clean":"2023-12-16T00:03:45.193861+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:03:45.193861+0000","last_undegraded":"2023-12-16T00:03:45.193861+0000","last_fullsized":"2023-12-16T00:03:45.193861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:45.193798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:27.535599+0000","scrub_duration":0.0012721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629295+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629295+0000","last_peered":"2023-12-16T00:02:46.629295+0000","last_clean":"2023-12-16T00:02:46.629295+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629295+0000","last_undegraded":"2023-12-16T00:02:46.629295+0000","last_fullsized":"2023-12-16T00:02:46.629295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.712208+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:00:37.712208+0000","last_peered":"2023-12-16T00:00:37.712208+0000","last_clean":"2023-12-16T00:00:37.712208+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:00:37.712208+0000","last_undegraded":"2023-12-16T00:00:37.712208+0000","last_fullsized":"2023-12-16T00:00:37.712208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426875+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:01:40.426875+0000","last_peered":"2023-12-16T00:01:40.426875+0000","last_clean":"2023-12-16T00:01:40.426875+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:01:40.426875+0000","last_undegraded":"2023-12-16T00:01:40.426875+0000","last_fullsized":"2023-12-16T00:01:40.426875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.099235+0000","last_change":"2023-12-16T00:03:44.099255+0000","last_active":"2023-12-16T00:03:44.099235+0000","last_peered":"2023-12-16T00:03:44.099235+0000","last_clean":"2023-12-16T00:03:44.099235+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:03:44.099235+0000","last_undegraded":"2023-12-16T00:03:44.099235+0000","last_fullsized":"2023-12-16T00:03:44.099235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.099172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:07.211984+0000","scrub_duration":0.0012518329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.887190+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:01:04.887190+0000","last_peered":"2023-12-16T00:01:04.887190+0000","last_clean":"2023-12-16T00:01:04.887190+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:01:04.887190+0000","last_undegraded":"2023-12-16T00:01:04.887190+0000","last_fullsized":"2023-12-16T00:01:04.887190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.876980+0000","last_change":"2023-12-16T00:04:05.877000+0000","last_active":"2023-12-16T00:04:05.876980+0000","last_peered":"2023-12-16T00:04:05.876980+0000","last_clean":"2023-12-16T00:04:05.876980+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:04:05.876980+0000","last_undegraded":"2023-12-16T00:04:05.876980+0000","last_fullsized":"2023-12-16T00:04:05.876980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.876880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:41.515195+0000","scrub_duration":0.0014092810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:06.850990+0000","last_change":"2023-12-16T00:04:06.851033+0000","last_active":"2023-12-16T00:04:06.850990+0000","last_peered":"2023-12-16T00:04:06.850990+0000","last_clean":"2023-12-16T00:04:06.850990+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:04:06.850990+0000","last_undegraded":"2023-12-16T00:04:06.850990+0000","last_fullsized":"2023-12-16T00:04:06.850990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_clean_scrub_stamp":"2023-12-16T00:04:06.850910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:25.908040+0000","scrub_duration":0.00097751000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.682501+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:01:44.682501+0000","last_peered":"2023-12-16T00:01:44.682501+0000","last_clean":"2023-12-16T00:01:44.682501+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:01:44.682501+0000","last_undegraded":"2023-12-16T00:01:44.682501+0000","last_fullsized":"2023-12-16T00:01:44.682501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.493314+0000","last_change":"2023-12-16T00:03:36.493334+0000","last_active":"2023-12-16T00:03:36.493314+0000","last_peered":"2023-12-16T00:03:36.493314+0000","last_clean":"2023-12-16T00:03:36.493314+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:03:36.493314+0000","last_undegraded":"2023-12-16T00:03:36.493314+0000","last_fullsized":"2023-12-16T00:03:36.493314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.493246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:53.796792+0000","scrub_duration":0.00093940400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.104306+0000","last_change":"2023-12-16T00:03:53.104323+0000","last_active":"2023-12-16T00:03:53.104306+0000","last_peered":"2023-12-16T00:03:53.104306+0000","last_clean":"2023-12-16T00:03:53.104306+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:03:53.104306+0000","last_undegraded":"2023-12-16T00:03:53.104306+0000","last_fullsized":"2023-12-16T00:03:53.104306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.104258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:09.066868+0000","scrub_duration":0.0012952809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.208542+0000","last_change":"2023-12-16T00:04:00.208562+0000","last_active":"2023-12-16T00:04:00.208542+0000","last_peered":"2023-12-16T00:04:00.208542+0000","last_clean":"2023-12-16T00:04:00.208542+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:04:00.208542+0000","last_undegraded":"2023-12-16T00:04:00.208542+0000","last_fullsized":"2023-12-16T00:04:00.208542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.208477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:00.531527+0000","scrub_duration":0.00086714300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.631082+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:45.631082+0000","last_peered":"2023-12-16T00:00:45.631082+0000","last_clean":"2023-12-16T00:00:45.631082+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:45.631082+0000","last_undegraded":"2023-12-16T00:00:45.631082+0000","last_fullsized":"2023-12-16T00:00:45.631082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1695,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289272+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:00:27.289272+0000","last_peered":"2023-12-16T00:00:27.289272+0000","last_clean":"2023-12-16T00:00:27.289272+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:00:27.289272+0000","last_undegraded":"2023-12-16T00:00:27.289272+0000","last_fullsized":"2023-12-16T00:00:27.289272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411398+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411398+0000","last_peered":"2023-12-16T00:02:07.411398+0000","last_clean":"2023-12-16T00:02:07.411398+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411398+0000","last_undegraded":"2023-12-16T00:02:07.411398+0000","last_fullsized":"2023-12-16T00:02:07.411398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620322+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620322+0000","last_peered":"2023-12-16T00:02:06.620322+0000","last_clean":"2023-12-16T00:02:06.620322+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620322+0000","last_undegraded":"2023-12-16T00:02:06.620322+0000","last_fullsized":"2023-12-16T00:02:06.620322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.542129+0000","last_change":"2023-12-16T00:03:49.542149+0000","last_active":"2023-12-16T00:03:49.542129+0000","last_peered":"2023-12-16T00:03:49.542129+0000","last_clean":"2023-12-16T00:03:49.542129+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:03:49.542129+0000","last_undegraded":"2023-12-16T00:03:49.542129+0000","last_fullsized":"2023-12-16T00:03:49.542129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.542068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:12.196084+0000","scrub_duration":0.0010559110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408467+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:35.408467+0000","last_peered":"2023-12-16T00:00:35.408467+0000","last_clean":"2023-12-16T00:00:35.408467+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:35.408467+0000","last_undegraded":"2023-12-16T00:00:35.408467+0000","last_fullsized":"2023-12-16T00:00:35.408467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.157297+0000","last_change":"2023-12-16T00:03:31.157320+0000","last_active":"2023-12-16T00:03:31.157297+0000","last_peered":"2023-12-16T00:03:31.157297+0000","last_clean":"2023-12-16T00:03:31.157297+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:03:31.157297+0000","last_undegraded":"2023-12-16T00:03:31.157297+0000","last_fullsized":"2023-12-16T00:03:31.157297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.157241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:58:18.132539+0000","scrub_duration":0.0024345880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.103862+0000","last_change":"2023-12-16T00:03:59.103882+0000","last_active":"2023-12-16T00:03:59.103862+0000","last_peered":"2023-12-16T00:03:59.103862+0000","last_clean":"2023-12-16T00:03:59.103862+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:03:59.103862+0000","last_undegraded":"2023-12-16T00:03:59.103862+0000","last_fullsized":"2023-12-16T00:03:59.103862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.103798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:15.216322+0000","scrub_duration":0.001606133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886912+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886912+0000","last_peered":"2023-12-16T00:01:52.886912+0000","last_clean":"2023-12-16T00:01:52.886912+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886912+0000","last_undegraded":"2023-12-16T00:01:52.886912+0000","last_fullsized":"2023-12-16T00:01:52.886912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118199+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118199+0000","last_peered":"2023-12-16T00:02:20.118199+0000","last_clean":"2023-12-16T00:02:20.118199+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118199+0000","last_undegraded":"2023-12-16T00:02:20.118199+0000","last_fullsized":"2023-12-16T00:02:20.118199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409291+0000","last_change":"2023-12-15T22:52:55.189444+0000","last_active":"2023-12-16T00:00:35.409291+0000","last_peered":"2023-12-16T00:00:35.409291+0000","last_clean":"2023-12-16T00:00:35.409291+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:00:35.409291+0000","last_undegraded":"2023-12-16T00:00:35.409291+0000","last_fullsized":"2023-12-16T00:00:35.409291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630689+0000","last_change":"2023-12-15T22:53:01.908283+0000","last_active":"2023-12-16T00:00:45.630689+0000","last_peered":"2023-12-16T00:00:45.630689+0000","last_clean":"2023-12-16T00:00:45.630689+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:00:45.630689+0000","last_undegraded":"2023-12-16T00:00:45.630689+0000","last_fullsized":"2023-12-16T00:00:45.630689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415589+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:01:00.415589+0000","last_peered":"2023-12-16T00:01:00.415589+0000","last_clean":"2023-12-16T00:01:00.415589+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:01:00.415589+0000","last_undegraded":"2023-12-16T00:01:00.415589+0000","last_fullsized":"2023-12-16T00:01:00.415589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405927+0000","last_change":"2023-12-15T23:08:37.336551+0000","last_active":"2023-12-16T00:01:11.405927+0000","last_peered":"2023-12-16T00:01:11.405927+0000","last_clean":"2023-12-16T00:01:11.405927+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:01:11.405927+0000","last_undegraded":"2023-12-16T00:01:11.405927+0000","last_fullsized":"2023-12-16T00:01:11.405927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425019+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:01:35.425019+0000","last_peered":"2023-12-16T00:01:35.425019+0000","last_clean":"2023-12-16T00:01:35.425019+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:01:35.425019+0000","last_undegraded":"2023-12-16T00:01:35.425019+0000","last_fullsized":"2023-12-16T00:01:35.425019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.414205+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:46.414205+0000","last_peered":"2023-12-16T00:01:46.414205+0000","last_clean":"2023-12-16T00:01:46.414205+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:46.414205+0000","last_undegraded":"2023-12-16T00:01:46.414205+0000","last_fullsized":"2023-12-16T00:01:46.414205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.422218+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.422218+0000","last_peered":"2023-12-16T00:01:25.422218+0000","last_clean":"2023-12-16T00:01:25.422218+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.422218+0000","last_undegraded":"2023-12-16T00:01:25.422218+0000","last_fullsized":"2023-12-16T00:01:25.422218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403853+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:01:10.403853+0000","last_peered":"2023-12-16T00:01:10.403853+0000","last_clean":"2023-12-16T00:01:10.403853+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:01:10.403853+0000","last_undegraded":"2023-12-16T00:01:10.403853+0000","last_fullsized":"2023-12-16T00:01:10.403853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408273+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:35.408273+0000","last_peered":"2023-12-16T00:00:35.408273+0000","last_clean":"2023-12-16T00:00:35.408273+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:35.408273+0000","last_undegraded":"2023-12-16T00:00:35.408273+0000","last_fullsized":"2023-12-16T00:00:35.408273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.636643+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:01:10.636643+0000","last_peered":"2023-12-16T00:01:10.636643+0000","last_clean":"2023-12-16T00:01:10.636643+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:01:10.636643+0000","last_undegraded":"2023-12-16T00:01:10.636643+0000","last_fullsized":"2023-12-16T00:01:10.636643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1029,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304253+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304253+0000","last_peered":"2023-12-16T00:02:29.304253+0000","last_clean":"2023-12-16T00:02:29.304253+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304253+0000","last_undegraded":"2023-12-16T00:02:29.304253+0000","last_fullsized":"2023-12-16T00:02:29.304253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.840624+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:01:18.840624+0000","last_peered":"2023-12-16T00:01:18.840624+0000","last_clean":"2023-12-16T00:01:18.840624+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:01:18.840624+0000","last_undegraded":"2023-12-16T00:01:18.840624+0000","last_fullsized":"2023-12-16T00:01:18.840624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.460768+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:04.460768+0000","last_peered":"2023-12-16T00:02:04.460768+0000","last_clean":"2023-12-16T00:02:04.460768+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:04.460768+0000","last_undegraded":"2023-12-16T00:02:04.460768+0000","last_fullsized":"2023-12-16T00:02:04.460768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403828+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:01:10.403828+0000","last_peered":"2023-12-16T00:01:10.403828+0000","last_clean":"2023-12-16T00:01:10.403828+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:01:10.403828+0000","last_undegraded":"2023-12-16T00:01:10.403828+0000","last_fullsized":"2023-12-16T00:01:10.403828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638510+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:20.638510+0000","last_peered":"2023-12-16T00:01:20.638510+0000","last_clean":"2023-12-16T00:01:20.638510+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:20.638510+0000","last_undegraded":"2023-12-16T00:01:20.638510+0000","last_fullsized":"2023-12-16T00:01:20.638510+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408763+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:35.408763+0000","last_peered":"2023-12-16T00:00:35.408763+0000","last_clean":"2023-12-16T00:00:35.408763+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:35.408763+0000","last_undegraded":"2023-12-16T00:00:35.408763+0000","last_fullsized":"2023-12-16T00:00:35.408763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:08.841845+0000","last_change":"2023-12-16T00:04:08.841865+0000","last_active":"2023-12-16T00:04:08.841845+0000","last_peered":"2023-12-16T00:04:08.841845+0000","last_clean":"2023-12-16T00:04:08.841845+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:04:08.841845+0000","last_undegraded":"2023-12-16T00:04:08.841845+0000","last_fullsized":"2023-12-16T00:04:08.841845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_clean_scrub_stamp":"2023-12-16T00:04:08.841784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:19.871757+0000","scrub_duration":0.00090735399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413716+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:46.413716+0000","last_peered":"2023-12-16T00:01:46.413716+0000","last_clean":"2023-12-16T00:01:46.413716+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:46.413716+0000","last_undegraded":"2023-12-16T00:01:46.413716+0000","last_fullsized":"2023-12-16T00:01:46.413716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":149,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.173655+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:01:08.173655+0000","last_peered":"2023-12-16T00:01:08.173655+0000","last_clean":"2023-12-16T00:01:08.173655+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:01:08.173655+0000","last_undegraded":"2023-12-16T00:01:08.173655+0000","last_fullsized":"2023-12-16T00:01:08.173655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:02.272754+0000","last_change":"2023-12-16T00:04:02.272787+0000","last_active":"2023-12-16T00:04:02.272754+0000","last_peered":"2023-12-16T00:04:02.272754+0000","last_clean":"2023-12-16T00:04:02.272754+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:04:02.272754+0000","last_undegraded":"2023-12-16T00:04:02.272754+0000","last_fullsized":"2023-12-16T00:04:02.272754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_clean_scrub_stamp":"2023-12-16T00:04:02.272686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:18.235296+0000","scrub_duration":0.00092377500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410772+0000","last_change":"2023-12-15T22:52:53.174613+0000","last_active":"2023-12-16T00:00:40.410772+0000","last_peered":"2023-12-16T00:00:40.410772+0000","last_clean":"2023-12-16T00:00:40.410772+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:00:40.410772+0000","last_undegraded":"2023-12-16T00:00:40.410772+0000","last_fullsized":"2023-12-16T00:00:40.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:42.076754+0000","last_change":"2023-12-16T00:03:42.076798+0000","last_active":"2023-12-16T00:03:42.076754+0000","last_peered":"2023-12-16T00:03:42.076754+0000","last_clean":"2023-12-16T00:03:42.076754+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:03:42.076754+0000","last_undegraded":"2023-12-16T00:03:42.076754+0000","last_fullsized":"2023-12-16T00:03:42.076754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_clean_scrub_stamp":"2023-12-16T00:03:42.076689+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:57.373234+0000","scrub_duration":0.0028837759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214798+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214798+0000","last_peered":"2023-12-16T00:03:06.214798+0000","last_clean":"2023-12-16T00:03:06.214798+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214798+0000","last_undegraded":"2023-12-16T00:03:06.214798+0000","last_fullsized":"2023-12-16T00:03:06.214798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430630+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:55.430630+0000","last_peered":"2023-12-16T00:01:55.430630+0000","last_clean":"2023-12-16T00:01:55.430630+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:55.430630+0000","last_undegraded":"2023-12-16T00:01:55.430630+0000","last_fullsized":"2023-12-16T00:01:55.430630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.382834+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:01:54.382834+0000","last_peered":"2023-12-16T00:01:54.382834+0000","last_clean":"2023-12-16T00:01:54.382834+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:01:54.382834+0000","last_undegraded":"2023-12-16T00:01:54.382834+0000","last_fullsized":"2023-12-16T00:01:54.382834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.445908+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:12.445908+0000","last_peered":"2023-12-16T00:02:12.445908+0000","last_clean":"2023-12-16T00:02:12.445908+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:12.445908+0000","last_undegraded":"2023-12-16T00:02:12.445908+0000","last_fullsized":"2023-12-16T00:02:12.445908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:31.867764+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:00:31.867764+0000","last_peered":"2023-12-16T00:00:31.867764+0000","last_clean":"2023-12-16T00:00:31.867764+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:00:31.867764+0000","last_undegraded":"2023-12-16T00:00:31.867764+0000","last_fullsized":"2023-12-16T00:00:31.867764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575227+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575227+0000","last_peered":"2023-12-16T00:03:30.575227+0000","last_clean":"2023-12-16T00:03:30.575227+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575227+0000","last_undegraded":"2023-12-16T00:03:30.575227+0000","last_fullsized":"2023-12-16T00:03:30.575227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136427+0000","last_change":"2023-12-15T22:52:53.173970+0000","last_active":"2023-12-16T00:00:28.136427+0000","last_peered":"2023-12-16T00:00:28.136427+0000","last_clean":"2023-12-16T00:00:28.136427+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:00:28.136427+0000","last_undegraded":"2023-12-16T00:00:28.136427+0000","last_fullsized":"2023-12-16T00:00:28.136427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470578+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470578+0000","last_peered":"2023-12-16T00:02:55.470578+0000","last_clean":"2023-12-16T00:02:55.470578+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470578+0000","last_undegraded":"2023-12-16T00:02:55.470578+0000","last_fullsized":"2023-12-16T00:02:55.470578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.739311+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:01:55.739311+0000","last_peered":"2023-12-16T00:01:55.739311+0000","last_clean":"2023-12-16T00:01:55.739311+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:01:55.739311+0000","last_undegraded":"2023-12-16T00:01:55.739311+0000","last_fullsized":"2023-12-16T00:01:55.739311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1699,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.639401+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:01:56.639401+0000","last_peered":"2023-12-16T00:01:56.639401+0000","last_clean":"2023-12-16T00:01:56.639401+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:01:56.639401+0000","last_undegraded":"2023-12-16T00:01:56.639401+0000","last_fullsized":"2023-12-16T00:01:56.639401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.514652+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:14.514652+0000","last_peered":"2023-12-16T00:02:14.514652+0000","last_clean":"2023-12-16T00:02:14.514652+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:14.514652+0000","last_undegraded":"2023-12-16T00:02:14.514652+0000","last_fullsized":"2023-12-16T00:02:14.514652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:18.155939+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:01:18.155939+0000","last_peered":"2023-12-16T00:01:18.155939+0000","last_clean":"2023-12-16T00:01:18.155939+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:01:18.155939+0000","last_undegraded":"2023-12-16T00:01:18.155939+0000","last_fullsized":"2023-12-16T00:01:18.155939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.935847+0000","last_change":"2023-12-16T00:03:47.935882+0000","last_active":"2023-12-16T00:03:47.935847+0000","last_peered":"2023-12-16T00:03:47.935847+0000","last_clean":"2023-12-16T00:03:47.935847+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:03:47.935847+0000","last_undegraded":"2023-12-16T00:03:47.935847+0000","last_fullsized":"2023-12-16T00:03:47.935847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.935771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:56.317416+0000","scrub_duration":0.0010477100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.226844+0000","last_change":"2023-12-16T00:04:09.226874+0000","last_active":"2023-12-16T00:04:09.226844+0000","last_peered":"2023-12-16T00:04:09.226844+0000","last_clean":"2023-12-16T00:04:09.226844+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:04:09.226844+0000","last_undegraded":"2023-12-16T00:04:09.226844+0000","last_fullsized":"2023-12-16T00:04:09.226844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.226768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:44.325950+0000","scrub_duration":0.0012146679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355510+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355510+0000","last_peered":"2023-12-16T00:02:46.355510+0000","last_clean":"2023-12-16T00:02:46.355510+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355510+0000","last_undegraded":"2023-12-16T00:02:46.355510+0000","last_fullsized":"2023-12-16T00:02:46.355510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.258755+0000","last_change":"2023-12-16T00:04:05.258778+0000","last_active":"2023-12-16T00:04:05.258755+0000","last_peered":"2023-12-16T00:04:05.258755+0000","last_clean":"2023-12-16T00:04:05.258755+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:04:05.258755+0000","last_undegraded":"2023-12-16T00:04:05.258755+0000","last_fullsized":"2023-12-16T00:04:05.258755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.258689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:24:41.933338+0000","scrub_duration":0.0011204909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.134546+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:01:59.134546+0000","last_peered":"2023-12-16T00:01:59.134546+0000","last_clean":"2023-12-16T00:01:59.134546+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:01:59.134546+0000","last_undegraded":"2023-12-16T00:01:59.134546+0000","last_fullsized":"2023-12-16T00:01:59.134546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.699786+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:01:28.699786+0000","last_peered":"2023-12-16T00:01:28.699786+0000","last_clean":"2023-12-16T00:01:28.699786+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:01:28.699786+0000","last_undegraded":"2023-12-16T00:01:28.699786+0000","last_fullsized":"2023-12-16T00:01:28.699786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959687+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959687+0000","last_peered":"2023-12-16T00:03:20.959687+0000","last_clean":"2023-12-16T00:03:20.959687+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959687+0000","last_undegraded":"2023-12-16T00:03:20.959687+0000","last_fullsized":"2023-12-16T00:03:20.959687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.858736+0000","last_change":"2023-12-16T00:03:51.858771+0000","last_active":"2023-12-16T00:03:51.858736+0000","last_peered":"2023-12-16T00:03:51.858736+0000","last_clean":"2023-12-16T00:03:51.858736+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:03:51.858736+0000","last_undegraded":"2023-12-16T00:03:51.858736+0000","last_fullsized":"2023-12-16T00:03:51.858736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.858668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:28.407183+0000","scrub_duration":0.001347146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137591+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137591+0000","last_peered":"2023-12-16T00:02:59.137591+0000","last_clean":"2023-12-16T00:02:59.137591+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137591+0000","last_undegraded":"2023-12-16T00:02:59.137591+0000","last_fullsized":"2023-12-16T00:02:59.137591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.629876+0000","last_change":"2023-12-15T23:08:37.338593+0000","last_active":"2023-12-16T00:00:40.629876+0000","last_peered":"2023-12-16T00:00:40.629876+0000","last_clean":"2023-12-16T00:00:40.629876+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:00:40.629876+0000","last_undegraded":"2023-12-16T00:00:40.629876+0000","last_fullsized":"2023-12-16T00:00:40.629876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334191+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334191+0000","last_peered":"2023-12-16T00:02:27.334191+0000","last_clean":"2023-12-16T00:02:27.334191+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334191+0000","last_undegraded":"2023-12-16T00:02:27.334191+0000","last_fullsized":"2023-12-16T00:02:27.334191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1513,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.231162+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:01:34.231162+0000","last_peered":"2023-12-16T00:01:34.231162+0000","last_clean":"2023-12-16T00:01:34.231162+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:01:34.231162+0000","last_undegraded":"2023-12-16T00:01:34.231162+0000","last_fullsized":"2023-12-16T00:01:34.231162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.015601+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:01:22.015601+0000","last_peered":"2023-12-16T00:01:22.015601+0000","last_clean":"2023-12-16T00:01:22.015601+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:01:22.015601+0000","last_undegraded":"2023-12-16T00:01:22.015601+0000","last_fullsized":"2023-12-16T00:01:22.015601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.233361+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:00:26.233361+0000","last_peered":"2023-12-16T00:00:26.233361+0000","last_clean":"2023-12-16T00:00:26.233361+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:00:26.233361+0000","last_undegraded":"2023-12-16T00:00:26.233361+0000","last_fullsized":"2023-12-16T00:00:26.233361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.715344+0000","last_change":"2023-12-16T00:03:55.715381+0000","last_active":"2023-12-16T00:03:55.715344+0000","last_peered":"2023-12-16T00:03:55.715344+0000","last_clean":"2023-12-16T00:03:55.715344+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:03:55.715344+0000","last_undegraded":"2023-12-16T00:03:55.715344+0000","last_fullsized":"2023-12-16T00:03:55.715344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.715267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.096913+0000","scrub_duration":0.001072323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.439680+0000","last_change":"2023-12-15T22:52:53.171105+0000","last_active":"2023-12-16T00:00:26.439680+0000","last_peered":"2023-12-16T00:00:26.439680+0000","last_clean":"2023-12-16T00:00:26.439680+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:00:26.439680+0000","last_undegraded":"2023-12-16T00:00:26.439680+0000","last_fullsized":"2023-12-16T00:00:26.439680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355512+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355512+0000","last_peered":"2023-12-16T00:03:09.355512+0000","last_clean":"2023-12-16T00:03:09.355512+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355512+0000","last_undegraded":"2023-12-16T00:03:09.355512+0000","last_fullsized":"2023-12-16T00:03:09.355512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.409998+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:40.409998+0000","last_peered":"2023-12-16T00:00:40.409998+0000","last_clean":"2023-12-16T00:00:40.409998+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:40.409998+0000","last_undegraded":"2023-12-16T00:00:40.409998+0000","last_fullsized":"2023-12-16T00:00:40.409998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'115","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.070326+0000","last_change":"2023-12-16T00:03:41.070353+0000","last_active":"2023-12-16T00:03:41.070326+0000","last_peered":"2023-12-16T00:03:41.070326+0000","last_clean":"2023-12-16T00:03:41.070326+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:03:41.070326+0000","last_undegraded":"2023-12-16T00:03:41.070326+0000","last_fullsized":"2023-12-16T00:03:41.070326+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'115","last_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_deep_scrub":"54'115","last_deep_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.070267+0000","objects_scrubbed":29,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.536401+0000","scrub_duration":0.016426911999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.875715+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:01:05.875715+0000","last_peered":"2023-12-16T00:01:05.875715+0000","last_clean":"2023-12-16T00:01:05.875715+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:01:05.875715+0000","last_undegraded":"2023-12-16T00:01:05.875715+0000","last_fullsized":"2023-12-16T00:01:05.875715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":865,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:29.835807+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:00:29.835807+0000","last_peered":"2023-12-16T00:00:29.835807+0000","last_clean":"2023-12-16T00:00:29.835807+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:00:29.835807+0000","last_undegraded":"2023-12-16T00:00:29.835807+0000","last_fullsized":"2023-12-16T00:00:29.835807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642313+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:01:35.642313+0000","last_peered":"2023-12-16T00:01:35.642313+0000","last_clean":"2023-12-16T00:01:35.642313+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:01:35.642313+0000","last_undegraded":"2023-12-16T00:01:35.642313+0000","last_fullsized":"2023-12-16T00:01:35.642313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288152+0000","last_change":"2023-12-15T22:52:55.185359+0000","last_active":"2023-12-16T00:00:27.288152+0000","last_peered":"2023-12-16T00:00:27.288152+0000","last_clean":"2023-12-16T00:00:27.288152+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:00:27.288152+0000","last_undegraded":"2023-12-16T00:00:27.288152+0000","last_fullsized":"2023-12-16T00:00:27.288152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647082+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:55.647082+0000","last_peered":"2023-12-16T00:01:55.647082+0000","last_clean":"2023-12-16T00:01:55.647082+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:55.647082+0000","last_undegraded":"2023-12-16T00:01:55.647082+0000","last_fullsized":"2023-12-16T00:01:55.647082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:47.473179+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:00:47.473179+0000","last_peered":"2023-12-16T00:00:47.473179+0000","last_clean":"2023-12-16T00:00:47.473179+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:00:47.473179+0000","last_undegraded":"2023-12-16T00:00:47.473179+0000","last_fullsized":"2023-12-16T00:00:47.473179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427491+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:01:45.427491+0000","last_peered":"2023-12-16T00:01:45.427491+0000","last_clean":"2023-12-16T00:01:45.427491+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:01:45.427491+0000","last_undegraded":"2023-12-16T00:01:45.427491+0000","last_fullsized":"2023-12-16T00:01:45.427491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.121780+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:00:35.121780+0000","last_peered":"2023-12-16T00:00:35.121780+0000","last_clean":"2023-12-16T00:00:35.121780+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:00:35.121780+0000","last_undegraded":"2023-12-16T00:00:35.121780+0000","last_fullsized":"2023-12-16T00:00:35.121780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.732064+0000","last_change":"2023-12-16T00:03:56.732100+0000","last_active":"2023-12-16T00:03:56.732064+0000","last_peered":"2023-12-16T00:03:56.732064+0000","last_clean":"2023-12-16T00:03:56.732064+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:03:56.732064+0000","last_undegraded":"2023-12-16T00:03:56.732064+0000","last_fullsized":"2023-12-16T00:03:56.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.731978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:06.685949+0000","scrub_duration":0.00092347600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.695197+0000","last_change":"2023-12-16T00:03:51.695233+0000","last_active":"2023-12-16T00:03:51.695197+0000","last_peered":"2023-12-16T00:03:51.695197+0000","last_clean":"2023-12-16T00:03:51.695197+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:03:51.695197+0000","last_undegraded":"2023-12-16T00:03:51.695197+0000","last_fullsized":"2023-12-16T00:03:51.695197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.695125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:53.485109+0000","scrub_duration":0.0011650359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778104+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778104+0000","last_peered":"2023-12-16T00:02:03.778104+0000","last_clean":"2023-12-16T00:02:03.778104+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778104+0000","last_undegraded":"2023-12-16T00:02:03.778104+0000","last_fullsized":"2023-12-16T00:02:03.778104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630904+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:45.630904+0000","last_peered":"2023-12-16T00:00:45.630904+0000","last_clean":"2023-12-16T00:00:45.630904+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:45.630904+0000","last_undegraded":"2023-12-16T00:00:45.630904+0000","last_fullsized":"2023-12-16T00:00:45.630904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904049+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904049+0000","last_peered":"2023-12-16T00:01:44.904049+0000","last_clean":"2023-12-16T00:01:44.904049+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904049+0000","last_undegraded":"2023-12-16T00:01:44.904049+0000","last_fullsized":"2023-12-16T00:01:44.904049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":551,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.529169+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:00:50.529169+0000","last_peered":"2023-12-16T00:00:50.529169+0000","last_clean":"2023-12-16T00:00:50.529169+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:00:50.529169+0000","last_undegraded":"2023-12-16T00:00:50.529169+0000","last_fullsized":"2023-12-16T00:00:50.529169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.710465+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:00:43.710465+0000","last_peered":"2023-12-16T00:00:43.710465+0000","last_clean":"2023-12-16T00:00:43.710465+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:00:43.710465+0000","last_undegraded":"2023-12-16T00:00:43.710465+0000","last_fullsized":"2023-12-16T00:00:43.710465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468686+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468686+0000","last_peered":"2023-12-16T00:03:22.468686+0000","last_clean":"2023-12-16T00:03:22.468686+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468686+0000","last_undegraded":"2023-12-16T00:03:22.468686+0000","last_fullsized":"2023-12-16T00:03:22.468686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244135+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244135+0000","last_peered":"2023-12-16T00:03:28.244135+0000","last_clean":"2023-12-16T00:03:28.244135+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244135+0000","last_undegraded":"2023-12-16T00:03:28.244135+0000","last_fullsized":"2023-12-16T00:03:28.244135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647206+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:55.647206+0000","last_peered":"2023-12-16T00:01:55.647206+0000","last_clean":"2023-12-16T00:01:55.647206+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:55.647206+0000","last_undegraded":"2023-12-16T00:01:55.647206+0000","last_fullsized":"2023-12-16T00:01:55.647206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.118550+0000","last_change":"2023-12-16T00:03:58.118570+0000","last_active":"2023-12-16T00:03:58.118550+0000","last_peered":"2023-12-16T00:03:58.118550+0000","last_clean":"2023-12-16T00:03:58.118550+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:03:58.118550+0000","last_undegraded":"2023-12-16T00:03:58.118550+0000","last_fullsized":"2023-12-16T00:03:58.118550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.118482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:22:03.904023+0000","scrub_duration":0.00098478099999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707299+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707299+0000","last_peered":"2023-12-16T00:02:10.707299+0000","last_clean":"2023-12-16T00:02:10.707299+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707299+0000","last_undegraded":"2023-12-16T00:02:10.707299+0000","last_fullsized":"2023-12-16T00:02:10.707299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051798+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051798+0000","last_peered":"2023-12-16T00:01:33.051798+0000","last_clean":"2023-12-16T00:01:33.051798+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051798+0000","last_undegraded":"2023-12-16T00:01:33.051798+0000","last_fullsized":"2023-12-16T00:01:33.051798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350573+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350573+0000","last_peered":"2023-12-16T00:03:11.350573+0000","last_clean":"2023-12-16T00:03:11.350573+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350573+0000","last_undegraded":"2023-12-16T00:03:11.350573+0000","last_fullsized":"2023-12-16T00:03:11.350573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287777+0000","last_change":"2023-12-15T22:52:08.042206+0000","last_active":"2023-12-16T00:00:27.287777+0000","last_peered":"2023-12-16T00:00:27.287777+0000","last_clean":"2023-12-16T00:00:27.287777+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:00:27.287777+0000","last_undegraded":"2023-12-16T00:00:27.287777+0000","last_fullsized":"2023-12-16T00:00:27.287777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.643603+0000","last_change":"2023-12-15T22:52:53.175929+0000","last_active":"2023-12-16T00:01:40.643603+0000","last_peered":"2023-12-16T00:01:40.643603+0000","last_clean":"2023-12-16T00:01:40.643603+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:01:40.643603+0000","last_undegraded":"2023-12-16T00:01:40.643603+0000","last_fullsized":"2023-12-16T00:01:40.643603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461465+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461465+0000","last_peered":"2023-12-16T00:03:22.461465+0000","last_clean":"2023-12-16T00:03:22.461465+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461465+0000","last_undegraded":"2023-12-16T00:03:22.461465+0000","last_fullsized":"2023-12-16T00:03:22.461465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161228+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161228+0000","last_peered":"2023-12-16T00:03:14.161228+0000","last_clean":"2023-12-16T00:03:14.161228+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161228+0000","last_undegraded":"2023-12-16T00:03:14.161228+0000","last_fullsized":"2023-12-16T00:03:14.161228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193045+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193045+0000","last_peered":"2023-12-16T00:02:53.193045+0000","last_clean":"2023-12-16T00:02:53.193045+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193045+0000","last_undegraded":"2023-12-16T00:02:53.193045+0000","last_fullsized":"2023-12-16T00:02:53.193045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1587,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520664+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520664+0000","last_peered":"2023-12-16T00:02:25.520664+0000","last_clean":"2023-12-16T00:02:25.520664+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520664+0000","last_undegraded":"2023-12-16T00:02:25.520664+0000","last_fullsized":"2023-12-16T00:02:25.520664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410634+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:31.410634+0000","last_peered":"2023-12-16T00:01:31.410634+0000","last_clean":"2023-12-16T00:01:31.410634+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:31.410634+0000","last_undegraded":"2023-12-16T00:01:31.410634+0000","last_fullsized":"2023-12-16T00:01:31.410634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414172+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414172+0000","last_peered":"2023-12-16T00:03:17.414172+0000","last_clean":"2023-12-16T00:03:17.414172+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414172+0000","last_undegraded":"2023-12-16T00:03:17.414172+0000","last_fullsized":"2023-12-16T00:03:17.414172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.412902+0000","last_change":"2023-12-15T22:52:08.042171+0000","last_active":"2023-12-16T00:00:50.412902+0000","last_peered":"2023-12-16T00:00:50.412902+0000","last_clean":"2023-12-16T00:00:50.412902+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:00:50.412902+0000","last_undegraded":"2023-12-16T00:00:50.412902+0000","last_fullsized":"2023-12-16T00:00:50.412902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.531828+0000","last_change":"2023-12-16T00:03:41.531828+0000","last_active":"2023-12-16T00:03:41.531828+0000","last_peered":"2023-12-16T00:03:41.531828+0000","last_clean":"2023-12-16T00:03:41.531828+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:03:41.531828+0000","last_undegraded":"2023-12-16T00:03:41.531828+0000","last_fullsized":"2023-12-16T00:03:41.531828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.531720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.997854+0000","scrub_duration":0.001119472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990331+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990331+0000","last_peered":"2023-12-16T00:03:19.990331+0000","last_clean":"2023-12-16T00:03:19.990331+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990331+0000","last_undegraded":"2023-12-16T00:03:19.990331+0000","last_fullsized":"2023-12-16T00:03:19.990331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5996,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425396+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:01:35.425396+0000","last_peered":"2023-12-16T00:01:35.425396+0000","last_clean":"2023-12-16T00:01:35.425396+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:01:35.425396+0000","last_undegraded":"2023-12-16T00:01:35.425396+0000","last_fullsized":"2023-12-16T00:01:35.425396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166639+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166639+0000","last_peered":"2023-12-16T00:03:03.166639+0000","last_clean":"2023-12-16T00:03:03.166639+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166639+0000","last_undegraded":"2023-12-16T00:03:03.166639+0000","last_fullsized":"2023-12-16T00:03:03.166639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478560+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478560+0000","last_peered":"2023-12-16T00:02:02.478560+0000","last_clean":"2023-12-16T00:02:02.478560+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478560+0000","last_undegraded":"2023-12-16T00:02:02.478560+0000","last_fullsized":"2023-12-16T00:02:02.478560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.639650+0000","last_change":"2023-12-16T00:03:36.639670+0000","last_active":"2023-12-16T00:03:36.639650+0000","last_peered":"2023-12-16T00:03:36.639650+0000","last_clean":"2023-12-16T00:03:36.639650+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:03:36.639650+0000","last_undegraded":"2023-12-16T00:03:36.639650+0000","last_fullsized":"2023-12-16T00:03:36.639650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.639584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:26.898631+0000","scrub_duration":0.0012042960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.612164+0000","last_change":"2023-12-16T00:03:31.612184+0000","last_active":"2023-12-16T00:03:31.612164+0000","last_peered":"2023-12-16T00:03:31.612164+0000","last_clean":"2023-12-16T00:03:31.612164+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:03:31.612164+0000","last_undegraded":"2023-12-16T00:03:31.612164+0000","last_fullsized":"2023-12-16T00:03:31.612164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.612104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:55.639396+0000","scrub_duration":0.001020881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.567092+0000","last_change":"2023-12-16T00:03:52.567111+0000","last_active":"2023-12-16T00:03:52.567092+0000","last_peered":"2023-12-16T00:03:52.567092+0000","last_clean":"2023-12-16T00:03:52.567092+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:03:52.567092+0000","last_undegraded":"2023-12-16T00:03:52.567092+0000","last_fullsized":"2023-12-16T00:03:52.567092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.567032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:09.870577+0000","scrub_duration":0.00099403600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":942,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.173986+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.173986+0000","last_peered":"2023-12-16T00:02:51.173986+0000","last_clean":"2023-12-16T00:02:51.173986+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.173986+0000","last_undegraded":"2023-12-16T00:02:51.173986+0000","last_fullsized":"2023-12-16T00:02:51.173986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130536+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130536+0000","last_peered":"2023-12-16T00:01:57.130536+0000","last_clean":"2023-12-16T00:01:57.130536+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130536+0000","last_undegraded":"2023-12-16T00:01:57.130536+0000","last_fullsized":"2023-12-16T00:01:57.130536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712554+0000","last_change":"2023-12-15T23:08:37.338367+0000","last_active":"2023-12-16T00:00:27.712554+0000","last_peered":"2023-12-16T00:00:27.712554+0000","last_clean":"2023-12-16T00:00:27.712554+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:00:27.712554+0000","last_undegraded":"2023-12-16T00:00:27.712554+0000","last_fullsized":"2023-12-16T00:00:27.712554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425033+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:01:35.425033+0000","last_peered":"2023-12-16T00:01:35.425033+0000","last_clean":"2023-12-16T00:01:35.425033+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:01:35.425033+0000","last_undegraded":"2023-12-16T00:01:35.425033+0000","last_fullsized":"2023-12-16T00:01:35.425033+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160224+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160224+0000","last_peered":"2023-12-16T00:02:44.160224+0000","last_clean":"2023-12-16T00:02:44.160224+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160224+0000","last_undegraded":"2023-12-16T00:02:44.160224+0000","last_fullsized":"2023-12-16T00:02:44.160224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.128596+0000","last_change":"2023-12-16T00:03:52.128631+0000","last_active":"2023-12-16T00:03:52.128596+0000","last_peered":"2023-12-16T00:03:52.128596+0000","last_clean":"2023-12-16T00:03:52.128596+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:03:52.128596+0000","last_undegraded":"2023-12-16T00:03:52.128596+0000","last_fullsized":"2023-12-16T00:03:52.128596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.128525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:53.105511+0000","scrub_duration":0.00088122500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.540607+0000","last_change":"2023-12-16T00:03:59.540637+0000","last_active":"2023-12-16T00:03:59.540607+0000","last_peered":"2023-12-16T00:03:59.540607+0000","last_clean":"2023-12-16T00:03:59.540607+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:03:59.540607+0000","last_undegraded":"2023-12-16T00:03:59.540607+0000","last_fullsized":"2023-12-16T00:03:59.540607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.540485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:06.902422+0000","scrub_duration":0.001346311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'161","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:09.332840+0000","last_change":"2023-12-15T22:52:07.607745+0000","last_active":"2023-12-16T00:02:09.332840+0000","last_peered":"2023-12-16T00:02:09.332840+0000","last_clean":"2023-12-16T00:02:09.332840+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:02:09.332840+0000","last_undegraded":"2023-12-16T00:02:09.332840+0000","last_fullsized":"2023-12-16T00:02:09.332840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.425967+0000","last_change":"2023-12-15T22:52:53.176012+0000","last_active":"2023-12-16T00:01:40.425967+0000","last_peered":"2023-12-16T00:01:40.425967+0000","last_clean":"2023-12-16T00:01:40.425967+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:01:40.425967+0000","last_undegraded":"2023-12-16T00:01:40.425967+0000","last_fullsized":"2023-12-16T00:01:40.425967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152518+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152518+0000","last_peered":"2023-12-16T00:03:24.152518+0000","last_clean":"2023-12-16T00:03:24.152518+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152518+0000","last_undegraded":"2023-12-16T00:03:24.152518+0000","last_fullsized":"2023-12-16T00:03:24.152518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":991,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196285+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196285+0000","last_peered":"2023-12-16T00:02:25.196285+0000","last_clean":"2023-12-16T00:02:25.196285+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196285+0000","last_undegraded":"2023-12-16T00:02:25.196285+0000","last_fullsized":"2023-12-16T00:02:25.196285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483312+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483312+0000","last_peered":"2023-12-16T00:02:23.483312+0000","last_clean":"2023-12-16T00:02:23.483312+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483312+0000","last_undegraded":"2023-12-16T00:02:23.483312+0000","last_fullsized":"2023-12-16T00:02:23.483312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.179585+0000","last_change":"2023-12-16T00:03:55.179622+0000","last_active":"2023-12-16T00:03:55.179585+0000","last_peered":"2023-12-16T00:03:55.179585+0000","last_clean":"2023-12-16T00:03:55.179585+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:03:55.179585+0000","last_undegraded":"2023-12-16T00:03:55.179585+0000","last_fullsized":"2023-12-16T00:03:55.179585+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.179520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:26:19.218144+0000","scrub_duration":0.00092174800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1298,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966553+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966553+0000","last_peered":"2023-12-16T00:03:18.966553+0000","last_clean":"2023-12-16T00:03:18.966553+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966553+0000","last_undegraded":"2023-12-16T00:03:18.966553+0000","last_fullsized":"2023-12-16T00:03:18.966553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464112+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464112+0000","last_peered":"2023-12-16T00:03:25.464112+0000","last_clean":"2023-12-16T00:03:25.464112+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464112+0000","last_undegraded":"2023-12-16T00:03:25.464112+0000","last_fullsized":"2023-12-16T00:03:25.464112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015637+0000","last_change":"2023-12-15T22:52:53.173705+0000","last_active":"2023-12-16T00:00:26.015637+0000","last_peered":"2023-12-16T00:00:26.015637+0000","last_clean":"2023-12-16T00:00:26.015637+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:00:26.015637+0000","last_undegraded":"2023-12-16T00:00:26.015637+0000","last_fullsized":"2023-12-16T00:00:26.015637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.494653+0000","last_change":"2023-12-16T00:04:00.494673+0000","last_active":"2023-12-16T00:04:00.494653+0000","last_peered":"2023-12-16T00:04:00.494653+0000","last_clean":"2023-12-16T00:04:00.494653+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:04:00.494653+0000","last_undegraded":"2023-12-16T00:04:00.494653+0000","last_fullsized":"2023-12-16T00:04:00.494653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:12.576991+0000","scrub_duration":0.0013840110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529769+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529769+0000","last_peered":"2023-12-16T00:02:53.529769+0000","last_clean":"2023-12-16T00:02:53.529769+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529769+0000","last_undegraded":"2023-12-16T00:02:53.529769+0000","last_fullsized":"2023-12-16T00:02:53.529769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662996+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662996+0000","last_peered":"2023-12-16T00:02:16.662996+0000","last_clean":"2023-12-16T00:02:16.662996+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662996+0000","last_undegraded":"2023-12-16T00:02:16.662996+0000","last_fullsized":"2023-12-16T00:02:16.662996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.142469+0000","last_change":"2023-12-16T00:03:56.142490+0000","last_active":"2023-12-16T00:03:56.142469+0000","last_peered":"2023-12-16T00:03:56.142469+0000","last_clean":"2023-12-16T00:03:56.142469+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:03:56.142469+0000","last_undegraded":"2023-12-16T00:03:56.142469+0000","last_fullsized":"2023-12-16T00:03:56.142469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.142408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:45.112014+0000","scrub_duration":0.00089426600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5951,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323807+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323807+0000","last_peered":"2023-12-16T00:03:09.323807+0000","last_clean":"2023-12-16T00:03:09.323807+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323807+0000","last_undegraded":"2023-12-16T00:03:09.323807+0000","last_fullsized":"2023-12-16T00:03:09.323807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855239+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855239+0000","last_peered":"2023-12-16T00:03:23.855239+0000","last_clean":"2023-12-16T00:03:23.855239+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855239+0000","last_undegraded":"2023-12-16T00:03:23.855239+0000","last_fullsized":"2023-12-16T00:03:23.855239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.233208+0000","last_change":"2023-12-16T00:03:41.233244+0000","last_active":"2023-12-16T00:03:41.233208+0000","last_peered":"2023-12-16T00:03:41.233208+0000","last_clean":"2023-12-16T00:03:41.233208+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:03:41.233208+0000","last_undegraded":"2023-12-16T00:03:41.233208+0000","last_fullsized":"2023-12-16T00:03:41.233208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.233146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:29.219613+0000","scrub_duration":0.00094526300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.537375+0000","last_change":"2023-12-16T00:03:35.537411+0000","last_active":"2023-12-16T00:03:35.537375+0000","last_peered":"2023-12-16T00:03:35.537375+0000","last_clean":"2023-12-16T00:03:35.537375+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:03:35.537375+0000","last_undegraded":"2023-12-16T00:03:35.537375+0000","last_fullsized":"2023-12-16T00:03:35.537375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.537285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:54.142352+0000","scrub_duration":0.0011419679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335105+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335105+0000","last_peered":"2023-12-16T00:03:07.335105+0000","last_clean":"2023-12-16T00:03:07.335105+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335105+0000","last_undegraded":"2023-12-16T00:03:07.335105+0000","last_fullsized":"2023-12-16T00:03:07.335105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453548+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453548+0000","last_peered":"2023-12-16T00:02:34.453548+0000","last_clean":"2023-12-16T00:02:34.453548+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453548+0000","last_undegraded":"2023-12-16T00:02:34.453548+0000","last_fullsized":"2023-12-16T00:02:34.453548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116761+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116761+0000","last_peered":"2023-12-16T00:02:44.116761+0000","last_clean":"2023-12-16T00:02:44.116761+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116761+0000","last_undegraded":"2023-12-16T00:02:44.116761+0000","last_fullsized":"2023-12-16T00:02:44.116761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.097018+0000","last_change":"2023-12-16T00:03:57.097038+0000","last_active":"2023-12-16T00:03:57.097018+0000","last_peered":"2023-12-16T00:03:57.097018+0000","last_clean":"2023-12-16T00:03:57.097018+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:03:57.097018+0000","last_undegraded":"2023-12-16T00:03:57.097018+0000","last_fullsized":"2023-12-16T00:03:57.097018+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.096950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:03.688612+0000","scrub_duration":0.0011013220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629219+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629219+0000","last_peered":"2023-12-16T00:01:50.629219+0000","last_clean":"2023-12-16T00:01:50.629219+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629219+0000","last_undegraded":"2023-12-16T00:01:50.629219+0000","last_fullsized":"2023-12-16T00:01:50.629219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.896996+0000","last_change":"2023-12-16T00:03:35.896996+0000","last_active":"2023-12-16T00:03:35.896996+0000","last_peered":"2023-12-16T00:03:35.896996+0000","last_clean":"2023-12-16T00:03:35.896996+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:03:35.896996+0000","last_undegraded":"2023-12-16T00:03:35.896996+0000","last_fullsized":"2023-12-16T00:03:35.896996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.896905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.496966+0000","scrub_duration":0.0014309380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.643802+0000","last_change":"2023-12-15T22:52:53.170804+0000","last_active":"2023-12-16T00:01:40.643802+0000","last_peered":"2023-12-16T00:01:40.643802+0000","last_clean":"2023-12-16T00:01:40.643802+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:01:40.643802+0000","last_undegraded":"2023-12-16T00:01:40.643802+0000","last_fullsized":"2023-12-16T00:01:40.643802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.423013+0000","last_change":"2023-12-15T22:52:08.042765+0000","last_active":"2023-12-16T00:01:25.423013+0000","last_peered":"2023-12-16T00:01:25.423013+0000","last_clean":"2023-12-16T00:01:25.423013+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:01:25.423013+0000","last_undegraded":"2023-12-16T00:01:25.423013+0000","last_fullsized":"2023-12-16T00:01:25.423013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.079336+0000","last_change":"2023-12-16T00:03:38.079336+0000","last_active":"2023-12-16T00:03:38.079336+0000","last_peered":"2023-12-16T00:03:38.079336+0000","last_clean":"2023-12-16T00:03:38.079336+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:03:38.079336+0000","last_undegraded":"2023-12-16T00:03:38.079336+0000","last_fullsized":"2023-12-16T00:03:38.079336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.079227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:55.382772+0000","scrub_duration":0.0013798949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.356005+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.356005+0000","last_peered":"2023-12-16T00:02:33.356005+0000","last_clean":"2023-12-16T00:02:33.356005+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.356005+0000","last_undegraded":"2023-12-16T00:02:33.356005+0000","last_fullsized":"2023-12-16T00:02:33.356005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396540+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396540+0000","last_peered":"2023-12-16T00:01:59.396540+0000","last_clean":"2023-12-16T00:01:59.396540+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396540+0000","last_undegraded":"2023-12-16T00:01:59.396540+0000","last_fullsized":"2023-12-16T00:01:59.396540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.553856+0000","last_change":"2023-12-16T00:03:33.553856+0000","last_active":"2023-12-16T00:03:33.553856+0000","last_peered":"2023-12-16T00:03:33.553856+0000","last_clean":"2023-12-16T00:03:33.553856+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:03:33.553856+0000","last_undegraded":"2023-12-16T00:03:33.553856+0000","last_fullsized":"2023-12-16T00:03:33.553856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.553765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:14.335435+0000","scrub_duration":0.001373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430701+0000","last_change":"2023-12-15T22:52:53.175866+0000","last_active":"2023-12-16T00:01:55.430701+0000","last_peered":"2023-12-16T00:01:55.430701+0000","last_clean":"2023-12-16T00:01:55.430701+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:01:55.430701+0000","last_undegraded":"2023-12-16T00:01:55.430701+0000","last_fullsized":"2023-12-16T00:01:55.430701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.424239+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:01:30.424239+0000","last_peered":"2023-12-16T00:01:30.424239+0000","last_clean":"2023-12-16T00:01:30.424239+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:01:30.424239+0000","last_undegraded":"2023-12-16T00:01:30.424239+0000","last_fullsized":"2023-12-16T00:01:30.424239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968164+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968164+0000","last_peered":"2023-12-16T00:03:15.968164+0000","last_clean":"2023-12-16T00:03:15.968164+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968164+0000","last_undegraded":"2023-12-16T00:03:15.968164+0000","last_fullsized":"2023-12-16T00:03:15.968164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561094+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561094+0000","last_peered":"2023-12-16T00:02:30.561094+0000","last_clean":"2023-12-16T00:02:30.561094+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561094+0000","last_undegraded":"2023-12-16T00:02:30.561094+0000","last_fullsized":"2023-12-16T00:02:30.561094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016948+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:00:26.016948+0000","last_peered":"2023-12-16T00:00:26.016948+0000","last_clean":"2023-12-16T00:00:26.016948+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:00:26.016948+0000","last_undegraded":"2023-12-16T00:00:26.016948+0000","last_fullsized":"2023-12-16T00:00:26.016948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112902+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112902+0000","last_peered":"2023-12-16T00:02:08.112902+0000","last_clean":"2023-12-16T00:02:08.112902+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112902+0000","last_undegraded":"2023-12-16T00:02:08.112902+0000","last_fullsized":"2023-12-16T00:02:08.112902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":188,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426386+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:01:40.426386+0000","last_peered":"2023-12-16T00:01:40.426386+0000","last_clean":"2023-12-16T00:01:40.426386+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:01:40.426386+0000","last_undegraded":"2023-12-16T00:01:40.426386+0000","last_fullsized":"2023-12-16T00:01:40.426386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430319+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:55.430319+0000","last_peered":"2023-12-16T00:01:55.430319+0000","last_clean":"2023-12-16T00:01:55.430319+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:55.430319+0000","last_undegraded":"2023-12-16T00:01:55.430319+0000","last_fullsized":"2023-12-16T00:01:55.430319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.413067+0000","last_change":"2023-12-15T22:52:53.177942+0000","last_active":"2023-12-16T00:00:50.413067+0000","last_peered":"2023-12-16T00:00:50.413067+0000","last_clean":"2023-12-16T00:00:50.413067+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:00:50.413067+0000","last_undegraded":"2023-12-16T00:00:50.413067+0000","last_fullsized":"2023-12-16T00:00:50.413067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'66","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.166815+0000","last_change":"2023-12-16T00:03:47.166869+0000","last_active":"2023-12-16T00:03:47.166815+0000","last_peered":"2023-12-16T00:03:47.166815+0000","last_clean":"2023-12-16T00:03:47.166815+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:03:47.166815+0000","last_undegraded":"2023-12-16T00:03:47.166815+0000","last_fullsized":"2023-12-16T00:03:47.166815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.166746+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:27.979063+0000","scrub_duration":0.003753653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712557+0000","last_change":"2023-12-15T23:08:37.336646+0000","last_active":"2023-12-16T00:00:27.712557+0000","last_peered":"2023-12-16T00:00:27.712557+0000","last_clean":"2023-12-16T00:00:27.712557+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:00:27.712557+0000","last_undegraded":"2023-12-16T00:00:27.712557+0000","last_fullsized":"2023-12-16T00:00:27.712557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437459+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437459+0000","last_peered":"2023-12-16T00:02:40.437459+0000","last_clean":"2023-12-16T00:02:40.437459+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437459+0000","last_undegraded":"2023-12-16T00:02:40.437459+0000","last_fullsized":"2023-12-16T00:02:40.437459+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410473+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:31.410473+0000","last_peered":"2023-12-16T00:01:31.410473+0000","last_clean":"2023-12-16T00:01:31.410473+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:31.410473+0000","last_undegraded":"2023-12-16T00:01:31.410473+0000","last_fullsized":"2023-12-16T00:01:31.410473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562947+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562947+0000","last_peered":"2023-12-16T00:02:45.562947+0000","last_clean":"2023-12-16T00:02:45.562947+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562947+0000","last_undegraded":"2023-12-16T00:02:45.562947+0000","last_fullsized":"2023-12-16T00:02:45.562947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.563416+0000","last_change":"2023-12-16T00:03:44.563437+0000","last_active":"2023-12-16T00:03:44.563416+0000","last_peered":"2023-12-16T00:03:44.563416+0000","last_clean":"2023-12-16T00:03:44.563416+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:03:44.563416+0000","last_undegraded":"2023-12-16T00:03:44.563416+0000","last_fullsized":"2023-12-16T00:03:44.563416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.563348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:00:12.730238+0000","scrub_duration":0.0015157739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.357363+0000","last_change":"2023-12-16T00:03:33.357383+0000","last_active":"2023-12-16T00:03:33.357363+0000","last_peered":"2023-12-16T00:03:33.357363+0000","last_clean":"2023-12-16T00:03:33.357363+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:03:33.357363+0000","last_undegraded":"2023-12-16T00:03:33.357363+0000","last_fullsized":"2023-12-16T00:03:33.357363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.357294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:08.995610+0000","scrub_duration":0.0012151390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418581+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:01:10.418581+0000","last_peered":"2023-12-16T00:01:10.418581+0000","last_clean":"2023-12-16T00:01:10.418581+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:01:10.418581+0000","last_undegraded":"2023-12-16T00:01:10.418581+0000","last_fullsized":"2023-12-16T00:01:10.418581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'77","reported_seq":1319,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642496+0000","last_change":"2023-12-15T22:54:04.183681+0000","last_active":"2023-12-16T00:01:35.642496+0000","last_peered":"2023-12-16T00:01:35.642496+0000","last_clean":"2023-12-16T00:01:35.642496+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:01:35.642496+0000","last_undegraded":"2023-12-16T00:01:35.642496+0000","last_fullsized":"2023-12-16T00:01:35.642496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168065+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168065+0000","last_peered":"2023-12-16T00:02:06.168065+0000","last_clean":"2023-12-16T00:02:06.168065+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168065+0000","last_undegraded":"2023-12-16T00:02:06.168065+0000","last_fullsized":"2023-12-16T00:02:06.168065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169593+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169593+0000","last_peered":"2023-12-16T00:02:23.169593+0000","last_clean":"2023-12-16T00:02:23.169593+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169593+0000","last_undegraded":"2023-12-16T00:02:23.169593+0000","last_fullsized":"2023-12-16T00:02:23.169593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.428078+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:45.428078+0000","last_peered":"2023-12-16T00:01:45.428078+0000","last_clean":"2023-12-16T00:01:45.428078+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:45.428078+0000","last_undegraded":"2023-12-16T00:01:45.428078+0000","last_fullsized":"2023-12-16T00:01:45.428078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":404,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.022275+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:01:14.022275+0000","last_peered":"2023-12-16T00:01:14.022275+0000","last_clean":"2023-12-16T00:01:14.022275+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:01:14.022275+0000","last_undegraded":"2023-12-16T00:01:14.022275+0000","last_fullsized":"2023-12-16T00:01:14.022275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.024920+0000","last_change":"2023-12-16T00:03:46.024939+0000","last_active":"2023-12-16T00:03:46.024920+0000","last_peered":"2023-12-16T00:03:46.024920+0000","last_clean":"2023-12-16T00:03:46.024920+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:03:46.024920+0000","last_undegraded":"2023-12-16T00:03:46.024920+0000","last_fullsized":"2023-12-16T00:03:46.024920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.024856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:58.107273+0000","scrub_duration":0.00094653599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418706+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:01:10.418706+0000","last_peered":"2023-12-16T00:01:10.418706+0000","last_clean":"2023-12-16T00:01:10.418706+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:01:10.418706+0000","last_undegraded":"2023-12-16T00:01:10.418706+0000","last_fullsized":"2023-12-16T00:01:10.418706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.748971+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:38.748971+0000","last_peered":"2023-12-16T00:01:38.748971+0000","last_clean":"2023-12-16T00:01:38.748971+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:38.748971+0000","last_undegraded":"2023-12-16T00:01:38.748971+0000","last_fullsized":"2023-12-16T00:01:38.748971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007813+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007813+0000","last_peered":"2023-12-16T00:01:36.007813+0000","last_clean":"2023-12-16T00:01:36.007813+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007813+0000","last_undegraded":"2023-12-16T00:01:36.007813+0000","last_fullsized":"2023-12-16T00:01:36.007813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1755,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.889729+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:01:33.889729+0000","last_peered":"2023-12-16T00:01:33.889729+0000","last_clean":"2023-12-16T00:01:33.889729+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:01:33.889729+0000","last_undegraded":"2023-12-16T00:01:33.889729+0000","last_fullsized":"2023-12-16T00:01:33.889729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427580+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:01:45.427580+0000","last_peered":"2023-12-16T00:01:45.427580+0000","last_clean":"2023-12-16T00:01:45.427580+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:01:45.427580+0000","last_undegraded":"2023-12-16T00:01:45.427580+0000","last_fullsized":"2023-12-16T00:01:45.427580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.604810+0000","last_change":"2023-12-16T00:03:38.604829+0000","last_active":"2023-12-16T00:03:38.604810+0000","last_peered":"2023-12-16T00:03:38.604810+0000","last_clean":"2023-12-16T00:03:38.604810+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:03:38.604810+0000","last_undegraded":"2023-12-16T00:03:38.604810+0000","last_fullsized":"2023-12-16T00:03:38.604810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.604746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:35.411237+0000","scrub_duration":0.001128876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408854+0000","last_change":"2023-12-15T22:52:53.177782+0000","last_active":"2023-12-16T00:00:35.408854+0000","last_peered":"2023-12-16T00:00:35.408854+0000","last_clean":"2023-12-16T00:00:35.408854+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:00:35.408854+0000","last_undegraded":"2023-12-16T00:00:35.408854+0000","last_fullsized":"2023-12-16T00:00:35.408854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385135+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385135+0000","last_peered":"2023-12-16T00:02:50.385135+0000","last_clean":"2023-12-16T00:02:50.385135+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385135+0000","last_undegraded":"2023-12-16T00:02:50.385135+0000","last_fullsized":"2023-12-16T00:02:50.385135+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088962+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088962+0000","last_peered":"2023-12-16T00:02:04.088962+0000","last_clean":"2023-12-16T00:02:04.088962+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088962+0000","last_undegraded":"2023-12-16T00:02:04.088962+0000","last_fullsized":"2023-12-16T00:02:04.088962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823346+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823346+0000","last_peered":"2023-12-16T00:01:16.823346+0000","last_clean":"2023-12-16T00:01:16.823346+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823346+0000","last_undegraded":"2023-12-16T00:01:16.823346+0000","last_fullsized":"2023-12-16T00:01:16.823346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.427328+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:01:40.427328+0000","last_peered":"2023-12-16T00:01:40.427328+0000","last_clean":"2023-12-16T00:01:40.427328+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:01:40.427328+0000","last_undegraded":"2023-12-16T00:01:40.427328+0000","last_fullsized":"2023-12-16T00:01:40.427328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:40.253850+0000","last_change":"2023-12-16T00:03:40.253871+0000","last_active":"2023-12-16T00:03:40.253850+0000","last_peered":"2023-12-16T00:03:40.253850+0000","last_clean":"2023-12-16T00:03:40.253850+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:03:40.253850+0000","last_undegraded":"2023-12-16T00:03:40.253850+0000","last_fullsized":"2023-12-16T00:03:40.253850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_clean_scrub_stamp":"2023-12-16T00:03:40.253770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:14:18.023218+0000","scrub_duration":0.00092796800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137967+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:00:28.137967+0000","last_peered":"2023-12-16T00:00:28.137967+0000","last_clean":"2023-12-16T00:00:28.137967+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:00:28.137967+0000","last_undegraded":"2023-12-16T00:00:28.137967+0000","last_fullsized":"2023-12-16T00:00:28.137967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.740477+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:01:50.740477+0000","last_peered":"2023-12-16T00:01:50.740477+0000","last_clean":"2023-12-16T00:01:50.740477+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:01:50.740477+0000","last_undegraded":"2023-12-16T00:01:50.740477+0000","last_fullsized":"2023-12-16T00:01:50.740477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202192+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202192+0000","last_peered":"2023-12-16T00:02:33.202192+0000","last_clean":"2023-12-16T00:02:33.202192+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202192+0000","last_undegraded":"2023-12-16T00:02:33.202192+0000","last_fullsized":"2023-12-16T00:02:33.202192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360912+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360912+0000","last_peered":"2023-12-16T00:02:21.360912+0000","last_clean":"2023-12-16T00:02:21.360912+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360912+0000","last_undegraded":"2023-12-16T00:02:21.360912+0000","last_fullsized":"2023-12-16T00:02:21.360912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979291+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979291+0000","last_peered":"2023-12-16T00:03:26.979291+0000","last_clean":"2023-12-16T00:03:26.979291+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979291+0000","last_undegraded":"2023-12-16T00:03:26.979291+0000","last_fullsized":"2023-12-16T00:03:26.979291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.583273+0000","last_change":"2023-12-16T00:03:55.583308+0000","last_active":"2023-12-16T00:03:55.583273+0000","last_peered":"2023-12-16T00:03:55.583273+0000","last_clean":"2023-12-16T00:03:55.583273+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:03:55.583273+0000","last_undegraded":"2023-12-16T00:03:55.583273+0000","last_fullsized":"2023-12-16T00:03:55.583273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.583135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:07:10.879680+0000","scrub_duration":0.0013878409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377246+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377246+0000","last_peered":"2023-12-16T00:02:58.377246+0000","last_clean":"2023-12-16T00:02:58.377246+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377246+0000","last_undegraded":"2023-12-16T00:02:58.377246+0000","last_fullsized":"2023-12-16T00:02:58.377246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016932+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:00:26.016932+0000","last_peered":"2023-12-16T00:00:26.016932+0000","last_clean":"2023-12-16T00:00:26.016932+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:00:26.016932+0000","last_undegraded":"2023-12-16T00:00:26.016932+0000","last_fullsized":"2023-12-16T00:00:26.016932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.405006+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.405006+0000","last_peered":"2023-12-16T00:03:09.405006+0000","last_clean":"2023-12-16T00:03:09.405006+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.405006+0000","last_undegraded":"2023-12-16T00:03:09.405006+0000","last_fullsized":"2023-12-16T00:03:09.405006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062477+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062477+0000","last_peered":"2023-12-16T00:02:03.062477+0000","last_clean":"2023-12-16T00:02:03.062477+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062477+0000","last_undegraded":"2023-12-16T00:02:03.062477+0000","last_fullsized":"2023-12-16T00:02:03.062477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273204+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273204+0000","last_peered":"2023-12-16T00:02:14.273204+0000","last_clean":"2023-12-16T00:02:14.273204+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273204+0000","last_undegraded":"2023-12-16T00:02:14.273204+0000","last_fullsized":"2023-12-16T00:02:14.273204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.096649+0000","last_change":"2023-12-16T00:03:51.096670+0000","last_active":"2023-12-16T00:03:51.096649+0000","last_peered":"2023-12-16T00:03:51.096649+0000","last_clean":"2023-12-16T00:03:51.096649+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:03:51.096649+0000","last_undegraded":"2023-12-16T00:03:51.096649+0000","last_fullsized":"2023-12-16T00:03:51.096649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.096587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:21.124789+0000","scrub_duration":0.00091092400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.602939+0000","last_change":"2023-12-16T00:03:44.602959+0000","last_active":"2023-12-16T00:03:44.602939+0000","last_peered":"2023-12-16T00:03:44.602939+0000","last_clean":"2023-12-16T00:03:44.602939+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:03:44.602939+0000","last_undegraded":"2023-12-16T00:03:44.602939+0000","last_fullsized":"2023-12-16T00:03:44.602939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.602862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:59.899408+0000","scrub_duration":0.0010205100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624544+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624544+0000","last_peered":"2023-12-16T00:02:24.624544+0000","last_clean":"2023-12-16T00:02:24.624544+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624544+0000","last_undegraded":"2023-12-16T00:02:24.624544+0000","last_fullsized":"2023-12-16T00:02:24.624544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712547+0000","last_change":"2023-12-15T23:08:37.343787+0000","last_active":"2023-12-16T00:00:27.712547+0000","last_peered":"2023-12-16T00:00:27.712547+0000","last_clean":"2023-12-16T00:00:27.712547+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:00:27.712547+0000","last_undegraded":"2023-12-16T00:00:27.712547+0000","last_fullsized":"2023-12-16T00:00:27.712547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3899,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200935+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200935+0000","last_peered":"2023-12-16T00:02:19.200935+0000","last_clean":"2023-12-16T00:02:19.200935+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200935+0000","last_undegraded":"2023-12-16T00:02:19.200935+0000","last_fullsized":"2023-12-16T00:02:19.200935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.413093+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:41.413093+0000","last_peered":"2023-12-16T00:01:41.413093+0000","last_clean":"2023-12-16T00:01:41.413093+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:41.413093+0000","last_undegraded":"2023-12-16T00:01:41.413093+0000","last_fullsized":"2023-12-16T00:01:41.413093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339052+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339052+0000","last_peered":"2023-12-16T00:02:29.339052+0000","last_clean":"2023-12-16T00:02:29.339052+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339052+0000","last_undegraded":"2023-12-16T00:02:29.339052+0000","last_fullsized":"2023-12-16T00:02:29.339052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.234989+0000","last_change":"2023-12-16T00:04:09.235010+0000","last_active":"2023-12-16T00:04:09.234989+0000","last_peered":"2023-12-16T00:04:09.234989+0000","last_clean":"2023-12-16T00:04:09.234989+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:04:09.234989+0000","last_undegraded":"2023-12-16T00:04:09.234989+0000","last_fullsized":"2023-12-16T00:04:09.234989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.234925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:37.300137+0000","scrub_duration":0.00099844600000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119127+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119127+0000","last_peered":"2023-12-16T00:02:43.119127+0000","last_clean":"2023-12-16T00:02:43.119127+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119127+0000","last_undegraded":"2023-12-16T00:02:43.119127+0000","last_fullsized":"2023-12-16T00:02:43.119127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.712551+0000","last_change":"2023-12-15T23:08:37.338200+0000","last_active":"2023-12-16T00:00:27.712551+0000","last_peered":"2023-12-16T00:00:27.712551+0000","last_clean":"2023-12-16T00:00:27.712551+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:00:27.712551+0000","last_undegraded":"2023-12-16T00:00:27.712551+0000","last_fullsized":"2023-12-16T00:00:27.712551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413855+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:46.413855+0000","last_peered":"2023-12-16T00:01:46.413855+0000","last_clean":"2023-12-16T00:01:46.413855+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:46.413855+0000","last_undegraded":"2023-12-16T00:01:46.413855+0000","last_fullsized":"2023-12-16T00:01:46.413855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092070+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092070+0000","last_peered":"2023-12-16T00:02:06.092070+0000","last_clean":"2023-12-16T00:02:06.092070+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092070+0000","last_undegraded":"2023-12-16T00:02:06.092070+0000","last_fullsized":"2023-12-16T00:02:06.092070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059457+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059457+0000","last_peered":"2023-12-16T00:01:32.059457+0000","last_clean":"2023-12-16T00:01:32.059457+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059457+0000","last_undegraded":"2023-12-16T00:01:32.059457+0000","last_fullsized":"2023-12-16T00:01:32.059457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1519,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513307+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513307+0000","last_peered":"2023-12-16T00:02:15.513307+0000","last_clean":"2023-12-16T00:02:15.513307+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513307+0000","last_undegraded":"2023-12-16T00:02:15.513307+0000","last_fullsized":"2023-12-16T00:02:15.513307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418257+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:01:10.418257+0000","last_peered":"2023-12-16T00:01:10.418257+0000","last_clean":"2023-12-16T00:01:10.418257+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:01:10.418257+0000","last_undegraded":"2023-12-16T00:01:10.418257+0000","last_fullsized":"2023-12-16T00:01:10.418257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136426+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:28.136426+0000","last_peered":"2023-12-16T00:00:28.136426+0000","last_clean":"2023-12-16T00:00:28.136426+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:28.136426+0000","last_undegraded":"2023-12-16T00:00:28.136426+0000","last_fullsized":"2023-12-16T00:00:28.136426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'9","reported_seq":820,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.799885+0000","last_change":"2023-12-16T00:03:59.799917+0000","last_active":"2023-12-16T00:03:59.799885+0000","last_peered":"2023-12-16T00:03:59.799885+0000","last_clean":"2023-12-16T00:03:59.799885+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:03:59.799885+0000","last_undegraded":"2023-12-16T00:03:59.799885+0000","last_fullsized":"2023-12-16T00:03:59.799885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.799820+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:24.148485+0000","scrub_duration":0.0029504150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:03.182746+0000","last_change":"2023-12-16T00:04:03.182767+0000","last_active":"2023-12-16T00:04:03.182746+0000","last_peered":"2023-12-16T00:04:03.182746+0000","last_clean":"2023-12-16T00:04:03.182746+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:04:03.182746+0000","last_undegraded":"2023-12-16T00:04:03.182746+0000","last_fullsized":"2023-12-16T00:04:03.182746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_clean_scrub_stamp":"2023-12-16T00:04:03.182682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:32.339951+0000","scrub_duration":0.0012782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'114","reported_seq":4021,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.644671+0000","last_change":"2023-12-15T22:54:04.184037+0000","last_active":"2023-12-16T00:01:45.644671+0000","last_peered":"2023-12-16T00:01:45.644671+0000","last_clean":"2023-12-16T00:01:45.644671+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:01:45.644671+0000","last_undegraded":"2023-12-16T00:01:45.644671+0000","last_fullsized":"2023-12-16T00:01:45.644671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188470+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188470+0000","last_peered":"2023-12-16T00:03:12.188470+0000","last_clean":"2023-12-16T00:03:12.188470+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188470+0000","last_undegraded":"2023-12-16T00:03:12.188470+0000","last_fullsized":"2023-12-16T00:03:12.188470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246193+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246193+0000","last_peered":"2023-12-16T00:01:50.246193+0000","last_clean":"2023-12-16T00:01:50.246193+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246193+0000","last_undegraded":"2023-12-16T00:01:50.246193+0000","last_fullsized":"2023-12-16T00:01:50.246193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.930016+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.930016+0000","last_peered":"2023-12-16T00:01:26.930016+0000","last_clean":"2023-12-16T00:01:26.930016+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.930016+0000","last_undegraded":"2023-12-16T00:01:26.930016+0000","last_fullsized":"2023-12-16T00:01:26.930016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986569+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986569+0000","last_peered":"2023-12-16T00:01:56.986569+0000","last_clean":"2023-12-16T00:01:56.986569+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986569+0000","last_undegraded":"2023-12-16T00:01:56.986569+0000","last_fullsized":"2023-12-16T00:01:56.986569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'4","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.880915+0000","last_change":"2023-12-16T00:04:07.880946+0000","last_active":"2023-12-16T00:04:07.880915+0000","last_peered":"2023-12-16T00:04:07.880915+0000","last_clean":"2023-12-16T00:04:07.880915+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:04:07.880915+0000","last_undegraded":"2023-12-16T00:04:07.880915+0000","last_fullsized":"2023-12-16T00:04:07.880915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.880856+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:56.543873+0000","scrub_duration":0.003087462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136417+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:28.136417+0000","last_peered":"2023-12-16T00:00:28.136417+0000","last_clean":"2023-12-16T00:00:28.136417+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:28.136417+0000","last_undegraded":"2023-12-16T00:00:28.136417+0000","last_fullsized":"2023-12-16T00:00:28.136417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.193570+0000","last_change":"2023-12-16T00:03:34.193596+0000","last_active":"2023-12-16T00:03:34.193570+0000","last_peered":"2023-12-16T00:03:34.193570+0000","last_clean":"2023-12-16T00:03:34.193570+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:03:34.193570+0000","last_undegraded":"2023-12-16T00:03:34.193570+0000","last_fullsized":"2023-12-16T00:03:34.193570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.193509+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:52.798577+0000","scrub_duration":0.0029407489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3685,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689757+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689757+0000","last_peered":"2023-12-16T00:02:12.689757+0000","last_clean":"2023-12-16T00:02:12.689757+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689757+0000","last_undegraded":"2023-12-16T00:02:12.689757+0000","last_fullsized":"2023-12-16T00:02:12.689757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925869+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925869+0000","last_peered":"2023-12-16T00:01:40.925869+0000","last_clean":"2023-12-16T00:01:40.925869+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925869+0000","last_undegraded":"2023-12-16T00:01:40.925869+0000","last_fullsized":"2023-12-16T00:01:40.925869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296944+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296944+0000","last_peered":"2023-12-16T00:02:30.296944+0000","last_clean":"2023-12-16T00:02:30.296944+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296944+0000","last_undegraded":"2023-12-16T00:02:30.296944+0000","last_fullsized":"2023-12-16T00:02:30.296944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892789+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892789+0000","last_peered":"2023-12-16T00:01:49.892789+0000","last_clean":"2023-12-16T00:01:49.892789+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892789+0000","last_undegraded":"2023-12-16T00:01:49.892789+0000","last_fullsized":"2023-12-16T00:01:49.892789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":271,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038804+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038804+0000","last_peered":"2023-12-16T00:01:16.038804+0000","last_clean":"2023-12-16T00:01:16.038804+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038804+0000","last_undegraded":"2023-12-16T00:01:16.038804+0000","last_fullsized":"2023-12-16T00:01:16.038804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.637722+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:01:15.637722+0000","last_peered":"2023-12-16T00:01:15.637722+0000","last_clean":"2023-12-16T00:01:15.637722+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:01:15.637722+0000","last_undegraded":"2023-12-16T00:01:15.637722+0000","last_fullsized":"2023-12-16T00:01:15.637722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.009023+0000","last_change":"2023-12-16T00:03:47.009044+0000","last_active":"2023-12-16T00:03:47.009023+0000","last_peered":"2023-12-16T00:03:47.009023+0000","last_clean":"2023-12-16T00:03:47.009023+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:03:47.009023+0000","last_undegraded":"2023-12-16T00:03:47.009023+0000","last_fullsized":"2023-12-16T00:03:47.009023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.008959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:38:54.378679+0000","scrub_duration":0.00088682099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.212154+0000","last_change":"2023-12-16T00:03:36.212174+0000","last_active":"2023-12-16T00:03:36.212154+0000","last_peered":"2023-12-16T00:03:36.212154+0000","last_clean":"2023-12-16T00:03:36.212154+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:03:36.212154+0000","last_undegraded":"2023-12-16T00:03:36.212154+0000","last_fullsized":"2023-12-16T00:03:36.212154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.212089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:43.729491+0000","scrub_duration":0.0014192359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.440829+0000","last_change":"2023-12-15T23:08:37.338736+0000","last_active":"2023-12-16T00:00:26.440829+0000","last_peered":"2023-12-16T00:00:26.440829+0000","last_clean":"2023-12-16T00:00:26.440829+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:00:26.440829+0000","last_undegraded":"2023-12-16T00:00:26.440829+0000","last_fullsized":"2023-12-16T00:00:26.440829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1323,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656814+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656814+0000","last_peered":"2023-12-16T00:02:04.656814+0000","last_clean":"2023-12-16T00:02:04.656814+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656814+0000","last_undegraded":"2023-12-16T00:02:04.656814+0000","last_fullsized":"2023-12-16T00:02:04.656814+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993680+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993680+0000","last_peered":"2023-12-16T00:01:57.993680+0000","last_clean":"2023-12-16T00:01:57.993680+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993680+0000","last_undegraded":"2023-12-16T00:01:57.993680+0000","last_fullsized":"2023-12-16T00:01:57.993680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020629+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020629+0000","last_peered":"2023-12-16T00:02:10.020629+0000","last_clean":"2023-12-16T00:02:10.020629+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020629+0000","last_undegraded":"2023-12-16T00:02:10.020629+0000","last_fullsized":"2023-12-16T00:02:10.020629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237522+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237522+0000","last_peered":"2023-12-16T00:02:34.237522+0000","last_clean":"2023-12-16T00:02:34.237522+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237522+0000","last_undegraded":"2023-12-16T00:02:34.237522+0000","last_fullsized":"2023-12-16T00:02:34.237522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":400,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418894+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:01:10.418894+0000","last_peered":"2023-12-16T00:01:10.418894+0000","last_clean":"2023-12-16T00:01:10.418894+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:01:10.418894+0000","last_undegraded":"2023-12-16T00:01:10.418894+0000","last_fullsized":"2023-12-16T00:01:10.418894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:10.252767+0000","last_change":"2023-12-16T00:04:10.252786+0000","last_active":"2023-12-16T00:04:10.252767+0000","last_peered":"2023-12-16T00:04:10.252767+0000","last_clean":"2023-12-16T00:04:10.252767+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:04:10.252767+0000","last_undegraded":"2023-12-16T00:04:10.252767+0000","last_fullsized":"2023-12-16T00:04:10.252767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_clean_scrub_stamp":"2023-12-16T00:04:10.252705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:05.754592+0000","scrub_duration":0.00085390599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.202961+0000","last_change":"2023-12-16T00:03:57.202995+0000","last_active":"2023-12-16T00:03:57.202961+0000","last_peered":"2023-12-16T00:03:57.202961+0000","last_clean":"2023-12-16T00:03:57.202961+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:03:57.202961+0000","last_undegraded":"2023-12-16T00:03:57.202961+0000","last_fullsized":"2023-12-16T00:03:57.202961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.202889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:46:43.817306+0000","scrub_duration":0.001274428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483652+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483652+0000","last_peered":"2023-12-16T00:03:15.483652+0000","last_clean":"2023-12-16T00:03:15.483652+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483652+0000","last_undegraded":"2023-12-16T00:03:15.483652+0000","last_fullsized":"2023-12-16T00:03:15.483652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425544+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425544+0000","last_peered":"2023-12-16T00:03:09.425544+0000","last_clean":"2023-12-16T00:03:09.425544+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425544+0000","last_undegraded":"2023-12-16T00:03:09.425544+0000","last_fullsized":"2023-12-16T00:03:09.425544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374415+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374415+0000","last_peered":"2023-12-16T00:03:18.374415+0000","last_clean":"2023-12-16T00:03:18.374415+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374415+0000","last_undegraded":"2023-12-16T00:03:18.374415+0000","last_fullsized":"2023-12-16T00:03:18.374415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183034+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183034+0000","last_peered":"2023-12-16T00:03:26.183034+0000","last_clean":"2023-12-16T00:03:26.183034+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183034+0000","last_undegraded":"2023-12-16T00:03:26.183034+0000","last_fullsized":"2023-12-16T00:03:26.183034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136647+0000","last_change":"2023-12-15T22:52:55.191615+0000","last_active":"2023-12-16T00:00:28.136647+0000","last_peered":"2023-12-16T00:00:28.136647+0000","last_clean":"2023-12-16T00:00:28.136647+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:00:28.136647+0000","last_undegraded":"2023-12-16T00:00:28.136647+0000","last_fullsized":"2023-12-16T00:00:28.136647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.568117+0000","last_change":"2023-12-16T00:03:51.568117+0000","last_active":"2023-12-16T00:03:51.568117+0000","last_peered":"2023-12-16T00:03:51.568117+0000","last_clean":"2023-12-16T00:03:51.568117+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:03:51.568117+0000","last_undegraded":"2023-12-16T00:03:51.568117+0000","last_fullsized":"2023-12-16T00:03:51.568117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.568038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:22:26.529802+0000","scrub_duration":0.00091025800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605022+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605022+0000","last_peered":"2023-12-16T00:03:27.605022+0000","last_clean":"2023-12-16T00:03:27.605022+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605022+0000","last_undegraded":"2023-12-16T00:03:27.605022+0000","last_fullsized":"2023-12-16T00:03:27.605022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.429819+0000","last_change":"2023-12-15T22:52:53.177707+0000","last_active":"2023-12-16T00:01:55.429819+0000","last_peered":"2023-12-16T00:01:55.429819+0000","last_clean":"2023-12-16T00:01:55.429819+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:01:55.429819+0000","last_undegraded":"2023-12-16T00:01:55.429819+0000","last_fullsized":"2023-12-16T00:01:55.429819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246579+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246579+0000","last_peered":"2023-12-16T00:03:24.246579+0000","last_clean":"2023-12-16T00:03:24.246579+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246579+0000","last_undegraded":"2023-12-16T00:03:24.246579+0000","last_fullsized":"2023-12-16T00:03:24.246579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:04.360759+0000","last_change":"2023-12-16T00:04:04.360778+0000","last_active":"2023-12-16T00:04:04.360759+0000","last_peered":"2023-12-16T00:04:04.360759+0000","last_clean":"2023-12-16T00:04:04.360759+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:04:04.360759+0000","last_undegraded":"2023-12-16T00:04:04.360759+0000","last_fullsized":"2023-12-16T00:04:04.360759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_clean_scrub_stamp":"2023-12-16T00:04:04.360695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:36:29.949685+0000","scrub_duration":0.0010605300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427796+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427796+0000","last_peered":"2023-12-16T00:03:03.427796+0000","last_clean":"2023-12-16T00:03:03.427796+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427796+0000","last_undegraded":"2023-12-16T00:03:03.427796+0000","last_fullsized":"2023-12-16T00:03:03.427796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.468765+0000","last_change":"2023-12-16T00:04:05.468783+0000","last_active":"2023-12-16T00:04:05.468765+0000","last_peered":"2023-12-16T00:04:05.468765+0000","last_clean":"2023-12-16T00:04:05.468765+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:04:05.468765+0000","last_undegraded":"2023-12-16T00:04:05.468765+0000","last_fullsized":"2023-12-16T00:04:05.468765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.468702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:14.473558+0000","scrub_duration":0.00092584000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:50.574499+0000","last_change":"2023-12-16T00:03:50.574518+0000","last_active":"2023-12-16T00:03:50.574499+0000","last_peered":"2023-12-16T00:03:50.574499+0000","last_clean":"2023-12-16T00:03:50.574499+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:03:50.574499+0000","last_undegraded":"2023-12-16T00:03:50.574499+0000","last_fullsized":"2023-12-16T00:03:50.574499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_clean_scrub_stamp":"2023-12-16T00:03:50.574437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.601730+0000","scrub_duration":0.00092257299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388607+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388607+0000","last_peered":"2023-12-16T00:03:15.388607+0000","last_clean":"2023-12-16T00:03:15.388607+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388607+0000","last_undegraded":"2023-12-16T00:03:15.388607+0000","last_fullsized":"2023-12-16T00:03:15.388607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.416013+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.416013+0000","last_peered":"2023-12-16T00:03:16.416013+0000","last_clean":"2023-12-16T00:03:16.416013+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.416013+0000","last_undegraded":"2023-12-16T00:03:16.416013+0000","last_fullsized":"2023-12-16T00:03:16.416013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.232649+0000","last_change":"2023-12-16T00:03:35.232670+0000","last_active":"2023-12-16T00:03:35.232649+0000","last_peered":"2023-12-16T00:03:35.232649+0000","last_clean":"2023-12-16T00:03:35.232649+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:03:35.232649+0000","last_undegraded":"2023-12-16T00:03:35.232649+0000","last_fullsized":"2023-12-16T00:03:35.232649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.232583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:43.491905+0000","scrub_duration":0.001170903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.940236+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:00:51.940236+0000","last_peered":"2023-12-16T00:00:51.940236+0000","last_clean":"2023-12-16T00:00:51.940236+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:00:51.940236+0000","last_undegraded":"2023-12-16T00:00:51.940236+0000","last_fullsized":"2023-12-16T00:00:51.940236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.161808+0000","last_change":"2023-12-16T00:03:55.161826+0000","last_active":"2023-12-16T00:03:55.161808+0000","last_peered":"2023-12-16T00:03:55.161808+0000","last_clean":"2023-12-16T00:03:55.161808+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:03:55.161808+0000","last_undegraded":"2023-12-16T00:03:55.161808+0000","last_fullsized":"2023-12-16T00:03:55.161808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.161744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:39.312326+0000","scrub_duration":0.00093413199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":161,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.691584+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:01:43.691584+0000","last_peered":"2023-12-16T00:01:43.691584+0000","last_clean":"2023-12-16T00:01:43.691584+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:01:43.691584+0000","last_undegraded":"2023-12-16T00:01:43.691584+0000","last_fullsized":"2023-12-16T00:01:43.691584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015739+0000","last_change":"2023-12-15T22:52:53.176539+0000","last_active":"2023-12-16T00:00:26.015739+0000","last_peered":"2023-12-16T00:00:26.015739+0000","last_clean":"2023-12-16T00:00:26.015739+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:00:26.015739+0000","last_undegraded":"2023-12-16T00:00:26.015739+0000","last_fullsized":"2023-12-16T00:00:26.015739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:41.271632+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:00:41.271632+0000","last_peered":"2023-12-16T00:00:41.271632+0000","last_clean":"2023-12-16T00:00:41.271632+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:00:41.271632+0000","last_undegraded":"2023-12-16T00:00:41.271632+0000","last_fullsized":"2023-12-16T00:00:41.271632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":247,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.925127+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:00:48.925127+0000","last_peered":"2023-12-16T00:00:48.925127+0000","last_clean":"2023-12-16T00:00:48.925127+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:00:48.925127+0000","last_undegraded":"2023-12-16T00:00:48.925127+0000","last_fullsized":"2023-12-16T00:00:48.925127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.297264+0000","last_change":"2023-12-16T00:03:49.297285+0000","last_active":"2023-12-16T00:03:49.297264+0000","last_peered":"2023-12-16T00:03:49.297264+0000","last_clean":"2023-12-16T00:03:49.297264+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:03:49.297264+0000","last_undegraded":"2023-12-16T00:03:49.297264+0000","last_fullsized":"2023-12-16T00:03:49.297264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.297202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:12.808001+0000","scrub_duration":0.001104505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.015869+0000","last_change":"2023-12-15T22:52:53.173784+0000","last_active":"2023-12-16T00:00:26.015869+0000","last_peered":"2023-12-16T00:00:26.015869+0000","last_clean":"2023-12-16T00:00:26.015869+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:00:26.015869+0000","last_undegraded":"2023-12-16T00:00:26.015869+0000","last_fullsized":"2023-12-16T00:00:26.015869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469761+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469761+0000","last_peered":"2023-12-16T00:03:07.469761+0000","last_clean":"2023-12-16T00:03:07.469761+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469761+0000","last_undegraded":"2023-12-16T00:03:07.469761+0000","last_fullsized":"2023-12-16T00:03:07.469761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.880758+0000","last_change":"2023-12-16T00:03:34.880778+0000","last_active":"2023-12-16T00:03:34.880758+0000","last_peered":"2023-12-16T00:03:34.880758+0000","last_clean":"2023-12-16T00:03:34.880758+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:03:34.880758+0000","last_undegraded":"2023-12-16T00:03:34.880758+0000","last_fullsized":"2023-12-16T00:03:34.880758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.880692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:10.519008+0000","scrub_duration":0.00091466200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431217+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431217+0000","last_peered":"2023-12-16T00:03:20.431217+0000","last_clean":"2023-12-16T00:03:20.431217+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431217+0000","last_undegraded":"2023-12-16T00:03:20.431217+0000","last_fullsized":"2023-12-16T00:03:20.431217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.559821+0000","last_change":"2023-12-16T00:03:46.559841+0000","last_active":"2023-12-16T00:03:46.559821+0000","last_peered":"2023-12-16T00:03:46.559821+0000","last_clean":"2023-12-16T00:03:46.559821+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:03:46.559821+0000","last_undegraded":"2023-12-16T00:03:46.559821+0000","last_fullsized":"2023-12-16T00:03:46.559821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.559754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:04.114550+0000","scrub_duration":0.0010144640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328107+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328107+0000","last_peered":"2023-12-16T00:03:29.328107+0000","last_clean":"2023-12-16T00:03:29.328107+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328107+0000","last_undegraded":"2023-12-16T00:03:29.328107+0000","last_fullsized":"2023-12-16T00:03:29.328107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409528+0000","last_change":"2023-12-15T22:52:53.174676+0000","last_active":"2023-12-16T00:00:35.409528+0000","last_peered":"2023-12-16T00:00:35.409528+0000","last_clean":"2023-12-16T00:00:35.409528+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:00:35.409528+0000","last_undegraded":"2023-12-16T00:00:35.409528+0000","last_fullsized":"2023-12-16T00:00:35.409528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408164+0000","last_change":"2023-12-15T22:52:53.176395+0000","last_active":"2023-12-16T00:00:35.408164+0000","last_peered":"2023-12-16T00:00:35.408164+0000","last_clean":"2023-12-16T00:00:35.408164+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:00:35.408164+0000","last_undegraded":"2023-12-16T00:00:35.408164+0000","last_fullsized":"2023-12-16T00:00:35.408164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.075972+0000","last_change":"2023-12-16T00:03:49.075991+0000","last_active":"2023-12-16T00:03:49.075972+0000","last_peered":"2023-12-16T00:03:49.075972+0000","last_clean":"2023-12-16T00:03:49.075972+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:03:49.075972+0000","last_undegraded":"2023-12-16T00:03:49.075972+0000","last_fullsized":"2023-12-16T00:03:49.075972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.075896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:14.857673+0000","scrub_duration":0.0010048839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.628015+0000","last_change":"2023-12-15T22:52:53.176111+0000","last_active":"2023-12-16T00:00:35.628015+0000","last_peered":"2023-12-16T00:00:35.628015+0000","last_clean":"2023-12-16T00:00:35.628015+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:00:35.628015+0000","last_undegraded":"2023-12-16T00:00:35.628015+0000","last_fullsized":"2023-12-16T00:00:35.628015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409418+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:35.409418+0000","last_peered":"2023-12-16T00:00:35.409418+0000","last_clean":"2023-12-16T00:00:35.409418+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:35.409418+0000","last_undegraded":"2023-12-16T00:00:35.409418+0000","last_fullsized":"2023-12-16T00:00:35.409418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237891,"num_omap_keys":906,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4352,"ondisk_log_size":4352,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2383,"ondisk_log_size":2383,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":898,"ondisk_log_size":898,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608422,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":0.72199999999999998,"15min":1.004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":1.044},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.54400000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.374,"15min":0.373},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.57899999999999996,"15min":1.149},"last":0.438},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63},"last":0.496}]}]},{"osd":5,"up_from":11,"seq":47244641124,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.747},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.879},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.622}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.37},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.61099999999999999,"15min":0.754},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26100000000000001},"max":{"1min":0.50700000000000001,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.37}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.31,"5min":0.307,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.40600000000000003}]}]},{"osd":3,"up_from":11,"seq":47244641126,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.27400000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69299999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":1.25,"15min":1.25},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.379,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Dec 16 00:03:58 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.439},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.62,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54000000000000004}]}]},{"osd":2,"up_from":11,"seq":47244641123,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.32200000000000001},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45400000000000001,"5min":0.55500000000000005,"15min":1.0169999999999999},"last":0.25},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33500000000000002},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.41199999999999998,"5min":0.55400000000000005,"15min":0.87},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33900000000000002},"min":{"1min":0.23300000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.40999999999999998,"5min":0.50800000000000001,"15min":0.88900000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.436,"5min":0.52400000000000002,"15min":1.2769999999999999},"last":0.35099999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.72999999999999998,"5min":0.83199999999999996,"15min":1.2450000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.97999999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":1.2190000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":1.169},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.4670000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.91000000000000003},"last":0.64500000000000002}]}]},{"osd":1,"up_from":11,"seq":47244641124,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.312,"15min":0.316},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.437,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.34100000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.80100000000000005},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.52200000000000002},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48899999999999999,"5min":0.504,"15min":0.504},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.71999999999999997,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.64700000000000002,"5min":0.71099999999999997,"15min":0.75700000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.44900000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.755,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.878},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.65800000000000003}]}]},{"osd":0,"up_from":11,"seq":47244641124,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.316,"15min":0.316},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40600000000000003,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.33700000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.47099999999999997,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.42799999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.441}]},{"osd":3,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.83599999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.78300000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.875},"last":0.50800000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.496},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:04:13.503 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.504 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.504 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.504 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.505 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.505 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.505 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.505 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.506 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.506 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.506 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.506 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.507 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.507 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.507 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.507 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.508 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.508 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.508 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.509 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.509 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.509 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.510 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.510 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.510 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.510 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.511 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.511 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.511 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.512 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.512 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.512 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.512 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.512 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.513 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.513 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.513 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.514 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.514 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.514 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.515 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.515 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.515 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.515 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.515 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.516 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.516 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.516 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.516 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.517 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.517 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.517 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.517 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.518 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.518 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.518 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.519 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.519 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.519 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.519 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.520 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.520 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.520 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.521 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.521 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.521 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.522 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.522 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.522 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.522 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.523 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.523 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.523 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.523 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:13.523 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:04:33.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:04:33.863 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:04:33.889 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:04:33.893 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2222,"stamp":"2023-12-16T00:04:32.292761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":933840,"num_omap_keys":4044,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36582,"ondisk_log_size":36582,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":307928,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":298038,"kb_avail":628837672,"statfs":{"total":644245094400,"available":643929776128,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":305191585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16541,"num_omap_keys":63,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005604"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358393+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358393+0000","last_peered":"2023-12-16T00:03:26.358393+0000","last_clean":"2023-12-16T00:03:26.358393+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358393+0000","last_undegraded":"2023-12-16T00:03:26.358393+0000","last_fullsized":"2023-12-16T00:03:26.358393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.880866+0000","last_change":"2023-12-16T00:03:59.880889+0000","last_active":"2023-12-16T00:03:59.880866+0000","last_peered":"2023-12-16T00:03:59.880866+0000","last_clean":"2023-12-16T00:03:59.880866+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:03:59.880866+0000","last_undegraded":"2023-12-16T00:03:59.880866+0000","last_fullsized":"2023-12-16T00:03:59.880866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.880808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:54.155437+0000","scrub_duration":0.00089921599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.541603+0000","last_change":"2023-12-16T00:04:07.541622+0000","last_active":"2023-12-16T00:04:07.541603+0000","last_peered":"2023-12-16T00:04:07.541603+0000","last_clean":"2023-12-16T00:04:07.541603+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:04:07.541603+0000","last_undegraded":"2023-12-16T00:04:07.541603+0000","last_fullsized":"2023-12-16T00:04:07.541603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.541533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:44.090049+0000","scrub_duration":0.0010501169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408466+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:21.408466+0000","last_peered":"2023-12-16T00:01:21.408466+0000","last_clean":"2023-12-16T00:01:21.408466+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:21.408466+0000","last_undegraded":"2023-12-16T00:01:21.408466+0000","last_fullsized":"2023-12-16T00:01:21.408466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.563813+0000","last_change":"2023-12-16T00:03:53.563813+0000","last_active":"2023-12-16T00:03:53.563813+0000","last_peered":"2023-12-16T00:03:53.563813+0000","last_clean":"2023-12-16T00:03:53.563813+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:03:53.563813+0000","last_undegraded":"2023-12-16T00:03:53.563813+0000","last_fullsized":"2023-12-16T00:03:53.563813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.563736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:33.029870+0000","scrub_duration":0.00070934700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:01.884589+0000","last_change":"2023-12-16T00:04:01.884628+0000","last_active":"2023-12-16T00:04:01.884589+0000","last_peered":"2023-12-16T00:04:01.884589+0000","last_clean":"2023-12-16T00:04:01.884589+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:04:01.884589+0000","last_undegraded":"2023-12-16T00:04:01.884589+0000","last_fullsized":"2023-12-16T00:04:01.884589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_clean_scrub_stamp":"2023-12-16T00:04:01.884510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:50.547528+0000","scrub_duration":0.00152728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.245549+0000","last_change":"2023-12-16T00:03:58.245569+0000","last_active":"2023-12-16T00:03:58.245549+0000","last_peered":"2023-12-16T00:03:58.245549+0000","last_clean":"2023-12-16T00:03:58.245549+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:03:58.245549+0000","last_undegraded":"2023-12-16T00:03:58.245549+0000","last_fullsized":"2023-12-16T00:03:58.245549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.245495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:53:53.747382+0000","scrub_duration":0.00088301999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.295639+0000","last_change":"2023-12-16T00:03:51.295660+0000","last_active":"2023-12-16T00:03:51.295639+0000","last_peered":"2023-12-16T00:03:51.295639+0000","last_clean":"2023-12-16T00:03:51.295639+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:03:51.295639+0000","last_undegraded":"2023-12-16T00:03:51.295639+0000","last_fullsized":"2023-12-16T00:03:51.295639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.295576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:17.077353+0000","scrub_duration":0.0012592949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.850192+0000","last_change":"2023-12-16T00:04:11.850226+0000","last_active":"2023-12-16T00:04:11.850192+0000","last_peered":"2023-12-16T00:04:11.850192+0000","last_clean":"2023-12-16T00:04:11.850192+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:04:11.850192+0000","last_undegraded":"2023-12-16T00:04:11.850192+0000","last_fullsized":"2023-12-16T00:04:11.850192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.850125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:35.360924+0000","scrub_duration":0.0015218740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136544+0000","last_change":"2023-12-15T22:52:53.171062+0000","last_active":"2023-12-16T00:00:28.136544+0000","last_peered":"2023-12-16T00:00:28.136544+0000","last_clean":"2023-12-16T00:00:28.136544+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:00:28.136544+0000","last_undegraded":"2023-12-16T00:00:28.136544+0000","last_fullsized":"2023-12-16T00:00:28.136544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477835+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477835+0000","last_peered":"2023-12-16T00:03:06.477835+0000","last_clean":"2023-12-16T00:03:06.477835+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477835+0000","last_undegraded":"2023-12-16T00:03:06.477835+0000","last_fullsized":"2023-12-16T00:03:06.477835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288014+0000","last_change":"2023-12-15T22:52:53.170328+0000","last_active":"2023-12-16T00:00:27.288014+0000","last_peered":"2023-12-16T00:00:27.288014+0000","last_clean":"2023-12-16T00:00:27.288014+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:00:27.288014+0000","last_undegraded":"2023-12-16T00:00:27.288014+0000","last_fullsized":"2023-12-16T00:00:27.288014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.779040+0000","last_change":"2023-12-16T00:04:21.779060+0000","last_active":"2023-12-16T00:04:21.779040+0000","last_peered":"2023-12-16T00:04:21.779040+0000","last_clean":"2023-12-16T00:04:21.779040+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:04:21.779040+0000","last_undegraded":"2023-12-16T00:04:21.779040+0000","last_fullsized":"2023-12-16T00:04:21.779040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.778969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:05.929551+0000","scrub_duration":0.001213221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408096+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:21.408096+0000","last_peered":"2023-12-16T00:01:21.408096+0000","last_clean":"2023-12-16T00:01:21.408096+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:21.408096+0000","last_undegraded":"2023-12-16T00:01:21.408096+0000","last_fullsized":"2023-12-16T00:01:21.408096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:45.193861+0000","last_change":"2023-12-16T00:03:45.193882+0000","last_active":"2023-12-16T00:03:45.193861+0000","last_peered":"2023-12-16T00:03:45.193861+0000","last_clean":"2023-12-16T00:03:45.193861+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:03:45.193861+0000","last_undegraded":"2023-12-16T00:03:45.193861+0000","last_fullsized":"2023-12-16T00:03:45.193861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:45.193798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:27.535599+0000","scrub_duration":0.0012721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629295+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629295+0000","last_peered":"2023-12-16T00:02:46.629295+0000","last_clean":"2023-12-16T00:02:46.629295+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629295+0000","last_undegraded":"2023-12-16T00:02:46.629295+0000","last_fullsized":"2023-12-16T00:02:46.629295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434834+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:02:10.434834+0000","last_peered":"2023-12-16T00:02:10.434834+0000","last_clean":"2023-12-16T00:02:10.434834+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:02:10.434834+0000","last_undegraded":"2023-12-16T00:02:10.434834+0000","last_fullsized":"2023-12-16T00:02:10.434834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426875+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:01:40.426875+0000","last_peered":"2023-12-16T00:01:40.426875+0000","last_clean":"2023-12-16T00:01:40.426875+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:01:40.426875+0000","last_undegraded":"2023-12-16T00:01:40.426875+0000","last_fullsized":"2023-12-16T00:01:40.426875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.099235+0000","last_change":"2023-12-16T00:03:44.099255+0000","last_active":"2023-12-16T00:03:44.099235+0000","last_peered":"2023-12-16T00:03:44.099235+0000","last_clean":"2023-12-16T00:03:44.099235+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:03:44.099235+0000","last_undegraded":"2023-12-16T00:03:44.099235+0000","last_fullsized":"2023-12-16T00:03:44.099235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.099172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:07.211984+0000","scrub_duration":0.0012518329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418586+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:02:10.418586+0000","last_peered":"2023-12-16T00:02:10.418586+0000","last_clean":"2023-12-16T00:02:10.418586+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:02:10.418586+0000","last_undegraded":"2023-12-16T00:02:10.418586+0000","last_fullsized":"2023-12-16T00:02:10.418586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.876980+0000","last_change":"2023-12-16T00:04:05.877000+0000","last_active":"2023-12-16T00:04:05.876980+0000","last_peered":"2023-12-16T00:04:05.876980+0000","last_clean":"2023-12-16T00:04:05.876980+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:04:05.876980+0000","last_undegraded":"2023-12-16T00:04:05.876980+0000","last_fullsized":"2023-12-16T00:04:05.876980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.876880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:41.515195+0000","scrub_duration":0.0014092810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:06.850990+0000","last_change":"2023-12-16T00:04:06.851033+0000","last_active":"2023-12-16T00:04:06.850990+0000","last_peered":"2023-12-16T00:04:06.850990+0000","last_clean":"2023-12-16T00:04:06.850990+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:04:06.850990+0000","last_undegraded":"2023-12-16T00:04:06.850990+0000","last_fullsized":"2023-12-16T00:04:06.850990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_clean_scrub_stamp":"2023-12-16T00:04:06.850910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:25.908040+0000","scrub_duration":0.00097751000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418502+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:02:10.418502+0000","last_peered":"2023-12-16T00:02:10.418502+0000","last_clean":"2023-12-16T00:02:10.418502+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:02:10.418502+0000","last_undegraded":"2023-12-16T00:02:10.418502+0000","last_fullsized":"2023-12-16T00:02:10.418502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.493314+0000","last_change":"2023-12-16T00:03:36.493334+0000","last_active":"2023-12-16T00:03:36.493314+0000","last_peered":"2023-12-16T00:03:36.493314+0000","last_clean":"2023-12-16T00:03:36.493314+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:03:36.493314+0000","last_undegraded":"2023-12-16T00:03:36.493314+0000","last_fullsized":"2023-12-16T00:03:36.493314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.493246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:53.796792+0000","scrub_duration":0.00093940400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.104306+0000","last_change":"2023-12-16T00:03:53.104323+0000","last_active":"2023-12-16T00:03:53.104306+0000","last_peered":"2023-12-16T00:03:53.104306+0000","last_clean":"2023-12-16T00:03:53.104306+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:03:53.104306+0000","last_undegraded":"2023-12-16T00:03:53.104306+0000","last_fullsized":"2023-12-16T00:03:53.104306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.104258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:09.066868+0000","scrub_duration":0.0012952809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.208542+0000","last_change":"2023-12-16T00:04:00.208562+0000","last_active":"2023-12-16T00:04:00.208542+0000","last_peered":"2023-12-16T00:04:00.208542+0000","last_clean":"2023-12-16T00:04:00.208542+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:04:00.208542+0000","last_undegraded":"2023-12-16T00:04:00.208542+0000","last_fullsized":"2023-12-16T00:04:00.208542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.208477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:00.531527+0000","scrub_duration":0.00086714300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.631082+0000","last_change":"2023-12-15T23:08:37.337949+0000","last_active":"2023-12-16T00:00:45.631082+0000","last_peered":"2023-12-16T00:00:45.631082+0000","last_clean":"2023-12-16T00:00:45.631082+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:00:45.631082+0000","last_undegraded":"2023-12-16T00:00:45.631082+0000","last_fullsized":"2023-12-16T00:00:45.631082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'101","reported_seq":1696,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.438148+0000","last_change":"2023-12-15T22:54:04.180940+0000","last_active":"2023-12-16T00:02:20.438148+0000","last_peered":"2023-12-16T00:02:20.438148+0000","last_clean":"2023-12-16T00:02:20.438148+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:02:20.438148+0000","last_undegraded":"2023-12-16T00:02:20.438148+0000","last_fullsized":"2023-12-16T00:02:20.438148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411398+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411398+0000","last_peered":"2023-12-16T00:02:07.411398+0000","last_clean":"2023-12-16T00:02:07.411398+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411398+0000","last_undegraded":"2023-12-16T00:02:07.411398+0000","last_fullsized":"2023-12-16T00:02:07.411398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'7","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289078+0000","last_change":"2023-12-15T22:55:02.196154+0000","last_active":"2023-12-16T00:00:27.289078+0000","last_peered":"2023-12-16T00:00:27.289078+0000","last_clean":"2023-12-16T00:00:27.289078+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:00:27.289078+0000","last_undegraded":"2023-12-16T00:00:27.289078+0000","last_fullsized":"2023-12-16T00:00:27.289078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:31.164225+0000","last_clean_scrub_stamp":"2023-12-15T22:53:31.164225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620322+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620322+0000","last_peered":"2023-12-16T00:02:06.620322+0000","last_clean":"2023-12-16T00:02:06.620322+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620322+0000","last_undegraded":"2023-12-16T00:02:06.620322+0000","last_fullsized":"2023-12-16T00:02:06.620322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.542129+0000","last_change":"2023-12-16T00:03:49.542149+0000","last_active":"2023-12-16T00:03:49.542129+0000","last_peered":"2023-12-16T00:03:49.542129+0000","last_clean":"2023-12-16T00:03:49.542129+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:03:49.542129+0000","last_undegraded":"2023-12-16T00:03:49.542129+0000","last_fullsized":"2023-12-16T00:03:49.542129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.542068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:12.196084+0000","scrub_duration":0.0010559110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408467+0000","last_change":"2023-12-15T22:52:53.175752+0000","last_active":"2023-12-16T00:00:35.408467+0000","last_peered":"2023-12-16T00:00:35.408467+0000","last_clean":"2023-12-16T00:00:35.408467+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:00:35.408467+0000","last_undegraded":"2023-12-16T00:00:35.408467+0000","last_fullsized":"2023-12-16T00:00:35.408467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.157297+0000","last_change":"2023-12-16T00:03:31.157320+0000","last_active":"2023-12-16T00:03:31.157297+0000","last_peered":"2023-12-16T00:03:31.157297+0000","last_clean":"2023-12-16T00:03:31.157297+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:03:31.157297+0000","last_undegraded":"2023-12-16T00:03:31.157297+0000","last_fullsized":"2023-12-16T00:03:31.157297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.157241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:58:18.132539+0000","scrub_duration":0.0024345880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.103862+0000","last_change":"2023-12-16T00:03:59.103882+0000","last_active":"2023-12-16T00:03:59.103862+0000","last_peered":"2023-12-16T00:03:59.103862+0000","last_clean":"2023-12-16T00:03:59.103862+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:03:59.103862+0000","last_undegraded":"2023-12-16T00:03:59.103862+0000","last_fullsized":"2023-12-16T00:03:59.103862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.103798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:15.216322+0000","scrub_duration":0.001606133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886912+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886912+0000","last_peered":"2023-12-16T00:01:52.886912+0000","last_clean":"2023-12-16T00:01:52.886912+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886912+0000","last_undegraded":"2023-12-16T00:01:52.886912+0000","last_fullsized":"2023-12-16T00:01:52.886912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118199+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118199+0000","last_peered":"2023-12-16T00:02:20.118199+0000","last_clean":"2023-12-16T00:02:20.118199+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118199+0000","last_undegraded":"2023-12-16T00:02:20.118199+0000","last_fullsized":"2023-12-16T00:02:20.118199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.770654+0000","last_change":"2023-12-16T00:04:19.770689+0000","last_active":"2023-12-16T00:04:19.770654+0000","last_peered":"2023-12-16T00:04:19.770654+0000","last_clean":"2023-12-16T00:04:19.770654+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:04:19.770654+0000","last_undegraded":"2023-12-16T00:04:19.770654+0000","last_fullsized":"2023-12-16T00:04:19.770654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:20.747565+0000","scrub_duration":0.00081478900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.613484+0000","last_change":"2023-12-16T00:04:21.613504+0000","last_active":"2023-12-16T00:04:21.613484+0000","last_peered":"2023-12-16T00:04:21.613484+0000","last_clean":"2023-12-16T00:04:21.613484+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:04:21.613484+0000","last_undegraded":"2023-12-16T00:04:21.613484+0000","last_fullsized":"2023-12-16T00:04:21.613484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.613416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:35:24.089617+0000","scrub_duration":0.0013326939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"49'6","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415589+0000","last_change":"2023-12-15T22:53:04.316843+0000","last_active":"2023-12-16T00:01:00.415589+0000","last_peered":"2023-12-16T00:01:00.415589+0000","last_clean":"2023-12-16T00:01:00.415589+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:01:00.415589+0000","last_undegraded":"2023-12-16T00:01:00.415589+0000","last_fullsized":"2023-12-16T00:01:00.415589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:03.292619+0000","last_clean_scrub_stamp":"2023-12-15T22:53:03.292619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.863793+0000","last_change":"2023-12-16T00:04:25.863829+0000","last_active":"2023-12-16T00:04:25.863793+0000","last_peered":"2023-12-16T00:04:25.863793+0000","last_clean":"2023-12-16T00:04:25.863793+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:04:25.863793+0000","last_undegraded":"2023-12-16T00:04:25.863793+0000","last_fullsized":"2023-12-16T00:04:25.863793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.863725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:26.840711+0000","scrub_duration":0.00098527300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'69","reported_seq":1108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425019+0000","last_change":"2023-12-15T22:54:04.186634+0000","last_active":"2023-12-16T00:01:35.425019+0000","last_peered":"2023-12-16T00:01:35.425019+0000","last_clean":"2023-12-16T00:01:35.425019+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:01:35.425019+0000","last_undegraded":"2023-12-16T00:01:35.425019+0000","last_fullsized":"2023-12-16T00:01:35.425019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.842572+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:01:24.842572+0000","last_peered":"2023-12-16T00:01:24.842572+0000","last_clean":"2023-12-16T00:01:24.842572+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:01:24.842572+0000","last_undegraded":"2023-12-16T00:01:24.842572+0000","last_fullsized":"2023-12-16T00:01:24.842572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.414205+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:46.414205+0000","last_peered":"2023-12-16T00:01:46.414205+0000","last_clean":"2023-12-16T00:01:46.414205+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:46.414205+0000","last_undegraded":"2023-12-16T00:01:46.414205+0000","last_fullsized":"2023-12-16T00:01:46.414205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.422218+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.422218+0000","last_peered":"2023-12-16T00:01:25.422218+0000","last_clean":"2023-12-16T00:01:25.422218+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.422218+0000","last_undegraded":"2023-12-16T00:01:25.422218+0000","last_fullsized":"2023-12-16T00:01:25.422218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403853+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:01:10.403853+0000","last_peered":"2023-12-16T00:01:10.403853+0000","last_clean":"2023-12-16T00:01:10.403853+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:01:10.403853+0000","last_undegraded":"2023-12-16T00:01:10.403853+0000","last_fullsized":"2023-12-16T00:01:10.403853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408273+0000","last_change":"2023-12-15T22:52:53.173433+0000","last_active":"2023-12-16T00:00:35.408273+0000","last_peered":"2023-12-16T00:00:35.408273+0000","last_clean":"2023-12-16T00:00:35.408273+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:00:35.408273+0000","last_undegraded":"2023-12-16T00:00:35.408273+0000","last_fullsized":"2023-12-16T00:00:35.408273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.636643+0000","last_change":"2023-12-15T23:08:37.341084+0000","last_active":"2023-12-16T00:01:10.636643+0000","last_peered":"2023-12-16T00:01:10.636643+0000","last_clean":"2023-12-16T00:01:10.636643+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:01:10.636643+0000","last_undegraded":"2023-12-16T00:01:10.636643+0000","last_fullsized":"2023-12-16T00:01:10.636643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1029,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304253+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304253+0000","last_peered":"2023-12-16T00:02:29.304253+0000","last_clean":"2023-12-16T00:02:29.304253+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304253+0000","last_undegraded":"2023-12-16T00:02:29.304253+0000","last_fullsized":"2023-12-16T00:02:29.304253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.422119+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:02:16.422119+0000","last_peered":"2023-12-16T00:02:16.422119+0000","last_clean":"2023-12-16T00:02:16.422119+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:02:16.422119+0000","last_undegraded":"2023-12-16T00:02:16.422119+0000","last_fullsized":"2023-12-16T00:02:16.422119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.438339+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:20.438339+0000","last_peered":"2023-12-16T00:02:20.438339+0000","last_clean":"2023-12-16T00:02:20.438339+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:20.438339+0000","last_undegraded":"2023-12-16T00:02:20.438339+0000","last_fullsized":"2023-12-16T00:02:20.438339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403828+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:01:10.403828+0000","last_peered":"2023-12-16T00:01:10.403828+0000","last_clean":"2023-12-16T00:01:10.403828+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:01:10.403828+0000","last_undegraded":"2023-12-16T00:01:10.403828+0000","last_fullsized":"2023-12-16T00:01:10.403828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638510+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:20.638510+0000","last_peered":"2023-12-16T00:01:20.638510+0000","last_clean":"2023-12-16T00:01:20.638510+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:20.638510+0000","last_undegraded":"2023-12-16T00:01:20.638510+0000","last_fullsized":"2023-12-16T00:01:20.638510+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408763+0000","last_change":"2023-12-15T22:52:53.171204+0000","last_active":"2023-12-16T00:00:35.408763+0000","last_peered":"2023-12-16T00:00:35.408763+0000","last_clean":"2023-12-16T00:00:35.408763+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:00:35.408763+0000","last_undegraded":"2023-12-16T00:00:35.408763+0000","last_fullsized":"2023-12-16T00:00:35.408763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:08.841845+0000","last_change":"2023-12-16T00:04:08.841865+0000","last_active":"2023-12-16T00:04:08.841845+0000","last_peered":"2023-12-16T00:04:08.841845+0000","last_clean":"2023-12-16T00:04:08.841845+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:04:08.841845+0000","last_undegraded":"2023-12-16T00:04:08.841845+0000","last_fullsized":"2023-12-16T00:04:08.841845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_clean_scrub_stamp":"2023-12-16T00:04:08.841784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:19.871757+0000","scrub_duration":0.00090735399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.471939+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:18.471939+0000","last_peered":"2023-12-16T00:02:18.471939+0000","last_clean":"2023-12-16T00:02:18.471939+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:18.471939+0000","last_undegraded":"2023-12-16T00:02:18.471939+0000","last_fullsized":"2023-12-16T00:02:18.471939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413716+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:46.413716+0000","last_peered":"2023-12-16T00:01:46.413716+0000","last_clean":"2023-12-16T00:01:46.413716+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:46.413716+0000","last_undegraded":"2023-12-16T00:01:46.413716+0000","last_fullsized":"2023-12-16T00:01:46.413716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.437960+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:02:25.437960+0000","last_peered":"2023-12-16T00:02:25.437960+0000","last_clean":"2023-12-16T00:02:25.437960+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:02:25.437960+0000","last_undegraded":"2023-12-16T00:02:25.437960+0000","last_fullsized":"2023-12-16T00:02:25.437960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:02.272787+0000","last_change":"2023-12-16T00:04:02.272787+0000","last_active":"2023-12-16T00:04:02.272787+0000","last_peered":"2023-12-16T00:04:02.272787+0000","last_clean":"2023-12-16T00:04:02.272787+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:04:02.272787+0000","last_undegraded":"2023-12-16T00:04:02.272787+0000","last_fullsized":"2023-12-16T00:04:02.272787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_clean_scrub_stamp":"2023-12-16T00:04:02.272686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:18.235296+0000","scrub_duration":0.00092377500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.775781+0000","last_change":"2023-12-16T00:04:20.775800+0000","last_active":"2023-12-16T00:04:20.775781+0000","last_peered":"2023-12-16T00:04:20.775781+0000","last_clean":"2023-12-16T00:04:20.775781+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:04:20.775781+0000","last_undegraded":"2023-12-16T00:04:20.775781+0000","last_fullsized":"2023-12-16T00:04:20.775781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.775724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:36.738334+0000","scrub_duration":0.00087610900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":128,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:42.076754+0000","last_change":"2023-12-16T00:03:42.076798+0000","last_active":"2023-12-16T00:03:42.076754+0000","last_peered":"2023-12-16T00:03:42.076754+0000","last_clean":"2023-12-16T00:03:42.076754+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:03:42.076754+0000","last_undegraded":"2023-12-16T00:03:42.076754+0000","last_fullsized":"2023-12-16T00:03:42.076754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_clean_scrub_stamp":"2023-12-16T00:03:42.076689+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:57.373234+0000","scrub_duration":0.0028837759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214798+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214798+0000","last_peered":"2023-12-16T00:03:06.214798+0000","last_clean":"2023-12-16T00:03:06.214798+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214798+0000","last_undegraded":"2023-12-16T00:03:06.214798+0000","last_fullsized":"2023-12-16T00:03:06.214798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430630+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:55.430630+0000","last_peered":"2023-12-16T00:01:55.430630+0000","last_clean":"2023-12-16T00:01:55.430630+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:55.430630+0000","last_undegraded":"2023-12-16T00:01:55.430630+0000","last_fullsized":"2023-12-16T00:01:55.430630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436097+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:02:15.436097+0000","last_peered":"2023-12-16T00:02:15.436097+0000","last_clean":"2023-12-16T00:02:15.436097+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:02:15.436097+0000","last_undegraded":"2023-12-16T00:02:15.436097+0000","last_fullsized":"2023-12-16T00:02:15.436097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437602+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:20.437602+0000","last_peered":"2023-12-16T00:02:20.437602+0000","last_clean":"2023-12-16T00:02:20.437602+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:20.437602+0000","last_undegraded":"2023-12-16T00:02:20.437602+0000","last_fullsized":"2023-12-16T00:02:20.437602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650855+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:02:10.650855+0000","last_peered":"2023-12-16T00:02:10.650855+0000","last_clean":"2023-12-16T00:02:10.650855+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:02:10.650855+0000","last_undegraded":"2023-12-16T00:02:10.650855+0000","last_fullsized":"2023-12-16T00:02:10.650855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575247+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575247+0000","last_peered":"2023-12-16T00:03:30.575247+0000","last_clean":"2023-12-16T00:03:30.575247+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575247+0000","last_undegraded":"2023-12-16T00:03:30.575247+0000","last_fullsized":"2023-12-16T00:03:30.575247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.737621+0000","last_change":"2023-12-16T00:04:26.737657+0000","last_active":"2023-12-16T00:04:26.737621+0000","last_peered":"2023-12-16T00:04:26.737621+0000","last_clean":"2023-12-16T00:04:26.737621+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:04:26.737621+0000","last_undegraded":"2023-12-16T00:04:26.737621+0000","last_fullsized":"2023-12-16T00:04:26.737621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.737548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:13.351966+0000","scrub_duration":0.00090241200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":294,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470578+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470578+0000","last_peered":"2023-12-16T00:02:55.470578+0000","last_clean":"2023-12-16T00:02:55.470578+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470578+0000","last_undegraded":"2023-12-16T00:02:55.470578+0000","last_fullsized":"2023-12-16T00:02:55.470578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:11.420710+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:02:11.420710+0000","last_peered":"2023-12-16T00:02:11.420710+0000","last_clean":"2023-12-16T00:02:11.420710+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:02:11.420710+0000","last_undegraded":"2023-12-16T00:02:11.420710+0000","last_fullsized":"2023-12-16T00:02:11.420710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1700,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.420411+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:02:20.420411+0000","last_peered":"2023-12-16T00:02:20.420411+0000","last_clean":"2023-12-16T00:02:20.420411+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:02:20.420411+0000","last_undegraded":"2023-12-16T00:02:20.420411+0000","last_fullsized":"2023-12-16T00:02:20.420411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.115840+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:01.115840+0000","last_peered":"2023-12-16T00:02:01.115840+0000","last_clean":"2023-12-16T00:02:01.115840+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:01.115840+0000","last_undegraded":"2023-12-16T00:02:01.115840+0000","last_fullsized":"2023-12-16T00:02:01.115840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437806+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:20.437806+0000","last_peered":"2023-12-16T00:02:20.437806+0000","last_clean":"2023-12-16T00:02:20.437806+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:20.437806+0000","last_undegraded":"2023-12-16T00:02:20.437806+0000","last_fullsized":"2023-12-16T00:02:20.437806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:59.725079+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:00:59.725079+0000","last_peered":"2023-12-16T00:00:59.725079+0000","last_clean":"2023-12-16T00:00:59.725079+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:00:59.725079+0000","last_undegraded":"2023-12-16T00:00:59.725079+0000","last_fullsized":"2023-12-16T00:00:59.725079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435325+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:02:15.435325+0000","last_peered":"2023-12-16T00:02:15.435325+0000","last_clean":"2023-12-16T00:02:15.435325+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:02:15.435325+0000","last_undegraded":"2023-12-16T00:02:15.435325+0000","last_fullsized":"2023-12-16T00:02:15.435325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.935847+0000","last_change":"2023-12-16T00:03:47.935882+0000","last_active":"2023-12-16T00:03:47.935847+0000","last_peered":"2023-12-16T00:03:47.935847+0000","last_clean":"2023-12-16T00:03:47.935847+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:03:47.935847+0000","last_undegraded":"2023-12-16T00:03:47.935847+0000","last_fullsized":"2023-12-16T00:03:47.935847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.935771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:56.317416+0000","scrub_duration":0.0010477100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.226844+0000","last_change":"2023-12-16T00:04:09.226874+0000","last_active":"2023-12-16T00:04:09.226844+0000","last_peered":"2023-12-16T00:04:09.226844+0000","last_clean":"2023-12-16T00:04:09.226844+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:04:09.226844+0000","last_undegraded":"2023-12-16T00:04:09.226844+0000","last_fullsized":"2023-12-16T00:04:09.226844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.226768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:44.325950+0000","scrub_duration":0.0012146679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355510+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355510+0000","last_peered":"2023-12-16T00:02:46.355510+0000","last_clean":"2023-12-16T00:02:46.355510+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355510+0000","last_undegraded":"2023-12-16T00:02:46.355510+0000","last_fullsized":"2023-12-16T00:02:46.355510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112397+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112397+0000","last_peered":"2023-12-16T00:02:45.112397+0000","last_clean":"2023-12-16T00:02:45.112397+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112397+0000","last_undegraded":"2023-12-16T00:02:45.112397+0000","last_fullsized":"2023-12-16T00:02:45.112397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.219666+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:01:31.219666+0000","last_peered":"2023-12-16T00:01:31.219666+0000","last_clean":"2023-12-16T00:01:31.219666+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:01:31.219666+0000","last_undegraded":"2023-12-16T00:01:31.219666+0000","last_fullsized":"2023-12-16T00:01:31.219666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.258755+0000","last_change":"2023-12-16T00:04:05.258778+0000","last_active":"2023-12-16T00:04:05.258755+0000","last_peered":"2023-12-16T00:04:05.258755+0000","last_clean":"2023-12-16T00:04:05.258755+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:04:05.258755+0000","last_undegraded":"2023-12-16T00:04:05.258755+0000","last_fullsized":"2023-12-16T00:04:05.258755+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.258689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:24:41.933338+0000","scrub_duration":0.0011204909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.125108+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:00.125108+0000","last_peered":"2023-12-16T00:02:00.125108+0000","last_clean":"2023-12-16T00:02:00.125108+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:00.125108+0000","last_undegraded":"2023-12-16T00:02:00.125108+0000","last_fullsized":"2023-12-16T00:02:00.125108+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.436446+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:02:20.436446+0000","last_peered":"2023-12-16T00:02:20.436446+0000","last_clean":"2023-12-16T00:02:20.436446+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:02:20.436446+0000","last_undegraded":"2023-12-16T00:02:20.436446+0000","last_fullsized":"2023-12-16T00:02:20.436446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435963+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:02:15.435963+0000","last_peered":"2023-12-16T00:02:15.435963+0000","last_clean":"2023-12-16T00:02:15.435963+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:02:15.435963+0000","last_undegraded":"2023-12-16T00:02:15.435963+0000","last_fullsized":"2023-12-16T00:02:15.435963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2713,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:37.954006+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:00:37.954006+0000","last_peered":"2023-12-16T00:00:37.954006+0000","last_clean":"2023-12-16T00:00:37.954006+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:00:37.954006+0000","last_undegraded":"2023-12-16T00:00:37.954006+0000","last_fullsized":"2023-12-16T00:00:37.954006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959687+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959687+0000","last_peered":"2023-12-16T00:03:20.959687+0000","last_clean":"2023-12-16T00:03:20.959687+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959687+0000","last_undegraded":"2023-12-16T00:03:20.959687+0000","last_fullsized":"2023-12-16T00:03:20.959687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.858736+0000","last_change":"2023-12-16T00:03:51.858771+0000","last_active":"2023-12-16T00:03:51.858736+0000","last_peered":"2023-12-16T00:03:51.858736+0000","last_clean":"2023-12-16T00:03:51.858736+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:03:51.858736+0000","last_undegraded":"2023-12-16T00:03:51.858736+0000","last_fullsized":"2023-12-16T00:03:51.858736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.858668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:28.407183+0000","scrub_duration":0.001347146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.633664+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:34.633664+0000","last_peered":"2023-12-16T00:02:34.633664+0000","last_clean":"2023-12-16T00:02:34.633664+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:34.633664+0000","last_undegraded":"2023-12-16T00:02:34.633664+0000","last_fullsized":"2023-12-16T00:02:34.633664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":174,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137591+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137591+0000","last_peered":"2023-12-16T00:02:59.137591+0000","last_clean":"2023-12-16T00:02:59.137591+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137591+0000","last_undegraded":"2023-12-16T00:02:59.137591+0000","last_fullsized":"2023-12-16T00:02:59.137591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.608993+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:21.608993+0000","last_peered":"2023-12-16T00:02:21.608993+0000","last_clean":"2023-12-16T00:02:21.608993+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:21.608993+0000","last_undegraded":"2023-12-16T00:02:21.608993+0000","last_fullsized":"2023-12-16T00:02:21.608993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:48.750353+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:00:48.750353+0000","last_peered":"2023-12-16T00:00:48.750353+0000","last_clean":"2023-12-16T00:00:48.750353+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:00:48.750353+0000","last_undegraded":"2023-12-16T00:00:48.750353+0000","last_fullsized":"2023-12-16T00:00:48.750353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.652375+0000","last_change":"2023-12-16T00:04:30.652410+0000","last_active":"2023-12-16T00:04:30.652375+0000","last_peered":"2023-12-16T00:04:30.652375+0000","last_clean":"2023-12-16T00:04:30.652375+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:04:30.652375+0000","last_undegraded":"2023-12-16T00:04:30.652375+0000","last_fullsized":"2023-12-16T00:04:30.652375+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:16:38.233284+0000","scrub_duration":0.00097347899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334221+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334221+0000","last_peered":"2023-12-16T00:02:27.334221+0000","last_clean":"2023-12-16T00:02:27.334221+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334221+0000","last_undegraded":"2023-12-16T00:02:27.334221+0000","last_fullsized":"2023-12-16T00:02:27.334221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1514,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436505+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:02:15.436505+0000","last_peered":"2023-12-16T00:02:15.436505+0000","last_clean":"2023-12-16T00:02:15.436505+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:02:15.436505+0000","last_undegraded":"2023-12-16T00:02:15.436505+0000","last_fullsized":"2023-12-16T00:02:15.436505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.652072+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:02:15.652072+0000","last_peered":"2023-12-16T00:02:15.652072+0000","last_clean":"2023-12-16T00:02:15.652072+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:02:15.652072+0000","last_undegraded":"2023-12-16T00:02:15.652072+0000","last_fullsized":"2023-12-16T00:02:15.652072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433677+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:02:10.433677+0000","last_peered":"2023-12-16T00:02:10.433677+0000","last_clean":"2023-12-16T00:02:10.433677+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:02:10.433677+0000","last_undegraded":"2023-12-16T00:02:10.433677+0000","last_fullsized":"2023-12-16T00:02:10.433677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.715344+0000","last_change":"2023-12-16T00:03:55.715381+0000","last_active":"2023-12-16T00:03:55.715344+0000","last_peered":"2023-12-16T00:03:55.715344+0000","last_clean":"2023-12-16T00:03:55.715344+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:03:55.715344+0000","last_undegraded":"2023-12-16T00:03:55.715344+0000","last_fullsized":"2023-12-16T00:03:55.715344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.715267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.096913+0000","scrub_duration":0.001072323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.605521+0000","last_change":"2023-12-16T00:04:19.605541+0000","last_active":"2023-12-16T00:04:19.605521+0000","last_peered":"2023-12-16T00:04:19.605521+0000","last_clean":"2023-12-16T00:04:19.605521+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:04:19.605521+0000","last_undegraded":"2023-12-16T00:04:19.605521+0000","last_fullsized":"2023-12-16T00:04:19.605521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.605462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:55.243778+0000","scrub_duration":0.00083103500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355512+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355512+0000","last_peered":"2023-12-16T00:03:09.355512+0000","last_clean":"2023-12-16T00:03:09.355512+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355512+0000","last_undegraded":"2023-12-16T00:03:09.355512+0000","last_fullsized":"2023-12-16T00:03:09.355512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.409998+0000","last_change":"2023-12-15T23:08:37.343881+0000","last_active":"2023-12-16T00:00:40.409998+0000","last_peered":"2023-12-16T00:00:40.409998+0000","last_clean":"2023-12-16T00:00:40.409998+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:00:40.409998+0000","last_undegraded":"2023-12-16T00:00:40.409998+0000","last_fullsized":"2023-12-16T00:00:40.409998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'115","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.070326+0000","last_change":"2023-12-16T00:03:41.070353+0000","last_active":"2023-12-16T00:03:41.070326+0000","last_peered":"2023-12-16T00:03:41.070326+0000","last_clean":"2023-12-16T00:03:41.070326+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:03:41.070326+0000","last_undegraded":"2023-12-16T00:03:41.070326+0000","last_fullsized":"2023-12-16T00:03:41.070326+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'115","last_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_deep_scrub":"54'115","last_deep_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.070267+0000","objects_scrubbed":29,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.536401+0000","scrub_duration":0.016426911999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.158907+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:05.158907+0000","last_peered":"2023-12-16T00:02:05.158907+0000","last_clean":"2023-12-16T00:02:05.158907+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:05.158907+0000","last_undegraded":"2023-12-16T00:02:05.158907+0000","last_fullsized":"2023-12-16T00:02:05.158907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.476828+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:05.476828+0000","last_peered":"2023-12-16T00:02:05.476828+0000","last_clean":"2023-12-16T00:02:05.476828+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:05.476828+0000","last_undegraded":"2023-12-16T00:02:05.476828+0000","last_fullsized":"2023-12-16T00:02:05.476828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419368+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:02:15.419368+0000","last_peered":"2023-12-16T00:02:15.419368+0000","last_clean":"2023-12-16T00:02:15.419368+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:02:15.419368+0000","last_undegraded":"2023-12-16T00:02:15.419368+0000","last_fullsized":"2023-12-16T00:02:15.419368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419458+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:02:15.419458+0000","last_peered":"2023-12-16T00:02:15.419458+0000","last_clean":"2023-12-16T00:02:15.419458+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:02:15.419458+0000","last_undegraded":"2023-12-16T00:02:15.419458+0000","last_fullsized":"2023-12-16T00:02:15.419458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642313+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:01:35.642313+0000","last_peered":"2023-12-16T00:01:35.642313+0000","last_clean":"2023-12-16T00:01:35.642313+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:01:35.642313+0000","last_undegraded":"2023-12-16T00:01:35.642313+0000","last_fullsized":"2023-12-16T00:01:35.642313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.257435+0000","last_change":"2023-12-16T00:04:19.257453+0000","last_active":"2023-12-16T00:04:19.257435+0000","last_peered":"2023-12-16T00:04:19.257435+0000","last_clean":"2023-12-16T00:04:19.257435+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:04:19.257435+0000","last_undegraded":"2023-12-16T00:04:19.257435+0000","last_fullsized":"2023-12-16T00:04:19.257435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.257374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:27:40.773145+0000","scrub_duration":0.00086390499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.287830+0000","last_change":"2023-12-15T22:52:53.173337+0000","last_active":"2023-12-16T00:00:27.287830+0000","last_peered":"2023-12-16T00:00:27.287830+0000","last_clean":"2023-12-16T00:00:27.287830+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:00:27.287830+0000","last_undegraded":"2023-12-16T00:00:27.287830+0000","last_fullsized":"2023-12-16T00:00:27.287830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647082+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:55.647082+0000","last_peered":"2023-12-16T00:01:55.647082+0000","last_clean":"2023-12-16T00:01:55.647082+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:55.647082+0000","last_undegraded":"2023-12-16T00:01:55.647082+0000","last_fullsized":"2023-12-16T00:01:55.647082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421739+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:02:16.421739+0000","last_peered":"2023-12-16T00:02:16.421739+0000","last_clean":"2023-12-16T00:02:16.421739+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:02:16.421739+0000","last_undegraded":"2023-12-16T00:02:16.421739+0000","last_fullsized":"2023-12-16T00:02:16.421739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427491+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:01:45.427491+0000","last_peered":"2023-12-16T00:01:45.427491+0000","last_clean":"2023-12-16T00:01:45.427491+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:01:45.427491+0000","last_undegraded":"2023-12-16T00:01:45.427491+0000","last_fullsized":"2023-12-16T00:01:45.427491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434936+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:02:10.434936+0000","last_peered":"2023-12-16T00:02:10.434936+0000","last_clean":"2023-12-16T00:02:10.434936+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:02:10.434936+0000","last_undegraded":"2023-12-16T00:02:10.434936+0000","last_fullsized":"2023-12-16T00:02:10.434936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.732064+0000","last_change":"2023-12-16T00:03:56.732100+0000","last_active":"2023-12-16T00:03:56.732064+0000","last_peered":"2023-12-16T00:03:56.732064+0000","last_clean":"2023-12-16T00:03:56.732064+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:03:56.732064+0000","last_undegraded":"2023-12-16T00:03:56.732064+0000","last_fullsized":"2023-12-16T00:03:56.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.731978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:06.685949+0000","scrub_duration":0.00092347600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.695233+0000","last_change":"2023-12-16T00:03:51.695233+0000","last_active":"2023-12-16T00:03:51.695233+0000","last_peered":"2023-12-16T00:03:51.695233+0000","last_clean":"2023-12-16T00:03:51.695233+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:03:51.695233+0000","last_undegraded":"2023-12-16T00:03:51.695233+0000","last_fullsized":"2023-12-16T00:03:51.695233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.695125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:53.485109+0000","scrub_duration":0.0011650359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778104+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778104+0000","last_peered":"2023-12-16T00:02:03.778104+0000","last_clean":"2023-12-16T00:02:03.778104+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778104+0000","last_undegraded":"2023-12-16T00:02:03.778104+0000","last_fullsized":"2023-12-16T00:02:03.778104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.630904+0000","last_change":"2023-12-15T23:08:37.333186+0000","last_active":"2023-12-16T00:00:45.630904+0000","last_peered":"2023-12-16T00:00:45.630904+0000","last_clean":"2023-12-16T00:00:45.630904+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:00:45.630904+0000","last_undegraded":"2023-12-16T00:00:45.630904+0000","last_fullsized":"2023-12-16T00:00:45.630904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904049+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904049+0000","last_peered":"2023-12-16T00:01:44.904049+0000","last_clean":"2023-12-16T00:01:44.904049+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904049+0000","last_undegraded":"2023-12-16T00:01:44.904049+0000","last_fullsized":"2023-12-16T00:01:44.904049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421700+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:02:16.421700+0000","last_peered":"2023-12-16T00:02:16.421700+0000","last_clean":"2023-12-16T00:02:16.421700+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:02:16.421700+0000","last_undegraded":"2023-12-16T00:02:16.421700+0000","last_fullsized":"2023-12-16T00:02:16.421700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650691+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:02:10.650691+0000","last_peered":"2023-12-16T00:02:10.650691+0000","last_clean":"2023-12-16T00:02:10.650691+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:02:10.650691+0000","last_undegraded":"2023-12-16T00:02:10.650691+0000","last_fullsized":"2023-12-16T00:02:10.650691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468686+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468686+0000","last_peered":"2023-12-16T00:03:22.468686+0000","last_clean":"2023-12-16T00:03:22.468686+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468686+0000","last_undegraded":"2023-12-16T00:03:22.468686+0000","last_fullsized":"2023-12-16T00:03:22.468686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244156+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244156+0000","last_peered":"2023-12-16T00:03:28.244156+0000","last_clean":"2023-12-16T00:03:28.244156+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244156+0000","last_undegraded":"2023-12-16T00:03:28.244156+0000","last_fullsized":"2023-12-16T00:03:28.244156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647206+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:55.647206+0000","last_peered":"2023-12-16T00:01:55.647206+0000","last_clean":"2023-12-16T00:01:55.647206+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:55.647206+0000","last_undegraded":"2023-12-16T00:01:55.647206+0000","last_fullsized":"2023-12-16T00:01:55.647206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.118550+0000","last_change":"2023-12-16T00:03:58.118570+0000","last_active":"2023-12-16T00:03:58.118550+0000","last_peered":"2023-12-16T00:03:58.118550+0000","last_clean":"2023-12-16T00:03:58.118550+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:03:58.118550+0000","last_undegraded":"2023-12-16T00:03:58.118550+0000","last_fullsized":"2023-12-16T00:03:58.118550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.118482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:22:03.904023+0000","scrub_duration":0.00098478099999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707299+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707299+0000","last_peered":"2023-12-16T00:02:10.707299+0000","last_clean":"2023-12-16T00:02:10.707299+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707299+0000","last_undegraded":"2023-12-16T00:02:10.707299+0000","last_fullsized":"2023-12-16T00:02:10.707299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051798+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051798+0000","last_peered":"2023-12-16T00:01:33.051798+0000","last_clean":"2023-12-16T00:01:33.051798+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051798+0000","last_undegraded":"2023-12-16T00:01:33.051798+0000","last_fullsized":"2023-12-16T00:01:33.051798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350573+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350573+0000","last_peered":"2023-12-16T00:03:11.350573+0000","last_clean":"2023-12-16T00:03:11.350573+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350573+0000","last_undegraded":"2023-12-16T00:03:11.350573+0000","last_fullsized":"2023-12-16T00:03:11.350573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.159507+0000","last_change":"2023-12-16T00:04:29.159527+0000","last_active":"2023-12-16T00:04:29.159507+0000","last_peered":"2023-12-16T00:04:29.159507+0000","last_clean":"2023-12-16T00:04:29.159507+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:04:29.159507+0000","last_undegraded":"2023-12-16T00:04:29.159507+0000","last_fullsized":"2023-12-16T00:04:29.159507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.159437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:42.436132+0000","scrub_duration":0.001297589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.541039+0000","last_change":"2023-12-16T00:04:13.541055+0000","last_active":"2023-12-16T00:04:13.541039+0000","last_peered":"2023-12-16T00:04:13.541039+0000","last_clean":"2023-12-16T00:04:13.541039+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:04:13.541039+0000","last_undegraded":"2023-12-16T00:04:13.541039+0000","last_fullsized":"2023-12-16T00:04:13.541039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.540990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:15:02.204008+0000","scrub_duration":0.001141256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461465+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461465+0000","last_peered":"2023-12-16T00:03:22.461465+0000","last_clean":"2023-12-16T00:03:22.461465+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461465+0000","last_undegraded":"2023-12-16T00:03:22.461465+0000","last_fullsized":"2023-12-16T00:03:22.461465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":167,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161228+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161228+0000","last_peered":"2023-12-16T00:03:14.161228+0000","last_clean":"2023-12-16T00:03:14.161228+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161228+0000","last_undegraded":"2023-12-16T00:03:14.161228+0000","last_fullsized":"2023-12-16T00:03:14.161228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193045+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193045+0000","last_peered":"2023-12-16T00:02:53.193045+0000","last_clean":"2023-12-16T00:02:53.193045+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193045+0000","last_undegraded":"2023-12-16T00:02:53.193045+0000","last_fullsized":"2023-12-16T00:02:53.193045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.730498+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:01:36.730498+0000","last_peered":"2023-12-16T00:01:36.730498+0000","last_clean":"2023-12-16T00:01:36.730498+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:01:36.730498+0000","last_undegraded":"2023-12-16T00:01:36.730498+0000","last_fullsized":"2023-12-16T00:01:36.730498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1587,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520664+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520664+0000","last_peered":"2023-12-16T00:02:25.520664+0000","last_clean":"2023-12-16T00:02:25.520664+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520664+0000","last_undegraded":"2023-12-16T00:02:25.520664+0000","last_fullsized":"2023-12-16T00:02:25.520664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410634+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:31.410634+0000","last_peered":"2023-12-16T00:01:31.410634+0000","last_clean":"2023-12-16T00:01:31.410634+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:31.410634+0000","last_undegraded":"2023-12-16T00:01:31.410634+0000","last_fullsized":"2023-12-16T00:01:31.410634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414172+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414172+0000","last_peered":"2023-12-16T00:03:17.414172+0000","last_clean":"2023-12-16T00:03:17.414172+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414172+0000","last_undegraded":"2023-12-16T00:03:17.414172+0000","last_fullsized":"2023-12-16T00:03:17.414172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.714859+0000","last_change":"2023-12-16T00:04:27.714879+0000","last_active":"2023-12-16T00:04:27.714859+0000","last_peered":"2023-12-16T00:04:27.714859+0000","last_clean":"2023-12-16T00:04:27.714859+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:04:27.714859+0000","last_undegraded":"2023-12-16T00:04:27.714859+0000","last_fullsized":"2023-12-16T00:04:27.714859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.714794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:23.216681+0000","scrub_duration":0.001320136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.531828+0000","last_change":"2023-12-16T00:03:41.531828+0000","last_active":"2023-12-16T00:03:41.531828+0000","last_peered":"2023-12-16T00:03:41.531828+0000","last_clean":"2023-12-16T00:03:41.531828+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:03:41.531828+0000","last_undegraded":"2023-12-16T00:03:41.531828+0000","last_fullsized":"2023-12-16T00:03:41.531828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.531720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.997854+0000","scrub_duration":0.001119472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990331+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990331+0000","last_peered":"2023-12-16T00:03:19.990331+0000","last_clean":"2023-12-16T00:03:19.990331+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990331+0000","last_undegraded":"2023-12-16T00:03:19.990331+0000","last_fullsized":"2023-12-16T00:03:19.990331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":210,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.139421+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:16.139421+0000","last_peered":"2023-12-16T00:02:16.139421+0000","last_clean":"2023-12-16T00:02:16.139421+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:16.139421+0000","last_undegraded":"2023-12-16T00:02:16.139421+0000","last_fullsized":"2023-12-16T00:02:16.139421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.148521+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:01:42.148521+0000","last_peered":"2023-12-16T00:01:42.148521+0000","last_clean":"2023-12-16T00:01:42.148521+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:01:42.148521+0000","last_undegraded":"2023-12-16T00:01:42.148521+0000","last_fullsized":"2023-12-16T00:01:42.148521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.927447+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:01:48.927447+0000","last_peered":"2023-12-16T00:01:48.927447+0000","last_clean":"2023-12-16T00:01:48.927447+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:01:48.927447+0000","last_undegraded":"2023-12-16T00:01:48.927447+0000","last_fullsized":"2023-12-16T00:01:48.927447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'100","reported_seq":5996,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425396+0000","last_change":"2023-12-15T22:54:04.182853+0000","last_active":"2023-12-16T00:01:35.425396+0000","last_peered":"2023-12-16T00:01:35.425396+0000","last_clean":"2023-12-16T00:01:35.425396+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:01:35.425396+0000","last_undegraded":"2023-12-16T00:01:35.425396+0000","last_fullsized":"2023-12-16T00:01:35.425396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166639+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166639+0000","last_peered":"2023-12-16T00:03:03.166639+0000","last_clean":"2023-12-16T00:03:03.166639+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166639+0000","last_undegraded":"2023-12-16T00:03:03.166639+0000","last_fullsized":"2023-12-16T00:03:03.166639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478560+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478560+0000","last_peered":"2023-12-16T00:02:02.478560+0000","last_clean":"2023-12-16T00:02:02.478560+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478560+0000","last_undegraded":"2023-12-16T00:02:02.478560+0000","last_fullsized":"2023-12-16T00:02:02.478560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.639670+0000","last_change":"2023-12-16T00:03:36.639670+0000","last_active":"2023-12-16T00:03:36.639670+0000","last_peered":"2023-12-16T00:03:36.639670+0000","last_clean":"2023-12-16T00:03:36.639670+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:03:36.639670+0000","last_undegraded":"2023-12-16T00:03:36.639670+0000","last_fullsized":"2023-12-16T00:03:36.639670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.639584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:26.898631+0000","scrub_duration":0.0012042960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.612164+0000","last_change":"2023-12-16T00:03:31.612184+0000","last_active":"2023-12-16T00:03:31.612164+0000","last_peered":"2023-12-16T00:03:31.612164+0000","last_clean":"2023-12-16T00:03:31.612164+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:03:31.612164+0000","last_undegraded":"2023-12-16T00:03:31.612164+0000","last_fullsized":"2023-12-16T00:03:31.612164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.612104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:55.639396+0000","scrub_duration":0.001020881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.567092+0000","last_change":"2023-12-16T00:03:52.567111+0000","last_active":"2023-12-16T00:03:52.567092+0000","last_peered":"2023-12-16T00:03:52.567092+0000","last_clean":"2023-12-16T00:03:52.567092+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:03:52.567092+0000","last_undegraded":"2023-12-16T00:03:52.567092+0000","last_fullsized":"2023-12-16T00:03:52.567092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.567032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:09.870577+0000","scrub_duration":0.00099403600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":328,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703344+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703344+0000","last_peered":"2023-12-16T00:02:37.703344+0000","last_clean":"2023-12-16T00:02:37.703344+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703344+0000","last_undegraded":"2023-12-16T00:02:37.703344+0000","last_fullsized":"2023-12-16T00:02:37.703344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":943,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.174022+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.174022+0000","last_peered":"2023-12-16T00:02:51.174022+0000","last_clean":"2023-12-16T00:02:51.174022+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.174022+0000","last_undegraded":"2023-12-16T00:02:51.174022+0000","last_fullsized":"2023-12-16T00:02:51.174022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130536+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130536+0000","last_peered":"2023-12-16T00:01:57.130536+0000","last_clean":"2023-12-16T00:01:57.130536+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130536+0000","last_undegraded":"2023-12-16T00:01:57.130536+0000","last_fullsized":"2023-12-16T00:01:57.130536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.836140+0000","last_change":"2023-12-16T00:04:24.836161+0000","last_active":"2023-12-16T00:04:24.836140+0000","last_peered":"2023-12-16T00:04:24.836140+0000","last_clean":"2023-12-16T00:04:24.836140+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:04:24.836140+0000","last_undegraded":"2023-12-16T00:04:24.836140+0000","last_fullsized":"2023-12-16T00:04:24.836140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.836073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:13.730641+0000","scrub_duration":0.0014096079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'95","reported_seq":4134,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.425033+0000","last_change":"2023-12-15T22:54:04.188596+0000","last_active":"2023-12-16T00:01:35.425033+0000","last_peered":"2023-12-16T00:01:35.425033+0000","last_clean":"2023-12-16T00:01:35.425033+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:01:35.425033+0000","last_undegraded":"2023-12-16T00:01:35.425033+0000","last_fullsized":"2023-12-16T00:01:35.425033+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160224+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160224+0000","last_peered":"2023-12-16T00:02:44.160224+0000","last_clean":"2023-12-16T00:02:44.160224+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160224+0000","last_undegraded":"2023-12-16T00:02:44.160224+0000","last_fullsized":"2023-12-16T00:02:44.160224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.128631+0000","last_change":"2023-12-16T00:03:52.128631+0000","last_active":"2023-12-16T00:03:52.128631+0000","last_peered":"2023-12-16T00:03:52.128631+0000","last_clean":"2023-12-16T00:03:52.128631+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:03:52.128631+0000","last_undegraded":"2023-12-16T00:03:52.128631+0000","last_fullsized":"2023-12-16T00:03:52.128631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.128525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:53.105511+0000","scrub_duration":0.00088122500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.540607+0000","last_change":"2023-12-16T00:03:59.540637+0000","last_active":"2023-12-16T00:03:59.540607+0000","last_peered":"2023-12-16T00:03:59.540607+0000","last_clean":"2023-12-16T00:03:59.540607+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:03:59.540607+0000","last_undegraded":"2023-12-16T00:03:59.540607+0000","last_fullsized":"2023-12-16T00:03:59.540607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.540485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:06.902422+0000","scrub_duration":0.001346311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'163","reported_seq":300,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.193935+0000","last_change":"2023-12-16T00:04:30.193971+0000","last_active":"2023-12-16T00:04:30.193935+0000","last_peered":"2023-12-16T00:04:30.193935+0000","last_clean":"2023-12-16T00:04:30.193935+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:04:30.193935+0000","last_undegraded":"2023-12-16T00:04:30.193935+0000","last_fullsized":"2023-12-16T00:04:30.193935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.193875+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:19.677418+0000","scrub_duration":0.0057472679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:15.221706+0000","last_change":"2023-12-16T00:04:15.221724+0000","last_active":"2023-12-16T00:04:15.221706+0000","last_peered":"2023-12-16T00:04:15.221706+0000","last_clean":"2023-12-16T00:04:15.221706+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:04:15.221706+0000","last_undegraded":"2023-12-16T00:04:15.221706+0000","last_fullsized":"2023-12-16T00:04:15.221706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_clean_scrub_stamp":"2023-12-16T00:04:15.221646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:22.707320+0000","scrub_duration":0.0012625480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152518+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152518+0000","last_peered":"2023-12-16T00:03:24.152518+0000","last_clean":"2023-12-16T00:03:24.152518+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152518+0000","last_undegraded":"2023-12-16T00:03:24.152518+0000","last_fullsized":"2023-12-16T00:03:24.152518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":991,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196285+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196285+0000","last_peered":"2023-12-16T00:02:25.196285+0000","last_clean":"2023-12-16T00:02:25.196285+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196285+0000","last_undegraded":"2023-12-16T00:02:25.196285+0000","last_fullsized":"2023-12-16T00:02:25.196285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483332+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483332+0000","last_peered":"2023-12-16T00:02:23.483332+0000","last_clean":"2023-12-16T00:02:23.483332+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483332+0000","last_undegraded":"2023-12-16T00:02:23.483332+0000","last_fullsized":"2023-12-16T00:02:23.483332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.897143+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:01:15.897143+0000","last_peered":"2023-12-16T00:01:15.897143+0000","last_clean":"2023-12-16T00:01:15.897143+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:01:15.897143+0000","last_undegraded":"2023-12-16T00:01:15.897143+0000","last_fullsized":"2023-12-16T00:01:15.897143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.179585+0000","last_change":"2023-12-16T00:03:55.179622+0000","last_active":"2023-12-16T00:03:55.179585+0000","last_peered":"2023-12-16T00:03:55.179585+0000","last_clean":"2023-12-16T00:03:55.179585+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:03:55.179585+0000","last_undegraded":"2023-12-16T00:03:55.179585+0000","last_fullsized":"2023-12-16T00:03:55.179585+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.179520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:26:19.218144+0000","scrub_duration":0.00092174800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1298,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966553+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966553+0000","last_peered":"2023-12-16T00:03:18.966553+0000","last_clean":"2023-12-16T00:03:18.966553+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966553+0000","last_undegraded":"2023-12-16T00:03:18.966553+0000","last_fullsized":"2023-12-16T00:03:18.966553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464112+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464112+0000","last_peered":"2023-12-16T00:03:25.464112+0000","last_clean":"2023-12-16T00:03:25.464112+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464112+0000","last_undegraded":"2023-12-16T00:03:25.464112+0000","last_fullsized":"2023-12-16T00:03:25.464112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.200715+0000","last_change":"2023-12-16T00:04:11.200715+0000","last_active":"2023-12-16T00:04:11.200715+0000","last_peered":"2023-12-16T00:04:11.200715+0000","last_clean":"2023-12-16T00:04:11.200715+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:04:11.200715+0000","last_undegraded":"2023-12-16T00:04:11.200715+0000","last_fullsized":"2023-12-16T00:04:11.200715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.200632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:05.973413+0000","scrub_duration":0.00096315500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.494653+0000","last_change":"2023-12-16T00:04:00.494673+0000","last_active":"2023-12-16T00:04:00.494653+0000","last_peered":"2023-12-16T00:04:00.494653+0000","last_clean":"2023-12-16T00:04:00.494653+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:04:00.494653+0000","last_undegraded":"2023-12-16T00:04:00.494653+0000","last_fullsized":"2023-12-16T00:04:00.494653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:12.576991+0000","scrub_duration":0.0013840110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529769+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529769+0000","last_peered":"2023-12-16T00:02:53.529769+0000","last_clean":"2023-12-16T00:02:53.529769+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529769+0000","last_undegraded":"2023-12-16T00:02:53.529769+0000","last_fullsized":"2023-12-16T00:02:53.529769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662996+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662996+0000","last_peered":"2023-12-16T00:02:16.662996+0000","last_clean":"2023-12-16T00:02:16.662996+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662996+0000","last_undegraded":"2023-12-16T00:02:16.662996+0000","last_fullsized":"2023-12-16T00:02:16.662996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.142469+0000","last_change":"2023-12-16T00:03:56.142490+0000","last_active":"2023-12-16T00:03:56.142469+0000","last_peered":"2023-12-16T00:03:56.142469+0000","last_clean":"2023-12-16T00:03:56.142469+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:03:56.142469+0000","last_undegraded":"2023-12-16T00:03:56.142469+0000","last_fullsized":"2023-12-16T00:03:56.142469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.142408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:45.112014+0000","scrub_duration":0.00089426600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5951,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323807+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323807+0000","last_peered":"2023-12-16T00:03:09.323807+0000","last_clean":"2023-12-16T00:03:09.323807+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323807+0000","last_undegraded":"2023-12-16T00:03:09.323807+0000","last_fullsized":"2023-12-16T00:03:09.323807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855239+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855239+0000","last_peered":"2023-12-16T00:03:23.855239+0000","last_clean":"2023-12-16T00:03:23.855239+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855239+0000","last_undegraded":"2023-12-16T00:03:23.855239+0000","last_fullsized":"2023-12-16T00:03:23.855239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.233244+0000","last_change":"2023-12-16T00:03:41.233244+0000","last_active":"2023-12-16T00:03:41.233244+0000","last_peered":"2023-12-16T00:03:41.233244+0000","last_clean":"2023-12-16T00:03:41.233244+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:03:41.233244+0000","last_undegraded":"2023-12-16T00:03:41.233244+0000","last_fullsized":"2023-12-16T00:03:41.233244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.233146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:29.219613+0000","scrub_duration":0.00094526300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.537375+0000","last_change":"2023-12-16T00:03:35.537411+0000","last_active":"2023-12-16T00:03:35.537375+0000","last_peered":"2023-12-16T00:03:35.537375+0000","last_clean":"2023-12-16T00:03:35.537375+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:03:35.537375+0000","last_undegraded":"2023-12-16T00:03:35.537375+0000","last_fullsized":"2023-12-16T00:03:35.537375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.537285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:54.142352+0000","scrub_duration":0.0011419679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335105+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335105+0000","last_peered":"2023-12-16T00:03:07.335105+0000","last_clean":"2023-12-16T00:03:07.335105+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335105+0000","last_undegraded":"2023-12-16T00:03:07.335105+0000","last_fullsized":"2023-12-16T00:03:07.335105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453548+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453548+0000","last_peered":"2023-12-16T00:02:34.453548+0000","last_clean":"2023-12-16T00:02:34.453548+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453548+0000","last_undegraded":"2023-12-16T00:02:34.453548+0000","last_fullsized":"2023-12-16T00:02:34.453548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116761+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116761+0000","last_peered":"2023-12-16T00:02:44.116761+0000","last_clean":"2023-12-16T00:02:44.116761+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116761+0000","last_undegraded":"2023-12-16T00:02:44.116761+0000","last_fullsized":"2023-12-16T00:02:44.116761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.097018+0000","last_change":"2023-12-16T00:03:57.097038+0000","last_active":"2023-12-16T00:03:57.097018+0000","last_peered":"2023-12-16T00:03:57.097018+0000","last_clean":"2023-12-16T00:03:57.097018+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:03:57.097018+0000","last_undegraded":"2023-12-16T00:03:57.097018+0000","last_fullsized":"2023-12-16T00:03:57.097018+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.096950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:03.688612+0000","scrub_duration":0.0011013220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629219+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629219+0000","last_peered":"2023-12-16T00:01:50.629219+0000","last_clean":"2023-12-16T00:01:50.629219+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629219+0000","last_undegraded":"2023-12-16T00:01:50.629219+0000","last_fullsized":"2023-12-16T00:01:50.629219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.896996+0000","last_change":"2023-12-16T00:03:35.896996+0000","last_active":"2023-12-16T00:03:35.896996+0000","last_peered":"2023-12-16T00:03:35.896996+0000","last_clean":"2023-12-16T00:03:35.896996+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:03:35.896996+0000","last_undegraded":"2023-12-16T00:03:35.896996+0000","last_fullsized":"2023-12-16T00:03:35.896996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.896905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.496966+0000","scrub_duration":0.0014309380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:12.560783+0000","last_change":"2023-12-16T00:04:12.560804+0000","last_active":"2023-12-16T00:04:12.560783+0000","last_peered":"2023-12-16T00:04:12.560783+0000","last_clean":"2023-12-16T00:04:12.560783+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:04:12.560783+0000","last_undegraded":"2023-12-16T00:04:12.560783+0000","last_fullsized":"2023-12-16T00:04:12.560783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_clean_scrub_stamp":"2023-12-16T00:04:12.560713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:45:06.835342+0000","scrub_duration":0.001076154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:28.200075+0000","last_change":"2023-12-16T00:04:28.200097+0000","last_active":"2023-12-16T00:04:28.200075+0000","last_peered":"2023-12-16T00:04:28.200075+0000","last_clean":"2023-12-16T00:04:28.200075+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:04:28.200075+0000","last_undegraded":"2023-12-16T00:04:28.200075+0000","last_fullsized":"2023-12-16T00:04:28.200075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_clean_scrub_stamp":"2023-12-16T00:04:28.199999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:26:48.754557+0000","scrub_duration":0.001243393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.079336+0000","last_change":"2023-12-16T00:03:38.079336+0000","last_active":"2023-12-16T00:03:38.079336+0000","last_peered":"2023-12-16T00:03:38.079336+0000","last_clean":"2023-12-16T00:03:38.079336+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:03:38.079336+0000","last_undegraded":"2023-12-16T00:03:38.079336+0000","last_fullsized":"2023-12-16T00:03:38.079336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.079227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:55.382772+0000","scrub_duration":0.0013798949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.356005+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.356005+0000","last_peered":"2023-12-16T00:02:33.356005+0000","last_clean":"2023-12-16T00:02:33.356005+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.356005+0000","last_undegraded":"2023-12-16T00:02:33.356005+0000","last_fullsized":"2023-12-16T00:02:33.356005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396540+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396540+0000","last_peered":"2023-12-16T00:01:59.396540+0000","last_clean":"2023-12-16T00:01:59.396540+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396540+0000","last_undegraded":"2023-12-16T00:01:59.396540+0000","last_fullsized":"2023-12-16T00:01:59.396540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.553856+0000","last_change":"2023-12-16T00:03:33.553856+0000","last_active":"2023-12-16T00:03:33.553856+0000","last_peered":"2023-12-16T00:03:33.553856+0000","last_clean":"2023-12-16T00:03:33.553856+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:03:33.553856+0000","last_undegraded":"2023-12-16T00:03:33.553856+0000","last_fullsized":"2023-12-16T00:03:33.553856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.553765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:14.335435+0000","scrub_duration":0.001373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:18.736355+0000","last_change":"2023-12-16T00:04:18.736375+0000","last_active":"2023-12-16T00:04:18.736355+0000","last_peered":"2023-12-16T00:04:18.736355+0000","last_clean":"2023-12-16T00:04:18.736355+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:04:18.736355+0000","last_undegraded":"2023-12-16T00:04:18.736355+0000","last_fullsized":"2023-12-16T00:04:18.736355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_clean_scrub_stamp":"2023-12-16T00:04:18.736296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:48.764498+0000","scrub_duration":0.001450713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.424239+0000","last_change":"2023-12-15T22:52:08.042083+0000","last_active":"2023-12-16T00:01:30.424239+0000","last_peered":"2023-12-16T00:01:30.424239+0000","last_clean":"2023-12-16T00:01:30.424239+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:01:30.424239+0000","last_undegraded":"2023-12-16T00:01:30.424239+0000","last_fullsized":"2023-12-16T00:01:30.424239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:06.585166+0000","last_clean_scrub_stamp":"2023-12-15T22:52:06.585166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968164+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968164+0000","last_peered":"2023-12-16T00:03:15.968164+0000","last_clean":"2023-12-16T00:03:15.968164+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968164+0000","last_undegraded":"2023-12-16T00:03:15.968164+0000","last_fullsized":"2023-12-16T00:03:15.968164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561094+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561094+0000","last_peered":"2023-12-16T00:02:30.561094+0000","last_clean":"2023-12-16T00:02:30.561094+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561094+0000","last_undegraded":"2023-12-16T00:02:30.561094+0000","last_fullsized":"2023-12-16T00:02:30.561094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.428221+0000","last_change":"2023-12-15T23:08:37.339757+0000","last_active":"2023-12-16T00:01:50.428221+0000","last_peered":"2023-12-16T00:01:50.428221+0000","last_clean":"2023-12-16T00:01:50.428221+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:01:50.428221+0000","last_undegraded":"2023-12-16T00:01:50.428221+0000","last_fullsized":"2023-12-16T00:01:50.428221+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112902+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112902+0000","last_peered":"2023-12-16T00:02:08.112902+0000","last_clean":"2023-12-16T00:02:08.112902+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112902+0000","last_undegraded":"2023-12-16T00:02:08.112902+0000","last_fullsized":"2023-12-16T00:02:08.112902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'14","reported_seq":188,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426386+0000","last_change":"2023-12-15T22:55:02.194944+0000","last_active":"2023-12-16T00:01:40.426386+0000","last_peered":"2023-12-16T00:01:40.426386+0000","last_clean":"2023-12-16T00:01:40.426386+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:01:40.426386+0000","last_undegraded":"2023-12-16T00:01:40.426386+0000","last_fullsized":"2023-12-16T00:01:40.426386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:53:25.137153+0000","last_clean_scrub_stamp":"2023-12-15T22:53:25.137153+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430319+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:55.430319+0000","last_peered":"2023-12-16T00:01:55.430319+0000","last_clean":"2023-12-16T00:01:55.430319+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:55.430319+0000","last_undegraded":"2023-12-16T00:01:55.430319+0000","last_fullsized":"2023-12-16T00:01:55.430319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:22.268148+0000","last_change":"2023-12-16T00:04:22.268168+0000","last_active":"2023-12-16T00:04:22.268148+0000","last_peered":"2023-12-16T00:04:22.268148+0000","last_clean":"2023-12-16T00:04:22.268148+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:04:22.268148+0000","last_undegraded":"2023-12-16T00:04:22.268148+0000","last_fullsized":"2023-12-16T00:04:22.268148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_clean_scrub_stamp":"2023-12-16T00:04:22.268086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:27:11.687443+0000","scrub_duration":0.00091220899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'66","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.166815+0000","last_change":"2023-12-16T00:03:47.166869+0000","last_active":"2023-12-16T00:03:47.166815+0000","last_peered":"2023-12-16T00:03:47.166815+0000","last_clean":"2023-12-16T00:03:47.166815+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:03:47.166815+0000","last_undegraded":"2023-12-16T00:03:47.166815+0000","last_fullsized":"2023-12-16T00:03:47.166815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.166746+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:27.979063+0000","scrub_duration":0.003753653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.835800+0000","last_change":"2023-12-16T00:04:11.835800+0000","last_active":"2023-12-16T00:04:11.835800+0000","last_peered":"2023-12-16T00:04:11.835800+0000","last_clean":"2023-12-16T00:04:11.835800+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:04:11.835800+0000","last_undegraded":"2023-12-16T00:04:11.835800+0000","last_fullsized":"2023-12-16T00:04:11.835800+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.835718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:30.892848+0000","scrub_duration":0.00092772700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437459+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437459+0000","last_peered":"2023-12-16T00:02:40.437459+0000","last_clean":"2023-12-16T00:02:40.437459+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437459+0000","last_undegraded":"2023-12-16T00:02:40.437459+0000","last_fullsized":"2023-12-16T00:02:40.437459+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410473+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:31.410473+0000","last_peered":"2023-12-16T00:01:31.410473+0000","last_clean":"2023-12-16T00:01:31.410473+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:31.410473+0000","last_undegraded":"2023-12-16T00:01:31.410473+0000","last_fullsized":"2023-12-16T00:01:31.410473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562947+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562947+0000","last_peered":"2023-12-16T00:02:45.562947+0000","last_clean":"2023-12-16T00:02:45.562947+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562947+0000","last_undegraded":"2023-12-16T00:02:45.562947+0000","last_fullsized":"2023-12-16T00:02:45.562947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.563416+0000","last_change":"2023-12-16T00:03:44.563437+0000","last_active":"2023-12-16T00:03:44.563416+0000","last_peered":"2023-12-16T00:03:44.563416+0000","last_clean":"2023-12-16T00:03:44.563416+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:03:44.563416+0000","last_undegraded":"2023-12-16T00:03:44.563416+0000","last_fullsized":"2023-12-16T00:03:44.563416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.563348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:00:12.730238+0000","scrub_duration":0.0015157739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.357363+0000","last_change":"2023-12-16T00:03:33.357383+0000","last_active":"2023-12-16T00:03:33.357363+0000","last_peered":"2023-12-16T00:03:33.357363+0000","last_clean":"2023-12-16T00:03:33.357363+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:03:33.357363+0000","last_undegraded":"2023-12-16T00:03:33.357363+0000","last_fullsized":"2023-12-16T00:03:33.357363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.357294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:08.995610+0000","scrub_duration":0.0012151390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418581+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:01:10.418581+0000","last_peered":"2023-12-16T00:01:10.418581+0000","last_clean":"2023-12-16T00:01:10.418581+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:01:10.418581+0000","last_undegraded":"2023-12-16T00:01:10.418581+0000","last_fullsized":"2023-12-16T00:01:10.418581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'103","reported_seq":1354,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.641342+0000","last_change":"2023-12-16T00:04:25.641365+0000","last_active":"2023-12-16T00:04:25.641342+0000","last_peered":"2023-12-16T00:04:25.641342+0000","last_clean":"2023-12-16T00:04:25.641342+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:04:25.641342+0000","last_undegraded":"2023-12-16T00:04:25.641342+0000","last_fullsized":"2023-12-16T00:04:25.641342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'103","last_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_deep_scrub":"54'103","last_deep_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.641288+0000","objects_scrubbed":26,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:52.348878+0000","scrub_duration":0.012960006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6171,"num_omap_keys":23,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168065+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168065+0000","last_peered":"2023-12-16T00:02:06.168065+0000","last_clean":"2023-12-16T00:02:06.168065+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168065+0000","last_undegraded":"2023-12-16T00:02:06.168065+0000","last_fullsized":"2023-12-16T00:02:06.168065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169593+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169593+0000","last_peered":"2023-12-16T00:02:23.169593+0000","last_clean":"2023-12-16T00:02:23.169593+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169593+0000","last_undegraded":"2023-12-16T00:02:23.169593+0000","last_fullsized":"2023-12-16T00:02:23.169593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.428078+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:45.428078+0000","last_peered":"2023-12-16T00:01:45.428078+0000","last_clean":"2023-12-16T00:01:45.428078+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:45.428078+0000","last_undegraded":"2023-12-16T00:01:45.428078+0000","last_fullsized":"2023-12-16T00:01:45.428078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436856+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:02:15.436856+0000","last_peered":"2023-12-16T00:02:15.436856+0000","last_clean":"2023-12-16T00:02:15.436856+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:02:15.436856+0000","last_undegraded":"2023-12-16T00:02:15.436856+0000","last_fullsized":"2023-12-16T00:02:15.436856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.024920+0000","last_change":"2023-12-16T00:03:46.024939+0000","last_active":"2023-12-16T00:03:46.024920+0000","last_peered":"2023-12-16T00:03:46.024920+0000","last_clean":"2023-12-16T00:03:46.024920+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:03:46.024920+0000","last_undegraded":"2023-12-16T00:03:46.024920+0000","last_fullsized":"2023-12-16T00:03:46.024920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.024856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:58.107273+0000","scrub_duration":0.00094653599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418706+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:01:10.418706+0000","last_peered":"2023-12-16T00:01:10.418706+0000","last_clean":"2023-12-16T00:01:10.418706+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:01:10.418706+0000","last_undegraded":"2023-12-16T00:01:10.418706+0000","last_fullsized":"2023-12-16T00:01:10.418706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'98","reported_seq":1076,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137944+0000","last_change":"2023-12-15T22:55:02.200310+0000","last_active":"2023-12-16T00:00:28.137944+0000","last_peered":"2023-12-16T00:00:28.137944+0000","last_clean":"2023-12-16T00:00:28.137944+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:00:28.137944+0000","last_undegraded":"2023-12-16T00:00:28.137944+0000","last_fullsized":"2023-12-16T00:00:28.137944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.414596+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:55.414596+0000","last_peered":"2023-12-16T00:01:55.414596+0000","last_clean":"2023-12-16T00:01:55.414596+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:55.414596+0000","last_undegraded":"2023-12-16T00:01:55.414596+0000","last_fullsized":"2023-12-16T00:01:55.414596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007813+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007813+0000","last_peered":"2023-12-16T00:01:36.007813+0000","last_clean":"2023-12-16T00:01:36.007813+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007813+0000","last_undegraded":"2023-12-16T00:01:36.007813+0000","last_fullsized":"2023-12-16T00:01:36.007813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1756,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419678+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:02:15.419678+0000","last_peered":"2023-12-16T00:02:15.419678+0000","last_clean":"2023-12-16T00:02:15.419678+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:02:15.419678+0000","last_undegraded":"2023-12-16T00:02:15.419678+0000","last_fullsized":"2023-12-16T00:02:15.419678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427580+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:01:45.427580+0000","last_peered":"2023-12-16T00:01:45.427580+0000","last_clean":"2023-12-16T00:01:45.427580+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:01:45.427580+0000","last_undegraded":"2023-12-16T00:01:45.427580+0000","last_fullsized":"2023-12-16T00:01:45.427580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.604810+0000","last_change":"2023-12-16T00:03:38.604829+0000","last_active":"2023-12-16T00:03:38.604810+0000","last_peered":"2023-12-16T00:03:38.604810+0000","last_clean":"2023-12-16T00:03:38.604810+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:03:38.604810+0000","last_undegraded":"2023-12-16T00:03:38.604810+0000","last_fullsized":"2023-12-16T00:03:38.604810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.604746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:35.411237+0000","scrub_duration":0.001128876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.165592+0000","last_change":"2023-12-16T00:04:27.165612+0000","last_active":"2023-12-16T00:04:27.165592+0000","last_peered":"2023-12-16T00:04:27.165592+0000","last_clean":"2023-12-16T00:04:27.165592+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:04:27.165592+0000","last_undegraded":"2023-12-16T00:04:27.165592+0000","last_fullsized":"2023-12-16T00:04:27.165592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.165525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:43.495488+0000","scrub_duration":0.001076278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.289320+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:00:27.289320+0000","last_peered":"2023-12-16T00:00:27.289320+0000","last_clean":"2023-12-16T00:00:27.289320+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:00:27.289320+0000","last_undegraded":"2023-12-16T00:00:27.289320+0000","last_fullsized":"2023-12-16T00:00:27.289320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385135+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385135+0000","last_peered":"2023-12-16T00:02:50.385135+0000","last_clean":"2023-12-16T00:02:50.385135+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385135+0000","last_undegraded":"2023-12-16T00:02:50.385135+0000","last_fullsized":"2023-12-16T00:02:50.385135+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088962+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088962+0000","last_peered":"2023-12-16T00:02:04.088962+0000","last_clean":"2023-12-16T00:02:04.088962+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088962+0000","last_undegraded":"2023-12-16T00:02:04.088962+0000","last_fullsized":"2023-12-16T00:02:04.088962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823346+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823346+0000","last_peered":"2023-12-16T00:01:16.823346+0000","last_clean":"2023-12-16T00:01:16.823346+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823346+0000","last_undegraded":"2023-12-16T00:01:16.823346+0000","last_fullsized":"2023-12-16T00:01:16.823346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.427328+0000","last_change":"2023-12-15T22:52:55.187607+0000","last_active":"2023-12-16T00:01:40.427328+0000","last_peered":"2023-12-16T00:01:40.427328+0000","last_clean":"2023-12-16T00:01:40.427328+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:01:40.427328+0000","last_undegraded":"2023-12-16T00:01:40.427328+0000","last_fullsized":"2023-12-16T00:01:40.427328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:40.253850+0000","last_change":"2023-12-16T00:03:40.253871+0000","last_active":"2023-12-16T00:03:40.253850+0000","last_peered":"2023-12-16T00:03:40.253850+0000","last_clean":"2023-12-16T00:03:40.253850+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:03:40.253850+0000","last_undegraded":"2023-12-16T00:03:40.253850+0000","last_fullsized":"2023-12-16T00:03:40.253850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_clean_scrub_stamp":"2023-12-16T00:03:40.253770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:14:18.023218+0000","scrub_duration":0.00092796800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.429489+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:01:50.429489+0000","last_peered":"2023-12-16T00:01:50.429489+0000","last_clean":"2023-12-16T00:01:50.429489+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:01:50.429489+0000","last_undegraded":"2023-12-16T00:01:50.429489+0000","last_fullsized":"2023-12-16T00:01:50.429489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4448,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.417593+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:02:01.417593+0000","last_peered":"2023-12-16T00:02:01.417593+0000","last_clean":"2023-12-16T00:02:01.417593+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:02:01.417593+0000","last_undegraded":"2023-12-16T00:02:01.417593+0000","last_fullsized":"2023-12-16T00:02:01.417593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202192+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202192+0000","last_peered":"2023-12-16T00:02:33.202192+0000","last_clean":"2023-12-16T00:02:33.202192+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202192+0000","last_undegraded":"2023-12-16T00:02:33.202192+0000","last_fullsized":"2023-12-16T00:02:33.202192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360912+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360912+0000","last_peered":"2023-12-16T00:02:21.360912+0000","last_clean":"2023-12-16T00:02:21.360912+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360912+0000","last_undegraded":"2023-12-16T00:02:21.360912+0000","last_fullsized":"2023-12-16T00:02:21.360912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979291+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979291+0000","last_peered":"2023-12-16T00:03:26.979291+0000","last_clean":"2023-12-16T00:03:26.979291+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979291+0000","last_undegraded":"2023-12-16T00:03:26.979291+0000","last_fullsized":"2023-12-16T00:03:26.979291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.583273+0000","last_change":"2023-12-16T00:03:55.583308+0000","last_active":"2023-12-16T00:03:55.583273+0000","last_peered":"2023-12-16T00:03:55.583273+0000","last_clean":"2023-12-16T00:03:55.583273+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:03:55.583273+0000","last_undegraded":"2023-12-16T00:03:55.583273+0000","last_fullsized":"2023-12-16T00:03:55.583273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.583135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:07:10.879680+0000","scrub_duration":0.0013878409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377246+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377246+0000","last_peered":"2023-12-16T00:02:58.377246+0000","last_clean":"2023-12-16T00:02:58.377246+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377246+0000","last_undegraded":"2023-12-16T00:02:58.377246+0000","last_fullsized":"2023-12-16T00:02:58.377246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.428686+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:01:50.428686+0000","last_peered":"2023-12-16T00:01:50.428686+0000","last_clean":"2023-12-16T00:01:50.428686+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:01:50.428686+0000","last_undegraded":"2023-12-16T00:01:50.428686+0000","last_fullsized":"2023-12-16T00:01:50.428686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.405006+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.405006+0000","last_peered":"2023-12-16T00:03:09.405006+0000","last_clean":"2023-12-16T00:03:09.405006+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.405006+0000","last_undegraded":"2023-12-16T00:03:09.405006+0000","last_fullsized":"2023-12-16T00:03:09.405006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062496+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062496+0000","last_peered":"2023-12-16T00:02:03.062496+0000","last_clean":"2023-12-16T00:02:03.062496+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062496+0000","last_undegraded":"2023-12-16T00:02:03.062496+0000","last_fullsized":"2023-12-16T00:02:03.062496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273204+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273204+0000","last_peered":"2023-12-16T00:02:14.273204+0000","last_clean":"2023-12-16T00:02:14.273204+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273204+0000","last_undegraded":"2023-12-16T00:02:14.273204+0000","last_fullsized":"2023-12-16T00:02:14.273204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.096649+0000","last_change":"2023-12-16T00:03:51.096670+0000","last_active":"2023-12-16T00:03:51.096649+0000","last_peered":"2023-12-16T00:03:51.096649+0000","last_clean":"2023-12-16T00:03:51.096649+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:03:51.096649+0000","last_undegraded":"2023-12-16T00:03:51.096649+0000","last_fullsized":"2023-12-16T00:03:51.096649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.096587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:21.124789+0000","scrub_duration":0.00091092400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.602939+0000","last_change":"2023-12-16T00:03:44.602959+0000","last_active":"2023-12-16T00:03:44.602939+0000","last_peered":"2023-12-16T00:03:44.602939+0000","last_clean":"2023-12-16T00:03:44.602939+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:03:44.602939+0000","last_undegraded":"2023-12-16T00:03:44.602939+0000","last_fullsized":"2023-12-16T00:03:44.602939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.602862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:59.899408+0000","scrub_duration":0.0010205100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624544+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624544+0000","last_peered":"2023-12-16T00:02:24.624544+0000","last_clean":"2023-12-16T00:02:24.624544+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624544+0000","last_undegraded":"2023-12-16T00:02:24.624544+0000","last_fullsized":"2023-12-16T00:02:24.624544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.794703+0000","last_change":"2023-12-16T00:04:19.794736+0000","last_active":"2023-12-16T00:04:19.794703+0000","last_peered":"2023-12-16T00:04:19.794703+0000","last_clean":"2023-12-16T00:04:19.794703+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:04:19.794703+0000","last_undegraded":"2023-12-16T00:04:19.794703+0000","last_fullsized":"2023-12-16T00:04:19.794703+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.794635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:27.164354+0000","scrub_duration":0.001013683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3899,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200935+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200935+0000","last_peered":"2023-12-16T00:02:19.200935+0000","last_clean":"2023-12-16T00:02:19.200935+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200935+0000","last_undegraded":"2023-12-16T00:02:19.200935+0000","last_fullsized":"2023-12-16T00:02:19.200935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.413093+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:41.413093+0000","last_peered":"2023-12-16T00:01:41.413093+0000","last_clean":"2023-12-16T00:01:41.413093+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:41.413093+0000","last_undegraded":"2023-12-16T00:01:41.413093+0000","last_fullsized":"2023-12-16T00:01:41.413093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339052+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339052+0000","last_peered":"2023-12-16T00:02:29.339052+0000","last_clean":"2023-12-16T00:02:29.339052+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339052+0000","last_undegraded":"2023-12-16T00:02:29.339052+0000","last_fullsized":"2023-12-16T00:02:29.339052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.234989+0000","last_change":"2023-12-16T00:04:09.235010+0000","last_active":"2023-12-16T00:04:09.234989+0000","last_peered":"2023-12-16T00:04:09.234989+0000","last_clean":"2023-12-16T00:04:09.234989+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:04:09.234989+0000","last_undegraded":"2023-12-16T00:04:09.234989+0000","last_fullsized":"2023-12-16T00:04:09.234989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.234925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:37.300137+0000","scrub_duration":0.00099844600000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119127+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119127+0000","last_peered":"2023-12-16T00:02:43.119127+0000","last_clean":"2023-12-16T00:02:43.119127+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119127+0000","last_undegraded":"2023-12-16T00:02:43.119127+0000","last_fullsized":"2023-12-16T00:02:43.119127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.827267+0000","last_change":"2023-12-16T00:04:17.827287+0000","last_active":"2023-12-16T00:04:17.827267+0000","last_peered":"2023-12-16T00:04:17.827267+0000","last_clean":"2023-12-16T00:04:17.827267+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:04:17.827267+0000","last_undegraded":"2023-12-16T00:04:17.827267+0000","last_fullsized":"2023-12-16T00:04:17.827267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.827208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:45.730814+0000","scrub_duration":0.00094996999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413855+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:46.413855+0000","last_peered":"2023-12-16T00:01:46.413855+0000","last_clean":"2023-12-16T00:01:46.413855+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:46.413855+0000","last_undegraded":"2023-12-16T00:01:46.413855+0000","last_fullsized":"2023-12-16T00:01:46.413855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092070+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092070+0000","last_peered":"2023-12-16T00:02:06.092070+0000","last_clean":"2023-12-16T00:02:06.092070+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092070+0000","last_undegraded":"2023-12-16T00:02:06.092070+0000","last_fullsized":"2023-12-16T00:02:06.092070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059457+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059457+0000","last_peered":"2023-12-16T00:01:32.059457+0000","last_clean":"2023-12-16T00:01:32.059457+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059457+0000","last_undegraded":"2023-12-16T00:01:32.059457+0000","last_fullsized":"2023-12-16T00:01:32.059457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1519,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513307+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513307+0000","last_peered":"2023-12-16T00:02:15.513307+0000","last_clean":"2023-12-16T00:02:15.513307+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513307+0000","last_undegraded":"2023-12-16T00:02:15.513307+0000","last_fullsized":"2023-12-16T00:02:15.513307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418257+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:01:10.418257+0000","last_peered":"2023-12-16T00:01:10.418257+0000","last_clean":"2023-12-16T00:01:10.418257+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:01:10.418257+0000","last_undegraded":"2023-12-16T00:01:10.418257+0000","last_fullsized":"2023-12-16T00:01:10.418257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136426+0000","last_change":"2023-12-15T22:52:53.175451+0000","last_active":"2023-12-16T00:00:28.136426+0000","last_peered":"2023-12-16T00:00:28.136426+0000","last_clean":"2023-12-16T00:00:28.136426+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:00:28.136426+0000","last_undegraded":"2023-12-16T00:00:28.136426+0000","last_fullsized":"2023-12-16T00:00:28.136426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'9","reported_seq":820,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.799885+0000","last_change":"2023-12-16T00:03:59.799917+0000","last_active":"2023-12-16T00:03:59.799885+0000","last_peered":"2023-12-16T00:03:59.799885+0000","last_clean":"2023-12-16T00:03:59.799885+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:03:59.799885+0000","last_undegraded":"2023-12-16T00:03:59.799885+0000","last_fullsized":"2023-12-16T00:03:59.799885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.799820+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:24.148485+0000","scrub_duration":0.0029504150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:03.182746+0000","last_change":"2023-12-16T00:04:03.182767+0000","last_active":"2023-12-16T00:04:03.182746+0000","last_peered":"2023-12-16T00:04:03.182746+0000","last_clean":"2023-12-16T00:04:03.182746+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:04:03.182746+0000","last_undegraded":"2023-12-16T00:04:03.182746+0000","last_fullsized":"2023-12-16T00:04:03.182746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_clean_scrub_stamp":"2023-12-16T00:04:03.182682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:32.339951+0000","scrub_duration":0.0012782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'156","reported_seq":4072,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.660885+0000","last_change":"2023-12-16T00:04:26.660931+0000","last_active":"2023-12-16T00:04:26.660885+0000","last_peered":"2023-12-16T00:04:26.660885+0000","last_clean":"2023-12-16T00:04:26.660885+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:04:26.660885+0000","last_undegraded":"2023-12-16T00:04:26.660885+0000","last_fullsized":"2023-12-16T00:04:26.660885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'156","last_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_deep_scrub":"54'156","last_deep_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.660828+0000","objects_scrubbed":42,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:08:20.920894+0000","scrub_duration":0.020600820999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10370,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188470+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188470+0000","last_peered":"2023-12-16T00:03:12.188470+0000","last_clean":"2023-12-16T00:03:12.188470+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188470+0000","last_undegraded":"2023-12-16T00:03:12.188470+0000","last_fullsized":"2023-12-16T00:03:12.188470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246193+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246193+0000","last_peered":"2023-12-16T00:01:50.246193+0000","last_clean":"2023-12-16T00:01:50.246193+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246193+0000","last_undegraded":"2023-12-16T00:01:50.246193+0000","last_fullsized":"2023-12-16T00:01:50.246193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.930016+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.930016+0000","last_peered":"2023-12-16T00:01:26.930016+0000","last_clean":"2023-12-16T00:01:26.930016+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.930016+0000","last_undegraded":"2023-12-16T00:01:26.930016+0000","last_fullsized":"2023-12-16T00:01:26.930016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986569+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986569+0000","last_peered":"2023-12-16T00:01:56.986569+0000","last_clean":"2023-12-16T00:01:56.986569+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986569+0000","last_undegraded":"2023-12-16T00:01:56.986569+0000","last_fullsized":"2023-12-16T00:01:56.986569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'4","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.880915+0000","last_change":"2023-12-16T00:04:07.880946+0000","last_active":"2023-12-16T00:04:07.880915+0000","last_peered":"2023-12-16T00:04:07.880915+0000","last_clean":"2023-12-16T00:04:07.880915+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:04:07.880915+0000","last_undegraded":"2023-12-16T00:04:07.880915+0000","last_fullsized":"2023-12-16T00:04:07.880915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.880856+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:56.543873+0000","scrub_duration":0.003087462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136417+0000","last_change":"2023-12-15T22:52:53.175639+0000","last_active":"2023-12-16T00:00:28.136417+0000","last_peered":"2023-12-16T00:00:28.136417+0000","last_clean":"2023-12-16T00:00:28.136417+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:00:28.136417+0000","last_undegraded":"2023-12-16T00:00:28.136417+0000","last_fullsized":"2023-12-16T00:00:28.136417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.193570+0000","last_change":"2023-12-16T00:03:34.193596+0000","last_active":"2023-12-16T00:03:34.193570+0000","last_peered":"2023-12-16T00:03:34.193570+0000","last_clean":"2023-12-16T00:03:34.193570+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:03:34.193570+0000","last_undegraded":"2023-12-16T00:03:34.193570+0000","last_fullsized":"2023-12-16T00:03:34.193570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.193509+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:52.798577+0000","scrub_duration":0.0029407489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:26.016924+0000","last_change":"2023-12-15T23:08:37.343864+0000","last_active":"2023-12-16T00:00:26.016924+0000","last_peered":"2023-12-16T00:00:26.016924+0000","last_clean":"2023-12-16T00:00:26.016924+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:00:26.016924+0000","last_undegraded":"2023-12-16T00:00:26.016924+0000","last_fullsized":"2023-12-16T00:00:26.016924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3685,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689757+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689757+0000","last_peered":"2023-12-16T00:02:12.689757+0000","last_clean":"2023-12-16T00:02:12.689757+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689757+0000","last_undegraded":"2023-12-16T00:02:12.689757+0000","last_fullsized":"2023-12-16T00:02:12.689757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925869+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925869+0000","last_peered":"2023-12-16T00:01:40.925869+0000","last_clean":"2023-12-16T00:01:40.925869+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925869+0000","last_undegraded":"2023-12-16T00:01:40.925869+0000","last_fullsized":"2023-12-16T00:01:40.925869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296944+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296944+0000","last_peered":"2023-12-16T00:02:30.296944+0000","last_clean":"2023-12-16T00:02:30.296944+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296944+0000","last_undegraded":"2023-12-16T00:02:30.296944+0000","last_fullsized":"2023-12-16T00:02:30.296944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892789+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892789+0000","last_peered":"2023-12-16T00:01:49.892789+0000","last_clean":"2023-12-16T00:01:49.892789+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892789+0000","last_undegraded":"2023-12-16T00:01:49.892789+0000","last_fullsized":"2023-12-16T00:01:49.892789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":271,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038804+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038804+0000","last_peered":"2023-12-16T00:01:16.038804+0000","last_clean":"2023-12-16T00:01:16.038804+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038804+0000","last_undegraded":"2023-12-16T00:01:16.038804+0000","last_fullsized":"2023-12-16T00:01:16.038804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.637722+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:01:15.637722+0000","last_peered":"2023-12-16T00:01:15.637722+0000","last_clean":"2023-12-16T00:01:15.637722+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:01:15.637722+0000","last_undegraded":"2023-12-16T00:01:15.637722+0000","last_fullsized":"2023-12-16T00:01:15.637722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.009023+0000","last_change":"2023-12-16T00:03:47.009044+0000","last_active":"2023-12-16T00:03:47.009023+0000","last_peered":"2023-12-16T00:03:47.009023+0000","last_clean":"2023-12-16T00:03:47.009023+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:03:47.009023+0000","last_undegraded":"2023-12-16T00:03:47.009023+0000","last_fullsized":"2023-12-16T00:03:47.009023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.008959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:38:54.378679+0000","scrub_duration":0.00088682099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.212154+0000","last_change":"2023-12-16T00:03:36.212174+0000","last_active":"2023-12-16T00:03:36.212154+0000","last_peered":"2023-12-16T00:03:36.212154+0000","last_clean":"2023-12-16T00:03:36.212154+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:03:36.212154+0000","last_undegraded":"2023-12-16T00:03:36.212154+0000","last_fullsized":"2023-12-16T00:03:36.212154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.212089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:43.729491+0000","scrub_duration":0.0014192359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.681417+0000","last_change":"2023-12-16T00:04:29.681452+0000","last_active":"2023-12-16T00:04:29.681417+0000","last_peered":"2023-12-16T00:04:29.681417+0000","last_clean":"2023-12-16T00:04:29.681417+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:04:29.681417+0000","last_undegraded":"2023-12-16T00:04:29.681417+0000","last_fullsized":"2023-12-16T00:04:29.681417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.681321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:18.575890+0000","scrub_duration":0.0011304970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1323,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656814+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656814+0000","last_peered":"2023-12-16T00:02:04.656814+0000","last_clean":"2023-12-16T00:02:04.656814+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656814+0000","last_undegraded":"2023-12-16T00:02:04.656814+0000","last_fullsized":"2023-12-16T00:02:04.656814+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993680+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993680+0000","last_peered":"2023-12-16T00:01:57.993680+0000","last_clean":"2023-12-16T00:01:57.993680+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993680+0000","last_undegraded":"2023-12-16T00:01:57.993680+0000","last_fullsized":"2023-12-16T00:01:57.993680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020629+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020629+0000","last_peered":"2023-12-16T00:02:10.020629+0000","last_clean":"2023-12-16T00:02:10.020629+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020629+0000","last_undegraded":"2023-12-16T00:02:10.020629+0000","last_fullsized":"2023-12-16T00:02:10.020629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237522+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237522+0000","last_peered":"2023-12-16T00:02:34.237522+0000","last_clean":"2023-12-16T00:02:34.237522+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237522+0000","last_undegraded":"2023-12-16T00:02:34.237522+0000","last_fullsized":"2023-12-16T00:02:34.237522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":400,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418894+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:01:10.418894+0000","last_peered":"2023-12-16T00:01:10.418894+0000","last_clean":"2023-12-16T00:01:10.418894+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:01:10.418894+0000","last_undegraded":"2023-12-16T00:01:10.418894+0000","last_fullsized":"2023-12-16T00:01:10.418894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:10.252767+0000","last_change":"2023-12-16T00:04:10.252786+0000","last_active":"2023-12-16T00:04:10.252767+0000","last_peered":"2023-12-16T00:04:10.252767+0000","last_clean":"2023-12-16T00:04:10.252767+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:04:10.252767+0000","last_undegraded":"2023-12-16T00:04:10.252767+0000","last_fullsized":"2023-12-16T00:04:10.252767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_clean_scrub_stamp":"2023-12-16T00:04:10.252705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:05.754592+0000","scrub_duration":0.00085390599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.202961+0000","last_change":"2023-12-16T00:03:57.202995+0000","last_active":"2023-12-16T00:03:57.202961+0000","last_peered":"2023-12-16T00:03:57.202961+0000","last_clean":"2023-12-16T00:03:57.202961+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:03:57.202961+0000","last_undegraded":"2023-12-16T00:03:57.202961+0000","last_fullsized":"2023-12-16T00:03:57.202961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.202889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:46:43.817306+0000","scrub_duration":0.001274428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483672+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483672+0000","last_peered":"2023-12-16T00:03:15.483672+0000","last_clean":"2023-12-16T00:03:15.483672+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483672+0000","last_undegraded":"2023-12-16T00:03:15.483672+0000","last_fullsized":"2023-12-16T00:03:15.483672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425544+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425544+0000","last_peered":"2023-12-16T00:03:09.425544+0000","last_clean":"2023-12-16T00:03:09.425544+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425544+0000","last_undegraded":"2023-12-16T00:03:09.425544+0000","last_fullsized":"2023-12-16T00:03:09.425544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374435+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374435+0000","last_peered":"2023-12-16T00:03:18.374435+0000","last_clean":"2023-12-16T00:03:18.374435+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374435+0000","last_undegraded":"2023-12-16T00:03:18.374435+0000","last_fullsized":"2023-12-16T00:03:18.374435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183034+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183034+0000","last_peered":"2023-12-16T00:03:26.183034+0000","last_clean":"2023-12-16T00:03:26.183034+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183034+0000","last_undegraded":"2023-12-16T00:03:26.183034+0000","last_fullsized":"2023-12-16T00:03:26.183034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:14.833875+0000","last_change":"2023-12-16T00:04:14.833875+0000","last_active":"2023-12-16T00:04:14.833875+0000","last_peered":"2023-12-16T00:04:14.833875+0000","last_clean":"2023-12-16T00:04:14.833875+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:04:14.833875+0000","last_undegraded":"2023-12-16T00:04:14.833875+0000","last_fullsized":"2023-12-16T00:04:14.833875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_clean_scrub_stamp":"2023-12-16T00:04:14.833789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:40.615567+0000","scrub_duration":0.00096600899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.568117+0000","last_change":"2023-12-16T00:03:51.568117+0000","last_active":"2023-12-16T00:03:51.568117+0000","last_peered":"2023-12-16T00:03:51.568117+0000","last_clean":"2023-12-16T00:03:51.568117+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:03:51.568117+0000","last_undegraded":"2023-12-16T00:03:51.568117+0000","last_fullsized":"2023-12-16T00:03:51.568117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.568038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:22:26.529802+0000","scrub_duration":0.00091025800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605043+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605043+0000","last_peered":"2023-12-16T00:03:27.605043+0000","last_clean":"2023-12-16T00:03:27.605043+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605043+0000","last_undegraded":"2023-12-16T00:03:27.605043+0000","last_fullsized":"2023-12-16T00:03:27.605043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.247539+0000","last_change":"2023-12-16T00:04:19.247558+0000","last_active":"2023-12-16T00:04:19.247539+0000","last_peered":"2023-12-16T00:04:19.247539+0000","last_clean":"2023-12-16T00:04:19.247539+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:04:19.247539+0000","last_undegraded":"2023-12-16T00:04:19.247539+0000","last_fullsized":"2023-12-16T00:04:19.247539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.247460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:42.927615+0000","scrub_duration":0.0011105209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246579+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246579+0000","last_peered":"2023-12-16T00:03:24.246579+0000","last_clean":"2023-12-16T00:03:24.246579+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246579+0000","last_undegraded":"2023-12-16T00:03:24.246579+0000","last_fullsized":"2023-12-16T00:03:24.246579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:04.360778+0000","last_change":"2023-12-16T00:04:04.360778+0000","last_active":"2023-12-16T00:04:04.360778+0000","last_peered":"2023-12-16T00:04:04.360778+0000","last_clean":"2023-12-16T00:04:04.360778+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:04:04.360778+0000","last_undegraded":"2023-12-16T00:04:04.360778+0000","last_fullsized":"2023-12-16T00:04:04.360778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_clean_scrub_stamp":"2023-12-16T00:04:04.360695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:36:29.949685+0000","scrub_duration":0.0010605300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427796+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427796+0000","last_peered":"2023-12-16T00:03:03.427796+0000","last_clean":"2023-12-16T00:03:03.427796+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427796+0000","last_undegraded":"2023-12-16T00:03:03.427796+0000","last_fullsized":"2023-12-16T00:03:03.427796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.468783+0000","last_change":"2023-12-16T00:04:05.468783+0000","last_active":"2023-12-16T00:04:05.468783+0000","last_peered":"2023-12-16T00:04:05.468783+0000","last_clean":"2023-12-16T00:04:05.468783+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:04:05.468783+0000","last_undegraded":"2023-12-16T00:04:05.468783+0000","last_fullsized":"2023-12-16T00:04:05.468783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.468702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:14.473558+0000","scrub_duration":0.00092584000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:50.574499+0000","last_change":"2023-12-16T00:03:50.574518+0000","last_active":"2023-12-16T00:03:50.574499+0000","last_peered":"2023-12-16T00:03:50.574499+0000","last_clean":"2023-12-16T00:03:50.574499+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:03:50.574499+0000","last_undegraded":"2023-12-16T00:03:50.574499+0000","last_fullsized":"2023-12-16T00:03:50.574499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_clean_scrub_stamp":"2023-12-16T00:03:50.574437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.601730+0000","scrub_duration":0.00092257299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388626+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388626+0000","last_peered":"2023-12-16T00:03:15.388626+0000","last_clean":"2023-12-16T00:03:15.388626+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388626+0000","last_undegraded":"2023-12-16T00:03:15.388626+0000","last_fullsized":"2023-12-16T00:03:15.388626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.416013+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.416013+0000","last_peered":"2023-12-16T00:03:16.416013+0000","last_clean":"2023-12-16T00:03:16.416013+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.416013+0000","last_undegraded":"2023-12-16T00:03:16.416013+0000","last_fullsized":"2023-12-16T00:03:16.416013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.232670+0000","last_change":"2023-12-16T00:03:35.232670+0000","last_active":"2023-12-16T00:03:35.232670+0000","last_peered":"2023-12-16T00:03:35.232670+0000","last_clean":"2023-12-16T00:03:35.232670+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:03:35.232670+0000","last_undegraded":"2023-12-16T00:03:35.232670+0000","last_fullsized":"2023-12-16T00:03:35.232670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.232583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:43.491905+0000","scrub_duration":0.001170903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434822+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:02:10.434822+0000","last_peered":"2023-12-16T00:02:10.434822+0000","last_clean":"2023-12-16T00:02:10.434822+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:02:10.434822+0000","last_undegraded":"2023-12-16T00:02:10.434822+0000","last_fullsized":"2023-12-16T00:02:10.434822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.161808+0000","last_change":"2023-12-16T00:03:55.161826+0000","last_active":"2023-12-16T00:03:55.161808+0000","last_peered":"2023-12-16T00:03:55.161808+0000","last_clean":"2023-12-16T00:03:55.161808+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:03:55.161808+0000","last_undegraded":"2023-12-16T00:03:55.161808+0000","last_fullsized":"2023-12-16T00:03:55.161808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.161744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:39.312326+0000","scrub_duration":0.00093413199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136435+0000","last_change":"2023-12-15T22:52:53.170101+0000","last_active":"2023-12-16T00:00:28.136435+0000","last_peered":"2023-12-16T00:00:28.136435+0000","last_clean":"2023-12-16T00:00:28.136435+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:00:28.136435+0000","last_undegraded":"2023-12-16T00:00:28.136435+0000","last_fullsized":"2023-12-16T00:00:28.136435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.421815+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:02:25.421815+0000","last_peered":"2023-12-16T00:02:25.421815+0000","last_clean":"2023-12-16T00:02:25.421815+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:02:25.421815+0000","last_undegraded":"2023-12-16T00:02:25.421815+0000","last_fullsized":"2023-12-16T00:02:25.421815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.224907+0000","last_change":"2023-12-16T00:04:17.224937+0000","last_active":"2023-12-16T00:04:17.224907+0000","last_peered":"2023-12-16T00:04:17.224907+0000","last_clean":"2023-12-16T00:04:17.224907+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:04:17.224907+0000","last_undegraded":"2023-12-16T00:04:17.224907+0000","last_fullsized":"2023-12-16T00:04:17.224907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.224839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:26.673965+0000","scrub_duration":0.001284019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433538+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:02:10.433538+0000","last_peered":"2023-12-16T00:02:10.433538+0000","last_clean":"2023-12-16T00:02:10.433538+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:02:10.433538+0000","last_undegraded":"2023-12-16T00:02:10.433538+0000","last_fullsized":"2023-12-16T00:02:10.433538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.136462+0000","last_change":"2023-12-15T22:52:53.174629+0000","last_active":"2023-12-16T00:00:28.136462+0000","last_peered":"2023-12-16T00:00:28.136462+0000","last_clean":"2023-12-16T00:00:28.136462+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:00:28.136462+0000","last_undegraded":"2023-12-16T00:00:28.136462+0000","last_fullsized":"2023-12-16T00:00:28.136462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":248,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418214+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:02:10.418214+0000","last_peered":"2023-12-16T00:02:10.418214+0000","last_clean":"2023-12-16T00:02:10.418214+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:02:10.418214+0000","last_undegraded":"2023-12-16T00:02:10.418214+0000","last_fullsized":"2023-12-16T00:02:10.418214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.297264+0000","last_change":"2023-12-16T00:03:49.297285+0000","last_active":"2023-12-16T00:03:49.297264+0000","last_peered":"2023-12-16T00:03:49.297264+0000","last_clean":"2023-12-16T00:03:49.297264+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:03:49.297264+0000","last_undegraded":"2023-12-16T00:03:49.297264+0000","last_fullsized":"2023-12-16T00:03:49.297264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.297202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:12.808001+0000","scrub_duration":0.001104505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.198460+0000","last_change":"2023-12-16T00:04:24.198479+0000","last_active":"2023-12-16T00:04:24.198460+0000","last_peered":"2023-12-16T00:04:24.198460+0000","last_clean":"2023-12-16T00:04:24.198460+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:04:24.198460+0000","last_undegraded":"2023-12-16T00:04:24.198460+0000","last_fullsized":"2023-12-16T00:04:24.198460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.198382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:58:53.529777+0000","scrub_duration":0.001608139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469761+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469761+0000","last_peered":"2023-12-16T00:03:07.469761+0000","last_clean":"2023-12-16T00:03:07.469761+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469761+0000","last_undegraded":"2023-12-16T00:03:07.469761+0000","last_fullsized":"2023-12-16T00:03:07.469761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:27.288000+0000","last_change":"2023-12-15T22:52:53.173660+0000","last_active":"2023-12-16T00:00:27.288000+0000","last_peered":"2023-12-16T00:00:27.288000+0000","last_clean":"2023-12-16T00:00:27.288000+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:00:27.288000+0000","last_undegraded":"2023-12-16T00:00:27.288000+0000","last_fullsized":"2023-12-16T00:00:27.288000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:52.152932+0000","last_clean_scrub_stamp":"2023-12-15T22:52:52.152932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.880758+0000","last_change":"2023-12-16T00:03:34.880778+0000","last_active":"2023-12-16T00:03:34.880758+0000","last_peered":"2023-12-16T00:03:34.880758+0000","last_clean":"2023-12-16T00:03:34.880758+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:03:34.880758+0000","last_undegraded":"2023-12-16T00:03:34.880758+0000","last_fullsized":"2023-12-16T00:03:34.880758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.880692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:10.519008+0000","scrub_duration":0.00091466200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431217+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431217+0000","last_peered":"2023-12-16T00:03:20.431217+0000","last_clean":"2023-12-16T00:03:20.431217+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431217+0000","last_undegraded":"2023-12-16T00:03:20.431217+0000","last_fullsized":"2023-12-16T00:03:20.431217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.559821+0000","last_change":"2023-12-16T00:03:46.559841+0000","last_active":"2023-12-16T00:03:46.559821+0000","last_peered":"2023-12-16T00:03:46.559821+0000","last_clean":"2023-12-16T00:03:46.559821+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:03:46.559821+0000","last_undegraded":"2023-12-16T00:03:46.559821+0000","last_fullsized":"2023-12-16T00:03:46.559821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.559754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:04.114550+0000","scrub_duration":0.0010144640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328107+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328107+0000","last_peered":"2023-12-16T00:03:29.328107+0000","last_clean":"2023-12-16T00:03:29.328107+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328107+0000","last_undegraded":"2023-12-16T00:03:29.328107+0000","last_fullsized":"2023-12-16T00:03:29.328107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.842572+0000","last_change":"2023-12-16T00:04:13.842594+0000","last_active":"2023-12-16T00:04:13.842572+0000","last_peered":"2023-12-16T00:04:13.842572+0000","last_clean":"2023-12-16T00:04:13.842572+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:04:13.842572+0000","last_undegraded":"2023-12-16T00:04:13.842572+0000","last_fullsized":"2023-12-16T00:04:13.842572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.842508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:21.212228+0000","scrub_duration":0.000924185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.194894+0000","last_change":"2023-12-16T00:04:13.194913+0000","last_active":"2023-12-16T00:04:13.194894+0000","last_peered":"2023-12-16T00:04:13.194894+0000","last_clean":"2023-12-16T00:04:13.194894+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:04:13.194894+0000","last_undegraded":"2023-12-16T00:04:13.194894+0000","last_fullsized":"2023-12-16T00:04:13.194894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.194829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:13.517879+0000","scrub_duration":0.001183609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.075972+0000","last_change":"2023-12-16T00:03:49.075991+0000","last_active":"2023-12-16T00:03:49.075972+0000","last_peered":"2023-12-16T00:03:49.075972+0000","last_clean":"2023-12-16T00:03:49.075972+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:03:49.075972+0000","last_undegraded":"2023-12-16T00:03:49.075972+0000","last_fullsized":"2023-12-16T00:03:49.075972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.075896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:14.857673+0000","scrub_duration":0.0010048839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.645329+0000","last_change":"2023-12-16T00:04:20.645349+0000","last_active":"2023-12-16T00:04:20.645329+0000","last_peered":"2023-12-16T00:04:20.645329+0000","last_clean":"2023-12-16T00:04:20.645329+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:04:20.645329+0000","last_undegraded":"2023-12-16T00:04:20.645329+0000","last_fullsized":"2023-12-16T00:04:20.645329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.645263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:39.702393+0000","scrub_duration":0.0012813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.409418+0000","last_change":"2023-12-15T22:52:55.191691+0000","last_active":"2023-12-16T00:00:35.409418+0000","last_peered":"2023-12-16T00:00:35.409418+0000","last_clean":"2023-12-16T00:00:35.409418+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:00:35.409418+0000","last_undegraded":"2023-12-16T00:00:35.409418+0000","last_fullsized":"2023-12-16T00:00:35.409418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:52:54.159534+0000","last_clean_scrub_stamp":"2023-12-15T22:52:54.159534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254432,"num_omap_keys":969,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4420,"ondisk_log_size":4420,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2383,"ondisk_log_size":2383,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":898,"ondisk_log_size":898,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608426,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69899999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.66100000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.376,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":0.72199999999999998,"15min":1.004},"last":0.504},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":1.044},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.54400000000000004,"5min":0.56799999999999995,"15min":0.61899999999999999},"last":0.37}]},{"osd":5,"last update":"Sat Dec 16 00:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.374,"15min":0.373},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.505,"5min":0.57899999999999996,"15min":1.149},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.63},"last":0.39600000000000002}]}]},{"osd":5,"up_from":11,"seq":47244641128,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.68400000000000005,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.505},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.29299999999999998},"max":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.747},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.879},"last":0.496}]},{"osd":2,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.37},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.61099999999999999,"15min":0.754},"last":0.436},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26100000000000001},"max":{"1min":0.50700000000000001,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.31,"5min":0.307,"15min":0.26000000000000001},"max":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.92500000000000004},"last":0.41999999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641130,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.27400000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69299999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":1.25,"15min":1.25},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.379,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Dec 16 00:03:58 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Dec 16 00:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.438},{"interface":"front","average":{"1min":0.433,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.62,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.51500000000000001}]}]},{"osd":2,"up_from":11,"seq":47244641127,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.32200000000000001},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45400000000000001,"5min":0.55500000000000005,"15min":1.0169999999999999},"last":0.372},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33500000000000002},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.41199999999999998,"5min":0.55400000000000005,"15min":0.87},"last":0.313}]},{"osd":1,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33900000000000002},"min":{"1min":0.23300000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.40999999999999998,"5min":0.50800000000000001,"15min":0.88900000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.436,"5min":0.52400000000000002,"15min":1.2769999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.72999999999999998,"5min":0.83199999999999996,"15min":1.2450000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.97999999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":1.2190000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":1.169},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.4670000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.91000000000000003},"last":0.49199999999999999}]}]},{"osd":1,"up_from":11,"seq":47244641128,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51292,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806308,"statfs":{"total":107374182400,"available":107321659392,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.315},"min":{"1min":0.23400000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.43099999999999999,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.45500000000000002,"5min":0.47699999999999998,"15min":0.80100000000000005},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41099999999999998,"5min":0.495,"15min":0.52200000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.28999999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.497,"5min":0.504,"15min":0.504},"last":0.28999999999999998}]},{"osd":3,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.69399999999999995,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.72799999999999998},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.41599999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.621},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.81100000000000005,"15min":0.878},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72599999999999998,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.60899999999999999}]}]},{"osd":0,"up_from":11,"seq":47244641128,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.316,"15min":0.316},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40600000000000003,"5min":0.47699999999999998,"15min":0.51200000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.33700000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.20799999999999999},"max":{"1min":0.47099999999999997,"5min":0.56299999999999994,"15min":0.59199999999999997},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.44900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.42799999999999999,"5min":0.51900000000000002,"15min":0.52700000000000002},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.83599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.83599999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.78300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.875},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:04:33.922 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.923 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.923 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.923 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.923 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-12-15T22:53:31.164225+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=31, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.924 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.924 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-15T22:53:03.292619+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.925 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.925 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.925 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.926 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.926 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.927 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.927 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.927 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.928 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.928 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.929 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.929 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.929 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.930 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.930 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-12-15T22:52:06.585166+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=6, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.931 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.931 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.931 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-12-15T22:53:25.137153+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=25, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.932 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.932 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.932 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.933 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.933 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.933 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.934 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.934 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.935 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.935 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.936 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.936 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.937 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-15T22:52:52.152932+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=52, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.937 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-15T22:52:54.159534+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=52, tm_sec=54, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:33.937 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:04:53.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:04:54.283 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:04:54.304 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:04:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2232,"stamp":"2023-12-16T00:04:52.302621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":974972,"num_omap_keys":4201,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36777,"ondisk_log_size":36777,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":312088,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":302198,"kb_avail":628833512,"statfs":{"total":644245094400,"available":643925516288,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":309451425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32578,"num_omap_keys":125,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005543"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358393+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358393+0000","last_peered":"2023-12-16T00:03:26.358393+0000","last_clean":"2023-12-16T00:03:26.358393+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358393+0000","last_undegraded":"2023-12-16T00:03:26.358393+0000","last_fullsized":"2023-12-16T00:03:26.358393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.880866+0000","last_change":"2023-12-16T00:03:59.880889+0000","last_active":"2023-12-16T00:03:59.880866+0000","last_peered":"2023-12-16T00:03:59.880866+0000","last_clean":"2023-12-16T00:03:59.880866+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:03:59.880866+0000","last_undegraded":"2023-12-16T00:03:59.880866+0000","last_fullsized":"2023-12-16T00:03:59.880866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.880808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:54.155437+0000","scrub_duration":0.00089921599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.541603+0000","last_change":"2023-12-16T00:04:07.541622+0000","last_active":"2023-12-16T00:04:07.541603+0000","last_peered":"2023-12-16T00:04:07.541603+0000","last_clean":"2023-12-16T00:04:07.541603+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:04:07.541603+0000","last_undegraded":"2023-12-16T00:04:07.541603+0000","last_fullsized":"2023-12-16T00:04:07.541603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.541533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:44.090049+0000","scrub_duration":0.0010501169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408466+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:21.408466+0000","last_peered":"2023-12-16T00:01:21.408466+0000","last_clean":"2023-12-16T00:01:21.408466+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:21.408466+0000","last_undegraded":"2023-12-16T00:01:21.408466+0000","last_fullsized":"2023-12-16T00:01:21.408466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.563813+0000","last_change":"2023-12-16T00:03:53.563813+0000","last_active":"2023-12-16T00:03:53.563813+0000","last_peered":"2023-12-16T00:03:53.563813+0000","last_clean":"2023-12-16T00:03:53.563813+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:03:53.563813+0000","last_undegraded":"2023-12-16T00:03:53.563813+0000","last_fullsized":"2023-12-16T00:03:53.563813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.563736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:33.029870+0000","scrub_duration":0.00070934700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:01.884589+0000","last_change":"2023-12-16T00:04:01.884628+0000","last_active":"2023-12-16T00:04:01.884589+0000","last_peered":"2023-12-16T00:04:01.884589+0000","last_clean":"2023-12-16T00:04:01.884589+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:04:01.884589+0000","last_undegraded":"2023-12-16T00:04:01.884589+0000","last_fullsized":"2023-12-16T00:04:01.884589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_clean_scrub_stamp":"2023-12-16T00:04:01.884510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:50.547528+0000","scrub_duration":0.00152728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.245549+0000","last_change":"2023-12-16T00:03:58.245569+0000","last_active":"2023-12-16T00:03:58.245549+0000","last_peered":"2023-12-16T00:03:58.245549+0000","last_clean":"2023-12-16T00:03:58.245549+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:03:58.245549+0000","last_undegraded":"2023-12-16T00:03:58.245549+0000","last_fullsized":"2023-12-16T00:03:58.245549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.245495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:53:53.747382+0000","scrub_duration":0.00088301999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.295639+0000","last_change":"2023-12-16T00:03:51.295660+0000","last_active":"2023-12-16T00:03:51.295639+0000","last_peered":"2023-12-16T00:03:51.295639+0000","last_clean":"2023-12-16T00:03:51.295639+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:03:51.295639+0000","last_undegraded":"2023-12-16T00:03:51.295639+0000","last_fullsized":"2023-12-16T00:03:51.295639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.295576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:17.077353+0000","scrub_duration":0.0012592949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.850192+0000","last_change":"2023-12-16T00:04:11.850226+0000","last_active":"2023-12-16T00:04:11.850192+0000","last_peered":"2023-12-16T00:04:11.850192+0000","last_clean":"2023-12-16T00:04:11.850192+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:04:11.850192+0000","last_undegraded":"2023-12-16T00:04:11.850192+0000","last_fullsized":"2023-12-16T00:04:11.850192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.850125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:35.360924+0000","scrub_duration":0.0015218740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:40.856504+0000","last_change":"2023-12-16T00:04:40.856541+0000","last_active":"2023-12-16T00:04:40.856504+0000","last_peered":"2023-12-16T00:04:40.856504+0000","last_clean":"2023-12-16T00:04:40.856504+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:04:40.856504+0000","last_undegraded":"2023-12-16T00:04:40.856504+0000","last_fullsized":"2023-12-16T00:04:40.856504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:40.856434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:40.856434+0000","last_clean_scrub_stamp":"2023-12-16T00:04:40.856434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:37.645530+0000","scrub_duration":0.0011732960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477835+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477835+0000","last_peered":"2023-12-16T00:03:06.477835+0000","last_clean":"2023-12-16T00:03:06.477835+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477835+0000","last_undegraded":"2023-12-16T00:03:06.477835+0000","last_fullsized":"2023-12-16T00:03:06.477835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.116114+0000","last_change":"2023-12-16T00:04:37.116146+0000","last_active":"2023-12-16T00:04:37.116114+0000","last_peered":"2023-12-16T00:04:37.116114+0000","last_clean":"2023-12-16T00:04:37.116114+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:04:37.116114+0000","last_undegraded":"2023-12-16T00:04:37.116114+0000","last_fullsized":"2023-12-16T00:04:37.116114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.116042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.116042+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.116042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:32.623138+0000","scrub_duration":0.001289423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.779040+0000","last_change":"2023-12-16T00:04:21.779060+0000","last_active":"2023-12-16T00:04:21.779040+0000","last_peered":"2023-12-16T00:04:21.779040+0000","last_clean":"2023-12-16T00:04:21.779040+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:04:21.779040+0000","last_undegraded":"2023-12-16T00:04:21.779040+0000","last_fullsized":"2023-12-16T00:04:21.779040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.778969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:05.929551+0000","scrub_duration":0.001213221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408096+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:21.408096+0000","last_peered":"2023-12-16T00:01:21.408096+0000","last_clean":"2023-12-16T00:01:21.408096+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:21.408096+0000","last_undegraded":"2023-12-16T00:01:21.408096+0000","last_fullsized":"2023-12-16T00:01:21.408096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:45.193861+0000","last_change":"2023-12-16T00:03:45.193882+0000","last_active":"2023-12-16T00:03:45.193861+0000","last_peered":"2023-12-16T00:03:45.193861+0000","last_clean":"2023-12-16T00:03:45.193861+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:03:45.193861+0000","last_undegraded":"2023-12-16T00:03:45.193861+0000","last_fullsized":"2023-12-16T00:03:45.193861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:45.193798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:27.535599+0000","scrub_duration":0.0012721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629295+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629295+0000","last_peered":"2023-12-16T00:02:46.629295+0000","last_clean":"2023-12-16T00:02:46.629295+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629295+0000","last_undegraded":"2023-12-16T00:02:46.629295+0000","last_fullsized":"2023-12-16T00:02:46.629295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434834+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:02:10.434834+0000","last_peered":"2023-12-16T00:02:10.434834+0000","last_clean":"2023-12-16T00:02:10.434834+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:02:10.434834+0000","last_undegraded":"2023-12-16T00:02:10.434834+0000","last_fullsized":"2023-12-16T00:02:10.434834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426875+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:01:40.426875+0000","last_peered":"2023-12-16T00:01:40.426875+0000","last_clean":"2023-12-16T00:01:40.426875+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:01:40.426875+0000","last_undegraded":"2023-12-16T00:01:40.426875+0000","last_fullsized":"2023-12-16T00:01:40.426875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.099235+0000","last_change":"2023-12-16T00:03:44.099255+0000","last_active":"2023-12-16T00:03:44.099235+0000","last_peered":"2023-12-16T00:03:44.099235+0000","last_clean":"2023-12-16T00:03:44.099235+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:03:44.099235+0000","last_undegraded":"2023-12-16T00:03:44.099235+0000","last_fullsized":"2023-12-16T00:03:44.099235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.099172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:07.211984+0000","scrub_duration":0.0012518329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418586+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:02:10.418586+0000","last_peered":"2023-12-16T00:02:10.418586+0000","last_clean":"2023-12-16T00:02:10.418586+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:02:10.418586+0000","last_undegraded":"2023-12-16T00:02:10.418586+0000","last_fullsized":"2023-12-16T00:02:10.418586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.876980+0000","last_change":"2023-12-16T00:04:05.877000+0000","last_active":"2023-12-16T00:04:05.876980+0000","last_peered":"2023-12-16T00:04:05.876980+0000","last_clean":"2023-12-16T00:04:05.876980+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:04:05.876980+0000","last_undegraded":"2023-12-16T00:04:05.876980+0000","last_fullsized":"2023-12-16T00:04:05.876980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.876880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:41.515195+0000","scrub_duration":0.0014092810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:06.850990+0000","last_change":"2023-12-16T00:04:06.851033+0000","last_active":"2023-12-16T00:04:06.850990+0000","last_peered":"2023-12-16T00:04:06.850990+0000","last_clean":"2023-12-16T00:04:06.850990+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:04:06.850990+0000","last_undegraded":"2023-12-16T00:04:06.850990+0000","last_fullsized":"2023-12-16T00:04:06.850990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_clean_scrub_stamp":"2023-12-16T00:04:06.850910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:25.908040+0000","scrub_duration":0.00097751000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418502+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:02:10.418502+0000","last_peered":"2023-12-16T00:02:10.418502+0000","last_clean":"2023-12-16T00:02:10.418502+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:02:10.418502+0000","last_undegraded":"2023-12-16T00:02:10.418502+0000","last_fullsized":"2023-12-16T00:02:10.418502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.493314+0000","last_change":"2023-12-16T00:03:36.493334+0000","last_active":"2023-12-16T00:03:36.493314+0000","last_peered":"2023-12-16T00:03:36.493314+0000","last_clean":"2023-12-16T00:03:36.493314+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:03:36.493314+0000","last_undegraded":"2023-12-16T00:03:36.493314+0000","last_fullsized":"2023-12-16T00:03:36.493314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.493246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:53.796792+0000","scrub_duration":0.00093940400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.104306+0000","last_change":"2023-12-16T00:03:53.104323+0000","last_active":"2023-12-16T00:03:53.104306+0000","last_peered":"2023-12-16T00:03:53.104306+0000","last_clean":"2023-12-16T00:03:53.104306+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:03:53.104306+0000","last_undegraded":"2023-12-16T00:03:53.104306+0000","last_fullsized":"2023-12-16T00:03:53.104306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.104258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:09.066868+0000","scrub_duration":0.0012952809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.208542+0000","last_change":"2023-12-16T00:04:00.208562+0000","last_active":"2023-12-16T00:04:00.208542+0000","last_peered":"2023-12-16T00:04:00.208542+0000","last_clean":"2023-12-16T00:04:00.208542+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:04:00.208542+0000","last_undegraded":"2023-12-16T00:04:00.208542+0000","last_fullsized":"2023-12-16T00:04:00.208542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.208477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:00.531527+0000","scrub_duration":0.00086714300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:40.569387+0000","last_change":"2023-12-16T00:04:40.569407+0000","last_active":"2023-12-16T00:04:40.569387+0000","last_peered":"2023-12-16T00:04:40.569387+0000","last_clean":"2023-12-16T00:04:40.569387+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:04:40.569387+0000","last_undegraded":"2023-12-16T00:04:40.569387+0000","last_fullsized":"2023-12-16T00:04:40.569387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:40.569321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:40.569321+0000","last_clean_scrub_stamp":"2023-12-16T00:04:40.569321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:36.071208+0000","scrub_duration":0.001182326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'142","reported_seq":1746,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:44.271771+0000","last_change":"2023-12-16T00:04:44.271831+0000","last_active":"2023-12-16T00:04:44.271771+0000","last_peered":"2023-12-16T00:04:44.271771+0000","last_clean":"2023-12-16T00:04:44.271771+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:04:44.271771+0000","last_undegraded":"2023-12-16T00:04:44.271771+0000","last_fullsized":"2023-12-16T00:04:44.271771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'142","last_scrub_stamp":"2023-12-16T00:04:44.271708+0000","last_deep_scrub":"54'142","last_deep_scrub_stamp":"2023-12-16T00:04:44.271708+0000","last_clean_scrub_stamp":"2023-12-16T00:04:44.271708+0000","objects_scrubbed":41,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:46:28.224409+0000","scrub_duration":0.020811165999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9692,"num_omap_keys":36,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411398+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411398+0000","last_peered":"2023-12-16T00:02:07.411398+0000","last_clean":"2023-12-16T00:02:07.411398+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411398+0000","last_undegraded":"2023-12-16T00:02:07.411398+0000","last_fullsized":"2023-12-16T00:02:07.411398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'12","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:49.234522+0000","last_change":"2023-12-16T00:04:49.234555+0000","last_active":"2023-12-16T00:04:49.234522+0000","last_peered":"2023-12-16T00:04:49.234522+0000","last_clean":"2023-12-16T00:04:49.234522+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:04:49.234522+0000","last_undegraded":"2023-12-16T00:04:49.234522+0000","last_fullsized":"2023-12-16T00:04:49.234522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:04:49.234455+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:04:49.234455+0000","last_clean_scrub_stamp":"2023-12-16T00:04:49.234455+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:01.252367+0000","scrub_duration":0.0044167649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620322+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620322+0000","last_peered":"2023-12-16T00:02:06.620322+0000","last_clean":"2023-12-16T00:02:06.620322+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620322+0000","last_undegraded":"2023-12-16T00:02:06.620322+0000","last_fullsized":"2023-12-16T00:02:06.620322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.542129+0000","last_change":"2023-12-16T00:03:49.542149+0000","last_active":"2023-12-16T00:03:49.542129+0000","last_peered":"2023-12-16T00:03:49.542129+0000","last_clean":"2023-12-16T00:03:49.542129+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:03:49.542129+0000","last_undegraded":"2023-12-16T00:03:49.542129+0000","last_fullsized":"2023-12-16T00:03:49.542129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.542068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:12.196084+0000","scrub_duration":0.0010559110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:35.099727+0000","last_change":"2023-12-16T00:04:35.099747+0000","last_active":"2023-12-16T00:04:35.099727+0000","last_peered":"2023-12-16T00:04:35.099727+0000","last_clean":"2023-12-16T00:04:35.099727+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:04:35.099727+0000","last_undegraded":"2023-12-16T00:04:35.099727+0000","last_fullsized":"2023-12-16T00:04:35.099727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:35.099657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:35.099657+0000","last_clean_scrub_stamp":"2023-12-16T00:04:35.099657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:36:42.930374+0000","scrub_duration":0.00097042999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.157297+0000","last_change":"2023-12-16T00:03:31.157320+0000","last_active":"2023-12-16T00:03:31.157297+0000","last_peered":"2023-12-16T00:03:31.157297+0000","last_clean":"2023-12-16T00:03:31.157297+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:03:31.157297+0000","last_undegraded":"2023-12-16T00:03:31.157297+0000","last_fullsized":"2023-12-16T00:03:31.157297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.157241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:58:18.132539+0000","scrub_duration":0.0024345880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.103882+0000","last_change":"2023-12-16T00:03:59.103882+0000","last_active":"2023-12-16T00:03:59.103882+0000","last_peered":"2023-12-16T00:03:59.103882+0000","last_clean":"2023-12-16T00:03:59.103882+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:03:59.103882+0000","last_undegraded":"2023-12-16T00:03:59.103882+0000","last_fullsized":"2023-12-16T00:03:59.103882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.103798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:15.216322+0000","scrub_duration":0.001606133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6215,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.272472+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:40.272472+0000","last_peered":"2023-12-16T00:02:40.272472+0000","last_clean":"2023-12-16T00:02:40.272472+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:40.272472+0000","last_undegraded":"2023-12-16T00:02:40.272472+0000","last_fullsized":"2023-12-16T00:02:40.272472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886912+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886912+0000","last_peered":"2023-12-16T00:01:52.886912+0000","last_clean":"2023-12-16T00:01:52.886912+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886912+0000","last_undegraded":"2023-12-16T00:01:52.886912+0000","last_fullsized":"2023-12-16T00:01:52.886912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118199+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118199+0000","last_peered":"2023-12-16T00:02:20.118199+0000","last_clean":"2023-12-16T00:02:20.118199+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118199+0000","last_undegraded":"2023-12-16T00:02:20.118199+0000","last_fullsized":"2023-12-16T00:02:20.118199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.770654+0000","last_change":"2023-12-16T00:04:19.770689+0000","last_active":"2023-12-16T00:04:19.770654+0000","last_peered":"2023-12-16T00:04:19.770654+0000","last_clean":"2023-12-16T00:04:19.770654+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:04:19.770654+0000","last_undegraded":"2023-12-16T00:04:19.770654+0000","last_fullsized":"2023-12-16T00:04:19.770654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:20.747565+0000","scrub_duration":0.00081478900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.613484+0000","last_change":"2023-12-16T00:04:21.613504+0000","last_active":"2023-12-16T00:04:21.613484+0000","last_peered":"2023-12-16T00:04:21.613484+0000","last_clean":"2023-12-16T00:04:21.613484+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:04:21.613484+0000","last_undegraded":"2023-12-16T00:04:21.613484+0000","last_fullsized":"2023-12-16T00:04:21.613484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.613416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:35:24.089617+0000","scrub_duration":0.0013326939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"54'7","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:32.225673+0000","last_change":"2023-12-16T00:04:32.225699+0000","last_active":"2023-12-16T00:04:32.225673+0000","last_peered":"2023-12-16T00:04:32.225673+0000","last_clean":"2023-12-16T00:04:32.225673+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:04:32.225673+0000","last_undegraded":"2023-12-16T00:04:32.225673+0000","last_fullsized":"2023-12-16T00:04:32.225673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:04:32.225618+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:04:32.225618+0000","last_clean_scrub_stamp":"2023-12-16T00:04:32.225618+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:42:44.057469+0000","scrub_duration":0.0026127350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.863793+0000","last_change":"2023-12-16T00:04:25.863829+0000","last_active":"2023-12-16T00:04:25.863793+0000","last_peered":"2023-12-16T00:04:25.863793+0000","last_clean":"2023-12-16T00:04:25.863793+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:04:25.863793+0000","last_undegraded":"2023-12-16T00:04:25.863793+0000","last_fullsized":"2023-12-16T00:04:25.863793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.863725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:26.840711+0000","scrub_duration":0.00098527300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'98","reported_seq":1146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:36.206857+0000","last_change":"2023-12-16T00:04:36.206883+0000","last_active":"2023-12-16T00:04:36.206857+0000","last_peered":"2023-12-16T00:04:36.206857+0000","last_clean":"2023-12-16T00:04:36.206857+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:04:36.206857+0000","last_undegraded":"2023-12-16T00:04:36.206857+0000","last_fullsized":"2023-12-16T00:04:36.206857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'98","last_scrub_stamp":"2023-12-16T00:04:36.206803+0000","last_deep_scrub":"54'98","last_deep_scrub_stamp":"2023-12-16T00:04:36.206803+0000","last_clean_scrub_stamp":"2023-12-16T00:04:36.206803+0000","objects_scrubbed":29,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:46:20.159503+0000","scrub_duration":0.014301810999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7620,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.429700+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:02:46.429700+0000","last_peered":"2023-12-16T00:02:46.429700+0000","last_clean":"2023-12-16T00:02:46.429700+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:02:46.429700+0000","last_undegraded":"2023-12-16T00:02:46.429700+0000","last_fullsized":"2023-12-16T00:02:46.429700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.414205+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:46.414205+0000","last_peered":"2023-12-16T00:01:46.414205+0000","last_clean":"2023-12-16T00:01:46.414205+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:46.414205+0000","last_undegraded":"2023-12-16T00:01:46.414205+0000","last_fullsized":"2023-12-16T00:01:46.414205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.422218+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.422218+0000","last_peered":"2023-12-16T00:01:25.422218+0000","last_clean":"2023-12-16T00:01:25.422218+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.422218+0000","last_undegraded":"2023-12-16T00:01:25.422218+0000","last_fullsized":"2023-12-16T00:01:25.422218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403853+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:01:10.403853+0000","last_peered":"2023-12-16T00:01:10.403853+0000","last_clean":"2023-12-16T00:01:10.403853+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:01:10.403853+0000","last_undegraded":"2023-12-16T00:01:10.403853+0000","last_fullsized":"2023-12-16T00:01:10.403853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:33.147272+0000","last_change":"2023-12-16T00:04:33.147291+0000","last_active":"2023-12-16T00:04:33.147272+0000","last_peered":"2023-12-16T00:04:33.147272+0000","last_clean":"2023-12-16T00:04:33.147272+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:04:33.147272+0000","last_undegraded":"2023-12-16T00:04:33.147272+0000","last_fullsized":"2023-12-16T00:04:33.147272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:33.147211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:33.147211+0000","last_clean_scrub_stamp":"2023-12-16T00:04:33.147211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:56.827365+0000","scrub_duration":0.00095753099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:39.578391+0000","last_change":"2023-12-16T00:04:39.578416+0000","last_active":"2023-12-16T00:04:39.578391+0000","last_peered":"2023-12-16T00:04:39.578391+0000","last_clean":"2023-12-16T00:04:39.578391+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:04:39.578391+0000","last_undegraded":"2023-12-16T00:04:39.578391+0000","last_fullsized":"2023-12-16T00:04:39.578391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:39.578324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:39.578324+0000","last_clean_scrub_stamp":"2023-12-16T00:04:39.578324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:26.192742+0000","scrub_duration":0.0014997089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1029,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304253+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304253+0000","last_peered":"2023-12-16T00:02:29.304253+0000","last_clean":"2023-12-16T00:02:29.304253+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304253+0000","last_undegraded":"2023-12-16T00:02:29.304253+0000","last_fullsized":"2023-12-16T00:02:29.304253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.422119+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:02:16.422119+0000","last_peered":"2023-12-16T00:02:16.422119+0000","last_clean":"2023-12-16T00:02:16.422119+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:02:16.422119+0000","last_undegraded":"2023-12-16T00:02:16.422119+0000","last_fullsized":"2023-12-16T00:02:16.422119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.438339+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:20.438339+0000","last_peered":"2023-12-16T00:02:20.438339+0000","last_clean":"2023-12-16T00:02:20.438339+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:20.438339+0000","last_undegraded":"2023-12-16T00:02:20.438339+0000","last_fullsized":"2023-12-16T00:02:20.438339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403828+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:01:10.403828+0000","last_peered":"2023-12-16T00:01:10.403828+0000","last_clean":"2023-12-16T00:01:10.403828+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:01:10.403828+0000","last_undegraded":"2023-12-16T00:01:10.403828+0000","last_fullsized":"2023-12-16T00:01:10.403828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638510+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:20.638510+0000","last_peered":"2023-12-16T00:01:20.638510+0000","last_clean":"2023-12-16T00:01:20.638510+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:20.638510+0000","last_undegraded":"2023-12-16T00:01:20.638510+0000","last_fullsized":"2023-12-16T00:01:20.638510+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.809475+0000","last_change":"2023-12-16T00:04:37.809494+0000","last_active":"2023-12-16T00:04:37.809475+0000","last_peered":"2023-12-16T00:04:37.809475+0000","last_clean":"2023-12-16T00:04:37.809475+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:04:37.809475+0000","last_undegraded":"2023-12-16T00:04:37.809475+0000","last_fullsized":"2023-12-16T00:04:37.809475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.809411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.809411+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.809411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:05.874622+0000","scrub_duration":0.001197219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:08.841845+0000","last_change":"2023-12-16T00:04:08.841865+0000","last_active":"2023-12-16T00:04:08.841845+0000","last_peered":"2023-12-16T00:04:08.841845+0000","last_clean":"2023-12-16T00:04:08.841845+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:04:08.841845+0000","last_undegraded":"2023-12-16T00:04:08.841845+0000","last_fullsized":"2023-12-16T00:04:08.841845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_clean_scrub_stamp":"2023-12-16T00:04:08.841784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:19.871757+0000","scrub_duration":0.00090735399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1615,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.416912+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:35.416912+0000","last_peered":"2023-12-16T00:02:35.416912+0000","last_clean":"2023-12-16T00:02:35.416912+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:35.416912+0000","last_undegraded":"2023-12-16T00:02:35.416912+0000","last_fullsized":"2023-12-16T00:02:35.416912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.444613+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:45.444613+0000","last_peered":"2023-12-16T00:02:45.444613+0000","last_clean":"2023-12-16T00:02:45.444613+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:45.444613+0000","last_undegraded":"2023-12-16T00:02:45.444613+0000","last_fullsized":"2023-12-16T00:02:45.444613+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413716+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:46.413716+0000","last_peered":"2023-12-16T00:01:46.413716+0000","last_clean":"2023-12-16T00:01:46.413716+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:46.413716+0000","last_undegraded":"2023-12-16T00:01:46.413716+0000","last_fullsized":"2023-12-16T00:01:46.413716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:42.883711+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:01:42.883711+0000","last_peered":"2023-12-16T00:01:42.883711+0000","last_clean":"2023-12-16T00:01:42.883711+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:01:42.883711+0000","last_undegraded":"2023-12-16T00:01:42.883711+0000","last_fullsized":"2023-12-16T00:01:42.883711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.831149+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:00:51.831149+0000","last_peered":"2023-12-16T00:00:51.831149+0000","last_clean":"2023-12-16T00:00:51.831149+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:00:51.831149+0000","last_undegraded":"2023-12-16T00:00:51.831149+0000","last_fullsized":"2023-12-16T00:00:51.831149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.437960+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:02:25.437960+0000","last_peered":"2023-12-16T00:02:25.437960+0000","last_clean":"2023-12-16T00:02:25.437960+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:02:25.437960+0000","last_undegraded":"2023-12-16T00:02:25.437960+0000","last_fullsized":"2023-12-16T00:02:25.437960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:02.272787+0000","last_change":"2023-12-16T00:04:02.272787+0000","last_active":"2023-12-16T00:04:02.272787+0000","last_peered":"2023-12-16T00:04:02.272787+0000","last_clean":"2023-12-16T00:04:02.272787+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:04:02.272787+0000","last_undegraded":"2023-12-16T00:04:02.272787+0000","last_fullsized":"2023-12-16T00:04:02.272787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_clean_scrub_stamp":"2023-12-16T00:04:02.272686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:18.235296+0000","scrub_duration":0.00092377500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.775781+0000","last_change":"2023-12-16T00:04:20.775800+0000","last_active":"2023-12-16T00:04:20.775781+0000","last_peered":"2023-12-16T00:04:20.775781+0000","last_clean":"2023-12-16T00:04:20.775781+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:04:20.775781+0000","last_undegraded":"2023-12-16T00:04:20.775781+0000","last_fullsized":"2023-12-16T00:04:20.775781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.775724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:36.738334+0000","scrub_duration":0.00087610900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:42.076798+0000","last_change":"2023-12-16T00:03:42.076798+0000","last_active":"2023-12-16T00:03:42.076798+0000","last_peered":"2023-12-16T00:03:42.076798+0000","last_clean":"2023-12-16T00:03:42.076798+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:03:42.076798+0000","last_undegraded":"2023-12-16T00:03:42.076798+0000","last_fullsized":"2023-12-16T00:03:42.076798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_clean_scrub_stamp":"2023-12-16T00:03:42.076689+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:57.373234+0000","scrub_duration":0.0028837759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":269,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214798+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214798+0000","last_peered":"2023-12-16T00:03:06.214798+0000","last_clean":"2023-12-16T00:03:06.214798+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214798+0000","last_undegraded":"2023-12-16T00:03:06.214798+0000","last_fullsized":"2023-12-16T00:03:06.214798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.999349+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:01:23.999349+0000","last_peered":"2023-12-16T00:01:23.999349+0000","last_clean":"2023-12-16T00:01:23.999349+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:01:23.999349+0000","last_undegraded":"2023-12-16T00:01:23.999349+0000","last_fullsized":"2023-12-16T00:01:23.999349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430630+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:55.430630+0000","last_peered":"2023-12-16T00:01:55.430630+0000","last_clean":"2023-12-16T00:01:55.430630+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:55.430630+0000","last_undegraded":"2023-12-16T00:01:55.430630+0000","last_fullsized":"2023-12-16T00:01:55.430630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.600943+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:25.600943+0000","last_peered":"2023-12-16T00:02:25.600943+0000","last_clean":"2023-12-16T00:02:25.600943+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:25.600943+0000","last_undegraded":"2023-12-16T00:02:25.600943+0000","last_fullsized":"2023-12-16T00:02:25.600943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4024,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182286+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182286+0000","last_peered":"2023-12-16T00:02:58.182286+0000","last_clean":"2023-12-16T00:02:58.182286+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182286+0000","last_undegraded":"2023-12-16T00:02:58.182286+0000","last_fullsized":"2023-12-16T00:02:58.182286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436097+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:02:15.436097+0000","last_peered":"2023-12-16T00:02:15.436097+0000","last_clean":"2023-12-16T00:02:15.436097+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:02:15.436097+0000","last_undegraded":"2023-12-16T00:02:15.436097+0000","last_fullsized":"2023-12-16T00:02:15.436097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437602+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:20.437602+0000","last_peered":"2023-12-16T00:02:20.437602+0000","last_clean":"2023-12-16T00:02:20.437602+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:20.437602+0000","last_undegraded":"2023-12-16T00:02:20.437602+0000","last_fullsized":"2023-12-16T00:02:20.437602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.175698+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:01:32.175698+0000","last_peered":"2023-12-16T00:01:32.175698+0000","last_clean":"2023-12-16T00:01:32.175698+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:01:32.175698+0000","last_undegraded":"2023-12-16T00:01:32.175698+0000","last_fullsized":"2023-12-16T00:01:32.175698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2433,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.989777+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:00:45.989777+0000","last_peered":"2023-12-16T00:00:45.989777+0000","last_clean":"2023-12-16T00:00:45.989777+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:00:45.989777+0000","last_undegraded":"2023-12-16T00:00:45.989777+0000","last_fullsized":"2023-12-16T00:00:45.989777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650855+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:02:10.650855+0000","last_peered":"2023-12-16T00:02:10.650855+0000","last_clean":"2023-12-16T00:02:10.650855+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:02:10.650855+0000","last_undegraded":"2023-12-16T00:02:10.650855+0000","last_fullsized":"2023-12-16T00:02:10.650855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575247+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575247+0000","last_peered":"2023-12-16T00:03:30.575247+0000","last_clean":"2023-12-16T00:03:30.575247+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575247+0000","last_undegraded":"2023-12-16T00:03:30.575247+0000","last_fullsized":"2023-12-16T00:03:30.575247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.737621+0000","last_change":"2023-12-16T00:04:26.737657+0000","last_active":"2023-12-16T00:04:26.737621+0000","last_peered":"2023-12-16T00:04:26.737621+0000","last_clean":"2023-12-16T00:04:26.737621+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:04:26.737621+0000","last_undegraded":"2023-12-16T00:04:26.737621+0000","last_fullsized":"2023-12-16T00:04:26.737621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.737548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:13.351966+0000","scrub_duration":0.00090241200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470629+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470629+0000","last_peered":"2023-12-16T00:02:55.470629+0000","last_clean":"2023-12-16T00:02:55.470629+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470629+0000","last_undegraded":"2023-12-16T00:02:55.470629+0000","last_fullsized":"2023-12-16T00:02:55.470629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":158,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.137072+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:18.137072+0000","last_peered":"2023-12-16T00:02:18.137072+0000","last_clean":"2023-12-16T00:02:18.137072+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:18.137072+0000","last_undegraded":"2023-12-16T00:02:18.137072+0000","last_fullsized":"2023-12-16T00:02:18.137072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.679499+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:08.679499+0000","last_peered":"2023-12-16T00:02:08.679499+0000","last_clean":"2023-12-16T00:02:08.679499+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:08.679499+0000","last_undegraded":"2023-12-16T00:02:08.679499+0000","last_fullsized":"2023-12-16T00:02:08.679499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:11.420710+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:02:11.420710+0000","last_peered":"2023-12-16T00:02:11.420710+0000","last_clean":"2023-12-16T00:02:11.420710+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:02:11.420710+0000","last_undegraded":"2023-12-16T00:02:11.420710+0000","last_fullsized":"2023-12-16T00:02:11.420710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:45.411329+0000","last_change":"2023-12-15T23:08:37.332651+0000","last_active":"2023-12-16T00:00:45.411329+0000","last_peered":"2023-12-16T00:00:45.411329+0000","last_clean":"2023-12-16T00:00:45.411329+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:00:45.411329+0000","last_undegraded":"2023-12-16T00:00:45.411329+0000","last_fullsized":"2023-12-16T00:00:45.411329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1700,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.420411+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:02:20.420411+0000","last_peered":"2023-12-16T00:02:20.420411+0000","last_clean":"2023-12-16T00:02:20.420411+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:02:20.420411+0000","last_undegraded":"2023-12-16T00:02:20.420411+0000","last_fullsized":"2023-12-16T00:02:20.420411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443263+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:45.443263+0000","last_peered":"2023-12-16T00:02:45.443263+0000","last_clean":"2023-12-16T00:02:45.443263+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:45.443263+0000","last_undegraded":"2023-12-16T00:02:45.443263+0000","last_fullsized":"2023-12-16T00:02:45.443263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437806+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:20.437806+0000","last_peered":"2023-12-16T00:02:20.437806+0000","last_clean":"2023-12-16T00:02:20.437806+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:20.437806+0000","last_undegraded":"2023-12-16T00:02:20.437806+0000","last_fullsized":"2023-12-16T00:02:20.437806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.425961+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:02:31.425961+0000","last_peered":"2023-12-16T00:02:31.425961+0000","last_clean":"2023-12-16T00:02:31.425961+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:02:31.425961+0000","last_undegraded":"2023-12-16T00:02:31.425961+0000","last_fullsized":"2023-12-16T00:02:31.425961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435325+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:02:15.435325+0000","last_peered":"2023-12-16T00:02:15.435325+0000","last_clean":"2023-12-16T00:02:15.435325+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:02:15.435325+0000","last_undegraded":"2023-12-16T00:02:15.435325+0000","last_fullsized":"2023-12-16T00:02:15.435325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.867712+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:00:52.867712+0000","last_peered":"2023-12-16T00:00:52.867712+0000","last_clean":"2023-12-16T00:00:52.867712+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:00:52.867712+0000","last_undegraded":"2023-12-16T00:00:52.867712+0000","last_fullsized":"2023-12-16T00:00:52.867712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.935882+0000","last_change":"2023-12-16T00:03:47.935882+0000","last_active":"2023-12-16T00:03:47.935882+0000","last_peered":"2023-12-16T00:03:47.935882+0000","last_clean":"2023-12-16T00:03:47.935882+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:03:47.935882+0000","last_undegraded":"2023-12-16T00:03:47.935882+0000","last_fullsized":"2023-12-16T00:03:47.935882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.935771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:56.317416+0000","scrub_duration":0.0010477100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.226844+0000","last_change":"2023-12-16T00:04:09.226874+0000","last_active":"2023-12-16T00:04:09.226844+0000","last_peered":"2023-12-16T00:04:09.226844+0000","last_clean":"2023-12-16T00:04:09.226844+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:04:09.226844+0000","last_undegraded":"2023-12-16T00:04:09.226844+0000","last_fullsized":"2023-12-16T00:04:09.226844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.226768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:44.325950+0000","scrub_duration":0.0012146679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.611838+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:31.611838+0000","last_peered":"2023-12-16T00:02:31.611838+0000","last_clean":"2023-12-16T00:02:31.611838+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:31.611838+0000","last_undegraded":"2023-12-16T00:02:31.611838+0000","last_fullsized":"2023-12-16T00:02:31.611838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355553+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355553+0000","last_peered":"2023-12-16T00:02:46.355553+0000","last_clean":"2023-12-16T00:02:46.355553+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355553+0000","last_undegraded":"2023-12-16T00:02:46.355553+0000","last_fullsized":"2023-12-16T00:02:46.355553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112436+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112436+0000","last_peered":"2023-12-16T00:02:45.112436+0000","last_clean":"2023-12-16T00:02:45.112436+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112436+0000","last_undegraded":"2023-12-16T00:02:45.112436+0000","last_fullsized":"2023-12-16T00:02:45.112436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439376+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:02:30.439376+0000","last_peered":"2023-12-16T00:02:30.439376+0000","last_clean":"2023-12-16T00:02:30.439376+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:02:30.439376+0000","last_undegraded":"2023-12-16T00:02:30.439376+0000","last_fullsized":"2023-12-16T00:02:30.439376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.258778+0000","last_change":"2023-12-16T00:04:05.258778+0000","last_active":"2023-12-16T00:04:05.258778+0000","last_peered":"2023-12-16T00:04:05.258778+0000","last_clean":"2023-12-16T00:04:05.258778+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:04:05.258778+0000","last_undegraded":"2023-12-16T00:04:05.258778+0000","last_fullsized":"2023-12-16T00:04:05.258778+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.258689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:24:41.933338+0000","scrub_duration":0.0011204909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1267,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:32.402095+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:32.402095+0000","last_peered":"2023-12-16T00:02:32.402095+0000","last_clean":"2023-12-16T00:02:32.402095+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:32.402095+0000","last_undegraded":"2023-12-16T00:02:32.402095+0000","last_fullsized":"2023-12-16T00:02:32.402095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443611+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:45.443611+0000","last_peered":"2023-12-16T00:02:45.443611+0000","last_clean":"2023-12-16T00:02:45.443611+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:45.443611+0000","last_undegraded":"2023-12-16T00:02:45.443611+0000","last_fullsized":"2023-12-16T00:02:45.443611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.436446+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:02:20.436446+0000","last_peered":"2023-12-16T00:02:20.436446+0000","last_clean":"2023-12-16T00:02:20.436446+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:02:20.436446+0000","last_undegraded":"2023-12-16T00:02:20.436446+0000","last_fullsized":"2023-12-16T00:02:20.436446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435963+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:02:15.435963+0000","last_peered":"2023-12-16T00:02:15.435963+0000","last_clean":"2023-12-16T00:02:15.435963+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:02:15.435963+0000","last_undegraded":"2023-12-16T00:02:15.435963+0000","last_fullsized":"2023-12-16T00:02:15.435963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2714,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.423106+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:02:30.423106+0000","last_peered":"2023-12-16T00:02:30.423106+0000","last_clean":"2023-12-16T00:02:30.423106+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:02:30.423106+0000","last_undegraded":"2023-12-16T00:02:30.423106+0000","last_fullsized":"2023-12-16T00:02:30.423106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:57.790135+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:00:57.790135+0000","last_peered":"2023-12-16T00:00:57.790135+0000","last_clean":"2023-12-16T00:00:57.790135+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:00:57.790135+0000","last_undegraded":"2023-12-16T00:00:57.790135+0000","last_fullsized":"2023-12-16T00:00:57.790135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959687+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959687+0000","last_peered":"2023-12-16T00:03:20.959687+0000","last_clean":"2023-12-16T00:03:20.959687+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959687+0000","last_undegraded":"2023-12-16T00:03:20.959687+0000","last_fullsized":"2023-12-16T00:03:20.959687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.858736+0000","last_change":"2023-12-16T00:03:51.858771+0000","last_active":"2023-12-16T00:03:51.858736+0000","last_peered":"2023-12-16T00:03:51.858736+0000","last_clean":"2023-12-16T00:03:51.858736+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:03:51.858736+0000","last_undegraded":"2023-12-16T00:03:51.858736+0000","last_fullsized":"2023-12-16T00:03:51.858736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.858668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:28.407183+0000","scrub_duration":0.001347146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.425026+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:40.425026+0000","last_peered":"2023-12-16T00:02:40.425026+0000","last_clean":"2023-12-16T00:02:40.425026+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:40.425026+0000","last_undegraded":"2023-12-16T00:02:40.425026+0000","last_fullsized":"2023-12-16T00:02:40.425026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137639+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137639+0000","last_peered":"2023-12-16T00:02:59.137639+0000","last_clean":"2023-12-16T00:02:59.137639+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137639+0000","last_undegraded":"2023-12-16T00:02:59.137639+0000","last_fullsized":"2023-12-16T00:02:59.137639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.422788+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:30.422788+0000","last_peered":"2023-12-16T00:02:30.422788+0000","last_clean":"2023-12-16T00:02:30.422788+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:30.422788+0000","last_undegraded":"2023-12-16T00:02:30.422788+0000","last_fullsized":"2023-12-16T00:02:30.422788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.656192+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:02:30.656192+0000","last_peered":"2023-12-16T00:02:30.656192+0000","last_clean":"2023-12-16T00:02:30.656192+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:02:30.656192+0000","last_undegraded":"2023-12-16T00:02:30.656192+0000","last_fullsized":"2023-12-16T00:02:30.656192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.652375+0000","last_change":"2023-12-16T00:04:30.652410+0000","last_active":"2023-12-16T00:04:30.652375+0000","last_peered":"2023-12-16T00:04:30.652375+0000","last_clean":"2023-12-16T00:04:30.652375+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:04:30.652375+0000","last_undegraded":"2023-12-16T00:04:30.652375+0000","last_fullsized":"2023-12-16T00:04:30.652375+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:16:38.233284+0000","scrub_duration":0.00097347899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.745095+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:01:28.745095+0000","last_peered":"2023-12-16T00:01:28.745095+0000","last_clean":"2023-12-16T00:01:28.745095+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:01:28.745095+0000","last_undegraded":"2023-12-16T00:01:28.745095+0000","last_fullsized":"2023-12-16T00:01:28.745095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334221+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334221+0000","last_peered":"2023-12-16T00:02:27.334221+0000","last_clean":"2023-12-16T00:02:27.334221+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334221+0000","last_undegraded":"2023-12-16T00:02:27.334221+0000","last_fullsized":"2023-12-16T00:02:27.334221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1514,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436505+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:02:15.436505+0000","last_peered":"2023-12-16T00:02:15.436505+0000","last_clean":"2023-12-16T00:02:15.436505+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:02:15.436505+0000","last_undegraded":"2023-12-16T00:02:15.436505+0000","last_fullsized":"2023-12-16T00:02:15.436505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.652072+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:02:15.652072+0000","last_peered":"2023-12-16T00:02:15.652072+0000","last_clean":"2023-12-16T00:02:15.652072+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:02:15.652072+0000","last_undegraded":"2023-12-16T00:02:15.652072+0000","last_fullsized":"2023-12-16T00:02:15.652072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433677+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:02:10.433677+0000","last_peered":"2023-12-16T00:02:10.433677+0000","last_clean":"2023-12-16T00:02:10.433677+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:02:10.433677+0000","last_undegraded":"2023-12-16T00:02:10.433677+0000","last_fullsized":"2023-12-16T00:02:10.433677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.715344+0000","last_change":"2023-12-16T00:03:55.715381+0000","last_active":"2023-12-16T00:03:55.715344+0000","last_peered":"2023-12-16T00:03:55.715344+0000","last_clean":"2023-12-16T00:03:55.715344+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:03:55.715344+0000","last_undegraded":"2023-12-16T00:03:55.715344+0000","last_fullsized":"2023-12-16T00:03:55.715344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.715267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.096913+0000","scrub_duration":0.001072323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.605521+0000","last_change":"2023-12-16T00:04:19.605541+0000","last_active":"2023-12-16T00:04:19.605521+0000","last_peered":"2023-12-16T00:04:19.605521+0000","last_clean":"2023-12-16T00:04:19.605521+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:04:19.605521+0000","last_undegraded":"2023-12-16T00:04:19.605521+0000","last_fullsized":"2023-12-16T00:04:19.605521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.605462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:55.243778+0000","scrub_duration":0.00083103500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355512+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355512+0000","last_peered":"2023-12-16T00:03:09.355512+0000","last_clean":"2023-12-16T00:03:09.355512+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355512+0000","last_undegraded":"2023-12-16T00:03:09.355512+0000","last_fullsized":"2023-12-16T00:03:09.355512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":178,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.570322+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:50.570322+0000","last_peered":"2023-12-16T00:02:50.570322+0000","last_clean":"2023-12-16T00:02:50.570322+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:50.570322+0000","last_undegraded":"2023-12-16T00:02:50.570322+0000","last_fullsized":"2023-12-16T00:02:50.570322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:48.212724+0000","last_change":"2023-12-16T00:04:48.212743+0000","last_active":"2023-12-16T00:04:48.212724+0000","last_peered":"2023-12-16T00:04:48.212724+0000","last_clean":"2023-12-16T00:04:48.212724+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:04:48.212724+0000","last_undegraded":"2023-12-16T00:04:48.212724+0000","last_fullsized":"2023-12-16T00:04:48.212724+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:48.212664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:48.212664+0000","last_clean_scrub_stamp":"2023-12-16T00:04:48.212664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:05:25.007001+0000","scrub_duration":0.0012711459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'115","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.070326+0000","last_change":"2023-12-16T00:03:41.070353+0000","last_active":"2023-12-16T00:03:41.070326+0000","last_peered":"2023-12-16T00:03:41.070326+0000","last_clean":"2023-12-16T00:03:41.070326+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:03:41.070326+0000","last_undegraded":"2023-12-16T00:03:41.070326+0000","last_fullsized":"2023-12-16T00:03:41.070326+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'115","last_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_deep_scrub":"54'115","last_deep_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.070267+0000","objects_scrubbed":29,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.536401+0000","scrub_duration":0.016426911999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443777+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:45.443777+0000","last_peered":"2023-12-16T00:02:45.443777+0000","last_clean":"2023-12-16T00:02:45.443777+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:45.443777+0000","last_undegraded":"2023-12-16T00:02:45.443777+0000","last_fullsized":"2023-12-16T00:02:45.443777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.442067+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:35.442067+0000","last_peered":"2023-12-16T00:02:35.442067+0000","last_clean":"2023-12-16T00:02:35.442067+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:35.442067+0000","last_undegraded":"2023-12-16T00:02:35.442067+0000","last_fullsized":"2023-12-16T00:02:35.442067+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419368+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:02:15.419368+0000","last_peered":"2023-12-16T00:02:15.419368+0000","last_clean":"2023-12-16T00:02:15.419368+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:02:15.419368+0000","last_undegraded":"2023-12-16T00:02:15.419368+0000","last_fullsized":"2023-12-16T00:02:15.419368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419458+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:02:15.419458+0000","last_peered":"2023-12-16T00:02:15.419458+0000","last_clean":"2023-12-16T00:02:15.419458+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:02:15.419458+0000","last_undegraded":"2023-12-16T00:02:15.419458+0000","last_fullsized":"2023-12-16T00:02:15.419458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642313+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:01:35.642313+0000","last_peered":"2023-12-16T00:01:35.642313+0000","last_clean":"2023-12-16T00:01:35.642313+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:01:35.642313+0000","last_undegraded":"2023-12-16T00:01:35.642313+0000","last_fullsized":"2023-12-16T00:01:35.642313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.257435+0000","last_change":"2023-12-16T00:04:19.257453+0000","last_active":"2023-12-16T00:04:19.257435+0000","last_peered":"2023-12-16T00:04:19.257435+0000","last_clean":"2023-12-16T00:04:19.257435+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:04:19.257435+0000","last_undegraded":"2023-12-16T00:04:19.257435+0000","last_fullsized":"2023-12-16T00:04:19.257435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.257374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:27:40.773145+0000","scrub_duration":0.00086390499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:38.161807+0000","last_change":"2023-12-16T00:04:38.161807+0000","last_active":"2023-12-16T00:04:38.161807+0000","last_peered":"2023-12-16T00:04:38.161807+0000","last_clean":"2023-12-16T00:04:38.161807+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:04:38.161807+0000","last_undegraded":"2023-12-16T00:04:38.161807+0000","last_fullsized":"2023-12-16T00:04:38.161807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:38.161724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:38.161724+0000","last_clean_scrub_stamp":"2023-12-16T00:04:38.161724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:09:03.042611+0000","scrub_duration":0.00096443199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.327933+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:35.327933+0000","last_peered":"2023-12-16T00:02:35.327933+0000","last_clean":"2023-12-16T00:02:35.327933+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:35.327933+0000","last_undegraded":"2023-12-16T00:02:35.327933+0000","last_fullsized":"2023-12-16T00:02:35.327933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.674611+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:10.674611+0000","last_peered":"2023-12-16T00:02:10.674611+0000","last_clean":"2023-12-16T00:02:10.674611+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:10.674611+0000","last_undegraded":"2023-12-16T00:02:10.674611+0000","last_fullsized":"2023-12-16T00:02:10.674611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647082+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:55.647082+0000","last_peered":"2023-12-16T00:01:55.647082+0000","last_clean":"2023-12-16T00:01:55.647082+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:55.647082+0000","last_undegraded":"2023-12-16T00:01:55.647082+0000","last_fullsized":"2023-12-16T00:01:55.647082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414669+0000","last_change":"2023-12-15T23:08:37.343454+0000","last_active":"2023-12-16T00:00:55.414669+0000","last_peered":"2023-12-16T00:00:55.414669+0000","last_clean":"2023-12-16T00:00:55.414669+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:00:55.414669+0000","last_undegraded":"2023-12-16T00:00:55.414669+0000","last_fullsized":"2023-12-16T00:00:55.414669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3489,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377147+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377147+0000","last_peered":"2023-12-16T00:03:02.377147+0000","last_clean":"2023-12-16T00:03:02.377147+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377147+0000","last_undegraded":"2023-12-16T00:03:02.377147+0000","last_fullsized":"2023-12-16T00:03:02.377147+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.033925+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:01:34.033925+0000","last_peered":"2023-12-16T00:01:34.033925+0000","last_clean":"2023-12-16T00:01:34.033925+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:01:34.033925+0000","last_undegraded":"2023-12-16T00:01:34.033925+0000","last_fullsized":"2023-12-16T00:01:34.033925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421739+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:02:16.421739+0000","last_peered":"2023-12-16T00:02:16.421739+0000","last_clean":"2023-12-16T00:02:16.421739+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:02:16.421739+0000","last_undegraded":"2023-12-16T00:02:16.421739+0000","last_fullsized":"2023-12-16T00:02:16.421739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427491+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:01:45.427491+0000","last_peered":"2023-12-16T00:01:45.427491+0000","last_clean":"2023-12-16T00:01:45.427491+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:01:45.427491+0000","last_undegraded":"2023-12-16T00:01:45.427491+0000","last_fullsized":"2023-12-16T00:01:45.427491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434936+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:02:10.434936+0000","last_peered":"2023-12-16T00:02:10.434936+0000","last_clean":"2023-12-16T00:02:10.434936+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:02:10.434936+0000","last_undegraded":"2023-12-16T00:02:10.434936+0000","last_fullsized":"2023-12-16T00:02:10.434936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.732064+0000","last_change":"2023-12-16T00:03:56.732100+0000","last_active":"2023-12-16T00:03:56.732064+0000","last_peered":"2023-12-16T00:03:56.732064+0000","last_clean":"2023-12-16T00:03:56.732064+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:03:56.732064+0000","last_undegraded":"2023-12-16T00:03:56.732064+0000","last_fullsized":"2023-12-16T00:03:56.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.731978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:06.685949+0000","scrub_duration":0.00092347600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.695233+0000","last_change":"2023-12-16T00:03:51.695233+0000","last_active":"2023-12-16T00:03:51.695233+0000","last_peered":"2023-12-16T00:03:51.695233+0000","last_clean":"2023-12-16T00:03:51.695233+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:03:51.695233+0000","last_undegraded":"2023-12-16T00:03:51.695233+0000","last_fullsized":"2023-12-16T00:03:51.695233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.695125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:53.485109+0000","scrub_duration":0.0011650359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.159341+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:24.159341+0000","last_peered":"2023-12-16T00:02:24.159341+0000","last_clean":"2023-12-16T00:02:24.159341+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:24.159341+0000","last_undegraded":"2023-12-16T00:02:24.159341+0000","last_fullsized":"2023-12-16T00:02:24.159341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":808,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.560253+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:16.560253+0000","last_peered":"2023-12-16T00:02:16.560253+0000","last_clean":"2023-12-16T00:02:16.560253+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:16.560253+0000","last_undegraded":"2023-12-16T00:02:16.560253+0000","last_fullsized":"2023-12-16T00:02:16.560253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778104+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778104+0000","last_peered":"2023-12-16T00:02:03.778104+0000","last_clean":"2023-12-16T00:02:03.778104+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778104+0000","last_undegraded":"2023-12-16T00:02:03.778104+0000","last_fullsized":"2023-12-16T00:02:03.778104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.599766+0000","last_change":"2023-12-16T00:04:37.599785+0000","last_active":"2023-12-16T00:04:37.599766+0000","last_peered":"2023-12-16T00:04:37.599766+0000","last_clean":"2023-12-16T00:04:37.599766+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:04:37.599766+0000","last_undegraded":"2023-12-16T00:04:37.599766+0000","last_fullsized":"2023-12-16T00:04:37.599766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.599703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.599703+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.599703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:21.750285+0000","scrub_duration":0.001144017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1805,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:18.043120+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:02:18.043120+0000","last_peered":"2023-12-16T00:02:18.043120+0000","last_clean":"2023-12-16T00:02:18.043120+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:02:18.043120+0000","last_undegraded":"2023-12-16T00:02:18.043120+0000","last_fullsized":"2023-12-16T00:02:18.043120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.984548+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:01:24.984548+0000","last_peered":"2023-12-16T00:01:24.984548+0000","last_clean":"2023-12-16T00:01:24.984548+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:01:24.984548+0000","last_undegraded":"2023-12-16T00:01:24.984548+0000","last_fullsized":"2023-12-16T00:01:24.984548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904049+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904049+0000","last_peered":"2023-12-16T00:01:44.904049+0000","last_clean":"2023-12-16T00:01:44.904049+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904049+0000","last_undegraded":"2023-12-16T00:01:44.904049+0000","last_fullsized":"2023-12-16T00:01:44.904049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421700+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:02:16.421700+0000","last_peered":"2023-12-16T00:02:16.421700+0000","last_clean":"2023-12-16T00:02:16.421700+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:02:16.421700+0000","last_undegraded":"2023-12-16T00:02:16.421700+0000","last_fullsized":"2023-12-16T00:02:16.421700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650691+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:02:10.650691+0000","last_peered":"2023-12-16T00:02:10.650691+0000","last_clean":"2023-12-16T00:02:10.650691+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:02:10.650691+0000","last_undegraded":"2023-12-16T00:02:10.650691+0000","last_fullsized":"2023-12-16T00:02:10.650691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468686+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468686+0000","last_peered":"2023-12-16T00:03:22.468686+0000","last_clean":"2023-12-16T00:03:22.468686+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468686+0000","last_undegraded":"2023-12-16T00:03:22.468686+0000","last_fullsized":"2023-12-16T00:03:22.468686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244156+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244156+0000","last_peered":"2023-12-16T00:03:28.244156+0000","last_clean":"2023-12-16T00:03:28.244156+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244156+0000","last_undegraded":"2023-12-16T00:03:28.244156+0000","last_fullsized":"2023-12-16T00:03:28.244156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334733+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334733+0000","last_peered":"2023-12-16T00:03:03.334733+0000","last_clean":"2023-12-16T00:03:03.334733+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334733+0000","last_undegraded":"2023-12-16T00:03:03.334733+0000","last_fullsized":"2023-12-16T00:03:03.334733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":244,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.163987+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:53.163987+0000","last_peered":"2023-12-16T00:02:53.163987+0000","last_clean":"2023-12-16T00:02:53.163987+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:53.163987+0000","last_undegraded":"2023-12-16T00:02:53.163987+0000","last_fullsized":"2023-12-16T00:02:53.163987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:53.416148+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:01:53.416148+0000","last_peered":"2023-12-16T00:01:53.416148+0000","last_clean":"2023-12-16T00:01:53.416148+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:01:53.416148+0000","last_undegraded":"2023-12-16T00:01:53.416148+0000","last_fullsized":"2023-12-16T00:01:53.416148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647206+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:55.647206+0000","last_peered":"2023-12-16T00:01:55.647206+0000","last_clean":"2023-12-16T00:01:55.647206+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:55.647206+0000","last_undegraded":"2023-12-16T00:01:55.647206+0000","last_fullsized":"2023-12-16T00:01:55.647206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.118550+0000","last_change":"2023-12-16T00:03:58.118570+0000","last_active":"2023-12-16T00:03:58.118550+0000","last_peered":"2023-12-16T00:03:58.118550+0000","last_clean":"2023-12-16T00:03:58.118550+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:03:58.118550+0000","last_undegraded":"2023-12-16T00:03:58.118550+0000","last_fullsized":"2023-12-16T00:03:58.118550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.118482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:22:03.904023+0000","scrub_duration":0.00098478099999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707299+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707299+0000","last_peered":"2023-12-16T00:02:10.707299+0000","last_clean":"2023-12-16T00:02:10.707299+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707299+0000","last_undegraded":"2023-12-16T00:02:10.707299+0000","last_fullsized":"2023-12-16T00:02:10.707299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051798+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051798+0000","last_peered":"2023-12-16T00:01:33.051798+0000","last_clean":"2023-12-16T00:01:33.051798+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051798+0000","last_undegraded":"2023-12-16T00:01:33.051798+0000","last_fullsized":"2023-12-16T00:01:33.051798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:38.975172+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:01:38.975172+0000","last_peered":"2023-12-16T00:01:38.975172+0000","last_clean":"2023-12-16T00:01:38.975172+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:01:38.975172+0000","last_undegraded":"2023-12-16T00:01:38.975172+0000","last_fullsized":"2023-12-16T00:01:38.975172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":126,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.574179+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:01:55.574179+0000","last_peered":"2023-12-16T00:01:55.574179+0000","last_clean":"2023-12-16T00:01:55.574179+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:01:55.574179+0000","last_undegraded":"2023-12-16T00:01:55.574179+0000","last_fullsized":"2023-12-16T00:01:55.574179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350573+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350573+0000","last_peered":"2023-12-16T00:03:11.350573+0000","last_clean":"2023-12-16T00:03:11.350573+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350573+0000","last_undegraded":"2023-12-16T00:03:11.350573+0000","last_fullsized":"2023-12-16T00:03:11.350573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.159507+0000","last_change":"2023-12-16T00:04:29.159527+0000","last_active":"2023-12-16T00:04:29.159507+0000","last_peered":"2023-12-16T00:04:29.159507+0000","last_clean":"2023-12-16T00:04:29.159507+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:04:29.159507+0000","last_undegraded":"2023-12-16T00:04:29.159507+0000","last_fullsized":"2023-12-16T00:04:29.159507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.159437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:42.436132+0000","scrub_duration":0.001297589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.541039+0000","last_change":"2023-12-16T00:04:13.541055+0000","last_active":"2023-12-16T00:04:13.541039+0000","last_peered":"2023-12-16T00:04:13.541039+0000","last_clean":"2023-12-16T00:04:13.541039+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:04:13.541039+0000","last_undegraded":"2023-12-16T00:04:13.541039+0000","last_fullsized":"2023-12-16T00:04:13.541039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.540990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:15:02.204008+0000","scrub_duration":0.001141256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461465+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461465+0000","last_peered":"2023-12-16T00:03:22.461465+0000","last_clean":"2023-12-16T00:03:22.461465+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461465+0000","last_undegraded":"2023-12-16T00:03:22.461465+0000","last_fullsized":"2023-12-16T00:03:22.461465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161263+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161263+0000","last_peered":"2023-12-16T00:03:14.161263+0000","last_clean":"2023-12-16T00:03:14.161263+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161263+0000","last_undegraded":"2023-12-16T00:03:14.161263+0000","last_fullsized":"2023-12-16T00:03:14.161263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193064+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193064+0000","last_peered":"2023-12-16T00:02:53.193064+0000","last_clean":"2023-12-16T00:02:53.193064+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193064+0000","last_undegraded":"2023-12-16T00:02:53.193064+0000","last_fullsized":"2023-12-16T00:02:53.193064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439582+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:02:30.439582+0000","last_peered":"2023-12-16T00:02:30.439582+0000","last_clean":"2023-12-16T00:02:30.439582+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:02:30.439582+0000","last_undegraded":"2023-12-16T00:02:30.439582+0000","last_fullsized":"2023-12-16T00:02:30.439582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408829+0000","last_change":"2023-12-15T23:08:37.333477+0000","last_active":"2023-12-16T00:00:35.408829+0000","last_peered":"2023-12-16T00:00:35.408829+0000","last_clean":"2023-12-16T00:00:35.408829+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:00:35.408829+0000","last_undegraded":"2023-12-16T00:00:35.408829+0000","last_fullsized":"2023-12-16T00:00:35.408829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1587,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520664+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520664+0000","last_peered":"2023-12-16T00:02:25.520664+0000","last_clean":"2023-12-16T00:02:25.520664+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520664+0000","last_undegraded":"2023-12-16T00:02:25.520664+0000","last_fullsized":"2023-12-16T00:02:25.520664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410634+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:31.410634+0000","last_peered":"2023-12-16T00:01:31.410634+0000","last_clean":"2023-12-16T00:01:31.410634+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:31.410634+0000","last_undegraded":"2023-12-16T00:01:31.410634+0000","last_fullsized":"2023-12-16T00:01:31.410634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":180,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:43.313125+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:00:43.313125+0000","last_peered":"2023-12-16T00:00:43.313125+0000","last_clean":"2023-12-16T00:00:43.313125+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:00:43.313125+0000","last_undegraded":"2023-12-16T00:00:43.313125+0000","last_fullsized":"2023-12-16T00:00:43.313125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414172+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414172+0000","last_peered":"2023-12-16T00:03:17.414172+0000","last_clean":"2023-12-16T00:03:17.414172+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414172+0000","last_undegraded":"2023-12-16T00:03:17.414172+0000","last_fullsized":"2023-12-16T00:03:17.414172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.714859+0000","last_change":"2023-12-16T00:04:27.714879+0000","last_active":"2023-12-16T00:04:27.714859+0000","last_peered":"2023-12-16T00:04:27.714859+0000","last_clean":"2023-12-16T00:04:27.714859+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:04:27.714859+0000","last_undegraded":"2023-12-16T00:04:27.714859+0000","last_fullsized":"2023-12-16T00:04:27.714859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.714794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:23.216681+0000","scrub_duration":0.001320136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.531828+0000","last_change":"2023-12-16T00:03:41.531828+0000","last_active":"2023-12-16T00:03:41.531828+0000","last_peered":"2023-12-16T00:03:41.531828+0000","last_clean":"2023-12-16T00:03:41.531828+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:03:41.531828+0000","last_undegraded":"2023-12-16T00:03:41.531828+0000","last_fullsized":"2023-12-16T00:03:41.531828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.531720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.997854+0000","scrub_duration":0.001119472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990331+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990331+0000","last_peered":"2023-12-16T00:03:19.990331+0000","last_clean":"2023-12-16T00:03:19.990331+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990331+0000","last_undegraded":"2023-12-16T00:03:19.990331+0000","last_fullsized":"2023-12-16T00:03:19.990331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.656100+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:30.656100+0000","last_peered":"2023-12-16T00:02:30.656100+0000","last_clean":"2023-12-16T00:02:30.656100+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:30.656100+0000","last_undegraded":"2023-12-16T00:02:30.656100+0000","last_fullsized":"2023-12-16T00:02:30.656100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.441073+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:02:30.441073+0000","last_peered":"2023-12-16T00:02:30.441073+0000","last_clean":"2023-12-16T00:02:30.441073+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:02:30.441073+0000","last_undegraded":"2023-12-16T00:02:30.441073+0000","last_fullsized":"2023-12-16T00:02:30.441073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439536+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:02:30.439536+0000","last_peered":"2023-12-16T00:02:30.439536+0000","last_clean":"2023-12-16T00:02:30.439536+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:02:30.439536+0000","last_undegraded":"2023-12-16T00:02:30.439536+0000","last_fullsized":"2023-12-16T00:02:30.439536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:28.137963+0000","last_change":"2023-12-15T23:09:02.675276+0000","last_active":"2023-12-16T00:00:28.137963+0000","last_peered":"2023-12-16T00:00:28.137963+0000","last_clean":"2023-12-16T00:00:28.137963+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:00:28.137963+0000","last_undegraded":"2023-12-16T00:00:28.137963+0000","last_fullsized":"2023-12-16T00:00:28.137963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'140","reported_seq":6045,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:44.854897+0000","last_change":"2023-12-16T00:04:44.854933+0000","last_active":"2023-12-16T00:04:44.854897+0000","last_peered":"2023-12-16T00:04:44.854897+0000","last_clean":"2023-12-16T00:04:44.854897+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:04:44.854897+0000","last_undegraded":"2023-12-16T00:04:44.854897+0000","last_fullsized":"2023-12-16T00:04:44.854897+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'140","last_scrub_stamp":"2023-12-16T00:04:44.854835+0000","last_deep_scrub":"54'140","last_deep_scrub_stamp":"2023-12-16T00:04:44.854835+0000","last_clean_scrub_stamp":"2023-12-16T00:04:44.854835+0000","objects_scrubbed":40,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:05.262749+0000","scrub_duration":0.020750068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6463,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166639+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166639+0000","last_peered":"2023-12-16T00:03:03.166639+0000","last_clean":"2023-12-16T00:03:03.166639+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166639+0000","last_undegraded":"2023-12-16T00:03:03.166639+0000","last_fullsized":"2023-12-16T00:03:03.166639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478560+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478560+0000","last_peered":"2023-12-16T00:02:02.478560+0000","last_clean":"2023-12-16T00:02:02.478560+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478560+0000","last_undegraded":"2023-12-16T00:02:02.478560+0000","last_fullsized":"2023-12-16T00:02:02.478560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.790148+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:01:16.790148+0000","last_peered":"2023-12-16T00:01:16.790148+0000","last_clean":"2023-12-16T00:01:16.790148+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:01:16.790148+0000","last_undegraded":"2023-12-16T00:01:16.790148+0000","last_fullsized":"2023-12-16T00:01:16.790148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1420,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.174601+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:01:31.174601+0000","last_peered":"2023-12-16T00:01:31.174601+0000","last_clean":"2023-12-16T00:01:31.174601+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:01:31.174601+0000","last_undegraded":"2023-12-16T00:01:31.174601+0000","last_fullsized":"2023-12-16T00:01:31.174601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.007493+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:01:15.007493+0000","last_peered":"2023-12-16T00:01:15.007493+0000","last_clean":"2023-12-16T00:01:15.007493+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:01:15.007493+0000","last_undegraded":"2023-12-16T00:01:15.007493+0000","last_fullsized":"2023-12-16T00:01:15.007493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.639670+0000","last_change":"2023-12-16T00:03:36.639670+0000","last_active":"2023-12-16T00:03:36.639670+0000","last_peered":"2023-12-16T00:03:36.639670+0000","last_clean":"2023-12-16T00:03:36.639670+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:03:36.639670+0000","last_undegraded":"2023-12-16T00:03:36.639670+0000","last_fullsized":"2023-12-16T00:03:36.639670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.639584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:26.898631+0000","scrub_duration":0.0012042960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.612164+0000","last_change":"2023-12-16T00:03:31.612184+0000","last_active":"2023-12-16T00:03:31.612164+0000","last_peered":"2023-12-16T00:03:31.612164+0000","last_clean":"2023-12-16T00:03:31.612164+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:03:31.612164+0000","last_undegraded":"2023-12-16T00:03:31.612164+0000","last_fullsized":"2023-12-16T00:03:31.612164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.612104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:55.639396+0000","scrub_duration":0.001020881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.567092+0000","last_change":"2023-12-16T00:03:52.567111+0000","last_active":"2023-12-16T00:03:52.567092+0000","last_peered":"2023-12-16T00:03:52.567092+0000","last_clean":"2023-12-16T00:03:52.567092+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:03:52.567092+0000","last_undegraded":"2023-12-16T00:03:52.567092+0000","last_fullsized":"2023-12-16T00:03:52.567092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.567032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:09.870577+0000","scrub_duration":0.00099403600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":329,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703371+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703371+0000","last_peered":"2023-12-16T00:02:37.703371+0000","last_clean":"2023-12-16T00:02:37.703371+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703371+0000","last_undegraded":"2023-12-16T00:02:37.703371+0000","last_fullsized":"2023-12-16T00:02:37.703371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":943,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.174022+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.174022+0000","last_peered":"2023-12-16T00:02:51.174022+0000","last_clean":"2023-12-16T00:02:51.174022+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.174022+0000","last_undegraded":"2023-12-16T00:02:51.174022+0000","last_fullsized":"2023-12-16T00:02:51.174022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130536+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130536+0000","last_peered":"2023-12-16T00:01:57.130536+0000","last_clean":"2023-12-16T00:01:57.130536+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130536+0000","last_undegraded":"2023-12-16T00:01:57.130536+0000","last_fullsized":"2023-12-16T00:01:57.130536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.243312+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:01:47.243312+0000","last_peered":"2023-12-16T00:01:47.243312+0000","last_clean":"2023-12-16T00:01:47.243312+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:01:47.243312+0000","last_undegraded":"2023-12-16T00:01:47.243312+0000","last_fullsized":"2023-12-16T00:01:47.243312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.836140+0000","last_change":"2023-12-16T00:04:24.836161+0000","last_active":"2023-12-16T00:04:24.836140+0000","last_peered":"2023-12-16T00:04:24.836140+0000","last_clean":"2023-12-16T00:04:24.836140+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:04:24.836140+0000","last_undegraded":"2023-12-16T00:04:24.836140+0000","last_fullsized":"2023-12-16T00:04:24.836140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.836073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:13.730641+0000","scrub_duration":0.0014096079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'131","reported_seq":4179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:33.238825+0000","last_change":"2023-12-16T00:04:33.238873+0000","last_active":"2023-12-16T00:04:33.238825+0000","last_peered":"2023-12-16T00:04:33.238825+0000","last_clean":"2023-12-16T00:04:33.238825+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:04:33.238825+0000","last_undegraded":"2023-12-16T00:04:33.238825+0000","last_fullsized":"2023-12-16T00:04:33.238825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'131","last_scrub_stamp":"2023-12-16T00:04:33.238763+0000","last_deep_scrub":"54'131","last_deep_scrub_stamp":"2023-12-16T00:04:33.238763+0000","last_clean_scrub_stamp":"2023-12-16T00:04:33.238763+0000","objects_scrubbed":36,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:51.602474+0000","scrub_duration":0.018596789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8554,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160224+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160224+0000","last_peered":"2023-12-16T00:02:44.160224+0000","last_clean":"2023-12-16T00:02:44.160224+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160224+0000","last_undegraded":"2023-12-16T00:02:44.160224+0000","last_fullsized":"2023-12-16T00:02:44.160224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1475,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.861478+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:01:34.861478+0000","last_peered":"2023-12-16T00:01:34.861478+0000","last_clean":"2023-12-16T00:01:34.861478+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:01:34.861478+0000","last_undegraded":"2023-12-16T00:01:34.861478+0000","last_fullsized":"2023-12-16T00:01:34.861478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.185711+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:01:12.185711+0000","last_peered":"2023-12-16T00:01:12.185711+0000","last_clean":"2023-12-16T00:01:12.185711+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:01:12.185711+0000","last_undegraded":"2023-12-16T00:01:12.185711+0000","last_fullsized":"2023-12-16T00:01:12.185711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.128631+0000","last_change":"2023-12-16T00:03:52.128631+0000","last_active":"2023-12-16T00:03:52.128631+0000","last_peered":"2023-12-16T00:03:52.128631+0000","last_clean":"2023-12-16T00:03:52.128631+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:03:52.128631+0000","last_undegraded":"2023-12-16T00:03:52.128631+0000","last_fullsized":"2023-12-16T00:03:52.128631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.128525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:53.105511+0000","scrub_duration":0.00088122500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.540607+0000","last_change":"2023-12-16T00:03:59.540637+0000","last_active":"2023-12-16T00:03:59.540607+0000","last_peered":"2023-12-16T00:03:59.540607+0000","last_clean":"2023-12-16T00:03:59.540607+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:03:59.540607+0000","last_undegraded":"2023-12-16T00:03:59.540607+0000","last_fullsized":"2023-12-16T00:03:59.540607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.540485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:06.902422+0000","scrub_duration":0.001346311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'163","reported_seq":300,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.193935+0000","last_change":"2023-12-16T00:04:30.193971+0000","last_active":"2023-12-16T00:04:30.193935+0000","last_peered":"2023-12-16T00:04:30.193935+0000","last_clean":"2023-12-16T00:04:30.193935+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:04:30.193935+0000","last_undegraded":"2023-12-16T00:04:30.193935+0000","last_fullsized":"2023-12-16T00:04:30.193935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.193875+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:19.677418+0000","scrub_duration":0.0057472679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:15.221706+0000","last_change":"2023-12-16T00:04:15.221724+0000","last_active":"2023-12-16T00:04:15.221706+0000","last_peered":"2023-12-16T00:04:15.221706+0000","last_clean":"2023-12-16T00:04:15.221706+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:04:15.221706+0000","last_undegraded":"2023-12-16T00:04:15.221706+0000","last_fullsized":"2023-12-16T00:04:15.221706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_clean_scrub_stamp":"2023-12-16T00:04:15.221646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:22.707320+0000","scrub_duration":0.0012625480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":303,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152541+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152541+0000","last_peered":"2023-12-16T00:03:24.152541+0000","last_clean":"2023-12-16T00:03:24.152541+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152541+0000","last_undegraded":"2023-12-16T00:03:24.152541+0000","last_fullsized":"2023-12-16T00:03:24.152541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":991,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196285+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196285+0000","last_peered":"2023-12-16T00:02:25.196285+0000","last_clean":"2023-12-16T00:02:25.196285+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196285+0000","last_undegraded":"2023-12-16T00:02:25.196285+0000","last_fullsized":"2023-12-16T00:02:25.196285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483332+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483332+0000","last_peered":"2023-12-16T00:02:23.483332+0000","last_clean":"2023-12-16T00:02:23.483332+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483332+0000","last_undegraded":"2023-12-16T00:02:23.483332+0000","last_fullsized":"2023-12-16T00:02:23.483332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.658195+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:02:40.658195+0000","last_peered":"2023-12-16T00:02:40.658195+0000","last_clean":"2023-12-16T00:02:40.658195+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:02:40.658195+0000","last_undegraded":"2023-12-16T00:02:40.658195+0000","last_fullsized":"2023-12-16T00:02:40.658195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.179585+0000","last_change":"2023-12-16T00:03:55.179622+0000","last_active":"2023-12-16T00:03:55.179585+0000","last_peered":"2023-12-16T00:03:55.179585+0000","last_clean":"2023-12-16T00:03:55.179585+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:03:55.179585+0000","last_undegraded":"2023-12-16T00:03:55.179585+0000","last_fullsized":"2023-12-16T00:03:55.179585+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.179520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:26:19.218144+0000","scrub_duration":0.00092174800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1298,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966553+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966553+0000","last_peered":"2023-12-16T00:03:18.966553+0000","last_clean":"2023-12-16T00:03:18.966553+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966553+0000","last_undegraded":"2023-12-16T00:03:18.966553+0000","last_fullsized":"2023-12-16T00:03:18.966553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:08.874764+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:01:08.874764+0000","last_peered":"2023-12-16T00:01:08.874764+0000","last_clean":"2023-12-16T00:01:08.874764+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:01:08.874764+0000","last_undegraded":"2023-12-16T00:01:08.874764+0000","last_fullsized":"2023-12-16T00:01:08.874764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464112+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464112+0000","last_peered":"2023-12-16T00:03:25.464112+0000","last_clean":"2023-12-16T00:03:25.464112+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464112+0000","last_undegraded":"2023-12-16T00:03:25.464112+0000","last_fullsized":"2023-12-16T00:03:25.464112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.200715+0000","last_change":"2023-12-16T00:04:11.200715+0000","last_active":"2023-12-16T00:04:11.200715+0000","last_peered":"2023-12-16T00:04:11.200715+0000","last_clean":"2023-12-16T00:04:11.200715+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:04:11.200715+0000","last_undegraded":"2023-12-16T00:04:11.200715+0000","last_fullsized":"2023-12-16T00:04:11.200715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.200632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:05.973413+0000","scrub_duration":0.00096315500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.494653+0000","last_change":"2023-12-16T00:04:00.494673+0000","last_active":"2023-12-16T00:04:00.494653+0000","last_peered":"2023-12-16T00:04:00.494653+0000","last_clean":"2023-12-16T00:04:00.494653+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:04:00.494653+0000","last_undegraded":"2023-12-16T00:04:00.494653+0000","last_fullsized":"2023-12-16T00:04:00.494653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:12.576991+0000","scrub_duration":0.0013840110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529769+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529769+0000","last_peered":"2023-12-16T00:02:53.529769+0000","last_clean":"2023-12-16T00:02:53.529769+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529769+0000","last_undegraded":"2023-12-16T00:02:53.529769+0000","last_fullsized":"2023-12-16T00:02:53.529769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662996+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662996+0000","last_peered":"2023-12-16T00:02:16.662996+0000","last_clean":"2023-12-16T00:02:16.662996+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662996+0000","last_undegraded":"2023-12-16T00:02:16.662996+0000","last_fullsized":"2023-12-16T00:02:16.662996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.722648+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:01:26.722648+0000","last_peered":"2023-12-16T00:01:26.722648+0000","last_clean":"2023-12-16T00:01:26.722648+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:01:26.722648+0000","last_undegraded":"2023-12-16T00:01:26.722648+0000","last_fullsized":"2023-12-16T00:01:26.722648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.142469+0000","last_change":"2023-12-16T00:03:56.142490+0000","last_active":"2023-12-16T00:03:56.142469+0000","last_peered":"2023-12-16T00:03:56.142469+0000","last_clean":"2023-12-16T00:03:56.142469+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:03:56.142469+0000","last_undegraded":"2023-12-16T00:03:56.142469+0000","last_fullsized":"2023-12-16T00:03:56.142469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.142408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:45.112014+0000","scrub_duration":0.00089426600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5951,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323807+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323807+0000","last_peered":"2023-12-16T00:03:09.323807+0000","last_clean":"2023-12-16T00:03:09.323807+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323807+0000","last_undegraded":"2023-12-16T00:03:09.323807+0000","last_fullsized":"2023-12-16T00:03:09.323807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.840149+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:01:10.840149+0000","last_peered":"2023-12-16T00:01:10.840149+0000","last_clean":"2023-12-16T00:01:10.840149+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:01:10.840149+0000","last_undegraded":"2023-12-16T00:01:10.840149+0000","last_fullsized":"2023-12-16T00:01:10.840149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855239+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855239+0000","last_peered":"2023-12-16T00:03:23.855239+0000","last_clean":"2023-12-16T00:03:23.855239+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855239+0000","last_undegraded":"2023-12-16T00:03:23.855239+0000","last_fullsized":"2023-12-16T00:03:23.855239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.233244+0000","last_change":"2023-12-16T00:03:41.233244+0000","last_active":"2023-12-16T00:03:41.233244+0000","last_peered":"2023-12-16T00:03:41.233244+0000","last_clean":"2023-12-16T00:03:41.233244+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:03:41.233244+0000","last_undegraded":"2023-12-16T00:03:41.233244+0000","last_fullsized":"2023-12-16T00:03:41.233244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.233146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:29.219613+0000","scrub_duration":0.00094526300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.537375+0000","last_change":"2023-12-16T00:03:35.537411+0000","last_active":"2023-12-16T00:03:35.537375+0000","last_peered":"2023-12-16T00:03:35.537375+0000","last_clean":"2023-12-16T00:03:35.537375+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:03:35.537375+0000","last_undegraded":"2023-12-16T00:03:35.537375+0000","last_fullsized":"2023-12-16T00:03:35.537375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.537285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:54.142352+0000","scrub_duration":0.0011419679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335105+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335105+0000","last_peered":"2023-12-16T00:03:07.335105+0000","last_clean":"2023-12-16T00:03:07.335105+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335105+0000","last_undegraded":"2023-12-16T00:03:07.335105+0000","last_fullsized":"2023-12-16T00:03:07.335105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453548+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453548+0000","last_peered":"2023-12-16T00:02:34.453548+0000","last_clean":"2023-12-16T00:02:34.453548+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453548+0000","last_undegraded":"2023-12-16T00:02:34.453548+0000","last_fullsized":"2023-12-16T00:02:34.453548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116761+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116761+0000","last_peered":"2023-12-16T00:02:44.116761+0000","last_clean":"2023-12-16T00:02:44.116761+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116761+0000","last_undegraded":"2023-12-16T00:02:44.116761+0000","last_fullsized":"2023-12-16T00:02:44.116761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:34.199809+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:01:34.199809+0000","last_peered":"2023-12-16T00:01:34.199809+0000","last_clean":"2023-12-16T00:01:34.199809+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:01:34.199809+0000","last_undegraded":"2023-12-16T00:01:34.199809+0000","last_fullsized":"2023-12-16T00:01:34.199809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.097018+0000","last_change":"2023-12-16T00:03:57.097038+0000","last_active":"2023-12-16T00:03:57.097018+0000","last_peered":"2023-12-16T00:03:57.097018+0000","last_clean":"2023-12-16T00:03:57.097018+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:03:57.097018+0000","last_undegraded":"2023-12-16T00:03:57.097018+0000","last_fullsized":"2023-12-16T00:03:57.097018+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.096950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:03.688612+0000","scrub_duration":0.0011013220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629219+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629219+0000","last_peered":"2023-12-16T00:01:50.629219+0000","last_clean":"2023-12-16T00:01:50.629219+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629219+0000","last_undegraded":"2023-12-16T00:01:50.629219+0000","last_fullsized":"2023-12-16T00:01:50.629219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.896996+0000","last_change":"2023-12-16T00:03:35.896996+0000","last_active":"2023-12-16T00:03:35.896996+0000","last_peered":"2023-12-16T00:03:35.896996+0000","last_clean":"2023-12-16T00:03:35.896996+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:03:35.896996+0000","last_undegraded":"2023-12-16T00:03:35.896996+0000","last_fullsized":"2023-12-16T00:03:35.896996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.896905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.496966+0000","scrub_duration":0.0014309380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:12.560783+0000","last_change":"2023-12-16T00:04:12.560804+0000","last_active":"2023-12-16T00:04:12.560783+0000","last_peered":"2023-12-16T00:04:12.560783+0000","last_clean":"2023-12-16T00:04:12.560783+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:04:12.560783+0000","last_undegraded":"2023-12-16T00:04:12.560783+0000","last_fullsized":"2023-12-16T00:04:12.560783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_clean_scrub_stamp":"2023-12-16T00:04:12.560713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:45:06.835342+0000","scrub_duration":0.001076154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:28.200075+0000","last_change":"2023-12-16T00:04:28.200097+0000","last_active":"2023-12-16T00:04:28.200075+0000","last_peered":"2023-12-16T00:04:28.200075+0000","last_clean":"2023-12-16T00:04:28.200075+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:04:28.200075+0000","last_undegraded":"2023-12-16T00:04:28.200075+0000","last_fullsized":"2023-12-16T00:04:28.200075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_clean_scrub_stamp":"2023-12-16T00:04:28.199999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:26:48.754557+0000","scrub_duration":0.001243393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.079336+0000","last_change":"2023-12-16T00:03:38.079336+0000","last_active":"2023-12-16T00:03:38.079336+0000","last_peered":"2023-12-16T00:03:38.079336+0000","last_clean":"2023-12-16T00:03:38.079336+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:03:38.079336+0000","last_undegraded":"2023-12-16T00:03:38.079336+0000","last_fullsized":"2023-12-16T00:03:38.079336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.079227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:55.382772+0000","scrub_duration":0.0013798949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.356005+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.356005+0000","last_peered":"2023-12-16T00:02:33.356005+0000","last_clean":"2023-12-16T00:02:33.356005+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.356005+0000","last_undegraded":"2023-12-16T00:02:33.356005+0000","last_fullsized":"2023-12-16T00:02:33.356005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:40.410121+0000","last_change":"2023-12-15T23:08:37.338579+0000","last_active":"2023-12-16T00:00:40.410121+0000","last_peered":"2023-12-16T00:00:40.410121+0000","last_clean":"2023-12-16T00:00:40.410121+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:00:40.410121+0000","last_undegraded":"2023-12-16T00:00:40.410121+0000","last_fullsized":"2023-12-16T00:00:40.410121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396540+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396540+0000","last_peered":"2023-12-16T00:01:59.396540+0000","last_clean":"2023-12-16T00:01:59.396540+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396540+0000","last_undegraded":"2023-12-16T00:01:59.396540+0000","last_fullsized":"2023-12-16T00:01:59.396540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.553856+0000","last_change":"2023-12-16T00:03:33.553856+0000","last_active":"2023-12-16T00:03:33.553856+0000","last_peered":"2023-12-16T00:03:33.553856+0000","last_clean":"2023-12-16T00:03:33.553856+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:03:33.553856+0000","last_undegraded":"2023-12-16T00:03:33.553856+0000","last_fullsized":"2023-12-16T00:03:33.553856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.553765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:14.335435+0000","scrub_duration":0.001373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:18.736355+0000","last_change":"2023-12-16T00:04:18.736375+0000","last_active":"2023-12-16T00:04:18.736355+0000","last_peered":"2023-12-16T00:04:18.736355+0000","last_clean":"2023-12-16T00:04:18.736355+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:04:18.736355+0000","last_undegraded":"2023-12-16T00:04:18.736355+0000","last_fullsized":"2023-12-16T00:04:18.736355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_clean_scrub_stamp":"2023-12-16T00:04:18.736296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:48.764498+0000","scrub_duration":0.001450713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:32.847040+0000","last_change":"2023-12-16T00:04:32.847063+0000","last_active":"2023-12-16T00:04:32.847040+0000","last_peered":"2023-12-16T00:04:32.847040+0000","last_clean":"2023-12-16T00:04:32.847040+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:04:32.847040+0000","last_undegraded":"2023-12-16T00:04:32.847040+0000","last_fullsized":"2023-12-16T00:04:32.847040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:32.846963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:32.846963+0000","last_clean_scrub_stamp":"2023-12-16T00:04:32.846963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:43.762694+0000","scrub_duration":0.001381492,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968164+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968164+0000","last_peered":"2023-12-16T00:03:15.968164+0000","last_clean":"2023-12-16T00:03:15.968164+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968164+0000","last_undegraded":"2023-12-16T00:03:15.968164+0000","last_fullsized":"2023-12-16T00:03:15.968164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561094+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561094+0000","last_peered":"2023-12-16T00:02:30.561094+0000","last_clean":"2023-12-16T00:02:30.561094+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561094+0000","last_undegraded":"2023-12-16T00:02:30.561094+0000","last_fullsized":"2023-12-16T00:02:30.561094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.255242+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:01:28.255242+0000","last_peered":"2023-12-16T00:01:28.255242+0000","last_clean":"2023-12-16T00:01:28.255242+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:01:28.255242+0000","last_undegraded":"2023-12-16T00:01:28.255242+0000","last_fullsized":"2023-12-16T00:01:28.255242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.186554+0000","last_change":"2023-12-16T00:04:41.186574+0000","last_active":"2023-12-16T00:04:41.186554+0000","last_peered":"2023-12-16T00:04:41.186554+0000","last_clean":"2023-12-16T00:04:41.186554+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:04:41.186554+0000","last_undegraded":"2023-12-16T00:04:41.186554+0000","last_fullsized":"2023-12-16T00:04:41.186554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.186490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.186490+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.186490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:55.047270+0000","scrub_duration":0.00090685400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'142","reported_seq":6352,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:35.408870+0000","last_change":"2023-12-15T22:55:02.208686+0000","last_active":"2023-12-16T00:00:35.408870+0000","last_peered":"2023-12-16T00:00:35.408870+0000","last_clean":"2023-12-16T00:00:35.408870+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:00:35.408870+0000","last_undegraded":"2023-12-16T00:00:35.408870+0000","last_fullsized":"2023-12-16T00:00:35.408870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T22:54:03.162134+0000","last_clean_scrub_stamp":"2023-12-15T22:54:03.162134+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112902+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112902+0000","last_peered":"2023-12-16T00:02:08.112902+0000","last_clean":"2023-12-16T00:02:08.112902+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112902+0000","last_undegraded":"2023-12-16T00:02:08.112902+0000","last_fullsized":"2023-12-16T00:02:08.112902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'20","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.162446+0000","last_change":"2023-12-16T00:04:37.162488+0000","last_active":"2023-12-16T00:04:37.162446+0000","last_peered":"2023-12-16T00:04:37.162446+0000","last_clean":"2023-12-16T00:04:37.162446+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:04:37.162446+0000","last_undegraded":"2023-12-16T00:04:37.162446+0000","last_fullsized":"2023-12-16T00:04:37.162446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:04:37.162392+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:04:37.162392+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.162392+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:37.797563+0000","scrub_duration":0.0048793430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430319+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:55.430319+0000","last_peered":"2023-12-16T00:01:55.430319+0000","last_clean":"2023-12-16T00:01:55.430319+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:55.430319+0000","last_undegraded":"2023-12-16T00:01:55.430319+0000","last_fullsized":"2023-12-16T00:01:55.430319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:22.268148+0000","last_change":"2023-12-16T00:04:22.268168+0000","last_active":"2023-12-16T00:04:22.268148+0000","last_peered":"2023-12-16T00:04:22.268148+0000","last_clean":"2023-12-16T00:04:22.268148+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:04:22.268148+0000","last_undegraded":"2023-12-16T00:04:22.268148+0000","last_fullsized":"2023-12-16T00:04:22.268148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_clean_scrub_stamp":"2023-12-16T00:04:22.268086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:27:11.687443+0000","scrub_duration":0.00091220899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'66","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.166815+0000","last_change":"2023-12-16T00:03:47.166869+0000","last_active":"2023-12-16T00:03:47.166815+0000","last_peered":"2023-12-16T00:03:47.166815+0000","last_clean":"2023-12-16T00:03:47.166815+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:03:47.166815+0000","last_undegraded":"2023-12-16T00:03:47.166815+0000","last_fullsized":"2023-12-16T00:03:47.166815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.166746+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:27.979063+0000","scrub_duration":0.003753653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.835800+0000","last_change":"2023-12-16T00:04:11.835800+0000","last_active":"2023-12-16T00:04:11.835800+0000","last_peered":"2023-12-16T00:04:11.835800+0000","last_clean":"2023-12-16T00:04:11.835800+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:04:11.835800+0000","last_undegraded":"2023-12-16T00:04:11.835800+0000","last_fullsized":"2023-12-16T00:04:11.835800+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.835718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:30.892848+0000","scrub_duration":0.00092772700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437459+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437459+0000","last_peered":"2023-12-16T00:02:40.437459+0000","last_clean":"2023-12-16T00:02:40.437459+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437459+0000","last_undegraded":"2023-12-16T00:02:40.437459+0000","last_fullsized":"2023-12-16T00:02:40.437459+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410473+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:31.410473+0000","last_peered":"2023-12-16T00:01:31.410473+0000","last_clean":"2023-12-16T00:01:31.410473+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:31.410473+0000","last_undegraded":"2023-12-16T00:01:31.410473+0000","last_fullsized":"2023-12-16T00:01:31.410473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562947+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562947+0000","last_peered":"2023-12-16T00:02:45.562947+0000","last_clean":"2023-12-16T00:02:45.562947+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562947+0000","last_undegraded":"2023-12-16T00:02:45.562947+0000","last_fullsized":"2023-12-16T00:02:45.562947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.563416+0000","last_change":"2023-12-16T00:03:44.563437+0000","last_active":"2023-12-16T00:03:44.563416+0000","last_peered":"2023-12-16T00:03:44.563416+0000","last_clean":"2023-12-16T00:03:44.563416+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:03:44.563416+0000","last_undegraded":"2023-12-16T00:03:44.563416+0000","last_fullsized":"2023-12-16T00:03:44.563416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.563348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:00:12.730238+0000","scrub_duration":0.0015157739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.357363+0000","last_change":"2023-12-16T00:03:33.357383+0000","last_active":"2023-12-16T00:03:33.357363+0000","last_peered":"2023-12-16T00:03:33.357363+0000","last_clean":"2023-12-16T00:03:33.357363+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:03:33.357363+0000","last_undegraded":"2023-12-16T00:03:33.357363+0000","last_fullsized":"2023-12-16T00:03:33.357363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.357294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:08.995610+0000","scrub_duration":0.0012151390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418581+0000","last_change":"2023-12-15T23:08:37.341238+0000","last_active":"2023-12-16T00:01:10.418581+0000","last_peered":"2023-12-16T00:01:10.418581+0000","last_clean":"2023-12-16T00:01:10.418581+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:01:10.418581+0000","last_undegraded":"2023-12-16T00:01:10.418581+0000","last_fullsized":"2023-12-16T00:01:10.418581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'103","reported_seq":1354,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.641342+0000","last_change":"2023-12-16T00:04:25.641365+0000","last_active":"2023-12-16T00:04:25.641342+0000","last_peered":"2023-12-16T00:04:25.641342+0000","last_clean":"2023-12-16T00:04:25.641342+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:04:25.641342+0000","last_undegraded":"2023-12-16T00:04:25.641342+0000","last_fullsized":"2023-12-16T00:04:25.641342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'103","last_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_deep_scrub":"54'103","last_deep_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.641288+0000","objects_scrubbed":26,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:52.348878+0000","scrub_duration":0.012960006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6171,"num_omap_keys":23,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168065+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168065+0000","last_peered":"2023-12-16T00:02:06.168065+0000","last_clean":"2023-12-16T00:02:06.168065+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168065+0000","last_undegraded":"2023-12-16T00:02:06.168065+0000","last_fullsized":"2023-12-16T00:02:06.168065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169593+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169593+0000","last_peered":"2023-12-16T00:02:23.169593+0000","last_clean":"2023-12-16T00:02:23.169593+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169593+0000","last_undegraded":"2023-12-16T00:02:23.169593+0000","last_fullsized":"2023-12-16T00:02:23.169593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.428078+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:45.428078+0000","last_peered":"2023-12-16T00:01:45.428078+0000","last_clean":"2023-12-16T00:01:45.428078+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:45.428078+0000","last_undegraded":"2023-12-16T00:01:45.428078+0000","last_fullsized":"2023-12-16T00:01:45.428078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436856+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:02:15.436856+0000","last_peered":"2023-12-16T00:02:15.436856+0000","last_clean":"2023-12-16T00:02:15.436856+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:02:15.436856+0000","last_undegraded":"2023-12-16T00:02:15.436856+0000","last_fullsized":"2023-12-16T00:02:15.436856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.024920+0000","last_change":"2023-12-16T00:03:46.024939+0000","last_active":"2023-12-16T00:03:46.024920+0000","last_peered":"2023-12-16T00:03:46.024920+0000","last_clean":"2023-12-16T00:03:46.024920+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:03:46.024920+0000","last_undegraded":"2023-12-16T00:03:46.024920+0000","last_fullsized":"2023-12-16T00:03:46.024920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.024856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:58.107273+0000","scrub_duration":0.00094653599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418706+0000","last_change":"2023-12-15T23:08:37.341183+0000","last_active":"2023-12-16T00:01:10.418706+0000","last_peered":"2023-12-16T00:01:10.418706+0000","last_clean":"2023-12-16T00:01:10.418706+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:01:10.418706+0000","last_undegraded":"2023-12-16T00:01:10.418706+0000","last_fullsized":"2023-12-16T00:01:10.418706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'135","reported_seq":1122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:45.814898+0000","last_change":"2023-12-16T00:04:45.814929+0000","last_active":"2023-12-16T00:04:45.814898+0000","last_peered":"2023-12-16T00:04:45.814898+0000","last_clean":"2023-12-16T00:04:45.814898+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:04:45.814898+0000","last_undegraded":"2023-12-16T00:04:45.814898+0000","last_fullsized":"2023-12-16T00:04:45.814898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'135","last_scrub_stamp":"2023-12-16T00:04:45.814845+0000","last_deep_scrub":"54'135","last_deep_scrub_stamp":"2023-12-16T00:04:45.814845+0000","last_clean_scrub_stamp":"2023-12-16T00:04:45.814845+0000","objects_scrubbed":37,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:59:15.146240+0000","scrub_duration":0.016599495999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8803,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.414596+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:55.414596+0000","last_peered":"2023-12-16T00:01:55.414596+0000","last_clean":"2023-12-16T00:01:55.414596+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:55.414596+0000","last_undegraded":"2023-12-16T00:01:55.414596+0000","last_fullsized":"2023-12-16T00:01:55.414596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007813+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007813+0000","last_peered":"2023-12-16T00:01:36.007813+0000","last_clean":"2023-12-16T00:01:36.007813+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007813+0000","last_undegraded":"2023-12-16T00:01:36.007813+0000","last_fullsized":"2023-12-16T00:01:36.007813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1756,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419678+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:02:15.419678+0000","last_peered":"2023-12-16T00:02:15.419678+0000","last_clean":"2023-12-16T00:02:15.419678+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:02:15.419678+0000","last_undegraded":"2023-12-16T00:02:15.419678+0000","last_fullsized":"2023-12-16T00:02:15.419678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427580+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:01:45.427580+0000","last_peered":"2023-12-16T00:01:45.427580+0000","last_clean":"2023-12-16T00:01:45.427580+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:01:45.427580+0000","last_undegraded":"2023-12-16T00:01:45.427580+0000","last_fullsized":"2023-12-16T00:01:45.427580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.604810+0000","last_change":"2023-12-16T00:03:38.604829+0000","last_active":"2023-12-16T00:03:38.604810+0000","last_peered":"2023-12-16T00:03:38.604810+0000","last_clean":"2023-12-16T00:03:38.604810+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:03:38.604810+0000","last_undegraded":"2023-12-16T00:03:38.604810+0000","last_fullsized":"2023-12-16T00:03:38.604810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.604746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:35.411237+0000","scrub_duration":0.001128876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.165592+0000","last_change":"2023-12-16T00:04:27.165612+0000","last_active":"2023-12-16T00:04:27.165592+0000","last_peered":"2023-12-16T00:04:27.165592+0000","last_clean":"2023-12-16T00:04:27.165592+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:04:27.165592+0000","last_undegraded":"2023-12-16T00:04:27.165592+0000","last_fullsized":"2023-12-16T00:04:27.165592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.165525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:43.495488+0000","scrub_duration":0.001076278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.440779+0000","last_change":"2023-12-15T23:08:37.339753+0000","last_active":"2023-12-16T00:02:30.440779+0000","last_peered":"2023-12-16T00:02:30.440779+0000","last_clean":"2023-12-16T00:02:30.440779+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:02:30.440779+0000","last_undegraded":"2023-12-16T00:02:30.440779+0000","last_fullsized":"2023-12-16T00:02:30.440779+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385135+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385135+0000","last_peered":"2023-12-16T00:02:50.385135+0000","last_clean":"2023-12-16T00:02:50.385135+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385135+0000","last_undegraded":"2023-12-16T00:02:50.385135+0000","last_fullsized":"2023-12-16T00:02:50.385135+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088962+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088962+0000","last_peered":"2023-12-16T00:02:04.088962+0000","last_clean":"2023-12-16T00:02:04.088962+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088962+0000","last_undegraded":"2023-12-16T00:02:04.088962+0000","last_fullsized":"2023-12-16T00:02:04.088962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823346+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823346+0000","last_peered":"2023-12-16T00:01:16.823346+0000","last_clean":"2023-12-16T00:01:16.823346+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823346+0000","last_undegraded":"2023-12-16T00:01:16.823346+0000","last_fullsized":"2023-12-16T00:01:16.823346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:42.230579+0000","last_change":"2023-12-16T00:04:42.230599+0000","last_active":"2023-12-16T00:04:42.230579+0000","last_peered":"2023-12-16T00:04:42.230579+0000","last_clean":"2023-12-16T00:04:42.230579+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:04:42.230579+0000","last_undegraded":"2023-12-16T00:04:42.230579+0000","last_fullsized":"2023-12-16T00:04:42.230579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:42.230519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:42.230519+0000","last_clean_scrub_stamp":"2023-12-16T00:04:42.230519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:14:00.594229+0000","scrub_duration":0.00084420199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:40.253850+0000","last_change":"2023-12-16T00:03:40.253871+0000","last_active":"2023-12-16T00:03:40.253850+0000","last_peered":"2023-12-16T00:03:40.253850+0000","last_clean":"2023-12-16T00:03:40.253850+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:03:40.253850+0000","last_undegraded":"2023-12-16T00:03:40.253850+0000","last_fullsized":"2023-12-16T00:03:40.253850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_clean_scrub_stamp":"2023-12-16T00:03:40.253770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:14:18.023218+0000","scrub_duration":0.00092796800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.429489+0000","last_change":"2023-12-15T23:08:37.343529+0000","last_active":"2023-12-16T00:01:50.429489+0000","last_peered":"2023-12-16T00:01:50.429489+0000","last_clean":"2023-12-16T00:01:50.429489+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:01:50.429489+0000","last_undegraded":"2023-12-16T00:01:50.429489+0000","last_fullsized":"2023-12-16T00:01:50.429489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4448,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.417593+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:02:01.417593+0000","last_peered":"2023-12-16T00:02:01.417593+0000","last_clean":"2023-12-16T00:02:01.417593+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:02:01.417593+0000","last_undegraded":"2023-12-16T00:02:01.417593+0000","last_fullsized":"2023-12-16T00:02:01.417593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202192+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202192+0000","last_peered":"2023-12-16T00:02:33.202192+0000","last_clean":"2023-12-16T00:02:33.202192+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202192+0000","last_undegraded":"2023-12-16T00:02:33.202192+0000","last_fullsized":"2023-12-16T00:02:33.202192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360912+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360912+0000","last_peered":"2023-12-16T00:02:21.360912+0000","last_clean":"2023-12-16T00:02:21.360912+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360912+0000","last_undegraded":"2023-12-16T00:02:21.360912+0000","last_fullsized":"2023-12-16T00:02:21.360912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979291+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979291+0000","last_peered":"2023-12-16T00:03:26.979291+0000","last_clean":"2023-12-16T00:03:26.979291+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979291+0000","last_undegraded":"2023-12-16T00:03:26.979291+0000","last_fullsized":"2023-12-16T00:03:26.979291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.583273+0000","last_change":"2023-12-16T00:03:55.583308+0000","last_active":"2023-12-16T00:03:55.583273+0000","last_peered":"2023-12-16T00:03:55.583273+0000","last_clean":"2023-12-16T00:03:55.583273+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:03:55.583273+0000","last_undegraded":"2023-12-16T00:03:55.583273+0000","last_fullsized":"2023-12-16T00:03:55.583273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.583135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:07:10.879680+0000","scrub_duration":0.0013878409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377246+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377246+0000","last_peered":"2023-12-16T00:02:58.377246+0000","last_clean":"2023-12-16T00:02:58.377246+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377246+0000","last_undegraded":"2023-12-16T00:02:58.377246+0000","last_fullsized":"2023-12-16T00:02:58.377246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.428686+0000","last_change":"2023-12-15T23:08:37.342522+0000","last_active":"2023-12-16T00:01:50.428686+0000","last_peered":"2023-12-16T00:01:50.428686+0000","last_clean":"2023-12-16T00:01:50.428686+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:01:50.428686+0000","last_undegraded":"2023-12-16T00:01:50.428686+0000","last_fullsized":"2023-12-16T00:01:50.428686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-15T23:08:36.320509+0000","last_clean_scrub_stamp":"2023-12-15T23:08:36.320509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.405006+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.405006+0000","last_peered":"2023-12-16T00:03:09.405006+0000","last_clean":"2023-12-16T00:03:09.405006+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.405006+0000","last_undegraded":"2023-12-16T00:03:09.405006+0000","last_fullsized":"2023-12-16T00:03:09.405006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062496+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062496+0000","last_peered":"2023-12-16T00:02:03.062496+0000","last_clean":"2023-12-16T00:02:03.062496+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062496+0000","last_undegraded":"2023-12-16T00:02:03.062496+0000","last_fullsized":"2023-12-16T00:02:03.062496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273204+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273204+0000","last_peered":"2023-12-16T00:02:14.273204+0000","last_clean":"2023-12-16T00:02:14.273204+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273204+0000","last_undegraded":"2023-12-16T00:02:14.273204+0000","last_fullsized":"2023-12-16T00:02:14.273204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.096649+0000","last_change":"2023-12-16T00:03:51.096670+0000","last_active":"2023-12-16T00:03:51.096649+0000","last_peered":"2023-12-16T00:03:51.096649+0000","last_clean":"2023-12-16T00:03:51.096649+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:03:51.096649+0000","last_undegraded":"2023-12-16T00:03:51.096649+0000","last_fullsized":"2023-12-16T00:03:51.096649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.096587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:21.124789+0000","scrub_duration":0.00091092400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.602939+0000","last_change":"2023-12-16T00:03:44.602959+0000","last_active":"2023-12-16T00:03:44.602939+0000","last_peered":"2023-12-16T00:03:44.602939+0000","last_clean":"2023-12-16T00:03:44.602939+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:03:44.602939+0000","last_undegraded":"2023-12-16T00:03:44.602939+0000","last_fullsized":"2023-12-16T00:03:44.602939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.602862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:59.899408+0000","scrub_duration":0.0010205100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624544+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624544+0000","last_peered":"2023-12-16T00:02:24.624544+0000","last_clean":"2023-12-16T00:02:24.624544+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624544+0000","last_undegraded":"2023-12-16T00:02:24.624544+0000","last_fullsized":"2023-12-16T00:02:24.624544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.794703+0000","last_change":"2023-12-16T00:04:19.794736+0000","last_active":"2023-12-16T00:04:19.794703+0000","last_peered":"2023-12-16T00:04:19.794703+0000","last_clean":"2023-12-16T00:04:19.794703+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:04:19.794703+0000","last_undegraded":"2023-12-16T00:04:19.794703+0000","last_fullsized":"2023-12-16T00:04:19.794703+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.794635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:27.164354+0000","scrub_duration":0.001013683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3899,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200935+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200935+0000","last_peered":"2023-12-16T00:02:19.200935+0000","last_clean":"2023-12-16T00:02:19.200935+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200935+0000","last_undegraded":"2023-12-16T00:02:19.200935+0000","last_fullsized":"2023-12-16T00:02:19.200935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.413093+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:41.413093+0000","last_peered":"2023-12-16T00:01:41.413093+0000","last_clean":"2023-12-16T00:01:41.413093+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:41.413093+0000","last_undegraded":"2023-12-16T00:01:41.413093+0000","last_fullsized":"2023-12-16T00:01:41.413093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339052+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339052+0000","last_peered":"2023-12-16T00:02:29.339052+0000","last_clean":"2023-12-16T00:02:29.339052+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339052+0000","last_undegraded":"2023-12-16T00:02:29.339052+0000","last_fullsized":"2023-12-16T00:02:29.339052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.234989+0000","last_change":"2023-12-16T00:04:09.235010+0000","last_active":"2023-12-16T00:04:09.234989+0000","last_peered":"2023-12-16T00:04:09.234989+0000","last_clean":"2023-12-16T00:04:09.234989+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:04:09.234989+0000","last_undegraded":"2023-12-16T00:04:09.234989+0000","last_fullsized":"2023-12-16T00:04:09.234989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.234925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:37.300137+0000","scrub_duration":0.00099844600000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119127+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119127+0000","last_peered":"2023-12-16T00:02:43.119127+0000","last_clean":"2023-12-16T00:02:43.119127+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119127+0000","last_undegraded":"2023-12-16T00:02:43.119127+0000","last_fullsized":"2023-12-16T00:02:43.119127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.827287+0000","last_change":"2023-12-16T00:04:17.827287+0000","last_active":"2023-12-16T00:04:17.827287+0000","last_peered":"2023-12-16T00:04:17.827287+0000","last_clean":"2023-12-16T00:04:17.827287+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:04:17.827287+0000","last_undegraded":"2023-12-16T00:04:17.827287+0000","last_fullsized":"2023-12-16T00:04:17.827287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.827208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:45.730814+0000","scrub_duration":0.00094996999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413855+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:46.413855+0000","last_peered":"2023-12-16T00:01:46.413855+0000","last_clean":"2023-12-16T00:01:46.413855+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:46.413855+0000","last_undegraded":"2023-12-16T00:01:46.413855+0000","last_fullsized":"2023-12-16T00:01:46.413855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092070+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092070+0000","last_peered":"2023-12-16T00:02:06.092070+0000","last_clean":"2023-12-16T00:02:06.092070+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092070+0000","last_undegraded":"2023-12-16T00:02:06.092070+0000","last_fullsized":"2023-12-16T00:02:06.092070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059457+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059457+0000","last_peered":"2023-12-16T00:01:32.059457+0000","last_clean":"2023-12-16T00:01:32.059457+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059457+0000","last_undegraded":"2023-12-16T00:01:32.059457+0000","last_fullsized":"2023-12-16T00:01:32.059457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1519,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513307+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513307+0000","last_peered":"2023-12-16T00:02:15.513307+0000","last_clean":"2023-12-16T00:02:15.513307+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513307+0000","last_undegraded":"2023-12-16T00:02:15.513307+0000","last_fullsized":"2023-12-16T00:02:15.513307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418257+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:01:10.418257+0000","last_peered":"2023-12-16T00:01:10.418257+0000","last_clean":"2023-12-16T00:01:10.418257+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:01:10.418257+0000","last_undegraded":"2023-12-16T00:01:10.418257+0000","last_fullsized":"2023-12-16T00:01:10.418257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.810746+0000","last_change":"2023-12-16T00:04:41.810765+0000","last_active":"2023-12-16T00:04:41.810746+0000","last_peered":"2023-12-16T00:04:41.810746+0000","last_clean":"2023-12-16T00:04:41.810746+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:04:41.810746+0000","last_undegraded":"2023-12-16T00:04:41.810746+0000","last_fullsized":"2023-12-16T00:04:41.810746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.810681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.810681+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.810681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:27:02.365239+0000","scrub_duration":0.000874827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'9","reported_seq":820,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.799885+0000","last_change":"2023-12-16T00:03:59.799917+0000","last_active":"2023-12-16T00:03:59.799885+0000","last_peered":"2023-12-16T00:03:59.799885+0000","last_clean":"2023-12-16T00:03:59.799885+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:03:59.799885+0000","last_undegraded":"2023-12-16T00:03:59.799885+0000","last_fullsized":"2023-12-16T00:03:59.799885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.799820+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:24.148485+0000","scrub_duration":0.0029504150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:03.182767+0000","last_change":"2023-12-16T00:04:03.182767+0000","last_active":"2023-12-16T00:04:03.182767+0000","last_peered":"2023-12-16T00:04:03.182767+0000","last_clean":"2023-12-16T00:04:03.182767+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:04:03.182767+0000","last_undegraded":"2023-12-16T00:04:03.182767+0000","last_fullsized":"2023-12-16T00:04:03.182767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_clean_scrub_stamp":"2023-12-16T00:04:03.182682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:32.339951+0000","scrub_duration":0.0012782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'156","reported_seq":4072,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.660885+0000","last_change":"2023-12-16T00:04:26.660931+0000","last_active":"2023-12-16T00:04:26.660885+0000","last_peered":"2023-12-16T00:04:26.660885+0000","last_clean":"2023-12-16T00:04:26.660885+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:04:26.660885+0000","last_undegraded":"2023-12-16T00:04:26.660885+0000","last_fullsized":"2023-12-16T00:04:26.660885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'156","last_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_deep_scrub":"54'156","last_deep_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.660828+0000","objects_scrubbed":42,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:08:20.920894+0000","scrub_duration":0.020600820999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10370,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188470+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188470+0000","last_peered":"2023-12-16T00:03:12.188470+0000","last_clean":"2023-12-16T00:03:12.188470+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188470+0000","last_undegraded":"2023-12-16T00:03:12.188470+0000","last_fullsized":"2023-12-16T00:03:12.188470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246193+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246193+0000","last_peered":"2023-12-16T00:01:50.246193+0000","last_clean":"2023-12-16T00:01:50.246193+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246193+0000","last_undegraded":"2023-12-16T00:01:50.246193+0000","last_fullsized":"2023-12-16T00:01:50.246193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.930016+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.930016+0000","last_peered":"2023-12-16T00:01:26.930016+0000","last_clean":"2023-12-16T00:01:26.930016+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.930016+0000","last_undegraded":"2023-12-16T00:01:26.930016+0000","last_fullsized":"2023-12-16T00:01:26.930016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986569+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986569+0000","last_peered":"2023-12-16T00:01:56.986569+0000","last_clean":"2023-12-16T00:01:56.986569+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986569+0000","last_undegraded":"2023-12-16T00:01:56.986569+0000","last_fullsized":"2023-12-16T00:01:56.986569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'4","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.880915+0000","last_change":"2023-12-16T00:04:07.880946+0000","last_active":"2023-12-16T00:04:07.880915+0000","last_peered":"2023-12-16T00:04:07.880915+0000","last_clean":"2023-12-16T00:04:07.880915+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:04:07.880915+0000","last_undegraded":"2023-12-16T00:04:07.880915+0000","last_fullsized":"2023-12-16T00:04:07.880915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.880856+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:56.543873+0000","scrub_duration":0.003087462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:42.852312+0000","last_change":"2023-12-16T00:04:42.852332+0000","last_active":"2023-12-16T00:04:42.852312+0000","last_peered":"2023-12-16T00:04:42.852312+0000","last_clean":"2023-12-16T00:04:42.852312+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:04:42.852312+0000","last_undegraded":"2023-12-16T00:04:42.852312+0000","last_fullsized":"2023-12-16T00:04:42.852312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:42.852247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:42.852247+0000","last_clean_scrub_stamp":"2023-12-16T00:04:42.852247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:52.301374+0000","scrub_duration":0.00091768100000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.193570+0000","last_change":"2023-12-16T00:03:34.193596+0000","last_active":"2023-12-16T00:03:34.193570+0000","last_peered":"2023-12-16T00:03:34.193570+0000","last_clean":"2023-12-16T00:03:34.193570+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:03:34.193570+0000","last_undegraded":"2023-12-16T00:03:34.193570+0000","last_fullsized":"2023-12-16T00:03:34.193570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.193509+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:52.798577+0000","scrub_duration":0.0029407489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:43.190876+0000","last_change":"2023-12-16T00:04:43.190911+0000","last_active":"2023-12-16T00:04:43.190876+0000","last_peered":"2023-12-16T00:04:43.190876+0000","last_clean":"2023-12-16T00:04:43.190876+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:04:43.190876+0000","last_undegraded":"2023-12-16T00:04:43.190876+0000","last_fullsized":"2023-12-16T00:04:43.190876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:43.190803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:43.190803+0000","last_clean_scrub_stamp":"2023-12-16T00:04:43.190803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:53.054005+0000","scrub_duration":0.0014524150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3685,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689757+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689757+0000","last_peered":"2023-12-16T00:02:12.689757+0000","last_clean":"2023-12-16T00:02:12.689757+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689757+0000","last_undegraded":"2023-12-16T00:02:12.689757+0000","last_fullsized":"2023-12-16T00:02:12.689757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925869+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925869+0000","last_peered":"2023-12-16T00:01:40.925869+0000","last_clean":"2023-12-16T00:01:40.925869+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925869+0000","last_undegraded":"2023-12-16T00:01:40.925869+0000","last_fullsized":"2023-12-16T00:01:40.925869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296944+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296944+0000","last_peered":"2023-12-16T00:02:30.296944+0000","last_clean":"2023-12-16T00:02:30.296944+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296944+0000","last_undegraded":"2023-12-16T00:02:30.296944+0000","last_fullsized":"2023-12-16T00:02:30.296944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892789+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892789+0000","last_peered":"2023-12-16T00:01:49.892789+0000","last_clean":"2023-12-16T00:01:49.892789+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892789+0000","last_undegraded":"2023-12-16T00:01:49.892789+0000","last_fullsized":"2023-12-16T00:01:49.892789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":271,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038804+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038804+0000","last_peered":"2023-12-16T00:01:16.038804+0000","last_clean":"2023-12-16T00:01:16.038804+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038804+0000","last_undegraded":"2023-12-16T00:01:16.038804+0000","last_fullsized":"2023-12-16T00:01:16.038804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.637722+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:01:15.637722+0000","last_peered":"2023-12-16T00:01:15.637722+0000","last_clean":"2023-12-16T00:01:15.637722+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:01:15.637722+0000","last_undegraded":"2023-12-16T00:01:15.637722+0000","last_fullsized":"2023-12-16T00:01:15.637722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.009023+0000","last_change":"2023-12-16T00:03:47.009044+0000","last_active":"2023-12-16T00:03:47.009023+0000","last_peered":"2023-12-16T00:03:47.009023+0000","last_clean":"2023-12-16T00:03:47.009023+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:03:47.009023+0000","last_undegraded":"2023-12-16T00:03:47.009023+0000","last_fullsized":"2023-12-16T00:03:47.009023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.008959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:38:54.378679+0000","scrub_duration":0.00088682099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.212154+0000","last_change":"2023-12-16T00:03:36.212174+0000","last_active":"2023-12-16T00:03:36.212154+0000","last_peered":"2023-12-16T00:03:36.212154+0000","last_clean":"2023-12-16T00:03:36.212154+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:03:36.212154+0000","last_undegraded":"2023-12-16T00:03:36.212154+0000","last_fullsized":"2023-12-16T00:03:36.212154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.212089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:43.729491+0000","scrub_duration":0.0014192359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.681452+0000","last_change":"2023-12-16T00:04:29.681452+0000","last_active":"2023-12-16T00:04:29.681452+0000","last_peered":"2023-12-16T00:04:29.681452+0000","last_clean":"2023-12-16T00:04:29.681452+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:04:29.681452+0000","last_undegraded":"2023-12-16T00:04:29.681452+0000","last_fullsized":"2023-12-16T00:04:29.681452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.681321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:18.575890+0000","scrub_duration":0.0011304970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1323,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656814+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656814+0000","last_peered":"2023-12-16T00:02:04.656814+0000","last_clean":"2023-12-16T00:02:04.656814+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656814+0000","last_undegraded":"2023-12-16T00:02:04.656814+0000","last_fullsized":"2023-12-16T00:02:04.656814+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993680+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993680+0000","last_peered":"2023-12-16T00:01:57.993680+0000","last_clean":"2023-12-16T00:01:57.993680+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993680+0000","last_undegraded":"2023-12-16T00:01:57.993680+0000","last_fullsized":"2023-12-16T00:01:57.993680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020629+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020629+0000","last_peered":"2023-12-16T00:02:10.020629+0000","last_clean":"2023-12-16T00:02:10.020629+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020629+0000","last_undegraded":"2023-12-16T00:02:10.020629+0000","last_fullsized":"2023-12-16T00:02:10.020629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237522+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237522+0000","last_peered":"2023-12-16T00:02:34.237522+0000","last_clean":"2023-12-16T00:02:34.237522+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237522+0000","last_undegraded":"2023-12-16T00:02:34.237522+0000","last_fullsized":"2023-12-16T00:02:34.237522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":400,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418894+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:01:10.418894+0000","last_peered":"2023-12-16T00:01:10.418894+0000","last_clean":"2023-12-16T00:01:10.418894+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:01:10.418894+0000","last_undegraded":"2023-12-16T00:01:10.418894+0000","last_fullsized":"2023-12-16T00:01:10.418894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:10.252767+0000","last_change":"2023-12-16T00:04:10.252786+0000","last_active":"2023-12-16T00:04:10.252767+0000","last_peered":"2023-12-16T00:04:10.252767+0000","last_clean":"2023-12-16T00:04:10.252767+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:04:10.252767+0000","last_undegraded":"2023-12-16T00:04:10.252767+0000","last_fullsized":"2023-12-16T00:04:10.252767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_clean_scrub_stamp":"2023-12-16T00:04:10.252705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:05.754592+0000","scrub_duration":0.00085390599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.202961+0000","last_change":"2023-12-16T00:03:57.202995+0000","last_active":"2023-12-16T00:03:57.202961+0000","last_peered":"2023-12-16T00:03:57.202961+0000","last_clean":"2023-12-16T00:03:57.202961+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:03:57.202961+0000","last_undegraded":"2023-12-16T00:03:57.202961+0000","last_fullsized":"2023-12-16T00:03:57.202961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.202889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:46:43.817306+0000","scrub_duration":0.001274428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483672+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483672+0000","last_peered":"2023-12-16T00:03:15.483672+0000","last_clean":"2023-12-16T00:03:15.483672+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483672+0000","last_undegraded":"2023-12-16T00:03:15.483672+0000","last_fullsized":"2023-12-16T00:03:15.483672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425544+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425544+0000","last_peered":"2023-12-16T00:03:09.425544+0000","last_clean":"2023-12-16T00:03:09.425544+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425544+0000","last_undegraded":"2023-12-16T00:03:09.425544+0000","last_fullsized":"2023-12-16T00:03:09.425544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374435+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374435+0000","last_peered":"2023-12-16T00:03:18.374435+0000","last_clean":"2023-12-16T00:03:18.374435+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374435+0000","last_undegraded":"2023-12-16T00:03:18.374435+0000","last_fullsized":"2023-12-16T00:03:18.374435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183034+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183034+0000","last_peered":"2023-12-16T00:03:26.183034+0000","last_clean":"2023-12-16T00:03:26.183034+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183034+0000","last_undegraded":"2023-12-16T00:03:26.183034+0000","last_fullsized":"2023-12-16T00:03:26.183034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.808784+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:01:20.808784+0000","last_peered":"2023-12-16T00:01:20.808784+0000","last_clean":"2023-12-16T00:01:20.808784+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:01:20.808784+0000","last_undegraded":"2023-12-16T00:01:20.808784+0000","last_fullsized":"2023-12-16T00:01:20.808784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:14.833875+0000","last_change":"2023-12-16T00:04:14.833875+0000","last_active":"2023-12-16T00:04:14.833875+0000","last_peered":"2023-12-16T00:04:14.833875+0000","last_clean":"2023-12-16T00:04:14.833875+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:04:14.833875+0000","last_undegraded":"2023-12-16T00:04:14.833875+0000","last_fullsized":"2023-12-16T00:04:14.833875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_clean_scrub_stamp":"2023-12-16T00:04:14.833789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:40.615567+0000","scrub_duration":0.00096600899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.568117+0000","last_change":"2023-12-16T00:03:51.568117+0000","last_active":"2023-12-16T00:03:51.568117+0000","last_peered":"2023-12-16T00:03:51.568117+0000","last_clean":"2023-12-16T00:03:51.568117+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:03:51.568117+0000","last_undegraded":"2023-12-16T00:03:51.568117+0000","last_fullsized":"2023-12-16T00:03:51.568117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.568038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:22:26.529802+0000","scrub_duration":0.00091025800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605043+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605043+0000","last_peered":"2023-12-16T00:03:27.605043+0000","last_clean":"2023-12-16T00:03:27.605043+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605043+0000","last_undegraded":"2023-12-16T00:03:27.605043+0000","last_fullsized":"2023-12-16T00:03:27.605043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.247539+0000","last_change":"2023-12-16T00:04:19.247558+0000","last_active":"2023-12-16T00:04:19.247539+0000","last_peered":"2023-12-16T00:04:19.247539+0000","last_clean":"2023-12-16T00:04:19.247539+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:04:19.247539+0000","last_undegraded":"2023-12-16T00:04:19.247539+0000","last_fullsized":"2023-12-16T00:04:19.247539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.247460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:42.927615+0000","scrub_duration":0.0011105209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246579+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246579+0000","last_peered":"2023-12-16T00:03:24.246579+0000","last_clean":"2023-12-16T00:03:24.246579+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246579+0000","last_undegraded":"2023-12-16T00:03:24.246579+0000","last_fullsized":"2023-12-16T00:03:24.246579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:04.360778+0000","last_change":"2023-12-16T00:04:04.360778+0000","last_active":"2023-12-16T00:04:04.360778+0000","last_peered":"2023-12-16T00:04:04.360778+0000","last_clean":"2023-12-16T00:04:04.360778+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:04:04.360778+0000","last_undegraded":"2023-12-16T00:04:04.360778+0000","last_fullsized":"2023-12-16T00:04:04.360778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_clean_scrub_stamp":"2023-12-16T00:04:04.360695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:36:29.949685+0000","scrub_duration":0.0010605300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502708+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502708+0000","last_peered":"2023-12-16T00:02:54.502708+0000","last_clean":"2023-12-16T00:02:54.502708+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502708+0000","last_undegraded":"2023-12-16T00:02:54.502708+0000","last_fullsized":"2023-12-16T00:02:54.502708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427796+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427796+0000","last_peered":"2023-12-16T00:03:03.427796+0000","last_clean":"2023-12-16T00:03:03.427796+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427796+0000","last_undegraded":"2023-12-16T00:03:03.427796+0000","last_fullsized":"2023-12-16T00:03:03.427796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.468783+0000","last_change":"2023-12-16T00:04:05.468783+0000","last_active":"2023-12-16T00:04:05.468783+0000","last_peered":"2023-12-16T00:04:05.468783+0000","last_clean":"2023-12-16T00:04:05.468783+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:04:05.468783+0000","last_undegraded":"2023-12-16T00:04:05.468783+0000","last_fullsized":"2023-12-16T00:04:05.468783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.468702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:14.473558+0000","scrub_duration":0.00092584000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:50.574499+0000","last_change":"2023-12-16T00:03:50.574518+0000","last_active":"2023-12-16T00:03:50.574499+0000","last_peered":"2023-12-16T00:03:50.574499+0000","last_clean":"2023-12-16T00:03:50.574499+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:03:50.574499+0000","last_undegraded":"2023-12-16T00:03:50.574499+0000","last_fullsized":"2023-12-16T00:03:50.574499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_clean_scrub_stamp":"2023-12-16T00:03:50.574437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.601730+0000","scrub_duration":0.00092257299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388626+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388626+0000","last_peered":"2023-12-16T00:03:15.388626+0000","last_clean":"2023-12-16T00:03:15.388626+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388626+0000","last_undegraded":"2023-12-16T00:03:15.388626+0000","last_fullsized":"2023-12-16T00:03:15.388626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.416013+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.416013+0000","last_peered":"2023-12-16T00:03:16.416013+0000","last_clean":"2023-12-16T00:03:16.416013+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.416013+0000","last_undegraded":"2023-12-16T00:03:16.416013+0000","last_fullsized":"2023-12-16T00:03:16.416013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.232670+0000","last_change":"2023-12-16T00:03:35.232670+0000","last_active":"2023-12-16T00:03:35.232670+0000","last_peered":"2023-12-16T00:03:35.232670+0000","last_clean":"2023-12-16T00:03:35.232670+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:03:35.232670+0000","last_undegraded":"2023-12-16T00:03:35.232670+0000","last_fullsized":"2023-12-16T00:03:35.232670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.232583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:43.491905+0000","scrub_duration":0.001170903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434822+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:02:10.434822+0000","last_peered":"2023-12-16T00:02:10.434822+0000","last_clean":"2023-12-16T00:02:10.434822+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:02:10.434822+0000","last_undegraded":"2023-12-16T00:02:10.434822+0000","last_fullsized":"2023-12-16T00:02:10.434822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.161808+0000","last_change":"2023-12-16T00:03:55.161826+0000","last_active":"2023-12-16T00:03:55.161808+0000","last_peered":"2023-12-16T00:03:55.161808+0000","last_clean":"2023-12-16T00:03:55.161808+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:03:55.161808+0000","last_undegraded":"2023-12-16T00:03:55.161808+0000","last_fullsized":"2023-12-16T00:03:55.161808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.161744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:39.312326+0000","scrub_duration":0.00093413199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:36.821979+0000","last_change":"2023-12-16T00:04:36.821979+0000","last_active":"2023-12-16T00:04:36.821979+0000","last_peered":"2023-12-16T00:04:36.821979+0000","last_clean":"2023-12-16T00:04:36.821979+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:04:36.821979+0000","last_undegraded":"2023-12-16T00:04:36.821979+0000","last_fullsized":"2023-12-16T00:04:36.821979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:36.821826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:36.821826+0000","last_clean_scrub_stamp":"2023-12-16T00:04:36.821826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:37:02.410817+0000","scrub_duration":0.0012783670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.421815+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:02:25.421815+0000","last_peered":"2023-12-16T00:02:25.421815+0000","last_clean":"2023-12-16T00:02:25.421815+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:02:25.421815+0000","last_undegraded":"2023-12-16T00:02:25.421815+0000","last_fullsized":"2023-12-16T00:02:25.421815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.224907+0000","last_change":"2023-12-16T00:04:17.224937+0000","last_active":"2023-12-16T00:04:17.224907+0000","last_peered":"2023-12-16T00:04:17.224907+0000","last_clean":"2023-12-16T00:04:17.224907+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:04:17.224907+0000","last_undegraded":"2023-12-16T00:04:17.224907+0000","last_fullsized":"2023-12-16T00:04:17.224907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.224839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:26.673965+0000","scrub_duration":0.001284019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433538+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:02:10.433538+0000","last_peered":"2023-12-16T00:02:10.433538+0000","last_clean":"2023-12-16T00:02:10.433538+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:02:10.433538+0000","last_undegraded":"2023-12-16T00:02:10.433538+0000","last_fullsized":"2023-12-16T00:02:10.433538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.537629+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:50.537629+0000","last_peered":"2023-12-16T00:02:50.537629+0000","last_clean":"2023-12-16T00:02:50.537629+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:50.537629+0000","last_undegraded":"2023-12-16T00:02:50.537629+0000","last_fullsized":"2023-12-16T00:02:50.537629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:38.828084+0000","last_change":"2023-12-16T00:04:38.828104+0000","last_active":"2023-12-16T00:04:38.828084+0000","last_peered":"2023-12-16T00:04:38.828084+0000","last_clean":"2023-12-16T00:04:38.828084+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:04:38.828084+0000","last_undegraded":"2023-12-16T00:04:38.828084+0000","last_fullsized":"2023-12-16T00:04:38.828084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:38.828010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:38.828010+0000","last_clean_scrub_stamp":"2023-12-16T00:04:38.828010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:43:52.053618+0000","scrub_duration":0.00088924399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":248,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418214+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:02:10.418214+0000","last_peered":"2023-12-16T00:02:10.418214+0000","last_clean":"2023-12-16T00:02:10.418214+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:02:10.418214+0000","last_undegraded":"2023-12-16T00:02:10.418214+0000","last_fullsized":"2023-12-16T00:02:10.418214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.297264+0000","last_change":"2023-12-16T00:03:49.297285+0000","last_active":"2023-12-16T00:03:49.297264+0000","last_peered":"2023-12-16T00:03:49.297264+0000","last_clean":"2023-12-16T00:03:49.297264+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:03:49.297264+0000","last_undegraded":"2023-12-16T00:03:49.297264+0000","last_fullsized":"2023-12-16T00:03:49.297264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.297202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:12.808001+0000","scrub_duration":0.001104505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.198460+0000","last_change":"2023-12-16T00:04:24.198479+0000","last_active":"2023-12-16T00:04:24.198460+0000","last_peered":"2023-12-16T00:04:24.198460+0000","last_clean":"2023-12-16T00:04:24.198460+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:04:24.198460+0000","last_undegraded":"2023-12-16T00:04:24.198460+0000","last_fullsized":"2023-12-16T00:04:24.198460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.198382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:58:53.529777+0000","scrub_duration":0.001608139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:42.770790+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:00:42.770790+0000","last_peered":"2023-12-16T00:00:42.770790+0000","last_clean":"2023-12-16T00:00:42.770790+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:00:42.770790+0000","last_undegraded":"2023-12-16T00:00:42.770790+0000","last_fullsized":"2023-12-16T00:00:42.770790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469761+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469761+0000","last_peered":"2023-12-16T00:03:07.469761+0000","last_clean":"2023-12-16T00:03:07.469761+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469761+0000","last_undegraded":"2023-12-16T00:03:07.469761+0000","last_fullsized":"2023-12-16T00:03:07.469761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.227644+0000","last_change":"2023-12-16T00:04:41.227681+0000","last_active":"2023-12-16T00:04:41.227644+0000","last_peered":"2023-12-16T00:04:41.227644+0000","last_clean":"2023-12-16T00:04:41.227644+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:04:41.227644+0000","last_undegraded":"2023-12-16T00:04:41.227644+0000","last_fullsized":"2023-12-16T00:04:41.227644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.227575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.227575+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.227575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:32.450823+0000","scrub_duration":0.00093770699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:52.828251+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:00:52.828251+0000","last_peered":"2023-12-16T00:00:52.828251+0000","last_clean":"2023-12-16T00:00:52.828251+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:00:52.828251+0000","last_undegraded":"2023-12-16T00:00:52.828251+0000","last_fullsized":"2023-12-16T00:00:52.828251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.880758+0000","last_change":"2023-12-16T00:03:34.880778+0000","last_active":"2023-12-16T00:03:34.880758+0000","last_peered":"2023-12-16T00:03:34.880758+0000","last_clean":"2023-12-16T00:03:34.880758+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:03:34.880758+0000","last_undegraded":"2023-12-16T00:03:34.880758+0000","last_fullsized":"2023-12-16T00:03:34.880758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.880692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:10.519008+0000","scrub_duration":0.00091466200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431217+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431217+0000","last_peered":"2023-12-16T00:03:20.431217+0000","last_clean":"2023-12-16T00:03:20.431217+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431217+0000","last_undegraded":"2023-12-16T00:03:20.431217+0000","last_fullsized":"2023-12-16T00:03:20.431217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":230,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:54.625081+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:01:54.625081+0000","last_peered":"2023-12-16T00:01:54.625081+0000","last_clean":"2023-12-16T00:01:54.625081+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:01:54.625081+0000","last_undegraded":"2023-12-16T00:01:54.625081+0000","last_fullsized":"2023-12-16T00:01:54.625081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.559821+0000","last_change":"2023-12-16T00:03:46.559841+0000","last_active":"2023-12-16T00:03:46.559821+0000","last_peered":"2023-12-16T00:03:46.559821+0000","last_clean":"2023-12-16T00:03:46.559821+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:03:46.559821+0000","last_undegraded":"2023-12-16T00:03:46.559821+0000","last_fullsized":"2023-12-16T00:03:46.559821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.559754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:04.114550+0000","scrub_duration":0.0010144640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.276273+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:01:02.276273+0000","last_peered":"2023-12-16T00:01:02.276273+0000","last_clean":"2023-12-16T00:01:02.276273+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:01:02.276273+0000","last_undegraded":"2023-12-16T00:01:02.276273+0000","last_fullsized":"2023-12-16T00:01:02.276273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328126+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328126+0000","last_peered":"2023-12-16T00:03:29.328126+0000","last_clean":"2023-12-16T00:03:29.328126+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328126+0000","last_undegraded":"2023-12-16T00:03:29.328126+0000","last_fullsized":"2023-12-16T00:03:29.328126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.842572+0000","last_change":"2023-12-16T00:04:13.842594+0000","last_active":"2023-12-16T00:04:13.842572+0000","last_peered":"2023-12-16T00:04:13.842572+0000","last_clean":"2023-12-16T00:04:13.842572+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:04:13.842572+0000","last_undegraded":"2023-12-16T00:04:13.842572+0000","last_fullsized":"2023-12-16T00:04:13.842572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.842508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:21.212228+0000","scrub_duration":0.000924185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.194894+0000","last_change":"2023-12-16T00:04:13.194913+0000","last_active":"2023-12-16T00:04:13.194894+0000","last_peered":"2023-12-16T00:04:13.194894+0000","last_clean":"2023-12-16T00:04:13.194894+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:04:13.194894+0000","last_undegraded":"2023-12-16T00:04:13.194894+0000","last_fullsized":"2023-12-16T00:04:13.194894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.194829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:13.517879+0000","scrub_duration":0.001183609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.075972+0000","last_change":"2023-12-16T00:03:49.075991+0000","last_active":"2023-12-16T00:03:49.075972+0000","last_peered":"2023-12-16T00:03:49.075972+0000","last_clean":"2023-12-16T00:03:49.075972+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:03:49.075972+0000","last_undegraded":"2023-12-16T00:03:49.075972+0000","last_fullsized":"2023-12-16T00:03:49.075972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.075896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:14.857673+0000","scrub_duration":0.0010048839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.645329+0000","last_change":"2023-12-16T00:04:20.645349+0000","last_active":"2023-12-16T00:04:20.645329+0000","last_peered":"2023-12-16T00:04:20.645329+0000","last_clean":"2023-12-16T00:04:20.645329+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:04:20.645329+0000","last_undegraded":"2023-12-16T00:04:20.645329+0000","last_fullsized":"2023-12-16T00:04:20.645329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.645263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:39.702393+0000","scrub_duration":0.0012813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:43.832231+0000","last_change":"2023-12-16T00:04:43.832250+0000","last_active":"2023-12-16T00:04:43.832231+0000","last_peered":"2023-12-16T00:04:43.832231+0000","last_clean":"2023-12-16T00:04:43.832231+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:04:43.832231+0000","last_undegraded":"2023-12-16T00:04:43.832231+0000","last_fullsized":"2023-12-16T00:04:43.832231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:43.832168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:43.832168+0000","last_clean_scrub_stamp":"2023-12-16T00:04:43.832168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:35:54.258281+0000","scrub_duration":0.001279131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":295564,"num_omap_keys":1126,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4603,"ondisk_log_size":4603,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2383,"ondisk_log_size":2383,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":904,"ondisk_log_size":904,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608430,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.40899999999999997,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.63400000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34899999999999998},"max":{"1min":0.61899999999999999,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.626}]},{"osd":2,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":0.71399999999999997,"15min":1.004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.626,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.56000000000000005,"15min":1.044},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.376,"15min":0.373},"min":{"1min":0.28799999999999998,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.504,"5min":0.57899999999999996,"15min":1.149},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.63},"last":0.42499999999999999}]}]},{"osd":5,"up_from":11,"seq":47244641132,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":54856,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802744,"statfs":{"total":107374182400,"available":107318009856,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.64500000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.48699999999999999}]},{"osd":1,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.747},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.64400000000000002,"5min":0.69699999999999995,"15min":0.879},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.623,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.754},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26300000000000001},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":0.40400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.92500000000000004},"last":0.28599999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641134,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67900000000000005,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.38300000000000001,"15min":0.311},"max":{"1min":0.67400000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.29599999999999999},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.68300000000000005,"5min":1.25,"15min":1.25},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:03:58 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.24199999999999999},"max":{"1min":0.628,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.30399999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.50600000000000001}]}]},{"osd":2,"up_from":11,"seq":47244641131,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.309,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":1.0169999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50800000000000001,"5min":0.55400000000000005,"15min":0.87},"last":0.31}]},{"osd":1,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.88900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.35699999999999998},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.44500000000000001,"5min":0.51800000000000002,"15min":1.2769999999999999},"last":0.372}]},{"osd":3,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.2450000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.97999999999999998},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":1.2190000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.169},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.4670000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.91000000000000003},"last":0.70699999999999996}]}]},{"osd":1,"up_from":11,"seq":47244641132,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55452,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802148,"statfs":{"total":107374182400,"available":107317399552,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.315},"min":{"1min":0.23400000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.43099999999999999,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.45500000000000002,"5min":0.47699999999999998,"15min":0.80100000000000005},"last":0.37}]},{"osd":2,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41099999999999998,"5min":0.495,"15min":0.52200000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.28999999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.497,"5min":0.504,"15min":0.504},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.69399999999999995,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.72799999999999998},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.41599999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.81100000000000005,"15min":0.878},"last":0.621}]},{"osd":5,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72599999999999998,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.57299999999999995}]}]},{"osd":0,"up_from":11,"seq":47244641132,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.318,"15min":0.317},"min":{"1min":0.22800000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.51200000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.218},"max":{"1min":0.45300000000000001,"5min":0.51400000000000001,"15min":0.59199999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.29499999999999998,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.45400000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48299999999999998,"5min":0.503,"15min":0.52700000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.45100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.73099999999999998,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.41899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.83599999999999997},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.436,"5min":0.376,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.72899999999999998,"15min":0.78300000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.875},"last":0.57599999999999996}]},{"osd":5,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.80200000000000005},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:04:54.338 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.339 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.339 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.340 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.341 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.341 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2023-12-15T22:54:03.162134+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=22, tm_min=54, tm_sec=3, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.342 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.342 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.342 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.343 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.343 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2023-12-15T23:08:36.320509+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=15, tm_hour=23, tm_min=8, tm_sec=36, tm_wday=4, tm_yday=349, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=0, tm_min=0, tm_sec=24, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T00:04:54.345 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T00:05:14.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2023-12-16T00:05:14.705 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-16T00:05:14.734 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-12-16T00:05:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":2243,"stamp":"2023-12-16T00:05:14.313586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":807755,"num_objects":2522,"num_object_clones":0,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2522,"num_whiteouts":0,"num_read":203733,"num_read_kb":200136,"num_write":41335,"num_write_kb":12321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":362,"num_keys_recovered":4,"num_objects_omap":1259,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988030,"num_omap_keys":4251,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36821,"ondisk_log_size":36821,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":316248,"kb_used_data":9832,"kb_used_omap":9,"kb_used_meta":306358,"kb_avail":628829352,"statfs":{"total":644245094400,"available":643921256448,"internally_reserved":0,"allocated":10067968,"data_stored":3727722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":313711265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006136"},"pg_stats":[{"pgid":"9.35","version":"54'15","reported_seq":106,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:07.859923+0000","last_change":"2023-12-16T00:01:07.859923+0000","last_active":"2023-12-16T00:01:07.859923+0000","last_peered":"2023-12-16T00:01:07.859923+0000","last_clean":"2023-12-16T00:01:07.859923+0000","last_became_active":"2023-12-15T22:53:26.162697+0000","last_became_peered":"2023-12-15T22:53:26.162697+0000","last_unstale":"2023-12-16T00:01:07.859923+0000","last_undegraded":"2023-12-16T00:01:07.859923+0000","last_fullsized":"2023-12-16T00:01:07.859923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:07.859752+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.859752+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:00:56.675374+0000","scrub_duration":0.0030391089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":48,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.358393+0000","last_change":"2023-12-16T00:03:26.358393+0000","last_active":"2023-12-16T00:03:26.358393+0000","last_peered":"2023-12-16T00:03:26.358393+0000","last_clean":"2023-12-16T00:03:26.358393+0000","last_became_active":"2023-12-15T22:52:53.172352+0000","last_became_peered":"2023-12-15T22:52:53.172352+0000","last_unstale":"2023-12-16T00:03:26.358393+0000","last_undegraded":"2023-12-16T00:03:26.358393+0000","last_fullsized":"2023-12-16T00:03:26.358393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.358307+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.358307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:59:20.461619+0000","scrub_duration":0.001141205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.880866+0000","last_change":"2023-12-16T00:03:59.880889+0000","last_active":"2023-12-16T00:03:59.880866+0000","last_peered":"2023-12-16T00:03:59.880866+0000","last_clean":"2023-12-16T00:03:59.880866+0000","last_became_active":"2023-12-15T22:52:55.188523+0000","last_became_peered":"2023-12-15T22:52:55.188523+0000","last_unstale":"2023-12-16T00:03:59.880866+0000","last_undegraded":"2023-12-16T00:03:59.880866+0000","last_fullsized":"2023-12-16T00:03:59.880866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.880808+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.880808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:54.155437+0000","scrub_duration":0.00089921599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"54'8","reported_seq":120,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417308+0000","last_change":"2023-12-16T00:00:49.807951+0000","last_active":"2023-12-16T00:01:05.417308+0000","last_peered":"2023-12-16T00:01:05.417308+0000","last_clean":"2023-12-16T00:01:05.417308+0000","last_became_active":"2023-12-15T22:53:26.165154+0000","last_became_peered":"2023-12-15T22:53:26.165154+0000","last_unstale":"2023-12-16T00:01:05.417308+0000","last_undegraded":"2023-12-16T00:01:05.417308+0000","last_fullsized":"2023-12-16T00:01:05.417308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:49.807850+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.807850+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:54.184993+0000","scrub_duration":0.003954178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.541603+0000","last_change":"2023-12-16T00:04:07.541622+0000","last_active":"2023-12-16T00:04:07.541603+0000","last_peered":"2023-12-16T00:04:07.541603+0000","last_clean":"2023-12-16T00:04:07.541603+0000","last_became_active":"2023-12-15T22:52:53.169454+0000","last_became_peered":"2023-12-15T22:52:53.169454+0000","last_unstale":"2023-12-16T00:04:07.541603+0000","last_undegraded":"2023-12-16T00:04:07.541603+0000","last_fullsized":"2023-12-16T00:04:07.541603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:07.541533+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.541533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:44.090049+0000","scrub_duration":0.0010501169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.397436+0000","last_change":"2023-12-16T00:03:21.397456+0000","last_active":"2023-12-16T00:03:21.397436+0000","last_peered":"2023-12-16T00:03:21.397436+0000","last_clean":"2023-12-16T00:03:21.397436+0000","last_became_active":"2023-12-15T22:52:55.185292+0000","last_became_peered":"2023-12-15T22:52:55.185292+0000","last_unstale":"2023-12-16T00:03:21.397436+0000","last_undegraded":"2023-12-16T00:03:21.397436+0000","last_fullsized":"2023-12-16T00:03:21.397436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.397367+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.397367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:57.945883+0000","scrub_duration":0.00094495699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"54'37","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408466+0000","last_change":"2023-12-16T00:01:15.778718+0000","last_active":"2023-12-16T00:01:21.408466+0000","last_peered":"2023-12-16T00:01:21.408466+0000","last_clean":"2023-12-16T00:01:21.408466+0000","last_became_active":"2023-12-15T22:53:26.158281+0000","last_became_peered":"2023-12-15T22:53:26.158281+0000","last_unstale":"2023-12-16T00:01:21.408466+0000","last_undegraded":"2023-12-16T00:01:21.408466+0000","last_fullsized":"2023-12-16T00:01:21.408466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'37","last_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_deep_scrub":"54'37","last_deep_scrub_stamp":"2023-12-16T00:01:15.778593+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.778593+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:22.036306+0000","scrub_duration":0.0091291140000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":311,"num_read_kb":281,"num_write":166,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.563813+0000","last_change":"2023-12-16T00:03:53.563813+0000","last_active":"2023-12-16T00:03:53.563813+0000","last_peered":"2023-12-16T00:03:53.563813+0000","last_clean":"2023-12-16T00:03:53.563813+0000","last_became_active":"2023-12-15T22:53:01.291004+0000","last_became_peered":"2023-12-15T22:53:01.291004+0000","last_unstale":"2023-12-16T00:03:53.563813+0000","last_undegraded":"2023-12-16T00:03:53.563813+0000","last_fullsized":"2023-12-16T00:03:53.563813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.563736+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.563736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:33.029870+0000","scrub_duration":0.00070934700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.481070+0000","last_change":"2023-12-16T00:03:01.481090+0000","last_active":"2023-12-16T00:03:01.481070+0000","last_peered":"2023-12-16T00:03:01.481070+0000","last_clean":"2023-12-16T00:03:01.481070+0000","last_became_active":"2023-12-15T22:52:55.187894+0000","last_became_peered":"2023-12-15T22:52:55.187894+0000","last_unstale":"2023-12-16T00:03:01.481070+0000","last_undegraded":"2023-12-16T00:03:01.481070+0000","last_fullsized":"2023-12-16T00:03:01.481070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.480995+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.480995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:20.671101+0000","scrub_duration":0.0013019430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"54'14","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.635716+0000","last_change":"2023-12-16T00:00:26.953922+0000","last_active":"2023-12-16T00:01:05.635716+0000","last_peered":"2023-12-16T00:01:05.635716+0000","last_clean":"2023-12-16T00:01:05.635716+0000","last_became_active":"2023-12-15T22:53:26.155643+0000","last_became_peered":"2023-12-15T22:53:26.155643+0000","last_unstale":"2023-12-16T00:01:05.635716+0000","last_undegraded":"2023-12-16T00:01:05.635716+0000","last_fullsized":"2023-12-16T00:01:05.635716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:26.953820+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.953820+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:26.214940+0000","scrub_duration":0.0052551539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":181,"num_write":73,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:01.884628+0000","last_change":"2023-12-16T00:04:01.884628+0000","last_active":"2023-12-16T00:04:01.884628+0000","last_peered":"2023-12-16T00:04:01.884628+0000","last_clean":"2023-12-16T00:04:01.884628+0000","last_became_active":"2023-12-15T22:52:53.173912+0000","last_became_peered":"2023-12-15T22:52:53.173912+0000","last_unstale":"2023-12-16T00:04:01.884628+0000","last_undegraded":"2023-12-16T00:04:01.884628+0000","last_fullsized":"2023-12-16T00:04:01.884628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:01.884510+0000","last_clean_scrub_stamp":"2023-12-16T00:04:01.884510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:50.547528+0000","scrub_duration":0.00152728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.245549+0000","last_change":"2023-12-16T00:03:58.245569+0000","last_active":"2023-12-16T00:03:58.245549+0000","last_peered":"2023-12-16T00:03:58.245549+0000","last_clean":"2023-12-16T00:03:58.245549+0000","last_became_active":"2023-12-15T22:52:55.194680+0000","last_became_peered":"2023-12-15T22:52:55.194680+0000","last_unstale":"2023-12-16T00:03:58.245549+0000","last_undegraded":"2023-12-16T00:03:58.245549+0000","last_fullsized":"2023-12-16T00:03:58.245549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.245495+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.245495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:53:53.747382+0000","scrub_duration":0.00088301999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"54'4","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.829526+0000","last_change":"2023-12-16T00:01:17.829526+0000","last_active":"2023-12-16T00:01:17.829526+0000","last_peered":"2023-12-16T00:01:17.829526+0000","last_clean":"2023-12-16T00:01:17.829526+0000","last_became_active":"2023-12-15T22:53:26.161189+0000","last_became_peered":"2023-12-15T22:53:26.161189+0000","last_unstale":"2023-12-16T00:01:17.829526+0000","last_undegraded":"2023-12-16T00:01:17.829526+0000","last_fullsized":"2023-12-16T00:01:17.829526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:01:17.829440+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.829440+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:47.148210+0000","scrub_duration":0.003297342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.295639+0000","last_change":"2023-12-16T00:03:51.295660+0000","last_active":"2023-12-16T00:03:51.295639+0000","last_peered":"2023-12-16T00:03:51.295639+0000","last_clean":"2023-12-16T00:03:51.295639+0000","last_became_active":"2023-12-15T22:52:53.171768+0000","last_became_peered":"2023-12-15T22:52:53.171768+0000","last_unstale":"2023-12-16T00:03:51.295639+0000","last_undegraded":"2023-12-16T00:03:51.295639+0000","last_fullsized":"2023-12-16T00:03:51.295639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.295576+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.295576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:17.077353+0000","scrub_duration":0.0012592949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.850226+0000","last_change":"2023-12-16T00:04:11.850226+0000","last_active":"2023-12-16T00:04:11.850226+0000","last_peered":"2023-12-16T00:04:11.850226+0000","last_clean":"2023-12-16T00:04:11.850226+0000","last_became_active":"2023-12-15T22:52:55.186739+0000","last_became_peered":"2023-12-15T22:52:55.186739+0000","last_unstale":"2023-12-16T00:04:11.850226+0000","last_undegraded":"2023-12-16T00:04:11.850226+0000","last_fullsized":"2023-12-16T00:04:11.850226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.850125+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.850125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:35.360924+0000","scrub_duration":0.0015218740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"54'9","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.416444+0000","last_change":"2023-12-16T00:00:31.205183+0000","last_active":"2023-12-16T00:01:05.416444+0000","last_peered":"2023-12-16T00:01:05.416444+0000","last_clean":"2023-12-16T00:01:05.416444+0000","last_became_active":"2023-12-15T22:53:26.162017+0000","last_became_peered":"2023-12-15T22:53:26.162017+0000","last_unstale":"2023-12-16T00:01:05.416444+0000","last_undegraded":"2023-12-16T00:01:05.416444+0000","last_fullsized":"2023-12-16T00:01:05.416444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:00:31.205072+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.205072+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:41.960302+0000","scrub_duration":0.0044274259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":37,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:40.856504+0000","last_change":"2023-12-16T00:04:40.856541+0000","last_active":"2023-12-16T00:04:40.856504+0000","last_peered":"2023-12-16T00:04:40.856504+0000","last_clean":"2023-12-16T00:04:40.856504+0000","last_became_active":"2023-12-15T22:52:53.170772+0000","last_became_peered":"2023-12-15T22:52:53.170772+0000","last_unstale":"2023-12-16T00:04:40.856504+0000","last_undegraded":"2023-12-16T00:04:40.856504+0000","last_fullsized":"2023-12-16T00:04:40.856504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:40.856434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:40.856434+0000","last_clean_scrub_stamp":"2023-12-16T00:04:40.856434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:02:37.645530+0000","scrub_duration":0.0011732960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.477835+0000","last_change":"2023-12-16T00:03:06.477835+0000","last_active":"2023-12-16T00:03:06.477835+0000","last_peered":"2023-12-16T00:03:06.477835+0000","last_clean":"2023-12-16T00:03:06.477835+0000","last_became_active":"2023-12-15T22:52:55.187438+0000","last_became_peered":"2023-12-15T22:52:55.187438+0000","last_unstale":"2023-12-16T00:03:06.477835+0000","last_undegraded":"2023-12-16T00:03:06.477835+0000","last_fullsized":"2023-12-16T00:03:06.477835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.477761+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.477761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:43.482691+0000","scrub_duration":0.0010175080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"54'16","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417319+0000","last_change":"2023-12-16T00:00:49.916346+0000","last_active":"2023-12-16T00:01:05.417319+0000","last_peered":"2023-12-16T00:01:05.417319+0000","last_clean":"2023-12-16T00:01:05.417319+0000","last_became_active":"2023-12-15T22:53:26.156494+0000","last_became_peered":"2023-12-15T22:53:26.156494+0000","last_unstale":"2023-12-16T00:01:05.417319+0000","last_undegraded":"2023-12-16T00:01:05.417319+0000","last_fullsized":"2023-12-16T00:01:05.417319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:00:49.916227+0000","last_clean_scrub_stamp":"2023-12-16T00:00:49.916227+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:51.616715+0000","scrub_duration":0.0054728069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":82,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.116114+0000","last_change":"2023-12-16T00:04:37.116146+0000","last_active":"2023-12-16T00:04:37.116114+0000","last_peered":"2023-12-16T00:04:37.116114+0000","last_clean":"2023-12-16T00:04:37.116114+0000","last_became_active":"2023-12-15T22:52:53.170042+0000","last_became_peered":"2023-12-15T22:52:53.170042+0000","last_unstale":"2023-12-16T00:04:37.116114+0000","last_undegraded":"2023-12-16T00:04:37.116114+0000","last_fullsized":"2023-12-16T00:04:37.116114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.116042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.116042+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.116042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:32.623138+0000","scrub_duration":0.001289423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.779040+0000","last_change":"2023-12-16T00:04:21.779060+0000","last_active":"2023-12-16T00:04:21.779040+0000","last_peered":"2023-12-16T00:04:21.779040+0000","last_clean":"2023-12-16T00:04:21.779040+0000","last_became_active":"2023-12-15T22:53:01.294263+0000","last_became_peered":"2023-12-15T22:53:01.294263+0000","last_unstale":"2023-12-16T00:04:21.779040+0000","last_undegraded":"2023-12-16T00:04:21.779040+0000","last_fullsized":"2023-12-16T00:04:21.779040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.778969+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.778969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:05.929551+0000","scrub_duration":0.001213221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"54'12","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:21.408096+0000","last_change":"2023-12-16T00:01:07.749707+0000","last_active":"2023-12-16T00:01:21.408096+0000","last_peered":"2023-12-16T00:01:21.408096+0000","last_clean":"2023-12-16T00:01:21.408096+0000","last_became_active":"2023-12-15T22:53:26.160207+0000","last_became_peered":"2023-12-15T22:53:26.160207+0000","last_unstale":"2023-12-16T00:01:21.408096+0000","last_undegraded":"2023-12-16T00:01:21.408096+0000","last_fullsized":"2023-12-16T00:01:21.408096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:07.749597+0000","last_clean_scrub_stamp":"2023-12-16T00:01:07.749597+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:10.354848+0000","scrub_duration":0.0050197150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":198,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:45.193861+0000","last_change":"2023-12-16T00:03:45.193882+0000","last_active":"2023-12-16T00:03:45.193861+0000","last_peered":"2023-12-16T00:03:45.193861+0000","last_clean":"2023-12-16T00:03:45.193861+0000","last_became_active":"2023-12-15T22:52:53.175202+0000","last_became_peered":"2023-12-15T22:52:53.175202+0000","last_unstale":"2023-12-16T00:03:45.193861+0000","last_undegraded":"2023-12-16T00:03:45.193861+0000","last_fullsized":"2023-12-16T00:03:45.193861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:45.193798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:45.193798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:27.535599+0000","scrub_duration":0.0012721620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.629295+0000","last_change":"2023-12-16T00:02:46.629295+0000","last_active":"2023-12-16T00:02:46.629295+0000","last_peered":"2023-12-16T00:02:46.629295+0000","last_clean":"2023-12-16T00:02:46.629295+0000","last_became_active":"2023-12-15T22:52:55.190200+0000","last_became_peered":"2023-12-15T22:52:55.190200+0000","last_unstale":"2023-12-16T00:02:46.629295+0000","last_undegraded":"2023-12-16T00:02:46.629295+0000","last_fullsized":"2023-12-16T00:02:46.629295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:46.629211+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.629211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:35.239310+0000","scrub_duration":0.00086101099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"54'15","reported_seq":152,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434834+0000","last_change":"2023-12-16T00:00:37.712208+0000","last_active":"2023-12-16T00:02:10.434834+0000","last_peered":"2023-12-16T00:02:10.434834+0000","last_clean":"2023-12-16T00:02:10.434834+0000","last_became_active":"2023-12-15T22:53:26.163640+0000","last_became_peered":"2023-12-15T22:53:26.163640+0000","last_unstale":"2023-12-16T00:02:10.434834+0000","last_undegraded":"2023-12-16T00:02:10.434834+0000","last_fullsized":"2023-12-16T00:02:10.434834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:00:37.712066+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.712066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:02.971908+0000","scrub_duration":0.0044125700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":161,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.423139+0000","last_change":"2023-12-16T00:02:59.423159+0000","last_active":"2023-12-16T00:02:59.423139+0000","last_peered":"2023-12-16T00:02:59.423139+0000","last_clean":"2023-12-16T00:02:59.423139+0000","last_became_active":"2023-12-15T22:52:55.187297+0000","last_became_peered":"2023-12-15T22:52:55.187297+0000","last_unstale":"2023-12-16T00:02:59.423139+0000","last_undegraded":"2023-12-16T00:02:59.423139+0000","last_fullsized":"2023-12-16T00:02:59.423139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:59.423077+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.423077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:56:07.375911+0000","scrub_duration":0.001330555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.376992+0000","last_change":"2023-12-16T00:03:10.376992+0000","last_active":"2023-12-16T00:03:10.376992+0000","last_peered":"2023-12-16T00:03:10.376992+0000","last_clean":"2023-12-16T00:03:10.376992+0000","last_became_active":"2023-12-15T22:53:01.297194+0000","last_became_peered":"2023-12-15T22:53:01.297194+0000","last_unstale":"2023-12-16T00:03:10.376992+0000","last_undegraded":"2023-12-16T00:03:10.376992+0000","last_fullsized":"2023-12-16T00:03:10.376992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.376866+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.376866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:19.355936+0000","scrub_duration":0.001167387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"54'18","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.426875+0000","last_change":"2023-12-16T00:00:29.129532+0000","last_active":"2023-12-16T00:01:40.426875+0000","last_peered":"2023-12-16T00:01:40.426875+0000","last_clean":"2023-12-16T00:01:40.426875+0000","last_became_active":"2023-12-15T22:53:26.160764+0000","last_became_peered":"2023-12-15T22:53:26.160764+0000","last_unstale":"2023-12-16T00:01:40.426875+0000","last_undegraded":"2023-12-16T00:01:40.426875+0000","last_fullsized":"2023-12-16T00:01:40.426875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:00:29.129398+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.129398+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:21.847343+0000","scrub_duration":0.011367092000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":361,"num_read_kb":362,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.099235+0000","last_change":"2023-12-16T00:03:44.099255+0000","last_active":"2023-12-16T00:03:44.099235+0000","last_peered":"2023-12-16T00:03:44.099235+0000","last_clean":"2023-12-16T00:03:44.099235+0000","last_became_active":"2023-12-15T22:52:55.189659+0000","last_became_peered":"2023-12-15T22:52:55.189659+0000","last_unstale":"2023-12-16T00:03:44.099235+0000","last_undegraded":"2023-12-16T00:03:44.099235+0000","last_fullsized":"2023-12-16T00:03:44.099235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.099172+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.099172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:07.211984+0000","scrub_duration":0.0012518329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.394519+0000","last_change":"2023-12-16T00:03:14.394536+0000","last_active":"2023-12-16T00:03:14.394519+0000","last_peered":"2023-12-16T00:03:14.394519+0000","last_clean":"2023-12-16T00:03:14.394519+0000","last_became_active":"2023-12-15T22:52:53.175424+0000","last_became_peered":"2023-12-15T22:52:53.175424+0000","last_unstale":"2023-12-16T00:03:14.394519+0000","last_undegraded":"2023-12-16T00:03:14.394519+0000","last_fullsized":"2023-12-16T00:03:14.394519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:14.394464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.394464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:29.691009+0000","scrub_duration":0.00088744200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"54'36","reported_seq":201,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418586+0000","last_change":"2023-12-16T00:01:04.887190+0000","last_active":"2023-12-16T00:02:10.418586+0000","last_peered":"2023-12-16T00:02:10.418586+0000","last_clean":"2023-12-16T00:02:10.418586+0000","last_became_active":"2023-12-15T22:53:26.162273+0000","last_became_peered":"2023-12-15T22:53:26.162273+0000","last_unstale":"2023-12-16T00:02:10.418586+0000","last_undegraded":"2023-12-16T00:02:10.418586+0000","last_fullsized":"2023-12-16T00:02:10.418586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'36","last_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_deep_scrub":"54'36","last_deep_scrub_stamp":"2023-12-16T00:01:04.887091+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.887091+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.220584+0000","scrub_duration":0.0058954280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":259,"num_read_kb":249,"num_write":195,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.876980+0000","last_change":"2023-12-16T00:04:05.877000+0000","last_active":"2023-12-16T00:04:05.876980+0000","last_peered":"2023-12-16T00:04:05.876980+0000","last_clean":"2023-12-16T00:04:05.876980+0000","last_became_active":"2023-12-15T22:52:55.187839+0000","last_became_peered":"2023-12-15T22:52:55.187839+0000","last_unstale":"2023-12-16T00:04:05.876980+0000","last_undegraded":"2023-12-16T00:04:05.876980+0000","last_fullsized":"2023-12-16T00:04:05.876980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.876880+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.876880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:41.515195+0000","scrub_duration":0.0014092810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:06.850990+0000","last_change":"2023-12-16T00:04:06.851033+0000","last_active":"2023-12-16T00:04:06.850990+0000","last_peered":"2023-12-16T00:04:06.850990+0000","last_clean":"2023-12-16T00:04:06.850990+0000","last_became_active":"2023-12-15T22:52:53.175399+0000","last_became_peered":"2023-12-15T22:52:53.175399+0000","last_unstale":"2023-12-16T00:04:06.850990+0000","last_undegraded":"2023-12-16T00:04:06.850990+0000","last_fullsized":"2023-12-16T00:04:06.850990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:06.850910+0000","last_clean_scrub_stamp":"2023-12-16T00:04:06.850910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:25.908040+0000","scrub_duration":0.00097751000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"54'14","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418502+0000","last_change":"2023-12-16T00:01:44.682501+0000","last_active":"2023-12-16T00:02:10.418502+0000","last_peered":"2023-12-16T00:02:10.418502+0000","last_clean":"2023-12-16T00:02:10.418502+0000","last_became_active":"2023-12-15T22:53:26.162495+0000","last_became_peered":"2023-12-15T22:53:26.162495+0000","last_unstale":"2023-12-16T00:02:10.418502+0000","last_undegraded":"2023-12-16T00:02:10.418502+0000","last_fullsized":"2023-12-16T00:02:10.418502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:44.682357+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.682357+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:43:12.739164+0000","scrub_duration":0.005555356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":69,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.281009+0000","last_change":"2023-12-16T00:03:17.281047+0000","last_active":"2023-12-16T00:03:17.281009+0000","last_peered":"2023-12-16T00:03:17.281009+0000","last_clean":"2023-12-16T00:03:17.281009+0000","last_became_active":"2023-12-15T22:52:55.190290+0000","last_became_peered":"2023-12-15T22:52:55.190290+0000","last_unstale":"2023-12-16T00:03:17.281009+0000","last_undegraded":"2023-12-16T00:03:17.281009+0000","last_fullsized":"2023-12-16T00:03:17.281009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.280930+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.280930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:22.701354+0000","scrub_duration":0.001141794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.493314+0000","last_change":"2023-12-16T00:03:36.493334+0000","last_active":"2023-12-16T00:03:36.493314+0000","last_peered":"2023-12-16T00:03:36.493314+0000","last_clean":"2023-12-16T00:03:36.493314+0000","last_became_active":"2023-12-15T22:52:53.170957+0000","last_became_peered":"2023-12-15T22:52:53.170957+0000","last_unstale":"2023-12-16T00:03:36.493314+0000","last_undegraded":"2023-12-16T00:03:36.493314+0000","last_fullsized":"2023-12-16T00:03:36.493314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.493246+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.493246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:53.796792+0000","scrub_duration":0.00093940400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"54'8","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:22.164417+0000","last_change":"2023-12-16T00:01:22.164417+0000","last_active":"2023-12-16T00:01:22.164417+0000","last_peered":"2023-12-16T00:01:22.164417+0000","last_clean":"2023-12-16T00:01:22.164417+0000","last_became_active":"2023-12-15T22:53:26.155494+0000","last_became_peered":"2023-12-15T22:53:26.155494+0000","last_unstale":"2023-12-16T00:01:22.164417+0000","last_undegraded":"2023-12-16T00:01:22.164417+0000","last_fullsized":"2023-12-16T00:01:22.164417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:22.164315+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.164315+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:08.845349+0000","scrub_duration":0.0033790690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":80,"num_write":39,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.379807+0000","last_change":"2023-12-16T00:03:01.379827+0000","last_active":"2023-12-16T00:03:01.379807+0000","last_peered":"2023-12-16T00:03:01.379807+0000","last_clean":"2023-12-16T00:03:01.379807+0000","last_became_active":"2023-12-15T22:52:55.187426+0000","last_became_peered":"2023-12-15T22:52:55.187426+0000","last_unstale":"2023-12-16T00:03:01.379807+0000","last_undegraded":"2023-12-16T00:03:01.379807+0000","last_fullsized":"2023-12-16T00:03:01.379807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:01.379745+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.379745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:34:12.617018+0000","scrub_duration":0.0013465619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:53.104306+0000","last_change":"2023-12-16T00:03:53.104323+0000","last_active":"2023-12-16T00:03:53.104306+0000","last_peered":"2023-12-16T00:03:53.104306+0000","last_clean":"2023-12-16T00:03:53.104306+0000","last_became_active":"2023-12-15T22:52:53.177452+0000","last_became_peered":"2023-12-15T22:52:53.177452+0000","last_unstale":"2023-12-16T00:03:53.104306+0000","last_undegraded":"2023-12-16T00:03:53.104306+0000","last_fullsized":"2023-12-16T00:03:53.104306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:53.104258+0000","last_clean_scrub_stamp":"2023-12-16T00:03:53.104258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:09.066868+0000","scrub_duration":0.0012952809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"54'7","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.632659+0000","last_change":"2023-12-16T00:02:00.632659+0000","last_active":"2023-12-16T00:02:00.632659+0000","last_peered":"2023-12-16T00:02:00.632659+0000","last_clean":"2023-12-16T00:02:00.632659+0000","last_became_active":"2023-12-15T22:53:26.156796+0000","last_became_peered":"2023-12-15T22:53:26.156796+0000","last_unstale":"2023-12-16T00:02:00.632659+0000","last_undegraded":"2023-12-16T00:02:00.632659+0000","last_fullsized":"2023-12-16T00:02:00.632659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:02:00.632562+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.632562+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:18.633178+0000","scrub_duration":0.0028500639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":51,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.370211+0000","last_change":"2023-12-16T00:03:12.370232+0000","last_active":"2023-12-16T00:03:12.370211+0000","last_peered":"2023-12-16T00:03:12.370211+0000","last_clean":"2023-12-16T00:03:12.370211+0000","last_became_active":"2023-12-15T22:53:01.292985+0000","last_became_peered":"2023-12-15T22:53:01.292985+0000","last_unstale":"2023-12-16T00:03:12.370211+0000","last_undegraded":"2023-12-16T00:03:12.370211+0000","last_fullsized":"2023-12-16T00:03:12.370211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.370143+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.370143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:54.711944+0000","scrub_duration":0.001101749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.208542+0000","last_change":"2023-12-16T00:04:00.208562+0000","last_active":"2023-12-16T00:04:00.208542+0000","last_peered":"2023-12-16T00:04:00.208542+0000","last_clean":"2023-12-16T00:04:00.208542+0000","last_became_active":"2023-12-15T22:52:53.174818+0000","last_became_peered":"2023-12-15T22:52:53.174818+0000","last_unstale":"2023-12-16T00:04:00.208542+0000","last_undegraded":"2023-12-16T00:04:00.208542+0000","last_fullsized":"2023-12-16T00:04:00.208542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.208477+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.208477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:00.531527+0000","scrub_duration":0.00086714300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:40.569407+0000","last_change":"2023-12-16T00:04:40.569407+0000","last_active":"2023-12-16T00:04:40.569407+0000","last_peered":"2023-12-16T00:04:40.569407+0000","last_clean":"2023-12-16T00:04:40.569407+0000","last_became_active":"2023-12-15T23:08:37.337675+0000","last_became_peered":"2023-12-15T23:08:37.337675+0000","last_unstale":"2023-12-16T00:04:40.569407+0000","last_undegraded":"2023-12-16T00:04:40.569407+0000","last_fullsized":"2023-12-16T00:04:40.569407+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:40.569321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:40.569321+0000","last_clean_scrub_stamp":"2023-12-16T00:04:40.569321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:36.071208+0000","scrub_duration":0.001182326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"54'142","reported_seq":1746,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:44.271771+0000","last_change":"2023-12-16T00:04:44.271831+0000","last_active":"2023-12-16T00:04:44.271771+0000","last_peered":"2023-12-16T00:04:44.271771+0000","last_clean":"2023-12-16T00:04:44.271771+0000","last_became_active":"2023-12-15T22:54:04.180634+0000","last_became_peered":"2023-12-15T22:54:04.180634+0000","last_unstale":"2023-12-16T00:04:44.271771+0000","last_undegraded":"2023-12-16T00:04:44.271771+0000","last_fullsized":"2023-12-16T00:04:44.271771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'142","last_scrub_stamp":"2023-12-16T00:04:44.271708+0000","last_deep_scrub":"54'142","last_deep_scrub_stamp":"2023-12-16T00:04:44.271708+0000","last_clean_scrub_stamp":"2023-12-16T00:04:44.271708+0000","objects_scrubbed":41,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:46:28.224409+0000","scrub_duration":0.020811165999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2734,"num_read_kb":2690,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9692,"num_omap_keys":36,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.411398+0000","last_change":"2023-12-16T00:02:07.411398+0000","last_active":"2023-12-16T00:02:07.411398+0000","last_peered":"2023-12-16T00:02:07.411398+0000","last_clean":"2023-12-16T00:02:07.411398+0000","last_became_active":"2023-12-15T22:53:58.171779+0000","last_became_peered":"2023-12-15T22:53:58.171779+0000","last_unstale":"2023-12-16T00:02:07.411398+0000","last_undegraded":"2023-12-16T00:02:07.411398+0000","last_fullsized":"2023-12-16T00:02:07.411398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.411319+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.411319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:22.822001+0000","scrub_duration":0.0011936080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"54'12","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:49.234555+0000","last_change":"2023-12-16T00:04:49.234555+0000","last_active":"2023-12-16T00:04:49.234555+0000","last_peered":"2023-12-16T00:04:49.234555+0000","last_clean":"2023-12-16T00:04:49.234555+0000","last_became_active":"2023-12-15T22:55:02.193832+0000","last_became_peered":"2023-12-15T22:55:02.193832+0000","last_unstale":"2023-12-16T00:04:49.234555+0000","last_undegraded":"2023-12-16T00:04:49.234555+0000","last_fullsized":"2023-12-16T00:04:49.234555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:04:49.234455+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:04:49.234455+0000","last_clean_scrub_stamp":"2023-12-16T00:04:49.234455+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:01.252367+0000","scrub_duration":0.0044167649999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":111,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403451+0000","last_change":"2023-12-16T00:00:40.365472+0000","last_active":"2023-12-16T00:01:01.403451+0000","last_peered":"2023-12-16T00:01:01.403451+0000","last_clean":"2023-12-16T00:01:01.403451+0000","last_became_active":"2023-12-15T22:53:30.178101+0000","last_became_peered":"2023-12-15T22:53:30.178101+0000","last_unstale":"2023-12-16T00:01:01.403451+0000","last_undegraded":"2023-12-16T00:01:01.403451+0000","last_fullsized":"2023-12-16T00:01:01.403451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:40.365368+0000","last_clean_scrub_stamp":"2023-12-16T00:00:40.365368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:08.403218+0000","scrub_duration":0.00092627499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"54'331","reported_seq":566,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415893+0000","last_change":"2023-12-16T00:00:38.089755+0000","last_active":"2023-12-16T00:01:00.415893+0000","last_peered":"2023-12-16T00:01:00.415893+0000","last_clean":"2023-12-16T00:01:00.415893+0000","last_became_active":"2023-12-15T22:53:28.165253+0000","last_became_peered":"2023-12-15T22:53:28.165253+0000","last_unstale":"2023-12-16T00:01:00.415893+0000","last_undegraded":"2023-12-16T00:01:00.415893+0000","last_fullsized":"2023-12-16T00:01:00.415893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'331","last_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_deep_scrub":"54'331","last_deep_scrub_stamp":"2023-12-16T00:00:38.089617+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.089617+0000","objects_scrubbed":22,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:48.844847+0000","scrub_duration":0.011525986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":467,"num_read_kb":455,"num_write":455,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17384,"num_omap_keys":77,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"54'32","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.620322+0000","last_change":"2023-12-16T00:02:06.620322+0000","last_active":"2023-12-16T00:02:06.620322+0000","last_peered":"2023-12-16T00:02:06.620322+0000","last_clean":"2023-12-16T00:02:06.620322+0000","last_became_active":"2023-12-15T22:53:26.157169+0000","last_became_peered":"2023-12-15T22:53:26.157169+0000","last_unstale":"2023-12-16T00:02:06.620322+0000","last_undegraded":"2023-12-16T00:02:06.620322+0000","last_fullsized":"2023-12-16T00:02:06.620322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:02:06.620227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.620227+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:25.873054+0000","scrub_duration":0.005862094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":325,"num_write":169,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.646521+0000","last_change":"2023-12-16T00:02:14.646521+0000","last_active":"2023-12-16T00:02:14.646521+0000","last_peered":"2023-12-16T00:02:14.646521+0000","last_clean":"2023-12-16T00:02:14.646521+0000","last_became_active":"2023-12-15T22:53:10.336311+0000","last_became_peered":"2023-12-15T22:53:10.336311+0000","last_unstale":"2023-12-16T00:02:14.646521+0000","last_undegraded":"2023-12-16T00:02:14.646521+0000","last_fullsized":"2023-12-16T00:02:14.646521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:14.646423+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.646423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:28.674818+0000","scrub_duration":0.0014900530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.542129+0000","last_change":"2023-12-16T00:03:49.542149+0000","last_active":"2023-12-16T00:03:49.542129+0000","last_peered":"2023-12-16T00:03:49.542129+0000","last_clean":"2023-12-16T00:03:49.542129+0000","last_became_active":"2023-12-15T22:52:55.192633+0000","last_became_peered":"2023-12-15T22:52:55.192633+0000","last_unstale":"2023-12-16T00:03:49.542129+0000","last_undegraded":"2023-12-16T00:03:49.542129+0000","last_fullsized":"2023-12-16T00:03:49.542129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.542068+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.542068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:56:12.196084+0000","scrub_duration":0.0010559110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:35.099727+0000","last_change":"2023-12-16T00:04:35.099747+0000","last_active":"2023-12-16T00:04:35.099727+0000","last_peered":"2023-12-16T00:04:35.099727+0000","last_clean":"2023-12-16T00:04:35.099727+0000","last_became_active":"2023-12-15T22:52:53.175401+0000","last_became_peered":"2023-12-15T22:52:53.175401+0000","last_unstale":"2023-12-16T00:04:35.099727+0000","last_undegraded":"2023-12-16T00:04:35.099727+0000","last_fullsized":"2023-12-16T00:04:35.099727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:35.099657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:35.099657+0000","last_clean_scrub_stamp":"2023-12-16T00:04:35.099657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:36:42.930374+0000","scrub_duration":0.00097042999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.157297+0000","last_change":"2023-12-16T00:03:31.157320+0000","last_active":"2023-12-16T00:03:31.157297+0000","last_peered":"2023-12-16T00:03:31.157297+0000","last_clean":"2023-12-16T00:03:31.157297+0000","last_became_active":"2023-12-15T22:53:04.313943+0000","last_became_peered":"2023-12-15T22:53:04.313943+0000","last_unstale":"2023-12-16T00:03:31.157297+0000","last_undegraded":"2023-12-16T00:03:31.157297+0000","last_fullsized":"2023-12-16T00:03:31.157297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:31.157241+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.157241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:58:18.132539+0000","scrub_duration":0.0024345880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.181058+0000","last_change":"2023-12-16T00:02:54.181058+0000","last_active":"2023-12-16T00:02:54.181058+0000","last_peered":"2023-12-16T00:02:54.181058+0000","last_clean":"2023-12-16T00:02:54.181058+0000","last_became_active":"2023-12-15T22:53:06.322037+0000","last_became_peered":"2023-12-15T22:53:06.322037+0000","last_unstale":"2023-12-16T00:02:54.181058+0000","last_undegraded":"2023-12-16T00:02:54.181058+0000","last_fullsized":"2023-12-16T00:02:54.181058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:54.180967+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.180967+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:00.772629+0000","scrub_duration":0.0036794480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.099331+0000","last_change":"2023-12-16T00:02:40.099331+0000","last_active":"2023-12-16T00:02:40.099331+0000","last_peered":"2023-12-16T00:02:40.099331+0000","last_clean":"2023-12-16T00:02:40.099331+0000","last_became_active":"2023-12-15T22:53:08.331612+0000","last_became_peered":"2023-12-15T22:53:08.331612+0000","last_unstale":"2023-12-16T00:02:40.099331+0000","last_undegraded":"2023-12-16T00:02:40.099331+0000","last_fullsized":"2023-12-16T00:02:40.099331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:40.099221+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.099221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:56.334202+0000","scrub_duration":0.001640454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.103882+0000","last_change":"2023-12-16T00:03:59.103882+0000","last_active":"2023-12-16T00:03:59.103882+0000","last_peered":"2023-12-16T00:03:59.103882+0000","last_clean":"2023-12-16T00:03:59.103882+0000","last_became_active":"2023-12-15T23:08:37.338664+0000","last_became_peered":"2023-12-15T23:08:37.338664+0000","last_unstale":"2023-12-16T00:03:59.103882+0000","last_undegraded":"2023-12-16T00:03:59.103882+0000","last_fullsized":"2023-12-16T00:03:59.103882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.103798+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.103798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:15.216322+0000","scrub_duration":0.001606133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"54'136","reported_seq":6216,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.445260+0000","last_change":"2023-12-16T00:02:40.272472+0000","last_active":"2023-12-16T00:02:50.445260+0000","last_peered":"2023-12-16T00:02:50.445260+0000","last_clean":"2023-12-16T00:02:50.445260+0000","last_became_active":"2023-12-15T22:54:04.186984+0000","last_became_peered":"2023-12-15T22:54:04.186984+0000","last_unstale":"2023-12-16T00:02:50.445260+0000","last_undegraded":"2023-12-16T00:02:50.445260+0000","last_fullsized":"2023-12-16T00:02:50.445260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:02:40.272378+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.272378+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:28.258845+0000","scrub_duration":0.021195851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7121,"num_read_kb":7089,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7865,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:52.886912+0000","last_change":"2023-12-16T00:01:52.886912+0000","last_active":"2023-12-16T00:01:52.886912+0000","last_peered":"2023-12-16T00:01:52.886912+0000","last_clean":"2023-12-16T00:01:52.886912+0000","last_became_active":"2023-12-15T22:53:58.167161+0000","last_became_peered":"2023-12-15T22:53:58.167161+0000","last_unstale":"2023-12-16T00:01:52.886912+0000","last_undegraded":"2023-12-16T00:01:52.886912+0000","last_fullsized":"2023-12-16T00:01:52.886912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:52.886810+0000","last_clean_scrub_stamp":"2023-12-16T00:01:52.886810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:01.652250+0000","scrub_duration":0.0014125400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"54'4","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.118199+0000","last_change":"2023-12-16T00:02:20.118199+0000","last_active":"2023-12-16T00:02:20.118199+0000","last_peered":"2023-12-16T00:02:20.118199+0000","last_clean":"2023-12-16T00:02:20.118199+0000","last_became_active":"2023-12-15T22:53:32.194543+0000","last_became_peered":"2023-12-15T22:53:32.194543+0000","last_unstale":"2023-12-16T00:02:20.118199+0000","last_undegraded":"2023-12-16T00:02:20.118199+0000","last_fullsized":"2023-12-16T00:02:20.118199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:20.118096+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.118096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:14.148618+0000","scrub_duration":0.0027790639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"54'21","reported_seq":862,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:14.781698+0000","last_change":"2023-12-16T00:01:14.781698+0000","last_active":"2023-12-16T00:01:14.781698+0000","last_peered":"2023-12-16T00:01:14.781698+0000","last_clean":"2023-12-16T00:01:14.781698+0000","last_became_active":"2023-12-15T22:53:30.176637+0000","last_became_peered":"2023-12-15T22:53:30.176637+0000","last_unstale":"2023-12-16T00:01:14.781698+0000","last_undegraded":"2023-12-16T00:01:14.781698+0000","last_fullsized":"2023-12-16T00:01:14.781698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'21","last_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_deep_scrub":"54'21","last_deep_scrub_stamp":"2023-12-16T00:01:14.781576+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.781576+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:32.782192+0000","scrub_duration":0.0024479219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"54'2004","reported_seq":3318,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.401744+0000","last_change":"2023-12-16T00:00:34.871612+0000","last_active":"2023-12-16T00:01:00.401744+0000","last_peered":"2023-12-16T00:01:00.401744+0000","last_clean":"2023-12-16T00:01:00.401744+0000","last_became_active":"2023-12-15T22:53:28.163973+0000","last_became_peered":"2023-12-15T22:53:28.163973+0000","last_unstale":"2023-12-16T00:01:00.401744+0000","last_undegraded":"2023-12-16T00:01:00.401744+0000","last_fullsized":"2023-12-16T00:01:00.401744+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2004","last_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_deep_scrub":"54'2004","last_deep_scrub_stamp":"2023-12-16T00:00:34.871492+0000","last_clean_scrub_stamp":"2023-12-16T00:00:34.871492+0000","objects_scrubbed":15,"log_size":1804,"log_dups_size":200,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:45:50.789612+0000","scrub_duration":0.014147738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39771,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4747,"num_read_kb":4361,"num_write":2369,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":77,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"54'13","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.752053+0000","last_change":"2023-12-16T00:01:25.752053+0000","last_active":"2023-12-16T00:01:25.752053+0000","last_peered":"2023-12-16T00:01:25.752053+0000","last_clean":"2023-12-16T00:01:25.752053+0000","last_became_active":"2023-12-15T22:53:26.159418+0000","last_became_peered":"2023-12-15T22:53:26.159418+0000","last_unstale":"2023-12-16T00:01:25.752053+0000","last_undegraded":"2023-12-16T00:01:25.752053+0000","last_fullsized":"2023-12-16T00:01:25.752053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:25.751953+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.751953+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:46.112043+0000","scrub_duration":0.0031904239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":54,"num_write":59,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.844596+0000","last_change":"2023-12-16T00:01:46.844596+0000","last_active":"2023-12-16T00:01:46.844596+0000","last_peered":"2023-12-16T00:01:46.844596+0000","last_clean":"2023-12-16T00:01:46.844596+0000","last_became_active":"2023-12-15T22:53:10.340591+0000","last_became_peered":"2023-12-15T22:53:10.340591+0000","last_unstale":"2023-12-16T00:01:46.844596+0000","last_undegraded":"2023-12-16T00:01:46.844596+0000","last_fullsized":"2023-12-16T00:01:46.844596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:46.844487+0000","last_clean_scrub_stamp":"2023-12-16T00:01:46.844487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:46.864635+0000","scrub_duration":0.00087358100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.770654+0000","last_change":"2023-12-16T00:04:19.770689+0000","last_active":"2023-12-16T00:04:19.770654+0000","last_peered":"2023-12-16T00:04:19.770654+0000","last_clean":"2023-12-16T00:04:19.770654+0000","last_became_active":"2023-12-15T22:52:55.189152+0000","last_became_peered":"2023-12-15T22:52:55.189152+0000","last_unstale":"2023-12-16T00:04:19.770654+0000","last_undegraded":"2023-12-16T00:04:19.770654+0000","last_fullsized":"2023-12-16T00:04:19.770654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.770579+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:20.747565+0000","scrub_duration":0.00081478900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:21.613484+0000","last_change":"2023-12-16T00:04:21.613504+0000","last_active":"2023-12-16T00:04:21.613484+0000","last_peered":"2023-12-16T00:04:21.613484+0000","last_clean":"2023-12-16T00:04:21.613484+0000","last_became_active":"2023-12-15T22:53:01.908053+0000","last_became_peered":"2023-12-15T22:53:01.908053+0000","last_unstale":"2023-12-16T00:04:21.613484+0000","last_undegraded":"2023-12-16T00:04:21.613484+0000","last_fullsized":"2023-12-16T00:04:21.613484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:21.613416+0000","last_clean_scrub_stamp":"2023-12-16T00:04:21.613416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:35:24.089617+0000","scrub_duration":0.0013326939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"54'7","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:32.225673+0000","last_change":"2023-12-16T00:04:32.225699+0000","last_active":"2023-12-16T00:04:32.225673+0000","last_peered":"2023-12-16T00:04:32.225673+0000","last_clean":"2023-12-16T00:04:32.225673+0000","last_became_active":"2023-12-15T22:53:04.316622+0000","last_became_peered":"2023-12-15T22:53:04.316622+0000","last_unstale":"2023-12-16T00:04:32.225673+0000","last_undegraded":"2023-12-16T00:04:32.225673+0000","last_fullsized":"2023-12-16T00:04:32.225673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:04:32.225618+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:04:32.225618+0000","last_clean_scrub_stamp":"2023-12-16T00:04:32.225618+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:42:44.057469+0000","scrub_duration":0.0026127350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":116,"num_write":11,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"54'45","reported_seq":141,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:47.604997+0000","last_change":"2023-12-16T00:02:47.604997+0000","last_active":"2023-12-16T00:02:47.604997+0000","last_peered":"2023-12-16T00:02:47.604997+0000","last_clean":"2023-12-16T00:02:47.604997+0000","last_became_active":"2023-12-15T22:53:06.324430+0000","last_became_peered":"2023-12-15T22:53:06.324430+0000","last_unstale":"2023-12-16T00:02:47.604997+0000","last_undegraded":"2023-12-16T00:02:47.604997+0000","last_fullsized":"2023-12-16T00:02:47.604997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'45","last_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_deep_scrub":"54'45","last_deep_scrub_stamp":"2023-12-16T00:02:47.604912+0000","last_clean_scrub_stamp":"2023-12-16T00:02:47.604912+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:30.231500+0000","scrub_duration":0.0031771270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":60,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.567538+0000","last_change":"2023-12-16T00:02:27.567538+0000","last_active":"2023-12-16T00:02:27.567538+0000","last_peered":"2023-12-16T00:02:27.567538+0000","last_clean":"2023-12-16T00:02:27.567538+0000","last_became_active":"2023-12-15T22:53:08.330464+0000","last_became_peered":"2023-12-15T22:53:08.330464+0000","last_unstale":"2023-12-16T00:02:27.567538+0000","last_undegraded":"2023-12-16T00:02:27.567538+0000","last_fullsized":"2023-12-16T00:02:27.567538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:27.567453+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.567453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:10.589304+0000","scrub_duration":0.0011432930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.863793+0000","last_change":"2023-12-16T00:04:25.863829+0000","last_active":"2023-12-16T00:04:25.863793+0000","last_peered":"2023-12-16T00:04:25.863793+0000","last_clean":"2023-12-16T00:04:25.863793+0000","last_became_active":"2023-12-15T23:08:37.336293+0000","last_became_peered":"2023-12-15T23:08:37.336293+0000","last_unstale":"2023-12-16T00:04:25.863793+0000","last_undegraded":"2023-12-16T00:04:25.863793+0000","last_fullsized":"2023-12-16T00:04:25.863793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:25.863725+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.863725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:26.840711+0000","scrub_duration":0.00098527300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"54'98","reported_seq":1146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:36.206857+0000","last_change":"2023-12-16T00:04:36.206883+0000","last_active":"2023-12-16T00:04:36.206857+0000","last_peered":"2023-12-16T00:04:36.206857+0000","last_clean":"2023-12-16T00:04:36.206857+0000","last_became_active":"2023-12-15T22:54:04.186214+0000","last_became_peered":"2023-12-15T22:54:04.186214+0000","last_unstale":"2023-12-16T00:04:36.206857+0000","last_undegraded":"2023-12-16T00:04:36.206857+0000","last_fullsized":"2023-12-16T00:04:36.206857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'98","last_scrub_stamp":"2023-12-16T00:04:36.206803+0000","last_deep_scrub":"54'98","last_deep_scrub_stamp":"2023-12-16T00:04:36.206803+0000","last_clean_scrub_stamp":"2023-12-16T00:04:36.206803+0000","objects_scrubbed":29,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:46:20.159503+0000","scrub_duration":0.014301810999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1796,"num_read_kb":1770,"num_write":100,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7620,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.429700+0000","last_change":"2023-12-16T00:01:24.842572+0000","last_active":"2023-12-16T00:02:46.429700+0000","last_peered":"2023-12-16T00:02:46.429700+0000","last_clean":"2023-12-16T00:02:46.429700+0000","last_became_active":"2023-12-15T22:53:58.167878+0000","last_became_peered":"2023-12-15T22:53:58.167878+0000","last_unstale":"2023-12-16T00:02:46.429700+0000","last_undegraded":"2023-12-16T00:02:46.429700+0000","last_fullsized":"2023-12-16T00:02:46.429700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.842491+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.842491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:56.307311+0000","scrub_duration":0.00087697999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"54'8","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.414205+0000","last_change":"2023-12-16T00:01:26.778894+0000","last_active":"2023-12-16T00:01:46.414205+0000","last_peered":"2023-12-16T00:01:46.414205+0000","last_clean":"2023-12-16T00:01:46.414205+0000","last_became_active":"2023-12-15T22:53:32.199771+0000","last_became_peered":"2023-12-15T22:53:32.199771+0000","last_unstale":"2023-12-16T00:01:46.414205+0000","last_undegraded":"2023-12-16T00:01:46.414205+0000","last_fullsized":"2023-12-16T00:01:46.414205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:26.778815+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.778815+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:31.406850+0000","scrub_duration":0.0022902959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:25.422218+0000","last_change":"2023-12-16T00:01:25.348968+0000","last_active":"2023-12-16T00:01:25.422218+0000","last_peered":"2023-12-16T00:01:25.422218+0000","last_clean":"2023-12-16T00:01:25.422218+0000","last_became_active":"2023-12-15T22:53:30.183192+0000","last_became_peered":"2023-12-15T22:53:30.183192+0000","last_unstale":"2023-12-16T00:01:25.422218+0000","last_undegraded":"2023-12-16T00:01:25.422218+0000","last_fullsized":"2023-12-16T00:01:25.422218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.348842+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.348842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:54.068985+0000","scrub_duration":0.0012277849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"54'213","reported_seq":452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403853+0000","last_change":"2023-12-16T00:00:41.887185+0000","last_active":"2023-12-16T00:01:10.403853+0000","last_peered":"2023-12-16T00:01:10.403853+0000","last_clean":"2023-12-16T00:01:10.403853+0000","last_became_active":"2023-12-15T22:53:28.167275+0000","last_became_peered":"2023-12-15T22:53:28.167275+0000","last_unstale":"2023-12-16T00:01:10.403853+0000","last_undegraded":"2023-12-16T00:01:10.403853+0000","last_fullsized":"2023-12-16T00:01:10.403853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'213","last_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_deep_scrub":"54'213","last_deep_scrub_stamp":"2023-12-16T00:00:41.887070+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.887070+0000","objects_scrubbed":12,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:01.805635+0000","scrub_duration":0.0079385310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":484,"num_read_kb":349,"num_write":166,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'10","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414117+0000","last_change":"2023-12-16T00:00:39.270474+0000","last_active":"2023-12-16T00:00:55.414117+0000","last_peered":"2023-12-16T00:00:55.414117+0000","last_clean":"2023-12-16T00:00:55.414117+0000","last_became_active":"2023-12-15T22:53:26.161841+0000","last_became_peered":"2023-12-15T22:53:26.161841+0000","last_unstale":"2023-12-16T00:00:55.414117+0000","last_undegraded":"2023-12-16T00:00:55.414117+0000","last_fullsized":"2023-12-16T00:00:55.414117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:39.270337+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.270337+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:24.469019+0000","scrub_duration":0.0040969509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":57,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.165998+0000","last_change":"2023-12-16T00:01:55.165998+0000","last_active":"2023-12-16T00:01:55.165998+0000","last_peered":"2023-12-16T00:01:55.165998+0000","last_clean":"2023-12-16T00:01:55.165998+0000","last_became_active":"2023-12-15T22:53:10.340072+0000","last_became_peered":"2023-12-15T22:53:10.340072+0000","last_unstale":"2023-12-16T00:01:55.165998+0000","last_undegraded":"2023-12-16T00:01:55.165998+0000","last_fullsized":"2023-12-16T00:01:55.165998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.165906+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.165906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:08.749291+0000","scrub_duration":0.0010642309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.958638+0000","last_change":"2023-12-16T00:03:27.958656+0000","last_active":"2023-12-16T00:03:27.958638+0000","last_peered":"2023-12-16T00:03:27.958638+0000","last_clean":"2023-12-16T00:03:27.958638+0000","last_became_active":"2023-12-15T22:52:55.187845+0000","last_became_peered":"2023-12-15T22:52:55.187845+0000","last_unstale":"2023-12-16T00:03:27.958638+0000","last_undegraded":"2023-12-16T00:03:27.958638+0000","last_fullsized":"2023-12-16T00:03:27.958638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.958580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.958580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:44:22.233209+0000","scrub_duration":0.00089666500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:33.147272+0000","last_change":"2023-12-16T00:04:33.147291+0000","last_active":"2023-12-16T00:04:33.147272+0000","last_peered":"2023-12-16T00:04:33.147272+0000","last_clean":"2023-12-16T00:04:33.147272+0000","last_became_active":"2023-12-15T22:52:53.173009+0000","last_became_peered":"2023-12-15T22:52:53.173009+0000","last_unstale":"2023-12-16T00:04:33.147272+0000","last_undegraded":"2023-12-16T00:04:33.147272+0000","last_fullsized":"2023-12-16T00:04:33.147272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:33.147211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:33.147211+0000","last_clean_scrub_stamp":"2023-12-16T00:04:33.147211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:56.827365+0000","scrub_duration":0.00095753099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"54'12","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.346325+0000","last_change":"2023-12-16T00:03:02.346325+0000","last_active":"2023-12-16T00:03:02.346325+0000","last_peered":"2023-12-16T00:03:02.346325+0000","last_clean":"2023-12-16T00:03:02.346325+0000","last_became_active":"2023-12-15T22:53:04.321309+0000","last_became_peered":"2023-12-15T22:53:04.321309+0000","last_unstale":"2023-12-16T00:03:02.346325+0000","last_undegraded":"2023-12-16T00:03:02.346325+0000","last_fullsized":"2023-12-16T00:03:02.346325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:03:02.346242+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.346242+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:30.158960+0000","scrub_duration":0.0021493889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"54'75","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.328473+0000","last_change":"2023-12-16T00:03:19.328473+0000","last_active":"2023-12-16T00:03:19.328473+0000","last_peered":"2023-12-16T00:03:19.328473+0000","last_clean":"2023-12-16T00:03:19.328473+0000","last_became_active":"2023-12-15T22:53:06.321297+0000","last_became_peered":"2023-12-15T22:53:06.321297+0000","last_unstale":"2023-12-16T00:03:19.328473+0000","last_undegraded":"2023-12-16T00:03:19.328473+0000","last_fullsized":"2023-12-16T00:03:19.328473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:03:19.328390+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.328390+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:32.996213+0000","scrub_duration":0.0034146469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"54'13","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:48.359647+0000","last_change":"2023-12-16T00:01:48.359647+0000","last_active":"2023-12-16T00:01:48.359647+0000","last_peered":"2023-12-16T00:01:48.359647+0000","last_clean":"2023-12-16T00:01:48.359647+0000","last_became_active":"2023-12-15T22:53:08.332575+0000","last_became_peered":"2023-12-15T22:53:08.332575+0000","last_unstale":"2023-12-16T00:01:48.359647+0000","last_undegraded":"2023-12-16T00:01:48.359647+0000","last_fullsized":"2023-12-16T00:01:48.359647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:48.359552+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.359552+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:10:47.144011+0000","scrub_duration":0.0023497930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:39.578391+0000","last_change":"2023-12-16T00:04:39.578416+0000","last_active":"2023-12-16T00:04:39.578391+0000","last_peered":"2023-12-16T00:04:39.578391+0000","last_clean":"2023-12-16T00:04:39.578391+0000","last_became_active":"2023-12-15T23:08:37.340828+0000","last_became_peered":"2023-12-15T23:08:37.340828+0000","last_unstale":"2023-12-16T00:04:39.578391+0000","last_undegraded":"2023-12-16T00:04:39.578391+0000","last_fullsized":"2023-12-16T00:04:39.578391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:39.578324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:39.578324+0000","last_clean_scrub_stamp":"2023-12-16T00:04:39.578324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:26.192742+0000","scrub_duration":0.0014997089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"54'120","reported_seq":1029,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.304253+0000","last_change":"2023-12-16T00:02:29.304253+0000","last_active":"2023-12-16T00:02:29.304253+0000","last_peered":"2023-12-16T00:02:29.304253+0000","last_clean":"2023-12-16T00:02:29.304253+0000","last_became_active":"2023-12-15T22:54:04.187008+0000","last_became_peered":"2023-12-15T22:54:04.187008+0000","last_unstale":"2023-12-16T00:02:29.304253+0000","last_undegraded":"2023-12-16T00:02:29.304253+0000","last_fullsized":"2023-12-16T00:02:29.304253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'120","last_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_deep_scrub":"54'120","last_deep_scrub_stamp":"2023-12-16T00:02:29.304117+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.304117+0000","objects_scrubbed":34,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:38.283187+0000","scrub_duration":0.017925427000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1439,"num_read_kb":1407,"num_write":119,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7918,"num_omap_keys":29,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.422119+0000","last_change":"2023-12-16T00:01:18.840624+0000","last_active":"2023-12-16T00:02:16.422119+0000","last_peered":"2023-12-16T00:02:16.422119+0000","last_clean":"2023-12-16T00:02:16.422119+0000","last_became_active":"2023-12-15T22:53:58.170684+0000","last_became_peered":"2023-12-15T22:53:58.170684+0000","last_unstale":"2023-12-16T00:02:16.422119+0000","last_undegraded":"2023-12-16T00:02:16.422119+0000","last_fullsized":"2023-12-16T00:02:16.422119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:18.840544+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.840544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:41.243603+0000","scrub_duration":0.00097639500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"54'10","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.438339+0000","last_change":"2023-12-16T00:02:04.460768+0000","last_active":"2023-12-16T00:02:20.438339+0000","last_peered":"2023-12-16T00:02:20.438339+0000","last_clean":"2023-12-16T00:02:20.438339+0000","last_became_active":"2023-12-15T22:53:32.196938+0000","last_became_peered":"2023-12-15T22:53:32.196938+0000","last_unstale":"2023-12-16T00:02:20.438339+0000","last_undegraded":"2023-12-16T00:02:20.438339+0000","last_fullsized":"2023-12-16T00:02:20.438339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:04.460684+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.460684+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:58.315341+0000","scrub_duration":0.0051545530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.403828+0000","last_change":"2023-12-16T00:00:44.905696+0000","last_active":"2023-12-16T00:01:10.403828+0000","last_peered":"2023-12-16T00:01:10.403828+0000","last_clean":"2023-12-16T00:01:10.403828+0000","last_became_active":"2023-12-15T22:53:30.176058+0000","last_became_peered":"2023-12-15T22:53:30.176058+0000","last_unstale":"2023-12-16T00:01:10.403828+0000","last_undegraded":"2023-12-16T00:01:10.403828+0000","last_fullsized":"2023-12-16T00:01:10.403828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:44.905615+0000","last_clean_scrub_stamp":"2023-12-16T00:00:44.905615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:56.750181+0000","scrub_duration":0.0014334860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"54'2316","reported_seq":3295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638510+0000","last_change":"2023-12-16T00:01:11.901978+0000","last_active":"2023-12-16T00:01:20.638510+0000","last_peered":"2023-12-16T00:01:20.638510+0000","last_clean":"2023-12-16T00:01:20.638510+0000","last_became_active":"2023-12-15T22:53:28.164703+0000","last_became_peered":"2023-12-15T22:53:28.164703+0000","last_unstale":"2023-12-16T00:01:20.638510+0000","last_undegraded":"2023-12-16T00:01:20.638510+0000","last_fullsized":"2023-12-16T00:01:20.638510+0000","mapping_epoch":35,"log_start":"54'500","ondisk_log_start":"54'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2316","last_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_deep_scrub":"54'2316","last_deep_scrub_stamp":"2023-12-16T00:01:11.901851+0000","last_clean_scrub_stamp":"2023-12-16T00:01:11.901851+0000","objects_scrubbed":23,"log_size":1816,"log_dups_size":500,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:57.100533+0000","scrub_duration":0.019418072000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3961,"num_read_kb":3945,"num_write":2372,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'8","reported_seq":114,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633076+0000","last_change":"2023-12-16T00:00:38.838138+0000","last_active":"2023-12-16T00:00:55.633076+0000","last_peered":"2023-12-16T00:00:55.633076+0000","last_clean":"2023-12-16T00:00:55.633076+0000","last_became_active":"2023-12-15T22:53:26.163772+0000","last_became_peered":"2023-12-15T22:53:26.163772+0000","last_unstale":"2023-12-16T00:00:55.633076+0000","last_undegraded":"2023-12-16T00:00:55.633076+0000","last_fullsized":"2023-12-16T00:00:55.633076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:38.838031+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.838031+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:11:40.718601+0000","scrub_duration":0.0049744009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.678089+0000","last_change":"2023-12-16T00:02:07.678089+0000","last_active":"2023-12-16T00:02:07.678089+0000","last_peered":"2023-12-16T00:02:07.678089+0000","last_clean":"2023-12-16T00:02:07.678089+0000","last_became_active":"2023-12-15T22:53:11.077957+0000","last_became_peered":"2023-12-15T22:53:11.077957+0000","last_unstale":"2023-12-16T00:02:07.678089+0000","last_undegraded":"2023-12-16T00:02:07.678089+0000","last_fullsized":"2023-12-16T00:02:07.678089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.677988+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.677988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:47.838201+0000","scrub_duration":0.0013637320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.944184+0000","last_change":"2023-12-16T00:03:28.944221+0000","last_active":"2023-12-16T00:03:28.944184+0000","last_peered":"2023-12-16T00:03:28.944184+0000","last_clean":"2023-12-16T00:03:28.944184+0000","last_became_active":"2023-12-15T22:52:55.188819+0000","last_became_peered":"2023-12-15T22:52:55.188819+0000","last_unstale":"2023-12-16T00:03:28.944184+0000","last_undegraded":"2023-12-16T00:03:28.944184+0000","last_fullsized":"2023-12-16T00:03:28.944184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.944112+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.944112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.607130+0000","scrub_duration":0.001104956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.809475+0000","last_change":"2023-12-16T00:04:37.809494+0000","last_active":"2023-12-16T00:04:37.809475+0000","last_peered":"2023-12-16T00:04:37.809475+0000","last_clean":"2023-12-16T00:04:37.809475+0000","last_became_active":"2023-12-15T22:52:53.170922+0000","last_became_peered":"2023-12-15T22:52:53.170922+0000","last_unstale":"2023-12-16T00:04:37.809475+0000","last_undegraded":"2023-12-16T00:04:37.809475+0000","last_fullsized":"2023-12-16T00:04:37.809475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.809411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.809411+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.809411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:05.874622+0000","scrub_duration":0.001197219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.415369+0000","last_change":"2023-12-16T00:02:57.415369+0000","last_active":"2023-12-16T00:02:57.415369+0000","last_peered":"2023-12-16T00:02:57.415369+0000","last_clean":"2023-12-16T00:02:57.415369+0000","last_became_active":"2023-12-15T22:53:04.318548+0000","last_became_peered":"2023-12-15T22:53:04.318548+0000","last_unstale":"2023-12-16T00:02:57.415369+0000","last_undegraded":"2023-12-16T00:02:57.415369+0000","last_fullsized":"2023-12-16T00:02:57.415369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.415259+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.415259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:25.582149+0000","scrub_duration":0.0013721619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"54'52","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.328510+0000","last_change":"2023-12-16T00:02:51.328510+0000","last_active":"2023-12-16T00:02:51.328510+0000","last_peered":"2023-12-16T00:02:51.328510+0000","last_clean":"2023-12-16T00:02:51.328510+0000","last_became_active":"2023-12-15T22:53:06.321312+0000","last_became_peered":"2023-12-15T22:53:06.321312+0000","last_unstale":"2023-12-16T00:02:51.328510+0000","last_undegraded":"2023-12-16T00:02:51.328510+0000","last_fullsized":"2023-12-16T00:02:51.328510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:51.328421+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.328421+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:36:48.134913+0000","scrub_duration":0.0030916479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"54'13","reported_seq":807,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:05.030724+0000","last_change":"2023-12-16T00:02:05.030724+0000","last_active":"2023-12-16T00:02:05.030724+0000","last_peered":"2023-12-16T00:02:05.030724+0000","last_clean":"2023-12-16T00:02:05.030724+0000","last_became_active":"2023-12-15T22:53:08.329384+0000","last_became_peered":"2023-12-15T22:53:08.329384+0000","last_unstale":"2023-12-16T00:02:05.030724+0000","last_undegraded":"2023-12-16T00:02:05.030724+0000","last_fullsized":"2023-12-16T00:02:05.030724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:05.030651+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.030651+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:27.600774+0000","scrub_duration":0.0020491609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:08.841865+0000","last_change":"2023-12-16T00:04:08.841865+0000","last_active":"2023-12-16T00:04:08.841865+0000","last_peered":"2023-12-16T00:04:08.841865+0000","last_clean":"2023-12-16T00:04:08.841865+0000","last_became_active":"2023-12-15T23:08:37.336269+0000","last_became_peered":"2023-12-15T23:08:37.336269+0000","last_unstale":"2023-12-16T00:04:08.841865+0000","last_undegraded":"2023-12-16T00:04:08.841865+0000","last_fullsized":"2023-12-16T00:04:08.841865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:08.841784+0000","last_clean_scrub_stamp":"2023-12-16T00:04:08.841784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:19.871757+0000","scrub_duration":0.00090735399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"54'105","reported_seq":1616,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.445779+0000","last_change":"2023-12-16T00:02:35.416912+0000","last_active":"2023-12-16T00:02:50.445779+0000","last_peered":"2023-12-16T00:02:50.445779+0000","last_clean":"2023-12-16T00:02:50.445779+0000","last_became_active":"2023-12-15T22:54:04.184313+0000","last_became_peered":"2023-12-15T22:54:04.184313+0000","last_unstale":"2023-12-16T00:02:50.445779+0000","last_undegraded":"2023-12-16T00:02:50.445779+0000","last_fullsized":"2023-12-16T00:02:50.445779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:35.416817+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.416817+0000","objects_scrubbed":34,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:13.186264+0000","scrub_duration":0.016268916000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2592,"num_read_kb":2574,"num_write":97,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5685,"num_omap_keys":21,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.444613+0000","last_change":"2023-12-16T00:02:18.471939+0000","last_active":"2023-12-16T00:02:45.444613+0000","last_peered":"2023-12-16T00:02:45.444613+0000","last_clean":"2023-12-16T00:02:45.444613+0000","last_became_active":"2023-12-15T22:53:58.169803+0000","last_became_peered":"2023-12-15T22:53:58.169803+0000","last_unstale":"2023-12-16T00:02:45.444613+0000","last_undegraded":"2023-12-16T00:02:45.444613+0000","last_fullsized":"2023-12-16T00:02:45.444613+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:18.471856+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.471856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:28.801498+0000","scrub_duration":0.0012322120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"54'15","reported_seq":115,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413716+0000","last_change":"2023-12-16T00:01:31.719966+0000","last_active":"2023-12-16T00:01:46.413716+0000","last_peered":"2023-12-16T00:01:46.413716+0000","last_clean":"2023-12-16T00:01:46.413716+0000","last_became_active":"2023-12-15T22:53:32.192638+0000","last_became_peered":"2023-12-15T22:53:32.192638+0000","last_unstale":"2023-12-16T00:01:46.413716+0000","last_undegraded":"2023-12-16T00:01:46.413716+0000","last_fullsized":"2023-12-16T00:01:46.413716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:01:31.719848+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.719848+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:44.086382+0000","scrub_duration":0.0047060160000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":93,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.446004+0000","last_change":"2023-12-16T00:01:42.883711+0000","last_active":"2023-12-16T00:02:50.446004+0000","last_peered":"2023-12-16T00:02:50.446004+0000","last_clean":"2023-12-16T00:02:50.446004+0000","last_became_active":"2023-12-15T22:53:30.180683+0000","last_became_peered":"2023-12-15T22:53:30.180683+0000","last_unstale":"2023-12-16T00:02:50.446004+0000","last_undegraded":"2023-12-16T00:02:50.446004+0000","last_fullsized":"2023-12-16T00:02:50.446004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.883625+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.883625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:41.271003+0000","scrub_duration":0.0015060309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'357","reported_seq":535,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.445923+0000","last_change":"2023-12-16T00:00:51.831149+0000","last_active":"2023-12-16T00:02:50.445923+0000","last_peered":"2023-12-16T00:02:50.445923+0000","last_clean":"2023-12-16T00:02:50.445923+0000","last_became_active":"2023-12-15T22:53:28.171963+0000","last_became_peered":"2023-12-15T22:53:28.171963+0000","last_unstale":"2023-12-16T00:02:50.445923+0000","last_undegraded":"2023-12-16T00:02:50.445923+0000","last_fullsized":"2023-12-16T00:02:50.445923+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'357","last_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_deep_scrub":"54'357","last_deep_scrub_stamp":"2023-12-16T00:00:51.831040+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.831040+0000","objects_scrubbed":15,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:15.034998+0000","scrub_duration":0.0088532309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":456,"num_read_kb":449,"num_write":522,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35640,"num_omap_keys":158,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"54'6","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.437960+0000","last_change":"2023-12-16T00:01:08.173655+0000","last_active":"2023-12-16T00:02:25.437960+0000","last_peered":"2023-12-16T00:02:25.437960+0000","last_clean":"2023-12-16T00:02:25.437960+0000","last_became_active":"2023-12-15T22:53:26.158534+0000","last_became_peered":"2023-12-15T22:53:26.158534+0000","last_unstale":"2023-12-16T00:02:25.437960+0000","last_undegraded":"2023-12-16T00:02:25.437960+0000","last_fullsized":"2023-12-16T00:02:25.437960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:08.173571+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.173571+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:43.334979+0000","scrub_duration":0.0031695640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":149,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:02.272787+0000","last_change":"2023-12-16T00:04:02.272787+0000","last_active":"2023-12-16T00:04:02.272787+0000","last_peered":"2023-12-16T00:04:02.272787+0000","last_clean":"2023-12-16T00:04:02.272787+0000","last_became_active":"2023-12-15T22:52:55.184935+0000","last_became_peered":"2023-12-15T22:52:55.184935+0000","last_unstale":"2023-12-16T00:04:02.272787+0000","last_undegraded":"2023-12-16T00:04:02.272787+0000","last_fullsized":"2023-12-16T00:04:02.272787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:02.272686+0000","last_clean_scrub_stamp":"2023-12-16T00:04:02.272686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:18.235296+0000","scrub_duration":0.00092377500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.775800+0000","last_change":"2023-12-16T00:04:20.775800+0000","last_active":"2023-12-16T00:04:20.775800+0000","last_peered":"2023-12-16T00:04:20.775800+0000","last_clean":"2023-12-16T00:04:20.775800+0000","last_became_active":"2023-12-15T22:52:53.174050+0000","last_became_peered":"2023-12-15T22:52:53.174050+0000","last_unstale":"2023-12-16T00:04:20.775800+0000","last_undegraded":"2023-12-16T00:04:20.775800+0000","last_fullsized":"2023-12-16T00:04:20.775800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.775724+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.775724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:05:36.738334+0000","scrub_duration":0.00087610900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:42.076798+0000","last_change":"2023-12-16T00:03:42.076798+0000","last_active":"2023-12-16T00:03:42.076798+0000","last_peered":"2023-12-16T00:03:42.076798+0000","last_clean":"2023-12-16T00:03:42.076798+0000","last_became_active":"2023-12-15T22:53:04.314867+0000","last_became_peered":"2023-12-15T22:53:04.314867+0000","last_unstale":"2023-12-16T00:03:42.076798+0000","last_undegraded":"2023-12-16T00:03:42.076798+0000","last_fullsized":"2023-12-16T00:03:42.076798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:03:42.076689+0000","last_clean_scrub_stamp":"2023-12-16T00:03:42.076689+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:57.373234+0000","scrub_duration":0.0028837759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"54'127","reported_seq":270,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.214842+0000","last_change":"2023-12-16T00:03:06.214842+0000","last_active":"2023-12-16T00:03:06.214842+0000","last_peered":"2023-12-16T00:03:06.214842+0000","last_clean":"2023-12-16T00:03:06.214842+0000","last_became_active":"2023-12-15T22:53:06.321371+0000","last_became_peered":"2023-12-15T22:53:06.321371+0000","last_unstale":"2023-12-16T00:03:06.214842+0000","last_undegraded":"2023-12-16T00:03:06.214842+0000","last_fullsized":"2023-12-16T00:03:06.214842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:06.214739+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.214739+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:41.606653+0000","scrub_duration":0.0057288779999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.661995+0000","last_change":"2023-12-16T00:01:23.999349+0000","last_active":"2023-12-16T00:02:55.661995+0000","last_peered":"2023-12-16T00:02:55.661995+0000","last_clean":"2023-12-16T00:02:55.661995+0000","last_became_active":"2023-12-15T22:53:08.334836+0000","last_became_peered":"2023-12-15T22:53:08.334836+0000","last_unstale":"2023-12-16T00:02:55.661995+0000","last_undegraded":"2023-12-16T00:02:55.661995+0000","last_fullsized":"2023-12-16T00:02:55.661995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.999263+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.999263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:41.218099+0000","scrub_duration":0.001285923,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430630+0000","last_change":"2023-12-16T00:01:45.858072+0000","last_active":"2023-12-16T00:01:55.430630+0000","last_peered":"2023-12-16T00:01:55.430630+0000","last_clean":"2023-12-16T00:01:55.430630+0000","last_became_active":"2023-12-15T22:53:10.340651+0000","last_became_peered":"2023-12-15T22:53:10.340651+0000","last_unstale":"2023-12-16T00:01:55.430630+0000","last_undegraded":"2023-12-16T00:01:55.430630+0000","last_fullsized":"2023-12-16T00:01:55.430630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:45.857983+0000","last_clean_scrub_stamp":"2023-12-16T00:01:45.857983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:08.428106+0000","scrub_duration":0.00087345599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.427782+0000","last_change":"2023-12-16T00:02:25.600943+0000","last_active":"2023-12-16T00:02:50.427782+0000","last_peered":"2023-12-16T00:02:50.427782+0000","last_clean":"2023-12-16T00:02:50.427782+0000","last_became_active":"2023-12-15T23:08:37.340624+0000","last_became_peered":"2023-12-15T23:08:37.340624+0000","last_unstale":"2023-12-16T00:02:50.427782+0000","last_undegraded":"2023-12-16T00:02:50.427782+0000","last_fullsized":"2023-12-16T00:02:50.427782+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:25.600830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.600830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:25.620978+0000","scrub_duration":0.0012871200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"54'133","reported_seq":4025,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.182330+0000","last_change":"2023-12-16T00:02:58.182330+0000","last_active":"2023-12-16T00:02:58.182330+0000","last_peered":"2023-12-16T00:02:58.182330+0000","last_clean":"2023-12-16T00:02:58.182330+0000","last_became_active":"2023-12-15T22:54:04.188509+0000","last_became_peered":"2023-12-15T22:54:04.188509+0000","last_unstale":"2023-12-16T00:02:58.182330+0000","last_undegraded":"2023-12-16T00:02:58.182330+0000","last_fullsized":"2023-12-16T00:02:58.182330+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'133","last_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_deep_scrub":"54'133","last_deep_scrub_stamp":"2023-12-16T00:02:58.182227+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.182227+0000","objects_scrubbed":36,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.576901+0000","scrub_duration":0.022198616000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5016,"num_read_kb":4994,"num_write":134,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8067,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436097+0000","last_change":"2023-12-16T00:01:54.382834+0000","last_active":"2023-12-16T00:02:15.436097+0000","last_peered":"2023-12-16T00:02:15.436097+0000","last_clean":"2023-12-16T00:02:15.436097+0000","last_became_active":"2023-12-15T22:53:58.168821+0000","last_became_peered":"2023-12-15T22:53:58.168821+0000","last_unstale":"2023-12-16T00:02:15.436097+0000","last_undegraded":"2023-12-16T00:02:15.436097+0000","last_fullsized":"2023-12-16T00:02:15.436097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:54.382756+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.382756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:13.597833+0000","scrub_duration":0.00086735399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"54'10","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437602+0000","last_change":"2023-12-16T00:02:12.445908+0000","last_active":"2023-12-16T00:02:20.437602+0000","last_peered":"2023-12-16T00:02:20.437602+0000","last_clean":"2023-12-16T00:02:20.437602+0000","last_became_active":"2023-12-15T22:53:32.194331+0000","last_became_peered":"2023-12-15T22:53:32.194331+0000","last_unstale":"2023-12-16T00:02:20.437602+0000","last_undegraded":"2023-12-16T00:02:20.437602+0000","last_fullsized":"2023-12-16T00:02:20.437602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:12.445813+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.445813+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:46:08.016708+0000","scrub_duration":0.004045005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":59,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.445115+0000","last_change":"2023-12-16T00:01:32.175698+0000","last_active":"2023-12-16T00:02:50.445115+0000","last_peered":"2023-12-16T00:02:50.445115+0000","last_clean":"2023-12-16T00:02:50.445115+0000","last_became_active":"2023-12-15T22:53:30.175039+0000","last_became_peered":"2023-12-15T22:53:30.175039+0000","last_unstale":"2023-12-16T00:02:50.445115+0000","last_undegraded":"2023-12-16T00:02:50.445115+0000","last_fullsized":"2023-12-16T00:02:50.445115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:32.175622+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.175622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:54.745745+0000","scrub_duration":0.00092006499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'800","reported_seq":2434,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.446247+0000","last_change":"2023-12-16T00:00:45.989777+0000","last_active":"2023-12-16T00:02:50.446247+0000","last_peered":"2023-12-16T00:02:50.446247+0000","last_clean":"2023-12-16T00:02:50.446247+0000","last_became_active":"2023-12-15T22:53:28.168103+0000","last_became_peered":"2023-12-15T22:53:28.168103+0000","last_unstale":"2023-12-16T00:02:50.446247+0000","last_undegraded":"2023-12-16T00:02:50.446247+0000","last_fullsized":"2023-12-16T00:02:50.446247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'800","last_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_deep_scrub":"54'800","last_deep_scrub_stamp":"2023-12-16T00:00:45.989660+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.989660+0000","objects_scrubbed":23,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:14.046467+0000","scrub_duration":0.015067199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2308,"num_read_kb":2334,"num_write":1374,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121212,"num_omap_keys":591,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"54'7","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650855+0000","last_change":"2023-12-16T00:00:31.867764+0000","last_active":"2023-12-16T00:02:10.650855+0000","last_peered":"2023-12-16T00:02:10.650855+0000","last_clean":"2023-12-16T00:02:10.650855+0000","last_became_active":"2023-12-15T22:53:26.160385+0000","last_became_peered":"2023-12-15T22:53:26.160385+0000","last_unstale":"2023-12-16T00:02:10.650855+0000","last_undegraded":"2023-12-16T00:02:10.650855+0000","last_fullsized":"2023-12-16T00:02:10.650855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'7","last_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_deep_scrub":"54'7","last_deep_scrub_stamp":"2023-12-16T00:00:31.867643+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.867643+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:35:09.571435+0000","scrub_duration":0.0041098580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":39,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:30.575247+0000","last_change":"2023-12-16T00:03:30.575247+0000","last_active":"2023-12-16T00:03:30.575247+0000","last_peered":"2023-12-16T00:03:30.575247+0000","last_clean":"2023-12-16T00:03:30.575247+0000","last_became_active":"2023-12-15T22:52:55.189195+0000","last_became_peered":"2023-12-15T22:52:55.189195+0000","last_unstale":"2023-12-16T00:03:30.575247+0000","last_undegraded":"2023-12-16T00:03:30.575247+0000","last_fullsized":"2023-12-16T00:03:30.575247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:30.575159+0000","last_clean_scrub_stamp":"2023-12-16T00:03:30.575159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:18:25.134885+0000","scrub_duration":0.001488643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.737657+0000","last_change":"2023-12-16T00:04:26.737657+0000","last_active":"2023-12-16T00:04:26.737657+0000","last_peered":"2023-12-16T00:04:26.737657+0000","last_clean":"2023-12-16T00:04:26.737657+0000","last_became_active":"2023-12-15T22:52:53.173613+0000","last_became_peered":"2023-12-15T22:52:53.173613+0000","last_unstale":"2023-12-16T00:04:26.737657+0000","last_undegraded":"2023-12-16T00:04:26.737657+0000","last_fullsized":"2023-12-16T00:04:26.737657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:26.737548+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.737548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:13.351966+0000","scrub_duration":0.00090241200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"54'5","reported_seq":295,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.470629+0000","last_change":"2023-12-16T00:02:55.470629+0000","last_active":"2023-12-16T00:02:55.470629+0000","last_peered":"2023-12-16T00:02:55.470629+0000","last_clean":"2023-12-16T00:02:55.470629+0000","last_became_active":"2023-12-15T22:53:04.316028+0000","last_became_peered":"2023-12-15T22:53:04.316028+0000","last_unstale":"2023-12-16T00:02:55.470629+0000","last_undegraded":"2023-12-16T00:02:55.470629+0000","last_fullsized":"2023-12-16T00:02:55.470629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:02:55.470492+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.470492+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:38.492343+0000","scrub_duration":0.0027243200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":431,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"54'52","reported_seq":159,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.661982+0000","last_change":"2023-12-16T00:02:18.137072+0000","last_active":"2023-12-16T00:02:55.661982+0000","last_peered":"2023-12-16T00:02:55.661982+0000","last_clean":"2023-12-16T00:02:55.661982+0000","last_became_active":"2023-12-15T22:53:06.321190+0000","last_became_peered":"2023-12-15T22:53:06.321190+0000","last_unstale":"2023-12-16T00:02:55.661982+0000","last_undegraded":"2023-12-16T00:02:55.661982+0000","last_fullsized":"2023-12-16T00:02:55.661982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:18.136979+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.136979+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:32.165374+0000","scrub_duration":0.003623551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.426501+0000","last_change":"2023-12-16T00:02:08.679499+0000","last_active":"2023-12-16T00:02:45.426501+0000","last_peered":"2023-12-16T00:02:45.426501+0000","last_clean":"2023-12-16T00:02:45.426501+0000","last_became_active":"2023-12-15T22:53:08.335929+0000","last_became_peered":"2023-12-15T22:53:08.335929+0000","last_unstale":"2023-12-16T00:02:45.426501+0000","last_undegraded":"2023-12-16T00:02:45.426501+0000","last_fullsized":"2023-12-16T00:02:45.426501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.679433+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.679433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:42:13.942387+0000","scrub_duration":0.00095943199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:11.420710+0000","last_change":"2023-12-16T00:01:55.739311+0000","last_active":"2023-12-16T00:02:11.420710+0000","last_peered":"2023-12-16T00:02:11.420710+0000","last_clean":"2023-12-16T00:02:11.420710+0000","last_became_active":"2023-12-15T22:53:10.339456+0000","last_became_peered":"2023-12-15T22:53:10.339456+0000","last_unstale":"2023-12-16T00:02:11.420710+0000","last_undegraded":"2023-12-16T00:02:11.420710+0000","last_fullsized":"2023-12-16T00:02:11.420710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:55.739229+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.739229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:18.309353+0000","scrub_duration":0.0011974959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:55.174888+0000","last_change":"2023-12-16T00:04:55.174888+0000","last_active":"2023-12-16T00:04:55.174888+0000","last_peered":"2023-12-16T00:04:55.174888+0000","last_clean":"2023-12-16T00:04:55.174888+0000","last_became_active":"2023-12-15T23:08:37.332395+0000","last_became_peered":"2023-12-15T23:08:37.332395+0000","last_unstale":"2023-12-16T00:04:55.174888+0000","last_undegraded":"2023-12-16T00:04:55.174888+0000","last_fullsized":"2023-12-16T00:04:55.174888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:55.174802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:55.174802+0000","last_clean_scrub_stamp":"2023-12-16T00:04:55.174802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:19:05.038004+0000","scrub_duration":0.00114591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"54'136","reported_seq":1700,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.420411+0000","last_change":"2023-12-16T00:01:56.639401+0000","last_active":"2023-12-16T00:02:20.420411+0000","last_peered":"2023-12-16T00:02:20.420411+0000","last_clean":"2023-12-16T00:02:20.420411+0000","last_became_active":"2023-12-15T22:55:02.193167+0000","last_became_peered":"2023-12-15T22:55:02.193167+0000","last_unstale":"2023-12-16T00:02:20.420411+0000","last_undegraded":"2023-12-16T00:02:20.420411+0000","last_fullsized":"2023-12-16T00:02:20.420411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'136","last_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_deep_scrub":"54'136","last_deep_scrub_stamp":"2023-12-16T00:01:56.639310+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.639310+0000","objects_scrubbed":38,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:17.568119+0000","scrub_duration":0.018719942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2572,"num_read_kb":2530,"num_write":143,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11215,"num_omap_keys":42,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443263+0000","last_change":"2023-12-16T00:02:01.115840+0000","last_active":"2023-12-16T00:02:45.443263+0000","last_peered":"2023-12-16T00:02:45.443263+0000","last_clean":"2023-12-16T00:02:45.443263+0000","last_became_active":"2023-12-15T22:53:58.161867+0000","last_became_peered":"2023-12-15T22:53:58.161867+0000","last_unstale":"2023-12-16T00:02:45.443263+0000","last_undegraded":"2023-12-16T00:02:45.443263+0000","last_fullsized":"2023-12-16T00:02:45.443263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:01.115734+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.115734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:05.353705+0000","scrub_duration":0.0011368699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"54'12","reported_seq":104,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.437806+0000","last_change":"2023-12-16T00:02:14.514652+0000","last_active":"2023-12-16T00:02:20.437806+0000","last_peered":"2023-12-16T00:02:20.437806+0000","last_clean":"2023-12-16T00:02:20.437806+0000","last_became_active":"2023-12-15T22:53:32.195085+0000","last_became_peered":"2023-12-15T22:53:32.195085+0000","last_unstale":"2023-12-16T00:02:20.437806+0000","last_undegraded":"2023-12-16T00:02:20.437806+0000","last_fullsized":"2023-12-16T00:02:20.437806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:14.514515+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.514515+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:08.869849+0000","scrub_duration":0.0047966040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.425961+0000","last_change":"2023-12-16T00:00:59.725079+0000","last_active":"2023-12-16T00:02:31.425961+0000","last_peered":"2023-12-16T00:02:31.425961+0000","last_clean":"2023-12-16T00:02:31.425961+0000","last_became_active":"2023-12-15T22:53:30.176172+0000","last_became_peered":"2023-12-15T22:53:30.176172+0000","last_unstale":"2023-12-16T00:02:31.425961+0000","last_undegraded":"2023-12-16T00:02:31.425961+0000","last_fullsized":"2023-12-16T00:02:31.425961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:59.724983+0000","last_clean_scrub_stamp":"2023-12-16T00:00:59.724983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:52:24.984825+0000","scrub_duration":0.00092534799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"54'801","reported_seq":2123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435325+0000","last_change":"2023-12-16T00:01:18.155939+0000","last_active":"2023-12-16T00:02:15.435325+0000","last_peered":"2023-12-16T00:02:15.435325+0000","last_clean":"2023-12-16T00:02:15.435325+0000","last_became_active":"2023-12-15T22:53:28.169482+0000","last_became_peered":"2023-12-15T22:53:28.169482+0000","last_unstale":"2023-12-16T00:02:15.435325+0000","last_undegraded":"2023-12-16T00:02:15.435325+0000","last_fullsized":"2023-12-16T00:02:15.435325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'801","last_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_deep_scrub":"54'801","last_deep_scrub_stamp":"2023-12-16T00:01:18.155813+0000","last_clean_scrub_stamp":"2023-12-16T00:01:18.155813+0000","objects_scrubbed":25,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:04.836847+0000","scrub_duration":0.017691174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1164,"num_read_kb":1147,"num_write":509,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17377,"num_omap_keys":77,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'10","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.444145+0000","last_change":"2023-12-16T00:00:52.867712+0000","last_active":"2023-12-16T00:02:45.444145+0000","last_peered":"2023-12-16T00:02:45.444145+0000","last_clean":"2023-12-16T00:02:45.444145+0000","last_became_active":"2023-12-15T22:53:26.163076+0000","last_became_peered":"2023-12-15T22:53:26.163076+0000","last_unstale":"2023-12-16T00:02:45.444145+0000","last_undegraded":"2023-12-16T00:02:45.444145+0000","last_fullsized":"2023-12-16T00:02:45.444145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:52.867591+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.867591+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:37:38.877718+0000","scrub_duration":0.0042081030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":367,"num_write":50,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.935882+0000","last_change":"2023-12-16T00:03:47.935882+0000","last_active":"2023-12-16T00:03:47.935882+0000","last_peered":"2023-12-16T00:03:47.935882+0000","last_clean":"2023-12-16T00:03:47.935882+0000","last_became_active":"2023-12-15T22:52:55.187655+0000","last_became_peered":"2023-12-15T22:52:55.187655+0000","last_unstale":"2023-12-16T00:03:47.935882+0000","last_undegraded":"2023-12-16T00:03:47.935882+0000","last_fullsized":"2023-12-16T00:03:47.935882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.935771+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.935771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:56.317416+0000","scrub_duration":0.0010477100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.226874+0000","last_change":"2023-12-16T00:04:09.226874+0000","last_active":"2023-12-16T00:04:09.226874+0000","last_peered":"2023-12-16T00:04:09.226874+0000","last_clean":"2023-12-16T00:04:09.226874+0000","last_became_active":"2023-12-15T22:52:53.171664+0000","last_became_peered":"2023-12-15T22:52:53.171664+0000","last_unstale":"2023-12-16T00:04:09.226874+0000","last_undegraded":"2023-12-16T00:04:09.226874+0000","last_fullsized":"2023-12-16T00:04:09.226874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.226768+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.226768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:44.325950+0000","scrub_duration":0.0012146679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'16","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.427864+0000","last_change":"2023-12-16T00:02:31.611838+0000","last_active":"2023-12-16T00:02:50.427864+0000","last_peered":"2023-12-16T00:02:50.427864+0000","last_clean":"2023-12-16T00:02:50.427864+0000","last_became_active":"2023-12-15T22:53:04.318554+0000","last_became_peered":"2023-12-15T22:53:04.318554+0000","last_unstale":"2023-12-16T00:02:50.427864+0000","last_undegraded":"2023-12-16T00:02:50.427864+0000","last_fullsized":"2023-12-16T00:02:50.427864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:31.611747+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.611747+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:52:07.391156+0000","scrub_duration":0.0021789999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"54'95","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.355553+0000","last_change":"2023-12-16T00:02:46.355553+0000","last_active":"2023-12-16T00:02:46.355553+0000","last_peered":"2023-12-16T00:02:46.355553+0000","last_clean":"2023-12-16T00:02:46.355553+0000","last_became_active":"2023-12-15T22:53:06.319443+0000","last_became_peered":"2023-12-15T22:53:06.319443+0000","last_unstale":"2023-12-16T00:02:46.355553+0000","last_undegraded":"2023-12-16T00:02:46.355553+0000","last_fullsized":"2023-12-16T00:02:46.355553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'95","last_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_deep_scrub":"54'95","last_deep_scrub_stamp":"2023-12-16T00:02:46.355451+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.355451+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:57.592381+0000","scrub_duration":0.0045946049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":86,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"54'13","reported_seq":810,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.112436+0000","last_change":"2023-12-16T00:02:45.112436+0000","last_active":"2023-12-16T00:02:45.112436+0000","last_peered":"2023-12-16T00:02:45.112436+0000","last_clean":"2023-12-16T00:02:45.112436+0000","last_became_active":"2023-12-15T22:53:08.332767+0000","last_became_peered":"2023-12-15T22:53:08.332767+0000","last_unstale":"2023-12-16T00:02:45.112436+0000","last_undegraded":"2023-12-16T00:02:45.112436+0000","last_fullsized":"2023-12-16T00:02:45.112436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:45.112313+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.112313+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:20:56.349244+0000","scrub_duration":0.0021891039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439376+0000","last_change":"2023-12-16T00:01:31.219666+0000","last_active":"2023-12-16T00:02:30.439376+0000","last_peered":"2023-12-16T00:02:30.439376+0000","last_clean":"2023-12-16T00:02:30.439376+0000","last_became_active":"2023-12-15T22:53:10.340108+0000","last_became_peered":"2023-12-15T22:53:10.340108+0000","last_unstale":"2023-12-16T00:02:30.439376+0000","last_undegraded":"2023-12-16T00:02:30.439376+0000","last_fullsized":"2023-12-16T00:02:30.439376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.219587+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.219587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:55:59.435029+0000","scrub_duration":0.001208549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.258778+0000","last_change":"2023-12-16T00:04:05.258778+0000","last_active":"2023-12-16T00:04:05.258778+0000","last_peered":"2023-12-16T00:04:05.258778+0000","last_clean":"2023-12-16T00:04:05.258778+0000","last_became_active":"2023-12-15T23:08:37.340974+0000","last_became_peered":"2023-12-15T23:08:37.340974+0000","last_unstale":"2023-12-16T00:04:05.258778+0000","last_undegraded":"2023-12-16T00:04:05.258778+0000","last_fullsized":"2023-12-16T00:04:05.258778+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.258689+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.258689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:24:41.933338+0000","scrub_duration":0.0011204909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"54'128","reported_seq":1268,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.660569+0000","last_change":"2023-12-16T00:02:32.402095+0000","last_active":"2023-12-16T00:02:50.660569+0000","last_peered":"2023-12-16T00:02:50.660569+0000","last_clean":"2023-12-16T00:02:50.660569+0000","last_became_active":"2023-12-15T22:54:04.185052+0000","last_became_peered":"2023-12-15T22:54:04.185052+0000","last_unstale":"2023-12-16T00:02:50.660569+0000","last_undegraded":"2023-12-16T00:02:50.660569+0000","last_fullsized":"2023-12-16T00:02:50.660569+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'128","last_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_deep_scrub":"54'128","last_deep_scrub_stamp":"2023-12-16T00:02:32.401998+0000","last_clean_scrub_stamp":"2023-12-16T00:02:32.401998+0000","objects_scrubbed":31,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:37.644592+0000","scrub_duration":0.017425927000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1862,"num_read_kb":1835,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9310,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443611+0000","last_change":"2023-12-16T00:02:00.125108+0000","last_active":"2023-12-16T00:02:45.443611+0000","last_peered":"2023-12-16T00:02:45.443611+0000","last_clean":"2023-12-16T00:02:45.443611+0000","last_became_active":"2023-12-15T22:53:58.167129+0000","last_became_peered":"2023-12-15T22:53:58.167129+0000","last_unstale":"2023-12-16T00:02:45.443611+0000","last_undegraded":"2023-12-16T00:02:45.443611+0000","last_fullsized":"2023-12-16T00:02:45.443611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.124994+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.124994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:45.590487+0000","scrub_duration":0.0013516439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"54'13","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.436446+0000","last_change":"2023-12-16T00:01:59.134546+0000","last_active":"2023-12-16T00:02:20.436446+0000","last_peered":"2023-12-16T00:02:20.436446+0000","last_clean":"2023-12-16T00:02:20.436446+0000","last_became_active":"2023-12-15T22:53:32.189036+0000","last_became_peered":"2023-12-15T22:53:32.189036+0000","last_unstale":"2023-12-16T00:02:20.436446+0000","last_undegraded":"2023-12-16T00:02:20.436446+0000","last_fullsized":"2023-12-16T00:02:20.436446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:01:59.134463+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.134463+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:39.067121+0000","scrub_duration":0.0041210769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":86,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.435963+0000","last_change":"2023-12-16T00:01:28.699786+0000","last_active":"2023-12-16T00:02:15.435963+0000","last_peered":"2023-12-16T00:02:15.435963+0000","last_clean":"2023-12-16T00:02:15.435963+0000","last_became_active":"2023-12-15T22:53:30.183142+0000","last_became_peered":"2023-12-15T22:53:30.183142+0000","last_unstale":"2023-12-16T00:02:15.435963+0000","last_undegraded":"2023-12-16T00:02:15.435963+0000","last_fullsized":"2023-12-16T00:02:15.435963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.699677+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.699677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:43:15.380711+0000","scrub_duration":0.0010172390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"54'1679","reported_seq":2714,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.423106+0000","last_change":"2023-12-16T00:00:37.954006+0000","last_active":"2023-12-16T00:02:30.423106+0000","last_peered":"2023-12-16T00:02:30.423106+0000","last_clean":"2023-12-16T00:02:30.423106+0000","last_became_active":"2023-12-15T22:53:28.166740+0000","last_became_peered":"2023-12-15T22:53:28.166740+0000","last_unstale":"2023-12-16T00:02:30.423106+0000","last_undegraded":"2023-12-16T00:02:30.423106+0000","last_fullsized":"2023-12-16T00:02:30.423106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1679","last_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_deep_scrub":"54'1679","last_deep_scrub_stamp":"2023-12-16T00:00:37.953908+0000","last_clean_scrub_stamp":"2023-12-16T00:00:37.953908+0000","objects_scrubbed":27,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:46.212565+0000","scrub_duration":0.027289418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2785,"num_read_kb":2641,"num_write":554,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18118,"num_omap_keys":82,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'12","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.444087+0000","last_change":"2023-12-16T00:00:57.790135+0000","last_active":"2023-12-16T00:02:45.444087+0000","last_peered":"2023-12-16T00:02:45.444087+0000","last_clean":"2023-12-16T00:02:45.444087+0000","last_became_active":"2023-12-15T22:53:26.162828+0000","last_became_peered":"2023-12-15T22:53:26.162828+0000","last_unstale":"2023-12-16T00:02:45.444087+0000","last_undegraded":"2023-12-16T00:02:45.444087+0000","last_fullsized":"2023-12-16T00:02:45.444087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:57.790033+0000","last_clean_scrub_stamp":"2023-12-16T00:00:57.790033+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:14:06.803451+0000","scrub_duration":0.0040829949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":137,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.959722+0000","last_change":"2023-12-16T00:03:20.959722+0000","last_active":"2023-12-16T00:03:20.959722+0000","last_peered":"2023-12-16T00:03:20.959722+0000","last_clean":"2023-12-16T00:03:20.959722+0000","last_became_active":"2023-12-15T22:52:55.193445+0000","last_became_peered":"2023-12-15T22:52:55.193445+0000","last_unstale":"2023-12-16T00:03:20.959722+0000","last_undegraded":"2023-12-16T00:03:20.959722+0000","last_fullsized":"2023-12-16T00:03:20.959722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.959594+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.959594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:29.341240+0000","scrub_duration":0.00095062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.858771+0000","last_change":"2023-12-16T00:03:51.858771+0000","last_active":"2023-12-16T00:03:51.858771+0000","last_peered":"2023-12-16T00:03:51.858771+0000","last_clean":"2023-12-16T00:03:51.858771+0000","last_became_active":"2023-12-15T22:52:53.174678+0000","last_became_peered":"2023-12-15T22:52:53.174678+0000","last_unstale":"2023-12-16T00:03:51.858771+0000","last_undegraded":"2023-12-16T00:03:51.858771+0000","last_fullsized":"2023-12-16T00:03:51.858771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.858668+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.858668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:28.407183+0000","scrub_duration":0.001347146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.425026+0000","last_change":"2023-12-16T00:02:34.633664+0000","last_active":"2023-12-16T00:02:40.425026+0000","last_peered":"2023-12-16T00:02:40.425026+0000","last_clean":"2023-12-16T00:02:40.425026+0000","last_became_active":"2023-12-15T22:53:04.317030+0000","last_became_peered":"2023-12-15T22:53:04.317030+0000","last_unstale":"2023-12-16T00:02:40.425026+0000","last_undegraded":"2023-12-16T00:02:40.425026+0000","last_fullsized":"2023-12-16T00:02:40.425026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.633582+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.633582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:11:30.773081+0000","scrub_duration":0.00099069999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"54'59","reported_seq":175,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:59.137639+0000","last_change":"2023-12-16T00:02:59.137639+0000","last_active":"2023-12-16T00:02:59.137639+0000","last_peered":"2023-12-16T00:02:59.137639+0000","last_clean":"2023-12-16T00:02:59.137639+0000","last_became_active":"2023-12-15T22:53:06.321542+0000","last_became_peered":"2023-12-15T22:53:06.321542+0000","last_unstale":"2023-12-16T00:02:59.137639+0000","last_undegraded":"2023-12-16T00:02:59.137639+0000","last_fullsized":"2023-12-16T00:02:59.137639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:59.137522+0000","last_clean_scrub_stamp":"2023-12-16T00:02:59.137522+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:28:28.294790+0000","scrub_duration":0.0039482140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.422788+0000","last_change":"2023-12-16T00:02:21.608993+0000","last_active":"2023-12-16T00:02:30.422788+0000","last_peered":"2023-12-16T00:02:30.422788+0000","last_clean":"2023-12-16T00:02:30.422788+0000","last_became_active":"2023-12-15T22:53:08.332125+0000","last_became_peered":"2023-12-15T22:53:08.332125+0000","last_unstale":"2023-12-16T00:02:30.422788+0000","last_undegraded":"2023-12-16T00:02:30.422788+0000","last_fullsized":"2023-12-16T00:02:30.422788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.608906+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.608906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:49.824348+0000","scrub_duration":0.001164537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.656192+0000","last_change":"2023-12-16T00:00:48.750353+0000","last_active":"2023-12-16T00:02:30.656192+0000","last_peered":"2023-12-16T00:02:30.656192+0000","last_clean":"2023-12-16T00:02:30.656192+0000","last_became_active":"2023-12-15T22:53:10.340235+0000","last_became_peered":"2023-12-15T22:53:10.340235+0000","last_unstale":"2023-12-16T00:02:30.656192+0000","last_undegraded":"2023-12-16T00:02:30.656192+0000","last_fullsized":"2023-12-16T00:02:30.656192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:48.750287+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.750287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:27.388420+0000","scrub_duration":0.001064623,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.652410+0000","last_change":"2023-12-16T00:04:30.652410+0000","last_active":"2023-12-16T00:04:30.652410+0000","last_peered":"2023-12-16T00:04:30.652410+0000","last_clean":"2023-12-16T00:04:30.652410+0000","last_became_active":"2023-12-15T23:08:37.338323+0000","last_became_peered":"2023-12-15T23:08:37.338323+0000","last_unstale":"2023-12-16T00:04:30.652410+0000","last_undegraded":"2023-12-16T00:04:30.652410+0000","last_fullsized":"2023-12-16T00:04:30.652410+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:30.652300+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:16:38.233284+0000","scrub_duration":0.00097347899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"54'114","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.948145+0000","last_change":"2023-12-16T00:03:07.948145+0000","last_active":"2023-12-16T00:03:07.948145+0000","last_peered":"2023-12-16T00:03:07.948145+0000","last_clean":"2023-12-16T00:03:07.948145+0000","last_became_active":"2023-12-15T22:54:04.186866+0000","last_became_peered":"2023-12-15T22:54:04.186866+0000","last_unstale":"2023-12-16T00:03:07.948145+0000","last_undegraded":"2023-12-16T00:03:07.948145+0000","last_fullsized":"2023-12-16T00:03:07.948145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'114","last_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_deep_scrub":"54'114","last_deep_scrub_stamp":"2023-12-16T00:03:07.948016+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.948016+0000","objects_scrubbed":29,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:26.553084+0000","scrub_duration":0.016961200999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4265,"num_read_kb":4238,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7875,"num_omap_keys":30,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.433786+0000","last_change":"2023-12-16T00:01:28.745095+0000","last_active":"2023-12-16T00:03:01.433786+0000","last_peered":"2023-12-16T00:03:01.433786+0000","last_clean":"2023-12-16T00:03:01.433786+0000","last_became_active":"2023-12-15T22:53:58.172133+0000","last_became_peered":"2023-12-15T22:53:58.172133+0000","last_unstale":"2023-12-16T00:03:01.433786+0000","last_undegraded":"2023-12-16T00:03:01.433786+0000","last_fullsized":"2023-12-16T00:03:01.433786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.745008+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.745008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:46.745624+0000","scrub_duration":0.0010819930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"54'18","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:27.334221+0000","last_change":"2023-12-16T00:02:27.334221+0000","last_active":"2023-12-16T00:02:27.334221+0000","last_peered":"2023-12-16T00:02:27.334221+0000","last_clean":"2023-12-16T00:02:27.334221+0000","last_became_active":"2023-12-15T22:53:32.194245+0000","last_became_peered":"2023-12-15T22:53:32.194245+0000","last_unstale":"2023-12-16T00:02:27.334221+0000","last_undegraded":"2023-12-16T00:02:27.334221+0000","last_fullsized":"2023-12-16T00:02:27.334221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:02:27.334128+0000","last_clean_scrub_stamp":"2023-12-16T00:02:27.334128+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:28:21.806785+0000","scrub_duration":0.0030756669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":149,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"54'577","reported_seq":1514,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436505+0000","last_change":"2023-12-16T00:01:34.231162+0000","last_active":"2023-12-16T00:02:15.436505+0000","last_peered":"2023-12-16T00:02:15.436505+0000","last_clean":"2023-12-16T00:02:15.436505+0000","last_became_active":"2023-12-15T22:53:30.179043+0000","last_became_peered":"2023-12-15T22:53:30.179043+0000","last_unstale":"2023-12-16T00:02:15.436505+0000","last_undegraded":"2023-12-16T00:02:15.436505+0000","last_fullsized":"2023-12-16T00:02:15.436505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.231081+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.231081+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:21:29.623193+0000","scrub_duration":0.0022115590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"54'528","reported_seq":1169,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.652072+0000","last_change":"2023-12-16T00:01:22.015601+0000","last_active":"2023-12-16T00:02:15.652072+0000","last_peered":"2023-12-16T00:02:15.652072+0000","last_clean":"2023-12-16T00:02:15.652072+0000","last_became_active":"2023-12-15T22:53:28.166079+0000","last_became_peered":"2023-12-15T22:53:28.166079+0000","last_unstale":"2023-12-16T00:02:15.652072+0000","last_undegraded":"2023-12-16T00:02:15.652072+0000","last_fullsized":"2023-12-16T00:02:15.652072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'528","last_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_deep_scrub":"54'528","last_deep_scrub_stamp":"2023-12-16T00:01:22.015476+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.015476+0000","objects_scrubbed":15,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:02.354097+0000","scrub_duration":0.0095737700000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28423,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1715,"num_read_kb":1528,"num_write":890,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35231,"num_omap_keys":156,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"54'8","reported_seq":129,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433677+0000","last_change":"2023-12-16T00:00:26.233361+0000","last_active":"2023-12-16T00:02:10.433677+0000","last_peered":"2023-12-16T00:02:10.433677+0000","last_clean":"2023-12-16T00:02:10.433677+0000","last_became_active":"2023-12-15T22:53:26.164815+0000","last_became_peered":"2023-12-15T22:53:26.164815+0000","last_unstale":"2023-12-16T00:02:10.433677+0000","last_undegraded":"2023-12-16T00:02:10.433677+0000","last_fullsized":"2023-12-16T00:02:10.433677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:26.233275+0000","last_clean_scrub_stamp":"2023-12-16T00:00:26.233275+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:30:59.284713+0000","scrub_duration":0.0055774839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":43,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.715381+0000","last_change":"2023-12-16T00:03:55.715381+0000","last_active":"2023-12-16T00:03:55.715381+0000","last_peered":"2023-12-16T00:03:55.715381+0000","last_clean":"2023-12-16T00:03:55.715381+0000","last_became_active":"2023-12-15T22:52:55.189705+0000","last_became_peered":"2023-12-15T22:52:55.189705+0000","last_unstale":"2023-12-16T00:03:55.715381+0000","last_undegraded":"2023-12-16T00:03:55.715381+0000","last_fullsized":"2023-12-16T00:03:55.715381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.715267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.715267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.096913+0000","scrub_duration":0.001072323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.605541+0000","last_change":"2023-12-16T00:04:19.605541+0000","last_active":"2023-12-16T00:04:19.605541+0000","last_peered":"2023-12-16T00:04:19.605541+0000","last_clean":"2023-12-16T00:04:19.605541+0000","last_became_active":"2023-12-15T22:52:53.170774+0000","last_became_peered":"2023-12-15T22:52:53.170774+0000","last_unstale":"2023-12-16T00:04:19.605541+0000","last_undegraded":"2023-12-16T00:04:19.605541+0000","last_fullsized":"2023-12-16T00:04:19.605541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.605462+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.605462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:55.243778+0000","scrub_duration":0.00083103500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":212,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.355555+0000","last_change":"2023-12-16T00:03:09.355555+0000","last_active":"2023-12-16T00:03:09.355555+0000","last_peered":"2023-12-16T00:03:09.355555+0000","last_clean":"2023-12-16T00:03:09.355555+0000","last_became_active":"2023-12-15T22:53:04.314885+0000","last_became_peered":"2023-12-15T22:53:04.314885+0000","last_unstale":"2023-12-16T00:03:09.355555+0000","last_undegraded":"2023-12-16T00:03:09.355555+0000","last_fullsized":"2023-12-16T00:03:09.355555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:09.355440+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.355440+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:24.766122+0000","scrub_duration":0.0030080770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":130,"num_read_kb":260,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"54'66","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.431166+0000","last_change":"2023-12-16T00:02:50.570322+0000","last_active":"2023-12-16T00:02:51.431166+0000","last_peered":"2023-12-16T00:02:51.431166+0000","last_clean":"2023-12-16T00:02:51.431166+0000","last_became_active":"2023-12-15T22:53:06.320683+0000","last_became_peered":"2023-12-15T22:53:06.320683+0000","last_unstale":"2023-12-16T00:02:51.431166+0000","last_undegraded":"2023-12-16T00:02:51.431166+0000","last_fullsized":"2023-12-16T00:02:51.431166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:50.570242+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.570242+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:16.961786+0000","scrub_duration":0.0035892979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.251681+0000","last_change":"2023-12-16T00:02:37.251681+0000","last_active":"2023-12-16T00:02:37.251681+0000","last_peered":"2023-12-16T00:02:37.251681+0000","last_clean":"2023-12-16T00:02:37.251681+0000","last_became_active":"2023-12-15T22:53:08.334262+0000","last_became_peered":"2023-12-15T22:53:08.334262+0000","last_unstale":"2023-12-16T00:02:37.251681+0000","last_undegraded":"2023-12-16T00:02:37.251681+0000","last_fullsized":"2023-12-16T00:02:37.251681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.251594+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.251594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:15.021042+0000","scrub_duration":0.0010270889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638481+0000","last_change":"2023-12-16T00:01:04.831218+0000","last_active":"2023-12-16T00:01:20.638481+0000","last_peered":"2023-12-16T00:01:20.638481+0000","last_clean":"2023-12-16T00:01:20.638481+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:20.638481+0000","last_undegraded":"2023-12-16T00:01:20.638481+0000","last_fullsized":"2023-12-16T00:01:20.638481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:04.831135+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.831135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:05:29.798911+0000","scrub_duration":0.001392564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:48.212743+0000","last_change":"2023-12-16T00:04:48.212743+0000","last_active":"2023-12-16T00:04:48.212743+0000","last_peered":"2023-12-16T00:04:48.212743+0000","last_clean":"2023-12-16T00:04:48.212743+0000","last_became_active":"2023-12-15T23:08:37.343589+0000","last_became_peered":"2023-12-15T23:08:37.343589+0000","last_unstale":"2023-12-16T00:04:48.212743+0000","last_undegraded":"2023-12-16T00:04:48.212743+0000","last_fullsized":"2023-12-16T00:04:48.212743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:48.212664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:48.212664+0000","last_clean_scrub_stamp":"2023-12-16T00:04:48.212664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:05:25.007001+0000","scrub_duration":0.0012711459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"54'115","reported_seq":925,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.070326+0000","last_change":"2023-12-16T00:03:41.070353+0000","last_active":"2023-12-16T00:03:41.070326+0000","last_peered":"2023-12-16T00:03:41.070326+0000","last_clean":"2023-12-16T00:03:41.070326+0000","last_became_active":"2023-12-15T22:54:04.178128+0000","last_became_peered":"2023-12-15T22:54:04.178128+0000","last_unstale":"2023-12-16T00:03:41.070326+0000","last_undegraded":"2023-12-16T00:03:41.070326+0000","last_fullsized":"2023-12-16T00:03:41.070326+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'115","last_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_deep_scrub":"54'115","last_deep_scrub_stamp":"2023-12-16T00:03:41.070267+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.070267+0000","objects_scrubbed":29,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.536401+0000","scrub_duration":0.016426911999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1379,"num_read_kb":1343,"num_write":136,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8416,"num_omap_keys":33,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443777+0000","last_change":"2023-12-16T00:02:05.158907+0000","last_active":"2023-12-16T00:02:45.443777+0000","last_peered":"2023-12-16T00:02:45.443777+0000","last_clean":"2023-12-16T00:02:45.443777+0000","last_became_active":"2023-12-15T22:53:58.167059+0000","last_became_peered":"2023-12-15T22:53:58.167059+0000","last_unstale":"2023-12-16T00:02:45.443777+0000","last_undegraded":"2023-12-16T00:02:45.443777+0000","last_fullsized":"2023-12-16T00:02:45.443777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:05.158830+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.158830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:24.373908+0000","scrub_duration":0.001144092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"54'12","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:35.442067+0000","last_change":"2023-12-16T00:02:05.476828+0000","last_active":"2023-12-16T00:02:35.442067+0000","last_peered":"2023-12-16T00:02:35.442067+0000","last_clean":"2023-12-16T00:02:35.442067+0000","last_became_active":"2023-12-15T22:53:32.194464+0000","last_became_peered":"2023-12-15T22:53:32.194464+0000","last_unstale":"2023-12-16T00:02:35.442067+0000","last_undegraded":"2023-12-16T00:02:35.442067+0000","last_fullsized":"2023-12-16T00:02:35.442067+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:05.476711+0000","last_clean_scrub_stamp":"2023-12-16T00:02:05.476711+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.093715+0000","scrub_duration":0.0042794299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":70,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419368+0000","last_change":"2023-12-16T00:01:05.875715+0000","last_active":"2023-12-16T00:02:15.419368+0000","last_peered":"2023-12-16T00:02:15.419368+0000","last_clean":"2023-12-16T00:02:15.419368+0000","last_became_active":"2023-12-15T22:53:30.173679+0000","last_became_peered":"2023-12-15T22:53:30.173679+0000","last_unstale":"2023-12-16T00:02:15.419368+0000","last_undegraded":"2023-12-16T00:02:15.419368+0000","last_fullsized":"2023-12-16T00:02:15.419368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:05.875634+0000","last_clean_scrub_stamp":"2023-12-16T00:01:05.875634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:29.723501+0000","scrub_duration":0.0010073739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"54'462","reported_seq":866,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419458+0000","last_change":"2023-12-16T00:00:29.835807+0000","last_active":"2023-12-16T00:02:15.419458+0000","last_peered":"2023-12-16T00:02:15.419458+0000","last_clean":"2023-12-16T00:02:15.419458+0000","last_became_active":"2023-12-15T22:53:28.164846+0000","last_became_peered":"2023-12-15T22:53:28.164846+0000","last_unstale":"2023-12-16T00:02:15.419458+0000","last_undegraded":"2023-12-16T00:02:15.419458+0000","last_fullsized":"2023-12-16T00:02:15.419458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'462","last_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_deep_scrub":"54'462","last_deep_scrub_stamp":"2023-12-16T00:00:29.835715+0000","last_clean_scrub_stamp":"2023-12-16T00:00:29.835715+0000","objects_scrubbed":28,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:05:27.206034+0000","scrub_duration":0.016479112000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":782,"num_read_kb":760,"num_write":570,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17611,"num_omap_keys":78,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"54'14","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.642313+0000","last_change":"2023-12-16T00:00:33.867211+0000","last_active":"2023-12-16T00:01:35.642313+0000","last_peered":"2023-12-16T00:01:35.642313+0000","last_clean":"2023-12-16T00:01:35.642313+0000","last_became_active":"2023-12-15T22:53:26.156557+0000","last_became_peered":"2023-12-15T22:53:26.156557+0000","last_unstale":"2023-12-16T00:01:35.642313+0000","last_undegraded":"2023-12-16T00:01:35.642313+0000","last_fullsized":"2023-12-16T00:01:35.642313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:33.867129+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.867129+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:20:27.489041+0000","scrub_duration":0.003445296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":127,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.257453+0000","last_change":"2023-12-16T00:04:19.257453+0000","last_active":"2023-12-16T00:04:19.257453+0000","last_peered":"2023-12-16T00:04:19.257453+0000","last_clean":"2023-12-16T00:04:19.257453+0000","last_became_active":"2023-12-15T22:52:55.184998+0000","last_became_peered":"2023-12-15T22:52:55.184998+0000","last_unstale":"2023-12-16T00:04:19.257453+0000","last_undegraded":"2023-12-16T00:04:19.257453+0000","last_fullsized":"2023-12-16T00:04:19.257453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.257374+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.257374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:27:40.773145+0000","scrub_duration":0.00086390499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:38.161807+0000","last_change":"2023-12-16T00:04:38.161807+0000","last_active":"2023-12-16T00:04:38.161807+0000","last_peered":"2023-12-16T00:04:38.161807+0000","last_clean":"2023-12-16T00:04:38.161807+0000","last_became_active":"2023-12-15T22:52:53.172675+0000","last_became_peered":"2023-12-15T22:52:53.172675+0000","last_unstale":"2023-12-16T00:04:38.161807+0000","last_undegraded":"2023-12-16T00:04:38.161807+0000","last_fullsized":"2023-12-16T00:04:38.161807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:38.161724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:38.161724+0000","last_clean_scrub_stamp":"2023-12-16T00:04:38.161724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:09:03.042611+0000","scrub_duration":0.00096443199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"54'16","reported_seq":121,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.660958+0000","last_change":"2023-12-16T00:02:35.327933+0000","last_active":"2023-12-16T00:02:50.660958+0000","last_peered":"2023-12-16T00:02:50.660958+0000","last_clean":"2023-12-16T00:02:50.660958+0000","last_became_active":"2023-12-15T22:53:04.317481+0000","last_became_peered":"2023-12-15T22:53:04.317481+0000","last_unstale":"2023-12-16T00:02:50.660958+0000","last_undegraded":"2023-12-16T00:02:50.660958+0000","last_fullsized":"2023-12-16T00:02:50.660958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:02:35.327838+0000","last_clean_scrub_stamp":"2023-12-16T00:02:35.327838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:54:34.978027+0000","scrub_duration":0.0028981160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"54'97","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.580144+0000","last_change":"2023-12-16T00:02:28.580144+0000","last_active":"2023-12-16T00:02:28.580144+0000","last_peered":"2023-12-16T00:02:28.580144+0000","last_clean":"2023-12-16T00:02:28.580144+0000","last_became_active":"2023-12-15T22:53:06.319826+0000","last_became_peered":"2023-12-15T22:53:06.319826+0000","last_unstale":"2023-12-16T00:02:28.580144+0000","last_undegraded":"2023-12-16T00:02:28.580144+0000","last_fullsized":"2023-12-16T00:02:28.580144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:28.580047+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.580047+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:12:22.043812+0000","scrub_duration":0.0055190300000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.429270+0000","last_change":"2023-12-16T00:02:10.674611+0000","last_active":"2023-12-16T00:02:55.429270+0000","last_peered":"2023-12-16T00:02:55.429270+0000","last_clean":"2023-12-16T00:02:55.429270+0000","last_became_active":"2023-12-15T22:53:08.334778+0000","last_became_peered":"2023-12-15T22:53:08.334778+0000","last_unstale":"2023-12-16T00:02:55.429270+0000","last_undegraded":"2023-12-16T00:02:55.429270+0000","last_fullsized":"2023-12-16T00:02:55.429270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:10.674541+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.674541+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:16.306253+0000","scrub_duration":0.0028084609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647082+0000","last_change":"2023-12-16T00:01:08.873647+0000","last_active":"2023-12-16T00:01:55.647082+0000","last_peered":"2023-12-16T00:01:55.647082+0000","last_clean":"2023-12-16T00:01:55.647082+0000","last_became_active":"2023-12-15T22:53:10.333520+0000","last_became_peered":"2023-12-15T22:53:10.333520+0000","last_unstale":"2023-12-16T00:01:55.647082+0000","last_undegraded":"2023-12-16T00:01:55.647082+0000","last_fullsized":"2023-12-16T00:01:55.647082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.873517+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.873517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:26.034329+0000","scrub_duration":0.0011058350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"51'7","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:57.242470+0000","last_change":"2023-12-16T00:04:57.242470+0000","last_active":"2023-12-16T00:04:57.242470+0000","last_peered":"2023-12-16T00:04:57.242470+0000","last_clean":"2023-12-16T00:04:57.242470+0000","last_became_active":"2023-12-15T23:08:37.342431+0000","last_became_peered":"2023-12-15T23:08:37.342431+0000","last_unstale":"2023-12-16T00:04:57.242470+0000","last_undegraded":"2023-12-16T00:04:57.242470+0000","last_fullsized":"2023-12-16T00:04:57.242470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'7","last_scrub_stamp":"2023-12-16T00:04:57.242361+0000","last_deep_scrub":"51'7","last_deep_scrub_stamp":"2023-12-16T00:04:57.242361+0000","last_clean_scrub_stamp":"2023-12-16T00:04:57.242361+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:55:26.560904+0000","scrub_duration":0.0017620279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"54'145","reported_seq":3490,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:02.377198+0000","last_change":"2023-12-16T00:03:02.377198+0000","last_active":"2023-12-16T00:03:02.377198+0000","last_peered":"2023-12-16T00:03:02.377198+0000","last_clean":"2023-12-16T00:03:02.377198+0000","last_became_active":"2023-12-15T22:54:04.177998+0000","last_became_peered":"2023-12-15T22:54:04.177998+0000","last_unstale":"2023-12-16T00:03:02.377198+0000","last_undegraded":"2023-12-16T00:03:02.377198+0000","last_fullsized":"2023-12-16T00:03:02.377198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'145","last_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_deep_scrub":"54'145","last_deep_scrub_stamp":"2023-12-16T00:03:02.377088+0000","last_clean_scrub_stamp":"2023-12-16T00:03:02.377088+0000","objects_scrubbed":40,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:25.031104+0000","scrub_duration":0.024668315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4038,"num_read_kb":3997,"num_write":145,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10096,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:28.522187+0000","last_change":"2023-12-16T00:02:28.522187+0000","last_active":"2023-12-16T00:02:28.522187+0000","last_peered":"2023-12-16T00:02:28.522187+0000","last_clean":"2023-12-16T00:02:28.522187+0000","last_became_active":"2023-12-15T22:53:58.172482+0000","last_became_peered":"2023-12-15T22:53:58.172482+0000","last_unstale":"2023-12-16T00:02:28.522187+0000","last_undegraded":"2023-12-16T00:02:28.522187+0000","last_fullsized":"2023-12-16T00:02:28.522187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:28.522103+0000","last_clean_scrub_stamp":"2023-12-16T00:02:28.522103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:10:50.097311+0000","scrub_duration":0.0010192809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"54'12","reported_seq":113,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.662217+0000","last_change":"2023-12-16T00:01:34.033925+0000","last_active":"2023-12-16T00:02:55.662217+0000","last_peered":"2023-12-16T00:02:55.662217+0000","last_clean":"2023-12-16T00:02:55.662217+0000","last_became_active":"2023-12-15T22:53:32.189655+0000","last_became_peered":"2023-12-15T22:53:32.189655+0000","last_unstale":"2023-12-16T00:02:55.662217+0000","last_undegraded":"2023-12-16T00:02:55.662217+0000","last_fullsized":"2023-12-16T00:02:55.662217+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:34.033833+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.033833+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.034449+0000","scrub_duration":0.0029959119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":778,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":107,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421739+0000","last_change":"2023-12-16T00:00:47.473179+0000","last_active":"2023-12-16T00:02:16.421739+0000","last_peered":"2023-12-16T00:02:16.421739+0000","last_clean":"2023-12-16T00:02:16.421739+0000","last_became_active":"2023-12-15T22:53:30.183222+0000","last_became_peered":"2023-12-15T22:53:30.183222+0000","last_unstale":"2023-12-16T00:02:16.421739+0000","last_undegraded":"2023-12-16T00:02:16.421739+0000","last_fullsized":"2023-12-16T00:02:16.421739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:47.473067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.473067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:26.111201+0000","scrub_duration":0.0010035020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"54'623","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427491+0000","last_change":"2023-12-16T00:00:33.786894+0000","last_active":"2023-12-16T00:01:45.427491+0000","last_peered":"2023-12-16T00:01:45.427491+0000","last_clean":"2023-12-16T00:01:45.427491+0000","last_became_active":"2023-12-15T22:53:28.166688+0000","last_became_peered":"2023-12-15T22:53:28.166688+0000","last_unstale":"2023-12-16T00:01:45.427491+0000","last_undegraded":"2023-12-16T00:01:45.427491+0000","last_fullsized":"2023-12-16T00:01:45.427491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'623","last_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_deep_scrub":"54'623","last_deep_scrub_stamp":"2023-12-16T00:00:33.786809+0000","last_clean_scrub_stamp":"2023-12-16T00:00:33.786809+0000","objects_scrubbed":29,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:25:12.424943+0000","scrub_duration":0.019550262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":913,"num_read_kb":898,"num_write":915,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52615,"num_omap_keys":233,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"54'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434936+0000","last_change":"2023-12-16T00:00:35.121780+0000","last_active":"2023-12-16T00:02:10.434936+0000","last_peered":"2023-12-16T00:02:10.434936+0000","last_clean":"2023-12-16T00:02:10.434936+0000","last_became_active":"2023-12-15T22:53:26.161536+0000","last_became_peered":"2023-12-15T22:53:26.161536+0000","last_unstale":"2023-12-16T00:02:10.434936+0000","last_undegraded":"2023-12-16T00:02:10.434936+0000","last_fullsized":"2023-12-16T00:02:10.434936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:35.121663+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.121663+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:08.173101+0000","scrub_duration":0.0032165700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":26,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.732100+0000","last_change":"2023-12-16T00:03:56.732100+0000","last_active":"2023-12-16T00:03:56.732100+0000","last_peered":"2023-12-16T00:03:56.732100+0000","last_clean":"2023-12-16T00:03:56.732100+0000","last_became_active":"2023-12-15T22:52:55.191273+0000","last_became_peered":"2023-12-15T22:52:55.191273+0000","last_unstale":"2023-12-16T00:03:56.732100+0000","last_undegraded":"2023-12-16T00:03:56.732100+0000","last_fullsized":"2023-12-16T00:03:56.732100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.731978+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.731978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:06.685949+0000","scrub_duration":0.00092347600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.695233+0000","last_change":"2023-12-16T00:03:51.695233+0000","last_active":"2023-12-16T00:03:51.695233+0000","last_peered":"2023-12-16T00:03:51.695233+0000","last_clean":"2023-12-16T00:03:51.695233+0000","last_became_active":"2023-12-15T22:52:53.171319+0000","last_became_peered":"2023-12-15T22:52:53.171319+0000","last_unstale":"2023-12-16T00:03:51.695233+0000","last_undegraded":"2023-12-16T00:03:51.695233+0000","last_fullsized":"2023-12-16T00:03:51.695233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.695125+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.695125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:53.485109+0000","scrub_duration":0.0011650359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"54'4","reported_seq":105,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.161112+0000","last_change":"2023-12-16T00:03:19.161139+0000","last_active":"2023-12-16T00:03:19.161112+0000","last_peered":"2023-12-16T00:03:19.161112+0000","last_clean":"2023-12-16T00:03:19.161112+0000","last_became_active":"2023-12-15T22:53:04.317850+0000","last_became_peered":"2023-12-15T22:53:04.317850+0000","last_unstale":"2023-12-16T00:03:19.161112+0000","last_undegraded":"2023-12-16T00:03:19.161112+0000","last_fullsized":"2023-12-16T00:03:19.161112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:03:19.161057+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.161057+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:16.083496+0000","scrub_duration":0.002553694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"54'74","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.662156+0000","last_change":"2023-12-16T00:02:24.159341+0000","last_active":"2023-12-16T00:02:55.662156+0000","last_peered":"2023-12-16T00:02:55.662156+0000","last_clean":"2023-12-16T00:02:55.662156+0000","last_became_active":"2023-12-15T22:53:06.322789+0000","last_became_peered":"2023-12-15T22:53:06.322789+0000","last_unstale":"2023-12-16T00:02:55.662156+0000","last_undegraded":"2023-12-16T00:02:55.662156+0000","last_fullsized":"2023-12-16T00:02:55.662156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2023-12-16T00:02:24.159251+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.159251+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:43.374329+0000","scrub_duration":0.0035380030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"54'13","reported_seq":809,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.432543+0000","last_change":"2023-12-16T00:02:16.560253+0000","last_active":"2023-12-16T00:02:56.432543+0000","last_peered":"2023-12-16T00:02:56.432543+0000","last_clean":"2023-12-16T00:02:56.432543+0000","last_became_active":"2023-12-15T22:53:08.331839+0000","last_became_peered":"2023-12-15T22:53:08.331839+0000","last_unstale":"2023-12-16T00:02:56.432543+0000","last_undegraded":"2023-12-16T00:02:56.432543+0000","last_fullsized":"2023-12-16T00:02:56.432543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:16.560177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.560177+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:05.170275+0000","scrub_duration":0.002474937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.778104+0000","last_change":"2023-12-16T00:02:03.778104+0000","last_active":"2023-12-16T00:02:03.778104+0000","last_peered":"2023-12-16T00:02:03.778104+0000","last_clean":"2023-12-16T00:02:03.778104+0000","last_became_active":"2023-12-15T22:53:10.339762+0000","last_became_peered":"2023-12-15T22:53:10.339762+0000","last_unstale":"2023-12-16T00:02:03.778104+0000","last_undegraded":"2023-12-16T00:02:03.778104+0000","last_fullsized":"2023-12-16T00:02:03.778104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.778016+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.778016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:31.571694+0000","scrub_duration":0.0010762230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.599785+0000","last_change":"2023-12-16T00:04:37.599785+0000","last_active":"2023-12-16T00:04:37.599785+0000","last_peered":"2023-12-16T00:04:37.599785+0000","last_clean":"2023-12-16T00:04:37.599785+0000","last_became_active":"2023-12-15T23:08:37.332898+0000","last_became_peered":"2023-12-15T23:08:37.332898+0000","last_unstale":"2023-12-16T00:04:37.599785+0000","last_undegraded":"2023-12-16T00:04:37.599785+0000","last_fullsized":"2023-12-16T00:04:37.599785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:37.599703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:37.599703+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.599703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:21.750285+0000","scrub_duration":0.001144017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"54'238","reported_seq":1806,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.448882+0000","last_change":"2023-12-16T00:02:18.043120+0000","last_active":"2023-12-16T00:03:05.448882+0000","last_peered":"2023-12-16T00:03:05.448882+0000","last_clean":"2023-12-16T00:03:05.448882+0000","last_became_active":"2023-12-15T22:54:04.179766+0000","last_became_peered":"2023-12-15T22:54:04.179766+0000","last_unstale":"2023-12-16T00:03:05.448882+0000","last_undegraded":"2023-12-16T00:03:05.448882+0000","last_fullsized":"2023-12-16T00:03:05.448882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'238","last_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_deep_scrub":"54'238","last_deep_scrub_stamp":"2023-12-16T00:02:18.043026+0000","last_clean_scrub_stamp":"2023-12-16T00:02:18.043026+0000","objects_scrubbed":35,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:23.463450+0000","scrub_duration":0.017159058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3073,"num_read_kb":3260,"num_write":406,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22706,"num_omap_keys":83,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.439868+0000","last_change":"2023-12-16T00:02:00.439868+0000","last_active":"2023-12-16T00:02:00.439868+0000","last_peered":"2023-12-16T00:02:00.439868+0000","last_clean":"2023-12-16T00:02:00.439868+0000","last_became_active":"2023-12-15T22:53:58.170438+0000","last_became_peered":"2023-12-15T22:53:58.170438+0000","last_unstale":"2023-12-16T00:02:00.439868+0000","last_undegraded":"2023-12-16T00:02:00.439868+0000","last_fullsized":"2023-12-16T00:02:00.439868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.439788+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.439788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:04.677758+0000","scrub_duration":0.00099068799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"54'6","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.662297+0000","last_change":"2023-12-16T00:01:24.984548+0000","last_active":"2023-12-16T00:02:55.662297+0000","last_peered":"2023-12-16T00:02:55.662297+0000","last_clean":"2023-12-16T00:02:55.662297+0000","last_became_active":"2023-12-15T22:53:32.192047+0000","last_became_peered":"2023-12-15T22:53:32.192047+0000","last_unstale":"2023-12-16T00:02:55.662297+0000","last_undegraded":"2023-12-16T00:02:55.662297+0000","last_fullsized":"2023-12-16T00:02:55.662297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:24.984466+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.984466+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:51.701202+0000","scrub_duration":0.0031835660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"54'577","reported_seq":1544,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.904049+0000","last_change":"2023-12-16T00:01:44.904049+0000","last_active":"2023-12-16T00:01:44.904049+0000","last_peered":"2023-12-16T00:01:44.904049+0000","last_clean":"2023-12-16T00:01:44.904049+0000","last_became_active":"2023-12-15T22:53:30.178722+0000","last_became_peered":"2023-12-15T22:53:30.178722+0000","last_unstale":"2023-12-16T00:01:44.904049+0000","last_undegraded":"2023-12-16T00:01:44.904049+0000","last_fullsized":"2023-12-16T00:01:44.904049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:44.903967+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.903967+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:19.485670+0000","scrub_duration":0.0026381410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"54'333","reported_seq":552,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.421700+0000","last_change":"2023-12-16T00:00:50.529169+0000","last_active":"2023-12-16T00:02:16.421700+0000","last_peered":"2023-12-16T00:02:16.421700+0000","last_clean":"2023-12-16T00:02:16.421700+0000","last_became_active":"2023-12-15T22:53:28.169849+0000","last_became_peered":"2023-12-15T22:53:28.169849+0000","last_unstale":"2023-12-16T00:02:16.421700+0000","last_undegraded":"2023-12-16T00:02:16.421700+0000","last_fullsized":"2023-12-16T00:02:16.421700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'333","last_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_deep_scrub":"54'333","last_deep_scrub_stamp":"2023-12-16T00:00:50.529067+0000","last_clean_scrub_stamp":"2023-12-16T00:00:50.529067+0000","objects_scrubbed":21,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:52.570260+0000","scrub_duration":0.012872573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":453,"num_read_kb":444,"num_write":457,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17834,"num_omap_keys":79,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"54'2","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.650691+0000","last_change":"2023-12-16T00:00:43.710465+0000","last_active":"2023-12-16T00:02:10.650691+0000","last_peered":"2023-12-16T00:02:10.650691+0000","last_clean":"2023-12-16T00:02:10.650691+0000","last_became_active":"2023-12-15T22:53:26.164651+0000","last_became_peered":"2023-12-15T22:53:26.164651+0000","last_unstale":"2023-12-16T00:02:10.650691+0000","last_undegraded":"2023-12-16T00:02:10.650691+0000","last_fullsized":"2023-12-16T00:02:10.650691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:00:43.710383+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.710383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:17.354065+0000","scrub_duration":0.0022035729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.468705+0000","last_change":"2023-12-16T00:03:22.468705+0000","last_active":"2023-12-16T00:03:22.468705+0000","last_peered":"2023-12-16T00:03:22.468705+0000","last_clean":"2023-12-16T00:03:22.468705+0000","last_became_active":"2023-12-15T22:52:55.189408+0000","last_became_peered":"2023-12-15T22:52:55.189408+0000","last_unstale":"2023-12-16T00:03:22.468705+0000","last_undegraded":"2023-12-16T00:03:22.468705+0000","last_fullsized":"2023-12-16T00:03:22.468705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.468588+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.468588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:10.455054+0000","scrub_duration":0.001174998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:28.244156+0000","last_change":"2023-12-16T00:03:28.244156+0000","last_active":"2023-12-16T00:03:28.244156+0000","last_peered":"2023-12-16T00:03:28.244156+0000","last_clean":"2023-12-16T00:03:28.244156+0000","last_became_active":"2023-12-15T22:52:53.173355+0000","last_became_peered":"2023-12-15T22:52:53.173355+0000","last_unstale":"2023-12-16T00:03:28.244156+0000","last_undegraded":"2023-12-16T00:03:28.244156+0000","last_fullsized":"2023-12-16T00:03:28.244156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:28.244071+0000","last_clean_scrub_stamp":"2023-12-16T00:03:28.244071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:47:37.223141+0000","scrub_duration":0.00084962099999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":80,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.334765+0000","last_change":"2023-12-16T00:03:03.334765+0000","last_active":"2023-12-16T00:03:03.334765+0000","last_peered":"2023-12-16T00:03:03.334765+0000","last_clean":"2023-12-16T00:03:03.334765+0000","last_became_active":"2023-12-15T22:53:04.318376+0000","last_became_peered":"2023-12-15T22:53:04.318376+0000","last_unstale":"2023-12-16T00:03:03.334765+0000","last_undegraded":"2023-12-16T00:03:03.334765+0000","last_fullsized":"2023-12-16T00:03:03.334765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.334650+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.334650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:23:40.009300+0000","scrub_duration":0.001253407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"54'111","reported_seq":245,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.447224+0000","last_change":"2023-12-16T00:02:53.163987+0000","last_active":"2023-12-16T00:02:55.447224+0000","last_peered":"2023-12-16T00:02:55.447224+0000","last_clean":"2023-12-16T00:02:55.447224+0000","last_became_active":"2023-12-15T22:53:06.319904+0000","last_became_peered":"2023-12-15T22:53:06.319904+0000","last_unstale":"2023-12-16T00:02:55.447224+0000","last_undegraded":"2023-12-16T00:02:55.447224+0000","last_fullsized":"2023-12-16T00:02:55.447224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'111","last_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_deep_scrub":"54'111","last_deep_scrub_stamp":"2023-12-16T00:02:53.163845+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.163845+0000","objects_scrubbed":8,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:00.681246+0000","scrub_duration":0.0055239850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.447359+0000","last_change":"2023-12-16T00:01:53.416148+0000","last_active":"2023-12-16T00:02:55.447359+0000","last_peered":"2023-12-16T00:02:55.447359+0000","last_clean":"2023-12-16T00:02:55.447359+0000","last_became_active":"2023-12-15T22:53:08.329942+0000","last_became_peered":"2023-12-15T22:53:08.329942+0000","last_unstale":"2023-12-16T00:02:55.447359+0000","last_undegraded":"2023-12-16T00:02:55.447359+0000","last_fullsized":"2023-12-16T00:02:55.447359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:53.416073+0000","last_clean_scrub_stamp":"2023-12-16T00:01:53.416073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:42.026171+0000","scrub_duration":0.0013583009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.647206+0000","last_change":"2023-12-16T00:01:13.884007+0000","last_active":"2023-12-16T00:01:55.647206+0000","last_peered":"2023-12-16T00:01:55.647206+0000","last_clean":"2023-12-16T00:01:55.647206+0000","last_became_active":"2023-12-15T22:53:10.333953+0000","last_became_peered":"2023-12-15T22:53:10.333953+0000","last_unstale":"2023-12-16T00:01:55.647206+0000","last_undegraded":"2023-12-16T00:01:55.647206+0000","last_fullsized":"2023-12-16T00:01:55.647206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:13.883874+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.883874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:20.141587+0000","scrub_duration":0.0012533360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:58.118570+0000","last_change":"2023-12-16T00:03:58.118570+0000","last_active":"2023-12-16T00:03:58.118570+0000","last_peered":"2023-12-16T00:03:58.118570+0000","last_clean":"2023-12-16T00:03:58.118570+0000","last_became_active":"2023-12-15T23:08:37.335840+0000","last_became_peered":"2023-12-15T23:08:37.335840+0000","last_unstale":"2023-12-16T00:03:58.118570+0000","last_undegraded":"2023-12-16T00:03:58.118570+0000","last_fullsized":"2023-12-16T00:03:58.118570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:58.118482+0000","last_clean_scrub_stamp":"2023-12-16T00:03:58.118482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:22:03.904023+0000","scrub_duration":0.00098478099999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"54'186","reported_seq":1534,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.707299+0000","last_change":"2023-12-16T00:02:10.707299+0000","last_active":"2023-12-16T00:02:10.707299+0000","last_peered":"2023-12-16T00:02:10.707299+0000","last_clean":"2023-12-16T00:02:10.707299+0000","last_became_active":"2023-12-15T22:54:04.183056+0000","last_became_peered":"2023-12-15T22:54:04.183056+0000","last_unstale":"2023-12-16T00:02:10.707299+0000","last_undegraded":"2023-12-16T00:02:10.707299+0000","last_fullsized":"2023-12-16T00:02:10.707299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:10.707207+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.707207+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:01:19.472648+0000","scrub_duration":0.019839806000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2233,"num_read_kb":2195,"num_write":198,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8911,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.051798+0000","last_change":"2023-12-16T00:01:33.051798+0000","last_active":"2023-12-16T00:01:33.051798+0000","last_peered":"2023-12-16T00:01:33.051798+0000","last_clean":"2023-12-16T00:01:33.051798+0000","last_became_active":"2023-12-15T22:53:58.166542+0000","last_became_peered":"2023-12-15T22:53:58.166542+0000","last_unstale":"2023-12-16T00:01:33.051798+0000","last_undegraded":"2023-12-16T00:01:33.051798+0000","last_fullsized":"2023-12-16T00:01:33.051798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.051711+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.051711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:37.679747+0000","scrub_duration":0.001115638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"54'6","reported_seq":81,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.682653+0000","last_change":"2023-12-16T00:01:33.682653+0000","last_active":"2023-12-16T00:01:33.682653+0000","last_peered":"2023-12-16T00:01:33.682653+0000","last_clean":"2023-12-16T00:01:33.682653+0000","last_became_active":"2023-12-15T22:53:32.195064+0000","last_became_peered":"2023-12-15T22:53:32.195064+0000","last_unstale":"2023-12-16T00:01:33.682653+0000","last_undegraded":"2023-12-16T00:01:33.682653+0000","last_fullsized":"2023-12-16T00:01:33.682653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:33.682573+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.682573+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:04:52.935400+0000","scrub_duration":0.0032277460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:00.663027+0000","last_change":"2023-12-16T00:01:38.975172+0000","last_active":"2023-12-16T00:03:00.663027+0000","last_peered":"2023-12-16T00:03:00.663027+0000","last_clean":"2023-12-16T00:03:00.663027+0000","last_became_active":"2023-12-15T22:53:30.176018+0000","last_became_peered":"2023-12-15T22:53:30.176018+0000","last_unstale":"2023-12-16T00:03:00.663027+0000","last_undegraded":"2023-12-16T00:03:00.663027+0000","last_fullsized":"2023-12-16T00:03:00.663027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.975087+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.975087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:25:51.341622+0000","scrub_duration":0.0010847389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2116","reported_seq":3465,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415772+0000","last_change":"2023-12-16T00:00:39.752812+0000","last_active":"2023-12-16T00:01:00.415772+0000","last_peered":"2023-12-16T00:01:00.415772+0000","last_clean":"2023-12-16T00:01:00.415772+0000","last_became_active":"2023-12-15T22:53:28.170859+0000","last_became_peered":"2023-12-15T22:53:28.170859+0000","last_unstale":"2023-12-16T00:01:00.415772+0000","last_undegraded":"2023-12-16T00:01:00.415772+0000","last_fullsized":"2023-12-16T00:01:00.415772+0000","mapping_epoch":35,"log_start":"49'200","ondisk_log_start":"49'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2116","last_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_deep_scrub":"54'2116","last_deep_scrub_stamp":"2023-12-16T00:00:39.752706+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.752706+0000","objects_scrubbed":24,"log_size":1916,"log_dups_size":200,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:33.225899+0000","scrub_duration":0.021795821999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39049,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4812,"num_read_kb":4546,"num_write":2513,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17449,"num_omap_keys":77,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"54'6","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.426187+0000","last_change":"2023-12-16T00:01:55.574179+0000","last_active":"2023-12-16T00:02:45.426187+0000","last_peered":"2023-12-16T00:02:45.426187+0000","last_clean":"2023-12-16T00:02:45.426187+0000","last_became_active":"2023-12-15T22:53:26.164327+0000","last_became_peered":"2023-12-15T22:53:26.164327+0000","last_unstale":"2023-12-16T00:02:45.426187+0000","last_undegraded":"2023-12-16T00:02:45.426187+0000","last_fullsized":"2023-12-16T00:02:45.426187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:55.574048+0000","last_clean_scrub_stamp":"2023-12-16T00:01:55.574048+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:56:22.290784+0000","scrub_duration":0.0034870439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.350573+0000","last_change":"2023-12-16T00:03:11.350573+0000","last_active":"2023-12-16T00:03:11.350573+0000","last_peered":"2023-12-16T00:03:11.350573+0000","last_clean":"2023-12-16T00:03:11.350573+0000","last_became_active":"2023-12-15T22:52:55.184911+0000","last_became_peered":"2023-12-15T22:52:55.184911+0000","last_unstale":"2023-12-16T00:03:11.350573+0000","last_undegraded":"2023-12-16T00:03:11.350573+0000","last_fullsized":"2023-12-16T00:03:11.350573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:11.350487+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.350487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:50.816621+0000","scrub_duration":0.00097520500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.159507+0000","last_change":"2023-12-16T00:04:29.159527+0000","last_active":"2023-12-16T00:04:29.159507+0000","last_peered":"2023-12-16T00:04:29.159507+0000","last_clean":"2023-12-16T00:04:29.159507+0000","last_became_active":"2023-12-15T22:52:08.041946+0000","last_became_peered":"2023-12-15T22:52:08.041946+0000","last_unstale":"2023-12-16T00:04:29.159507+0000","last_undegraded":"2023-12-16T00:04:29.159507+0000","last_fullsized":"2023-12-16T00:04:29.159507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.159437+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.159437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:42.436132+0000","scrub_duration":0.001297589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.541039+0000","last_change":"2023-12-16T00:04:13.541055+0000","last_active":"2023-12-16T00:04:13.541039+0000","last_peered":"2023-12-16T00:04:13.541039+0000","last_clean":"2023-12-16T00:04:13.541039+0000","last_became_active":"2023-12-15T22:52:53.175488+0000","last_became_peered":"2023-12-15T22:52:53.175488+0000","last_unstale":"2023-12-16T00:04:13.541039+0000","last_undegraded":"2023-12-16T00:04:13.541039+0000","last_fullsized":"2023-12-16T00:04:13.541039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.540990+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.540990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:15:02.204008+0000","scrub_duration":0.001141256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:22.461465+0000","last_change":"2023-12-16T00:03:22.461465+0000","last_active":"2023-12-16T00:03:22.461465+0000","last_peered":"2023-12-16T00:03:22.461465+0000","last_clean":"2023-12-16T00:03:22.461465+0000","last_became_active":"2023-12-15T22:53:04.320748+0000","last_became_peered":"2023-12-15T22:53:04.320748+0000","last_unstale":"2023-12-16T00:03:22.461465+0000","last_undegraded":"2023-12-16T00:03:22.461465+0000","last_fullsized":"2023-12-16T00:03:22.461465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:22.461350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:22.461350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:12.720398+0000","scrub_duration":0.001141642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"54'51","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:14.161263+0000","last_change":"2023-12-16T00:03:14.161263+0000","last_active":"2023-12-16T00:03:14.161263+0000","last_peered":"2023-12-16T00:03:14.161263+0000","last_clean":"2023-12-16T00:03:14.161263+0000","last_became_active":"2023-12-15T22:53:06.324524+0000","last_became_peered":"2023-12-15T22:53:06.324524+0000","last_unstale":"2023-12-16T00:03:14.161263+0000","last_undegraded":"2023-12-16T00:03:14.161263+0000","last_fullsized":"2023-12-16T00:03:14.161263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:14.161165+0000","last_clean_scrub_stamp":"2023-12-16T00:03:14.161165+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:03.130771+0000","scrub_duration":0.0043125519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":46,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.193064+0000","last_change":"2023-12-16T00:02:53.193064+0000","last_active":"2023-12-16T00:02:53.193064+0000","last_peered":"2023-12-16T00:02:53.193064+0000","last_clean":"2023-12-16T00:02:53.193064+0000","last_became_active":"2023-12-15T22:53:08.335358+0000","last_became_peered":"2023-12-15T22:53:08.335358+0000","last_unstale":"2023-12-16T00:02:53.193064+0000","last_undegraded":"2023-12-16T00:02:53.193064+0000","last_fullsized":"2023-12-16T00:02:53.193064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:53.192989+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.192989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:41:42.162595+0000","scrub_duration":0.0011454690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439582+0000","last_change":"2023-12-16T00:01:36.730498+0000","last_active":"2023-12-16T00:02:30.439582+0000","last_peered":"2023-12-16T00:02:30.439582+0000","last_clean":"2023-12-16T00:02:30.439582+0000","last_became_active":"2023-12-15T22:53:10.333485+0000","last_became_peered":"2023-12-15T22:53:10.333485+0000","last_unstale":"2023-12-16T00:02:30.439582+0000","last_undegraded":"2023-12-16T00:02:30.439582+0000","last_fullsized":"2023-12-16T00:02:30.439582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.730383+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.730383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:42.362095+0000","scrub_duration":0.00092399500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:58.250425+0000","last_change":"2023-12-16T00:04:58.250425+0000","last_active":"2023-12-16T00:04:58.250425+0000","last_peered":"2023-12-16T00:04:58.250425+0000","last_clean":"2023-12-16T00:04:58.250425+0000","last_became_active":"2023-12-15T23:08:37.332910+0000","last_became_peered":"2023-12-15T23:08:37.332910+0000","last_unstale":"2023-12-16T00:04:58.250425+0000","last_undegraded":"2023-12-16T00:04:58.250425+0000","last_fullsized":"2023-12-16T00:04:58.250425+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:58.250334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:58.250334+0000","last_clean_scrub_stamp":"2023-12-16T00:04:58.250334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:20:17.052400+0000","scrub_duration":0.001099671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"54'187","reported_seq":1587,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.520664+0000","last_change":"2023-12-16T00:02:25.520664+0000","last_active":"2023-12-16T00:02:25.520664+0000","last_peered":"2023-12-16T00:02:25.520664+0000","last_clean":"2023-12-16T00:02:25.520664+0000","last_became_active":"2023-12-15T22:54:04.183037+0000","last_became_peered":"2023-12-15T22:54:04.183037+0000","last_unstale":"2023-12-16T00:02:25.520664+0000","last_undegraded":"2023-12-16T00:02:25.520664+0000","last_fullsized":"2023-12-16T00:02:25.520664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'187","last_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_deep_scrub":"54'187","last_deep_scrub_stamp":"2023-12-16T00:02:25.520572+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.520572+0000","objects_scrubbed":44,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:01.255790+0000","scrub_duration":0.019831304000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2366,"num_read_kb":2328,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11482,"num_omap_keys":45,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410634+0000","last_change":"2023-12-16T00:01:22.835817+0000","last_active":"2023-12-16T00:01:31.410634+0000","last_peered":"2023-12-16T00:01:31.410634+0000","last_clean":"2023-12-16T00:01:31.410634+0000","last_became_active":"2023-12-15T22:53:58.170657+0000","last_became_peered":"2023-12-15T22:53:58.170657+0000","last_unstale":"2023-12-16T00:01:31.410634+0000","last_undegraded":"2023-12-16T00:01:31.410634+0000","last_fullsized":"2023-12-16T00:01:31.410634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.835734+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.835734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:40.054571+0000","scrub_duration":0.001190637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"54'10","reported_seq":146,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:22.189625+0000","last_change":"2023-12-16T00:02:22.189625+0000","last_active":"2023-12-16T00:02:22.189625+0000","last_peered":"2023-12-16T00:02:22.189625+0000","last_clean":"2023-12-16T00:02:22.189625+0000","last_became_active":"2023-12-15T22:53:32.191130+0000","last_became_peered":"2023-12-15T22:53:32.191130+0000","last_unstale":"2023-12-16T00:02:22.189625+0000","last_undegraded":"2023-12-16T00:02:22.189625+0000","last_fullsized":"2023-12-16T00:02:22.189625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:22.189545+0000","last_clean_scrub_stamp":"2023-12-16T00:02:22.189545+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:11.385349+0000","scrub_duration":0.0043313409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":163,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.693650+0000","last_change":"2023-12-16T00:01:41.693650+0000","last_active":"2023-12-16T00:01:41.693650+0000","last_peered":"2023-12-16T00:01:41.693650+0000","last_clean":"2023-12-16T00:01:41.693650+0000","last_became_active":"2023-12-15T22:53:30.178183+0000","last_became_peered":"2023-12-15T22:53:30.178183+0000","last_unstale":"2023-12-16T00:01:41.693650+0000","last_undegraded":"2023-12-16T00:01:41.693650+0000","last_fullsized":"2023-12-16T00:01:41.693650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.693567+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.693567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:19:04.897525+0000","scrub_duration":0.00092468699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"54'2353","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:56.401958+0000","last_change":"2023-12-16T00:00:43.447098+0000","last_active":"2023-12-16T00:00:56.401958+0000","last_peered":"2023-12-16T00:00:56.401958+0000","last_clean":"2023-12-16T00:00:56.401958+0000","last_became_active":"2023-12-15T22:53:28.162639+0000","last_became_peered":"2023-12-15T22:53:28.162639+0000","last_unstale":"2023-12-16T00:00:56.401958+0000","last_undegraded":"2023-12-16T00:00:56.401958+0000","last_fullsized":"2023-12-16T00:00:56.401958+0000","mapping_epoch":35,"log_start":"54'700","ondisk_log_start":"54'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2353","last_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_deep_scrub":"54'2353","last_deep_scrub_stamp":"2023-12-16T00:00:43.446999+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.446999+0000","objects_scrubbed":32,"log_size":1653,"log_dups_size":700,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:38.605253+0000","scrub_duration":0.027090954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3353,"num_read_kb":3218,"num_write":597,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17687,"num_omap_keys":81,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"54'23","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443025+0000","last_change":"2023-12-16T00:00:43.313125+0000","last_active":"2023-12-16T00:02:45.443025+0000","last_peered":"2023-12-16T00:02:45.443025+0000","last_clean":"2023-12-16T00:02:45.443025+0000","last_became_active":"2023-12-15T22:53:26.161609+0000","last_became_peered":"2023-12-15T22:53:26.161609+0000","last_unstale":"2023-12-16T00:02:45.443025+0000","last_undegraded":"2023-12-16T00:02:45.443025+0000","last_fullsized":"2023-12-16T00:02:45.443025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'23","last_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_deep_scrub":"54'23","last_deep_scrub_stamp":"2023-12-16T00:00:43.312967+0000","last_clean_scrub_stamp":"2023-12-16T00:00:43.312967+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:11.369774+0000","scrub_duration":0.0055633269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":220,"num_write":85,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:17.414172+0000","last_change":"2023-12-16T00:03:17.414172+0000","last_active":"2023-12-16T00:03:17.414172+0000","last_peered":"2023-12-16T00:03:17.414172+0000","last_clean":"2023-12-16T00:03:17.414172+0000","last_became_active":"2023-12-15T22:52:55.187272+0000","last_became_peered":"2023-12-15T22:52:55.187272+0000","last_unstale":"2023-12-16T00:03:17.414172+0000","last_undegraded":"2023-12-16T00:03:17.414172+0000","last_fullsized":"2023-12-16T00:03:17.414172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:17.414086+0000","last_clean_scrub_stamp":"2023-12-16T00:03:17.414086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:24.931488+0000","scrub_duration":0.00096880800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.714879+0000","last_change":"2023-12-16T00:04:27.714879+0000","last_active":"2023-12-16T00:04:27.714879+0000","last_peered":"2023-12-16T00:04:27.714879+0000","last_clean":"2023-12-16T00:04:27.714879+0000","last_became_active":"2023-12-15T22:52:08.041857+0000","last_became_peered":"2023-12-15T22:52:08.041857+0000","last_unstale":"2023-12-16T00:04:27.714879+0000","last_undegraded":"2023-12-16T00:04:27.714879+0000","last_fullsized":"2023-12-16T00:04:27.714879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.714794+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.714794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:23.216681+0000","scrub_duration":0.001320136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.531828+0000","last_change":"2023-12-16T00:03:41.531828+0000","last_active":"2023-12-16T00:03:41.531828+0000","last_peered":"2023-12-16T00:03:41.531828+0000","last_clean":"2023-12-16T00:03:41.531828+0000","last_became_active":"2023-12-15T22:52:53.170839+0000","last_became_peered":"2023-12-15T22:52:53.170839+0000","last_unstale":"2023-12-16T00:03:41.531828+0000","last_undegraded":"2023-12-16T00:03:41.531828+0000","last_fullsized":"2023-12-16T00:03:41.531828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.531720+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.531720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:39:20.997854+0000","scrub_duration":0.001119472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:19.990331+0000","last_change":"2023-12-16T00:03:19.990331+0000","last_active":"2023-12-16T00:03:19.990331+0000","last_peered":"2023-12-16T00:03:19.990331+0000","last_clean":"2023-12-16T00:03:19.990331+0000","last_became_active":"2023-12-15T22:53:04.319055+0000","last_became_peered":"2023-12-15T22:53:04.319055+0000","last_unstale":"2023-12-16T00:03:19.990331+0000","last_undegraded":"2023-12-16T00:03:19.990331+0000","last_fullsized":"2023-12-16T00:03:19.990331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:19.990253+0000","last_clean_scrub_stamp":"2023-12-16T00:03:19.990253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:32.072670+0000","scrub_duration":0.001078706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"54'90","reported_seq":211,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.656100+0000","last_change":"2023-12-16T00:02:16.139421+0000","last_active":"2023-12-16T00:02:30.656100+0000","last_peered":"2023-12-16T00:02:30.656100+0000","last_clean":"2023-12-16T00:02:30.656100+0000","last_became_active":"2023-12-15T22:53:06.322976+0000","last_became_peered":"2023-12-15T22:53:06.322976+0000","last_unstale":"2023-12-16T00:02:30.656100+0000","last_undegraded":"2023-12-16T00:02:30.656100+0000","last_fullsized":"2023-12-16T00:02:30.656100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'90","last_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_deep_scrub":"54'90","last_deep_scrub_stamp":"2023-12-16T00:02:16.139314+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.139314+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:14.923774+0000","scrub_duration":0.0048129920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.441073+0000","last_change":"2023-12-16T00:01:42.148521+0000","last_active":"2023-12-16T00:02:30.441073+0000","last_peered":"2023-12-16T00:02:30.441073+0000","last_clean":"2023-12-16T00:02:30.441073+0000","last_became_active":"2023-12-15T22:53:08.334666+0000","last_became_peered":"2023-12-15T22:53:08.334666+0000","last_unstale":"2023-12-16T00:02:30.441073+0000","last_undegraded":"2023-12-16T00:02:30.441073+0000","last_fullsized":"2023-12-16T00:02:30.441073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:42.148444+0000","last_clean_scrub_stamp":"2023-12-16T00:01:42.148444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:22.308657+0000","scrub_duration":0.00087089800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.439536+0000","last_change":"2023-12-16T00:01:48.927447+0000","last_active":"2023-12-16T00:02:30.439536+0000","last_peered":"2023-12-16T00:02:30.439536+0000","last_clean":"2023-12-16T00:02:30.439536+0000","last_became_active":"2023-12-15T22:53:10.334198+0000","last_became_peered":"2023-12-15T22:53:10.334198+0000","last_unstale":"2023-12-16T00:02:30.439536+0000","last_undegraded":"2023-12-16T00:02:30.439536+0000","last_fullsized":"2023-12-16T00:02:30.439536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:48.927345+0000","last_clean_scrub_stamp":"2023-12-16T00:01:48.927345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:42.391110+0000","scrub_duration":0.001096777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:05:04.946205+0000","last_change":"2023-12-16T00:05:04.946226+0000","last_active":"2023-12-16T00:05:04.946205+0000","last_peered":"2023-12-16T00:05:04.946205+0000","last_clean":"2023-12-16T00:05:04.946205+0000","last_became_active":"2023-12-15T23:09:02.674991+0000","last_became_peered":"2023-12-15T23:09:02.674991+0000","last_unstale":"2023-12-16T00:05:04.946205+0000","last_undegraded":"2023-12-16T00:05:04.946205+0000","last_fullsized":"2023-12-16T00:05:04.946205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:05:04.946145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:05:04.946145+0000","last_clean_scrub_stamp":"2023-12-16T00:05:04.946145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:18.806924+0000","scrub_duration":0.001201906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"54'140","reported_seq":6045,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:44.854897+0000","last_change":"2023-12-16T00:04:44.854933+0000","last_active":"2023-12-16T00:04:44.854897+0000","last_peered":"2023-12-16T00:04:44.854897+0000","last_clean":"2023-12-16T00:04:44.854897+0000","last_became_active":"2023-12-15T22:54:04.182535+0000","last_became_peered":"2023-12-15T22:54:04.182535+0000","last_unstale":"2023-12-16T00:04:44.854897+0000","last_undegraded":"2023-12-16T00:04:44.854897+0000","last_fullsized":"2023-12-16T00:04:44.854897+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'140","last_scrub_stamp":"2023-12-16T00:04:44.854835+0000","last_deep_scrub":"54'140","last_deep_scrub_stamp":"2023-12-16T00:04:44.854835+0000","last_clean_scrub_stamp":"2023-12-16T00:04:44.854835+0000","objects_scrubbed":40,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:05.262749+0000","scrub_duration":0.020750068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6770,"num_read_kb":6748,"num_write":140,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6463,"num_omap_keys":25,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.166639+0000","last_change":"2023-12-16T00:03:03.166639+0000","last_active":"2023-12-16T00:03:03.166639+0000","last_peered":"2023-12-16T00:03:03.166639+0000","last_clean":"2023-12-16T00:03:03.166639+0000","last_became_active":"2023-12-15T22:53:58.171353+0000","last_became_peered":"2023-12-15T22:53:58.171353+0000","last_unstale":"2023-12-16T00:03:03.166639+0000","last_undegraded":"2023-12-16T00:03:03.166639+0000","last_fullsized":"2023-12-16T00:03:03.166639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.166543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.166543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:15:47.166408+0000","scrub_duration":0.0010328410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:02.478560+0000","last_change":"2023-12-16T00:02:02.478560+0000","last_active":"2023-12-16T00:02:02.478560+0000","last_peered":"2023-12-16T00:02:02.478560+0000","last_clean":"2023-12-16T00:02:02.478560+0000","last_became_active":"2023-12-15T22:53:32.192805+0000","last_became_peered":"2023-12-15T22:53:32.192805+0000","last_unstale":"2023-12-16T00:02:02.478560+0000","last_undegraded":"2023-12-16T00:02:02.478560+0000","last_fullsized":"2023-12-16T00:02:02.478560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:02.478452+0000","last_clean_scrub_stamp":"2023-12-16T00:02:02.478452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.108515+0000","scrub_duration":0.0010119339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.427539+0000","last_change":"2023-12-16T00:01:16.790148+0000","last_active":"2023-12-16T00:02:50.427539+0000","last_peered":"2023-12-16T00:02:50.427539+0000","last_clean":"2023-12-16T00:02:50.427539+0000","last_became_active":"2023-12-15T22:53:30.180662+0000","last_became_peered":"2023-12-15T22:53:30.180662+0000","last_unstale":"2023-12-16T00:02:50.427539+0000","last_undegraded":"2023-12-16T00:02:50.427539+0000","last_fullsized":"2023-12-16T00:02:50.427539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.790063+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.790063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:00.098706+0000","scrub_duration":0.00092295599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"54'278","reported_seq":1421,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.445700+0000","last_change":"2023-12-16T00:01:31.174601+0000","last_active":"2023-12-16T00:02:50.445700+0000","last_peered":"2023-12-16T00:02:50.445700+0000","last_clean":"2023-12-16T00:02:50.445700+0000","last_became_active":"2023-12-15T22:53:28.173114+0000","last_became_peered":"2023-12-15T22:53:28.173114+0000","last_unstale":"2023-12-16T00:02:50.445700+0000","last_undegraded":"2023-12-16T00:02:50.445700+0000","last_fullsized":"2023-12-16T00:02:50.445700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:01:31.174474+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.174474+0000","objects_scrubbed":19,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:38.461126+0000","scrub_duration":0.011225413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1283,"num_read_kb":1279,"num_write":381,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9494,"num_omap_keys":58,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"54'32","reported_seq":218,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:00.448523+0000","last_change":"2023-12-16T00:01:15.007493+0000","last_active":"2023-12-16T00:03:00.448523+0000","last_peered":"2023-12-16T00:03:00.448523+0000","last_clean":"2023-12-16T00:03:00.448523+0000","last_became_active":"2023-12-15T22:53:26.159016+0000","last_became_peered":"2023-12-15T22:53:26.159016+0000","last_unstale":"2023-12-16T00:03:00.448523+0000","last_undegraded":"2023-12-16T00:03:00.448523+0000","last_fullsized":"2023-12-16T00:03:00.448523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'32","last_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_deep_scrub":"54'32","last_deep_scrub_stamp":"2023-12-16T00:01:15.007364+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.007364+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:35.367454+0000","scrub_duration":0.0063648699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":295,"num_read_kb":297,"num_write":153,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.639670+0000","last_change":"2023-12-16T00:03:36.639670+0000","last_active":"2023-12-16T00:03:36.639670+0000","last_peered":"2023-12-16T00:03:36.639670+0000","last_clean":"2023-12-16T00:03:36.639670+0000","last_became_active":"2023-12-15T22:52:55.190673+0000","last_became_peered":"2023-12-15T22:52:55.190673+0000","last_unstale":"2023-12-16T00:03:36.639670+0000","last_undegraded":"2023-12-16T00:03:36.639670+0000","last_fullsized":"2023-12-16T00:03:36.639670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.639584+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.639584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:26.898631+0000","scrub_duration":0.0012042960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:31.612184+0000","last_change":"2023-12-16T00:03:31.612184+0000","last_active":"2023-12-16T00:03:31.612184+0000","last_peered":"2023-12-16T00:03:31.612184+0000","last_clean":"2023-12-16T00:03:31.612184+0000","last_became_active":"2023-12-15T22:52:08.041816+0000","last_became_peered":"2023-12-15T22:52:08.041816+0000","last_unstale":"2023-12-16T00:03:31.612184+0000","last_undegraded":"2023-12-16T00:03:31.612184+0000","last_fullsized":"2023-12-16T00:03:31.612184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:31.612104+0000","last_clean_scrub_stamp":"2023-12-16T00:03:31.612104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:55.639396+0000","scrub_duration":0.001020881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.567111+0000","last_change":"2023-12-16T00:03:52.567111+0000","last_active":"2023-12-16T00:03:52.567111+0000","last_peered":"2023-12-16T00:03:52.567111+0000","last_clean":"2023-12-16T00:03:52.567111+0000","last_became_active":"2023-12-15T22:52:53.172438+0000","last_became_peered":"2023-12-15T22:52:53.172438+0000","last_unstale":"2023-12-16T00:03:52.567111+0000","last_undegraded":"2023-12-16T00:03:52.567111+0000","last_fullsized":"2023-12-16T00:03:52.567111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.567032+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.567032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:39:09.870577+0000","scrub_duration":0.00099403600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"54'15","reported_seq":329,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.703371+0000","last_change":"2023-12-16T00:02:37.703371+0000","last_active":"2023-12-16T00:02:37.703371+0000","last_peered":"2023-12-16T00:02:37.703371+0000","last_clean":"2023-12-16T00:02:37.703371+0000","last_became_active":"2023-12-15T22:53:04.314742+0000","last_became_peered":"2023-12-15T22:53:04.314742+0000","last_unstale":"2023-12-16T00:02:37.703371+0000","last_undegraded":"2023-12-16T00:02:37.703371+0000","last_fullsized":"2023-12-16T00:02:37.703371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'15","last_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_deep_scrub":"54'15","last_deep_scrub_stamp":"2023-12-16T00:02:37.703275+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.703275+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:11:36.487734+0000","scrub_duration":0.003237186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":239,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"54'99","reported_seq":943,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:51.174022+0000","last_change":"2023-12-16T00:02:51.174022+0000","last_active":"2023-12-16T00:02:51.174022+0000","last_peered":"2023-12-16T00:02:51.174022+0000","last_clean":"2023-12-16T00:02:51.174022+0000","last_became_active":"2023-12-15T22:53:06.323201+0000","last_became_peered":"2023-12-15T22:53:06.323201+0000","last_unstale":"2023-12-16T00:02:51.174022+0000","last_undegraded":"2023-12-16T00:02:51.174022+0000","last_fullsized":"2023-12-16T00:02:51.174022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'99","last_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_deep_scrub":"54'99","last_deep_scrub_stamp":"2023-12-16T00:02:51.173924+0000","last_clean_scrub_stamp":"2023-12-16T00:02:51.173924+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:32:04.218668+0000","scrub_duration":0.0053695929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":130,"num_read_kb":122,"num_write":85,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.130536+0000","last_change":"2023-12-16T00:01:57.130536+0000","last_active":"2023-12-16T00:01:57.130536+0000","last_peered":"2023-12-16T00:01:57.130536+0000","last_clean":"2023-12-16T00:01:57.130536+0000","last_became_active":"2023-12-15T22:53:08.332093+0000","last_became_peered":"2023-12-15T22:53:08.332093+0000","last_unstale":"2023-12-16T00:01:57.130536+0000","last_undegraded":"2023-12-16T00:01:57.130536+0000","last_fullsized":"2023-12-16T00:01:57.130536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.130458+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.130458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:16.345536+0000","scrub_duration":0.0010793140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.446213+0000","last_change":"2023-12-16T00:01:47.243312+0000","last_active":"2023-12-16T00:02:55.446213+0000","last_peered":"2023-12-16T00:02:55.446213+0000","last_clean":"2023-12-16T00:02:55.446213+0000","last_became_active":"2023-12-15T22:53:10.339686+0000","last_became_peered":"2023-12-15T22:53:10.339686+0000","last_unstale":"2023-12-16T00:02:55.446213+0000","last_undegraded":"2023-12-16T00:02:55.446213+0000","last_fullsized":"2023-12-16T00:02:55.446213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.243202+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.243202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:27.403415+0000","scrub_duration":0.0014494340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.836161+0000","last_change":"2023-12-16T00:04:24.836161+0000","last_active":"2023-12-16T00:04:24.836161+0000","last_peered":"2023-12-16T00:04:24.836161+0000","last_clean":"2023-12-16T00:04:24.836161+0000","last_became_active":"2023-12-15T23:08:37.338125+0000","last_became_peered":"2023-12-15T23:08:37.338125+0000","last_unstale":"2023-12-16T00:04:24.836161+0000","last_undegraded":"2023-12-16T00:04:24.836161+0000","last_fullsized":"2023-12-16T00:04:24.836161+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.836073+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.836073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:13.730641+0000","scrub_duration":0.0014096079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"54'131","reported_seq":4179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:33.238825+0000","last_change":"2023-12-16T00:04:33.238873+0000","last_active":"2023-12-16T00:04:33.238825+0000","last_peered":"2023-12-16T00:04:33.238825+0000","last_clean":"2023-12-16T00:04:33.238825+0000","last_became_active":"2023-12-15T22:54:04.188327+0000","last_became_peered":"2023-12-15T22:54:04.188327+0000","last_unstale":"2023-12-16T00:04:33.238825+0000","last_undegraded":"2023-12-16T00:04:33.238825+0000","last_fullsized":"2023-12-16T00:04:33.238825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'131","last_scrub_stamp":"2023-12-16T00:04:33.238763+0000","last_deep_scrub":"54'131","last_deep_scrub_stamp":"2023-12-16T00:04:33.238763+0000","last_clean_scrub_stamp":"2023-12-16T00:04:33.238763+0000","objects_scrubbed":36,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:51.602474+0000","scrub_duration":0.018596789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5302,"num_read_kb":5267,"num_write":135,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8554,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.160224+0000","last_change":"2023-12-16T00:02:44.160224+0000","last_active":"2023-12-16T00:02:44.160224+0000","last_peered":"2023-12-16T00:02:44.160224+0000","last_clean":"2023-12-16T00:02:44.160224+0000","last_became_active":"2023-12-15T22:53:58.172616+0000","last_became_peered":"2023-12-15T22:53:58.172616+0000","last_unstale":"2023-12-16T00:02:44.160224+0000","last_undegraded":"2023-12-16T00:02:44.160224+0000","last_fullsized":"2023-12-16T00:02:44.160224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:44.160143+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.160143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:55:52.112976+0000","scrub_duration":0.00099547799999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"54'22","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.012683+0000","last_change":"2023-12-16T00:02:14.012683+0000","last_active":"2023-12-16T00:02:14.012683+0000","last_peered":"2023-12-16T00:02:14.012683+0000","last_clean":"2023-12-16T00:02:14.012683+0000","last_became_active":"2023-12-15T22:53:32.191431+0000","last_became_peered":"2023-12-15T22:53:32.191431+0000","last_unstale":"2023-12-16T00:02:14.012683+0000","last_undegraded":"2023-12-16T00:02:14.012683+0000","last_fullsized":"2023-12-16T00:02:14.012683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:14.012592+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.012592+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:40.404136+0000","scrub_duration":0.0051119420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":98,"num_write":61,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"54'577","reported_seq":1476,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.427698+0000","last_change":"2023-12-16T00:01:34.861478+0000","last_active":"2023-12-16T00:02:50.427698+0000","last_peered":"2023-12-16T00:02:50.427698+0000","last_clean":"2023-12-16T00:02:50.427698+0000","last_became_active":"2023-12-15T22:53:30.180614+0000","last_became_peered":"2023-12-15T22:53:30.180614+0000","last_unstale":"2023-12-16T00:02:50.427698+0000","last_undegraded":"2023-12-16T00:02:50.427698+0000","last_fullsized":"2023-12-16T00:02:50.427698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:34.861391+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.861391+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:23.677013+0000","scrub_duration":0.002445553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"54'282","reported_seq":553,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.444613+0000","last_change":"2023-12-16T00:01:12.185711+0000","last_active":"2023-12-16T00:02:50.444613+0000","last_peered":"2023-12-16T00:02:50.444613+0000","last_clean":"2023-12-16T00:02:50.444613+0000","last_became_active":"2023-12-15T22:53:28.167780+0000","last_became_peered":"2023-12-15T22:53:28.167780+0000","last_unstale":"2023-12-16T00:02:50.444613+0000","last_undegraded":"2023-12-16T00:02:50.444613+0000","last_fullsized":"2023-12-16T00:02:50.444613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'282","last_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_deep_scrub":"54'282","last_deep_scrub_stamp":"2023-12-16T00:01:12.185599+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.185599+0000","objects_scrubbed":20,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:32.545689+0000","scrub_duration":0.011948617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":491,"num_read_kb":479,"num_write":303,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'12","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414096+0000","last_change":"2023-12-16T00:00:48.250294+0000","last_active":"2023-12-16T00:00:55.414096+0000","last_peered":"2023-12-16T00:00:55.414096+0000","last_clean":"2023-12-16T00:00:55.414096+0000","last_became_active":"2023-12-15T22:53:26.161181+0000","last_became_peered":"2023-12-15T22:53:26.161181+0000","last_unstale":"2023-12-16T00:00:55.414096+0000","last_undegraded":"2023-12-16T00:00:55.414096+0000","last_fullsized":"2023-12-16T00:00:55.414096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:48.250200+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.250200+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:11:49.950688+0000","scrub_duration":0.0044198850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":275,"num_read_kb":274,"num_write":61,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:52.128631+0000","last_change":"2023-12-16T00:03:52.128631+0000","last_active":"2023-12-16T00:03:52.128631+0000","last_peered":"2023-12-16T00:03:52.128631+0000","last_clean":"2023-12-16T00:03:52.128631+0000","last_became_active":"2023-12-15T22:52:55.191195+0000","last_became_peered":"2023-12-15T22:52:55.191195+0000","last_unstale":"2023-12-16T00:03:52.128631+0000","last_undegraded":"2023-12-16T00:03:52.128631+0000","last_fullsized":"2023-12-16T00:03:52.128631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:52.128525+0000","last_clean_scrub_stamp":"2023-12-16T00:03:52.128525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:53.105511+0000","scrub_duration":0.00088122500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.540637+0000","last_change":"2023-12-16T00:03:59.540637+0000","last_active":"2023-12-16T00:03:59.540637+0000","last_peered":"2023-12-16T00:03:59.540637+0000","last_clean":"2023-12-16T00:03:59.540637+0000","last_became_active":"2023-12-15T22:52:07.603040+0000","last_became_peered":"2023-12-15T22:52:07.603040+0000","last_unstale":"2023-12-16T00:03:59.540637+0000","last_undegraded":"2023-12-16T00:03:59.540637+0000","last_fullsized":"2023-12-16T00:03:59.540637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:59.540485+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.540485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:06.902422+0000","scrub_duration":0.001346311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"54'163","reported_seq":300,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:30.193935+0000","last_change":"2023-12-16T00:04:30.193971+0000","last_active":"2023-12-16T00:04:30.193935+0000","last_peered":"2023-12-16T00:04:30.193935+0000","last_clean":"2023-12-16T00:04:30.193935+0000","last_became_active":"2023-12-15T22:52:07.606909+0000","last_became_peered":"2023-12-15T22:52:07.606909+0000","last_unstale":"2023-12-16T00:04:30.193935+0000","last_undegraded":"2023-12-16T00:04:30.193935+0000","last_fullsized":"2023-12-16T00:04:30.193935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'163","last_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_deep_scrub":"54'163","last_deep_scrub_stamp":"2023-12-16T00:04:30.193875+0000","last_clean_scrub_stamp":"2023-12-16T00:04:30.193875+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:19.677418+0000","scrub_duration":0.0057472679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:15.221706+0000","last_change":"2023-12-16T00:04:15.221724+0000","last_active":"2023-12-16T00:04:15.221706+0000","last_peered":"2023-12-16T00:04:15.221706+0000","last_clean":"2023-12-16T00:04:15.221706+0000","last_became_active":"2023-12-15T22:52:53.175393+0000","last_became_peered":"2023-12-15T22:52:53.175393+0000","last_unstale":"2023-12-16T00:04:15.221706+0000","last_undegraded":"2023-12-16T00:04:15.221706+0000","last_fullsized":"2023-12-16T00:04:15.221706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:15.221646+0000","last_clean_scrub_stamp":"2023-12-16T00:04:15.221646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:47:22.707320+0000","scrub_duration":0.0012625480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"54'2","reported_seq":303,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.152541+0000","last_change":"2023-12-16T00:03:24.152541+0000","last_active":"2023-12-16T00:03:24.152541+0000","last_peered":"2023-12-16T00:03:24.152541+0000","last_clean":"2023-12-16T00:03:24.152541+0000","last_became_active":"2023-12-15T22:53:04.318997+0000","last_became_peered":"2023-12-15T22:53:04.318997+0000","last_unstale":"2023-12-16T00:03:24.152541+0000","last_undegraded":"2023-12-16T00:03:24.152541+0000","last_fullsized":"2023-12-16T00:03:24.152541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:24.152464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.152464+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:38.547138+0000","scrub_duration":0.002482817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"54'121","reported_seq":991,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.196285+0000","last_change":"2023-12-16T00:02:25.196285+0000","last_active":"2023-12-16T00:02:25.196285+0000","last_peered":"2023-12-16T00:02:25.196285+0000","last_clean":"2023-12-16T00:02:25.196285+0000","last_became_active":"2023-12-15T22:53:06.321040+0000","last_became_peered":"2023-12-15T22:53:06.321040+0000","last_unstale":"2023-12-16T00:02:25.196285+0000","last_undegraded":"2023-12-16T00:02:25.196285+0000","last_fullsized":"2023-12-16T00:02:25.196285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'121","last_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_deep_scrub":"54'121","last_deep_scrub_stamp":"2023-12-16T00:02:25.196154+0000","last_clean_scrub_stamp":"2023-12-16T00:02:25.196154+0000","objects_scrubbed":10,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:05.128812+0000","scrub_duration":0.0064055960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":180,"num_read_kb":165,"num_write":104,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.483332+0000","last_change":"2023-12-16T00:02:23.483332+0000","last_active":"2023-12-16T00:02:23.483332+0000","last_peered":"2023-12-16T00:02:23.483332+0000","last_clean":"2023-12-16T00:02:23.483332+0000","last_became_active":"2023-12-15T22:53:08.331812+0000","last_became_peered":"2023-12-15T22:53:08.331812+0000","last_unstale":"2023-12-16T00:02:23.483332+0000","last_undegraded":"2023-12-16T00:02:23.483332+0000","last_fullsized":"2023-12-16T00:02:23.483332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:23.483255+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.483255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:26.050414+0000","scrub_duration":0.001316247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.658195+0000","last_change":"2023-12-16T00:01:15.897143+0000","last_active":"2023-12-16T00:02:40.658195+0000","last_peered":"2023-12-16T00:02:40.658195+0000","last_clean":"2023-12-16T00:02:40.658195+0000","last_became_active":"2023-12-15T22:53:11.079699+0000","last_became_peered":"2023-12-15T22:53:11.079699+0000","last_unstale":"2023-12-16T00:02:40.658195+0000","last_undegraded":"2023-12-16T00:02:40.658195+0000","last_fullsized":"2023-12-16T00:02:40.658195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:15.897067+0000","last_clean_scrub_stamp":"2023-12-16T00:01:15.897067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:43.953874+0000","scrub_duration":0.00092592100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.179622+0000","last_change":"2023-12-16T00:03:55.179622+0000","last_active":"2023-12-16T00:03:55.179622+0000","last_peered":"2023-12-16T00:03:55.179622+0000","last_clean":"2023-12-16T00:03:55.179622+0000","last_became_active":"2023-12-15T23:08:37.339566+0000","last_became_peered":"2023-12-15T23:08:37.339566+0000","last_unstale":"2023-12-16T00:03:55.179622+0000","last_undegraded":"2023-12-16T00:03:55.179622+0000","last_fullsized":"2023-12-16T00:03:55.179622+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.179520+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.179520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:26:19.218144+0000","scrub_duration":0.00092174800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"54'119","reported_seq":1298,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.966553+0000","last_change":"2023-12-16T00:03:18.966553+0000","last_active":"2023-12-16T00:03:18.966553+0000","last_peered":"2023-12-16T00:03:18.966553+0000","last_clean":"2023-12-16T00:03:18.966553+0000","last_became_active":"2023-12-15T22:54:04.188525+0000","last_became_peered":"2023-12-15T22:54:04.188525+0000","last_unstale":"2023-12-16T00:03:18.966553+0000","last_undegraded":"2023-12-16T00:03:18.966553+0000","last_fullsized":"2023-12-16T00:03:18.966553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2023-12-16T00:03:18.966464+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.966464+0000","objects_scrubbed":31,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:42.079275+0000","scrub_duration":0.017696940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2070,"num_read_kb":2035,"num_write":129,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9886,"num_omap_keys":37,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.947160+0000","last_change":"2023-12-16T00:01:30.947160+0000","last_active":"2023-12-16T00:01:30.947160+0000","last_peered":"2023-12-16T00:01:30.947160+0000","last_clean":"2023-12-16T00:01:30.947160+0000","last_became_active":"2023-12-15T22:53:58.167600+0000","last_became_peered":"2023-12-15T22:53:58.167600+0000","last_unstale":"2023-12-16T00:01:30.947160+0000","last_undegraded":"2023-12-16T00:01:30.947160+0000","last_fullsized":"2023-12-16T00:01:30.947160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:30.947077+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.947077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:49:25.159151+0000","scrub_duration":0.0014044649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"54'2","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.428863+0000","last_change":"2023-12-16T00:01:08.874764+0000","last_active":"2023-12-16T00:02:55.428863+0000","last_peered":"2023-12-16T00:02:55.428863+0000","last_clean":"2023-12-16T00:02:55.428863+0000","last_became_active":"2023-12-15T22:53:32.191237+0000","last_became_peered":"2023-12-15T22:53:32.191237+0000","last_unstale":"2023-12-16T00:02:55.428863+0000","last_undegraded":"2023-12-16T00:02:55.428863+0000","last_fullsized":"2023-12-16T00:02:55.428863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:08.874680+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.874680+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:21:02.496592+0000","scrub_duration":0.0024196249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"54'577","reported_seq":1457,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:02.818289+0000","last_change":"2023-12-16T00:01:02.818289+0000","last_active":"2023-12-16T00:01:02.818289+0000","last_peered":"2023-12-16T00:01:02.818289+0000","last_clean":"2023-12-16T00:01:02.818289+0000","last_became_active":"2023-12-15T22:53:30.180839+0000","last_became_peered":"2023-12-15T22:53:30.180839+0000","last_unstale":"2023-12-16T00:01:02.818289+0000","last_undegraded":"2023-12-16T00:01:02.818289+0000","last_fullsized":"2023-12-16T00:01:02.818289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:02.818226+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.818226+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:31:35.869663+0000","scrub_duration":0.0023825629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"54'270","reported_seq":512,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.420423+0000","last_change":"2023-12-16T00:01:09.905760+0000","last_active":"2023-12-16T00:01:15.420423+0000","last_peered":"2023-12-16T00:01:15.420423+0000","last_clean":"2023-12-16T00:01:15.420423+0000","last_became_active":"2023-12-15T22:53:28.173168+0000","last_became_peered":"2023-12-15T22:53:28.173168+0000","last_unstale":"2023-12-16T00:01:15.420423+0000","last_undegraded":"2023-12-16T00:01:15.420423+0000","last_fullsized":"2023-12-16T00:01:15.420423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'270","last_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_deep_scrub":"54'270","last_deep_scrub_stamp":"2023-12-16T00:01:09.905665+0000","last_clean_scrub_stamp":"2023-12-16T00:01:09.905665+0000","objects_scrubbed":18,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:56:14.533700+0000","scrub_duration":0.0091059009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":329,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"54'2","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:58.644862+0000","last_change":"2023-12-16T00:01:58.644862+0000","last_active":"2023-12-16T00:01:58.644862+0000","last_peered":"2023-12-16T00:01:58.644862+0000","last_clean":"2023-12-16T00:01:58.644862+0000","last_became_active":"2023-12-15T22:53:26.157348+0000","last_became_peered":"2023-12-15T22:53:26.157348+0000","last_unstale":"2023-12-16T00:01:58.644862+0000","last_undegraded":"2023-12-16T00:01:58.644862+0000","last_fullsized":"2023-12-16T00:01:58.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:01:58.644783+0000","last_clean_scrub_stamp":"2023-12-16T00:01:58.644783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:13.046766+0000","scrub_duration":0.0027850510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:25.464112+0000","last_change":"2023-12-16T00:03:25.464112+0000","last_active":"2023-12-16T00:03:25.464112+0000","last_peered":"2023-12-16T00:03:25.464112+0000","last_clean":"2023-12-16T00:03:25.464112+0000","last_became_active":"2023-12-15T22:52:55.190714+0000","last_became_peered":"2023-12-15T22:52:55.190714+0000","last_unstale":"2023-12-16T00:03:25.464112+0000","last_undegraded":"2023-12-16T00:03:25.464112+0000","last_fullsized":"2023-12-16T00:03:25.464112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:25.464021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:25.464021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:53.630911+0000","scrub_duration":0.00094116000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.200715+0000","last_change":"2023-12-16T00:04:11.200715+0000","last_active":"2023-12-16T00:04:11.200715+0000","last_peered":"2023-12-16T00:04:11.200715+0000","last_clean":"2023-12-16T00:04:11.200715+0000","last_became_active":"2023-12-15T22:52:53.173420+0000","last_became_peered":"2023-12-15T22:52:53.173420+0000","last_unstale":"2023-12-16T00:04:11.200715+0000","last_undegraded":"2023-12-16T00:04:11.200715+0000","last_fullsized":"2023-12-16T00:04:11.200715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.200632+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.200632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:05.973413+0000","scrub_duration":0.00096315500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:00.494673+0000","last_change":"2023-12-16T00:04:00.494673+0000","last_active":"2023-12-16T00:04:00.494673+0000","last_peered":"2023-12-16T00:04:00.494673+0000","last_clean":"2023-12-16T00:04:00.494673+0000","last_became_active":"2023-12-15T22:52:07.607094+0000","last_became_peered":"2023-12-15T22:52:07.607094+0000","last_unstale":"2023-12-16T00:04:00.494673+0000","last_undegraded":"2023-12-16T00:04:00.494673+0000","last_fullsized":"2023-12-16T00:04:00.494673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:00.494574+0000","last_clean_scrub_stamp":"2023-12-16T00:04:00.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:12.576991+0000","scrub_duration":0.0013840110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.581630+0000","last_change":"2023-12-16T00:02:49.581630+0000","last_active":"2023-12-16T00:02:49.581630+0000","last_peered":"2023-12-16T00:02:49.581630+0000","last_clean":"2023-12-16T00:02:49.581630+0000","last_became_active":"2023-12-15T22:53:04.318922+0000","last_became_peered":"2023-12-15T22:53:04.318922+0000","last_unstale":"2023-12-16T00:02:49.581630+0000","last_undegraded":"2023-12-16T00:02:49.581630+0000","last_fullsized":"2023-12-16T00:02:49.581630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:49.581552+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.581552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:52.148710+0000","scrub_duration":0.0023613000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"54'96","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:53.529769+0000","last_change":"2023-12-16T00:02:53.529769+0000","last_active":"2023-12-16T00:02:53.529769+0000","last_peered":"2023-12-16T00:02:53.529769+0000","last_clean":"2023-12-16T00:02:53.529769+0000","last_became_active":"2023-12-15T22:53:06.322859+0000","last_became_peered":"2023-12-15T22:53:06.322859+0000","last_unstale":"2023-12-16T00:02:53.529769+0000","last_undegraded":"2023-12-16T00:02:53.529769+0000","last_fullsized":"2023-12-16T00:02:53.529769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'96","last_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_deep_scrub":"54'96","last_deep_scrub_stamp":"2023-12-16T00:02:53.529661+0000","last_clean_scrub_stamp":"2023-12-16T00:02:53.529661+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:58.950085+0000","scrub_duration":0.0051603509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":88,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:16.662996+0000","last_change":"2023-12-16T00:02:16.662996+0000","last_active":"2023-12-16T00:02:16.662996+0000","last_peered":"2023-12-16T00:02:16.662996+0000","last_clean":"2023-12-16T00:02:16.662996+0000","last_became_active":"2023-12-15T22:53:08.334244+0000","last_became_peered":"2023-12-15T22:53:08.334244+0000","last_unstale":"2023-12-16T00:02:16.662996+0000","last_undegraded":"2023-12-16T00:02:16.662996+0000","last_fullsized":"2023-12-16T00:02:16.662996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:16.662900+0000","last_clean_scrub_stamp":"2023-12-16T00:02:16.662900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:38:02.601880+0000","scrub_duration":0.00092272199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.447237+0000","last_change":"2023-12-16T00:01:26.722648+0000","last_active":"2023-12-16T00:02:55.447237+0000","last_peered":"2023-12-16T00:02:55.447237+0000","last_clean":"2023-12-16T00:02:55.447237+0000","last_became_active":"2023-12-15T22:53:10.340919+0000","last_became_peered":"2023-12-15T22:53:10.340919+0000","last_unstale":"2023-12-16T00:02:55.447237+0000","last_undegraded":"2023-12-16T00:02:55.447237+0000","last_fullsized":"2023-12-16T00:02:55.447237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.722564+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.722564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:45.346811+0000","scrub_duration":0.000969095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:56.142490+0000","last_change":"2023-12-16T00:03:56.142490+0000","last_active":"2023-12-16T00:03:56.142490+0000","last_peered":"2023-12-16T00:03:56.142490+0000","last_clean":"2023-12-16T00:03:56.142490+0000","last_became_active":"2023-12-15T23:08:37.342416+0000","last_became_peered":"2023-12-15T23:08:37.342416+0000","last_unstale":"2023-12-16T00:03:56.142490+0000","last_undegraded":"2023-12-16T00:03:56.142490+0000","last_fullsized":"2023-12-16T00:03:56.142490+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:56.142408+0000","last_clean_scrub_stamp":"2023-12-16T00:03:56.142408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:45.112014+0000","scrub_duration":0.00089426600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"54'137","reported_seq":5951,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.323807+0000","last_change":"2023-12-16T00:03:09.323807+0000","last_active":"2023-12-16T00:03:09.323807+0000","last_peered":"2023-12-16T00:03:09.323807+0000","last_clean":"2023-12-16T00:03:09.323807+0000","last_became_active":"2023-12-15T22:54:04.184319+0000","last_became_peered":"2023-12-15T22:54:04.184319+0000","last_unstale":"2023-12-16T00:03:09.323807+0000","last_undegraded":"2023-12-16T00:03:09.323807+0000","last_fullsized":"2023-12-16T00:03:09.323807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'137","last_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_deep_scrub":"54'137","last_deep_scrub_stamp":"2023-12-16T00:03:09.323683+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.323683+0000","objects_scrubbed":45,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:06:28.836039+0000","scrub_duration":0.021715292000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6564,"num_read_kb":6535,"num_write":123,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7287,"num_omap_keys":29,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.326942+0000","last_change":"2023-12-16T00:02:24.326942+0000","last_active":"2023-12-16T00:02:24.326942+0000","last_peered":"2023-12-16T00:02:24.326942+0000","last_clean":"2023-12-16T00:02:24.326942+0000","last_became_active":"2023-12-15T22:53:58.167280+0000","last_became_peered":"2023-12-15T22:53:58.167280+0000","last_unstale":"2023-12-16T00:02:24.326942+0000","last_undegraded":"2023-12-16T00:02:24.326942+0000","last_fullsized":"2023-12-16T00:02:24.326942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:24.326857+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.326857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:07:18.181514+0000","scrub_duration":0.001381838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"54'8","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.428725+0000","last_change":"2023-12-16T00:01:10.840149+0000","last_active":"2023-12-16T00:02:55.428725+0000","last_peered":"2023-12-16T00:02:55.428725+0000","last_clean":"2023-12-16T00:02:55.428725+0000","last_became_active":"2023-12-15T22:53:32.194250+0000","last_became_peered":"2023-12-15T22:53:32.194250+0000","last_unstale":"2023-12-16T00:02:55.428725+0000","last_undegraded":"2023-12-16T00:02:55.428725+0000","last_fullsized":"2023-12-16T00:02:55.428725+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.840058+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.840058+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:12.720628+0000","scrub_duration":0.002755726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":710,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:37.228233+0000","last_change":"2023-12-16T00:01:37.228233+0000","last_active":"2023-12-16T00:01:37.228233+0000","last_peered":"2023-12-16T00:01:37.228233+0000","last_clean":"2023-12-16T00:01:37.228233+0000","last_became_active":"2023-12-15T22:53:30.180738+0000","last_became_peered":"2023-12-15T22:53:30.180738+0000","last_unstale":"2023-12-16T00:01:37.228233+0000","last_undegraded":"2023-12-16T00:01:37.228233+0000","last_fullsized":"2023-12-16T00:01:37.228233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:37.228120+0000","last_clean_scrub_stamp":"2023-12-16T00:01:37.228120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:37.846120+0000","scrub_duration":0.001233874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"54'478","reported_seq":740,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403692+0000","last_change":"2023-12-16T00:00:30.359714+0000","last_active":"2023-12-16T00:01:01.403692+0000","last_peered":"2023-12-16T00:01:01.403692+0000","last_clean":"2023-12-16T00:01:01.403692+0000","last_became_active":"2023-12-15T22:53:28.169698+0000","last_became_peered":"2023-12-15T22:53:28.169698+0000","last_unstale":"2023-12-16T00:01:01.403692+0000","last_undegraded":"2023-12-16T00:01:01.403692+0000","last_fullsized":"2023-12-16T00:01:01.403692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'478","last_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_deep_scrub":"54'478","last_deep_scrub_stamp":"2023-12-16T00:00:30.359628+0000","last_clean_scrub_stamp":"2023-12-16T00:00:30.359628+0000","objects_scrubbed":27,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:45.459977+0000","scrub_duration":0.017785751999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":652,"num_read_kb":641,"num_write":775,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52840,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'14","reported_seq":150,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414697+0000","last_change":"2023-12-16T00:00:39.090940+0000","last_active":"2023-12-16T00:00:55.414697+0000","last_peered":"2023-12-16T00:00:55.414697+0000","last_clean":"2023-12-16T00:00:55.414697+0000","last_became_active":"2023-12-15T22:53:26.159206+0000","last_became_peered":"2023-12-15T22:53:26.159206+0000","last_unstale":"2023-12-16T00:00:55.414697+0000","last_undegraded":"2023-12-16T00:00:55.414697+0000","last_fullsized":"2023-12-16T00:00:55.414697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:00:39.090846+0000","last_clean_scrub_stamp":"2023-12-16T00:00:39.090846+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:51:41.696098+0000","scrub_duration":0.0040069049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":170,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.855259+0000","last_change":"2023-12-16T00:03:23.855259+0000","last_active":"2023-12-16T00:03:23.855259+0000","last_peered":"2023-12-16T00:03:23.855259+0000","last_clean":"2023-12-16T00:03:23.855259+0000","last_became_active":"2023-12-15T22:52:55.191816+0000","last_became_peered":"2023-12-15T22:52:55.191816+0000","last_unstale":"2023-12-16T00:03:23.855259+0000","last_undegraded":"2023-12-16T00:03:23.855259+0000","last_fullsized":"2023-12-16T00:03:23.855259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.855176+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.855176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:05:33.809147+0000","scrub_duration":0.001489221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:41.233244+0000","last_change":"2023-12-16T00:03:41.233244+0000","last_active":"2023-12-16T00:03:41.233244+0000","last_peered":"2023-12-16T00:03:41.233244+0000","last_clean":"2023-12-16T00:03:41.233244+0000","last_became_active":"2023-12-15T22:52:53.173499+0000","last_became_peered":"2023-12-15T22:52:53.173499+0000","last_unstale":"2023-12-16T00:03:41.233244+0000","last_undegraded":"2023-12-16T00:03:41.233244+0000","last_fullsized":"2023-12-16T00:03:41.233244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:41.233146+0000","last_clean_scrub_stamp":"2023-12-16T00:03:41.233146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:27:29.219613+0000","scrub_duration":0.00094526300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.537375+0000","last_change":"2023-12-16T00:03:35.537411+0000","last_active":"2023-12-16T00:03:35.537375+0000","last_peered":"2023-12-16T00:03:35.537375+0000","last_clean":"2023-12-16T00:03:35.537375+0000","last_became_active":"2023-12-15T22:52:08.041831+0000","last_became_peered":"2023-12-15T22:52:08.041831+0000","last_unstale":"2023-12-16T00:03:35.537375+0000","last_undegraded":"2023-12-16T00:03:35.537375+0000","last_fullsized":"2023-12-16T00:03:35.537375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.537285+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.537285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:54.142352+0000","scrub_duration":0.0011419679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"54'2","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.335105+0000","last_change":"2023-12-16T00:03:07.335105+0000","last_active":"2023-12-16T00:03:07.335105+0000","last_peered":"2023-12-16T00:03:07.335105+0000","last_clean":"2023-12-16T00:03:07.335105+0000","last_became_active":"2023-12-15T22:53:04.318148+0000","last_became_peered":"2023-12-15T22:53:04.318148+0000","last_unstale":"2023-12-16T00:03:07.335105+0000","last_undegraded":"2023-12-16T00:03:07.335105+0000","last_fullsized":"2023-12-16T00:03:07.335105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:07.335021+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.335021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:21:42.296786+0000","scrub_duration":0.0030096789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"54'75","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.453548+0000","last_change":"2023-12-16T00:02:34.453548+0000","last_active":"2023-12-16T00:02:34.453548+0000","last_peered":"2023-12-16T00:02:34.453548+0000","last_clean":"2023-12-16T00:02:34.453548+0000","last_became_active":"2023-12-15T22:53:06.324594+0000","last_became_peered":"2023-12-15T22:53:06.324594+0000","last_unstale":"2023-12-16T00:02:34.453548+0000","last_undegraded":"2023-12-16T00:02:34.453548+0000","last_fullsized":"2023-12-16T00:02:34.453548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:34.453438+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.453438+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:35.826735+0000","scrub_duration":0.0040721730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:44.116761+0000","last_change":"2023-12-16T00:02:44.116761+0000","last_active":"2023-12-16T00:02:44.116761+0000","last_peered":"2023-12-16T00:02:44.116761+0000","last_clean":"2023-12-16T00:02:44.116761+0000","last_became_active":"2023-12-15T22:53:08.333188+0000","last_became_peered":"2023-12-15T22:53:08.333188+0000","last_unstale":"2023-12-16T00:02:44.116761+0000","last_undegraded":"2023-12-16T00:02:44.116761+0000","last_fullsized":"2023-12-16T00:02:44.116761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:44.116679+0000","last_clean_scrub_stamp":"2023-12-16T00:02:44.116679+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:24.928997+0000","scrub_duration":0.0021644849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.446330+0000","last_change":"2023-12-16T00:01:34.199809+0000","last_active":"2023-12-16T00:02:55.446330+0000","last_peered":"2023-12-16T00:02:55.446330+0000","last_clean":"2023-12-16T00:02:55.446330+0000","last_became_active":"2023-12-15T22:53:11.077410+0000","last_became_peered":"2023-12-15T22:53:11.077410+0000","last_unstale":"2023-12-16T00:02:55.446330+0000","last_undegraded":"2023-12-16T00:02:55.446330+0000","last_fullsized":"2023-12-16T00:02:55.446330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:34.199705+0000","last_clean_scrub_stamp":"2023-12-16T00:01:34.199705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:34.219852+0000","scrub_duration":0.00093555500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.097038+0000","last_change":"2023-12-16T00:03:57.097038+0000","last_active":"2023-12-16T00:03:57.097038+0000","last_peered":"2023-12-16T00:03:57.097038+0000","last_clean":"2023-12-16T00:03:57.097038+0000","last_became_active":"2023-12-15T23:08:37.337363+0000","last_became_peered":"2023-12-15T23:08:37.337363+0000","last_unstale":"2023-12-16T00:03:57.097038+0000","last_undegraded":"2023-12-16T00:03:57.097038+0000","last_fullsized":"2023-12-16T00:03:57.097038+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.096950+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.096950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:03.688612+0000","scrub_duration":0.0011013220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"54'127","reported_seq":1444,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.135021+0000","last_change":"2023-12-16T00:03:26.135069+0000","last_active":"2023-12-16T00:03:26.135021+0000","last_peered":"2023-12-16T00:03:26.135021+0000","last_clean":"2023-12-16T00:03:26.135021+0000","last_became_active":"2023-12-15T22:54:04.180262+0000","last_became_peered":"2023-12-15T22:54:04.180262+0000","last_unstale":"2023-12-16T00:03:26.135021+0000","last_undegraded":"2023-12-16T00:03:26.135021+0000","last_fullsized":"2023-12-16T00:03:26.135021+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'127","last_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_deep_scrub":"54'127","last_deep_scrub_stamp":"2023-12-16T00:03:26.134966+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.134966+0000","objects_scrubbed":36,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:55:48.788982+0000","scrub_duration":0.0154567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2231,"num_read_kb":2200,"num_write":138,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9619,"num_omap_keys":36,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.629219+0000","last_change":"2023-12-16T00:01:50.629219+0000","last_active":"2023-12-16T00:01:50.629219+0000","last_peered":"2023-12-16T00:01:50.629219+0000","last_clean":"2023-12-16T00:01:50.629219+0000","last_became_active":"2023-12-15T22:53:58.167707+0000","last_became_peered":"2023-12-15T22:53:58.167707+0000","last_unstale":"2023-12-16T00:01:50.629219+0000","last_undegraded":"2023-12-16T00:01:50.629219+0000","last_fullsized":"2023-12-16T00:01:50.629219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.629143+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.629143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:07:13.032202+0000","scrub_duration":0.00077094299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"54'2","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.339093+0000","last_change":"2023-12-16T00:02:33.339093+0000","last_active":"2023-12-16T00:02:33.339093+0000","last_peered":"2023-12-16T00:02:33.339093+0000","last_clean":"2023-12-16T00:02:33.339093+0000","last_became_active":"2023-12-15T22:53:32.192074+0000","last_became_peered":"2023-12-15T22:53:32.192074+0000","last_unstale":"2023-12-16T00:02:33.339093+0000","last_undegraded":"2023-12-16T00:02:33.339093+0000","last_fullsized":"2023-12-16T00:02:33.339093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:02:33.338972+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.338972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:31:46.383715+0000","scrub_duration":0.0023297449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":27,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":66,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.921209+0000","last_change":"2023-12-16T00:01:43.921209+0000","last_active":"2023-12-16T00:01:43.921209+0000","last_peered":"2023-12-16T00:01:43.921209+0000","last_clean":"2023-12-16T00:01:43.921209+0000","last_became_active":"2023-12-15T22:53:30.177583+0000","last_became_peered":"2023-12-15T22:53:30.177583+0000","last_unstale":"2023-12-16T00:01:43.921209+0000","last_undegraded":"2023-12-16T00:01:43.921209+0000","last_fullsized":"2023-12-16T00:01:43.921209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:43.921096+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.921096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:49.184050+0000","scrub_duration":0.00090031300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'530","reported_seq":777,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403539+0000","last_change":"2023-12-16T00:00:42.388117+0000","last_active":"2023-12-16T00:01:01.403539+0000","last_peered":"2023-12-16T00:01:01.403539+0000","last_clean":"2023-12-16T00:01:01.403539+0000","last_became_active":"2023-12-15T22:53:28.169683+0000","last_became_peered":"2023-12-15T22:53:28.169683+0000","last_unstale":"2023-12-16T00:01:01.403539+0000","last_undegraded":"2023-12-16T00:01:01.403539+0000","last_fullsized":"2023-12-16T00:01:01.403539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'530","last_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_deep_scrub":"54'530","last_deep_scrub_stamp":"2023-12-16T00:00:42.387944+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.387944+0000","objects_scrubbed":22,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:05.194113+0000","scrub_duration":0.014242299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":668,"num_read_kb":657,"num_write":799,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":52838,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"54'6","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414799+0000","last_change":"2023-12-16T00:00:28.096310+0000","last_active":"2023-12-16T00:00:55.414799+0000","last_peered":"2023-12-16T00:00:55.414799+0000","last_clean":"2023-12-16T00:00:55.414799+0000","last_became_active":"2023-12-15T22:53:26.156599+0000","last_became_peered":"2023-12-15T22:53:26.156599+0000","last_unstale":"2023-12-16T00:00:55.414799+0000","last_undegraded":"2023-12-16T00:00:55.414799+0000","last_fullsized":"2023-12-16T00:00:55.414799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:28.096217+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.096217+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:22.308290+0000","scrub_duration":0.002759722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.896996+0000","last_change":"2023-12-16T00:03:35.896996+0000","last_active":"2023-12-16T00:03:35.896996+0000","last_peered":"2023-12-16T00:03:35.896996+0000","last_clean":"2023-12-16T00:03:35.896996+0000","last_became_active":"2023-12-15T22:52:55.191525+0000","last_became_peered":"2023-12-15T22:52:55.191525+0000","last_unstale":"2023-12-16T00:03:35.896996+0000","last_undegraded":"2023-12-16T00:03:35.896996+0000","last_fullsized":"2023-12-16T00:03:35.896996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.896905+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.896905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.496966+0000","scrub_duration":0.0014309380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:12.560783+0000","last_change":"2023-12-16T00:04:12.560804+0000","last_active":"2023-12-16T00:04:12.560783+0000","last_peered":"2023-12-16T00:04:12.560783+0000","last_clean":"2023-12-16T00:04:12.560783+0000","last_became_active":"2023-12-15T22:52:53.170169+0000","last_became_peered":"2023-12-15T22:52:53.170169+0000","last_unstale":"2023-12-16T00:04:12.560783+0000","last_undegraded":"2023-12-16T00:04:12.560783+0000","last_fullsized":"2023-12-16T00:04:12.560783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:12.560713+0000","last_clean_scrub_stamp":"2023-12-16T00:04:12.560713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:45:06.835342+0000","scrub_duration":0.001076154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:28.200075+0000","last_change":"2023-12-16T00:04:28.200097+0000","last_active":"2023-12-16T00:04:28.200075+0000","last_peered":"2023-12-16T00:04:28.200075+0000","last_clean":"2023-12-16T00:04:28.200075+0000","last_became_active":"2023-12-15T22:52:08.042474+0000","last_became_peered":"2023-12-15T22:52:08.042474+0000","last_unstale":"2023-12-16T00:04:28.200075+0000","last_undegraded":"2023-12-16T00:04:28.200075+0000","last_fullsized":"2023-12-16T00:04:28.200075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:28.199999+0000","last_clean_scrub_stamp":"2023-12-16T00:04:28.199999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:26:48.754557+0000","scrub_duration":0.001243393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.079336+0000","last_change":"2023-12-16T00:03:38.079336+0000","last_active":"2023-12-16T00:03:38.079336+0000","last_peered":"2023-12-16T00:03:38.079336+0000","last_clean":"2023-12-16T00:03:38.079336+0000","last_became_active":"2023-12-15T22:53:04.315215+0000","last_became_peered":"2023-12-15T22:53:04.315215+0000","last_unstale":"2023-12-16T00:03:38.079336+0000","last_undegraded":"2023-12-16T00:03:38.079336+0000","last_fullsized":"2023-12-16T00:03:38.079336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.079227+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.079227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:55.382772+0000","scrub_duration":0.0013798949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"54'105","reported_seq":234,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.356005+0000","last_change":"2023-12-16T00:02:33.356005+0000","last_active":"2023-12-16T00:02:33.356005+0000","last_peered":"2023-12-16T00:02:33.356005+0000","last_clean":"2023-12-16T00:02:33.356005+0000","last_became_active":"2023-12-15T22:53:06.321076+0000","last_became_peered":"2023-12-15T22:53:06.321076+0000","last_unstale":"2023-12-16T00:02:33.356005+0000","last_undegraded":"2023-12-16T00:02:33.356005+0000","last_fullsized":"2023-12-16T00:02:33.356005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'105","last_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_deep_scrub":"54'105","last_deep_scrub_stamp":"2023-12-16T00:02:33.355894+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.355894+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:08:01.168612+0000","scrub_duration":0.004787103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":140,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"54'13","reported_seq":812,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:49.126706+0000","last_change":"2023-12-16T00:02:49.126706+0000","last_active":"2023-12-16T00:02:49.126706+0000","last_peered":"2023-12-16T00:02:49.126706+0000","last_clean":"2023-12-16T00:02:49.126706+0000","last_became_active":"2023-12-15T22:53:08.332747+0000","last_became_peered":"2023-12-15T22:53:08.332747+0000","last_unstale":"2023-12-16T00:02:49.126706+0000","last_undegraded":"2023-12-16T00:02:49.126706+0000","last_fullsized":"2023-12-16T00:02:49.126706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:49.126623+0000","last_clean_scrub_stamp":"2023-12-16T00:02:49.126623+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:08.316729+0000","scrub_duration":0.002796354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.307425+0000","last_change":"2023-12-16T00:01:26.307425+0000","last_active":"2023-12-16T00:01:26.307425+0000","last_peered":"2023-12-16T00:01:26.307425+0000","last_clean":"2023-12-16T00:01:26.307425+0000","last_became_active":"2023-12-15T22:53:11.077428+0000","last_became_peered":"2023-12-15T22:53:11.077428+0000","last_unstale":"2023-12-16T00:01:26.307425+0000","last_undegraded":"2023-12-16T00:01:26.307425+0000","last_fullsized":"2023-12-16T00:01:26.307425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:26.307297+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.307297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:06.877214+0000","scrub_duration":0.00098923400000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:53.994174+0000","last_change":"2023-12-16T00:04:53.994174+0000","last_active":"2023-12-16T00:04:53.994174+0000","last_peered":"2023-12-16T00:04:53.994174+0000","last_clean":"2023-12-16T00:04:53.994174+0000","last_became_active":"2023-12-15T23:08:37.338331+0000","last_became_peered":"2023-12-15T23:08:37.338331+0000","last_unstale":"2023-12-16T00:04:53.994174+0000","last_undegraded":"2023-12-16T00:04:53.994174+0000","last_fullsized":"2023-12-16T00:04:53.994174+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:53.994092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:53.994092+0000","last_clean_scrub_stamp":"2023-12-16T00:04:53.994092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:45.217340+0000","scrub_duration":0.0011231940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"54'134","reported_seq":3557,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:46.095791+0000","last_change":"2023-12-16T00:02:46.095791+0000","last_active":"2023-12-16T00:02:46.095791+0000","last_peered":"2023-12-16T00:02:46.095791+0000","last_clean":"2023-12-16T00:02:46.095791+0000","last_became_active":"2023-12-15T22:54:04.186503+0000","last_became_peered":"2023-12-15T22:54:04.186503+0000","last_unstale":"2023-12-16T00:02:46.095791+0000","last_undegraded":"2023-12-16T00:02:46.095791+0000","last_fullsized":"2023-12-16T00:02:46.095791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'134","last_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_deep_scrub":"54'134","last_deep_scrub_stamp":"2023-12-16T00:02:46.095692+0000","last_clean_scrub_stamp":"2023-12-16T00:02:46.095692+0000","objects_scrubbed":34,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:26.877362+0000","scrub_duration":0.019646896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4136,"num_read_kb":4105,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7578,"num_omap_keys":28,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:59.396540+0000","last_change":"2023-12-16T00:01:59.396540+0000","last_active":"2023-12-16T00:01:59.396540+0000","last_peered":"2023-12-16T00:01:59.396540+0000","last_clean":"2023-12-16T00:01:59.396540+0000","last_became_active":"2023-12-15T22:53:58.169842+0000","last_became_peered":"2023-12-15T22:53:58.169842+0000","last_unstale":"2023-12-16T00:01:59.396540+0000","last_undegraded":"2023-12-16T00:01:59.396540+0000","last_fullsized":"2023-12-16T00:01:59.396540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:59.396422+0000","last_clean_scrub_stamp":"2023-12-16T00:01:59.396422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:06.251658+0000","scrub_duration":0.001110654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"47'2","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:12.791802+0000","last_change":"2023-12-16T00:01:12.791802+0000","last_active":"2023-12-16T00:01:12.791802+0000","last_peered":"2023-12-16T00:01:12.791802+0000","last_clean":"2023-12-16T00:01:12.791802+0000","last_became_active":"2023-12-15T22:53:32.194713+0000","last_became_peered":"2023-12-15T22:53:32.194713+0000","last_unstale":"2023-12-16T00:01:12.791802+0000","last_undegraded":"2023-12-16T00:01:12.791802+0000","last_fullsized":"2023-12-16T00:01:12.791802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'2","last_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_deep_scrub":"47'2","last_deep_scrub_stamp":"2023-12-16T00:01:12.791720+0000","last_clean_scrub_stamp":"2023-12-16T00:01:12.791720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:35.597889+0000","scrub_duration":0.00099905799999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"54'577","reported_seq":1452,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:28.950205+0000","last_change":"2023-12-16T00:01:28.950205+0000","last_active":"2023-12-16T00:01:28.950205+0000","last_peered":"2023-12-16T00:01:28.950205+0000","last_clean":"2023-12-16T00:01:28.950205+0000","last_became_active":"2023-12-15T22:53:30.174674+0000","last_became_peered":"2023-12-15T22:53:30.174674+0000","last_unstale":"2023-12-16T00:01:28.950205+0000","last_undegraded":"2023-12-16T00:01:28.950205+0000","last_fullsized":"2023-12-16T00:01:28.950205+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:28.950123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.950123+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:47:41.524159+0000","scrub_duration":0.0024998189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"54'278","reported_seq":447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403462+0000","last_change":"2023-12-16T00:00:36.333082+0000","last_active":"2023-12-16T00:01:01.403462+0000","last_peered":"2023-12-16T00:01:01.403462+0000","last_clean":"2023-12-16T00:01:01.403462+0000","last_became_active":"2023-12-15T22:53:28.169864+0000","last_became_peered":"2023-12-15T22:53:28.169864+0000","last_unstale":"2023-12-16T00:01:01.403462+0000","last_undegraded":"2023-12-16T00:01:01.403462+0000","last_fullsized":"2023-12-16T00:01:01.403462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'278","last_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_deep_scrub":"54'278","last_deep_scrub_stamp":"2023-12-16T00:00:36.332903+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.332903+0000","objects_scrubbed":21,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:51:50.122552+0000","scrub_duration":0.014455024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":403,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17388,"num_omap_keys":77,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"54'16","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418951+0000","last_change":"2023-12-16T00:01:00.804753+0000","last_active":"2023-12-16T00:01:10.418951+0000","last_peered":"2023-12-16T00:01:10.418951+0000","last_clean":"2023-12-16T00:01:10.418951+0000","last_became_active":"2023-12-15T22:53:26.165126+0000","last_became_peered":"2023-12-15T22:53:26.165126+0000","last_unstale":"2023-12-16T00:01:10.418951+0000","last_undegraded":"2023-12-16T00:01:10.418951+0000","last_fullsized":"2023-12-16T00:01:10.418951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'16","last_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_deep_scrub":"54'16","last_deep_scrub_stamp":"2023-12-16T00:01:00.804614+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.804614+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:29:32.778114+0000","scrub_duration":0.004012537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":303,"num_read_kb":281,"num_write":75,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.553856+0000","last_change":"2023-12-16T00:03:33.553856+0000","last_active":"2023-12-16T00:03:33.553856+0000","last_peered":"2023-12-16T00:03:33.553856+0000","last_clean":"2023-12-16T00:03:33.553856+0000","last_became_active":"2023-12-15T22:52:55.190725+0000","last_became_peered":"2023-12-15T22:52:55.190725+0000","last_unstale":"2023-12-16T00:03:33.553856+0000","last_undegraded":"2023-12-16T00:03:33.553856+0000","last_fullsized":"2023-12-16T00:03:33.553856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.553765+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.553765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:14.335435+0000","scrub_duration":0.001373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:18.736355+0000","last_change":"2023-12-16T00:04:18.736375+0000","last_active":"2023-12-16T00:04:18.736355+0000","last_peered":"2023-12-16T00:04:18.736355+0000","last_clean":"2023-12-16T00:04:18.736355+0000","last_became_active":"2023-12-15T22:52:53.175591+0000","last_became_peered":"2023-12-15T22:52:53.175591+0000","last_unstale":"2023-12-16T00:04:18.736355+0000","last_undegraded":"2023-12-16T00:04:18.736355+0000","last_fullsized":"2023-12-16T00:04:18.736355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:18.736296+0000","last_clean_scrub_stamp":"2023-12-16T00:04:18.736296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:48.764498+0000","scrub_duration":0.001450713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:32.847040+0000","last_change":"2023-12-16T00:04:32.847063+0000","last_active":"2023-12-16T00:04:32.847040+0000","last_peered":"2023-12-16T00:04:32.847040+0000","last_clean":"2023-12-16T00:04:32.847040+0000","last_became_active":"2023-12-15T22:52:08.041790+0000","last_became_peered":"2023-12-15T22:52:08.041790+0000","last_unstale":"2023-12-16T00:04:32.847040+0000","last_undegraded":"2023-12-16T00:04:32.847040+0000","last_fullsized":"2023-12-16T00:04:32.847040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:32.846963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:32.846963+0000","last_clean_scrub_stamp":"2023-12-16T00:04:32.846963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:03:43.762694+0000","scrub_duration":0.001381492,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.968164+0000","last_change":"2023-12-16T00:03:15.968164+0000","last_active":"2023-12-16T00:03:15.968164+0000","last_peered":"2023-12-16T00:03:15.968164+0000","last_clean":"2023-12-16T00:03:15.968164+0000","last_became_active":"2023-12-15T22:53:04.315254+0000","last_became_peered":"2023-12-15T22:53:04.315254+0000","last_unstale":"2023-12-16T00:03:15.968164+0000","last_undegraded":"2023-12-16T00:03:15.968164+0000","last_fullsized":"2023-12-16T00:03:15.968164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:15.968070+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.968070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:31.264615+0000","scrub_duration":0.002573484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"54'104","reported_seq":243,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.964663+0000","last_change":"2023-12-16T00:03:05.964663+0000","last_active":"2023-12-16T00:03:05.964663+0000","last_peered":"2023-12-16T00:03:05.964663+0000","last_clean":"2023-12-16T00:03:05.964663+0000","last_became_active":"2023-12-15T22:53:06.324578+0000","last_became_peered":"2023-12-15T22:53:06.324578+0000","last_unstale":"2023-12-16T00:03:05.964663+0000","last_undegraded":"2023-12-16T00:03:05.964663+0000","last_fullsized":"2023-12-16T00:03:05.964663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'104","last_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_deep_scrub":"54'104","last_deep_scrub_stamp":"2023-12-16T00:03:05.964543+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.964543+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.408620+0000","scrub_duration":0.0053722630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":142,"num_write":96,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.561094+0000","last_change":"2023-12-16T00:02:30.561094+0000","last_active":"2023-12-16T00:02:30.561094+0000","last_peered":"2023-12-16T00:02:30.561094+0000","last_clean":"2023-12-16T00:02:30.561094+0000","last_became_active":"2023-12-15T22:53:08.330456+0000","last_became_peered":"2023-12-15T22:53:08.330456+0000","last_unstale":"2023-12-16T00:02:30.561094+0000","last_undegraded":"2023-12-16T00:02:30.561094+0000","last_fullsized":"2023-12-16T00:02:30.561094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.561000+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.561000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:16:35.803594+0000","scrub_duration":0.001140297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.446499+0000","last_change":"2023-12-16T00:01:28.255242+0000","last_active":"2023-12-16T00:02:55.446499+0000","last_peered":"2023-12-16T00:02:55.446499+0000","last_clean":"2023-12-16T00:02:55.446499+0000","last_became_active":"2023-12-15T22:53:11.078932+0000","last_became_peered":"2023-12-15T22:53:11.078932+0000","last_unstale":"2023-12-16T00:02:55.446499+0000","last_undegraded":"2023-12-16T00:02:55.446499+0000","last_fullsized":"2023-12-16T00:02:55.446499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:28.255159+0000","last_clean_scrub_stamp":"2023-12-16T00:01:28.255159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:35.541812+0000","scrub_duration":0.00094854200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.186554+0000","last_change":"2023-12-16T00:04:41.186574+0000","last_active":"2023-12-16T00:04:41.186554+0000","last_peered":"2023-12-16T00:04:41.186554+0000","last_clean":"2023-12-16T00:04:41.186554+0000","last_became_active":"2023-12-15T23:08:37.339523+0000","last_became_peered":"2023-12-15T23:08:37.339523+0000","last_unstale":"2023-12-16T00:04:41.186554+0000","last_undegraded":"2023-12-16T00:04:41.186554+0000","last_fullsized":"2023-12-16T00:04:41.186554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.186490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.186490+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.186490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:47:55.047270+0000","scrub_duration":0.00090685400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"54'186","reported_seq":6405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:50.891459+0000","last_change":"2023-12-16T00:04:50.891523+0000","last_active":"2023-12-16T00:04:50.891459+0000","last_peered":"2023-12-16T00:04:50.891459+0000","last_clean":"2023-12-16T00:04:50.891459+0000","last_became_active":"2023-12-15T22:55:02.197935+0000","last_became_peered":"2023-12-15T22:55:02.197935+0000","last_unstale":"2023-12-16T00:04:50.891459+0000","last_undegraded":"2023-12-16T00:04:50.891459+0000","last_fullsized":"2023-12-16T00:04:50.891459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:04:50.891363+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:04:50.891363+0000","last_clean_scrub_stamp":"2023-12-16T00:04:50.891363+0000","objects_scrubbed":44,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:42:06.837196+0000","scrub_duration":0.022503693000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":7400,"num_read_kb":7351,"num_write":201,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13058,"num_omap_keys":50,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:08.112902+0000","last_change":"2023-12-16T00:02:08.112902+0000","last_active":"2023-12-16T00:02:08.112902+0000","last_peered":"2023-12-16T00:02:08.112902+0000","last_clean":"2023-12-16T00:02:08.112902+0000","last_became_active":"2023-12-15T22:53:58.169299+0000","last_became_peered":"2023-12-15T22:53:58.169299+0000","last_unstale":"2023-12-16T00:02:08.112902+0000","last_undegraded":"2023-12-16T00:02:08.112902+0000","last_fullsized":"2023-12-16T00:02:08.112902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:08.112815+0000","last_clean_scrub_stamp":"2023-12-16T00:02:08.112815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:46:35.906493+0000","scrub_duration":0.0010267710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"54'11","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:30.676149+0000","last_change":"2023-12-16T00:01:30.676149+0000","last_active":"2023-12-16T00:01:30.676149+0000","last_peered":"2023-12-16T00:01:30.676149+0000","last_clean":"2023-12-16T00:01:30.676149+0000","last_became_active":"2023-12-15T22:53:32.195078+0000","last_became_peered":"2023-12-15T22:53:32.195078+0000","last_unstale":"2023-12-16T00:01:30.676149+0000","last_undegraded":"2023-12-16T00:01:30.676149+0000","last_fullsized":"2023-12-16T00:01:30.676149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:01:30.676065+0000","last_clean_scrub_stamp":"2023-12-16T00:01:30.676065+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:05.837472+0000","scrub_duration":0.004098455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:03.772085+0000","last_change":"2023-12-16T00:01:03.772085+0000","last_active":"2023-12-16T00:01:03.772085+0000","last_peered":"2023-12-16T00:01:03.772085+0000","last_clean":"2023-12-16T00:01:03.772085+0000","last_became_active":"2023-12-15T22:53:30.176154+0000","last_became_peered":"2023-12-15T22:53:30.176154+0000","last_unstale":"2023-12-16T00:01:03.772085+0000","last_undegraded":"2023-12-16T00:01:03.772085+0000","last_fullsized":"2023-12-16T00:01:03.772085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:03.772017+0000","last_clean_scrub_stamp":"2023-12-16T00:01:03.772017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:37.786731+0000","scrub_duration":0.00079306299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"54'688","reported_seq":1206,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:01.403552+0000","last_change":"2023-12-16T00:00:31.329707+0000","last_active":"2023-12-16T00:01:01.403552+0000","last_peered":"2023-12-16T00:01:01.403552+0000","last_clean":"2023-12-16T00:01:01.403552+0000","last_became_active":"2023-12-15T22:53:28.169839+0000","last_became_peered":"2023-12-15T22:53:28.169839+0000","last_unstale":"2023-12-16T00:01:01.403552+0000","last_undegraded":"2023-12-16T00:01:01.403552+0000","last_fullsized":"2023-12-16T00:01:01.403552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'688","last_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_deep_scrub":"54'688","last_deep_scrub_stamp":"2023-12-16T00:00:31.329599+0000","last_clean_scrub_stamp":"2023-12-16T00:00:31.329599+0000","objects_scrubbed":24,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:41.455058+0000","scrub_duration":0.019340255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44156,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1647,"num_read_kb":1351,"num_write":1155,"num_write_kb":770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34776,"num_omap_keys":154,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'20","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:37.162446+0000","last_change":"2023-12-16T00:04:37.162488+0000","last_active":"2023-12-16T00:04:37.162446+0000","last_peered":"2023-12-16T00:04:37.162446+0000","last_clean":"2023-12-16T00:04:37.162446+0000","last_became_active":"2023-12-15T22:55:02.194734+0000","last_became_peered":"2023-12-15T22:55:02.194734+0000","last_unstale":"2023-12-16T00:04:37.162446+0000","last_undegraded":"2023-12-16T00:04:37.162446+0000","last_fullsized":"2023-12-16T00:04:37.162446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:04:37.162392+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:04:37.162392+0000","last_clean_scrub_stamp":"2023-12-16T00:04:37.162392+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:37.797563+0000","scrub_duration":0.0048793430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":219,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.430319+0000","last_change":"2023-12-16T00:01:22.279354+0000","last_active":"2023-12-16T00:01:55.430319+0000","last_peered":"2023-12-16T00:01:55.430319+0000","last_clean":"2023-12-16T00:01:55.430319+0000","last_became_active":"2023-12-15T22:53:10.342075+0000","last_became_peered":"2023-12-15T22:53:10.342075+0000","last_unstale":"2023-12-16T00:01:55.430319+0000","last_undegraded":"2023-12-16T00:01:55.430319+0000","last_fullsized":"2023-12-16T00:01:55.430319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:22.279249+0000","last_clean_scrub_stamp":"2023-12-16T00:01:22.279249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:27.910961+0000","scrub_duration":0.001218069,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:23.440280+0000","last_change":"2023-12-16T00:03:23.440310+0000","last_active":"2023-12-16T00:03:23.440280+0000","last_peered":"2023-12-16T00:03:23.440280+0000","last_clean":"2023-12-16T00:03:23.440280+0000","last_became_active":"2023-12-15T22:52:55.184524+0000","last_became_peered":"2023-12-15T22:52:55.184524+0000","last_unstale":"2023-12-16T00:03:23.440280+0000","last_undegraded":"2023-12-16T00:03:23.440280+0000","last_fullsized":"2023-12-16T00:03:23.440280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:23.440207+0000","last_clean_scrub_stamp":"2023-12-16T00:03:23.440207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:20.246698+0000","scrub_duration":0.00103418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:22.268148+0000","last_change":"2023-12-16T00:04:22.268168+0000","last_active":"2023-12-16T00:04:22.268148+0000","last_peered":"2023-12-16T00:04:22.268148+0000","last_clean":"2023-12-16T00:04:22.268148+0000","last_became_active":"2023-12-15T22:52:53.177660+0000","last_became_peered":"2023-12-15T22:52:53.177660+0000","last_unstale":"2023-12-16T00:04:22.268148+0000","last_undegraded":"2023-12-16T00:04:22.268148+0000","last_fullsized":"2023-12-16T00:04:22.268148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:22.268086+0000","last_clean_scrub_stamp":"2023-12-16T00:04:22.268086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:27:11.687443+0000","scrub_duration":0.00091220899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"54'11","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.430520+0000","last_change":"2023-12-16T00:03:01.430520+0000","last_active":"2023-12-16T00:03:01.430520+0000","last_peered":"2023-12-16T00:03:01.430520+0000","last_clean":"2023-12-16T00:03:01.430520+0000","last_became_active":"2023-12-15T22:53:04.317700+0000","last_became_peered":"2023-12-15T22:53:04.317700+0000","last_unstale":"2023-12-16T00:03:01.430520+0000","last_undegraded":"2023-12-16T00:03:01.430520+0000","last_fullsized":"2023-12-16T00:03:01.430520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:03:01.430412+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.430412+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:15.098235+0000","scrub_duration":0.0033132460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":72,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"54'66","reported_seq":177,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.166815+0000","last_change":"2023-12-16T00:03:47.166869+0000","last_active":"2023-12-16T00:03:47.166815+0000","last_peered":"2023-12-16T00:03:47.166815+0000","last_clean":"2023-12-16T00:03:47.166815+0000","last_became_active":"2023-12-15T22:53:06.324091+0000","last_became_peered":"2023-12-15T22:53:06.324091+0000","last_unstale":"2023-12-16T00:03:47.166815+0000","last_undegraded":"2023-12-16T00:03:47.166815+0000","last_fullsized":"2023-12-16T00:03:47.166815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:03:47.166746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.166746+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:49:27.979063+0000","scrub_duration":0.003753653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.106627+0000","last_change":"2023-12-16T00:02:12.106627+0000","last_active":"2023-12-16T00:02:12.106627+0000","last_peered":"2023-12-16T00:02:12.106627+0000","last_clean":"2023-12-16T00:02:12.106627+0000","last_became_active":"2023-12-15T22:53:08.328836+0000","last_became_peered":"2023-12-15T22:53:08.328836+0000","last_unstale":"2023-12-16T00:02:12.106627+0000","last_undegraded":"2023-12-16T00:02:12.106627+0000","last_fullsized":"2023-12-16T00:02:12.106627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:12.106538+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.106538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:52.266751+0000","scrub_duration":0.001128614,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:11.835800+0000","last_change":"2023-12-16T00:04:11.835800+0000","last_active":"2023-12-16T00:04:11.835800+0000","last_peered":"2023-12-16T00:04:11.835800+0000","last_clean":"2023-12-16T00:04:11.835800+0000","last_became_active":"2023-12-15T23:08:37.336404+0000","last_became_peered":"2023-12-15T23:08:37.336404+0000","last_unstale":"2023-12-16T00:04:11.835800+0000","last_undegraded":"2023-12-16T00:04:11.835800+0000","last_fullsized":"2023-12-16T00:04:11.835800+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:11.835718+0000","last_clean_scrub_stamp":"2023-12-16T00:04:11.835718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:30.892848+0000","scrub_duration":0.00092772700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"54'186","reported_seq":6518,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:40.437459+0000","last_change":"2023-12-16T00:02:40.437459+0000","last_active":"2023-12-16T00:02:40.437459+0000","last_peered":"2023-12-16T00:02:40.437459+0000","last_clean":"2023-12-16T00:02:40.437459+0000","last_became_active":"2023-12-15T22:54:04.193339+0000","last_became_peered":"2023-12-15T22:54:04.193339+0000","last_unstale":"2023-12-16T00:02:40.437459+0000","last_undegraded":"2023-12-16T00:02:40.437459+0000","last_fullsized":"2023-12-16T00:02:40.437459+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'186","last_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_deep_scrub":"54'186","last_deep_scrub_stamp":"2023-12-16T00:02:40.437347+0000","last_clean_scrub_stamp":"2023-12-16T00:02:40.437347+0000","objects_scrubbed":47,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:23.063935+0000","scrub_duration":0.031967469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":7565,"num_read_kb":7519,"num_write":225,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11214,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.410473+0000","last_change":"2023-12-16T00:01:25.805839+0000","last_active":"2023-12-16T00:01:31.410473+0000","last_peered":"2023-12-16T00:01:31.410473+0000","last_clean":"2023-12-16T00:01:31.410473+0000","last_became_active":"2023-12-15T22:53:58.169059+0000","last_became_peered":"2023-12-15T22:53:58.169059+0000","last_unstale":"2023-12-16T00:01:31.410473+0000","last_undegraded":"2023-12-16T00:01:31.410473+0000","last_fullsized":"2023-12-16T00:01:31.410473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:25.805741+0000","last_clean_scrub_stamp":"2023-12-16T00:01:25.805741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:05.466000+0000","scrub_duration":0.0011445660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"54'8","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:43.749669+0000","last_change":"2023-12-16T00:01:43.749669+0000","last_active":"2023-12-16T00:01:43.749669+0000","last_peered":"2023-12-16T00:01:43.749669+0000","last_clean":"2023-12-16T00:01:43.749669+0000","last_became_active":"2023-12-15T22:53:32.193057+0000","last_became_peered":"2023-12-15T22:53:32.193057+0000","last_unstale":"2023-12-16T00:01:43.749669+0000","last_undegraded":"2023-12-16T00:01:43.749669+0000","last_fullsized":"2023-12-16T00:01:43.749669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:43.749563+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.749563+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:12.469707+0000","scrub_duration":0.004122578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1131,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.357258+0000","last_change":"2023-12-16T00:01:50.357258+0000","last_active":"2023-12-16T00:01:50.357258+0000","last_peered":"2023-12-16T00:01:50.357258+0000","last_clean":"2023-12-16T00:01:50.357258+0000","last_became_active":"2023-12-15T22:53:30.176962+0000","last_became_peered":"2023-12-15T22:53:30.176962+0000","last_unstale":"2023-12-16T00:01:50.357258+0000","last_undegraded":"2023-12-16T00:01:50.357258+0000","last_fullsized":"2023-12-16T00:01:50.357258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:50.357178+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.357178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:04.385573+0000","scrub_duration":0.001146266,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"54'327","reported_seq":1302,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:00.415882+0000","last_change":"2023-12-16T00:00:35.735004+0000","last_active":"2023-12-16T00:01:00.415882+0000","last_peered":"2023-12-16T00:01:00.415882+0000","last_clean":"2023-12-16T00:01:00.415882+0000","last_became_active":"2023-12-15T22:53:28.170866+0000","last_became_peered":"2023-12-15T22:53:28.170866+0000","last_unstale":"2023-12-16T00:01:00.415882+0000","last_undegraded":"2023-12-16T00:01:00.415882+0000","last_fullsized":"2023-12-16T00:01:00.415882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'327","last_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_deep_scrub":"54'327","last_deep_scrub_stamp":"2023-12-16T00:00:35.734879+0000","last_clean_scrub_stamp":"2023-12-16T00:00:35.734879+0000","objects_scrubbed":22,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.776072+0000","scrub_duration":0.011427486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":468,"num_read_kb":455,"num_write":444,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28212,"num_omap_keys":98,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.562947+0000","last_change":"2023-12-16T00:02:45.562947+0000","last_active":"2023-12-16T00:02:45.562947+0000","last_peered":"2023-12-16T00:02:45.562947+0000","last_clean":"2023-12-16T00:02:45.562947+0000","last_became_active":"2023-12-15T22:55:02.192539+0000","last_became_peered":"2023-12-15T22:55:02.192539+0000","last_unstale":"2023-12-16T00:02:45.562947+0000","last_undegraded":"2023-12-16T00:02:45.562947+0000","last_fullsized":"2023-12-16T00:02:45.562947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:45.562851+0000","last_clean_scrub_stamp":"2023-12-16T00:02:45.562851+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:00.973533+0000","scrub_duration":0.0028396670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638961+0000","last_change":"2023-12-16T00:00:53.783150+0000","last_active":"2023-12-16T00:01:20.638961+0000","last_peered":"2023-12-16T00:01:20.638961+0000","last_clean":"2023-12-16T00:01:20.638961+0000","last_became_active":"2023-12-15T22:53:10.339631+0000","last_became_peered":"2023-12-15T22:53:10.339631+0000","last_unstale":"2023-12-16T00:01:20.638961+0000","last_undegraded":"2023-12-16T00:01:20.638961+0000","last_fullsized":"2023-12-16T00:01:20.638961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:53.783030+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.783030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:46.485073+0000","scrub_duration":0.001325711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.563416+0000","last_change":"2023-12-16T00:03:44.563437+0000","last_active":"2023-12-16T00:03:44.563416+0000","last_peered":"2023-12-16T00:03:44.563416+0000","last_clean":"2023-12-16T00:03:44.563416+0000","last_became_active":"2023-12-15T22:52:55.190248+0000","last_became_peered":"2023-12-15T22:52:55.190248+0000","last_unstale":"2023-12-16T00:03:44.563416+0000","last_undegraded":"2023-12-16T00:03:44.563416+0000","last_fullsized":"2023-12-16T00:03:44.563416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.563348+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.563348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:00:12.730238+0000","scrub_duration":0.0015157739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:33.357363+0000","last_change":"2023-12-16T00:03:33.357383+0000","last_active":"2023-12-16T00:03:33.357363+0000","last_peered":"2023-12-16T00:03:33.357363+0000","last_clean":"2023-12-16T00:03:33.357363+0000","last_became_active":"2023-12-15T22:52:53.172446+0000","last_became_peered":"2023-12-15T22:52:53.172446+0000","last_unstale":"2023-12-16T00:03:33.357363+0000","last_undegraded":"2023-12-16T00:03:33.357363+0000","last_fullsized":"2023-12-16T00:03:33.357363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:33.357294+0000","last_clean_scrub_stamp":"2023-12-16T00:03:33.357294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:08.995610+0000","scrub_duration":0.0012151390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:37.364098+0000","last_change":"2023-12-16T00:02:37.364098+0000","last_active":"2023-12-16T00:02:37.364098+0000","last_peered":"2023-12-16T00:02:37.364098+0000","last_clean":"2023-12-16T00:02:37.364098+0000","last_became_active":"2023-12-15T22:53:04.318145+0000","last_became_peered":"2023-12-15T22:53:04.318145+0000","last_unstale":"2023-12-16T00:02:37.364098+0000","last_undegraded":"2023-12-16T00:02:37.364098+0000","last_fullsized":"2023-12-16T00:02:37.364098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:37.364018+0000","last_clean_scrub_stamp":"2023-12-16T00:02:37.364018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:30.477993+0000","scrub_duration":0.00091939599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"54'33","reported_seq":123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:08.957714+0000","last_change":"2023-12-16T00:03:08.957714+0000","last_active":"2023-12-16T00:03:08.957714+0000","last_peered":"2023-12-16T00:03:08.957714+0000","last_clean":"2023-12-16T00:03:08.957714+0000","last_became_active":"2023-12-15T22:53:06.316769+0000","last_became_peered":"2023-12-15T22:53:06.316769+0000","last_unstale":"2023-12-16T00:03:08.957714+0000","last_undegraded":"2023-12-16T00:03:08.957714+0000","last_fullsized":"2023-12-16T00:03:08.957714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'33","last_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_deep_scrub":"54'33","last_deep_scrub_stamp":"2023-12-16T00:03:08.957627+0000","last_clean_scrub_stamp":"2023-12-16T00:03:08.957627+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:26.261172+0000","scrub_duration":0.0031460220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.491867+0000","last_change":"2023-12-16T00:02:33.491867+0000","last_active":"2023-12-16T00:02:33.491867+0000","last_peered":"2023-12-16T00:02:33.491867+0000","last_clean":"2023-12-16T00:02:33.491867+0000","last_became_active":"2023-12-15T22:53:08.334788+0000","last_became_peered":"2023-12-15T22:53:08.334788+0000","last_unstale":"2023-12-16T00:02:33.491867+0000","last_undegraded":"2023-12-16T00:02:33.491867+0000","last_fullsized":"2023-12-16T00:02:33.491867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.491782+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.491782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:10.496712+0000","scrub_duration":0.00089031199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:05:01.991739+0000","last_change":"2023-12-16T00:05:01.991759+0000","last_active":"2023-12-16T00:05:01.991739+0000","last_peered":"2023-12-16T00:05:01.991739+0000","last_clean":"2023-12-16T00:05:01.991739+0000","last_became_active":"2023-12-15T23:08:37.340949+0000","last_became_peered":"2023-12-15T23:08:37.340949+0000","last_unstale":"2023-12-16T00:05:01.991739+0000","last_undegraded":"2023-12-16T00:05:01.991739+0000","last_fullsized":"2023-12-16T00:05:01.991739+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:05:01.991675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:05:01.991675+0000","last_clean_scrub_stamp":"2023-12-16T00:05:01.991675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:58:25.646425+0000","scrub_duration":0.00097725900000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"54'103","reported_seq":1354,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:25.641342+0000","last_change":"2023-12-16T00:04:25.641365+0000","last_active":"2023-12-16T00:04:25.641342+0000","last_peered":"2023-12-16T00:04:25.641342+0000","last_clean":"2023-12-16T00:04:25.641342+0000","last_became_active":"2023-12-15T22:54:04.183435+0000","last_became_peered":"2023-12-15T22:54:04.183435+0000","last_unstale":"2023-12-16T00:04:25.641342+0000","last_undegraded":"2023-12-16T00:04:25.641342+0000","last_fullsized":"2023-12-16T00:04:25.641342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'103","last_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_deep_scrub":"54'103","last_deep_scrub_stamp":"2023-12-16T00:04:25.641288+0000","last_clean_scrub_stamp":"2023-12-16T00:04:25.641288+0000","objects_scrubbed":26,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:52.348878+0000","scrub_duration":0.012960006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2189,"num_read_kb":2164,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6171,"num_omap_keys":23,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.168065+0000","last_change":"2023-12-16T00:02:06.168065+0000","last_active":"2023-12-16T00:02:06.168065+0000","last_peered":"2023-12-16T00:02:06.168065+0000","last_clean":"2023-12-16T00:02:06.168065+0000","last_became_active":"2023-12-15T22:53:58.164388+0000","last_became_peered":"2023-12-15T22:53:58.164388+0000","last_unstale":"2023-12-16T00:02:06.168065+0000","last_undegraded":"2023-12-16T00:02:06.168065+0000","last_fullsized":"2023-12-16T00:02:06.168065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.167981+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.167981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:14:08.735139+0000","scrub_duration":0.0010702159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"54'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:23.169593+0000","last_change":"2023-12-16T00:02:23.169593+0000","last_active":"2023-12-16T00:02:23.169593+0000","last_peered":"2023-12-16T00:02:23.169593+0000","last_clean":"2023-12-16T00:02:23.169593+0000","last_became_active":"2023-12-15T22:53:32.189621+0000","last_became_peered":"2023-12-15T22:53:32.189621+0000","last_unstale":"2023-12-16T00:02:23.169593+0000","last_undegraded":"2023-12-16T00:02:23.169593+0000","last_fullsized":"2023-12-16T00:02:23.169593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:02:23.169468+0000","last_clean_scrub_stamp":"2023-12-16T00:02:23.169468+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:48.100470+0000","scrub_duration":0.0048186130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1553,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.428078+0000","last_change":"2023-12-16T00:01:40.822697+0000","last_active":"2023-12-16T00:01:45.428078+0000","last_peered":"2023-12-16T00:01:45.428078+0000","last_clean":"2023-12-16T00:01:45.428078+0000","last_became_active":"2023-12-15T22:53:30.183216+0000","last_became_peered":"2023-12-15T22:53:30.183216+0000","last_unstale":"2023-12-16T00:01:45.428078+0000","last_undegraded":"2023-12-16T00:01:45.428078+0000","last_fullsized":"2023-12-16T00:01:45.428078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.822611+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.822611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.540212+0000","scrub_duration":0.00096530699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"54'192","reported_seq":405,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.436856+0000","last_change":"2023-12-16T00:01:14.022275+0000","last_active":"2023-12-16T00:02:15.436856+0000","last_peered":"2023-12-16T00:02:15.436856+0000","last_clean":"2023-12-16T00:02:15.436856+0000","last_became_active":"2023-12-15T22:53:28.170781+0000","last_became_peered":"2023-12-15T22:53:28.170781+0000","last_unstale":"2023-12-16T00:02:15.436856+0000","last_undegraded":"2023-12-16T00:02:15.436856+0000","last_fullsized":"2023-12-16T00:02:15.436856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'192","last_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_deep_scrub":"54'192","last_deep_scrub_stamp":"2023-12-16T00:01:14.022117+0000","last_clean_scrub_stamp":"2023-12-16T00:01:14.022117+0000","objects_scrubbed":16,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:49.183525+0000","scrub_duration":0.008810699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":309,"num_read_kb":301,"num_write":206,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"54'18","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:04.218086+0000","last_change":"2023-12-16T00:01:04.218086+0000","last_active":"2023-12-16T00:01:04.218086+0000","last_peered":"2023-12-16T00:01:04.218086+0000","last_clean":"2023-12-16T00:01:04.218086+0000","last_became_active":"2023-12-15T22:53:26.158838+0000","last_became_peered":"2023-12-15T22:53:26.158838+0000","last_unstale":"2023-12-16T00:01:04.218086+0000","last_undegraded":"2023-12-16T00:01:04.218086+0000","last_fullsized":"2023-12-16T00:01:04.218086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:04.217978+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.217978+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:55:01.452141+0000","scrub_duration":0.0065238809999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":141,"num_write":93,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.283941+0000","last_change":"2023-12-16T00:01:51.283941+0000","last_active":"2023-12-16T00:01:51.283941+0000","last_peered":"2023-12-16T00:01:51.283941+0000","last_clean":"2023-12-16T00:01:51.283941+0000","last_became_active":"2023-12-15T22:53:10.335120+0000","last_became_peered":"2023-12-15T22:53:10.335120+0000","last_unstale":"2023-12-16T00:01:51.283941+0000","last_undegraded":"2023-12-16T00:01:51.283941+0000","last_fullsized":"2023-12-16T00:01:51.283941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.283864+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.283864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:41:05.312259+0000","scrub_duration":0.00075310500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.381752+0000","last_change":"2023-12-16T00:03:10.381793+0000","last_active":"2023-12-16T00:03:10.381752+0000","last_peered":"2023-12-16T00:03:10.381752+0000","last_clean":"2023-12-16T00:03:10.381752+0000","last_became_active":"2023-12-15T22:52:55.191724+0000","last_became_peered":"2023-12-15T22:52:55.191724+0000","last_unstale":"2023-12-16T00:03:10.381752+0000","last_undegraded":"2023-12-16T00:03:10.381752+0000","last_fullsized":"2023-12-16T00:03:10.381752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.381692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.381692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:53.008280+0000","scrub_duration":0.0012147569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.024920+0000","last_change":"2023-12-16T00:03:46.024939+0000","last_active":"2023-12-16T00:03:46.024920+0000","last_peered":"2023-12-16T00:03:46.024920+0000","last_clean":"2023-12-16T00:03:46.024920+0000","last_became_active":"2023-12-15T22:52:53.176495+0000","last_became_peered":"2023-12-15T22:52:53.176495+0000","last_unstale":"2023-12-16T00:03:46.024920+0000","last_undegraded":"2023-12-16T00:03:46.024920+0000","last_fullsized":"2023-12-16T00:03:46.024920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.024856+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.024856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:58.107273+0000","scrub_duration":0.00094653599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.452475+0000","last_change":"2023-12-16T00:02:55.452475+0000","last_active":"2023-12-16T00:02:55.452475+0000","last_peered":"2023-12-16T00:02:55.452475+0000","last_clean":"2023-12-16T00:02:55.452475+0000","last_became_active":"2023-12-15T22:53:04.318662+0000","last_became_peered":"2023-12-15T22:53:04.318662+0000","last_unstale":"2023-12-16T00:02:55.452475+0000","last_undegraded":"2023-12-16T00:02:55.452475+0000","last_fullsized":"2023-12-16T00:02:55.452475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:55.452365+0000","last_clean_scrub_stamp":"2023-12-16T00:02:55.452365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:44.648169+0000","scrub_duration":0.001097857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"54'67","reported_seq":179,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.312545+0000","last_change":"2023-12-16T00:03:13.312592+0000","last_active":"2023-12-16T00:03:13.312545+0000","last_peered":"2023-12-16T00:03:13.312545+0000","last_clean":"2023-12-16T00:03:13.312545+0000","last_became_active":"2023-12-15T22:53:06.319841+0000","last_became_peered":"2023-12-15T22:53:06.319841+0000","last_unstale":"2023-12-16T00:03:13.312545+0000","last_undegraded":"2023-12-16T00:03:13.312545+0000","last_fullsized":"2023-12-16T00:03:13.312545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'67","last_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_deep_scrub":"54'67","last_deep_scrub_stamp":"2023-12-16T00:03:13.312469+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.312469+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:27:39.704013+0000","scrub_duration":0.0038709399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":91,"num_write":62,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.891975+0000","last_change":"2023-12-16T00:01:51.891975+0000","last_active":"2023-12-16T00:01:51.891975+0000","last_peered":"2023-12-16T00:01:51.891975+0000","last_clean":"2023-12-16T00:01:51.891975+0000","last_became_active":"2023-12-15T22:53:08.335734+0000","last_became_peered":"2023-12-15T22:53:08.335734+0000","last_unstale":"2023-12-16T00:01:51.891975+0000","last_undegraded":"2023-12-16T00:01:51.891975+0000","last_fullsized":"2023-12-16T00:01:51.891975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:51.891879+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.891879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:32.052092+0000","scrub_duration":0.001092801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:05:03.261614+0000","last_change":"2023-12-16T00:05:03.261632+0000","last_active":"2023-12-16T00:05:03.261614+0000","last_peered":"2023-12-16T00:05:03.261614+0000","last_clean":"2023-12-16T00:05:03.261614+0000","last_became_active":"2023-12-15T23:08:37.340911+0000","last_became_peered":"2023-12-15T23:08:37.340911+0000","last_unstale":"2023-12-16T00:05:03.261614+0000","last_undegraded":"2023-12-16T00:05:03.261614+0000","last_fullsized":"2023-12-16T00:05:03.261614+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:05:03.261554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:05:03.261554+0000","last_clean_scrub_stamp":"2023-12-16T00:05:03.261554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:34:04.894004+0000","scrub_duration":0.00093887400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"54'135","reported_seq":1123,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:45.814929+0000","last_change":"2023-12-16T00:04:45.814929+0000","last_active":"2023-12-16T00:04:45.814929+0000","last_peered":"2023-12-16T00:04:45.814929+0000","last_clean":"2023-12-16T00:04:45.814929+0000","last_became_active":"2023-12-15T22:55:02.187297+0000","last_became_peered":"2023-12-15T22:55:02.187297+0000","last_unstale":"2023-12-16T00:04:45.814929+0000","last_undegraded":"2023-12-16T00:04:45.814929+0000","last_fullsized":"2023-12-16T00:04:45.814929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'135","last_scrub_stamp":"2023-12-16T00:04:45.814845+0000","last_deep_scrub":"54'135","last_deep_scrub_stamp":"2023-12-16T00:04:45.814845+0000","last_clean_scrub_stamp":"2023-12-16T00:04:45.814845+0000","objects_scrubbed":37,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:59:15.146240+0000","scrub_duration":0.016599495999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1677,"num_read_kb":1648,"num_write":141,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8803,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:55.414596+0000","last_change":"2023-12-16T00:01:38.748971+0000","last_active":"2023-12-16T00:01:55.414596+0000","last_peered":"2023-12-16T00:01:55.414596+0000","last_clean":"2023-12-16T00:01:55.414596+0000","last_became_active":"2023-12-15T22:53:58.169979+0000","last_became_peered":"2023-12-15T22:53:58.169979+0000","last_unstale":"2023-12-16T00:01:55.414596+0000","last_undegraded":"2023-12-16T00:01:55.414596+0000","last_fullsized":"2023-12-16T00:01:55.414596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:38.748850+0000","last_clean_scrub_stamp":"2023-12-16T00:01:38.748850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:52:41.354102+0000","scrub_duration":0.0015375090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.007813+0000","last_change":"2023-12-16T00:01:36.007813+0000","last_active":"2023-12-16T00:01:36.007813+0000","last_peered":"2023-12-16T00:01:36.007813+0000","last_clean":"2023-12-16T00:01:36.007813+0000","last_became_active":"2023-12-15T22:53:32.190645+0000","last_became_peered":"2023-12-15T22:53:32.190645+0000","last_unstale":"2023-12-16T00:01:36.007813+0000","last_undegraded":"2023-12-16T00:01:36.007813+0000","last_fullsized":"2023-12-16T00:01:36.007813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:36.007700+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.007700+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:11.169108+0000","scrub_duration":0.0044871060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"54'577","reported_seq":1756,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.419678+0000","last_change":"2023-12-16T00:01:33.889729+0000","last_active":"2023-12-16T00:02:15.419678+0000","last_peered":"2023-12-16T00:02:15.419678+0000","last_clean":"2023-12-16T00:02:15.419678+0000","last_became_active":"2023-12-15T22:53:30.181161+0000","last_became_peered":"2023-12-15T22:53:30.181161+0000","last_unstale":"2023-12-16T00:02:15.419678+0000","last_undegraded":"2023-12-16T00:02:15.419678+0000","last_fullsized":"2023-12-16T00:02:15.419678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:33.889651+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.889651+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:06.941088+0000","scrub_duration":0.0022267849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'255","reported_seq":407,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:45.427580+0000","last_change":"2023-12-16T00:00:56.283672+0000","last_active":"2023-12-16T00:01:45.427580+0000","last_peered":"2023-12-16T00:01:45.427580+0000","last_clean":"2023-12-16T00:01:45.427580+0000","last_became_active":"2023-12-15T22:53:28.167314+0000","last_became_peered":"2023-12-15T22:53:28.167314+0000","last_unstale":"2023-12-16T00:01:45.427580+0000","last_undegraded":"2023-12-16T00:01:45.427580+0000","last_fullsized":"2023-12-16T00:01:45.427580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'255","last_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_deep_scrub":"54'255","last_deep_scrub_stamp":"2023-12-16T00:00:56.283558+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.283558+0000","objects_scrubbed":14,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:54:26.076431+0000","scrub_duration":0.0093121409999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":314,"num_read_kb":303,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17609,"num_omap_keys":78,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'13","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.414354+0000","last_change":"2023-12-16T00:00:54.280053+0000","last_active":"2023-12-16T00:00:55.414354+0000","last_peered":"2023-12-16T00:00:55.414354+0000","last_clean":"2023-12-16T00:00:55.414354+0000","last_became_active":"2023-12-15T22:53:26.159234+0000","last_became_peered":"2023-12-15T22:53:26.159234+0000","last_unstale":"2023-12-16T00:00:55.414354+0000","last_undegraded":"2023-12-16T00:00:55.414354+0000","last_fullsized":"2023-12-16T00:00:55.414354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:00:54.279935+0000","last_clean_scrub_stamp":"2023-12-16T00:00:54.279935+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:08:11.498771+0000","scrub_duration":0.0050090259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":176,"num_write":63,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.850203+0000","last_change":"2023-12-16T00:01:41.850203+0000","last_active":"2023-12-16T00:01:41.850203+0000","last_peered":"2023-12-16T00:01:41.850203+0000","last_clean":"2023-12-16T00:01:41.850203+0000","last_became_active":"2023-12-15T22:53:10.334823+0000","last_became_peered":"2023-12-15T22:53:10.334823+0000","last_unstale":"2023-12-16T00:01:41.850203+0000","last_undegraded":"2023-12-16T00:01:41.850203+0000","last_fullsized":"2023-12-16T00:01:41.850203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.850127+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.850127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:08.772705+0000","scrub_duration":0.00090391400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:38.604810+0000","last_change":"2023-12-16T00:03:38.604829+0000","last_active":"2023-12-16T00:03:38.604810+0000","last_peered":"2023-12-16T00:03:38.604810+0000","last_clean":"2023-12-16T00:03:38.604810+0000","last_became_active":"2023-12-15T22:52:55.188937+0000","last_became_peered":"2023-12-15T22:52:55.188937+0000","last_unstale":"2023-12-16T00:03:38.604810+0000","last_undegraded":"2023-12-16T00:03:38.604810+0000","last_fullsized":"2023-12-16T00:03:38.604810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:38.604746+0000","last_clean_scrub_stamp":"2023-12-16T00:03:38.604746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:37:35.411237+0000","scrub_duration":0.001128876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:27.165592+0000","last_change":"2023-12-16T00:04:27.165612+0000","last_active":"2023-12-16T00:04:27.165592+0000","last_peered":"2023-12-16T00:04:27.165592+0000","last_clean":"2023-12-16T00:04:27.165592+0000","last_became_active":"2023-12-15T22:52:53.177513+0000","last_became_peered":"2023-12-15T22:52:53.177513+0000","last_unstale":"2023-12-16T00:04:27.165592+0000","last_undegraded":"2023-12-16T00:04:27.165592+0000","last_fullsized":"2023-12-16T00:04:27.165592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:27.165525+0000","last_clean_scrub_stamp":"2023-12-16T00:04:27.165525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:52:43.495488+0000","scrub_duration":0.001076278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":78,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:06.291071+0000","last_change":"2023-12-16T00:03:06.291103+0000","last_active":"2023-12-16T00:03:06.291071+0000","last_peered":"2023-12-16T00:03:06.291071+0000","last_clean":"2023-12-16T00:03:06.291071+0000","last_became_active":"2023-12-15T22:53:04.317086+0000","last_became_peered":"2023-12-15T22:53:04.317086+0000","last_unstale":"2023-12-16T00:03:06.291071+0000","last_undegraded":"2023-12-16T00:03:06.291071+0000","last_fullsized":"2023-12-16T00:03:06.291071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:06.290988+0000","last_clean_scrub_stamp":"2023-12-16T00:03:06.290988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.735064+0000","scrub_duration":0.00097621800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"54'52","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.196708+0000","last_change":"2023-12-16T00:03:10.196708+0000","last_active":"2023-12-16T00:03:10.196708+0000","last_peered":"2023-12-16T00:03:10.196708+0000","last_clean":"2023-12-16T00:03:10.196708+0000","last_became_active":"2023-12-15T22:53:06.324587+0000","last_became_peered":"2023-12-15T22:53:06.324587+0000","last_unstale":"2023-12-16T00:03:10.196708+0000","last_undegraded":"2023-12-16T00:03:10.196708+0000","last_fullsized":"2023-12-16T00:03:10.196708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:03:10.196632+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.196632+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:51.008949+0000","scrub_duration":0.0033966090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:41.219384+0000","last_change":"2023-12-16T00:02:41.219384+0000","last_active":"2023-12-16T00:02:41.219384+0000","last_peered":"2023-12-16T00:02:41.219384+0000","last_clean":"2023-12-16T00:02:41.219384+0000","last_became_active":"2023-12-15T22:53:08.332119+0000","last_became_peered":"2023-12-15T22:53:08.332119+0000","last_unstale":"2023-12-16T00:02:41.219384+0000","last_undegraded":"2023-12-16T00:02:41.219384+0000","last_fullsized":"2023-12-16T00:02:41.219384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:41.219237+0000","last_clean_scrub_stamp":"2023-12-16T00:02:41.219237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:19:23.561038+0000","scrub_duration":0.00134117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:59.244790+0000","last_change":"2023-12-16T00:04:59.244809+0000","last_active":"2023-12-16T00:04:59.244790+0000","last_peered":"2023-12-16T00:04:59.244790+0000","last_clean":"2023-12-16T00:04:59.244790+0000","last_became_active":"2023-12-15T23:08:37.339573+0000","last_became_peered":"2023-12-15T23:08:37.339573+0000","last_unstale":"2023-12-16T00:04:59.244790+0000","last_undegraded":"2023-12-16T00:04:59.244790+0000","last_fullsized":"2023-12-16T00:04:59.244790+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:59.244732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:59.244732+0000","last_clean_scrub_stamp":"2023-12-16T00:04:59.244732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:17:41.726953+0000","scrub_duration":0.0012375450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"54'123","reported_seq":3204,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:50.385135+0000","last_change":"2023-12-16T00:02:50.385135+0000","last_active":"2023-12-16T00:02:50.385135+0000","last_peered":"2023-12-16T00:02:50.385135+0000","last_clean":"2023-12-16T00:02:50.385135+0000","last_became_active":"2023-12-15T22:54:04.178760+0000","last_became_peered":"2023-12-15T22:54:04.178760+0000","last_unstale":"2023-12-16T00:02:50.385135+0000","last_undegraded":"2023-12-16T00:02:50.385135+0000","last_fullsized":"2023-12-16T00:02:50.385135+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'123","last_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_deep_scrub":"54'123","last_deep_scrub_stamp":"2023-12-16T00:02:50.385045+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.385045+0000","objects_scrubbed":34,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:40.644093+0000","scrub_duration":0.017410523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3537,"num_read_kb":3504,"num_write":118,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6314,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.088962+0000","last_change":"2023-12-16T00:02:04.088962+0000","last_active":"2023-12-16T00:02:04.088962+0000","last_peered":"2023-12-16T00:02:04.088962+0000","last_clean":"2023-12-16T00:02:04.088962+0000","last_became_active":"2023-12-15T22:53:58.161154+0000","last_became_peered":"2023-12-15T22:53:58.161154+0000","last_unstale":"2023-12-16T00:02:04.088962+0000","last_undegraded":"2023-12-16T00:02:04.088962+0000","last_fullsized":"2023-12-16T00:02:04.088962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:04.088872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.088872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:57.943529+0000","scrub_duration":0.00086766199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"54'10","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.823346+0000","last_change":"2023-12-16T00:01:16.823346+0000","last_active":"2023-12-16T00:01:16.823346+0000","last_peered":"2023-12-16T00:01:16.823346+0000","last_clean":"2023-12-16T00:01:16.823346+0000","last_became_active":"2023-12-15T22:53:32.195272+0000","last_became_peered":"2023-12-15T22:53:32.195272+0000","last_unstale":"2023-12-16T00:01:16.823346+0000","last_undegraded":"2023-12-16T00:01:16.823346+0000","last_fullsized":"2023-12-16T00:01:16.823346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:01:16.823219+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.823219+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:42:44.880026+0000","scrub_duration":0.0039912250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:36.207144+0000","last_change":"2023-12-16T00:01:36.207144+0000","last_active":"2023-12-16T00:01:36.207144+0000","last_peered":"2023-12-16T00:01:36.207144+0000","last_clean":"2023-12-16T00:01:36.207144+0000","last_became_active":"2023-12-15T22:53:30.180823+0000","last_became_peered":"2023-12-15T22:53:30.180823+0000","last_unstale":"2023-12-16T00:01:36.207144+0000","last_undegraded":"2023-12-16T00:01:36.207144+0000","last_fullsized":"2023-12-16T00:01:36.207144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:36.207066+0000","last_clean_scrub_stamp":"2023-12-16T00:01:36.207066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:36.825066+0000","scrub_duration":0.0012276050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"54'1863","reported_seq":2782,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418427+0000","last_change":"2023-12-16T00:00:36.693822+0000","last_active":"2023-12-16T00:01:10.418427+0000","last_peered":"2023-12-16T00:01:10.418427+0000","last_clean":"2023-12-16T00:01:10.418427+0000","last_became_active":"2023-12-15T22:53:28.170660+0000","last_became_peered":"2023-12-15T22:53:28.170660+0000","last_unstale":"2023-12-16T00:01:10.418427+0000","last_undegraded":"2023-12-16T00:01:10.418427+0000","last_fullsized":"2023-12-16T00:01:10.418427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'1863","last_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_deep_scrub":"54'1863","last_deep_scrub_stamp":"2023-12-16T00:00:36.693696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:36.693696+0000","objects_scrubbed":21,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:04:27.812786+0000","scrub_duration":0.017549480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3408,"num_read_kb":3399,"num_write":1949,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.873227+0000","last_change":"2023-12-16T00:01:10.873227+0000","last_active":"2023-12-16T00:01:10.873227+0000","last_peered":"2023-12-16T00:01:10.873227+0000","last_clean":"2023-12-16T00:01:10.873227+0000","last_became_active":"2023-12-15T22:53:26.158964+0000","last_became_peered":"2023-12-15T22:53:26.158964+0000","last_unstale":"2023-12-16T00:01:10.873227+0000","last_undegraded":"2023-12-16T00:01:10.873227+0000","last_fullsized":"2023-12-16T00:01:10.873227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:10.873102+0000","last_clean_scrub_stamp":"2023-12-16T00:01:10.873102+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:35.055847+0000","scrub_duration":0.0038037909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":90,"num_write":37,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:42.230579+0000","last_change":"2023-12-16T00:04:42.230599+0000","last_active":"2023-12-16T00:04:42.230579+0000","last_peered":"2023-12-16T00:04:42.230579+0000","last_clean":"2023-12-16T00:04:42.230579+0000","last_became_active":"2023-12-15T22:52:55.187360+0000","last_became_peered":"2023-12-15T22:52:55.187360+0000","last_unstale":"2023-12-16T00:04:42.230579+0000","last_undegraded":"2023-12-16T00:04:42.230579+0000","last_fullsized":"2023-12-16T00:04:42.230579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:42.230519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:42.230519+0000","last_clean_scrub_stamp":"2023-12-16T00:04:42.230519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:14:00.594229+0000","scrub_duration":0.00084420199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:40.253850+0000","last_change":"2023-12-16T00:03:40.253871+0000","last_active":"2023-12-16T00:03:40.253850+0000","last_peered":"2023-12-16T00:03:40.253850+0000","last_clean":"2023-12-16T00:03:40.253850+0000","last_became_active":"2023-12-15T22:52:53.173965+0000","last_became_peered":"2023-12-15T22:52:53.173965+0000","last_unstale":"2023-12-16T00:03:40.253850+0000","last_undegraded":"2023-12-16T00:03:40.253850+0000","last_fullsized":"2023-12-16T00:03:40.253850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:40.253770+0000","last_clean_scrub_stamp":"2023-12-16T00:03:40.253770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:14:18.023218+0000","scrub_duration":0.00092796800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:13.958172+0000","last_change":"2023-12-16T00:03:13.958172+0000","last_active":"2023-12-16T00:03:13.958172+0000","last_peered":"2023-12-16T00:03:13.958172+0000","last_clean":"2023-12-16T00:03:13.958172+0000","last_became_active":"2023-12-15T22:53:04.315838+0000","last_became_peered":"2023-12-15T22:53:04.315838+0000","last_unstale":"2023-12-16T00:03:13.958172+0000","last_undegraded":"2023-12-16T00:03:13.958172+0000","last_fullsized":"2023-12-16T00:03:13.958172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:13.958074+0000","last_clean_scrub_stamp":"2023-12-16T00:03:13.958074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:53.424208+0000","scrub_duration":0.001209527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"54'59","reported_seq":170,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.329189+0000","last_change":"2023-12-16T00:02:30.329189+0000","last_active":"2023-12-16T00:02:30.329189+0000","last_peered":"2023-12-16T00:02:30.329189+0000","last_clean":"2023-12-16T00:02:30.329189+0000","last_became_active":"2023-12-15T22:53:06.321056+0000","last_became_peered":"2023-12-15T22:53:06.321056+0000","last_unstale":"2023-12-16T00:02:30.329189+0000","last_undegraded":"2023-12-16T00:02:30.329189+0000","last_fullsized":"2023-12-16T00:02:30.329189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59","last_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_deep_scrub":"54'59","last_deep_scrub_stamp":"2023-12-16T00:02:30.329097+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.329097+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:13.350948+0000","scrub_duration":0.0043350840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":82,"num_write":54,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:20.522842+0000","last_change":"2023-12-16T00:02:20.522842+0000","last_active":"2023-12-16T00:02:20.522842+0000","last_peered":"2023-12-16T00:02:20.522842+0000","last_clean":"2023-12-16T00:02:20.522842+0000","last_became_active":"2023-12-15T22:53:08.329804+0000","last_became_peered":"2023-12-15T22:53:08.329804+0000","last_unstale":"2023-12-16T00:02:20.522842+0000","last_undegraded":"2023-12-16T00:02:20.522842+0000","last_fullsized":"2023-12-16T00:02:20.522842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:20.522760+0000","last_clean_scrub_stamp":"2023-12-16T00:02:20.522760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:10:30.000138+0000","scrub_duration":0.001078575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:50.632068+0000","last_change":"2023-12-16T00:00:42.677782+0000","last_active":"2023-12-16T00:00:50.632068+0000","last_peered":"2023-12-16T00:00:50.632068+0000","last_clean":"2023-12-16T00:00:50.632068+0000","last_became_active":"2023-12-15T22:53:11.077784+0000","last_became_peered":"2023-12-15T22:53:11.077784+0000","last_unstale":"2023-12-16T00:00:50.632068+0000","last_undegraded":"2023-12-16T00:00:50.632068+0000","last_fullsized":"2023-12-16T00:00:50.632068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:42.677696+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.677696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:06:04.476811+0000","scrub_duration":0.00094459000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:58.995247+0000","last_change":"2023-12-16T00:04:58.995267+0000","last_active":"2023-12-16T00:04:58.995247+0000","last_peered":"2023-12-16T00:04:58.995247+0000","last_clean":"2023-12-16T00:04:58.995247+0000","last_became_active":"2023-12-15T23:08:37.343269+0000","last_became_peered":"2023-12-15T23:08:37.343269+0000","last_unstale":"2023-12-16T00:04:58.995247+0000","last_undegraded":"2023-12-16T00:04:58.995247+0000","last_fullsized":"2023-12-16T00:04:58.995247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:58.995188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:58.995188+0000","last_clean_scrub_stamp":"2023-12-16T00:04:58.995188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:12:09.915531+0000","scrub_duration":0.0012102180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"54'198","reported_seq":4448,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.417593+0000","last_change":"2023-12-16T00:01:50.740477+0000","last_active":"2023-12-16T00:02:01.417593+0000","last_peered":"2023-12-16T00:02:01.417593+0000","last_clean":"2023-12-16T00:02:01.417593+0000","last_became_active":"2023-12-15T22:54:04.181336+0000","last_became_peered":"2023-12-15T22:54:04.181336+0000","last_unstale":"2023-12-16T00:02:01.417593+0000","last_undegraded":"2023-12-16T00:02:01.417593+0000","last_fullsized":"2023-12-16T00:02:01.417593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'198","last_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_deep_scrub":"54'198","last_deep_scrub_stamp":"2023-12-16T00:01:50.740401+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.740401+0000","objects_scrubbed":54,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:18.955842+0000","scrub_duration":0.024788213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":5750,"num_read_kb":5703,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14738,"num_omap_keys":56,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:33.202192+0000","last_change":"2023-12-16T00:02:33.202192+0000","last_active":"2023-12-16T00:02:33.202192+0000","last_peered":"2023-12-16T00:02:33.202192+0000","last_clean":"2023-12-16T00:02:33.202192+0000","last_became_active":"2023-12-15T22:53:58.170713+0000","last_became_peered":"2023-12-15T22:53:58.170713+0000","last_unstale":"2023-12-16T00:02:33.202192+0000","last_undegraded":"2023-12-16T00:02:33.202192+0000","last_fullsized":"2023-12-16T00:02:33.202192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:33.202098+0000","last_clean_scrub_stamp":"2023-12-16T00:02:33.202098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:38.622522+0000","scrub_duration":0.0011930459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.360912+0000","last_change":"2023-12-16T00:02:21.360912+0000","last_active":"2023-12-16T00:02:21.360912+0000","last_peered":"2023-12-16T00:02:21.360912+0000","last_clean":"2023-12-16T00:02:21.360912+0000","last_became_active":"2023-12-15T22:53:32.190181+0000","last_became_peered":"2023-12-15T22:53:32.190181+0000","last_unstale":"2023-12-16T00:02:21.360912+0000","last_undegraded":"2023-12-16T00:02:21.360912+0000","last_fullsized":"2023-12-16T00:02:21.360912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.360823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.360823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:20.990886+0000","scrub_duration":0.00096411299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:31.902886+0000","last_change":"2023-12-16T00:01:31.902886+0000","last_active":"2023-12-16T00:01:31.902886+0000","last_peered":"2023-12-16T00:01:31.902886+0000","last_clean":"2023-12-16T00:01:31.902886+0000","last_became_active":"2023-12-15T22:53:30.176882+0000","last_became_peered":"2023-12-15T22:53:30.176882+0000","last_unstale":"2023-12-16T00:01:31.902886+0000","last_undegraded":"2023-12-16T00:01:31.902886+0000","last_fullsized":"2023-12-16T00:01:31.902886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:31.902808+0000","last_clean_scrub_stamp":"2023-12-16T00:01:31.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:25.376002+0000","scrub_duration":0.00091490699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'2139","reported_seq":2981,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:11.405629+0000","last_change":"2023-12-16T00:00:45.499882+0000","last_active":"2023-12-16T00:01:11.405629+0000","last_peered":"2023-12-16T00:01:11.405629+0000","last_clean":"2023-12-16T00:01:11.405629+0000","last_became_active":"2023-12-15T22:53:28.169472+0000","last_became_peered":"2023-12-15T22:53:28.169472+0000","last_unstale":"2023-12-16T00:01:11.405629+0000","last_undegraded":"2023-12-16T00:01:11.405629+0000","last_fullsized":"2023-12-16T00:01:11.405629+0000","mapping_epoch":35,"log_start":"54'400","ondisk_log_start":"54'400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2139","last_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_deep_scrub":"54'2139","last_deep_scrub_stamp":"2023-12-16T00:00:45.499749+0000","last_clean_scrub_stamp":"2023-12-16T00:00:45.499749+0000","objects_scrubbed":20,"log_size":1739,"log_dups_size":400,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:30:19.143430+0000","scrub_duration":0.019332022000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2892,"num_read_kb":2887,"num_write":541,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35844,"num_omap_keys":163,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'10","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417330+0000","last_change":"2023-12-16T00:00:56.854713+0000","last_active":"2023-12-16T00:01:05.417330+0000","last_peered":"2023-12-16T00:01:05.417330+0000","last_clean":"2023-12-16T00:01:05.417330+0000","last_became_active":"2023-12-15T22:53:26.156045+0000","last_became_peered":"2023-12-15T22:53:26.156045+0000","last_unstale":"2023-12-16T00:01:05.417330+0000","last_undegraded":"2023-12-16T00:01:05.417330+0000","last_fullsized":"2023-12-16T00:01:05.417330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:56.854606+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.854606+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:32:03.059604+0000","scrub_duration":0.0044203000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":51,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.979311+0000","last_change":"2023-12-16T00:03:26.979311+0000","last_active":"2023-12-16T00:03:26.979311+0000","last_peered":"2023-12-16T00:03:26.979311+0000","last_clean":"2023-12-16T00:03:26.979311+0000","last_became_active":"2023-12-15T22:52:55.190847+0000","last_became_peered":"2023-12-15T22:52:55.190847+0000","last_unstale":"2023-12-16T00:03:26.979311+0000","last_undegraded":"2023-12-16T00:03:26.979311+0000","last_fullsized":"2023-12-16T00:03:26.979311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.979211+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.979211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:44:51.327876+0000","scrub_duration":0.0011354869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.583273+0000","last_change":"2023-12-16T00:03:55.583308+0000","last_active":"2023-12-16T00:03:55.583273+0000","last_peered":"2023-12-16T00:03:55.583273+0000","last_clean":"2023-12-16T00:03:55.583273+0000","last_became_active":"2023-12-15T22:52:53.169092+0000","last_became_peered":"2023-12-15T22:52:53.169092+0000","last_unstale":"2023-12-16T00:03:55.583273+0000","last_undegraded":"2023-12-16T00:03:55.583273+0000","last_fullsized":"2023-12-16T00:03:55.583273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.583135+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.583135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:07:10.879680+0000","scrub_duration":0.0013878409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"54'4","reported_seq":564,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:58.377246+0000","last_change":"2023-12-16T00:02:58.377246+0000","last_active":"2023-12-16T00:02:58.377246+0000","last_peered":"2023-12-16T00:02:58.377246+0000","last_clean":"2023-12-16T00:02:58.377246+0000","last_became_active":"2023-12-15T22:53:04.322086+0000","last_became_peered":"2023-12-15T22:53:04.322086+0000","last_unstale":"2023-12-16T00:02:58.377246+0000","last_undegraded":"2023-12-16T00:02:58.377246+0000","last_fullsized":"2023-12-16T00:02:58.377246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:02:58.377159+0000","last_clean_scrub_stamp":"2023-12-16T00:02:58.377159+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:42:12.771832+0000","scrub_duration":0.0023191219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":539,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"54'97","reported_seq":221,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:39.316747+0000","last_change":"2023-12-16T00:02:39.316747+0000","last_active":"2023-12-16T00:02:39.316747+0000","last_peered":"2023-12-16T00:02:39.316747+0000","last_clean":"2023-12-16T00:02:39.316747+0000","last_became_active":"2023-12-15T22:53:06.321220+0000","last_became_peered":"2023-12-15T22:53:06.321220+0000","last_unstale":"2023-12-16T00:02:39.316747+0000","last_undegraded":"2023-12-16T00:02:39.316747+0000","last_fullsized":"2023-12-16T00:02:39.316747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:02:39.316656+0000","last_clean_scrub_stamp":"2023-12-16T00:02:39.316656+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:12:14.708570+0000","scrub_duration":0.0049940050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:07.087362+0000","last_change":"2023-12-16T00:02:07.087362+0000","last_active":"2023-12-16T00:02:07.087362+0000","last_peered":"2023-12-16T00:02:07.087362+0000","last_clean":"2023-12-16T00:02:07.087362+0000","last_became_active":"2023-12-15T22:53:08.332636+0000","last_became_peered":"2023-12-15T22:53:08.332636+0000","last_unstale":"2023-12-16T00:02:07.087362+0000","last_undegraded":"2023-12-16T00:02:07.087362+0000","last_fullsized":"2023-12-16T00:02:07.087362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:07.087271+0000","last_clean_scrub_stamp":"2023-12-16T00:02:07.087271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:47:26.891557+0000","scrub_duration":0.0013948249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:35.239301+0000","last_change":"2023-12-16T00:01:35.239301+0000","last_active":"2023-12-16T00:01:35.239301+0000","last_peered":"2023-12-16T00:01:35.239301+0000","last_clean":"2023-12-16T00:01:35.239301+0000","last_became_active":"2023-12-15T22:53:11.078446+0000","last_became_peered":"2023-12-15T22:53:11.078446+0000","last_unstale":"2023-12-16T00:01:35.239301+0000","last_undegraded":"2023-12-16T00:01:35.239301+0000","last_fullsized":"2023-12-16T00:01:35.239301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:35.239193+0000","last_clean_scrub_stamp":"2023-12-16T00:01:35.239193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:16:35.259341+0000","scrub_duration":0.0014533479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:51.187820+0000","last_change":"2023-12-16T00:04:51.187841+0000","last_active":"2023-12-16T00:04:51.187820+0000","last_peered":"2023-12-16T00:04:51.187820+0000","last_clean":"2023-12-16T00:04:51.187820+0000","last_became_active":"2023-12-15T23:08:37.342270+0000","last_became_peered":"2023-12-15T23:08:37.342270+0000","last_unstale":"2023-12-16T00:04:51.187820+0000","last_undegraded":"2023-12-16T00:04:51.187820+0000","last_fullsized":"2023-12-16T00:04:51.187820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:51.187760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:51.187760+0000","last_clean_scrub_stamp":"2023-12-16T00:04:51.187760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:31:46.668526+0000","scrub_duration":0.0014151190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"54'147","reported_seq":1374,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.405006+0000","last_change":"2023-12-16T00:03:09.405006+0000","last_active":"2023-12-16T00:03:09.405006+0000","last_peered":"2023-12-16T00:03:09.405006+0000","last_clean":"2023-12-16T00:03:09.405006+0000","last_became_active":"2023-12-15T22:54:04.190493+0000","last_became_peered":"2023-12-15T22:54:04.190493+0000","last_unstale":"2023-12-16T00:03:09.405006+0000","last_undegraded":"2023-12-16T00:03:09.405006+0000","last_fullsized":"2023-12-16T00:03:09.405006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'147","last_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_deep_scrub":"54'147","last_deep_scrub_stamp":"2023-12-16T00:03:09.404918+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.404918+0000","objects_scrubbed":38,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:25.737552+0000","scrub_duration":0.018749913999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2074,"num_read_kb":2031,"num_write":153,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9677,"num_omap_keys":36,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:03.062496+0000","last_change":"2023-12-16T00:02:03.062496+0000","last_active":"2023-12-16T00:02:03.062496+0000","last_peered":"2023-12-16T00:02:03.062496+0000","last_clean":"2023-12-16T00:02:03.062496+0000","last_became_active":"2023-12-15T22:53:58.162967+0000","last_became_peered":"2023-12-15T22:53:58.162967+0000","last_unstale":"2023-12-16T00:02:03.062496+0000","last_undegraded":"2023-12-16T00:02:03.062496+0000","last_fullsized":"2023-12-16T00:02:03.062496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:03.062410+0000","last_clean_scrub_stamp":"2023-12-16T00:02:03.062410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:39:02.692472+0000","scrub_duration":0.0011563929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"54'10","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:14.273204+0000","last_change":"2023-12-16T00:02:14.273204+0000","last_active":"2023-12-16T00:02:14.273204+0000","last_peered":"2023-12-16T00:02:14.273204+0000","last_clean":"2023-12-16T00:02:14.273204+0000","last_became_active":"2023-12-15T22:53:32.194536+0000","last_became_peered":"2023-12-15T22:53:32.194536+0000","last_unstale":"2023-12-16T00:02:14.273204+0000","last_undegraded":"2023-12-16T00:02:14.273204+0000","last_fullsized":"2023-12-16T00:02:14.273204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:02:14.273074+0000","last_clean_scrub_stamp":"2023-12-16T00:02:14.273074+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:38:57.294925+0000","scrub_duration":0.003830254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.478959+0000","last_change":"2023-12-16T00:02:19.478959+0000","last_active":"2023-12-16T00:02:19.478959+0000","last_peered":"2023-12-16T00:02:19.478959+0000","last_clean":"2023-12-16T00:02:19.478959+0000","last_became_active":"2023-12-15T22:53:30.179569+0000","last_became_peered":"2023-12-15T22:53:30.179569+0000","last_unstale":"2023-12-16T00:02:19.478959+0000","last_undegraded":"2023-12-16T00:02:19.478959+0000","last_fullsized":"2023-12-16T00:02:19.478959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:19.478872+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.478872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:08.674676+0000","scrub_duration":0.0010783909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"54'194","reported_seq":389,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.025328+0000","last_change":"2023-12-16T00:02:04.025328+0000","last_active":"2023-12-16T00:02:04.025328+0000","last_peered":"2023-12-16T00:02:04.025328+0000","last_clean":"2023-12-16T00:02:04.025328+0000","last_became_active":"2023-12-15T22:53:28.169655+0000","last_became_peered":"2023-12-15T22:53:28.169655+0000","last_unstale":"2023-12-16T00:02:04.025328+0000","last_undegraded":"2023-12-16T00:02:04.025328+0000","last_fullsized":"2023-12-16T00:02:04.025328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'194","last_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_deep_scrub":"54'194","last_deep_scrub_stamp":"2023-12-16T00:02:04.025230+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.025230+0000","objects_scrubbed":16,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:56:32.240672+0000","scrub_duration":0.0082150720000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":277,"num_read_kb":269,"num_write":223,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'9","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:44.725631+0000","last_change":"2023-12-16T00:01:44.725631+0000","last_active":"2023-12-16T00:01:44.725631+0000","last_peered":"2023-12-16T00:01:44.725631+0000","last_clean":"2023-12-16T00:01:44.725631+0000","last_became_active":"2023-12-15T22:53:26.158173+0000","last_became_peered":"2023-12-15T22:53:26.158173+0000","last_unstale":"2023-12-16T00:01:44.725631+0000","last_undegraded":"2023-12-16T00:01:44.725631+0000","last_fullsized":"2023-12-16T00:01:44.725631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:01:44.725549+0000","last_clean_scrub_stamp":"2023-12-16T00:01:44.725549+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:25.295465+0000","scrub_duration":0.0039401760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":36,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.096649+0000","last_change":"2023-12-16T00:03:51.096670+0000","last_active":"2023-12-16T00:03:51.096649+0000","last_peered":"2023-12-16T00:03:51.096649+0000","last_clean":"2023-12-16T00:03:51.096649+0000","last_became_active":"2023-12-15T22:52:55.189578+0000","last_became_peered":"2023-12-15T22:52:55.189578+0000","last_unstale":"2023-12-16T00:03:51.096649+0000","last_undegraded":"2023-12-16T00:03:51.096649+0000","last_fullsized":"2023-12-16T00:03:51.096649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.096587+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.096587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:52:21.124789+0000","scrub_duration":0.00091092400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:44.602939+0000","last_change":"2023-12-16T00:03:44.602959+0000","last_active":"2023-12-16T00:03:44.602939+0000","last_peered":"2023-12-16T00:03:44.602939+0000","last_clean":"2023-12-16T00:03:44.602939+0000","last_became_active":"2023-12-15T22:52:53.167718+0000","last_became_peered":"2023-12-15T22:52:53.167718+0000","last_unstale":"2023-12-16T00:03:44.602939+0000","last_undegraded":"2023-12-16T00:03:44.602939+0000","last_fullsized":"2023-12-16T00:03:44.602939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:44.602862+0000","last_clean_scrub_stamp":"2023-12-16T00:03:44.602862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:59.899408+0000","scrub_duration":0.0010205100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.461260+0000","last_change":"2023-12-16T00:03:24.461279+0000","last_active":"2023-12-16T00:03:24.461260+0000","last_peered":"2023-12-16T00:03:24.461260+0000","last_clean":"2023-12-16T00:03:24.461260+0000","last_became_active":"2023-12-15T22:53:04.320806+0000","last_became_peered":"2023-12-15T22:53:04.320806+0000","last_unstale":"2023-12-16T00:03:24.461260+0000","last_undegraded":"2023-12-16T00:03:24.461260+0000","last_fullsized":"2023-12-16T00:03:24.461260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.461193+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.461193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:35:21.383632+0000","scrub_duration":0.001146839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"54'66","reported_seq":181,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:24.624544+0000","last_change":"2023-12-16T00:02:24.624544+0000","last_active":"2023-12-16T00:02:24.624544+0000","last_peered":"2023-12-16T00:02:24.624544+0000","last_clean":"2023-12-16T00:02:24.624544+0000","last_became_active":"2023-12-15T22:53:06.322101+0000","last_became_peered":"2023-12-15T22:53:06.322101+0000","last_unstale":"2023-12-16T00:02:24.624544+0000","last_undegraded":"2023-12-16T00:02:24.624544+0000","last_fullsized":"2023-12-16T00:02:24.624544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'66","last_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_deep_scrub":"54'66","last_deep_scrub_stamp":"2023-12-16T00:02:24.624432+0000","last_clean_scrub_stamp":"2023-12-16T00:02:24.624432+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:47.194555+0000","scrub_duration":0.0040880270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":88,"num_write":60,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:20.638980+0000","last_change":"2023-12-16T00:01:16.918187+0000","last_active":"2023-12-16T00:01:20.638980+0000","last_peered":"2023-12-16T00:01:20.638980+0000","last_clean":"2023-12-16T00:01:20.638980+0000","last_became_active":"2023-12-15T22:53:08.329727+0000","last_became_peered":"2023-12-15T22:53:08.329727+0000","last_unstale":"2023-12-16T00:01:20.638980+0000","last_undegraded":"2023-12-16T00:01:20.638980+0000","last_fullsized":"2023-12-16T00:01:20.638980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:16.918105+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.918105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:50:46.236874+0000","scrub_duration":0.00092854199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.195656+0000","last_change":"2023-12-16T00:01:41.195656+0000","last_active":"2023-12-16T00:01:41.195656+0000","last_peered":"2023-12-16T00:01:41.195656+0000","last_clean":"2023-12-16T00:01:41.195656+0000","last_became_active":"2023-12-15T22:53:10.340090+0000","last_became_peered":"2023-12-15T22:53:10.340090+0000","last_unstale":"2023-12-16T00:01:41.195656+0000","last_undegraded":"2023-12-16T00:01:41.195656+0000","last_fullsized":"2023-12-16T00:01:41.195656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:41.195553+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:16.974961+0000","scrub_duration":0.00087870600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.794703+0000","last_change":"2023-12-16T00:04:19.794736+0000","last_active":"2023-12-16T00:04:19.794703+0000","last_peered":"2023-12-16T00:04:19.794703+0000","last_clean":"2023-12-16T00:04:19.794703+0000","last_became_active":"2023-12-15T23:08:37.343537+0000","last_became_peered":"2023-12-15T23:08:37.343537+0000","last_unstale":"2023-12-16T00:04:19.794703+0000","last_undegraded":"2023-12-16T00:04:19.794703+0000","last_fullsized":"2023-12-16T00:04:19.794703+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.794635+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.794635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:27.164354+0000","scrub_duration":0.001013683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"54'182","reported_seq":3899,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:19.200935+0000","last_change":"2023-12-16T00:02:19.200935+0000","last_active":"2023-12-16T00:02:19.200935+0000","last_peered":"2023-12-16T00:02:19.200935+0000","last_clean":"2023-12-16T00:02:19.200935+0000","last_became_active":"2023-12-15T22:54:04.188807+0000","last_became_peered":"2023-12-15T22:54:04.188807+0000","last_unstale":"2023-12-16T00:02:19.200935+0000","last_undegraded":"2023-12-16T00:02:19.200935+0000","last_fullsized":"2023-12-16T00:02:19.200935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'182","last_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_deep_scrub":"54'182","last_deep_scrub_stamp":"2023-12-16T00:02:19.200795+0000","last_clean_scrub_stamp":"2023-12-16T00:02:19.200795+0000","objects_scrubbed":43,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:01:32.784180+0000","scrub_duration":0.023258995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4677,"num_read_kb":4628,"num_write":213,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11121,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:41.413093+0000","last_change":"2023-12-16T00:01:20.824418+0000","last_active":"2023-12-16T00:01:41.413093+0000","last_peered":"2023-12-16T00:01:41.413093+0000","last_clean":"2023-12-16T00:01:41.413093+0000","last_became_active":"2023-12-15T22:53:58.170560+0000","last_became_peered":"2023-12-15T22:53:58.170560+0000","last_unstale":"2023-12-16T00:01:41.413093+0000","last_undegraded":"2023-12-16T00:01:41.413093+0000","last_fullsized":"2023-12-16T00:01:41.413093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:20.824341+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.824341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:35.910229+0000","scrub_duration":0.0011004680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"54'13","reported_seq":116,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:29.339052+0000","last_change":"2023-12-16T00:02:29.339052+0000","last_active":"2023-12-16T00:02:29.339052+0000","last_peered":"2023-12-16T00:02:29.339052+0000","last_clean":"2023-12-16T00:02:29.339052+0000","last_became_active":"2023-12-15T22:53:32.194336+0000","last_became_peered":"2023-12-15T22:53:32.194336+0000","last_unstale":"2023-12-16T00:02:29.339052+0000","last_undegraded":"2023-12-16T00:02:29.339052+0000","last_fullsized":"2023-12-16T00:02:29.339052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:29.338956+0000","last_clean_scrub_stamp":"2023-12-16T00:02:29.338956+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:17:59.591002+0000","scrub_duration":0.0042194909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":122,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418600+0000","last_change":"2023-12-16T00:01:08.802296+0000","last_active":"2023-12-16T00:01:10.418600+0000","last_peered":"2023-12-16T00:01:10.418600+0000","last_clean":"2023-12-16T00:01:10.418600+0000","last_became_active":"2023-12-15T22:53:30.176730+0000","last_became_peered":"2023-12-15T22:53:30.176730+0000","last_unstale":"2023-12-16T00:01:10.418600+0000","last_undegraded":"2023-12-16T00:01:10.418600+0000","last_fullsized":"2023-12-16T00:01:10.418600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:08.802214+0000","last_clean_scrub_stamp":"2023-12-16T00:01:08.802214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:23:40.267035+0000","scrub_duration":0.000898425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"54'9972","reported_seq":16989,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418499+0000","last_change":"2023-12-16T00:00:47.805517+0000","last_active":"2023-12-16T00:01:10.418499+0000","last_peered":"2023-12-16T00:01:10.418499+0000","last_clean":"2023-12-16T00:01:10.418499+0000","last_became_active":"2023-12-15T22:53:28.170472+0000","last_became_peered":"2023-12-15T22:53:28.170472+0000","last_unstale":"2023-12-16T00:01:10.418499+0000","last_undegraded":"2023-12-16T00:01:10.418499+0000","last_fullsized":"2023-12-16T00:01:10.418499+0000","mapping_epoch":35,"log_start":"54'8100","ondisk_log_start":"54'8100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9972","last_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_deep_scrub":"54'9972","last_deep_scrub_stamp":"2023-12-16T00:00:47.805375+0000","last_clean_scrub_stamp":"2023-12-16T00:00:47.805375+0000","objects_scrubbed":16,"log_size":1872,"log_dups_size":3000,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:42:04.966187+0000","scrub_duration":0.016303171000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19319,"num_read_kb":19311,"num_write":5234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17697,"num_omap_keys":80,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"54'11","reported_seq":107,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417202+0000","last_change":"2023-12-16T00:00:42.992882+0000","last_active":"2023-12-16T00:01:05.417202+0000","last_peered":"2023-12-16T00:01:05.417202+0000","last_clean":"2023-12-16T00:01:05.417202+0000","last_became_active":"2023-12-15T22:53:26.163538+0000","last_became_peered":"2023-12-15T22:53:26.163538+0000","last_unstale":"2023-12-16T00:01:05.417202+0000","last_undegraded":"2023-12-16T00:01:05.417202+0000","last_fullsized":"2023-12-16T00:01:05.417202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'11","last_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_deep_scrub":"54'11","last_deep_scrub_stamp":"2023-12-16T00:00:42.992799+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.992799+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:56.847943+0000","scrub_duration":0.0033031380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":41,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.417894+0000","last_change":"2023-12-16T00:03:05.417937+0000","last_active":"2023-12-16T00:03:05.417894+0000","last_peered":"2023-12-16T00:03:05.417894+0000","last_clean":"2023-12-16T00:03:05.417894+0000","last_became_active":"2023-12-15T22:52:55.189423+0000","last_became_peered":"2023-12-15T22:52:55.189423+0000","last_unstale":"2023-12-16T00:03:05.417894+0000","last_undegraded":"2023-12-16T00:03:05.417894+0000","last_fullsized":"2023-12-16T00:03:05.417894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.417813+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.417813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:53.034817+0000","scrub_duration":0.00098145000000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:09.234989+0000","last_change":"2023-12-16T00:04:09.235010+0000","last_active":"2023-12-16T00:04:09.234989+0000","last_peered":"2023-12-16T00:04:09.234989+0000","last_clean":"2023-12-16T00:04:09.234989+0000","last_became_active":"2023-12-15T22:52:53.176372+0000","last_became_peered":"2023-12-15T22:52:53.176372+0000","last_unstale":"2023-12-16T00:04:09.234989+0000","last_undegraded":"2023-12-16T00:04:09.234989+0000","last_fullsized":"2023-12-16T00:04:09.234989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:09.234925+0000","last_clean_scrub_stamp":"2023-12-16T00:04:09.234925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:07:37.300137+0000","scrub_duration":0.00099844600000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"54'2","reported_seq":253,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:04.436189+0000","last_change":"2023-12-16T00:03:04.436189+0000","last_active":"2023-12-16T00:03:04.436189+0000","last_peered":"2023-12-16T00:03:04.436189+0000","last_clean":"2023-12-16T00:03:04.436189+0000","last_became_active":"2023-12-15T22:53:04.317530+0000","last_became_peered":"2023-12-15T22:53:04.317530+0000","last_unstale":"2023-12-16T00:03:04.436189+0000","last_undegraded":"2023-12-16T00:03:04.436189+0000","last_fullsized":"2023-12-16T00:03:04.436189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2023-12-16T00:03:04.436109+0000","last_clean_scrub_stamp":"2023-12-16T00:03:04.436109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:53.631913+0000","scrub_duration":0.0025361540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"54'75","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:48.322949+0000","last_change":"2023-12-16T00:02:48.322949+0000","last_active":"2023-12-16T00:02:48.322949+0000","last_peered":"2023-12-16T00:02:48.322949+0000","last_clean":"2023-12-16T00:02:48.322949+0000","last_became_active":"2023-12-15T22:53:06.319973+0000","last_became_peered":"2023-12-15T22:53:06.319973+0000","last_unstale":"2023-12-16T00:02:48.322949+0000","last_undegraded":"2023-12-16T00:02:48.322949+0000","last_fullsized":"2023-12-16T00:02:48.322949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'75","last_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_deep_scrub":"54'75","last_deep_scrub_stamp":"2023-12-16T00:02:48.322853+0000","last_clean_scrub_stamp":"2023-12-16T00:02:48.322853+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:29.104523+0000","scrub_duration":0.003697035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"54'13","reported_seq":811,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:43.119127+0000","last_change":"2023-12-16T00:02:43.119127+0000","last_active":"2023-12-16T00:02:43.119127+0000","last_peered":"2023-12-16T00:02:43.119127+0000","last_clean":"2023-12-16T00:02:43.119127+0000","last_became_active":"2023-12-15T22:53:08.332004+0000","last_became_peered":"2023-12-15T22:53:08.332004+0000","last_unstale":"2023-12-16T00:02:43.119127+0000","last_undegraded":"2023-12-16T00:02:43.119127+0000","last_fullsized":"2023-12-16T00:02:43.119127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'13","last_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_deep_scrub":"54'13","last_deep_scrub_stamp":"2023-12-16T00:02:43.119021+0000","last_clean_scrub_stamp":"2023-12-16T00:02:43.119021+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:08.050024+0000","scrub_duration":0.0021957420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:33.219713+0000","last_change":"2023-12-16T00:01:33.219713+0000","last_active":"2023-12-16T00:01:33.219713+0000","last_peered":"2023-12-16T00:01:33.219713+0000","last_clean":"2023-12-16T00:01:33.219713+0000","last_became_active":"2023-12-15T22:53:10.339314+0000","last_became_peered":"2023-12-15T22:53:10.339314+0000","last_unstale":"2023-12-16T00:01:33.219713+0000","last_undegraded":"2023-12-16T00:01:33.219713+0000","last_fullsized":"2023-12-16T00:01:33.219713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:33.219630+0000","last_clean_scrub_stamp":"2023-12-16T00:01:33.219630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:31.607009+0000","scrub_duration":0.000939706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.827287+0000","last_change":"2023-12-16T00:04:17.827287+0000","last_active":"2023-12-16T00:04:17.827287+0000","last_peered":"2023-12-16T00:04:17.827287+0000","last_clean":"2023-12-16T00:04:17.827287+0000","last_became_active":"2023-12-15T23:08:37.337941+0000","last_became_peered":"2023-12-15T23:08:37.337941+0000","last_unstale":"2023-12-16T00:04:17.827287+0000","last_undegraded":"2023-12-16T00:04:17.827287+0000","last_fullsized":"2023-12-16T00:04:17.827287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.827208+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.827208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:45.730814+0000","scrub_duration":0.00094996999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"54'183","reported_seq":5926,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:46.413855+0000","last_change":"2023-12-16T00:01:41.803834+0000","last_active":"2023-12-16T00:01:46.413855+0000","last_peered":"2023-12-16T00:01:46.413855+0000","last_clean":"2023-12-16T00:01:46.413855+0000","last_became_active":"2023-12-15T22:54:04.178917+0000","last_became_peered":"2023-12-15T22:54:04.178917+0000","last_unstale":"2023-12-16T00:01:46.413855+0000","last_undegraded":"2023-12-16T00:01:46.413855+0000","last_fullsized":"2023-12-16T00:01:46.413855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'183","last_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_deep_scrub":"54'183","last_deep_scrub_stamp":"2023-12-16T00:01:41.803667+0000","last_clean_scrub_stamp":"2023-12-16T00:01:41.803667+0000","objects_scrubbed":45,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:16.385371+0000","scrub_duration":0.023798956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6575,"num_read_kb":6523,"num_write":207,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14250,"num_omap_keys":58,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:06.092070+0000","last_change":"2023-12-16T00:02:06.092070+0000","last_active":"2023-12-16T00:02:06.092070+0000","last_peered":"2023-12-16T00:02:06.092070+0000","last_clean":"2023-12-16T00:02:06.092070+0000","last_became_active":"2023-12-15T22:53:58.169550+0000","last_became_peered":"2023-12-15T22:53:58.169550+0000","last_unstale":"2023-12-16T00:02:06.092070+0000","last_undegraded":"2023-12-16T00:02:06.092070+0000","last_fullsized":"2023-12-16T00:02:06.092070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:06.091992+0000","last_clean_scrub_stamp":"2023-12-16T00:02:06.091992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:52:53.708996+0000","scrub_duration":0.001310922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"54'14","reported_seq":122,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:32.059457+0000","last_change":"2023-12-16T00:01:32.059457+0000","last_active":"2023-12-16T00:01:32.059457+0000","last_peered":"2023-12-16T00:01:32.059457+0000","last_clean":"2023-12-16T00:01:32.059457+0000","last_became_active":"2023-12-15T22:53:32.190517+0000","last_became_peered":"2023-12-15T22:53:32.190517+0000","last_unstale":"2023-12-16T00:01:32.059457+0000","last_undegraded":"2023-12-16T00:01:32.059457+0000","last_fullsized":"2023-12-16T00:01:32.059457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:32.059356+0000","last_clean_scrub_stamp":"2023-12-16T00:01:32.059356+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:52:11.719615+0000","scrub_duration":0.0048232539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":84,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"54'577","reported_seq":1519,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:15.513307+0000","last_change":"2023-12-16T00:02:15.513307+0000","last_active":"2023-12-16T00:02:15.513307+0000","last_peered":"2023-12-16T00:02:15.513307+0000","last_clean":"2023-12-16T00:02:15.513307+0000","last_became_active":"2023-12-15T22:53:30.180365+0000","last_became_peered":"2023-12-15T22:53:30.180365+0000","last_unstale":"2023-12-16T00:02:15.513307+0000","last_undegraded":"2023-12-16T00:02:15.513307+0000","last_fullsized":"2023-12-16T00:02:15.513307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:02:15.513177+0000","last_clean_scrub_stamp":"2023-12-16T00:02:15.513177+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:38:20.933601+0000","scrub_duration":0.0025047350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"54'254","reported_seq":441,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418257+0000","last_change":"2023-12-16T00:00:53.253697+0000","last_active":"2023-12-16T00:01:10.418257+0000","last_peered":"2023-12-16T00:01:10.418257+0000","last_clean":"2023-12-16T00:01:10.418257+0000","last_became_active":"2023-12-15T22:53:28.167764+0000","last_became_peered":"2023-12-15T22:53:28.167764+0000","last_unstale":"2023-12-16T00:01:10.418257+0000","last_undegraded":"2023-12-16T00:01:10.418257+0000","last_fullsized":"2023-12-16T00:01:10.418257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'254","last_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_deep_scrub":"54'254","last_deep_scrub_stamp":"2023-12-16T00:00:53.253561+0000","last_clean_scrub_stamp":"2023-12-16T00:00:53.253561+0000","objects_scrubbed":17,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:28:08.339449+0000","scrub_duration":0.010387397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":323,"num_read_kb":316,"num_write":379,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17842,"num_omap_keys":79,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"54'28","reported_seq":163,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404981+0000","last_change":"2023-12-16T00:01:00.778805+0000","last_active":"2023-12-16T00:01:06.404981+0000","last_peered":"2023-12-16T00:01:06.404981+0000","last_clean":"2023-12-16T00:01:06.404981+0000","last_became_active":"2023-12-15T22:53:26.162252+0000","last_became_peered":"2023-12-15T22:53:26.162252+0000","last_unstale":"2023-12-16T00:01:06.404981+0000","last_undegraded":"2023-12-16T00:01:06.404981+0000","last_fullsized":"2023-12-16T00:01:06.404981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:01:00.778710+0000","last_clean_scrub_stamp":"2023-12-16T00:01:00.778710+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:54.251904+0000","scrub_duration":0.0045643849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":197,"num_write":152,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:57.430981+0000","last_change":"2023-12-16T00:02:57.431000+0000","last_active":"2023-12-16T00:02:57.430981+0000","last_peered":"2023-12-16T00:02:57.430981+0000","last_clean":"2023-12-16T00:02:57.430981+0000","last_became_active":"2023-12-15T22:52:55.194006+0000","last_became_peered":"2023-12-15T22:52:55.194006+0000","last_unstale":"2023-12-16T00:02:57.430981+0000","last_undegraded":"2023-12-16T00:02:57.430981+0000","last_fullsized":"2023-12-16T00:02:57.430981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:57.430918+0000","last_clean_scrub_stamp":"2023-12-16T00:02:57.430918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:22.361920+0000","scrub_duration":0.0010613129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.810746+0000","last_change":"2023-12-16T00:04:41.810765+0000","last_active":"2023-12-16T00:04:41.810746+0000","last_peered":"2023-12-16T00:04:41.810746+0000","last_clean":"2023-12-16T00:04:41.810746+0000","last_became_active":"2023-12-15T22:52:53.174454+0000","last_became_peered":"2023-12-15T22:52:53.174454+0000","last_unstale":"2023-12-16T00:04:41.810746+0000","last_undegraded":"2023-12-16T00:04:41.810746+0000","last_fullsized":"2023-12-16T00:04:41.810746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.810681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.810681+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.810681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:27:02.365239+0000","scrub_duration":0.000874827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"54'9","reported_seq":820,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:59.799885+0000","last_change":"2023-12-16T00:03:59.799917+0000","last_active":"2023-12-16T00:03:59.799885+0000","last_peered":"2023-12-16T00:03:59.799885+0000","last_clean":"2023-12-16T00:03:59.799885+0000","last_became_active":"2023-12-15T22:53:04.321270+0000","last_became_peered":"2023-12-15T22:53:04.321270+0000","last_unstale":"2023-12-16T00:03:59.799885+0000","last_undegraded":"2023-12-16T00:03:59.799885+0000","last_fullsized":"2023-12-16T00:03:59.799885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'9","last_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_deep_scrub":"54'9","last_deep_scrub_stamp":"2023-12-16T00:03:59.799820+0000","last_clean_scrub_stamp":"2023-12-16T00:03:59.799820+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:24.148485+0000","scrub_duration":0.0029504150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"54'97","reported_seq":222,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:11.207686+0000","last_change":"2023-12-16T00:03:11.207686+0000","last_active":"2023-12-16T00:03:11.207686+0000","last_peered":"2023-12-16T00:03:11.207686+0000","last_clean":"2023-12-16T00:03:11.207686+0000","last_became_active":"2023-12-15T22:53:06.320159+0000","last_became_peered":"2023-12-15T22:53:06.320159+0000","last_unstale":"2023-12-16T00:03:11.207686+0000","last_undegraded":"2023-12-16T00:03:11.207686+0000","last_fullsized":"2023-12-16T00:03:11.207686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'97","last_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_deep_scrub":"54'97","last_deep_scrub_stamp":"2023-12-16T00:03:11.207580+0000","last_clean_scrub_stamp":"2023-12-16T00:03:11.207580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:46.050400+0000","scrub_duration":0.0049966359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:00.158574+0000","last_change":"2023-12-16T00:02:00.158574+0000","last_active":"2023-12-16T00:02:00.158574+0000","last_peered":"2023-12-16T00:02:00.158574+0000","last_clean":"2023-12-16T00:02:00.158574+0000","last_became_active":"2023-12-15T22:53:08.335394+0000","last_became_peered":"2023-12-15T22:53:08.335394+0000","last_unstale":"2023-12-16T00:02:00.158574+0000","last_undegraded":"2023-12-16T00:02:00.158574+0000","last_fullsized":"2023-12-16T00:02:00.158574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:00.158499+0000","last_clean_scrub_stamp":"2023-12-16T00:02:00.158499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:07.013736+0000","scrub_duration":0.0011103770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:23.134858+0000","last_change":"2023-12-16T00:01:23.134858+0000","last_active":"2023-12-16T00:01:23.134858+0000","last_peered":"2023-12-16T00:01:23.134858+0000","last_clean":"2023-12-16T00:01:23.134858+0000","last_became_active":"2023-12-15T22:53:10.339056+0000","last_became_peered":"2023-12-15T22:53:10.339056+0000","last_unstale":"2023-12-16T00:01:23.134858+0000","last_undegraded":"2023-12-16T00:01:23.134858+0000","last_fullsized":"2023-12-16T00:01:23.134858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:23.134748+0000","last_clean_scrub_stamp":"2023-12-16T00:01:23.134748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:08:28.766460+0000","scrub_duration":0.001211469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:03.182767+0000","last_change":"2023-12-16T00:04:03.182767+0000","last_active":"2023-12-16T00:04:03.182767+0000","last_peered":"2023-12-16T00:04:03.182767+0000","last_clean":"2023-12-16T00:04:03.182767+0000","last_became_active":"2023-12-15T23:08:37.340928+0000","last_became_peered":"2023-12-15T23:08:37.340928+0000","last_unstale":"2023-12-16T00:04:03.182767+0000","last_undegraded":"2023-12-16T00:04:03.182767+0000","last_fullsized":"2023-12-16T00:04:03.182767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:03.182682+0000","last_clean_scrub_stamp":"2023-12-16T00:04:03.182682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:29:32.339951+0000","scrub_duration":0.0012782679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"54'156","reported_seq":4072,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:26.660885+0000","last_change":"2023-12-16T00:04:26.660931+0000","last_active":"2023-12-16T00:04:26.660885+0000","last_peered":"2023-12-16T00:04:26.660885+0000","last_clean":"2023-12-16T00:04:26.660885+0000","last_became_active":"2023-12-15T22:54:04.183724+0000","last_became_peered":"2023-12-15T22:54:04.183724+0000","last_unstale":"2023-12-16T00:04:26.660885+0000","last_undegraded":"2023-12-16T00:04:26.660885+0000","last_fullsized":"2023-12-16T00:04:26.660885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'156","last_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_deep_scrub":"54'156","last_deep_scrub_stamp":"2023-12-16T00:04:26.660828+0000","last_clean_scrub_stamp":"2023-12-16T00:04:26.660828+0000","objects_scrubbed":42,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:08:20.920894+0000","scrub_duration":0.020600820999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":5109,"num_read_kb":5067,"num_write":160,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10370,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:12.188470+0000","last_change":"2023-12-16T00:03:12.188470+0000","last_active":"2023-12-16T00:03:12.188470+0000","last_peered":"2023-12-16T00:03:12.188470+0000","last_clean":"2023-12-16T00:03:12.188470+0000","last_became_active":"2023-12-15T22:53:58.173241+0000","last_became_peered":"2023-12-15T22:53:58.173241+0000","last_unstale":"2023-12-16T00:03:12.188470+0000","last_undegraded":"2023-12-16T00:03:12.188470+0000","last_fullsized":"2023-12-16T00:03:12.188470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:12.188386+0000","last_clean_scrub_stamp":"2023-12-16T00:03:12.188386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:36.227010+0000","scrub_duration":0.001170655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"54'12","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:50.246193+0000","last_change":"2023-12-16T00:01:50.246193+0000","last_active":"2023-12-16T00:01:50.246193+0000","last_peered":"2023-12-16T00:01:50.246193+0000","last_clean":"2023-12-16T00:01:50.246193+0000","last_became_active":"2023-12-15T22:53:32.192265+0000","last_became_peered":"2023-12-15T22:53:32.192265+0000","last_unstale":"2023-12-16T00:01:50.246193+0000","last_undegraded":"2023-12-16T00:01:50.246193+0000","last_fullsized":"2023-12-16T00:01:50.246193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:50.246123+0000","last_clean_scrub_stamp":"2023-12-16T00:01:50.246123+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:00:59.011564+0000","scrub_duration":0.0032782190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":78,"num_read_kb":61,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"54'577","reported_seq":1447,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:26.930016+0000","last_change":"2023-12-16T00:01:26.930016+0000","last_active":"2023-12-16T00:01:26.930016+0000","last_peered":"2023-12-16T00:01:26.930016+0000","last_clean":"2023-12-16T00:01:26.930016+0000","last_became_active":"2023-12-15T22:53:30.180721+0000","last_became_peered":"2023-12-15T22:53:30.180721+0000","last_unstale":"2023-12-16T00:01:26.930016+0000","last_undegraded":"2023-12-16T00:01:26.930016+0000","last_fullsized":"2023-12-16T00:01:26.930016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'577","last_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_deep_scrub":"54'577","last_deep_scrub_stamp":"2023-12-16T00:01:26.929934+0000","last_clean_scrub_stamp":"2023-12-16T00:01:26.929934+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:28.971127+0000","scrub_duration":0.0023356129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'212","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:56.986569+0000","last_change":"2023-12-16T00:01:56.986569+0000","last_active":"2023-12-16T00:01:56.986569+0000","last_peered":"2023-12-16T00:01:56.986569+0000","last_clean":"2023-12-16T00:01:56.986569+0000","last_became_active":"2023-12-15T22:53:28.165800+0000","last_became_peered":"2023-12-15T22:53:28.165800+0000","last_unstale":"2023-12-16T00:01:56.986569+0000","last_undegraded":"2023-12-16T00:01:56.986569+0000","last_fullsized":"2023-12-16T00:01:56.986569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'212","last_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_deep_scrub":"54'212","last_deep_scrub_stamp":"2023-12-16T00:01:56.986441+0000","last_clean_scrub_stamp":"2023-12-16T00:01:56.986441+0000","objects_scrubbed":24,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:19:37.556357+0000","scrub_duration":0.01334484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":271,"num_read_kb":263,"num_write":262,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"54'4","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:07.880946+0000","last_change":"2023-12-16T00:04:07.880946+0000","last_active":"2023-12-16T00:04:07.880946+0000","last_peered":"2023-12-16T00:04:07.880946+0000","last_clean":"2023-12-16T00:04:07.880946+0000","last_became_active":"2023-12-15T22:55:02.191095+0000","last_became_peered":"2023-12-15T22:55:02.191095+0000","last_unstale":"2023-12-16T00:04:07.880946+0000","last_undegraded":"2023-12-16T00:04:07.880946+0000","last_fullsized":"2023-12-16T00:04:07.880946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:04:07.880856+0000","last_clean_scrub_stamp":"2023-12-16T00:04:07.880856+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:56.543873+0000","scrub_duration":0.003087462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:10.384434+0000","last_change":"2023-12-16T00:03:10.384452+0000","last_active":"2023-12-16T00:03:10.384434+0000","last_peered":"2023-12-16T00:03:10.384434+0000","last_clean":"2023-12-16T00:03:10.384434+0000","last_became_active":"2023-12-15T22:52:55.187800+0000","last_became_peered":"2023-12-15T22:52:55.187800+0000","last_unstale":"2023-12-16T00:03:10.384434+0000","last_undegraded":"2023-12-16T00:03:10.384434+0000","last_fullsized":"2023-12-16T00:03:10.384434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:10.384379+0000","last_clean_scrub_stamp":"2023-12-16T00:03:10.384379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:26:58.370845+0000","scrub_duration":0.00093618200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:42.852312+0000","last_change":"2023-12-16T00:04:42.852332+0000","last_active":"2023-12-16T00:04:42.852312+0000","last_peered":"2023-12-16T00:04:42.852312+0000","last_clean":"2023-12-16T00:04:42.852312+0000","last_became_active":"2023-12-15T22:52:53.174640+0000","last_became_peered":"2023-12-15T22:52:53.174640+0000","last_unstale":"2023-12-16T00:04:42.852312+0000","last_undegraded":"2023-12-16T00:04:42.852312+0000","last_fullsized":"2023-12-16T00:04:42.852312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:42.852247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:42.852247+0000","last_clean_scrub_stamp":"2023-12-16T00:04:42.852247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:52.301374+0000","scrub_duration":0.00091768100000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.193570+0000","last_change":"2023-12-16T00:03:34.193596+0000","last_active":"2023-12-16T00:03:34.193570+0000","last_peered":"2023-12-16T00:03:34.193570+0000","last_clean":"2023-12-16T00:03:34.193570+0000","last_became_active":"2023-12-15T22:53:04.316122+0000","last_became_peered":"2023-12-15T22:53:04.316122+0000","last_unstale":"2023-12-16T00:03:34.193570+0000","last_undegraded":"2023-12-16T00:03:34.193570+0000","last_fullsized":"2023-12-16T00:03:34.193570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:03:34.193509+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.193509+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:09:52.798577+0000","scrub_duration":0.0029407489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":23,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'51","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:01.116493+0000","last_change":"2023-12-16T00:03:01.116493+0000","last_active":"2023-12-16T00:03:01.116493+0000","last_peered":"2023-12-16T00:03:01.116493+0000","last_clean":"2023-12-16T00:03:01.116493+0000","last_became_active":"2023-12-15T22:53:06.319684+0000","last_became_peered":"2023-12-15T22:53:06.319684+0000","last_unstale":"2023-12-16T00:03:01.116493+0000","last_undegraded":"2023-12-16T00:03:01.116493+0000","last_fullsized":"2023-12-16T00:03:01.116493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'51","last_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_deep_scrub":"54'51","last_deep_scrub_stamp":"2023-12-16T00:03:01.116401+0000","last_clean_scrub_stamp":"2023-12-16T00:03:01.116401+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:17:55.676127+0000","scrub_duration":0.0033054320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":74,"num_read_kb":68,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:21.525360+0000","last_change":"2023-12-16T00:02:21.525360+0000","last_active":"2023-12-16T00:02:21.525360+0000","last_peered":"2023-12-16T00:02:21.525360+0000","last_clean":"2023-12-16T00:02:21.525360+0000","last_became_active":"2023-12-15T22:53:08.329833+0000","last_became_peered":"2023-12-15T22:53:08.329833+0000","last_unstale":"2023-12-16T00:02:21.525360+0000","last_undegraded":"2023-12-16T00:02:21.525360+0000","last_fullsized":"2023-12-16T00:02:21.525360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:21.525274+0000","last_clean_scrub_stamp":"2023-12-16T00:02:21.525274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:37.857908+0000","scrub_duration":0.0011872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:51.754995+0000","last_change":"2023-12-16T00:00:51.754995+0000","last_active":"2023-12-16T00:00:51.754995+0000","last_peered":"2023-12-16T00:00:51.754995+0000","last_clean":"2023-12-16T00:00:51.754995+0000","last_became_active":"2023-12-15T22:53:11.079369+0000","last_became_peered":"2023-12-15T22:53:11.079369+0000","last_unstale":"2023-12-16T00:00:51.754995+0000","last_undegraded":"2023-12-16T00:00:51.754995+0000","last_fullsized":"2023-12-16T00:00:51.754995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:00:51.754888+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.754888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:53.796081+0000","scrub_duration":0.00099567800000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:43.190876+0000","last_change":"2023-12-16T00:04:43.190911+0000","last_active":"2023-12-16T00:04:43.190876+0000","last_peered":"2023-12-16T00:04:43.190876+0000","last_clean":"2023-12-16T00:04:43.190876+0000","last_became_active":"2023-12-15T23:08:37.343645+0000","last_became_peered":"2023-12-15T23:08:37.343645+0000","last_unstale":"2023-12-16T00:04:43.190876+0000","last_undegraded":"2023-12-16T00:04:43.190876+0000","last_fullsized":"2023-12-16T00:04:43.190876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:43.190803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:43.190803+0000","last_clean_scrub_stamp":"2023-12-16T00:04:43.190803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:18:53.054005+0000","scrub_duration":0.0014524150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"54'155","reported_seq":3685,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:12.689757+0000","last_change":"2023-12-16T00:02:12.689757+0000","last_active":"2023-12-16T00:02:12.689757+0000","last_peered":"2023-12-16T00:02:12.689757+0000","last_clean":"2023-12-16T00:02:12.689757+0000","last_became_active":"2023-12-15T22:54:04.179157+0000","last_became_peered":"2023-12-15T22:54:04.179157+0000","last_unstale":"2023-12-16T00:02:12.689757+0000","last_undegraded":"2023-12-16T00:02:12.689757+0000","last_fullsized":"2023-12-16T00:02:12.689757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'155","last_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_deep_scrub":"54'155","last_deep_scrub_stamp":"2023-12-16T00:02:12.689660+0000","last_clean_scrub_stamp":"2023-12-16T00:02:12.689660+0000","objects_scrubbed":45,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:30:41.409804+0000","scrub_duration":0.021270672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":4229,"num_read_kb":4180,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9696,"num_omap_keys":37,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:40.925869+0000","last_change":"2023-12-16T00:01:40.925869+0000","last_active":"2023-12-16T00:01:40.925869+0000","last_peered":"2023-12-16T00:01:40.925869+0000","last_clean":"2023-12-16T00:01:40.925869+0000","last_became_active":"2023-12-15T22:53:58.167888+0000","last_became_peered":"2023-12-15T22:53:58.167888+0000","last_unstale":"2023-12-16T00:01:40.925869+0000","last_undegraded":"2023-12-16T00:01:40.925869+0000","last_fullsized":"2023-12-16T00:01:40.925869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:40.925785+0000","last_clean_scrub_stamp":"2023-12-16T00:01:40.925785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:59.550032+0000","scrub_duration":0.001044023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"54'43","reported_seq":138,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.296944+0000","last_change":"2023-12-16T00:02:30.296944+0000","last_active":"2023-12-16T00:02:30.296944+0000","last_peered":"2023-12-16T00:02:30.296944+0000","last_clean":"2023-12-16T00:02:30.296944+0000","last_became_active":"2023-12-15T22:53:32.189819+0000","last_became_peered":"2023-12-15T22:53:32.189819+0000","last_unstale":"2023-12-16T00:02:30.296944+0000","last_undegraded":"2023-12-16T00:02:30.296944+0000","last_fullsized":"2023-12-16T00:02:30.296944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'43","last_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_deep_scrub":"54'43","last_deep_scrub_stamp":"2023-12-16T00:02:30.296841+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.296841+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:56.688385+0000","scrub_duration":0.0062088559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2665,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":115,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:49.892789+0000","last_change":"2023-12-16T00:01:49.892789+0000","last_active":"2023-12-16T00:01:49.892789+0000","last_peered":"2023-12-16T00:01:49.892789+0000","last_clean":"2023-12-16T00:01:49.892789+0000","last_became_active":"2023-12-15T22:53:30.180634+0000","last_became_peered":"2023-12-15T22:53:30.180634+0000","last_unstale":"2023-12-16T00:01:49.892789+0000","last_undegraded":"2023-12-16T00:01:49.892789+0000","last_fullsized":"2023-12-16T00:01:49.892789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:49.892712+0000","last_clean_scrub_stamp":"2023-12-16T00:01:49.892712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:51:25.672120+0000","scrub_duration":0.001291784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"54'124","reported_seq":271,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:16.038804+0000","last_change":"2023-12-16T00:01:16.038804+0000","last_active":"2023-12-16T00:01:16.038804+0000","last_peered":"2023-12-16T00:01:16.038804+0000","last_clean":"2023-12-16T00:01:16.038804+0000","last_became_active":"2023-12-15T22:53:28.166435+0000","last_became_peered":"2023-12-15T22:53:28.166435+0000","last_unstale":"2023-12-16T00:01:16.038804+0000","last_undegraded":"2023-12-16T00:01:16.038804+0000","last_fullsized":"2023-12-16T00:01:16.038804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'124","last_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_deep_scrub":"54'124","last_deep_scrub_stamp":"2023-12-16T00:01:16.038698+0000","last_clean_scrub_stamp":"2023-12-16T00:01:16.038698+0000","objects_scrubbed":13,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:34.662945+0000","scrub_duration":0.0069805249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":205,"num_read_kb":200,"num_write":141,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"54'20","reported_seq":157,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:15.637722+0000","last_change":"2023-12-16T00:00:56.808354+0000","last_active":"2023-12-16T00:01:15.637722+0000","last_peered":"2023-12-16T00:01:15.637722+0000","last_clean":"2023-12-16T00:01:15.637722+0000","last_became_active":"2023-12-15T22:53:26.157603+0000","last_became_peered":"2023-12-15T22:53:26.157603+0000","last_unstale":"2023-12-16T00:01:15.637722+0000","last_undegraded":"2023-12-16T00:01:15.637722+0000","last_fullsized":"2023-12-16T00:01:15.637722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'20","last_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_deep_scrub":"54'20","last_deep_scrub_stamp":"2023-12-16T00:00:56.808266+0000","last_clean_scrub_stamp":"2023-12-16T00:00:56.808266+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:48:51.020339+0000","scrub_duration":0.0045683679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":182,"num_write":101,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:47.009023+0000","last_change":"2023-12-16T00:03:47.009044+0000","last_active":"2023-12-16T00:03:47.009023+0000","last_peered":"2023-12-16T00:03:47.009023+0000","last_clean":"2023-12-16T00:03:47.009023+0000","last_became_active":"2023-12-15T22:52:55.187630+0000","last_became_peered":"2023-12-15T22:52:55.187630+0000","last_unstale":"2023-12-16T00:03:47.009023+0000","last_undegraded":"2023-12-16T00:03:47.009023+0000","last_fullsized":"2023-12-16T00:03:47.009023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:47.008959+0000","last_clean_scrub_stamp":"2023-12-16T00:03:47.008959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:38:54.378679+0000","scrub_duration":0.00088682099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:36.212174+0000","last_change":"2023-12-16T00:03:36.212174+0000","last_active":"2023-12-16T00:03:36.212174+0000","last_peered":"2023-12-16T00:03:36.212174+0000","last_clean":"2023-12-16T00:03:36.212174+0000","last_became_active":"2023-12-15T22:52:53.173933+0000","last_became_peered":"2023-12-15T22:52:53.173933+0000","last_unstale":"2023-12-16T00:03:36.212174+0000","last_undegraded":"2023-12-16T00:03:36.212174+0000","last_fullsized":"2023-12-16T00:03:36.212174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:36.212089+0000","last_clean_scrub_stamp":"2023-12-16T00:03:36.212089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:58:43.729491+0000","scrub_duration":0.0014192359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"54'5","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.540793+0000","last_change":"2023-12-16T00:03:29.540833+0000","last_active":"2023-12-16T00:03:29.540793+0000","last_peered":"2023-12-16T00:03:29.540793+0000","last_clean":"2023-12-16T00:03:29.540793+0000","last_became_active":"2023-12-15T22:53:04.322219+0000","last_became_peered":"2023-12-15T22:53:04.322219+0000","last_unstale":"2023-12-16T00:03:29.540793+0000","last_undegraded":"2023-12-16T00:03:29.540793+0000","last_fullsized":"2023-12-16T00:03:29.540793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'5","last_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_deep_scrub":"54'5","last_deep_scrub_stamp":"2023-12-16T00:03:29.540716+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.540716+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:13:47.095512+0000","scrub_duration":0.0021108590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":13,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"54'22","reported_seq":111,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:56.187949+0000","last_change":"2023-12-16T00:02:56.187949+0000","last_active":"2023-12-16T00:02:56.187949+0000","last_peered":"2023-12-16T00:02:56.187949+0000","last_clean":"2023-12-16T00:02:56.187949+0000","last_became_active":"2023-12-15T22:53:06.321463+0000","last_became_peered":"2023-12-15T22:53:06.321463+0000","last_unstale":"2023-12-16T00:02:56.187949+0000","last_undegraded":"2023-12-16T00:02:56.187949+0000","last_fullsized":"2023-12-16T00:02:56.187949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:02:56.187823+0000","last_clean_scrub_stamp":"2023-12-16T00:02:56.187823+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:21:01.973364+0000","scrub_duration":0.0029909340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:30.550775+0000","last_change":"2023-12-16T00:02:30.550775+0000","last_active":"2023-12-16T00:02:30.550775+0000","last_peered":"2023-12-16T00:02:30.550775+0000","last_clean":"2023-12-16T00:02:30.550775+0000","last_became_active":"2023-12-15T22:53:08.334679+0000","last_became_peered":"2023-12-15T22:53:08.334679+0000","last_unstale":"2023-12-16T00:02:30.550775+0000","last_undegraded":"2023-12-16T00:02:30.550775+0000","last_fullsized":"2023-12-16T00:02:30.550775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:30.550689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:30.550689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:19.938615+0000","scrub_duration":0.0010873269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:24.110080+0000","last_change":"2023-12-16T00:01:24.110080+0000","last_active":"2023-12-16T00:01:24.110080+0000","last_peered":"2023-12-16T00:01:24.110080+0000","last_clean":"2023-12-16T00:01:24.110080+0000","last_became_active":"2023-12-15T22:53:10.341219+0000","last_became_peered":"2023-12-15T22:53:10.341219+0000","last_unstale":"2023-12-16T00:01:24.110080+0000","last_undegraded":"2023-12-16T00:01:24.110080+0000","last_fullsized":"2023-12-16T00:01:24.110080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:24.109991+0000","last_clean_scrub_stamp":"2023-12-16T00:01:24.109991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:52.830134+0000","scrub_duration":0.00087473300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:29.681452+0000","last_change":"2023-12-16T00:04:29.681452+0000","last_active":"2023-12-16T00:04:29.681452+0000","last_peered":"2023-12-16T00:04:29.681452+0000","last_clean":"2023-12-16T00:04:29.681452+0000","last_became_active":"2023-12-15T23:08:37.338476+0000","last_became_peered":"2023-12-15T23:08:37.338476+0000","last_unstale":"2023-12-16T00:04:29.681452+0000","last_undegraded":"2023-12-16T00:04:29.681452+0000","last_fullsized":"2023-12-16T00:04:29.681452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:29.681321+0000","last_clean_scrub_stamp":"2023-12-16T00:04:29.681321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:45:18.575890+0000","scrub_duration":0.0011304970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"54'122","reported_seq":1323,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:04.656814+0000","last_change":"2023-12-16T00:02:04.656814+0000","last_active":"2023-12-16T00:02:04.656814+0000","last_peered":"2023-12-16T00:02:04.656814+0000","last_clean":"2023-12-16T00:02:04.656814+0000","last_became_active":"2023-12-15T22:54:04.184178+0000","last_became_peered":"2023-12-15T22:54:04.184178+0000","last_unstale":"2023-12-16T00:02:04.656814+0000","last_undegraded":"2023-12-16T00:02:04.656814+0000","last_fullsized":"2023-12-16T00:02:04.656814+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'122","last_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_deep_scrub":"54'122","last_deep_scrub_stamp":"2023-12-16T00:02:04.656722+0000","last_clean_scrub_stamp":"2023-12-16T00:02:04.656722+0000","objects_scrubbed":37,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:26:17.023257+0000","scrub_duration":0.019740087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":1999,"num_read_kb":1968,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":26,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:57.993680+0000","last_change":"2023-12-16T00:01:57.993680+0000","last_active":"2023-12-16T00:01:57.993680+0000","last_peered":"2023-12-16T00:01:57.993680+0000","last_clean":"2023-12-16T00:01:57.993680+0000","last_became_active":"2023-12-15T22:53:58.166729+0000","last_became_peered":"2023-12-15T22:53:58.166729+0000","last_unstale":"2023-12-16T00:01:57.993680+0000","last_undegraded":"2023-12-16T00:01:57.993680+0000","last_fullsized":"2023-12-16T00:01:57.993680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:57.993595+0000","last_clean_scrub_stamp":"2023-12-16T00:01:57.993595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:07:24.916173+0000","scrub_duration":0.001206885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"54'153","reported_seq":398,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.020629+0000","last_change":"2023-12-16T00:02:10.020629+0000","last_active":"2023-12-16T00:02:10.020629+0000","last_peered":"2023-12-16T00:02:10.020629+0000","last_clean":"2023-12-16T00:02:10.020629+0000","last_became_active":"2023-12-15T22:53:32.191530+0000","last_became_peered":"2023-12-15T22:53:32.191530+0000","last_unstale":"2023-12-16T00:02:10.020629+0000","last_undegraded":"2023-12-16T00:02:10.020629+0000","last_fullsized":"2023-12-16T00:02:10.020629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'153","last_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_deep_scrub":"54'153","last_deep_scrub_stamp":"2023-12-16T00:02:10.020548+0000","last_clean_scrub_stamp":"2023-12-16T00:02:10.020548+0000","objects_scrubbed":2,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:37:25.431230+0000","scrub_duration":0.0030253049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":620,"num_write":300,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.237522+0000","last_change":"2023-12-16T00:02:34.237522+0000","last_active":"2023-12-16T00:02:34.237522+0000","last_peered":"2023-12-16T00:02:34.237522+0000","last_clean":"2023-12-16T00:02:34.237522+0000","last_became_active":"2023-12-15T22:53:30.176701+0000","last_became_peered":"2023-12-15T22:53:30.176701+0000","last_unstale":"2023-12-16T00:02:34.237522+0000","last_undegraded":"2023-12-16T00:02:34.237522+0000","last_fullsized":"2023-12-16T00:02:34.237522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.237443+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.237443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:23:44.567085+0000","scrub_duration":0.00092076099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"54'202","reported_seq":400,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:10.418894+0000","last_change":"2023-12-16T00:00:42.049319+0000","last_active":"2023-12-16T00:01:10.418894+0000","last_peered":"2023-12-16T00:01:10.418894+0000","last_clean":"2023-12-16T00:01:10.418894+0000","last_became_active":"2023-12-15T22:53:28.163557+0000","last_became_peered":"2023-12-15T22:53:28.163557+0000","last_unstale":"2023-12-16T00:01:10.418894+0000","last_undegraded":"2023-12-16T00:01:10.418894+0000","last_fullsized":"2023-12-16T00:01:10.418894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'202","last_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_deep_scrub":"54'202","last_deep_scrub_stamp":"2023-12-16T00:00:42.049188+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.049188+0000","objects_scrubbed":17,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:18:05.253146+0000","scrub_duration":0.011699639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":321,"num_read_kb":312,"num_write":245,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"54'17","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.404850+0000","last_change":"2023-12-16T00:01:04.838215+0000","last_active":"2023-12-16T00:01:06.404850+0000","last_peered":"2023-12-16T00:01:06.404850+0000","last_clean":"2023-12-16T00:01:06.404850+0000","last_became_active":"2023-12-15T22:53:26.160483+0000","last_became_peered":"2023-12-15T22:53:26.160483+0000","last_unstale":"2023-12-16T00:01:06.404850+0000","last_undegraded":"2023-12-16T00:01:06.404850+0000","last_fullsized":"2023-12-16T00:01:06.404850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'17","last_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_deep_scrub":"54'17","last_deep_scrub_stamp":"2023-12-16T00:01:04.838122+0000","last_clean_scrub_stamp":"2023-12-16T00:01:04.838122+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:06:15.593352+0000","scrub_duration":0.0068962559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:10.252767+0000","last_change":"2023-12-16T00:04:10.252786+0000","last_active":"2023-12-16T00:04:10.252767+0000","last_peered":"2023-12-16T00:04:10.252767+0000","last_clean":"2023-12-16T00:04:10.252767+0000","last_became_active":"2023-12-15T22:52:55.184981+0000","last_became_peered":"2023-12-15T22:52:55.184981+0000","last_unstale":"2023-12-16T00:04:10.252767+0000","last_undegraded":"2023-12-16T00:04:10.252767+0000","last_fullsized":"2023-12-16T00:04:10.252767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:10.252705+0000","last_clean_scrub_stamp":"2023-12-16T00:04:10.252705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:54:05.754592+0000","scrub_duration":0.00085390599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:57.202961+0000","last_change":"2023-12-16T00:03:57.202995+0000","last_active":"2023-12-16T00:03:57.202961+0000","last_peered":"2023-12-16T00:03:57.202961+0000","last_clean":"2023-12-16T00:03:57.202961+0000","last_became_active":"2023-12-15T22:52:53.174484+0000","last_became_peered":"2023-12-15T22:52:53.174484+0000","last_unstale":"2023-12-16T00:03:57.202961+0000","last_undegraded":"2023-12-16T00:03:57.202961+0000","last_fullsized":"2023-12-16T00:03:57.202961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:57.202889+0000","last_clean_scrub_stamp":"2023-12-16T00:03:57.202889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:46:43.817306+0000","scrub_duration":0.001274428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:05.463653+0000","last_change":"2023-12-16T00:03:05.463653+0000","last_active":"2023-12-16T00:03:05.463653+0000","last_peered":"2023-12-16T00:03:05.463653+0000","last_clean":"2023-12-16T00:03:05.463653+0000","last_became_active":"2023-12-15T22:53:04.318047+0000","last_became_peered":"2023-12-15T22:53:04.318047+0000","last_unstale":"2023-12-16T00:03:05.463653+0000","last_undegraded":"2023-12-16T00:03:05.463653+0000","last_fullsized":"2023-12-16T00:03:05.463653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:05.463535+0000","last_clean_scrub_stamp":"2023-12-16T00:03:05.463535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.940913+0000","scrub_duration":0.0012561849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"54'52","reported_seq":155,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:31.604419+0000","last_change":"2023-12-16T00:02:31.604419+0000","last_active":"2023-12-16T00:02:31.604419+0000","last_peered":"2023-12-16T00:02:31.604419+0000","last_clean":"2023-12-16T00:02:31.604419+0000","last_became_active":"2023-12-15T22:53:06.320350+0000","last_became_peered":"2023-12-15T22:53:06.320350+0000","last_unstale":"2023-12-16T00:02:31.604419+0000","last_undegraded":"2023-12-16T00:02:31.604419+0000","last_fullsized":"2023-12-16T00:02:31.604419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'52","last_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_deep_scrub":"54'52","last_deep_scrub_stamp":"2023-12-16T00:02:31.604332+0000","last_clean_scrub_stamp":"2023-12-16T00:02:31.604332+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:07:59.417049+0000","scrub_duration":0.0036151909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":48,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:34.327776+0000","last_change":"2023-12-16T00:02:34.327776+0000","last_active":"2023-12-16T00:02:34.327776+0000","last_peered":"2023-12-16T00:02:34.327776+0000","last_clean":"2023-12-16T00:02:34.327776+0000","last_became_active":"2023-12-15T22:53:08.333521+0000","last_became_peered":"2023-12-15T22:53:08.333521+0000","last_unstale":"2023-12-16T00:02:34.327776+0000","last_undegraded":"2023-12-16T00:02:34.327776+0000","last_fullsized":"2023-12-16T00:02:34.327776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:34.327689+0000","last_clean_scrub_stamp":"2023-12-16T00:02:34.327689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:41.845091+0000","scrub_duration":0.00089479000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:47.679968+0000","last_change":"2023-12-16T00:01:47.679968+0000","last_active":"2023-12-16T00:01:47.679968+0000","last_peered":"2023-12-16T00:01:47.679968+0000","last_clean":"2023-12-16T00:01:47.679968+0000","last_became_active":"2023-12-15T22:53:10.339739+0000","last_became_peered":"2023-12-15T22:53:10.339739+0000","last_unstale":"2023-12-16T00:01:47.679968+0000","last_undegraded":"2023-12-16T00:01:47.679968+0000","last_fullsized":"2023-12-16T00:01:47.679968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:01:47.679882+0000","last_clean_scrub_stamp":"2023-12-16T00:01:47.679882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:54.966535+0000","scrub_duration":0.00099216499999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"54'14","reported_seq":154,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:01.634861+0000","last_change":"2023-12-16T00:02:01.634861+0000","last_active":"2023-12-16T00:02:01.634861+0000","last_peered":"2023-12-16T00:02:01.634861+0000","last_clean":"2023-12-16T00:02:01.634861+0000","last_became_active":"2023-12-15T22:53:26.156072+0000","last_became_peered":"2023-12-15T22:53:26.156072+0000","last_unstale":"2023-12-16T00:02:01.634861+0000","last_undegraded":"2023-12-16T00:02:01.634861+0000","last_fullsized":"2023-12-16T00:02:01.634861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:02:01.634771+0000","last_clean_scrub_stamp":"2023-12-16T00:02:01.634771+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:01:09.624163+0000","scrub_duration":0.0051329119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.483672+0000","last_change":"2023-12-16T00:03:15.483672+0000","last_active":"2023-12-16T00:03:15.483672+0000","last_peered":"2023-12-16T00:03:15.483672+0000","last_clean":"2023-12-16T00:03:15.483672+0000","last_became_active":"2023-12-15T22:52:55.189806+0000","last_became_peered":"2023-12-15T22:52:55.189806+0000","last_unstale":"2023-12-16T00:03:15.483672+0000","last_undegraded":"2023-12-16T00:03:15.483672+0000","last_fullsized":"2023-12-16T00:03:15.483672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.483585+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.483585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:23.742907+0000","scrub_duration":0.0014693569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:09.425544+0000","last_change":"2023-12-16T00:03:09.425544+0000","last_active":"2023-12-16T00:03:09.425544+0000","last_peered":"2023-12-16T00:03:09.425544+0000","last_clean":"2023-12-16T00:03:09.425544+0000","last_became_active":"2023-12-15T22:53:01.292927+0000","last_became_peered":"2023-12-15T22:53:01.292927+0000","last_unstale":"2023-12-16T00:03:09.425544+0000","last_undegraded":"2023-12-16T00:03:09.425544+0000","last_fullsized":"2023-12-16T00:03:09.425544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:09.425467+0000","last_clean_scrub_stamp":"2023-12-16T00:03:09.425467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:47.194914+0000","scrub_duration":0.00096339600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"54'14","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.869331+0000","last_change":"2023-12-16T00:01:06.869331+0000","last_active":"2023-12-16T00:01:06.869331+0000","last_peered":"2023-12-16T00:01:06.869331+0000","last_clean":"2023-12-16T00:01:06.869331+0000","last_became_active":"2023-12-15T22:53:26.165675+0000","last_became_peered":"2023-12-15T22:53:26.165675+0000","last_unstale":"2023-12-16T00:01:06.869331+0000","last_undegraded":"2023-12-16T00:01:06.869331+0000","last_fullsized":"2023-12-16T00:01:06.869331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.869235+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.869235+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:33.585971+0000","scrub_duration":0.0077901439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":383,"num_read_kb":355,"num_write":76,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:18.374435+0000","last_change":"2023-12-16T00:03:18.374435+0000","last_active":"2023-12-16T00:03:18.374435+0000","last_peered":"2023-12-16T00:03:18.374435+0000","last_clean":"2023-12-16T00:03:18.374435+0000","last_became_active":"2023-12-15T22:52:55.188142+0000","last_became_peered":"2023-12-15T22:52:55.188142+0000","last_unstale":"2023-12-16T00:03:18.374435+0000","last_undegraded":"2023-12-16T00:03:18.374435+0000","last_fullsized":"2023-12-16T00:03:18.374435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:18.374350+0000","last_clean_scrub_stamp":"2023-12-16T00:03:18.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:43:10.789941+0000","scrub_duration":0.00094402600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:26.183034+0000","last_change":"2023-12-16T00:03:26.183034+0000","last_active":"2023-12-16T00:03:26.183034+0000","last_peered":"2023-12-16T00:03:26.183034+0000","last_clean":"2023-12-16T00:03:26.183034+0000","last_became_active":"2023-12-15T22:52:53.174792+0000","last_became_peered":"2023-12-15T22:52:53.174792+0000","last_unstale":"2023-12-16T00:03:26.183034+0000","last_undegraded":"2023-12-16T00:03:26.183034+0000","last_fullsized":"2023-12-16T00:03:26.183034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:26.182953+0000","last_clean_scrub_stamp":"2023-12-16T00:03:26.182953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:19:51.113955+0000","scrub_duration":0.001482875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"54'6","reported_seq":112,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:00.447995+0000","last_change":"2023-12-16T00:01:20.808784+0000","last_active":"2023-12-16T00:03:00.447995+0000","last_peered":"2023-12-16T00:03:00.447995+0000","last_clean":"2023-12-16T00:03:00.447995+0000","last_became_active":"2023-12-15T22:53:26.158305+0000","last_became_peered":"2023-12-15T22:53:26.158305+0000","last_unstale":"2023-12-16T00:03:00.447995+0000","last_undegraded":"2023-12-16T00:03:00.447995+0000","last_fullsized":"2023-12-16T00:03:00.447995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:01:20.808697+0000","last_clean_scrub_stamp":"2023-12-16T00:01:20.808697+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:29:55.970105+0000","scrub_duration":0.0037761600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":70,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:14.833875+0000","last_change":"2023-12-16T00:04:14.833875+0000","last_active":"2023-12-16T00:04:14.833875+0000","last_peered":"2023-12-16T00:04:14.833875+0000","last_clean":"2023-12-16T00:04:14.833875+0000","last_became_active":"2023-12-15T22:52:55.191362+0000","last_became_peered":"2023-12-15T22:52:55.191362+0000","last_unstale":"2023-12-16T00:04:14.833875+0000","last_undegraded":"2023-12-16T00:04:14.833875+0000","last_fullsized":"2023-12-16T00:04:14.833875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:14.833789+0000","last_clean_scrub_stamp":"2023-12-16T00:04:14.833789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:40.615567+0000","scrub_duration":0.00096600899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:51.568117+0000","last_change":"2023-12-16T00:03:51.568117+0000","last_active":"2023-12-16T00:03:51.568117+0000","last_peered":"2023-12-16T00:03:51.568117+0000","last_clean":"2023-12-16T00:03:51.568117+0000","last_became_active":"2023-12-15T22:53:01.291430+0000","last_became_peered":"2023-12-15T22:53:01.291430+0000","last_unstale":"2023-12-16T00:03:51.568117+0000","last_undegraded":"2023-12-16T00:03:51.568117+0000","last_fullsized":"2023-12-16T00:03:51.568117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:51.568038+0000","last_clean_scrub_stamp":"2023-12-16T00:03:51.568038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:22:26.529802+0000","scrub_duration":0.00091025800000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"54'12","reported_seq":137,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:13.015000+0000","last_change":"2023-12-16T00:01:13.015000+0000","last_active":"2023-12-16T00:01:13.015000+0000","last_peered":"2023-12-16T00:01:13.015000+0000","last_clean":"2023-12-16T00:01:13.015000+0000","last_became_active":"2023-12-15T22:53:26.156559+0000","last_became_peered":"2023-12-15T22:53:26.156559+0000","last_unstale":"2023-12-16T00:01:13.015000+0000","last_undegraded":"2023-12-16T00:01:13.015000+0000","last_fullsized":"2023-12-16T00:01:13.015000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:01:13.014893+0000","last_clean_scrub_stamp":"2023-12-16T00:01:13.014893+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:56:06.458531+0000","scrub_duration":0.0051001529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":55,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:27.605043+0000","last_change":"2023-12-16T00:03:27.605043+0000","last_active":"2023-12-16T00:03:27.605043+0000","last_peered":"2023-12-16T00:03:27.605043+0000","last_clean":"2023-12-16T00:03:27.605043+0000","last_became_active":"2023-12-15T22:52:55.189663+0000","last_became_peered":"2023-12-15T22:52:55.189663+0000","last_unstale":"2023-12-16T00:03:27.605043+0000","last_undegraded":"2023-12-16T00:03:27.605043+0000","last_fullsized":"2023-12-16T00:03:27.605043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:27.604955+0000","last_clean_scrub_stamp":"2023-12-16T00:03:27.604955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:20:09.946756+0000","scrub_duration":0.001362722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:19.247539+0000","last_change":"2023-12-16T00:04:19.247558+0000","last_active":"2023-12-16T00:04:19.247539+0000","last_peered":"2023-12-16T00:04:19.247539+0000","last_clean":"2023-12-16T00:04:19.247539+0000","last_became_active":"2023-12-15T22:52:53.176612+0000","last_became_peered":"2023-12-15T22:52:53.176612+0000","last_unstale":"2023-12-16T00:04:19.247539+0000","last_undegraded":"2023-12-16T00:04:19.247539+0000","last_fullsized":"2023-12-16T00:04:19.247539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:19.247460+0000","last_clean_scrub_stamp":"2023-12-16T00:04:19.247460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:01:42.927615+0000","scrub_duration":0.0011105209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"54'10","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:05.417582+0000","last_change":"2023-12-16T00:00:38.742008+0000","last_active":"2023-12-16T00:01:05.417582+0000","last_peered":"2023-12-16T00:01:05.417582+0000","last_clean":"2023-12-16T00:01:05.417582+0000","last_became_active":"2023-12-15T22:53:26.165544+0000","last_became_peered":"2023-12-15T22:53:26.165544+0000","last_unstale":"2023-12-16T00:01:05.417582+0000","last_undegraded":"2023-12-16T00:01:05.417582+0000","last_fullsized":"2023-12-16T00:01:05.417582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'10","last_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_deep_scrub":"54'10","last_deep_scrub_stamp":"2023-12-16T00:00:38.741907+0000","last_clean_scrub_stamp":"2023-12-16T00:00:38.741907+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:57:48.609313+0000","scrub_duration":0.0042997299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":49,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:24.246579+0000","last_change":"2023-12-16T00:03:24.246579+0000","last_active":"2023-12-16T00:03:24.246579+0000","last_peered":"2023-12-16T00:03:24.246579+0000","last_clean":"2023-12-16T00:03:24.246579+0000","last_became_active":"2023-12-15T22:52:55.191668+0000","last_became_peered":"2023-12-15T22:52:55.191668+0000","last_unstale":"2023-12-16T00:03:24.246579+0000","last_undegraded":"2023-12-16T00:03:24.246579+0000","last_fullsized":"2023-12-16T00:03:24.246579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:24.246458+0000","last_clean_scrub_stamp":"2023-12-16T00:03:24.246458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:13.442262+0000","scrub_duration":0.001218022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:04.360778+0000","last_change":"2023-12-16T00:04:04.360778+0000","last_active":"2023-12-16T00:04:04.360778+0000","last_peered":"2023-12-16T00:04:04.360778+0000","last_clean":"2023-12-16T00:04:04.360778+0000","last_became_active":"2023-12-15T22:52:53.171881+0000","last_became_peered":"2023-12-15T22:52:53.171881+0000","last_unstale":"2023-12-16T00:04:04.360778+0000","last_undegraded":"2023-12-16T00:04:04.360778+0000","last_fullsized":"2023-12-16T00:04:04.360778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:04.360695+0000","last_clean_scrub_stamp":"2023-12-16T00:04:04.360695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:36:29.949685+0000","scrub_duration":0.0010605300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"54'8","reported_seq":94,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:54.502753+0000","last_change":"2023-12-16T00:02:54.502753+0000","last_active":"2023-12-16T00:02:54.502753+0000","last_peered":"2023-12-16T00:02:54.502753+0000","last_clean":"2023-12-16T00:02:54.502753+0000","last_became_active":"2023-12-15T22:55:02.192345+0000","last_became_peered":"2023-12-15T22:55:02.192345+0000","last_unstale":"2023-12-16T00:02:54.502753+0000","last_undegraded":"2023-12-16T00:02:54.502753+0000","last_fullsized":"2023-12-16T00:02:54.502753+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:02:54.502648+0000","last_clean_scrub_stamp":"2023-12-16T00:02:54.502648+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:47:48.533170+0000","scrub_duration":0.0038340480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":94,"num_read_kb":85,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:03.427796+0000","last_change":"2023-12-16T00:03:03.427796+0000","last_active":"2023-12-16T00:03:03.427796+0000","last_peered":"2023-12-16T00:03:03.427796+0000","last_clean":"2023-12-16T00:03:03.427796+0000","last_became_active":"2023-12-15T22:52:55.190757+0000","last_became_peered":"2023-12-15T22:52:55.190757+0000","last_unstale":"2023-12-16T00:03:03.427796+0000","last_undegraded":"2023-12-16T00:03:03.427796+0000","last_fullsized":"2023-12-16T00:03:03.427796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:03.427718+0000","last_clean_scrub_stamp":"2023-12-16T00:03:03.427718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:52.815644+0000","scrub_duration":0.00089293800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:05.468783+0000","last_change":"2023-12-16T00:04:05.468783+0000","last_active":"2023-12-16T00:04:05.468783+0000","last_peered":"2023-12-16T00:04:05.468783+0000","last_clean":"2023-12-16T00:04:05.468783+0000","last_became_active":"2023-12-15T22:52:53.172031+0000","last_became_peered":"2023-12-15T22:52:53.172031+0000","last_unstale":"2023-12-16T00:04:05.468783+0000","last_undegraded":"2023-12-16T00:04:05.468783+0000","last_fullsized":"2023-12-16T00:04:05.468783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:05.468702+0000","last_clean_scrub_stamp":"2023-12-16T00:04:05.468702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:14.473558+0000","scrub_duration":0.00092584000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"54'46","reported_seq":220,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:00:55.633341+0000","last_change":"2023-12-16T00:00:28.937550+0000","last_active":"2023-12-16T00:00:55.633341+0000","last_peered":"2023-12-16T00:00:55.633341+0000","last_clean":"2023-12-16T00:00:55.633341+0000","last_became_active":"2023-12-15T22:53:26.155410+0000","last_became_peered":"2023-12-15T22:53:26.155410+0000","last_unstale":"2023-12-16T00:00:55.633341+0000","last_undegraded":"2023-12-16T00:00:55.633341+0000","last_fullsized":"2023-12-16T00:00:55.633341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'46","last_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_deep_scrub":"54'46","last_deep_scrub_stamp":"2023-12-16T00:00:28.937478+0000","last_clean_scrub_stamp":"2023-12-16T00:00:28.937478+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:11:39.062938+0000","scrub_duration":0.0062737920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":255,"num_write":124,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:50.574499+0000","last_change":"2023-12-16T00:03:50.574518+0000","last_active":"2023-12-16T00:03:50.574499+0000","last_peered":"2023-12-16T00:03:50.574499+0000","last_clean":"2023-12-16T00:03:50.574499+0000","last_became_active":"2023-12-15T22:52:55.186548+0000","last_became_peered":"2023-12-15T22:52:55.186548+0000","last_unstale":"2023-12-16T00:03:50.574499+0000","last_undegraded":"2023-12-16T00:03:50.574499+0000","last_fullsized":"2023-12-16T00:03:50.574499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:50.574437+0000","last_clean_scrub_stamp":"2023-12-16T00:03:50.574437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:11:14.601730+0000","scrub_duration":0.00092257299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:15.388626+0000","last_change":"2023-12-16T00:03:15.388626+0000","last_active":"2023-12-16T00:03:15.388626+0000","last_peered":"2023-12-16T00:03:15.388626+0000","last_clean":"2023-12-16T00:03:15.388626+0000","last_became_active":"2023-12-15T22:52:53.176972+0000","last_became_peered":"2023-12-15T22:52:53.176972+0000","last_unstale":"2023-12-16T00:03:15.388626+0000","last_undegraded":"2023-12-16T00:03:15.388626+0000","last_fullsized":"2023-12-16T00:03:15.388626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:15.388545+0000","last_clean_scrub_stamp":"2023-12-16T00:03:15.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:13:22.750483+0000","scrub_duration":0.00086855299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"54'8","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:51.591113+0000","last_change":"2023-12-16T00:01:51.591113+0000","last_active":"2023-12-16T00:01:51.591113+0000","last_peered":"2023-12-16T00:01:51.591113+0000","last_clean":"2023-12-16T00:01:51.591113+0000","last_became_active":"2023-12-15T22:53:26.164863+0000","last_became_peered":"2023-12-15T22:53:26.164863+0000","last_unstale":"2023-12-16T00:01:51.591113+0000","last_undegraded":"2023-12-16T00:01:51.591113+0000","last_fullsized":"2023-12-16T00:01:51.591113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:01:51.591019+0000","last_clean_scrub_stamp":"2023-12-16T00:01:51.591019+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:37:31.929640+0000","scrub_duration":0.0033309530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:16.416013+0000","last_change":"2023-12-16T00:03:16.416013+0000","last_active":"2023-12-16T00:03:16.416013+0000","last_peered":"2023-12-16T00:03:16.416013+0000","last_clean":"2023-12-16T00:03:16.416013+0000","last_became_active":"2023-12-15T22:52:55.183315+0000","last_became_peered":"2023-12-15T22:52:55.183315+0000","last_unstale":"2023-12-16T00:03:16.416013+0000","last_undegraded":"2023-12-16T00:03:16.416013+0000","last_fullsized":"2023-12-16T00:03:16.416013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:16.415925+0000","last_clean_scrub_stamp":"2023-12-16T00:03:16.415925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:28.498342+0000","scrub_duration":0.001391542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:35.232670+0000","last_change":"2023-12-16T00:03:35.232670+0000","last_active":"2023-12-16T00:03:35.232670+0000","last_peered":"2023-12-16T00:03:35.232670+0000","last_clean":"2023-12-16T00:03:35.232670+0000","last_became_active":"2023-12-15T22:52:53.176404+0000","last_became_peered":"2023-12-15T22:52:53.176404+0000","last_unstale":"2023-12-16T00:03:35.232670+0000","last_undegraded":"2023-12-16T00:03:35.232670+0000","last_fullsized":"2023-12-16T00:03:35.232670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:35.232583+0000","last_clean_scrub_stamp":"2023-12-16T00:03:35.232583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:16:43.491905+0000","scrub_duration":0.001170903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"54'6","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.434822+0000","last_change":"2023-12-16T00:00:51.940236+0000","last_active":"2023-12-16T00:02:10.434822+0000","last_peered":"2023-12-16T00:02:10.434822+0000","last_clean":"2023-12-16T00:02:10.434822+0000","last_became_active":"2023-12-15T22:53:26.155240+0000","last_became_peered":"2023-12-15T22:53:26.155240+0000","last_unstale":"2023-12-16T00:02:10.434822+0000","last_undegraded":"2023-12-16T00:02:10.434822+0000","last_fullsized":"2023-12-16T00:02:10.434822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2023-12-16T00:00:51.940108+0000","last_clean_scrub_stamp":"2023-12-16T00:00:51.940108+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:32.278729+0000","scrub_duration":0.0028601270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":35,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:55.161808+0000","last_change":"2023-12-16T00:03:55.161826+0000","last_active":"2023-12-16T00:03:55.161808+0000","last_peered":"2023-12-16T00:03:55.161808+0000","last_clean":"2023-12-16T00:03:55.161808+0000","last_became_active":"2023-12-15T22:52:55.188361+0000","last_became_peered":"2023-12-15T22:52:55.188361+0000","last_unstale":"2023-12-16T00:03:55.161808+0000","last_undegraded":"2023-12-16T00:03:55.161808+0000","last_fullsized":"2023-12-16T00:03:55.161808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:55.161744+0000","last_clean_scrub_stamp":"2023-12-16T00:03:55.161744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:38:39.312326+0000","scrub_duration":0.00093413199999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":90,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:36.821979+0000","last_change":"2023-12-16T00:04:36.821979+0000","last_active":"2023-12-16T00:04:36.821979+0000","last_peered":"2023-12-16T00:04:36.821979+0000","last_clean":"2023-12-16T00:04:36.821979+0000","last_became_active":"2023-12-15T22:52:53.169852+0000","last_became_peered":"2023-12-15T22:52:53.169852+0000","last_unstale":"2023-12-16T00:04:36.821979+0000","last_undegraded":"2023-12-16T00:04:36.821979+0000","last_fullsized":"2023-12-16T00:04:36.821979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:36.821826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:36.821826+0000","last_clean_scrub_stamp":"2023-12-16T00:04:36.821826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:37:02.410817+0000","scrub_duration":0.0012783670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"54'22","reported_seq":162,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:25.421815+0000","last_change":"2023-12-16T00:01:43.691584+0000","last_active":"2023-12-16T00:02:25.421815+0000","last_peered":"2023-12-16T00:02:25.421815+0000","last_clean":"2023-12-16T00:02:25.421815+0000","last_became_active":"2023-12-15T22:53:26.160627+0000","last_became_peered":"2023-12-15T22:53:26.160627+0000","last_unstale":"2023-12-16T00:02:25.421815+0000","last_undegraded":"2023-12-16T00:02:25.421815+0000","last_fullsized":"2023-12-16T00:02:25.421815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'22","last_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_deep_scrub":"54'22","last_deep_scrub_stamp":"2023-12-16T00:01:43.691470+0000","last_clean_scrub_stamp":"2023-12-16T00:01:43.691470+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:57.546614+0000","scrub_duration":0.0049723959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":118,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:21.474187+0000","last_change":"2023-12-16T00:03:21.474206+0000","last_active":"2023-12-16T00:03:21.474187+0000","last_peered":"2023-12-16T00:03:21.474187+0000","last_clean":"2023-12-16T00:03:21.474187+0000","last_became_active":"2023-12-15T22:52:55.188568+0000","last_became_peered":"2023-12-15T22:52:55.188568+0000","last_unstale":"2023-12-16T00:03:21.474187+0000","last_undegraded":"2023-12-16T00:03:21.474187+0000","last_fullsized":"2023-12-16T00:03:21.474187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:21.474129+0000","last_clean_scrub_stamp":"2023-12-16T00:03:21.474129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:02.255799+0000","scrub_duration":0.0011434220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:17.224937+0000","last_change":"2023-12-16T00:04:17.224937+0000","last_active":"2023-12-16T00:04:17.224937+0000","last_peered":"2023-12-16T00:04:17.224937+0000","last_clean":"2023-12-16T00:04:17.224937+0000","last_became_active":"2023-12-15T22:52:53.175677+0000","last_became_peered":"2023-12-15T22:52:53.175677+0000","last_unstale":"2023-12-16T00:04:17.224937+0000","last_undegraded":"2023-12-16T00:04:17.224937+0000","last_fullsized":"2023-12-16T00:04:17.224937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:17.224839+0000","last_clean_scrub_stamp":"2023-12-16T00:04:17.224839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:26.673965+0000","scrub_duration":0.001284019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"54'12","reported_seq":118,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.433538+0000","last_change":"2023-12-16T00:00:41.271632+0000","last_active":"2023-12-16T00:02:10.433538+0000","last_peered":"2023-12-16T00:02:10.433538+0000","last_clean":"2023-12-16T00:02:10.433538+0000","last_became_active":"2023-12-15T22:53:26.158416+0000","last_became_peered":"2023-12-15T22:53:26.158416+0000","last_unstale":"2023-12-16T00:02:10.433538+0000","last_undegraded":"2023-12-16T00:02:10.433538+0000","last_fullsized":"2023-12-16T00:02:10.433538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'12","last_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_deep_scrub":"54'12","last_deep_scrub_stamp":"2023-12-16T00:00:41.271543+0000","last_clean_scrub_stamp":"2023-12-16T00:00:41.271543+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:36:47.529256+0000","scrub_duration":0.0036615800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:55.429206+0000","last_change":"2023-12-16T00:02:50.537629+0000","last_active":"2023-12-16T00:02:55.429206+0000","last_peered":"2023-12-16T00:02:55.429206+0000","last_clean":"2023-12-16T00:02:55.429206+0000","last_became_active":"2023-12-15T22:52:55.191043+0000","last_became_peered":"2023-12-15T22:52:55.191043+0000","last_unstale":"2023-12-16T00:02:55.429206+0000","last_undegraded":"2023-12-16T00:02:55.429206+0000","last_fullsized":"2023-12-16T00:02:55.429206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:02:50.537536+0000","last_clean_scrub_stamp":"2023-12-16T00:02:50.537536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:26.272755+0000","scrub_duration":0.001283249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:38.828104+0000","last_change":"2023-12-16T00:04:38.828104+0000","last_active":"2023-12-16T00:04:38.828104+0000","last_peered":"2023-12-16T00:04:38.828104+0000","last_clean":"2023-12-16T00:04:38.828104+0000","last_became_active":"2023-12-15T22:52:53.174334+0000","last_became_peered":"2023-12-15T22:52:53.174334+0000","last_unstale":"2023-12-16T00:04:38.828104+0000","last_undegraded":"2023-12-16T00:04:38.828104+0000","last_fullsized":"2023-12-16T00:04:38.828104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:38.828010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:38.828010+0000","last_clean_scrub_stamp":"2023-12-16T00:04:38.828010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:43:52.053618+0000","scrub_duration":0.00088924399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"54'28","reported_seq":248,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:10.418214+0000","last_change":"2023-12-16T00:00:48.925127+0000","last_active":"2023-12-16T00:02:10.418214+0000","last_peered":"2023-12-16T00:02:10.418214+0000","last_clean":"2023-12-16T00:02:10.418214+0000","last_became_active":"2023-12-15T22:53:26.165519+0000","last_became_peered":"2023-12-15T22:53:26.165519+0000","last_unstale":"2023-12-16T00:02:10.418214+0000","last_undegraded":"2023-12-16T00:02:10.418214+0000","last_fullsized":"2023-12-16T00:02:10.418214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'28","last_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_deep_scrub":"54'28","last_deep_scrub_stamp":"2023-12-16T00:00:48.925038+0000","last_clean_scrub_stamp":"2023-12-16T00:00:48.925038+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:53.919510+0000","scrub_duration":0.005101281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":378,"num_write":150,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.297285+0000","last_change":"2023-12-16T00:03:49.297285+0000","last_active":"2023-12-16T00:03:49.297285+0000","last_peered":"2023-12-16T00:03:49.297285+0000","last_clean":"2023-12-16T00:03:49.297285+0000","last_became_active":"2023-12-15T22:52:55.188961+0000","last_became_peered":"2023-12-15T22:52:55.188961+0000","last_unstale":"2023-12-16T00:03:49.297285+0000","last_undegraded":"2023-12-16T00:03:49.297285+0000","last_fullsized":"2023-12-16T00:03:49.297285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.297202+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.297202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:12.808001+0000","scrub_duration":0.001104505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:24.198479+0000","last_change":"2023-12-16T00:04:24.198479+0000","last_active":"2023-12-16T00:04:24.198479+0000","last_peered":"2023-12-16T00:04:24.198479+0000","last_clean":"2023-12-16T00:04:24.198479+0000","last_became_active":"2023-12-15T22:52:53.173211+0000","last_became_peered":"2023-12-15T22:52:53.173211+0000","last_unstale":"2023-12-16T00:04:24.198479+0000","last_undegraded":"2023-12-16T00:04:24.198479+0000","last_fullsized":"2023-12-16T00:04:24.198479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:24.198382+0000","last_clean_scrub_stamp":"2023-12-16T00:04:24.198382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:58:53.529777+0000","scrub_duration":0.001608139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"54'4","reported_seq":109,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.444012+0000","last_change":"2023-12-16T00:00:42.770790+0000","last_active":"2023-12-16T00:02:45.444012+0000","last_peered":"2023-12-16T00:02:45.444012+0000","last_clean":"2023-12-16T00:02:45.444012+0000","last_became_active":"2023-12-15T22:53:26.165125+0000","last_became_peered":"2023-12-15T22:53:26.165125+0000","last_unstale":"2023-12-16T00:02:45.444012+0000","last_undegraded":"2023-12-16T00:02:45.444012+0000","last_fullsized":"2023-12-16T00:02:45.444012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2023-12-16T00:00:42.770698+0000","last_clean_scrub_stamp":"2023-12-16T00:00:42.770698+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:08:46.369331+0000","scrub_duration":0.0026456280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":82,"num_write":23,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:07.469779+0000","last_change":"2023-12-16T00:03:07.469779+0000","last_active":"2023-12-16T00:03:07.469779+0000","last_peered":"2023-12-16T00:03:07.469779+0000","last_clean":"2023-12-16T00:03:07.469779+0000","last_became_active":"2023-12-15T22:52:55.193691+0000","last_became_peered":"2023-12-15T22:52:55.193691+0000","last_unstale":"2023-12-16T00:03:07.469779+0000","last_undegraded":"2023-12-16T00:03:07.469779+0000","last_fullsized":"2023-12-16T00:03:07.469779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:07.469703+0000","last_clean_scrub_stamp":"2023-12-16T00:03:07.469703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:08.843000+0000","scrub_duration":0.0013701150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:41.227681+0000","last_change":"2023-12-16T00:04:41.227681+0000","last_active":"2023-12-16T00:04:41.227681+0000","last_peered":"2023-12-16T00:04:41.227681+0000","last_clean":"2023-12-16T00:04:41.227681+0000","last_became_active":"2023-12-15T22:52:53.173399+0000","last_became_peered":"2023-12-15T22:52:53.173399+0000","last_unstale":"2023-12-16T00:04:41.227681+0000","last_undegraded":"2023-12-16T00:04:41.227681+0000","last_fullsized":"2023-12-16T00:04:41.227681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:41.227575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:41.227575+0000","last_clean_scrub_stamp":"2023-12-16T00:04:41.227575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:35:32.450823+0000","scrub_duration":0.00093770699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"54'8","reported_seq":164,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.426874+0000","last_change":"2023-12-16T00:00:52.828251+0000","last_active":"2023-12-16T00:02:45.426874+0000","last_peered":"2023-12-16T00:02:45.426874+0000","last_clean":"2023-12-16T00:02:45.426874+0000","last_became_active":"2023-12-15T22:53:26.162413+0000","last_became_peered":"2023-12-15T22:53:26.162413+0000","last_unstale":"2023-12-16T00:02:45.426874+0000","last_undegraded":"2023-12-16T00:02:45.426874+0000","last_fullsized":"2023-12-16T00:02:45.426874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2023-12-16T00:00:52.828140+0000","last_clean_scrub_stamp":"2023-12-16T00:00:52.828140+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:51.070222+0000","scrub_duration":0.003857812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:34.880778+0000","last_change":"2023-12-16T00:03:34.880778+0000","last_active":"2023-12-16T00:03:34.880778+0000","last_peered":"2023-12-16T00:03:34.880778+0000","last_clean":"2023-12-16T00:03:34.880778+0000","last_became_active":"2023-12-15T22:52:55.190128+0000","last_became_peered":"2023-12-15T22:52:55.190128+0000","last_unstale":"2023-12-16T00:03:34.880778+0000","last_undegraded":"2023-12-16T00:03:34.880778+0000","last_fullsized":"2023-12-16T00:03:34.880778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:34.880692+0000","last_clean_scrub_stamp":"2023-12-16T00:03:34.880692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:10.519008+0000","scrub_duration":0.00091466200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:20.431256+0000","last_change":"2023-12-16T00:03:20.431256+0000","last_active":"2023-12-16T00:03:20.431256+0000","last_peered":"2023-12-16T00:03:20.431256+0000","last_clean":"2023-12-16T00:03:20.431256+0000","last_became_active":"2023-12-15T22:52:53.172758+0000","last_became_peered":"2023-12-15T22:52:53.172758+0000","last_unstale":"2023-12-16T00:03:20.431256+0000","last_undegraded":"2023-12-16T00:03:20.431256+0000","last_fullsized":"2023-12-16T00:03:20.431256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:20.431142+0000","last_clean_scrub_stamp":"2023-12-16T00:03:20.431142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:29.435998+0000","scrub_duration":0.0011121589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"54'31","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.426695+0000","last_change":"2023-12-16T00:01:54.625081+0000","last_active":"2023-12-16T00:02:45.426695+0000","last_peered":"2023-12-16T00:02:45.426695+0000","last_clean":"2023-12-16T00:02:45.426695+0000","last_became_active":"2023-12-15T22:53:26.159569+0000","last_became_peered":"2023-12-15T22:53:26.159569+0000","last_unstale":"2023-12-16T00:02:45.426695+0000","last_undegraded":"2023-12-16T00:02:45.426695+0000","last_fullsized":"2023-12-16T00:02:45.426695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:54.624963+0000","last_clean_scrub_stamp":"2023-12-16T00:01:54.624963+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:09:11.843799+0000","scrub_duration":0.0060378350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":347,"num_read_kb":352,"num_write":174,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:46.559841+0000","last_change":"2023-12-16T00:03:46.559841+0000","last_active":"2023-12-16T00:03:46.559841+0000","last_peered":"2023-12-16T00:03:46.559841+0000","last_clean":"2023-12-16T00:03:46.559841+0000","last_became_active":"2023-12-15T22:52:55.188766+0000","last_became_peered":"2023-12-15T22:52:55.188766+0000","last_unstale":"2023-12-16T00:03:46.559841+0000","last_undegraded":"2023-12-16T00:03:46.559841+0000","last_fullsized":"2023-12-16T00:03:46.559841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:46.559754+0000","last_clean_scrub_stamp":"2023-12-16T00:03:46.559754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:14:04.114550+0000","scrub_duration":0.0010144640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.204695+0000","last_change":"2023-12-16T00:03:29.204715+0000","last_active":"2023-12-16T00:03:29.204695+0000","last_peered":"2023-12-16T00:03:29.204695+0000","last_clean":"2023-12-16T00:03:29.204695+0000","last_became_active":"2023-12-15T22:52:53.175991+0000","last_became_peered":"2023-12-15T22:52:53.175991+0000","last_unstale":"2023-12-16T00:03:29.204695+0000","last_undegraded":"2023-12-16T00:03:29.204695+0000","last_fullsized":"2023-12-16T00:03:29.204695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.204639+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.204639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:27:48.394745+0000","scrub_duration":0.001345972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"54'31","reported_seq":219,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:02:45.443579+0000","last_change":"2023-12-16T00:01:02.276273+0000","last_active":"2023-12-16T00:02:45.443579+0000","last_peered":"2023-12-16T00:02:45.443579+0000","last_clean":"2023-12-16T00:02:45.443579+0000","last_became_active":"2023-12-15T22:53:26.158751+0000","last_became_peered":"2023-12-15T22:53:26.158751+0000","last_unstale":"2023-12-16T00:02:45.443579+0000","last_undegraded":"2023-12-16T00:02:45.443579+0000","last_fullsized":"2023-12-16T00:02:45.443579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'31","last_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_deep_scrub":"54'31","last_deep_scrub_stamp":"2023-12-16T00:01:02.276173+0000","last_clean_scrub_stamp":"2023-12-16T00:01:02.276173+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:24:26.458918+0000","scrub_duration":0.0062108550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":295,"num_write":152,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:29.328126+0000","last_change":"2023-12-16T00:03:29.328126+0000","last_active":"2023-12-16T00:03:29.328126+0000","last_peered":"2023-12-16T00:03:29.328126+0000","last_clean":"2023-12-16T00:03:29.328126+0000","last_became_active":"2023-12-15T22:52:55.186614+0000","last_became_peered":"2023-12-15T22:52:55.186614+0000","last_unstale":"2023-12-16T00:03:29.328126+0000","last_undegraded":"2023-12-16T00:03:29.328126+0000","last_fullsized":"2023-12-16T00:03:29.328126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:29.328045+0000","last_clean_scrub_stamp":"2023-12-16T00:03:29.328045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:14:17.991062+0000","scrub_duration":0.00095926500000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.842572+0000","last_change":"2023-12-16T00:04:13.842594+0000","last_active":"2023-12-16T00:04:13.842572+0000","last_peered":"2023-12-16T00:04:13.842572+0000","last_clean":"2023-12-16T00:04:13.842572+0000","last_became_active":"2023-12-15T22:52:53.174096+0000","last_became_peered":"2023-12-15T22:52:53.174096+0000","last_unstale":"2023-12-16T00:04:13.842572+0000","last_undegraded":"2023-12-16T00:04:13.842572+0000","last_fullsized":"2023-12-16T00:04:13.842572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.842508+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.842508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:39:21.212228+0000","scrub_duration":0.000924185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"54'18","reported_seq":166,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:17.124595+0000","last_change":"2023-12-16T00:01:17.124595+0000","last_active":"2023-12-16T00:01:17.124595+0000","last_peered":"2023-12-16T00:01:17.124595+0000","last_clean":"2023-12-16T00:01:17.124595+0000","last_became_active":"2023-12-15T22:53:26.163883+0000","last_became_peered":"2023-12-15T22:53:26.163883+0000","last_unstale":"2023-12-16T00:01:17.124595+0000","last_undegraded":"2023-12-16T00:01:17.124595+0000","last_fullsized":"2023-12-16T00:01:17.124595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'18","last_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_deep_scrub":"54'18","last_deep_scrub_stamp":"2023-12-16T00:01:17.124483+0000","last_clean_scrub_stamp":"2023-12-16T00:01:17.124483+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T00:49:51.339718+0000","scrub_duration":0.006225113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":228,"num_write":94,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:13.194894+0000","last_change":"2023-12-16T00:04:13.194913+0000","last_active":"2023-12-16T00:04:13.194894+0000","last_peered":"2023-12-16T00:04:13.194894+0000","last_clean":"2023-12-16T00:04:13.194894+0000","last_became_active":"2023-12-15T22:52:53.175466+0000","last_became_peered":"2023-12-15T22:52:53.175466+0000","last_unstale":"2023-12-16T00:04:13.194894+0000","last_undegraded":"2023-12-16T00:04:13.194894+0000","last_fullsized":"2023-12-16T00:04:13.194894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:13.194829+0000","last_clean_scrub_stamp":"2023-12-16T00:04:13.194829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T02:49:13.517879+0000","scrub_duration":0.001183609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:03:49.075972+0000","last_change":"2023-12-16T00:03:49.075991+0000","last_active":"2023-12-16T00:03:49.075972+0000","last_peered":"2023-12-16T00:03:49.075972+0000","last_clean":"2023-12-16T00:03:49.075972+0000","last_became_active":"2023-12-15T22:52:55.193484+0000","last_became_peered":"2023-12-15T22:52:55.193484+0000","last_unstale":"2023-12-16T00:03:49.075972+0000","last_undegraded":"2023-12-16T00:03:49.075972+0000","last_fullsized":"2023-12-16T00:03:49.075972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:03:49.075896+0000","last_clean_scrub_stamp":"2023-12-16T00:03:49.075896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:36:14.857673+0000","scrub_duration":0.0010048839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"54'14","reported_seq":103,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:01:06.883780+0000","last_change":"2023-12-16T00:01:06.883780+0000","last_active":"2023-12-16T00:01:06.883780+0000","last_peered":"2023-12-16T00:01:06.883780+0000","last_clean":"2023-12-16T00:01:06.883780+0000","last_became_active":"2023-12-15T22:53:26.161310+0000","last_became_peered":"2023-12-15T22:53:26.161310+0000","last_unstale":"2023-12-16T00:01:06.883780+0000","last_undegraded":"2023-12-16T00:01:06.883780+0000","last_fullsized":"2023-12-16T00:01:06.883780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'14","last_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_deep_scrub":"54'14","last_deep_scrub_stamp":"2023-12-16T00:01:06.883693+0000","last_clean_scrub_stamp":"2023-12-16T00:01:06.883693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T01:34:20.445872+0000","scrub_duration":0.003216478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:20.645329+0000","last_change":"2023-12-16T00:04:20.645349+0000","last_active":"2023-12-16T00:04:20.645329+0000","last_peered":"2023-12-16T00:04:20.645329+0000","last_clean":"2023-12-16T00:04:20.645329+0000","last_became_active":"2023-12-15T22:52:53.175365+0000","last_became_peered":"2023-12-15T22:52:53.175365+0000","last_unstale":"2023-12-16T00:04:20.645329+0000","last_undegraded":"2023-12-16T00:04:20.645329+0000","last_fullsized":"2023-12-16T00:04:20.645329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:20.645263+0000","last_clean_scrub_stamp":"2023-12-16T00:04:20.645263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:05:39.702393+0000","scrub_duration":0.0012813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T00:04:43.832231+0000","last_change":"2023-12-16T00:04:43.832250+0000","last_active":"2023-12-16T00:04:43.832231+0000","last_peered":"2023-12-16T00:04:43.832231+0000","last_clean":"2023-12-16T00:04:43.832231+0000","last_became_active":"2023-12-15T22:52:55.191447+0000","last_became_peered":"2023-12-15T22:52:55.191447+0000","last_unstale":"2023-12-16T00:04:43.832231+0000","last_undegraded":"2023-12-16T00:04:43.832231+0000","last_fullsized":"2023-12-16T00:04:43.832231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T00:04:43.832168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T00:04:43.832168+0000","last_clean_scrub_stamp":"2023-12-16T00:04:43.832168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:35:54.258281+0000","scrub_duration":0.001279131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1216,"num_object_clones":0,"num_object_copies":2432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":122340,"num_read_kb":121426,"num_write":5016,"num_write_kb":2111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1216,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":308622,"num_omap_keys":1176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4647,"ondisk_log_size":4647,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":19171,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1858,"num_read_kb":2251,"num_write":172,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":38342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":3445,"num_read_kb":3204,"num_write":2185,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2383,"ondisk_log_size":2383,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":4675,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":11114,"num_read_kb":10419,"num_write":4413,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2334720,"data_stored":9350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":904,"ondisk_log_size":904,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":157385,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":61976,"num_read_kb":60211,"num_write":28372,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670145,"num_omap_keys":3021,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":311442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23354,"ondisk_log_size":23354,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4637,"ondisk_log_size":4637,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":32454,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":2817,"num_read_kb":2470,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":356,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9013,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539608434,"num_pgs":183,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50616,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806984,"statfs":{"total":107374182400,"available":107322351616,"internally_reserved":0,"allocated":1425408,"data_stored":482844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.40899999999999997,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":0.63400000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.438}]},{"osd":1,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34899999999999998},"max":{"1min":0.61899999999999999,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40300000000000002,"5min":0.311,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":0.71399999999999997,"15min":1.004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.626,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45500000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.56000000000000005,"15min":1.044},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.36599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.27700000000000002}]},{"osd":5,"last update":"Sat Dec 16 00:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.376,"15min":0.373},"min":{"1min":0.28799999999999998,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.504,"5min":0.57899999999999996,"15min":1.149},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.63},"last":0.29399999999999998}]}]},{"osd":5,"up_from":11,"seq":47244641136,"num_pgs":162,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59016,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798584,"statfs":{"total":107374182400,"available":107313750016,"internally_reserved":0,"allocated":1507328,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72899999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.30399999999999999},"max":{"1min":0.64500000000000002,"5min":0.68300000000000005,"15min":0.96699999999999997},"last":0.62}]},{"osd":1,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.747},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.64400000000000002,"5min":0.69699999999999995,"15min":0.879},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.73499999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.496,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.623,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.754},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28000000000000003,"5min":0.26900000000000002,"15min":0.26300000000000001},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.60199999999999998},"last":0.439}]},{"osd":4,"last update":"Sat Dec 16 00:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":0.40400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.92500000000000004},"last":0.47599999999999998}]}]},{"osd":3,"up_from":11,"seq":47244641138,"num_pgs":172,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59540,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798060,"statfs":{"total":107374182400,"available":107313213440,"internally_reserved":0,"allocated":2043904,"data_stored":1008848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67900000000000005,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.38300000000000001,"15min":0.311},"max":{"1min":0.67400000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.29599999999999999},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.495}]},{"osd":2,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.68300000000000005,"5min":1.25,"15min":1.25},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34999999999999998},"min":{"1min":0.26900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39500000000000002,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":0.53200000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.30399999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39200000000000002}]}]},{"osd":2,"up_from":11,"seq":47244641135,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50652,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806948,"statfs":{"total":107374182400,"available":107322314752,"internally_reserved":0,"allocated":1462272,"data_stored":410835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.309,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":1.0169999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50800000000000001,"5min":0.55400000000000005,"15min":0.87},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.88900000000000001},"last":0.378},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.35699999999999998},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.44500000000000001,"5min":0.51800000000000002,"15min":1.2769999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.2450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.97999999999999998},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":1.2190000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.169},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Dec 16 00:04:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.4670000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.91000000000000003},"last":0.54000000000000004}]}]},{"osd":1,"up_from":11,"seq":47244641136,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55452,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104802148,"statfs":{"total":107374182400,"available":107317399552,"internally_reserved":0,"allocated":2117632,"data_stored":1030642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.315},"min":{"1min":0.23400000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.43099999999999999,"5min":0.47499999999999998,"15min":0.52600000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.217,"15min":0.19900000000000001},"max":{"1min":0.45500000000000002,"5min":0.47699999999999998,"15min":0.80100000000000005},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41099999999999998,"5min":0.495,"15min":0.52200000000000002},"last":0.372},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.28999999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.497,"5min":0.504,"15min":0.504},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.32000000000000001},"max":{"1min":0.69399999999999995,"5min":0.76300000000000001,"15min":0.80900000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.72799999999999998},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.41599999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.69699999999999995,"5min":0.76600000000000001,"15min":0.86199999999999999},"last":0.621},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.81100000000000005,"15min":0.878},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Dec 16 00:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72599999999999998,"5min":0.76800000000000002,"15min":0.77700000000000002},"last":0.59599999999999997}]}]},{"osd":0,"up_from":11,"seq":47244641136,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":40972,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104816628,"statfs":{"total":107374182400,"available":107332227072,"internally_reserved":0,"allocated":1511424,"data_stored":381237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.318,"15min":0.317},"min":{"1min":0.22800000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.51200000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.218},"max":{"1min":0.45300000000000001,"5min":0.51400000000000001,"15min":0.59199999999999997},"last":0.29599999999999999}]},{"osd":2,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.29499999999999998,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.45400000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48299999999999998,"5min":0.503,"15min":0.52700000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.45100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.73099999999999998,"15min":0.83599999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.41899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.83599999999999997},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.436,"5min":0.376,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.72899999999999998,"15min":0.78300000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.875},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Dec 16 00:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.80200000000000005},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":8340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":7041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":6214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":6218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":1395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":1385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":68727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":41323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":46083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":112542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":40694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":15582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":8099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":10327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T00:05:14.767 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster c1 config set global mon_health_to_clog false 2023-12-16T00:05:15.061 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2023-12-16T00:05:15.075 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T00:05:15.075 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T00:05:15.075 DEBUG:tasks.ceph.c1.osd.0:waiting for process to exit 2023-12-16T00:05:15.076 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.110 INFO:tasks.ceph.c1.osd.0:Stopped 2023-12-16T00:05:15.111 DEBUG:tasks.ceph.c1.osd.1:waiting for process to exit 2023-12-16T00:05:15.111 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.178 INFO:tasks.ceph.c1.osd.1:Stopped 2023-12-16T00:05:15.178 DEBUG:tasks.ceph.c1.osd.2:waiting for process to exit 2023-12-16T00:05:15.178 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.245 INFO:tasks.ceph.c1.osd.2:Stopped 2023-12-16T00:05:15.246 DEBUG:tasks.ceph.c1.osd.3:waiting for process to exit 2023-12-16T00:05:15.246 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.282 INFO:tasks.ceph.c1.osd.3:Stopped 2023-12-16T00:05:15.282 DEBUG:tasks.ceph.c1.osd.4:waiting for process to exit 2023-12-16T00:05:15.282 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.367 INFO:tasks.ceph.c1.osd.4:Stopped 2023-12-16T00:05:15.368 DEBUG:tasks.ceph.c1.osd.5:waiting for process to exit 2023-12-16T00:05:15.368 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.407 INFO:tasks.ceph.c1.osd.5:Stopped 2023-12-16T00:05:15.407 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T00:05:15.407 DEBUG:tasks.ceph.c1.mgr.x:waiting for process to exit 2023-12-16T00:05:15.407 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.477 INFO:tasks.ceph.c1.mgr.x:Stopped 2023-12-16T00:05:15.477 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T00:05:15.477 DEBUG:tasks.ceph.c1.mon.a:waiting for process to exit 2023-12-16T00:05:15.477 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T00:05:15.494 INFO:tasks.ceph.c1.mon.a:Stopped 2023-12-16T00:05:15.494 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T00:05:15.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2023-12-16T00:05:15.612 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-0 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-16T00:05:15.612 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/c1-0 2023-12-16T00:05:15.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-1 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-16T00:05:15.748 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/c1-1 2023-12-16T00:05:15.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-2 on ubuntu@smithi093.front.sepia.ceph.com 2023-12-16T00:05:15.870 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/c1-2 2023-12-16T00:05:15.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-3 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-16T00:05:15.919 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/c1-3 2023-12-16T00:05:16.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-16T00:05:16.061 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/c1-4 2023-12-16T00:05:16.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-12-16T00:05:16.169 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/c1-5 2023-12-16T00:05:16.224 INFO:tasks.ceph:Archiving mon data... 2023-12-16T00:05:16.224 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/mon/c1-a to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/data/c1.mon.a.tgz 2023-12-16T00:05:16.224 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-12-16T00:05:16.239 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.fmn2Nh6HTf 2023-12-16T00:05:16.240 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar cz -f - -C /var/lib/ceph/mon/c1-a -- . > /tmp/tmp.fmn2Nh6HTf 2023-12-16T00:05:16.403 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.fmn2Nh6HTf 2023-12-16T00:05:16.487 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.fmn2Nh6HTf is 375KB 2023-12-16T00:05:16.582 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.fmn2Nh6HTf 2023-12-16T00:05:16.596 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T00:05:16.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:05:16.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:05:16.641 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:05:16.644 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T00:05:16.717 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T00:05:16.735 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T00:05:16.752 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T00:05:16.769 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T00:05:16.770 INFO:tasks.ceph:Archiving crash dumps... 2023-12-16T00:05:16.771 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi093/crash 2023-12-16T00:05:16.772 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T00:05:16.801 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi183/crash 2023-12-16T00:05:16.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T00:05:16.854 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi188/crash 2023-12-16T00:05:16.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T00:05:16.925 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi192/crash 2023-12-16T00:05:16.926 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T00:05:17.037 INFO:tasks.ceph:Compressing logs... 2023-12-16T00:05:17.037 DEBUG:teuthology.orchestra.run.smithi093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T00:05:17.040 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T00:05:17.042 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T00:05:17.045 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T00:05:17.063 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99592.log 2023-12-16T00:05:17.091 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86927.log 2023-12-16T00:05:17.091 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.4.log 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86967.log 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.86927.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86927.log.gz 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83409.log 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.86967.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86887.log 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86967.log.gz 2023-12-16T00:05:17.092 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83409.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83409.log.gz 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-mgr.x.log 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.86887.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.87931.log 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86887.log.gz 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83369.log 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.1.87931.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.1.log 2023-12-16T00:05:17.093 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83369.log: 92.8% -- replaced with /var/log/ceph/c1-client.1.87931.log.gz 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83369.log.gz 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.1.87078.log 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ops-log-c1-client.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83289.log 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr: 35.5% -- replaced with /var/log/ceph/ops-log-c1-client.1.log.gz 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.1.87078.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83249.log 2023-12-16T00:05:17.094 INFO:teuthology.orchestra.run.smithi183.stderr: 45.3% -- replaced with /var/log/ceph/c1-client.1.87078.log.gz 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83289.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83289.log.gz 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83449.log 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83249.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86847.log 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83249.log.gz 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83449.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83449.log.gz 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.5.log 2023-12-16T00:05:17.095 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.86847.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86847.log.gzgzip 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr: -5 --verbose -- /var/log/ceph/rgw.c1.client.1.log 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.3.log 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/rgw.c1.client.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83329.log 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.86990.log 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.admin.83329.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83329.log.gz 2023-12-16T00:05:17.096 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/c1-client.1.86990.log: 82.3% -- replaced with /var/log/ceph/c1-client.1.86990.log.gz 2023-12-16T00:05:17.097 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/rgw.c1.client.1.log.gz 2023-12-16T00:05:17.105 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83360.log 2023-12-16T00:05:17.105 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.1.log 2023-12-16T00:05:17.105 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.1.log 2023-12-16T00:05:17.105 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83360.log: /var/log/ceph/rgw.c2.client.1.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83360.log.gz 2023-12-16T00:05:17.105 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83520.log 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ops-log-c2-client.1.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.86816.log 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr: 35.8% -- replaced with /var/log/ceph/ops-log-c2-client.1.log.gz 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83520.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83480.log 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83520.log.gz 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.86816.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83560.log 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.86816.log.gz 2023-12-16T00:05:17.106 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83480.log: gzip -5 --verbose -- /var/log/ceph/c2-client.1.86839.log 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83480.log.gz 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83560.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.3.log 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83560.log.gz 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.1.86839.log: gzip -5 --verbose -- /var/log/ceph/c2-mgr.x.log 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr: 82.5% -- replaced with /var/log/ceph/c2-client.1.86839.log.gz 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.86696.log 2023-12-16T00:05:17.107 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.86736.log 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/rgw.c2.client.1.log.gz 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.86696.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.5.log 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.86696.log.gz 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.86736.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.86736.log.gz 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83400.log 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.4.log 2023-12-16T00:05:17.108 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83400.log: gzip -5 --verbose -- /var/log/ceph/c2-client.1.86927.log 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83400.log.gz 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.86776.log 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.1.86927.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83440.log 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr: 44.2% -- replaced with /var/log/ceph/c2-client.1.86927.log.gz 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.86776.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.86776.log.gz 2023-12-16T00:05:17.109 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c2-client.admin.83440.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83440.log.gz 2023-12-16T00:05:17.307 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93625.log 2023-12-16T00:05:17.307 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108886.log 2023-12-16T00:05:17.307 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99592.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.99592.log.gz 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93625.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98785.log 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr: 46.7% -- replaced with /var/log/ceph/c1-client.0.93625.log.gz 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108886.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.90756.log 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108886.log.gz 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98785.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101475.log 2023-12-16T00:05:17.308 INFO:teuthology.orchestra.run.smithi093.stderr: 70.5% -- replaced with /var/log/ceph/c1-client.0.98785.log.gz 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90756.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99680.log 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90756.log.gz 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101475.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104147.log 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101475.log.gz 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99680.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108500.log 2023-12-16T00:05:17.309 INFO:teuthology.orchestra.run.smithi093.stderr: 57.1% -- replaced with /var/log/ceph/c1-client.0.99680.log.gz 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104147.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93716.log 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr: 53.9% -- replaced with /var/log/ceph/c1-client.0.104147.log.gz 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108500.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.96640.log 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108500.log.gz 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93716.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87258.log 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr: 46.7% -- replaced with /var/log/ceph/c1-client.0.93716.log.gz 2023-12-16T00:05:17.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96640.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87455.log 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96640.log.gz 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87258.log: gzip -5 --verbose -- /var/log/ceph/c1.audit.log 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87258.log.gz 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87455.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98963.log 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87455.log.gz 2023-12-16T00:05:17.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1.audit.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106314.log 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98963.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102998.log 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98963.log.gz 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106314.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.106314.log.gz 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87263.log 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/c1.audit.log.gz 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102998.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106050.log 2023-12-16T00:05:17.312 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102998.log.gz 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87263.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107216.log 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87263.log.gz 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.106854.log 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106050.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.106050.log.gz 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107216.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87113.log 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107216.log.gz 2023-12-16T00:05:17.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106854.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100931.log 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr: 50.7% -- replaced with /var/log/ceph/c1-client.0.106854.log.gz 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96139.log 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87113.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87113.log.gz 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100931.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92096.log 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100931.log.gz 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96139.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107571.log 2023-12-16T00:05:17.314 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96139.log.gz 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92096.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92726.log 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr: 52.7% -- replaced with /var/log/ceph/c1-client.0.92096.log.gz 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107571.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104056.log 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr: 91.2% -- replaced with /var/log/ceph/c1-client.0.107571.log.gz 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92726.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107480.log 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.92726.log.gz 2023-12-16T00:05:17.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104056.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.95975.log 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.104056.log.gz 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107480.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107304.log 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107480.log.gz 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95975.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102104.log 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr: 40.2% -- replaced with /var/log/ceph/c1-client.0.95975.log.gz 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107304.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100037.log 2023-12-16T00:05:17.316 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107304.log.gz 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102104.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109266.log 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr: 63.3% -- replaced with /var/log/ceph/c1-client.0.102104.log.gz 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100037.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98875.log 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100037.log.gz 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109266.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.89528.log 2023-12-16T00:05:17.317 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109266.log.gz 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98875.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105142.log 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98875.log.gz 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.89528.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100662.log 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.89528.log.gz 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105142.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.89633.log 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.105142.log.gz 2023-12-16T00:05:17.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100662.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.91557.log 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100662.log.gz 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.89633.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.2.log 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr: 18.5% -- replaced with /var/log/ceph/c1-client.0.89633.log.gz 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91557.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93806.log 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr: 46.6% -- replaced with /var/log/ceph/c1-client.0.91557.log.gz 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97443.log 2023-12-16T00:05:17.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93806.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87803.log 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93806.log.gz 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97443.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109096.log 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97443.log.gz 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87803.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97804.log 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87803.log.gz 2023-12-16T00:05:17.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109096.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.96998.log 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109096.log.gz 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97804.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.97804.log.gz 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.95399.log 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96998.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.96904.log 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96998.log.gz 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95399.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109222.log 2023-12-16T00:05:17.321 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.95399.log.gz 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96904.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92454.log 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96904.log.gz 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109222.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105779.log 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109222.log.gz 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92454.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102822.log 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr: 63.4% -- replaced with /var/log/ceph/c1-client.0.92454.log.gz 2023-12-16T00:05:17.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105779.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101747.log 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.105779.log.gz 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102822.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87687.log 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102822.log.gz 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101747.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107670.log 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101747.log.gz 2023-12-16T00:05:17.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87687.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.95317.log 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87687.log.gz 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107670.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108374.log 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107670.log.gz 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95317.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101292.log 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.95317.log.gz 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108374.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98253.log 2023-12-16T00:05:17.324 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108374.log.gz 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101292.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.96728.log 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101292.log.gz 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98253.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101019.log 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98253.log.gz 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96728.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87005.log 2023-12-16T00:05:17.325 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96728.log.gz 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101019.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98517.log 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101019.log.gz 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87005.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.89486.log 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87005.log.gz 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98517.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103086.log 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98517.log.gz 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.89486.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108290.log 2023-12-16T00:05:17.326 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.89486.log.gz 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103086.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100131.log 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103086.log.gz 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108290.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108164.log 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108290.log.gz 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100131.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104417.log 2023-12-16T00:05:17.327 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100131.log.gz 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108164.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108122.log 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108164.log.gz 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104417.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.94070.log 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.104417.log.gz 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108122.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106402.log 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108122.log.gz 2023-12-16T00:05:17.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94070.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92186.log 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94070.log.gz 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106402.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106951.log 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106402.log.gz 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/c1-client.0.92186.log: -5 --verbose -- /var/log/ceph/c1-client.0.105233.log 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr: 52.4% -- replaced with /var/log/ceph/c1-client.0.92186.log.gz 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106951.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88308.log 2023-12-16T00:05:17.329 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106951.log.gz 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105233.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87261.log 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr: 78.9% -- replaced with /var/log/ceph/c1-client.0.105233.log.gz 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88308.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104961.log 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.88308.log.gz 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87261.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106584.log 2023-12-16T00:05:17.330 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87261.log.gz 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104961.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.89305.log 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.104961.log.gz 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106584.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93174.log 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106584.log.gz 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.89305.log: -- /var/log/ceph/c1-client.0.102555.log 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr: 1.8% -- replaced with /var/log/ceph/c1-client.0.89305.log.gz 2023-12-16T00:05:17.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93174.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103702.log 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr: 59.7% -- replaced with /var/log/ceph/c1-client.0.93174.log.gz 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102555.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104689.log 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102555.log.gz 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103702.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108248.log 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103702.log.gz 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104689.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86919.log 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr: 65.2% -- replaced with /var/log/ceph/c1-client.0.104689.log.gz 2023-12-16T00:05:17.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108248.log: gzip -5 --verbose -- /var/log/ceph/c1.log 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108248.log.gz 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.86919.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108669.log 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86919.log.gz 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108970.log 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108669.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102377.log 2023-12-16T00:05:17.333 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108669.log.gz 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108970.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108726.log 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108970.log.gz 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102377.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99236.log 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr: 58.0% -- replaced with /var/log/ceph/c1-client.0.102377.log.gz 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108726.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97087.log 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108726.log.gz 2023-12-16T00:05:17.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99236.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.99236.log.gz 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80432.log 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97087.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104779.log 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr: 57.3% -- replaced with /var/log/ceph/c1-client.0.97087.log.gz 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.tmp-client.admin.80432.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87262.log 0.0% 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.80432.log.gz 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104779.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107803.log 2023-12-16T00:05:17.335 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.104779.log.gz 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87262.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87262.log.gz 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92633.log 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107803.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103526.log 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92633.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106672.log 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% 92.7% -- replaced with /var/log/ceph/c1-client.0.92633.log.gz -- replaced with /var/log/ceph/c1-client.0.107803.log.gz 2023-12-16T00:05:17.336 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103526.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.91203.log 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103526.log.gz 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106672.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.94256.log 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106672.log.gz 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91203.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.91203.log.gz -5 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.0.99502.log 2023-12-16T00:05:17.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94256.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108542.log 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94256.log.gz 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99502.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/c1-client.0.99502.log.gz /var/log/ceph/c1-client.0.92992.log 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose --/var/log/ceph/c1-client.admin.108542.log: /var/log/ceph/c1-client.admin.107954.log 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108542.log.gz 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92992.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101197.log 2023-12-16T00:05:17.338 INFO:teuthology.orchestra.run.smithi093.stderr: 70.6% -- replaced with /var/log/ceph/c1-client.0.92992.log.gz 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.107954.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101835.log 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.107954.log.gz 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101197.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.101197.log.gz 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.106494.log 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101835.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108626.log 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/c1.log.gz 2023-12-16T00:05:17.339 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.101835.log.gz 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106494.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97355.log 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr: 67.9% -- replaced with /var/log/ceph/c1-client.0.106494.log.gz 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108626.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109012.log 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108626.log.gz 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/c1-client.0.97355.log: --verbose -- /var/log/ceph/c1-client.admin.108458.log 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97355.log.gz 2023-12-16T00:05:17.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109012.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97531.log 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109012.log.gz 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108458.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99949.log 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108458.log.gz 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97531.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103350.log 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97531.log.gz 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99949.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109138.log 2023-12-16T00:05:17.341 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.99949.log.gz 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103350.log: gzip -5 --verbose -- /var/log/ceph/c1-mon.a.log 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103350.log.gz 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109138.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.90580.log 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109138.log.gz 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.95646.log 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90580.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99770.log 2023-12-16T00:05:17.342 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90580.log.gz 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95646.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100750.log 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.95646.log.gz 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99770.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87447.log 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.99770.log.gz 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100750.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98605.log 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100750.log.gz 2023-12-16T00:05:17.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87447.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87447.log.gz 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87807.log 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98605.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102195.log 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98605.log.gz 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87807.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87807.log.gz 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93356.log 2023-12-16T00:05:17.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102195.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109054.log 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102195.log.gz 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93356.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102732.log 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr: 51.0% -- replaced with /var/log/ceph/c1-client.0.93356.log.gz 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96816.log 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109054.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109054.log.gz 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102732.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109180.log 2023-12-16T00:05:17.345 INFO:teuthology.orchestra.run.smithi093.stderr: 68.5% -- replaced with /var/log/ceph/c1-client.0.102732.log.gz 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96816.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92545.log 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96816.log.gz 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109180.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109180.log.gz 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.89387.log 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92364.log 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92545.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.92545.log.gz 2023-12-16T00:05:17.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.89387.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97177.log 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.89387.log.gz 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92364.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98693.log 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr: 51.3% -- replaced with /var/log/ceph/c1-client.0.92364.log.gz 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97177.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92006.log 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr: 57.1% -- replaced with /var/log/ceph/c1-client.0.97177.log.gz 2023-12-16T00:05:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98693.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99058.log 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr: 75.1% -- replaced with /var/log/ceph/c1-client.0.98693.log.gz 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92006.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.0.log 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr: 52.4% -- replaced with /var/log/ceph/c1-client.0.92006.log.gz 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99058.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c1-client.0.99058.log.gz /var/log/ceph/c1-client.0.90939.log 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ops-log-c1-client.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106138.log 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90939.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.90939.log.gz 2023-12-16T00:05:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87449.log 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.86963.log 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106138.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.106138.log.gz 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87449.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101107.log 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87449.log.gz 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.86963.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86963.log.gz 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.100219.log 2023-12-16T00:05:17.349 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.101563.log 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101107.log: 58.0%/var/log/ceph/c1-client.0.100219.log: -- replaced with /var/log/ceph/c1-client.0.101107.log.gz 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100219.log.gz 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.98073.log 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101563.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.101563.log.gz 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.97892.log 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108416.log 2023-12-16T00:05:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98073.log: 57.3% -- replaced with /var/log/ceph/c1-client.0.98073.log.gz 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97892.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108584.log 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97892.log.gz 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108416.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87806.log 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108416.log.gz 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99324.log 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108584.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108584.log.gz 2023-12-16T00:05:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87806.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98163.log 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87806.log.gz 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99324.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/c1-client.0.99324.log.gz -- 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/c1-client.admin.107996.log 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99146.log 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98163.log: 57.5% -- replaced with /var/log/ceph/c1-client.0.98163.log.gz 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.107996.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100308.log 2023-12-16T00:05:17.352 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.107996.log.gz 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99146.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105050.log 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr: 47.1% -- replaced with /var/log/ceph/c1-client.0.99146.log.gz 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93894.log 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100308.log: 56.2% -- replaced with /var/log/ceph/c1-client.0.100308.log.gz 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105050.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101657.log 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr: 78.8% -- replaced with /var/log/ceph/c1-client.0.105050.log.gz 2023-12-16T00:05:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93894.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102644.log 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93894.log.gz 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.90668.log 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101657.log: 64.7% -- replaced with /var/log/ceph/c1-client.0.101657.log.gz 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102644.log: gzip -5 --verbose -- /var/log/ceph/rgw.c1.client.0.log 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102644.log.gz 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90668.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87514.log 2023-12-16T00:05:17.354 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90668.log.gz 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94163.log 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/rgw.c1.client.0.log: /var/log/ceph/c1-client.admin.87514.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.91469.log 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87514.log.gz 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94163.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.94163.log.gz -5 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.0.93982.log 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.106765.log 2023-12-16T00:05:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91469.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.91469.log.gz 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93982.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93446.log 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93982.log.gz 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106765.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.106765.log.gz 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.100486.log 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.103614.log 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93446.log: 46.7% -- replaced with /var/log/ceph/c1-client.0.93446.log.gz 2023-12-16T00:05:17.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100486.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107128.log 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.100486.log.gz 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103614.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c1-client.0.103614.log.gz 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.0.103174.log 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88003.log 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107128.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.107128.log.gz 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103174.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108769.log 2023-12-16T00:05:17.357 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103174.log.gz 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88003.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93086.log 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.88003.log.gz 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108769.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97714.log 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108769.log.gz 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93086.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97619.log 2023-12-16T00:05:17.358 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93086.log.gz 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97714.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88350.log 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr: 70.1% -- replaced with /var/log/ceph/c1-client.0.97714.log.gz 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/c1-client.0.97619.log: -5 --verbose -- /var/log/ceph/c1-client.0.100838.log 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr: 86.5%/var/log/ceph/c1-client.admin.88350.log: -- replaced with /var/log/ceph/c1-client.0.97619.log.gz 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.88350.log.gz 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.109306.log 2023-12-16T00:05:17.359 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100838.log: 82.5%gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108332.log 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.0.100838.log.gz 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94435.log 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.109306.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.109306.log.gz 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108332.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108080.log 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108332.log.gz 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94435.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.94435.log.gz -5 2023-12-16T00:05:17.360 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.0.91291.log 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91826.log 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108080.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108080.log.gz 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91291.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.92814.log 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.91291.log.gz 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91826.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99412.log 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr: 50.7% -- replaced with /var/log/ceph/c1-client.0.91826.log.gz 2023-12-16T00:05:17.361 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.92814.log: -- /var/log/ceph/c1-client.0.104237.log 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr: 49.9% -- replaced with /var/log/ceph/c1-client.0.92814.log.gz 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99412.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.94523.log 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr: 57.4% -- replaced with /var/log/ceph/c1-client.0.99412.log.gz 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.104506.log 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104237.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.104237.log.gz 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94523.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103790.log 2023-12-16T00:05:17.362 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94523.log.gz 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104506.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87260.log 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr: 75.3% -- replaced with /var/log/ceph/c1-client.0.104506.log.gz 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103790.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.0.103790.log.gz 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/c1-client.0.89551.log 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87260.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.95728.log 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87260.log.gz 2023-12-16T00:05:17.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.89551.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c1-client.0.89551.log.gz /var/log/ceph/c1-client.0.100574.log 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95728.log: 7.2% -- replaced with /var/log/ceph/c1-client.0.95728.log.gz 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105326.log 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96460.log 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100574.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.100574.log.gz 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105326.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.105326.log.gz -5 2023-12-16T00:05:17.364 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.0.95554.log 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96460.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103966.log 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.96460.log.gz 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95554.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.101380.log 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr: 14.6% -- replaced with /var/log/ceph/c1-client.0.95554.log.gz 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/c1-client.0.103966.log: -5 --verbose -- /var/log/ceph/c1-client.0.91115.log 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr: 68.7% -- replaced with /var/log/ceph/c1-client.0.103966.log.gz 2023-12-16T00:05:17.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101380.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.101380.log.gz 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93265.log 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91115.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87747.log 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.91115.log.gz 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93265.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83676.log 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93265.log.gz 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88045.log 2023-12-16T00:05:17.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87747.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87747.log.gz 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.83676.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.admin.83676.log.gz 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/c1-client.0.96264.log 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88045.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.88045.log.gz 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105691.log 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96264.log: gzip -5 0.0% --verbose -- /var/log/ceph/c1-client.0.89223.log 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.0.96264.log.gz 2023-12-16T00:05:17.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105691.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.105691.log.gz 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88087.log 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94344.log 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.89223.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.89223.log.gz 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88087.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.admin.88087.log.gz 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/c1-client.0.106226.log 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94344.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.94344.log.gz 2023-12-16T00:05:17.368 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.95225.log 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.106226.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.106226.log.gz 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91379.log 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95225.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.95225.log.gz 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105962.log 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96552.log 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91379.log: 56.9% -- replaced with /var/log/ceph/c1-client.0.91379.log.gz 2023-12-16T00:05:17.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105962.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.0.105962.log.gz 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/c1-osd.1.log 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.96552.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.96552.log.gz 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108206.log 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108038.log 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108206.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.admin.108206.log.gz 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/c1-client.admin.108811.log 2023-12-16T00:05:17.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108038.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108038.log.gz 2023-12-16T00:05:17.371 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91738.log 2023-12-16T00:05:17.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108811.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108811.log.gz 2023-12-16T00:05:17.371 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.83871.log 2023-12-16T00:05:17.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91738.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.91738.log.gz 2023-12-16T00:05:17.371 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.93536.log 2023-12-16T00:05:17.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.83871.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83871.log.gz 2023-12-16T00:05:17.372 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87959.log 2023-12-16T00:05:17.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.93536.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.93536.log.gz 2023-12-16T00:05:17.372 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91027.log 2023-12-16T00:05:17.373 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87959.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87959.log.gz 2023-12-16T00:05:17.373 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105872.log 2023-12-16T00:05:17.373 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91027.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.91027.log.gz 2023-12-16T00:05:17.373 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.90847.log 2023-12-16T00:05:17.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105872.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.105872.log.gz 2023-12-16T00:05:17.374 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92904.log 2023-12-16T00:05:17.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90847.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.90847.log.gz 2023-12-16T00:05:17.374 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.102910.log 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92904.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.92904.log.gz 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94867.log 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102910.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.102910.log.gz 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87259.log 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96057.log 2023-12-16T00:05:17.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94867.log: /var/log/ceph/c1-client.admin.87259.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98341.log 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94867.log.gz 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87259.log.gz 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/c1-client.0.96057.log: --verbose -- /var/log/ceph/c1-client.0.103438.log 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr: 4.8% -- replaced with /var/log/ceph/c1-client.0.96057.log.gz/var/log/ceph/c1-client.0.98341.log: 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91647.log 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98341.log.gz 2023-12-16T00:05:17.376 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/c1-client.0.103438.log: --verbose -- /var/log/ceph/c1-client.admin.83942.log 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103438.log.gz 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.91647.log: 60.7% -- replaced with /var/log/ceph/c1-client.0.91647.log.gz 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87515.log 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.83942.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.83942.log.gz 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.101926.log 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87515.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87515.log.gz 2023-12-16T00:05:17.377 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92276.log 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.101926.log: 56.0%gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88268.log 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.0.101926.log.gz 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.92276.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105601.log 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.92276.log.gz 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94699.log 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88268.log: gzip/var/log/ceph/c1-client.0.105601.log: -5 --verbose -- /var/log/ceph/c1-client.admin.87919.log 2023-12-16T00:05:17.378 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.88268.log.gz 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr: 54.2% -- replaced with /var/log/ceph/c1-client.0.105601.log.gz 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94699.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.94699.log.gz 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.104597.log 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87919.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.admin.87919.log.gz 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/c1-client.0.94611.log 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104597.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.104597.log.gz 2023-12-16T00:05:17.379 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.102285.log 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.94611.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.94611.log.gz 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105414.log 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102285.log: gzip 0.0% -5 --verbose -- /var/log/ceph/c1-client.0.107392.log 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.0.102285.log.gz 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105414.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.108928.log 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr: 67.7% -- replaced with /var/log/ceph/c1-client.0.105414.log.gz 2023-12-16T00:05:17.380 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/c1-client.0.107392.log: --verbose -- /var/log/ceph/c1-client.admin.86863.log 2023-12-16T00:05:17.381 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.107392.log.gz 2023-12-16T00:05:17.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.108928.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.108928.log.gz 2023-12-16T00:05:17.381 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.88226.log 2023-12-16T00:05:17.381 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91916.log 2023-12-16T00:05:17.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.86863.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.86863.log.gz 2023-12-16T00:05:17.384 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.103878.log 2023-12-16T00:05:17.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.88226.log: /var/log/ceph/c1-client.0.91916.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.88469.log 53.0% -- replaced with /var/log/ceph/c1-client.0.91916.log.gz 2023-12-16T00:05:17.385 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.385 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.admin.88226.log.gz 2023-12-16T00:05:17.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103878.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.103878.log.gz 2023-12-16T00:05:17.386 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.88373.log 2023-12-16T00:05:17.386 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.88469.log: gzip -5 --verbose -- 43.9% -- replaced with /var/log/ceph/c1-client.0.88469.log.gz 2023-12-16T00:05:17.386 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/c1-client.0.97267.log 2023-12-16T00:05:17.386 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.88373.log: 94.9%gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87067.log 2023-12-16T00:05:17.387 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ops-log-c1-client.0.log.gz 2023-12-16T00:05:17.387 INFO:teuthology.orchestra.run.smithi093.stderr: 84.1% -- replaced with /var/log/ceph/c1-client.0.88373.log.gz 2023-12-16T00:05:17.387 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97267.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98429.log 2023-12-16T00:05:17.388 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97267.log.gz 2023-12-16T00:05:17.388 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87067.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102016.log 2023-12-16T00:05:17.388 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87067.log.gz 2023-12-16T00:05:17.389 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.98429.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.99861.log 2023-12-16T00:05:17.389 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.98429.log.gz 2023-12-16T00:05:17.389 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.90412.log 2023-12-16T00:05:17.389 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102016.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.102016.log.gz 2023-12-16T00:05:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.99861.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.95853.log 2023-12-16T00:05:17.390 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.99861.log.gz 2023-12-16T00:05:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.90412.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.0.log 2023-12-16T00:05:17.390 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90412.log.gz 2023-12-16T00:05:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.95853.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c1-client.0.95853.log.gz /var/log/ceph/c1-client.0.104325.log 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102467.log 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104325.log: gzip 73.7% -5 --verbose -- /var/log/ceph/c1-client.0.104869.log 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/c1-client.0.104325.log.gz 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.102467.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100398.log 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102467.log.gz 2023-12-16T00:05:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.104869.log: 85.1% -- replaced with /var/log/ceph/c1-client.0.104869.log.gz 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87509.log 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.100398.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.100398.log.gz 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.107040.log 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87509.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87509.log.gz 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105505.log 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.107040.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.107040.log.gz 2023-12-16T00:05:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.103262.log 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.105505.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.105505.log.gz 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.97985.log 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.103262.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.103262.log.gz 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.87667.log 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.0.97985.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.97985.log.gz 2023-12-16T00:05:17.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/c1-client.admin.87667.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.87667.log.gz 2023-12-16T00:05:17.395 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/c2-mgr.x.log.gz 2023-12-16T00:05:17.430 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.92901.log 2023-12-16T00:05:17.430 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.115136.log 2023-12-16T00:05:17.431 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.95492.log 2023-12-16T00:05:17.431 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92901.log: /var/log/ceph/c2-client.0.115136.log: 62.4% -- replaced with /var/log/ceph/c2-client.0.92901.log.gz 2023-12-16T00:05:17.431 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119516.log 2023-12-16T00:05:17.431 INFO:teuthology.orchestra.run.smithi188.stderr: 89.6% -- replaced with /var/log/ceph/c2-client.0.115136.log.gz 2023-12-16T00:05:17.432 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95492.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96708.log 2023-12-16T00:05:17.432 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.95492.log.gz 2023-12-16T00:05:17.432 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119516.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.88696.log 2023-12-16T00:05:17.433 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.119516.log.gz 2023-12-16T00:05:17.433 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96708.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118788.log 2023-12-16T00:05:17.433 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.96708.log.gz 2023-12-16T00:05:17.434 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.88696.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98491.log 2023-12-16T00:05:17.434 INFO:teuthology.orchestra.run.smithi188.stderr: 43.9% -- replaced with /var/log/ceph/c2-client.0.88696.log.gz 2023-12-16T00:05:17.434 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118788.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104715.log 2023-12-16T00:05:17.434 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118788.log.gz 2023-12-16T00:05:17.435 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98491.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111119.log 2023-12-16T00:05:17.435 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98491.log.gz 2023-12-16T00:05:17.435 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104715.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91917.log 2023-12-16T00:05:17.436 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.104715.log.gz 2023-12-16T00:05:17.436 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111119.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102543.log 2023-12-16T00:05:17.436 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.111119.log.gz 2023-12-16T00:05:17.436 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91917.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92366.log 2023-12-16T00:05:17.437 INFO:teuthology.orchestra.run.smithi188.stderr: 46.6% -- replaced with /var/log/ceph/c2-client.0.91917.log.gz 2023-12-16T00:05:17.437 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102543.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102428.log 2023-12-16T00:05:17.438 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.102543.log.gz 2023-12-16T00:05:17.438 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92366.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101093.log 2023-12-16T00:05:17.438 INFO:teuthology.orchestra.run.smithi188.stderr: 82.4% -- replaced with /var/log/ceph/c2-client.0.92366.log.gz 2023-12-16T00:05:17.439 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102428.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87433.log 2023-12-16T00:05:17.439 INFO:teuthology.orchestra.run.smithi188.stderr: 56.8% -- replaced with /var/log/ceph/c2-client.0.102428.log.gz 2023-12-16T00:05:17.439 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101093.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96279.log 2023-12-16T00:05:17.440 INFO:teuthology.orchestra.run.smithi188.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.101093.log.gz 2023-12-16T00:05:17.440 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87433.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99493.log 2023-12-16T00:05:17.440 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87433.log.gz 2023-12-16T00:05:17.441 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96279.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92544.log 2023-12-16T00:05:17.441 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.96279.log.gz 2023-12-16T00:05:17.441 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99493.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112701.log 2023-12-16T00:05:17.441 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99493.log.gz 2023-12-16T00:05:17.442 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92544.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108569.log 2023-12-16T00:05:17.442 INFO:teuthology.orchestra.run.smithi188.stderr: 85.9% -- replaced with /var/log/ceph/c2-client.0.92544.log.gz 2023-12-16T00:05:17.442 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112701.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106591.log 2023-12-16T00:05:17.443 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112701.log.gz 2023-12-16T00:05:17.443 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108569.log: gzip -5 --verbose -- /var/log/ceph/c2-mon.a.log 2023-12-16T00:05:17.443 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108569.log.gz 2023-12-16T00:05:17.444 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106591.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102337.log 2023-12-16T00:05:17.444 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.106591.log.gz 2023-12-16T00:05:17.444 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88329.log 2023-12-16T00:05:17.445 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102337.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99850.log 2023-12-16T00:05:17.445 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.102337.log.gz 2023-12-16T00:05:17.445 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88329.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88053.log 2023-12-16T00:05:17.446 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88329.log.gz 2023-12-16T00:05:17.446 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99850.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94710.log 2023-12-16T00:05:17.446 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.99850.log.gz 2023-12-16T00:05:17.446 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88053.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113156.log 2023-12-16T00:05:17.447 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88053.log.gz 2023-12-16T00:05:17.447 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94710.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83525.log 2023-12-16T00:05:17.447 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.94710.log.gz 2023-12-16T00:05:17.448 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113156.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100477.log 2023-12-16T00:05:17.448 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113156.log.gz 2023-12-16T00:05:17.448 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.83525.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87879.log 2023-12-16T00:05:17.449 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83525.log.gz 2023-12-16T00:05:17.449 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100477.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92188.log 2023-12-16T00:05:17.449 INFO:teuthology.orchestra.run.smithi188.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.100477.log.gz 2023-12-16T00:05:17.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87879.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116475.log 2023-12-16T00:05:17.450 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87879.log.gz 2023-12-16T00:05:17.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92188.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87577.log 2023-12-16T00:05:17.451 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.92188.log.gz 2023-12-16T00:05:17.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116475.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.116475.log.gz 2023-12-16T00:05:17.451 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.110864.log 2023-12-16T00:05:17.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87577.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106043.log 2023-12-16T00:05:17.452 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87577.log.gz 2023-12-16T00:05:17.452 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.91826.log 2023-12-16T00:05:17.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110864.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.110864.log.gz 2023-12-16T00:05:17.453 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106043.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103276.log 2023-12-16T00:05:17.453 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.106043.log.gz 2023-12-16T00:05:17.453 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91826.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.91826.log.gz 2023-12-16T00:05:17.454 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.92004.log 2023-12-16T00:05:17.454 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.103276.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99760.log 2023-12-16T00:05:17.454 INFO:teuthology.orchestra.run.smithi188.stderr: 90.9% -- replaced with /var/log/ceph/c2-client.0.103276.log.gz 2023-12-16T00:05:17.454 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92004.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113977.log 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr: 83.2% -- replaced with /var/log/ceph/c2-client.0.92004.log.gz 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99760.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116560.log 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.99760.log.gz 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113977.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109334.log 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113977.log.gz 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116560.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106682.log 2023-12-16T00:05:17.455 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.116560.log.gz 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109334.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112883.log 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109334.log.gz 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106682.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112428.log 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106682.log.gz 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112883.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96626.log 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112883.log.gz 2023-12-16T00:05:17.456 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112428.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98946.log 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112428.log.gz 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96626.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.96626.log.gz 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.101981.log 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98946.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106407.log 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98946.log.gz 2023-12-16T00:05:17.457 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101981.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116830.log 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr: 58.8% -- replaced with /var/log/ceph/c2-client.0.101981.log.gz 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106407.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119334.log 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.106407.log.gz 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116830.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98036.log 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.116830.log.gz 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119334.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91102.log 2023-12-16T00:05:17.458 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.119334.log.gz 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98036.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97853.log 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98036.log.gz 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91102.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92636.log 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.91102.log.gz 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97853.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99310.log 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.97853.log.gz 2023-12-16T00:05:17.459 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92636.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93904.log 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr: 53.3% -- replaced with /var/log/ceph/c2-client.0.92636.log.gz 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99310.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101712.log 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99310.log.gz 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93904.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117966.log 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.93904.log.gz 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101712.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.120102.log 2023-12-16T00:05:17.460 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.101712.log.gz 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.117966.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93164.log 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr: 68.8% -- replaced with /var/log/ceph/c2-client.0.117966.log.gz 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.120102.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118423.log 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.120102.log.gz 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93164.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110439.log 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.93164.log.gz 2023-12-16T00:05:17.461 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118423.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87689.log 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118423.log.gz 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110439.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100299.log 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110439.log.gz 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87689.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87822.log 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87689.log.gz 2023-12-16T00:05:17.462 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100299.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110779.log 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.100299.log.gz 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87822.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92097.log 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87822.log.gz 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110779.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96872.log 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110779.log.gz 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92097.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94802.log 2023-12-16T00:05:17.463 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.92097.log.gz 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96872.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93614.log 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.96872.log.gz 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94802.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93524.log 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.94802.log.gz 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93614.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.89657.log 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.93614.log.gz 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93524.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118332.log 2023-12-16T00:05:17.464 INFO:teuthology.orchestra.run.smithi188.stderr: 76.7% -- replaced with /var/log/ceph/c2-client.0.93524.log.gz 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.89657.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90550.log 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.89657.log.gz 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118332.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118058.log 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118332.log.gz 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.90550.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106134.log 2023-12-16T00:05:17.465 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90550.log.gz 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118058.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118697.log 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118058.log.gz 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106134.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108994.log 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106134.log.gz 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118697.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112792.log 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118697.log.gz 2023-12-16T00:05:17.466 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108994.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99675.log 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108994.log.gz 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112792.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88165.log 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112792.log.gz 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99675.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92989.log 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.99675.log.gz 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88165.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105500.log 2023-12-16T00:05:17.467 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88165.log.gz 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92989.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101449.log 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.92989.log.gz 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105500.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95823.log 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr: 82.6% -- replaced with /var/log/ceph/c2-client.0.105500.log.gz 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101449.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99940.log 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr: 69.5% -- replaced with /var/log/ceph/c2-client.0.101449.log.gz 2023-12-16T00:05:17.468 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95823.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105679.log 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.95823.log.gz 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99940.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107137.log 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.99940.log.gz 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105679.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109249.log 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105679.log.gz 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107137.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103104.log 2023-12-16T00:05:17.469 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.107137.log.gz 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109249.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.109249.log.gz 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.102924.log 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.103104.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106225.log 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr: 57.0% -- replaced with /var/log/ceph/c2-client.0.103104.log.gz 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102924.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106864.log 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr: 70.6% -- replaced with /var/log/ceph/c2-client.0.102924.log.gz 2023-12-16T00:05:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106225.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88413.log 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.106225.log.gz 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106864.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.115497.log 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106864.log.gz 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88413.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101362.log 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88413.log.gz 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.115497.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109674.log 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.115497.log.gz 2023-12-16T00:05:17.471 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101362.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104537.log 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr: 69.0% -- replaced with /var/log/ceph/c2-client.0.101362.log.gz 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109674.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91648.log 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109674.log.gz 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104537.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91284.log 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr: 68.6% -- replaced with /var/log/ceph/c2-client.0.104537.log.gz 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91648.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106316.log 2023-12-16T00:05:17.472 INFO:teuthology.orchestra.run.smithi188.stderr: 56.1% -- replaced with /var/log/ceph/c2-client.0.91648.log.gz 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91284.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.91284.log.gz 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87245.log 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106316.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92279.log 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106316.log.gz 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87245.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111461.log 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87245.log.gz 2023-12-16T00:05:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92279.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107693.log 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr: 50.7% -- replaced with /var/log/ceph/c2-client.0.92279.log.gz 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111461.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109759.log 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107693.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100564.log 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr: 90.6% -- replaced with /var/log/ceph/c2-client.0.107693.log.gz 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109759.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.109759.log.gz 2023-12-16T00:05:17.474 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119607.log 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100564.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109419.log 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr: 75.9% -- replaced with /var/log/ceph/c2-client.0.100564.log.gz 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119607.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103191.log 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.119607.log.gz 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109419.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.109419.log.gz 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.99584.log 2023-12-16T00:05:17.475 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.103191.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88371.log 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.103191.log.gz 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99584.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108909.log 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99584.log.gz 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr: 97.0% -- replaced with /var/log/ceph/c2-client.0.111461.log.gz 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88371.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.115321.log 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88371.log.gz 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108909.log: gzip -5 --verbose -- /var/log/ceph/c2.log 2023-12-16T00:05:17.476 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108909.log.gz 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.115321.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88093.log 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.115321.log.gz 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87580.log 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88093.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c2.audit.log -- replaced with /var/log/ceph/c2-client.admin.88093.log.gz 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr: 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87580.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100830.log 2023-12-16T00:05:17.477 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87580.log.gz 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2.audit.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107592.log 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100830.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.100830.log.gz 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.91466.log 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.90920.log 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107592.log: 89.7% -- replaced with /var/log/ceph/c2.audit.log.gz 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr: 92.9% -- replaced with /var/log/ceph/c2-client.0.107592.log.gz 2023-12-16T00:05:17.478 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91466.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95914.log 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91466.log.gz 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.99128.log 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.90920.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.90920.log.gz 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95914.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103378.log 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.95914.log.gz 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99128.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100653.log 2023-12-16T00:05:17.479 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99128.log.gz 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose/var/log/ceph/c2-client.0.103378.log: -- /var/log/ceph/c2-client.0.96954.log 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.103378.log.gz 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100653.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90829.log 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr: 69.5% -- replaced with /var/log/ceph/c2-client.0.100653.log.gz 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96954.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116742.log 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.96954.log.gz 2023-12-16T00:05:17.480 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.90829.log: 89.3% -- replaced with /var/log/ceph/c2.log.gz 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.90641.log 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90829.log.gz 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116742.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109164.log 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr: 49.9% -- replaced with /var/log/ceph/c2-client.0.116742.log.gz 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.90641.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104260.log 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90641.log.gz 2023-12-16T00:05:17.481 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109164.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90732.log 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109164.log.gz 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104260.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95064.log 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr: 87.1% -- replaced with /var/log/ceph/c2-client.0.104260.log.gz 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.90732.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107228.log 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90732.log.gz 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95064.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98582.log 2023-12-16T00:05:17.482 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.95064.log.gz 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107228.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93079.log 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.107228.log.gz 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98582.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116651.log 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98582.log.gz 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93079.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83717.log 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.93079.log.gz 2023-12-16T00:05:17.483 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116651.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118605.log 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.116651.log.gz 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.83717.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.0.log 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83717.log.gz 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118605.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93995.log 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118605.log.gz 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ops-log-c2-client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118240.log 2023-12-16T00:05:17.484 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93995.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94619.log 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr: 50.4% -- replaced with /var/log/ceph/c2-client.0.93995.log.gz 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118240.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.118240.log.gz 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.95237.log 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94619.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106773.log 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.94619.log.gz 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95237.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.95237.log.gz 2023-12-16T00:05:17.485 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.113247.log 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106773.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.115406.log 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106773.log.gz 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113247.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113430.log 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113247.log.gz 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.115406.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87377.log 2023-12-16T00:05:17.486 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.115406.log.gz 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113430.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103469.log 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113430.log.gz 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87377.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97944.log 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87377.log.gz 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.103469.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.103469.log.gz 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.118879.log 2023-12-16T00:05:17.487 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97944.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91011.log 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.97944.log.gz 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118879.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100123.log 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118879.log.gz 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91011.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.106955.log 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91011.log.gz 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100123.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.100123.log.gz 2023-12-16T00:05:17.488 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119789.log 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106955.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93705.log 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106955.log.gz 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119789.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118970.log 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.119789.log.gz 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93705.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99402.log 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr: 77.0% -- replaced with /var/log/ceph/c2-client.0.93705.log.gz 2023-12-16T00:05:17.489 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118970.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94979.log 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118970.log.gz 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108009.log 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99402.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.99402.log.gz 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94979.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.0.94979.log.gz -5 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/c2-client.0.119243.log 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108009.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112610.log 2023-12-16T00:05:17.490 INFO:teuthology.orchestra.run.smithi188.stderr: 94.3% -- replaced with /var/log/ceph/c2-client.0.108009.log.gz 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119243.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87579.log 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.119243.log.gz 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112610.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94892.log 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112610.log.gz 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87579.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87579.log.gz 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.109589.log 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94892.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107908.log 2023-12-16T00:05:17.491 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.94892.log.gz 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109589.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/c2-client.0.109589.log.gz /var/log/ceph/c2-client.0.100213.log 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr: 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107908.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101271.log 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr: 92.7% -- replaced with /var/log/ceph/c2-client.0.107908.log.gz 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100213.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113704.log 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.100213.log.gz 2023-12-16T00:05:17.492 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101271.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105588.log 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.101271.log.gz 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113704.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87331.log 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113704.log.gz 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105588.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111556.log 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105588.log.gz 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87331.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119971.log 2023-12-16T00:05:17.493 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87331.log.gz 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111556.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.2.log 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.111556.log.gz 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119971.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110099.log 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr: 9.2% -- replaced with /var/log/ceph/c2-client.0.119971.log.gz 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93433.log 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110099.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.110099.log.gz 2023-12-16T00:05:17.494 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.112974.log 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.117625.log 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93433.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.93433.log.gz 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112974.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.112974.log.gz 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.94085.log 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.101890.log 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.117625.log: /var/log/ceph/c2-client.0.94085.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110694.log 2023-12-16T00:05:17.495 INFO:teuthology.orchestra.run.smithi188.stderr: 95.9% -- replaced with /var/log/ceph/c2-client.0.117625.log.gz 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr: 46.7% -- replaced with /var/log/ceph/c2-client.0.94085.log.gz 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101890.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114250.log 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.101890.log.gz 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110694.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87881.log 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110694.log.gz 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.114250.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107046.log 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.114250.log.gz 2023-12-16T00:05:17.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87881.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87881.log.gz 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108654.log 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.113612.log 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107046.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.107046.log.gz 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108654.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.89433.log 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108654.log.gz 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113612.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108314.log 2023-12-16T00:05:17.497 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113612.log.gz 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.110354.log 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.89433.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.89433.log.gz 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108314.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87289.log 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108314.log.gz 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110354.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.110354.log.gz 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.100030.log 2023-12-16T00:05:17.498 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.111204.log 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87289.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87289.log.gz 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100030.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117871.log 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.100030.log.gz 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111204.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.111204.log.gz 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.99037.log 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.111374.log 2023-12-16T00:05:17.499 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.117871.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.117871.log.gz 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.99037.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110949.log 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99037.log.gz 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111374.log: 0.0%gzip -- replaced with /var/log/ceph/c2-client.0.111374.log.gz 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.105952.log 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108484.log 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110949.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.110949.log.gz 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105952.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102159.log 2023-12-16T00:05:17.500 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105952.log.gz 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108484.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.108484.log.gz 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.102808.log 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87712.log 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102159.log: /var/log/ceph/c2-client.0.102808.log: 57.0% -- replaced with /var/log/ceph/c2-client.0.102159.log.gz 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr: 42.5% -- replaced with /var/log/ceph/c2-client.0.102808.log.gz 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.91735.log 2023-12-16T00:05:17.501 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98309.log 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87712.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87712.log.gz 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91735.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92723.log 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91735.log.gz 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98309.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.83791.log 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98309.log.gz 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.113795.log 2023-12-16T00:05:17.502 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92723.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.92723.log.gz 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.83791.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107319.log 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.83791.log.gz 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113795.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91193.log 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113795.log.gz 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.89615.log 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107319.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.107319.log.gz 2023-12-16T00:05:17.503 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91193.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.88600.log 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91193.log.gz 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.89615.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.89615.log.gz 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119698.log 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.102721.log 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.88600.log: /var/log/ceph/c2-client.0.119698.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.119698.log.gz 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr: 84.2% -- replaced with /var/log/ceph/c2-client.0.88600.log.gz 2023-12-16T00:05:17.504 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108124.log 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr: 94.9% -- replaced with /var/log/ceph/ops-log-c2-client.0.log.gz 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108824.log 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102721.log: 52.2% -- replaced with /var/log/ceph/c2-client.0.102721.log.gz 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108124.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88453.log 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/c2-client.0.108124.log.gz 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108824.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88535.log 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.108824.log.gz 2023-12-16T00:05:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/c2-client.admin.88453.log: -5 --verbose -- /var/log/ceph/c2-client.0.102634.log 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88453.log.gz 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88535.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119425.log 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88535.log.gz 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102634.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113521.log 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr: 57.0% -- replaced with /var/log/ceph/c2-client.0.102634.log.gz 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119425.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110184.log 2023-12-16T00:05:17.506 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.119425.log.gz 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113521.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.113521.log.gz 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.94354.log 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110184.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100915.log 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110184.log.gz 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94354.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104624.log 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr: 49.6% -- replaced with /var/log/ceph/c2-client.0.94354.log.gz 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100915.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107410.log 2023-12-16T00:05:17.507 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.100915.log.gz 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104624.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109844.log 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107410.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.118149.log 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.107410.log.gz 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109844.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88577.log 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109844.log.gz 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118149.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112519.log 2023-12-16T00:05:17.508 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.118149.log.gz 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98764.log 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88577.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88577.log.gz 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112519.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95322.log 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.112519.log.gz 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98764.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87189.log 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98764.log.gz 2023-12-16T00:05:17.509 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95322.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.95322.log.gz 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119061.log 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98127.log 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87189.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87189.log.gz 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119061.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109929.log 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.119061.log.gz 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98127.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96096.log 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98127.log.gz 2023-12-16T00:05:17.510 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109929.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94441.log 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109929.log.gz 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96096.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88133.log 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.96096.log.gz 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94441.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114341.log 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr: 51.0% -- replaced with /var/log/ceph/c2-client.0.94441.log.gz 2023-12-16T00:05:17.511 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88133.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113065.log 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88133.log.gz 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.114341.log: gzip -5 --verbose -- 41.9% /var/log/ceph/c2-client.0.94172.log 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr: -- replaced with /var/log/ceph/c2-client.0.114341.log.gz 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113065.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87575.log 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr: 96.3% -- replaced with /var/log/ceph/c2-client.0.104624.log.gz 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.113065.log.gz 2023-12-16T00:05:17.512 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94172.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.94172.log.gz 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.94263.log 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87575.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95730.log 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87575.log.gz 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94263.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116293.log 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.94263.log.gz 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95730.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87578.log 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.95730.log.gz 2023-12-16T00:05:17.513 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116293.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108229.log 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr: 90.3% -- replaced with /var/log/ceph/c2-client.0.116293.log.gz 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87578.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97761.log 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87578.log.gz 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108229.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.108229.log.gz 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.104446.log 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97761.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111289.log 2023-12-16T00:05:17.514 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.97761.log.gz 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104446.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101536.log 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.104446.log.gz 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111289.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110269.log 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.111289.log.gz 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101536.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.101536.log.gz 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.92457.log 2023-12-16T00:05:17.515 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110269.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114159.log 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110269.log.gz 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92457.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91557.log 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr: 53.3% -- replaced with /var/log/ceph/c2-client.0.92457.log.gz 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.114159.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110609.log 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.114159.log.gz 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.91557.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119152.log 2023-12-16T00:05:17.516 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91557.log.gz 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110609.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.96370.log 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110609.log.gz 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.119152.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102246.log 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.119152.log.gz 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96370.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97386.log 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.96370.log.gz 2023-12-16T00:05:17.517 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102246.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.102246.log.gz 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.100390.log 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97386.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.92814.log 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr: 13.6% -- replaced with /var/log/ceph/c2-client.0.97386.log.gz 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100390.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93798.log 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr: 57.9% -- replaced with /var/log/ceph/c2-client.0.100390.log.gz 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.92814.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.89516.log 2023-12-16T00:05:17.518 INFO:teuthology.orchestra.run.smithi188.stderr: 50.7% -- replaced with /var/log/ceph/c2-client.0.92814.log.gz 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93798.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97116.log 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.93798.log.gz 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.89516.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105770.log 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.89516.log.gz 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97116.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88033.log 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.97116.log.gz 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105770.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101006.log 2023-12-16T00:05:17.519 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105770.log.gz 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88033.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88033.log.gz 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88495.log 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101006.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87993.log 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr: 57.5% -- replaced with /var/log/ceph/c2-client.0.101006.log.gz 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88495.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88495.log.gz 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.102068.log 2023-12-16T00:05:17.520 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87993.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107794.log 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87993.log.gz 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.102068.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.102068.log.gz 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.0.log 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107794.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.112341.log 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr: 94.4% -- replaced with /var/log/ceph/c2-client.0.107794.log.gz 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/rgw.c2.client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101180.log 2023-12-16T00:05:17.521 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.114068.log 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.112341.log: 66.5% -- replaced with /var/log/ceph/c2-client.0.112341.log.gz 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101180.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98855.log 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.101180.log.gz 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.114068.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110524.log 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.114068.log.gz 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98855.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.101803.log 2023-12-16T00:05:17.522 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98855.log.gz 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110524.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93346.log 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110524.log.gz 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101803.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113338.log 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr: 49.9% -- replaced with /var/log/ceph/c2-client.0.101803.log.gz 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.93346.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109079.log 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr: 50.1% -- replaced with /var/log/ceph/c2-client.0.93346.log.gz 2023-12-16T00:05:17.523 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113338.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100740.log 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113338.log.gz 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109079.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95152.log 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.109079.log.gz 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.100740.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.100740.log.gz 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.113886.log 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.96005.log 2023-12-16T00:05:17.524 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95152.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.95152.log.gz 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.113886.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107501.log 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.113886.log.gz 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96005.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110014.log 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.96005.log.gz 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.101626.log 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.107501.log: 66.0% -- replaced with /var/log/ceph/c2-client.0.107501.log.gz 2023-12-16T00:05:17.525 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.110014.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.89762.log 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110014.log.gz 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.101626.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.101626.log.gz 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.96187.log 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.106498.log 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.89762.log: 17.8% -- replaced with /var/log/ceph/c2-client.0.89762.log.gz 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96187.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109504.log 2023-12-16T00:05:17.526 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.96187.log.gz 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.106498.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117780.log 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106498.log.gz 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.116385.log 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.109504.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.109504.log.gz 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.117780.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88245.log 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.117780.log.gz 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.116385.log: 0.0%gzip -- replaced with /var/log/ceph/c2-client.0.116385.log.gz 2023-12-16T00:05:17.527 INFO:teuthology.orchestra.run.smithi188.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.103013.log 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.96452.log 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88245.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88245.log.gz 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.103013.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95574.log 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.103013.log.gz 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.96452.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/c2-client.0.96452.log.gz -- 2023-12-16T00:05:17.528 INFO:teuthology.orchestra.run.smithi188.stderr: /var/log/ceph/c2-client.0.89680.log 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.105861.log 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95574.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.95574.log.gz 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.89680.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.87581.log 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.89680.log.gz 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.105861.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.0.log 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.105861.log.gz 2023-12-16T00:05:17.529 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98400.log 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87581.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87581.log.gz 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.104355.log 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98400.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.120058.log 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98400.log.gz 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.104355.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.98218.log 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.104355.log.gz 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.120058.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.1.log 2023-12-16T00:05:17.530 INFO:teuthology.orchestra.run.smithi188.stderr: 8.2% -- replaced with /var/log/ceph/c2-client.0.120058.log.gz 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.115231.log 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.98218.log: /var/log/ceph/c2-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.119880.log 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98218.log.gz 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5/var/log/ceph/c2-client.0.115231.log: --verbose -- /var/log/ceph/c2-client.0.111034.log 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.115231.log.gz/var/log/ceph/c2-client.0.119880.log: 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.119880.log.gz 2023-12-16T00:05:17.531 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.118514.log 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.111034.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.111034.log.gz 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80295.log 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.118514.log: gzip -5 --verbose -- 47.4% /var/log/ceph/c2-client.0.91375.log 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr: -- replaced with /var/log/ceph/c2-client.0.118514.log.gz 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.tmp-client.admin.80295.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93255.log 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80295.log.gz 2023-12-16T00:05:17.532 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose/var/log/ceph/c2-client.0.91375.log: -- /var/log/ceph/c2-client.admin.87821.log 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.91375.log.gz/var/log/ceph/c2-client.0.93255.log: 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1%gzip -5 --verbose -- /var/log/ceph/c2-client.0.97289.log 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr: -- replaced with /var/log/ceph/c2-client.0.93255.log.gz 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.87821.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95407.log 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.87821.log.gz 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5/var/log/ceph/c2-client.0.97289.log: --verbose -- /var/log/ceph/c2-client.0.94528.log 2023-12-16T00:05:17.533 INFO:teuthology.orchestra.run.smithi188.stderr: 19.1% -- replaced with /var/log/ceph/c2-client.0.97289.log.gz 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.95407.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.95407.log.gz 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98673.log 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.88285.log 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.94528.log: /var/log/ceph/c2-client.0.98673.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97207.log 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.94528.log.gz 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.98673.log.gz 2023-12-16T00:05:17.534 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.admin.88285.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.88285.log.gz 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.99219.log 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108399.log 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.97207.log: /var/log/ceph/c2-client.0.99219.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108739.log 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.97207.log.gz 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99219.log.gz 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108399.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.108399.log.gz 2023-12-16T00:05:17.535 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/c2-client.0.108739.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.108739.log.gz 2023-12-16T00:05:17.536 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/c1-mgr.x.log.gz 2023-12-16T00:05:18.316 INFO:teuthology.orchestra.run.smithi188.stderr: 91.6% -- replaced with /var/log/ceph/c2-mon.a.log.gz 2023-12-16T00:05:18.647 INFO:teuthology.orchestra.run.smithi093.stderr: 91.5% -- replaced with /var/log/ceph/c1-mon.a.log.gz 2023-12-16T00:05:20.170 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/rgw.c2.client.0.log.gz 2023-12-16T00:05:20.865 INFO:teuthology.orchestra.run.smithi093.stderr: 93.6% -- replaced with /var/log/ceph/rgw.c1.client.0.log.gz 2023-12-16T00:05:23.303 INFO:teuthology.orchestra.run.smithi188.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.0.log.gz 2023-12-16T00:05:23.997 INFO:teuthology.orchestra.run.smithi188.stderr: 93.7% -- replaced with /var/log/ceph/c2-osd.2.log.gz 2023-12-16T00:05:24.098 INFO:teuthology.orchestra.run.smithi188.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.1.log.gz 2023-12-16T00:05:24.100 INFO:teuthology.orchestra.run.smithi188.stderr: 2023-12-16T00:05:24.100 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m7.041s 2023-12-16T00:05:24.101 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m23.426s 2023-12-16T00:05:24.101 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m1.028s 2023-12-16T00:05:24.306 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/c2-osd.3.log.gz 2023-12-16T00:05:25.013 INFO:teuthology.orchestra.run.smithi192.stderr: 93.7% -- replaced with /var/log/ceph/c2-osd.4.log.gz 2023-12-16T00:05:25.358 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/c2-osd.5.log.gz 2023-12-16T00:05:25.359 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-12-16T00:05:25.360 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m8.298s 2023-12-16T00:05:25.360 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m22.924s 2023-12-16T00:05:25.360 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.819s 2023-12-16T00:05:25.497 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/c1-osd.3.log.gz 2023-12-16T00:05:25.769 INFO:teuthology.orchestra.run.smithi093.stderr: 93.8% -- replaced with /var/log/ceph/c1-osd.1.log.gz 2023-12-16T00:05:26.083 INFO:teuthology.orchestra.run.smithi183.stderr: 93.8% -- replaced with /var/log/ceph/c1-osd.4.log.gz 2023-12-16T00:05:26.301 INFO:teuthology.orchestra.run.smithi093.stderr: 93.8% -- replaced with /var/log/ceph/c1-osd.2.log.gz 2023-12-16T00:05:26.586 INFO:teuthology.orchestra.run.smithi093.stderr: 94.0% -- replaced with /var/log/ceph/c1-osd.0.log.gz 2023-12-16T00:05:26.589 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-16T00:05:26.589 INFO:teuthology.orchestra.run.smithi093.stderr:real 0m9.537s 2023-12-16T00:05:26.589 INFO:teuthology.orchestra.run.smithi093.stderr:user 0m31.639s 2023-12-16T00:05:26.589 INFO:teuthology.orchestra.run.smithi093.stderr:sys 0m1.189s 2023-12-16T00:05:28.354 INFO:teuthology.orchestra.run.smithi183.stderr: 94.1% -- replaced with /var/log/ceph/c1-osd.5.log.gz 2023-12-16T00:05:28.356 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-12-16T00:05:28.356 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m11.299s 2023-12-16T00:05:28.356 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m28.050s 2023-12-16T00:05:28.356 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m1.031s 2023-12-16T00:05:28.357 INFO:tasks.ceph:Archiving logs... 2023-12-16T00:05:28.357 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi093/log 2023-12-16T00:05:28.358 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T00:05:33.339 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi183/log 2023-12-16T00:05:33.340 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T00:05:37.705 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi188/log 2023-12-16T00:05:37.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T00:05:41.616 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi192/log 2023-12-16T00:05:41.617 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T00:05:45.247 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T00:05:45.257 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2023-12-16T00:05:45.261 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T00:05:45.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T00:05:45.264 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T00:05:45.267 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T00:05:45.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T00:05:45.400 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T00:05:45.410 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T00:05:45.410 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T00:05:45.413 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T00:05:45.415 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T00:05:45.418 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T00:05:45.427 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 1: ntpq: command not found 2023-12-16T00:05:45.429 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-12-16T00:05:45.431 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T00:05:45.431 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-16T00:05:45.432 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 59 +77us[ +61us] +/- 96ms 2023-12-16T00:05:45.432 INFO:teuthology.orchestra.run.smithi093.stdout:^* hv02.front.sepia.ceph.com 3 7 377 58 -434us[ -450us] +/- 62ms 2023-12-16T00:05:45.432 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 56 +560us[ +560us] +/- 76ms 2023-12-16T00:05:45.432 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T00:05:45.433 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2023-12-16T00:05:45.434 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T00:05:45.434 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-12-16T00:05:45.434 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 125 +44us[ +44us] +/- 95ms 2023-12-16T00:05:45.434 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv02.front.sepia.ceph.com 3 9 377 311 -463us[ -468us] +/- 58ms 2023-12-16T00:05:45.434 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 119 +515us[ +515us] +/- 75ms 2023-12-16T00:05:45.435 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T00:05:45.435 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2023-12-16T00:05:45.437 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T00:05:45.438 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-12-16T00:05:45.438 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 61 +82us[ +75us] +/- 96ms 2023-12-16T00:05:45.438 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv02.front.sepia.ceph.com 3 7 377 55 -443us[ -450us] +/- 62ms 2023-12-16T00:05:45.438 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 62 +534us[ +527us] +/- 76ms 2023-12-16T00:05:45.438 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T00:05:45.439 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T00:05:45.439 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-12-16T00:05:45.439 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 53 +50us[ +50us] +/- 96ms 2023-12-16T00:05:45.440 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv02.front.sepia.ceph.com 3 8 377 186 -440us[ -441us] +/- 60ms 2023-12-16T00:05:45.440 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 63 +525us[ +525us] +/- 76ms 2023-12-16T00:05:45.440 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T00:05:45.440 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T00:05:45.450 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T00:05:45.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T00:05:45.459 DEBUG:teuthology.orchestra.run.smithi093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T00:05:45.574 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T00:05:45.672 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T00:05:45.771 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T00:05:45.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T00:05:45.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:45.904 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T00:05:45.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:45.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T00:05:45.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:45.972 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T00:05:46.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:46.005 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T00:05:46.055 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T00:05:46.065 INFO:teuthology.task.internal:Duration was 4969.612713 seconds 2023-12-16T00:05:46.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T00:05:46.074 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T00:05:46.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T00:05:46.076 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T00:05:46.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T00:05:46.081 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T00:05:46.120 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T00:05:46.122 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T00:05:46.122 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T00:05:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T00:05:46.440 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T00:05:46.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-12-16T00:05:46.441 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T00:05:46.462 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-12-16T00:05:46.462 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T00:05:46.489 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2023-12-16T00:05:46.490 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T00:05:46.510 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-12-16T00:05:46.510 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T00:05:46.531 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T00:05:46.531 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T00:05:46.534 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T00:05:46.536 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T00:05:46.553 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T00:05:46.599 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T00:05:46.599 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T00:05:46.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T00:05:46.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T00:05:46.622 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T00:05:46.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T00:05:46.769 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T00:05:46.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T00:05:46.797 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T00:05:46.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T00:05:46.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T00:05:46.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T00:05:46.893 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:46.895 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:46.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:46.900 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:46.918 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-12-16T00:05:46.921 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-12-16T00:05:46.923 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2023-12-16T00:05:46.943 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-12-16T00:05:46.998 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:47.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:47.012 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:47.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:47.052 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:47.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:47.066 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T00:05:47.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:47.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T00:05:47.092 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T00:05:47.093 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi093 2023-12-16T00:05:47.093 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T00:05:47.128 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi183 2023-12-16T00:05:47.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T00:05:47.163 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi188 2023-12-16T00:05:47.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T00:05:47.198 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342/remote/smithi192 2023-12-16T00:05:47.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T00:05:47.234 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T00:05:47.234 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T00:05:47.236 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T00:05:47.238 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T00:05:47.241 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T00:05:47.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T00:05:47.295 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T00:05:47.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T00:05:47.307 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T00:05:47.307 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T00:05:47.309 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T00:05:47.311 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T00:05:47.313 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T00:05:47.321 INFO:teuthology.orchestra.run.smithi093.stdout: 265245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 00:05 /home/ubuntu/cephtest 2023-12-16T00:05:47.323 INFO:teuthology.orchestra.run.smithi183.stdout: 265984 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 00:05 /home/ubuntu/cephtest 2023-12-16T00:05:47.325 INFO:teuthology.orchestra.run.smithi188.stdout: 265244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 00:05 /home/ubuntu/cephtest 2023-12-16T00:05:47.337 INFO:teuthology.orchestra.run.smithi192.stdout: 265895 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 00:05 /home/ubuntu/cephtest 2023-12-16T00:05:47.338 INFO:teuthology.orchestra.run.smithi192.stdout: 265321 0 srwxr-xr-x 1 root root 0 Dec 15 22:53 /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock 2023-12-16T00:05:47.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T00:05:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-16T00:05:47.339 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_e787ab71a54a65a1c318d8bb7b1e65f35409fcd9/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-16T00:05:47.352 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T00:05:47.368 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T00:05:47.394 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi188 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2023-12-16T00:05:47.394 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T00:05:47.425 DEBUG:teuthology.nuke:shortname: smithi093 2023-12-16T00:05:47.425 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:05:47.449 DEBUG:teuthology.nuke:shortname: smithi183 2023-12-16T00:05:47.450 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:05:47.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.995171', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTkSOV80tJk85dkV8F5PRsO6fi64MovGnV7hV3dDBO4DaKTO97r0g9H9hvqss8awoXMTdhDInHUZ7dnzFDH68g='} 2023-12-16T00:05:47.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.993096', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXg1PuUOpLyPc+kU9XLJlFkTsEj5Zhzl2NxipOMVIhhYH5Epow/wtZAh5ghI6PVAo+qb+3MZTv9QWu6gJWLuEI='} 2023-12-16T00:05:47.477 DEBUG:teuthology.nuke:shortname: smithi188 2023-12-16T00:05:47.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:05:47.498 DEBUG:teuthology.nuke:shortname: smithi192 2023-12-16T00:05:47.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:05:47.502 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.996359', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzekXi9h3/MUFBU2UQZ7W94HhOodc/o+NbksKUAvvdCscx2OIzXTPDVq26QcSiz7Kug++81lhm9RHqFHhSx8r0='} 2023-12-16T00:05:47.513 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-16T00:05:47.513 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:05:47.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-15_22:32:14-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7493342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:34:09.997522', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLkkrrjNNiylYVct9T7DdexgtF0FBcoy72e6vlrR88zR4RNLA2bKY4BfIJB9kgkPtZFLtQ90ihqWgfs1+Sckyg='} 2023-12-16T00:05:47.540 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-16T00:05:47.540 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:47.562 INFO:teuthology.orchestra.console.smithi183:Power off 2023-12-16T00:05:47.562 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:05:47.575 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-16T00:05:47.585 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-12-16T00:05:47.586 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:47.605 INFO:teuthology.orchestra.console.smithi192:Power off 2023-12-16T00:05:47.605 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:05:47.621 INFO:teuthology.orchestra.console.smithi188:Power off 2023-12-16T00:05:47.621 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:05:47.632 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-12-16T00:05:47.632 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-12-16T00:05:47.632 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:47.648 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-12-16T00:05:47.648 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:47.660 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-12-16T00:05:47.675 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-12-16T00:05:51.576 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:51.633 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:51.661 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:51.676 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:51.691 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-16T00:05:51.746 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-12-16T00:05:51.773 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-12-16T00:05:51.787 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-12-16T00:05:55.696 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:55.747 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:55.773 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:55.787 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:55.811 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-16T00:05:55.859 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-12-16T00:05:55.884 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-12-16T00:05:55.899 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-12-16T00:05:55.912 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-16T00:05:55.960 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-12-16T00:05:59.885 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:59.900 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:05:59.999 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-12-16T00:06:00.012 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-12-16T00:06:00.101 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-12-16T00:06:00.113 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-12-16T00:06:00.218 INFO:teuthology.run:Summary data: description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} duration: 4969.612712621689 failure_reason: rgw multisite test failures flavor: default owner: scheduled_smanjara@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8067ac8a33f64ef5afba66075054b485 status: fail success: false 2023-12-16T00:06:00.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:06:00.291 INFO:teuthology.run:FAIL